-- Logs begin at Tue 2022-08-02 05:54:52 UTC, end at Tue 2022-08-02 08:34:09 UTC. -- Aug 02 06:35:32.631280 n-d-851337-3 systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 06:35:32.642612 n-d-851337-3 devstack@n-api.service[110835]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 06:35:32.645224 n-d-851337-3 devstack@n-api.service[110835]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 06:35:32 2022] *** Aug 02 06:35:32.645224 n-d-851337-3 devstack@n-api.service[110835]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 06:35:32.645224 n-d-851337-3 devstack@n-api.service[110835]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 06:35:32.645224 n-d-851337-3 devstack@n-api.service[110835]: nodename: n-d-851337-3 Aug 02 06:35:32.645224 n-d-851337-3 devstack@n-api.service[110835]: machine: x86_64 Aug 02 06:35:32.645224 n-d-851337-3 devstack@n-api.service[110835]: clock source: unix Aug 02 06:35:32.645224 n-d-851337-3 devstack@n-api.service[110835]: pcre jit disabled Aug 02 06:35:32.645224 n-d-851337-3 devstack@n-api.service[110835]: detected number of CPU cores: 4 Aug 02 06:35:32.645224 n-d-851337-3 devstack@n-api.service[110835]: current working directory: / Aug 02 06:35:32.645224 n-d-851337-3 devstack@n-api.service[110835]: detected binary path: /usr/bin/uwsgi-core Aug 02 06:35:32.645827 n-d-851337-3 devstack@n-api.service[110835]: your processes number limit is 47680 Aug 02 06:35:32.645827 n-d-851337-3 devstack@n-api.service[110835]: your memory page size is 4096 bytes Aug 02 06:35:32.645827 n-d-851337-3 devstack@n-api.service[110835]: detected max file descriptor number: 2048 Aug 02 06:35:32.645827 n-d-851337-3 devstack@n-api.service[110835]: lock engine: pthread robust mutexes Aug 02 06:35:32.646109 n-d-851337-3 devstack@n-api.service[110835]: thunder lock: enabled Aug 02 06:35:32.646109 n-d-851337-3 devstack@n-api.service[110835]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 06:35:32.646261 n-d-851337-3 devstack@n-api.service[110835]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 06:35:32.686535 n-d-851337-3 devstack@n-api.service[110835]: Python main interpreter initialized at 0x56005d4d89c0 Aug 02 06:35:32.686535 n-d-851337-3 devstack@n-api.service[110835]: python threads support enabled Aug 02 06:35:32.686535 n-d-851337-3 devstack@n-api.service[110835]: your server socket listen backlog is limited to 100 connections Aug 02 06:35:32.686535 n-d-851337-3 devstack@n-api.service[110835]: your mercy for graceful operations on workers is 90 seconds Aug 02 06:35:32.686948 n-d-851337-3 devstack@n-api.service[110835]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 06:35:32.686948 n-d-851337-3 devstack@n-api.service[110835]: *** Operational MODE: preforking *** Aug 02 06:35:32.687250 n-d-851337-3 devstack@n-api.service[110835]: *** uWSGI is running in multiple interpreter mode *** Aug 02 06:35:32.687250 n-d-851337-3 devstack@n-api.service[110835]: spawned uWSGI master process (pid: 110835) Aug 02 06:35:32.687453 n-d-851337-3 systemd[1]: Started Devstack devstack@n-api.service. Aug 02 06:35:32.689767 n-d-851337-3 devstack@n-api.service[110835]: spawned uWSGI worker 1 (pid: 110838, cores: 1) Aug 02 06:35:32.690593 n-d-851337-3 devstack@n-api.service[110835]: spawned uWSGI worker 2 (pid: 110839, cores: 1) Aug 02 06:35:32.690593 n-d-851337-3 devstack@n-api.service[110835]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 06:35:33.349973 n-d-851337-3 devstack@n-api.service[110839]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 06:35:33.350599 n-d-851337-3 devstack@n-api.service[110838]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 06:35:34.413390 n-d-851337-3 devstack@n-api.service[110838]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 06:35:34.413390 n-d-851337-3 devstack@n-api.service[110838]: from cryptography.utils import int_from_bytes Aug 02 06:35:34.414170 n-d-851337-3 devstack@n-api.service[110838]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 06:35:34.414170 n-d-851337-3 devstack@n-api.service[110838]: from cryptography.utils import int_from_bytes Aug 02 06:35:34.421146 n-d-851337-3 devstack@n-api.service[110839]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 06:35:34.421146 n-d-851337-3 devstack@n-api.service[110839]: from cryptography.utils import int_from_bytes Aug 02 06:35:34.421605 n-d-851337-3 devstack@n-api.service[110839]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 06:35:34.421605 n-d-851337-3 devstack@n-api.service[110839]: from cryptography.utils import int_from_bytes Aug 02 06:35:36.873253 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 06:35:36.873720 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 06:35:36.874048 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 06:35:36.874194 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 06:35:36.874564 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 06:35:36.874662 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 06:35:36.874743 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 06:35:36.874899 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 06:35:36.875004 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.875301 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 06:35:36.875443 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.875540 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 06:35:36.875622 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.875913 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.876044 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.876238 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.876352 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.876503 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.876641 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.876817 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.876915 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.877129 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.877247 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.877434 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.877529 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.877686 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.877775 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.878017 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.878107 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.878334 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851337-3 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.878428 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.878624 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.878733 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.878934 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.879019 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.879238 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.879324 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851337-3 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.879545 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.879644 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.879843 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.879930 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.880152 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.880259 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.880446 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.880542 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.880748 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.880938 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.881064 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.882141 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.882253 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.882253 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.882377 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.882453 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.882527 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.882600 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.882678 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.882746 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.882816 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.882881 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.883073 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.883163 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.883377 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.883473 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.883678 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.883767 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.883989 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.884084 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.884297 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.884423 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851337-3 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.884614 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.884736 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.884918 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.885052 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.885329 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851337-3 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.885494 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.885693 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.885801 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.886000 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.886106 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.886297 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.886399 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.886666 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.886781 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.886973 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.887563 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.887768 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.887983 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.887983 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.888313 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.888313 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.888574 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.888574 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.888723 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.888862 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.888968 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.889161 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.889255 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.889466 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.889552 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.889770 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.889865 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.890096 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.890246 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.890394 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.890494 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.890691 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.890786 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.890935 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.891023 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.891237 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.891336 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.891553 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.891733 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.891818 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.891902 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.892101 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.892188 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.892406 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.892502 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.892651 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.892738 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.892961 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.893057 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.893260 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.893347 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.893507 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.893605 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.893823 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.893942 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.894168 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.894262 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.894478 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.894578 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.894771 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.894868 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.895073 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.895165 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.895382 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.895480 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.895683 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.895783 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.895988 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.896078 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.896290 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.896379 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.896593 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.896697 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.896893 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.896990 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.897201 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.897297 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.897519 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.897617 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.897821 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.897934 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.898148 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.898238 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.898480 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.898583 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.898771 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.898866 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.899079 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.899169 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.899390 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.899478 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.899708 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.899797 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.900013 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.900116 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.900317 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.900473 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.900620 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.900714 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.900923 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.901022 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.901228 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.901321 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.901530 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.901628 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.901776 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.901881 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.902111 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.902204 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.902411 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.902518 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.902713 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.902811 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.903009 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.903108 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.903308 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.903398 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.903607 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.903707 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.903959 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.904058 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.904293 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.904430 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.904563 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.904677 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.904891 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.905024 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.905194 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.905330 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.905477 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.905637 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.905769 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.905865 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.906120 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.906255 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.906374 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.906468 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.906667 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.906776 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.906968 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.907063 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.907268 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.907363 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.907564 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.907656 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.907865 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.907959 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.908166 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.908269 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.908464 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.908558 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.908761 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.908854 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.909062 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.909156 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.909359 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.909453 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.909672 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.909764 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.910063 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.910166 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.910290 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.910374 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.910601 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.910688 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.910898 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.910998 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.911197 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.911285 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.911505 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.911592 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.911797 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.911890 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.912118 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.912206 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.912399 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.912486 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.912693 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.912791 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.912989 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.913073 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.913284 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.913384 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.913657 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.913805 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.913970 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.914104 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.914233 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.914367 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.914490 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.914618 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.914740 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.914860 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.915024 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.915163 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.915337 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.915459 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.915636 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.915773 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.915929 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.916062 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.916224 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.916346 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.916520 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.916643 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.916829 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.916959 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.917131 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.917256 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.917430 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.917554 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.917790 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:35:36.917957 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.918147 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.918271 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.918472 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.918596 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.918797 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.918922 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.919108 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.919229 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.919435 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.919559 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.919746 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.919870 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.920066 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.920199 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.920371 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.920507 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.920671 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.920793 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.920979 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.921103 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.921285 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.921420 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.921591 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.921717 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.921922 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.922050 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.922232 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.922368 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.922543 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.922667 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.922854 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.922978 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.923160 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.923297 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.923471 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.923596 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.923797 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.923938 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.924093 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.924231 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.924396 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.924517 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.924718 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.924841 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.925035 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.925167 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.925349 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.925473 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.925669 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.925792 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.926008 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.926142 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.926315 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.926440 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.926621 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.926745 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.926924 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.927062 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.927312 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.927438 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.927566 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.927688 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.927817 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.927946 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.928125 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.928250 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.928435 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.928564 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.928744 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.928870 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.929053 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.929176 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.929357 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.929491 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.929664 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.929804 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.929983 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.930107 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.930292 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.930430 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.930601 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.930719 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.930905 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.931028 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.931214 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.931346 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.931521 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.931645 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.931828 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.931985 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.932134 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.932270 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.932433 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.932560 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.932731 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.932855 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.933029 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.933154 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.933329 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.933451 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.933624 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.933746 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.933947 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.934090 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.934249 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.934374 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.934549 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.934674 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.934867 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.935002 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.935246 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.935373 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.935550 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.935683 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.935855 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.935985 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.936162 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.936286 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.936464 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.936596 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.936770 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.936894 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.937075 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.937197 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.937379 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.937532 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.937683 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.937830 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.938004 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.938126 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.938293 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.938428 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.938610 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.938741 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.938908 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.939032 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.939246 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.939380 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.939502 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.939622 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.939787 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.939922 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.940127 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.940249 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.940376 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.940505 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.940674 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.940791 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.940984 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.941123 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.941289 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.941417 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.941592 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.941715 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.941920 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.942047 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.942237 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.942372 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.942535 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.942669 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.942850 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.942973 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.943165 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.943288 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.943461 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.943585 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.943756 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.943879 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.944058 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.944182 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.944352 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.944484 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.944649 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.944773 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.944944 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.945068 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.945247 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.945384 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.945538 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.945695 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.945816 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.945954 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.946144 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.946280 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.946442 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.946565 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.946739 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.946869 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.947038 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.947164 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.947336 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.947474 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.947670 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.947802 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.947933 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.948055 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.948197 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.948322 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.948511 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.948633 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.948812 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.948936 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.949111 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.949235 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.949448 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.949580 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.949747 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.949871 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.950084 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.950208 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.950396 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.950529 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.950732 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.950919 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.951042 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.951246 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.951637 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.951779 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.951903 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.952022 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.952150 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.952279 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.952400 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.952530 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.952659 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.952780 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.952900 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.953031 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.953164 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.953329 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.953462 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.953636 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.953760 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.953971 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.954113 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.954280 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.954412 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.954598 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.954724 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.954905 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.955048 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.955226 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.955350 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.955527 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.955652 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.955838 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.955969 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.956144 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.956268 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.956450 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.956581 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.956752 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.956888 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.957054 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.957178 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.957357 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.957481 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.957664 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.957795 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.957995 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.958097 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.958298 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.958408 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.958601 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.958697 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.958903 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.958997 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.959214 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.959308 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.959516 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.959619 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.959825 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.959928 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.960126 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.960221 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.960432 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.960527 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.960736 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.960830 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.961048 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.961144 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.961345 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.961441 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.961647 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.961741 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.961982 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.962080 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.962287 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.962383 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.962588 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.962685 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.962897 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.963002 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.963203 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.963361 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.963501 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.963635 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.963794 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.963938 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.964098 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.964233 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.964397 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.964532 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.964695 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.964838 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.964992 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.965134 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.965297 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.965441 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.965596 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.965747 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.965880 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.965997 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.966201 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.966376 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.966566 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.966691 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.966870 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.967004 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.967171 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.967296 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.967470 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.967596 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.967812 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.967947 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.968068 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.968189 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.968392 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.968523 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.968655 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.968776 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.968937 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.969061 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.969234 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.969367 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.969535 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.969661 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.969835 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.970040 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.970172 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.970295 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.970461 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.970586 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.970762 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.970902 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.971108 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.971241 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.971364 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.971484 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.971673 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.971807 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.971974 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.972097 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.972277 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.972400 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.972592 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.972727 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.972888 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.973019 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.973194 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.973323 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.973499 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.973623 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.973801 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.973945 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.974127 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.974264 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.974439 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.974565 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.974747 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.974879 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.975051 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.975181 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.975353 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.975477 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.975656 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.975784 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.975959 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.976083 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.976252 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.976383 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.976554 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.976679 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.976857 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.976988 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.977163 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.977415 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.977539 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.977740 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.977983 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.978124 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.978248 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.978377 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.978626 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.978752 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.978959 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.979098 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.979273 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.979397 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.979589 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.979714 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.979907 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.980040 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.980209 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.980340 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.980515 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.980639 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.980813 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.980937 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.981112 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.981251 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.981419 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.981554 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.981717 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.981845 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.982058 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.982196 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.982357 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.982489 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.982661 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.982782 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.982956 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.983100 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.983254 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.983379 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.983551 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.983680 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.983847 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.983971 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.984142 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.984264 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.984437 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.984560 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.984739 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.984862 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.985038 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.985169 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.985353 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.985477 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.985651 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.985775 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.985968 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.986096 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.986268 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.986394 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.986563 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.986688 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.986875 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.987005 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.987174 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.987307 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.987475 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.987598 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.987774 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.987897 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.988112 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.988248 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.988399 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.988524 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.988697 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.988820 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.989014 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.989149 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.989311 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.989436 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.989611 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.989736 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.989926 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.990061 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.990232 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.990345 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.990539 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.990670 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.990838 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.990969 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.991133 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.991264 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.991433 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.991556 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.991754 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.991877 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.992004 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.992124 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.992302 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.992424 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.992603 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.992726 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.992895 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.993017 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.993196 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.993317 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.993493 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.993618 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.993785 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.993926 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.994102 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.994244 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.994404 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.994538 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.994706 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.994831 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.994999 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.995132 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.995299 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.995422 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.995592 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.995714 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.995893 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.996024 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.996185 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.996307 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.996482 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.996614 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.996777 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.996907 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.997076 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.997262 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.997386 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.997743 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.997876 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.998154 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.998356 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.998485 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.998678 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.998914 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.999052 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.999265 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.999483 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.999607 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:36.999846 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.000057 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.000190 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.000456 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.000579 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.000766 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.001065 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.001187 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.001368 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.001665 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.001795 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.001982 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.002280 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.002413 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.002581 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.002830 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.002955 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.003156 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.003372 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.003514 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.003733 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.003891 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.004037 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.004199 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.004333 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.004464 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.004621 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.004762 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.004912 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.005035 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.005200 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.005334 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.005495 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.005633 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.005827 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.006021 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.006189 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.006340 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.006487 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.006611 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.006773 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.006913 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.007083 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.007215 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.007392 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.007524 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.007698 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.007824 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.007998 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.008122 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.008313 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.008497 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.008655 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.008804 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.008943 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.009072 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.009204 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.009357 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.009494 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.009639 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.009772 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.009947 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.010077 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.010196 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.010372 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.010579 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.010723 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.010865 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.010998 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.011131 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.011264 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.011410 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.011553 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.011698 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.011867 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.012350 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.012522 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.012659 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.012826 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.012978 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.013140 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.013272 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.013448 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.013601 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.013752 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.013884 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.014065 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.014152 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.014368 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.014457 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.014671 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.014756 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.014975 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.015068 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.015281 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.015370 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.015584 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.015668 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.015883 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.015968 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.016187 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.016280 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.016489 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.016574 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.016784 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.016869 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.017091 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.017176 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.017395 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.017480 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.017695 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.017789 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.018023 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.018113 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.018321 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.018420 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.018628 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.018742 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.018921 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.019007 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.019230 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.019339 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.019539 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.019634 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.019847 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.019942 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.020152 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.020238 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.020459 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.020558 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.020765 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.020852 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.021066 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.021154 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.021388 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.021476 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.021684 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.021769 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.022007 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.022095 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.022317 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.022406 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.022628 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.022714 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.022932 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.023018 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.023238 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.023366 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.023545 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.023670 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.023848 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.023972 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.024163 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.024288 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.024458 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.024582 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.024754 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.024891 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.025050 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.025173 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.025360 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.025484 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.025658 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.025791 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.025992 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.026118 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.026399 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.026522 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.026708 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.026841 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.027004 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.027127 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.027335 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.027467 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.027640 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.027774 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.027942 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.028061 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.028248 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.028372 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.028569 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.028801 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.028953 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.029079 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.029200 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.029327 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.029497 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.029624 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.029817 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.029977 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.030146 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.030271 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.030464 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.030589 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.030772 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.030895 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.031080 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.031206 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.031376 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.031521 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.031722 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.031847 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.032020 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.032151 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.032299 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.032424 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.032612 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.032737 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.033015 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.033134 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.033330 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.033464 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.033630 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.033753 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.033962 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.034093 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.034272 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.034416 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.034569 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.034692 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.034867 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.034992 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.035173 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.035315 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.035472 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.035596 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.035771 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.035895 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.036087 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.036221 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.036383 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.036515 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.036686 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.036811 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.036988 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.037121 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.037292 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.037418 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.037589 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.037720 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.037885 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.038028 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.038217 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.038361 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.038506 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.038628 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.038825 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.039005 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.039161 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.039318 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.039473 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.039625 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.039792 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.039944 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.040120 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.040282 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.040441 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.040616 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.040754 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.040898 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.041045 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.041191 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.041338 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.041512 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.041675 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.041854 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.042083 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.042216 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.042343 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.042486 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.042616 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.042737 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.042900 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.043028 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.043172 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.043307 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.043424 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.043536 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.043650 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.043741 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.043886 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.044242 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.044470 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.044604 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.044604 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.044864 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.045019 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.045162 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.045311 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.045447 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.045576 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.045745 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.045943 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.046033 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.046033 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.046267 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.046407 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.046549 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.046702 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.046845 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.046982 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.047116 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.047222 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.047353 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.047483 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.047628 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.047768 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.047893 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.048014 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.048180 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.048300 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.048492 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.048616 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.048808 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.049019 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.049158 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.049297 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.049447 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.049599 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.049727 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.049883 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.050048 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.050187 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.050325 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.050448 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.050592 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.050731 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.050891 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.051017 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.051198 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.051334 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.051492 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.051630 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.051790 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.051929 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.052118 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.052243 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.052391 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.052529 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.052688 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.052822 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.053004 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.053129 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.053309 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.053435 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.053608 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.053732 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.053924 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.054053 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.054228 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.054354 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.054552 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.054689 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.054853 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.054983 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.055161 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.055293 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.055473 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.055596 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.055793 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.055980 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.056120 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.056306 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.056430 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.056614 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.056745 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.056923 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.057062 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.057228 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.057360 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.057532 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.057656 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.057836 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.057989 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.058165 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.058290 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.058470 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.058605 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.058774 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.058907 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.059080 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.059226 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.059397 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.059500 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.059705 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.059836 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.060037 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.060163 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.060374 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.060556 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.060680 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.060884 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.061018 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.061196 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.061321 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.061509 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.061634 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.061817 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.061960 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.062155 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.062293 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.062467 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.062600 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.062778 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.062903 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.063085 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.063220 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.063398 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.063525 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.063701 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.063824 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.064002 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.064133 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.064307 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.064431 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.064612 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.064736 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.064916 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.065058 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.065218 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.065342 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.065521 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.065645 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.065832 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.065976 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.066168 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.066291 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.066493 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.066616 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.066809 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.066934 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.067109 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.067231 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.067414 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.067554 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.067720 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.067852 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.068028 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.068230 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.068363 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.068543 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.068667 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.068874 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.068998 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.069223 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.069358 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.069495 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.069617 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.069805 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.069954 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.070140 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.070277 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.070448 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.070582 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.070750 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.070872 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.071051 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.071183 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.071359 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.071491 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.071667 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.071791 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.071968 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.072101 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.072281 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.072404 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.072585 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.072791 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.072924 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.073101 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.073226 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.073431 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.073557 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.073750 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.074005 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.074147 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.074348 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.074474 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.074662 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.074787 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.074982 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.075117 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.075302 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.075425 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.075603 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.075769 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.075963 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.076089 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.076269 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.076395 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.076571 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.076708 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.076871 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.076994 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.077182 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.077306 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.077481 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.077612 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.077778 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.077951 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.078098 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.078224 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.078404 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.078631 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.078757 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.078975 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.079107 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.079288 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.079415 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.079589 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.079698 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.079909 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.080007 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.080214 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.080321 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.080513 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.080608 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.080809 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.080911 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.081115 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.081221 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.081415 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.081510 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.081710 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.081805 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.082031 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.082145 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.082331 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.082469 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.082626 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.082750 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.082923 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.083056 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.083227 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.083353 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.083525 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.083650 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.083828 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.083960 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.084126 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.084249 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.084428 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.084553 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.084740 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.084864 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.085040 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.085172 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.085347 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.085479 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.085654 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.085780 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.085981 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.086118 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.086281 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.086405 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.086582 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.086704 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.086882 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.087007 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.087185 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.087309 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.087481 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.087598 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.087787 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.087912 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.088085 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.088331 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.088460 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.088659 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.088784 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.088967 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.089090 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.089289 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.089523 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.089658 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.089783 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.089926 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.090050 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.090219 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.090345 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.090518 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.090641 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.090826 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.090963 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.091130 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.091273 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.091459 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.091585 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.091767 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.091898 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.092071 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.092201 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.092376 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.092494 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.092680 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.092917 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.093043 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.093246 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.093370 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.093565 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.093688 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.093869 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.094057 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.094180 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.094313 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.094482 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.094660 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.094794 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.094917 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.095074 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.095208 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.095381 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.095515 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.095697 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.095820 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.096004 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.096130 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.096312 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.096451 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.096619 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.096743 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.096924 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.097050 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.097227 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.097351 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.097529 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.097652 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.097836 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.097978 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.098173 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.098299 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.098476 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.098599 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.098804 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.098938 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.099072 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.099203 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.099371 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.099512 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.099697 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.099839 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.099962 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.100082 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.100296 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.100432 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.100614 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.100747 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.100930 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.101055 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.101243 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.101376 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.101555 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.101682 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.101857 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.102018 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.102184 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.102319 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.102485 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.102603 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.102787 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.102910 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.103096 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.103227 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.103421 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.103548 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.103732 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.103856 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.104026 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.104148 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.104325 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.104455 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.104622 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.104754 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.104926 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.105049 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.105235 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.105358 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.105537 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.105661 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.105832 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.105987 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.106150 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.106273 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.106451 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.106575 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.106748 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.106899 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.107126 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.107251 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.107424 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.107549 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.107720 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.107853 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.108025 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.108149 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.108319 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.108466 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.108604 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.108770 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.108910 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.109097 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.109223 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.109344 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.109474 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.109650 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.109852 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.110034 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.110158 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.110279 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.110414 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.110569 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.110695 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.110874 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.110999 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.111180 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.111313 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.111475 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.111599 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.111772 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.111896 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.112071 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.112230 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.112361 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.112491 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.112667 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.112791 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.112965 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.113090 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.113265 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.113389 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.113564 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.113689 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.113863 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.114022 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.114184 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.114316 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.114488 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.114612 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.114793 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.114916 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.115098 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.115220 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.115403 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.115542 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.115705 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.115828 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.116004 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.116136 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.116304 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.116501 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.116624 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.116744 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.116897 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.117028 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.117216 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.117348 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.117534 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.117666 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.117833 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.118007 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.118174 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.118298 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.118481 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.118604 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.118789 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.118912 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.119101 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.119221 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.119407 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.119507 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.119713 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.119809 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.120014 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.120110 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.120327 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.120424 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.120634 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.120729 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.120935 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.121031 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.121238 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.121334 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.121541 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.121644 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.121840 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.121979 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.122167 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.122263 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.122474 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.122597 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.122805 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.122904 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.123118 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.123204 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.123430 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.123528 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.123732 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.123835 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.124045 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.124147 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.124353 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.124442 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.124677 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.124774 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.124979 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.125073 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.125288 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.125376 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.125595 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.125683 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.125915 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.126007 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.126229 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.126324 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.126526 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.126623 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.126775 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 06:35:37.126871 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.127121 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.127434 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.127744 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.128064 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.128386 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.128692 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.129013 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.129334 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.129675 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.130007 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.130343 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.130668 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.130976 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.131283 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.131584 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:35:37.131821 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 06:35:37.283113 n-d-851337-3 devstack@n-api.service[110838]: INFO dbcounter [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] Registered counter for database nova_api Aug 02 06:35:37.288429 n-d-851337-3 devstack@n-api.service[110839]: INFO dbcounter [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] Registered counter for database nova_api Aug 02 06:35:37.303649 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_db.sqlalchemy.engines [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110838) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:35:37.308812 n-d-851337-3 devstack@n-api.service[110839]: DEBUG oslo_db.sqlalchemy.engines [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:35:37.310989 n-d-851337-3 devstack@n-api.service[110838]: DEBUG dbcounter [-] [110838] Writer thread running {{(pid=110838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:35:37.315584 n-d-851337-3 devstack@n-api.service[110839]: DEBUG dbcounter [-] [110839] Writer thread running {{(pid=110839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:35:37.366415 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.context [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3b7f982-e927-4a3f-b699-817c726d55c4(cell1) {{(pid=110838) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 06:35:37.370282 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_concurrency.lockutils [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:35:37.371034 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.context [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3b7f982-e927-4a3f-b699-817c726d55c4(cell1) {{(pid=110839) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 06:35:37.371842 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_concurrency.lockutils [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:35:37.372645 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_concurrency.lockutils [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:35:37.374623 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_concurrency.lockutils [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:35:37.375026 n-d-851337-3 devstack@n-api.service[110839]: DEBUG oslo_concurrency.lockutils [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:35:37.376607 n-d-851337-3 devstack@n-api.service[110839]: DEBUG oslo_concurrency.lockutils [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:35:37.376763 n-d-851337-3 devstack@n-api.service[110838]: INFO dbcounter [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] Registered counter for database nova_cell0 Aug 02 06:35:37.377389 n-d-851337-3 devstack@n-api.service[110839]: DEBUG oslo_concurrency.lockutils [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:35:37.379389 n-d-851337-3 devstack@n-api.service[110839]: DEBUG oslo_concurrency.lockutils [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:35:37.381377 n-d-851337-3 devstack@n-api.service[110839]: INFO dbcounter [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] Registered counter for database nova_cell0 Aug 02 06:35:37.381923 n-d-851337-3 devstack@n-api.service[110838]: INFO dbcounter [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] Registered counter for database nova_cell1 Aug 02 06:35:37.387288 n-d-851337-3 devstack@n-api.service[110839]: INFO dbcounter [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] Registered counter for database nova_cell1 Aug 02 06:35:37.390381 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_db.sqlalchemy.engines [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110838) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:35:37.392137 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_db.sqlalchemy.engines [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110838) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:35:37.394341 n-d-851337-3 devstack@n-api.service[110839]: DEBUG oslo_db.sqlalchemy.engines [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:35:37.398340 n-d-851337-3 devstack@n-api.service[110838]: DEBUG dbcounter [-] [110838] Writer thread running {{(pid=110838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:35:37.399761 n-d-851337-3 devstack@n-api.service[110839]: DEBUG dbcounter [-] [110839] Writer thread running {{(pid=110839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:35:37.399977 n-d-851337-3 devstack@n-api.service[110838]: DEBUG dbcounter [-] [110838] Writer thread running {{(pid=110838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:35:37.400423 n-d-851337-3 devstack@n-api.service[110839]: DEBUG oslo_db.sqlalchemy.engines [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:35:37.541213 n-d-851337-3 devstack@n-api.service[110838]: INFO dbcounter [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] Registered counter for database nova_cell0 Aug 02 06:35:37.541439 n-d-851337-3 devstack@n-api.service[110839]: DEBUG dbcounter [-] [110839] Writer thread running {{(pid=110839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:35:37.547903 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_db.sqlalchemy.engines [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110838) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:35:37.551468 n-d-851337-3 devstack@n-api.service[110839]: INFO dbcounter [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] Registered counter for database nova_cell0 Aug 02 06:35:37.553039 n-d-851337-3 devstack@n-api.service[110838]: DEBUG dbcounter [-] [110838] Writer thread running {{(pid=110838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:35:37.560350 n-d-851337-3 devstack@n-api.service[110839]: DEBUG oslo_db.sqlalchemy.engines [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:35:37.565098 n-d-851337-3 devstack@n-api.service[110839]: DEBUG dbcounter [-] [110839] Writer thread running {{(pid=110839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:35:37.881998 n-d-851337-3 devstack@n-api.service[110838]: WARNING keystonemiddleware.auth_token [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 06:35:37.889732 n-d-851337-3 devstack@n-api.service[110838]: WARNING keystonemiddleware.auth_token [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 06:35:37.892580 n-d-851337-3 devstack@n-api.service[110839]: WARNING keystonemiddleware.auth_token [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 06:35:37.899883 n-d-851337-3 devstack@n-api.service[110839]: WARNING keystonemiddleware.auth_token [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 06:35:38.229151 n-d-851337-3 devstack@n-api.service[110838]: WARNING keystonemiddleware.auth_token [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 06:35:38.235203 n-d-851337-3 devstack@n-api.service[110838]: WARNING keystonemiddleware.auth_token [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 06:35:38.240470 n-d-851337-3 devstack@n-api.service[110838]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56005d4d89c0 pid: 110838 (default app) Aug 02 06:35:38.242616 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:35:38.243781 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001797 Aug 02 06:35:38.244185 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 788 bytes} [Tue Aug 2 06:35:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:35:38.245173 n-d-851337-3 devstack@n-api.service[110839]: WARNING keystonemiddleware.auth_token [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 06:35:38.251243 n-d-851337-3 devstack@n-api.service[110839]: WARNING keystonemiddleware.auth_token [None req-f2a8c62e-879c-47e4-b013-9b04c81e50db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 06:35:38.256497 n-d-851337-3 devstack@n-api.service[110839]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56005d4d89c0 pid: 110839 (default app) Aug 02 06:36:54.242565 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:36:54.243756 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Aug 02 06:36:54.244269 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 2/2] 10.222.0.79 () {54 vars in 930 bytes} [Tue Aug 2 06:36:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:36:54.256465 n-d-851337-3 devstack@n-api.service[110839]: DEBUG dbcounter [-] [110839] Writing DB stats nova_api:SELECT=3 {{(pid=110839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:36:54.257460 n-d-851337-3 devstack@n-api.service[110839]: DEBUG dbcounter [-] [110839] Writing DB stats nova_cell0:SELECT=3 {{(pid=110839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:36:54.258785 n-d-851337-3 devstack@n-api.service[110839]: DEBUG dbcounter [-] [110839] Writing DB stats nova_cell1:SELECT=3 {{(pid=110839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:36:54.259632 n-d-851337-3 devstack@n-api.service[110839]: DEBUG dbcounter [-] [110839] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:36:55.122291 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-1dc1caec-f5b3-4689-addc-8a59def414ab admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:36:55.154257 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-1dc1caec-f5b3-4689-addc-8a59def414ab admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.903115 Aug 02 06:36:55.155012 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 1/3] 10.222.0.79 () {60 vars in 1291 bytes} [Tue Aug 2 06:36:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:36:57.348896 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:36:57.349921 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-a44241d7-26dd-4343-8ff8-1450087b0f5e None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 02 06:36:57.350565 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 3/4] 10.222.0.79 () {54 vars in 930 bytes} [Tue Aug 2 06:36:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:36:57.808402 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-cbb89125-a475-42f5-9eb4-e16bad4a8bee admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256"}} {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:36:57.828377 n-d-851337-3 devstack@n-api.service[110839]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:36:57.828377 n-d-851337-3 devstack@n-api.service[110839]: warnings.warn(msg) Aug 02 06:36:57.861602 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-cbb89125-a475-42f5-9eb4-e16bad4a8bee admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.504931 Aug 02 06:36:57.862187 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 2/5] 10.222.0.79 () {64 vars in 1282 bytes} [Tue Aug 2 06:36:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 06:36:57.875920 n-d-851337-3 devstack@n-api.service[110838]: DEBUG dbcounter [-] [110838] Writing DB stats nova_api:SELECT=3 {{(pid=110838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:36:57.877293 n-d-851337-3 devstack@n-api.service[110838]: DEBUG dbcounter [-] [110838] Writing DB stats nova_cell0:SELECT=3 {{(pid=110838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:36:57.878213 n-d-851337-3 devstack@n-api.service[110838]: DEBUG dbcounter [-] [110838] Writing DB stats nova_cell1:SELECT=3 {{(pid=110838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:36:57.879360 n-d-851337-3 devstack@n-api.service[110838]: DEBUG dbcounter [-] [110838] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:36:58.082683 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-5e2dfce3-39c1-4b9d-98e0-596262e887bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:36:58.087142 n-d-851337-3 devstack@n-api.service[110838]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:36:58.087142 n-d-851337-3 devstack@n-api.service[110838]: warnings.warn(msg) Aug 02 06:36:58.146344 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-5e2dfce3-39c1-4b9d-98e0-596262e887bb admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.275726 Aug 02 06:36:58.146920 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 4/6] 10.222.0.79 () {64 vars in 1335 bytes} [Tue Aug 2 06:36:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:37:00.413239 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-cbb89125-a475-42f5-9eb4-e16bad4a8bee admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:00.414278 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-cbb89125-a475-42f5-9eb4-e16bad4a8bee admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 02 06:37:00.414676 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 3/7] 10.222.0.79 () {54 vars in 930 bytes} [Tue Aug 2 06:37:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:01.206487 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-285e7881-020f-4b17-9243-2806e131c5dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0}} {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:01.225254 n-d-851337-3 devstack@n-api.service[110838]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:37:01.225254 n-d-851337-3 devstack@n-api.service[110838]: warnings.warn(msg) Aug 02 06:37:01.245576 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-285e7881-020f-4b17-9243-2806e131c5dc admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.824167 Aug 02 06:37:01.246203 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 5/8] 10.222.0.79 () {64 vars in 1282 bytes} [Tue Aug 2 06:37:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:37:01.258200 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-cc59411f-53a3-4040-86df-980daa0e9212 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:01.261342 n-d-851337-3 devstack@n-api.service[110839]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:37:01.261342 n-d-851337-3 devstack@n-api.service[110839]: warnings.warn(msg) Aug 02 06:37:01.294900 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-cc59411f-53a3-4040-86df-980daa0e9212 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040203 Aug 02 06:37:01.295388 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 4/9] 10.222.0.79 () {64 vars in 1335 bytes} [Tue Aug 2 06:37:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:37:03.770180 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-285e7881-020f-4b17-9243-2806e131c5dc admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:03.772532 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-285e7881-020f-4b17-9243-2806e131c5dc admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003193 Aug 02 06:37:03.778824 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 6/10] 10.222.0.79 () {54 vars in 930 bytes} [Tue Aug 2 06:37:03 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:04.227630 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-ce48dcd3-9ee9-4327-bfea-3b3fe53a6e33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:04.251076 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-ce48dcd3-9ee9-4327-bfea-3b3fe53a6e33 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.470717 Aug 02 06:37:04.258365 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 5/11] 10.222.0.79 () {64 vars in 1282 bytes} [Tue Aug 2 06:37:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:37:04.266874 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-aa03d189-1cd6-49c5-bc15-d7de71ed48b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:04.294414 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-aa03d189-1cd6-49c5-bc15-d7de71ed48b4 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031585 Aug 02 06:37:04.304615 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 7/12] 10.222.0.79 () {64 vars in 1335 bytes} [Tue Aug 2 06:37:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:37:06.543471 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-ce48dcd3-9ee9-4327-bfea-3b3fe53a6e33 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:06.545158 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-ce48dcd3-9ee9-4327-bfea-3b3fe53a6e33 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002862 Aug 02 06:37:06.545611 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 6/13] 10.222.0.79 () {54 vars in 930 bytes} [Tue Aug 2 06:37:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:06.942554 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-3322952f-6635-4dcb-a975-a94fa06b9095 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "swap": 0, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:06.962816 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-3322952f-6635-4dcb-a975-a94fa06b9095 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.409070 Aug 02 06:37:06.963921 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 8/14] 10.222.0.79 () {64 vars in 1282 bytes} [Tue Aug 2 06:37:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:37:06.976378 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-3406a011-f0fb-4cb8-83de-e985c0f1008e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:07.003728 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-3406a011-f0fb-4cb8-83de-e985c0f1008e admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031779 Aug 02 06:37:07.004947 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 7/15] 10.222.0.79 () {64 vars in 1335 bytes} [Tue Aug 2 06:37:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:37:09.205466 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-3322952f-6635-4dcb-a975-a94fa06b9095 admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:09.206517 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-3322952f-6635-4dcb-a975-a94fa06b9095 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 02 06:37:09.207176 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 9/16] 10.222.0.79 () {54 vars in 930 bytes} [Tue Aug 2 06:37:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:09.687322 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-a5c58348-412e-4183-9d83-0249d17080b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "swap": 0, "id": "d4"}} {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:09.713383 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-a5c58348-412e-4183-9d83-0249d17080b0 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.500106 Aug 02 06:37:09.713867 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 8/17] 10.222.0.79 () {64 vars in 1282 bytes} [Tue Aug 2 06:37:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:37:09.725915 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-82683e97-8e9d-46eb-a759-f16dfbeba46c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:09.779206 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-82683e97-8e9d-46eb-a759-f16dfbeba46c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056890 Aug 02 06:37:09.791383 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 10/18] 10.222.0.79 () {64 vars in 1335 bytes} [Tue Aug 2 06:37:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:37:12.091444 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-a5c58348-412e-4183-9d83-0249d17080b0 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:12.092468 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-a5c58348-412e-4183-9d83-0249d17080b0 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 02 06:37:12.093031 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 9/19] 10.222.0.79 () {54 vars in 930 bytes} [Tue Aug 2 06:37:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:12.540366 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-9616efcf-79a2-495f-aa0f-b639c865794d admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:12.565342 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-9616efcf-79a2-495f-aa0f-b639c865794d admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.466034 Aug 02 06:37:12.566227 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 11/20] 10.222.0.79 () {60 vars in 1291 bytes} [Tue Aug 2 06:37:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:37:14.777845 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-a5c58348-412e-4183-9d83-0249d17080b0 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:14.779515 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-a5c58348-412e-4183-9d83-0249d17080b0 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Aug 02 06:37:14.780059 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 10/21] 10.222.0.79 () {54 vars in 930 bytes} [Tue Aug 2 06:37:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:15.258339 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-980c816f-60f2-4679-a192-3cfda22f27cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0}} {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:15.282740 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-980c816f-60f2-4679-a192-3cfda22f27cd admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.496035 Aug 02 06:37:15.283510 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 12/22] 10.222.0.79 () {64 vars in 1282 bytes} [Tue Aug 2 06:37:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 06:37:15.300933 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-e270c31a-c954-4537-a466-4f4873bfacda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:15.331767 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-e270c31a-c954-4537-a466-4f4873bfacda admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036797 Aug 02 06:37:15.332393 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 11/23] 10.222.0.79 () {64 vars in 1332 bytes} [Tue Aug 2 06:37:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:37:17.550078 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-980c816f-60f2-4679-a192-3cfda22f27cd admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:17.551228 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-980c816f-60f2-4679-a192-3cfda22f27cd admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 Aug 02 06:37:17.551984 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 13/24] 10.222.0.79 () {54 vars in 930 bytes} [Tue Aug 2 06:37:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:18.010752 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-07823b6c-b440-41fd-a218-272f6fefc1cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "ram": 2048}} {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:18.033117 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-07823b6c-b440-41fd-a218-272f6fefc1cf admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.475147 Aug 02 06:37:18.033715 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 12/25] 10.222.0.79 () {64 vars in 1282 bytes} [Tue Aug 2 06:37:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:37:18.046415 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-1910aea6-c439-4d18-9eb5-a53baa480f97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:18.073484 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-1910aea6-c439-4d18-9eb5-a53baa480f97 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031083 Aug 02 06:37:18.074121 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 14/26] 10.222.0.79 () {64 vars in 1332 bytes} [Tue Aug 2 06:37:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:37:20.558450 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-07823b6c-b440-41fd-a218-272f6fefc1cf admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:20.559397 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-07823b6c-b440-41fd-a218-272f6fefc1cf admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 02 06:37:20.559853 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 13/27] 10.222.0.79 () {54 vars in 930 bytes} [Tue Aug 2 06:37:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:20.981655 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-0d3b98af-60e3-44e6-b86d-b60badad4710 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096}} {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:21.001589 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-0d3b98af-60e3-44e6-b86d-b60badad4710 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.435714 Aug 02 06:37:21.002337 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 15/28] 10.222.0.79 () {64 vars in 1282 bytes} [Tue Aug 2 06:37:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:37:21.014526 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-179acc94-6445-416d-af51-692994999bc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:21.039050 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-179acc94-6445-416d-af51-692994999bc4 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028305 Aug 02 06:37:21.039626 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 14/29] 10.222.0.79 () {64 vars in 1332 bytes} [Tue Aug 2 06:37:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:37:23.219582 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-0d3b98af-60e3-44e6-b86d-b60badad4710 admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:23.220601 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-0d3b98af-60e3-44e6-b86d-b60badad4710 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 02 06:37:23.221276 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 16/30] 10.222.0.79 () {54 vars in 930 bytes} [Tue Aug 2 06:37:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:23.658006 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-653ee81a-69f7-4a84-9f41-5ba635749cad admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "rxtx_factor": 1.0}} {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:23.677702 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-653ee81a-69f7-4a84-9f41-5ba635749cad admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.450202 Aug 02 06:37:23.678630 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 15/31] 10.222.0.79 () {64 vars in 1282 bytes} [Tue Aug 2 06:37:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 06:37:23.690620 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-384191e7-72fb-472e-ab44-71d394295352 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:23.715327 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-384191e7-72fb-472e-ab44-71d394295352 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028289 Aug 02 06:37:23.715922 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 17/32] 10.222.0.79 () {64 vars in 1332 bytes} [Tue Aug 2 06:37:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:37:25.968897 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-653ee81a-69f7-4a84-9f41-5ba635749cad admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:25.970121 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-653ee81a-69f7-4a84-9f41-5ba635749cad admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 02 06:37:25.970586 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 16/33] 10.222.0.79 () {54 vars in 930 bytes} [Tue Aug 2 06:37:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:26.408303 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-305946e9-5d26-4b86-b130-4a09b5ea6ef8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:26.438347 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-305946e9-5d26-4b86-b130-4a09b5ea6ef8 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.461610 Aug 02 06:37:26.439606 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 18/34] 10.222.0.79 () {64 vars in 1282 bytes} [Tue Aug 2 06:37:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:37:26.451671 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-bef87cfa-3d08-4500-8a7f-26421f2c0f41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:26.457525 n-d-851337-3 devstack@n-api.service[110839]: DEBUG dbcounter [-] [110839] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:37:26.489796 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-bef87cfa-3d08-4500-8a7f-26421f2c0f41 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042016 Aug 02 06:37:26.491036 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 17/35] 10.222.0.79 () {64 vars in 1332 bytes} [Tue Aug 2 06:37:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:37:51.030055 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-305946e9-5d26-4b86-b130-4a09b5ea6ef8 admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:51.031085 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-305946e9-5d26-4b86-b130-4a09b5ea6ef8 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001768 Aug 02 06:37:51.031563 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 19/36] 10.222.0.79 () {54 vars in 930 bytes} [Tue Aug 2 06:37:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:51.046266 n-d-851337-3 devstack@n-api.service[110839]: DEBUG dbcounter [-] [110839] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:37:51.453638 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-73e12a41-3fbd-4a4d-b67f-53b319a76450 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:51.472760 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-73e12a41-3fbd-4a4d-b67f-53b319a76450 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.433825 Aug 02 06:37:51.473233 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 18/37] 10.222.0.79 () {60 vars in 1291 bytes} [Tue Aug 2 06:37:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:37:52.560076 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-305946e9-5d26-4b86-b130-4a09b5ea6ef8 admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:52.561084 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-305946e9-5d26-4b86-b130-4a09b5ea6ef8 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 02 06:37:52.561462 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 20/38] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Aug 2 06:37:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:53.171137 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-060940aa-d4be-4b1f-a86b-36ec9f9a67b1 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:53.176985 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.wsgi [None req-060940aa-d4be-4b1f-a86b-36ec9f9a67b1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-060940aa-d4be-4b1f-a86b-36ec9f9a67b1 admin admin] Request method failure captured: Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: Accept: application/json Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: Accept-Encoding: gzip, deflate Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: Connection: keep-alive Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: Content-Length: 0 Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: Host: 10.222.0.79 Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: Openstack-Api-Version: compute 2.90 Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: Openstack-System-Scope: None Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: User-Agent: python-novaclient Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: X-Auth-Token: gAAAAABi6MZAIkG2376ePaXSaUZYYiYVy5ckcxNZVV5sxK_7RicNBEsL62hZ5cRFy2CS16wfdBQWWdOxK_fmieW14XJyirsF1mX8IwAhkURzSnD3eBwEVT14H6FK-gAQN3O-VMFhIro3cXUodUU0z6cwnFSjI9ioOSFWggPoPGByiVL_uKOUDnc Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: X-Domain-Id: None Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: X-Domain-Name: None Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: X-Identity-Status: Confirmed Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: X-Is-Admin-Project: True Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: X-Project-Domain-Id: default Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: X-Project-Domain-Name: Default Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: X-Project-Id: 2ebaf92f0afb4de7a144a89714a42c7d Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: X-Project-Name: admin Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: X-Role: member,reader,admin Aug 02 06:37:53.180311 n-d-851337-3 devstack@n-api.service[110839]: X-Roles: member,reader,admin Aug 02 06:37:53.181862 n-d-851337-3 devstack@n-api.service[110839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebaf92f0afb4de7a144a89714a42c7d"}]}] Aug 02 06:37:53.181862 n-d-851337-3 devstack@n-api.service[110839]: X-Tenant: admin Aug 02 06:37:53.181862 n-d-851337-3 devstack@n-api.service[110839]: X-Tenant-Id: 2ebaf92f0afb4de7a144a89714a42c7d Aug 02 06:37:53.181862 n-d-851337-3 devstack@n-api.service[110839]: X-Tenant-Name: admin Aug 02 06:37:53.181862 n-d-851337-3 devstack@n-api.service[110839]: X-User: admin Aug 02 06:37:53.181862 n-d-851337-3 devstack@n-api.service[110839]: X-User-Domain-Id: default Aug 02 06:37:53.181862 n-d-851337-3 devstack@n-api.service[110839]: X-User-Domain-Name: Default Aug 02 06:37:53.181862 n-d-851337-3 devstack@n-api.service[110839]: X-User-Id: f14e78eaaba940bfa5794d3414602c53 Aug 02 06:37:53.181862 n-d-851337-3 devstack@n-api.service[110839]: X-User-Name: admin Aug 02 06:37:53.181862 n-d-851337-3 devstack@n-api.service[110839]: method: > Aug 02 06:37:53.181862 n-d-851337-3 devstack@n-api.service[110839]: exception: Flavor 42 could not be found. Aug 02 06:37:53.181862 n-d-851337-3 devstack@n-api.service[110839]: action_args: {'id': '42'} Aug 02 06:37:53.181862 n-d-851337-3 devstack@n-api.service[110839]: {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:37:53.181862 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:37:53.182901 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:53.184059 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-060940aa-d4be-4b1f-a86b-36ec9f9a67b1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:37:53.185172 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-060940aa-d4be-4b1f-a86b-36ec9f9a67b1 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.422786 Aug 02 06:37:53.185172 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 19/39] 10.222.0.79 () {60 vars in 1190 bytes} [Tue Aug 2 06:37:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 06:37:53.192075 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-a5a3f964-b852-4419-9ff0-a26ce340a0f8 admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:53.196333 n-d-851337-3 devstack@n-api.service[110838]: DEBUG dbcounter [-] [110838] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:37:53.216556 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-a5a3f964-b852-4419-9ff0-a26ce340a0f8 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028059 Aug 02 06:37:53.217103 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 21/40] 10.222.0.79 () {60 vars in 1210 bytes} [Tue Aug 2 06:37:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:37:53.231587 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-92cf3689-c47a-48c5-8695-51c9d4874408 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:53.255196 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-92cf3689-c47a-48c5-8695-51c9d4874408 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027189 Aug 02 06:37:53.255712 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 20/41] 10.222.0.79 () {60 vars in 1210 bytes} [Tue Aug 2 06:37:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:37:53.265818 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-4413fe9a-4a35-437f-adaf-c9c9e2196b56 admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:53.271696 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.wsgi [None req-4413fe9a-4a35-437f-adaf-c9c9e2196b56 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-4413fe9a-4a35-437f-adaf-c9c9e2196b56 admin admin] Request method failure captured: Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: Accept: application/json Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: Accept-Encoding: gzip, deflate Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: Connection: keep-alive Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: Content-Length: 0 Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: Host: 10.222.0.79 Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: Openstack-Api-Version: compute 2.90 Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: Openstack-System-Scope: None Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: User-Agent: python-novaclient Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: X-Auth-Token: gAAAAABi6MZAIkG2376ePaXSaUZYYiYVy5ckcxNZVV5sxK_7RicNBEsL62hZ5cRFy2CS16wfdBQWWdOxK_fmieW14XJyirsF1mX8IwAhkURzSnD3eBwEVT14H6FK-gAQN3O-VMFhIro3cXUodUU0z6cwnFSjI9ioOSFWggPoPGByiVL_uKOUDnc Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: X-Domain-Id: None Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: X-Domain-Name: None Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: X-Identity-Status: Confirmed Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: X-Is-Admin-Project: True Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: X-Project-Domain-Id: default Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: X-Project-Domain-Name: Default Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: X-Project-Id: 2ebaf92f0afb4de7a144a89714a42c7d Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: X-Project-Name: admin Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: X-Role: member,reader,admin Aug 02 06:37:53.274967 n-d-851337-3 devstack@n-api.service[110838]: X-Roles: member,reader,admin Aug 02 06:37:53.276447 n-d-851337-3 devstack@n-api.service[110838]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebaf92f0afb4de7a144a89714a42c7d"}]}] Aug 02 06:37:53.276447 n-d-851337-3 devstack@n-api.service[110838]: X-Tenant: admin Aug 02 06:37:53.276447 n-d-851337-3 devstack@n-api.service[110838]: X-Tenant-Id: 2ebaf92f0afb4de7a144a89714a42c7d Aug 02 06:37:53.276447 n-d-851337-3 devstack@n-api.service[110838]: X-Tenant-Name: admin Aug 02 06:37:53.276447 n-d-851337-3 devstack@n-api.service[110838]: X-User: admin Aug 02 06:37:53.276447 n-d-851337-3 devstack@n-api.service[110838]: X-User-Domain-Id: default Aug 02 06:37:53.276447 n-d-851337-3 devstack@n-api.service[110838]: X-User-Domain-Name: Default Aug 02 06:37:53.276447 n-d-851337-3 devstack@n-api.service[110838]: X-User-Id: f14e78eaaba940bfa5794d3414602c53 Aug 02 06:37:53.276447 n-d-851337-3 devstack@n-api.service[110838]: X-User-Name: admin Aug 02 06:37:53.276447 n-d-851337-3 devstack@n-api.service[110838]: method: > Aug 02 06:37:53.276447 n-d-851337-3 devstack@n-api.service[110838]: exception: Flavor 42 could not be found. Aug 02 06:37:53.276447 n-d-851337-3 devstack@n-api.service[110838]: action_args: {'id': '42'} Aug 02 06:37:53.276447 n-d-851337-3 devstack@n-api.service[110838]: {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:37:53.276447 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:37:53.277318 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:53.278372 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-4413fe9a-4a35-437f-adaf-c9c9e2196b56 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:37:53.279506 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-4413fe9a-4a35-437f-adaf-c9c9e2196b56 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014524 Aug 02 06:37:53.279506 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 22/42] 10.222.0.79 () {60 vars in 1190 bytes} [Tue Aug 2 06:37:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 06:37:54.280054 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-92cf3689-c47a-48c5-8695-51c9d4874408 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:54.281195 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-92cf3689-c47a-48c5-8695-51c9d4874408 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001907 Aug 02 06:37:54.281579 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 21/43] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Aug 2 06:37:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:54.832778 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-3de848f0-733e-4969-9d98-30dc0b9d4d3c admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:54.838989 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.wsgi [None req-3de848f0-733e-4969-9d98-30dc0b9d4d3c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-3de848f0-733e-4969-9d98-30dc0b9d4d3c admin admin] Request method failure captured: Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: Accept: application/json Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: Accept-Encoding: gzip, deflate Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: Connection: keep-alive Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: Content-Length: 0 Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: Host: 10.222.0.79 Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: Openstack-Api-Version: compute 2.90 Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: Openstack-System-Scope: None Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: User-Agent: python-novaclient Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: X-Auth-Token: gAAAAABi6MZCW-pW0DMj0GwlAAhKG0Sw2U93fGPdMGeADNlU8XJIcHpJbt1Y1qiRqYSMMa1yorkMgaRmnSSTLWclImaX2K512wYfXuZHuGla4c2iWmWFKVgg7pJU4_s2WrhafNdnpqUIK0KGi7cFK9LGymld4Owi90JPhwcw0czUYXUpEL9QaQo Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: X-Domain-Id: None Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: X-Domain-Name: None Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: X-Identity-Status: Confirmed Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: X-Is-Admin-Project: True Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: X-Project-Domain-Id: default Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: X-Project-Domain-Name: Default Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: X-Project-Id: 2ebaf92f0afb4de7a144a89714a42c7d Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: X-Project-Name: admin Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: X-Role: member,reader,admin Aug 02 06:37:54.840650 n-d-851337-3 devstack@n-api.service[110838]: X-Roles: member,reader,admin Aug 02 06:37:54.842200 n-d-851337-3 devstack@n-api.service[110838]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebaf92f0afb4de7a144a89714a42c7d"}]}] Aug 02 06:37:54.842200 n-d-851337-3 devstack@n-api.service[110838]: X-Tenant: admin Aug 02 06:37:54.842200 n-d-851337-3 devstack@n-api.service[110838]: X-Tenant-Id: 2ebaf92f0afb4de7a144a89714a42c7d Aug 02 06:37:54.842200 n-d-851337-3 devstack@n-api.service[110838]: X-Tenant-Name: admin Aug 02 06:37:54.842200 n-d-851337-3 devstack@n-api.service[110838]: X-User: admin Aug 02 06:37:54.842200 n-d-851337-3 devstack@n-api.service[110838]: X-User-Domain-Id: default Aug 02 06:37:54.842200 n-d-851337-3 devstack@n-api.service[110838]: X-User-Domain-Name: Default Aug 02 06:37:54.842200 n-d-851337-3 devstack@n-api.service[110838]: X-User-Id: f14e78eaaba940bfa5794d3414602c53 Aug 02 06:37:54.842200 n-d-851337-3 devstack@n-api.service[110838]: X-User-Name: admin Aug 02 06:37:54.842200 n-d-851337-3 devstack@n-api.service[110838]: method: > Aug 02 06:37:54.842200 n-d-851337-3 devstack@n-api.service[110838]: exception: Flavor 84 could not be found. Aug 02 06:37:54.842200 n-d-851337-3 devstack@n-api.service[110838]: action_args: {'id': '84'} Aug 02 06:37:54.842200 n-d-851337-3 devstack@n-api.service[110838]: {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:37:54.842200 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:37:54.845181 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:54.846416 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-3de848f0-733e-4969-9d98-30dc0b9d4d3c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:37:54.848324 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-3de848f0-733e-4969-9d98-30dc0b9d4d3c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.423188 Aug 02 06:37:54.848324 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 23/44] 10.222.0.79 () {60 vars in 1190 bytes} [Tue Aug 2 06:37:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 06:37:54.854729 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-02c52a64-3f3a-4436-9097-b48b80f9d186 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:54.871638 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-02c52a64-3f3a-4436-9097-b48b80f9d186 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022868 Aug 02 06:37:54.872174 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 22/45] 10.222.0.79 () {60 vars in 1210 bytes} [Tue Aug 2 06:37:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:37:54.881916 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-a8980f5f-ac69-49da-9a36-580413631308 admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:54.898426 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-a8980f5f-ac69-49da-9a36-580413631308 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020166 Aug 02 06:37:54.898984 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 24/46] 10.222.0.79 () {60 vars in 1210 bytes} [Tue Aug 2 06:37:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:37:54.908868 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-bf09bd90-0688-4ef0-8ed5-4b84c7064e2d admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:54.914656 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.wsgi [None req-bf09bd90-0688-4ef0-8ed5-4b84c7064e2d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-bf09bd90-0688-4ef0-8ed5-4b84c7064e2d admin admin] Request method failure captured: Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: Accept: application/json Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: Accept-Encoding: gzip, deflate Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: Connection: keep-alive Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: Content-Length: 0 Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: Host: 10.222.0.79 Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: Openstack-Api-Version: compute 2.90 Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: Openstack-System-Scope: None Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: User-Agent: python-novaclient Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: X-Auth-Token: gAAAAABi6MZCW-pW0DMj0GwlAAhKG0Sw2U93fGPdMGeADNlU8XJIcHpJbt1Y1qiRqYSMMa1yorkMgaRmnSSTLWclImaX2K512wYfXuZHuGla4c2iWmWFKVgg7pJU4_s2WrhafNdnpqUIK0KGi7cFK9LGymld4Owi90JPhwcw0czUYXUpEL9QaQo Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: X-Domain-Id: None Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: X-Domain-Name: None Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: X-Identity-Status: Confirmed Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: X-Is-Admin-Project: True Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: X-Project-Domain-Id: default Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: X-Project-Domain-Name: Default Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: X-Project-Id: 2ebaf92f0afb4de7a144a89714a42c7d Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: X-Project-Name: admin Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: X-Role: member,reader,admin Aug 02 06:37:54.916198 n-d-851337-3 devstack@n-api.service[110839]: X-Roles: member,reader,admin Aug 02 06:37:54.917639 n-d-851337-3 devstack@n-api.service[110839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebaf92f0afb4de7a144a89714a42c7d"}]}] Aug 02 06:37:54.917639 n-d-851337-3 devstack@n-api.service[110839]: X-Tenant: admin Aug 02 06:37:54.917639 n-d-851337-3 devstack@n-api.service[110839]: X-Tenant-Id: 2ebaf92f0afb4de7a144a89714a42c7d Aug 02 06:37:54.917639 n-d-851337-3 devstack@n-api.service[110839]: X-Tenant-Name: admin Aug 02 06:37:54.917639 n-d-851337-3 devstack@n-api.service[110839]: X-User: admin Aug 02 06:37:54.917639 n-d-851337-3 devstack@n-api.service[110839]: X-User-Domain-Id: default Aug 02 06:37:54.917639 n-d-851337-3 devstack@n-api.service[110839]: X-User-Domain-Name: Default Aug 02 06:37:54.917639 n-d-851337-3 devstack@n-api.service[110839]: X-User-Id: f14e78eaaba940bfa5794d3414602c53 Aug 02 06:37:54.917639 n-d-851337-3 devstack@n-api.service[110839]: X-User-Name: admin Aug 02 06:37:54.917639 n-d-851337-3 devstack@n-api.service[110839]: method: > Aug 02 06:37:54.917639 n-d-851337-3 devstack@n-api.service[110839]: exception: Flavor 84 could not be found. Aug 02 06:37:54.917639 n-d-851337-3 devstack@n-api.service[110839]: action_args: {'id': '84'} Aug 02 06:37:54.917639 n-d-851337-3 devstack@n-api.service[110839]: {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:37:54.917639 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:37:54.918518 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:54.919760 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-bf09bd90-0688-4ef0-8ed5-4b84c7064e2d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:37:54.921093 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-bf09bd90-0688-4ef0-8ed5-4b84c7064e2d admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012441 Aug 02 06:37:54.921093 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 23/47] 10.222.0.79 () {60 vars in 1190 bytes} [Tue Aug 2 06:37:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 06:37:55.898726 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-a8980f5f-ac69-49da-9a36-580413631308 admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:55.900103 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-a8980f5f-ac69-49da-9a36-580413631308 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Aug 02 06:37:55.900601 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 25/48] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Aug 2 06:37:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:56.470606 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-87c0336d-f64c-4304-a8fd-da2c77b3a3b3 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:56.476933 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.wsgi [None req-87c0336d-f64c-4304-a8fd-da2c77b3a3b3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-87c0336d-f64c-4304-a8fd-da2c77b3a3b3 admin admin] Request method failure captured: Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: Accept: application/json Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: Accept-Encoding: gzip, deflate Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: Connection: keep-alive Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: Content-Length: 0 Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: Host: 10.222.0.79 Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: Openstack-Api-Version: compute 2.90 Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: Openstack-System-Scope: None Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: User-Agent: python-novaclient Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: X-Auth-Token: gAAAAABi6MZDMvomq8-HpHgHDq95QX3XnoeBbyzqmfM5TiMhi5FdzfAePgjxxErXmO_16gtwAvA5_YQBT_TVXblYHTkczD8lxQdbwecUvzJDNCiCaUJ3fziAe12UxuY8oMAiRHUU3MDMe0dhYxJR_EvWpJSICxXzSx7yiUa1bW9P7OtgGBETymM Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: X-Domain-Id: None Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: X-Domain-Name: None Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: X-Identity-Status: Confirmed Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: X-Is-Admin-Project: True Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: X-Project-Domain-Id: default Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: X-Project-Domain-Name: Default Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: X-Project-Id: 2ebaf92f0afb4de7a144a89714a42c7d Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: X-Project-Name: admin Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: X-Role: member,reader,admin Aug 02 06:37:56.478465 n-d-851337-3 devstack@n-api.service[110839]: X-Roles: member,reader,admin Aug 02 06:37:56.479896 n-d-851337-3 devstack@n-api.service[110839]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebaf92f0afb4de7a144a89714a42c7d"}]}] Aug 02 06:37:56.479896 n-d-851337-3 devstack@n-api.service[110839]: X-Tenant: admin Aug 02 06:37:56.479896 n-d-851337-3 devstack@n-api.service[110839]: X-Tenant-Id: 2ebaf92f0afb4de7a144a89714a42c7d Aug 02 06:37:56.479896 n-d-851337-3 devstack@n-api.service[110839]: X-Tenant-Name: admin Aug 02 06:37:56.479896 n-d-851337-3 devstack@n-api.service[110839]: X-User: admin Aug 02 06:37:56.479896 n-d-851337-3 devstack@n-api.service[110839]: X-User-Domain-Id: default Aug 02 06:37:56.479896 n-d-851337-3 devstack@n-api.service[110839]: X-User-Domain-Name: Default Aug 02 06:37:56.479896 n-d-851337-3 devstack@n-api.service[110839]: X-User-Id: f14e78eaaba940bfa5794d3414602c53 Aug 02 06:37:56.479896 n-d-851337-3 devstack@n-api.service[110839]: X-User-Name: admin Aug 02 06:37:56.479896 n-d-851337-3 devstack@n-api.service[110839]: method: > Aug 02 06:37:56.479896 n-d-851337-3 devstack@n-api.service[110839]: exception: Flavor 451 could not be found. Aug 02 06:37:56.479896 n-d-851337-3 devstack@n-api.service[110839]: action_args: {'id': '451'} Aug 02 06:37:56.479896 n-d-851337-3 devstack@n-api.service[110839]: {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:37:56.479896 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:37:56.480829 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: ERROR nova.api.openstack.wsgi Aug 02 06:37:56.481937 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-87c0336d-f64c-4304-a8fd-da2c77b3a3b3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:37:56.482958 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-87c0336d-f64c-4304-a8fd-da2c77b3a3b3 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.439737 Aug 02 06:37:56.482958 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 24/49] 10.222.0.79 () {60 vars in 1193 bytes} [Tue Aug 2 06:37:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 06:37:56.489826 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-cf7bae0b-a46a-4d53-b59f-0a0f5bb1482a admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:56.504964 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-cf7bae0b-a46a-4d53-b59f-0a0f5bb1482a admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018782 Aug 02 06:37:56.505474 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 26/50] 10.222.0.79 () {60 vars in 1210 bytes} [Tue Aug 2 06:37:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:37:56.515808 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-bb705ddc-7b1a-4c56-b45d-3202b051f3b1 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:56.531070 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-bb705ddc-7b1a-4c56-b45d-3202b051f3b1 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019047 Aug 02 06:37:56.531633 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 25/51] 10.222.0.79 () {60 vars in 1210 bytes} [Tue Aug 2 06:37:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:37:56.541067 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-f94556b9-1aaa-4bf9-b9a7-9e3d805e45b2 admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:56.546759 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.wsgi [None req-f94556b9-1aaa-4bf9-b9a7-9e3d805e45b2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-f94556b9-1aaa-4bf9-b9a7-9e3d805e45b2 admin admin] Request method failure captured: Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: Accept: application/json Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: Accept-Encoding: gzip, deflate Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: Connection: keep-alive Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: Content-Length: 0 Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: Host: 10.222.0.79 Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: Openstack-Api-Version: compute 2.90 Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: Openstack-System-Scope: None Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: User-Agent: python-novaclient Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: X-Auth-Token: gAAAAABi6MZDMvomq8-HpHgHDq95QX3XnoeBbyzqmfM5TiMhi5FdzfAePgjxxErXmO_16gtwAvA5_YQBT_TVXblYHTkczD8lxQdbwecUvzJDNCiCaUJ3fziAe12UxuY8oMAiRHUU3MDMe0dhYxJR_EvWpJSICxXzSx7yiUa1bW9P7OtgGBETymM Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: X-Domain-Id: None Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: X-Domain-Name: None Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: X-Identity-Status: Confirmed Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: X-Is-Admin-Project: True Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: X-Project-Domain-Id: default Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: X-Project-Domain-Name: Default Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: X-Project-Id: 2ebaf92f0afb4de7a144a89714a42c7d Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: X-Project-Name: admin Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: X-Role: member,reader,admin Aug 02 06:37:56.548290 n-d-851337-3 devstack@n-api.service[110838]: X-Roles: member,reader,admin Aug 02 06:37:56.549880 n-d-851337-3 devstack@n-api.service[110838]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebaf92f0afb4de7a144a89714a42c7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebaf92f0afb4de7a144a89714a42c7d"}]}] Aug 02 06:37:56.549880 n-d-851337-3 devstack@n-api.service[110838]: X-Tenant: admin Aug 02 06:37:56.549880 n-d-851337-3 devstack@n-api.service[110838]: X-Tenant-Id: 2ebaf92f0afb4de7a144a89714a42c7d Aug 02 06:37:56.549880 n-d-851337-3 devstack@n-api.service[110838]: X-Tenant-Name: admin Aug 02 06:37:56.549880 n-d-851337-3 devstack@n-api.service[110838]: X-User: admin Aug 02 06:37:56.549880 n-d-851337-3 devstack@n-api.service[110838]: X-User-Domain-Id: default Aug 02 06:37:56.549880 n-d-851337-3 devstack@n-api.service[110838]: X-User-Domain-Name: Default Aug 02 06:37:56.549880 n-d-851337-3 devstack@n-api.service[110838]: X-User-Id: f14e78eaaba940bfa5794d3414602c53 Aug 02 06:37:56.549880 n-d-851337-3 devstack@n-api.service[110838]: X-User-Name: admin Aug 02 06:37:56.549880 n-d-851337-3 devstack@n-api.service[110838]: method: > Aug 02 06:37:56.549880 n-d-851337-3 devstack@n-api.service[110838]: exception: Flavor 451 could not be found. Aug 02 06:37:56.549880 n-d-851337-3 devstack@n-api.service[110838]: action_args: {'id': '451'} Aug 02 06:37:56.549880 n-d-851337-3 devstack@n-api.service[110838]: {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:37:56.549880 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:37:56.550987 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: ERROR nova.api.openstack.wsgi Aug 02 06:37:56.552600 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-f94556b9-1aaa-4bf9-b9a7-9e3d805e45b2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:37:56.554015 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-f94556b9-1aaa-4bf9-b9a7-9e3d805e45b2 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012195 Aug 02 06:37:56.554015 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 27/52] 10.222.0.79 () {60 vars in 1193 bytes} [Tue Aug 2 06:37:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 06:37:57.511546 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-bb705ddc-7b1a-4c56-b45d-3202b051f3b1 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:57.512866 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-bb705ddc-7b1a-4c56-b45d-3202b051f3b1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002374 Aug 02 06:37:57.513382 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 26/53] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Aug 2 06:37:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:58.071128 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-32c11b02-8809-448d-92f9-bfd301fefcae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:58.093132 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-32c11b02-8809-448d-92f9-bfd301fefcae admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.446178 Aug 02 06:37:58.093667 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 28/54] 10.222.0.79 () {64 vars in 1235 bytes} [Tue Aug 2 06:37:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:37:59.059906 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-bb705ddc-7b1a-4c56-b45d-3202b051f3b1 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:37:59.061268 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-bb705ddc-7b1a-4c56-b45d-3202b051f3b1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001997 Aug 02 06:37:59.061798 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 27/55] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Aug 2 06:37:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:37:59.611924 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-859566a5-db52-4847-996b-7d121a41c2a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:37:59.632623 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-859566a5-db52-4847-996b-7d121a41c2a3 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.428264 Aug 02 06:37:59.633156 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 29/56] 10.222.0.79 () {64 vars in 1235 bytes} [Tue Aug 2 06:37:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:38:00.608953 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-bb705ddc-7b1a-4c56-b45d-3202b051f3b1 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:38:00.610008 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-bb705ddc-7b1a-4c56-b45d-3202b051f3b1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001620 Aug 02 06:38:00.610402 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 28/57] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Aug 2 06:38:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:38:01.179075 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-3dfed870-a022-49e0-aeb0-e2a21fda4baa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:38:01.199947 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-3dfed870-a022-49e0-aeb0-e2a21fda4baa admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.452751 Aug 02 06:38:01.200484 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 30/58] 10.222.0.79 () {64 vars in 1235 bytes} [Tue Aug 2 06:38:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:38:02.322390 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-bb705ddc-7b1a-4c56-b45d-3202b051f3b1 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:38:02.323467 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-bb705ddc-7b1a-4c56-b45d-3202b051f3b1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 02 06:38:02.323905 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 29/59] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Aug 2 06:38:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:38:03.007546 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-c9f68581-84ae-4ab1-8b61-5aaf9d4a89f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:38:03.029173 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-c9f68581-84ae-4ab1-8b61-5aaf9d4a89f2 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.567930 Aug 02 06:38:03.029751 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 31/60] 10.222.0.79 () {64 vars in 1235 bytes} [Tue Aug 2 06:38:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:38:04.018640 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-bb705ddc-7b1a-4c56-b45d-3202b051f3b1 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:38:04.020022 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-bb705ddc-7b1a-4c56-b45d-3202b051f3b1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Aug 02 06:38:04.020520 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 30/61] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Aug 2 06:38:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:38:04.596367 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-ab0c53f5-317d-4b92-abf8-f07eb8b78361 admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:38:04.616912 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-ab0c53f5-317d-4b92-abf8-f07eb8b78361 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.455288 Aug 02 06:38:04.617439 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 32/62] 10.222.0.79 () {60 vars in 1202 bytes} [Tue Aug 2 06:38:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:38:56.071117 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-bb705ddc-7b1a-4c56-b45d-3202b051f3b1 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:38:56.071755 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-bb705ddc-7b1a-4c56-b45d-3202b051f3b1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Aug 02 06:38:56.072203 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 31/63] 10.222.0.79 () {54 vars in 930 bytes} [Tue Aug 2 06:38:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:38:56.079454 n-d-851337-3 devstack@n-api.service[110838]: DEBUG dbcounter [-] [110838] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:38:56.528104 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-9170e047-42f8-4914-8bff-d9505fcddd4e admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:38:56.548475 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-9170e047-42f8-4914-8bff-d9505fcddd4e admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.469888 Aug 02 06:38:56.549001 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 33/64] 10.222.0.79 () {60 vars in 1291 bytes} [Tue Aug 2 06:38:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:38:56.569846 n-d-851337-3 devstack@n-api.service[110839]: DEBUG dbcounter [-] [110839] Writing DB stats nova_api:SELECT=14 {{(pid=110839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:38:56.573573 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-4e17c81d-932c-479b-af82-cf4c6571c787 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:38:56.581238 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-4e17c81d-932c-479b-af82-cf4c6571c787 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012936 Aug 02 06:38:56.581748 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 32/65] 10.222.0.79 () {60 vars in 1282 bytes} [Tue Aug 2 06:38:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:38:56.593579 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-aa84d35e-355c-428c-b881-09a9fb795421 admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:38:56.601709 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-aa84d35e-355c-428c-b881-09a9fb795421 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011972 Aug 02 06:38:56.602272 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 34/66] 10.222.0.79 () {60 vars in 1285 bytes} [Tue Aug 2 06:38:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:38:56.614344 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-b9a09c6e-d40f-4ceb-b128-3420290e29b0 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:38:56.622523 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-b9a09c6e-d40f-4ceb-b128-3420290e29b0 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012058 Aug 02 06:38:56.623084 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 33/67] 10.222.0.79 () {60 vars in 1285 bytes} [Tue Aug 2 06:38:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:38:56.636005 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-7bea2c90-715c-4c5f-b141-b90541b59c92 admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:38:56.644702 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-7bea2c90-715c-4c5f-b141-b90541b59c92 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012588 Aug 02 06:38:56.645246 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 35/68] 10.222.0.79 () {60 vars in 1282 bytes} [Tue Aug 2 06:38:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:44:25.319724 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-b9a09c6e-d40f-4ceb-b128-3420290e29b0 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:44:25.320767 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-b9a09c6e-d40f-4ceb-b128-3420290e29b0 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 02 06:44:25.321162 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 34/69] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Aug 2 06:44:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:44:25.461199 n-d-851337-3 devstack@n-api.service[110838]: DEBUG dbcounter [-] [110838] Writing DB stats nova_api:SELECT=6 {{(pid=110838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:44:25.619506 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-3234c34c-54bc-439f-a81c-9bf67312c307 admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:44:25.621925 n-d-851337-3 devstack@n-api.service[110838]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:44:25.621925 n-d-851337-3 devstack@n-api.service[110838]: warnings.warn(msg) Aug 02 06:44:25.623172 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_concurrency.lockutils [None req-3234c34c-54bc-439f-a81c-9bf67312c307 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:44:25.623609 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_concurrency.lockutils [None req-3234c34c-54bc-439f-a81c-9bf67312c307 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:44:25.624473 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_concurrency.lockutils [None req-3234c34c-54bc-439f-a81c-9bf67312c307 admin admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:44:25.624898 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_concurrency.lockutils [None req-3234c34c-54bc-439f-a81c-9bf67312c307 admin admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:44:25.666060 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-3234c34c-54bc-439f-a81c-9bf67312c307 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.206201 Aug 02 06:44:25.666616 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 36/70] 10.222.0.79 () {60 vars in 1193 bytes} [Tue Aug 2 06:44:25 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:44:26.506650 n-d-851337-3 devstack@n-api.service[110839]: DEBUG nova.api.openstack.wsgi [None req-b9a09c6e-d40f-4ceb-b128-3420290e29b0 admin admin] Calling method '>' {{(pid=110839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:44:26.507663 n-d-851337-3 devstack@n-api.service[110839]: INFO nova.api.openstack.requestlog [None req-b9a09c6e-d40f-4ceb-b128-3420290e29b0 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 02 06:44:26.508053 n-d-851337-3 devstack@n-api.service[110839]: [pid: 110839|app: 0|req: 35/71] 10.222.0.79 () {56 vars in 1074 bytes} [Tue Aug 2 06:44:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:44:26.702477 n-d-851337-3 devstack@n-api.service[110838]: DEBUG nova.api.openstack.wsgi [None req-10df828e-e1bf-4b92-b330-8f8c18deed87 admin admin] Calling method '>' {{(pid=110838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:44:26.704858 n-d-851337-3 devstack@n-api.service[110838]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:44:26.704858 n-d-851337-3 devstack@n-api.service[110838]: warnings.warn(msg) Aug 02 06:44:26.706067 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_concurrency.lockutils [None req-10df828e-e1bf-4b92-b330-8f8c18deed87 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:44:26.706505 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_concurrency.lockutils [None req-10df828e-e1bf-4b92-b330-8f8c18deed87 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:44:26.707821 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_concurrency.lockutils [None req-10df828e-e1bf-4b92-b330-8f8c18deed87 admin admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:44:26.708320 n-d-851337-3 devstack@n-api.service[110838]: DEBUG oslo_concurrency.lockutils [None req-10df828e-e1bf-4b92-b330-8f8c18deed87 admin admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:44:26.730423 n-d-851337-3 devstack@n-api.service[110838]: INFO nova.api.openstack.requestlog [None req-10df828e-e1bf-4b92-b330-8f8c18deed87 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.085534 Aug 02 06:44:26.730963 n-d-851337-3 devstack@n-api.service[110838]: [pid: 110838|app: 0|req: 37/72] 10.222.0.79 () {60 vars in 1193 bytes} [Tue Aug 2 06:44:26 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:45:11.128515 n-d-851337-3 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 02 06:45:11.129498 n-d-851337-3 devstack@n-api.service[110835]: Tue Aug 2 06:45:11 2022 - graceful shutdown triggered... Aug 02 06:45:11.130132 n-d-851337-3 devstack@n-api.service[110839]: Gracefully killing worker 2 (pid: 110839)... Aug 02 06:45:11.130542 n-d-851337-3 devstack@n-api.service[110838]: Gracefully killing worker 1 (pid: 110838)... Aug 02 06:45:12.130518 n-d-851337-3 devstack@n-api.service[110835]: worker 1 buried after 1 seconds Aug 02 06:45:12.130518 n-d-851337-3 devstack@n-api.service[110835]: worker 2 buried after 1 seconds Aug 02 06:45:12.130518 n-d-851337-3 devstack@n-api.service[110835]: goodbye to uWSGI. Aug 02 06:45:12.132844 n-d-851337-3 systemd[1]: devstack@n-api.service: Succeeded. Aug 02 06:45:12.133778 n-d-851337-3 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 02 06:45:12.139405 n-d-851337-3 systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 06:45:12.159984 n-d-851337-3 devstack@n-api.service[126108]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 06:45:12.181951 n-d-851337-3 devstack@n-api.service[126108]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 06:45:12 2022] *** Aug 02 06:45:12.183032 n-d-851337-3 devstack@n-api.service[126108]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 06:45:12.183032 n-d-851337-3 devstack@n-api.service[126108]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 06:45:12.183032 n-d-851337-3 devstack@n-api.service[126108]: nodename: n-d-851337-3 Aug 02 06:45:12.183032 n-d-851337-3 devstack@n-api.service[126108]: machine: x86_64 Aug 02 06:45:12.183032 n-d-851337-3 devstack@n-api.service[126108]: clock source: unix Aug 02 06:45:12.183032 n-d-851337-3 devstack@n-api.service[126108]: pcre jit disabled Aug 02 06:45:12.183032 n-d-851337-3 devstack@n-api.service[126108]: detected number of CPU cores: 4 Aug 02 06:45:12.183032 n-d-851337-3 devstack@n-api.service[126108]: current working directory: / Aug 02 06:45:12.183032 n-d-851337-3 devstack@n-api.service[126108]: detected binary path: /usr/bin/uwsgi-core Aug 02 06:45:12.183032 n-d-851337-3 devstack@n-api.service[126108]: your processes number limit is 47680 Aug 02 06:45:12.183032 n-d-851337-3 devstack@n-api.service[126108]: your memory page size is 4096 bytes Aug 02 06:45:12.183032 n-d-851337-3 devstack@n-api.service[126108]: detected max file descriptor number: 2048 Aug 02 06:45:12.183834 n-d-851337-3 devstack@n-api.service[126108]: lock engine: pthread robust mutexes Aug 02 06:45:12.183834 n-d-851337-3 devstack@n-api.service[126108]: thunder lock: enabled Aug 02 06:45:12.183834 n-d-851337-3 devstack@n-api.service[126108]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 06:45:12.183834 n-d-851337-3 devstack@n-api.service[126108]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 06:45:12.223608 n-d-851337-3 devstack@n-api.service[126108]: Python main interpreter initialized at 0x556d8d5319c0 Aug 02 06:45:12.223608 n-d-851337-3 devstack@n-api.service[126108]: python threads support enabled Aug 02 06:45:12.223608 n-d-851337-3 devstack@n-api.service[126108]: your server socket listen backlog is limited to 100 connections Aug 02 06:45:12.223608 n-d-851337-3 devstack@n-api.service[126108]: your mercy for graceful operations on workers is 90 seconds Aug 02 06:45:12.224038 n-d-851337-3 devstack@n-api.service[126108]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 06:45:12.224038 n-d-851337-3 devstack@n-api.service[126108]: *** Operational MODE: preforking *** Aug 02 06:45:12.224338 n-d-851337-3 devstack@n-api.service[126108]: *** uWSGI is running in multiple interpreter mode *** Aug 02 06:45:12.224338 n-d-851337-3 devstack@n-api.service[126108]: spawned uWSGI master process (pid: 126108) Aug 02 06:45:12.224544 n-d-851337-3 systemd[1]: Started Devstack devstack@n-api.service. Aug 02 06:45:12.225185 n-d-851337-3 devstack@n-api.service[126108]: spawned uWSGI worker 1 (pid: 126119, cores: 1) Aug 02 06:45:12.225652 n-d-851337-3 devstack@n-api.service[126108]: spawned uWSGI worker 2 (pid: 126120, cores: 1) Aug 02 06:45:12.225764 n-d-851337-3 devstack@n-api.service[126108]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 06:45:12.877462 n-d-851337-3 devstack@n-api.service[126120]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 06:45:12.878115 n-d-851337-3 devstack@n-api.service[126119]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 06:45:14.028609 n-d-851337-3 devstack@n-api.service[126119]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 06:45:14.028609 n-d-851337-3 devstack@n-api.service[126119]: from cryptography.utils import int_from_bytes Aug 02 06:45:14.029311 n-d-851337-3 devstack@n-api.service[126119]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 06:45:14.029311 n-d-851337-3 devstack@n-api.service[126119]: from cryptography.utils import int_from_bytes Aug 02 06:45:14.029454 n-d-851337-3 devstack@n-api.service[126120]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 06:45:14.029454 n-d-851337-3 devstack@n-api.service[126120]: from cryptography.utils import int_from_bytes Aug 02 06:45:14.030202 n-d-851337-3 devstack@n-api.service[126120]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 06:45:14.030202 n-d-851337-3 devstack@n-api.service[126120]: from cryptography.utils import int_from_bytes Aug 02 06:45:16.451583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 06:45:16.452214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 06:45:16.452495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 06:45:16.452704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 06:45:16.452998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 06:45:16.453392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.453693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.454043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.454396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.454725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.455040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.455371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.455697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.456035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.456297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.456613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.456941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851337-3 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.457260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.457782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.458125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.458448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.458632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 06:45:16.459014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.459100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 06:45:16.459189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.459374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.459474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 06:45:16.459749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 06:45:16.459858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.460007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 06:45:16.460971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.461072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.461163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.461269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.461360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.461447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.461536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.461615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.461703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.461792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.461879 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.462009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.462212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.462329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.462523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.462668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.462854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.462994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.463156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.463297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.463520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.463662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851337-3 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.463846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851337-3 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.463984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.464130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.464268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.464479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.464631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.464892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.465062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.465216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.465348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.465491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.465619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.465793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.466098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.466231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.466356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.466489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.466613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.466759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.466903 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.467214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.467362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.467496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.467629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.467770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.467911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.468037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.468170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.468295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.468426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.468565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.468735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.468876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.469039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.469169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.469372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.469511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.469673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.470199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.470199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.470455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851337-3 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.470671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.470806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.470940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.471067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.471199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.471341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.471467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.471600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.471732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.471868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.472002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.472144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.472283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.472492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.472636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.472762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.472897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.473032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.473167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.473342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.473472 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.473607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.473751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.473884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.474058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.474185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.474310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.474471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.474617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.474751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.474999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.475145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.475275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.475407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.475666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.475863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.476001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.476296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.476443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.476622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.476852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.476993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.477370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.477512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.477648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.477866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.478070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.478223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.478489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.478624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.478812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.479062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.479201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.479414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.479653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.479786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.480048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.480262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.480481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.480701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.480912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.480912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.481324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.481544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.481767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.482052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.482272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.482406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.482593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.482723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.482857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.482983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.483118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.483244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.483449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.483709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.483937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.484152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.484379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.484610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.484867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.485080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.485319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.485451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.485585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.485754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.485883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.486042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.486169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.486302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.486515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.486654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.486654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.486950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.487076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.487076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.487493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.487718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.487718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.487977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.488111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.488111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.488424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.488553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.488553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.488808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.488945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.489158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.489286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.489412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.489537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.489671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.489804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.490034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.490173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.490306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.490438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.490612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.490886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.491150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.491378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.491601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.491822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.492059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.492292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.492504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.492728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.492942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.493156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.493309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.493446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.493581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.493707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.493832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.494025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.494156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.494281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.494413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.494545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.494679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.494819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.494957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.495089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.495223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.495461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.495601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.495741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.495868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.495992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.496192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.496331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.496456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.496671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.496802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.496928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.497062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.497195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.497324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.497613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.497772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.498002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.498144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.498279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.498417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.498417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.498660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.498787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.498918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.499052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.499177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.499302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.499427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.499559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.499690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.499828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.499960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.500085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.500216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.500427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.500555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.500689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.500823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.500823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.500823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.500823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.501305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.501436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.501583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.501583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.501844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.502166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.502501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.502638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.502828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.502950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.503143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.503282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.503489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.503838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.504155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.504504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.504887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.505152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.505521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.505775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.505946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.506128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.506273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.506464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.506604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.506778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.507102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.507419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.507733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.508066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.508358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.508670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.508956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.509095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.509294 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.509437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.509621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.509756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.509950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.510090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.510265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.510396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.510581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.511325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.511325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.511579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.511713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.511847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.511981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.512115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.512251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.512385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.512520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.512647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.512784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.512910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.513024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.513155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.513347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.513485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.513674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 06:45:16.513809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.514004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.514144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.514341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.514482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.514650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.514779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.514968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.515107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.515284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.515420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.515656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.515798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.515933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.516074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.516203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.516328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.516505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.516641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.516813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.516942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.517140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.517277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.517454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.517583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.517855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.518008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.518152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.518371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.518503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.518638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.518773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.518907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.519041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.519167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.519300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.519427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.519613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.519751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.519933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.520070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.520310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.520460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.520638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.520775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.520956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.521085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.521271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.521415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.521607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.521744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.521967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.522113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.522277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.522425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.522605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.522733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.522931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.523053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.523247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.523384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.523552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.523686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.523864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.523998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.524172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.524306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.524482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.524613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.524789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.524931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.525103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.525232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.525406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.525534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.525800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.525961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.526109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.526236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.526369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.526495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.526620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.526752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.526946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.527075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.527259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.527387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.527567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.527711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.527980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.528121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.528248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.528387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.528589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.528738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.528866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.529001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.529127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.529252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.529450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.529657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.529786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.529948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.530091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.530218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.530377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.530518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.530686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.530825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.531005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.531142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.531320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.531448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.531630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.531765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.531942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.532069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.532255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.532383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.532568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.532703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.532886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.533021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.533199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.533326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.533504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.533639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.533819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.533966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.534158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.534301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.534467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.534652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.534793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.534926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.535092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.535233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.535402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.535530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.535730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.535909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.536126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.536256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.536397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.536531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.536656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.536789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.536971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.537107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.537285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.537411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.537598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.537734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.538068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.538211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.538338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.538461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.538619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.538840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.538840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.539088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.539215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.539347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.539481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.539611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.539778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.539907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.540102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.540232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.540411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.540549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.540729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.540857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.541029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.541156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.541342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.541548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.541675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.541807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.541967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.542095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.542264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.542394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.542575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.542711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.542880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.543023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.543187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.543317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.543494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.543629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.543799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.543941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.544102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.544237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.544420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.544550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.544728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.544857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.545034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.545172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.545338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.545475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.545645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.545788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.545968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.546125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.546332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.546461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.546597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.546723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.546856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.546989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.547182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.547318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.547498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.547636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.547822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.547950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.548218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.548354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.548490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.548616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.548743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.548964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.549092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.549226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.549365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.549499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.549624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.549758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.549956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.550101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.550265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.550395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.550611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.550756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.550930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.551078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.551239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.551375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.551611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.551741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.551939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.552082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.552256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.552391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.552574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.552770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.552906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.553041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.553188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.553324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.553511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.553640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.553821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.553986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.554161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.554287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.554474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.554603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.554785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.554944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.555120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.555250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.555405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.555540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.555727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.555864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.556037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.556164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.556398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.556545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.556687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.556824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.556950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.557076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.557258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.557395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.557580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.557707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.557885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.558290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.558443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.558648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.558787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.558914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.559143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.559275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.559412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.559551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.559678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.559802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.559926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.560057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.560276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.560421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.560546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.560682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.560808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.560941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.561087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.561215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.561346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.561532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.561669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.561849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.562038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.562175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.562303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.562485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.562629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.562789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.562925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.563097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.563225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.563402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.563531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.563706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.563834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.564007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.564134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.564317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.564452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.564624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.564753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.564935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.565054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.565240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.565375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.565560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.565698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.565862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.566013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.566189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.566326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.566555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.566698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.566832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.566958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.567120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.567247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.567418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.567557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.567725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.567859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.568060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.568187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.568455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.568612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.568750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.568889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.569022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.569148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.569289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.569501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.569633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.569768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.569948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.570077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.570205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.570331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.570487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.570609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.570807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.570944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.571120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.571257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.571430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.571560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.571740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.571868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.572049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.572190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.572360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.572496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.572669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.572797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.572979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.573107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.573284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.573421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.573591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.573718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.573915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.574059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.574220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.574347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.574531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.574660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.574836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.574977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.575144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.575407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.575566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.575740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.575869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.576048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.576176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.576362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.576498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.576717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.576865 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.577004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.577138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.577264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.577397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.577566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.577704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.577869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.578022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.578205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.578351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.578609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.578740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.578866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.578999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.579481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.579696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.579828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.579954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.580080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.580205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.580338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.580509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.580645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.580779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.580946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.581083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.581250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.581378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.581559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.581688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.581864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.582026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.582190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.582325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.582500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.582648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.582840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.582968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.583155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.583285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.583460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.583596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.583766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.583901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.584075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.584209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.584376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.584513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.584678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.584821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.584980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.585107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.585286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.585424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.585598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.585724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.585937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.586060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.586251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.586383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.586558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.586700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.586919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.587050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.587177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.587303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.587513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.587642 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.587774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.587898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.588075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.588205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.588379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.588517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.588796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.588924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.589049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.589181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.589316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.589455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.589590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.589729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.589992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.590125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.590266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.590393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.590520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.590653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.590770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.590894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.591074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.591212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.591377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.591514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.591697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.591844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.592009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.592139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.592314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.592443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.592618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.592744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.592929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.593058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.593237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.593367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.593539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.593677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.593850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.594011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.594194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.594332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.594509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.594713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.594845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.594977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.595112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.595238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.595413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.595549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.595683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.595818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.595993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.596131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.596299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.596455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.596623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.596758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.597013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.597160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.597301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.597435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.597589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.597715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.597849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.598041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.598180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.598334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.598462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.598587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.598851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.598993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.599121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.599254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.599380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.599515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.599654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.599791 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.599934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.600140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.600277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.600405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.600538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.600672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.600808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.600973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.601119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.601287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.601423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.601594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.601730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.601919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.602052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.602237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.602386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.602559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.602688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.602877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.603015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.603183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.603325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.603487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.603618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.603792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.603930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.604095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.604236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.604441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.604577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.604751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.604880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.605088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.605230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.605403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.605530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.605720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.605848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.606064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.606201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.606373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.606509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.606683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.606812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.606997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.607230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.607363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.607497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.607624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.607749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.607904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.608040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.608217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.608346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.608522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.608659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.608931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.609066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.609200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.609335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.609462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.609640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.609769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.609992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.610150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.610354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.610484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.610621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.610748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.610929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.611058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.611247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.611384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.611555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.611691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.612050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.612190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.612326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.612460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.612601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.612728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.612845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.612960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.613075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.613199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.613342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.613481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.613654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.613793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.614103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.614261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.614390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.614515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.614649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.614821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.614952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.615148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.615285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.615469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.615599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.615795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.615933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.616124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.616265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.616432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.616572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.616736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.616877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.617047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.617178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.617398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.617536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.617662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.618353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.618488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.618625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.618751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.619038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.619206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.619345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.619472 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.619606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.619731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.619856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.620067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.620209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.620351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.620558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.620689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.620820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.620953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.621072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.621205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.621345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.621473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.621611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.621753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.621907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.622049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.622176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.622302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.622436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.622563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.622696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.622822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.622947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.623081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.623207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.623339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.623465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.623597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.623730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.623864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.623990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.624122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.624262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.624422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.624560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.624758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.624888 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.625091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.625221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.625412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.625550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.625748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.625878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.626131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.626272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.626408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.626547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.626719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.626848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.627049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.627188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.627356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.627588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.627726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.627861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.627988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.628113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.628259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.628399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.628565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.628695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.628873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.629136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.629283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.629412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.629557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.629687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.629819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.629965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.630131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.630263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.630458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.630615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.630820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.630958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.631100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.631229 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.631362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.631490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.631674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.631812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.631983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.632126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.632288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.632425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.632634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.632773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.632944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.633074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.633280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.633409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.633591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.633728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.633945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.634080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.634207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.634324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.634531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.634676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.634838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.634976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.635151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.635293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.635463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.635602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.635772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.635902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.636446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.636584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.636756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.636887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.637075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.637211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.637380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.637507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.637734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.637882 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.638031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.638156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.638332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.638462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.638653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.638782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.638961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.639183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.639329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.639516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.639635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.639838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.639942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.640157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.640259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.640460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.640561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.640780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.640897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.641100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.641219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.641418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.641519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.641733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.641834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.642076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.642170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.642386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.642483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.642714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.642813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.643038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.643131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.643352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.643444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.643670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.643770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.643998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.644107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.644300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.644406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.644607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.644712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.644915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.645100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.645286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.645380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.645576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.645686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.645885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.646055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.646219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.646352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.646524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.646663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.646831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.646969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.647137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.647269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.647459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.647589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.647751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.647961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.648100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.648235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.648370 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.648505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.648647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.648781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.648956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.649078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.649399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.649545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.649664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.649818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.649993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.650137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.650306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.650447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.650614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.650751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.650921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.651219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.651361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.651586 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.651745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.651874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.651999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.652153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.652319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.652457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.652582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.652735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.652871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.653066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.653209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.653403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.653544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.653726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.653856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.654068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.654219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.654380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.654509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.654689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.654823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.655004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.655142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.655321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.655447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.655630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.655853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.655990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.656190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.656317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.656505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.656633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.656820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.656955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.657138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.657266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.657455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.657703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.657840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.658093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.658224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.658405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.658532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.658722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.658851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.659036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.659165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.659411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.659629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.659767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.659907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.660041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.660177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.660311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.660437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.660570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.660711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.660915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.661048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.661240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.661375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.661549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.661669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.661855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.661984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.662199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.662293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.662517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.662612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.662827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.662919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.663143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.663235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.663451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.663542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.663761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.663862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.664079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.664231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.664376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.664504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.664680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.664810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.664994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.665132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.665305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.665443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.665611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.665739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.665939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.666092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.666251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.666388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.666569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.666699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.666878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.667016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.667194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.667331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.667503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.667632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.667818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.667955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.668126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.668341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.668478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.668660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.668798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.668995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.669131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.669323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.669467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.669724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.669865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.670018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.670144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.670282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.670409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.670600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.670744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.670908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.671037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.671215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.671347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.671577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.671787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.671925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.672052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.672177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.672426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.672564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.672739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.672876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.673047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.673177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.673371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.673520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.673684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.673826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.674103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.674242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.674417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.674630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.674768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.674902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.675036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.675205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.675344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.675533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.675683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.675851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.675980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.676166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.676303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.676540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.676676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.676850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.676987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.677159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.677328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.677508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.677647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.677824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.678016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.678149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.678284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.678449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.678578 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.678762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.678892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.679075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.679205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.679379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.679509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.679794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.679945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.680084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.680219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.680338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.680471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.680607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.680734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.680897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.681027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.681203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.681333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.681516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.681778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.681939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.682081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.682211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.682336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.682461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.682604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.682732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.682867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.683034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.683162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.683322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.683485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.683624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.683795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.683927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.684222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.684356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.684529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.684659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.684841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.684971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.685164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.685301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.685488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.685618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.685799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.686001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.686132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.686267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.686437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.686567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.686787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.686930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.687067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.687208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.687408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.687546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.687752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.687889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.688085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.688217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.688409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.688536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.688720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.688962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.689101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.689296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.689433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.689617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.689746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.690031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.690182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.690313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.690448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.690575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.690701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.690860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.691000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.691177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.691315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.691488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.691618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.691854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.691993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.692154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.692289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.719422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.719817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.719971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.720101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.720921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.721124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.721368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.721791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.722780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.723061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.723198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.723491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.723977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.724218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.724435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.724734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.725055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.725181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.725274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.725364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.725364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.725563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.725683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.725807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.725807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.726271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.726816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.726971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.727120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.727254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.727408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.727603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.727725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.727840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.727966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.728147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.728651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.728923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.729026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.729227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.729373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.729553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.729553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.729964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.730107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.730296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.730527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.730951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.731405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.732393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.732615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.732830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.732830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.733592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.733871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.734043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.734176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.734300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.734461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.734733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.735212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.735560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.735662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.735755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.735848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.735950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.736044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.736143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.736239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.736365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.736543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.736658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.736753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.736845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.736936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.737968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.738916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.739100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.739174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.739242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.739309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.739377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.739455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.739526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.739592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.739660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.739771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.739842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.739926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 06:45:16.740208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.740655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.741807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.742818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.743375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.743375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.743375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.743375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.743375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.743375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.743375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.743375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 06:45:16.743848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 06:45:16.784456 n-d-851337-3 devstack@n-api.service[126119]: INFO dbcounter [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] Registered counter for database nova_api Aug 02 06:45:16.806080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_db.sqlalchemy.engines [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:45:16.806529 n-d-851337-3 devstack@n-api.service[126120]: INFO dbcounter [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] Registered counter for database nova_api Aug 02 06:45:16.813566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writer thread running {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:45:16.829010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_db.sqlalchemy.engines [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:45:16.836121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writer thread running {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:45:16.869623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.context [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3b7f982-e927-4a3f-b699-817c726d55c4(cell1) {{(pid=126119) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 06:45:16.873779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:45:16.875424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:45:16.876228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:45:16.878435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:45:16.880371 n-d-851337-3 devstack@n-api.service[126119]: INFO dbcounter [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] Registered counter for database nova_cell0 Aug 02 06:45:16.884518 n-d-851337-3 devstack@n-api.service[126119]: INFO dbcounter [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] Registered counter for database nova_cell1 Aug 02 06:45:16.891877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_db.sqlalchemy.engines [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:45:16.893563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.context [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3b7f982-e927-4a3f-b699-817c726d55c4(cell1) {{(pid=126120) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 06:45:16.896908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_db.sqlalchemy.engines [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:45:16.897856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:45:16.898503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writer thread running {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:45:16.899468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:45:16.900257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:45:16.902275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:45:16.904308 n-d-851337-3 devstack@n-api.service[126120]: INFO dbcounter [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] Registered counter for database nova_cell0 Aug 02 06:45:16.908348 n-d-851337-3 devstack@n-api.service[126120]: INFO dbcounter [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] Registered counter for database nova_cell1 Aug 02 06:45:16.917329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_db.sqlalchemy.engines [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:45:16.918122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_db.sqlalchemy.engines [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:45:16.925229 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writer thread running {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:45:16.926530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writer thread running {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:45:17.041201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writer thread running {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:45:17.050631 n-d-851337-3 devstack@n-api.service[126119]: INFO dbcounter [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] Registered counter for database nova_cell0 Aug 02 06:45:17.057700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_db.sqlalchemy.engines [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:45:17.062675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writer thread running {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:45:17.072916 n-d-851337-3 devstack@n-api.service[126120]: INFO dbcounter [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] Registered counter for database nova_cell0 Aug 02 06:45:17.080624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_db.sqlalchemy.engines [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 06:45:17.086076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writer thread running {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 06:45:17.375083 n-d-851337-3 devstack@n-api.service[126119]: WARNING keystonemiddleware.auth_token [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 06:45:17.383326 n-d-851337-3 devstack@n-api.service[126119]: WARNING keystonemiddleware.auth_token [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 06:45:17.410346 n-d-851337-3 devstack@n-api.service[126120]: WARNING keystonemiddleware.auth_token [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 06:45:17.417693 n-d-851337-3 devstack@n-api.service[126120]: WARNING keystonemiddleware.auth_token [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 06:45:17.726437 n-d-851337-3 devstack@n-api.service[126119]: WARNING keystonemiddleware.auth_token [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 06:45:17.732467 n-d-851337-3 devstack@n-api.service[126119]: WARNING keystonemiddleware.auth_token [None req-b11f1338-9293-4b69-938f-5f2f1879f1ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 06:45:17.737757 n-d-851337-3 devstack@n-api.service[126119]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556d8d5319c0 pid: 126119 (default app) Aug 02 06:45:17.758851 n-d-851337-3 devstack@n-api.service[126120]: WARNING keystonemiddleware.auth_token [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 06:45:17.765236 n-d-851337-3 devstack@n-api.service[126120]: WARNING keystonemiddleware.auth_token [None req-7b4311a5-5d93-4be2-9cf8-0f21291287c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 06:45:17.770606 n-d-851337-3 devstack@n-api.service[126120]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556d8d5319c0 pid: 126120 (default app) Aug 02 06:46:03.036340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:03.037164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:03.038152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:03.039127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:04.489197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:04.494740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:04.495523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:04.499030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:04.890763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8c6179a7-33bf-4033-8be4-c420166fba7f tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '.version_select at 0x7f9289b90ee0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:04.891756 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:04.891756 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:04.907853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8c6179a7-33bf-4033-8be4-c420166fba7f tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3b7f982-e927-4a3f-b699-817c726d55c4(cell1) {{(pid=126119) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 02 06:46:04.912260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c6179a7-33bf-4033-8be4-c420166fba7f tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:04.914682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c6179a7-33bf-4033-8be4-c420166fba7f tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:04.977534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c6179a7-33bf-4033-8be4-c420166fba7f tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:04.979509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c6179a7-33bf-4033-8be4-c420166fba7f tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:05.009684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c6179a7-33bf-4033-8be4-c420166fba7f tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:05.015672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c6179a7-33bf-4033-8be4-c420166fba7f tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:05.032667 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8c6179a7-33bf-4033-8be4-c420166fba7f tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 2.003093 Aug 02 06:46:05.035256 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1/1] 10.222.0.79 () {58 vars in 1167 bytes} [Tue Aug 2 06:46:03 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 2007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:05.486035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-61fc2cdc-55bc-4622-bd97-001d5bfb4c61 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-982603721", "ram": 512, "vcpus": 1, "disk": 10, "id": 1790025248, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:05.527343 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:05.527343 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:05.599684 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-61fc2cdc-55bc-4622-bd97-001d5bfb4c61 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.561272 Aug 02 06:46:05.600499 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2/2] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:05 2022] POST /compute/v2.1/flavors => generated 415 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:05.810178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e89d07ae-39a4-4429-bb49-aecdaad747a8 tempest-FlavorMetadataValidation-930867420 tempest-FlavorMetadataValidation-930867420-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-380285544", "id": 788873235, "os-flavor-access:is_public": "True"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:05.857722 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e89d07ae-39a4-4429-bb49-aecdaad747a8 tempest-FlavorMetadataValidation-930867420 tempest-FlavorMetadataValidation-930867420-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.254659 Aug 02 06:46:05.864320 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3/3] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 06:46:05 2022] POST /compute/v2.1/flavors => generated 467 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:46:05.889386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-eac623a2-ab9a-44e9-9e44-966da968bb78 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1011670100", "name": "tempest-test_aggregate-1449536583"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:05.936735 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:05.936735 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:05.939095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.aggregate [None req-eac623a2-ab9a-44e9-9e44-966da968bb78 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Generated uuid f4f27638-1e1e-4531-aa5a-8faf22084bdb for aggregate {{(pid=126119) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:06.042525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ee0bb946-726d-428e-bc61-55477247f15d tempest-AZAdminNegativeTestJSON-1824447534 tempest-AZAdminNegativeTestJSON-1824447534-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:06.044641 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:06.044641 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:06.046400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ee0bb946-726d-428e-bc61-55477247f15d tempest-AZAdminNegativeTestJSON-1824447534 tempest-AZAdminNegativeTestJSON-1824447534-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'cc76c0a694614addbd6cd5cb3d76b702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a051bb4ce74844aa9e1a94378ba770f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ee0bb946-726d-428e-bc61-55477247f15d tempest-AZAdminNegativeTestJSON-1824447534 tempest-AZAdminNegativeTestJSON-1824447534-project] Request method failure captured: Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mgp8QJ9UXm2CAUNHF0oUcB7q9akJYtOfYJ5Z3sutM7K1C-GwsrWMq0S5-RCNOpNe-GFQx0Q2y2-YPmVcuxOO4NtS0YF0ED045mq3z4jpeBThfO0OYs9aW2Q7QajieuLVOKkVpEke4_c6FOYHKCQyagBvwURdwknQpyJs4CJHnOZhcs Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a051bb4ce74844aa9e1a94378ba770f8 Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1824447534 Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:06.050875 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:06.052411 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a051bb4ce74844aa9e1a94378ba770f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a051bb4ce74844aa9e1a94378ba770f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a051bb4ce74844aa9e1a94378ba770f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a051bb4ce74844aa9e1a94378ba770f8"}]}] Aug 02 06:46:06.052411 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AZAdminNegativeTestJSON-1824447534 Aug 02 06:46:06.052411 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a051bb4ce74844aa9e1a94378ba770f8 Aug 02 06:46:06.052411 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1824447534 Aug 02 06:46:06.052411 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AZAdminNegativeTestJSON-1824447534-project Aug 02 06:46:06.052411 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:06.052411 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:06.052411 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: cc76c0a694614addbd6cd5cb3d76b702 Aug 02 06:46:06.052411 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AZAdminNegativeTestJSON-1824447534-project Aug 02 06:46:06.052411 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:06.052411 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 02 06:46:06.052411 n-d-851337-3 devstack@n-api.service[126120]: action_args: {} Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:06.053282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:06.054986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ee0bb946-726d-428e-bc61-55477247f15d tempest-AZAdminNegativeTestJSON-1824447534 tempest-AZAdminNegativeTestJSON-1824447534-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:06.057097 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ee0bb946-726d-428e-bc61-55477247f15d tempest-AZAdminNegativeTestJSON-1824447534 tempest-AZAdminNegativeTestJSON-1824447534-project] 10.222.0.79 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.585114 Aug 02 06:46:06.057097 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1/4] 10.222.0.79 () {58 vars in 1185 bytes} [Tue Aug 2 06:46:04 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1587 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:46:06.083342 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-eac623a2-ab9a-44e9-9e44-966da968bb78 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.217847 Aug 02 06:46:06.085028 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 4/5] 10.222.0.79 () {60 vars in 1165 bytes} [Tue Aug 2 06:46:05 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:06.355165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c5840478-904d-4d25-a552-a39326871dc6 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Calling method '.version_select at 0x7f9289a6b0d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:06.362855 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:06.362855 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:06.375774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c5840478-904d-4d25-a552-a39326871dc6 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3b7f982-e927-4a3f-b699-817c726d55c4(cell1) {{(pid=126120) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 02 06:46:06.380647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5840478-904d-4d25-a552-a39326871dc6 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:06.381453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5840478-904d-4d25-a552-a39326871dc6 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:06.470981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5840478-904d-4d25-a552-a39326871dc6 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:06.475415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5840478-904d-4d25-a552-a39326871dc6 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:06.495458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5840478-904d-4d25-a552-a39326871dc6 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:06.496031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5840478-904d-4d25-a552-a39326871dc6 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:06.512422 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c5840478-904d-4d25-a552-a39326871dc6 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.455534 Aug 02 06:46:06.513010 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2/6] 10.222.0.79 () {60 vars in 1208 bytes} [Tue Aug 2 06:46:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:06.542129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-38641da2-a8b7-4556-8f43-28714df44ef5 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:06.547006 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:06.547006 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:06.548342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38641da2-a8b7-4556-8f43-28714df44ef5 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:06.548794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38641da2-a8b7-4556-8f43-28714df44ef5 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:06.549643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38641da2-a8b7-4556-8f43-28714df44ef5 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:06.550128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38641da2-a8b7-4556-8f43-28714df44ef5 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:06.620190 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-38641da2-a8b7-4556-8f43-28714df44ef5 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.533575 Aug 02 06:46:06.621627 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 5/7] 10.222.0.79 () {58 vars in 1176 bytes} [Tue Aug 2 06:46:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:06.632048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9e9b6df0-dc06-4047-b7bf-dcc213fc8d9e tempest-FlavorMetadataValidation-930867420 tempest-FlavorMetadataValidation-930867420-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:06.635936 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:06.635936 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:06.833015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5c7863d4-bb55-466b-a0da-e36ecee931b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:06.867170 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9e9b6df0-dc06-4047-b7bf-dcc213fc8d9e tempest-FlavorMetadataValidation-930867420 tempest-FlavorMetadataValidation-930867420-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/788873235/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.244152 Aug 02 06:46:06.868042 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 6/8] 10.222.0.79 () {62 vars in 1262 bytes} [Tue Aug 2 06:46:06 2022] POST /compute/v2.1/flavors/788873235/os-extra_specs => generated 62 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:06.878280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7694077c-b0b5-4282-a93f-8bc4731eb980 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:06.879447 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:06.879447 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:06.893103 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-5c7863d4-bb55-466b-a0da-e36ecee931b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] HTTP exception thrown: Flavor 1790025248 has no extra specs with key hw:cpu_thread_policy. Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5c7863d4-bb55-466b-a0da-e36ecee931b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Request method failure captured: Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/flavors/1790025248/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mgp9litJlPUJHH5Yr_OyZEfGick2A8isVOS7lr3_vWVTYX9DEvR5XpBDaVBMaRnn_48ju-z1FlJLoXiwWC46CDh2yaW73_cmTE_to7gPKNyN4DE67Jms7bsTG7Z15tELLi1CQN58Od-OSDjpS88BeGXlGoVSF7hyWUBYw7TbcWmayE Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 374b260008804c8b89ce84f4caf8e51e Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:06.895380 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:06.896480 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/374b260008804c8b89ce84f4caf8e51e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/374b260008804c8b89ce84f4caf8e51e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_374b260008804c8b89ce84f4caf8e51e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/374b260008804c8b89ce84f4caf8e51e"}]}] Aug 02 06:46:06.896480 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 Aug 02 06:46:06.896480 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 374b260008804c8b89ce84f4caf8e51e Aug 02 06:46:06.896480 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 Aug 02 06:46:06.896480 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project Aug 02 06:46:06.896480 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:06.896480 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:06.896480 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 91b04f845b214a7babf656d5ba2b2e8e Aug 02 06:46:06.896480 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project Aug 02 06:46:06.896480 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:06.896480 n-d-851337-3 devstack@n-api.service[126120]: exception: Flavor 1790025248 has no extra specs with key hw:cpu_thread_policy. Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'flavor_id': '1790025248', 'id': 'hw:cpu_thread_policy'} Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1790025248 has no extra specs with key hw:cpu_thread_policy. Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:06.897030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:06.898194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:06.898194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:06.898194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:06.898194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:06.898194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:06.898194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1790025248 has no extra specs with key hw:cpu_thread_policy. Aug 02 06:46:06.898194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:06.903532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5c7863d4-bb55-466b-a0da-e36ecee931b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Returning 404 to user: Flavor 1790025248 has no extra specs with key hw:cpu_thread_policy. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:06.904104 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7694077c-b0b5-4282-a93f-8bc4731eb980 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.033686 Aug 02 06:46:06.904702 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 7/9] 10.222.0.79 () {58 vars in 1143 bytes} [Tue Aug 2 06:46:06 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:06.906589 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5c7863d4-bb55-466b-a0da-e36ecee931b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] 10.222.0.79 "GET /compute/v2.1/flavors/1790025248/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.390839 Aug 02 06:46:06.914472 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3/10] 10.222.0.79 () {58 vars in 1266 bytes} [Tue Aug 2 06:46:06 2022] GET /compute/v2.1/flavors/1790025248/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:06.915844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d211ebbf-b127-40a1-b14f-89d2cad4dc43 tempest-FlavorMetadataValidation-930867420 tempest-FlavorMetadataValidation-930867420-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:06.919118 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:06.919118 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:06.927564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5e05f677-1cd4-4142-a82a-2c6d77d17a31 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:06.939207 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:06.939207 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:06.940574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5e05f677-1cd4-4142-a82a-2c6d77d17a31 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '91b04f845b214a7babf656d5ba2b2e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b260008804c8b89ce84f4caf8e51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5e05f677-1cd4-4142-a82a-2c6d77d17a31 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Request method failure captured: Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/flavors/1790025248/os-extra_specs HTTP/1.1 Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 66 Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mgp9litJlPUJHH5Yr_OyZEfGick2A8isVOS7lr3_vWVTYX9DEvR5XpBDaVBMaRnn_48ju-z1FlJLoXiwWC46CDh2yaW73_cmTE_to7gPKNyN4DE67Jms7bsTG7Z15tELLi1CQN58Od-OSDjpS88BeGXlGoVSF7hyWUBYw7TbcWmayE Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 374b260008804c8b89ce84f4caf8e51e Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:06.944260 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:06.945329 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/374b260008804c8b89ce84f4caf8e51e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/374b260008804c8b89ce84f4caf8e51e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_374b260008804c8b89ce84f4caf8e51e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/374b260008804c8b89ce84f4caf8e51e"}]}] Aug 02 06:46:06.945329 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 Aug 02 06:46:06.945329 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 374b260008804c8b89ce84f4caf8e51e Aug 02 06:46:06.945329 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 Aug 02 06:46:06.945329 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project Aug 02 06:46:06.945329 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:06.945329 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:06.945329 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 91b04f845b214a7babf656d5ba2b2e8e Aug 02 06:46:06.945329 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project Aug 02 06:46:06.945329 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:46:06.945329 n-d-851337-3 devstack@n-api.service[126120]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 02 06:46:06.945329 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'flavor_id': '1790025248', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:06.946615 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 02 06:46:06.947525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:06.950019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5e05f677-1cd4-4142-a82a-2c6d77d17a31 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:06.950929 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5e05f677-1cd4-4142-a82a-2c6d77d17a31 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] 10.222.0.79 "POST /compute/v2.1/flavors/1790025248/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.035184 Aug 02 06:46:06.957097 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 4/11] 10.222.0.79 () {60 vars in 1224 bytes} [Tue Aug 2 06:46:06 2022] POST /compute/v2.1/flavors/1790025248/os-extra_specs => generated 124 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:06.964006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d539cad1-1007-4fe8-9896-46dc73dadd43 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-3"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:06.967927 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:06.967927 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:06.987355 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d211ebbf-b127-40a1-b14f-89d2cad4dc43 tempest-FlavorMetadataValidation-930867420 tempest-FlavorMetadataValidation-930867420-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/788873235" status: 202 len: 0 microversion: 2.86 time: 0.079600 Aug 02 06:46:06.988367 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 8/12] 10.222.0.79 () {60 vars in 1199 bytes} [Tue Aug 2 06:46:06 2022] DELETE /compute/v2.1/flavors/788873235 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:46:07.000062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d540bce8-843f-41f1-8a9e-9b080c86b71e tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:07.003110 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:07.003110 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:07.012395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d539cad1-1007-4fe8-9896-46dc73dadd43 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:07.013959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d539cad1-1007-4fe8-9896-46dc73dadd43 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:07.053612 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d540bce8-843f-41f1-8a9e-9b080c86b71e tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1790025248/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.064050 Aug 02 06:46:07.054458 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 9/13] 10.222.0.79 () {60 vars in 1224 bytes} [Tue Aug 2 06:46:06 2022] POST /compute/v2.1/flavors/1790025248/os-extra_specs => generated 66 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:46:07.064668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-59303dc4-32a9-4370-b2e6-326da660d716 tempest-FlavorMetadataValidation-930867420 tempest-FlavorMetadataValidation-930867420-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:07.141652 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-59303dc4-32a9-4370-b2e6-326da660d716 tempest-FlavorMetadataValidation-930867420 tempest-FlavorMetadataValidation-930867420-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 6269 microversion: 2.86 time: 0.085248 Aug 02 06:46:07.145945 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 10/14] 10.222.0.79 () {60 vars in 1187 bytes} [Tue Aug 2 06:46:07 2022] GET /compute/v2.1/flavors/detail => generated 6269 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:07.166689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a4f93b9b-c28b-4b26-a1d2-cb3ccae19b15 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:07.167565 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:07.167565 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:07.172766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a4f93b9b-c28b-4b26-a1d2-cb3ccae19b15 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '91b04f845b214a7babf656d5ba2b2e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b260008804c8b89ce84f4caf8e51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a4f93b9b-c28b-4b26-a1d2-cb3ccae19b15 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Request method failure captured: Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/flavors/1790025248/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mgp9litJlPUJHH5Yr_OyZEfGick2A8isVOS7lr3_vWVTYX9DEvR5XpBDaVBMaRnn_48ju-z1FlJLoXiwWC46CDh2yaW73_cmTE_to7gPKNyN4DE67Jms7bsTG7Z15tELLi1CQN58Od-OSDjpS88BeGXlGoVSF7hyWUBYw7TbcWmayE Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 374b260008804c8b89ce84f4caf8e51e Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:46:07.186002 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:46:07.187429 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/374b260008804c8b89ce84f4caf8e51e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/374b260008804c8b89ce84f4caf8e51e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_374b260008804c8b89ce84f4caf8e51e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/374b260008804c8b89ce84f4caf8e51e"}]}] Aug 02 06:46:07.187429 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 Aug 02 06:46:07.187429 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 374b260008804c8b89ce84f4caf8e51e Aug 02 06:46:07.187429 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 Aug 02 06:46:07.187429 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project Aug 02 06:46:07.187429 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:07.187429 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:07.187429 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 91b04f845b214a7babf656d5ba2b2e8e Aug 02 06:46:07.187429 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project Aug 02 06:46:07.187429 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:07.187429 n-d-851337-3 devstack@n-api.service[126119]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'flavor_id': '1790025248', 'id': 'hw:numa_nodes'} Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:07.188175 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.189587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a4f93b9b-c28b-4b26-a1d2-cb3ccae19b15 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:07.195448 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a4f93b9b-c28b-4b26-a1d2-cb3ccae19b15 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] 10.222.0.79 "DELETE /compute/v2.1/flavors/1790025248/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.051562 Aug 02 06:46:07.196810 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 11/15] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 06:46:07 2022] DELETE /compute/v2.1/flavors/1790025248/os-extra_specs/hw:numa_nodes => generated 124 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:07.207207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-411927ae-893b-415b-9176-6910809ad71e tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:07.238104 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-411927ae-893b-415b-9176-6910809ad71e tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1790025248/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034883 Aug 02 06:46:07.239711 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 12/16] 10.222.0.79 () {60 vars in 1224 bytes} [Tue Aug 2 06:46:07 2022] POST /compute/v2.1/flavors/1790025248/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:46:07.254780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e3cd1b6e-05db-4475-8c45-ec3ceff9c25f tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:07.261793 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:07.261793 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:07.266854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e3cd1b6e-05db-4475-8c45-ec3ceff9c25f tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '91b04f845b214a7babf656d5ba2b2e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b260008804c8b89ce84f4caf8e51e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e3cd1b6e-05db-4475-8c45-ec3ceff9c25f tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Request method failure captured: Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: request: PUT /compute/v2.1/flavors/1790025248/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 22 Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mgp9litJlPUJHH5Yr_OyZEfGick2A8isVOS7lr3_vWVTYX9DEvR5XpBDaVBMaRnn_48ju-z1FlJLoXiwWC46CDh2yaW73_cmTE_to7gPKNyN4DE67Jms7bsTG7Z15tELLi1CQN58Od-OSDjpS88BeGXlGoVSF7hyWUBYw7TbcWmayE Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 374b260008804c8b89ce84f4caf8e51e Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:46:07.270486 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:46:07.271611 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/374b260008804c8b89ce84f4caf8e51e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/374b260008804c8b89ce84f4caf8e51e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_374b260008804c8b89ce84f4caf8e51e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/374b260008804c8b89ce84f4caf8e51e"}]}] Aug 02 06:46:07.271611 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 Aug 02 06:46:07.271611 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 374b260008804c8b89ce84f4caf8e51e Aug 02 06:46:07.271611 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 Aug 02 06:46:07.271611 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project Aug 02 06:46:07.271611 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:07.271611 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:07.271611 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 91b04f845b214a7babf656d5ba2b2e8e Aug 02 06:46:07.271611 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project Aug 02 06:46:07.271611 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:46:07.271611 n-d-851337-3 devstack@n-api.service[126119]: {"hw:numa_nodes": "1"} Aug 02 06:46:07.271611 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:07.271611 n-d-851337-3 devstack@n-api.service[126119]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'flavor_id': '1790025248', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:07.272295 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 02 06:46:07.273190 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.274200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e3cd1b6e-05db-4475-8c45-ec3ceff9c25f tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:07.274200 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e3cd1b6e-05db-4475-8c45-ec3ceff9c25f tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580 tempest-FlavorsExtraSpecsNegativeTestJSON-1857194580-project] 10.222.0.79 "PUT /compute/v2.1/flavors/1790025248/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.026544 Aug 02 06:46:07.275882 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 13/17] 10.222.0.79 () {60 vars in 1265 bytes} [Tue Aug 2 06:46:07 2022] PUT /compute/v2.1/flavors/1790025248/os-extra_specs/hw:numa_nodes => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:46:07.284232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b037638c-36e9-4661-8312-5eea73a77e4b tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:07.295003 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-b037638c-36e9-4661-8312-5eea73a77e4b tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] HTTP exception thrown: Flavor 1790025248 has no extra specs with key hw:cpu_thread_policy. Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b037638c-36e9-4661-8312-5eea73a77e4b tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] Request method failure captured: Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/flavors/1790025248/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mgsnp-WPUDENuewPDt6b6cw2D7IebfrqvXaMcJUZXSE4EjfulzsfhSDUZZhNas36m_hG2sVyih2vF75esYjlTJRMEVWJVpErI9WQ3WwMFmWnRMDt9cdn5aLlTJFBRH1Sk0JHOPYIAVIKvS0HD6ldfGgSxSD5Vl5TPj0dLbh9v-wvAY Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: d4bb7f7f170145569111d32d36903014 Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:46:07.298121 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:46:07.299244 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d4bb7f7f170145569111d32d36903014"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d4bb7f7f170145569111d32d36903014"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d4bb7f7f170145569111d32d36903014"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d4bb7f7f170145569111d32d36903014"}]}] Aug 02 06:46:07.299244 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 Aug 02 06:46:07.299244 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: d4bb7f7f170145569111d32d36903014 Aug 02 06:46:07.299244 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 Aug 02 06:46:07.299244 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin Aug 02 06:46:07.299244 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:07.299244 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:07.299244 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: ab3dba8089ed4332b285a598774b2793 Aug 02 06:46:07.299244 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin Aug 02 06:46:07.299244 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:07.299244 n-d-851337-3 devstack@n-api.service[126119]: exception: Flavor 1790025248 has no extra specs with key hw:cpu_thread_policy. Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'flavor_id': '1790025248', 'id': 'hw:cpu_thread_policy'} Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1790025248 has no extra specs with key hw:cpu_thread_policy. Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:07.299852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.300883 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:07.300883 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:07.300883 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:07.300883 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:07.300883 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:07.300883 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1790025248 has no extra specs with key hw:cpu_thread_policy. Aug 02 06:46:07.300883 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.300883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b037638c-36e9-4661-8312-5eea73a77e4b tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] Returning 404 to user: Flavor 1790025248 has no extra specs with key hw:cpu_thread_policy. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:07.300883 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b037638c-36e9-4661-8312-5eea73a77e4b tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1790025248/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.019984 Aug 02 06:46:07.301829 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 14/18] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 06:46:07 2022] DELETE /compute/v2.1/flavors/1790025248/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:07.324570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-eebbf7af-6850-494f-a80b-8a0af39f71fa tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:07.334212 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-eebbf7af-6850-494f-a80b-8a0af39f71fa tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-eebbf7af-6850-494f-a80b-8a0af39f71fa tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] Request method failure captured: Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: request: PUT /compute/v2.1/flavors/1790025248/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 27 Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mgsnp-WPUDENuewPDt6b6cw2D7IebfrqvXaMcJUZXSE4EjfulzsfhSDUZZhNas36m_hG2sVyih2vF75esYjlTJRMEVWJVpErI9WQ3WwMFmWnRMDt9cdn5aLlTJFBRH1Sk0JHOPYIAVIKvS0HD6ldfGgSxSD5Vl5TPj0dLbh9v-wvAY Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: d4bb7f7f170145569111d32d36903014 Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:46:07.336499 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:46:07.337614 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d4bb7f7f170145569111d32d36903014"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d4bb7f7f170145569111d32d36903014"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d4bb7f7f170145569111d32d36903014"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d4bb7f7f170145569111d32d36903014"}]}] Aug 02 06:46:07.337614 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 Aug 02 06:46:07.337614 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: d4bb7f7f170145569111d32d36903014 Aug 02 06:46:07.337614 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 Aug 02 06:46:07.337614 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin Aug 02 06:46:07.337614 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:07.337614 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:07.337614 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: ab3dba8089ed4332b285a598774b2793 Aug 02 06:46:07.337614 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin Aug 02 06:46:07.337614 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:46:07.337614 n-d-851337-3 devstack@n-api.service[126119]: {"hw:cpu_policy": "shared"} Aug 02 06:46:07.337614 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:07.337614 n-d-851337-3 devstack@n-api.service[126119]: exception: Request body and URI mismatch Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'flavor_id': '1790025248', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:07.338347 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:07.339270 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:07.339270 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:07.339270 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 02 06:46:07.339270 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.339270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-eebbf7af-6850-494f-a80b-8a0af39f71fa tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:07.341358 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-eebbf7af-6850-494f-a80b-8a0af39f71fa tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/1790025248/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.030867 Aug 02 06:46:07.342393 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 15/19] 10.222.0.79 () {60 vars in 1265 bytes} [Tue Aug 2 06:46:07 2022] PUT /compute/v2.1/flavors/1790025248/os-extra_specs/hw:numa_nodes => generated 73 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 02 06:46:07.355897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5c1a9951-4138-47a4-99af-c15a1daabd6c tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5c1a9951-4138-47a4-99af-c15a1daabd6c tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] Request method failure captured: Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: request: PUT /compute/v2.1/flavors/1790025248/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 49 Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mgsnp-WPUDENuewPDt6b6cw2D7IebfrqvXaMcJUZXSE4EjfulzsfhSDUZZhNas36m_hG2sVyih2vF75esYjlTJRMEVWJVpErI9WQ3WwMFmWnRMDt9cdn5aLlTJFBRH1Sk0JHOPYIAVIKvS0HD6ldfGgSxSD5Vl5TPj0dLbh9v-wvAY Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: d4bb7f7f170145569111d32d36903014 Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:46:07.361529 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:46:07.362955 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d4bb7f7f170145569111d32d36903014"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d4bb7f7f170145569111d32d36903014"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d4bb7f7f170145569111d32d36903014"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d4bb7f7f170145569111d32d36903014"}]}] Aug 02 06:46:07.362955 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 Aug 02 06:46:07.362955 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: d4bb7f7f170145569111d32d36903014 Aug 02 06:46:07.362955 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 Aug 02 06:46:07.362955 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin Aug 02 06:46:07.362955 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:07.362955 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:07.362955 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: ab3dba8089ed4332b285a598774b2793 Aug 02 06:46:07.362955 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin Aug 02 06:46:07.362955 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:46:07.362955 n-d-851337-3 devstack@n-api.service[126119]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 02 06:46:07.362955 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'flavor_id': '1790025248', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance: Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 02 06:46:07.367896 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.369077 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:07.370069 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:07.370069 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:07.370069 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:46:07.370069 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:46:07.370069 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 02 06:46:07.370069 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:07.370069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5c1a9951-4138-47a4-99af-c15a1daabd6c tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:07.370069 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5c1a9951-4138-47a4-99af-c15a1daabd6c tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/1790025248/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.012236 Aug 02 06:46:07.370069 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 16/20] 10.222.0.79 () {60 vars in 1265 bytes} [Tue Aug 2 06:46:07 2022] PUT /compute/v2.1/flavors/1790025248/os-extra_specs/hw:numa_nodes => generated 117 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:46:07.372478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-49250603-4c58-45b7-bcab-3d09794c307f tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:07.395190 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-49250603-4c58-45b7-bcab-3d09794c307f tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1790025248" status: 202 len: 0 microversion: 2.1 time: 0.026258 Aug 02 06:46:07.398833 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 17/21] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:46:07 2022] DELETE /compute/v2.1/flavors/1790025248 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:07.412695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a2eee1d2-4a7a-4fbc-9faf-620c9c718cde tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:07.436762 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a2eee1d2-4a7a-4fbc-9faf-620c9c718cde tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991 tempest-FlavorsExtraSpecsNegativeTestJSON-1887381991-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031698 Aug 02 06:46:07.437881 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 18/22] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:08.404862 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d539cad1-1007-4fe8-9896-46dc73dadd43 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 1.445480 Aug 02 06:46:08.406864 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 5/23] 10.222.0.79 () {60 vars in 1191 bytes} [Tue Aug 2 06:46:06 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:09.594903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1120863254", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "availability_zone": "tempest-test_az-1011670100"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:09.637511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:09.638322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:09.639522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:09.640220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:09.746779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d72aa4dd-7630-416b-8bac-5ab2f1ed8a28 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1073585479", "id": 1525359795, "os-flavor-access:is_public": "True"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:09.796204 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:09.796204 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:09.860315 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d72aa4dd-7630-416b-8bac-5ab2f1ed8a28 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.756069 Aug 02 06:46:09.863095 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 6/24] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:09 2022] POST /compute/v2.1/flavors => generated 430 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:09.878304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-261785a4-1b54-4715-aa89-705fd7255190 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:09.879652 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:09.879652 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:09.921420 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-261785a4-1b54-4715-aa89-705fd7255190 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1525359795" status: 202 len: 0 microversion: 2.1 time: 0.046799 Aug 02 06:46:09.926481 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 7/25] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:46:09 2022] DELETE /compute/v2.1/flavors/1525359795 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:09.932436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-851bcbf2-1b02-4dd6-b6b8-dbebaa283ad7 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:09.966829 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-851bcbf2-1b02-4dd6-b6b8-dbebaa283ad7 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038694 Aug 02 06:46:09.974038 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 8/26] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:09.996728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a8c1685-5391-4c72-9a4b-aec61de80fb1 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-986947411", "id": 1307610902, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:10.040053 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8a8c1685-5391-4c72-9a4b-aec61de80fb1 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.050528 Aug 02 06:46:10.047905 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 9/27] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:09 2022] POST /compute/v2.1/flavors => generated 416 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:10.058400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f29bb0eb-c9c6-4416-a0bf-65a14780d269 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:10.170517 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f29bb0eb-c9c6-4416-a0bf-65a14780d269 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.121140 Aug 02 06:46:10.171787 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 10/28] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:10 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:10.194486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1cc3891c-141c-4051-8745-f94bdd46da65 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:10.236875 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1cc3891c-141c-4051-8745-f94bdd46da65 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1307610902" status: 202 len: 0 microversion: 2.1 time: 0.050238 Aug 02 06:46:10.241273 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 11/29] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:46:10 2022] DELETE /compute/v2.1/flavors/1307610902 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:10.246582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3e031fc6-05e2-4b05-a817-fa4de403ff88 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:10.281355 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3e031fc6-05e2-4b05-a817-fa4de403ff88 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038707 Aug 02 06:46:10.286645 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 12/30] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:10.304166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3e191a66-dd17-4780-8216-1701075fc7b8 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1639511776", "id": 624500097, "os-flavor-access:is_public": "True"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:10.332948 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3e191a66-dd17-4780-8216-1701075fc7b8 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.033291 Aug 02 06:46:10.333549 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 13/31] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:10 2022] POST /compute/v2.1/flavors => generated 426 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:10.352133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-75b89190-fa1f-4bf0-bced-f762073d7f11 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:10.385591 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-75b89190-fa1f-4bf0-bced-f762073d7f11 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/624500097" status: 202 len: 0 microversion: 2.1 time: 0.033896 Aug 02 06:46:10.386365 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 14/32] 10.222.0.79 () {58 vars in 1158 bytes} [Tue Aug 2 06:46:10 2022] DELETE /compute/v2.1/flavors/624500097 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:10.408439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7112a609-4c79-4714-b23f-d50f798d4f12 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:10.436923 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7112a609-4c79-4714-b23f-d50f798d4f12 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045595 Aug 02 06:46:10.438323 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 15/33] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:10.468128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fd33d59a-83d0-4101-a5b4-896ffc46d355 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1198157196", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:10.515395 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fd33d59a-83d0-4101-a5b4-896ffc46d355 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.052176 Aug 02 06:46:10.516645 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 16/34] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:10 2022] POST /compute/v2.1/flavors => generated 507 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:10.536076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a1d997a7-23a9-4f60-b86d-3cfc1eec1fb1 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:10.578533 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a1d997a7-23a9-4f60-b86d-3cfc1eec1fb1 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/322dca6b-eac9-4b51-9a0d-1129dac266d2" status: 202 len: 0 microversion: 2.1 time: 0.053762 Aug 02 06:46:10.579316 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 17/35] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:46:10 2022] DELETE /compute/v2.1/flavors/322dca6b-eac9-4b51-9a0d-1129dac266d2 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:46:10.587832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7aef139-21e0-44ea-aecc-aa5dfc241f10 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:10.623248 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7aef139-21e0-44ea-aecc-aa5dfc241f10 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039189 Aug 02 06:46:10.624120 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 18/36] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:10.656517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-695ef8df-8b3a-4e3a-b324-c8c7f3b36b47 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1603153734", "id": "2911d2ce-7548-47f5-b8c8-7499f62fcb85", "os-flavor-access:is_public": "True"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:10.688828 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-695ef8df-8b3a-4e3a-b324-c8c7f3b36b47 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.038178 Aug 02 06:46:10.690350 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 19/37] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:10 2022] POST /compute/v2.1/flavors => generated 507 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:10.705412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f0fe386e-172a-4dc8-bdd3-1840d65206ce tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:10.740137 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f0fe386e-172a-4dc8-bdd3-1840d65206ce tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/2911d2ce-7548-47f5-b8c8-7499f62fcb85" status: 202 len: 0 microversion: 2.1 time: 0.040172 Aug 02 06:46:10.745024 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 20/38] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:46:10 2022] DELETE /compute/v2.1/flavors/2911d2ce-7548-47f5-b8c8-7499f62fcb85 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:10.772233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b5721d43-c44b-48e0-a3f1-8056ad2849ee tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:10.831504 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b5721d43-c44b-48e0-a3f1-8056ad2849ee tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.083915 Aug 02 06:46:10.832855 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 21/39] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:10.860345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-59f873fd-e7ef-4480-b947-b58de6278136 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-941570158", "id": 316672372, "os-flavor-access:is_public": "True"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:10.896852 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-59f873fd-e7ef-4480-b947-b58de6278136 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.043701 Aug 02 06:46:10.898482 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 22/40] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:10 2022] POST /compute/v2.1/flavors => generated 410 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:10.917269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8d92d1e9-d303-4869-bb1b-53448374b1fb tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:10.934056 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8d92d1e9-d303-4869-bb1b-53448374b1fb tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/316672372" status: 200 len: 410 microversion: 2.1 time: 0.026918 Aug 02 06:46:10.935262 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 23/41] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:46:10 2022] GET /compute/v2.1/flavors/316672372 => generated 410 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:11.120879 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:46:11.435292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-947ec505-44e8-4e70-8722-319d1223da86 tempest-FlavorsAdminTestJSON-1122181825 tempest-FlavorsAdminTestJSON-1122181825-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:11.500483 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-947ec505-44e8-4e70-8722-319d1223da86 tempest-FlavorsAdminTestJSON-1122181825 tempest-FlavorsAdminTestJSON-1122181825-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.556837 Aug 02 06:46:11.501156 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 24/42] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:10 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:11.527588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-79fb7e4d-c64c-4cdf-97b8-d153cc657e07 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:11.550886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7,nova_api:DELETE=17 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:11.574407 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-79fb7e4d-c64c-4cdf-97b8-d153cc657e07 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/316672372" status: 202 len: 0 microversion: 2.1 time: 0.057473 Aug 02 06:46:11.575361 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 25/43] 10.222.0.79 () {58 vars in 1158 bytes} [Tue Aug 2 06:46:11 2022] DELETE /compute/v2.1/flavors/316672372 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:11.592972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3c02d3a9-7f3f-41ee-bb84-c49ec14e53bc tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:11.624719 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3c02d3a9-7f3f-41ee-bb84-c49ec14e53bc tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044954 Aug 02 06:46:11.626007 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 26/44] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:11.654868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:46:11.655587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:46:11.656789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:46:11.657400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:46:11.658214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:46:11.660028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e9cb53e1-fc12-49b2-af20-44c3b5879dd8 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-675214477", "id": 602087190, "os-flavor-access:is_public": "False"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:11.695424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:11.696217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:11.697289 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:11.697952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:11.709656 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e9cb53e1-fc12-49b2-af20-44c3b5879dd8 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.063586 Aug 02 06:46:11.717569 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 27/45] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:11 2022] POST /compute/v2.1/flavors => generated 426 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:11.730261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-687465bd-99fb-4637-a8a9-b497729c638a tempest-FlavorsAdminTestJSON-1122181825 tempest-FlavorsAdminTestJSON-1122181825-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "602087190"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:11.760686 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-687465bd-99fb-4637-a8a9-b497729c638a tempest-FlavorsAdminTestJSON-1122181825 tempest-FlavorsAdminTestJSON-1122181825-project] HTTP exception thrown: Flavor 602087190 could not be found. Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-687465bd-99fb-4637-a8a9-b497729c638a tempest-FlavorsAdminTestJSON-1122181825 tempest-FlavorsAdminTestJSON-1122181825-project] Request method failure captured: Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 106 Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MguqBNXdH7ovNGZSlwxjxewUPvN7HXLa-EIluI4QbEVEA-sjWZbtjJXwNpupDH6G_twnlVRn-O5A-he3_-0KmXTWYGZ-85bW22gYKhnmwm61hwRBDsDqSJJlC8Y_zIk8Exaqnp7uab2WgpfqsctERxpZGEbYhz2Vv9NxiwDRZl7w9A Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8f791fbf1c00464582af6076038a0526 Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-FlavorsAdminTestJSON-1122181825 Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:11.770835 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:11.771989 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8f791fbf1c00464582af6076038a0526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f791fbf1c00464582af6076038a0526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8f791fbf1c00464582af6076038a0526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8f791fbf1c00464582af6076038a0526"}]}] Aug 02 06:46:11.771989 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-FlavorsAdminTestJSON-1122181825 Aug 02 06:46:11.771989 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8f791fbf1c00464582af6076038a0526 Aug 02 06:46:11.771989 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1122181825 Aug 02 06:46:11.771989 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-FlavorsAdminTestJSON-1122181825-project Aug 02 06:46:11.771989 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:11.771989 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:11.771989 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: fbc2fcdfff204d4080221a589c100430 Aug 02 06:46:11.771989 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-FlavorsAdminTestJSON-1122181825-project Aug 02 06:46:11.771989 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:46:11.771989 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "test", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "602087190"}} Aug 02 06:46:11.771989 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:11.771989 n-d-851337-3 devstack@n-api.service[126120]: exception: Flavor 602087190 could not be found. Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '602087190'}}} Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 602087190 could not be found. Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:11.773052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 602087190 could not be found. Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:11.774042 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:11.775092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:11.775092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:11.775092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:11.775092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 602087190 could not be found. Aug 02 06:46:11.775092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:11.778485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-687465bd-99fb-4637-a8a9-b497729c638a tempest-FlavorsAdminTestJSON-1122181825 tempest-FlavorsAdminTestJSON-1122181825-project] Returning 400 to user: Flavor 602087190 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:11.780743 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-687465bd-99fb-4637-a8a9-b497729c638a tempest-FlavorsAdminTestJSON-1122181825 tempest-FlavorsAdminTestJSON-1122181825-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.061771 Aug 02 06:46:11.785061 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 28/46] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:11 2022] POST /compute/v2.1/servers => generated 80 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 02 06:46:11.793690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f5e0a01-c1da-47ff-b527-0179501a866c tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:11.816083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Getting quotas for project 8261c265db344360973bc041d571e9f6. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:46:11.819627 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f5e0a01-c1da-47ff-b527-0179501a866c tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/602087190" status: 202 len: 0 microversion: 2.1 time: 0.029826 Aug 02 06:46:11.825006 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 29/47] 10.222.0.79 () {58 vars in 1158 bytes} [Tue Aug 2 06:46:11 2022] DELETE /compute/v2.1/flavors/602087190 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:11.832340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Getting quotas for user 4607cc90b2b04d91be564cf95bc19227 and project 8261c265db344360973bc041d571e9f6. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:46:11.833605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e849f301-d60d-48ac-b88f-1c0f5528846d tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:11.876880 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e849f301-d60d-48ac-b88f-1c0f5528846d tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043328 Aug 02 06:46:11.889198 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 30/48] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:11.898850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:46:11.903213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-de34e9d2-982e-49cd-8989-83ab7e765826 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1358253413", "id": 1180494422, "os-flavor-access:is_public": "False"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:11.904876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:46:11.937224 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-de34e9d2-982e-49cd-8989-83ab7e765826 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.037614 Aug 02 06:46:11.950583 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 31/49] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:11 2022] POST /compute/v2.1/flavors => generated 415 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:11.961995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a060e72c-d486-4787-bd2c-94f21da517c9 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-667477501", "id": 759265573, "os-flavor-access:is_public": "True"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:11.996694 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a060e72c-d486-4787-bd2c-94f21da517c9 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.042984 Aug 02 06:46:12.010520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=9,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:DELETE=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:12.010918 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 32/50] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:11 2022] POST /compute/v2.1/flavors => generated 410 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:12.023845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-35a970dc-7bf3-40aa-a887-492f109fa76d tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.036954 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-598d86a6-6618-4c76-b4cb-b8034ed6f51a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.102775 Aug 02 06:46:12.038432 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 19/51] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:46:12.060911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e847b405-2e6e-446a-9939-4d25be6875fb tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.062045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e847b405-2e6e-446a-9939-4d25be6875fb tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:12.100888 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-35a970dc-7bf3-40aa-a887-492f109fa76d tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.088353 Aug 02 06:46:12.115156 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 33/52] 10.222.0.79 () {58 vars in 1169 bytes} [Tue Aug 2 06:46:12 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:12.126687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bae10d11-1055-419a-8b98-ff9aa0ec6f11 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.154747 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bae10d11-1055-419a-8b98-ff9aa0ec6f11 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.038326 Aug 02 06:46:12.155809 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 34/53] 10.222.0.79 () {58 vars in 1177 bytes} [Tue Aug 2 06:46:12 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:12.169090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ea8788f9-acf6-4ed8-9a92-373f0b5ccb84 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.179598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e847b405-2e6e-446a-9939-4d25be6875fb tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:12.189788 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ea8788f9-acf6-4ed8-9a92-373f0b5ccb84 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.024356 Aug 02 06:46:12.190462 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 35/54] 10.222.0.79 () {58 vars in 1171 bytes} [Tue Aug 2 06:46:12 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:12.197178 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e847b405-2e6e-446a-9939-4d25be6875fb tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1243 microversion: 2.1 time: 0.140955 Aug 02 06:46:12.197810 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 20/55] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:12 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1243 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:12.206914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d133d1d0-af44-48fc-8a58-13a47bb71f8b tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.229822 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d133d1d0-af44-48fc-8a58-13a47bb71f8b tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.026828 Aug 02 06:46:12.240462 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 36/56] 10.222.0.79 () {58 vars in 1169 bytes} [Tue Aug 2 06:46:12 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:12.251214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4900636b-8835-46c4-9f0c-951bf5f5f6cd tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.288088 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4900636b-8835-46c4-9f0c-951bf5f5f6cd tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.043082 Aug 02 06:46:12.289564 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 21/57] 10.222.0.79 () {58 vars in 1169 bytes} [Tue Aug 2 06:46:12 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:12.307569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1004faf9-63ec-414d-a037-dd8668b8f243 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.351157 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1004faf9-63ec-414d-a037-dd8668b8f243 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.047429 Aug 02 06:46:12.352137 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 37/58] 10.222.0.79 () {58 vars in 1175 bytes} [Tue Aug 2 06:46:12 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:12.369744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8348c3c1-4854-46b2-bc8f-fb4cedc72904 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.422095 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8348c3c1-4854-46b2-bc8f-fb4cedc72904 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.054294 Aug 02 06:46:12.423901 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 22/59] 10.222.0.79 () {58 vars in 1173 bytes} [Tue Aug 2 06:46:12 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:12.442749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-323e71e4-9e76-42e3-9646-92ddfd70a6f2 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.523154 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-323e71e4-9e76-42e3-9646-92ddfd70a6f2 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.084405 Aug 02 06:46:12.527129 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 38/60] 10.222.0.79 () {58 vars in 1169 bytes} [Tue Aug 2 06:46:12 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:12.547053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4755fe82-b08d-4b2c-a385-9e1cf6a04d12 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.548207 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:12.548207 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:12.597877 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4755fe82-b08d-4b2c-a385-9e1cf6a04d12 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/759265573" status: 202 len: 0 microversion: 2.1 time: 0.053384 Aug 02 06:46:12.599005 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 23/61] 10.222.0.79 () {58 vars in 1158 bytes} [Tue Aug 2 06:46:12 2022] DELETE /compute/v2.1/flavors/759265573 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:12.607774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c21a0746-82f0-47eb-aef2-74c23417dd7e tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.667465 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c21a0746-82f0-47eb-aef2-74c23417dd7e tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063397 Aug 02 06:46:12.674770 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 39/62] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:12.692137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-19d8fbcf-e5ac-4e6a-a9be-9a65f0a24954 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.736965 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-19d8fbcf-e5ac-4e6a-a9be-9a65f0a24954 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1180494422" status: 202 len: 0 microversion: 2.1 time: 0.048920 Aug 02 06:46:12.738290 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 24/63] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:46:12 2022] DELETE /compute/v2.1/flavors/1180494422 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:12.748061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cc9b1fd3-b4ad-4dd6-970d-cada06a2db4e tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.786274 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cc9b1fd3-b4ad-4dd6-970d-cada06a2db4e tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043044 Aug 02 06:46:12.787254 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 40/64] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:12.807932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-710340b1-c8d7-485d-9644-ba0a00e73e78 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-677180620", "id": 1816210041, "os-flavor-access:is_public": "False"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:12.811275 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:12.811275 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:12.852445 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-710340b1-c8d7-485d-9644-ba0a00e73e78 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.047232 Aug 02 06:46:12.854728 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 25/65] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:12 2022] POST /compute/v2.1/flavors => generated 414 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:12.868288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-218f5977-4810-442e-9825-c429a7ff6493 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.903610 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-218f5977-4810-442e-9825-c429a7ff6493 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040443 Aug 02 06:46:12.926867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-63807030-7ba4-42fe-bcf8-6c87b4049dcb tempest-FlavorsAdminTestJSON-1122181825 tempest-FlavorsAdminTestJSON-1122181825-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:12.933522 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 41/66] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:12.974368 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-63807030-7ba4-42fe-bcf8-6c87b4049dcb tempest-FlavorsAdminTestJSON-1122181825 tempest-FlavorsAdminTestJSON-1122181825-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054554 Aug 02 06:46:12.975634 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 26/67] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:13.002068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-92181e24-13f6-4584-b102-146f30b6ca87 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:13.042906 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-92181e24-13f6-4584-b102-146f30b6ca87 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1816210041" status: 202 len: 0 microversion: 2.1 time: 0.053562 Aug 02 06:46:13.047173 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 42/68] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:46:12 2022] DELETE /compute/v2.1/flavors/1816210041 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:13.054130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-51a98406-d108-4d19-81b8-bad1d599b42e tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:13.092702 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-51a98406-d108-4d19-81b8-bad1d599b42e tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044111 Aug 02 06:46:13.119478 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 27/69] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:13.144573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0c408a20-c8b0-4a92-beda-e41598459d5c tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1753207442", "id": 1835694268, "os-flavor-access:is_public": "True"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:13.197684 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0c408a20-c8b0-4a92-beda-e41598459d5c tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.063769 Aug 02 06:46:13.199901 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 43/70] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:13 2022] POST /compute/v2.1/flavors => generated 414 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:13.214570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a35d4a2c-a747-4b9e-b0fa-705f4c7197f5 tempest-FlavorsAdminTestJSON-1122181825 tempest-FlavorsAdminTestJSON-1122181825-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:13.231439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-af52f03b-8f50-4d5d-94c8-4ca4a4e7ee92 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:13.235752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-af52f03b-8f50-4d5d-94c8-4ca4a4e7ee92 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:13.262904 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a35d4a2c-a747-4b9e-b0fa-705f4c7197f5 tempest-FlavorsAdminTestJSON-1122181825 tempest-FlavorsAdminTestJSON-1122181825-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.056150 Aug 02 06:46:13.266826 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 28/71] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:13 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:13.289027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-032d8ab0-27bc-4402-b5c9-1f1c31e24fa2 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:13.324421 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-032d8ab0-27bc-4402-b5c9-1f1c31e24fa2 tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1835694268" status: 202 len: 0 microversion: 2.1 time: 0.039654 Aug 02 06:46:13.325146 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 29/72] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:46:13 2022] DELETE /compute/v2.1/flavors/1835694268 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:46:13.340327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c4c9ce72-7153-4247-bcee-7d33f0efccbe tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:13.391623 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c4c9ce72-7153-4247-bcee-7d33f0efccbe tempest-FlavorsAdminTestJSON-1147751587 tempest-FlavorsAdminTestJSON-1147751587-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060220 Aug 02 06:46:13.403722 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 30/73] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:14.460172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-af52f03b-8f50-4d5d-94c8-4ca4a4e7ee92 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:14.476360 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-af52f03b-8f50-4d5d-94c8-4ca4a4e7ee92 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1243 microversion: 2.1 time: 1.255232 Aug 02 06:46:14.477746 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 44/74] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:13 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1243 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:15.499004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-09be3875-3c27-45fb-b24f-9d0629b05d2c tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:15.501313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-09be3875-3c27-45fb-b24f-9d0629b05d2c tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:15.516797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09be3875-3c27-45fb-b24f-9d0629b05d2c tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:15.518891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09be3875-3c27-45fb-b24f-9d0629b05d2c tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:15.519960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09be3875-3c27-45fb-b24f-9d0629b05d2c tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:15.522847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09be3875-3c27-45fb-b24f-9d0629b05d2c tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:15.856258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-14480715-91b3-4019-a4d0-e57fb46b0616 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Calling method '.version_select at 0x7f927bf9eaf0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:15.857763 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:15.857763 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:15.859322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-14480715-91b3-4019-a4d0-e57fb46b0616 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'ea4ca0ea4d41410f8e72889902b93da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa56717e6b7476d8741b704c78f403f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-14480715-91b3-4019-a4d0-e57fb46b0616 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Request method failure captured: Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mg0Qa2EOsVGF2OrydYiJHS1Nuvld8JRdFDyyxXlh5OyVtBmEhD-T0iokAOw46YUgTFX4aGIvI9QFZf7i_R1WOcSF1cMMkWevrd4owEF-ehzX2gFzpCVfjZTgCfA0iUzwmfXQZMJMZ-oWo96NNRsU2U5qQjhlP-7jK_bQwvfy8Iz8Lo Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 3aa56717e6b7476d8741b704c78f403f Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:46:15.863992 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:46:15.865412 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3aa56717e6b7476d8741b704c78f403f"}]}] Aug 02 06:46:15.865412 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:15.865412 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 3aa56717e6b7476d8741b704c78f403f Aug 02 06:46:15.865412 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:15.865412 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-HypervisorAdminNegativeTestJSON-340012879-project Aug 02 06:46:15.865412 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:15.865412 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:15.865412 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: ea4ca0ea4d41410f8e72889902b93da9 Aug 02 06:46:15.865412 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-340012879-project Aug 02 06:46:15.865412 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:46:15.865412 n-d-851337-3 devstack@n-api.service[126119]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 02 06:46:15.865412 n-d-851337-3 devstack@n-api.service[126119]: action_args: {} Aug 02 06:46:15.865412 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:15.866309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 02 06:46:15.867468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:15.870416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-14480715-91b3-4019-a4d0-e57fb46b0616 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:15.880304 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-14480715-91b3-4019-a4d0-e57fb46b0616 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.694022 Aug 02 06:46:15.880896 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 31/75] 10.222.0.79 () {58 vars in 1167 bytes} [Tue Aug 2 06:46:15 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 696 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:15.897379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-09be3875-3c27-45fb-b24f-9d0629b05d2c tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:15.914653 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-09be3875-3c27-45fb-b24f-9d0629b05d2c tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1297 microversion: 2.1 time: 0.420936 Aug 02 06:46:15.923580 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 45/76] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:15 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1297 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:15.932257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-632e75b9-408a-4769-96e8-ac501f865675 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Calling method '.version_select at 0x7f927bf1bb80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:15.933175 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:15.933175 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:15.934538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-632e75b9-408a-4769-96e8-ac501f865675 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'ea4ca0ea4d41410f8e72889902b93da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa56717e6b7476d8741b704c78f403f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-632e75b9-408a-4769-96e8-ac501f865675 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Request method failure captured: Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mg0Qa2EOsVGF2OrydYiJHS1Nuvld8JRdFDyyxXlh5OyVtBmEhD-T0iokAOw46YUgTFX4aGIvI9QFZf7i_R1WOcSF1cMMkWevrd4owEF-ehzX2gFzpCVfjZTgCfA0iUzwmfXQZMJMZ-oWo96NNRsU2U5qQjhlP-7jK_bQwvfy8Iz8Lo Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 3aa56717e6b7476d8741b704c78f403f Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:15.936635 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:15.937990 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3aa56717e6b7476d8741b704c78f403f"}]}] Aug 02 06:46:15.937990 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:15.937990 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 3aa56717e6b7476d8741b704c78f403f Aug 02 06:46:15.937990 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:15.937990 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HypervisorAdminNegativeTestJSON-340012879-project Aug 02 06:46:15.937990 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:15.937990 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:15.937990 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: ea4ca0ea4d41410f8e72889902b93da9 Aug 02 06:46:15.937990 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-340012879-project Aug 02 06:46:15.937990 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:46:15.937990 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 02 06:46:15.937990 n-d-851337-3 devstack@n-api.service[126120]: action_args: {} Aug 02 06:46:15.937990 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:15.938778 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 02 06:46:15.939964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:15.941088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-632e75b9-408a-4769-96e8-ac501f865675 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:15.941088 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-632e75b9-408a-4769-96e8-ac501f865675 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.013442 Aug 02 06:46:15.964960 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 46/77] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:15 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:15.974553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-db6c0aaf-99b4-470c-8987-63c662581454 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Calling method '.version_select at 0x7f927bf3caf0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:15.979831 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:15.979831 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:15.981182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-db6c0aaf-99b4-470c-8987-63c662581454 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'ea4ca0ea4d41410f8e72889902b93da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa56717e6b7476d8741b704c78f403f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-db6c0aaf-99b4-470c-8987-63c662581454 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Request method failure captured: Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mg0Qa2EOsVGF2OrydYiJHS1Nuvld8JRdFDyyxXlh5OyVtBmEhD-T0iokAOw46YUgTFX4aGIvI9QFZf7i_R1WOcSF1cMMkWevrd4owEF-ehzX2gFzpCVfjZTgCfA0iUzwmfXQZMJMZ-oWo96NNRsU2U5qQjhlP-7jK_bQwvfy8Iz8Lo Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 3aa56717e6b7476d8741b704c78f403f Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:15.982816 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:15.984113 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3aa56717e6b7476d8741b704c78f403f"}]}] Aug 02 06:46:15.984113 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:15.984113 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 3aa56717e6b7476d8741b704c78f403f Aug 02 06:46:15.984113 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:15.984113 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HypervisorAdminNegativeTestJSON-340012879-project Aug 02 06:46:15.984113 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:15.984113 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:15.984113 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: ea4ca0ea4d41410f8e72889902b93da9 Aug 02 06:46:15.984113 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-340012879-project Aug 02 06:46:15.984113 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:46:15.984113 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 02 06:46:15.984113 n-d-851337-3 devstack@n-api.service[126120]: action_args: {} Aug 02 06:46:15.984113 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:15.984887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 02 06:46:15.985872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:15.988806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-db6c0aaf-99b4-470c-8987-63c662581454 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:15.988806 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-db6c0aaf-99b4-470c-8987-63c662581454 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.018165 Aug 02 06:46:15.988806 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 47/78] 10.222.0.79 () {58 vars in 1179 bytes} [Tue Aug 2 06:46:15 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:16.222927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-484465125", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:16.340777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:46:16.617334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-955f8961-6879-48cd-a7a2-21fa0e7dffc9 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Calling method '.version_select at 0x7f9288093040>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:16.621767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-955f8961-6879-48cd-a7a2-21fa0e7dffc9 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:16.622455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-955f8961-6879-48cd-a7a2-21fa0e7dffc9 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:16.673034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-955f8961-6879-48cd-a7a2-21fa0e7dffc9 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:16.673493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-955f8961-6879-48cd-a7a2-21fa0e7dffc9 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:16.706760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-955f8961-6879-48cd-a7a2-21fa0e7dffc9 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:16.710103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-955f8961-6879-48cd-a7a2-21fa0e7dffc9 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:16.725055 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-955f8961-6879-48cd-a7a2-21fa0e7dffc9 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.730711 Aug 02 06:46:16.726489 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 48/79] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:16.744537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:46:16.745624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0a8c545e-aaf4-44ab-a655-ce8065d1e37c tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Calling method '.version_select at 0x7f927bf1bca0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:16.746624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:46:16.747342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:46:16.747899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:46:16.748485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:46:16.749035 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:16.749035 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:16.753337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0a8c545e-aaf4-44ab-a655-ce8065d1e37c tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'ea4ca0ea4d41410f8e72889902b93da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa56717e6b7476d8741b704c78f403f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0a8c545e-aaf4-44ab-a655-ce8065d1e37c tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Request method failure captured: Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mg0Qa2EOsVGF2OrydYiJHS1Nuvld8JRdFDyyxXlh5OyVtBmEhD-T0iokAOw46YUgTFX4aGIvI9QFZf7i_R1WOcSF1cMMkWevrd4owEF-ehzX2gFzpCVfjZTgCfA0iUzwmfXQZMJMZ-oWo96NNRsU2U5qQjhlP-7jK_bQwvfy8Iz8Lo Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 3aa56717e6b7476d8741b704c78f403f Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:16.758326 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:16.759675 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3aa56717e6b7476d8741b704c78f403f"}]}] Aug 02 06:46:16.759675 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:16.759675 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 3aa56717e6b7476d8741b704c78f403f Aug 02 06:46:16.759675 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:16.759675 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HypervisorAdminNegativeTestJSON-340012879-project Aug 02 06:46:16.759675 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:16.759675 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:16.759675 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: ea4ca0ea4d41410f8e72889902b93da9 Aug 02 06:46:16.759675 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-340012879-project Aug 02 06:46:16.759675 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:46:16.759675 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 02 06:46:16.759675 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '1'} Aug 02 06:46:16.759675 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:16.760832 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 02 06:46:16.761883 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:16.764347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:16.764795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:16.766520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0a8c545e-aaf4-44ab-a655-ce8065d1e37c tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:16.769111 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0a8c545e-aaf4-44ab-a655-ce8065d1e37c tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.036006 Aug 02 06:46:16.769632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:16.770126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:16.778172 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 49/80] 10.222.0.79 () {58 vars in 1173 bytes} [Tue Aug 2 06:46:16 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:16.793197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-97123858-3934-4c4e-9d21-afef495fe76d tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Calling method '.version_select at 0x7f927bef5790>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:16.798897 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-97123858-3934-4c4e-9d21-afef495fe76d tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] HTTP exception thrown: Hypervisor with ID '89b6095b-6f9a-48c7-9da8-4e89eb22a112' could not be found. Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-97123858-3934-4c4e-9d21-afef495fe76d tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Request method failure captured: Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hypervisors/89b6095b-6f9a-48c7-9da8-4e89eb22a112/uptime HTTP/1.1 Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mg3G-_UQQM6lHkGGk1Dd8IkWjvYf1PiTAnv9iXpf9KpB_uTj5U00JFUif_eAKX2BjYh6GuQRk-CyNesZOzYeY_4bH-EcezBxdFYoZEKJ6AdfOw8XyYdpkndQUki8lFlzgEyFg8pg9dXH6XfC6xB5lWKb_D4JmAiANRfFbwm6ioKHCA Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 1ee57ed688834f7c88082bf520a6e0e0 Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1441853293 Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:46:16.808971 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:46:16.810332 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ee57ed688834f7c88082bf520a6e0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ee57ed688834f7c88082bf520a6e0e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ee57ed688834f7c88082bf520a6e0e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ee57ed688834f7c88082bf520a6e0e0"}]}] Aug 02 06:46:16.810332 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1441853293 Aug 02 06:46:16.810332 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 1ee57ed688834f7c88082bf520a6e0e0 Aug 02 06:46:16.810332 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1441853293 Aug 02 06:46:16.810332 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin Aug 02 06:46:16.810332 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:16.810332 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:16.810332 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 13fbdb224bcf4cb58340bd07f01b3c78 Aug 02 06:46:16.810332 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin Aug 02 06:46:16.810332 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:46:16.810332 n-d-851337-3 devstack@n-api.service[126120]: exception: Hypervisor with ID '89b6095b-6f9a-48c7-9da8-4e89eb22a112' could not be found. Aug 02 06:46:16.810332 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '89b6095b-6f9a-48c7-9da8-4e89eb22a112'} Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '89b6095b-6f9a-48c7-9da8-4e89eb22a112' Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 02 06:46:16.811115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '89b6095b-6f9a-48c7-9da8-4e89eb22a112' could not be found. Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:16.812340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:16.813455 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:16.813455 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:16.813455 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:16.813455 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:16.813455 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:16.813455 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '89b6095b-6f9a-48c7-9da8-4e89eb22a112' could not be found. Aug 02 06:46:16.813455 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:16.816273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-97123858-3934-4c4e-9d21-afef495fe76d tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Returning 404 to user: Hypervisor with ID '89b6095b-6f9a-48c7-9da8-4e89eb22a112' could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:16.816537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Getting quotas for project 8d7a272c645741bba2da4d0bae7a470b. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:46:16.817834 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-97123858-3934-4c4e-9d21-afef495fe76d tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/89b6095b-6f9a-48c7-9da8-4e89eb22a112/uptime" status: 404 len: 123 microversion: 2.1 time: 0.038180 Aug 02 06:46:16.824720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Getting quotas for user 218f99459dc54c7187c8ee0022e64e81 and project 8d7a272c645741bba2da4d0bae7a470b. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:46:16.826258 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 50/81] 10.222.0.79 () {58 vars in 1278 bytes} [Tue Aug 2 06:46:16 2022] GET /compute/v2.1/os-hypervisors/89b6095b-6f9a-48c7-9da8-4e89eb22a112/uptime => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:16.850305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:46:16.851964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-77766d14-03ac-417b-96c3-f3bdb70fe9f2 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Calling method '.version_select at 0x7f927bef5790>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:16.852488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:46:16.853826 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:16.853826 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:16.860481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77766d14-03ac-417b-96c3-f3bdb70fe9f2 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:16.863295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77766d14-03ac-417b-96c3-f3bdb70fe9f2 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:16.908083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77766d14-03ac-417b-96c3-f3bdb70fe9f2 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:16.908538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77766d14-03ac-417b-96c3-f3bdb70fe9f2 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:16.927825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77766d14-03ac-417b-96c3-f3bdb70fe9f2 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:16.939138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77766d14-03ac-417b-96c3-f3bdb70fe9f2 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:16.959458 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3847adf9-3b84-4b2d-93ee-dd9e9c94c4b4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073080 Aug 02 06:46:16.960218 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-77766d14-03ac-417b-96c3-f3bdb70fe9f2 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.129277 Aug 02 06:46:16.961050 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 32/82] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:46:16.963336 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 51/83] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:16.972061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4949f69d-f303-4130-a7f1-ec933ec755f4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:16.977729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-00ff07c8-729c-4d98-a08f-f68c1fe6c285 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:16.978568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-00ff07c8-729c-4d98-a08f-f68c1fe6c285 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:16.982748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4949f69d-f303-4130-a7f1-ec933ec755f4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:16.996348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4949f69d-f303-4130-a7f1-ec933ec755f4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:16.997113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4949f69d-f303-4130-a7f1-ec933ec755f4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:16.998594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4949f69d-f303-4130-a7f1-ec933ec755f4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:16.999640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4949f69d-f303-4130-a7f1-ec933ec755f4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:17.217796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-00ff07c8-729c-4d98-a08f-f68c1fe6c285 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:17.229691 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-00ff07c8-729c-4d98-a08f-f68c1fe6c285 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1219 microversion: 2.1 time: 0.259052 Aug 02 06:46:17.230591 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 52/84] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:16 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1219 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:17.255641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-95298a39-ff37-4e33-ae68-4ab02e577dc0 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Calling method '.version_select at 0x7f927bfee040>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:17.267085 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:17.267085 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:17.271351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-95298a39-ff37-4e33-ae68-4ab02e577dc0 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'ea4ca0ea4d41410f8e72889902b93da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa56717e6b7476d8741b704c78f403f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-95298a39-ff37-4e33-ae68-4ab02e577dc0 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Request method failure captured: Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mg0Qa2EOsVGF2OrydYiJHS1Nuvld8JRdFDyyxXlh5OyVtBmEhD-T0iokAOw46YUgTFX4aGIvI9QFZf7i_R1WOcSF1cMMkWevrd4owEF-ehzX2gFzpCVfjZTgCfA0iUzwmfXQZMJMZ-oWo96NNRsU2U5qQjhlP-7jK_bQwvfy8Iz8Lo Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 3aa56717e6b7476d8741b704c78f403f Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:17.275399 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:17.276542 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3aa56717e6b7476d8741b704c78f403f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3aa56717e6b7476d8741b704c78f403f"}]}] Aug 02 06:46:17.276542 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:17.276542 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 3aa56717e6b7476d8741b704c78f403f Aug 02 06:46:17.276542 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-340012879 Aug 02 06:46:17.276542 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HypervisorAdminNegativeTestJSON-340012879-project Aug 02 06:46:17.276542 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:17.276542 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:17.276542 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: ea4ca0ea4d41410f8e72889902b93da9 Aug 02 06:46:17.276542 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-340012879-project Aug 02 06:46:17.276542 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:46:17.276542 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 02 06:46:17.276542 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '1'} Aug 02 06:46:17.276542 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:17.277208 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 02 06:46:17.278285 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:17.290385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-95298a39-ff37-4e33-ae68-4ab02e577dc0 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:17.292273 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-95298a39-ff37-4e33-ae68-4ab02e577dc0 tempest-HypervisorAdminNegativeTestJSON-340012879 tempest-HypervisorAdminNegativeTestJSON-340012879-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.060225 Aug 02 06:46:17.294177 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 53/85] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:46:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:17.306677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5ebc83af-9e05-4638-89bf-1dd4c6792226 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Calling method '.version_select at 0x7f927bf3c700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:17.310781 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-5ebc83af-9e05-4638-89bf-1dd4c6792226 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] HTTP exception thrown: Hypervisor with ID 'a4a845e5-1935-416e-92cd-837226799372' could not be found. Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5ebc83af-9e05-4638-89bf-1dd4c6792226 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Request method failure captured: Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hypervisors/a4a845e5-1935-416e-92cd-837226799372 HTTP/1.1 Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mg3G-_UQQM6lHkGGk1Dd8IkWjvYf1PiTAnv9iXpf9KpB_uTj5U00JFUif_eAKX2BjYh6GuQRk-CyNesZOzYeY_4bH-EcezBxdFYoZEKJ6AdfOw8XyYdpkndQUki8lFlzgEyFg8pg9dXH6XfC6xB5lWKb_D4JmAiANRfFbwm6ioKHCA Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 1ee57ed688834f7c88082bf520a6e0e0 Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1441853293 Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:46:17.326520 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:46:17.327587 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ee57ed688834f7c88082bf520a6e0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ee57ed688834f7c88082bf520a6e0e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ee57ed688834f7c88082bf520a6e0e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ee57ed688834f7c88082bf520a6e0e0"}]}] Aug 02 06:46:17.327587 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1441853293 Aug 02 06:46:17.327587 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 1ee57ed688834f7c88082bf520a6e0e0 Aug 02 06:46:17.327587 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1441853293 Aug 02 06:46:17.327587 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin Aug 02 06:46:17.327587 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:17.327587 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:17.327587 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 13fbdb224bcf4cb58340bd07f01b3c78 Aug 02 06:46:17.327587 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin Aug 02 06:46:17.327587 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:46:17.327587 n-d-851337-3 devstack@n-api.service[126120]: exception: Hypervisor with ID 'a4a845e5-1935-416e-92cd-837226799372' could not be found. Aug 02 06:46:17.327587 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'a4a845e5-1935-416e-92cd-837226799372'} Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'a4a845e5-1935-416e-92cd-837226799372' Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 02 06:46:17.328934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 02 06:46:17.330097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'a4a845e5-1935-416e-92cd-837226799372' could not be found. Aug 02 06:46:17.331170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:17.331170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:17.331170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:17.331170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:17.331170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:17.331170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:17.331170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:17.331170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:17.331170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'a4a845e5-1935-416e-92cd-837226799372' could not be found. Aug 02 06:46:17.331170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:17.334585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5ebc83af-9e05-4638-89bf-1dd4c6792226 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] Returning 404 to user: Hypervisor with ID 'a4a845e5-1935-416e-92cd-837226799372' could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:17.336022 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5ebc83af-9e05-4638-89bf-1dd4c6792226 tempest-HypervisorAdminNegativeTestJSON-1441853293 tempest-HypervisorAdminNegativeTestJSON-1441853293-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/a4a845e5-1935-416e-92cd-837226799372" status: 404 len: 123 microversion: 2.1 time: 0.034054 Aug 02 06:46:17.339820 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 54/86] 10.222.0.79 () {58 vars in 1257 bytes} [Tue Aug 2 06:46:17 2022] GET /compute/v2.1/os-hypervisors/a4a845e5-1935-416e-92cd-837226799372 => generated 123 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:18.173621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4949f69d-f303-4130-a7f1-ec933ec755f4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:18.210567 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4949f69d-f303-4130-a7f1-ec933ec755f4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 1.245497 Aug 02 06:46:18.215360 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 33/87] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:16 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:18.254394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-53a040eb-1c09-4f85-bbef-672c4560afac tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:18.255073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-53a040eb-1c09-4f85-bbef-672c4560afac tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:18.564088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-106d3848-33b6-4b82-9fce-9b9505b38fd5 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Action: 'update', calling method: .version_select at 0x7f928f6ded30>, body: {"quota_set": {"ram": "5120"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:18.887550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-106d3848-33b6-4b82-9fce-9b9505b38fd5 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:18.895920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-106d3848-33b6-4b82-9fce-9b9505b38fd5 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:18.897764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-106d3848-33b6-4b82-9fce-9b9505b38fd5 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:18.899833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-106d3848-33b6-4b82-9fce-9b9505b38fd5 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:19.006872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-53a040eb-1c09-4f85-bbef-672c4560afac tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:19.022643 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-53a040eb-1c09-4f85-bbef-672c4560afac tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1219 microversion: 2.1 time: 0.770200 Aug 02 06:46:19.030390 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 34/88] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:18 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1219 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:19.140063 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-106d3848-33b6-4b82-9fce-9b9505b38fd5 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/9b0e2afa1b1c4aa09f9ba38812e80d3b" status: 200 len: 148 microversion: 2.57 time: 1.449169 Aug 02 06:46:19.141100 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 55/89] 10.222.0.79 () {62 vars in 1303 bytes} [Tue Aug 2 06:46:17 2022] PUT /compute/v2.1/os-quota-sets/9b0e2afa1b1c4aa09f9ba38812e80d3b => generated 148 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 06:46:19.153029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1845fa1c-b6ed-47d7-895e-094c29ffa6a7 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Calling method '.version_select at 0x7f927be8ee50>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:19.233644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8b05f25f-1ba5-48d9-b698-12650d5b93ce tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:19.234757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8b05f25f-1ba5-48d9-b698-12650d5b93ce tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:19.245583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b05f25f-1ba5-48d9-b698-12650d5b93ce tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:19.253988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b05f25f-1ba5-48d9-b698-12650d5b93ce tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:19.255613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b05f25f-1ba5-48d9-b698-12650d5b93ce tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:19.262515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b05f25f-1ba5-48d9-b698-12650d5b93ce tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:19.280926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1845fa1c-b6ed-47d7-895e-094c29ffa6a7 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:19.282351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1845fa1c-b6ed-47d7-895e-094c29ffa6a7 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:19.283318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1845fa1c-b6ed-47d7-895e-094c29ffa6a7 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:19.284095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1845fa1c-b6ed-47d7-895e-094c29ffa6a7 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:19.313078 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1845fa1c-b6ed-47d7-895e-094c29ffa6a7 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/9b0e2afa1b1c4aa09f9ba38812e80d3b/detail" status: 200 len: 463 microversion: 2.57 time: 0.164913 Aug 02 06:46:19.314364 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 35/90] 10.222.0.79 () {60 vars in 1304 bytes} [Tue Aug 2 06:46:19 2022] GET /compute/v2.1/os-quota-sets/9b0e2afa1b1c4aa09f9ba38812e80d3b/detail => generated 463 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:46:19.597660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b540b968-a58a-4cc9-93fd-fb5914689191 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Action: 'update', calling method: .version_select at 0x7f927bf9e4c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:19.610022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8b05f25f-1ba5-48d9-b698-12650d5b93ce tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:19.618374 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8b05f25f-1ba5-48d9-b698-12650d5b93ce tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 0.389425 Aug 02 06:46:19.621406 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 56/91] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:19 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:19.756209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b540b968-a58a-4cc9-93fd-fb5914689191 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:19.756783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b540b968-a58a-4cc9-93fd-fb5914689191 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:19.757719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b540b968-a58a-4cc9-93fd-fb5914689191 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:19.758234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b540b968-a58a-4cc9-93fd-fb5914689191 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:19.944790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b540b968-a58a-4cc9-93fd-fb5914689191 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:19.945225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b540b968-a58a-4cc9-93fd-fb5914689191 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:19.946571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b540b968-a58a-4cc9-93fd-fb5914689191 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:19.947015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b540b968-a58a-4cc9-93fd-fb5914689191 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:20.051485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-785cef4b-43fa-420e-93ed-1dd31bac59d3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:20.052749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-785cef4b-43fa-420e-93ed-1dd31bac59d3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:20.072794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-785cef4b-43fa-420e-93ed-1dd31bac59d3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:20.074513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-785cef4b-43fa-420e-93ed-1dd31bac59d3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:20.075563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-785cef4b-43fa-420e-93ed-1dd31bac59d3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:20.078314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-785cef4b-43fa-420e-93ed-1dd31bac59d3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:20.250364 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b540b968-a58a-4cc9-93fd-fb5914689191 tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/9b0e2afa1b1c4aa09f9ba38812e80d3b?user_id=baafe5d840a940bd8111a6536617eef4" status: 200 len: 148 microversion: 2.57 time: 0.654299 Aug 02 06:46:20.259063 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 36/92] 10.222.0.79 () {62 vars in 1384 bytes} [Tue Aug 2 06:46:19 2022] PUT /compute/v2.1/os-quota-sets/9b0e2afa1b1c4aa09f9ba38812e80d3b?user_id=baafe5d840a940bd8111a6536617eef4 => generated 148 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:46:20.280228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-785cef4b-43fa-420e-93ed-1dd31bac59d3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:20.288548 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-785cef4b-43fa-420e-93ed-1dd31bac59d3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1271 microversion: 2.1 time: 0.242934 Aug 02 06:46:20.289505 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 57/93] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:20 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:20.295826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a4b775c4-97e5-4e12-901b-6077a2dd311d tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] Calling method '.version_select at 0x7f927be0cee0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:21.171627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-13413fed-86d3-4bcd-a95c-daddd410c9eb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:21.183170 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-13413fed-86d3-4bcd-a95c-daddd410c9eb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.926730 Aug 02 06:46:21.183744 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 37/94] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:46:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:21.211026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-38467a2f-6612-4dbd-b11e-4d5c83232ef9 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:21.214452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-38467a2f-6612-4dbd-b11e-4d5c83232ef9 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:21.226262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38467a2f-6612-4dbd-b11e-4d5c83232ef9 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:21.227981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38467a2f-6612-4dbd-b11e-4d5c83232ef9 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:21.232852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38467a2f-6612-4dbd-b11e-4d5c83232ef9 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:21.233519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38467a2f-6612-4dbd-b11e-4d5c83232ef9 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:21.640404 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a4b775c4-97e5-4e12-901b-6077a2dd311d tempest-QuotasAdminTestV257-1062103528 tempest-QuotasAdminTestV257-1062103528-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/9b0e2afa1b1c4aa09f9ba38812e80d3b?user_id=baafe5d840a940bd8111a6536617eef4" status: 200 len: 190 microversion: 2.57 time: 1.348734 Aug 02 06:46:21.641306 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 58/95] 10.222.0.79 () {60 vars in 1364 bytes} [Tue Aug 2 06:46:20 2022] GET /compute/v2.1/os-quota-sets/9b0e2afa1b1c4aa09f9ba38812e80d3b?user_id=baafe5d840a940bd8111a6536617eef4 => generated 190 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:46:21.809749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-38467a2f-6612-4dbd-b11e-4d5c83232ef9 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:21.823869 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-38467a2f-6612-4dbd-b11e-4d5c83232ef9 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 0.622417 Aug 02 06:46:21.830857 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 38/96] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:21 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:21.854018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f5d05367-7062-490f-965a-a7f8d29d9a6b tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:21.854827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f5d05367-7062-490f-965a-a7f8d29d9a6b tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:21.867811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=84,nova_api:DELETE=9 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:21.878153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5d05367-7062-490f-965a-a7f8d29d9a6b tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:21.882735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5d05367-7062-490f-965a-a7f8d29d9a6b tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:21.889151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5d05367-7062-490f-965a-a7f8d29d9a6b tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:21.891330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5d05367-7062-490f-965a-a7f8d29d9a6b tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:22.053998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f5d05367-7062-490f-965a-a7f8d29d9a6b tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:22.067626 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f5d05367-7062-490f-965a-a7f8d29d9a6b tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1277 microversion: 2.1 time: 0.234128 Aug 02 06:46:22.083980 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 39/97] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:21 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:22.614466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fb7a3118-0c76-453c-87e7-e13b6e10be4d tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-881448289", "id": 1804928652, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:22.617716 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:22.617716 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:22.651447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:22.657620 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fb7a3118-0c76-453c-87e7-e13b6e10be4d tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 1.015051 Aug 02 06:46:22.664697 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 59/98] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:21 2022] POST /compute/v2.1/flavors => generated 424 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:22.676365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-447d3190-222d-49a8-9b18-fbfa25f73e43 tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:22.701801 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-447d3190-222d-49a8-9b18-fbfa25f73e43 tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029577 Aug 02 06:46:22.702964 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 60/99] 10.222.0.79 () {58 vars in 1182 bytes} [Tue Aug 2 06:46:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:46:22.713376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-85e4a7d5-20c2-404e-a4cf-a3ffd1e23755 tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-2036680690", "id": 2050779305, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:22.751391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-3d1eac46-0cb7-44f1-959b-8be1d0525390 req-d2864abe-4a0d-4e98-8410-e48ce456d853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb3120a-e908-473d-8ca1-e4c436aec919", "tag": "9cace3c3-57b9-40a1-b369-dce8d985258c"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:22.785494 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-85e4a7d5-20c2-404e-a4cf-a3ffd1e23755 tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.072977 Aug 02 06:46:22.787386 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 61/100] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:22 2022] POST /compute/v2.1/flavors => generated 425 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:22.798783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3d1eac46-0cb7-44f1-959b-8be1d0525390 req-d2864abe-4a0d-4e98-8410-e48ce456d853 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:22.799270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3d1eac46-0cb7-44f1-959b-8be1d0525390 req-d2864abe-4a0d-4e98-8410-e48ce456d853 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:22.814802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ece07791-194d-472a-9db0-2c9d2767206d tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:22.869714 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-3d1eac46-0cb7-44f1-959b-8be1d0525390 req-d2864abe-4a0d-4e98-8410-e48ce456d853 service nova] Creating event network-changed:9cace3c3-57b9-40a1-b369-dce8d985258c for instance efb3120a-e908-473d-8ca1-e4c436aec919 on n-h2-851337-3 Aug 02 06:46:22.870306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3d1eac46-0cb7-44f1-959b-8be1d0525390 req-d2864abe-4a0d-4e98-8410-e48ce456d853 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126119) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 06:46:22.876383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2009207c-aba2-4d40-b8f5-00c89a6f1580 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:22.876894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2009207c-aba2-4d40-b8f5-00c89a6f1580 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:22.882193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2009207c-aba2-4d40-b8f5-00c89a6f1580 None None] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:22.882876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2009207c-aba2-4d40-b8f5-00c89a6f1580 None None] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:22.896947 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ece07791-194d-472a-9db0-2c9d2767206d tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.101951 Aug 02 06:46:22.902193 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.compute.rpcapi [None req-2009207c-aba2-4d40-b8f5-00c89a6f1580 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 06:46:22.907433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2009207c-aba2-4d40-b8f5-00c89a6f1580 None None] Releasing lock "compute-rpcapi-router" {{(pid=126119) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 06:46:22.908207 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 62/101] 10.222.0.79 () {58 vars in 1182 bytes} [Tue Aug 2 06:46:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:46:22.943926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-53c6e8c3-f412-468c-a22b-23e206b770b4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:22.947616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-53c6e8c3-f412-468c-a22b-23e206b770b4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:22.950843 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2009207c-aba2-4d40-b8f5-00c89a6f1580 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.864801 Aug 02 06:46:22.952103 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 40/102] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:22.966856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f9e15d07-f4e1-4316-a81a-a2a57b388862 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Action: 'create', calling method: .version_select at 0x7f927be398b0>, body: {"keypair": {"name": "tempest-keypair-1309647087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxfelzNi/95jx3BhBS5rPqDcFEVPgaGOnKBDrxhzoGyTdhLcnaJuArL/MtgKWMq6D+I2wJx9Kf72ZyuEF6QdFE+ILwVfj5C85B1aZVmn3UX+vLacdGhfzo80TE3dcLcxA=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:22.971346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53c6e8c3-f412-468c-a22b-23e206b770b4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:22.977524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53c6e8c3-f412-468c-a22b-23e206b770b4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:22.980682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53c6e8c3-f412-468c-a22b-23e206b770b4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:22.982999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53c6e8c3-f412-468c-a22b-23e206b770b4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:23.035472 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f9e15d07-f4e1-4316-a81a-a2a57b388862 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Getting quotas for project fcf8ed73c2f64b7194098acb56270897. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:46:23.048785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f9e15d07-f4e1-4316-a81a-a2a57b388862 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Getting quotas for user 5c5e925155c248be81bfc65bc7652ab6 and project fcf8ed73c2f64b7194098acb56270897. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:46:23.157572 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f9e15d07-f4e1-4316-a81a-a2a57b388862 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.203877 Aug 02 06:46:23.172536 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 41/103] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:46:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:23.190564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-305d5c54-87ca-484c-9b5a-50ae6d5e59a3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:23.200389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-305d5c54-87ca-484c-9b5a-50ae6d5e59a3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:23.237753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-305d5c54-87ca-484c-9b5a-50ae6d5e59a3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:23.238257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-305d5c54-87ca-484c-9b5a-50ae6d5e59a3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:23.242350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-305d5c54-87ca-484c-9b5a-50ae6d5e59a3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:23.242782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-305d5c54-87ca-484c-9b5a-50ae6d5e59a3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:23.791889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-305d5c54-87ca-484c-9b5a-50ae6d5e59a3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:23.800317 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-305d5c54-87ca-484c-9b5a-50ae6d5e59a3 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1277 microversion: 2.1 time: 0.625626 Aug 02 06:46:23.800908 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 42/104] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:23 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1277 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:24.021929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-53c6e8c3-f412-468c-a22b-23e206b770b4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:24.034186 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-53c6e8c3-f412-468c-a22b-23e206b770b4 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 1.119845 Aug 02 06:46:24.034770 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 63/105] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:22 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:24.821360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-44e7e86e-4c53-4831-92ca-4096215af4bc tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:24.822337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-44e7e86e-4c53-4831-92ca-4096215af4bc tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:24.831363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44e7e86e-4c53-4831-92ca-4096215af4bc tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:24.840120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44e7e86e-4c53-4831-92ca-4096215af4bc tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:24.844922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44e7e86e-4c53-4831-92ca-4096215af4bc tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:24.845729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44e7e86e-4c53-4831-92ca-4096215af4bc tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:25.056807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-22dfb1b8-12cf-4f80-91cb-c885fcaa3707 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:25.057500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-22dfb1b8-12cf-4f80-91cb-c885fcaa3707 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:25.079982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22dfb1b8-12cf-4f80-91cb-c885fcaa3707 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:25.080800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22dfb1b8-12cf-4f80-91cb-c885fcaa3707 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:25.081792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22dfb1b8-12cf-4f80-91cb-c885fcaa3707 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:25.082424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22dfb1b8-12cf-4f80-91cb-c885fcaa3707 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:25.565844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44e7e86e-4c53-4831-92ca-4096215af4bc tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:25.576168 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-44e7e86e-4c53-4831-92ca-4096215af4bc tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.759257 Aug 02 06:46:25.591171 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 43/106] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:24 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:25.677243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-22dfb1b8-12cf-4f80-91cb-c885fcaa3707 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:25.685808 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-22dfb1b8-12cf-4f80-91cb-c885fcaa3707 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 0.632918 Aug 02 06:46:25.690906 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 64/107] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:25 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:26.597168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-13cd2c37-cf33-4fa3-951c-d29ef99ff46f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:26.598163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-13cd2c37-cf33-4fa3-951c-d29ef99ff46f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:26.615066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13cd2c37-cf33-4fa3-951c-d29ef99ff46f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:26.615523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13cd2c37-cf33-4fa3-951c-d29ef99ff46f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:26.616334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13cd2c37-cf33-4fa3-951c-d29ef99ff46f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:26.616758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13cd2c37-cf33-4fa3-951c-d29ef99ff46f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:26.713399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ac59318-9927-4e40-8871-0c9ce37ed6d3 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:26.714179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2ac59318-9927-4e40-8871-0c9ce37ed6d3 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:26.726636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ac59318-9927-4e40-8871-0c9ce37ed6d3 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:26.736217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ac59318-9927-4e40-8871-0c9ce37ed6d3 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:26.739336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ac59318-9927-4e40-8871-0c9ce37ed6d3 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:26.740643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ac59318-9927-4e40-8871-0c9ce37ed6d3 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:27.287210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-13cd2c37-cf33-4fa3-951c-d29ef99ff46f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:27.300882 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-13cd2c37-cf33-4fa3-951c-d29ef99ff46f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.704351 Aug 02 06:46:27.304003 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 44/108] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:26 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:27.578361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2ac59318-9927-4e40-8871-0c9ce37ed6d3 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:27.590449 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2ac59318-9927-4e40-8871-0c9ce37ed6d3 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 0.880192 Aug 02 06:46:27.593576 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 65/109] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:26 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:27.637712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e52de2dc-646c-45ce-8c27-16f4f0b3ffd0 tempest-NetworksTest-1607136718 tempest-NetworksTest-1607136718-project-admin] Calling method '.version_select at 0x7f927be7f670>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:28.223180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-984aa5a1-ecb7-477a-8a83-f2792c3a1cb3 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1786735296", "id": 206536847, "os-flavor-access:is_public": "False"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:28.228308 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:28.228308 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:28.289829 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-984aa5a1-ecb7-477a-8a83-f2792c3a1cb3 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.471231 Aug 02 06:46:28.292908 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 66/110] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:27 2022] POST /compute/v2.1/flavors => generated 436 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:28.316155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b3f88007-3027-48bd-b37a-77dce23bc3b5 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "084355ce918044b9988d3356abd08de1"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:28.324107 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:28.324107 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:28.554283 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e52de2dc-646c-45ce-8c27-16f4f0b3ffd0 tempest-NetworksTest-1607136718 tempest-NetworksTest-1607136718-project-admin] 10.222.0.79 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 1.246722 Aug 02 06:46:28.555326 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 45/111] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:46:27 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:28.562905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e0edddaa-e61c-49bd-ae1e-06aa46e5ce15 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:28.566392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e0edddaa-e61c-49bd-ae1e-06aa46e5ce15 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:28.584788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0edddaa-e61c-49bd-ae1e-06aa46e5ce15 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:28.585233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0edddaa-e61c-49bd-ae1e-06aa46e5ce15 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:28.586036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0edddaa-e61c-49bd-ae1e-06aa46e5ce15 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:28.587165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0edddaa-e61c-49bd-ae1e-06aa46e5ce15 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:28.815663 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b3f88007-3027-48bd-b37a-77dce23bc3b5 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/206536847/action" status: 200 len: 96 microversion: 2.1 time: 0.506973 Aug 02 06:46:28.825268 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 67/112] 10.222.0.79 () {60 vars in 1197 bytes} [Tue Aug 2 06:46:28 2022] POST /compute/v2.1/flavors/206536847/action => generated 96 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:46:28.834532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d5c2c29b-79eb-4276-a329-b6140bb7281b tempest-NetworksTest-1607136718 tempest-NetworksTest-1607136718-project-admin] Calling method '.version_select at 0x7f927bf0d940>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:28.950036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:29.366898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e0edddaa-e61c-49bd-ae1e-06aa46e5ce15 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:29.370938 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d5c2c29b-79eb-4276-a329-b6140bb7281b tempest-NetworksTest-1607136718 tempest-NetworksTest-1607136718-project-admin] 10.222.0.79 "GET /compute/v2.1/os-networks/a216acbd-5c92-441a-b243-674c18d16f72" status: 200 len: 652 microversion: 2.1 time: 0.543446 Aug 02 06:46:29.371529 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 68/113] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 06:46:28 2022] GET /compute/v2.1/os-networks/a216acbd-5c92-441a-b243-674c18d16f72 => generated 652 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:29.377346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-01738f5b-6323-4d05-bfe8-7f062d9a378a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:29.378194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-01738f5b-6323-4d05-bfe8-7f062d9a378a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:29.381064 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e0edddaa-e61c-49bd-ae1e-06aa46e5ce15 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.824183 Aug 02 06:46:29.386206 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 46/114] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:28 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:29.393406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2058183336", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "2050779305", "adminPass": "***", "networks": [{"uuid": "178d4ee9-06a0-46b2-b8bd-814f8a6113fd"}], "security_groups": [{"name": "tempest-securitygroup--106403822"}], "key_name": "tempest-keypair-1309647087", "user_data": "}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:29.403800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-01738f5b-6323-4d05-bfe8-7f062d9a378a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:29.404271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-01738f5b-6323-4d05-bfe8-7f062d9a378a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:29.420742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-01738f5b-6323-4d05-bfe8-7f062d9a378a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:29.421296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-01738f5b-6323-4d05-bfe8-7f062d9a378a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:29.818317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-01738f5b-6323-4d05-bfe8-7f062d9a378a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:29.829034 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-01738f5b-6323-4d05-bfe8-7f062d9a378a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 0.456043 Aug 02 06:46:29.843212 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 69/115] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:29 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:29.843212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e10c59ab-82de-4251-9ec9-cc3af4fd5adb tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "084355ce918044b9988d3356abd08de1"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:29.849036 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:29.849036 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:30.038218 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-e10c59ab-82de-4251-9ec9-cc3af4fd5adb tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] HTTP exception thrown: Flavor access already exists for flavor 30 and project 084355ce918044b9988d3356abd08de1 combination. Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e10c59ab-82de-4251-9ec9-cc3af4fd5adb tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Request method failure captured: Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/flavors/206536847/action HTTP/1.1 Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 67 Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MhBUMOuE3dov9isV0Qk9Fyre5uwXtG3DVuYzLdXGCB_pwmQfYmLuCJZXd8LVN7RDQ5xWCBa5Q2wRrD78DgayICEsC_QgL2xtxxS8s4gs1LwlUJAG2_FtVQczJRooTXXrulMTuc2COYpxI6VlcQkd2Ys0n9DWeMSua-LTMeCblU68p8 Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 97cafba1ed5a488c8733d0d43881cf3b Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1113623032 Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:46:30.062554 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:46:30.063923 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/97cafba1ed5a488c8733d0d43881cf3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/97cafba1ed5a488c8733d0d43881cf3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_97cafba1ed5a488c8733d0d43881cf3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/97cafba1ed5a488c8733d0d43881cf3b"}]}] Aug 02 06:46:30.063923 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1113623032 Aug 02 06:46:30.063923 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 97cafba1ed5a488c8733d0d43881cf3b Aug 02 06:46:30.063923 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1113623032 Aug 02 06:46:30.063923 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin Aug 02 06:46:30.063923 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:30.063923 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:30.063923 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: eaee6545ae5b4e3fa452ca3be3e7567f Aug 02 06:46:30.063923 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin Aug 02 06:46:30.063923 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:46:30.063923 n-d-851337-3 devstack@n-api.service[126120]: {"addTenantAccess": {"tenant": "084355ce918044b9988d3356abd08de1"}} Aug 02 06:46:30.063923 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: exception: Flavor access already exists for flavor 30 and project 084355ce918044b9988d3356abd08de1 combination. Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '206536847', 'body': {'addTenantAccess': {'tenant': '084355ce918044b9988d3356abd08de1'}}} Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result.read() Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 06:46:30.064646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '30-084355ce918044b9988d3356abd08de1' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi session.flush() Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 06:46:30.065666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 06:46:30.066740 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 06:46:30.067749 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result.read() Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '30-084355ce918044b9988d3356abd08de1' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 2, 6, 46, 30, 29376), 'updated_at': None, 'flavor_id': 30, 'project_id': '084355ce918044b9988d3356abd08de1'}] Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:30.068652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 30 and project 084355ce918044b9988d3356abd08de1 combination. Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:30.069524 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 30 and project 084355ce918044b9988d3356abd08de1 combination. Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:30.072252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:30.075977 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 30 and project 084355ce918044b9988d3356abd08de1 combination. Aug 02 06:46:30.075977 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:30.075977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e10c59ab-82de-4251-9ec9-cc3af4fd5adb tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Returning 409 to user: Flavor access already exists for flavor 30 and project 084355ce918044b9988d3356abd08de1 combination. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:30.075977 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e10c59ab-82de-4251-9ec9-cc3af4fd5adb tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/206536847/action" status: 409 len: 152 microversion: 2.1 time: 0.232250 Aug 02 06:46:30.075977 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 70/116] 10.222.0.79 () {60 vars in 1197 bytes} [Tue Aug 2 06:46:29 2022] POST /compute/v2.1/flavors/206536847/action => generated 152 bytes in 234 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:46:30.084173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bbbf235e-c540-432d-a5a7-122acaa134be tempest-NetworksTest-1607136718 tempest-NetworksTest-1607136718-project-admin] Calling method '.version_select at 0x7f927bbf1790>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:30.253793 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bbbf235e-c540-432d-a5a7-122acaa134be tempest-NetworksTest-1607136718 tempest-NetworksTest-1607136718-project-admin] 10.222.0.79 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.186347 Aug 02 06:46:30.255258 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 71/117] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:46:30 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:30.443452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-aa8649f2-3f44-4f3f-b50d-2efc8438607c req-8d9e3019-f178-46f7-82d3-793e2fc09147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a8a334e-542e-452d-8822-2324c95201f4", "tag": "894f0ef5-8e0a-4cde-927f-f70e446bf0eb"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:30.483700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-aa8649f2-3f44-4f3f-b50d-2efc8438607c req-8d9e3019-f178-46f7-82d3-793e2fc09147 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:30.485832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-aa8649f2-3f44-4f3f-b50d-2efc8438607c req-8d9e3019-f178-46f7-82d3-793e2fc09147 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:30.544909 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-aa8649f2-3f44-4f3f-b50d-2efc8438607c req-8d9e3019-f178-46f7-82d3-793e2fc09147 service nova] Creating event network-changed:894f0ef5-8e0a-4cde-927f-f70e446bf0eb for instance 0a8a334e-542e-452d-8822-2324c95201f4 on n-h1-851337-3 Aug 02 06:46:30.545478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-aa8649f2-3f44-4f3f-b50d-2efc8438607c req-8d9e3019-f178-46f7-82d3-793e2fc09147 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 06:46:30.548324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a065f475-4a8a-409f-8b7f-74e8c0c1e466 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:30.548852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a065f475-4a8a-409f-8b7f-74e8c0c1e466 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:30.552484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a065f475-4a8a-409f-8b7f-74e8c0c1e466 None None] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:30.552910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a065f475-4a8a-409f-8b7f-74e8c0c1e466 None None] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:30.585337 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.compute.rpcapi [None req-a065f475-4a8a-409f-8b7f-74e8c0c1e466 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 06:46:30.587732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a065f475-4a8a-409f-8b7f-74e8c0c1e466 None None] Releasing lock "compute-rpcapi-router" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 06:46:30.631000 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a065f475-4a8a-409f-8b7f-74e8c0c1e466 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.373904 Aug 02 06:46:30.631645 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 72/118] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:30.642475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b14a3f5-37e7-4823-bf83-3269db5f3028 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "084355ce918044b9988d3356abd08de1"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:30.648348 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:30.648348 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:31.193062 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6b14a3f5-37e7-4823-bf83-3269db5f3028 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/206536847/action" status: 200 len: 21 microversion: 2.1 time: 0.555578 Aug 02 06:46:31.193923 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 73/119] 10.222.0.79 () {60 vars in 1197 bytes} [Tue Aug 2 06:46:30 2022] POST /compute/v2.1/flavors/206536847/action => generated 21 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:46:31.207982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df1f8bb0-ebd1-4abe-8304-d0b56e4d4259 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:31.208998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df1f8bb0-ebd1-4abe-8304-d0b56e4d4259 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:31.216974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df1f8bb0-ebd1-4abe-8304-d0b56e4d4259 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:31.217845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df1f8bb0-ebd1-4abe-8304-d0b56e4d4259 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:31.233025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df1f8bb0-ebd1-4abe-8304-d0b56e4d4259 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:31.235392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df1f8bb0-ebd1-4abe-8304-d0b56e4d4259 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:31.489340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-df1f8bb0-ebd1-4abe-8304-d0b56e4d4259 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:31.497997 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df1f8bb0-ebd1-4abe-8304-d0b56e4d4259 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.297410 Aug 02 06:46:31.499806 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 74/120] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:31 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:31.504835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ceca04a7-135a-4c82-a5db-93dbb0b4c238 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:31.505624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ceca04a7-135a-4c82-a5db-93dbb0b4c238 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:31.519873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ceca04a7-135a-4c82-a5db-93dbb0b4c238 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:31.527173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ceca04a7-135a-4c82-a5db-93dbb0b4c238 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:31.528302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ceca04a7-135a-4c82-a5db-93dbb0b4c238 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:31.528952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ceca04a7-135a-4c82-a5db-93dbb0b4c238 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:31.607727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=16 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:31.706490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ceca04a7-135a-4c82-a5db-93dbb0b4c238 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:31.714816 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ceca04a7-135a-4c82-a5db-93dbb0b4c238 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 0.213416 Aug 02 06:46:31.727080 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 75/121] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:31 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:31.728529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0f74b499-7c0f-4185-9a6e-9b9542cc1307 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:31.728529 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:31.728529 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:31.750583 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0f74b499-7c0f-4185-9a6e-9b9542cc1307 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/206536847" status: 202 len: 0 microversion: 2.1 time: 0.026083 Aug 02 06:46:31.751367 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 76/122] 10.222.0.79 () {58 vars in 1158 bytes} [Tue Aug 2 06:46:31 2022] DELETE /compute/v2.1/flavors/206536847 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:32.092927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2c06bd6c-87a4-4ba6-8dfd-084a3084c233 tempest-SecurityGroupsTestAdminJSON-1562076909 tempest-SecurityGroupsTestAdminJSON-1562076909-project] Action: 'create', calling method: .version_select at 0x7f927bbf18b0>, body: {"security_group": {"name": "tempest-securitygroup-1767556008", "description": "tempest-description-1787536753"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:32.457182 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2c06bd6c-87a4-4ba6-8dfd-084a3084c233 tempest-SecurityGroupsTestAdminJSON-1562076909 tempest-SecurityGroupsTestAdminJSON-1562076909-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.704387 Aug 02 06:46:32.458206 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 77/123] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:46:31 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:32.471704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e31ac82f-4730-46df-9156-f2746f83ceba tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:32.515344 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e31ac82f-4730-46df-9156-f2746f83ceba tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.055654 Aug 02 06:46:32.516246 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 78/124] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:32 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:32.521407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2331edff-75b8-4d85-9e80-e1018985044a tempest-SecurityGroupsTestAdminJSON-1562076909 tempest-SecurityGroupsTestAdminJSON-1562076909-project] Action: 'create', calling method: .version_select at 0x7f927bb87790>, body: {"security_group": {"name": "tempest-securitygroup-926858081", "description": "tempest-description-1452341461"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:32.897638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=17 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:32.902016 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2331edff-75b8-4d85-9e80-e1018985044a tempest-SecurityGroupsTestAdminJSON-1562076909 tempest-SecurityGroupsTestAdminJSON-1562076909-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.384530 Aug 02 06:46:32.911455 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 79/125] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:46:32 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:32.916394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] validate_networks() for [('178d4ee9-06a0-46b2-b8bd-814f8a6113fd', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:46:32.918088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9520e57e-2c09-4463-bb41-89ce0a477e46 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:32.919101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9520e57e-2c09-4463-bb41-89ce0a477e46 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:32.927797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9520e57e-2c09-4463-bb41-89ce0a477e46 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:32.928610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9520e57e-2c09-4463-bb41-89ce0a477e46 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:32.929780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9520e57e-2c09-4463-bb41-89ce0a477e46 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:32.930551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9520e57e-2c09-4463-bb41-89ce0a477e46 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:33.080003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=34 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:33.275285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9520e57e-2c09-4463-bb41-89ce0a477e46 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:33.284664 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9520e57e-2c09-4463-bb41-89ce0a477e46 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.371427 Aug 02 06:46:33.285075 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 80/126] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:32 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:33.289909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0cd2619b-4bfc-4fec-953a-92ec27e0d813 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-477835162", "id": 1353814429, "os-flavor-access:is_public": "True"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:33.292850 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:33.292850 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:33.310066 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0cd2619b-4bfc-4fec-953a-92ec27e0d813 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.023423 Aug 02 06:46:33.310857 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 81/127] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:33 2022] POST /compute/v2.1/flavors => generated 437 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:33.315645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f44786e3-b62d-4a23-a985-d9811c7839e6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:33.316419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f44786e3-b62d-4a23-a985-d9811c7839e6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:33.323637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f44786e3-b62d-4a23-a985-d9811c7839e6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:33.324081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f44786e3-b62d-4a23-a985-d9811c7839e6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:33.324853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f44786e3-b62d-4a23-a985-d9811c7839e6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:33.325285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f44786e3-b62d-4a23-a985-d9811c7839e6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:33.469875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f44786e3-b62d-4a23-a985-d9811c7839e6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:33.477967 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f44786e3-b62d-4a23-a985-d9811c7839e6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 0.165954 Aug 02 06:46:33.478850 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 82/128] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:33 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:33.749036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:46:33.749467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:46:33.750159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:46:33.750769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:46:33.751555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:46:33.761091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:33.761541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:33.762561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:33.763172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:33.771177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=68 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:33.775513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c8f30800-ce31-4f49-a814-80318de4f1ef tempest-SecurityGroupsTestAdminJSON-966244574 tempest-SecurityGroupsTestAdminJSON-966244574-project-admin] Action: 'create', calling method: .version_select at 0x7f927bb8e700>, body: {"security_group": {"name": "tempest-securitygroup-1360552812", "description": "tempest-description-1017387207"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:33.785362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Getting quotas for project fcf8ed73c2f64b7194098acb56270897. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:46:33.789682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Getting quotas for user 5c5e925155c248be81bfc65bc7652ab6 and project fcf8ed73c2f64b7194098acb56270897. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:46:33.801361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:46:33.803821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:46:33.858101 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3c7f7984-0649-4ba4-b3fe-d98e650634f8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.466628 Aug 02 06:46:33.858101 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 47/129] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 4468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:46:33.862436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6beb2da0-80a0-4a3f-b9c2-a751071e330c tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:33.863375 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:33.863375 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:33.871145 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-6beb2da0-80a0-4a3f-b9c2-a751071e330c tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6beb2da0-80a0-4a3f-b9c2-a751071e330c tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Request method failure captured: Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/flavors/1353814429/os-flavor-access HTTP/1.1 Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MhBUMOuE3dov9isV0Qk9Fyre5uwXtG3DVuYzLdXGCB_pwmQfYmLuCJZXd8LVN7RDQ5xWCBa5Q2wRrD78DgayICEsC_QgL2xtxxS8s4gs1LwlUJAG2_FtVQczJRooTXXrulMTuc2COYpxI6VlcQkd2Ys0n9DWeMSua-LTMeCblU68p8 Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 97cafba1ed5a488c8733d0d43881cf3b Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1113623032 Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:46:33.873102 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:46:33.875230 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/97cafba1ed5a488c8733d0d43881cf3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/97cafba1ed5a488c8733d0d43881cf3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_97cafba1ed5a488c8733d0d43881cf3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/97cafba1ed5a488c8733d0d43881cf3b"}]}] Aug 02 06:46:33.875230 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1113623032 Aug 02 06:46:33.875230 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 97cafba1ed5a488c8733d0d43881cf3b Aug 02 06:46:33.875230 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1113623032 Aug 02 06:46:33.875230 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin Aug 02 06:46:33.875230 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:33.875230 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:33.875230 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: eaee6545ae5b4e3fa452ca3be3e7567f Aug 02 06:46:33.875230 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin Aug 02 06:46:33.875230 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:33.875230 n-d-851337-3 devstack@n-api.service[126119]: exception: Access list not available for public flavors. Aug 02 06:46:33.875230 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'flavor_id': '1353814429'} Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 02 06:46:33.876471 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:33.877669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6beb2da0-80a0-4a3f-b9c2-a751071e330c tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:33.877669 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6beb2da0-80a0-4a3f-b9c2-a751071e330c tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/1353814429/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.018681 Aug 02 06:46:33.877669 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 48/130] 10.222.0.79 () {58 vars in 1209 bytes} [Tue Aug 2 06:46:33 2022] GET /compute/v2.1/flavors/1353814429/os-flavor-access => generated 91 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:46:33.887851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-790bbd0e-817a-4cf2-9c98-6b2f88e5f819 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:33.891647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-790bbd0e-817a-4cf2-9c98-6b2f88e5f819 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:33.965646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-790bbd0e-817a-4cf2-9c98-6b2f88e5f819 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:33.972767 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-790bbd0e-817a-4cf2-9c98-6b2f88e5f819 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 200 len: 1265 microversion: 2.1 time: 0.096145 Aug 02 06:46:33.974018 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 49/131] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:33 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:33.979290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d3dc7775-feee-4e22-8460-974166a0db00 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:33.980245 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:33.980245 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:34.003282 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d3dc7775-feee-4e22-8460-974166a0db00 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1353814429" status: 202 len: 0 microversion: 2.1 time: 0.027332 Aug 02 06:46:34.007416 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 50/132] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:46:33 2022] DELETE /compute/v2.1/flavors/1353814429 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:34.013201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6d1074cd-89d3-4afa-b409-35d309e8343a tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:34.035865 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6d1074cd-89d3-4afa-b409-35d309e8343a tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.026914 Aug 02 06:46:34.050393 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 51/133] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:34 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:34.058692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ec8c4eba-6364-45c9-b641-8eb6e0c1035c tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1951262388", "id": 1273590830, "os-flavor-access:is_public": "False"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:34.061502 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:34.061502 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:34.079454 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ec8c4eba-6364-45c9-b641-8eb6e0c1035c tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.024705 Aug 02 06:46:34.080367 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 52/134] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:34 2022] POST /compute/v2.1/flavors => generated 439 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:34.137048 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c8f30800-ce31-4f49-a814-80318de4f1ef tempest-SecurityGroupsTestAdminJSON-966244574 tempest-SecurityGroupsTestAdminJSON-966244574-project-admin] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.655275 Aug 02 06:46:34.142628 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 83/135] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:46:33 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:34.152097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4467d09b-5ec6-4a5c-9a57-93ce93ab67ef tempest-SecurityGroupsTestAdminJSON-966244574 tempest-SecurityGroupsTestAdminJSON-966244574-project-admin] Action: 'create', calling method: .version_select at 0x7f927bb8eaf0>, body: {"security_group": {"name": "tempest-securitygroup-630456722", "description": "tempest-description-1395004282"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:34.341186 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4467d09b-5ec6-4a5c-9a57-93ce93ab67ef tempest-SecurityGroupsTestAdminJSON-966244574 tempest-SecurityGroupsTestAdminJSON-966244574-project-admin] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.192466 Aug 02 06:46:34.347164 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 84/136] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:46:34 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:34.353941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0e144023-a323-40d0-865a-d271557b4dc6 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:34.354637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0e144023-a323-40d0-865a-d271557b4dc6 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:34.361983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e144023-a323-40d0-865a-d271557b4dc6 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:34.362660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e144023-a323-40d0-865a-d271557b4dc6 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:34.363634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e144023-a323-40d0-865a-d271557b4dc6 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:34.364136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e144023-a323-40d0-865a-d271557b4dc6 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:34.472809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-905fb68f-5958-4079-bdd3-e31f4d457971 tempest-FlavorsAccessNegativeTestJSON-942083795 tempest-FlavorsAccessNegativeTestJSON-942083795-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "084355ce918044b9988d3356abd08de1"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:34.475332 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:34.475332 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:34.476206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-905fb68f-5958-4079-bdd3-e31f4d457971 tempest-FlavorsAccessNegativeTestJSON-942083795 tempest-FlavorsAccessNegativeTestJSON-942083795-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '1817c068fc47489a906d0c4d628fe208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084355ce918044b9988d3356abd08de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-905fb68f-5958-4079-bdd3-e31f4d457971 tempest-FlavorsAccessNegativeTestJSON-942083795 tempest-FlavorsAccessNegativeTestJSON-942083795-project] Request method failure captured: Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/flavors/1273590830/action HTTP/1.1 Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 67 Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MhA3mwg0zxNdTsHcqpqs26MDfLJMVqZ8fT8R4OXMIFn1Ve3UTL3n3flpaLoMWqhI6i3RVpXHdTymJr2HYv77FeR1MF3dlC-U7Bo_7vAbiTyMFm6Y30bnzw-DG0HagKPh7urG5bOUD6B40u5dlkc4Hh-G4D-VchVXd27ZeBZOs5u6VE Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 084355ce918044b9988d3356abd08de1 Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-942083795 Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:46:34.477824 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:46:34.479165 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/084355ce918044b9988d3356abd08de1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/084355ce918044b9988d3356abd08de1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_084355ce918044b9988d3356abd08de1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/084355ce918044b9988d3356abd08de1"}]}] Aug 02 06:46:34.479165 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-942083795 Aug 02 06:46:34.479165 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 084355ce918044b9988d3356abd08de1 Aug 02 06:46:34.479165 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-942083795 Aug 02 06:46:34.479165 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FlavorsAccessNegativeTestJSON-942083795-project Aug 02 06:46:34.479165 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:34.479165 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:34.479165 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 1817c068fc47489a906d0c4d628fe208 Aug 02 06:46:34.479165 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-942083795-project Aug 02 06:46:34.479165 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:46:34.479165 n-d-851337-3 devstack@n-api.service[126119]: {"addTenantAccess": {"tenant": "084355ce918044b9988d3356abd08de1"}} Aug 02 06:46:34.479165 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1273590830', 'body': {'addTenantAccess': {'tenant': '084355ce918044b9988d3356abd08de1'}}} Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:34.479847 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 02 06:46:34.480907 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:34.482718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-905fb68f-5958-4079-bdd3-e31f4d457971 tempest-FlavorsAccessNegativeTestJSON-942083795 tempest-FlavorsAccessNegativeTestJSON-942083795-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:34.482718 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-905fb68f-5958-4079-bdd3-e31f4d457971 tempest-FlavorsAccessNegativeTestJSON-942083795 tempest-FlavorsAccessNegativeTestJSON-942083795-project] 10.222.0.79 "POST /compute/v2.1/flavors/1273590830/action" status: 403 len: 130 microversion: 2.1 time: 0.388146 Aug 02 06:46:34.483243 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 53/137] 10.222.0.79 () {60 vars in 1200 bytes} [Tue Aug 2 06:46:34 2022] POST /compute/v2.1/flavors/1273590830/action => generated 130 bytes in 392 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:34.487844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fa1ef1d6-3848-4d55-b853-667389c3d158 tempest-SecurityGroupsTestAdminJSON-966244574 tempest-SecurityGroupsTestAdminJSON-966244574-project-admin] Calling method '.version_select at 0x7f927bdfd430>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:34.551724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0e144023-a323-40d0-865a-d271557b4dc6 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:34.555439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:34.560121 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0e144023-a323-40d0-865a-d271557b4dc6 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.211573 Aug 02 06:46:34.560699 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 85/138] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:34 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:34.565639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-52ee999d-c9f2-4abc-b464-5dbece19b732 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:34.566506 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:34.566506 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:34.585938 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-52ee999d-c9f2-4abc-b464-5dbece19b732 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1273590830" status: 202 len: 0 microversion: 2.1 time: 0.023616 Aug 02 06:46:34.586634 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 86/139] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:46:34 2022] DELETE /compute/v2.1/flavors/1273590830 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:34.593973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5fac5c3b-800c-4256-99c8-9a401d834a23 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:34.595034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5fac5c3b-800c-4256-99c8-9a401d834a23 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:34.602165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5fac5c3b-800c-4256-99c8-9a401d834a23 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:34.603045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5fac5c3b-800c-4256-99c8-9a401d834a23 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:34.604006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5fac5c3b-800c-4256-99c8-9a401d834a23 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:34.604690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5fac5c3b-800c-4256-99c8-9a401d834a23 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:35.031938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5fac5c3b-800c-4256-99c8-9a401d834a23 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:35.041988 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5fac5c3b-800c-4256-99c8-9a401d834a23 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 0.453297 Aug 02 06:46:35.043717 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 87/140] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:34 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:35.049682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2b238b76-0dad-47f8-9a1e-cd8746c617c9 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:35.073853 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2b238b76-0dad-47f8-9a1e-cd8746c617c9 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.028860 Aug 02 06:46:35.074474 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 88/141] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:35 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:35.084599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cdffc6be-d77b-4d11-8060-7da01e2c35bc tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:35.090580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cdffc6be-d77b-4d11-8060-7da01e2c35bc tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:35.103774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdffc6be-d77b-4d11-8060-7da01e2c35bc tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:35.104400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdffc6be-d77b-4d11-8060-7da01e2c35bc tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:35.105717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdffc6be-d77b-4d11-8060-7da01e2c35bc tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:35.106511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdffc6be-d77b-4d11-8060-7da01e2c35bc tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:35.212738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cdffc6be-d77b-4d11-8060-7da01e2c35bc tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:35.222923 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cdffc6be-d77b-4d11-8060-7da01e2c35bc tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 200 len: 1291 microversion: 2.1 time: 0.146779 Aug 02 06:46:35.224244 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 89/142] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:35 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 1291 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:35.229704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2d7c2403-572b-4d31-99d9-c5c567a4b7d2 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-988721982", "id": 603630594, "os-flavor-access:is_public": "False"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:35.234735 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:35.234735 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:35.257418 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2d7c2403-572b-4d31-99d9-c5c567a4b7d2 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.031720 Aug 02 06:46:35.259013 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 90/143] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:35 2022] POST /compute/v2.1/flavors => generated 435 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:35.276641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c372194a-13ce-4d3a-8c1b-ae80401fa946 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "084355ce918044b9988d3356abd08de1"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:35.284603 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:35.284603 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:35.517610 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c372194a-13ce-4d3a-8c1b-ae80401fa946 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/603630594/action" status: 200 len: 96 microversion: 2.1 time: 0.249258 Aug 02 06:46:35.518247 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 91/144] 10.222.0.79 () {60 vars in 1197 bytes} [Tue Aug 2 06:46:35 2022] POST /compute/v2.1/flavors/603630594/action => generated 96 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:46:35.528466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8883c62c-9083-4703-9464-d8d0362be44d tempest-FlavorsAccessNegativeTestJSON-942083795 tempest-FlavorsAccessNegativeTestJSON-942083795-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "084355ce918044b9988d3356abd08de1"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:35.531241 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:35.531241 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:35.532114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8883c62c-9083-4703-9464-d8d0362be44d tempest-FlavorsAccessNegativeTestJSON-942083795 tempest-FlavorsAccessNegativeTestJSON-942083795-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '1817c068fc47489a906d0c4d628fe208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084355ce918044b9988d3356abd08de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8883c62c-9083-4703-9464-d8d0362be44d tempest-FlavorsAccessNegativeTestJSON-942083795 tempest-FlavorsAccessNegativeTestJSON-942083795-project] Request method failure captured: Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/flavors/603630594/action HTTP/1.1 Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 70 Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MhA3mwg0zxNdTsHcqpqs26MDfLJMVqZ8fT8R4OXMIFn1Ve3UTL3n3flpaLoMWqhI6i3RVpXHdTymJr2HYv77FeR1MF3dlC-U7Bo_7vAbiTyMFm6Y30bnzw-DG0HagKPh7urG5bOUD6B40u5dlkc4Hh-G4D-VchVXd27ZeBZOs5u6VE Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 084355ce918044b9988d3356abd08de1 Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-942083795 Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:35.534082 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:35.535446 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/084355ce918044b9988d3356abd08de1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/084355ce918044b9988d3356abd08de1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_084355ce918044b9988d3356abd08de1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/084355ce918044b9988d3356abd08de1"}]}] Aug 02 06:46:35.535446 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-942083795 Aug 02 06:46:35.535446 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 084355ce918044b9988d3356abd08de1 Aug 02 06:46:35.535446 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-942083795 Aug 02 06:46:35.535446 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-FlavorsAccessNegativeTestJSON-942083795-project Aug 02 06:46:35.535446 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:35.535446 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:35.535446 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 1817c068fc47489a906d0c4d628fe208 Aug 02 06:46:35.535446 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-942083795-project Aug 02 06:46:35.535446 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:46:35.535446 n-d-851337-3 devstack@n-api.service[126120]: {"removeTenantAccess": {"tenant": "084355ce918044b9988d3356abd08de1"}} Aug 02 06:46:35.535446 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '603630594', 'body': {'removeTenantAccess': {'tenant': '084355ce918044b9988d3356abd08de1'}}} Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can( Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:35.539514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 02 06:46:35.540864 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:35.542186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8883c62c-9083-4703-9464-d8d0362be44d tempest-FlavorsAccessNegativeTestJSON-942083795 tempest-FlavorsAccessNegativeTestJSON-942083795-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:35.542186 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8883c62c-9083-4703-9464-d8d0362be44d tempest-FlavorsAccessNegativeTestJSON-942083795 tempest-FlavorsAccessNegativeTestJSON-942083795-project] 10.222.0.79 "POST /compute/v2.1/flavors/603630594/action" status: 403 len: 133 microversion: 2.1 time: 0.010827 Aug 02 06:46:35.542186 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 92/145] 10.222.0.79 () {60 vars in 1197 bytes} [Tue Aug 2 06:46:35 2022] POST /compute/v2.1/flavors/603630594/action => generated 133 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:46:35.544956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6dd3500c-6dee-4ae7-b1f1-b444258619a7 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "084355ce918044b9988d3356abd08de1"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:35.619465 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6dd3500c-6dee-4ae7-b1f1-b444258619a7 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/603630594/action" status: 200 len: 21 microversion: 2.1 time: 0.078881 Aug 02 06:46:35.625296 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 93/146] 10.222.0.79 () {60 vars in 1197 bytes} [Tue Aug 2 06:46:35 2022] POST /compute/v2.1/flavors/603630594/action => generated 21 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:46:35.630270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-17a9b7c1-e314-4dc9-92ab-e189c6811b78 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:35.630889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-17a9b7c1-e314-4dc9-92ab-e189c6811b78 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:35.637712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17a9b7c1-e314-4dc9-92ab-e189c6811b78 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:35.638201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17a9b7c1-e314-4dc9-92ab-e189c6811b78 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:35.638977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17a9b7c1-e314-4dc9-92ab-e189c6811b78 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:35.639417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17a9b7c1-e314-4dc9-92ab-e189c6811b78 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:35.961426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-17a9b7c1-e314-4dc9-92ab-e189c6811b78 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:35.974432 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-17a9b7c1-e314-4dc9-92ab-e189c6811b78 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.347903 Aug 02 06:46:35.976286 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 94/147] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:35 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:35.982152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-657a3bc6-8604-4a8a-937e-2a78f1aed7a7 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:35.982953 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:35.982953 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:35.996350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:DELETE=11 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:36.007413 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-657a3bc6-8604-4a8a-937e-2a78f1aed7a7 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/603630594" status: 202 len: 0 microversion: 2.1 time: 0.029633 Aug 02 06:46:36.008007 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 95/148] 10.222.0.79 () {58 vars in 1158 bytes} [Tue Aug 2 06:46:35 2022] DELETE /compute/v2.1/flavors/603630594 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:36.019811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4cc229d1-3393-41d1-aa5e-b4b7bb08a374 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:36.044453 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4cc229d1-3393-41d1-aa5e-b4b7bb08a374 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.031418 Aug 02 06:46:36.055116 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 96/149] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:36 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:36.066508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-94d5a233-8d8b-4054-9994-1df90f1c700a tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-237812971", "id": 2047134452, "os-flavor-access:is_public": "False"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:36.070832 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:36.070832 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:36.089691 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-94d5a233-8d8b-4054-9994-1df90f1c700a tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.028232 Aug 02 06:46:36.090415 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 97/150] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:36 2022] POST /compute/v2.1/flavors => generated 438 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:36.102433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4ec0e2c6-8ddb-4003-bf27-53372f4b195a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:36.103053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4ec0e2c6-8ddb-4003-bf27-53372f4b195a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:36.115264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ec0e2c6-8ddb-4003-bf27-53372f4b195a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:36.116887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ec0e2c6-8ddb-4003-bf27-53372f4b195a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:36.118220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ec0e2c6-8ddb-4003-bf27-53372f4b195a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:36.119091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ec0e2c6-8ddb-4003-bf27-53372f4b195a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:36.321617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4ec0e2c6-8ddb-4003-bf27-53372f4b195a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:36.330582 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4ec0e2c6-8ddb-4003-bf27-53372f4b195a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 0.232014 Aug 02 06:46:36.345936 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 98/151] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:36 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:36.356404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0814ba25-74ae-4a07-abdb-f37354d22ce3 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4b7291b7da0245fe93d4bd14169bd663"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:36.359166 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:36.359166 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:36.597072 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-0814ba25-74ae-4a07-abdb-f37354d22ce3 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] HTTP exception thrown: Flavor access not found for 34 / 4b7291b7da0245fe93d4bd14169bd663 combination. Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0814ba25-74ae-4a07-abdb-f37354d22ce3 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Request method failure captured: Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/flavors/2047134452/action HTTP/1.1 Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 70 Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MhBUMOuE3dov9isV0Qk9Fyre5uwXtG3DVuYzLdXGCB_pwmQfYmLuCJZXd8LVN7RDQ5xWCBa5Q2wRrD78DgayICEsC_QgL2xtxxS8s4gs1LwlUJAG2_FtVQczJRooTXXrulMTuc2COYpxI6VlcQkd2Ys0n9DWeMSua-LTMeCblU68p8 Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 97cafba1ed5a488c8733d0d43881cf3b Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1113623032 Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:46:36.599150 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:46:36.600284 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/97cafba1ed5a488c8733d0d43881cf3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/97cafba1ed5a488c8733d0d43881cf3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_97cafba1ed5a488c8733d0d43881cf3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/97cafba1ed5a488c8733d0d43881cf3b"}]}] Aug 02 06:46:36.600284 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1113623032 Aug 02 06:46:36.600284 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 97cafba1ed5a488c8733d0d43881cf3b Aug 02 06:46:36.600284 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1113623032 Aug 02 06:46:36.600284 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin Aug 02 06:46:36.600284 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:36.600284 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:36.600284 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: eaee6545ae5b4e3fa452ca3be3e7567f Aug 02 06:46:36.600284 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin Aug 02 06:46:36.600284 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:46:36.600284 n-d-851337-3 devstack@n-api.service[126120]: {"removeTenantAccess": {"tenant": "4b7291b7da0245fe93d4bd14169bd663"}} Aug 02 06:46:36.600284 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: exception: Flavor access not found for 34 / 4b7291b7da0245fe93d4bd14169bd663 combination. Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '2047134452', 'body': {'removeTenantAccess': {'tenant': '4b7291b7da0245fe93d4bd14169bd663'}}} Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 02 06:46:36.600898 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 34 / 4b7291b7da0245fe93d4bd14169bd663 combination. Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 34 / 4b7291b7da0245fe93d4bd14169bd663 combination. Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:36.601856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:36.602930 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:36.602930 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:36.602930 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:36.602930 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:36.602930 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 34 / 4b7291b7da0245fe93d4bd14169bd663 combination. Aug 02 06:46:36.602930 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:36.605178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0814ba25-74ae-4a07-abdb-f37354d22ce3 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Returning 404 to user: Flavor access not found for 34 / 4b7291b7da0245fe93d4bd14169bd663 combination. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:36.606193 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0814ba25-74ae-4a07-abdb-f37354d22ce3 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/2047134452/action" status: 404 len: 124 microversion: 2.1 time: 0.259017 Aug 02 06:46:36.606926 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 99/152] 10.222.0.79 () {60 vars in 1200 bytes} [Tue Aug 2 06:46:36 2022] POST /compute/v2.1/flavors/2047134452/action => generated 124 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:36.613123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f0c58b52-b3bf-485a-91ce-ea6288df6cf7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:36.613926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f0c58b52-b3bf-485a-91ce-ea6288df6cf7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:36.622417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0c58b52-b3bf-485a-91ce-ea6288df6cf7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:36.623000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0c58b52-b3bf-485a-91ce-ea6288df6cf7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:36.623884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0c58b52-b3bf-485a-91ce-ea6288df6cf7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:36.624395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0c58b52-b3bf-485a-91ce-ea6288df6cf7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:36.711579 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fa1ef1d6-3848-4d55-b853-667389c3d158 tempest-SecurityGroupsTestAdminJSON-966244574 tempest-SecurityGroupsTestAdminJSON-966244574-project-admin] 10.222.0.79 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 6939 microversion: 2.1 time: 2.227060 Aug 02 06:46:36.712908 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 54/153] 10.222.0.79 () {58 vars in 1191 bytes} [Tue Aug 2 06:46:34 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 6939 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:36.717656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8b9bedf8-e7ad-4c52-b744-95ff8467d1dc tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:36.746866 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8b9bedf8-e7ad-4c52-b744-95ff8467d1dc tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/2047134452" status: 202 len: 0 microversion: 2.1 time: 0.032723 Aug 02 06:46:36.747457 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 55/154] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:46:36 2022] DELETE /compute/v2.1/flavors/2047134452 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:36.755835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-65141e2a-ecce-40dc-9d1c-63d81df6b36a tempest-SecurityGroupsTestAdminJSON-1562076909 tempest-SecurityGroupsTestAdminJSON-1562076909-project] Calling method '.version_select at 0x7f927be393a0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:36.872244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f0c58b52-b3bf-485a-91ce-ea6288df6cf7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:36.887613 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f0c58b52-b3bf-485a-91ce-ea6288df6cf7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 200 len: 1412 microversion: 2.1 time: 0.279384 Aug 02 06:46:36.888200 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 100/155] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:36 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 1412 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:36.901980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43e16385-be86-4ff7-862a-41b7f13096f5 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:36.944266 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43e16385-be86-4ff7-862a-41b7f13096f5 tempest-FlavorsAccessNegativeTestJSON-1113623032 tempest-FlavorsAccessNegativeTestJSON-1113623032-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.054948 Aug 02 06:46:36.951642 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 101/156] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:46:36 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:36.999558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7ee66159-ec8a-436b-8919-dd7adcbab53f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:37.000789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7ee66159-ec8a-436b-8919-dd7adcbab53f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:37.012367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ee66159-ec8a-436b-8919-dd7adcbab53f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:37.013030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ee66159-ec8a-436b-8919-dd7adcbab53f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:37.014430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ee66159-ec8a-436b-8919-dd7adcbab53f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:37.015154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ee66159-ec8a-436b-8919-dd7adcbab53f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:37.059173 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-65141e2a-ecce-40dc-9d1c-63d81df6b36a tempest-SecurityGroupsTestAdminJSON-1562076909 tempest-SecurityGroupsTestAdminJSON-1562076909-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.307953 Aug 02 06:46:37.067775 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 56/157] 10.222.0.79 () {58 vars in 1191 bytes} [Tue Aug 2 06:46:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:37.073753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-531da809-05a5-40f3-b540-6b17b2c04561 tempest-SecurityGroupsTestAdminJSON-966244574 tempest-SecurityGroupsTestAdminJSON-966244574-project-admin] Calling method '.version_select at 0x7f927bda30d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:37.294341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7ee66159-ec8a-436b-8919-dd7adcbab53f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:37.306796 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7ee66159-ec8a-436b-8919-dd7adcbab53f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.313945 Aug 02 06:46:37.308691 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 102/158] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:36 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:37.363739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6d99dc90-5881-4b9c-afec-ff1ba41dac99 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:37.366598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6d99dc90-5881-4b9c-afec-ff1ba41dac99 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:37.393488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d99dc90-5881-4b9c-afec-ff1ba41dac99 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:37.394101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d99dc90-5881-4b9c-afec-ff1ba41dac99 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:37.395433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d99dc90-5881-4b9c-afec-ff1ba41dac99 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:37.395866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d99dc90-5881-4b9c-afec-ff1ba41dac99 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:37.403048 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-531da809-05a5-40f3-b540-6b17b2c04561 tempest-SecurityGroupsTestAdminJSON-966244574 tempest-SecurityGroupsTestAdminJSON-966244574-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/9dfdd9da-a48e-4513-936b-2fd250a1317b" status: 202 len: 0 microversion: 2.1 time: 0.333392 Aug 02 06:46:37.404167 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 57/159] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:46:37 2022] DELETE /compute/v2.1/os-security-groups/9dfdd9da-a48e-4513-936b-2fd250a1317b => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:46:37.412682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-76916447-180b-42a9-b2d7-724af748b1ea tempest-SecurityGroupsTestAdminJSON-966244574 tempest-SecurityGroupsTestAdminJSON-966244574-project-admin] Calling method '.version_select at 0x7f927bd40a60>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:37.630073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6d99dc90-5881-4b9c-afec-ff1ba41dac99 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:37.638921 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6d99dc90-5881-4b9c-afec-ff1ba41dac99 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 0.286863 Aug 02 06:46:37.639842 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 103/160] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:37 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:37.662293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-14ea4576-0368-48f5-8c97-4e5d11febc2c req-0ddb14d7-c511-40fa-95e3-9f3b07a12568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "996312b8-1c9c-4def-aa0b-4eaf8f74e3c8", "tag": "bfaf7f27-ecd4-4a2a-bbfd-d833f7f8f759"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:37.691188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-14ea4576-0368-48f5-8c97-4e5d11febc2c req-0ddb14d7-c511-40fa-95e3-9f3b07a12568 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:37.695468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-14ea4576-0368-48f5-8c97-4e5d11febc2c req-0ddb14d7-c511-40fa-95e3-9f3b07a12568 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:37.732587 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-14ea4576-0368-48f5-8c97-4e5d11febc2c req-0ddb14d7-c511-40fa-95e3-9f3b07a12568 service nova] Creating event network-changed:bfaf7f27-ecd4-4a2a-bbfd-d833f7f8f759 for instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 on n-h2-851337-3 Aug 02 06:46:37.739722 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-14ea4576-0368-48f5-8c97-4e5d11febc2c req-0ddb14d7-c511-40fa-95e3-9f3b07a12568 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098250 Aug 02 06:46:37.743175 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 104/161] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:37.793513 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-76916447-180b-42a9-b2d7-724af748b1ea tempest-SecurityGroupsTestAdminJSON-966244574 tempest-SecurityGroupsTestAdminJSON-966244574-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/120f7111-153a-4f2a-85d9-e9ee799314a8" status: 202 len: 0 microversion: 2.1 time: 0.384868 Aug 02 06:46:37.796157 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 58/162] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:46:37 2022] DELETE /compute/v2.1/os-security-groups/120f7111-153a-4f2a-85d9-e9ee799314a8 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:37.816199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8b711ada-ef95-4b5c-b524-85cbf200835b tempest-SecurityGroupsTestAdminJSON-1562076909 tempest-SecurityGroupsTestAdminJSON-1562076909-project] Calling method '.version_select at 0x7f927bbf1550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:37.911225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-04fb9c62-6fee-4411-96f5-918dc195b189 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:37.911838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-04fb9c62-6fee-4411-96f5-918dc195b189 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:37.931320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04fb9c62-6fee-4411-96f5-918dc195b189 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:37.932346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04fb9c62-6fee-4411-96f5-918dc195b189 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:37.933368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04fb9c62-6fee-4411-96f5-918dc195b189 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:37.934053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04fb9c62-6fee-4411-96f5-918dc195b189 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:38.361814 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8b711ada-ef95-4b5c-b524-85cbf200835b tempest-SecurityGroupsTestAdminJSON-1562076909 tempest-SecurityGroupsTestAdminJSON-1562076909-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/e9c220d1-7791-465a-a9ec-ee67981b89f3" status: 202 len: 0 microversion: 2.1 time: 0.558814 Aug 02 06:46:38.362854 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 105/163] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:46:37 2022] DELETE /compute/v2.1/os-security-groups/e9c220d1-7791-465a-a9ec-ee67981b89f3 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:46:38.368074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-26240919-8a2a-4feb-b7cb-57f66e9a5f57 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:38.368673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-26240919-8a2a-4feb-b7cb-57f66e9a5f57 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:38.375887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26240919-8a2a-4feb-b7cb-57f66e9a5f57 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:38.376333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26240919-8a2a-4feb-b7cb-57f66e9a5f57 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:38.377147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26240919-8a2a-4feb-b7cb-57f66e9a5f57 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:38.377574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26240919-8a2a-4feb-b7cb-57f66e9a5f57 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:38.404566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-04fb9c62-6fee-4411-96f5-918dc195b189 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:38.415284 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-04fb9c62-6fee-4411-96f5-918dc195b189 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 200 len: 1412 microversion: 2.1 time: 0.508001 Aug 02 06:46:38.428761 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 59/164] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:37 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 1412 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:38.433845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c813f291-0d6c-43ed-91f2-7dd8149c5d0e tempest-SecurityGroupsTestAdminJSON-1562076909 tempest-SecurityGroupsTestAdminJSON-1562076909-project] Calling method '.version_select at 0x7f927bdc6a60>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:38.627812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-26240919-8a2a-4feb-b7cb-57f66e9a5f57 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:38.648170 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-26240919-8a2a-4feb-b7cb-57f66e9a5f57 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.281598 Aug 02 06:46:38.648798 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 106/165] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:38 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:38.663017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2a22f55c-c544-4199-bb54-b17362036344 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:38.663878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2a22f55c-c544-4199-bb54-b17362036344 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:38.679940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a22f55c-c544-4199-bb54-b17362036344 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:38.680768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a22f55c-c544-4199-bb54-b17362036344 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:38.681750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a22f55c-c544-4199-bb54-b17362036344 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:38.682408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a22f55c-c544-4199-bb54-b17362036344 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:38.771958 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c813f291-0d6c-43ed-91f2-7dd8149c5d0e tempest-SecurityGroupsTestAdminJSON-1562076909 tempest-SecurityGroupsTestAdminJSON-1562076909-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/3855ebf5-0d08-46aa-b455-d56c54daa9f3" status: 202 len: 0 microversion: 2.1 time: 0.341806 Aug 02 06:46:38.772537 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 60/166] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:46:38 2022] DELETE /compute/v2.1/os-security-groups/3855ebf5-0d08-46aa-b455-d56c54daa9f3 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:46:38.878669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2a22f55c-c544-4199-bb54-b17362036344 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:38.886879 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2a22f55c-c544-4199-bb54-b17362036344 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 0.228291 Aug 02 06:46:38.887775 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 107/167] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:38 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:39.294200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-817373912", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": "none"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:39.357337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:46:39.358323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:46:39.359278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:46:39.360007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:46:39.361069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:46:39.378775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:39.379243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:39.380357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:39.380465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:39.400262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Getting quotas for project 252702b461514c20853159fa3138c43c. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:46:39.404866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Getting quotas for user 7082e2ac9bb043c2a96c61f07de8281c and project 252702b461514c20853159fa3138c43c. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:46:39.418580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:46:39.421179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:46:39.440224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aa71ed22-68f0-40fa-9bf0-d69936df9da8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:39.442157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aa71ed22-68f0-40fa-9bf0-d69936df9da8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:39.453085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa71ed22-68f0-40fa-9bf0-d69936df9da8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:39.454264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa71ed22-68f0-40fa-9bf0-d69936df9da8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:39.455898 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa71ed22-68f0-40fa-9bf0-d69936df9da8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:39.456628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa71ed22-68f0-40fa-9bf0-d69936df9da8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:39.490365 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-19d1fa14-ec51-4fbc-9cd5-15392ff6c8d6 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.639663 Aug 02 06:46:39.491272 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 61/168] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 06:46:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 06:46:39.503373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8184249a-aa3a-49f8-8079-c0e1f72090a3 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:39.506079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8184249a-aa3a-49f8-8079-c0e1f72090a3 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:39.633850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8184249a-aa3a-49f8-8079-c0e1f72090a3 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:39.645695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8184249a-aa3a-49f8-8079-c0e1f72090a3 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:39.647951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8184249a-aa3a-49f8-8079-c0e1f72090a3 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:39.668256 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8184249a-aa3a-49f8-8079-c0e1f72090a3 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "PUT /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1358 microversion: 2.75 time: 0.169559 Aug 02 06:46:39.670095 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 62/169] 10.222.0.79 () {62 vars in 1297 bytes} [Tue Aug 2 06:46:39 2022] PUT /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:46:39.699317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fd0e847f-4da6-4bde-ad24-78f6e9d22cff tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:39.699944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fd0e847f-4da6-4bde-ad24-78f6e9d22cff tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:39.718666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd0e847f-4da6-4bde-ad24-78f6e9d22cff tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:39.719119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd0e847f-4da6-4bde-ad24-78f6e9d22cff tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:39.722671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd0e847f-4da6-4bde-ad24-78f6e9d22cff tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:39.723131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd0e847f-4da6-4bde-ad24-78f6e9d22cff tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:39.789844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-aa71ed22-68f0-40fa-9bf0-d69936df9da8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:39.814443 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aa71ed22-68f0-40fa-9bf0-d69936df9da8 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 200 len: 1412 microversion: 2.1 time: 0.380610 Aug 02 06:46:39.816785 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 108/170] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:39 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 1412 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:39.828968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e1683111-c5f0-4a49-9cee-2f370765da17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:39.830837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e1683111-c5f0-4a49-9cee-2f370765da17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:40.080876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e1683111-c5f0-4a49-9cee-2f370765da17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:40.091369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e1683111-c5f0-4a49-9cee-2f370765da17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:40.094086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e1683111-c5f0-4a49-9cee-2f370765da17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:40.105216 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e1683111-c5f0-4a49-9cee-2f370765da17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1358 microversion: 2.75 time: 0.286690 Aug 02 06:46:40.122887 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 109/171] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:39 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1358 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:40.128071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0861c0a0-b662-4c94-bb23-33f2111ce3f2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:40.128723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0861c0a0-b662-4c94-bb23-33f2111ce3f2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:40.136144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fd0e847f-4da6-4bde-ad24-78f6e9d22cff tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:40.147252 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fd0e847f-4da6-4bde-ad24-78f6e9d22cff tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.455793 Aug 02 06:46:40.150494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0861c0a0-b662-4c94-bb23-33f2111ce3f2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:40.150948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0861c0a0-b662-4c94-bb23-33f2111ce3f2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:40.151798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0861c0a0-b662-4c94-bb23-33f2111ce3f2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:40.152257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0861c0a0-b662-4c94-bb23-33f2111ce3f2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:40.166656 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 63/172] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:39 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:40.397744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0861c0a0-b662-4c94-bb23-33f2111ce3f2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:40.408148 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0861c0a0-b662-4c94-bb23-33f2111ce3f2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 0.284014 Aug 02 06:46:40.410565 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 110/173] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:40 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:40.476426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-7ae05e9f-cd83-4ecc-bf4d-b29b1235220d req-9e5e7fa6-fa3a-496e-989e-3538a5a69a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb3120a-e908-473d-8ca1-e4c436aec919", "name": "network-vif-plugged", "status": "completed", "tag": "9cace3c3-57b9-40a1-b369-dce8d985258c"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:40.488078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7ae05e9f-cd83-4ecc-bf4d-b29b1235220d req-9e5e7fa6-fa3a-496e-989e-3538a5a69a54 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:40.488684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7ae05e9f-cd83-4ecc-bf4d-b29b1235220d req-9e5e7fa6-fa3a-496e-989e-3538a5a69a54 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:40.502209 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-7ae05e9f-cd83-4ecc-bf4d-b29b1235220d req-9e5e7fa6-fa3a-496e-989e-3538a5a69a54 service nova] Creating event network-vif-plugged:9cace3c3-57b9-40a1-b369-dce8d985258c for instance efb3120a-e908-473d-8ca1-e4c436aec919 on n-h2-851337-3 Aug 02 06:46:40.509099 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-7ae05e9f-cd83-4ecc-bf4d-b29b1235220d req-9e5e7fa6-fa3a-496e-989e-3538a5a69a54 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163177 Aug 02 06:46:40.510450 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 64/174] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:40.835670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7a686f2d-dff3-41a2-961b-4c7ef6a8c0f9 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:40.836244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7a686f2d-dff3-41a2-961b-4c7ef6a8c0f9 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:40.839320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:40.847062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a686f2d-dff3-41a2-961b-4c7ef6a8c0f9 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:40.849628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a686f2d-dff3-41a2-961b-4c7ef6a8c0f9 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:40.851829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a686f2d-dff3-41a2-961b-4c7ef6a8c0f9 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:40.853536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a686f2d-dff3-41a2-961b-4c7ef6a8c0f9 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:41.029783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7a686f2d-dff3-41a2-961b-4c7ef6a8c0f9 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:41.037498 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7a686f2d-dff3-41a2-961b-4c7ef6a8c0f9 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 200 len: 1412 microversion: 2.1 time: 0.205633 Aug 02 06:46:41.038846 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 111/175] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:40 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 1412 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:41.139782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5e24c696-6894-4895-b48a-0b22d189c49d tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:41.140565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5e24c696-6894-4895-b48a-0b22d189c49d tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:41.144124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:41.148290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e24c696-6894-4895-b48a-0b22d189c49d tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:41.148948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e24c696-6894-4895-b48a-0b22d189c49d tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:41.149874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e24c696-6894-4895-b48a-0b22d189c49d tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:41.150715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e24c696-6894-4895-b48a-0b22d189c49d tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:41.181286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dbd5aef0-fab7-4f81-8d2d-a8e4f801a5bf tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:41.182260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dbd5aef0-fab7-4f81-8d2d-a8e4f801a5bf tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:41.192460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbd5aef0-fab7-4f81-8d2d-a8e4f801a5bf tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:41.194696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbd5aef0-fab7-4f81-8d2d-a8e4f801a5bf tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:41.198319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbd5aef0-fab7-4f81-8d2d-a8e4f801a5bf tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:41.199667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbd5aef0-fab7-4f81-8d2d-a8e4f801a5bf tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:41.295717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5e24c696-6894-4895-b48a-0b22d189c49d tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:41.307209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5e24c696-6894-4895-b48a-0b22d189c49d tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:41.309425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5e24c696-6894-4895-b48a-0b22d189c49d tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:41.316856 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5e24c696-6894-4895-b48a-0b22d189c49d tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1428 microversion: 2.75 time: 0.181745 Aug 02 06:46:41.318042 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 65/176] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:41 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1428 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:41.391255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dbd5aef0-fab7-4f81-8d2d-a8e4f801a5bf tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:41.399133 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dbd5aef0-fab7-4f81-8d2d-a8e4f801a5bf tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.223365 Aug 02 06:46:41.410075 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 112/177] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:41 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:41.431819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ac57306-0fad-42d9-9a26-68dfb507b536 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:41.432351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ac57306-0fad-42d9-9a26-68dfb507b536 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:41.439187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ac57306-0fad-42d9-9a26-68dfb507b536 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:41.439944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ac57306-0fad-42d9-9a26-68dfb507b536 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:41.440934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ac57306-0fad-42d9-9a26-68dfb507b536 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:41.441435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ac57306-0fad-42d9-9a26-68dfb507b536 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:41.590288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ac57306-0fad-42d9-9a26-68dfb507b536 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:41.603241 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ac57306-0fad-42d9-9a26-68dfb507b536 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 0.175268 Aug 02 06:46:41.604649 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 66/178] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:41 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:42.059235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ac387de9-6c3b-4ee6-8b99-ef558d29eedb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:42.059843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ac387de9-6c3b-4ee6-8b99-ef558d29eedb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:42.066405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac387de9-6c3b-4ee6-8b99-ef558d29eedb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:42.067087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac387de9-6c3b-4ee6-8b99-ef558d29eedb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:42.068067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac387de9-6c3b-4ee6-8b99-ef558d29eedb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:42.068710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac387de9-6c3b-4ee6-8b99-ef558d29eedb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:42.230682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ac387de9-6c3b-4ee6-8b99-ef558d29eedb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:42.239024 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ac387de9-6c3b-4ee6-8b99-ef558d29eedb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 200 len: 1412 microversion: 2.1 time: 0.183634 Aug 02 06:46:42.253167 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 113/179] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:42 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 1412 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:42.258741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-038a3b6e-6960-4fa5-9cb3-52ff72912fac tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Calling method '.version_select at 0x7f927bd439d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:42.261702 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:42.261702 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:42.262938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-038a3b6e-6960-4fa5-9cb3-52ff72912fac tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:42.263383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-038a3b6e-6960-4fa5-9cb3-52ff72912fac tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:42.264623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-038a3b6e-6960-4fa5-9cb3-52ff72912fac tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:42.265065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-038a3b6e-6960-4fa5-9cb3-52ff72912fac tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:42.292118 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-038a3b6e-6960-4fa5-9cb3-52ff72912fac tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.185522 Aug 02 06:46:42.299336 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 67/180] 10.222.0.79 () {58 vars in 1128 bytes} [Tue Aug 2 06:46:42 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:42.304760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df115b16-7ede-44bc-9270-c90b1c32602b tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Calling method '.version_select at 0x7f927bef5790>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:42.307885 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:42.307885 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:42.309302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df115b16-7ede-44bc-9270-c90b1c32602b tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:42.309746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df115b16-7ede-44bc-9270-c90b1c32602b tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:42.311246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df115b16-7ede-44bc-9270-c90b1c32602b tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:42.312542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df115b16-7ede-44bc-9270-c90b1c32602b tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:42.343193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-601e92cb-7e14-4648-aedd-4bb5da061ddb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:42.343916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-601e92cb-7e14-4648-aedd-4bb5da061ddb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:42.346856 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df115b16-7ede-44bc-9270-c90b1c32602b tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.046188 Aug 02 06:46:42.347922 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 114/181] 10.222.0.79 () {58 vars in 1139 bytes} [Tue Aug 2 06:46:42 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:42.350921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-601e92cb-7e14-4648-aedd-4bb5da061ddb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:42.351444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-601e92cb-7e14-4648-aedd-4bb5da061ddb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:42.352341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-601e92cb-7e14-4648-aedd-4bb5da061ddb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:42.352845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-601e92cb-7e14-4648-aedd-4bb5da061ddb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:42.361184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7844b6b5-c578-41a8-90bf-9576cd39f2de tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Calling method '.version_select at 0x7f927bde28b0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:42.363762 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:42.363762 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:42.364894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7844b6b5-c578-41a8-90bf-9576cd39f2de tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:42.366082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7844b6b5-c578-41a8-90bf-9576cd39f2de tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:42.366169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7844b6b5-c578-41a8-90bf-9576cd39f2de tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:42.366546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7844b6b5-c578-41a8-90bf-9576cd39f2de tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:42.391215 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7844b6b5-c578-41a8-90bf-9576cd39f2de tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.034348 Aug 02 06:46:42.393934 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 115/182] 10.222.0.79 () {58 vars in 1145 bytes} [Tue Aug 2 06:46:42 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 06:46:42.421349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e84fe3ce-6cf2-4d9d-997e-ef26ef21ab95 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:42.422060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e84fe3ce-6cf2-4d9d-997e-ef26ef21ab95 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:42.422317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-601e92cb-7e14-4648-aedd-4bb5da061ddb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:42.429350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e84fe3ce-6cf2-4d9d-997e-ef26ef21ab95 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:42.430081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e84fe3ce-6cf2-4d9d-997e-ef26ef21ab95 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:42.431031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e84fe3ce-6cf2-4d9d-997e-ef26ef21ab95 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:42.431636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e84fe3ce-6cf2-4d9d-997e-ef26ef21ab95 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:42.432184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-601e92cb-7e14-4648-aedd-4bb5da061ddb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:42.433661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-601e92cb-7e14-4648-aedd-4bb5da061ddb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:42.439400 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-601e92cb-7e14-4648-aedd-4bb5da061ddb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1416 microversion: 2.75 time: 0.099970 Aug 02 06:46:42.440135 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 68/183] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:42 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1416 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:46:42.575648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e84fe3ce-6cf2-4d9d-997e-ef26ef21ab95 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:42.583986 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e84fe3ce-6cf2-4d9d-997e-ef26ef21ab95 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.167323 Aug 02 06:46:42.584599 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 116/184] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:42 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:42.624774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-24056966-9067-4a1e-b65a-a6b9bf3583e7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:42.625398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-24056966-9067-4a1e-b65a-a6b9bf3583e7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:42.631962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24056966-9067-4a1e-b65a-a6b9bf3583e7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:42.632412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24056966-9067-4a1e-b65a-a6b9bf3583e7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:42.633300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24056966-9067-4a1e-b65a-a6b9bf3583e7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:42.633741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24056966-9067-4a1e-b65a-a6b9bf3583e7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:42.753558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-334492756", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:42.774118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-24056966-9067-4a1e-b65a-a6b9bf3583e7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:42.783922 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-24056966-9067-4a1e-b65a-a6b9bf3583e7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1339 microversion: 2.1 time: 0.163047 Aug 02 06:46:42.786739 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 69/185] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:42 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1339 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:42.819313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:46:43.020601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:46:43.021023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:46:43.021511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:46:43.021919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:46:43.022345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:46:43.031496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:43.031941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:43.032785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:43.033217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:43.050334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Getting quotas for project 3573e2fa6bf04720b7fb8d85b6cc5a54. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:46:43.054398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Getting quotas for user b5122454fd05436fb394a44cef1db729 and project 3573e2fa6bf04720b7fb8d85b6cc5a54. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:46:43.065851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:46:43.068525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:46:43.121104 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7671a0f1-d280-46ef-a2ba-df21e7948c3f tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491995 Aug 02 06:46:43.121738 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 117/186] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 06:46:43.174234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1650201878", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:43.225993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:46:43.260672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-adb4220d-344a-4d7f-a408-3c54af222ae5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:43.261375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-adb4220d-344a-4d7f-a408-3c54af222ae5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:43.268239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-adb4220d-344a-4d7f-a408-3c54af222ae5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:43.268719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-adb4220d-344a-4d7f-a408-3c54af222ae5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:43.269463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-adb4220d-344a-4d7f-a408-3c54af222ae5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:43.269883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-adb4220d-344a-4d7f-a408-3c54af222ae5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:43.274040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:43.466590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-adb4220d-344a-4d7f-a408-3c54af222ae5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:43.474620 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-adb4220d-344a-4d7f-a408-3c54af222ae5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 200 len: 1412 microversion: 2.1 time: 0.218107 Aug 02 06:46:43.475226 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 118/187] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:43 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 1412 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:43.480515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b235a150-2033-4964-a809-3b3060c41051 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:43.481259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b235a150-2033-4964-a809-3b3060c41051 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:43.493210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b235a150-2033-4964-a809-3b3060c41051 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:43.493697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b235a150-2033-4964-a809-3b3060c41051 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:43.494498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b235a150-2033-4964-a809-3b3060c41051 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:43.495026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b235a150-2033-4964-a809-3b3060c41051 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:43.504635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:46:43.505688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:46:43.506438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:46:43.506846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:46:43.507306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:46:43.517367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:43.517929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:43.519028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:43.519476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:43.539387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Getting quotas for project 3573e2fa6bf04720b7fb8d85b6cc5a54. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:46:43.544303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Getting quotas for user b5122454fd05436fb394a44cef1db729 and project 3573e2fa6bf04720b7fb8d85b6cc5a54. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:46:43.572586 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:46:43.575902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:46:43.626556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b235a150-2033-4964-a809-3b3060c41051 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:43.645757 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3e742dea-0145-4519-bf32-efc59945fb6a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.476029 Aug 02 06:46:43.647567 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 70/188] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:46:43.649353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b235a150-2033-4964-a809-3b3060c41051 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:43.652780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b235a150-2033-4964-a809-3b3060c41051 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:43.654766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0df6dfbf-167f-4d28-af5c-083f7437445d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:43.655621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0df6dfbf-167f-4d28-af5c-083f7437445d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:43.666183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0df6dfbf-167f-4d28-af5c-083f7437445d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:43.666850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0df6dfbf-167f-4d28-af5c-083f7437445d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:43.668598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0df6dfbf-167f-4d28-af5c-083f7437445d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:43.669249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0df6dfbf-167f-4d28-af5c-083f7437445d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:43.671478 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b235a150-2033-4964-a809-3b3060c41051 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1416 microversion: 2.75 time: 0.194648 Aug 02 06:46:43.672795 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 119/189] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:43 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1416 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:43.679539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ae6563be-468e-44c8-ba71-b8732ab644d4 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:43.680707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae6563be-468e-44c8-ba71-b8732ab644d4 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:43.775000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ae6563be-468e-44c8-ba71-b8732ab644d4 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:43.788507 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ae6563be-468e-44c8-ba71-b8732ab644d4 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 200 len: 1214 microversion: 2.1 time: 0.114605 Aug 02 06:46:43.789372 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 120/190] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:43 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:43.809955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-36b99951-c61d-41e3-ba31-b7d8c8f48ba7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:43.810671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-36b99951-c61d-41e3-ba31-b7d8c8f48ba7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:43.829217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36b99951-c61d-41e3-ba31-b7d8c8f48ba7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:43.829730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36b99951-c61d-41e3-ba31-b7d8c8f48ba7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:43.830778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36b99951-c61d-41e3-ba31-b7d8c8f48ba7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:43.831053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36b99951-c61d-41e3-ba31-b7d8c8f48ba7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:43.867336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0df6dfbf-167f-4d28-af5c-083f7437445d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:43.878936 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0df6dfbf-167f-4d28-af5c-083f7437445d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.229919 Aug 02 06:46:43.879709 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 71/191] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:43 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:43.943562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-2a15114c-9e39-493c-8300-ac94c05bdf8f req-288843ee-6bbf-45ab-ac06-34351c48fed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a8a334e-542e-452d-8822-2324c95201f4", "name": "network-vif-plugged", "status": "completed", "tag": "894f0ef5-8e0a-4cde-927f-f70e446bf0eb"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:43.955453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2a15114c-9e39-493c-8300-ac94c05bdf8f req-288843ee-6bbf-45ab-ac06-34351c48fed6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:43.955944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2a15114c-9e39-493c-8300-ac94c05bdf8f req-288843ee-6bbf-45ab-ac06-34351c48fed6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:43.968944 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-2a15114c-9e39-493c-8300-ac94c05bdf8f req-288843ee-6bbf-45ab-ac06-34351c48fed6 service nova] Creating event network-vif-plugged:894f0ef5-8e0a-4cde-927f-f70e446bf0eb for instance 0a8a334e-542e-452d-8822-2324c95201f4 on n-h1-851337-3 Aug 02 06:46:43.976054 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-2a15114c-9e39-493c-8300-ac94c05bdf8f req-288843ee-6bbf-45ab-ac06-34351c48fed6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039212 Aug 02 06:46:43.977217 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 72/192] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:44.063138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-36b99951-c61d-41e3-ba31-b7d8c8f48ba7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:44.072482 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-36b99951-c61d-41e3-ba31-b7d8c8f48ba7 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1489 microversion: 2.1 time: 0.266794 Aug 02 06:46:44.073567 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 121/193] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:43 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1489 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:44.098702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4332dece-e87e-452e-901a-5a686c041fcb tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:44.101194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4332dece-e87e-452e-901a-5a686c041fcb tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:44.109238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4332dece-e87e-452e-901a-5a686c041fcb tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:44.110716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4332dece-e87e-452e-901a-5a686c041fcb tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:44.111705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4332dece-e87e-452e-901a-5a686c041fcb tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:44.112357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4332dece-e87e-452e-901a-5a686c041fcb tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:44.458297 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4332dece-e87e-452e-901a-5a686c041fcb tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1640 microversion: 2.1 time: 0.367653 Aug 02 06:46:44.459115 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 73/194] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:44 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1640 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:44.478135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0761a614-60f5-4f0b-8ec0-fbc2cca4859a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:44.478754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0761a614-60f5-4f0b-8ec0-fbc2cca4859a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:44.485293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0761a614-60f5-4f0b-8ec0-fbc2cca4859a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:44.485803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0761a614-60f5-4f0b-8ec0-fbc2cca4859a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:44.486608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0761a614-60f5-4f0b-8ec0-fbc2cca4859a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:44.487206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0761a614-60f5-4f0b-8ec0-fbc2cca4859a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:44.495910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-98100d0e-17d7-45dc-88d7-7499e6960ccf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:44.496446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-98100d0e-17d7-45dc-88d7-7499e6960ccf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:44.502813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98100d0e-17d7-45dc-88d7-7499e6960ccf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:44.503484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98100d0e-17d7-45dc-88d7-7499e6960ccf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:44.504357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98100d0e-17d7-45dc-88d7-7499e6960ccf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:44.504938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98100d0e-17d7-45dc-88d7-7499e6960ccf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:44.525344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0761a614-60f5-4f0b-8ec0-fbc2cca4859a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:46:44.674502 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0761a614-60f5-4f0b-8ec0-fbc2cca4859a tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "DELETE /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 204 len: 0 microversion: 2.1 time: 0.199757 Aug 02 06:46:44.678449 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 122/195] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:46:44 2022] DELETE /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:46:44.683401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8f7fcdeb-1540-42bb-8657-0f0517ae585e tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:44.684098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8f7fcdeb-1540-42bb-8657-0f0517ae585e tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:44.690677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7fcdeb-1540-42bb-8657-0f0517ae585e tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:44.691124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7fcdeb-1540-42bb-8657-0f0517ae585e tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:44.691886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7fcdeb-1540-42bb-8657-0f0517ae585e tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:44.692401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7fcdeb-1540-42bb-8657-0f0517ae585e tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:44.703203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-98100d0e-17d7-45dc-88d7-7499e6960ccf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:44.712863 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-98100d0e-17d7-45dc-88d7-7499e6960ccf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 200 len: 1412 microversion: 2.1 time: 0.221093 Aug 02 06:46:44.713694 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 74/196] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:44 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 1412 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:44.718743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3329d19c-7f94-46a3-914b-44af983b0006 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:44.719437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3329d19c-7f94-46a3-914b-44af983b0006 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:44.731528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3329d19c-7f94-46a3-914b-44af983b0006 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:44.732641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3329d19c-7f94-46a3-914b-44af983b0006 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:44.733327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3329d19c-7f94-46a3-914b-44af983b0006 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:44.733758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3329d19c-7f94-46a3-914b-44af983b0006 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:44.832879 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3329d19c-7f94-46a3-914b-44af983b0006 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:44.849747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3329d19c-7f94-46a3-914b-44af983b0006 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:44.853015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3329d19c-7f94-46a3-914b-44af983b0006 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:44.858917 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3329d19c-7f94-46a3-914b-44af983b0006 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1416 microversion: 2.75 time: 0.143792 Aug 02 06:46:44.859501 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 75/197] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:44 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1416 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:44.876073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-23ee5915-0342-4196-a02e-9de5c0007105 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:44.876073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-23ee5915-0342-4196-a02e-9de5c0007105 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:44.877401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23ee5915-0342-4196-a02e-9de5c0007105 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:44.877605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23ee5915-0342-4196-a02e-9de5c0007105 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:44.878470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23ee5915-0342-4196-a02e-9de5c0007105 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:44.878906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23ee5915-0342-4196-a02e-9de5c0007105 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:44.882494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8f7fcdeb-1540-42bb-8657-0f0517ae585e tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:44.891372 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8f7fcdeb-1540-42bb-8657-0f0517ae585e tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1495 microversion: 2.1 time: 0.212017 Aug 02 06:46:44.892748 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 123/198] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:44 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1495 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:44.905123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f114cd5e-ae07-4571-a33a-6a6ed4309f85 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:44.905739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f114cd5e-ae07-4571-a33a-6a6ed4309f85 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:44.912051 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f114cd5e-ae07-4571-a33a-6a6ed4309f85 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:44.912492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f114cd5e-ae07-4571-a33a-6a6ed4309f85 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:44.913254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f114cd5e-ae07-4571-a33a-6a6ed4309f85 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:44.913684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f114cd5e-ae07-4571-a33a-6a6ed4309f85 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:44.952025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23ee5915-0342-4196-a02e-9de5c0007105 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:44.960760 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-23ee5915-0342-4196-a02e-9de5c0007105 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 200 len: 1296 microversion: 2.1 time: 0.094357 Aug 02 06:46:44.961354 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 76/199] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:44 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:45.049864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f114cd5e-ae07-4571-a33a-6a6ed4309f85 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:45.057603 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f114cd5e-ae07-4571-a33a-6a6ed4309f85 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.156770 Aug 02 06:46:45.058450 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 124/200] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:44 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:45.738195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-901e1842-a334-4e2c-91b1-f55abac1db94 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:45.738814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-901e1842-a334-4e2c-91b1-f55abac1db94 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:45.746075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-901e1842-a334-4e2c-91b1-f55abac1db94 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:45.746572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-901e1842-a334-4e2c-91b1-f55abac1db94 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:45.747393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-901e1842-a334-4e2c-91b1-f55abac1db94 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:45.747845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-901e1842-a334-4e2c-91b1-f55abac1db94 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:45.884072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83e8cf16-1fd5-4a94-92b2-4fad3d789efe tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:45.885653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-83e8cf16-1fd5-4a94-92b2-4fad3d789efe tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:45.892241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83e8cf16-1fd5-4a94-92b2-4fad3d789efe tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:45.892935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83e8cf16-1fd5-4a94-92b2-4fad3d789efe tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:45.893601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83e8cf16-1fd5-4a94-92b2-4fad3d789efe tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:45.894204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83e8cf16-1fd5-4a94-92b2-4fad3d789efe tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:45.925538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-901e1842-a334-4e2c-91b1-f55abac1db94 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:45.937675 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-901e1842-a334-4e2c-91b1-f55abac1db94 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 200 len: 1412 microversion: 2.1 time: 0.205273 Aug 02 06:46:45.938941 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 77/201] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:45 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 1412 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:45.944655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-53d9fc99-61c0-4cc1-9d19-c08c3e0b34a6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:45.945481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-53d9fc99-61c0-4cc1-9d19-c08c3e0b34a6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:45.960853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53d9fc99-61c0-4cc1-9d19-c08c3e0b34a6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:45.961387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53d9fc99-61c0-4cc1-9d19-c08c3e0b34a6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:45.962295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53d9fc99-61c0-4cc1-9d19-c08c3e0b34a6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:45.962975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53d9fc99-61c0-4cc1-9d19-c08c3e0b34a6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:46.012546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-83e8cf16-1fd5-4a94-92b2-4fad3d789efe tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:46.024707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-83e8cf16-1fd5-4a94-92b2-4fad3d789efe tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:46.028366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-83e8cf16-1fd5-4a94-92b2-4fad3d789efe tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:46.038714 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-83e8cf16-1fd5-4a94-92b2-4fad3d789efe tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1416 microversion: 2.75 time: 0.158533 Aug 02 06:46:46.042642 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 125/202] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:45 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1416 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:46:46.050553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c77a92b-3553-420b-a93a-4605cc9b1a8c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:46.051263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9c77a92b-3553-420b-a93a-4605cc9b1a8c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:46.066924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c77a92b-3553-420b-a93a-4605cc9b1a8c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:46.067401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c77a92b-3553-420b-a93a-4605cc9b1a8c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:46.068179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c77a92b-3553-420b-a93a-4605cc9b1a8c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:46.069228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c77a92b-3553-420b-a93a-4605cc9b1a8c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:46.159061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9c77a92b-3553-420b-a93a-4605cc9b1a8c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:46.167091 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9c77a92b-3553-420b-a93a-4605cc9b1a8c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 200 len: 1306 microversion: 2.1 time: 0.123225 Aug 02 06:46:46.168303 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 126/203] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:46 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 1306 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:46.172925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-eed10797-918c-4868-b92b-eb99483ffc34 req-cd0b5023-4534-434d-8797-b3d82c448711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "996312b8-1c9c-4def-aa0b-4eaf8f74e3c8", "name": "network-vif-plugged", "status": "completed", "tag": "bfaf7f27-ecd4-4a2a-bbfd-d833f7f8f759"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:46.179655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:46.184058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-eed10797-918c-4868-b92b-eb99483ffc34 req-cd0b5023-4534-434d-8797-b3d82c448711 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:46.184623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-eed10797-918c-4868-b92b-eb99483ffc34 req-cd0b5023-4534-434d-8797-b3d82c448711 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:46.188468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-53d9fc99-61c0-4cc1-9d19-c08c3e0b34a6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:46.197294 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-53d9fc99-61c0-4cc1-9d19-c08c3e0b34a6 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1495 microversion: 2.1 time: 0.256699 Aug 02 06:46:46.198557 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 78/204] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:45 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1495 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:46.199833 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-eed10797-918c-4868-b92b-eb99483ffc34 req-cd0b5023-4534-434d-8797-b3d82c448711 service nova] Creating event network-vif-plugged:bfaf7f27-ecd4-4a2a-bbfd-d833f7f8f759 for instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 on n-h2-851337-3 Aug 02 06:46:46.203674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-43e9afb1-03db-4e4d-974b-f0184c51398d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:46.204280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-43e9afb1-03db-4e4d-974b-f0184c51398d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:46.204821 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-eed10797-918c-4868-b92b-eb99483ffc34 req-cd0b5023-4534-434d-8797-b3d82c448711 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035247 Aug 02 06:46:46.205567 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 127/205] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:46.210450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43e9afb1-03db-4e4d-974b-f0184c51398d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:46.210897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43e9afb1-03db-4e4d-974b-f0184c51398d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:46.211668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43e9afb1-03db-4e4d-974b-f0184c51398d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:46.212096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43e9afb1-03db-4e4d-974b-f0184c51398d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:46.482488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-960f27f5-837b-4729-99d2-35d528ea9cab req-3d08a099-9a52-4f8d-b5b9-07ad02e8f07b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9733613-ae5d-4c27-bf69-3958cd6e459c", "tag": "0020b2b9-f4f6-4a11-bb9e-d97035e3f4d9"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:46.502283 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-960f27f5-837b-4729-99d2-35d528ea9cab req-3d08a099-9a52-4f8d-b5b9-07ad02e8f07b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:46.502718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-960f27f5-837b-4729-99d2-35d528ea9cab req-3d08a099-9a52-4f8d-b5b9-07ad02e8f07b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:46.514733 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-960f27f5-837b-4729-99d2-35d528ea9cab req-3d08a099-9a52-4f8d-b5b9-07ad02e8f07b service nova] Creating event network-changed:0020b2b9-f4f6-4a11-bb9e-d97035e3f4d9 for instance d9733613-ae5d-4c27-bf69-3958cd6e459c on n-h2-851337-3 Aug 02 06:46:46.519776 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-960f27f5-837b-4729-99d2-35d528ea9cab req-3d08a099-9a52-4f8d-b5b9-07ad02e8f07b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042538 Aug 02 06:46:46.520620 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 128/206] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:46.543411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-43e9afb1-03db-4e4d-974b-f0184c51398d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:46.551307 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-43e9afb1-03db-4e4d-974b-f0184c51398d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1319 microversion: 2.1 time: 0.351537 Aug 02 06:46:46.552132 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 79/207] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:46 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:46.958929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dfb6cca0-c7cf-4735-b77d-5ff8df09b6ca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:46.960066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dfb6cca0-c7cf-4735-b77d-5ff8df09b6ca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:46.966780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dfb6cca0-c7cf-4735-b77d-5ff8df09b6ca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:46.967295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dfb6cca0-c7cf-4735-b77d-5ff8df09b6ca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:46.968160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dfb6cca0-c7cf-4735-b77d-5ff8df09b6ca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:46.968652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dfb6cca0-c7cf-4735-b77d-5ff8df09b6ca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.068210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ece0a11-61ea-4866-a66c-4544a1f0b468 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:47.068821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ece0a11-61ea-4866-a66c-4544a1f0b468 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:47.075493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ece0a11-61ea-4866-a66c-4544a1f0b468 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.076047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ece0a11-61ea-4866-a66c-4544a1f0b468 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.076819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ece0a11-61ea-4866-a66c-4544a1f0b468 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.077486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ece0a11-61ea-4866-a66c-4544a1f0b468 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.191964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ece0a11-61ea-4866-a66c-4544a1f0b468 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:47.195866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:47.201769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ece0a11-61ea-4866-a66c-4544a1f0b468 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:47.203300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ece0a11-61ea-4866-a66c-4544a1f0b468 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:47.208625 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ece0a11-61ea-4866-a66c-4544a1f0b468 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1437 microversion: 2.75 time: 0.145043 Aug 02 06:46:47.209232 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 80/208] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:47 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1437 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:46:47.214047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ec69de40-1f6f-4c33-83be-bf9f14bd367b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:47.214643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ec69de40-1f6f-4c33-83be-bf9f14bd367b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:47.222348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec69de40-1f6f-4c33-83be-bf9f14bd367b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.223118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec69de40-1f6f-4c33-83be-bf9f14bd367b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.223973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec69de40-1f6f-4c33-83be-bf9f14bd367b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.224417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec69de40-1f6f-4c33-83be-bf9f14bd367b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.324604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ec69de40-1f6f-4c33-83be-bf9f14bd367b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:47.333258 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ec69de40-1f6f-4c33-83be-bf9f14bd367b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 200 len: 1294 microversion: 2.1 time: 0.123027 Aug 02 06:46:47.334076 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 81/209] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:47 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 1294 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:47.346085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab0b23b7-f452-4854-ad3c-f2acefd00168 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:47.346085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ab0b23b7-f452-4854-ad3c-f2acefd00168 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:47.346375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dfb6cca0-c7cf-4735-b77d-5ff8df09b6ca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:47.352071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab0b23b7-f452-4854-ad3c-f2acefd00168 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.352765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab0b23b7-f452-4854-ad3c-f2acefd00168 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.353561 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dfb6cca0-c7cf-4735-b77d-5ff8df09b6ca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 200 len: 1412 microversion: 2.1 time: 0.398681 Aug 02 06:46:47.354091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab0b23b7-f452-4854-ad3c-f2acefd00168 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.354202 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 129/210] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:46 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 1412 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:47.359494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:47.362693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab0b23b7-f452-4854-ad3c-f2acefd00168 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.362828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:47.370862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.370862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.371138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.371383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.611568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:46:47.612048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:46:47.612573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:46:47.613064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:46:47.613533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:46:47.697009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:47.704584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.705182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.706288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.706551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.735004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ab0b23b7-f452-4854-ad3c-f2acefd00168 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:47.748100 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ab0b23b7-f452-4854-ad3c-f2acefd00168 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1495 microversion: 2.1 time: 0.412988 Aug 02 06:46:47.762696 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 82/211] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:47 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1495 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:47.767898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ba33881-6850-4acd-9035-21074742d60a tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:47.768511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ba33881-6850-4acd-9035-21074742d60a tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:47.774809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ba33881-6850-4acd-9035-21074742d60a tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.775426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ba33881-6850-4acd-9035-21074742d60a tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.776341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ba33881-6850-4acd-9035-21074742d60a tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.776928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ba33881-6850-4acd-9035-21074742d60a tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.790883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:47.800283 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:47.802389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:47.808876 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ef4d55da-fb35-40bc-a6b6-52a4996e4c0c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "POST /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680/action" status: 202 len: 1494 microversion: 2.75 time: 0.453696 Aug 02 06:46:47.809534 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 130/212] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Aug 2 06:46:47 2022] POST /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680/action => generated 1494 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 02 06:46:47.839580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e36a1fbc-8538-47f9-98eb-67aeb6988600 req-107da2d2-3760-475c-8e0d-1ff9ed3298fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb3120a-e908-473d-8ca1-e4c436aec919", "name": "network-vif-deleted", "tag": "9cace3c3-57b9-40a1-b369-dce8d985258c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:47.853061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e36a1fbc-8538-47f9-98eb-67aeb6988600 req-107da2d2-3760-475c-8e0d-1ff9ed3298fb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.854074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e36a1fbc-8538-47f9-98eb-67aeb6988600 req-107da2d2-3760-475c-8e0d-1ff9ed3298fb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.869275 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e36a1fbc-8538-47f9-98eb-67aeb6988600 req-107da2d2-3760-475c-8e0d-1ff9ed3298fb service nova] Creating event network-vif-deleted:9cace3c3-57b9-40a1-b369-dce8d985258c for instance efb3120a-e908-473d-8ca1-e4c436aec919 on n-h2-851337-3 Aug 02 06:46:47.875868 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e36a1fbc-8538-47f9-98eb-67aeb6988600 req-107da2d2-3760-475c-8e0d-1ff9ed3298fb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047645 Aug 02 06:46:47.877800 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 131/213] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:47.885838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-35c2c982-c80f-41e0-9093-b2f3536679ae tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:47.886637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-35c2c982-c80f-41e0-9093-b2f3536679ae tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:47.895089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35c2c982-c80f-41e0-9093-b2f3536679ae tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.895610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35c2c982-c80f-41e0-9093-b2f3536679ae tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.896600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35c2c982-c80f-41e0-9093-b2f3536679ae tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:47.897035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35c2c982-c80f-41e0-9093-b2f3536679ae tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:47.989801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-35c2c982-c80f-41e0-9093-b2f3536679ae tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:47.999467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-35c2c982-c80f-41e0-9093-b2f3536679ae tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:48.001208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-35c2c982-c80f-41e0-9093-b2f3536679ae tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:48.007084 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-35c2c982-c80f-41e0-9093-b2f3536679ae tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.127105 Aug 02 06:46:48.015162 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 132/214] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:47 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:48.037599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ba33881-6850-4acd-9035-21074742d60a tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:48.045705 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ba33881-6850-4acd-9035-21074742d60a tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1468 microversion: 2.1 time: 0.281664 Aug 02 06:46:48.046319 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 83/215] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:47 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1468 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:48.183704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-474caeaa-dc8d-4cbf-922c-cae068befa20 tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:48.184199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-474caeaa-dc8d-4cbf-922c-cae068befa20 tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:48.190814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-474caeaa-dc8d-4cbf-922c-cae068befa20 tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:48.191254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-474caeaa-dc8d-4cbf-922c-cae068befa20 tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:48.192024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-474caeaa-dc8d-4cbf-922c-cae068befa20 tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:48.192448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-474caeaa-dc8d-4cbf-922c-cae068befa20 tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:48.258709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-474caeaa-dc8d-4cbf-922c-cae068befa20 tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:46:48.262050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:48.356277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fee972dc-5e68-4b5f-9b81-3b03c890ab2c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:48.357237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fee972dc-5e68-4b5f-9b81-3b03c890ab2c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:48.364502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fee972dc-5e68-4b5f-9b81-3b03c890ab2c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:48.365044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fee972dc-5e68-4b5f-9b81-3b03c890ab2c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:48.366676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fee972dc-5e68-4b5f-9b81-3b03c890ab2c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:48.367429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fee972dc-5e68-4b5f-9b81-3b03c890ab2c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:48.386825 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-474caeaa-dc8d-4cbf-922c-cae068befa20 tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] 10.222.0.79 "DELETE /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 204 len: 0 microversion: 2.1 time: 0.322886 Aug 02 06:46:48.387739 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 133/216] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:46:48 2022] DELETE /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:46:48.395172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b132070-1f15-4db7-a1c3-ce6cb93f4bca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:48.395919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6b132070-1f15-4db7-a1c3-ce6cb93f4bca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:48.403157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b132070-1f15-4db7-a1c3-ce6cb93f4bca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:48.403597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b132070-1f15-4db7-a1c3-ce6cb93f4bca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:48.404516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b132070-1f15-4db7-a1c3-ce6cb93f4bca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:48.405138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b132070-1f15-4db7-a1c3-ce6cb93f4bca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:48.874774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fee972dc-5e68-4b5f-9b81-3b03c890ab2c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:48.878167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6b132070-1f15-4db7-a1c3-ce6cb93f4bca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:48.887065 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fee972dc-5e68-4b5f-9b81-3b03c890ab2c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 200 len: 1336 microversion: 2.1 time: 0.535028 Aug 02 06:46:48.887937 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6b132070-1f15-4db7-a1c3-ce6cb93f4bca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 200 len: 1412 microversion: 2.1 time: 0.498518 Aug 02 06:46:48.888045 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 84/217] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:48 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 1336 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:48.893467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5a9212d7-dec2-4175-b68b-d0dc2eab71e8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:48.894431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5a9212d7-dec2-4175-b68b-d0dc2eab71e8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:48.896661 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 134/218] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:48 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 1412 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:48.901243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c5bc1eda-78ff-4482-aaea-b8b97ee4108b tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:48.901855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c5bc1eda-78ff-4482-aaea-b8b97ee4108b tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:48.905733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a9212d7-dec2-4175-b68b-d0dc2eab71e8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:48.906212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a9212d7-dec2-4175-b68b-d0dc2eab71e8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:48.906995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a9212d7-dec2-4175-b68b-d0dc2eab71e8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:48.907437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a9212d7-dec2-4175-b68b-d0dc2eab71e8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:48.925552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5bc1eda-78ff-4482-aaea-b8b97ee4108b tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:48.926030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5bc1eda-78ff-4482-aaea-b8b97ee4108b tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:48.929479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5bc1eda-78ff-4482-aaea-b8b97ee4108b tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:48.929874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5bc1eda-78ff-4482-aaea-b8b97ee4108b tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:48.973109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5bc1eda-78ff-4482-aaea-b8b97ee4108b tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:48.973709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5bc1eda-78ff-4482-aaea-b8b97ee4108b tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:48.974846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-c5bc1eda-78ff-4482-aaea-b8b97ee4108b tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lazy-loading 'fault' on Instance uuid efb3120a-e908-473d-8ca1-e4c436aec919 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:46:49.274858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c5bc1eda-78ff-4482-aaea-b8b97ee4108b tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4607cc90b2b04d91be564cf95bc19227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8261c265db344360973bc041d571e9f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:49.281994 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c5bc1eda-78ff-4482-aaea-b8b97ee4108b tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 200 len: 1329 microversion: 2.1 time: 0.384463 Aug 02 06:46:49.282715 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 135/219] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:48 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 1329 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:49.287299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e0394566-7a0e-4041-95bb-1bec1a500eea tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:49.287861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e0394566-7a0e-4041-95bb-1bec1a500eea tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:49.293819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0394566-7a0e-4041-95bb-1bec1a500eea tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:49.294301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0394566-7a0e-4041-95bb-1bec1a500eea tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:49.295069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0394566-7a0e-4041-95bb-1bec1a500eea tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:49.295579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0394566-7a0e-4041-95bb-1bec1a500eea tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:49.408262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e0394566-7a0e-4041-95bb-1bec1a500eea tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:49.418927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e0394566-7a0e-4041-95bb-1bec1a500eea tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:49.420947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e0394566-7a0e-4041-95bb-1bec1a500eea tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:49.426513 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e0394566-7a0e-4041-95bb-1bec1a500eea tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.142823 Aug 02 06:46:49.427319 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 136/220] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:49 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:49.453399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5a9212d7-dec2-4175-b68b-d0dc2eab71e8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:49.461121 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5a9212d7-dec2-4175-b68b-d0dc2eab71e8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1474 microversion: 2.1 time: 0.572331 Aug 02 06:46:49.461777 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 85/221] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:48 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1474 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:49.907886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c1a13c4f-c87f-4cee-9543-2993d59d28d4 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:49.908501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c1a13c4f-c87f-4cee-9543-2993d59d28d4 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:49.916160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1a13c4f-c87f-4cee-9543-2993d59d28d4 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:49.916648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1a13c4f-c87f-4cee-9543-2993d59d28d4 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:49.917844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1a13c4f-c87f-4cee-9543-2993d59d28d4 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:49.918325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1a13c4f-c87f-4cee-9543-2993d59d28d4 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:49.923951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dbac00a8-1b02-4304-b32f-dbf83c3adac4 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:49.924864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dbac00a8-1b02-4304-b32f-dbf83c3adac4 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:49.933160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbac00a8-1b02-4304-b32f-dbf83c3adac4 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:49.934273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbac00a8-1b02-4304-b32f-dbf83c3adac4 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:49.935056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbac00a8-1b02-4304-b32f-dbf83c3adac4 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:49.935750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbac00a8-1b02-4304-b32f-dbf83c3adac4 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:50.345367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c1a13c4f-c87f-4cee-9543-2993d59d28d4 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:50.353612 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c1a13c4f-c87f-4cee-9543-2993d59d28d4 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 200 len: 1336 microversion: 2.1 time: 0.449651 Aug 02 06:46:50.355843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dbac00a8-1b02-4304-b32f-dbf83c3adac4 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:50.364229 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dbac00a8-1b02-4304-b32f-dbf83c3adac4 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 200 len: 1611 microversion: 2.1 time: 0.446140 Aug 02 06:46:50.365071 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 86/222] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:49 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 1611 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:50.366382 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 137/223] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:49 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 1336 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:50.384147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7bce399d-ca8d-4127-bd80-852e068b6df2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:50.385698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8e7259e0-db41-40e1-bb88-8e3b3282afe1 req-c9503aad-ecb0-44c6-96cc-edaf050a1a01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b607f5e-31c1-40c5-bf8c-bd097275d4b6", "tag": "48058daa-15c6-43b5-9ea7-30316b9ebd93"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:50.390861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7bce399d-ca8d-4127-bd80-852e068b6df2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:50.398943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bce399d-ca8d-4127-bd80-852e068b6df2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:50.401285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bce399d-ca8d-4127-bd80-852e068b6df2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:50.402348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bce399d-ca8d-4127-bd80-852e068b6df2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:50.404729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bce399d-ca8d-4127-bd80-852e068b6df2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:50.409187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8e7259e0-db41-40e1-bb88-8e3b3282afe1 req-c9503aad-ecb0-44c6-96cc-edaf050a1a01 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:50.409630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8e7259e0-db41-40e1-bb88-8e3b3282afe1 req-c9503aad-ecb0-44c6-96cc-edaf050a1a01 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:50.422700 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8e7259e0-db41-40e1-bb88-8e3b3282afe1 req-c9503aad-ecb0-44c6-96cc-edaf050a1a01 service nova] Creating event network-changed:48058daa-15c6-43b5-9ea7-30316b9ebd93 for instance 2b607f5e-31c1-40c5-bf8c-bd097275d4b6 on n-h2-851337-3 Aug 02 06:46:50.426298 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-7bce399d-ca8d-4127-bd80-852e068b6df2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] HTTP exception thrown: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:50.428005 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8e7259e0-db41-40e1-bb88-8e3b3282afe1 req-c9503aad-ecb0-44c6-96cc-edaf050a1a01 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060391 Aug 02 06:46:50.428942 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 87/224] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7bce399d-ca8d-4127-bd80-852e068b6df2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Request method failure captured: Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 HTTP/1.1 Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgoIRWgTEHfV30A_gznp2kwY8SbC-XBpixhIxaPJQETrN0uaca2KvetOgMlv38h3kvhlXxrAvNa1haW0aLio7GkwPcjSoj2HS1MwE3eFntC4hiSDC695l35kRaPmP4lGOGwbHrKZsX1dhJNhQW7nB26XAWw5YXKg9r2eUoBkVVz-8I Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8261c265db344360973bc041d571e9f6 Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AggregatesAdminTestJSON-1247046912 Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:50.430898 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:50.432128 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8261c265db344360973bc041d571e9f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8261c265db344360973bc041d571e9f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8261c265db344360973bc041d571e9f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8261c265db344360973bc041d571e9f6"}]}] Aug 02 06:46:50.432128 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AggregatesAdminTestJSON-1247046912 Aug 02 06:46:50.432128 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8261c265db344360973bc041d571e9f6 Aug 02 06:46:50.432128 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1247046912 Aug 02 06:46:50.432128 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AggregatesAdminTestJSON-1247046912-project Aug 02 06:46:50.432128 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:50.432128 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:50.432128 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4607cc90b2b04d91be564cf95bc19227 Aug 02 06:46:50.432128 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AggregatesAdminTestJSON-1247046912-project Aug 02 06:46:50.432128 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:50.432128 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:50.432128 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'efb3120a-e908-473d-8ca1-e4c436aec919'} Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:50.432837 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:50.433942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:50.437827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7bce399d-ca8d-4127-bd80-852e068b6df2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Returning 404 to user: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:50.437827 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7bce399d-ca8d-4127-bd80-852e068b6df2 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 404 len: 111 microversion: 2.1 time: 0.064928 Aug 02 06:46:50.437827 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 138/225] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:50 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:50.438336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6914be5e-886d-4654-81ac-6f8733214731 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:50.438336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6914be5e-886d-4654-81ac-6f8733214731 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:50.442051 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dab27037-f93f-40a0-ae7c-539276a98050 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-3"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:50.443463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6914be5e-886d-4654-81ac-6f8733214731 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:50.443905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6914be5e-886d-4654-81ac-6f8733214731 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:50.447898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6914be5e-886d-4654-81ac-6f8733214731 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:50.448130 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:50.448130 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:50.449017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6914be5e-886d-4654-81ac-6f8733214731 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:50.455656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dab27037-f93f-40a0-ae7c-539276a98050 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:50.456094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dab27037-f93f-40a0-ae7c-539276a98050 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:50.623298 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dab27037-f93f-40a0-ae7c-539276a98050 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.183668 Aug 02 06:46:50.624548 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 139/226] 10.222.0.79 () {60 vars in 1191 bytes} [Tue Aug 2 06:46:50 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:50.631072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fe2da36d-ffd0-4a8c-b739-0edbbc1faa70 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:50.631894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fe2da36d-ffd0-4a8c-b739-0edbbc1faa70 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:50.640673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe2da36d-ffd0-4a8c-b739-0edbbc1faa70 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:50.641482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe2da36d-ffd0-4a8c-b739-0edbbc1faa70 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:50.643166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe2da36d-ffd0-4a8c-b739-0edbbc1faa70 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:50.643900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe2da36d-ffd0-4a8c-b739-0edbbc1faa70 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:50.757550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fe2da36d-ffd0-4a8c-b739-0edbbc1faa70 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:50.766554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fe2da36d-ffd0-4a8c-b739-0edbbc1faa70 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:50.768181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fe2da36d-ffd0-4a8c-b739-0edbbc1faa70 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:50.773720 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fe2da36d-ffd0-4a8c-b739-0edbbc1faa70 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.147380 Aug 02 06:46:50.774442 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 140/227] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:50 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:50.779203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d24940cf-808a-4128-8161-4b201cd50342 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:50.779895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d24940cf-808a-4128-8161-4b201cd50342 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:50.780880 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6914be5e-886d-4654-81ac-6f8733214731 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.350316 Aug 02 06:46:50.781563 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 88/228] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 06:46:50 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8/os-interface => generated 284 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:50.787781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-be7be9f3-6b95-45ab-8fe7-e568955fc5b2 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:50.790011 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:50.790011 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:50.793824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d24940cf-808a-4128-8161-4b201cd50342 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:50.794556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d24940cf-808a-4128-8161-4b201cd50342 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:50.795251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d24940cf-808a-4128-8161-4b201cd50342 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:50.795779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d24940cf-808a-4128-8161-4b201cd50342 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:50.821861 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-be7be9f3-6b95-45ab-8fe7-e568955fc5b2 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.039040 Aug 02 06:46:50.822640 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 89/229] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:46:50 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:50.837537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1aaaa027-94fa-4cfb-8cfb-50ba776c5bdb tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1422800981"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:50.840352 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:50.840352 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:50.841283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.aggregate [None req-1aaaa027-94fa-4cfb-8cfb-50ba776c5bdb tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Generated uuid 8c7c6713-918d-449b-b2aa-d9ad6594d227 for aggregate {{(pid=126119) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:50.863780 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1aaaa027-94fa-4cfb-8cfb-50ba776c5bdb tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.030324 Aug 02 06:46:50.870811 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 90/230] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:50.877643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e6113219-5fe0-4279-b7ce-286c6c76e827 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-3"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:50.881175 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:50.881175 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:50.893860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6113219-5fe0-4279-b7ce-286c6c76e827 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:50.894340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6113219-5fe0-4279-b7ce-286c6c76e827 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:50.989440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d24940cf-808a-4128-8161-4b201cd50342 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:50.997111 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d24940cf-808a-4128-8161-4b201cd50342 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 200 len: 1432 microversion: 2.1 time: 0.221552 Aug 02 06:46:50.997687 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 141/231] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:50 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 1432 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:51.248108 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e6113219-5fe0-4279-b7ce-286c6c76e827 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.375826 Aug 02 06:46:51.254905 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 91/232] 10.222.0.79 () {60 vars in 1191 bytes} [Tue Aug 2 06:46:50 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:51.260286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-271029e3-681a-4443-bcda-3c3868b2f9ce tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:51.261354 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:51.261354 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:51.268538 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-271029e3-681a-4443-bcda-3c3868b2f9ce tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.012284 Aug 02 06:46:51.276473 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 142/233] 10.222.0.79 () {58 vars in 1149 bytes} [Tue Aug 2 06:46:51 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:51.282996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-970d73d0-0e4e-470d-9bcc-8ced0ac34089 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-3"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:51.285657 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:51.285657 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:51.294151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-970d73d0-0e4e-470d-9bcc-8ced0ac34089 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:51.294594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-970d73d0-0e4e-470d-9bcc-8ced0ac34089 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:51.376651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-af7e1d9c-0bf6-4b4f-9afa-f6d7cef258a9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:51.377903 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-af7e1d9c-0bf6-4b4f-9afa-f6d7cef258a9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:51.384050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af7e1d9c-0bf6-4b4f-9afa-f6d7cef258a9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:51.384488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af7e1d9c-0bf6-4b4f-9afa-f6d7cef258a9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:51.385861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af7e1d9c-0bf6-4b4f-9afa-f6d7cef258a9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:51.386330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af7e1d9c-0bf6-4b4f-9afa-f6d7cef258a9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:51.410953 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-970d73d0-0e4e-470d-9bcc-8ced0ac34089 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.132107 Aug 02 06:46:51.411843 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 92/234] 10.222.0.79 () {60 vars in 1191 bytes} [Tue Aug 2 06:46:51 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:51.423468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-629a4ecf-ea36-4bb3-a14e-5466d15dcfc1 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:51.424555 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:51.424555 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:51.446404 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-629a4ecf-ea36-4bb3-a14e-5466d15dcfc1 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.026570 Aug 02 06:46:51.447023 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 93/235] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:46:51 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:51.458024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d2ac918f-0b35-4cb7-a057-1dd6fbaee2e5 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2050984902"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:51.460648 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:51.460648 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:51.461565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.aggregate [None req-d2ac918f-0b35-4cb7-a057-1dd6fbaee2e5 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Generated uuid 364cc1c1-a3e0-4419-946f-67e41ebf66b9 for aggregate {{(pid=126119) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:51.468397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:51.488607 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d2ac918f-0b35-4cb7-a057-1dd6fbaee2e5 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.034389 Aug 02 06:46:51.489497 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 94/236] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:51.507545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3055e839-3ba5-4a71-a1a4-e4a444487ce3 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-3"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:51.511686 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:51.511686 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:51.526689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3055e839-3ba5-4a71-a1a4-e4a444487ce3 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:51.527471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3055e839-3ba5-4a71-a1a4-e4a444487ce3 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:51.675345 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3055e839-3ba5-4a71-a1a4-e4a444487ce3 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.178331 Aug 02 06:46:51.676003 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 95/237] 10.222.0.79 () {60 vars in 1191 bytes} [Tue Aug 2 06:46:51 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:51.687186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-be3f4911-3f34-4f2d-a194-26e8b93cc384 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:51.687942 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:51.687942 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:51.694619 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-be3f4911-3f34-4f2d-a194-26e8b93cc384 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.011127 Aug 02 06:46:51.695376 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 96/238] 10.222.0.79 () {58 vars in 1143 bytes} [Tue Aug 2 06:46:51 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:51.706568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-576e07f1-50b4-464e-a84e-87a14c280c0c tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-3"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:51.709067 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:51.709067 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:51.718542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-576e07f1-50b4-464e-a84e-87a14c280c0c tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:51.718972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-576e07f1-50b4-464e-a84e-87a14c280c0c tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:51.867130 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-576e07f1-50b4-464e-a84e-87a14c280c0c tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.163682 Aug 02 06:46:51.868684 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 97/239] 10.222.0.79 () {60 vars in 1191 bytes} [Tue Aug 2 06:46:51 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:51.873365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a757503c-b1e5-4da1-8bb8-d231de0eb399 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:51.874429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a757503c-b1e5-4da1-8bb8-d231de0eb399 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:51.883242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a757503c-b1e5-4da1-8bb8-d231de0eb399 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:51.883680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a757503c-b1e5-4da1-8bb8-d231de0eb399 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:51.884501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a757503c-b1e5-4da1-8bb8-d231de0eb399 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:51.885628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a757503c-b1e5-4da1-8bb8-d231de0eb399 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.036396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a757503c-b1e5-4da1-8bb8-d231de0eb399 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:52.044669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a757503c-b1e5-4da1-8bb8-d231de0eb399 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:52.046243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a757503c-b1e5-4da1-8bb8-d231de0eb399 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:52.048942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-af7e1d9c-0bf6-4b4f-9afa-f6d7cef258a9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:52.051678 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a757503c-b1e5-4da1-8bb8-d231de0eb399 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.182662 Aug 02 06:46:52.063508 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 98/240] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:51 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:52.063508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e10b0edb-766c-4aed-ab65-314b50584fcb tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:52.063508 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.063508 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:52.067459 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-af7e1d9c-0bf6-4b4f-9afa-f6d7cef258a9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 200 len: 1314 microversion: 2.1 time: 0.694595 Aug 02 06:46:52.075518 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 143/241] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:51 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:52.085792 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e10b0edb-766c-4aed-ab65-314b50584fcb tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.032470 Aug 02 06:46:52.086689 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 99/242] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:46:52 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:52.092065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-38f6c35f-3264-4233-bfd4-460dcd3bdca9 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:52.092921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-38f6c35f-3264-4233-bfd4-460dcd3bdca9 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:52.096858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-9b2d6696-499d-4c1c-a03a-4a77b28641e9 req-294afdb6-00ab-4d0f-9b31-57998ff0d137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9733613-ae5d-4c27-bf69-3958cd6e459c", "name": "network-vif-plugged", "status": "completed", "tag": "0020b2b9-f4f6-4a11-bb9e-d97035e3f4d9"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:52.099725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38f6c35f-3264-4233-bfd4-460dcd3bdca9 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.100607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38f6c35f-3264-4233-bfd4-460dcd3bdca9 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.101229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38f6c35f-3264-4233-bfd4-460dcd3bdca9 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.101666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38f6c35f-3264-4233-bfd4-460dcd3bdca9 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.106487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9b2d6696-499d-4c1c-a03a-4a77b28641e9 req-294afdb6-00ab-4d0f-9b31-57998ff0d137 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.106910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9b2d6696-499d-4c1c-a03a-4a77b28641e9 req-294afdb6-00ab-4d0f-9b31-57998ff0d137 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.116799 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-38f6c35f-3264-4233-bfd4-460dcd3bdca9 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] HTTP exception thrown: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:46:52.118331 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-9b2d6696-499d-4c1c-a03a-4a77b28641e9 req-294afdb6-00ab-4d0f-9b31-57998ff0d137 service nova] Creating event network-vif-plugged:0020b2b9-f4f6-4a11-bb9e-d97035e3f4d9 for instance d9733613-ae5d-4c27-bf69-3958cd6e459c on n-h2-851337-3 Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-38f6c35f-3264-4233-bfd4-460dcd3bdca9 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Request method failure captured: Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 HTTP/1.1 Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mg0bRqjxPW4upN2EHTg1EQGC0QhDM96JlAljXPbDaOTYEWm9HSVxCM8hVMHkfFTgCQPkUXkUJNsdA3xa4e940--fb_Sesm1IuC_2ucm0FG-9S3O-JCXRqolPyXvfXORilc6WvA2VoUInpRz6GX2Doyiv9aYcZvwPxAGmrtOoRfL6Gc Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 8d7a272c645741bba2da4d0bae7a470b Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:46:52.120701 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:46:52.121952 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8d7a272c645741bba2da4d0bae7a470b"}]}] Aug 02 06:46:52.121952 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:46:52.121952 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 8d7a272c645741bba2da4d0bae7a470b Aug 02 06:46:52.121952 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:46:52.121952 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-DeleteServersAdminTestJSON-1677757129-project Aug 02 06:46:52.121952 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:52.121952 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:52.121952 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 218f99459dc54c7187c8ee0022e64e81 Aug 02 06:46:52.121952 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-DeleteServersAdminTestJSON-1677757129-project Aug 02 06:46:52.121952 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:52.121952 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:46:52.121952 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '0a8a334e-542e-452d-8822-2324c95201f4'} Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:52.122708 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:46:52.123798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.124740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-38f6c35f-3264-4233-bfd4-460dcd3bdca9 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Returning 404 to user: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:52.124740 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-38f6c35f-3264-4233-bfd4-460dcd3bdca9 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 404 len: 111 microversion: 2.1 time: 0.034322 Aug 02 06:46:52.124740 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 100/243] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:52 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:52.124931 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-9b2d6696-499d-4c1c-a03a-4a77b28641e9 req-294afdb6-00ab-4d0f-9b31-57998ff0d137 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036238 Aug 02 06:46:52.124931 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 144/244] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:52.130351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb8eb129-e314-4f0c-b8da-f402fe8c460d tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2038089860"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:52.133999 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.133999 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:52.135443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.aggregate [None req-cb8eb129-e314-4f0c-b8da-f402fe8c460d tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Generated uuid 208d4b36-b860-4e1c-b1ca-8bc29cb3cf2b for aggregate {{(pid=126119) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:52.163126 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cb8eb129-e314-4f0c-b8da-f402fe8c460d tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037856 Aug 02 06:46:52.170173 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 101/245] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:52.178065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-29ea4eba-dfdb-4eca-ae80-4fe46a64b131 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-3"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:52.180886 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.180886 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:52.191505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29ea4eba-dfdb-4eca-ae80-4fe46a64b131 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.191964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29ea4eba-dfdb-4eca-ae80-4fe46a64b131 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.247687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-873713885", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:52.314936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:46:52.327477 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-29ea4eba-dfdb-4eca-ae80-4fe46a64b131 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.154804 Aug 02 06:46:52.328099 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 145/246] 10.222.0.79 () {60 vars in 1191 bytes} [Tue Aug 2 06:46:52 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:52.339290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-89b1132e-fa04-4b08-b84e-86b8dab26ec7 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-3"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:52.341935 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.341935 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:52.350339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89b1132e-fa04-4b08-b84e-86b8dab26ec7 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.350783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89b1132e-fa04-4b08-b84e-86b8dab26ec7 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.463985 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-89b1132e-fa04-4b08-b84e-86b8dab26ec7 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.127850 Aug 02 06:46:52.464653 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 146/247] 10.222.0.79 () {60 vars in 1191 bytes} [Tue Aug 2 06:46:52 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:52.476498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cbe7bc87-9709-4b50-a83f-6ad1a9cd6554 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:52.477278 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.477278 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:52.500489 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cbe7bc87-9709-4b50-a83f-6ad1a9cd6554 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.028652 Aug 02 06:46:52.501084 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 147/248] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:46:52 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:52.511493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7877af2c-efce-47a0-97fb-09249d5333bd req-3c36cc9a-de65-448a-bec5-4ec544a7d445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a8a334e-542e-452d-8822-2324c95201f4", "name": "network-vif-deleted", "tag": "894f0ef5-8e0a-4cde-927f-f70e446bf0eb"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:52.522039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7877af2c-efce-47a0-97fb-09249d5333bd req-3c36cc9a-de65-448a-bec5-4ec544a7d445 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.522484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7877af2c-efce-47a0-97fb-09249d5333bd req-3c36cc9a-de65-448a-bec5-4ec544a7d445 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.533157 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7877af2c-efce-47a0-97fb-09249d5333bd req-3c36cc9a-de65-448a-bec5-4ec544a7d445 service nova] Creating event network-vif-deleted:894f0ef5-8e0a-4cde-927f-f70e446bf0eb for instance 0a8a334e-542e-452d-8822-2324c95201f4 on n-h1-851337-3 Aug 02 06:46:52.538144 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7877af2c-efce-47a0-97fb-09249d5333bd req-3c36cc9a-de65-448a-bec5-4ec544a7d445 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031090 Aug 02 06:46:52.538807 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 148/249] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:52.543714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c043386-261b-4643-9fcb-b7b92aaea6b8 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-320530829"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:52.546363 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.546363 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:52.547243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.aggregate [None req-1c043386-261b-4643-9fcb-b7b92aaea6b8 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Generated uuid bb234bf2-599a-4ca1-9e86-1ceb88a91610 for aggregate {{(pid=126120) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:52.575028 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1c043386-261b-4643-9fcb-b7b92aaea6b8 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.034814 Aug 02 06:46:52.576176 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 149/250] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:52 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:52.581231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-72e87f99-8893-4836-9db0-ffe04ac8dfd2 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Calling method '.version_select at 0x7f927bb3a1f0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:52.584074 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.584074 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:52.585219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72e87f99-8893-4836-9db0-ffe04ac8dfd2 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.585672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72e87f99-8893-4836-9db0-ffe04ac8dfd2 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.586498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72e87f99-8893-4836-9db0-ffe04ac8dfd2 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.586962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72e87f99-8893-4836-9db0-ffe04ac8dfd2 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.611038 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-72e87f99-8893-4836-9db0-ffe04ac8dfd2 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.033573 Aug 02 06:46:52.611645 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 150/251] 10.222.0.79 () {58 vars in 1128 bytes} [Tue Aug 2 06:46:52 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:52.615914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d8ade294-e352-45a6-a8fa-09491eb0c1cc tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:52.616672 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.616672 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:52.638189 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d8ade294-e352-45a6-a8fa-09491eb0c1cc tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.025427 Aug 02 06:46:52.639188 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 151/252] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:46:52 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:52.644216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-64b9a7f9-495b-4beb-8f06-daa459983ac9 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Calling method '.version_select at 0x7f927b8dc280>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:52.646762 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.646762 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:52.647958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64b9a7f9-495b-4beb-8f06-daa459983ac9 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.648405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64b9a7f9-495b-4beb-8f06-daa459983ac9 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.649188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64b9a7f9-495b-4beb-8f06-daa459983ac9 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.649789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64b9a7f9-495b-4beb-8f06-daa459983ac9 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.662694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:52.676926 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-64b9a7f9-495b-4beb-8f06-daa459983ac9 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.036240 Aug 02 06:46:52.677585 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 152/253] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:46:52 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:52.684315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-11c63be9-8894-48e7-89a5-3a1c038a9b22 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:52.685479 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.685479 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:52.692662 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-11c63be9-8894-48e7-89a5-3a1c038a9b22 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-11c63be9-8894-48e7-89a5-3a1c038a9b22 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Request method failure captured: Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgqnXww_HrNsqHwePiApas8gM7gc1xq8ujVE4RWW8U43f0yFJF6JuDn-1hRjwNTLokwyfqgN7J4nUreftMLhj5mB2M99zyabjYRC1UnpJST6dYUoTMVgHgFm6kYbIZebQv4JH4-nfYenQOZbzCe1NDxCNyynC2yndbCBpajrqZxCSU Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 78a5b2d8101a439f93c4e38d174f2207 Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AggregatesAdminTestJSON-737184645 Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:46:52.707171 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:46:52.708640 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/78a5b2d8101a439f93c4e38d174f2207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78a5b2d8101a439f93c4e38d174f2207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_78a5b2d8101a439f93c4e38d174f2207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78a5b2d8101a439f93c4e38d174f2207"}]}] Aug 02 06:46:52.708640 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AggregatesAdminTestJSON-737184645 Aug 02 06:46:52.708640 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 78a5b2d8101a439f93c4e38d174f2207 Aug 02 06:46:52.708640 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-737184645 Aug 02 06:46:52.708640 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AggregatesAdminTestJSON-737184645-project-admin Aug 02 06:46:52.708640 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:52.708640 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:52.708640 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 13e45812144b471eabad69cb28b785d0 Aug 02 06:46:52.708640 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AggregatesAdminTestJSON-737184645-project-admin Aug 02 06:46:52.708640 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:52.708640 n-d-851337-3 devstack@n-api.service[126120]: exception: Aggregate 5 could not be found. Aug 02 06:46:52.708640 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '5'} Aug 02 06:46:52.708640 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:52.712657 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.713717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-11c63be9-8894-48e7-89a5-3a1c038a9b22 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:52.714840 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-11c63be9-8894-48e7-89a5-3a1c038a9b22 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.029830 Aug 02 06:46:52.714840 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 153/254] 10.222.0.79 () {58 vars in 1149 bytes} [Tue Aug 2 06:46:52 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:46:52.714840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-818e3991-3eaf-4b6c-a545-6dfd8a1fff5e tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Calling method '.version_select at 0x7f927b8dc9d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:52.716024 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.716024 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:52.717174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-818e3991-3eaf-4b6c-a545-6dfd8a1fff5e tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.717613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-818e3991-3eaf-4b6c-a545-6dfd8a1fff5e tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.718448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-818e3991-3eaf-4b6c-a545-6dfd8a1fff5e tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.718871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-818e3991-3eaf-4b6c-a545-6dfd8a1fff5e tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.743746 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-818e3991-3eaf-4b6c-a545-6dfd8a1fff5e tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.033646 Aug 02 06:46:52.749707 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 154/255] 10.222.0.79 () {58 vars in 1128 bytes} [Tue Aug 2 06:46:52 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:52.749707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aa8ce016-ad6f-4141-ae86-206b6132192f tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:52.750029 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.750029 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:52.764697 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-aa8ce016-ad6f-4141-ae86-206b6132192f tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aa8ce016-ad6f-4141-ae86-206b6132192f tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Request method failure captured: Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgqnXww_HrNsqHwePiApas8gM7gc1xq8ujVE4RWW8U43f0yFJF6JuDn-1hRjwNTLokwyfqgN7J4nUreftMLhj5mB2M99zyabjYRC1UnpJST6dYUoTMVgHgFm6kYbIZebQv4JH4-nfYenQOZbzCe1NDxCNyynC2yndbCBpajrqZxCSU Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 78a5b2d8101a439f93c4e38d174f2207 Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AggregatesAdminTestJSON-737184645 Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:46:52.766874 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:46:52.768257 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/78a5b2d8101a439f93c4e38d174f2207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78a5b2d8101a439f93c4e38d174f2207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_78a5b2d8101a439f93c4e38d174f2207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78a5b2d8101a439f93c4e38d174f2207"}]}] Aug 02 06:46:52.768257 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AggregatesAdminTestJSON-737184645 Aug 02 06:46:52.768257 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 78a5b2d8101a439f93c4e38d174f2207 Aug 02 06:46:52.768257 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-737184645 Aug 02 06:46:52.768257 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AggregatesAdminTestJSON-737184645-project-admin Aug 02 06:46:52.768257 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:52.768257 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:52.768257 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 13e45812144b471eabad69cb28b785d0 Aug 02 06:46:52.768257 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AggregatesAdminTestJSON-737184645-project-admin Aug 02 06:46:52.768257 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:52.768257 n-d-851337-3 devstack@n-api.service[126120]: exception: Aggregate 5 could not be found. Aug 02 06:46:52.768257 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '5'} Aug 02 06:46:52.768257 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:46:52.775595 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:52.776665 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:52.777846 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:52.777846 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:52.777846 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:52.777846 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 02 06:46:52.777846 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:52.777846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aa8ce016-ad6f-4141-ae86-206b6132192f tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:52.777846 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aa8ce016-ad6f-4141-ae86-206b6132192f tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.023007 Aug 02 06:46:52.777846 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 155/256] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:46:52 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:46:52.777846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0cdeb921-16e5-4080-b5a4-f6b5af5e0cdd tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Calling method '.version_select at 0x7f927b8dcc10>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:52.779897 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.779897 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:52.781399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0cdeb921-16e5-4080-b5a4-f6b5af5e0cdd tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.781652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0cdeb921-16e5-4080-b5a4-f6b5af5e0cdd tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.794464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0cdeb921-16e5-4080-b5a4-f6b5af5e0cdd tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.795143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0cdeb921-16e5-4080-b5a4-f6b5af5e0cdd tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.802679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:46:52.803354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:46:52.804009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:46:52.804415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:46:52.804818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:46:52.815289 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.816036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.816815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.817239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.828760 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0cdeb921-16e5-4080-b5a4-f6b5af5e0cdd tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-h2-851337-3" status: 200 len: 598 microversion: 2.1 time: 0.058913 Aug 02 06:46:52.829803 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 156/257] 10.222.0.79 () {58 vars in 1170 bytes} [Tue Aug 2 06:46:52 2022] GET /compute/v2.1/os-hosts/n-h2-851337-3 => generated 598 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:52.834784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6f99136b-5f19-4221-af2b-bddf39f948d0 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1448437381", "name": "tempest-test_aggregate-1496031455"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:52.836469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Getting quotas for project 8d7a272c645741bba2da4d0bae7a470b. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:46:52.841367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Getting quotas for user 218f99459dc54c7187c8ee0022e64e81 and project 8d7a272c645741bba2da4d0bae7a470b. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:46:52.854365 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.854365 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:52.855622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.aggregate [None req-6f99136b-5f19-4221-af2b-bddf39f948d0 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Generated uuid b3828e0d-0012-4100-85ed-394f3b66dbcb for aggregate {{(pid=126120) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:52.857398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:46:52.860092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:46:52.887526 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6f99136b-5f19-4221-af2b-bddf39f948d0 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.056456 Aug 02 06:46:52.888987 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 157/258] 10.222.0.79 () {60 vars in 1165 bytes} [Tue Aug 2 06:46:52 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:52.895632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-abed33a8-f6a7-40db-8434-7338bda5d8d9 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2147219127"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:52.898484 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.898484 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:52.899517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.aggregate [None req-abed33a8-f6a7-40db-8434-7338bda5d8d9 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Generated uuid bd068b0c-4e61-4eb5-b0e1-5579a2a1d505 for aggregate {{(pid=126120) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:52.917215 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0018a69f-42c5-40df-81a9-cb74e6089283 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674084 Aug 02 06:46:52.918275 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 102/259] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:46:52.922901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-73f64c77-b36d-4374-b9e7-5c394a2e0102 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Calling method '.version_select at 0x7f927bac19d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:52.923691 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.923691 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:52.932290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-73f64c77-b36d-4374-b9e7-5c394a2e0102 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.932777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-73f64c77-b36d-4374-b9e7-5c394a2e0102 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.934625 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-abed33a8-f6a7-40db-8434-7338bda5d8d9 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.044580 Aug 02 06:46:52.942704 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 158/260] 10.222.0.79 () {62 vars in 1205 bytes} [Tue Aug 2 06:46:52 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:46:52.950577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5827f0ca-c181-414a-b896-ba7d72689bac tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:52.951471 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:52.951471 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:52.956113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-73f64c77-b36d-4374-b9e7-5c394a2e0102 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:52.956572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-73f64c77-b36d-4374-b9e7-5c394a2e0102 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:52.988854 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-73f64c77-b36d-4374-b9e7-5c394a2e0102 tempest-HostsAdminTestJSON-2025882883 tempest-HostsAdminTestJSON-2025882883-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-h1-851337-3" status: 200 len: 467 microversion: 2.1 time: 0.069249 Aug 02 06:46:52.989636 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 103/261] 10.222.0.79 () {58 vars in 1170 bytes} [Tue Aug 2 06:46:52 2022] GET /compute/v2.1/os-hosts/n-h1-851337-3 => generated 467 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:52.997610 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5827f0ca-c181-414a-b896-ba7d72689bac tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.054299 Aug 02 06:46:52.998498 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 159/262] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:46:52 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:53.005128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7ffb95cd-7876-4067-94cc-ad7cd9c7ec66 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-474105715"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:53.005818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dd015389-afae-4552-b188-96c6414a9885 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:53.006979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dd015389-afae-4552-b188-96c6414a9885 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:53.083443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dd015389-afae-4552-b188-96c6414a9885 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:53.086132 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:53.086132 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:53.099080 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dd015389-afae-4552-b188-96c6414a9885 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1219 microversion: 2.1 time: 0.107720 Aug 02 06:46:53.102955 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 104/263] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:52 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:53.110041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0cc0a371-f375-4849-81ee-f475d2a2919d tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:53.110041 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:53.110041 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:53.116093 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-0cc0a371-f375-4849-81ee-f475d2a2919d tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0cc0a371-f375-4849-81ee-f475d2a2919d tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Request method failure captured: Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MgqnXww_HrNsqHwePiApas8gM7gc1xq8ujVE4RWW8U43f0yFJF6JuDn-1hRjwNTLokwyfqgN7J4nUreftMLhj5mB2M99zyabjYRC1UnpJST6dYUoTMVgHgFm6kYbIZebQv4JH4-nfYenQOZbzCe1NDxCNyynC2yndbCBpajrqZxCSU Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 78a5b2d8101a439f93c4e38d174f2207 Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AggregatesAdminTestJSON-737184645 Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:46:53.121991 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:46:53.123230 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/78a5b2d8101a439f93c4e38d174f2207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78a5b2d8101a439f93c4e38d174f2207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_78a5b2d8101a439f93c4e38d174f2207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78a5b2d8101a439f93c4e38d174f2207"}]}] Aug 02 06:46:53.123230 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AggregatesAdminTestJSON-737184645 Aug 02 06:46:53.123230 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 78a5b2d8101a439f93c4e38d174f2207 Aug 02 06:46:53.123230 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-737184645 Aug 02 06:46:53.123230 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AggregatesAdminTestJSON-737184645-project-admin Aug 02 06:46:53.123230 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:53.123230 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:53.123230 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 13e45812144b471eabad69cb28b785d0 Aug 02 06:46:53.123230 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AggregatesAdminTestJSON-737184645-project-admin Aug 02 06:46:53.123230 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:53.123230 n-d-851337-3 devstack@n-api.service[126119]: exception: Aggregate 6 could not be found. Aug 02 06:46:53.123230 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '6'} Aug 02 06:46:53.123230 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:53.123927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:53.124928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0cc0a371-f375-4849-81ee-f475d2a2919d tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:53.126005 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0cc0a371-f375-4849-81ee-f475d2a2919d tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.019156 Aug 02 06:46:53.133338 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 105/264] 10.222.0.79 () {58 vars in 1149 bytes} [Tue Aug 2 06:46:53 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:46:53.150225 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7ffb95cd-7876-4067-94cc-ad7cd9c7ec66 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-aggregates/7" status: 200 len: 298 microversion: 2.41 time: 0.149736 Aug 02 06:46:53.151146 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 160/265] 10.222.0.79 () {62 vars in 1210 bytes} [Tue Aug 2 06:46:52 2022] PUT /compute/v2.1/os-aggregates/7 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:46:53.156034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-97e87c71-18c8-4a87-b0e2-f7550bcb66e8 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:53.157337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-97e87c71-18c8-4a87-b0e2-f7550bcb66e8 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:53.164793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c556a894-0564-423b-a922-b2e9a425b322 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:53.166552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97e87c71-18c8-4a87-b0e2-f7550bcb66e8 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:53.166677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c556a894-0564-423b-a922-b2e9a425b322 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:53.167051 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97e87c71-18c8-4a87-b0e2-f7550bcb66e8 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:53.167861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97e87c71-18c8-4a87-b0e2-f7550bcb66e8 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:53.168367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97e87c71-18c8-4a87-b0e2-f7550bcb66e8 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:53.184186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c556a894-0564-423b-a922-b2e9a425b322 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:53.184726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c556a894-0564-423b-a922-b2e9a425b322 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:53.185547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c556a894-0564-423b-a922-b2e9a425b322 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:53.188816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c556a894-0564-423b-a922-b2e9a425b322 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:53.317785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c556a894-0564-423b-a922-b2e9a425b322 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:53.333424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c556a894-0564-423b-a922-b2e9a425b322 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:53.338513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c556a894-0564-423b-a922-b2e9a425b322 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:53.344154 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c556a894-0564-423b-a922-b2e9a425b322 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.204009 Aug 02 06:46:53.358940 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 106/266] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:53 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:53.367618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0c44258a-853f-4344-b5cd-0dd21b3b7c72 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:53.368606 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:53.368606 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:53.381981 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-0c44258a-853f-4344-b5cd-0dd21b3b7c72 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0c44258a-853f-4344-b5cd-0dd21b3b7c72 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Request method failure captured: Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MgqnXww_HrNsqHwePiApas8gM7gc1xq8ujVE4RWW8U43f0yFJF6JuDn-1hRjwNTLokwyfqgN7J4nUreftMLhj5mB2M99zyabjYRC1UnpJST6dYUoTMVgHgFm6kYbIZebQv4JH4-nfYenQOZbzCe1NDxCNyynC2yndbCBpajrqZxCSU Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 78a5b2d8101a439f93c4e38d174f2207 Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AggregatesAdminTestJSON-737184645 Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:46:53.383866 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:46:53.385643 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/78a5b2d8101a439f93c4e38d174f2207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78a5b2d8101a439f93c4e38d174f2207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_78a5b2d8101a439f93c4e38d174f2207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78a5b2d8101a439f93c4e38d174f2207"}]}] Aug 02 06:46:53.385643 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AggregatesAdminTestJSON-737184645 Aug 02 06:46:53.385643 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 78a5b2d8101a439f93c4e38d174f2207 Aug 02 06:46:53.385643 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-737184645 Aug 02 06:46:53.385643 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AggregatesAdminTestJSON-737184645-project-admin Aug 02 06:46:53.385643 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:53.385643 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:53.385643 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 13e45812144b471eabad69cb28b785d0 Aug 02 06:46:53.385643 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AggregatesAdminTestJSON-737184645-project-admin Aug 02 06:46:53.385643 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:53.385643 n-d-851337-3 devstack@n-api.service[126119]: exception: Aggregate 6 could not be found. Aug 02 06:46:53.385643 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '6'} Aug 02 06:46:53.385643 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:46:53.386485 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:53.387579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:53.388647 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:53.388647 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:53.388647 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:53.388647 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 02 06:46:53.388647 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:53.388647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0c44258a-853f-4344-b5cd-0dd21b3b7c72 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:53.388647 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0c44258a-853f-4344-b5cd-0dd21b3b7c72 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.025644 Aug 02 06:46:53.388647 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 107/267] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:46:53 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:46:53.392995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-16170466-efb9-4ee8-b307-319338c26702 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:53.393759 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:53.393759 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:53.402296 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-16170466-efb9-4ee8-b307-319338c26702 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/7" status: 200 len: 298 microversion: 2.41 time: 0.014897 Aug 02 06:46:53.403090 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 108/268] 10.222.0.79 () {60 vars in 1190 bytes} [Tue Aug 2 06:46:53 2022] GET /compute/v2.1/os-aggregates/7 => generated 298 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:46:53.408257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2655e1ec-c859-44b0-bfac-d5ed703a92b1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:53.408933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2655e1ec-c859-44b0-bfac-d5ed703a92b1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:53.417514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2655e1ec-c859-44b0-bfac-d5ed703a92b1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:53.417988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2655e1ec-c859-44b0-bfac-d5ed703a92b1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:53.418836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2655e1ec-c859-44b0-bfac-d5ed703a92b1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:53.419264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2655e1ec-c859-44b0-bfac-d5ed703a92b1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:53.447869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-97e87c71-18c8-4a87-b0e2-f7550bcb66e8 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:53.458336 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-97e87c71-18c8-4a87-b0e2-f7550bcb66e8 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 200 len: 1314 microversion: 2.1 time: 0.305999 Aug 02 06:46:53.458918 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 161/269] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:53 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:53.480928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a0a96a04-05ad-4cfe-a8d4-36cf9cb71d04 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1170398628"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:53.488125 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:53.488125 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:53.490289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.aggregate [None req-a0a96a04-05ad-4cfe-a8d4-36cf9cb71d04 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Generated uuid 02e91eb2-1531-456d-bad4-7915d747adc5 for aggregate {{(pid=126120) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:53.535097 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a0a96a04-05ad-4cfe-a8d4-36cf9cb71d04 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057478 Aug 02 06:46:53.537081 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 162/270] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:53.548341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a4aeddb1-7ac5-4990-9d2e-3cdfebbc46ec tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-3"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:53.555908 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:53.555908 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:53.576492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4aeddb1-7ac5-4990-9d2e-3cdfebbc46ec tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:53.578720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4aeddb1-7ac5-4990-9d2e-3cdfebbc46ec tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:53.733190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2655e1ec-c859-44b0-bfac-d5ed703a92b1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:53.745065 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2655e1ec-c859-44b0-bfac-d5ed703a92b1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 200 len: 1589 microversion: 2.1 time: 0.339711 Aug 02 06:46:53.747096 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 109/271] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:53 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 1589 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:53.754142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-04036cf8-2efb-419e-b14d-2b88b513f168 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:53.755316 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:53.755316 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:53.783411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=10 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:53.786001 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a4aeddb1-7ac5-4990-9d2e-3cdfebbc46ec tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 313 microversion: 2.41 time: 0.247709 Aug 02 06:46:53.790326 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 163/272] 10.222.0.79 () {62 vars in 1232 bytes} [Tue Aug 2 06:46:53 2022] POST /compute/v2.1/os-aggregates/7/action => generated 313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:46:53.790753 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-04036cf8-2efb-419e-b14d-2b88b513f168 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.041647 Aug 02 06:46:53.791399 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 110/273] 10.222.0.79 () {58 vars in 1149 bytes} [Tue Aug 2 06:46:53 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:53.803222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2f6118ce-629e-44d6-8dd1-04ef09789c47 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-3"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:53.808304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-970b5ea8-fd17-444d-b8f5-76c6662326f0 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:53.812319 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:53.812319 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:53.816464 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:53.816464 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:53.839233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f6118ce-629e-44d6-8dd1-04ef09789c47 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:53.841332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f6118ce-629e-44d6-8dd1-04ef09789c47 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:53.881680 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-970b5ea8-fd17-444d-b8f5-76c6662326f0 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.077375 Aug 02 06:46:53.882966 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 111/274] 10.222.0.79 () {60 vars in 1191 bytes} [Tue Aug 2 06:46:53 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:53.897159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9a87bf3e-924b-4c66-ac98-da762d2d950a tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:53.899166 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:53.899166 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:53.932722 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9a87bf3e-924b-4c66-ac98-da762d2d950a tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.040616 Aug 02 06:46:53.934091 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 112/275] 10.222.0.79 () {58 vars in 1149 bytes} [Tue Aug 2 06:46:53 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:53.946266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-83930416-43c5-40bf-a5ce-1fd9640cbaf6 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:53.947551 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:53.947551 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:53.987601 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-83930416-43c5-40bf-a5ce-1fd9640cbaf6 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.046658 Aug 02 06:46:53.992729 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 113/276] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:46:53 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 02 06:46:53.998001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-87f934f2-6481-4d42-adb0-42d46cd6e292 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-477091494", "availability_zone": "tempest-test_az-147856255"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:54.042913 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:54.042913 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:54.044003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.aggregate [None req-87f934f2-6481-4d42-adb0-42d46cd6e292 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Generated uuid 82b05466-cbda-4094-9d9f-b4ff47a91749 for aggregate {{(pid=126119) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:54.106001 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2f6118ce-629e-44d6-8dd1-04ef09789c47 tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 298 microversion: 2.41 time: 0.306705 Aug 02 06:46:54.113633 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-87f934f2-6481-4d42-adb0-42d46cd6e292 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.108969 Aug 02 06:46:54.113633 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 114/277] 10.222.0.79 () {60 vars in 1165 bytes} [Tue Aug 2 06:46:53 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:54.114056 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 164/278] 10.222.0.79 () {62 vars in 1232 bytes} [Tue Aug 2 06:46:53 2022] POST /compute/v2.1/os-aggregates/7/action => generated 298 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:46:54.129088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b080ab08-e2cc-4f1e-85cd-7f25a292fc7d tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:54.130017 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:54.130017 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:54.131475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-85eabafe-d8cf-4da1-878f-2b1ceccc4ca4 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-477091494_new", "availability_zone": "tempest-test_az-147856255_new"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:54.136069 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:54.136069 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:54.165251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:DELETE=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:54.198408 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b080ab08-e2cc-4f1e-85cd-7f25a292fc7d tempest-AggregatesAdminTestV241-880715962 tempest-AggregatesAdminTestV241-880715962-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.41 time: 0.081470 Aug 02 06:46:54.200423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-85eabafe-d8cf-4da1-878f-2b1ceccc4ca4 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:54.200868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-85eabafe-d8cf-4da1-878f-2b1ceccc4ca4 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:54.207799 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 115/279] 10.222.0.79 () {60 vars in 1193 bytes} [Tue Aug 2 06:46:54 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:54.216845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:54.221009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9eb0119c-bae7-48c9-8f52-48eec5b26651 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:54.224845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9eb0119c-bae7-48c9-8f52-48eec5b26651 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:54.247795 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-85eabafe-d8cf-4da1-878f-2b1ceccc4ca4 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 333 microversion: 2.1 time: 0.132390 Aug 02 06:46:54.254658 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 165/280] 10.222.0.79 () {60 vars in 1170 bytes} [Tue Aug 2 06:46:54 2022] PUT /compute/v2.1/os-aggregates/9 => generated 333 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:54.256312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9eb0119c-bae7-48c9-8f52-48eec5b26651 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:54.256817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9eb0119c-bae7-48c9-8f52-48eec5b26651 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:54.257746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9eb0119c-bae7-48c9-8f52-48eec5b26651 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:54.258774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9eb0119c-bae7-48c9-8f52-48eec5b26651 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:54.267444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-98dc3a35-8107-4e46-9c8e-925df10ecc49 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:54.269431 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:54.269431 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:54.281182 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-98dc3a35-8107-4e46-9c8e-925df10ecc49 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.022528 Aug 02 06:46:54.282860 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 166/281] 10.222.0.79 () {58 vars in 1143 bytes} [Tue Aug 2 06:46:54 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:54.297123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c9a6d48a-2a85-419a-8e65-2f1dc72a0995 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:54.299513 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:54.299513 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:54.341513 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c9a6d48a-2a85-419a-8e65-2f1dc72a0995 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.051441 Aug 02 06:46:54.346955 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 167/282] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:46:54 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:54.353973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-21ee20bf-ecb7-4769-9c8e-30518e936e0c tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1622143879"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:54.358214 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:54.358214 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:54.359673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.aggregate [None req-21ee20bf-ecb7-4769-9c8e-30518e936e0c tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Generated uuid d1d1022f-f799-495c-a78a-41311927430e for aggregate {{(pid=126120) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:54.382377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9eb0119c-bae7-48c9-8f52-48eec5b26651 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:54.395771 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9eb0119c-bae7-48c9-8f52-48eec5b26651 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1271 microversion: 2.1 time: 0.185022 Aug 02 06:46:54.414256 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-21ee20bf-ecb7-4769-9c8e-30518e936e0c tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.069687 Aug 02 06:46:54.415745 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 168/283] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:54.418919 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 116/284] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:54 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1271 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:54.424762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-38b8e748-ccee-49f6-a42f-8b1fef3ac9c1 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-29212847"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:54.426578 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-41a09ff4-320f-487f-b4c3-5f32e5780f77 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:54.427250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-41a09ff4-320f-487f-b4c3-5f32e5780f77 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:54.434473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41a09ff4-320f-487f-b4c3-5f32e5780f77 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:54.434757 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:54.434757 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:54.434944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41a09ff4-320f-487f-b4c3-5f32e5780f77 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:54.435722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41a09ff4-320f-487f-b4c3-5f32e5780f77 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:54.436490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41a09ff4-320f-487f-b4c3-5f32e5780f77 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:54.437956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.aggregate [None req-38b8e748-ccee-49f6-a42f-8b1fef3ac9c1 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Generated uuid c06b35db-550c-4dfb-b246-0d00361feeda for aggregate {{(pid=126120) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:54.492794 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-38b8e748-ccee-49f6-a42f-8b1fef3ac9c1 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.075941 Aug 02 06:46:54.494834 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 169/285] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:54 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:54.500227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b8cc7eda-ccba-442a-a45b-5dfd8dde68a3 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-3"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:54.505499 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:54.505499 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:54.515967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8cc7eda-ccba-442a-a45b-5dfd8dde68a3 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:54.517317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8cc7eda-ccba-442a-a45b-5dfd8dde68a3 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:54.622483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-41a09ff4-320f-487f-b4c3-5f32e5780f77 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:54.643651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-41a09ff4-320f-487f-b4c3-5f32e5780f77 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:54.647274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-41a09ff4-320f-487f-b4c3-5f32e5780f77 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:54.701189 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-41a09ff4-320f-487f-b4c3-5f32e5780f77 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.259361 Aug 02 06:46:54.702170 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 117/286] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:54 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:54.724446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-64df8a17-bc91-49e5-a388-fca68410dc27 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:54.728401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-64df8a17-bc91-49e5-a388-fca68410dc27 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:54.742795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-64df8a17-bc91-49e5-a388-fca68410dc27 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:54.752487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-64df8a17-bc91-49e5-a388-fca68410dc27 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:54.760690 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b8cc7eda-ccba-442a-a45b-5dfd8dde68a3 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.264034 Aug 02 06:46:54.762034 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 170/287] 10.222.0.79 () {60 vars in 1194 bytes} [Tue Aug 2 06:46:54 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:54.764587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-64df8a17-bc91-49e5-a388-fca68410dc27 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:54.765341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-64df8a17-bc91-49e5-a388-fca68410dc27 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:54.772286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-67356860-5eae-4c31-9802-59141ba0f9d2 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:54.773396 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:54.773396 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:54.789816 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-67356860-5eae-4c31-9802-59141ba0f9d2 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 459 microversion: 2.1 time: 0.025828 Aug 02 06:46:54.794767 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 171/288] 10.222.0.79 () {58 vars in 1143 bytes} [Tue Aug 2 06:46:54 2022] GET /compute/v2.1/os-aggregates => generated 459 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:54.806063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-417ee980-2a9e-40c8-8d01-c95f46c9833c req-113758cf-51c7-4e6e-867c-94855874436c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "996312b8-1c9c-4def-aa0b-4eaf8f74e3c8", "tag": "bfaf7f27-ecd4-4a2a-bbfd-d833f7f8f759"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:54.822958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:54.823290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:DELETE=5,nova_api:UPDATE=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:46:54.834252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-417ee980-2a9e-40c8-8d01-c95f46c9833c req-113758cf-51c7-4e6e-867c-94855874436c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:54.834883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-417ee980-2a9e-40c8-8d01-c95f46c9833c req-113758cf-51c7-4e6e-867c-94855874436c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:54.876125 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-417ee980-2a9e-40c8-8d01-c95f46c9833c req-113758cf-51c7-4e6e-867c-94855874436c service nova] Creating event network-changed:bfaf7f27-ecd4-4a2a-bbfd-d833f7f8f759 for instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 on n-h2-851337-3 Aug 02 06:46:54.897027 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-417ee980-2a9e-40c8-8d01-c95f46c9833c req-113758cf-51c7-4e6e-867c-94855874436c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084742 Aug 02 06:46:54.900224 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 172/289] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:54.920352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7f79ed5-f059-4721-aaf7-9dde76b8135d tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-3"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:54.929328 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:54.929328 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:54.966455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7f79ed5-f059-4721-aaf7-9dde76b8135d tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:54.966812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7f79ed5-f059-4721-aaf7-9dde76b8135d tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:55.031462 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-e7f79ed5-f059-4721-aaf7-9dde76b8135d tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] HTTP exception thrown: Aggregate 10 already has host n-h2-851337-3. Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7f79ed5-f059-4721-aaf7-9dde76b8135d tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Request method failure captured: Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 39 Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgtI-VLZRnF-SyZGQgjF0sbTrZViis2fmQFZce51xiY4AhDphQu-LP-zxk6XBg8d8S7ES6XTXpaRt6Vr_Pq9h7gkXfmXeYWiiz7R0oNFvVl6Lf_t2mzfRgbs6f_RIKPgLVT3t-EIm1UCNtz5S6V2IRCkYMctwnNEKFSWJarBoEGiMg Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:46:55.034656 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:46:55.035795 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}] Aug 02 06:46:55.035795 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:55.035795 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:55.035795 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:55.035795 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:55.035795 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:55.035795 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:55.035795 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5ad6f0a3857348dd89ef179a1cc0db51 Aug 02 06:46:55.035795 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:55.035795 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:46:55.035795 n-d-851337-3 devstack@n-api.service[126120]: {"add_host": {"host": "n-h2-851337-3"}} Aug 02 06:46:55.035795 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:55.035795 n-d-851337-3 devstack@n-api.service[126120]: exception: Aggregate 10 already has host n-h2-851337-3. Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h2-851337-3'}}} Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result.read() Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 06:46:55.036652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-851337-3-10' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi session.flush() Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 06:46:55.037676 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 06:46:55.038835 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 06:46:55.039760 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result.read() Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-851337-3-10' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 2, 6, 46, 55, 7945), 'updated_at': None, 'host': 'n-h2-851337-3', 'aggregate_id': 10}] Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:55.040695 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6594, in add_host_to_aggregate Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 10 already has host n-h2-851337-3. Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.041572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 10 already has host n-h2-851337-3. Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:55.043034 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:55.044231 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 10 already has host n-h2-851337-3. Aug 02 06:46:55.044231 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.044231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7f79ed5-f059-4721-aaf7-9dde76b8135d tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Returning 409 to user: Aggregate 10 already has host n-h2-851337-3. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:55.044231 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7f79ed5-f059-4721-aaf7-9dde76b8135d tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/10/action" status: 409 len: 96 microversion: 2.1 time: 0.127972 Aug 02 06:46:55.044231 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 173/290] 10.222.0.79 () {60 vars in 1194 bytes} [Tue Aug 2 06:46:54 2022] POST /compute/v2.1/os-aggregates/10/action => generated 96 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 02 06:46:55.054523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fbb82aef-5a47-4cfa-897e-5cfcee2773d3 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:55.055632 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:55.055632 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:55.092354 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fbb82aef-5a47-4cfa-897e-5cfcee2773d3 tempest-AggregatesAdminTestJSON-737184645 tempest-AggregatesAdminTestJSON-737184645-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.054611 Aug 02 06:46:55.093188 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 174/291] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:46:55 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:55.121221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-99c1ab12-27c2-423d-8cc4-bd054f2e8a27 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-3"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:55.124084 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:55.124084 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:55.133812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99c1ab12-27c2-423d-8cc4-bd054f2e8a27 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:55.134371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99c1ab12-27c2-423d-8cc4-bd054f2e8a27 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:55.303445 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-99c1ab12-27c2-423d-8cc4-bd054f2e8a27 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.205375 Aug 02 06:46:55.311902 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 175/292] 10.222.0.79 () {60 vars in 1194 bytes} [Tue Aug 2 06:46:55 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:55.322365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-40e0e477-87f3-4002-8a88-9e016bd56569 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:55.323198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-40e0e477-87f3-4002-8a88-9e016bd56569 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:55.330683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40e0e477-87f3-4002-8a88-9e016bd56569 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:55.331624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40e0e477-87f3-4002-8a88-9e016bd56569 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:55.333035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40e0e477-87f3-4002-8a88-9e016bd56569 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:55.333575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40e0e477-87f3-4002-8a88-9e016bd56569 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:55.352134 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-40e0e477-87f3-4002-8a88-9e016bd56569 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] HTTP exception thrown: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-40e0e477-87f3-4002-8a88-9e016bd56569 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Request method failure captured: Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 HTTP/1.1 Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgoIRWgTEHfV30A_gznp2kwY8SbC-XBpixhIxaPJQETrN0uaca2KvetOgMlv38h3kvhlXxrAvNa1haW0aLio7GkwPcjSoj2HS1MwE3eFntC4hiSDC695l35kRaPmP4lGOGwbHrKZsX1dhJNhQW7nB26XAWw5YXKg9r2eUoBkVVz-8I Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8261c265db344360973bc041d571e9f6 Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AggregatesAdminTestJSON-1247046912 Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:55.353836 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:55.355066 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8261c265db344360973bc041d571e9f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8261c265db344360973bc041d571e9f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8261c265db344360973bc041d571e9f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8261c265db344360973bc041d571e9f6"}]}] Aug 02 06:46:55.355066 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AggregatesAdminTestJSON-1247046912 Aug 02 06:46:55.355066 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8261c265db344360973bc041d571e9f6 Aug 02 06:46:55.355066 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1247046912 Aug 02 06:46:55.355066 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AggregatesAdminTestJSON-1247046912-project Aug 02 06:46:55.355066 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:55.355066 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:55.355066 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4607cc90b2b04d91be564cf95bc19227 Aug 02 06:46:55.355066 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AggregatesAdminTestJSON-1247046912-project Aug 02 06:46:55.355066 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:55.355066 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:55.355066 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'efb3120a-e908-473d-8ca1-e4c436aec919'} Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:55.355730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:55.357332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.358428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-40e0e477-87f3-4002-8a88-9e016bd56569 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Returning 404 to user: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:55.358428 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-40e0e477-87f3-4002-8a88-9e016bd56569 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "DELETE /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 404 len: 111 microversion: 2.1 time: 0.042237 Aug 02 06:46:55.358428 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 176/293] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:46:55 2022] DELETE /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:55.361236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-589b9087-ec24-423d-87f8-64cb1a4d5fe1 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:55.362168 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:55.362168 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:55.399494 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-589b9087-ec24-423d-87f8-64cb1a4d5fe1 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.041914 Aug 02 06:46:55.402949 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 177/294] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:46:55 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:55.415476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a053aa4f-cf99-4b1e-94f0-1c8ac66fb030 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:55.415855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a053aa4f-cf99-4b1e-94f0-1c8ac66fb030 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] [instance: efb3120a-e908-473d-8ca1-e4c436aec919] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:55.437069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a053aa4f-cf99-4b1e-94f0-1c8ac66fb030 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:55.437478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a053aa4f-cf99-4b1e-94f0-1c8ac66fb030 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:55.438324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a053aa4f-cf99-4b1e-94f0-1c8ac66fb030 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:55.438826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a053aa4f-cf99-4b1e-94f0-1c8ac66fb030 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:55.458463 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-a053aa4f-cf99-4b1e-94f0-1c8ac66fb030 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] HTTP exception thrown: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a053aa4f-cf99-4b1e-94f0-1c8ac66fb030 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Request method failure captured: Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 HTTP/1.1 Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgoIRWgTEHfV30A_gznp2kwY8SbC-XBpixhIxaPJQETrN0uaca2KvetOgMlv38h3kvhlXxrAvNa1haW0aLio7GkwPcjSoj2HS1MwE3eFntC4hiSDC695l35kRaPmP4lGOGwbHrKZsX1dhJNhQW7nB26XAWw5YXKg9r2eUoBkVVz-8I Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8261c265db344360973bc041d571e9f6 Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AggregatesAdminTestJSON-1247046912 Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:55.460297 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:55.461557 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8261c265db344360973bc041d571e9f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8261c265db344360973bc041d571e9f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8261c265db344360973bc041d571e9f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8261c265db344360973bc041d571e9f6"}]}] Aug 02 06:46:55.461557 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AggregatesAdminTestJSON-1247046912 Aug 02 06:46:55.461557 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8261c265db344360973bc041d571e9f6 Aug 02 06:46:55.461557 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1247046912 Aug 02 06:46:55.461557 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AggregatesAdminTestJSON-1247046912-project Aug 02 06:46:55.461557 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:55.461557 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:55.461557 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4607cc90b2b04d91be564cf95bc19227 Aug 02 06:46:55.461557 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AggregatesAdminTestJSON-1247046912-project Aug 02 06:46:55.461557 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:55.461557 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:55.461557 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'efb3120a-e908-473d-8ca1-e4c436aec919'} Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:55.462260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. Aug 02 06:46:55.463398 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:55.474991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a053aa4f-cf99-4b1e-94f0-1c8ac66fb030 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] Returning 404 to user: Instance efb3120a-e908-473d-8ca1-e4c436aec919 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:55.476101 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a053aa4f-cf99-4b1e-94f0-1c8ac66fb030 tempest-AggregatesAdminTestJSON-1247046912 tempest-AggregatesAdminTestJSON-1247046912-project] 10.222.0.79 "GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919" status: 404 len: 111 microversion: 2.1 time: 0.071040 Aug 02 06:46:55.489857 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 178/295] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:55 2022] GET /compute/v2.1/servers/efb3120a-e908-473d-8ca1-e4c436aec919 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:55.495120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-da07587f-2e99-43fb-b646-c3770c0286af tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1410365830"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:55.495745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-64df8a17-bc91-49e5-a388-fca68410dc27 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:55.500017 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:55.500017 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:55.501813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.aggregate [None req-da07587f-2e99-43fb-b646-c3770c0286af tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Generated uuid 43a2bbc5-6357-4410-b999-a9e85d22fbb1 for aggregate {{(pid=126120) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:55.503501 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-64df8a17-bc91-49e5-a388-fca68410dc27 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 200 len: 1314 microversion: 2.1 time: 0.799125 Aug 02 06:46:55.506560 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 118/296] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:54 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 1314 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:55.522704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4febbef4-7d56-451b-97c4-42985a769fb1 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:55.523686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4febbef4-7d56-451b-97c4-42985a769fb1 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:55.538868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4febbef4-7d56-451b-97c4-42985a769fb1 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:55.539312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4febbef4-7d56-451b-97c4-42985a769fb1 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:55.540075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4febbef4-7d56-451b-97c4-42985a769fb1 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:55.540507 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-da07587f-2e99-43fb-b646-c3770c0286af tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.046171 Aug 02 06:46:55.541061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4febbef4-7d56-451b-97c4-42985a769fb1 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:55.541456 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 179/297] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:55.692797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4febbef4-7d56-451b-97c4-42985a769fb1 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:55.705071 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4febbef4-7d56-451b-97c4-42985a769fb1 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1277 microversion: 2.1 time: 0.196462 Aug 02 06:46:55.706566 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 119/298] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:55 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:55.731913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d342e3e1-19c7-41c8-92e5-a948b3d76abb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:55.732526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d342e3e1-19c7-41c8-92e5-a948b3d76abb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:55.753734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d342e3e1-19c7-41c8-92e5-a948b3d76abb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:55.754158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d342e3e1-19c7-41c8-92e5-a948b3d76abb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:55.754922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d342e3e1-19c7-41c8-92e5-a948b3d76abb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:55.755559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d342e3e1-19c7-41c8-92e5-a948b3d76abb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:55.894869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d342e3e1-19c7-41c8-92e5-a948b3d76abb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:55.909027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d342e3e1-19c7-41c8-92e5-a948b3d76abb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:55.913922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d342e3e1-19c7-41c8-92e5-a948b3d76abb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:55.929822 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d342e3e1-19c7-41c8-92e5-a948b3d76abb tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.206619 Aug 02 06:46:55.930521 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 120/299] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:55 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:56.039009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-38a08030-9059-481d-a048-5121757a829e tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-3"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:56.046249 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:56.046249 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:56.050004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-38a08030-9059-481d-a048-5121757a829e tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '512b4dd8e1584f36aaee92549bf25d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebd31e50ccd4fabb5d9bd174d00e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-38a08030-9059-481d-a048-5121757a829e tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Request method failure captured: Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 39 Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgpI1flN8s0F53dNJ4R9skFKVEZCuT0L7qXo3HCKAS3GM7GKHM5FDqE1crC7VgJzlh5dGUC8Oafwb71yZ4XMCKecbAtnnYCQ8swwNxOKG3j0f3TzRQMolQWo4CIJIl-bmIyt3WBlbvNwZx5SBYJTtaRT7Zlw6WZnibECKoFofyPNRw Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 1ebd31e50ccd4fabb5d9bd174d00e2f9 Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:56.060732 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:56.062347 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}] Aug 02 06:46:56.062347 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:56.062347 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 1ebd31e50ccd4fabb5d9bd174d00e2f9 Aug 02 06:46:56.062347 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:56.062347 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AggregatesAdminNegativeTestJSON-950577364-project Aug 02 06:46:56.062347 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:56.062347 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:56.062347 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 512b4dd8e1584f36aaee92549bf25d0d Aug 02 06:46:56.062347 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-950577364-project Aug 02 06:46:56.062347 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:46:56.062347 n-d-851337-3 devstack@n-api.service[126120]: {"add_host": {"host": "n-h2-851337-3"}} Aug 02 06:46:56.062347 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:56.062347 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-851337-3'}}} Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:56.063319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 02 06:46:56.064619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.067893 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e954422d-7a5b-4398-b38c-0c90cfc9955b req-257acb25-0ed7-4947-aae0-aad692eaabba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b607f5e-31c1-40c5-bf8c-bd097275d4b6", "name": "network-vif-plugged", "status": "completed", "tag": "48058daa-15c6-43b5-9ea7-30316b9ebd93"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:56.071811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-38a08030-9059-481d-a048-5121757a829e tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:56.073937 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-38a08030-9059-481d-a048-5121757a829e tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] 10.222.0.79 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.524795 Aug 02 06:46:56.077727 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 180/300] 10.222.0.79 () {60 vars in 1194 bytes} [Tue Aug 2 06:46:55 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 528 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:46:56.089274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e954422d-7a5b-4398-b38c-0c90cfc9955b req-257acb25-0ed7-4947-aae0-aad692eaabba service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:56.090363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e954422d-7a5b-4398-b38c-0c90cfc9955b req-257acb25-0ed7-4947-aae0-aad692eaabba service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:56.097728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8bdacb04-3517-4fda-b038-dfd78629c26a tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:56.100573 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:56.100573 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:56.106801 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e954422d-7a5b-4398-b38c-0c90cfc9955b req-257acb25-0ed7-4947-aae0-aad692eaabba service nova] Creating event network-vif-plugged:48058daa-15c6-43b5-9ea7-30316b9ebd93 for instance 2b607f5e-31c1-40c5-bf8c-bd097275d4b6 on n-h2-851337-3 Aug 02 06:46:56.114776 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e954422d-7a5b-4398-b38c-0c90cfc9955b req-257acb25-0ed7-4947-aae0-aad692eaabba service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053046 Aug 02 06:46:56.117017 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 121/301] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:56.152946 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8bdacb04-3517-4fda-b038-dfd78629c26a tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.072414 Aug 02 06:46:56.159252 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 181/302] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:46:56 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:56.169631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-818477d6-e8eb-4992-814f-13d0032fac6e tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2087860374"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:56.174338 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:56.174338 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:56.176688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.aggregate [None req-818477d6-e8eb-4992-814f-13d0032fac6e tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Generated uuid 4a24e81a-9c4e-482f-a190-05dd668589ad for aggregate {{(pid=126119) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:56.212283 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-818477d6-e8eb-4992-814f-13d0032fac6e tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050525 Aug 02 06:46:56.214769 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 122/303] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:56 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:56.228751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c2a6bef8-42c4-4ba1-aaab-957bed6d6dde tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1840730428"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:56.231486 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:56.231486 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:56.242068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2a6bef8-42c4-4ba1-aaab-957bed6d6dde tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:56.242939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2a6bef8-42c4-4ba1-aaab-957bed6d6dde tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:56.253143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2a6bef8-42c4-4ba1-aaab-957bed6d6dde tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:56.253601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2a6bef8-42c4-4ba1-aaab-957bed6d6dde tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:56.263761 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-c2a6bef8-42c4-4ba1-aaab-957bed6d6dde tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1840730428 could not be found. Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c2a6bef8-42c4-4ba1-aaab-957bed6d6dde tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Request method failure captured: Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 58 Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgtI-VLZRnF-SyZGQgjF0sbTrZViis2fmQFZce51xiY4AhDphQu-LP-zxk6XBg8d8S7ES6XTXpaRt6Vr_Pq9h7gkXfmXeYWiiz7R0oNFvVl6Lf_t2mzfRgbs6f_RIKPgLVT3t-EIm1UCNtz5S6V2IRCkYMctwnNEKFSWJarBoEGiMg Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:46:56.267600 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:46:56.269069 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}] Aug 02 06:46:56.269069 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:56.269069 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:56.269069 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:56.269069 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:56.269069 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:56.269069 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:56.269069 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5ad6f0a3857348dd89ef179a1cc0db51 Aug 02 06:46:56.269069 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:56.269069 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:46:56.269069 n-d-851337-3 devstack@n-api.service[126120]: {"add_host": {"host": "tempest-nonexist_host-1840730428"}} Aug 02 06:46:56.269069 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:56.269069 n-d-851337-3 devstack@n-api.service[126120]: exception: Compute host tempest-nonexist_host-1840730428 could not be found. Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1840730428'}}} Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1840730428' is not mapped to any cell Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.269808 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6574, in add_host_to_aggregate Aug 02 06:46:56.270852 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1840730428 could not be found. Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1840730428 could not be found. Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:56.271887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.272948 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.272948 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:56.272948 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:56.272948 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:56.272948 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:56.272948 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1840730428 could not be found. Aug 02 06:46:56.272948 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.272948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c2a6bef8-42c4-4ba1-aaab-957bed6d6dde tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1840730428 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:56.272948 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c2a6bef8-42c4-4ba1-aaab-957bed6d6dde tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.046285 Aug 02 06:46:56.272948 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 182/304] 10.222.0.79 () {60 vars in 1194 bytes} [Tue Aug 2 06:46:56 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:56.280657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-252b1b62-9c21-44b0-80f0-689672a49086 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:56.282279 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:56.282279 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:56.315997 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-252b1b62-9c21-44b0-80f0-689672a49086 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.040874 Aug 02 06:46:56.317121 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 123/305] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:46:56 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:56.331178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b949fb6-7466-4778-a0a9-fd87666cb2d6 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b949fb6-7466-4778-a0a9-fd87666cb2d6 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Request method failure captured: Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 283 Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgtI-VLZRnF-SyZGQgjF0sbTrZViis2fmQFZce51xiY4AhDphQu-LP-zxk6XBg8d8S7ES6XTXpaRt6Vr_Pq9h7gkXfmXeYWiiz7R0oNFvVl6Lf_t2mzfRgbs6f_RIKPgLVT3t-EIm1UCNtz5S6V2IRCkYMctwnNEKFSWJarBoEGiMg Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:46:56.358118 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:46:56.359417 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}] Aug 02 06:46:56.359417 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:56.359417 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:56.359417 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:56.359417 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:56.359417 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:56.359417 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:56.359417 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5ad6f0a3857348dd89ef179a1cc0db51 Aug 02 06:46:56.359417 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:56.359417 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:46:56.359957 n-d-851337-3 devstack@n-api.service[126120]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 02 06:46:56.359957 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:56.359957 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 06:46:56.359957 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 02 06:46:56.359957 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:56.359957 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.359957 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:46:56.359957 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:46:56.359957 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:46:56.359957 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:56.360647 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:56.361664 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:56.362532 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:46:56.362532 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:46:56.362532 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 06:46:56.362532 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.365835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b949fb6-7466-4778-a0a9-fd87666cb2d6 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:56.371152 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b949fb6-7466-4778-a0a9-fd87666cb2d6 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.044634 Aug 02 06:46:56.372848 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 183/306] 10.222.0.79 () {60 vars in 1165 bytes} [Tue Aug 2 06:46:56 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:46:56.385859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab3e85c6-866b-46f9-a8fc-a4ef0d937fc9 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab3e85c6-866b-46f9-a8fc-a4ef0d937fc9 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Request method failure captured: Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 27 Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MgtI-VLZRnF-SyZGQgjF0sbTrZViis2fmQFZce51xiY4AhDphQu-LP-zxk6XBg8d8S7ES6XTXpaRt6Vr_Pq9h7gkXfmXeYWiiz7R0oNFvVl6Lf_t2mzfRgbs6f_RIKPgLVT3t-EIm1UCNtz5S6V2IRCkYMctwnNEKFSWJarBoEGiMg Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:46:56.393045 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:46:56.394253 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}] Aug 02 06:46:56.394253 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:56.394253 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:56.394253 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:56.394253 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:56.394253 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:56.394253 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:56.394253 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 5ad6f0a3857348dd89ef179a1cc0db51 Aug 02 06:46:56.394253 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:56.394253 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:46:56.394253 n-d-851337-3 devstack@n-api.service[126119]: {"aggregate": {"name": ""}} Aug 02 06:46:56.394253 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:56.394253 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi '' Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:56.394990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 02 06:46:56.396451 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.403801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab3e85c6-866b-46f9-a8fc-a4ef0d937fc9 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:56.405789 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ab3e85c6-866b-46f9-a8fc-a4ef0d937fc9 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.024934 Aug 02 06:46:56.406467 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 124/307] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:56 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:46:56.418649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5467402c-680f-40f8-8fd6-95a82e364eff tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1933946764"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:56.422162 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:56.422162 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:56.423489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5467402c-680f-40f8-8fd6-95a82e364eff tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '512b4dd8e1584f36aaee92549bf25d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebd31e50ccd4fabb5d9bd174d00e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5467402c-680f-40f8-8fd6-95a82e364eff tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Request method failure captured: Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 60 Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgpI1flN8s0F53dNJ4R9skFKVEZCuT0L7qXo3HCKAS3GM7GKHM5FDqE1crC7VgJzlh5dGUC8Oafwb71yZ4XMCKecbAtnnYCQ8swwNxOKG3j0f3TzRQMolQWo4CIJIl-bmIyt3WBlbvNwZx5SBYJTtaRT7Zlw6WZnibECKoFofyPNRw Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 1ebd31e50ccd4fabb5d9bd174d00e2f9 Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:56.425477 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:56.426688 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}] Aug 02 06:46:56.426688 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:56.426688 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 1ebd31e50ccd4fabb5d9bd174d00e2f9 Aug 02 06:46:56.426688 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:56.426688 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AggregatesAdminNegativeTestJSON-950577364-project Aug 02 06:46:56.426688 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:56.426688 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:56.426688 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 512b4dd8e1584f36aaee92549bf25d0d Aug 02 06:46:56.426688 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-950577364-project Aug 02 06:46:56.426688 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:46:56.426688 n-d-851337-3 devstack@n-api.service[126120]: {"aggregate": {"name": "tempest-test_aggregate-1933946764"}} Aug 02 06:46:56.426688 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:56.426688 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1933946764'}}} Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:56.427419 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:56.428395 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 02 06:46:56.429425 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.431030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5467402c-680f-40f8-8fd6-95a82e364eff tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:56.433729 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5467402c-680f-40f8-8fd6-95a82e364eff tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.020246 Aug 02 06:46:56.434337 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 184/308] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:56 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:56.459801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6bd3d13d-60ae-47c7-89b1-7d6522141e86 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1146477654"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:56.466316 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:56.466316 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:56.470366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.aggregate [None req-6bd3d13d-60ae-47c7-89b1-7d6522141e86 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Generated uuid cff8ca64-3ef3-4a91-bdcc-57ba95b087e4 for aggregate {{(pid=126119) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:56.520366 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6bd3d13d-60ae-47c7-89b1-7d6522141e86 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.072222 Aug 02 06:46:56.521182 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 125/309] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:56 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:56.531545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ccbe440-f9ce-4411-b143-8cf6d65f6b04 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:56.532259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2ccbe440-f9ce-4411-b143-8cf6d65f6b04 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:56.538545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0622ae9a-059e-4b24-b9a4-5ef8249ca1d6 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1146477654"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:56.539627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ccbe440-f9ce-4411-b143-8cf6d65f6b04 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:56.541363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ccbe440-f9ce-4411-b143-8cf6d65f6b04 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:56.542445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ccbe440-f9ce-4411-b143-8cf6d65f6b04 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:56.543157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ccbe440-f9ce-4411-b143-8cf6d65f6b04 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:56.545055 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:56.545055 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:56.546883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.aggregate [None req-0622ae9a-059e-4b24-b9a4-5ef8249ca1d6 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Generated uuid 2d68dd9b-7d36-4b14-973d-d49bb263af35 for aggregate {{(pid=126119) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:56.570754 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-0622ae9a-059e-4b24-b9a4-5ef8249ca1d6 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1146477654 already exists. Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0622ae9a-059e-4b24-b9a4-5ef8249ca1d6 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Request method failure captured: Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 60 Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MgtI-VLZRnF-SyZGQgjF0sbTrZViis2fmQFZce51xiY4AhDphQu-LP-zxk6XBg8d8S7ES6XTXpaRt6Vr_Pq9h7gkXfmXeYWiiz7R0oNFvVl6Lf_t2mzfRgbs6f_RIKPgLVT3t-EIm1UCNtz5S6V2IRCkYMctwnNEKFSWJarBoEGiMg Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:46:56.576754 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:46:56.578090 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}] Aug 02 06:46:56.578090 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:56.578090 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:56.578090 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:56.578090 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:56.578090 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:56.578090 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:56.578090 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 5ad6f0a3857348dd89ef179a1cc0db51 Aug 02 06:46:56.578090 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:56.578090 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:46:56.578090 n-d-851337-3 devstack@n-api.service[126119]: {"aggregate": {"name": "tempest-test_aggregate-1146477654"}} Aug 02 06:46:56.578090 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:56.578090 n-d-851337-3 devstack@n-api.service[126119]: exception: Aggregate tempest-test_aggregate-1146477654 already exists. Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1146477654'}}} Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6411, in create_aggregate Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 02 06:46:56.578796 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1146477654 already exists. Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:56.579852 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 02 06:46:56.581257 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 02 06:46:56.581257 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1146477654 already exists. Aug 02 06:46:56.581257 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.581257 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:56.581257 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.581257 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.581257 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:56.581257 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:56.581257 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:56.581257 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:56.581257 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1146477654 already exists. Aug 02 06:46:56.581257 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.584221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0622ae9a-059e-4b24-b9a4-5ef8249ca1d6 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1146477654 already exists. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:56.587559 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0622ae9a-059e-4b24-b9a4-5ef8249ca1d6 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.058995 Aug 02 06:46:56.589456 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 126/310] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:56 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:46:56.601176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-684d887d-4f63-40c1-8d1f-07be708d8f9d tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:56.606456 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:56.606456 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:56.650959 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-684d887d-4f63-40c1-8d1f-07be708d8f9d tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.054421 Aug 02 06:46:56.651980 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 127/311] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:46:56 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:56.673248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f910e55c-6e31-47be-b0fc-515a1ce1cba7 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2040228776"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:56.679299 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:56.679299 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:56.680609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.aggregate [None req-f910e55c-6e31-47be-b0fc-515a1ce1cba7 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Generated uuid 1654fc6f-0efa-4dd6-9672-5bf35e164ff7 for aggregate {{(pid=126119) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:56.713869 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f910e55c-6e31-47be-b0fc-515a1ce1cba7 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.051090 Aug 02 06:46:56.714939 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 128/312] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:56 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:56.733515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8290c862-3736-4ebe-a63c-1db23545e96f tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:56.735329 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:56.735329 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:56.736737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8290c862-3736-4ebe-a63c-1db23545e96f tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '512b4dd8e1584f36aaee92549bf25d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebd31e50ccd4fabb5d9bd174d00e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8290c862-3736-4ebe-a63c-1db23545e96f tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Request method failure captured: Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MgpI1flN8s0F53dNJ4R9skFKVEZCuT0L7qXo3HCKAS3GM7GKHM5FDqE1crC7VgJzlh5dGUC8Oafwb71yZ4XMCKecbAtnnYCQ8swwNxOKG3j0f3TzRQMolQWo4CIJIl-bmIyt3WBlbvNwZx5SBYJTtaRT7Zlw6WZnibECKoFofyPNRw Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 1ebd31e50ccd4fabb5d9bd174d00e2f9 Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:46:56.738453 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:46:56.739951 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}] Aug 02 06:46:56.739951 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:56.739951 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 1ebd31e50ccd4fabb5d9bd174d00e2f9 Aug 02 06:46:56.739951 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:56.739951 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AggregatesAdminNegativeTestJSON-950577364-project Aug 02 06:46:56.739951 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:56.739951 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:56.739951 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 512b4dd8e1584f36aaee92549bf25d0d Aug 02 06:46:56.739951 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-950577364-project Aug 02 06:46:56.739951 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:56.739951 n-d-851337-3 devstack@n-api.service[126119]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 02 06:46:56.739951 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '15'} Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:56.740736 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 02 06:46:56.741967 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:56.744096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8290c862-3736-4ebe-a63c-1db23545e96f tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:56.747278 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8290c862-3736-4ebe-a63c-1db23545e96f tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.019810 Aug 02 06:46:56.748555 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 129/313] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:46:56 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:56.764564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9fd3a8c3-94e1-4061-b99c-16a1579b9b8d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:56.765379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9fd3a8c3-94e1-4061-b99c-16a1579b9b8d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:56.775449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9fd3a8c3-94e1-4061-b99c-16a1579b9b8d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:56.776123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9fd3a8c3-94e1-4061-b99c-16a1579b9b8d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:56.777299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9fd3a8c3-94e1-4061-b99c-16a1579b9b8d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:56.777775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9fd3a8c3-94e1-4061-b99c-16a1579b9b8d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:57.055333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2ccbe440-f9ce-4411-b143-8cf6d65f6b04 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:57.063607 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2ccbe440-f9ce-4411-b143-8cf6d65f6b04 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 200 len: 1314 microversion: 2.1 time: 0.540993 Aug 02 06:46:57.074458 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 185/314] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:56 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:57.079886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5a4e9e26-0670-4ed9-a553-b507608be5cc tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:57.080658 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:57.080658 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:57.135226 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5a4e9e26-0670-4ed9-a553-b507608be5cc tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.059041 Aug 02 06:46:57.136104 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 186/315] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:46:57 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:57.142422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b56b690e-6075-405f-9471-8d53271c95e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:57.143604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b56b690e-6075-405f-9471-8d53271c95e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:57.152448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b56b690e-6075-405f-9471-8d53271c95e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:57.153010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b56b690e-6075-405f-9471-8d53271c95e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:57.154022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b56b690e-6075-405f-9471-8d53271c95e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:57.154574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b56b690e-6075-405f-9471-8d53271c95e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:57.342672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b56b690e-6075-405f-9471-8d53271c95e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:57.360525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b56b690e-6075-405f-9471-8d53271c95e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:57.362293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b56b690e-6075-405f-9471-8d53271c95e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:57.374323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9fd3a8c3-94e1-4061-b99c-16a1579b9b8d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:57.387174 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9fd3a8c3-94e1-4061-b99c-16a1579b9b8d tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1319 microversion: 2.1 time: 0.633567 Aug 02 06:46:57.387826 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b56b690e-6075-405f-9471-8d53271c95e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.250020 Aug 02 06:46:57.388427 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 187/316] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:57 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:57.389566 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 130/317] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:56 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1319 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:57.395351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-27bea0cc-0fbf-4ceb-bcc4-f3872ef0d404 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:57.396140 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:57.396140 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:57.434161 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-27bea0cc-0fbf-4ceb-bcc4-f3872ef0d404 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-27bea0cc-0fbf-4ceb-bcc4-f3872ef0d404 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Request method failure captured: Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgtI-VLZRnF-SyZGQgjF0sbTrZViis2fmQFZce51xiY4AhDphQu-LP-zxk6XBg8d8S7ES6XTXpaRt6Vr_Pq9h7gkXfmXeYWiiz7R0oNFvVl6Lf_t2mzfRgbs6f_RIKPgLVT3t-EIm1UCNtz5S6V2IRCkYMctwnNEKFSWJarBoEGiMg Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:46:57.439391 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:46:57.445447 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}] Aug 02 06:46:57.445447 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:57.445447 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:57.445447 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:57.445447 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:57.445447 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:57.445447 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:57.445447 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5ad6f0a3857348dd89ef179a1cc0db51 Aug 02 06:46:57.445447 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:57.445447 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:57.445447 n-d-851337-3 devstack@n-api.service[126120]: exception: Aggregate -1 could not be found. Aug 02 06:46:57.445447 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '-1'} Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 02 06:46:57.446176 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.447186 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:57.448291 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:57.448291 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:57.448291 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:57.448291 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:57.448291 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 02 06:46:57.448291 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.448291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-27bea0cc-0fbf-4ceb-bcc4-f3872ef0d404 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:57.448291 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-27bea0cc-0fbf-4ceb-bcc4-f3872ef0d404 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.050297 Aug 02 06:46:57.448291 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 188/318] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:46:57 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:46:57.449224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-14b46b4d-0d51-401f-92ae-2fc76f257549 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-488892219"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:57.451813 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:57.451813 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:57.453346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.aggregate [None req-14b46b4d-0d51-401f-92ae-2fc76f257549 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Generated uuid 52b687cb-bf83-4ea8-b317-fa2a79247b5a for aggregate {{(pid=126119) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:57.495324 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-14b46b4d-0d51-401f-92ae-2fc76f257549 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049547 Aug 02 06:46:57.495974 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 131/319] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:57.509054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd6960ce-6641-4670-833f-3d23355d3b24 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:57.510262 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:57.510262 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:57.511095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dd6960ce-6641-4670-833f-3d23355d3b24 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '512b4dd8e1584f36aaee92549bf25d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebd31e50ccd4fabb5d9bd174d00e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd6960ce-6641-4670-833f-3d23355d3b24 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Request method failure captured: Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgpI1flN8s0F53dNJ4R9skFKVEZCuT0L7qXo3HCKAS3GM7GKHM5FDqE1crC7VgJzlh5dGUC8Oafwb71yZ4XMCKecbAtnnYCQ8swwNxOKG3j0f3TzRQMolQWo4CIJIl-bmIyt3WBlbvNwZx5SBYJTtaRT7Zlw6WZnibECKoFofyPNRw Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 1ebd31e50ccd4fabb5d9bd174d00e2f9 Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:57.512842 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:57.514200 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}] Aug 02 06:46:57.514200 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:57.514200 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 1ebd31e50ccd4fabb5d9bd174d00e2f9 Aug 02 06:46:57.514200 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:57.514200 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AggregatesAdminNegativeTestJSON-950577364-project Aug 02 06:46:57.514200 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:57.514200 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:57.514200 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 512b4dd8e1584f36aaee92549bf25d0d Aug 02 06:46:57.514200 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-950577364-project Aug 02 06:46:57.514200 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:57.514200 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 02 06:46:57.514200 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '16'} Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:57.515038 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.516240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd6960ce-6641-4670-833f-3d23355d3b24 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:57.517408 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dd6960ce-6641-4670-833f-3d23355d3b24 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] 10.222.0.79 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.010121 Aug 02 06:46:57.518798 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 189/320] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:46:57 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:57.532469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-83b44112-88fc-45da-a224-19784d153fdc tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:57.535721 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:57.535721 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:57.575042 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-83b44112-88fc-45da-a224-19784d153fdc tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.053812 Aug 02 06:46:57.576049 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 132/321] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:46:57 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:57.585740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c058d057-002d-4c12-8666-dd5ca0e6210e tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:57.600101 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-c058d057-002d-4c12-8666-dd5ca0e6210e tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c058d057-002d-4c12-8666-dd5ca0e6210e tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Request method failure captured: Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgtI-VLZRnF-SyZGQgjF0sbTrZViis2fmQFZce51xiY4AhDphQu-LP-zxk6XBg8d8S7ES6XTXpaRt6Vr_Pq9h7gkXfmXeYWiiz7R0oNFvVl6Lf_t2mzfRgbs6f_RIKPgLVT3t-EIm1UCNtz5S6V2IRCkYMctwnNEKFSWJarBoEGiMg Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:46:57.617163 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:46:57.618519 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}] Aug 02 06:46:57.618519 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:57.618519 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:57.618519 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:57.618519 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:57.618519 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:57.618519 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:57.618519 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5ad6f0a3857348dd89ef179a1cc0db51 Aug 02 06:46:57.618519 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:57.618519 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:57.618519 n-d-851337-3 devstack@n-api.service[126120]: exception: Aggregate -1 could not be found. Aug 02 06:46:57.618519 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '-1'} Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:57.619173 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 02 06:46:57.620217 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.621165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c058d057-002d-4c12-8666-dd5ca0e6210e tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:57.621165 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c058d057-002d-4c12-8666-dd5ca0e6210e tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.038528 Aug 02 06:46:57.623759 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 190/322] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:46:57 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 02 06:46:57.634954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ddb4909c-c975-4a80-b662-16dc1d1c3e83 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:57.635739 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:57.635739 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:57.636642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ddb4909c-c975-4a80-b662-16dc1d1c3e83 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '512b4dd8e1584f36aaee92549bf25d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebd31e50ccd4fabb5d9bd174d00e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ddb4909c-c975-4a80-b662-16dc1d1c3e83 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Request method failure captured: Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MgpI1flN8s0F53dNJ4R9skFKVEZCuT0L7qXo3HCKAS3GM7GKHM5FDqE1crC7VgJzlh5dGUC8Oafwb71yZ4XMCKecbAtnnYCQ8swwNxOKG3j0f3TzRQMolQWo4CIJIl-bmIyt3WBlbvNwZx5SBYJTtaRT7Zlw6WZnibECKoFofyPNRw Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 1ebd31e50ccd4fabb5d9bd174d00e2f9 Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:46:57.638246 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:46:57.639390 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}] Aug 02 06:46:57.639390 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:57.639390 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 1ebd31e50ccd4fabb5d9bd174d00e2f9 Aug 02 06:46:57.639390 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:57.639390 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AggregatesAdminNegativeTestJSON-950577364-project Aug 02 06:46:57.639390 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:57.639390 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:57.639390 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 512b4dd8e1584f36aaee92549bf25d0d Aug 02 06:46:57.639390 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-950577364-project Aug 02 06:46:57.639390 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:57.639390 n-d-851337-3 devstack@n-api.service[126119]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 02 06:46:57.639390 n-d-851337-3 devstack@n-api.service[126119]: action_args: {} Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:57.640028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 02 06:46:57.641019 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.643544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ddb4909c-c975-4a80-b662-16dc1d1c3e83 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:57.650891 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ddb4909c-c975-4a80-b662-16dc1d1c3e83 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.016919 Aug 02 06:46:57.653612 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 133/323] 10.222.0.79 () {58 vars in 1143 bytes} [Tue Aug 2 06:46:57 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:57.665929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fbce6848-376d-4cc8-8d9e-12a9a00a59df tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-675278433"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:57.674185 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:57.674185 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:57.675368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.aggregate [None req-fbce6848-376d-4cc8-8d9e-12a9a00a59df tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Generated uuid 68749327-ebfe-4646-8b8c-c5f5a1289714 for aggregate {{(pid=126120) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:57.720400 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fbce6848-376d-4cc8-8d9e-12a9a00a59df tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055801 Aug 02 06:46:57.721828 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 191/324] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:57.737048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-99013d97-711b-4513-9a4a-073c955ee1a4 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-3"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:57.739923 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:57.739923 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:57.768420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99013d97-711b-4513-9a4a-073c955ee1a4 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:57.769197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99013d97-711b-4513-9a4a-073c955ee1a4 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:57.957778 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-99013d97-711b-4513-9a4a-073c955ee1a4 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.225159 Aug 02 06:46:57.958469 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 134/325] 10.222.0.79 () {60 vars in 1194 bytes} [Tue Aug 2 06:46:57 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:57.971593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ce6ad180-5b7d-40ee-b5d9-b1895dd65075 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-3"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:57.975118 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:57.975118 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:46:57.976125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ce6ad180-5b7d-40ee-b5d9-b1895dd65075 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '512b4dd8e1584f36aaee92549bf25d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebd31e50ccd4fabb5d9bd174d00e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ce6ad180-5b7d-40ee-b5d9-b1895dd65075 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Request method failure captured: Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 42 Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgpI1flN8s0F53dNJ4R9skFKVEZCuT0L7qXo3HCKAS3GM7GKHM5FDqE1crC7VgJzlh5dGUC8Oafwb71yZ4XMCKecbAtnnYCQ8swwNxOKG3j0f3TzRQMolQWo4CIJIl-bmIyt3WBlbvNwZx5SBYJTtaRT7Zlw6WZnibECKoFofyPNRw Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 1ebd31e50ccd4fabb5d9bd174d00e2f9 Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:46:57.981478 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:46:57.983519 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ebd31e50ccd4fabb5d9bd174d00e2f9"}]}] Aug 02 06:46:57.983519 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:57.983519 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 1ebd31e50ccd4fabb5d9bd174d00e2f9 Aug 02 06:46:57.983519 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-950577364 Aug 02 06:46:57.983519 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AggregatesAdminNegativeTestJSON-950577364-project Aug 02 06:46:57.983519 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:46:57.983519 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:46:57.983519 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 512b4dd8e1584f36aaee92549bf25d0d Aug 02 06:46:57.983519 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-950577364-project Aug 02 06:46:57.983519 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:46:57.983519 n-d-851337-3 devstack@n-api.service[126120]: {"remove_host": {"host": "n-h2-851337-3"}} Aug 02 06:46:57.983519 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:46:57.983519 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-851337-3'}}} Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:57.988643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 02 06:46:57.989926 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:46:57.991138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ce6ad180-5b7d-40ee-b5d9-b1895dd65075 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:57.991138 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ce6ad180-5b7d-40ee-b5d9-b1895dd65075 tempest-AggregatesAdminNegativeTestJSON-950577364 tempest-AggregatesAdminNegativeTestJSON-950577364-project] 10.222.0.79 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.016201 Aug 02 06:46:57.991138 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 192/326] 10.222.0.79 () {60 vars in 1194 bytes} [Tue Aug 2 06:46:57 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:46:57.994530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d84fd40d-57d6-4f70-be3c-94edd9dde8af tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-3"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:57.998735 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:57.998735 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:58.012275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d84fd40d-57d6-4f70-be3c-94edd9dde8af tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:58.012724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d84fd40d-57d6-4f70-be3c-94edd9dde8af tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:58.089301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fda151cf-77ad-46c1-87f6-8050310aabab tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:58.090234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fda151cf-77ad-46c1-87f6-8050310aabab tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:58.102032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fda151cf-77ad-46c1-87f6-8050310aabab tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:58.102885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fda151cf-77ad-46c1-87f6-8050310aabab tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:58.104346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fda151cf-77ad-46c1-87f6-8050310aabab tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:58.106727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fda151cf-77ad-46c1-87f6-8050310aabab tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:58.157403 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d84fd40d-57d6-4f70-be3c-94edd9dde8af tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.167984 Aug 02 06:46:58.158457 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 135/327] 10.222.0.79 () {60 vars in 1194 bytes} [Tue Aug 2 06:46:57 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:58.169669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-77efbe99-cb0d-4e87-ab8a-1ed7117571f3 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:58.170697 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:58.170697 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:58.210961 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-77efbe99-cb0d-4e87-ab8a-1ed7117571f3 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.044602 Aug 02 06:46:58.213289 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 136/328] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:46:58 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:58.226056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fcb1aa46-c85c-4e80-a3af-484f4d4e32bd tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1475929102"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:58.230365 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:58.230365 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:58.231541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.aggregate [None req-fcb1aa46-c85c-4e80-a3af-484f4d4e32bd tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Generated uuid 40d0f835-65c0-4662-b3d8-abe519a932c4 for aggregate {{(pid=126119) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 06:46:58.264664 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fcb1aa46-c85c-4e80-a3af-484f4d4e32bd tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.045673 Aug 02 06:46:58.272544 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 137/329] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 06:46:58 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:46:58.277390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b0d9031d-8f99-4c6f-8934-4cc9401ed6f0 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:58.280198 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:58.280198 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:58.291508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0d9031d-8f99-4c6f-8934-4cc9401ed6f0 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:58.292339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0d9031d-8f99-4c6f-8934-4cc9401ed6f0 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:58.302466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0d9031d-8f99-4c6f-8934-4cc9401ed6f0 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:58.303395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0d9031d-8f99-4c6f-8934-4cc9401ed6f0 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:58.311715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.compute.aggregates [None req-b0d9031d-8f99-4c6f-8934-4cc9401ed6f0 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 02 06:46:58.312226 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-b0d9031d-8f99-4c6f-8934-4cc9401ed6f0 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b0d9031d-8f99-4c6f-8934-4cc9401ed6f0 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Request method failure captured: Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 42 Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MgtI-VLZRnF-SyZGQgjF0sbTrZViis2fmQFZce51xiY4AhDphQu-LP-zxk6XBg8d8S7ES6XTXpaRt6Vr_Pq9h7gkXfmXeYWiiz7R0oNFvVl6Lf_t2mzfRgbs6f_RIKPgLVT3t-EIm1UCNtz5S6V2IRCkYMctwnNEKFSWJarBoEGiMg Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:46:58.314695 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:46:58.316035 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d13b2dd4a5d04493b87984a6b0e453fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d13b2dd4a5d04493b87984a6b0e453fc"}]}] Aug 02 06:46:58.316035 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:58.316035 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: d13b2dd4a5d04493b87984a6b0e453fc Aug 02 06:46:58.316035 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957806129 Aug 02 06:46:58.316035 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:58.316035 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:46:58.316035 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:46:58.316035 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 5ad6f0a3857348dd89ef179a1cc0db51 Aug 02 06:46:58.316035 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin Aug 02 06:46:58.316035 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:46:58.316035 n-d-851337-3 devstack@n-api.service[126119]: {"remove_host": {"host": "nonexist_host"}} Aug 02 06:46:58.316035 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:46:58.316035 n-d-851337-3 devstack@n-api.service[126119]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 02 06:46:58.316808 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in remove_host_from_aggregate Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 02 06:46:58.317835 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:58.319230 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:46:58.325271 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:46:58.325271 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:46:58.325271 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:46:58.325271 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:46:58.325271 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 02 06:46:58.325271 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:46:58.325271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b0d9031d-8f99-4c6f-8934-4cc9401ed6f0 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:46:58.325271 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b0d9031d-8f99-4c6f-8934-4cc9401ed6f0 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.047316 Aug 02 06:46:58.325271 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 138/330] 10.222.0.79 () {60 vars in 1194 bytes} [Tue Aug 2 06:46:58 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:46:58.333308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7703027d-f0ec-42b6-8555-97ff9536fe77 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:58.333308 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:58.333308 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:58.377709 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7703027d-f0ec-42b6-8555-97ff9536fe77 tempest-AggregatesAdminNegativeTestJSON-957806129 tempest-AggregatesAdminNegativeTestJSON-957806129-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.051081 Aug 02 06:46:58.381969 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 139/331] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:46:58 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:46:58.410653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aaa559a1-2773-49fa-86cd-02ba5e973ed8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:58.411266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aaa559a1-2773-49fa-86cd-02ba5e973ed8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:58.418143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aaa559a1-2773-49fa-86cd-02ba5e973ed8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:58.418582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aaa559a1-2773-49fa-86cd-02ba5e973ed8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:58.421723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aaa559a1-2773-49fa-86cd-02ba5e973ed8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:58.422404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aaa559a1-2773-49fa-86cd-02ba5e973ed8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:58.541080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fda151cf-77ad-46c1-87f6-8050310aabab tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:58.549173 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fda151cf-77ad-46c1-87f6-8050310aabab tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 200 len: 1464 microversion: 2.1 time: 0.463860 Aug 02 06:46:58.553161 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 193/332] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:58 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 1464 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:46:58.566676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2c152c5-1fab-44f4-ba01-29f9f10b0190 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:58.567293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f2c152c5-1fab-44f4-ba01-29f9f10b0190 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:58.575061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2c152c5-1fab-44f4-ba01-29f9f10b0190 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:58.575511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2c152c5-1fab-44f4-ba01-29f9f10b0190 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:58.576288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2c152c5-1fab-44f4-ba01-29f9f10b0190 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:58.576719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2c152c5-1fab-44f4-ba01-29f9f10b0190 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:58.753155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f2c152c5-1fab-44f4-ba01-29f9f10b0190 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:58.764701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f2c152c5-1fab-44f4-ba01-29f9f10b0190 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:58.766251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f2c152c5-1fab-44f4-ba01-29f9f10b0190 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:58.773859 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f2c152c5-1fab-44f4-ba01-29f9f10b0190 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.219631 Aug 02 06:46:58.774470 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 194/333] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:58 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:46:58.785976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5989b0a1-cd84-4d5b-a1cc-23d0aa2c6b5e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:58.785976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5989b0a1-cd84-4d5b-a1cc-23d0aa2c6b5e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:58.793955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5989b0a1-cd84-4d5b-a1cc-23d0aa2c6b5e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:58.794596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5989b0a1-cd84-4d5b-a1cc-23d0aa2c6b5e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:58.795521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5989b0a1-cd84-4d5b-a1cc-23d0aa2c6b5e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:58.796094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5989b0a1-cd84-4d5b-a1cc-23d0aa2c6b5e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:58.844436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aaa559a1-2773-49fa-86cd-02ba5e973ed8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:58.854066 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aaa559a1-2773-49fa-86cd-02ba5e973ed8 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1319 microversion: 2.1 time: 0.447579 Aug 02 06:46:58.854956 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 140/334] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:58 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:59.024781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5989b0a1-cd84-4d5b-a1cc-23d0aa2c6b5e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:59.040327 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5989b0a1-cd84-4d5b-a1cc-23d0aa2c6b5e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1462 microversion: 2.1 time: 0.264707 Aug 02 06:46:59.040916 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 195/335] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:46:58 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1462 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:46:59.094832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-a4679aa6-4f14-433f-bbca-6fbe92ff761b req-77a156c5-6387-4187-9a24-39e4b1b80906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15cdb0c-fc57-4d57-b011-5f7d2a604172", "tag": "4eb2dde0-527a-42dc-9d97-f64be5223fa2"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:59.104667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a4679aa6-4f14-433f-bbca-6fbe92ff761b req-77a156c5-6387-4187-9a24-39e4b1b80906 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:59.105462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a4679aa6-4f14-433f-bbca-6fbe92ff761b req-77a156c5-6387-4187-9a24-39e4b1b80906 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:59.121004 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-a4679aa6-4f14-433f-bbca-6fbe92ff761b req-77a156c5-6387-4187-9a24-39e4b1b80906 service nova] Creating event network-changed:4eb2dde0-527a-42dc-9d97-f64be5223fa2 for instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 on n-h1-851337-3 Aug 02 06:46:59.132268 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-a4679aa6-4f14-433f-bbca-6fbe92ff761b req-77a156c5-6387-4187-9a24-39e4b1b80906 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040481 Aug 02 06:46:59.133571 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 196/336] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:46:59.302485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-126112056", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d9733613-ae5d-4c27-bf69-3958cd6e459c"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:46:59.408182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c460ab52-b4f2-4b94-9a35-68de791c5569 tempest-HypervisorAdminV228Test-1428643782 tempest-HypervisorAdminV228Test-1428643782-project-admin] Calling method '.version_select at 0x7f927bda28b0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:59.409637 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:59.409637 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:59.416403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c460ab52-b4f2-4b94-9a35-68de791c5569 tempest-HypervisorAdminV228Test-1428643782 tempest-HypervisorAdminV228Test-1428643782-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:59.417316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c460ab52-b4f2-4b94-9a35-68de791c5569 tempest-HypervisorAdminV228Test-1428643782 tempest-HypervisorAdminV228Test-1428643782-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:59.418562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:46:59.452514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c460ab52-b4f2-4b94-9a35-68de791c5569 tempest-HypervisorAdminV228Test-1428643782 tempest-HypervisorAdminV228Test-1428643782-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:59.453470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c460ab52-b4f2-4b94-9a35-68de791c5569 tempest-HypervisorAdminV228Test-1428643782 tempest-HypervisorAdminV228Test-1428643782-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:59.467584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c460ab52-b4f2-4b94-9a35-68de791c5569 tempest-HypervisorAdminV228Test-1428643782 tempest-HypervisorAdminV228Test-1428643782-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:59.468312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c460ab52-b4f2-4b94-9a35-68de791c5569 tempest-HypervisorAdminV228Test-1428643782 tempest-HypervisorAdminV228Test-1428643782-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:59.475879 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c460ab52-b4f2-4b94-9a35-68de791c5569 tempest-HypervisorAdminV228Test-1428643782 tempest-HypervisorAdminV228Test-1428643782-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.436634 Aug 02 06:46:59.476743 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 141/337] 10.222.0.79 () {60 vars in 1187 bytes} [Tue Aug 2 06:46:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 06:46:59.488094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0271add3-8330-4392-8c43-7e5164b21a34 tempest-HypervisorAdminV228Test-1428643782 tempest-HypervisorAdminV228Test-1428643782-project-admin] Calling method '.version_select at 0x7f927bd1f550>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:59.488994 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:46:59.488994 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:46:59.490393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0271add3-8330-4392-8c43-7e5164b21a34 tempest-HypervisorAdminV228Test-1428643782 tempest-HypervisorAdminV228Test-1428643782-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:59.490918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0271add3-8330-4392-8c43-7e5164b21a34 tempest-HypervisorAdminV228Test-1428643782 tempest-HypervisorAdminV228Test-1428643782-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:59.520721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0271add3-8330-4392-8c43-7e5164b21a34 tempest-HypervisorAdminV228Test-1428643782 tempest-HypervisorAdminV228Test-1428643782-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:59.521199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0271add3-8330-4392-8c43-7e5164b21a34 tempest-HypervisorAdminV228Test-1428643782 tempest-HypervisorAdminV228Test-1428643782-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:59.548889 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0271add3-8330-4392-8c43-7e5164b21a34 tempest-HypervisorAdminV228Test-1428643782 tempest-HypervisorAdminV228Test-1428643782-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.065149 Aug 02 06:46:59.549622 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 142/338] 10.222.0.79 () {60 vars in 1193 bytes} [Tue Aug 2 06:46:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:46:59.805207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6594103e-f781-47a7-9d18-c8cba53b1d67 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:46:59.806982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6594103e-f781-47a7-9d18-c8cba53b1d67 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:46:59.823892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6594103e-f781-47a7-9d18-c8cba53b1d67 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:59.824568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6594103e-f781-47a7-9d18-c8cba53b1d67 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:59.826233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6594103e-f781-47a7-9d18-c8cba53b1d67 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:59.828263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6594103e-f781-47a7-9d18-c8cba53b1d67 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:59.965749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6594103e-f781-47a7-9d18-c8cba53b1d67 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:59.976665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:46:59.977150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:46:59.977592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:46:59.978066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:46:59.978626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:46:59.997664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:46:59.998102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6594103e-f781-47a7-9d18-c8cba53b1d67 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:46:59.998273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:46:59.999588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:00.000310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:00.002450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6594103e-f781-47a7-9d18-c8cba53b1d67 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:00.007364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:DELETE=12,nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:00.013449 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6594103e-f781-47a7-9d18-c8cba53b1d67 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.217893 Aug 02 06:47:00.014243 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 143/339] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:46:59 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:47:00.019374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-07ed32c5-0479-4cc4-86cf-75f15dc30533 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:00.020164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-07ed32c5-0479-4cc4-86cf-75f15dc30533 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:00.026381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Getting quotas for project 3573e2fa6bf04720b7fb8d85b6cc5a54. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:00.030213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07ed32c5-0479-4cc4-86cf-75f15dc30533 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:00.030853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07ed32c5-0479-4cc4-86cf-75f15dc30533 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:00.031023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Getting quotas for user b5122454fd05436fb394a44cef1db729 and project 3573e2fa6bf04720b7fb8d85b6cc5a54. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:00.033239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07ed32c5-0479-4cc4-86cf-75f15dc30533 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:00.033832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07ed32c5-0479-4cc4-86cf-75f15dc30533 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:00.059843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:47:00.063421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:47:00.114755 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-de69c231-2d7b-42ba-8c9c-4034c48978e2 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817282 Aug 02 06:47:00.116339 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 197/340] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:46:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 06:47:00.130242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5d1e9a9a-2a0e-48e2-8dfa-63bf8fdbac55 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:00.131546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5d1e9a9a-2a0e-48e2-8dfa-63bf8fdbac55 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:00.223353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5d1e9a9a-2a0e-48e2-8dfa-63bf8fdbac55 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:00.230477 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5d1e9a9a-2a0e-48e2-8dfa-63bf8fdbac55 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881" status: 200 len: 1213 microversion: 2.1 time: 0.107287 Aug 02 06:47:00.237631 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 198/341] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:00 2022] GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:47:00.260307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-07ed32c5-0479-4cc4-86cf-75f15dc30533 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:00.269398 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-07ed32c5-0479-4cc4-86cf-75f15dc30533 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1319 microversion: 2.1 time: 0.253910 Aug 02 06:47:00.270078 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 144/342] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:00 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:01.040792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-512b342a-03c2-40d2-833c-a1b209692c07 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:01.041401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-512b342a-03c2-40d2-833c-a1b209692c07 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:01.048426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-512b342a-03c2-40d2-833c-a1b209692c07 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:01.048879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-512b342a-03c2-40d2-833c-a1b209692c07 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:01.049720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-512b342a-03c2-40d2-833c-a1b209692c07 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:01.052167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-512b342a-03c2-40d2-833c-a1b209692c07 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:01.137378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-512b342a-03c2-40d2-833c-a1b209692c07 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:01.147344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-512b342a-03c2-40d2-833c-a1b209692c07 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:01.149215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-512b342a-03c2-40d2-833c-a1b209692c07 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:01.152217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:01.155255 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-512b342a-03c2-40d2-833c-a1b209692c07 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.118599 Aug 02 06:47:01.156308 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 199/343] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:01 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:01.254177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1738c2a0-0aa0-49d9-ab35-1204bb1dcef3 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:01.256062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1738c2a0-0aa0-49d9-ab35-1204bb1dcef3 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:01.264019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1738c2a0-0aa0-49d9-ab35-1204bb1dcef3 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:01.264665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1738c2a0-0aa0-49d9-ab35-1204bb1dcef3 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:01.265738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1738c2a0-0aa0-49d9-ab35-1204bb1dcef3 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:01.266192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1738c2a0-0aa0-49d9-ab35-1204bb1dcef3 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:01.297045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9e1e1161-4e68-455a-a973-4619b88799db tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:01.298160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9e1e1161-4e68-455a-a973-4619b88799db tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:01.315990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e1e1161-4e68-455a-a973-4619b88799db tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:01.317868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e1e1161-4e68-455a-a973-4619b88799db tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:01.318703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e1e1161-4e68-455a-a973-4619b88799db tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:01.319139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e1e1161-4e68-455a-a973-4619b88799db tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:01.381218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1738c2a0-0aa0-49d9-ab35-1204bb1dcef3 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:01.391244 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1738c2a0-0aa0-49d9-ab35-1204bb1dcef3 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881" status: 200 len: 1265 microversion: 2.1 time: 0.141037 Aug 02 06:47:01.391897 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 145/344] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:01 2022] GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:01.648316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9e1e1161-4e68-455a-a973-4619b88799db tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:01.656786 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9e1e1161-4e68-455a-a973-4619b88799db tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1319 microversion: 2.1 time: 0.366101 Aug 02 06:47:01.657538 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 200/345] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:01 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:47:01.719461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9e1e1161-4e68-455a-a973-4619b88799db tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:01.720438 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9e1e1161-4e68-455a-a973-4619b88799db tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001359 Aug 02 06:47:01.720773 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 201/346] 10.222.0.79 () {56 vars in 886 bytes} [Tue Aug 2 06:47:01 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 02 06:47:01.805193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6f349d52-b01c-4727-aa49-2b635f02c788 tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1367157165", "id": 1489918548, "os-flavor-access:is_public": "False"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:01.812410 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:01.812410 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:01.867726 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6f349d52-b01c-4727-aa49-2b635f02c788 tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.368481 Aug 02 06:47:01.869461 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 146/347] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:47:01 2022] POST /compute/v2.1/flavors => generated 431 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:47:01.883518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-109c9f31-62cd-4acf-b7f4-1c6cf9ad91ee tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d0943fa1702043fea8986938fae501fd"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:01.890112 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:01.890112 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:02.183593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7eb273a9-0091-49bf-aeb7-0863c9d4a103 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:02.185788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7eb273a9-0091-49bf-aeb7-0863c9d4a103 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:02.197926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7eb273a9-0091-49bf-aeb7-0863c9d4a103 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:02.198706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7eb273a9-0091-49bf-aeb7-0863c9d4a103 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:02.199732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7eb273a9-0091-49bf-aeb7-0863c9d4a103 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:02.200876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7eb273a9-0091-49bf-aeb7-0863c9d4a103 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:02.316899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7eb273a9-0091-49bf-aeb7-0863c9d4a103 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:02.329721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7eb273a9-0091-49bf-aeb7-0863c9d4a103 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:02.332076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7eb273a9-0091-49bf-aeb7-0863c9d4a103 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:02.339210 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7eb273a9-0091-49bf-aeb7-0863c9d4a103 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.162297 Aug 02 06:47:02.339812 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 147/348] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:02 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:47:02.415799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-49f03468-d979-4570-ad26-fcc13eb4220a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:02.417367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-49f03468-d979-4570-ad26-fcc13eb4220a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:02.419687 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-109c9f31-62cd-4acf-b7f4-1c6cf9ad91ee tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1489918548/action" status: 200 len: 97 microversion: 2.1 time: 0.540652 Aug 02 06:47:02.421356 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 202/349] 10.222.0.79 () {60 vars in 1200 bytes} [Tue Aug 2 06:47:01 2022] POST /compute/v2.1/flavors/1489918548/action => generated 97 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 06:47:02.438775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49f03468-d979-4570-ad26-fcc13eb4220a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:02.440431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49f03468-d979-4570-ad26-fcc13eb4220a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:02.442111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49f03468-d979-4570-ad26-fcc13eb4220a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:02.444141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49f03468-d979-4570-ad26-fcc13eb4220a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:03.046403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0fb0edeb-684c-4672-aa2b-046c65958f73 tempest-FlavorsAccessTestJSON-1994922 tempest-FlavorsAccessTestJSON-1994922-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:03.085626 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0fb0edeb-684c-4672-aa2b-046c65958f73 tempest-FlavorsAccessTestJSON-1994922 tempest-FlavorsAccessTestJSON-1994922-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 6241 microversion: 2.1 time: 0.658822 Aug 02 06:47:03.099483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=30 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:03.102834 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 203/350] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:47:02 2022] GET /compute/v2.1/flavors/detail => generated 6241 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:03.108764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2f95bdea-b7f5-4833-bfc5-3f0583313380 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:03.110389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2f95bdea-b7f5-4833-bfc5-3f0583313380 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:03.117778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f95bdea-b7f5-4833-bfc5-3f0583313380 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:03.118253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f95bdea-b7f5-4833-bfc5-3f0583313380 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:03.119194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f95bdea-b7f5-4833-bfc5-3f0583313380 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:03.119621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f95bdea-b7f5-4833-bfc5-3f0583313380 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:03.346082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-49f03468-d979-4570-ad26-fcc13eb4220a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:03.354499 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-49f03468-d979-4570-ad26-fcc13eb4220a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881" status: 200 len: 1313 microversion: 2.1 time: 0.943916 Aug 02 06:47:03.368546 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 148/351] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:02 2022] GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 => generated 1313 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:03.374035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-caaf62e3-31d4-4719-9868-dc2ec0f9e5a8 tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d0943fa1702043fea8986938fae501fd"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:03.376983 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:03.376983 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:03.529263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2f95bdea-b7f5-4833-bfc5-3f0583313380 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:03.542279 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2f95bdea-b7f5-4833-bfc5-3f0583313380 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1319 microversion: 2.1 time: 0.437507 Aug 02 06:47:03.559272 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 204/352] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:03 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:03.568190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b0f67bd8-fe58-4a03-a5ec-6ed6bc3bd405 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:03.569388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b0f67bd8-fe58-4a03-a5ec-6ed6bc3bd405 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:03.576636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0f67bd8-fe58-4a03-a5ec-6ed6bc3bd405 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:03.577081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0f67bd8-fe58-4a03-a5ec-6ed6bc3bd405 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:03.578006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0f67bd8-fe58-4a03-a5ec-6ed6bc3bd405 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:03.579195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0f67bd8-fe58-4a03-a5ec-6ed6bc3bd405 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:03.676045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b0f67bd8-fe58-4a03-a5ec-6ed6bc3bd405 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:03.687850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b0f67bd8-fe58-4a03-a5ec-6ed6bc3bd405 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:03.695281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b0f67bd8-fe58-4a03-a5ec-6ed6bc3bd405 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:03.702868 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b0f67bd8-fe58-4a03-a5ec-6ed6bc3bd405 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.141620 Aug 02 06:47:03.706377 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 205/353] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:03 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:03.957075 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-caaf62e3-31d4-4719-9868-dc2ec0f9e5a8 tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1489918548/action" status: 200 len: 21 microversion: 2.1 time: 0.587163 Aug 02 06:47:03.966686 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 149/354] 10.222.0.79 () {60 vars in 1200 bytes} [Tue Aug 2 06:47:03 2022] POST /compute/v2.1/flavors/1489918548/action => generated 21 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:03.971751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3871c55e-4ab9-41fd-8802-7bcca1fce6ca tempest-FlavorsAccessTestJSON-1994922 tempest-FlavorsAccessTestJSON-1994922-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:04.012194 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3871c55e-4ab9-41fd-8802-7bcca1fce6ca tempest-FlavorsAccessTestJSON-1994922 tempest-FlavorsAccessTestJSON-1994922-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.044141 Aug 02 06:47:04.018115 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 206/355] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:47:03 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:04.031564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a7dc702f-5dc2-46b1-b814-5dbd63ff2388 tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:04.034475 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:04.034475 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:04.070115 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a7dc702f-5dc2-46b1-b814-5dbd63ff2388 tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1489918548" status: 202 len: 0 microversion: 2.1 time: 0.042201 Aug 02 06:47:04.071447 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 150/356] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:47:04 2022] DELETE /compute/v2.1/flavors/1489918548 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:47:04.080069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b2a8cb62-3911-43ec-907c-4daeb8eccd9d tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:04.123575 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b2a8cb62-3911-43ec-907c-4daeb8eccd9d tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.045815 Aug 02 06:47:04.142598 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 207/357] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:47:04 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:04.153819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-88d73cd9-8f48-41dd-a53a-41ce7efa844d tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-988511863", "id": 1814726729, "os-flavor-access:is_public": "False"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:04.160226 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:04.160226 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:04.190589 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-88d73cd9-8f48-41dd-a53a-41ce7efa844d tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.043822 Aug 02 06:47:04.191741 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 151/358] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:47:04 2022] POST /compute/v2.1/flavors => generated 430 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:04.201943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b315590d-9206-4728-84d6-711d0eb54332 req-ac4bac1b-0eae-4dd6-8612-74d41e9744df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffeec79d-f13b-43f6-8da2-70944a5ed881", "tag": "9335a2d8-f37b-4e9e-91fb-01c497886dd6"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:04.207243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-081219d1-93a5-45ca-977d-4924fcebf63f tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:04.209284 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:04.209284 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:04.220365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b315590d-9206-4728-84d6-711d0eb54332 req-ac4bac1b-0eae-4dd6-8612-74d41e9744df service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:04.220810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b315590d-9206-4728-84d6-711d0eb54332 req-ac4bac1b-0eae-4dd6-8612-74d41e9744df service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:04.231479 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-081219d1-93a5-45ca-977d-4924fcebf63f tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/1814726729/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.031701 Aug 02 06:47:04.232305 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 152/359] 10.222.0.79 () {58 vars in 1209 bytes} [Tue Aug 2 06:47:04 2022] GET /compute/v2.1/flavors/1814726729/os-flavor-access => generated 21 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:04.242616 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b315590d-9206-4728-84d6-711d0eb54332 req-ac4bac1b-0eae-4dd6-8612-74d41e9744df service nova] Creating event network-changed:9335a2d8-f37b-4e9e-91fb-01c497886dd6 for instance ffeec79d-f13b-43f6-8da2-70944a5ed881 on n-h2-851337-3 Aug 02 06:47:04.243760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-46699681-519d-4c88-94c5-50fb12261440 tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:04.252653 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b315590d-9206-4728-84d6-711d0eb54332 req-ac4bac1b-0eae-4dd6-8612-74d41e9744df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062812 Aug 02 06:47:04.254345 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 208/360] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:04.272203 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-46699681-519d-4c88-94c5-50fb12261440 tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1814726729" status: 202 len: 0 microversion: 2.1 time: 0.033695 Aug 02 06:47:04.273449 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 153/361] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:47:04 2022] DELETE /compute/v2.1/flavors/1814726729 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:47:04.284901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-92739bb5-3331-46e9-8739-a80cbbe9ff08 tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:04.318663 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-92739bb5-3331-46e9-8739-a80cbbe9ff08 tempest-FlavorsAccessTestJSON-1489688484 tempest-FlavorsAccessTestJSON-1489688484-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.040996 Aug 02 06:47:04.319776 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 209/362] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:47:04 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:04.375429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f5b368ef-6bcb-458c-82e1-d8934d74628d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:04.376778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f5b368ef-6bcb-458c-82e1-d8934d74628d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:04.383963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5b368ef-6bcb-458c-82e1-d8934d74628d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:04.384747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5b368ef-6bcb-458c-82e1-d8934d74628d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:04.385673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5b368ef-6bcb-458c-82e1-d8934d74628d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:04.386308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5b368ef-6bcb-458c-82e1-d8934d74628d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:04.571589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-81281291-1441-4608-a8f9-6d32b34d228e tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:04.572417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-81281291-1441-4608-a8f9-6d32b34d228e tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:04.587252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81281291-1441-4608-a8f9-6d32b34d228e tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:04.589180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81281291-1441-4608-a8f9-6d32b34d228e tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:04.590180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81281291-1441-4608-a8f9-6d32b34d228e tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:04.590755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81281291-1441-4608-a8f9-6d32b34d228e tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:04.699159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f5b368ef-6bcb-458c-82e1-d8934d74628d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:04.707048 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f5b368ef-6bcb-458c-82e1-d8934d74628d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881" status: 200 len: 1313 microversion: 2.1 time: 0.335545 Aug 02 06:47:04.707942 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 154/363] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:04 2022] GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:04.738491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-02938ce8-acca-436b-8d60-588522a2e29a tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:04.740308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-02938ce8-acca-436b-8d60-588522a2e29a tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:04.750256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02938ce8-acca-436b-8d60-588522a2e29a tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:04.751216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02938ce8-acca-436b-8d60-588522a2e29a tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:04.754302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02938ce8-acca-436b-8d60-588522a2e29a tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:04.755024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02938ce8-acca-436b-8d60-588522a2e29a tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:04.879234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-02938ce8-acca-436b-8d60-588522a2e29a tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:04.889092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-02938ce8-acca-436b-8d60-588522a2e29a tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:04.891204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-02938ce8-acca-436b-8d60-588522a2e29a tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:04.897650 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-02938ce8-acca-436b-8d60-588522a2e29a tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.166702 Aug 02 06:47:04.898982 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 155/364] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:04 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:47:04.901765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-81281291-1441-4608-a8f9-6d32b34d228e tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:04.910102 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-81281291-1441-4608-a8f9-6d32b34d228e tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1319 microversion: 2.1 time: 0.348574 Aug 02 06:47:04.910680 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 210/365] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:04 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:47:05.111642 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-96aded6a-4d8f-44f0-9db2-69e5686d3ac4 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Calling method '.version_select at 0x7f927b84b670>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:05.114939 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:05.114939 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:05.117978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96aded6a-4d8f-44f0-9db2-69e5686d3ac4 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.120279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96aded6a-4d8f-44f0-9db2-69e5686d3ac4 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.139738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96aded6a-4d8f-44f0-9db2-69e5686d3ac4 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.140222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96aded6a-4d8f-44f0-9db2-69e5686d3ac4 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.146841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a03533d7-d62f-4d6d-a550-378a0a05ef1d tempest-AZAdminV2TestJSON-173391721 tempest-AZAdminV2TestJSON-173391721-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:05.148508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a03533d7-d62f-4d6d-a550-378a0a05ef1d tempest-AZAdminV2TestJSON-173391721 tempest-AZAdminV2TestJSON-173391721-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.149517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a03533d7-d62f-4d6d-a550-378a0a05ef1d tempest-AZAdminV2TestJSON-173391721 tempest-AZAdminV2TestJSON-173391721-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.150513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a03533d7-d62f-4d6d-a550-378a0a05ef1d tempest-AZAdminV2TestJSON-173391721 tempest-AZAdminV2TestJSON-173391721-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.151201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a03533d7-d62f-4d6d-a550-378a0a05ef1d tempest-AZAdminV2TestJSON-173391721 tempest-AZAdminV2TestJSON-173391721-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.151871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96aded6a-4d8f-44f0-9db2-69e5686d3ac4 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.152573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96aded6a-4d8f-44f0-9db2-69e5686d3ac4 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.165385 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-96aded6a-4d8f-44f0-9db2-69e5686d3ac4 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.204650 Aug 02 06:47:05.172669 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 211/366] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:47:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:05.174536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=13 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:05.210758 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a03533d7-d62f-4d6d-a550-378a0a05ef1d tempest-AZAdminV2TestJSON-173391721 tempest-AZAdminV2TestJSON-173391721-project-admin] 10.222.0.79 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.310359 Aug 02 06:47:05.211649 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 156/367] 10.222.0.79 () {58 vars in 1164 bytes} [Tue Aug 2 06:47:04 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:05.228014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6dd1b471-a1bc-482d-8e8e-0c0e218c9728 tempest-AZAdminV2TestJSON-173391721 tempest-AZAdminV2TestJSON-173391721-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:05.230444 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:05.230444 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:05.234116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6dd1b471-a1bc-482d-8e8e-0c0e218c9728 tempest-AZAdminV2TestJSON-173391721 tempest-AZAdminV2TestJSON-173391721-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.235783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6dd1b471-a1bc-482d-8e8e-0c0e218c9728 tempest-AZAdminV2TestJSON-173391721 tempest-AZAdminV2TestJSON-173391721-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.237786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6dd1b471-a1bc-482d-8e8e-0c0e218c9728 tempest-AZAdminV2TestJSON-173391721 tempest-AZAdminV2TestJSON-173391721-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.238454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6dd1b471-a1bc-482d-8e8e-0c0e218c9728 tempest-AZAdminV2TestJSON-173391721 tempest-AZAdminV2TestJSON-173391721-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.270874 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6dd1b471-a1bc-482d-8e8e-0c0e218c9728 tempest-AZAdminV2TestJSON-173391721 tempest-AZAdminV2TestJSON-173391721-project-admin] 10.222.0.79 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.049227 Aug 02 06:47:05.271880 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 157/368] 10.222.0.79 () {58 vars in 1185 bytes} [Tue Aug 2 06:47:05 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:05.399451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7133e316-a792-4bc3-8680-0c4f21623e31 tempest-HypervisorAdminNegativeUnderV252Test-682789220 tempest-HypervisorAdminNegativeUnderV252Test-682789220-project] Calling method '.version_select at 0x7f927b9abd30>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:05.401411 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:05.401411 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:05.403354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7133e316-a792-4bc3-8680-0c4f21623e31 tempest-HypervisorAdminNegativeUnderV252Test-682789220 tempest-HypervisorAdminNegativeUnderV252Test-682789220-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '30c71f2e5f1b4ecebf3efb9be5153966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf10d35894f442b80374b7c19a6f33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7133e316-a792-4bc3-8680-0c4f21623e31 tempest-HypervisorAdminNegativeUnderV252Test-682789220 tempest-HypervisorAdminNegativeUnderV252Test-682789220-project] Request method failure captured: Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hypervisors/n-h2-851337-3/search HTTP/1.1 Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MhnxTsq6oQBmo_TcZAMXwhfB3xyqCEqSBvZ4ZshtODud89XWKaXQ1QCazfuHRiZWoxEsj9-odi5BEixC09JKGviLiLl3yk3Dn0RXhESyWVlZiyY5Nrvpnx8MpvY0gc_iVubBYubY7fuToNr5chUUI39gHAT6WXedSayxy6QfDfqHZg Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 4cf10d35894f442b80374b7c19a6f33b Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-682789220 Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:47:05.407660 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:47:05.409120 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4cf10d35894f442b80374b7c19a6f33b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4cf10d35894f442b80374b7c19a6f33b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4cf10d35894f442b80374b7c19a6f33b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4cf10d35894f442b80374b7c19a6f33b"}]}] Aug 02 06:47:05.409120 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-682789220 Aug 02 06:47:05.409120 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 4cf10d35894f442b80374b7c19a6f33b Aug 02 06:47:05.409120 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-682789220 Aug 02 06:47:05.409120 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-682789220-project Aug 02 06:47:05.409120 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:47:05.409120 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:47:05.409120 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 30c71f2e5f1b4ecebf3efb9be5153966 Aug 02 06:47:05.409120 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-682789220-project Aug 02 06:47:05.409120 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:47:05.409120 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 02 06:47:05.409120 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'n-h2-851337-3'} Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:47:05.409877 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 02 06:47:05.411240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:05.414052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7133e316-a792-4bc3-8680-0c4f21623e31 tempest-HypervisorAdminNegativeUnderV252Test-682789220 tempest-HypervisorAdminNegativeUnderV252Test-682789220-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:05.423723 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7133e316-a792-4bc3-8680-0c4f21623e31 tempest-HypervisorAdminNegativeUnderV252Test-682789220 tempest-HypervisorAdminNegativeUnderV252Test-682789220-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/n-h2-851337-3/search" status: 403 len: 117 microversion: 2.1 time: 0.241490 Aug 02 06:47:05.424307 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 212/369] 10.222.0.79 () {58 vars in 1209 bytes} [Tue Aug 2 06:47:05 2022] GET /compute/v2.1/os-hypervisors/n-h2-851337-3/search => generated 117 bytes in 251 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:47:05.433320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-22cd536d-10fc-407c-ba15-75a98efa9b0e tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Calling method '.version_select at 0x7f927bac1040>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:05.434287 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:05.434287 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:05.435561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22cd536d-10fc-407c-ba15-75a98efa9b0e tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.436004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22cd536d-10fc-407c-ba15-75a98efa9b0e tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.451242 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-22cd536d-10fc-407c-ba15-75a98efa9b0e tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-22cd536d-10fc-407c-ba15-75a98efa9b0e tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Request method failure captured: Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MhoPbLgU-zU9Ag1Fe9LY0Efkmp1nYha_s-JglAMgEuj8iNVD6KgrSenozbL783h47ESrRJ40RhRpDAOMz2aoJeOo2dbmd2plm-SyZSkK7OuNskzsdtCIjFxXU1nZi9mUiMLNYjM7EwXq-aIUYG6jBXKYms_lgrqhrtB_Kr5M_OH0rE Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: be19c45a685b4109892e545fb05c8edf Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2112391357 Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:47:05.453352 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:47:05.454696 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/be19c45a685b4109892e545fb05c8edf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be19c45a685b4109892e545fb05c8edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_be19c45a685b4109892e545fb05c8edf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be19c45a685b4109892e545fb05c8edf"}]}] Aug 02 06:47:05.454696 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2112391357 Aug 02 06:47:05.454696 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: be19c45a685b4109892e545fb05c8edf Aug 02 06:47:05.454696 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2112391357 Aug 02 06:47:05.454696 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin Aug 02 06:47:05.454696 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:47:05.454696 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:47:05.454696 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 8774e1b066264c1b88b6e6f79c388d09 Aug 02 06:47:05.454696 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin Aug 02 06:47:05.454696 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:47:05.454696 n-d-851337-3 devstack@n-api.service[126119]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 02 06:47:05.454696 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:05.455418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:05.456725 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:05.456725 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:05.456725 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:05.456725 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 02 06:47:05.456725 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:05.458111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-22cd536d-10fc-407c-ba15-75a98efa9b0e tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:05.458973 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-22cd536d-10fc-407c-ba15-75a98efa9b0e tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.029519 Aug 02 06:47:05.459531 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 158/370] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Aug 2 06:47:05 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:47:05.469298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-52b521ae-0607-48ab-9152-e9eed1a341e6 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Calling method '.version_select at 0x7f927b8b9d30>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:05.470481 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:05.470481 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:05.472924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52b521ae-0607-48ab-9152-e9eed1a341e6 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.473588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52b521ae-0607-48ab-9152-e9eed1a341e6 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.494355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52b521ae-0607-48ab-9152-e9eed1a341e6 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.495268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52b521ae-0607-48ab-9152-e9eed1a341e6 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.506560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52b521ae-0607-48ab-9152-e9eed1a341e6 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.507239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52b521ae-0607-48ab-9152-e9eed1a341e6 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.517231 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-52b521ae-0607-48ab-9152-e9eed1a341e6 tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.049403 Aug 02 06:47:05.519146 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 213/371] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:47:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:47:05.529720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9050161d-4cd9-47b8-bbcb-e0b09355dd1d tempest-HypervisorAdminNegativeUnderV252Test-682789220 tempest-HypervisorAdminNegativeUnderV252Test-682789220-project] Calling method '.version_select at 0x7f927bac1670>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:05.530613 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:05.530613 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:05.531735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9050161d-4cd9-47b8-bbcb-e0b09355dd1d tempest-HypervisorAdminNegativeUnderV252Test-682789220 tempest-HypervisorAdminNegativeUnderV252Test-682789220-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '30c71f2e5f1b4ecebf3efb9be5153966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf10d35894f442b80374b7c19a6f33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9050161d-4cd9-47b8-bbcb-e0b09355dd1d tempest-HypervisorAdminNegativeUnderV252Test-682789220 tempest-HypervisorAdminNegativeUnderV252Test-682789220-project] Request method failure captured: Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MhnxTsq6oQBmo_TcZAMXwhfB3xyqCEqSBvZ4ZshtODud89XWKaXQ1QCazfuHRiZWoxEsj9-odi5BEixC09JKGviLiLl3yk3Dn0RXhESyWVlZiyY5Nrvpnx8MpvY0gc_iVubBYubY7fuToNr5chUUI39gHAT6WXedSayxy6QfDfqHZg Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 4cf10d35894f442b80374b7c19a6f33b Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-682789220 Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:47:05.533328 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:47:05.534717 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4cf10d35894f442b80374b7c19a6f33b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4cf10d35894f442b80374b7c19a6f33b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4cf10d35894f442b80374b7c19a6f33b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4cf10d35894f442b80374b7c19a6f33b"}]}] Aug 02 06:47:05.534717 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-682789220 Aug 02 06:47:05.534717 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 4cf10d35894f442b80374b7c19a6f33b Aug 02 06:47:05.534717 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-682789220 Aug 02 06:47:05.534717 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-682789220-project Aug 02 06:47:05.534717 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:47:05.534717 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:47:05.534717 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 30c71f2e5f1b4ecebf3efb9be5153966 Aug 02 06:47:05.534717 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-682789220-project Aug 02 06:47:05.534717 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:47:05.534717 n-d-851337-3 devstack@n-api.service[126119]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 02 06:47:05.534717 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1'} Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:47:05.535532 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 02 06:47:05.536542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:05.537528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9050161d-4cd9-47b8-bbcb-e0b09355dd1d tempest-HypervisorAdminNegativeUnderV252Test-682789220 tempest-HypervisorAdminNegativeUnderV252Test-682789220-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:05.537528 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9050161d-4cd9-47b8-bbcb-e0b09355dd1d tempest-HypervisorAdminNegativeUnderV252Test-682789220 tempest-HypervisorAdminNegativeUnderV252Test-682789220-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.008809 Aug 02 06:47:05.539123 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 159/372] 10.222.0.79 () {58 vars in 1176 bytes} [Tue Aug 2 06:47:05 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:47:05.545805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1557cca0-dc26-4c33-85f6-3c13daf3b57f tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Calling method '.version_select at 0x7f927b8ad160>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:05.546625 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:05.546625 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:05.547862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1557cca0-dc26-4c33-85f6-3c13daf3b57f tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.548340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1557cca0-dc26-4c33-85f6-3c13daf3b57f tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.561906 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-1557cca0-dc26-4c33-85f6-3c13daf3b57f tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] HTTP exception thrown: No hypervisor matching 'd46658b8-ea31-4ae3-b0d8-c3226df19f4e' could be found. Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1557cca0-dc26-4c33-85f6-3c13daf3b57f tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Request method failure captured: Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hypervisors/d46658b8-ea31-4ae3-b0d8-c3226df19f4e/servers HTTP/1.1 Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MhoPbLgU-zU9Ag1Fe9LY0Efkmp1nYha_s-JglAMgEuj8iNVD6KgrSenozbL783h47ESrRJ40RhRpDAOMz2aoJeOo2dbmd2plm-SyZSkK7OuNskzsdtCIjFxXU1nZi9mUiMLNYjM7EwXq-aIUYG6jBXKYms_lgrqhrtB_Kr5M_OH0rE Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: be19c45a685b4109892e545fb05c8edf Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2112391357 Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:47:05.563366 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:47:05.564716 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/be19c45a685b4109892e545fb05c8edf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be19c45a685b4109892e545fb05c8edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_be19c45a685b4109892e545fb05c8edf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/be19c45a685b4109892e545fb05c8edf"}]}] Aug 02 06:47:05.564716 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2112391357 Aug 02 06:47:05.564716 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: be19c45a685b4109892e545fb05c8edf Aug 02 06:47:05.564716 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2112391357 Aug 02 06:47:05.564716 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin Aug 02 06:47:05.564716 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:47:05.564716 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:47:05.564716 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 8774e1b066264c1b88b6e6f79c388d09 Aug 02 06:47:05.564716 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin Aug 02 06:47:05.564716 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:47:05.564716 n-d-851337-3 devstack@n-api.service[126120]: exception: No hypervisor matching 'd46658b8-ea31-4ae3-b0d8-c3226df19f4e' could be found. Aug 02 06:47:05.564716 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'd46658b8-ea31-4ae3-b0d8-c3226df19f4e'} Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'd46658b8-ea31-4ae3-b0d8-c3226df19f4e' could be found. Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:05.565534 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:05.567005 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:05.567005 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:05.567005 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:05.567005 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:05.567005 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'd46658b8-ea31-4ae3-b0d8-c3226df19f4e' could be found. Aug 02 06:47:05.567005 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:05.567005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1557cca0-dc26-4c33-85f6-3c13daf3b57f tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] Returning 404 to user: No hypervisor matching 'd46658b8-ea31-4ae3-b0d8-c3226df19f4e' could be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:05.567005 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1557cca0-dc26-4c33-85f6-3c13daf3b57f tempest-HypervisorAdminNegativeUnderV252Test-2112391357 tempest-HypervisorAdminNegativeUnderV252Test-2112391357-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/d46658b8-ea31-4ae3-b0d8-c3226df19f4e/servers" status: 404 len: 123 microversion: 2.1 time: 0.024477 Aug 02 06:47:05.569986 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 214/373] 10.222.0.79 () {58 vars in 1281 bytes} [Tue Aug 2 06:47:05 2022] GET /compute/v2.1/os-hypervisors/d46658b8-ea31-4ae3-b0d8-c3226df19f4e/servers => generated 123 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:47:05.729328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0c013c8c-f747-4749-818a-be41812daa32 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:05.730356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0c013c8c-f747-4749-818a-be41812daa32 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:05.738011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c013c8c-f747-4749-818a-be41812daa32 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.738452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c013c8c-f747-4749-818a-be41812daa32 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.739221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c013c8c-f747-4749-818a-be41812daa32 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.739650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c013c8c-f747-4749-818a-be41812daa32 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.744105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:05.861790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-4af26512-5cbb-4c1d-92bc-c61a1651f608 req-6e3a54f4-0a60-4f85-8d8e-dcd344ce3197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15cdb0c-fc57-4d57-b011-5f7d2a604172", "name": "network-vif-plugged", "status": "completed", "tag": "4eb2dde0-527a-42dc-9d97-f64be5223fa2"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:05.874875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4af26512-5cbb-4c1d-92bc-c61a1651f608 req-6e3a54f4-0a60-4f85-8d8e-dcd344ce3197 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.875485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4af26512-5cbb-4c1d-92bc-c61a1651f608 req-6e3a54f4-0a60-4f85-8d8e-dcd344ce3197 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.882479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:05.891602 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-4af26512-5cbb-4c1d-92bc-c61a1651f608 req-6e3a54f4-0a60-4f85-8d8e-dcd344ce3197 service nova] Creating event network-vif-plugged:4eb2dde0-527a-42dc-9d97-f64be5223fa2 for instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 on n-h1-851337-3 Aug 02 06:47:05.897856 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-4af26512-5cbb-4c1d-92bc-c61a1651f608 req-6e3a54f4-0a60-4f85-8d8e-dcd344ce3197 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040338 Aug 02 06:47:05.899255 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 215/374] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:47:05.928201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-71c90b3a-bfd8-41bc-a153-00be68d9e514 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:05.930683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-71c90b3a-bfd8-41bc-a153-00be68d9e514 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:05.943052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0c013c8c-f747-4749-818a-be41812daa32 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:05.950838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71c90b3a-bfd8-41bc-a153-00be68d9e514 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.951874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71c90b3a-bfd8-41bc-a153-00be68d9e514 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.954487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71c90b3a-bfd8-41bc-a153-00be68d9e514 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.956883 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0c013c8c-f747-4749-818a-be41812daa32 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881" status: 200 len: 1313 microversion: 2.1 time: 0.232562 Aug 02 06:47:05.959594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71c90b3a-bfd8-41bc-a153-00be68d9e514 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.972418 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 160/375] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:05 2022] GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:05.978476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bef786db-d012-40c5-84e3-df5021a5bff4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:05.979384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bef786db-d012-40c5-84e3-df5021a5bff4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:05.989268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bef786db-d012-40c5-84e3-df5021a5bff4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.990130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bef786db-d012-40c5-84e3-df5021a5bff4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:05.991093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bef786db-d012-40c5-84e3-df5021a5bff4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:05.991679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bef786db-d012-40c5-84e3-df5021a5bff4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:06.204109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-71c90b3a-bfd8-41bc-a153-00be68d9e514 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:06.214877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-71c90b3a-bfd8-41bc-a153-00be68d9e514 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:06.223688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-71c90b3a-bfd8-41bc-a153-00be68d9e514 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:06.240955 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-71c90b3a-bfd8-41bc-a153-00be68d9e514 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.320563 Aug 02 06:47:06.242139 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 216/376] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:05 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:47:06.442716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bef786db-d012-40c5-84e3-df5021a5bff4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:06.456198 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bef786db-d012-40c5-84e3-df5021a5bff4 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1319 microversion: 2.1 time: 0.481562 Aug 02 06:47:06.459322 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 161/377] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:05 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:06.982040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-59fd1448-a08c-49cc-b317-923409cfac59 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:06.983323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-59fd1448-a08c-49cc-b317-923409cfac59 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:06.994797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-59fd1448-a08c-49cc-b317-923409cfac59 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:06.995328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-59fd1448-a08c-49cc-b317-923409cfac59 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:06.998116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-59fd1448-a08c-49cc-b317-923409cfac59 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:06.998770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-59fd1448-a08c-49cc-b317-923409cfac59 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:07.167447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-59fd1448-a08c-49cc-b317-923409cfac59 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:07.178067 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-59fd1448-a08c-49cc-b317-923409cfac59 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881" status: 200 len: 1313 microversion: 2.1 time: 0.203484 Aug 02 06:47:07.193301 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 217/378] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:06 2022] GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:07.273339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2b940f6d-9fd3-4b01-851a-b2345f4d7cde tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:07.274914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2b940f6d-9fd3-4b01-851a-b2345f4d7cde tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:07.286939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b940f6d-9fd3-4b01-851a-b2345f4d7cde tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:07.287661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b940f6d-9fd3-4b01-851a-b2345f4d7cde tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:07.288923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b940f6d-9fd3-4b01-851a-b2345f4d7cde tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:07.289769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b940f6d-9fd3-4b01-851a-b2345f4d7cde tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:07.363536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2b940f6d-9fd3-4b01-851a-b2345f4d7cde tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:07.372413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2b940f6d-9fd3-4b01-851a-b2345f4d7cde tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:07.375517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2b940f6d-9fd3-4b01-851a-b2345f4d7cde tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:07.381341 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2b940f6d-9fd3-4b01-851a-b2345f4d7cde tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.115107 Aug 02 06:47:07.381920 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 162/379] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:07 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:47:07.477768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3918587e-3cff-42fd-8d86-8064aeab2e9f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:07.478435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3918587e-3cff-42fd-8d86-8064aeab2e9f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:07.487676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3918587e-3cff-42fd-8d86-8064aeab2e9f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:07.492426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3918587e-3cff-42fd-8d86-8064aeab2e9f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:07.493482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3918587e-3cff-42fd-8d86-8064aeab2e9f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:07.494097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3918587e-3cff-42fd-8d86-8064aeab2e9f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:07.723920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3918587e-3cff-42fd-8d86-8064aeab2e9f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:07.734720 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3918587e-3cff-42fd-8d86-8064aeab2e9f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1319 microversion: 2.1 time: 0.261167 Aug 02 06:47:07.737171 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 218/380] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:07 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:08.158292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ade0d6d0-aa36-491b-a0c1-98e746736ad9 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Calling method '.version_select at 0x7f927ba39ca0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:08.159631 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:08.159631 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:08.160958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ade0d6d0-aa36-491b-a0c1-98e746736ad9 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.161643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ade0d6d0-aa36-491b-a0c1-98e746736ad9 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.190889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ade0d6d0-aa36-491b-a0c1-98e746736ad9 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.191322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ade0d6d0-aa36-491b-a0c1-98e746736ad9 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.206263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fdd9dd08-cbe3-4744-88d5-14bc78cfda18 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:08.209598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fdd9dd08-cbe3-4744-88d5-14bc78cfda18 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:08.219245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ade0d6d0-aa36-491b-a0c1-98e746736ad9 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.219711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ade0d6d0-aa36-491b-a0c1-98e746736ad9 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.221289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fdd9dd08-cbe3-4744-88d5-14bc78cfda18 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.222342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fdd9dd08-cbe3-4744-88d5-14bc78cfda18 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.223759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fdd9dd08-cbe3-4744-88d5-14bc78cfda18 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.224278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fdd9dd08-cbe3-4744-88d5-14bc78cfda18 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.238411 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ade0d6d0-aa36-491b-a0c1-98e746736ad9 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.520307 Aug 02 06:47:08.245498 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 163/381] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:47:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:08.251311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4a6d20e2-2507-428d-b283-8373cfb0659e tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Calling method '.version_select at 0x7f927babf310>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:08.252341 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:08.252341 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:08.253778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a6d20e2-2507-428d-b283-8373cfb0659e tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.254303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a6d20e2-2507-428d-b283-8373cfb0659e tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.281930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a6d20e2-2507-428d-b283-8373cfb0659e tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.282339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a6d20e2-2507-428d-b283-8373cfb0659e tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.312353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a6d20e2-2507-428d-b283-8373cfb0659e tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.313096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a6d20e2-2507-428d-b283-8373cfb0659e tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.320077 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4a6d20e2-2507-428d-b283-8373cfb0659e tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/n-h2-851337-3/servers" status: 200 len: 433 microversion: 2.1 time: 0.073039 Aug 02 06:47:08.321142 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 164/382] 10.222.0.79 () {58 vars in 1212 bytes} [Tue Aug 2 06:47:08 2022] GET /compute/v2.1/os-hypervisors/n-h2-851337-3/servers => generated 433 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:08.340329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-06bc0485-c3b1-4e2c-867d-e7963f91ccd7 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Calling method '.version_select at 0x7f927ba399d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:08.341126 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:08.341126 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:08.342302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06bc0485-c3b1-4e2c-867d-e7963f91ccd7 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.342738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06bc0485-c3b1-4e2c-867d-e7963f91ccd7 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.356562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06bc0485-c3b1-4e2c-867d-e7963f91ccd7 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.357034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06bc0485-c3b1-4e2c-867d-e7963f91ccd7 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.368731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06bc0485-c3b1-4e2c-867d-e7963f91ccd7 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.369479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06bc0485-c3b1-4e2c-867d-e7963f91ccd7 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.376263 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-06bc0485-c3b1-4e2c-867d-e7963f91ccd7 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.045708 Aug 02 06:47:08.376996 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 165/383] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:47:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:08.389664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cc704ad5-fe2c-424e-8ad0-47630824f628 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Calling method '.version_select at 0x7f927ba39a60>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:08.390887 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:08.390887 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:08.392416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc704ad5-fe2c-424e-8ad0-47630824f628 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.393794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc704ad5-fe2c-424e-8ad0-47630824f628 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.409259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fdd9dd08-cbe3-4744-88d5-14bc78cfda18 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:08.409865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc704ad5-fe2c-424e-8ad0-47630824f628 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.410998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc704ad5-fe2c-424e-8ad0-47630824f628 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.418850 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fdd9dd08-cbe3-4744-88d5-14bc78cfda18 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881" status: 200 len: 1313 microversion: 2.1 time: 0.221060 Aug 02 06:47:08.419323 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cc704ad5-fe2c-424e-8ad0-47630824f628 tempest-HypervisorAdminUnderV252Test-1949106027 tempest-HypervisorAdminUnderV252Test-1949106027-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/n-h2-851337-3/search" status: 200 len: 104 microversion: 2.1 time: 0.035310 Aug 02 06:47:08.420364 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 166/384] 10.222.0.79 () {58 vars in 1209 bytes} [Tue Aug 2 06:47:08 2022] GET /compute/v2.1/os-hypervisors/n-h2-851337-3/search => generated 104 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:47:08.425828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-afac2f87-d7f2-4ac9-b920-ab543a418fdc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:08.426615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-afac2f87-d7f2-4ac9-b920-ab543a418fdc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:08.431271 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 219/385] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:08 2022] GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:08.435097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-afac2f87-d7f2-4ac9-b920-ab543a418fdc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.435897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-afac2f87-d7f2-4ac9-b920-ab543a418fdc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.436805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-afac2f87-d7f2-4ac9-b920-ab543a418fdc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.437684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-afac2f87-d7f2-4ac9-b920-ab543a418fdc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.522054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-afac2f87-d7f2-4ac9-b920-ab543a418fdc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:08.531110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-afac2f87-d7f2-4ac9-b920-ab543a418fdc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:08.533070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-afac2f87-d7f2-4ac9-b920-ab543a418fdc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:08.539237 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-afac2f87-d7f2-4ac9-b920-ab543a418fdc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.116746 Aug 02 06:47:08.540554 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 167/386] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:08 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:08.756845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-12560aca-dbbd-4869-ae76-fa3364bb655c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:08.757293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-12560aca-dbbd-4869-ae76-fa3364bb655c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:08.764795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12560aca-dbbd-4869-ae76-fa3364bb655c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.765533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12560aca-dbbd-4869-ae76-fa3364bb655c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.766584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12560aca-dbbd-4869-ae76-fa3364bb655c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.767347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12560aca-dbbd-4869-ae76-fa3364bb655c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.948537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-12560aca-dbbd-4869-ae76-fa3364bb655c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:08.956991 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-12560aca-dbbd-4869-ae76-fa3364bb655c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1469 microversion: 2.1 time: 0.204611 Aug 02 06:47:08.971009 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 220/387] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:08 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:08.978569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-346a64c7-5617-40a8-b651-274d9aab963e tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:08.981089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-346a64c7-5617-40a8-b651-274d9aab963e tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:08.988793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-346a64c7-5617-40a8-b651-274d9aab963e tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.989302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-346a64c7-5617-40a8-b651-274d9aab963e tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:08.990329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-346a64c7-5617-40a8-b651-274d9aab963e tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:08.990997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-346a64c7-5617-40a8-b651-274d9aab963e tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:09.160746 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-346a64c7-5617-40a8-b651-274d9aab963e tempest-DeleteServersAdminTestJSON-1498784933 tempest-DeleteServersAdminTestJSON-1498784933-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172/action" status: 202 len: 0 microversion: 2.1 time: 0.185656 Aug 02 06:47:09.161836 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 168/388] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:47:08 2022] POST /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:47:09.170606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-14f3f844-5138-4049-a336-0d12993a6251 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:09.171220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-14f3f844-5138-4049-a336-0d12993a6251 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:09.177709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14f3f844-5138-4049-a336-0d12993a6251 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:09.178204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14f3f844-5138-4049-a336-0d12993a6251 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:09.179275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14f3f844-5138-4049-a336-0d12993a6251 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:09.179680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14f3f844-5138-4049-a336-0d12993a6251 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:09.223073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14f3f844-5138-4049-a336-0d12993a6251 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:09.224122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14f3f844-5138-4049-a336-0d12993a6251 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:09.224801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-14f3f844-5138-4049-a336-0d12993a6251 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lazy-loading 'fault' on Instance uuid a15cdb0c-fc57-4d57-b011-5f7d2a604172 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:09.412275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-14f3f844-5138-4049-a336-0d12993a6251 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:09.422568 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-14f3f844-5138-4049-a336-0d12993a6251 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1452 microversion: 2.1 time: 0.255839 Aug 02 06:47:09.438185 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 221/389] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:09 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1452 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:09.443116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-be382822-8ac6-423e-b489-cd7b0d15bfb5 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:09.443620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-be382822-8ac6-423e-b489-cd7b0d15bfb5 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:09.457660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fe223611-ddf9-4a2b-a01d-e72ac68762d7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:09.458456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fe223611-ddf9-4a2b-a01d-e72ac68762d7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:09.460558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be382822-8ac6-423e-b489-cd7b0d15bfb5 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:09.461008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be382822-8ac6-423e-b489-cd7b0d15bfb5 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:09.461794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be382822-8ac6-423e-b489-cd7b0d15bfb5 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:09.462272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be382822-8ac6-423e-b489-cd7b0d15bfb5 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:09.466339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe223611-ddf9-4a2b-a01d-e72ac68762d7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:09.467355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe223611-ddf9-4a2b-a01d-e72ac68762d7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:09.468404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe223611-ddf9-4a2b-a01d-e72ac68762d7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:09.470915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe223611-ddf9-4a2b-a01d-e72ac68762d7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:09.513247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-be382822-8ac6-423e-b489-cd7b0d15bfb5 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:47:09.660243 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-be382822-8ac6-423e-b489-cd7b0d15bfb5 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 204 len: 0 microversion: 2.1 time: 0.220113 Aug 02 06:47:09.664450 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 169/390] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:47:09 2022] DELETE /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:47:09.670096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-59567ab3-edb2-403d-8fa4-ea445a001860 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:09.670839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-59567ab3-edb2-403d-8fa4-ea445a001860 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:09.674296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fe223611-ddf9-4a2b-a01d-e72ac68762d7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:09.684398 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fe223611-ddf9-4a2b-a01d-e72ac68762d7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881" status: 200 len: 1313 microversion: 2.1 time: 0.238849 Aug 02 06:47:09.685002 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 222/391] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:09 2022] GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:09.689619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59567ab3-edb2-403d-8fa4-ea445a001860 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:09.690114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59567ab3-edb2-403d-8fa4-ea445a001860 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:09.693637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-82f249f9-bc45-4c66-aba5-9f6307993710 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:09.694658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59567ab3-edb2-403d-8fa4-ea445a001860 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:09.695441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-82f249f9-bc45-4c66-aba5-9f6307993710 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:09.699019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59567ab3-edb2-403d-8fa4-ea445a001860 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:09.708135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82f249f9-bc45-4c66-aba5-9f6307993710 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:09.708985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82f249f9-bc45-4c66-aba5-9f6307993710 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:09.710146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82f249f9-bc45-4c66-aba5-9f6307993710 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:09.710772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82f249f9-bc45-4c66-aba5-9f6307993710 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:09.755133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82f249f9-bc45-4c66-aba5-9f6307993710 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:09.755883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82f249f9-bc45-4c66-aba5-9f6307993710 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:09.756846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-82f249f9-bc45-4c66-aba5-9f6307993710 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lazy-loading 'fault' on Instance uuid a15cdb0c-fc57-4d57-b011-5f7d2a604172 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:09.777596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-59567ab3-edb2-403d-8fa4-ea445a001860 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:09.787814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-59567ab3-edb2-403d-8fa4-ea445a001860 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:09.794178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-59567ab3-edb2-403d-8fa4-ea445a001860 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:09.800184 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-59567ab3-edb2-403d-8fa4-ea445a001860 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.134381 Aug 02 06:47:09.800793 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 170/392] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:09 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:09.921583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-82f249f9-bc45-4c66-aba5-9f6307993710 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:09.931324 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-82f249f9-bc45-4c66-aba5-9f6307993710 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1458 microversion: 2.1 time: 0.243607 Aug 02 06:47:09.942953 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 223/393] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:09 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1458 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:10.041048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7ac6f83b-2e94-44f7-80c5-ce60b4213421 req-b95ab60d-c344-4775-8ff3-7e0d3d33f57b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffeec79d-f13b-43f6-8da2-70944a5ed881", "name": "network-vif-plugged", "status": "completed", "tag": "9335a2d8-f37b-4e9e-91fb-01c497886dd6"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:10.059834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=16 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:10.064215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7ac6f83b-2e94-44f7-80c5-ce60b4213421 req-b95ab60d-c344-4775-8ff3-7e0d3d33f57b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:10.064647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7ac6f83b-2e94-44f7-80c5-ce60b4213421 req-b95ab60d-c344-4775-8ff3-7e0d3d33f57b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:10.085475 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7ac6f83b-2e94-44f7-80c5-ce60b4213421 req-b95ab60d-c344-4775-8ff3-7e0d3d33f57b service nova] Creating event network-vif-plugged:9335a2d8-f37b-4e9e-91fb-01c497886dd6 for instance ffeec79d-f13b-43f6-8da2-70944a5ed881 on n-h2-851337-3 Aug 02 06:47:10.092998 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7ac6f83b-2e94-44f7-80c5-ce60b4213421 req-b95ab60d-c344-4775-8ff3-7e0d3d33f57b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055565 Aug 02 06:47:10.093599 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 224/394] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:47:10.232722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-11a86e20-df59-4129-893d-41d599712fb2 tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1988993588", "ram": 512, "vcpus": 1, "disk": 10, "id": 1835934398, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:10.235989 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:10.235989 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:10.257582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:10.269804 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-11a86e20-df59-4129-893d-41d599712fb2 tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.467885 Aug 02 06:47:10.279740 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 171/395] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:47:09 2022] POST /compute/v2.1/flavors => generated 416 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:10.281303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:10.286556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f1531e4d-1ba1-48f3-96ea-b062caebe7e1 tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:10.289275 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:10.289275 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:10.356869 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f1531e4d-1ba1-48f3-96ea-b062caebe7e1 tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1835934398/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.076755 Aug 02 06:47:10.359277 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 225/396] 10.222.0.79 () {60 vars in 1224 bytes} [Tue Aug 2 06:47:10 2022] POST /compute/v2.1/flavors/1835934398/os-extra_specs => generated 66 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:10.648957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ac71ab89-73d8-4de0-b3ac-ecd38850d242 tempest-FlavorsExtraSpecsTestJSON-2127518919 tempest-FlavorsExtraSpecsTestJSON-2127518919-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:10.666390 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ac71ab89-73d8-4de0-b3ac-ecd38850d242 tempest-FlavorsExtraSpecsTestJSON-2127518919 tempest-FlavorsExtraSpecsTestJSON-2127518919-project] 10.222.0.79 "GET /compute/v2.1/flavors/1835934398/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.294999 Aug 02 06:47:10.666390 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 172/397] 10.222.0.79 () {58 vars in 1203 bytes} [Tue Aug 2 06:47:10 2022] GET /compute/v2.1/flavors/1835934398/os-extra_specs => generated 66 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:10.675394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7435b91d-a25f-4cf7-b8fc-b78ca03d41e5 tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:10.704623 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7435b91d-a25f-4cf7-b8fc-b78ca03d41e5 tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1835934398/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032357 Aug 02 06:47:10.705842 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 226/398] 10.222.0.79 () {60 vars in 1224 bytes} [Tue Aug 2 06:47:10 2022] POST /compute/v2.1/flavors/1835934398/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:10.715822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4cfb15e2-ad52-4c38-af1f-722ce46bb6a1 tempest-FlavorsExtraSpecsTestJSON-2127518919 tempest-FlavorsExtraSpecsTestJSON-2127518919-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:10.726753 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4cfb15e2-ad52-4c38-af1f-722ce46bb6a1 tempest-FlavorsExtraSpecsTestJSON-2127518919 tempest-FlavorsExtraSpecsTestJSON-2127518919-project] 10.222.0.79 "GET /compute/v2.1/flavors/1835934398/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.014784 Aug 02 06:47:10.727994 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 227/399] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 06:47:10 2022] GET /compute/v2.1/flavors/1835934398/os-extra_specs/hw:numa_nodes => generated 22 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:10.734089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5cccdc95-89ae-43f7-a51c-ab7685afaa6c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:10.736356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5cccdc95-89ae-43f7-a51c-ab7685afaa6c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:10.739346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-25f81ff0-7ae2-486f-9f06-1e49e7495cff tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:10.744288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cccdc95-89ae-43f7-a51c-ab7685afaa6c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:10.744877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cccdc95-89ae-43f7-a51c-ab7685afaa6c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:10.745746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cccdc95-89ae-43f7-a51c-ab7685afaa6c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:10.746582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cccdc95-89ae-43f7-a51c-ab7685afaa6c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:10.769021 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-25f81ff0-7ae2-486f-9f06-1e49e7495cff tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1835934398/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034549 Aug 02 06:47:10.770196 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 228/400] 10.222.0.79 () {60 vars in 1224 bytes} [Tue Aug 2 06:47:10 2022] POST /compute/v2.1/flavors/1835934398/os-extra_specs => generated 66 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:10.793989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d1f97d67-788e-45c0-9439-7b3b7bb2ddcf tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:10.809703 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d1f97d67-788e-45c0-9439-7b3b7bb2ddcf tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/1835934398/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033374 Aug 02 06:47:10.816263 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 229/401] 10.222.0.79 () {58 vars in 1203 bytes} [Tue Aug 2 06:47:10 2022] GET /compute/v2.1/flavors/1835934398/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 06:47:10.822685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a9295117-fb83-4891-9ede-462f6250891e tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:10.826001 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:10.826001 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:10.838844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:SAVEPOINT=6,nova_api:RELEASE=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:10.867154 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a9295117-fb83-4891-9ede-462f6250891e tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/1835934398/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.049482 Aug 02 06:47:10.870060 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 230/402] 10.222.0.79 () {60 vars in 1265 bytes} [Tue Aug 2 06:47:10 2022] PUT /compute/v2.1/flavors/1835934398/os-extra_specs/hw:numa_nodes => generated 22 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:10.876849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-14fbbb45-70b7-492c-a1ed-975a82390e60 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:10.877623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-14fbbb45-70b7-492c-a1ed-975a82390e60 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:10.885449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14fbbb45-70b7-492c-a1ed-975a82390e60 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:10.886170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14fbbb45-70b7-492c-a1ed-975a82390e60 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:10.887249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14fbbb45-70b7-492c-a1ed-975a82390e60 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:10.887679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14fbbb45-70b7-492c-a1ed-975a82390e60 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:11.008580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-14fbbb45-70b7-492c-a1ed-975a82390e60 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:11.019765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-14fbbb45-70b7-492c-a1ed-975a82390e60 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:11.021414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-14fbbb45-70b7-492c-a1ed-975a82390e60 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:11.027787 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-14fbbb45-70b7-492c-a1ed-975a82390e60 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.156587 Aug 02 06:47:11.029074 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 231/403] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:10 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:11.034870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-90fa1ad6-f214-47bb-92f9-27dbf0c2b13a tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:11.043855 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-90fa1ad6-f214-47bb-92f9-27dbf0c2b13a tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/1835934398/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013470 Aug 02 06:47:11.044878 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 232/404] 10.222.0.79 () {58 vars in 1203 bytes} [Tue Aug 2 06:47:11 2022] GET /compute/v2.1/flavors/1835934398/os-extra_specs => generated 66 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:11.053264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4692926b-b3fc-4c2f-8ce9-c78d7ce9cdb2 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:11.054141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4692926b-b3fc-4c2f-8ce9-c78d7ce9cdb2 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:11.060534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4692926b-b3fc-4c2f-8ce9-c78d7ce9cdb2 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:11.061155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4692926b-b3fc-4c2f-8ce9-c78d7ce9cdb2 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:11.062129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4692926b-b3fc-4c2f-8ce9-c78d7ce9cdb2 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:11.062711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4692926b-b3fc-4c2f-8ce9-c78d7ce9cdb2 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:11.099834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4692926b-b3fc-4c2f-8ce9-c78d7ce9cdb2 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:11.100487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4692926b-b3fc-4c2f-8ce9-c78d7ce9cdb2 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:11.101129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-4692926b-b3fc-4c2f-8ce9-c78d7ce9cdb2 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lazy-loading 'fault' on Instance uuid a15cdb0c-fc57-4d57-b011-5f7d2a604172 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:11.111209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5cccdc95-89ae-43f7-a51c-ab7685afaa6c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:11.123526 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5cccdc95-89ae-43f7-a51c-ab7685afaa6c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881" status: 200 len: 1313 microversion: 2.1 time: 0.410316 Aug 02 06:47:11.138237 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 173/405] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:10 2022] GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:11.144543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2fc9c84e-b54c-4ef0-8aa0-316ae135265a tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:11.145543 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:11.145543 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:11.182946 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2fc9c84e-b54c-4ef0-8aa0-316ae135265a tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1835934398/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.043021 Aug 02 06:47:11.187302 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 174/406] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 06:47:11 2022] DELETE /compute/v2.1/flavors/1835934398/os-extra_specs/hw:numa_nodes => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:47:11.194291 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9bd86cb3-96ab-4d78-8133-10d40d5cecf5 tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:11.223964 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9bd86cb3-96ab-4d78-8133-10d40d5cecf5 tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1835934398/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.034716 Aug 02 06:47:11.228625 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 175/407] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 06:47:11 2022] DELETE /compute/v2.1/flavors/1835934398/os-extra_specs/hw:cpu_policy => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 06:47:11.236404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f06e1cd5-6cc5-476f-ae2c-5aa67f20dcd0 tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:11.248726 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f06e1cd5-6cc5-476f-ae2c-5aa67f20dcd0 tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/1835934398/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018321 Aug 02 06:47:11.256090 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 176/408] 10.222.0.79 () {58 vars in 1203 bytes} [Tue Aug 2 06:47:11 2022] GET /compute/v2.1/flavors/1835934398/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:11.261666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-99e4ec51-b907-41f0-bb44-ef914516fc12 tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:11.262459 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:11.262459 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:11.282077 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-99e4ec51-b907-41f0-bb44-ef914516fc12 tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1835934398" status: 202 len: 0 microversion: 2.1 time: 0.024388 Aug 02 06:47:11.283539 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 177/409] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:47:11 2022] DELETE /compute/v2.1/flavors/1835934398 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:47:11.295053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e7990483-9654-4dc5-be29-c96b45f59bbf tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:11.326156 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e7990483-9654-4dc5-be29-c96b45f59bbf tempest-FlavorsExtraSpecsTestJSON-355274726 tempest-FlavorsExtraSpecsTestJSON-355274726-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.038512 Aug 02 06:47:11.326853 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 178/410] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:47:11 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:11.652325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4692926b-b3fc-4c2f-8ce9-c78d7ce9cdb2 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:11.666988 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4692926b-b3fc-4c2f-8ce9-c78d7ce9cdb2 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1458 microversion: 2.1 time: 0.617913 Aug 02 06:47:11.668910 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 233/411] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:11 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1458 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:11.901136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6436734b-26cc-42b3-ad9f-469e11313d99 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Calling method '.version_select at 0x7f927bb3fdc0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:11.902101 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:11.902101 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:11.903338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6436734b-26cc-42b3-ad9f-469e11313d99 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:11.903873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6436734b-26cc-42b3-ad9f-469e11313d99 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:11.922071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6436734b-26cc-42b3-ad9f-469e11313d99 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:11.922588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6436734b-26cc-42b3-ad9f-469e11313d99 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:11.943001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6436734b-26cc-42b3-ad9f-469e11313d99 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:11.943149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6436734b-26cc-42b3-ad9f-469e11313d99 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:11.950818 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6436734b-26cc-42b3-ad9f-469e11313d99 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.533434 Aug 02 06:47:11.951535 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 179/412] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:47:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:47:11.963417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cd1ed4a1-677a-493a-90be-e17097cf5139 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Calling method '.version_select at 0x7f927b84b670>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:11.964216 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:11.964216 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:11.965364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd1ed4a1-677a-493a-90be-e17097cf5139 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:11.965797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd1ed4a1-677a-493a-90be-e17097cf5139 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:11.982926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd1ed4a1-677a-493a-90be-e17097cf5139 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:11.983972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd1ed4a1-677a-493a-90be-e17097cf5139 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:11.998347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd1ed4a1-677a-493a-90be-e17097cf5139 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:11.999204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd1ed4a1-677a-493a-90be-e17097cf5139 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.007009 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cd1ed4a1-677a-493a-90be-e17097cf5139 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.047405 Aug 02 06:47:12.019483 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 234/413] 10.222.0.79 () {58 vars in 1167 bytes} [Tue Aug 2 06:47:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:12.031469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6de8d39e-54f5-4e01-ace5-1e6c66e944ee tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Calling method '.version_select at 0x7f927bac1ca0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:12.032924 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:12.032924 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:12.034588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6de8d39e-54f5-4e01-ace5-1e6c66e944ee tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.035221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6de8d39e-54f5-4e01-ace5-1e6c66e944ee tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.052219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6de8d39e-54f5-4e01-ace5-1e6c66e944ee tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.052916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6de8d39e-54f5-4e01-ace5-1e6c66e944ee tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.056657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:12.062286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-addae4cd-1371-4cae-922c-dd888fdf3e81 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:12.063635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-addae4cd-1371-4cae-922c-dd888fdf3e81 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:12.069401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6de8d39e-54f5-4e01-ace5-1e6c66e944ee tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.070146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6de8d39e-54f5-4e01-ace5-1e6c66e944ee tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.085683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-addae4cd-1371-4cae-922c-dd888fdf3e81 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.086249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-addae4cd-1371-4cae-922c-dd888fdf3e81 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.089463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-addae4cd-1371-4cae-922c-dd888fdf3e81 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.089955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-addae4cd-1371-4cae-922c-dd888fdf3e81 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.105141 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6de8d39e-54f5-4e01-ace5-1e6c66e944ee tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.082471 Aug 02 06:47:12.107000 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 180/414] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:47:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:12.119306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-833287c4-e6f1-46a1-8138-ffba8ffb77fa tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Calling method '.version_select at 0x7f927bb3fb80>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:12.122761 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:12.122761 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:12.128457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-833287c4-e6f1-46a1-8138-ffba8ffb77fa tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.130448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-833287c4-e6f1-46a1-8138-ffba8ffb77fa tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.156981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-833287c4-e6f1-46a1-8138-ffba8ffb77fa tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.157694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-833287c4-e6f1-46a1-8138-ffba8ffb77fa tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.166077 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-833287c4-e6f1-46a1-8138-ffba8ffb77fa tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.052006 Aug 02 06:47:12.168025 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 181/415] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:47:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:47:12.173424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-da2416bb-382e-4bdb-b983-b0bab5126b75 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:12.175887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-da2416bb-382e-4bdb-b983-b0bab5126b75 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:12.183373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da2416bb-382e-4bdb-b983-b0bab5126b75 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.183859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da2416bb-382e-4bdb-b983-b0bab5126b75 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.185438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da2416bb-382e-4bdb-b983-b0bab5126b75 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.186133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da2416bb-382e-4bdb-b983-b0bab5126b75 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.230492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-addae4cd-1371-4cae-922c-dd888fdf3e81 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:12.278194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-addae4cd-1371-4cae-922c-dd888fdf3e81 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:12.280934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-addae4cd-1371-4cae-922c-dd888fdf3e81 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:12.288787 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-addae4cd-1371-4cae-922c-dd888fdf3e81 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.232476 Aug 02 06:47:12.290125 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 235/416] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:12 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:12.296449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2d2db0e7-818f-4ae4-925c-67a3f7004455 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Calling method '.version_select at 0x7f927b7959d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:12.297519 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:12.297519 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:12.313929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d2db0e7-818f-4ae4-925c-67a3f7004455 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.315255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d2db0e7-818f-4ae4-925c-67a3f7004455 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.358334 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2d2db0e7-818f-4ae4-925c-67a3f7004455 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.066856 Aug 02 06:47:12.368633 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 236/417] 10.222.0.79 () {58 vars in 1179 bytes} [Tue Aug 2 06:47:12 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:12.374352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6168dfc5-a7a9-42ac-a633-29b74c1f7099 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Calling method '.version_select at 0x7f927b8dab80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:12.376187 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:12.376187 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:12.378322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6168dfc5-a7a9-42ac-a633-29b74c1f7099 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.378949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6168dfc5-a7a9-42ac-a633-29b74c1f7099 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.397035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6168dfc5-a7a9-42ac-a633-29b74c1f7099 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.397532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6168dfc5-a7a9-42ac-a633-29b74c1f7099 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.412310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6168dfc5-a7a9-42ac-a633-29b74c1f7099 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.412310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6168dfc5-a7a9-42ac-a633-29b74c1f7099 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.419679 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6168dfc5-a7a9-42ac-a633-29b74c1f7099 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.049272 Aug 02 06:47:12.428767 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 237/418] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:47:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:12.434732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-39a9244b-b373-45ce-b708-fa91cfa2d7b7 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Calling method '.version_select at 0x7f927b795280>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:12.435670 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:12.435670 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:12.437680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39a9244b-b373-45ce-b708-fa91cfa2d7b7 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.438378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39a9244b-b373-45ce-b708-fa91cfa2d7b7 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.478809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39a9244b-b373-45ce-b708-fa91cfa2d7b7 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.479254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39a9244b-b373-45ce-b708-fa91cfa2d7b7 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.500846 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-39a9244b-b373-45ce-b708-fa91cfa2d7b7 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.069900 Aug 02 06:47:12.513262 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 238/419] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:47:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:12.525079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-2e97e927-d052-4cf9-82f9-4b044e2ff628 req-d0e0539f-6756-4263-bca2-02aeba4ad740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15cdb0c-fc57-4d57-b011-5f7d2a604172", "name": "network-vif-deleted", "tag": "4eb2dde0-527a-42dc-9d97-f64be5223fa2"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:12.556763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2e97e927-d052-4cf9-82f9-4b044e2ff628 req-d0e0539f-6756-4263-bca2-02aeba4ad740 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.557738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2e97e927-d052-4cf9-82f9-4b044e2ff628 req-d0e0539f-6756-4263-bca2-02aeba4ad740 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.565458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-da2416bb-382e-4bdb-b983-b0bab5126b75 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:12.577618 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-da2416bb-382e-4bdb-b983-b0bab5126b75 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881" status: 200 len: 1462 microversion: 2.1 time: 0.408395 Aug 02 06:47:12.582190 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-2e97e927-d052-4cf9-82f9-4b044e2ff628 req-d0e0539f-6756-4263-bca2-02aeba4ad740 service nova] Creating event network-vif-deleted:4eb2dde0-527a-42dc-9d97-f64be5223fa2 for instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 on n-h1-851337-3 Aug 02 06:47:12.588012 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 182/420] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:12 2022] GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 => generated 1462 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:12.599468 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-2e97e927-d052-4cf9-82f9-4b044e2ff628 req-d0e0539f-6756-4263-bca2-02aeba4ad740 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084774 Aug 02 06:47:12.600361 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 239/421] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:12.605435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dba118ce-6db8-49e9-97ee-943635ab6513 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Calling method '.version_select at 0x7f927bb3fd30>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:12.610465 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:12.610465 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:12.614640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dba118ce-6db8-49e9-97ee-943635ab6513 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.615889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dba118ce-6db8-49e9-97ee-943635ab6513 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.654174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dba118ce-6db8-49e9-97ee-943635ab6513 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.656054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dba118ce-6db8-49e9-97ee-943635ab6513 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.674084 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dba118ce-6db8-49e9-97ee-943635ab6513 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.084497 Aug 02 06:47:12.699743 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 183/422] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:47:12 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:12.717947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d2bdafd4-3428-4aaf-9275-4ef0c4d8c61c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:12.724394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d2bdafd4-3428-4aaf-9275-4ef0c4d8c61c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:12.739899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2bdafd4-3428-4aaf-9275-4ef0c4d8c61c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.739994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2bdafd4-3428-4aaf-9275-4ef0c4d8c61c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.741062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2bdafd4-3428-4aaf-9275-4ef0c4d8c61c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.743118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2bdafd4-3428-4aaf-9275-4ef0c4d8c61c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.791917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2bdafd4-3428-4aaf-9275-4ef0c4d8c61c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.792722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2bdafd4-3428-4aaf-9275-4ef0c4d8c61c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.795989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-d2bdafd4-3428-4aaf-9275-4ef0c4d8c61c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lazy-loading 'fault' on Instance uuid a15cdb0c-fc57-4d57-b011-5f7d2a604172 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:12.868453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d2bdafd4-3428-4aaf-9275-4ef0c4d8c61c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '218f99459dc54c7187c8ee0022e64e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7a272c645741bba2da4d0bae7a470b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:12.877165 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d2bdafd4-3428-4aaf-9275-4ef0c4d8c61c tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 200 len: 1309 microversion: 2.1 time: 0.175758 Aug 02 06:47:12.890510 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 184/423] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:12 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 1309 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:12.899458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-12ad70d2-fba1-430d-ad3b-b96f7436ccc2 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Calling method '.version_select at 0x7f927bb22700>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:12.901591 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:12.901591 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:12.903688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12ad70d2-fba1-430d-ad3b-b96f7436ccc2 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.904149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12ad70d2-fba1-430d-ad3b-b96f7436ccc2 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.920937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12ad70d2-fba1-430d-ad3b-b96f7436ccc2 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.921376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12ad70d2-fba1-430d-ad3b-b96f7436ccc2 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.938800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12ad70d2-fba1-430d-ad3b-b96f7436ccc2 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:12.939417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12ad70d2-fba1-430d-ad3b-b96f7436ccc2 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:12.979359 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-12ad70d2-fba1-430d-ad3b-b96f7436ccc2 tempest-HypervisorAdminTestJSON-1216393455 tempest-HypervisorAdminTestJSON-1216393455-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.085839 Aug 02 06:47:12.980747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a87c0760-a778-44e5-b50d-f3abd20fe04e tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:12.982337 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 185/424] 10.222.0.79 () {58 vars in 1173 bytes} [Tue Aug 2 06:47:12 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:12.995639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a87c0760-a778-44e5-b50d-f3abd20fe04e tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Searching by: {'deleted': False, 'project_id': '69be2c6df17f4a38a4017a3af857eb9b'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:47:13.020565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a87c0760-a778-44e5-b50d-f3abd20fe04e tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:13.020919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a87c0760-a778-44e5-b50d-f3abd20fe04e tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:13.021750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a87c0760-a778-44e5-b50d-f3abd20fe04e tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:13.022210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a87c0760-a778-44e5-b50d-f3abd20fe04e tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:13.252238 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a87c0760-a778-44e5-b50d-f3abd20fe04e tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.650611 Aug 02 06:47:13.252863 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 240/425] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:47:12 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:13.277357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-206a7cb8-e408-4c08-8acb-054dde90fcc2 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:13.292942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-206a7cb8-e408-4c08-8acb-054dde90fcc2 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Searching by: {'deleted': False} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:47:13.309878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-206a7cb8-e408-4c08-8acb-054dde90fcc2 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:13.313077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-206a7cb8-e408-4c08-8acb-054dde90fcc2 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:13.313946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-206a7cb8-e408-4c08-8acb-054dde90fcc2 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:13.315333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1fa036ac-a413-4607-8061-183969dc7dcc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:13.316063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-206a7cb8-e408-4c08-8acb-054dde90fcc2 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:13.316290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1fa036ac-a413-4607-8061-183969dc7dcc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:13.328538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fa036ac-a413-4607-8061-183969dc7dcc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:13.328826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fa036ac-a413-4607-8061-183969dc7dcc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:13.330058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fa036ac-a413-4607-8061-183969dc7dcc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:13.330658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fa036ac-a413-4607-8061-183969dc7dcc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:13.360490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:13.436697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1fa036ac-a413-4607-8061-183969dc7dcc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:13.475157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1fa036ac-a413-4607-8061-183969dc7dcc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:13.481654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1fa036ac-a413-4607-8061-183969dc7dcc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:13.495292 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1fa036ac-a413-4607-8061-183969dc7dcc tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.184088 Aug 02 06:47:13.517737 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 241/426] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:13 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:13.603199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-206a7cb8-e408-4c08-8acb-054dde90fcc2 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:47:13.797299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-206a7cb8-e408-4c08-8acb-054dde90fcc2 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:13.798021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-206a7cb8-e408-4c08-8acb-054dde90fcc2 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:14.149348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7be70520-5f73-4da0-8e30-ffd7399769b4 tempest-InstanceUsageAuditLogTestJSON-1799341303 tempest-InstanceUsageAuditLogTestJSON-1799341303-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:14.150424 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:14.150424 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:14.199271 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7be70520-5f73-4da0-8e30-ffd7399769b4 tempest-InstanceUsageAuditLogTestJSON-1799341303 tempest-InstanceUsageAuditLogTestJSON-1799341303-project-admin] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-02 06:47:13" status: 200 len: 318 microversion: 2.1 time: 0.676780 Aug 02 06:47:14.210985 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 242/427] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Aug 2 06:47:13 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-02%2006%3A47%3A13 => generated 318 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:14.222898 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7222438-00ba-445c-88eb-fbf88e35bd3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:14.223874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e7222438-00ba-445c-88eb-fbf88e35bd3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:14.234912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7222438-00ba-445c-88eb-fbf88e35bd3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:14.235255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7222438-00ba-445c-88eb-fbf88e35bd3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:14.236045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7222438-00ba-445c-88eb-fbf88e35bd3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:14.236477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7222438-00ba-445c-88eb-fbf88e35bd3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:14.270332 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-e7222438-00ba-445c-88eb-fbf88e35bd3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] HTTP exception thrown: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7222438-00ba-445c-88eb-fbf88e35bd3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Request method failure captured: Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 HTTP/1.1 Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mg0bRqjxPW4upN2EHTg1EQGC0QhDM96JlAljXPbDaOTYEWm9HSVxCM8hVMHkfFTgCQPkUXkUJNsdA3xa4e940--fb_Sesm1IuC_2ucm0FG-9S3O-JCXRqolPyXvfXORilc6WvA2VoUInpRz6GX2Doyiv9aYcZvwPxAGmrtOoRfL6Gc Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8d7a272c645741bba2da4d0bae7a470b Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:47:14.272556 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:47:14.274234 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8d7a272c645741bba2da4d0bae7a470b"}]}] Aug 02 06:47:14.274234 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.274234 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8d7a272c645741bba2da4d0bae7a470b Aug 02 06:47:14.274234 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.274234 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersAdminTestJSON-1677757129-project Aug 02 06:47:14.274234 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:47:14.274234 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:47:14.274234 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 218f99459dc54c7187c8ee0022e64e81 Aug 02 06:47:14.274234 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersAdminTestJSON-1677757129-project Aug 02 06:47:14.274234 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:47:14.274234 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.274234 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'a15cdb0c-fc57-4d57-b011-5f7d2a604172'} Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:14.275226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.276865 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.282353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7222438-00ba-445c-88eb-fbf88e35bd3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Returning 404 to user: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:14.289375 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7222438-00ba-445c-88eb-fbf88e35bd3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 404 len: 111 microversion: 2.1 time: 0.076338 Aug 02 06:47:14.291383 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 243/428] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:14 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:47:14.301744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5be2423c-2792-4856-94e8-107f9fba1629 tempest-InstanceUsageAuditLogTestJSON-1799341303 tempest-InstanceUsageAuditLogTestJSON-1799341303-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:14.303410 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:14.303410 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:14.317612 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5be2423c-2792-4856-94e8-107f9fba1629 tempest-InstanceUsageAuditLogTestJSON-1799341303 tempest-InstanceUsageAuditLogTestJSON-1799341303-project-admin] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.024804 Aug 02 06:47:14.318519 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 244/429] 10.222.0.79 () {58 vars in 1185 bytes} [Tue Aug 2 06:47:14 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:14.333078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1ebe2959-f1e4-4e16-81a9-f15747fda3ac tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:14.333825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1ebe2959-f1e4-4e16-81a9-f15747fda3ac tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:14.340467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ebe2959-f1e4-4e16-81a9-f15747fda3ac tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:14.341139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ebe2959-f1e4-4e16-81a9-f15747fda3ac tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:14.342171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ebe2959-f1e4-4e16-81a9-f15747fda3ac tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:14.342757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ebe2959-f1e4-4e16-81a9-f15747fda3ac tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:14.359037 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-1ebe2959-f1e4-4e16-81a9-f15747fda3ac tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] HTTP exception thrown: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1ebe2959-f1e4-4e16-81a9-f15747fda3ac tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Request method failure captured: Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 HTTP/1.1 Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mg0bRqjxPW4upN2EHTg1EQGC0QhDM96JlAljXPbDaOTYEWm9HSVxCM8hVMHkfFTgCQPkUXkUJNsdA3xa4e940--fb_Sesm1IuC_2ucm0FG-9S3O-JCXRqolPyXvfXORilc6WvA2VoUInpRz6GX2Doyiv9aYcZvwPxAGmrtOoRfL6Gc Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8d7a272c645741bba2da4d0bae7a470b Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:47:14.361343 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:47:14.362637 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8d7a272c645741bba2da4d0bae7a470b"}]}] Aug 02 06:47:14.362637 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.362637 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8d7a272c645741bba2da4d0bae7a470b Aug 02 06:47:14.362637 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.362637 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersAdminTestJSON-1677757129-project Aug 02 06:47:14.362637 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:47:14.362637 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:47:14.362637 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 218f99459dc54c7187c8ee0022e64e81 Aug 02 06:47:14.362637 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersAdminTestJSON-1677757129-project Aug 02 06:47:14.362637 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:47:14.362637 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.362637 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'a15cdb0c-fc57-4d57-b011-5f7d2a604172'} Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:14.363314 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.364374 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.366846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1ebe2959-f1e4-4e16-81a9-f15747fda3ac tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Returning 404 to user: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:14.367963 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1ebe2959-f1e4-4e16-81a9-f15747fda3ac tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 404 len: 111 microversion: 2.1 time: 0.039998 Aug 02 06:47:14.369115 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 245/430] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:47:14 2022] DELETE /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:47:14.384847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a8a34bd5-6cbf-47ca-9dca-492b8b2d5e07 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:14.388951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a8a34bd5-6cbf-47ca-9dca-492b8b2d5e07 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: a15cdb0c-fc57-4d57-b011-5f7d2a604172] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:14.406985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8a34bd5-6cbf-47ca-9dca-492b8b2d5e07 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:14.408913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8a34bd5-6cbf-47ca-9dca-492b8b2d5e07 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:14.410928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8a34bd5-6cbf-47ca-9dca-492b8b2d5e07 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:14.413132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8a34bd5-6cbf-47ca-9dca-492b8b2d5e07 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:14.458460 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-a8a34bd5-6cbf-47ca-9dca-492b8b2d5e07 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] HTTP exception thrown: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a8a34bd5-6cbf-47ca-9dca-492b8b2d5e07 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Request method failure captured: Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 HTTP/1.1 Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mg0bRqjxPW4upN2EHTg1EQGC0QhDM96JlAljXPbDaOTYEWm9HSVxCM8hVMHkfFTgCQPkUXkUJNsdA3xa4e940--fb_Sesm1IuC_2ucm0FG-9S3O-JCXRqolPyXvfXORilc6WvA2VoUInpRz6GX2Doyiv9aYcZvwPxAGmrtOoRfL6Gc Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8d7a272c645741bba2da4d0bae7a470b Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:47:14.462213 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:47:14.463385 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8d7a272c645741bba2da4d0bae7a470b"}]}] Aug 02 06:47:14.463385 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.463385 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8d7a272c645741bba2da4d0bae7a470b Aug 02 06:47:14.463385 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.463385 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersAdminTestJSON-1677757129-project Aug 02 06:47:14.463385 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:47:14.463385 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:47:14.463385 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 218f99459dc54c7187c8ee0022e64e81 Aug 02 06:47:14.463385 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersAdminTestJSON-1677757129-project Aug 02 06:47:14.463385 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:47:14.463385 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.463385 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'a15cdb0c-fc57-4d57-b011-5f7d2a604172'} Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:14.464068 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. Aug 02 06:47:14.465113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.466106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a8a34bd5-6cbf-47ca-9dca-492b8b2d5e07 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Returning 404 to user: Instance a15cdb0c-fc57-4d57-b011-5f7d2a604172 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:14.466106 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a8a34bd5-6cbf-47ca-9dca-492b8b2d5e07 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172" status: 404 len: 111 microversion: 2.1 time: 0.090430 Aug 02 06:47:14.472015 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 246/431] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:14 2022] GET /compute/v2.1/servers/a15cdb0c-fc57-4d57-b011-5f7d2a604172 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:47:14.484070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-26cac3c2-b952-42c3-8e68-8ac944a48857 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:14.488744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-26cac3c2-b952-42c3-8e68-8ac944a48857 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:14.512312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26cac3c2-b952-42c3-8e68-8ac944a48857 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:14.513321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26cac3c2-b952-42c3-8e68-8ac944a48857 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:14.514278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26cac3c2-b952-42c3-8e68-8ac944a48857 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:14.514938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26cac3c2-b952-42c3-8e68-8ac944a48857 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:14.535170 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-26cac3c2-b952-42c3-8e68-8ac944a48857 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] HTTP exception thrown: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-26cac3c2-b952-42c3-8e68-8ac944a48857 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Request method failure captured: Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 HTTP/1.1 Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mg0bRqjxPW4upN2EHTg1EQGC0QhDM96JlAljXPbDaOTYEWm9HSVxCM8hVMHkfFTgCQPkUXkUJNsdA3xa4e940--fb_Sesm1IuC_2ucm0FG-9S3O-JCXRqolPyXvfXORilc6WvA2VoUInpRz6GX2Doyiv9aYcZvwPxAGmrtOoRfL6Gc Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8d7a272c645741bba2da4d0bae7a470b Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:47:14.536820 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:47:14.538056 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8d7a272c645741bba2da4d0bae7a470b"}]}] Aug 02 06:47:14.538056 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.538056 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8d7a272c645741bba2da4d0bae7a470b Aug 02 06:47:14.538056 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.538056 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersAdminTestJSON-1677757129-project Aug 02 06:47:14.538056 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:47:14.538056 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:47:14.538056 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 218f99459dc54c7187c8ee0022e64e81 Aug 02 06:47:14.538056 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersAdminTestJSON-1677757129-project Aug 02 06:47:14.538056 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:47:14.538056 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:47:14.538056 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '0a8a334e-542e-452d-8822-2324c95201f4'} Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:14.538766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:47:14.542030 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.544188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-26cac3c2-b952-42c3-8e68-8ac944a48857 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Returning 404 to user: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:14.546469 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-26cac3c2-b952-42c3-8e68-8ac944a48857 tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 404 len: 111 microversion: 2.1 time: 0.065296 Aug 02 06:47:14.550932 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 247/432] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:47:14 2022] DELETE /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:47:14.571697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4a953312-fc5e-4ce7-93d5-eeb5ad1b028c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:14.572570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4a953312-fc5e-4ce7-93d5-eeb5ad1b028c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:14.584031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a953312-fc5e-4ce7-93d5-eeb5ad1b028c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:14.584732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a953312-fc5e-4ce7-93d5-eeb5ad1b028c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:14.585748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a953312-fc5e-4ce7-93d5-eeb5ad1b028c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:14.587197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a953312-fc5e-4ce7-93d5-eeb5ad1b028c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:14.628888 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-206a7cb8-e408-4c08-8acb-054dde90fcc2 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 8113 microversion: 2.1 time: 1.356821 Aug 02 06:47:14.629920 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 186/433] 10.222.0.79 () {58 vars in 1171 bytes} [Tue Aug 2 06:47:13 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 8113 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:14.637071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79b11845-86d6-43b0-a248-9504fc2c7e3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:14.638621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79b11845-86d6-43b0-a248-9504fc2c7e3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] [instance: 0a8a334e-542e-452d-8822-2324c95201f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:14.663455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79b11845-86d6-43b0-a248-9504fc2c7e3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:14.663860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79b11845-86d6-43b0-a248-9504fc2c7e3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:14.664556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79b11845-86d6-43b0-a248-9504fc2c7e3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:14.664984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79b11845-86d6-43b0-a248-9504fc2c7e3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:14.711972 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-79b11845-86d6-43b0-a248-9504fc2c7e3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] HTTP exception thrown: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79b11845-86d6-43b0-a248-9504fc2c7e3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Request method failure captured: Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 HTTP/1.1 Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mg0bRqjxPW4upN2EHTg1EQGC0QhDM96JlAljXPbDaOTYEWm9HSVxCM8hVMHkfFTgCQPkUXkUJNsdA3xa4e940--fb_Sesm1IuC_2ucm0FG-9S3O-JCXRqolPyXvfXORilc6WvA2VoUInpRz6GX2Doyiv9aYcZvwPxAGmrtOoRfL6Gc Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 8d7a272c645741bba2da4d0bae7a470b Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:47:14.723374 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:47:14.725057 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8d7a272c645741bba2da4d0bae7a470b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8d7a272c645741bba2da4d0bae7a470b"}]}] Aug 02 06:47:14.725057 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.725057 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 8d7a272c645741bba2da4d0bae7a470b Aug 02 06:47:14.725057 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1677757129 Aug 02 06:47:14.725057 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-DeleteServersAdminTestJSON-1677757129-project Aug 02 06:47:14.725057 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:47:14.725057 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:47:14.725057 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 218f99459dc54c7187c8ee0022e64e81 Aug 02 06:47:14.725057 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-DeleteServersAdminTestJSON-1677757129-project Aug 02 06:47:14.725057 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:47:14.725057 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:47:14.725057 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '0a8a334e-542e-452d-8822-2324c95201f4'} Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:14.725807 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. Aug 02 06:47:14.727043 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:14.728043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79b11845-86d6-43b0-a248-9504fc2c7e3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] Returning 404 to user: Instance 0a8a334e-542e-452d-8822-2324c95201f4 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:14.728043 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79b11845-86d6-43b0-a248-9504fc2c7e3f tempest-DeleteServersAdminTestJSON-1677757129 tempest-DeleteServersAdminTestJSON-1677757129-project] 10.222.0.79 "GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4" status: 404 len: 111 microversion: 2.1 time: 0.093943 Aug 02 06:47:14.728043 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 187/434] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:14 2022] GET /compute/v2.1/servers/0a8a334e-542e-452d-8822-2324c95201f4 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:47:14.738905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ca019476-baf9-4ae8-938d-5114d57a8c27 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:14.751045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4a953312-fc5e-4ce7-93d5-eeb5ad1b028c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:14.755321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ca019476-baf9-4ae8-938d-5114d57a8c27 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Searching by: {'deleted': False, 'project_id': '69be2c6df17f4a38a4017a3af857eb9b'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:47:14.761574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4a953312-fc5e-4ce7-93d5-eeb5ad1b028c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:14.763604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4a953312-fc5e-4ce7-93d5-eeb5ad1b028c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:14.776568 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4a953312-fc5e-4ce7-93d5-eeb5ad1b028c tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1446 microversion: 2.75 time: 0.224145 Aug 02 06:47:14.778126 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 248/435] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:14 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1446 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:14.816129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca019476-baf9-4ae8-938d-5114d57a8c27 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:14.816576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca019476-baf9-4ae8-938d-5114d57a8c27 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:14.820777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca019476-baf9-4ae8-938d-5114d57a8c27 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:14.822278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca019476-baf9-4ae8-938d-5114d57a8c27 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:15.015162 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ca019476-baf9-4ae8-938d-5114d57a8c27 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?tenant_id=3573e2fa6bf04720b7fb8d85b6cc5a54" status: 200 len: 15 microversion: 2.1 time: 0.286617 Aug 02 06:47:15.016330 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 188/436] 10.222.0.79 () {58 vars in 1231 bytes} [Tue Aug 2 06:47:14 2022] GET /compute/v2.1/servers/detail?tenant_id=3573e2fa6bf04720b7fb8d85b6cc5a54 => generated 15 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:15.038224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-086aa6d6-11a7-413a-a599-7941ce5daf35 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:15.046694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-086aa6d6-11a7-413a-a599-7941ce5daf35 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Searching by: {'tenant_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'deleted': False} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:47:15.053880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-086aa6d6-11a7-413a-a599-7941ce5daf35 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:15.055222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-086aa6d6-11a7-413a-a599-7941ce5daf35 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:15.056219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-086aa6d6-11a7-413a-a599-7941ce5daf35 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:15.056976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-086aa6d6-11a7-413a-a599-7941ce5daf35 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:15.104807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-086aa6d6-11a7-413a-a599-7941ce5daf35 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:47:15.278449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-086aa6d6-11a7-413a-a599-7941ce5daf35 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:15.279654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-086aa6d6-11a7-413a-a599-7941ce5daf35 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:15.681574 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-086aa6d6-11a7-413a-a599-7941ce5daf35 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3573e2fa6bf04720b7fb8d85b6cc5a54" status: 200 len: 4824 microversion: 2.1 time: 0.647882 Aug 02 06:47:15.683415 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 249/437] 10.222.0.79 () {58 vars in 1257 bytes} [Tue Aug 2 06:47:15 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3573e2fa6bf04720b7fb8d85b6cc5a54 => generated 4824 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:15.710047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b2764bdb-8c3e-4d20-b3ec-dcbf1741ed44 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:15.729207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b2764bdb-8c3e-4d20-b3ec-dcbf1741ed44 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Searching by: {'tenant_id': '69be2c6df17f4a38a4017a3af857eb9b', 'deleted': False} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:47:15.755826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2764bdb-8c3e-4d20-b3ec-dcbf1741ed44 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:15.758505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2764bdb-8c3e-4d20-b3ec-dcbf1741ed44 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:15.761177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2764bdb-8c3e-4d20-b3ec-dcbf1741ed44 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:15.761618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2764bdb-8c3e-4d20-b3ec-dcbf1741ed44 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:15.805744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5950687d-d6dd-4c9c-ac00-d983ac753955 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:15.806545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5950687d-d6dd-4c9c-ac00-d983ac753955 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:15.818873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5950687d-d6dd-4c9c-ac00-d983ac753955 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:15.822571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5950687d-d6dd-4c9c-ac00-d983ac753955 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:15.823692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5950687d-d6dd-4c9c-ac00-d983ac753955 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:15.825043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5950687d-d6dd-4c9c-ac00-d983ac753955 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:15.867380 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b2764bdb-8c3e-4d20-b3ec-dcbf1741ed44 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=69be2c6df17f4a38a4017a3af857eb9b" status: 200 len: 15 microversion: 2.1 time: 0.161392 Aug 02 06:47:15.868426 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 189/438] 10.222.0.79 () {58 vars in 1257 bytes} [Tue Aug 2 06:47:15 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=69be2c6df17f4a38a4017a3af857eb9b => generated 15 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:15.892503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-243a594f-8ca6-4e34-9e68-c97d81d7a48c tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:15.897928 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-243a594f-8ca6-4e34-9e68-c97d81d7a48c tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009285 Aug 02 06:47:15.911100 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 190/439] 10.222.0.79 () {58 vars in 1189 bytes} [Tue Aug 2 06:47:15 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:15.920669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-88a8cbf0-ac98-46f5-ade1-5ab23a76e74a tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:15.924635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-88a8cbf0-ac98-46f5-ade1-5ab23a76e74a tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:15.932518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88a8cbf0-ac98-46f5-ade1-5ab23a76e74a tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:15.933647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88a8cbf0-ac98-46f5-ade1-5ab23a76e74a tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:15.934653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88a8cbf0-ac98-46f5-ade1-5ab23a76e74a tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:15.935378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88a8cbf0-ac98-46f5-ade1-5ab23a76e74a tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:16.105670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5950687d-d6dd-4c9c-ac00-d983ac753955 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:16.107846 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-88a8cbf0-ac98-46f5-ade1-5ab23a76e74a tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c/action" status: 202 len: 0 microversion: 2.1 time: 0.191012 Aug 02 06:47:16.109049 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 191/440] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:47:15 2022] POST /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:47:16.118268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fed4e076-7082-46ef-adbc-7a47bb62fbac tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:16.119583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5950687d-d6dd-4c9c-ac00-d983ac753955 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:16.124880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5950687d-d6dd-4c9c-ac00-d983ac753955 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:16.131576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fed4e076-7082-46ef-adbc-7a47bb62fbac tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:16.132657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fed4e076-7082-46ef-adbc-7a47bb62fbac tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:47:16.144323 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5950687d-d6dd-4c9c-ac00-d983ac753955 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1452 microversion: 2.75 time: 0.343492 Aug 02 06:47:16.148067 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 250/441] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:15 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1452 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:47:16.153920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fed4e076-7082-46ef-adbc-7a47bb62fbac tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:16.160514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fed4e076-7082-46ef-adbc-7a47bb62fbac tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:16.161799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fed4e076-7082-46ef-adbc-7a47bb62fbac tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:16.162723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fed4e076-7082-46ef-adbc-7a47bb62fbac tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:16.366707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-fed4e076-7082-46ef-adbc-7a47bb62fbac tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:47:16.455992 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fed4e076-7082-46ef-adbc-7a47bb62fbac tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.341379 Aug 02 06:47:16.458024 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 192/442] 10.222.0.79 () {58 vars in 1150 bytes} [Tue Aug 2 06:47:16 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:16.472364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0d7831d1-bead-45e6-af0c-903a0d00a11b tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:16.475096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0d7831d1-bead-45e6-af0c-903a0d00a11b tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:16.492752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d7831d1-bead-45e6-af0c-903a0d00a11b tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:16.493609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d7831d1-bead-45e6-af0c-903a0d00a11b tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:16.494737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d7831d1-bead-45e6-af0c-903a0d00a11b tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:16.496948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d7831d1-bead-45e6-af0c-903a0d00a11b tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:16.677299 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0d7831d1-bead-45e6-af0c-903a0d00a11b tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c/action" status: 202 len: 0 microversion: 2.1 time: 0.210543 Aug 02 06:47:16.679881 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 251/443] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:47:16 2022] POST /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:47:16.690781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-21c4fb23-1acb-4b77-815c-53eebc1272d3 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:16.691437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-21c4fb23-1acb-4b77-815c-53eebc1272d3 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:16.709710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21c4fb23-1acb-4b77-815c-53eebc1272d3 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:16.715296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21c4fb23-1acb-4b77-815c-53eebc1272d3 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:16.719930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21c4fb23-1acb-4b77-815c-53eebc1272d3 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:16.720439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21c4fb23-1acb-4b77-815c-53eebc1272d3 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:17.101994 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-21c4fb23-1acb-4b77-815c-53eebc1272d3 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1613 microversion: 2.1 time: 0.416726 Aug 02 06:47:17.103039 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 193/444] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:16 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1613 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:17.133447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-da952028-9a5b-488e-bcfe-dbe8aa690e37 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:17.135422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-da952028-9a5b-488e-bcfe-dbe8aa690e37 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:17.148470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-da952028-9a5b-488e-bcfe-dbe8aa690e37 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:17.149928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-da952028-9a5b-488e-bcfe-dbe8aa690e37 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:17.151943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-da952028-9a5b-488e-bcfe-dbe8aa690e37 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:17.152809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-da952028-9a5b-488e-bcfe-dbe8aa690e37 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:17.187168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a8434611-f145-46c6-b05a-ab1bcced74e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:17.192611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a8434611-f145-46c6-b05a-ab1bcced74e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:17.230814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8434611-f145-46c6-b05a-ab1bcced74e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:17.232892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8434611-f145-46c6-b05a-ab1bcced74e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:17.237504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8434611-f145-46c6-b05a-ab1bcced74e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:17.240592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8434611-f145-46c6-b05a-ab1bcced74e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:17.552447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a8434611-f145-46c6-b05a-ab1bcced74e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:17.590013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a8434611-f145-46c6-b05a-ab1bcced74e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:17.590958 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-da952028-9a5b-488e-bcfe-dbe8aa690e37 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1613 microversion: 2.1 time: 0.463428 Aug 02 06:47:17.591608 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 252/445] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:17 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1613 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:17.595381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a8434611-f145-46c6-b05a-ab1bcced74e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:17.613354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b29a38f0-93a9-4253-90c9-060ca8a9d989 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:17.620077 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a8434611-f145-46c6-b05a-ab1bcced74e8 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1452 microversion: 2.75 time: 0.444540 Aug 02 06:47:17.621011 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 194/446] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:17 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1452 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:47:17.622516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b29a38f0-93a9-4253-90c9-060ca8a9d989 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Searching by: {'host': 'n-h2-851337-3', 'deleted': False} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:47:17.628753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b29a38f0-93a9-4253-90c9-060ca8a9d989 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:17.629707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b29a38f0-93a9-4253-90c9-060ca8a9d989 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:17.630661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b29a38f0-93a9-4253-90c9-060ca8a9d989 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:17.631216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b29a38f0-93a9-4253-90c9-060ca8a9d989 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:17.791448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-b29a38f0-93a9-4253-90c9-060ca8a9d989 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:47:17.926620 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b29a38f0-93a9-4253-90c9-060ca8a9d989 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "GET /compute/v2.1/servers?host=n-h2-851337-3&all_tenants=1" status: 200 len: 1328 microversion: 2.1 time: 0.315741 Aug 02 06:47:17.937648 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 253/447] 10.222.0.79 () {58 vars in 1190 bytes} [Tue Aug 2 06:47:17 2022] GET /compute/v2.1/servers?host=n-h2-851337-3&all_tenants=1 => generated 1328 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:17.943388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-529900b3-2b5a-4376-86e0-a05bbfb963aa tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:17.966299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-529900b3-2b5a-4376-86e0-a05bbfb963aa tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:47:18.004741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-529900b3-2b5a-4376-86e0-a05bbfb963aa tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:18.005193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-529900b3-2b5a-4376-86e0-a05bbfb963aa tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:18.006070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-529900b3-2b5a-4376-86e0-a05bbfb963aa tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:18.006503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-529900b3-2b5a-4376-86e0-a05bbfb963aa tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:18.234238 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-529900b3-2b5a-4376-86e0-a05bbfb963aa tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.295379 Aug 02 06:47:18.236990 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 195/448] 10.222.0.79 () {58 vars in 1196 bytes} [Tue Aug 2 06:47:17 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:18.248715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1acebd06-2cc4-4d5f-97a4-be16c5cd1972 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:18.251017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1acebd06-2cc4-4d5f-97a4-be16c5cd1972 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:18.273234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1acebd06-2cc4-4d5f-97a4-be16c5cd1972 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:18.273609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1acebd06-2cc4-4d5f-97a4-be16c5cd1972 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:18.274426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1acebd06-2cc4-4d5f-97a4-be16c5cd1972 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:18.275029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1acebd06-2cc4-4d5f-97a4-be16c5cd1972 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:18.421588 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1acebd06-2cc4-4d5f-97a4-be16c5cd1972 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c/action" status: 202 len: 0 microversion: 2.1 time: 0.176725 Aug 02 06:47:18.422279 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 254/449] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:47:18 2022] POST /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:47:18.430754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:18.433457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:18.449693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:18.450199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:18.450974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:18.451441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:18.577822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:47:18.578632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:47:18.579257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:47:18.579651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:47:18.580352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:47:18.669338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ee578d1-e7d9-4eef-959c-c3c00ae73d17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:18.670553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9ee578d1-e7d9-4eef-959c-c3c00ae73d17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:18.689064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ee578d1-e7d9-4eef-959c-c3c00ae73d17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:18.691478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ee578d1-e7d9-4eef-959c-c3c00ae73d17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:18.692457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ee578d1-e7d9-4eef-959c-c3c00ae73d17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:18.694348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ee578d1-e7d9-4eef-959c-c3c00ae73d17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:18.719079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:18.749267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:18.750215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:18.752137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:18.752584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:18.808441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:18.821088 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2f91cbca-21f1-48d2-825d-daedeb3fcbb1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "POST /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c/action" status: 202 len: 1066 microversion: 2.1 time: 0.394233 Aug 02 06:47:18.822456 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 196/450] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:47:18 2022] POST /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c/action => generated 1066 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 06:47:18.842424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3247d962-317c-46bb-809d-dce447f0267e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:18.843295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3247d962-317c-46bb-809d-dce447f0267e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:18.887959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3247d962-317c-46bb-809d-dce447f0267e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:18.888422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3247d962-317c-46bb-809d-dce447f0267e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:18.898789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3247d962-317c-46bb-809d-dce447f0267e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:18.901484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3247d962-317c-46bb-809d-dce447f0267e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:18.918589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9ee578d1-e7d9-4eef-959c-c3c00ae73d17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:18.944098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9ee578d1-e7d9-4eef-959c-c3c00ae73d17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:18.952829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9ee578d1-e7d9-4eef-959c-c3c00ae73d17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:18.990328 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9ee578d1-e7d9-4eef-959c-c3c00ae73d17 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1452 microversion: 2.75 time: 0.328887 Aug 02 06:47:18.994295 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 255/451] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:18 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1452 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:47:19.252185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3247d962-317c-46bb-809d-dce447f0267e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:19.263790 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3247d962-317c-46bb-809d-dce447f0267e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1470 microversion: 2.1 time: 0.427084 Aug 02 06:47:19.265103 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 197/452] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:18 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1470 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:47:20.030744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a4fd8c80-cae1-4e98-88a6-14ab99bd6fa0 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:20.031432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a4fd8c80-cae1-4e98-88a6-14ab99bd6fa0 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:20.039653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4fd8c80-cae1-4e98-88a6-14ab99bd6fa0 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:20.040039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4fd8c80-cae1-4e98-88a6-14ab99bd6fa0 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:20.040808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4fd8c80-cae1-4e98-88a6-14ab99bd6fa0 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:20.041224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4fd8c80-cae1-4e98-88a6-14ab99bd6fa0 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:20.165025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a4fd8c80-cae1-4e98-88a6-14ab99bd6fa0 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:20.177329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a4fd8c80-cae1-4e98-88a6-14ab99bd6fa0 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:20.180070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a4fd8c80-cae1-4e98-88a6-14ab99bd6fa0 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:20.193872 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a4fd8c80-cae1-4e98-88a6-14ab99bd6fa0 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1437 microversion: 2.75 time: 0.166888 Aug 02 06:47:20.197391 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 256/453] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:20 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1437 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:20.291548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b60ac3aa-43b3-4dbc-827f-d75c60783e99 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:20.292298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b60ac3aa-43b3-4dbc-827f-d75c60783e99 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:20.299736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b60ac3aa-43b3-4dbc-827f-d75c60783e99 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:20.300179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b60ac3aa-43b3-4dbc-827f-d75c60783e99 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:20.306889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b60ac3aa-43b3-4dbc-827f-d75c60783e99 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:20.307363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b60ac3aa-43b3-4dbc-827f-d75c60783e99 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:20.587763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b60ac3aa-43b3-4dbc-827f-d75c60783e99 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:20.595710 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b60ac3aa-43b3-4dbc-827f-d75c60783e99 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1470 microversion: 2.1 time: 0.308354 Aug 02 06:47:20.596282 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 257/454] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:20 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1470 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:47:20.762499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:20.767767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:20.779059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=93,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=5 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:20.780803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:20.781306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:20.787238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:20.787679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:20.937728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:47:20.939358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:47:20.941668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:47:20.943732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:47:20.944341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:47:21.117512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:21.130715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:21.131166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:21.156265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:21.156742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:21.166572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-468ec384-d3b6-498c-9214-3717d63f84fd tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Calling method '.version_select at 0x7f927b635f70>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:21.169217 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:21.169217 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:21.170678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-468ec384-d3b6-498c-9214-3717d63f84fd tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:21.174375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-468ec384-d3b6-498c-9214-3717d63f84fd tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:21.251413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-468ec384-d3b6-498c-9214-3717d63f84fd tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:21.252815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-468ec384-d3b6-498c-9214-3717d63f84fd tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:21.289498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:21.356086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-468ec384-d3b6-498c-9214-3717d63f84fd tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:21.358821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-468ec384-d3b6-498c-9214-3717d63f84fd tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:21.394521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-468ec384-d3b6-498c-9214-3717d63f84fd tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:21.397662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-468ec384-d3b6-498c-9214-3717d63f84fd tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:21.431060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-468ec384-d3b6-498c-9214-3717d63f84fd tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:21.432197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-468ec384-d3b6-498c-9214-3717d63f84fd tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:21.459773 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-468ec384-d3b6-498c-9214-3717d63f84fd tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1994 microversion: 2.53 time: 0.862387 Aug 02 06:47:21.470018 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 258/455] 10.222.0.79 () {60 vars in 1243 bytes} [Tue Aug 2 06:47:20 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1994 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:21.480454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df3cc6d8-a294-41f8-9a8a-93c044607797 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Calling method '.version_select at 0x7f927b7b54c0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:21.483190 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:21.483190 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:21.484795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df3cc6d8-a294-41f8-9a8a-93c044607797 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:21.485234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df3cc6d8-a294-41f8-9a8a-93c044607797 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:21.515670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df3cc6d8-a294-41f8-9a8a-93c044607797 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:21.516113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df3cc6d8-a294-41f8-9a8a-93c044607797 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:21.614129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df3cc6d8-a294-41f8-9a8a-93c044607797 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:21.616519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df3cc6d8-a294-41f8-9a8a-93c044607797 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:21.644065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df3cc6d8-a294-41f8-9a8a-93c044607797 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:21.650478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df3cc6d8-a294-41f8-9a8a-93c044607797 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:21.688147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:SELECT=95 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:21.690036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df3cc6d8-a294-41f8-9a8a-93c044607797 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:21.690874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df3cc6d8-a294-41f8-9a8a-93c044607797 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:21.708588 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df3cc6d8-a294-41f8-9a8a-93c044607797 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 686 microversion: 2.53 time: 0.231915 Aug 02 06:47:21.722341 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 259/456] 10.222.0.79 () {60 vars in 1222 bytes} [Tue Aug 2 06:47:21 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 686 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:47:21.735761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-902bd9de-3fbf-483c-8435-6590f3ba3e29 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:21.742851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-902bd9de-3fbf-483c-8435-6590f3ba3e29 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:21.759747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-902bd9de-3fbf-483c-8435-6590f3ba3e29 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:21.762514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-902bd9de-3fbf-483c-8435-6590f3ba3e29 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:21.764522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-902bd9de-3fbf-483c-8435-6590f3ba3e29 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:21.765348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-902bd9de-3fbf-483c-8435-6590f3ba3e29 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:22.043492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:22.187670 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e38e81b5-23b5-4ef6-b0e9-762abce7c010 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680/action" status: 202 len: 1940 microversion: 2.75 time: 1.965843 Aug 02 06:47:22.188331 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 198/457] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Aug 2 06:47:20 2022] POST /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680/action => generated 1940 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 02 06:47:22.203416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7bb77776-7e40-4d01-af6d-aea6d5aa7dd3 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Calling method '.version_select at 0x7f927b685c10>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:22.206537 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:22.206537 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:22.216079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bb77776-7e40-4d01-af6d-aea6d5aa7dd3 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:22.216591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bb77776-7e40-4d01-af6d-aea6d5aa7dd3 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:22.250663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bb77776-7e40-4d01-af6d-aea6d5aa7dd3 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:22.251119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bb77776-7e40-4d01-af6d-aea6d5aa7dd3 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:22.258677 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7bb77776-7e40-4d01-af6d-aea6d5aa7dd3 tempest-HypervisorAdminV253TestBase-1438608933 tempest-HypervisorAdminV253TestBase-1438608933-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/ca956c3b-9145-4e39-9b87-cfd5ffd5abd6" status: 200 len: 792 microversion: 2.53 time: 0.069225 Aug 02 06:47:22.269162 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 199/458] 10.222.0.79 () {60 vars in 1298 bytes} [Tue Aug 2 06:47:22 2022] GET /compute/v2.1/os-hypervisors/ca956c3b-9145-4e39-9b87-cfd5ffd5abd6 => generated 792 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:47:22.275980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cfb50d20-15e5-4ce4-9622-234eafea4d0f tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:22.281094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cfb50d20-15e5-4ce4-9622-234eafea4d0f tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:22.298552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cfb50d20-15e5-4ce4-9622-234eafea4d0f tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:22.298935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cfb50d20-15e5-4ce4-9622-234eafea4d0f tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:22.299705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cfb50d20-15e5-4ce4-9622-234eafea4d0f tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:22.304089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cfb50d20-15e5-4ce4-9622-234eafea4d0f tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:22.391402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-902bd9de-3fbf-483c-8435-6590f3ba3e29 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:22.404337 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-902bd9de-3fbf-483c-8435-6590f3ba3e29 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1470 microversion: 2.1 time: 0.674680 Aug 02 06:47:22.405109 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 260/459] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:21 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1470 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:22.681844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-cfb50d20-15e5-4ce4-9622-234eafea4d0f tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:22.739268 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cfb50d20-15e5-4ce4-9622-234eafea4d0f tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.468577 Aug 02 06:47:22.741432 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 200/460] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:22 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:23.329924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7a2ac0e1-01e0-42b8-bf60-7353caea46b3 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Calling method '.version_select at 0x7f927b5f5430>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:23.416427 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7a2ac0e1-01e0-42b8-bf60-7353caea46b3 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "GET /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557" status: 200 len: 637 microversion: 2.1 time: 0.105342 Aug 02 06:47:23.421556 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 261/461] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:47:23 2022] GET /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557 => generated 637 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:23.433702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-82b52507-bb07-4afb-a6ac-a9cc6874ef1b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:23.434354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-82b52507-bb07-4afb-a6ac-a9cc6874ef1b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:23.445121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-656238dd-6b0f-4aae-8bb4-6514094e0b76 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Action: 'update_all', calling method: .version_select at 0x7f927b5f5ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:23.447770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82b52507-bb07-4afb-a6ac-a9cc6874ef1b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:23.448226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82b52507-bb07-4afb-a6ac-a9cc6874ef1b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:23.454185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82b52507-bb07-4afb-a6ac-a9cc6874ef1b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:23.454640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82b52507-bb07-4afb-a6ac-a9cc6874ef1b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:23.549383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-656238dd-6b0f-4aae-8bb4-6514094e0b76 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:23.563173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-656238dd-6b0f-4aae-8bb4-6514094e0b76 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for user c3300058dc7e47f2bc60fa5d609c9266 and project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:23.757790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:24.122437 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-656238dd-6b0f-4aae-8bb4-6514094e0b76 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata" status: 200 len: 61 microversion: 2.1 time: 0.686520 Aug 02 06:47:24.123531 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 262/462] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:47:23 2022] PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata => generated 61 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 06:47:24.207904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-82b52507-bb07-4afb-a6ac-a9cc6874ef1b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:24.224700 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-82b52507-bb07-4afb-a6ac-a9cc6874ef1b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1470 microversion: 2.1 time: 0.801306 Aug 02 06:47:24.226262 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 201/463] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:23 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1470 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:24.234899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c7d3c6b4-e480-4b9f-811e-28e0249aaad1 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:24.235925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c7d3c6b4-e480-4b9f-811e-28e0249aaad1 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:24.258150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7d3c6b4-e480-4b9f-811e-28e0249aaad1 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:24.258869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7d3c6b4-e480-4b9f-811e-28e0249aaad1 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:24.260199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7d3c6b4-e480-4b9f-811e-28e0249aaad1 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:24.260853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7d3c6b4-e480-4b9f-811e-28e0249aaad1 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:24.571113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d277d7ea-66b4-408c-b2fd-ed46163e3059 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Action: 'create', calling method: .version_select at 0x7f927b5f55e0>, body: {"keypair": {"name": "tempest-keypair-513507095", "type": "ssh", "user_id": "cc8a4d799a5e48c792eb81036dba49a9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUN5EYugX3gNyn9BqyVikW5XjrEt+odCxm+O3q7LwKS/RAXbWU/ZGdhJjHxb8NlUUgdyQXSGIJOHYxAVq9iIvGKqnMDYBx7HNYnsq2Aib0DLdL2gZN5ajwcrQS1x/69rA=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:24.583388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-c7d3c6b4-e480-4b9f-811e-28e0249aaad1 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:24.603859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-d277d7ea-66b4-408c-b2fd-ed46163e3059 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Getting quotas for project 8bf59e91caad4176ab766748b82e1815. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:24.610434 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-d277d7ea-66b4-408c-b2fd-ed46163e3059 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Getting quotas for user 2cf65fabdf9e44988b4669eebf2ed596 and project 8bf59e91caad4176ab766748b82e1815. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:24.651935 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c7d3c6b4-e480-4b9f-811e-28e0249aaad1 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.421744 Aug 02 06:47:24.657582 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d277d7ea-66b4-408c-b2fd-ed46163e3059 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.532213 Aug 02 06:47:24.658354 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 263/464] 10.222.0.79 () {62 vars in 1200 bytes} [Tue Aug 2 06:47:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 534 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 06:47:24.681148 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 202/465] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:24 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:24.681933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7f931d4a-2548-4618-bfdf-7fbbc031b010 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Calling method '.version_select at 0x7f927b5f5820>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:24.682185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c5aae290-9e13-48b5-b880-29ea63fa7147 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Action: 'create', calling method: .version_select at 0x7f927b507dc0>, body: {"keypair": {"name": "tempest-keypair-161548339", "type": "ssh", "user_id": "cc8a4d799a5e48c792eb81036dba49a9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzWHbHqm5l/VN39bIVr2IVI4CeKkn72LiH2oBWeM/UngDabwvrZWMaz1kNBm/DMmuM1pdL3lYh2idBKQ77TE4tnOFqxxlQAbxn2IY1gEL5ISiswC0OnhmSaZ87s5kYBLg=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:24.739402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-c5aae290-9e13-48b5-b880-29ea63fa7147 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Getting quotas for project 8bf59e91caad4176ab766748b82e1815. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:24.744824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-c5aae290-9e13-48b5-b880-29ea63fa7147 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Getting quotas for user 2cf65fabdf9e44988b4669eebf2ed596 and project 8bf59e91caad4176ab766748b82e1815. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:24.786517 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c5aae290-9e13-48b5-b880-29ea63fa7147 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.116887 Aug 02 06:47:24.792604 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 203/466] 10.222.0.79 () {62 vars in 1200 bytes} [Tue Aug 2 06:47:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 06:47:24.808903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1eca855e-af9b-47d5-a1dd-3bd0a4ccf2e7 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Calling method '.version_select at 0x7f927b507b80>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:24.852686 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1eca855e-af9b-47d5-a1dd-3bd0a4ccf2e7 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-513507095?user_id=cc8a4d799a5e48c792eb81036dba49a9" status: 200 len: 511 microversion: 2.10 time: 0.055380 Aug 02 06:47:24.888470 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 204/467] 10.222.0.79 () {60 vars in 1337 bytes} [Tue Aug 2 06:47:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-513507095?user_id=cc8a4d799a5e48c792eb81036dba49a9 => generated 511 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:47:24.888470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bc60c159-899d-4ade-a786-cf63dce2c962 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Action: 'create', calling method: .version_select at 0x7f927b82d3a0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2075852298", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLDnNXPSAzX5Y1ZeVVhCiL/pidXhkzBUzDwNUntWKAnZWAPCmobDBYR1Y18sw3xbpQN56V6zsaOZSg3n10TSezSFolec9KIRj7RqzmCDbF37OPcKqodzLT5o5Oi6Lk1fA=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:24.936540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-bc60c159-899d-4ade-a786-cf63dce2c962 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Getting quotas for project 8bf59e91caad4176ab766748b82e1815. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:24.949152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-bc60c159-899d-4ade-a786-cf63dce2c962 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Getting quotas for user 2cf65fabdf9e44988b4669eebf2ed596 and project 8bf59e91caad4176ab766748b82e1815. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:24.996300 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bc60c159-899d-4ade-a786-cf63dce2c962 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.123990 Aug 02 06:47:24.997340 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 205/468] 10.222.0.79 () {62 vars in 1200 bytes} [Tue Aug 2 06:47:24 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 02 06:47:25.012005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9639e30e-ff95-452b-981b-aff32707ed18 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Calling method '.version_select at 0x7f927b6969d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:25.016971 n-d-851337-3 devstack@n-api.service[126119]: WARNING oslo_db.sqlalchemy.utils [None req-9639e30e-ff95-452b-981b-aff32707ed18 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 02 06:47:25.024778 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9639e30e-ff95-452b-981b-aff32707ed18 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] 10.222.0.79 "GET /compute/v2.1/os-keypairs?user_id=cc8a4d799a5e48c792eb81036dba49a9" status: 200 len: 724 microversion: 2.10 time: 0.017436 Aug 02 06:47:25.033086 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 206/469] 10.222.0.79 () {60 vars in 1259 bytes} [Tue Aug 2 06:47:25 2022] GET /compute/v2.1/os-keypairs?user_id=cc8a4d799a5e48c792eb81036dba49a9 => generated 724 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:47:25.038169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-665018e0-28b8-4966-ac9a-2b36ea023ee6 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Calling method '.version_select at 0x7f927b590670>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:25.072273 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-665018e0-28b8-4966-ac9a-2b36ea023ee6 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2075852298" status: 204 len: 0 microversion: 2.10 time: 0.037157 Aug 02 06:47:25.073144 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 207/470] 10.222.0.79 () {60 vars in 1325 bytes} [Tue Aug 2 06:47:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2075852298 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 06:47:25.084415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5b57a090-eeda-44d7-8495-2fd4a9426b18 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Calling method '.version_select at 0x7f927b507a60>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:25.100577 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7f931d4a-2548-4618-bfdf-7fbbc031b010 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "DELETE /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.430950 Aug 02 06:47:25.101313 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 264/471] 10.222.0.79 () {58 vars in 1296 bytes} [Tue Aug 2 06:47:24 2022] DELETE /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata/os_version => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:47:25.111386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9a691268-ad49-44c0-9267-1838b145fe4e tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Calling method '.version_select at 0x7f927b635670>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:25.144777 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5b57a090-eeda-44d7-8495-2fd4a9426b18 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-161548339?user_id=cc8a4d799a5e48c792eb81036dba49a9" status: 204 len: 0 microversion: 2.10 time: 0.064694 Aug 02 06:47:25.150679 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 208/472] 10.222.0.79 () {60 vars in 1340 bytes} [Tue Aug 2 06:47:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-161548339?user_id=cc8a4d799a5e48c792eb81036dba49a9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 06:47:25.156614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e1f3b655-6268-4489-9e2e-aef8eeb0cbf3 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] Calling method '.version_select at 0x7f927b62d0d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:25.164314 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9a691268-ad49-44c0-9267-1838b145fe4e tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "GET /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata" status: 200 len: 37 microversion: 2.1 time: 0.057132 Aug 02 06:47:25.172164 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 265/473] 10.222.0.79 () {58 vars in 1260 bytes} [Tue Aug 2 06:47:25 2022] GET /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata => generated 37 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:25.186084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cb9c426d-e06c-4540-a7b4-2f9209cbc53e tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Action: 'update_all', calling method: .version_select at 0x7f927b50e160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:25.215330 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e1f3b655-6268-4489-9e2e-aef8eeb0cbf3 tempest-KeyPairsV210TestJSON-619871688 tempest-KeyPairsV210TestJSON-619871688-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-513507095?user_id=cc8a4d799a5e48c792eb81036dba49a9" status: 204 len: 0 microversion: 2.10 time: 0.062625 Aug 02 06:47:25.215676 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 209/474] 10.222.0.79 () {60 vars in 1340 bytes} [Tue Aug 2 06:47:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-513507095?user_id=cc8a4d799a5e48c792eb81036dba49a9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 06:47:25.255841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fb839db6-19d6-466c-8f0f-84997720517b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:25.260252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fb839db6-19d6-466c-8f0f-84997720517b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:25.276159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-cb9c426d-e06c-4540-a7b4-2f9209cbc53e tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:25.285434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb839db6-19d6-466c-8f0f-84997720517b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:25.287260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb839db6-19d6-466c-8f0f-84997720517b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:25.288290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb839db6-19d6-466c-8f0f-84997720517b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:25.290160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb839db6-19d6-466c-8f0f-84997720517b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:25.294391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-cb9c426d-e06c-4540-a7b4-2f9209cbc53e tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for user c3300058dc7e47f2bc60fa5d609c9266 and project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:25.854593 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cb9c426d-e06c-4540-a7b4-2f9209cbc53e tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata" status: 200 len: 61 microversion: 2.1 time: 0.681023 Aug 02 06:47:25.859587 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 266/475] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:47:25 2022] PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata => generated 61 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:25.871652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-77b25b1c-9be5-4b3e-a7c2-5cb2d062c5fb tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:25.872285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-77b25b1c-9be5-4b3e-a7c2-5cb2d062c5fb tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:25.904980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77b25b1c-9be5-4b3e-a7c2-5cb2d062c5fb tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:25.905560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77b25b1c-9be5-4b3e-a7c2-5cb2d062c5fb tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:25.906592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77b25b1c-9be5-4b3e-a7c2-5cb2d062c5fb tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:25.907024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77b25b1c-9be5-4b3e-a7c2-5cb2d062c5fb tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:26.247653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-77b25b1c-9be5-4b3e-a7c2-5cb2d062c5fb tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:26.373082 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-77b25b1c-9be5-4b3e-a7c2-5cb2d062c5fb tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.510515 Aug 02 06:47:26.373704 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 267/476] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:25 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:26.380647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-95d2c3f4-c920-490f-ae5d-c91497213cdc tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Calling method '.version_select at 0x7f927b5f5d30>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:26.448759 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-95d2c3f4-c920-490f-ae5d-c91497213cdc tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "GET /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.073751 Aug 02 06:47:26.449420 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 268/477] 10.222.0.79 () {58 vars in 1290 bytes} [Tue Aug 2 06:47:26 2022] GET /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata/os_distro => generated 33 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:26.460571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7fd58ef2-0c98-4d23-9e27-44d0d4494e20 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Action: 'update_all', calling method: .version_select at 0x7f927b6ea5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:26.537493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7fd58ef2-0c98-4d23-9e27-44d0d4494e20 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:26.545477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7fd58ef2-0c98-4d23-9e27-44d0d4494e20 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for user c3300058dc7e47f2bc60fa5d609c9266 and project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:26.547111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fb839db6-19d6-466c-8f0f-84997720517b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:26.557857 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fb839db6-19d6-466c-8f0f-84997720517b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1470 microversion: 2.1 time: 1.308250 Aug 02 06:47:26.573797 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 210/478] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:25 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1470 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:26.872531 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7fd58ef2-0c98-4d23-9e27-44d0d4494e20 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata" status: 200 len: 61 microversion: 2.1 time: 0.416243 Aug 02 06:47:26.876053 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 269/479] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:47:26 2022] PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata => generated 61 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 06:47:26.882856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-78043e84-e29e-41f3-92b0-3715e42121f6 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Calling method '.version_select at 0x7f927b61b9d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:26.960964 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-78043e84-e29e-41f3-92b0-3715e42121f6 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "GET /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata" status: 200 len: 61 microversion: 2.1 time: 0.081896 Aug 02 06:47:26.961629 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 211/480] 10.222.0.79 () {58 vars in 1260 bytes} [Tue Aug 2 06:47:26 2022] GET /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata => generated 61 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:26.972368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8b2e7eaf-ba4b-47ae-9910-77c2b157dd42 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Action: 'update_all', calling method: .version_select at 0x7f927b5f5280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:27.049151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-8b2e7eaf-ba4b-47ae-9910-77c2b157dd42 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:27.054659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-8b2e7eaf-ba4b-47ae-9910-77c2b157dd42 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for user c3300058dc7e47f2bc60fa5d609c9266 and project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:27.378854 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8b2e7eaf-ba4b-47ae-9910-77c2b157dd42 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata" status: 200 len: 61 microversion: 2.1 time: 0.410407 Aug 02 06:47:27.382255 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 270/481] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:47:26 2022] PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata => generated 61 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:27.393960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b25eb426-cfe7-408b-a89b-1d681c0ad1c0 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Action: 'update_all', calling method: .version_select at 0x7f927b590430>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:27.403629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f25b672-4fe5-4fe4-9689-1bab6e41e894 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:27.404422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1f25b672-4fe5-4fe4-9689-1bab6e41e894 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:27.420721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f25b672-4fe5-4fe4-9689-1bab6e41e894 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:27.421184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f25b672-4fe5-4fe4-9689-1bab6e41e894 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:27.423804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f25b672-4fe5-4fe4-9689-1bab6e41e894 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:27.425600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f25b672-4fe5-4fe4-9689-1bab6e41e894 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:27.498117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-b25eb426-cfe7-408b-a89b-1d681c0ad1c0 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:27.515548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-b25eb426-cfe7-408b-a89b-1d681c0ad1c0 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for user c3300058dc7e47f2bc60fa5d609c9266 and project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:27.711981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-1f25b672-4fe5-4fe4-9689-1bab6e41e894 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:27.730761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:27.778212 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f25b672-4fe5-4fe4-9689-1bab6e41e894 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.379304 Aug 02 06:47:27.780931 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 271/482] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:27 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:27.807924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b9774fb1-0bad-4fc0-bad8-746f11ce852d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:27.808589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b9774fb1-0bad-4fc0-bad8-746f11ce852d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:27.835892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9774fb1-0bad-4fc0-bad8-746f11ce852d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:27.836345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9774fb1-0bad-4fc0-bad8-746f11ce852d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:27.838978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9774fb1-0bad-4fc0-bad8-746f11ce852d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:27.847450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9774fb1-0bad-4fc0-bad8-746f11ce852d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:28.077378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=13 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:28.231157 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b25eb426-cfe7-408b-a89b-1d681c0ad1c0 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata" status: 200 len: 64 microversion: 2.1 time: 0.842248 Aug 02 06:47:28.231919 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 212/483] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:47:27 2022] PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata => generated 64 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:28.242747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab36ed3d-b9a5-41d0-b55a-41395dd4ac86 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Calling method '.version_select at 0x7f927b590dc0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:28.318830 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ab36ed3d-b9a5-41d0-b55a-41395dd4ac86 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "GET /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata" status: 200 len: 64 microversion: 2.1 time: 0.081023 Aug 02 06:47:28.319629 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 213/484] 10.222.0.79 () {58 vars in 1260 bytes} [Tue Aug 2 06:47:28 2022] GET /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata => generated 64 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 06:47:28.334728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c1ba0aae-b0da-4beb-80e1-01668407ee02 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Action: 'update_all', calling method: .version_select at 0x7f927b696a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:28.402757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-c1ba0aae-b0da-4beb-80e1-01668407ee02 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:28.403952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b9774fb1-0bad-4fc0-bad8-746f11ce852d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:28.409931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-c1ba0aae-b0da-4beb-80e1-01668407ee02 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for user c3300058dc7e47f2bc60fa5d609c9266 and project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:28.415289 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b9774fb1-0bad-4fc0-bad8-746f11ce852d tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1470 microversion: 2.1 time: 0.632872 Aug 02 06:47:28.416112 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 272/485] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:27 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1470 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:28.811137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e6fe6a02-2c74-49b1-9391-3b0a30b0cf97 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:28.811962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e6fe6a02-2c74-49b1-9391-3b0a30b0cf97 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:28.821513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6fe6a02-2c74-49b1-9391-3b0a30b0cf97 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:28.822769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6fe6a02-2c74-49b1-9391-3b0a30b0cf97 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:28.833297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6fe6a02-2c74-49b1-9391-3b0a30b0cf97 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:28.833953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6fe6a02-2c74-49b1-9391-3b0a30b0cf97 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:28.921083 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c1ba0aae-b0da-4beb-80e1-01668407ee02 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata" status: 200 len: 61 microversion: 2.1 time: 0.593626 Aug 02 06:47:28.922273 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 214/486] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:47:28 2022] PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata => generated 61 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:28.935936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-96b1d3b0-381a-4912-bb0d-c3044d2e8fa2 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Action: 'update', calling method: .version_select at 0x7f927b696ee0>, body: {"meta": {"os_version": "alt"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:29.048888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-96b1d3b0-381a-4912-bb0d-c3044d2e8fa2 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:29.064315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-96b1d3b0-381a-4912-bb0d-c3044d2e8fa2 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for user c3300058dc7e47f2bc60fa5d609c9266 and project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:29.068709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-e6fe6a02-2c74-49b1-9391-3b0a30b0cf97 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:29.109153 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e6fe6a02-2c74-49b1-9391-3b0a30b0cf97 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.301990 Aug 02 06:47:29.109736 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 273/487] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:28 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:47:29.114220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b396b2b3-46f3-43c2-bf53-67e08657c6ba tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:29.114707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b396b2b3-46f3-43c2-bf53-67e08657c6ba tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:29.132808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b396b2b3-46f3-43c2-bf53-67e08657c6ba tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:29.133246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b396b2b3-46f3-43c2-bf53-67e08657c6ba tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:29.134399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b396b2b3-46f3-43c2-bf53-67e08657c6ba tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:29.134833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b396b2b3-46f3-43c2-bf53-67e08657c6ba tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:29.193637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b396b2b3-46f3-43c2-bf53-67e08657c6ba tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:47:29.405603 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b396b2b3-46f3-43c2-bf53-67e08657c6ba tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "DELETE /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 204 len: 0 microversion: 2.1 time: 0.294557 Aug 02 06:47:29.407317 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 274/488] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:47:29 2022] DELETE /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:47:29.442423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0a6e06fa-b2e7-449d-b9d8-62c6761cd116 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:29.443620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0a6e06fa-b2e7-449d-b9d8-62c6761cd116 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:29.455815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a6e06fa-b2e7-449d-b9d8-62c6761cd116 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:29.458212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a6e06fa-b2e7-449d-b9d8-62c6761cd116 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:29.460230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a6e06fa-b2e7-449d-b9d8-62c6761cd116 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:29.460972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a6e06fa-b2e7-449d-b9d8-62c6761cd116 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:29.564511 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-96b1d3b0-381a-4912-bb0d-c3044d2e8fa2 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.636510 Aug 02 06:47:29.565778 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 215/489] 10.222.0.79 () {60 vars in 1313 bytes} [Tue Aug 2 06:47:28 2022] PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata/os_version => generated 31 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 06:47:29.575166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8224f1a8-f21f-48e4-99bf-667ce130ea66 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Calling method '.version_select at 0x7f927b590040>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:29.628901 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8224f1a8-f21f-48e4-99bf-667ce130ea66 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "GET /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata" status: 200 len: 58 microversion: 2.1 time: 0.057532 Aug 02 06:47:29.636647 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 216/490] 10.222.0.79 () {58 vars in 1260 bytes} [Tue Aug 2 06:47:29 2022] GET /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata => generated 58 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:30.093430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0a6e06fa-b2e7-449d-b9d8-62c6761cd116 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:30.109447 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0a6e06fa-b2e7-449d-b9d8-62c6761cd116 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1470 microversion: 2.1 time: 0.670025 Aug 02 06:47:30.110806 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 275/491] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:29 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1470 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:47:30.122558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-46ee161e-7f2c-445d-8d5f-c750078709e7 tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423 tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:30.123756 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:30.123756 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:30.127468 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-46ee161e-7f2c-445d-8d5f-c750078709e7 tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423 tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 02 06:47:30.136584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e5aadf39-f2c1-4c78-a027-7f2329306924 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Action: 'update_all', calling method: .version_select at 0x7f927b6ead30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-46ee161e-7f2c-445d-8d5f-c750078709e7 tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423 tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423-project-admin] Request method failure captured: Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiBk9UctNqqGNyBqa3MO9mPaiWmZK8syJmTIHpul24u-CHZxa5aqzYQV_XCR27llaQeLwYk1hL-bvsV1fRTRgzxp2tiEFP2uBQGOJEAAXUY8ApXNfL58PPh5oBRfdMieOCwTFe5PTBVgp4HjY5g7F5v3XTgi3P7rbResVyxhS53H7A Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 5f97b8e8797245999d593251fd6f1ae2 Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423 Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:47:30.148215 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:47:30.149535 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5f97b8e8797245999d593251fd6f1ae2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5f97b8e8797245999d593251fd6f1ae2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5f97b8e8797245999d593251fd6f1ae2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5f97b8e8797245999d593251fd6f1ae2"}]}] Aug 02 06:47:30.149535 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423 Aug 02 06:47:30.149535 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 5f97b8e8797245999d593251fd6f1ae2 Aug 02 06:47:30.149535 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423 Aug 02 06:47:30.149535 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423-project-admin Aug 02 06:47:30.149535 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:47:30.149535 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:47:30.149535 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 5fbff57c4cf34552afea0d96b8ab65be Aug 02 06:47:30.149535 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423-project-admin Aug 02 06:47:30.149535 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:47:30.149535 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid timestamp for date invalid_time Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'invalid_time'} Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:30.150353 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:30.151585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 02 06:47:30.151585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 02 06:47:30.151585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 02 06:47:30.151585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:30.151585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:30.151585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:30.151585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:30.151585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:30.151585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:30.151585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:30.151585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:30.151585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 02 06:47:30.151585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:30.154440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-46ee161e-7f2c-445d-8d5f-c750078709e7 tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423 tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:30.157603 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-46ee161e-7f2c-445d-8d5f-c750078709e7 tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423 tempest-InstanceUsageAuditLogNegativeTestJSON-1859983423-project-admin] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.519704 Aug 02 06:47:30.159683 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 217/492] 10.222.0.79 () {58 vars in 1224 bytes} [Tue Aug 2 06:47:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 522 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 02 06:47:30.172094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1664623680", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "1804928652", "adminPass": "***", "networks": [{"uuid": "178d4ee9-06a0-46b2-b8bd-814f8a6113fd"}], "security_groups": [{"name": "tempest-securitygroup--106403822"}], "key_name": "tempest-keypair-1309647087", "user_data": "}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:30.246921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-e5aadf39-f2c1-4c78-a027-7f2329306924 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:30.258749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-e5aadf39-f2c1-4c78-a027-7f2329306924 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for user c3300058dc7e47f2bc60fa5d609c9266 and project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:30.460622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] validate_networks() for [('178d4ee9-06a0-46b2-b8bd-814f8a6113fd', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:47:30.797772 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e5aadf39-f2c1-4c78-a027-7f2329306924 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata" status: 200 len: 61 microversion: 2.1 time: 0.684528 Aug 02 06:47:30.804226 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 276/493] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:47:30 2022] PUT /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata => generated 61 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:30.809791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df6fa56f-5998-4087-8d3b-65b5d29d9651 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:30.810691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df6fa56f-5998-4087-8d3b-65b5d29d9651 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:30.817862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df6fa56f-5998-4087-8d3b-65b5d29d9651 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:30.818624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df6fa56f-5998-4087-8d3b-65b5d29d9651 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:30.819640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df6fa56f-5998-4087-8d3b-65b5d29d9651 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:30.820276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df6fa56f-5998-4087-8d3b-65b5d29d9651 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:30.950027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-df6fa56f-5998-4087-8d3b-65b5d29d9651 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:30.997282 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df6fa56f-5998-4087-8d3b-65b5d29d9651 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.191597 Aug 02 06:47:31.001058 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 277/494] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:30 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:31.389194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:47:31.390311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:47:31.390971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:47:31.391548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:47:31.392109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:47:31.408429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dcd9c5a0-d4fb-4501-ba14-84cd85a6027a tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 tempest-InstanceUsageAuditLogNegativeTestJSON-275354848-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:31.409591 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:31.409591 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:31.410410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:31.410735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dcd9c5a0-d4fb-4501-ba14-84cd85a6027a tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 tempest-InstanceUsageAuditLogNegativeTestJSON-275354848-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '4b1abd73c5354e7289e09b1e72410249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdd8c22f5aa4fb087954bcf09cdaf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:31.411204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:31.412159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dcd9c5a0-d4fb-4501-ba14-84cd85a6027a tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 tempest-InstanceUsageAuditLogNegativeTestJSON-275354848-project] Request method failure captured: Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MiAtX_f2vyvbrViXzfhNxcgReJtm5ueHTRHiXkB1ltGYueoNeQ_7HtS8V5bv3ojIi9f12wB77FLeXpLcE3FMe9i0-j6u5hmnHOMqHsJcEQByH5Trqd78O0HDO-mJTEuJKITnCCvdPoeBvRpSZckbLXcQqtqnj0wC_-2P8oZfcbeOSM Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 7bdd8c22f5aa4fb087954bcf09cdaf26 Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:47:31.412603 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:47:31.414049 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7bdd8c22f5aa4fb087954bcf09cdaf26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7bdd8c22f5aa4fb087954bcf09cdaf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7bdd8c22f5aa4fb087954bcf09cdaf26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7bdd8c22f5aa4fb087954bcf09cdaf26"}]}] Aug 02 06:47:31.414049 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 Aug 02 06:47:31.414049 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 7bdd8c22f5aa4fb087954bcf09cdaf26 Aug 02 06:47:31.414049 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 Aug 02 06:47:31.414049 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-275354848-project Aug 02 06:47:31.414049 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:47:31.414049 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:47:31.414049 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4b1abd73c5354e7289e09b1e72410249 Aug 02 06:47:31.414049 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-275354848-project Aug 02 06:47:31.414049 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: action_args: {} Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:47:31.414631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 02 06:47:31.415730 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:31.416650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dcd9c5a0-d4fb-4501-ba14-84cd85a6027a tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 tempest-InstanceUsageAuditLogNegativeTestJSON-275354848-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:31.416650 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dcd9c5a0-d4fb-4501-ba14-84cd85a6027a tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 tempest-InstanceUsageAuditLogNegativeTestJSON-275354848-project] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.411014 Aug 02 06:47:31.417677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:31.419006 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 278/495] 10.222.0.79 () {58 vars in 1185 bytes} [Tue Aug 2 06:47:31 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 417 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:47:31.434443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-610dc072-00a3-4f95-966a-61fc9b9adaf8 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Action: 'create', calling method: .version_select at 0x7f927b407550>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:31.459660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Getting quotas for project fcf8ed73c2f64b7194098acb56270897. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:31.479341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Getting quotas for user 5c5e925155c248be81bfc65bc7652ab6 and project fcf8ed73c2f64b7194098acb56270897. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:31.512447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:47:31.516248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:47:31.517320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-610dc072-00a3-4f95-966a-61fc9b9adaf8 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:31.530396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-610dc072-00a3-4f95-966a-61fc9b9adaf8 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Getting quotas for user c3300058dc7e47f2bc60fa5d609c9266 and project 8c6b2b6775a34884b23e16587a520c01. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:31.562590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:31.639119 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-243d5883-d693-497e-aba7-efc6f5ffb35a tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.472652 Aug 02 06:47:31.645696 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 218/496] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:47:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:47:31.648180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d7e212f0-37b0-4338-b108-100a2e3ef106 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:31.650346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d7e212f0-37b0-4338-b108-100a2e3ef106 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:31.689912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7e212f0-37b0-4338-b108-100a2e3ef106 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:31.690471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7e212f0-37b0-4338-b108-100a2e3ef106 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:31.691632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7e212f0-37b0-4338-b108-100a2e3ef106 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:31.691714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7e212f0-37b0-4338-b108-100a2e3ef106 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:32.278442 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-610dc072-00a3-4f95-966a-61fc9b9adaf8 tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "POST /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata" status: 200 len: 85 microversion: 2.1 time: 0.858249 Aug 02 06:47:32.279043 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 279/497] 10.222.0.79 () {60 vars in 1281 bytes} [Tue Aug 2 06:47:31 2022] POST /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata => generated 85 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:32.298326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6116511d-517f-4902-af12-68c57ccf084a tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 tempest-InstanceUsageAuditLogNegativeTestJSON-275354848-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:32.302169 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:32.302169 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:32.308315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6116511d-517f-4902-af12-68c57ccf084a tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 tempest-InstanceUsageAuditLogNegativeTestJSON-275354848-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '4b1abd73c5354e7289e09b1e72410249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdd8c22f5aa4fb087954bcf09cdaf26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6116511d-517f-4902-af12-68c57ccf084a tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 tempest-InstanceUsageAuditLogNegativeTestJSON-275354848-project] Request method failure captured: Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-02%2006:47:31 HTTP/1.1 Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MiAtX_f2vyvbrViXzfhNxcgReJtm5ueHTRHiXkB1ltGYueoNeQ_7HtS8V5bv3ojIi9f12wB77FLeXpLcE3FMe9i0-j6u5hmnHOMqHsJcEQByH5Trqd78O0HDO-mJTEuJKITnCCvdPoeBvRpSZckbLXcQqtqnj0wC_-2P8oZfcbeOSM Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 7bdd8c22f5aa4fb087954bcf09cdaf26 Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:47:32.313385 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:47:32.314649 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7bdd8c22f5aa4fb087954bcf09cdaf26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7bdd8c22f5aa4fb087954bcf09cdaf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7bdd8c22f5aa4fb087954bcf09cdaf26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7bdd8c22f5aa4fb087954bcf09cdaf26"}]}] Aug 02 06:47:32.314649 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 Aug 02 06:47:32.314649 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 7bdd8c22f5aa4fb087954bcf09cdaf26 Aug 02 06:47:32.314649 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 Aug 02 06:47:32.314649 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-275354848-project Aug 02 06:47:32.314649 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:47:32.314649 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:47:32.314649 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4b1abd73c5354e7289e09b1e72410249 Aug 02 06:47:32.314649 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-275354848-project Aug 02 06:47:32.314649 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '2022-08-02 06:47:31'} Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:47:32.315327 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 02 06:47:32.316432 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:32.325645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6116511d-517f-4902-af12-68c57ccf084a tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 tempest-InstanceUsageAuditLogNegativeTestJSON-275354848-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:32.326990 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6116511d-517f-4902-af12-68c57ccf084a tempest-InstanceUsageAuditLogNegativeTestJSON-275354848 tempest-InstanceUsageAuditLogNegativeTestJSON-275354848-project] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-02 06:47:31" status: 403 len: 128 microversion: 2.1 time: 0.039296 Aug 02 06:47:32.328045 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 280/498] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Aug 2 06:47:32 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-02%2006%3A47%3A31 => generated 128 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:47:32.340136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-98f76e22-94fe-43de-bdde-ca3d6881b765 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:32.341861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-98f76e22-94fe-43de-bdde-ca3d6881b765 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:32.524561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-98f76e22-94fe-43de-bdde-ca3d6881b765 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:32.536689 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-98f76e22-94fe-43de-bdde-ca3d6881b765 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1265 microversion: 2.1 time: 0.205703 Aug 02 06:47:32.538588 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 281/499] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:32 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:32.552911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5d72c67e-fedb-4f7d-a16c-9cc4f5d51a68 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:32.556419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5d72c67e-fedb-4f7d-a16c-9cc4f5d51a68 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:32.572405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d72c67e-fedb-4f7d-a16c-9cc4f5d51a68 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:32.572943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d72c67e-fedb-4f7d-a16c-9cc4f5d51a68 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:32.573774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d72c67e-fedb-4f7d-a16c-9cc4f5d51a68 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:32.574207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d72c67e-fedb-4f7d-a16c-9cc4f5d51a68 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:33.112048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-5d72c67e-fedb-4f7d-a16c-9cc4f5d51a68 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:33.154801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d7e212f0-37b0-4338-b108-100a2e3ef106 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:33.168538 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d7e212f0-37b0-4338-b108-100a2e3ef106 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1470 microversion: 2.1 time: 1.526932 Aug 02 06:47:33.171744 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 219/500] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:31 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1470 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:33.174005 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5d72c67e-fedb-4f7d-a16c-9cc4f5d51a68 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.634081 Aug 02 06:47:33.195533 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 282/501] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:32 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:33.197796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f652a5ec-d813-4725-b526-a1161878575f tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] Calling method '.version_select at 0x7f927b696f70>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:33.245056 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f652a5ec-d813-4725-b526-a1161878575f tempest-ImagesMetadataTestJSON-1706457392 tempest-ImagesMetadataTestJSON-1706457392-project] 10.222.0.79 "GET /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata" status: 200 len: 85 microversion: 2.1 time: 0.069530 Aug 02 06:47:33.251948 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 220/502] 10.222.0.79 () {58 vars in 1260 bytes} [Tue Aug 2 06:47:33 2022] GET /compute/v2.1/images/aff897e3-0710-4143-84fa-608a941c1557/metadata => generated 85 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:47:33.542380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f7bf5e7f-fefd-45bd-9ac2-f9d0bce962ee tempest-QuotaClassesAdminTestJSON-632367001 tempest-QuotaClassesAdminTestJSON-632367001-project-admin] Calling method '.version_select at 0x7f927b6ea940>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:33.557060 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:33.557060 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:33.578858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5ae3a2a4-85f6-4128-acc6-3cef8b891706 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:33.581549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5ae3a2a4-85f6-4128-acc6-3cef8b891706 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:33.582644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:33.599537 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f7bf5e7f-fefd-45bd-9ac2-f9d0bce962ee tempest-QuotaClassesAdminTestJSON-632367001 tempest-QuotaClassesAdminTestJSON-632367001-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.405531 Aug 02 06:47:33.601641 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 283/503] 10.222.0.79 () {58 vars in 1185 bytes} [Tue Aug 2 06:47:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:33.619801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ae3a2a4-85f6-4128-acc6-3cef8b891706 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:33.621707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ae3a2a4-85f6-4128-acc6-3cef8b891706 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:33.624386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ae3a2a4-85f6-4128-acc6-3cef8b891706 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:33.625957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ae3a2a4-85f6-4128-acc6-3cef8b891706 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:33.650220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e94f2e06-ee07-4408-9118-583845d5462a tempest-QuotaClassesAdminTestJSON-632367001 tempest-QuotaClassesAdminTestJSON-632367001-project-admin] Action: 'update', calling method: .version_select at 0x7f927b5f5550>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:33.684397 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:33.684397 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:34.041294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5ae3a2a4-85f6-4128-acc6-3cef8b891706 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:34.057813 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5ae3a2a4-85f6-4128-acc6-3cef8b891706 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1317 microversion: 2.1 time: 0.501174 Aug 02 06:47:34.062477 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 221/504] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:33 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:34.195365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c419e694-25c8-4363-8cf4-2f65be5b5413 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:34.200484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c419e694-25c8-4363-8cf4-2f65be5b5413 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:34.222770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c419e694-25c8-4363-8cf4-2f65be5b5413 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:34.224865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c419e694-25c8-4363-8cf4-2f65be5b5413 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:34.226000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c419e694-25c8-4363-8cf4-2f65be5b5413 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:34.233684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c419e694-25c8-4363-8cf4-2f65be5b5413 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:34.439691 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e94f2e06-ee07-4408-9118-583845d5462a tempest-QuotaClassesAdminTestJSON-632367001 tempest-QuotaClassesAdminTestJSON-632367001-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.826797 Aug 02 06:47:34.444521 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 284/505] 10.222.0.79 () {60 vars in 1206 bytes} [Tue Aug 2 06:47:33 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:34.454085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2b9aa05-c6e9-42a8-a7c8-2ad9bf68b975 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:34.454640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f2b9aa05-c6e9-42a8-a7c8-2ad9bf68b975 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:34.467938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2b9aa05-c6e9-42a8-a7c8-2ad9bf68b975 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:34.472463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2b9aa05-c6e9-42a8-a7c8-2ad9bf68b975 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:34.473321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2b9aa05-c6e9-42a8-a7c8-2ad9bf68b975 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:34.473769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2b9aa05-c6e9-42a8-a7c8-2ad9bf68b975 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:34.532619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:34.766540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-f2b9aa05-c6e9-42a8-a7c8-2ad9bf68b975 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:34.802259 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f2b9aa05-c6e9-42a8-a7c8-2ad9bf68b975 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.356583 Aug 02 06:47:34.805819 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 285/506] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:34 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:34.827690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c1265536-5384-4312-b7f8-c9c03858bd1b tempest-QuotaClassesAdminTestJSON-632367001 tempest-QuotaClassesAdminTestJSON-632367001-project-admin] Calling method '.version_select at 0x7f927b4079d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:34.828507 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:34.828507 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:34.879855 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c1265536-5384-4312-b7f8-c9c03858bd1b tempest-QuotaClassesAdminTestJSON-632367001 tempest-QuotaClassesAdminTestJSON-632367001-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.068118 Aug 02 06:47:34.880447 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 286/507] 10.222.0.79 () {58 vars in 1185 bytes} [Tue Aug 2 06:47:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:34.904046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0f7981c3-2a86-45f8-a58b-241162d47888 tempest-QuotaClassesAdminTestJSON-632367001 tempest-QuotaClassesAdminTestJSON-632367001-project-admin] Action: 'update', calling method: .version_select at 0x7f927b3e7670>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:34.920604 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:34.920604 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:34.933177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c419e694-25c8-4363-8cf4-2f65be5b5413 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:34.950622 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c419e694-25c8-4363-8cf4-2f65be5b5413 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1476 microversion: 2.1 time: 0.761579 Aug 02 06:47:34.951473 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 222/508] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:34 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1476 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:35.086345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f0a936cf-8b33-4465-abdd-bdebb4f8e473 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:35.087305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f0a936cf-8b33-4465-abdd-bdebb4f8e473 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:35.101502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0a936cf-8b33-4465-abdd-bdebb4f8e473 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:35.102553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0a936cf-8b33-4465-abdd-bdebb4f8e473 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:35.103550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0a936cf-8b33-4465-abdd-bdebb4f8e473 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:35.104305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0a936cf-8b33-4465-abdd-bdebb4f8e473 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:35.133425 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0f7981c3-2a86-45f8-a58b-241162d47888 tempest-QuotaClassesAdminTestJSON-632367001 tempest-QuotaClassesAdminTestJSON-632367001-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.244690 Aug 02 06:47:35.142297 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 287/509] 10.222.0.79 () {60 vars in 1206 bytes} [Tue Aug 2 06:47:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:35.369440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f0a936cf-8b33-4465-abdd-bdebb4f8e473 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:35.382406 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f0a936cf-8b33-4465-abdd-bdebb4f8e473 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1323 microversion: 2.1 time: 0.300122 Aug 02 06:47:35.397091 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 223/510] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:35 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1323 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:35.838168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-819a3e82-d885-4577-bf87-07fda18345e6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:35.839881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-819a3e82-d885-4577-bf87-07fda18345e6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:35.869306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-819a3e82-d885-4577-bf87-07fda18345e6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:35.870720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-819a3e82-d885-4577-bf87-07fda18345e6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:35.875619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-819a3e82-d885-4577-bf87-07fda18345e6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:35.879010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-819a3e82-d885-4577-bf87-07fda18345e6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:35.973659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9578db83-850d-4859-ab9a-46114ac5debd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:35.974310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9578db83-850d-4859-ab9a-46114ac5debd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:36.003969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9578db83-850d-4859-ab9a-46114ac5debd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:36.007058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9578db83-850d-4859-ab9a-46114ac5debd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:36.012905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9578db83-850d-4859-ab9a-46114ac5debd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:36.018653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9578db83-850d-4859-ab9a-46114ac5debd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:37.069699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-819a3e82-d885-4577-bf87-07fda18345e6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:37.117439 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-819a3e82-d885-4577-bf87-07fda18345e6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 1.288286 Aug 02 06:47:37.130840 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 288/511] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:35 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:37.142594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f5b1495e-e7c0-4426-84e7-ddf560e01f09 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:37.143772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f5b1495e-e7c0-4426-84e7-ddf560e01f09 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:37.149459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=24,nova_api:INSERT=12 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:37.151453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5b1495e-e7c0-4426-84e7-ddf560e01f09 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:37.152097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5b1495e-e7c0-4426-84e7-ddf560e01f09 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:37.153066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5b1495e-e7c0-4426-84e7-ddf560e01f09 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:37.153689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5b1495e-e7c0-4426-84e7-ddf560e01f09 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:37.377654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f5b1495e-e7c0-4426-84e7-ddf560e01f09 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:37.393569 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f5b1495e-e7c0-4426-84e7-ddf560e01f09 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1323 microversion: 2.1 time: 0.253662 Aug 02 06:47:37.394561 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 289/512] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:37 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1323 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:37.405657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-4a5e6742-6cd1-40d9-8b0a-6a39edff5d82 req-04d01313-7c05-4e3f-b61a-b6a9eaa6459d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9733613-ae5d-4c27-bf69-3958cd6e459c", "name": "network-vif-unplugged", "status": "completed", "tag": "0020b2b9-f4f6-4a11-bb9e-d97035e3f4d9"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:37.434879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4a5e6742-6cd1-40d9-8b0a-6a39edff5d82 req-04d01313-7c05-4e3f-b61a-b6a9eaa6459d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:37.435699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4a5e6742-6cd1-40d9-8b0a-6a39edff5d82 req-04d01313-7c05-4e3f-b61a-b6a9eaa6459d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:37.478842 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-4a5e6742-6cd1-40d9-8b0a-6a39edff5d82 req-04d01313-7c05-4e3f-b61a-b6a9eaa6459d service nova] Creating event network-vif-unplugged:0020b2b9-f4f6-4a11-bb9e-d97035e3f4d9 for instance d9733613-ae5d-4c27-bf69-3958cd6e459c on n-h2-851337-3 Aug 02 06:47:37.489632 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-4a5e6742-6cd1-40d9-8b0a-6a39edff5d82 req-04d01313-7c05-4e3f-b61a-b6a9eaa6459d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092564 Aug 02 06:47:37.491847 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 290/513] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:37.506357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-2a48d284-5527-4c36-8698-ab5386aefb94 req-4a630c6e-ecd0-4d15-9995-a81376442167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "996312b8-1c9c-4def-aa0b-4eaf8f74e3c8", "name": "network-vif-deleted", "tag": "bfaf7f27-ecd4-4a2a-bbfd-d833f7f8f759"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:37.528000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2a48d284-5527-4c36-8698-ab5386aefb94 req-4a630c6e-ecd0-4d15-9995-a81376442167 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:37.531806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2a48d284-5527-4c36-8698-ab5386aefb94 req-4a630c6e-ecd0-4d15-9995-a81376442167 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:37.551086 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-2a48d284-5527-4c36-8698-ab5386aefb94 req-4a630c6e-ecd0-4d15-9995-a81376442167 service nova] Creating event network-vif-deleted:bfaf7f27-ecd4-4a2a-bbfd-d833f7f8f759 for instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 on n-h2-851337-3 Aug 02 06:47:37.561416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9578db83-850d-4859-ab9a-46114ac5debd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:37.564037 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-2a48d284-5527-4c36-8698-ab5386aefb94 req-4a630c6e-ecd0-4d15-9995-a81376442167 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068746 Aug 02 06:47:37.567256 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 291/514] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:37.575808 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9578db83-850d-4859-ab9a-46114ac5debd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1476 microversion: 2.1 time: 1.604540 Aug 02 06:47:37.576691 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 224/515] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:35 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1476 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:47:38.154684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0458f458-3882-4509-8c84-cdfb5cc652c6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:38.155395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0458f458-3882-4509-8c84-cdfb5cc652c6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:38.181098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0458f458-3882-4509-8c84-cdfb5cc652c6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:38.181539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0458f458-3882-4509-8c84-cdfb5cc652c6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:38.182350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0458f458-3882-4509-8c84-cdfb5cc652c6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:38.182779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0458f458-3882-4509-8c84-cdfb5cc652c6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:38.406205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-0458f458-3882-4509-8c84-cdfb5cc652c6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:38.420135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c97927bf-1ede-41ec-bc79-377b1bd04a17 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:38.420990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c97927bf-1ede-41ec-bc79-377b1bd04a17 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:38.431861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c97927bf-1ede-41ec-bc79-377b1bd04a17 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:38.435429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c97927bf-1ede-41ec-bc79-377b1bd04a17 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:38.439962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c97927bf-1ede-41ec-bc79-377b1bd04a17 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:38.440589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c97927bf-1ede-41ec-bc79-377b1bd04a17 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:38.494102 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0458f458-3882-4509-8c84-cdfb5cc652c6 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.348242 Aug 02 06:47:38.494698 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 292/516] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:38 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:38.598236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6bdf4a72-c12e-469b-9c8a-3c328cbfab34 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:38.599207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6bdf4a72-c12e-469b-9c8a-3c328cbfab34 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:38.612684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bdf4a72-c12e-469b-9c8a-3c328cbfab34 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:38.613127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bdf4a72-c12e-469b-9c8a-3c328cbfab34 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:38.613931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bdf4a72-c12e-469b-9c8a-3c328cbfab34 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:38.614357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bdf4a72-c12e-469b-9c8a-3c328cbfab34 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:38.995360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6bdf4a72-c12e-469b-9c8a-3c328cbfab34 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:39.009357 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6bdf4a72-c12e-469b-9c8a-3c328cbfab34 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1476 microversion: 2.1 time: 0.411718 Aug 02 06:47:39.010645 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 293/517] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:38 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1476 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:47:39.018453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c97927bf-1ede-41ec-bc79-377b1bd04a17 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:39.029376 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c97927bf-1ede-41ec-bc79-377b1bd04a17 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1390 microversion: 2.1 time: 0.613900 Aug 02 06:47:39.033782 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 225/518] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:38 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1390 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:39.521649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9a492be1-8cc6-4798-9e93-e9fd66b5ba65 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:39.522433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9a492be1-8cc6-4798-9e93-e9fd66b5ba65 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:39.529001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a492be1-8cc6-4798-9e93-e9fd66b5ba65 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:39.529782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a492be1-8cc6-4798-9e93-e9fd66b5ba65 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:39.530896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a492be1-8cc6-4798-9e93-e9fd66b5ba65 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:39.531558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a492be1-8cc6-4798-9e93-e9fd66b5ba65 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:39.664751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-9a492be1-8cc6-4798-9e93-e9fd66b5ba65 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:39.690135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-4ed1f940-bdb6-41ed-8c8e-0b02f090ef26 req-a7fbe2c6-9f55-4d0b-bf6c-c9923131f0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428968c0-25cc-47b2-bfa1-6147889fdcdf", "tag": "4565e0ac-4aff-4f72-a7b3-08e4dfc5a210"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:39.711744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-4ed1f940-bdb6-41ed-8c8e-0b02f090ef26 req-a7fbe2c6-9f55-4d0b-bf6c-c9923131f0e3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:39.712183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-4ed1f940-bdb6-41ed-8c8e-0b02f090ef26 req-a7fbe2c6-9f55-4d0b-bf6c-c9923131f0e3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:39.726565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:39.727346 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9a492be1-8cc6-4798-9e93-e9fd66b5ba65 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.208966 Aug 02 06:47:39.729779 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 294/519] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:39 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:39.754278 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-4ed1f940-bdb6-41ed-8c8e-0b02f090ef26 req-a7fbe2c6-9f55-4d0b-bf6c-c9923131f0e3 service nova] Creating event network-changed:4565e0ac-4aff-4f72-a7b3-08e4dfc5a210 for instance 428968c0-25cc-47b2-bfa1-6147889fdcdf on n-h1-851337-3 Aug 02 06:47:39.766424 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-4ed1f940-bdb6-41ed-8c8e-0b02f090ef26 req-a7fbe2c6-9f55-4d0b-bf6c-c9923131f0e3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081460 Aug 02 06:47:39.770391 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 226/520] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:40.033014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-093bfcaa-f1f6-46ce-a52b-e9801fbecc85 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:40.034619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-093bfcaa-f1f6-46ce-a52b-e9801fbecc85 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:40.046322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-093bfcaa-f1f6-46ce-a52b-e9801fbecc85 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:40.049532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-093bfcaa-f1f6-46ce-a52b-e9801fbecc85 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:40.050772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-093bfcaa-f1f6-46ce-a52b-e9801fbecc85 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:40.053964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-093bfcaa-f1f6-46ce-a52b-e9801fbecc85 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:40.057821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-07660907-1b3b-4fb5-a49e-75ed02309d6e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:40.058573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-07660907-1b3b-4fb5-a49e-75ed02309d6e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:40.076993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07660907-1b3b-4fb5-a49e-75ed02309d6e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:40.089583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07660907-1b3b-4fb5-a49e-75ed02309d6e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:40.090479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07660907-1b3b-4fb5-a49e-75ed02309d6e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:40.090916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07660907-1b3b-4fb5-a49e-75ed02309d6e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:40.988935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-093bfcaa-f1f6-46ce-a52b-e9801fbecc85 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:40.997211 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-093bfcaa-f1f6-46ce-a52b-e9801fbecc85 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1476 microversion: 2.1 time: 0.968377 Aug 02 06:47:41.014553 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 295/521] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:40 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1476 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:41.026565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7ec86d8-3411-40b5-8933-a4708002fae5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:41.027582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e7ec86d8-3411-40b5-8933-a4708002fae5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:41.041973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7ec86d8-3411-40b5-8933-a4708002fae5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:41.053163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7ec86d8-3411-40b5-8933-a4708002fae5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:41.054214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7ec86d8-3411-40b5-8933-a4708002fae5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:41.054806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7ec86d8-3411-40b5-8933-a4708002fae5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:41.056318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-07660907-1b3b-4fb5-a49e-75ed02309d6e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:41.074220 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-07660907-1b3b-4fb5-a49e-75ed02309d6e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1390 microversion: 2.1 time: 1.020454 Aug 02 06:47:41.077577 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 227/522] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:40 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1390 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:41.322890 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-e7ec86d8-3411-40b5-8933-a4708002fae5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:41.376073 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7ec86d8-3411-40b5-8933-a4708002fae5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.359804 Aug 02 06:47:41.384735 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 296/523] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:41 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:41.438707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:41.490034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=26 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:41.566625 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6d92cbef-79f5-4952-8719-d39809eb5b8b tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] 10.222.0.79 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.487463 Aug 02 06:47:41.567559 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 228/524] 10.222.0.79 () {58 vars in 1128 bytes} [Tue Aug 2 06:47:41 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 489 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 06:47:41.575007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-02070335-aed1-4fef-b55f-80c80c86d99d req-e06ebc34-bf09-44fe-84ec-fcb680fe14aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9733613-ae5d-4c27-bf69-3958cd6e459c", "name": "network-vif-plugged", "status": "completed", "tag": "0020b2b9-f4f6-4a11-bb9e-d97035e3f4d9"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:41.577653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb8015af-ebfc-4b1d-9edd-f52cdf3da309 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Calling method '.version_select at 0x7f927b4d8940>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:41.601876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-02070335-aed1-4fef-b55f-80c80c86d99d req-e06ebc34-bf09-44fe-84ec-fcb680fe14aa service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:41.601876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-02070335-aed1-4fef-b55f-80c80c86d99d req-e06ebc34-bf09-44fe-84ec-fcb680fe14aa service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:41.665235 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-02070335-aed1-4fef-b55f-80c80c86d99d req-e06ebc34-bf09-44fe-84ec-fcb680fe14aa service nova] Creating event network-vif-plugged:0020b2b9-f4f6-4a11-bb9e-d97035e3f4d9 for instance d9733613-ae5d-4c27-bf69-3958cd6e459c on n-h2-851337-3 Aug 02 06:47:41.666312 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-cb8015af-ebfc-4b1d-9edd-f52cdf3da309 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] HTTP exception thrown: Image not found. Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb8015af-ebfc-4b1d-9edd-f52cdf3da309 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Request method failure captured: Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiMMgZ0Dqd0ZH6HtytMjLzFJfGa5iJ0eCEPDyqibNBayFDl46SK0ESpp0YsL_yJ5J_ImnYAfH9GOmsI3CNZfYNsFdoR9X5aAS2dfG5SzW7h1M2aHyw4B4tQ8UPXqpdlv0uGxQiloVssMY6XMZoDsAWAbCnvm32JtkZJwQWQ6TfX0z0 Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: bb1c9add417849d2bb6f59cfef4d9189 Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:47:41.679509 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:47:41.680834 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bb1c9add417849d2bb6f59cfef4d9189"}]}] Aug 02 06:47:41.680834 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.680834 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: bb1c9add417849d2bb6f59cfef4d9189 Aug 02 06:47:41.680834 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.680834 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesDeleteNegativeTestJSON-1802768033-project Aug 02 06:47:41.680834 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:47:41.680834 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:47:41.680834 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 745add58b6ab4303bb813569650b8fd2 Aug 02 06:47:41.680834 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033-project Aug 02 06:47:41.680834 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:47:41.680834 n-d-851337-3 devstack@n-api.service[126119]: exception: Image not found. Aug 02 06:47:41.680834 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '-1'} Aug 02 06:47:41.680834 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:41.680834 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.681709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:41.683383 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 02 06:47:41.684615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:47:41.684615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:47:41.684615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.684615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.684615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.684615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.684615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:41.684615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:41.684615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:41.684615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:41.684615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:47:41.684615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.684615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb8015af-ebfc-4b1d-9edd-f52cdf3da309 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Returning 404 to user: Image not found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:41.684615 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cb8015af-ebfc-4b1d-9edd-f52cdf3da309 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] 10.222.0.79 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.108508 Aug 02 06:47:41.689036 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 229/525] 10.222.0.79 () {58 vars in 1134 bytes} [Tue Aug 2 06:47:41 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:47:41.692437 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-02070335-aed1-4fef-b55f-80c80c86d99d req-e06ebc34-bf09-44fe-84ec-fcb680fe14aa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125138 Aug 02 06:47:41.709410 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 297/526] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:47:41.712917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1b5233db-3a0c-4735-bc46-da471b3f74a0 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Calling method '.version_select at 0x7f927b4e2310>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:41.777375 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-1b5233db-3a0c-4735-bc46-da471b3f74a0 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] HTTP exception thrown: Image not found. Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1b5233db-3a0c-4735-bc46-da471b3f74a0 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Request method failure captured: Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/images/2ef6f3b3-0d1e-4a68-919b-9a254f0067fj HTTP/1.1 Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiMMgZ0Dqd0ZH6HtytMjLzFJfGa5iJ0eCEPDyqibNBayFDl46SK0ESpp0YsL_yJ5J_ImnYAfH9GOmsI3CNZfYNsFdoR9X5aAS2dfG5SzW7h1M2aHyw4B4tQ8UPXqpdlv0uGxQiloVssMY6XMZoDsAWAbCnvm32JtkZJwQWQ6TfX0z0 Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: bb1c9add417849d2bb6f59cfef4d9189 Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:47:41.780671 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:47:41.782169 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bb1c9add417849d2bb6f59cfef4d9189"}]}] Aug 02 06:47:41.782169 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.782169 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: bb1c9add417849d2bb6f59cfef4d9189 Aug 02 06:47:41.782169 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.782169 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesDeleteNegativeTestJSON-1802768033-project Aug 02 06:47:41.782169 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:47:41.782169 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:47:41.782169 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 745add58b6ab4303bb813569650b8fd2 Aug 02 06:47:41.782169 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033-project Aug 02 06:47:41.782169 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:47:41.782169 n-d-851337-3 devstack@n-api.service[126119]: exception: Image not found. Aug 02 06:47:41.782169 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '2ef6f3b3-0d1e-4a68-919b-9a254f0067fj'} Aug 02 06:47:41.782169 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2ef6f3b3-0d1e-4a68-919b-9a254f0067fj to delete Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.783063 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2ef6f3b3-0d1e-4a68-919b-9a254f0067fj could not be found. Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:41.784112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1b5233db-3a0c-4735-bc46-da471b3f74a0 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Returning 404 to user: Image not found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:41.785206 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1b5233db-3a0c-4735-bc46-da471b3f74a0 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] 10.222.0.79 "DELETE /compute/v2.1/images/2ef6f3b3-0d1e-4a68-919b-9a254f0067fj" status: 404 len: 62 microversion: 2.1 time: 0.092761 Aug 02 06:47:41.787040 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 230/527] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:41 2022] DELETE /compute/v2.1/images/2ef6f3b3-0d1e-4a68-919b-9a254f0067fj => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:47:41.795645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-acaa5b85-4269-4204-8c51-a370449c59ef tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Calling method '.version_select at 0x7f927b3e73a0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:41.843425 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-acaa5b85-4269-4204-8c51-a370449c59ef tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] HTTP exception thrown: Image not found. Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-acaa5b85-4269-4204-8c51-a370449c59ef tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Request method failure captured: Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/images/c2ffdf60-b6d4-4e0c-b44d-8ea701c3082e1 HTTP/1.1 Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MiMMgZ0Dqd0ZH6HtytMjLzFJfGa5iJ0eCEPDyqibNBayFDl46SK0ESpp0YsL_yJ5J_ImnYAfH9GOmsI3CNZfYNsFdoR9X5aAS2dfG5SzW7h1M2aHyw4B4tQ8UPXqpdlv0uGxQiloVssMY6XMZoDsAWAbCnvm32JtkZJwQWQ6TfX0z0 Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: bb1c9add417849d2bb6f59cfef4d9189 Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:47:41.856048 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:47:41.857502 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bb1c9add417849d2bb6f59cfef4d9189"}]}] Aug 02 06:47:41.857502 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.857502 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: bb1c9add417849d2bb6f59cfef4d9189 Aug 02 06:47:41.857502 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.857502 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesDeleteNegativeTestJSON-1802768033-project Aug 02 06:47:41.857502 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:47:41.857502 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:47:41.857502 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 745add58b6ab4303bb813569650b8fd2 Aug 02 06:47:41.857502 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033-project Aug 02 06:47:41.857502 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:47:41.857502 n-d-851337-3 devstack@n-api.service[126120]: exception: Image not found. Aug 02 06:47:41.857502 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'c2ffdf60-b6d4-4e0c-b44d-8ea701c3082e1'} Aug 02 06:47:41.857502 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c2ffdf60-b6d4-4e0c-b44d-8ea701c3082e1 to delete Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.858275 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c2ffdf60-b6d4-4e0c-b44d-8ea701c3082e1 could not be found. Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:41.859381 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:41.860446 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 02 06:47:41.860446 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:47:41.860446 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:47:41.860446 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.860446 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.860446 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.860446 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.860446 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:41.860446 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:41.860446 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:41.860446 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:41.860446 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:47:41.860446 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.860446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-acaa5b85-4269-4204-8c51-a370449c59ef tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Returning 404 to user: Image not found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:41.863420 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-acaa5b85-4269-4204-8c51-a370449c59ef tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] 10.222.0.79 "DELETE /compute/v2.1/images/c2ffdf60-b6d4-4e0c-b44d-8ea701c3082e1" status: 404 len: 62 microversion: 2.1 time: 0.073135 Aug 02 06:47:41.864517 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 298/528] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:47:41 2022] DELETE /compute/v2.1/images/c2ffdf60-b6d4-4e0c-b44d-8ea701c3082e1 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:47:41.875602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0fce5252-fa3b-440e-bddc-217b21f18505 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Calling method '.version_select at 0x7f927b4cc550>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:41.926027 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-0fce5252-fa3b-440e-bddc-217b21f18505 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] HTTP exception thrown: Image not found. Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0fce5252-fa3b-440e-bddc-217b21f18505 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Request method failure captured: Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/images/tempest-invalid-1118238820 HTTP/1.1 Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiMMgZ0Dqd0ZH6HtytMjLzFJfGa5iJ0eCEPDyqibNBayFDl46SK0ESpp0YsL_yJ5J_ImnYAfH9GOmsI3CNZfYNsFdoR9X5aAS2dfG5SzW7h1M2aHyw4B4tQ8UPXqpdlv0uGxQiloVssMY6XMZoDsAWAbCnvm32JtkZJwQWQ6TfX0z0 Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: bb1c9add417849d2bb6f59cfef4d9189 Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:47:41.928891 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:47:41.930169 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bb1c9add417849d2bb6f59cfef4d9189"}]}] Aug 02 06:47:41.930169 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.930169 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: bb1c9add417849d2bb6f59cfef4d9189 Aug 02 06:47:41.930169 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.930169 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesDeleteNegativeTestJSON-1802768033-project Aug 02 06:47:41.930169 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:47:41.930169 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:47:41.930169 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 745add58b6ab4303bb813569650b8fd2 Aug 02 06:47:41.930169 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033-project Aug 02 06:47:41.930169 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:47:41.930169 n-d-851337-3 devstack@n-api.service[126119]: exception: Image not found. Aug 02 06:47:41.930169 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'tempest-invalid-1118238820'} Aug 02 06:47:41.930169 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1118238820 to delete Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.930891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1118238820 could not be found. Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:41.931935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:41.935166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 02 06:47:41.935166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:47:41.935166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:47:41.935166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.935166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.935166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.935166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.935166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:41.935166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:41.935166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:41.935166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:41.935166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:47:41.935166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.938482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0fce5252-fa3b-440e-bddc-217b21f18505 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Returning 404 to user: Image not found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:41.939763 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0fce5252-fa3b-440e-bddc-217b21f18505 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] 10.222.0.79 "DELETE /compute/v2.1/images/tempest-invalid-1118238820" status: 404 len: 62 microversion: 2.1 time: 0.069259 Aug 02 06:47:41.940816 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 231/529] 10.222.0.79 () {58 vars in 1206 bytes} [Tue Aug 2 06:47:41 2022] DELETE /compute/v2.1/images/tempest-invalid-1118238820 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:47:41.950028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44710c8c-81a6-43b4-bd62-cff4e0d49da0 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Calling method '.version_select at 0x7f927b625dc0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:41.981420 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-44710c8c-81a6-43b4-bd62-cff4e0d49da0 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] HTTP exception thrown: Image not found. Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44710c8c-81a6-43b4-bd62-cff4e0d49da0 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Request method failure captured: Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/images/19cf78eb-2b5a-4c35-98e5-545e6773974e HTTP/1.1 Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MiMMgZ0Dqd0ZH6HtytMjLzFJfGa5iJ0eCEPDyqibNBayFDl46SK0ESpp0YsL_yJ5J_ImnYAfH9GOmsI3CNZfYNsFdoR9X5aAS2dfG5SzW7h1M2aHyw4B4tQ8UPXqpdlv0uGxQiloVssMY6XMZoDsAWAbCnvm32JtkZJwQWQ6TfX0z0 Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: bb1c9add417849d2bb6f59cfef4d9189 Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:47:41.983619 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:47:41.984847 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bb1c9add417849d2bb6f59cfef4d9189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bb1c9add417849d2bb6f59cfef4d9189"}]}] Aug 02 06:47:41.984847 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.984847 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: bb1c9add417849d2bb6f59cfef4d9189 Aug 02 06:47:41.984847 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033 Aug 02 06:47:41.984847 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesDeleteNegativeTestJSON-1802768033-project Aug 02 06:47:41.984847 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:47:41.984847 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:47:41.984847 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 745add58b6ab4303bb813569650b8fd2 Aug 02 06:47:41.984847 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1802768033-project Aug 02 06:47:41.984847 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:47:41.984847 n-d-851337-3 devstack@n-api.service[126120]: exception: Image not found. Aug 02 06:47:41.984847 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '19cf78eb-2b5a-4c35-98e5-545e6773974e'} Aug 02 06:47:41.984847 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 19cf78eb-2b5a-4c35-98e5-545e6773974e to delete Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.985580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 19cf78eb-2b5a-4c35-98e5-545e6773974e could not be found. Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:41.986682 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:41.987790 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 02 06:47:41.987790 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:47:41.987790 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:47:41.987790 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.987790 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:41.987790 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.987790 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:41.987790 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:41.987790 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:41.987790 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:41.987790 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:41.987790 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:47:41.987790 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:41.990106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44710c8c-81a6-43b4-bd62-cff4e0d49da0 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] Returning 404 to user: Image not found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:41.993794 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-44710c8c-81a6-43b4-bd62-cff4e0d49da0 tempest-ImagesDeleteNegativeTestJSON-1802768033 tempest-ImagesDeleteNegativeTestJSON-1802768033-project] 10.222.0.79 "DELETE /compute/v2.1/images/19cf78eb-2b5a-4c35-98e5-545e6773974e" status: 404 len: 62 microversion: 2.1 time: 0.045729 Aug 02 06:47:41.994905 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 299/530] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:41 2022] DELETE /compute/v2.1/images/19cf78eb-2b5a-4c35-98e5-545e6773974e => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:47:42.029921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7c86a29a-9aad-4e4c-a0e3-d70f14e1109c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:42.030597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7c86a29a-9aad-4e4c-a0e3-d70f14e1109c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:42.045776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c86a29a-9aad-4e4c-a0e3-d70f14e1109c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:42.046317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c86a29a-9aad-4e4c-a0e3-d70f14e1109c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:42.050730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c86a29a-9aad-4e4c-a0e3-d70f14e1109c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:42.054238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c86a29a-9aad-4e4c-a0e3-d70f14e1109c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:42.104160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f7cea1c7-9003-4e6e-8737-f9936ac8b872 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:42.105553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f7cea1c7-9003-4e6e-8737-f9936ac8b872 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:42.117213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7cea1c7-9003-4e6e-8737-f9936ac8b872 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:42.117661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7cea1c7-9003-4e6e-8737-f9936ac8b872 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:42.122809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7cea1c7-9003-4e6e-8737-f9936ac8b872 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:42.123298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7cea1c7-9003-4e6e-8737-f9936ac8b872 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:42.552969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7c86a29a-9aad-4e4c-a0e3-d70f14e1109c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:42.563689 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7c86a29a-9aad-4e4c-a0e3-d70f14e1109c tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1476 microversion: 2.1 time: 0.540736 Aug 02 06:47:42.568367 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 232/531] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:42 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1476 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:42.576952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab85d65c-e578-4ecf-a46f-cfcc9d685129 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:42.580321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ab85d65c-e578-4ecf-a46f-cfcc9d685129 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:42.602644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab85d65c-e578-4ecf-a46f-cfcc9d685129 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:42.606333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab85d65c-e578-4ecf-a46f-cfcc9d685129 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:42.607408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab85d65c-e578-4ecf-a46f-cfcc9d685129 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:42.609273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab85d65c-e578-4ecf-a46f-cfcc9d685129 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:42.665863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f7cea1c7-9003-4e6e-8737-f9936ac8b872 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:42.678498 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f7cea1c7-9003-4e6e-8737-f9936ac8b872 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1390 microversion: 2.1 time: 0.581115 Aug 02 06:47:42.681359 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 300/532] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:42 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1390 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:42.770430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-ab85d65c-e578-4ecf-a46f-cfcc9d685129 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:42.807215 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ab85d65c-e578-4ecf-a46f-cfcc9d685129 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.234144 Aug 02 06:47:42.810496 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 233/533] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:42 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:43.376739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a35b2af4-b623-4453-a68b-824ad2d30f30 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Action: 'update', calling method: .version_select at 0x7f927b5f59d0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:43.380660 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:43.380660 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:43.383383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a35b2af4-b623-4453-a68b-824ad2d30f30 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:43.384214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a35b2af4-b623-4453-a68b-824ad2d30f30 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:43.401061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a35b2af4-b623-4453-a68b-824ad2d30f30 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:43.402679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a35b2af4-b623-4453-a68b-824ad2d30f30 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:43.425727 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-a35b2af4-b623-4453-a68b-824ad2d30f30 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] HTTP exception thrown: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a35b2af4-b623-4453-a68b-824ad2d30f30 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Request method failure captured: Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: request: PUT /compute/v2.1/os-services/e27440d8-2192-4bc0-81ed-40bdf1f1cf82 HTTP/1.1 Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 56 Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MiOV0hU0dByLd5X1dkXC0uGpx3X-u-amBwOiW0L3NTlb998bM2idv6nsgQIh52DM3e3VcRgNDa6WkrHBs08rxyUMJcbisRPkJ14rp9ZojqkKkmruG_sgZ2ajDPqQGxgFWN8xVEiuEzKmaZ9Dgj1mqz2np2Hv-zkwzleeNtVLbZAej0 Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.53 Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 044c15f1493d4f44989687aa9dbd0982 Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-992299642 Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:47:43.427628 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:47:43.429175 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/044c15f1493d4f44989687aa9dbd0982"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/044c15f1493d4f44989687aa9dbd0982"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_044c15f1493d4f44989687aa9dbd0982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/044c15f1493d4f44989687aa9dbd0982"}]}] Aug 02 06:47:43.429175 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-992299642 Aug 02 06:47:43.429175 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 044c15f1493d4f44989687aa9dbd0982 Aug 02 06:47:43.429175 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-992299642 Aug 02 06:47:43.429175 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin Aug 02 06:47:43.429175 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:47:43.429175 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:47:43.429175 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: ad4c26bb58544ffbbcceb9ee4d6601c8 Aug 02 06:47:43.429175 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin Aug 02 06:47:43.429175 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:47:43.429175 n-d-851337-3 devstack@n-api.service[126120]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 02 06:47:43.429175 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:47:43.429175 n-d-851337-3 devstack@n-api.service[126120]: exception: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'e27440d8-2192-4bc0-81ed-40bdf1f1cf82', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.430372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:43.432073 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:43.433447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:43.433447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.433447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.433447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a35b2af4-b623-4453-a68b-824ad2d30f30 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Returning 404 to user: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:43.437482 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a35b2af4-b623-4453-a68b-824ad2d30f30 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-services/e27440d8-2192-4bc0-81ed-40bdf1f1cf82" status: 404 len: 110 microversion: 2.53 time: 0.450918 Aug 02 06:47:43.443040 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 301/534] 10.222.0.79 () {62 vars in 1309 bytes} [Tue Aug 2 06:47:42 2022] PUT /compute/v2.1/os-services/e27440d8-2192-4bc0-81ed-40bdf1f1cf82 => generated 110 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:47:43.447673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-44d02196-7ae0-4e0c-9cc5-1208788160ec tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Action: 'update', calling method: .version_select at 0x7f927b696ca0>, body: {"status": "disabled"} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:43.450480 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:43.450480 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:43.451873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44d02196-7ae0-4e0c-9cc5-1208788160ec tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:43.452161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44d02196-7ae0-4e0c-9cc5-1208788160ec tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:43.479789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44d02196-7ae0-4e0c-9cc5-1208788160ec tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:43.480240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44d02196-7ae0-4e0c-9cc5-1208788160ec tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:43.513694 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-44d02196-7ae0-4e0c-9cc5-1208788160ec tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] HTTP exception thrown: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-44d02196-7ae0-4e0c-9cc5-1208788160ec tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Request method failure captured: Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: request: PUT /compute/v2.1/os-services/e27440d8-2192-4bc0-81ed-40bdf1f1cf82 HTTP/1.1 Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 22 Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiOV0hU0dByLd5X1dkXC0uGpx3X-u-amBwOiW0L3NTlb998bM2idv6nsgQIh52DM3e3VcRgNDa6WkrHBs08rxyUMJcbisRPkJ14rp9ZojqkKkmruG_sgZ2ajDPqQGxgFWN8xVEiuEzKmaZ9Dgj1mqz2np2Hv-zkwzleeNtVLbZAej0 Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: X-Openstack-Nova-Api-Version: 2.53 Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 044c15f1493d4f44989687aa9dbd0982 Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-992299642 Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:47:43.521657 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:47:43.523379 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/044c15f1493d4f44989687aa9dbd0982"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/044c15f1493d4f44989687aa9dbd0982"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_044c15f1493d4f44989687aa9dbd0982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/044c15f1493d4f44989687aa9dbd0982"}]}] Aug 02 06:47:43.523379 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-992299642 Aug 02 06:47:43.523379 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 044c15f1493d4f44989687aa9dbd0982 Aug 02 06:47:43.523379 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-992299642 Aug 02 06:47:43.523379 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin Aug 02 06:47:43.523379 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:47:43.523379 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:47:43.523379 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: ad4c26bb58544ffbbcceb9ee4d6601c8 Aug 02 06:47:43.523379 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin Aug 02 06:47:43.523379 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:47:43.523379 n-d-851337-3 devstack@n-api.service[126119]: {"status": "disabled"} Aug 02 06:47:43.523379 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:47:43.523379 n-d-851337-3 devstack@n-api.service[126119]: exception: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.523379 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'e27440d8-2192-4bc0-81ed-40bdf1f1cf82', 'body': {'status': 'disabled'}} Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:43.524177 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:43.525326 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:43.526435 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.526435 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.526998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-44d02196-7ae0-4e0c-9cc5-1208788160ec tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Returning 404 to user: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:43.529204 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-44d02196-7ae0-4e0c-9cc5-1208788160ec tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-services/e27440d8-2192-4bc0-81ed-40bdf1f1cf82" status: 404 len: 110 microversion: 2.53 time: 0.085469 Aug 02 06:47:43.532954 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 234/535] 10.222.0.79 () {62 vars in 1309 bytes} [Tue Aug 2 06:47:43 2022] PUT /compute/v2.1/os-services/e27440d8-2192-4bc0-81ed-40bdf1f1cf82 => generated 110 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:47:43.543587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f822a481-18b8-4325-886a-68a3b0971555 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Action: 'update', calling method: .version_select at 0x7f927b68b550>, body: {"status": "enabled"} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:43.550934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f822a481-18b8-4325-886a-68a3b0971555 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:43.551788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f822a481-18b8-4325-886a-68a3b0971555 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:43.558874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f822a481-18b8-4325-886a-68a3b0971555 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:43.562990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f822a481-18b8-4325-886a-68a3b0971555 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:43.573418 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-f822a481-18b8-4325-886a-68a3b0971555 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] HTTP exception thrown: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f822a481-18b8-4325-886a-68a3b0971555 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Request method failure captured: Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: request: PUT /compute/v2.1/os-services/e27440d8-2192-4bc0-81ed-40bdf1f1cf82 HTTP/1.1 Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 21 Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MiOV0hU0dByLd5X1dkXC0uGpx3X-u-amBwOiW0L3NTlb998bM2idv6nsgQIh52DM3e3VcRgNDa6WkrHBs08rxyUMJcbisRPkJ14rp9ZojqkKkmruG_sgZ2ajDPqQGxgFWN8xVEiuEzKmaZ9Dgj1mqz2np2Hv-zkwzleeNtVLbZAej0 Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.53 Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 044c15f1493d4f44989687aa9dbd0982 Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-992299642 Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:47:43.575455 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:47:43.576884 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/044c15f1493d4f44989687aa9dbd0982"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/044c15f1493d4f44989687aa9dbd0982"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_044c15f1493d4f44989687aa9dbd0982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/044c15f1493d4f44989687aa9dbd0982"}]}] Aug 02 06:47:43.576884 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-992299642 Aug 02 06:47:43.576884 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 044c15f1493d4f44989687aa9dbd0982 Aug 02 06:47:43.576884 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-992299642 Aug 02 06:47:43.576884 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin Aug 02 06:47:43.576884 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:47:43.576884 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:47:43.576884 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: ad4c26bb58544ffbbcceb9ee4d6601c8 Aug 02 06:47:43.576884 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin Aug 02 06:47:43.576884 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:47:43.576884 n-d-851337-3 devstack@n-api.service[126120]: {"status": "enabled"} Aug 02 06:47:43.576884 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:47:43.576884 n-d-851337-3 devstack@n-api.service[126120]: exception: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.576884 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'e27440d8-2192-4bc0-81ed-40bdf1f1cf82', 'body': {'status': 'enabled'}} Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:43.577766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:43.579437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:43.580574 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. Aug 02 06:47:43.580574 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:43.582082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f822a481-18b8-4325-886a-68a3b0971555 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Returning 404 to user: Service e27440d8-2192-4bc0-81ed-40bdf1f1cf82 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:43.584399 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f822a481-18b8-4325-886a-68a3b0971555 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-services/e27440d8-2192-4bc0-81ed-40bdf1f1cf82" status: 404 len: 110 microversion: 2.53 time: 0.044848 Aug 02 06:47:43.585243 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 302/536] 10.222.0.79 () {62 vars in 1309 bytes} [Tue Aug 2 06:47:43 2022] PUT /compute/v2.1/os-services/e27440d8-2192-4bc0-81ed-40bdf1f1cf82 => generated 110 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:47:43.596908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-eff03830-cfc2-4f5e-be26-c6c4591f6592 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:43.610689 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:43.610689 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:43.614398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eff03830-cfc2-4f5e-be26-c6c4591f6592 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:43.614398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eff03830-cfc2-4f5e-be26-c6c4591f6592 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:43.614398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eff03830-cfc2-4f5e-be26-c6c4591f6592 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:43.614696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eff03830-cfc2-4f5e-be26-c6c4591f6592 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:43.633132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-41e21d64-2a5a-4e9f-acf6-3777c7ef8fb7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:43.643474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-41e21d64-2a5a-4e9f-acf6-3777c7ef8fb7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:43.650759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41e21d64-2a5a-4e9f-acf6-3777c7ef8fb7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:43.658955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41e21d64-2a5a-4e9f-acf6-3777c7ef8fb7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:43.660339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41e21d64-2a5a-4e9f-acf6-3777c7ef8fb7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:43.663448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41e21d64-2a5a-4e9f-acf6-3777c7ef8fb7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:43.714154 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-eff03830-cfc2-4f5e-be26-c6c4591f6592 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.121255 Aug 02 06:47:43.718053 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 235/537] 10.222.0.79 () {60 vars in 1178 bytes} [Tue Aug 2 06:47:43 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:43.726664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b30c0379-d223-4994-934d-5488d0f1becb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:43.727493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b30c0379-d223-4994-934d-5488d0f1becb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:43.737494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b30c0379-d223-4994-934d-5488d0f1becb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:43.738138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b30c0379-d223-4994-934d-5488d0f1becb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:43.739240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b30c0379-d223-4994-934d-5488d0f1becb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:43.740067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b30c0379-d223-4994-934d-5488d0f1becb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:44.198866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b30c0379-d223-4994-934d-5488d0f1becb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:44.208166 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b30c0379-d223-4994-934d-5488d0f1becb tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1390 microversion: 2.1 time: 0.488682 Aug 02 06:47:44.208741 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 236/538] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:43 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1390 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:44.236607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c9ad857f-5b4d-481f-91ae-ae19a513d27b tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:44.239229 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:44.239229 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:47:44.240771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9ad857f-5b4d-481f-91ae-ae19a513d27b tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:44.246606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9ad857f-5b4d-481f-91ae-ae19a513d27b tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:44.247790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9ad857f-5b4d-481f-91ae-ae19a513d27b tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:44.248398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9ad857f-5b4d-481f-91ae-ae19a513d27b tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:44.286100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-41e21d64-2a5a-4e9f-acf6-3777c7ef8fb7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:44.302688 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-41e21d64-2a5a-4e9f-acf6-3777c7ef8fb7 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1462 microversion: 2.1 time: 0.678785 Aug 02 06:47:44.304701 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 303/539] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:43 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1462 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:44.326838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c7f7670e-d9bb-4040-b0d9-62e36f76e93d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:44.333823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c7f7670e-d9bb-4040-b0d9-62e36f76e93d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:44.351517 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c9ad857f-5b4d-481f-91ae-ae19a513d27b tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.130915 Aug 02 06:47:44.353137 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 237/540] 10.222.0.79 () {60 vars in 1211 bytes} [Tue Aug 2 06:47:44 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:44.361304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c7f7670e-d9bb-4040-b0d9-62e36f76e93d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:44.361770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c7f7670e-d9bb-4040-b0d9-62e36f76e93d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:44.363736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-47675c10-3516-4976-be0a-579f155d01f6 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:44.365636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c7f7670e-d9bb-4040-b0d9-62e36f76e93d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:44.366512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-47675c10-3516-4976-be0a-579f155d01f6 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:44.368623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c7f7670e-d9bb-4040-b0d9-62e36f76e93d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:44.385455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47675c10-3516-4976-be0a-579f155d01f6 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:44.387440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47675c10-3516-4976-be0a-579f155d01f6 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:44.388509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47675c10-3516-4976-be0a-579f155d01f6 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:44.391589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47675c10-3516-4976-be0a-579f155d01f6 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:44.739930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-c7f7670e-d9bb-4040-b0d9-62e36f76e93d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:44.793508 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c7f7670e-d9bb-4040-b0d9-62e36f76e93d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.487428 Aug 02 06:47:44.794125 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 304/541] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:44 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:44.810084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0c32f6e0-88a0-446e-bc63-4a7e12051db8 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:44.810084 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:44.810084 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:44.818212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c32f6e0-88a0-446e-bc63-4a7e12051db8 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:44.818778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c32f6e0-88a0-446e-bc63-4a7e12051db8 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:44.822281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c32f6e0-88a0-446e-bc63-4a7e12051db8 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:44.825156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c32f6e0-88a0-446e-bc63-4a7e12051db8 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:44.918995 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0c32f6e0-88a0-446e-bc63-4a7e12051db8 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.123774 Aug 02 06:47:44.921807 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 305/542] 10.222.0.79 () {60 vars in 1178 bytes} [Tue Aug 2 06:47:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:44.934325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-90357ec1-5721-4b00-bf46-6dc00af647df tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:44.937697 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:44.937697 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:44.941016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90357ec1-5721-4b00-bf46-6dc00af647df tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:44.946289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90357ec1-5721-4b00-bf46-6dc00af647df tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:44.947356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90357ec1-5721-4b00-bf46-6dc00af647df tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:44.947985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90357ec1-5721-4b00-bf46-6dc00af647df tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:45.003022 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-90357ec1-5721-4b00-bf46-6dc00af647df tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=n-d-851337-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.072452 Aug 02 06:47:45.010878 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 306/543] 10.222.0.79 () {60 vars in 1235 bytes} [Tue Aug 2 06:47:44 2022] GET /compute/v2.1/os-services?host=n-d-851337-3&binary=xxx => generated 16 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:45.023163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b2eda073-00a2-4c72-853c-7c0989eaf19e tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:45.026491 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:45.026491 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:45.030262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2eda073-00a2-4c72-853c-7c0989eaf19e tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:45.031723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2eda073-00a2-4c72-853c-7c0989eaf19e tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:45.036115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2eda073-00a2-4c72-853c-7c0989eaf19e tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:45.036726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2eda073-00a2-4c72-853c-7c0989eaf19e tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:45.101913 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b2eda073-00a2-4c72-853c-7c0989eaf19e tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.082563 Aug 02 06:47:45.104634 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 307/544] 10.222.0.79 () {60 vars in 1178 bytes} [Tue Aug 2 06:47:45 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:45.129538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f58370e7-960f-4acc-9666-c0737a3e01f7 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:45.132486 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:45.132486 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:45.134692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f58370e7-960f-4acc-9666-c0737a3e01f7 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:45.139833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f58370e7-960f-4acc-9666-c0737a3e01f7 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:45.140980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f58370e7-960f-4acc-9666-c0737a3e01f7 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:45.141579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f58370e7-960f-4acc-9666-c0737a3e01f7 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:45.142556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=84,nova_cell0:UPDATE=12 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:45.207429 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f58370e7-960f-4acc-9666-c0737a3e01f7 tempest-ServicesAdminNegativeV253TestJSON-992299642 tempest-ServicesAdminNegativeV253TestJSON-992299642-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.082093 Aug 02 06:47:45.215195 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 308/545] 10.222.0.79 () {60 vars in 1239 bytes} [Tue Aug 2 06:47:45 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:45.229025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-47675c10-3516-4976-be0a-579f155d01f6 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:45.241587 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-47675c10-3516-4976-be0a-579f155d01f6 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1462 microversion: 2.1 time: 0.886902 Aug 02 06:47:45.249138 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 238/546] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:44 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1462 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:45.256558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e9e2e2e1-4fc9-4cbf-b3ab-ab417d3dffaa tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:45.267427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e9e2e2e1-4fc9-4cbf-b3ab-ab417d3dffaa tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:45.306055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9e2e2e1-4fc9-4cbf-b3ab-ab417d3dffaa tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:45.307007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9e2e2e1-4fc9-4cbf-b3ab-ab417d3dffaa tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:45.307984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9e2e2e1-4fc9-4cbf-b3ab-ab417d3dffaa tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:45.308569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9e2e2e1-4fc9-4cbf-b3ab-ab417d3dffaa tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:45.634559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e9e2e2e1-4fc9-4cbf-b3ab-ab417d3dffaa tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:45.647680 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e9e2e2e1-4fc9-4cbf-b3ab-ab417d3dffaa tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1390 microversion: 2.1 time: 0.397253 Aug 02 06:47:45.649309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-54e09187-8e5b-4028-a1e0-3d92d4a93777 tempest-ServicesAdminNegativeV253TestJSON-141071550 tempest-ServicesAdminNegativeV253TestJSON-141071550-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:45.650804 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 239/547] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:45 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1390 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:45.662433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:45.666318 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:47:45.666318 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-54e09187-8e5b-4028-a1e0-3d92d4a93777 tempest-ServicesAdminNegativeV253TestJSON-141071550 tempest-ServicesAdminNegativeV253TestJSON-141071550-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '7f2bd4299f704bce894d08834d59d88c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f2889cfc11461f9bbe8acfb9875577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-54e09187-8e5b-4028-a1e0-3d92d4a93777 tempest-ServicesAdminNegativeV253TestJSON-141071550 tempest-ServicesAdminNegativeV253TestJSON-141071550-project] Request method failure captured: Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MiNYXanm5fgaUMEZ9_Cgw0Pn-It8MobwK6dSQ4HoMXzmjv-R1qHVIIRUqCgUqI5uv72Ayz5IVRtb_-VVz0AmS-bbAlwFbfdSUPKXu7osTfeVnHuETtZ_k6o2jY6nZfi2oo2ghyQSl2HDl0-M516CnR3zSiOfo635iCNYDawsW6EIrM Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.53 Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a4f2889cfc11461f9bbe8acfb9875577 Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-141071550 Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:47:45.669981 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:47:45.671642 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a4f2889cfc11461f9bbe8acfb9875577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a4f2889cfc11461f9bbe8acfb9875577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a4f2889cfc11461f9bbe8acfb9875577"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a4f2889cfc11461f9bbe8acfb9875577"}]}] Aug 02 06:47:45.671642 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-141071550 Aug 02 06:47:45.671642 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a4f2889cfc11461f9bbe8acfb9875577 Aug 02 06:47:45.671642 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-141071550 Aug 02 06:47:45.671642 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServicesAdminNegativeV253TestJSON-141071550-project Aug 02 06:47:45.671642 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:47:45.671642 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:47:45.671642 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 7f2bd4299f704bce894d08834d59d88c Aug 02 06:47:45.671642 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-141071550-project Aug 02 06:47:45.671642 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:47:45.671642 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 02 06:47:45.671642 n-d-851337-3 devstack@n-api.service[126120]: action_args: {} Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:47:45.672448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 02 06:47:45.673714 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:47:45.675087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-54e09187-8e5b-4028-a1e0-3d92d4a93777 tempest-ServicesAdminNegativeV253TestJSON-141071550 tempest-ServicesAdminNegativeV253TestJSON-141071550-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:45.676218 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-54e09187-8e5b-4028-a1e0-3d92d4a93777 tempest-ServicesAdminNegativeV253TestJSON-141071550 tempest-ServicesAdminNegativeV253TestJSON-141071550-project] 10.222.0.79 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.459216 Aug 02 06:47:45.677068 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 309/548] 10.222.0.79 () {60 vars in 1178 bytes} [Tue Aug 2 06:47:45 2022] GET /compute/v2.1/os-services => generated 112 bytes in 461 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Aug 02 06:47:45.680847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:45.697820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:45.698525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:45.699450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:45.700148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:45.855893 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:47:45.856547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:47:45.858045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:47:45.858898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:47:45.859455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:47:45.994699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:46.017668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:46.019244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:46.024247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:46.025001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:46.090964 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a7c0fb49-f34c-4767-af37-0842f366f5fb tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "POST /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c/action" status: 202 len: 1066 microversion: 2.1 time: 0.439050 Aug 02 06:47:46.104408 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 240/549] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:47:45 2022] POST /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c/action => generated 1066 bytes in 453 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 06:47:46.119836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-face0818-5a32-42aa-b19d-ed4b5ce862dd tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:46.134588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-face0818-5a32-42aa-b19d-ed4b5ce862dd tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:46.151040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-face0818-5a32-42aa-b19d-ed4b5ce862dd tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:46.160726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-face0818-5a32-42aa-b19d-ed4b5ce862dd tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:46.162773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-face0818-5a32-42aa-b19d-ed4b5ce862dd tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:46.166447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-face0818-5a32-42aa-b19d-ed4b5ce862dd tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:46.313952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-face0818-5a32-42aa-b19d-ed4b5ce862dd tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:46.353208 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-face0818-5a32-42aa-b19d-ed4b5ce862dd tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.246209 Aug 02 06:47:46.355070 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 241/550] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:46 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:46.365049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0c0f4938-7824-40d2-8a17-fefa3838cc80 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:46.365714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0c0f4938-7824-40d2-8a17-fefa3838cc80 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:46.372074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c0f4938-7824-40d2-8a17-fefa3838cc80 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:46.372518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c0f4938-7824-40d2-8a17-fefa3838cc80 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:46.373341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c0f4938-7824-40d2-8a17-fefa3838cc80 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:46.373768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c0f4938-7824-40d2-8a17-fefa3838cc80 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:46.642760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-260926816", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:46.719782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:47:47.548863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0c0f4938-7824-40d2-8a17-fefa3838cc80 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:47.566473 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0c0f4938-7824-40d2-8a17-fefa3838cc80 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1471 microversion: 2.1 time: 1.202585 Aug 02 06:47:47.567562 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 242/551] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:46 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1471 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:47.572455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4cdf35ef-81e1-47c1-9620-ad69d3dace9d tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:47.577589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4cdf35ef-81e1-47c1-9620-ad69d3dace9d tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:47.593663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cdf35ef-81e1-47c1-9620-ad69d3dace9d tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:47.594238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cdf35ef-81e1-47c1-9620-ad69d3dace9d tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:47.595096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cdf35ef-81e1-47c1-9620-ad69d3dace9d tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:47.595617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cdf35ef-81e1-47c1-9620-ad69d3dace9d tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:47.949716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:47:47.950935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:47:47.952659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:47:47.953331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:47:47.954021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:47:47.985801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:47.986391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:47.987270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:47.987880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:48.035479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:48.043673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:48.063317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:47:48.065978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:47:48.157175 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5cb57a19-276f-46db-ad72-bbf029fbb20a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.478740 Aug 02 06:47:48.158587 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 310/552] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:47:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:47:48.323499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-518402595", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "d2cb6aa5-9974-46cb-9343-692a25f49887"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:48.476842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] validate_networks() for [('d2cb6aa5-9974-46cb-9343-692a25f49887', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:47:48.805207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4cdf35ef-81e1-47c1-9620-ad69d3dace9d tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:48.840613 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4cdf35ef-81e1-47c1-9620-ad69d3dace9d tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1390 microversion: 2.1 time: 1.268872 Aug 02 06:47:48.846261 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 243/553] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:47 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1390 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:48.885603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2f8f728d-608a-496e-976e-9d9d3226d0c5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:48.887727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2f8f728d-608a-496e-976e-9d9d3226d0c5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:48.910194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f8f728d-608a-496e-976e-9d9d3226d0c5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:48.913839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f8f728d-608a-496e-976e-9d9d3226d0c5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:48.917232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f8f728d-608a-496e-976e-9d9d3226d0c5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:48.918641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f8f728d-608a-496e-976e-9d9d3226d0c5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:49.122178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-2f8f728d-608a-496e-976e-9d9d3226d0c5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:49.171362 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2f8f728d-608a-496e-976e-9d9d3226d0c5 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1927 microversion: 2.75 time: 0.305042 Aug 02 06:47:49.184718 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 244/554] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:48 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1927 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:49.198400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4aac680e-326d-4641-b5d3-230ad683fac1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:49.199023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4aac680e-326d-4641-b5d3-230ad683fac1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:49.221950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4aac680e-326d-4641-b5d3-230ad683fac1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:49.222407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4aac680e-326d-4641-b5d3-230ad683fac1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:49.223190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4aac680e-326d-4641-b5d3-230ad683fac1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:49.245359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4aac680e-326d-4641-b5d3-230ad683fac1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:49.410077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4aac680e-326d-4641-b5d3-230ad683fac1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:49.421873 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4aac680e-326d-4641-b5d3-230ad683fac1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 200 len: 1220 microversion: 2.1 time: 0.235121 Aug 02 06:47:49.430200 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 245/555] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:49 2022] GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 1220 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:49.462325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b3c990cc-f664-48d5-a7ce-4c2f279ad332 req-b638eebf-444c-49b0-bd7c-6e7b046434d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428968c0-25cc-47b2-bfa1-6147889fdcdf", "name": "network-vif-plugged", "status": "completed", "tag": "4565e0ac-4aff-4f72-a7b3-08e4dfc5a210"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:49.513553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b3c990cc-f664-48d5-a7ce-4c2f279ad332 req-b638eebf-444c-49b0-bd7c-6e7b046434d1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:49.515686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b3c990cc-f664-48d5-a7ce-4c2f279ad332 req-b638eebf-444c-49b0-bd7c-6e7b046434d1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:49.541988 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b3c990cc-f664-48d5-a7ce-4c2f279ad332 req-b638eebf-444c-49b0-bd7c-6e7b046434d1 service nova] Creating event network-vif-plugged:4565e0ac-4aff-4f72-a7b3-08e4dfc5a210 for instance 428968c0-25cc-47b2-bfa1-6147889fdcdf on n-h1-851337-3 Aug 02 06:47:49.550279 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b3c990cc-f664-48d5-a7ce-4c2f279ad332 req-b638eebf-444c-49b0-bd7c-6e7b046434d1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116648 Aug 02 06:47:49.552664 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 246/556] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:49.568451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9d322584-1bbd-4c7d-837b-24d8e3165d93 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:49.570722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9d322584-1bbd-4c7d-837b-24d8e3165d93 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:49.591991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d322584-1bbd-4c7d-837b-24d8e3165d93 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:49.600943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d322584-1bbd-4c7d-837b-24d8e3165d93 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:49.609819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d322584-1bbd-4c7d-837b-24d8e3165d93 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:49.611672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d322584-1bbd-4c7d-837b-24d8e3165d93 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:49.631091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:50.021483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9d322584-1bbd-4c7d-837b-24d8e3165d93 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:50.041877 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9d322584-1bbd-4c7d-837b-24d8e3165d93 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1471 microversion: 2.1 time: 0.487398 Aug 02 06:47:50.056173 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 247/557] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:49 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1471 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:50.070510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-55483525-e121-48dc-9bf7-ec30acc01608 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:50.072266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-55483525-e121-48dc-9bf7-ec30acc01608 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:50.100428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55483525-e121-48dc-9bf7-ec30acc01608 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:50.110634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55483525-e121-48dc-9bf7-ec30acc01608 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:50.116166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55483525-e121-48dc-9bf7-ec30acc01608 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:50.116721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55483525-e121-48dc-9bf7-ec30acc01608 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:50.333610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:47:50.334214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:47:50.334992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:47:50.335412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:47:50.335823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:47:50.353525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:50.356977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:50.362134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:50.362861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:50.422892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Getting quotas for project 28c28ea506a34625bf388395b06b67f5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:50.440835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Getting quotas for user a53fed20dabb4e45895da813d4c6538c and project 28c28ea506a34625bf388395b06b67f5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:50.476402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:47:50.481910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:47:50.647301 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f3fe5e4a-e3ae-4f7f-a279-0892f4743f0f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.483716 Aug 02 06:47:50.648315 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 311/558] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 06:47:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2489 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 06:47:50.657277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-74d77e7f-3908-4ee7-bdb3-69e3cdedcf86 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:50.658235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-74d77e7f-3908-4ee7-bdb3-69e3cdedcf86 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:50.667797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74d77e7f-3908-4ee7-bdb3-69e3cdedcf86 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:50.668492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74d77e7f-3908-4ee7-bdb3-69e3cdedcf86 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:50.669508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74d77e7f-3908-4ee7-bdb3-69e3cdedcf86 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:50.670168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74d77e7f-3908-4ee7-bdb3-69e3cdedcf86 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:50.691938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:50.894395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-74d77e7f-3908-4ee7-bdb3-69e3cdedcf86 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:50.940562 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-74d77e7f-3908-4ee7-bdb3-69e3cdedcf86 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1945 microversion: 2.75 time: 0.290323 Aug 02 06:47:50.942259 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 312/559] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:50 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1945 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:50.942384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-55483525-e121-48dc-9bf7-ec30acc01608 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:50.954871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a8778dae-5edd-4621-a2dc-caccee559340 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:50.956553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a8778dae-5edd-4621-a2dc-caccee559340 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:50.964364 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-55483525-e121-48dc-9bf7-ec30acc01608 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1390 microversion: 2.1 time: 0.906640 Aug 02 06:47:50.965131 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 248/560] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:50 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1390 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:50.971512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a621e3f7-3769-4ca8-a01f-4f0ce5d266e2 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:50.972129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a621e3f7-3769-4ca8-a01f-4f0ce5d266e2 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:50.976209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8778dae-5edd-4621-a2dc-caccee559340 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:50.976824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8778dae-5edd-4621-a2dc-caccee559340 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:50.978095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8778dae-5edd-4621-a2dc-caccee559340 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:50.983915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8778dae-5edd-4621-a2dc-caccee559340 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:51.061214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a621e3f7-3769-4ca8-a01f-4f0ce5d266e2 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:51.069805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a621e3f7-3769-4ca8-a01f-4f0ce5d266e2 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:51.077944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a621e3f7-3769-4ca8-a01f-4f0ce5d266e2 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:51.079193 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a621e3f7-3769-4ca8-a01f-4f0ce5d266e2 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1261 microversion: 2.25 time: 0.113057 Aug 02 06:47:51.080055 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 249/561] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:50 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1261 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:51.089374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-db5c38d6-3d4f-4ccb-ba37-0054206ff669 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:51.090347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-db5c38d6-3d4f-4ccb-ba37-0054206ff669 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:51.110249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db5c38d6-3d4f-4ccb-ba37-0054206ff669 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:51.110918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db5c38d6-3d4f-4ccb-ba37-0054206ff669 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:51.111857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db5c38d6-3d4f-4ccb-ba37-0054206ff669 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:51.112446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db5c38d6-3d4f-4ccb-ba37-0054206ff669 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:51.181811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a8778dae-5edd-4621-a2dc-caccee559340 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:51.194760 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a8778dae-5edd-4621-a2dc-caccee559340 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 200 len: 1274 microversion: 2.1 time: 0.247404 Aug 02 06:47:51.195681 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 313/562] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:50 2022] GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 1274 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:51.405576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-db5c38d6-3d4f-4ccb-ba37-0054206ff669 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:51.419573 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-db5c38d6-3d4f-4ccb-ba37-0054206ff669 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1471 microversion: 2.1 time: 0.337253 Aug 02 06:47:51.427200 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 250/563] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:51 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1471 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:51.974084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-883adffd-daad-4d4a-b2d6-a3039973dca8 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:51.974808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-883adffd-daad-4d4a-b2d6-a3039973dca8 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:51.990505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4b7fb10a-1712-4571-97cf-9f4a0b2f5832 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:51.991261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4b7fb10a-1712-4571-97cf-9f4a0b2f5832 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:52.000836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-883adffd-daad-4d4a-b2d6-a3039973dca8 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:52.001328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-883adffd-daad-4d4a-b2d6-a3039973dca8 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:52.004249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-883adffd-daad-4d4a-b2d6-a3039973dca8 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:52.005068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-883adffd-daad-4d4a-b2d6-a3039973dca8 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:52.009536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b7fb10a-1712-4571-97cf-9f4a0b2f5832 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:52.010027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b7fb10a-1712-4571-97cf-9f4a0b2f5832 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:52.017179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b7fb10a-1712-4571-97cf-9f4a0b2f5832 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:52.017821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b7fb10a-1712-4571-97cf-9f4a0b2f5832 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:52.170790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-883adffd-daad-4d4a-b2d6-a3039973dca8 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:52.195555 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-883adffd-daad-4d4a-b2d6-a3039973dca8 tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1933 microversion: 2.75 time: 0.230557 Aug 02 06:47:52.196644 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 314/564] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:51 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1933 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:52.203207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-811d353c-eb67-4efb-8ad2-8806540205fe tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:52.204216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-811d353c-eb67-4efb-8ad2-8806540205fe tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:52.216695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-811d353c-eb67-4efb-8ad2-8806540205fe tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:52.217804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-811d353c-eb67-4efb-8ad2-8806540205fe tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:52.219400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-811d353c-eb67-4efb-8ad2-8806540205fe tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:52.220025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-811d353c-eb67-4efb-8ad2-8806540205fe tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:52.325034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-811d353c-eb67-4efb-8ad2-8806540205fe tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:52.330881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4b7fb10a-1712-4571-97cf-9f4a0b2f5832 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:52.333380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-811d353c-eb67-4efb-8ad2-8806540205fe tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:52.335146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-811d353c-eb67-4efb-8ad2-8806540205fe tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:52.336761 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-811d353c-eb67-4efb-8ad2-8806540205fe tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1265 microversion: 2.25 time: 0.138876 Aug 02 06:47:52.337545 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 315/565] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:52 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:52.342938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d77e701a-a673-40dc-8643-46c1f09f5b9c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:52.343849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d77e701a-a673-40dc-8643-46c1f09f5b9c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:52.351820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d77e701a-a673-40dc-8643-46c1f09f5b9c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:52.352626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d77e701a-a673-40dc-8643-46c1f09f5b9c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:52.353686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d77e701a-a673-40dc-8643-46c1f09f5b9c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:52.354394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d77e701a-a673-40dc-8643-46c1f09f5b9c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:52.358139 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4b7fb10a-1712-4571-97cf-9f4a0b2f5832 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1390 microversion: 2.1 time: 0.371814 Aug 02 06:47:52.360536 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 251/566] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:51 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1390 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:47:52.448571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f1c3e84d-cef8-4dc8-8ab5-4e45667be5de tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:52.452244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f1c3e84d-cef8-4dc8-8ab5-4e45667be5de tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:52.461180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1c3e84d-cef8-4dc8-8ab5-4e45667be5de tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:52.462312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1c3e84d-cef8-4dc8-8ab5-4e45667be5de tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:52.463249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1c3e84d-cef8-4dc8-8ab5-4e45667be5de tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:52.464053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1c3e84d-cef8-4dc8-8ab5-4e45667be5de tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:52.729746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d77e701a-a673-40dc-8643-46c1f09f5b9c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:52.754204 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d77e701a-a673-40dc-8643-46c1f09f5b9c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 200 len: 1316 microversion: 2.1 time: 0.401603 Aug 02 06:47:52.754876 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 316/567] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:52 2022] GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:53.157249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f1c3e84d-cef8-4dc8-8ab5-4e45667be5de tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:53.167744 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f1c3e84d-cef8-4dc8-8ab5-4e45667be5de tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1471 microversion: 2.1 time: 0.723131 Aug 02 06:47:53.168334 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 252/568] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:52 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1471 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:47:53.228686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9f0f63c2-32f5-4a94-b678-ffa25b9a2e1b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:53.229275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9f0f63c2-32f5-4a94-b678-ffa25b9a2e1b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:53.243044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f0f63c2-32f5-4a94-b678-ffa25b9a2e1b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:53.244161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f0f63c2-32f5-4a94-b678-ffa25b9a2e1b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:53.245093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f0f63c2-32f5-4a94-b678-ffa25b9a2e1b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:53.246310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f0f63c2-32f5-4a94-b678-ffa25b9a2e1b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:53.363368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-95045d8a-9e90-41ee-b907-57ecc4a26581 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:53.364840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-95045d8a-9e90-41ee-b907-57ecc4a26581 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:53.377136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95045d8a-9e90-41ee-b907-57ecc4a26581 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:53.380024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95045d8a-9e90-41ee-b907-57ecc4a26581 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:53.381089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95045d8a-9e90-41ee-b907-57ecc4a26581 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:53.381777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95045d8a-9e90-41ee-b907-57ecc4a26581 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:53.416568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-9f0f63c2-32f5-4a94-b678-ffa25b9a2e1b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:53.468568 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9f0f63c2-32f5-4a94-b678-ffa25b9a2e1b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1933 microversion: 2.75 time: 0.241719 Aug 02 06:47:53.469424 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 317/569] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:53 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1933 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:53.484615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-29a12b4b-07a3-43b9-8d35-3c3ceb7ddd54 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:53.485254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-29a12b4b-07a3-43b9-8d35-3c3ceb7ddd54 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:53.492683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-95045d8a-9e90-41ee-b907-57ecc4a26581 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:53.499249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29a12b4b-07a3-43b9-8d35-3c3ceb7ddd54 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:53.499697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29a12b4b-07a3-43b9-8d35-3c3ceb7ddd54 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:53.500510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29a12b4b-07a3-43b9-8d35-3c3ceb7ddd54 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:53.500948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29a12b4b-07a3-43b9-8d35-3c3ceb7ddd54 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:53.511642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-95045d8a-9e90-41ee-b907-57ecc4a26581 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:53.513221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-95045d8a-9e90-41ee-b907-57ecc4a26581 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:53.514564 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-95045d8a-9e90-41ee-b907-57ecc4a26581 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1265 microversion: 2.25 time: 0.157116 Aug 02 06:47:53.515327 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 253/570] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:53 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:47:53.781059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-664cd1e9-7deb-4898-bacb-307b2a64f5f3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:53.782567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-664cd1e9-7deb-4898-bacb-307b2a64f5f3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:53.792755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-664cd1e9-7deb-4898-bacb-307b2a64f5f3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:53.793374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-664cd1e9-7deb-4898-bacb-307b2a64f5f3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:53.794482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-664cd1e9-7deb-4898-bacb-307b2a64f5f3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:53.795137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-664cd1e9-7deb-4898-bacb-307b2a64f5f3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:53.805532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-29a12b4b-07a3-43b9-8d35-3c3ceb7ddd54 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:53.814051 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-29a12b4b-07a3-43b9-8d35-3c3ceb7ddd54 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1390 microversion: 2.1 time: 0.338994 Aug 02 06:47:53.829214 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 318/571] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:53 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1390 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:53.864214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-d2fdc4bf-60ba-4a76-bb6c-9ec7f9de87ff req-c5078eea-0bd4-41d1-96bb-8810137f19c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ae3b2d-b9db-4285-a9d1-665045b4d168", "tag": "f735bcbb-19dc-417d-9bdf-5cb12315ce1c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:53.877884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:53.892464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d2fdc4bf-60ba-4a76-bb6c-9ec7f9de87ff req-c5078eea-0bd4-41d1-96bb-8810137f19c9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:53.894097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d2fdc4bf-60ba-4a76-bb6c-9ec7f9de87ff req-c5078eea-0bd4-41d1-96bb-8810137f19c9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:53.919398 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-d2fdc4bf-60ba-4a76-bb6c-9ec7f9de87ff req-c5078eea-0bd4-41d1-96bb-8810137f19c9 service nova] Creating event network-changed:f735bcbb-19dc-417d-9bdf-5cb12315ce1c for instance 75ae3b2d-b9db-4285-a9d1-665045b4d168 on n-h2-851337-3 Aug 02 06:47:53.934136 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-d2fdc4bf-60ba-4a76-bb6c-9ec7f9de87ff req-c5078eea-0bd4-41d1-96bb-8810137f19c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072368 Aug 02 06:47:53.937066 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 319/572] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:47:54.190003 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fc971526-4b20-4ee0-ac38-072817bdd2ea tempest-TenantUsagesNegativeTestJSON-1425039079 tempest-TenantUsagesNegativeTestJSON-1425039079-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-01T06%3A47%3A53.867920&end=2022-08-03T06%3A47%3A53.867920" status: 404 len: 112 microversion: - time: 0.250908 Aug 02 06:47:54.197457 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 320/573] 10.222.0.79 () {58 vars in 1316 bytes} [Tue Aug 2 06:47:53 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-01T06%3A47%3A53.867920&end=2022-08-03T06%3A47%3A53.867920 => generated 112 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 06:47:54.207033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6930d38-850b-4264-af0b-57bdf545a232 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:54.208205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d6930d38-850b-4264-af0b-57bdf545a232 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:54.208658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-664cd1e9-7deb-4898-bacb-307b2a64f5f3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:54.218125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6930d38-850b-4264-af0b-57bdf545a232 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:54.219620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6930d38-850b-4264-af0b-57bdf545a232 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:54.219746 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-664cd1e9-7deb-4898-bacb-307b2a64f5f3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 200 len: 1316 microversion: 2.1 time: 0.447860 Aug 02 06:47:54.221063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6930d38-850b-4264-af0b-57bdf545a232 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:54.222363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6930d38-850b-4264-af0b-57bdf545a232 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:54.224172 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 254/574] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:53 2022] GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:47:54.246526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9b7f50f6-6778-47ec-bea5-683f219b8cce tempest-TenantUsagesNegativeTestJSON-1425039079 tempest-TenantUsagesNegativeTestJSON-1425039079-project-admin] Calling method '.version_select at 0x7f927b97ad30>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:54.259471 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-9b7f50f6-6778-47ec-bea5-683f219b8cce tempest-TenantUsagesNegativeTestJSON-1425039079 tempest-TenantUsagesNegativeTestJSON-1425039079-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9b7f50f6-6778-47ec-bea5-683f219b8cce tempest-TenantUsagesNegativeTestJSON-1425039079 tempest-TenantUsagesNegativeTestJSON-1425039079-project-admin] Request method failure captured: Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-simple-tenant-usage/54979df12e74447ca4b06228e5f26b82?start=2022-08-03T06%3A47%3A53.867920&end=2022-08-01T06%3A47%3A53.867920 HTTP/1.1 Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiZV4cWQIlSI28nlEfraLvey2f1gqRck957r_xQDtTvac9rk9JwcoTL37o_EY4tCROYCFcEk9Qd1Cy8q3db5qulObo-lY9-8njlUyejt_LDQ0GJ4BhLPw_rfpvAYJPA1H7b-OPXTxmZxX8omFSUx7l5z7Z6wse-KOBOiDz0v39UAPI Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 7a9163ec1bdf49b4a6c01108ac2c6fe2 Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1425039079 Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:47:54.277944 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:47:54.279472 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7a9163ec1bdf49b4a6c01108ac2c6fe2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7a9163ec1bdf49b4a6c01108ac2c6fe2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7a9163ec1bdf49b4a6c01108ac2c6fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7a9163ec1bdf49b4a6c01108ac2c6fe2"}]}] Aug 02 06:47:54.279472 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1425039079 Aug 02 06:47:54.279472 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 7a9163ec1bdf49b4a6c01108ac2c6fe2 Aug 02 06:47:54.279472 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1425039079 Aug 02 06:47:54.279472 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TenantUsagesNegativeTestJSON-1425039079-project-admin Aug 02 06:47:54.279472 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:47:54.279472 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:47:54.279472 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 68037a4ceba444368ad79716d0412516 Aug 02 06:47:54.279472 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1425039079-project-admin Aug 02 06:47:54.279472 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:47:54.279472 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid start time. The start time cannot occur after the end time. Aug 02 06:47:54.279472 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '54979df12e74447ca4b06228e5f26b82'} Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 02 06:47:54.280389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 02 06:47:54.281538 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:54.281538 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:54.281538 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:54.281538 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:54.281538 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:54.281538 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:54.281538 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:47:54.281538 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:47:54.281538 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 02 06:47:54.281538 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:54.284573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9b7f50f6-6778-47ec-bea5-683f219b8cce tempest-TenantUsagesNegativeTestJSON-1425039079 tempest-TenantUsagesNegativeTestJSON-1425039079-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:54.285728 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9b7f50f6-6778-47ec-bea5-683f219b8cce tempest-TenantUsagesNegativeTestJSON-1425039079 tempest-TenantUsagesNegativeTestJSON-1425039079-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/54979df12e74447ca4b06228e5f26b82?start=2022-08-03T06%3A47%3A53.867920&end=2022-08-01T06%3A47%3A53.867920" status: 400 len: 111 microversion: 2.1 time: 0.058654 Aug 02 06:47:54.286521 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 255/575] 10.222.0.79 () {58 vars in 1412 bytes} [Tue Aug 2 06:47:54 2022] GET /compute/v2.1/os-simple-tenant-usage/54979df12e74447ca4b06228e5f26b82?start=2022-08-03T06%3A47%3A53.867920&end=2022-08-01T06%3A47%3A53.867920 => generated 111 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:47:54.298436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:54.492383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e29f162a-efc3-4d51-8650-28186c0d4597 tempest-TenantUsagesNegativeTestJSON-814278502 tempest-TenantUsagesNegativeTestJSON-814278502-project] Calling method '.version_select at 0x7f927b4e2160>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:54.501207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e29f162a-efc3-4d51-8650-28186c0d4597 tempest-TenantUsagesNegativeTestJSON-814278502 tempest-TenantUsagesNegativeTestJSON-814278502-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '8fba0669e77640639c530bbb1adc106f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54979df12e74447ca4b06228e5f26b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e29f162a-efc3-4d51-8650-28186c0d4597 tempest-TenantUsagesNegativeTestJSON-814278502 tempest-TenantUsagesNegativeTestJSON-814278502-project] Request method failure captured: Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-01T06%3A47%3A53.867920&end=2022-08-03T06%3A47%3A53.867920&detailed=1 HTTP/1.1 Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiY88mHv9535HbFoiqHfJ9TeFN0dfp6VbyRmToKr5vRSiKi47MbXSC1WkDBtefrrwwHZajqgwdB-U7deRmXVEXc91CleR_o0YdD-_7H1co2XzriiA34r3IkiPZqCNSYD96cAgd26TLm_nq6IShuV6Zf3UgZrJxzOZa1xJAypJtjITQ Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 54979df12e74447ca4b06228e5f26b82 Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-814278502 Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:47:54.525498 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:47:54.527020 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/54979df12e74447ca4b06228e5f26b82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/54979df12e74447ca4b06228e5f26b82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_54979df12e74447ca4b06228e5f26b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/54979df12e74447ca4b06228e5f26b82"}]}] Aug 02 06:47:54.527020 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-814278502 Aug 02 06:47:54.527020 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 54979df12e74447ca4b06228e5f26b82 Aug 02 06:47:54.527020 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-814278502 Aug 02 06:47:54.527020 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TenantUsagesNegativeTestJSON-814278502-project Aug 02 06:47:54.527020 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:47:54.527020 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:47:54.527020 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 8fba0669e77640639c530bbb1adc106f Aug 02 06:47:54.527020 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-814278502-project Aug 02 06:47:54.527020 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:47:54.527020 n-d-851337-3 devstack@n-api.service[126119]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 02 06:47:54.527020 n-d-851337-3 devstack@n-api.service[126119]: action_args: {} Aug 02 06:47:54.527020 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:47:54.528173 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:47:54.529263 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:47:54.530480 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 02 06:47:54.530480 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:47:54.532017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e29f162a-efc3-4d51-8650-28186c0d4597 tempest-TenantUsagesNegativeTestJSON-814278502 tempest-TenantUsagesNegativeTestJSON-814278502-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:47:54.533012 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e29f162a-efc3-4d51-8650-28186c0d4597 tempest-TenantUsagesNegativeTestJSON-814278502 tempest-TenantUsagesNegativeTestJSON-814278502-project] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-01T06%3A47%3A53.867920&end=2022-08-03T06%3A47%3A53.867920&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.240094 Aug 02 06:47:54.534387 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 256/576] 10.222.0.79 () {58 vars in 1335 bytes} [Tue Aug 2 06:47:54 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-01T06%3A47%3A53.867920&end=2022-08-03T06%3A47%3A53.867920&detailed=1 => generated 123 bytes in 243 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:47:54.554942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7a8b2649-0560-4685-a9a6-899e70257b8d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:54.555919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7a8b2649-0560-4685-a9a6-899e70257b8d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:54.569000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a8b2649-0560-4685-a9a6-899e70257b8d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:54.569807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a8b2649-0560-4685-a9a6-899e70257b8d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:54.582447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a8b2649-0560-4685-a9a6-899e70257b8d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:54.589310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a8b2649-0560-4685-a9a6-899e70257b8d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:55.344696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-7a8b2649-0560-4685-a9a6-899e70257b8d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:55.389873 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7a8b2649-0560-4685-a9a6-899e70257b8d tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1933 microversion: 2.75 time: 0.854143 Aug 02 06:47:55.405920 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 257/577] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:54 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1933 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:55.410348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-04dd7429-e396-4181-b237-376e52deac03 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:55.411167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-04dd7429-e396-4181-b237-376e52deac03 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:55.421755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04dd7429-e396-4181-b237-376e52deac03 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:55.422543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04dd7429-e396-4181-b237-376e52deac03 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:55.424181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04dd7429-e396-4181-b237-376e52deac03 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:55.424910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04dd7429-e396-4181-b237-376e52deac03 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:55.860992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-04dd7429-e396-4181-b237-376e52deac03 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:55.912521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-04dd7429-e396-4181-b237-376e52deac03 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:55.921748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-04dd7429-e396-4181-b237-376e52deac03 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:55.925800 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-04dd7429-e396-4181-b237-376e52deac03 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1321 microversion: 2.25 time: 0.529496 Aug 02 06:47:55.945375 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 258/578] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:55 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1321 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:55.957807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-13270d3c-641a-4cea-932b-380b80c912f6 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:55.959606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-13270d3c-641a-4cea-932b-380b80c912f6 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:55.966206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13270d3c-641a-4cea-932b-380b80c912f6 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:55.966933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13270d3c-641a-4cea-932b-380b80c912f6 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:55.967931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13270d3c-641a-4cea-932b-380b80c912f6 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:55.969143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13270d3c-641a-4cea-932b-380b80c912f6 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:56.096396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d6930d38-850b-4264-af0b-57bdf545a232 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:56.118792 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d6930d38-850b-4264-af0b-57bdf545a232 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1471 microversion: 2.1 time: 1.917692 Aug 02 06:47:56.140704 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 321/579] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:54 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1471 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:56.174343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bde09ed4-4966-4e55-b1e8-3f4350725f00 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:56.176770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bde09ed4-4966-4e55-b1e8-3f4350725f00 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:56.193017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bde09ed4-4966-4e55-b1e8-3f4350725f00 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:56.193480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bde09ed4-4966-4e55-b1e8-3f4350725f00 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:56.194294 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bde09ed4-4966-4e55-b1e8-3f4350725f00 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:56.196431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bde09ed4-4966-4e55-b1e8-3f4350725f00 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:56.675248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-13270d3c-641a-4cea-932b-380b80c912f6 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:56.692303 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-13270d3c-641a-4cea-932b-380b80c912f6 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1589 microversion: 2.1 time: 0.745356 Aug 02 06:47:56.692913 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 259/580] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:55 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1589 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:56.895216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bde09ed4-4966-4e55-b1e8-3f4350725f00 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:56.909629 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bde09ed4-4966-4e55-b1e8-3f4350725f00 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 200 len: 1316 microversion: 2.1 time: 0.754149 Aug 02 06:47:56.914171 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 322/581] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:56 2022] GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 1316 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:56.934759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2f555150-fccf-4627-bf9b-6b85c793746b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:56.935674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2f555150-fccf-4627-bf9b-6b85c793746b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:56.954977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f555150-fccf-4627-bf9b-6b85c793746b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:56.955428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f555150-fccf-4627-bf9b-6b85c793746b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:56.958011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f555150-fccf-4627-bf9b-6b85c793746b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:56.958632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f555150-fccf-4627-bf9b-6b85c793746b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:57.173823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1745420902", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "c92a3ed1-d696-472e-a733-75a14b7c8a60"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:47:57.183259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-2f555150-fccf-4627-bf9b-6b85c793746b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] Lazy-loading 'services' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:47:57.213019 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2f555150-fccf-4627-bf9b-6b85c793746b tempest-ServersAdmin275Test-427389200 tempest-ServersAdmin275Test-427389200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1918 microversion: 2.75 time: 0.296419 Aug 02 06:47:57.223756 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 323/582] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:56 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1918 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:57.235277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc7efb28-77b8-4423-9f53-baecbb07ab39 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:57.235740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bc7efb28-77b8-4423-9f53-baecbb07ab39 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:57.248579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc7efb28-77b8-4423-9f53-baecbb07ab39 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:57.253418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc7efb28-77b8-4423-9f53-baecbb07ab39 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:57.257550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc7efb28-77b8-4423-9f53-baecbb07ab39 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:57.258102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc7efb28-77b8-4423-9f53-baecbb07ab39 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:57.277299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] validate_networks() for [('c92a3ed1-d696-472e-a733-75a14b7c8a60', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:47:57.517376 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc7efb28-77b8-4423-9f53-baecbb07ab39 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.295602 Aug 02 06:47:57.525842 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 324/583] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 06:47:57 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf/os-interface => generated 284 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:47:57.525842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-03f02dae-836c-4a70-9a49-19fa200bec49 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:57.525842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-03f02dae-836c-4a70-9a49-19fa200bec49 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:57.546539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03f02dae-836c-4a70-9a49-19fa200bec49 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:57.547722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03f02dae-836c-4a70-9a49-19fa200bec49 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:57.552245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03f02dae-836c-4a70-9a49-19fa200bec49 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:57.552907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03f02dae-836c-4a70-9a49-19fa200bec49 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:58.017781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-03f02dae-836c-4a70-9a49-19fa200bec49 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:58.030319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-03f02dae-836c-4a70-9a49-19fa200bec49 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:58.033048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-03f02dae-836c-4a70-9a49-19fa200bec49 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:58.034712 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-03f02dae-836c-4a70-9a49-19fa200bec49 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1319 microversion: 2.25 time: 0.515536 Aug 02 06:47:58.035631 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 325/584] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:57 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:47:58.055488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e3a4997c-3440-4c94-af61-499071103e1a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:58.056014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e3a4997c-3440-4c94-af61-499071103e1a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:58.062638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3a4997c-3440-4c94-af61-499071103e1a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:58.063669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3a4997c-3440-4c94-af61-499071103e1a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:58.064464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3a4997c-3440-4c94-af61-499071103e1a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:58.064901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3a4997c-3440-4c94-af61-499071103e1a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:58.902993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e3a4997c-3440-4c94-af61-499071103e1a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:58.911675 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e3a4997c-3440-4c94-af61-499071103e1a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1471 microversion: 2.1 time: 0.860904 Aug 02 06:47:58.912258 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 326/585] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:58 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1471 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:58.917022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-46ef102c-9b79-41ec-aa92-43ca98d00bf3 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:58.917722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-46ef102c-9b79-41ec-aa92-43ca98d00bf3 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:58.923969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-46ef102c-9b79-41ec-aa92-43ca98d00bf3 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:58.924612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-46ef102c-9b79-41ec-aa92-43ca98d00bf3 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:58.925560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-46ef102c-9b79-41ec-aa92-43ca98d00bf3 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:58.926281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-46ef102c-9b79-41ec-aa92-43ca98d00bf3 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:58.955947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-46ef102c-9b79-41ec-aa92-43ca98d00bf3 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:47:59.125314 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-46ef102c-9b79-41ec-aa92-43ca98d00bf3 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "DELETE /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 204 len: 0 microversion: 2.75 time: 0.210696 Aug 02 06:47:59.128448 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 327/586] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:47:58 2022] DELETE /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 06:47:59.138124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-18bc234f-d9dd-41f7-90e6-22bb8f73c62e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:59.139917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-18bc234f-d9dd-41f7-90e6-22bb8f73c62e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:59.152635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18bc234f-d9dd-41f7-90e6-22bb8f73c62e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:59.161535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18bc234f-d9dd-41f7-90e6-22bb8f73c62e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:59.170023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18bc234f-d9dd-41f7-90e6-22bb8f73c62e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:59.170950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18bc234f-d9dd-41f7-90e6-22bb8f73c62e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:59.180049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:59.844773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:47:59.845336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:47:59.845651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:47:59.846504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:47:59.846913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:47:59.862473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:59.863287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:59.864407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:59.865127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:47:59.892901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Getting quotas for project a972437b40d745b2a16e01593bfaa1e5. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:47:59.904524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Getting quotas for user b519574e86e841c3a31851e1f4657dd8 and project a972437b40d745b2a16e01593bfaa1e5. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:47:59.925192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:47:59.932136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:47:59.942343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-18bc234f-d9dd-41f7-90e6-22bb8f73c62e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:47:59.958387 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-18bc234f-d9dd-41f7-90e6-22bb8f73c62e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 200 len: 1316 microversion: 2.1 time: 0.827220 Aug 02 06:47:59.959847 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 328/587] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:47:59 2022] GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 1316 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:47:59.965070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-198bc6c1-a8a3-4965-b4aa-b307a870e175 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:47:59.965843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-198bc6c1-a8a3-4965-b4aa-b307a870e175 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:47:59.977842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-198bc6c1-a8a3-4965-b4aa-b307a870e175 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:47:59.978404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:47:59.988322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-198bc6c1-a8a3-4965-b4aa-b307a870e175 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:00.003516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-198bc6c1-a8a3-4965-b4aa-b307a870e175 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:00.004840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-198bc6c1-a8a3-4965-b4aa-b307a870e175 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:00.027262 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9baf45b4-eb05-4e09-952c-78f4e831eb95 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.321386 Aug 02 06:48:00.037205 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 260/588] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:47:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:48:00.042350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c1b5f7af-035e-46ef-b539-bad1b742c6a9 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:00.042954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c1b5f7af-035e-46ef-b539-bad1b742c6a9 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:00.075564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1b5f7af-035e-46ef-b539-bad1b742c6a9 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:00.076006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1b5f7af-035e-46ef-b539-bad1b742c6a9 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:00.077118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1b5f7af-035e-46ef-b539-bad1b742c6a9 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:00.077704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1b5f7af-035e-46ef-b539-bad1b742c6a9 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:00.383142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=16 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:00.385531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c1b5f7af-035e-46ef-b539-bad1b742c6a9 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:00.404830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c1b5f7af-035e-46ef-b539-bad1b742c6a9 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:00.408139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c1b5f7af-035e-46ef-b539-bad1b742c6a9 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:00.420866 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c1b5f7af-035e-46ef-b539-bad1b742c6a9 tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1443 microversion: 2.75 time: 0.382428 Aug 02 06:48:00.422069 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 261/589] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:00 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1443 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:00.451944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-06701409-6ef5-41da-afd3-7c63cff64274 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:00.452837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-06701409-6ef5-41da-afd3-7c63cff64274 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:00.461064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=12 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:00.463765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06701409-6ef5-41da-afd3-7c63cff64274 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:00.467390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06701409-6ef5-41da-afd3-7c63cff64274 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:00.468384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06701409-6ef5-41da-afd3-7c63cff64274 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:00.475520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06701409-6ef5-41da-afd3-7c63cff64274 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:01.659930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-198bc6c1-a8a3-4965-b4aa-b307a870e175 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:01.679853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-198bc6c1-a8a3-4965-b4aa-b307a870e175 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:01.686311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-198bc6c1-a8a3-4965-b4aa-b307a870e175 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:01.689868 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-198bc6c1-a8a3-4965-b4aa-b307a870e175 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1361 microversion: 2.25 time: 1.727301 Aug 02 06:48:01.690928 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 329/590] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:47:59 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1361 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:01.697795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6aede3a0-b859-4d3a-b42d-0131a3d718be tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:01.698732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6aede3a0-b859-4d3a-b42d-0131a3d718be tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:01.721110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6aede3a0-b859-4d3a-b42d-0131a3d718be tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:01.721763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6aede3a0-b859-4d3a-b42d-0131a3d718be tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:01.722791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6aede3a0-b859-4d3a-b42d-0131a3d718be tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:01.723377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6aede3a0-b859-4d3a-b42d-0131a3d718be tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:01.937576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-06701409-6ef5-41da-afd3-7c63cff64274 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:01.947283 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-06701409-6ef5-41da-afd3-7c63cff64274 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1471 microversion: 2.1 time: 1.503573 Aug 02 06:48:01.948205 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 262/591] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:00 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1471 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:01.954992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-2bbdfcf7-4ddc-47f4-b541-c57bf40a7f88 req-b41e5912-5f91-4dc8-8e79-e1759d0e400a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428968c0-25cc-47b2-bfa1-6147889fdcdf", "tag": "4565e0ac-4aff-4f72-a7b3-08e4dfc5a210"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:01.969242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2bbdfcf7-4ddc-47f4-b541-c57bf40a7f88 req-b41e5912-5f91-4dc8-8e79-e1759d0e400a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:01.970605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2bbdfcf7-4ddc-47f4-b541-c57bf40a7f88 req-b41e5912-5f91-4dc8-8e79-e1759d0e400a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:01.988554 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-2bbdfcf7-4ddc-47f4-b541-c57bf40a7f88 req-b41e5912-5f91-4dc8-8e79-e1759d0e400a service nova] Creating event network-changed:4565e0ac-4aff-4f72-a7b3-08e4dfc5a210 for instance 428968c0-25cc-47b2-bfa1-6147889fdcdf on n-h1-851337-3 Aug 02 06:48:02.001768 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-2bbdfcf7-4ddc-47f4-b541-c57bf40a7f88 req-b41e5912-5f91-4dc8-8e79-e1759d0e400a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051903 Aug 02 06:48:02.002983 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 263/592] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:02.011589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-99ff521e-d9df-4682-9234-1231c7571e9e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:02.021094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-99ff521e-d9df-4682-9234-1231c7571e9e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:02.028363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99ff521e-d9df-4682-9234-1231c7571e9e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:02.029096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99ff521e-d9df-4682-9234-1231c7571e9e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:02.030236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99ff521e-d9df-4682-9234-1231c7571e9e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:02.030744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99ff521e-d9df-4682-9234-1231c7571e9e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:02.317982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-99ff521e-d9df-4682-9234-1231c7571e9e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:02.330367 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-99ff521e-d9df-4682-9234-1231c7571e9e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1283 microversion: 2.1 time: 0.324913 Aug 02 06:48:02.332009 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 264/593] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:02 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1283 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:02.339770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7cbb5684-2dbc-40c8-8b32-444b89eb364b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:02.340375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7cbb5684-2dbc-40c8-8b32-444b89eb364b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:02.356433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cbb5684-2dbc-40c8-8b32-444b89eb364b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:02.359311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cbb5684-2dbc-40c8-8b32-444b89eb364b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:02.360427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cbb5684-2dbc-40c8-8b32-444b89eb364b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:02.361174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cbb5684-2dbc-40c8-8b32-444b89eb364b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:02.480440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6aede3a0-b859-4d3a-b42d-0131a3d718be tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:02.495278 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6aede3a0-b859-4d3a-b42d-0131a3d718be tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1589 microversion: 2.1 time: 0.803060 Aug 02 06:48:02.511216 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 330/594] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:01 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1589 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:02.527780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e01f1145-ce53-4690-9433-28912388422e tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:02.529015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e01f1145-ce53-4690-9433-28912388422e tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:02.546015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e01f1145-ce53-4690-9433-28912388422e tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:02.546485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e01f1145-ce53-4690-9433-28912388422e tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:02.547284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e01f1145-ce53-4690-9433-28912388422e tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:02.547723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e01f1145-ce53-4690-9433-28912388422e tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:02.651958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e01f1145-ce53-4690-9433-28912388422e tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:02.652439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e01f1145-ce53-4690-9433-28912388422e tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:02.652992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-e01f1145-ce53-4690-9433-28912388422e tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lazy-loading 'fault' on Instance uuid 869b5888-d797-4250-926b-3f7801803680 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:48:02.879306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e01f1145-ce53-4690-9433-28912388422e tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:02.891438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e01f1145-ce53-4690-9433-28912388422e tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:02.893305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e01f1145-ce53-4690-9433-28912388422e tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7082e2ac9bb043c2a96c61f07de8281c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252702b461514c20853159fa3138c43c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:02.903172 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e01f1145-ce53-4690-9433-28912388422e tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 200 len: 1448 microversion: 2.75 time: 0.389960 Aug 02 06:48:02.919603 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 331/595] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:02 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 1448 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:02.932815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f07126f8-800e-41ea-b5d4-8d1d5e2cd26c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:02.934368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f07126f8-800e-41ea-b5d4-8d1d5e2cd26c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:02.944187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f07126f8-800e-41ea-b5d4-8d1d5e2cd26c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:02.945013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f07126f8-800e-41ea-b5d4-8d1d5e2cd26c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:02.946348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f07126f8-800e-41ea-b5d4-8d1d5e2cd26c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:02.947297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f07126f8-800e-41ea-b5d4-8d1d5e2cd26c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:03.225172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7cbb5684-2dbc-40c8-8b32-444b89eb364b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:03.244076 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7cbb5684-2dbc-40c8-8b32-444b89eb364b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 200 len: 1316 microversion: 2.1 time: 0.910455 Aug 02 06:48:03.246158 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 265/596] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:02 2022] GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 1316 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:03.256038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85007c38-6343-45ef-bc7d-ab2afabdb663 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:03.257054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-85007c38-6343-45ef-bc7d-ab2afabdb663 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:03.267870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85007c38-6343-45ef-bc7d-ab2afabdb663 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:03.270340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85007c38-6343-45ef-bc7d-ab2afabdb663 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:03.272239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85007c38-6343-45ef-bc7d-ab2afabdb663 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:03.274181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85007c38-6343-45ef-bc7d-ab2afabdb663 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:03.503432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f07126f8-800e-41ea-b5d4-8d1d5e2cd26c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:03.515500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f07126f8-800e-41ea-b5d4-8d1d5e2cd26c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:03.517017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f07126f8-800e-41ea-b5d4-8d1d5e2cd26c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:03.518178 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f07126f8-800e-41ea-b5d4-8d1d5e2cd26c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1361 microversion: 2.25 time: 0.597071 Aug 02 06:48:03.530061 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 332/597] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:02 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1361 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:03.535407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4c0369d0-c20c-49a1-be00-b7d261a7ac87 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:03.536647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4c0369d0-c20c-49a1-be00-b7d261a7ac87 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:03.544997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c0369d0-c20c-49a1-be00-b7d261a7ac87 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:03.546390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c0369d0-c20c-49a1-be00-b7d261a7ac87 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:03.547427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c0369d0-c20c-49a1-be00-b7d261a7ac87 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:03.548330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c0369d0-c20c-49a1-be00-b7d261a7ac87 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:03.848776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4c0369d0-c20c-49a1-be00-b7d261a7ac87 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:03.865425 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4c0369d0-c20c-49a1-be00-b7d261a7ac87 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1283 microversion: 2.1 time: 0.333449 Aug 02 06:48:03.866424 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 333/598] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:03 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1283 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:03.873511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-39cd15b8-921a-44ed-ae3e-151de6cf5cf4 req-ec8d76c9-39bf-40b4-a1da-e40431aab29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ae3b2d-b9db-4285-a9d1-665045b4d168", "name": "network-vif-plugged", "status": "completed", "tag": "f735bcbb-19dc-417d-9bdf-5cb12315ce1c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:03.888689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-39cd15b8-921a-44ed-ae3e-151de6cf5cf4 req-ec8d76c9-39bf-40b4-a1da-e40431aab29e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:03.892138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-39cd15b8-921a-44ed-ae3e-151de6cf5cf4 req-ec8d76c9-39bf-40b4-a1da-e40431aab29e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:03.913445 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-39cd15b8-921a-44ed-ae3e-151de6cf5cf4 req-ec8d76c9-39bf-40b4-a1da-e40431aab29e service nova] Creating event network-vif-plugged:f735bcbb-19dc-417d-9bdf-5cb12315ce1c for instance 75ae3b2d-b9db-4285-a9d1-665045b4d168 on n-h2-851337-3 Aug 02 06:48:03.919608 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-39cd15b8-921a-44ed-ae3e-151de6cf5cf4 req-ec8d76c9-39bf-40b4-a1da-e40431aab29e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051699 Aug 02 06:48:03.921647 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 334/599] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:03.929012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-34617148-19e8-4139-b922-b8b8b5aeb1cb req-c2ce1502-1c08-4d8a-9cf4-ab1ae0835216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a3ace8b-df75-4505-b172-20b320c1156b", "tag": "e5ea5923-841a-4c78-814d-259e79bcfef7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:03.944140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-34617148-19e8-4139-b922-b8b8b5aeb1cb req-c2ce1502-1c08-4d8a-9cf4-ab1ae0835216 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:03.944710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-34617148-19e8-4139-b922-b8b8b5aeb1cb req-c2ce1502-1c08-4d8a-9cf4-ab1ae0835216 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:03.960100 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-34617148-19e8-4139-b922-b8b8b5aeb1cb req-c2ce1502-1c08-4d8a-9cf4-ab1ae0835216 service nova] Creating event network-changed:e5ea5923-841a-4c78-814d-259e79bcfef7 for instance 0a3ace8b-df75-4505-b172-20b320c1156b on n-h1-851337-3 Aug 02 06:48:03.969000 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-34617148-19e8-4139-b922-b8b8b5aeb1cb req-c2ce1502-1c08-4d8a-9cf4-ab1ae0835216 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045646 Aug 02 06:48:03.969965 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 335/600] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:03.975755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f810735-b157-4b72-89db-02551eab10cd tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:03.976788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5f810735-b157-4b72-89db-02551eab10cd tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] [instance: 869b5888-d797-4250-926b-3f7801803680] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:03.983329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f810735-b157-4b72-89db-02551eab10cd tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:03.983943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f810735-b157-4b72-89db-02551eab10cd tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:03.985042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f810735-b157-4b72-89db-02551eab10cd tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:03.986176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f810735-b157-4b72-89db-02551eab10cd tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:04.013741 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-5f810735-b157-4b72-89db-02551eab10cd tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] HTTP exception thrown: Instance 869b5888-d797-4250-926b-3f7801803680 could not be found. Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f810735-b157-4b72-89db-02551eab10cd tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Request method failure captured: Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 HTTP/1.1 Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MhNLPomgYytIck2fQLxFrZd9cGOOerkKcXKPW8d6enO7LevRU61s51EnmG57ENYWCCVI7ZIuLP8_fHYGLbhOpx3MqCkuvXmEUSDYzagm8gN5GTq9HDLkw3CNAYnujUZMmMDoV6nEvRkFZtgYZWRn1QoJi6l-ZKk-69gg72rFSUaTn4 Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.75 Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 252702b461514c20853159fa3138c43c Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersAdmin275Test-593701069 Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:48:04.015649 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:48:04.017333 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/252702b461514c20853159fa3138c43c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/252702b461514c20853159fa3138c43c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_252702b461514c20853159fa3138c43c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/252702b461514c20853159fa3138c43c"}]}] Aug 02 06:48:04.017333 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersAdmin275Test-593701069 Aug 02 06:48:04.017333 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 252702b461514c20853159fa3138c43c Aug 02 06:48:04.017333 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersAdmin275Test-593701069 Aug 02 06:48:04.017333 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersAdmin275Test-593701069-project Aug 02 06:48:04.017333 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:48:04.017333 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:48:04.017333 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 7082e2ac9bb043c2a96c61f07de8281c Aug 02 06:48:04.017333 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersAdmin275Test-593701069-project Aug 02 06:48:04.017333 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:48:04.017333 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 869b5888-d797-4250-926b-3f7801803680 could not be found. Aug 02 06:48:04.017333 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '869b5888-d797-4250-926b-3f7801803680'} Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 869b5888-d797-4250-926b-3f7801803680 could not be found. Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:48:04.018530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 869b5888-d797-4250-926b-3f7801803680 could not be found. Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 869b5888-d797-4250-926b-3f7801803680 could not be found. Aug 02 06:48:04.020088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:04.021384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f810735-b157-4b72-89db-02551eab10cd tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] Returning 404 to user: Instance 869b5888-d797-4250-926b-3f7801803680 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:48:04.025257 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5f810735-b157-4b72-89db-02551eab10cd tempest-ServersAdmin275Test-593701069 tempest-ServersAdmin275Test-593701069-project] 10.222.0.79 "GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680" status: 404 len: 111 microversion: 2.75 time: 0.050450 Aug 02 06:48:04.029712 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 336/601] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:03 2022] GET /compute/v2.1/servers/869b5888-d797-4250-926b-3f7801803680 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:48:04.095946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-85007c38-6343-45ef-bc7d-ab2afabdb663 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:04.123048 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-85007c38-6343-45ef-bc7d-ab2afabdb663 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1471 microversion: 2.1 time: 0.875126 Aug 02 06:48:04.125883 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 266/602] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:03 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1471 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:04.270240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-124984ce-a2cb-4aaf-99cc-04281454fd46 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:04.270851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-124984ce-a2cb-4aaf-99cc-04281454fd46 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:04.285399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-124984ce-a2cb-4aaf-99cc-04281454fd46 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:04.285836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-124984ce-a2cb-4aaf-99cc-04281454fd46 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:04.286628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-124984ce-a2cb-4aaf-99cc-04281454fd46 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:04.287446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-124984ce-a2cb-4aaf-99cc-04281454fd46 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:04.540683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b671a8fa-9850-4db8-a585-9df7a994558d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:04.542187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b671a8fa-9850-4db8-a585-9df7a994558d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:04.548724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b671a8fa-9850-4db8-a585-9df7a994558d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:04.549510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b671a8fa-9850-4db8-a585-9df7a994558d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:04.550578 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b671a8fa-9850-4db8-a585-9df7a994558d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:04.551243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b671a8fa-9850-4db8-a585-9df7a994558d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:05.849540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-124984ce-a2cb-4aaf-99cc-04281454fd46 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:05.862012 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-124984ce-a2cb-4aaf-99cc-04281454fd46 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 200 len: 1316 microversion: 2.1 time: 1.596000 Aug 02 06:48:05.862591 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 337/603] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:04 2022] GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 1316 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:05.878017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b671a8fa-9850-4db8-a585-9df7a994558d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:05.889861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:05.903384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6c0a6953-eccf-4a89-9012-b13ab0ba17fb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:05.903771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6c0a6953-eccf-4a89-9012-b13ab0ba17fb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:05.913653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b671a8fa-9850-4db8-a585-9df7a994558d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:05.915718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b671a8fa-9850-4db8-a585-9df7a994558d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:05.916874 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b671a8fa-9850-4db8-a585-9df7a994558d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1361 microversion: 2.25 time: 1.380210 Aug 02 06:48:05.917426 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 267/604] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:04 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1361 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:48:05.937243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6c0a6953-eccf-4a89-9012-b13ab0ba17fb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:05.939586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6c0a6953-eccf-4a89-9012-b13ab0ba17fb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:05.940937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6c0a6953-eccf-4a89-9012-b13ab0ba17fb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:05.941382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6c0a6953-eccf-4a89-9012-b13ab0ba17fb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:05.962647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-47600051-cc10-43cb-868f-4a7fda0b0df1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:05.963633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-47600051-cc10-43cb-868f-4a7fda0b0df1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:05.978594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47600051-cc10-43cb-868f-4a7fda0b0df1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:05.980248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47600051-cc10-43cb-868f-4a7fda0b0df1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:05.981616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47600051-cc10-43cb-868f-4a7fda0b0df1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:05.984367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47600051-cc10-43cb-868f-4a7fda0b0df1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:06.738511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6c0a6953-eccf-4a89-9012-b13ab0ba17fb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:06.755509 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6c0a6953-eccf-4a89-9012-b13ab0ba17fb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1325 microversion: 2.1 time: 0.890451 Aug 02 06:48:06.759590 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 338/605] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:05 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1325 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:06.782285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-47600051-cc10-43cb-868f-4a7fda0b0df1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:06.798713 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-47600051-cc10-43cb-868f-4a7fda0b0df1 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1471 microversion: 2.1 time: 0.870697 Aug 02 06:48:06.811494 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 268/606] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:05 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1471 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:06.890300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-361d0b0b-4a10-4b2a-b3ed-5fb63b580dd0 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:06.891188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-361d0b0b-4a10-4b2a-b3ed-5fb63b580dd0 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:06.902920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-361d0b0b-4a10-4b2a-b3ed-5fb63b580dd0 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:06.903368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-361d0b0b-4a10-4b2a-b3ed-5fb63b580dd0 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:06.908442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-361d0b0b-4a10-4b2a-b3ed-5fb63b580dd0 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:06.908910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-361d0b0b-4a10-4b2a-b3ed-5fb63b580dd0 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:06.944948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-537319cf-e256-44d5-aee9-809455fbd010 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:06.945611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-537319cf-e256-44d5-aee9-809455fbd010 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:06.972150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-537319cf-e256-44d5-aee9-809455fbd010 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:06.972909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-537319cf-e256-44d5-aee9-809455fbd010 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:06.973817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-537319cf-e256-44d5-aee9-809455fbd010 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:06.976049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-537319cf-e256-44d5-aee9-809455fbd010 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:07.454295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-537319cf-e256-44d5-aee9-809455fbd010 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:07.475827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-537319cf-e256-44d5-aee9-809455fbd010 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:07.477486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-537319cf-e256-44d5-aee9-809455fbd010 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:07.478690 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-537319cf-e256-44d5-aee9-809455fbd010 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1361 microversion: 2.25 time: 0.539913 Aug 02 06:48:07.479262 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 269/607] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:06 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1361 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:48:07.523040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-361d0b0b-4a10-4b2a-b3ed-5fb63b580dd0 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:07.532818 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-361d0b0b-4a10-4b2a-b3ed-5fb63b580dd0 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 200 len: 1466 microversion: 2.1 time: 0.648115 Aug 02 06:48:07.533407 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 339/608] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:06 2022] GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 1466 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:48:07.776432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-865094449", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:07.883786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:48:07.959787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d994c0bc-1503-4062-b0c5-c9fb5009e77f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:07.960509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d994c0bc-1503-4062-b0c5-c9fb5009e77f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:07.971506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d994c0bc-1503-4062-b0c5-c9fb5009e77f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:07.972482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d994c0bc-1503-4062-b0c5-c9fb5009e77f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:07.973602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d994c0bc-1503-4062-b0c5-c9fb5009e77f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:07.974162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d994c0bc-1503-4062-b0c5-c9fb5009e77f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:08.617048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:48:08.620720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:48:08.624161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:48:08.625801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:48:08.627237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:48:08.653209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:08.653553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:08.662364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:08.663471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:08.703800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Getting quotas for project 1e08c65240da4f90a190b2da77a8ff92. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:08.710507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Getting quotas for user 87d1c9cb22d34aaa8b86860b84a1086d and project 1e08c65240da4f90a190b2da77a8ff92. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:08.747240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:48:08.753361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:48:08.859695 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e9742810-1740-4dbf-bb15-996bfb30e87d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.377602 Aug 02 06:48:08.862853 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 270/609] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:48:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:48:08.874712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-21b5283e-e3eb-42df-ab8a-7a0eff64751f tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:08.877051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-21b5283e-e3eb-42df-ab8a-7a0eff64751f tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:08.892521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21b5283e-e3eb-42df-ab8a-7a0eff64751f tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:08.896006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21b5283e-e3eb-42df-ab8a-7a0eff64751f tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:08.897056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21b5283e-e3eb-42df-ab8a-7a0eff64751f tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:08.898170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21b5283e-e3eb-42df-ab8a-7a0eff64751f tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:09.115749 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d994c0bc-1503-4062-b0c5-c9fb5009e77f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 200 len: 1617 microversion: 2.1 time: 1.562800 Aug 02 06:48:09.119695 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 340/610] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:07 2022] GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 1617 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:48:09.147057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-35cbfbf0-a2d5-49c6-9015-c1d99935e64b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:09.152924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-35cbfbf0-a2d5-49c6-9015-c1d99935e64b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:09.170935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35cbfbf0-a2d5-49c6-9015-c1d99935e64b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:09.173093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35cbfbf0-a2d5-49c6-9015-c1d99935e64b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:09.174069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35cbfbf0-a2d5-49c6-9015-c1d99935e64b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:09.176257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35cbfbf0-a2d5-49c6-9015-c1d99935e64b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:09.641019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-35cbfbf0-a2d5-49c6-9015-c1d99935e64b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:09.644749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-21b5283e-e3eb-42df-ab8a-7a0eff64751f tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:09.648913 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-35cbfbf0-a2d5-49c6-9015-c1d99935e64b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1471 microversion: 2.1 time: 0.523284 Aug 02 06:48:09.658377 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 341/611] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:09 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1471 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:09.670120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-13f7cdb9-74c4-4b05-a097-a1e38a579c51 req-a347434c-e8eb-4e0a-878e-2025b9297dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cfd7980-48fb-428b-a177-51e0ca0f7593", "tag": "5c6f370a-cb79-4c1d-a629-d389679669b1"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:09.674852 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-21b5283e-e3eb-42df-ab8a-7a0eff64751f tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1325 microversion: 2.1 time: 0.810748 Aug 02 06:48:09.677397 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 271/612] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:08 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1325 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:09.700245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-82b5e27d-f630-48c6-83b7-1b12119f4e27 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:09.704844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-82b5e27d-f630-48c6-83b7-1b12119f4e27 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:09.716725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-13f7cdb9-74c4-4b05-a097-a1e38a579c51 req-a347434c-e8eb-4e0a-878e-2025b9297dc9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:09.717435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-13f7cdb9-74c4-4b05-a097-a1e38a579c51 req-a347434c-e8eb-4e0a-878e-2025b9297dc9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:09.728211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82b5e27d-f630-48c6-83b7-1b12119f4e27 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:09.729656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82b5e27d-f630-48c6-83b7-1b12119f4e27 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:09.731850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82b5e27d-f630-48c6-83b7-1b12119f4e27 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:09.732299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82b5e27d-f630-48c6-83b7-1b12119f4e27 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:09.739430 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-13f7cdb9-74c4-4b05-a097-a1e38a579c51 req-a347434c-e8eb-4e0a-878e-2025b9297dc9 service nova] Creating event network-changed:5c6f370a-cb79-4c1d-a629-d389679669b1 for instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 on n-h2-851337-3 Aug 02 06:48:09.745721 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-13f7cdb9-74c4-4b05-a097-a1e38a579c51 req-a347434c-e8eb-4e0a-878e-2025b9297dc9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086044 Aug 02 06:48:09.748893 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 342/613] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:09.755554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b5f45c6-5700-4df5-b8fb-b2f0c1072ed1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:09.756646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b5f45c6-5700-4df5-b8fb-b2f0c1072ed1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:09.768009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b5f45c6-5700-4df5-b8fb-b2f0c1072ed1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:09.770095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b5f45c6-5700-4df5-b8fb-b2f0c1072ed1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:09.771411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b5f45c6-5700-4df5-b8fb-b2f0c1072ed1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:09.772462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b5f45c6-5700-4df5-b8fb-b2f0c1072ed1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:09.975860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7b5f45c6-5700-4df5-b8fb-b2f0c1072ed1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:09.984202 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b5f45c6-5700-4df5-b8fb-b2f0c1072ed1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1216 microversion: 2.1 time: 0.233834 Aug 02 06:48:09.988441 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 343/614] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:09 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1216 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:10.006567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a659d2bb-4e60-420e-aa48-48bc550ce6ae tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Action: 'create', calling method: .version_select at 0x7f927b37a550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1339846958", "policies": ["affinity"]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:10.082258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-a659d2bb-4e60-420e-aa48-48bc550ce6ae tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:10.101828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-a659d2bb-4e60-420e-aa48-48bc550ce6ae tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:10.239756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-a659d2bb-4e60-420e-aa48-48bc550ce6ae tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:10.257476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-a659d2bb-4e60-420e-aa48-48bc550ce6ae tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:10.296600 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a659d2bb-4e60-420e-aa48-48bc550ce6ae tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.306996 Aug 02 06:48:10.299024 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 344/615] 10.222.0.79 () {60 vars in 1174 bytes} [Tue Aug 2 06:48:09 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:10.453307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1989431670", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "2196c523-b960-4841-9622-3734bf03701d"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:10.587298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:48:10.778588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-82b5e27d-f630-48c6-83b7-1b12119f4e27 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:10.792827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-82b5e27d-f630-48c6-83b7-1b12119f4e27 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:10.796357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-82b5e27d-f630-48c6-83b7-1b12119f4e27 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:10.800829 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-82b5e27d-f630-48c6-83b7-1b12119f4e27 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1361 microversion: 2.25 time: 1.121337 Aug 02 06:48:10.801426 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 272/616] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:09 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1361 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:10.842501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-552f527d-4757-4e37-8057-9c1b5728aeb9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:10.843663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-552f527d-4757-4e37-8057-9c1b5728aeb9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:10.872338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-552f527d-4757-4e37-8057-9c1b5728aeb9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:10.877280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-552f527d-4757-4e37-8057-9c1b5728aeb9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:10.879857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-552f527d-4757-4e37-8057-9c1b5728aeb9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:10.882347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-552f527d-4757-4e37-8057-9c1b5728aeb9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:11.424698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:48:11.426045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:48:11.427022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:48:11.427607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:48:11.428239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:48:11.447688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-552f527d-4757-4e37-8057-9c1b5728aeb9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:11.464074 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-552f527d-4757-4e37-8057-9c1b5728aeb9 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1471 microversion: 2.1 time: 0.659803 Aug 02 06:48:11.468151 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 273/617] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:10 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1471 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:11.478906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f61431fa-eb47-4a9f-9004-4b959cc27b18 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:11.481012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f61431fa-eb47-4a9f-9004-4b959cc27b18 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:11.495180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f61431fa-eb47-4a9f-9004-4b959cc27b18 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:11.495947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f61431fa-eb47-4a9f-9004-4b959cc27b18 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:11.496887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f61431fa-eb47-4a9f-9004-4b959cc27b18 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:11.497471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f61431fa-eb47-4a9f-9004-4b959cc27b18 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:11.498974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:11.499848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:11.500969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:11.501663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:11.547595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:11.566010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:11.575458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:11.579835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Going to run 2 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:48:11.582405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: fdafac79-c3d1-43ea-b9cf-ecd696afc300] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:48:11.619636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126120) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 02 06:48:11.643365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:11.649916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:11.699092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:11.704864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:11.732721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=fdafac79-c3d1-43ea-b9cf-ecd696afc300,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:48:11.803220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:11.808777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:11.868785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f61431fa-eb47-4a9f-9004-4b959cc27b18 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:11.877233 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f61431fa-eb47-4a9f-9004-4b959cc27b18 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1325 microversion: 2.1 time: 0.407652 Aug 02 06:48:11.882256 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 274/618] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:11 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1325 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:11.885026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:11.894538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8936f279-c483-4ff7-b33d-121adc4309b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:11.895335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8936f279-c483-4ff7-b33d-121adc4309b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:11.900452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:11.907888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8936f279-c483-4ff7-b33d-121adc4309b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:11.908341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8936f279-c483-4ff7-b33d-121adc4309b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:11.909110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8936f279-c483-4ff7-b33d-121adc4309b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:11.909543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8936f279-c483-4ff7-b33d-121adc4309b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:11.979633 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0068ac57-3d12-429c-a84e-dbc5f5eeabb9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.532887 Aug 02 06:48:11.983442 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 345/619] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:48:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 1535 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 02 06:48:11.985713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-12b1f66b-f508-442a-998d-24ae6d0f1370 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:11.986564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-12b1f66b-f508-442a-998d-24ae6d0f1370 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:12.005651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12b1f66b-f508-442a-998d-24ae6d0f1370 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:12.007303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12b1f66b-f508-442a-998d-24ae6d0f1370 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:12.008042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12b1f66b-f508-442a-998d-24ae6d0f1370 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:12.009589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12b1f66b-f508-442a-998d-24ae6d0f1370 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:12.070444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8936f279-c483-4ff7-b33d-121adc4309b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:12.084149 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8936f279-c483-4ff7-b33d-121adc4309b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1270 microversion: 2.1 time: 0.197155 Aug 02 06:48:12.085097 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 275/620] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:11 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1270 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:12.097488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d28c6157-aeb2-4cee-9c43-45dcc4f4dea1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:12.110285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d28c6157-aeb2-4cee-9c43-45dcc4f4dea1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:12.111281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d28c6157-aeb2-4cee-9c43-45dcc4f4dea1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Searching by: {'deleted': False, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:48:12.139443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d28c6157-aeb2-4cee-9c43-45dcc4f4dea1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:12.140171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d28c6157-aeb2-4cee-9c43-45dcc4f4dea1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:12.141179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d28c6157-aeb2-4cee-9c43-45dcc4f4dea1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:12.142319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d28c6157-aeb2-4cee-9c43-45dcc4f4dea1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:12.251035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-12b1f66b-f508-442a-998d-24ae6d0f1370 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:12.253397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-d28c6157-aeb2-4cee-9c43-45dcc4f4dea1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:48:12.263952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-12b1f66b-f508-442a-998d-24ae6d0f1370 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:12.269259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-12b1f66b-f508-442a-998d-24ae6d0f1370 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:12.271210 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-12b1f66b-f508-442a-998d-24ae6d0f1370 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1361 microversion: 2.25 time: 0.289886 Aug 02 06:48:12.273800 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 346/621] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:11 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1361 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:12.484914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6e19fca9-7efa-43a0-be4c-967e40678740 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:12.485553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6e19fca9-7efa-43a0-be4c-967e40678740 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:12.493493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e19fca9-7efa-43a0-be4c-967e40678740 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:12.495319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e19fca9-7efa-43a0-be4c-967e40678740 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:12.498756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e19fca9-7efa-43a0-be4c-967e40678740 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:12.499986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e19fca9-7efa-43a0-be4c-967e40678740 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:12.763863 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d28c6157-aeb2-4cee-9c43-45dcc4f4dea1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.676585 Aug 02 06:48:12.764483 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 276/622] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Aug 2 06:48:12 2022] GET /compute/v2.1/servers => generated 1003 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:12.778830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1d6692f5-25e2-49dc-a2c0-fa4c7a341c6a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:12.779595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1d6692f5-25e2-49dc-a2c0-fa4c7a341c6a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:12.879166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6e19fca9-7efa-43a0-be4c-967e40678740 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:12.892202 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6e19fca9-7efa-43a0-be4c-967e40678740 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1471 microversion: 2.1 time: 0.411038 Aug 02 06:48:12.893537 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 347/623] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:12 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1471 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:12.907307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0bf1c28f-f93c-43fb-9585-e94ad92cfd71 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:12.907934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0bf1c28f-f93c-43fb-9585-e94ad92cfd71 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:12.920807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bf1c28f-f93c-43fb-9585-e94ad92cfd71 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:12.921285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bf1c28f-f93c-43fb-9585-e94ad92cfd71 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:12.922063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bf1c28f-f93c-43fb-9585-e94ad92cfd71 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:12.922498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bf1c28f-f93c-43fb-9585-e94ad92cfd71 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:13.052875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1d6692f5-25e2-49dc-a2c0-fa4c7a341c6a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:13.057028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=15 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:13.068746 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1d6692f5-25e2-49dc-a2c0-fa4c7a341c6a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1219 microversion: 2.1 time: 0.294701 Aug 02 06:48:13.071964 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 277/624] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:12 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1219 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:13.106959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a15ae0a4-c852-427e-a7a7-f660b4222392 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:13.108402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a15ae0a4-c852-427e-a7a7-f660b4222392 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:13.120228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a15ae0a4-c852-427e-a7a7-f660b4222392 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:13.123579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a15ae0a4-c852-427e-a7a7-f660b4222392 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:13.128629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a15ae0a4-c852-427e-a7a7-f660b4222392 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:13.129667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a15ae0a4-c852-427e-a7a7-f660b4222392 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:13.316970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a15ae0a4-c852-427e-a7a7-f660b4222392 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:13.331017 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a15ae0a4-c852-427e-a7a7-f660b4222392 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1270 microversion: 2.1 time: 0.228906 Aug 02 06:48:13.333614 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 278/625] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:13 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1270 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:48:13.344766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2bc270b3-3113-4523-b588-8fb57e876c1c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:13.345712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2bc270b3-3113-4523-b588-8fb57e876c1c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:13.362396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2bc270b3-3113-4523-b588-8fb57e876c1c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:13.362514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2bc270b3-3113-4523-b588-8fb57e876c1c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:13.363261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2bc270b3-3113-4523-b588-8fb57e876c1c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:13.363703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2bc270b3-3113-4523-b588-8fb57e876c1c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:13.544703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0bf1c28f-f93c-43fb-9585-e94ad92cfd71 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:13.548670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:13.565741 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0bf1c28f-f93c-43fb-9585-e94ad92cfd71 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1325 microversion: 2.1 time: 0.665437 Aug 02 06:48:13.566782 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 348/626] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:12 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1325 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:13.762233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2bc270b3-3113-4523-b588-8fb57e876c1c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:13.770753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2bc270b3-3113-4523-b588-8fb57e876c1c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:13.774944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2bc270b3-3113-4523-b588-8fb57e876c1c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:13.776105 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2bc270b3-3113-4523-b588-8fb57e876c1c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1361 microversion: 2.25 time: 0.441258 Aug 02 06:48:13.793348 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 279/627] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:13 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1361 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:13.913739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f4312d3-0b60-49a3-bbfb-cf6f9b016ddd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:13.914400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1f4312d3-0b60-49a3-bbfb-cf6f9b016ddd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:13.932387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f4312d3-0b60-49a3-bbfb-cf6f9b016ddd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:13.932847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f4312d3-0b60-49a3-bbfb-cf6f9b016ddd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:13.952392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f4312d3-0b60-49a3-bbfb-cf6f9b016ddd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:13.952957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f4312d3-0b60-49a3-bbfb-cf6f9b016ddd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:14.098684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1fb2a35f-bbf6-45fb-a16f-3be2df188fdd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:14.100417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1fb2a35f-bbf6-45fb-a16f-3be2df188fdd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:14.123391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1fb2a35f-bbf6-45fb-a16f-3be2df188fdd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:14.124225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1fb2a35f-bbf6-45fb-a16f-3be2df188fdd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:14.125200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1fb2a35f-bbf6-45fb-a16f-3be2df188fdd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:14.126990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1fb2a35f-bbf6-45fb-a16f-3be2df188fdd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:14.273721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1fb2a35f-bbf6-45fb-a16f-3be2df188fdd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:14.286821 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1fb2a35f-bbf6-45fb-a16f-3be2df188fdd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1271 microversion: 2.1 time: 0.197720 Aug 02 06:48:14.288000 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 280/628] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:14 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:48:14.299132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f4312d3-0b60-49a3-bbfb-cf6f9b016ddd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:14.330664 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f4312d3-0b60-49a3-bbfb-cf6f9b016ddd tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1477 microversion: 2.1 time: 0.416917 Aug 02 06:48:14.331533 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 349/629] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:13 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1477 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:14.354079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1b81d0e7-759b-4910-b1a5-200ec9083013 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:14.355889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1b81d0e7-759b-4910-b1a5-200ec9083013 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:14.376610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b81d0e7-759b-4910-b1a5-200ec9083013 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:14.385688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b81d0e7-759b-4910-b1a5-200ec9083013 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:14.389121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b81d0e7-759b-4910-b1a5-200ec9083013 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:14.394637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b81d0e7-759b-4910-b1a5-200ec9083013 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:14.592559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-efe47c93-3fcd-4990-98ca-1566e28d7d39 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:14.593628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-efe47c93-3fcd-4990-98ca-1566e28d7d39 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:14.605990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-efe47c93-3fcd-4990-98ca-1566e28d7d39 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:14.606783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-efe47c93-3fcd-4990-98ca-1566e28d7d39 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:14.608217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-efe47c93-3fcd-4990-98ca-1566e28d7d39 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:14.608851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-efe47c93-3fcd-4990-98ca-1566e28d7d39 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:15.964954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-efe47c93-3fcd-4990-98ca-1566e28d7d39 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:15.984456 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-efe47c93-3fcd-4990-98ca-1566e28d7d39 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1325 microversion: 2.1 time: 1.399858 Aug 02 06:48:15.985700 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 350/630] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:14 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1325 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:16.007278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2a785a8a-b5c5-4842-89b9-e02e6b598ffb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:16.008122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2a785a8a-b5c5-4842-89b9-e02e6b598ffb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:16.018199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a785a8a-b5c5-4842-89b9-e02e6b598ffb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:16.018640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a785a8a-b5c5-4842-89b9-e02e6b598ffb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:16.019396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a785a8a-b5c5-4842-89b9-e02e6b598ffb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:16.022790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a785a8a-b5c5-4842-89b9-e02e6b598ffb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:16.214502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1b81d0e7-759b-4910-b1a5-200ec9083013 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:16.226930 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1b81d0e7-759b-4910-b1a5-200ec9083013 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1312 microversion: 2.1 time: 1.878006 Aug 02 06:48:16.227519 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 281/631] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:14 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1312 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:16.232847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d7cb7876-8d71-46a7-ba68-c5e5959de1fd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:16.248143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d7cb7876-8d71-46a7-ba68-c5e5959de1fd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:16.269602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7cb7876-8d71-46a7-ba68-c5e5959de1fd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:16.270276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7cb7876-8d71-46a7-ba68-c5e5959de1fd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:16.271252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7cb7876-8d71-46a7-ba68-c5e5959de1fd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:16.271881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7cb7876-8d71-46a7-ba68-c5e5959de1fd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:16.652741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d7cb7876-8d71-46a7-ba68-c5e5959de1fd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:16.671712 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d7cb7876-8d71-46a7-ba68-c5e5959de1fd tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1277 microversion: 2.1 time: 0.442445 Aug 02 06:48:16.672354 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 282/632] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:16 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1277 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:16.677439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-83b0d8e7-f8a0-4661-baf1-c941ca059270 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:16.688368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-83b0d8e7-f8a0-4661-baf1-c941ca059270 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:16.701179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-83b0d8e7-f8a0-4661-baf1-c941ca059270 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:16.703686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-83b0d8e7-f8a0-4661-baf1-c941ca059270 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:16.704880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-83b0d8e7-f8a0-4661-baf1-c941ca059270 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:16.705723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-83b0d8e7-f8a0-4661-baf1-c941ca059270 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:17.057654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2a785a8a-b5c5-4842-89b9-e02e6b598ffb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:17.073479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2a785a8a-b5c5-4842-89b9-e02e6b598ffb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:17.075024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2a785a8a-b5c5-4842-89b9-e02e6b598ffb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:17.079723 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2a785a8a-b5c5-4842-89b9-e02e6b598ffb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1361 microversion: 2.25 time: 1.089304 Aug 02 06:48:17.080725 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 351/633] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:15 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1361 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:17.086037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-a5af390a-5006-4bdf-93d3-1c89e9d2fb5b req-84762cbf-444e-44d7-95f4-96c7a46d49a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3ace8b-df75-4505-b172-20b320c1156b", "name": "network-vif-plugged", "status": "completed", "tag": "e5ea5923-841a-4c78-814d-259e79bcfef7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:17.119175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a5af390a-5006-4bdf-93d3-1c89e9d2fb5b req-84762cbf-444e-44d7-95f4-96c7a46d49a1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:17.120653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a5af390a-5006-4bdf-93d3-1c89e9d2fb5b req-84762cbf-444e-44d7-95f4-96c7a46d49a1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:17.159775 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-a5af390a-5006-4bdf-93d3-1c89e9d2fb5b req-84762cbf-444e-44d7-95f4-96c7a46d49a1 service nova] Creating event network-vif-plugged:e5ea5923-841a-4c78-814d-259e79bcfef7 for instance 0a3ace8b-df75-4505-b172-20b320c1156b on n-h1-851337-3 Aug 02 06:48:17.176426 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-a5af390a-5006-4bdf-93d3-1c89e9d2fb5b req-84762cbf-444e-44d7-95f4-96c7a46d49a1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089328 Aug 02 06:48:17.177093 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 352/634] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:17.185829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-54ecb689-a3ec-480a-bf85-305ed20164b6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:17.186561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-54ecb689-a3ec-480a-bf85-305ed20164b6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:17.203317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54ecb689-a3ec-480a-bf85-305ed20164b6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:17.204884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54ecb689-a3ec-480a-bf85-305ed20164b6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:17.207679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54ecb689-a3ec-480a-bf85-305ed20164b6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:17.208128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54ecb689-a3ec-480a-bf85-305ed20164b6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:17.554769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-83b0d8e7-f8a0-4661-baf1-c941ca059270 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:17.570314 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-83b0d8e7-f8a0-4661-baf1-c941ca059270 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1477 microversion: 2.1 time: 0.896432 Aug 02 06:48:17.578855 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 283/635] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:16 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1477 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:17.595584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c12d9f2b-d496-4c63-b6fc-beb60068bb52 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:17.596354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c12d9f2b-d496-4c63-b6fc-beb60068bb52 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:17.608175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c12d9f2b-d496-4c63-b6fc-beb60068bb52 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:17.609018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c12d9f2b-d496-4c63-b6fc-beb60068bb52 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:17.612484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c12d9f2b-d496-4c63-b6fc-beb60068bb52 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:17.613045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c12d9f2b-d496-4c63-b6fc-beb60068bb52 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:17.857880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-54ecb689-a3ec-480a-bf85-305ed20164b6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:17.870946 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-54ecb689-a3ec-480a-bf85-305ed20164b6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1325 microversion: 2.1 time: 0.692593 Aug 02 06:48:17.871623 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 353/636] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:17 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1325 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:17.882717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44eab064-c26c-4b22-a62a-5f606321fcfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:17.884050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-44eab064-c26c-4b22-a62a-5f606321fcfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:17.894463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44eab064-c26c-4b22-a62a-5f606321fcfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:17.894906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44eab064-c26c-4b22-a62a-5f606321fcfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:17.899592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44eab064-c26c-4b22-a62a-5f606321fcfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:17.900117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44eab064-c26c-4b22-a62a-5f606321fcfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:18.073430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c12d9f2b-d496-4c63-b6fc-beb60068bb52 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:18.075547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-44eab064-c26c-4b22-a62a-5f606321fcfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:18.084326 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c12d9f2b-d496-4c63-b6fc-beb60068bb52 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1312 microversion: 2.1 time: 0.502202 Aug 02 06:48:18.098862 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 284/637] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:17 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1312 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:18.098962 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-44eab064-c26c-4b22-a62a-5f606321fcfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1277 microversion: 2.1 time: 0.223411 Aug 02 06:48:18.111894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4b48e256-5f10-49d7-b686-645798d9c4d8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:18.117975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4b48e256-5f10-49d7-b686-645798d9c4d8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:18.122792 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 354/638] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:17 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:18.132342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b48e256-5f10-49d7-b686-645798d9c4d8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:18.139857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b48e256-5f10-49d7-b686-645798d9c4d8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:18.145702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b48e256-5f10-49d7-b686-645798d9c4d8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:18.146300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b48e256-5f10-49d7-b686-645798d9c4d8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:18.498062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-54debbb0-ef3e-413a-96cf-09e1ac2c43d2 req-88d76481-a477-4487-a49a-58e2d8619b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1cfc9e6-596f-46db-a461-358881324e73", "tag": "a823a2eb-10f1-4619-aff3-00267fcfd035"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:18.530311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4b48e256-5f10-49d7-b686-645798d9c4d8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:18.532351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-54debbb0-ef3e-413a-96cf-09e1ac2c43d2 req-88d76481-a477-4487-a49a-58e2d8619b05 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:18.532990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-54debbb0-ef3e-413a-96cf-09e1ac2c43d2 req-88d76481-a477-4487-a49a-58e2d8619b05 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:18.536935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:18.549111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4b48e256-5f10-49d7-b686-645798d9c4d8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:18.551061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4b48e256-5f10-49d7-b686-645798d9c4d8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:18.554436 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4b48e256-5f10-49d7-b686-645798d9c4d8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1361 microversion: 2.25 time: 0.447774 Aug 02 06:48:18.560077 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 285/639] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:18 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1361 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:18.560836 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-54debbb0-ef3e-413a-96cf-09e1ac2c43d2 req-88d76481-a477-4487-a49a-58e2d8619b05 service nova] Creating event network-changed:a823a2eb-10f1-4619-aff3-00267fcfd035 for instance f1cfc9e6-596f-46db-a461-358881324e73 on n-h1-851337-3 Aug 02 06:48:18.577231 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-54debbb0-ef3e-413a-96cf-09e1ac2c43d2 req-88d76481-a477-4487-a49a-58e2d8619b05 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082942 Aug 02 06:48:18.578143 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 355/640] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:48:18.602388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-90ad1718-9ef9-4516-b10d-c6dad436455e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:18.602932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-90ad1718-9ef9-4516-b10d-c6dad436455e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:18.610944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90ad1718-9ef9-4516-b10d-c6dad436455e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:18.611657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90ad1718-9ef9-4516-b10d-c6dad436455e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:18.613039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90ad1718-9ef9-4516-b10d-c6dad436455e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:18.613655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90ad1718-9ef9-4516-b10d-c6dad436455e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:18.815626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-90ad1718-9ef9-4516-b10d-c6dad436455e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:18.841115 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-90ad1718-9ef9-4516-b10d-c6dad436455e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1477 microversion: 2.1 time: 0.241638 Aug 02 06:48:18.856080 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 286/641] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:18 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1477 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:18.895579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bab91e15-6d9c-4d78-be65-2f61cc7d908c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:18.896372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bab91e15-6d9c-4d78-be65-2f61cc7d908c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:18.903804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bab91e15-6d9c-4d78-be65-2f61cc7d908c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:18.904672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bab91e15-6d9c-4d78-be65-2f61cc7d908c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:18.905692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bab91e15-6d9c-4d78-be65-2f61cc7d908c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:18.906509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bab91e15-6d9c-4d78-be65-2f61cc7d908c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:19.106416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-353e88d4-3467-4ad2-9b57-c0cee405c689 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:19.107260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-353e88d4-3467-4ad2-9b57-c0cee405c689 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:19.132955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-353e88d4-3467-4ad2-9b57-c0cee405c689 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:19.132955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-353e88d4-3467-4ad2-9b57-c0cee405c689 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:19.132955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-353e88d4-3467-4ad2-9b57-c0cee405c689 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:19.132955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-353e88d4-3467-4ad2-9b57-c0cee405c689 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:19.464085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bab91e15-6d9c-4d78-be65-2f61cc7d908c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:19.474741 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bab91e15-6d9c-4d78-be65-2f61cc7d908c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1325 microversion: 2.1 time: 0.585467 Aug 02 06:48:19.475328 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 356/642] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:18 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1325 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:19.489875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5e759b2c-f906-43f0-b078-d2281ceca828 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:19.490884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5e759b2c-f906-43f0-b078-d2281ceca828 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:19.507866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e759b2c-f906-43f0-b078-d2281ceca828 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:19.509338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e759b2c-f906-43f0-b078-d2281ceca828 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:19.512092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e759b2c-f906-43f0-b078-d2281ceca828 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:19.512876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e759b2c-f906-43f0-b078-d2281ceca828 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:19.907898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-353e88d4-3467-4ad2-9b57-c0cee405c689 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:19.922955 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-353e88d4-3467-4ad2-9b57-c0cee405c689 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1312 microversion: 2.1 time: 0.816382 Aug 02 06:48:19.923892 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 287/643] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:19 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1312 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:19.937155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-66122b10-7859-4ba5-abf2-ff6f08a2ddbe req-732fb4aa-35ea-4d72-a6d6-3b0022474044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9733613-ae5d-4c27-bf69-3958cd6e459c", "name": "network-vif-unplugged", "status": "completed", "tag": "0020b2b9-f4f6-4a11-bb9e-d97035e3f4d9"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:19.954053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-66122b10-7859-4ba5-abf2-ff6f08a2ddbe req-732fb4aa-35ea-4d72-a6d6-3b0022474044 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:19.954499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-66122b10-7859-4ba5-abf2-ff6f08a2ddbe req-732fb4aa-35ea-4d72-a6d6-3b0022474044 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:19.967839 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-66122b10-7859-4ba5-abf2-ff6f08a2ddbe req-732fb4aa-35ea-4d72-a6d6-3b0022474044 service nova] Creating event network-vif-unplugged:0020b2b9-f4f6-4a11-bb9e-d97035e3f4d9 for instance d9733613-ae5d-4c27-bf69-3958cd6e459c on n-h2-851337-3 Aug 02 06:48:19.973787 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-66122b10-7859-4ba5-abf2-ff6f08a2ddbe req-732fb4aa-35ea-4d72-a6d6-3b0022474044 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047620 Aug 02 06:48:19.975942 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 288/644] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:19.981648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-082a0af7-d53d-43d0-85ee-5d484510a37f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:19.982660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-082a0af7-d53d-43d0-85ee-5d484510a37f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:19.990989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-082a0af7-d53d-43d0-85ee-5d484510a37f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:19.991633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-082a0af7-d53d-43d0-85ee-5d484510a37f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:19.992850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-082a0af7-d53d-43d0-85ee-5d484510a37f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:19.993445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-082a0af7-d53d-43d0-85ee-5d484510a37f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:20.037640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5e759b2c-f906-43f0-b078-d2281ceca828 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:20.057166 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5e759b2c-f906-43f0-b078-d2281ceca828 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1319 microversion: 2.1 time: 0.575396 Aug 02 06:48:20.060568 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 357/645] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:19 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1319 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:20.077233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-78e408ca-dd22-46d5-8c23-36870a8c6a2e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:20.079286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-78e408ca-dd22-46d5-8c23-36870a8c6a2e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:20.093948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e408ca-dd22-46d5-8c23-36870a8c6a2e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:20.094799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e408ca-dd22-46d5-8c23-36870a8c6a2e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:20.095716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e408ca-dd22-46d5-8c23-36870a8c6a2e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:20.096619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e408ca-dd22-46d5-8c23-36870a8c6a2e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:20.473789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-082a0af7-d53d-43d0-85ee-5d484510a37f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:20.484891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-082a0af7-d53d-43d0-85ee-5d484510a37f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:20.490185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-082a0af7-d53d-43d0-85ee-5d484510a37f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:20.491455 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-082a0af7-d53d-43d0-85ee-5d484510a37f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1558 microversion: 2.25 time: 0.514203 Aug 02 06:48:20.492126 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 289/646] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:19 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1558 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:20.516363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9f61b84a-13e3-404f-af34-850200de3dfb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:20.517750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9f61b84a-13e3-404f-af34-850200de3dfb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:20.525041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f61b84a-13e3-404f-af34-850200de3dfb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:20.525904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f61b84a-13e3-404f-af34-850200de3dfb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:20.527174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f61b84a-13e3-404f-af34-850200de3dfb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:20.528214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f61b84a-13e3-404f-af34-850200de3dfb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:20.575371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-78e408ca-dd22-46d5-8c23-36870a8c6a2e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:20.586244 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-78e408ca-dd22-46d5-8c23-36870a8c6a2e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1477 microversion: 2.1 time: 0.521533 Aug 02 06:48:20.586983 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 358/647] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:20 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1477 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:20.945009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-36ee542e-0a75-4eb8-b679-0538c38a81f7 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:20.945641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-36ee542e-0a75-4eb8-b679-0538c38a81f7 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:20.955754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36ee542e-0a75-4eb8-b679-0538c38a81f7 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:20.956474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36ee542e-0a75-4eb8-b679-0538c38a81f7 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:20.958298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36ee542e-0a75-4eb8-b679-0538c38a81f7 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:20.961555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36ee542e-0a75-4eb8-b679-0538c38a81f7 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:20.996403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9f61b84a-13e3-404f-af34-850200de3dfb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:21.009465 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9f61b84a-13e3-404f-af34-850200de3dfb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1325 microversion: 2.1 time: 0.507081 Aug 02 06:48:21.026498 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 290/648] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:20 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1325 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:21.040974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b0ffe6da-c4bf-4c50-94c8-c133547fd235 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:21.041826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b0ffe6da-c4bf-4c50-94c8-c133547fd235 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:21.061722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0ffe6da-c4bf-4c50-94c8-c133547fd235 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:21.062491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0ffe6da-c4bf-4c50-94c8-c133547fd235 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:21.064739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0ffe6da-c4bf-4c50-94c8-c133547fd235 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:21.065412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0ffe6da-c4bf-4c50-94c8-c133547fd235 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:21.410272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-36ee542e-0a75-4eb8-b679-0538c38a81f7 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 0a3ace8b-df75-4505-b172-20b320c1156b {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:48:21.435699 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-36ee542e-0a75-4eb8-b679-0538c38a81f7 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 2050 microversion: 2.25 time: 0.846251 Aug 02 06:48:21.439943 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 359/649] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:20 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 2050 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:21.448517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-446f0867-4f0e-470f-b2dc-d11a63cdc86e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:21.450121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-446f0867-4f0e-470f-b2dc-d11a63cdc86e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:21.465026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-446f0867-4f0e-470f-b2dc-d11a63cdc86e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:21.466775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-446f0867-4f0e-470f-b2dc-d11a63cdc86e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:21.467850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-446f0867-4f0e-470f-b2dc-d11a63cdc86e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:21.469202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-446f0867-4f0e-470f-b2dc-d11a63cdc86e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:21.524295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:21.609320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b0ffe6da-c4bf-4c50-94c8-c133547fd235 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:21.617990 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b0ffe6da-c4bf-4c50-94c8-c133547fd235 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1312 microversion: 2.1 time: 0.589000 Aug 02 06:48:21.618833 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 291/650] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:21 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1312 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:21.624741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-3133532e-0759-4ae3-b753-cb158324097f req-8a47e5d1-dfa8-4fc3-8b21-d42341bc8993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdafac79-c3d1-43ea-b9cf-ecd696afc300", "tag": "dc2c12d9-5559-413b-a059-a00cb0322123"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:21.636610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3133532e-0759-4ae3-b753-cb158324097f req-8a47e5d1-dfa8-4fc3-8b21-d42341bc8993 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:21.637369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3133532e-0759-4ae3-b753-cb158324097f req-8a47e5d1-dfa8-4fc3-8b21-d42341bc8993 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:21.654506 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-3133532e-0759-4ae3-b753-cb158324097f req-8a47e5d1-dfa8-4fc3-8b21-d42341bc8993 service nova] Creating event network-changed:dc2c12d9-5559-413b-a059-a00cb0322123 for instance fdafac79-c3d1-43ea-b9cf-ecd696afc300 on n-h1-851337-3 Aug 02 06:48:21.660675 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-3133532e-0759-4ae3-b753-cb158324097f req-8a47e5d1-dfa8-4fc3-8b21-d42341bc8993 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040412 Aug 02 06:48:21.662850 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 292/651] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:21.669298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2caf0ee1-12fc-4310-8a39-1f874c8c85ef tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:21.670596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2caf0ee1-12fc-4310-8a39-1f874c8c85ef tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:21.679273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2caf0ee1-12fc-4310-8a39-1f874c8c85ef tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:21.680302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2caf0ee1-12fc-4310-8a39-1f874c8c85ef tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:21.681713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2caf0ee1-12fc-4310-8a39-1f874c8c85ef tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:21.682347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2caf0ee1-12fc-4310-8a39-1f874c8c85ef tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:21.913954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=30 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:22.126850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-446f0867-4f0e-470f-b2dc-d11a63cdc86e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:22.142433 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-446f0867-4f0e-470f-b2dc-d11a63cdc86e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1319 microversion: 2.1 time: 0.701080 Aug 02 06:48:22.143710 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 360/652] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:21 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1319 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:22.148461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8348b7d4-8ef1-4091-b065-4a64a8917b94 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:22.149390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8348b7d4-8ef1-4091-b065-4a64a8917b94 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:22.164509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8348b7d4-8ef1-4091-b065-4a64a8917b94 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:22.166063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8348b7d4-8ef1-4091-b065-4a64a8917b94 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:22.168206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8348b7d4-8ef1-4091-b065-4a64a8917b94 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:22.170429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8348b7d4-8ef1-4091-b065-4a64a8917b94 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:22.193405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:22.199162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-2caf0ee1-12fc-4310-8a39-1f874c8c85ef tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 0a3ace8b-df75-4505-b172-20b320c1156b {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:48:22.252195 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2caf0ee1-12fc-4310-8a39-1f874c8c85ef tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 2050 microversion: 2.25 time: 0.587753 Aug 02 06:48:22.261494 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 293/653] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:21 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 2050 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:22.267946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-bcdd5153-c55d-4f4c-b1d5-54a4bc8f8567 req-fb2f451e-5007-4386-9379-e6ec55c18020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cfd7980-48fb-428b-a177-51e0ca0f7593", "name": "network-vif-plugged", "status": "completed", "tag": "5c6f370a-cb79-4c1d-a629-d389679669b1"}, {"server_uuid": "d9733613-ae5d-4c27-bf69-3958cd6e459c", "name": "network-vif-plugged", "status": "completed", "tag": "0020b2b9-f4f6-4a11-bb9e-d97035e3f4d9"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:22.288336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-bcdd5153-c55d-4f4c-b1d5-54a4bc8f8567 req-fb2f451e-5007-4386-9379-e6ec55c18020 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:22.289706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-bcdd5153-c55d-4f4c-b1d5-54a4bc8f8567 req-fb2f451e-5007-4386-9379-e6ec55c18020 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:22.313856 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-bcdd5153-c55d-4f4c-b1d5-54a4bc8f8567 req-fb2f451e-5007-4386-9379-e6ec55c18020 service nova] Creating event network-vif-plugged:5c6f370a-cb79-4c1d-a629-d389679669b1 for instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 on n-h2-851337-3 Aug 02 06:48:22.314660 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-bcdd5153-c55d-4f4c-b1d5-54a4bc8f8567 req-fb2f451e-5007-4386-9379-e6ec55c18020 service nova] Creating event network-vif-plugged:0020b2b9-f4f6-4a11-bb9e-d97035e3f4d9 for instance d9733613-ae5d-4c27-bf69-3958cd6e459c on n-h2-851337-3 Aug 02 06:48:22.328410 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-bcdd5153-c55d-4f4c-b1d5-54a4bc8f8567 req-fb2f451e-5007-4386-9379-e6ec55c18020 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065226 Aug 02 06:48:22.329373 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 294/654] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:22.344702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8348b7d4-8ef1-4091-b065-4a64a8917b94 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:22.360833 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8348b7d4-8ef1-4091-b065-4a64a8917b94 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1477 microversion: 2.1 time: 0.215807 Aug 02 06:48:22.366939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d2c588b1-b05c-4db0-beb5-e7968b27a413 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:22.370176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d2c588b1-b05c-4db0-beb5-e7968b27a413 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:22.376119 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 361/655] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:22 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1477 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:22.386937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-d10cd703-2682-4b0b-bea5-6abfc915fd9a req-763cb25b-8ac5-4f9f-8119-e1139060dd47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83", "tag": "9c10bb5f-0f1e-49f1-b818-534784fee842"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:22.400361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d10cd703-2682-4b0b-bea5-6abfc915fd9a req-763cb25b-8ac5-4f9f-8119-e1139060dd47 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:22.401093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d10cd703-2682-4b0b-bea5-6abfc915fd9a req-763cb25b-8ac5-4f9f-8119-e1139060dd47 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:22.405400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2c588b1-b05c-4db0-beb5-e7968b27a413 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:22.406103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2c588b1-b05c-4db0-beb5-e7968b27a413 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:22.410020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2c588b1-b05c-4db0-beb5-e7968b27a413 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:22.410479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2c588b1-b05c-4db0-beb5-e7968b27a413 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:22.416751 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-d10cd703-2682-4b0b-bea5-6abfc915fd9a req-763cb25b-8ac5-4f9f-8119-e1139060dd47 service nova] Creating event network-changed:9c10bb5f-0f1e-49f1-b818-534784fee842 for instance 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 on n-h1-851337-3 Aug 02 06:48:22.423312 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-d10cd703-2682-4b0b-bea5-6abfc915fd9a req-763cb25b-8ac5-4f9f-8119-e1139060dd47 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043922 Aug 02 06:48:22.424470 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 362/656] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:22.431599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bbf72f6e-a701-4193-95a9-ddf8abb8c78a tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:22.434553 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:48:22.434553 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:48:22.436826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbf72f6e-a701-4193-95a9-ddf8abb8c78a tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:22.437953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbf72f6e-a701-4193-95a9-ddf8abb8c78a tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:22.439190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbf72f6e-a701-4193-95a9-ddf8abb8c78a tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:22.439820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbf72f6e-a701-4193-95a9-ddf8abb8c78a tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:22.472390 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bbf72f6e-a701-4193-95a9-ddf8abb8c78a tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.046069 Aug 02 06:48:22.473553 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 363/657] 10.222.0.79 () {60 vars in 1217 bytes} [Tue Aug 2 06:48:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:48:22.496397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ebbc53d-e182-4124-965f-4412ff4cbece tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851337-3", "block_migration": "auto"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:22.503371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2ebbc53d-e182-4124-965f-4412ff4cbece tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:22.513447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ebbc53d-e182-4124-965f-4412ff4cbece tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:22.513926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ebbc53d-e182-4124-965f-4412ff4cbece tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:22.514859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ebbc53d-e182-4124-965f-4412ff4cbece tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:22.515298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ebbc53d-e182-4124-965f-4412ff4cbece tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:22.676732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-2ebbc53d-e182-4124-965f-4412ff4cbece tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'flavor' on Instance uuid 0a3ace8b-df75-4505-b172-20b320c1156b {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:48:22.788271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2ebbc53d-e182-4124-965f-4412ff4cbece tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Going to try to live migrate instance to n-h2-851337-3 {{(pid=126120) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 02 06:48:22.829269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:22.903196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d2c588b1-b05c-4db0-beb5-e7968b27a413 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:22.913505 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d2c588b1-b05c-4db0-beb5-e7968b27a413 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1325 microversion: 2.1 time: 0.578318 Aug 02 06:48:22.915803 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 295/658] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:22 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1325 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:22.920970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-06060682-8b5a-4772-9d9a-22544588ae3f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:22.921844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-06060682-8b5a-4772-9d9a-22544588ae3f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:22.939252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06060682-8b5a-4772-9d9a-22544588ae3f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:22.939950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06060682-8b5a-4772-9d9a-22544588ae3f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:22.941135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06060682-8b5a-4772-9d9a-22544588ae3f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:22.942092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06060682-8b5a-4772-9d9a-22544588ae3f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:23.132115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:23.338340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-06060682-8b5a-4772-9d9a-22544588ae3f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:23.347731 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-06060682-8b5a-4772-9d9a-22544588ae3f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1312 microversion: 2.1 time: 0.432101 Aug 02 06:48:23.348359 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 296/659] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:22 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1312 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:23.359755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-656781d5-b2ab-4e95-89ce-a3701e71fb76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:23.360892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-656781d5-b2ab-4e95-89ce-a3701e71fb76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:23.380826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-656781d5-b2ab-4e95-89ce-a3701e71fb76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:23.381476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-656781d5-b2ab-4e95-89ce-a3701e71fb76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:23.382511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-656781d5-b2ab-4e95-89ce-a3701e71fb76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:23.383434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-656781d5-b2ab-4e95-89ce-a3701e71fb76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:23.615687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-656781d5-b2ab-4e95-89ce-a3701e71fb76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:23.627449 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-656781d5-b2ab-4e95-89ce-a3701e71fb76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1319 microversion: 2.1 time: 0.278010 Aug 02 06:48:23.628779 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 297/660] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:23 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:23.638129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d6b87b0e-a939-4c53-a12a-2746333f7779 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:23.639324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d6b87b0e-a939-4c53-a12a-2746333f7779 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:23.647440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6b87b0e-a939-4c53-a12a-2746333f7779 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:23.648149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6b87b0e-a939-4c53-a12a-2746333f7779 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:23.654803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6b87b0e-a939-4c53-a12a-2746333f7779 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:23.655406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6b87b0e-a939-4c53-a12a-2746333f7779 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:23.954239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d6b87b0e-a939-4c53-a12a-2746333f7779 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:23.966698 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d6b87b0e-a939-4c53-a12a-2746333f7779 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1477 microversion: 2.1 time: 0.336619 Aug 02 06:48:23.967973 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 298/661] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:23 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1477 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:23.974733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b31ed27c-748f-474d-8c0c-e667af6697f8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:23.975699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b31ed27c-748f-474d-8c0c-e667af6697f8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:23.984338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b31ed27c-748f-474d-8c0c-e667af6697f8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:23.985060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b31ed27c-748f-474d-8c0c-e667af6697f8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:23.986190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b31ed27c-748f-474d-8c0c-e667af6697f8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:23.987054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b31ed27c-748f-474d-8c0c-e667af6697f8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:24.928367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b31ed27c-748f-474d-8c0c-e667af6697f8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:24.949061 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b31ed27c-748f-474d-8c0c-e667af6697f8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1325 microversion: 2.1 time: 0.978719 Aug 02 06:48:24.963583 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 299/662] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:23 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1325 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:24.974635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-198703e7-a59f-4e04-b9cc-d90564f152e9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:24.977733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-198703e7-a59f-4e04-b9cc-d90564f152e9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:24.997587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:25.000944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-198703e7-a59f-4e04-b9cc-d90564f152e9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:25.002215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-198703e7-a59f-4e04-b9cc-d90564f152e9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:25.005538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-198703e7-a59f-4e04-b9cc-d90564f152e9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:25.006430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-198703e7-a59f-4e04-b9cc-d90564f152e9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:25.470236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-198703e7-a59f-4e04-b9cc-d90564f152e9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:25.495445 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-198703e7-a59f-4e04-b9cc-d90564f152e9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1312 microversion: 2.1 time: 0.519575 Aug 02 06:48:25.496779 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 300/663] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:24 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1312 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:25.513527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c5e240ab-72ff-4a39-867e-77a187197861 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:25.514821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c5e240ab-72ff-4a39-867e-77a187197861 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:25.532419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5e240ab-72ff-4a39-867e-77a187197861 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:25.537792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5e240ab-72ff-4a39-867e-77a187197861 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:25.543832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5e240ab-72ff-4a39-867e-77a187197861 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:25.544614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5e240ab-72ff-4a39-867e-77a187197861 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:25.883869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c5e240ab-72ff-4a39-867e-77a187197861 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:25.893069 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c5e240ab-72ff-4a39-867e-77a187197861 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1319 microversion: 2.1 time: 0.392134 Aug 02 06:48:25.896970 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 301/664] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:25 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:25.911019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fcef70e6-51ac-440e-b6d9-f97a20134fb5 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:25.911655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fcef70e6-51ac-440e-b6d9-f97a20134fb5 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:25.919806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fcef70e6-51ac-440e-b6d9-f97a20134fb5 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:25.920326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fcef70e6-51ac-440e-b6d9-f97a20134fb5 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:25.921291 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fcef70e6-51ac-440e-b6d9-f97a20134fb5 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:25.921743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fcef70e6-51ac-440e-b6d9-f97a20134fb5 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:26.095133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fcef70e6-51ac-440e-b6d9-f97a20134fb5 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:26.106313 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fcef70e6-51ac-440e-b6d9-f97a20134fb5 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1462 microversion: 2.1 time: 0.208083 Aug 02 06:48:26.110707 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 302/665] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:25 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1462 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:26.118089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3ef8fbc3-651e-48a5-a1e4-f70537b0efe2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:26.118976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3ef8fbc3-651e-48a5-a1e4-f70537b0efe2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:26.129206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ef8fbc3-651e-48a5-a1e4-f70537b0efe2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:26.129858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ef8fbc3-651e-48a5-a1e4-f70537b0efe2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:26.130929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ef8fbc3-651e-48a5-a1e4-f70537b0efe2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:26.131700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ef8fbc3-651e-48a5-a1e4-f70537b0efe2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:26.414917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3ef8fbc3-651e-48a5-a1e4-f70537b0efe2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:26.429374 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3ef8fbc3-651e-48a5-a1e4-f70537b0efe2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1521 microversion: 2.1 time: 0.317238 Aug 02 06:48:26.447313 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 303/666] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:26 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:26.472742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0d13588-32a6-4005-bad0-2e895b0f05e0 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:26.475399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d0d13588-32a6-4005-bad0-2e895b0f05e0 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:26.515817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0d13588-32a6-4005-bad0-2e895b0f05e0 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:26.518758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0d13588-32a6-4005-bad0-2e895b0f05e0 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:26.524023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0d13588-32a6-4005-bad0-2e895b0f05e0 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:26.524831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0d13588-32a6-4005-bad0-2e895b0f05e0 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:26.533487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:26.822197 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d0d13588-32a6-4005-bad0-2e895b0f05e0 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c/action" status: 202 len: 0 microversion: 2.1 time: 0.372648 Aug 02 06:48:26.823269 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 304/667] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:48:26 2022] POST /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:48:26.833810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d4ac5616-19ca-4c9b-89b0-013b69719796 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:26.839396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d4ac5616-19ca-4c9b-89b0-013b69719796 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:26.852985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d4ac5616-19ca-4c9b-89b0-013b69719796 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:26.853456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d4ac5616-19ca-4c9b-89b0-013b69719796 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:26.854226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d4ac5616-19ca-4c9b-89b0-013b69719796 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:26.854659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d4ac5616-19ca-4c9b-89b0-013b69719796 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:27.022465 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2ebbc53d-e182-4124-965f-4412ff4cbece tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b/action" status: 202 len: 0 microversion: 2.25 time: 4.524812 Aug 02 06:48:27.023412 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 364/668] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Aug 2 06:48:22 2022] POST /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b/action => generated 0 bytes in 4539 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:48:27.032477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e370f92b-6b9e-45c5-9fdf-7e77b0a1c798 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:27.033417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e370f92b-6b9e-45c5-9fdf-7e77b0a1c798 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:27.053065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e370f92b-6b9e-45c5-9fdf-7e77b0a1c798 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:27.055902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e370f92b-6b9e-45c5-9fdf-7e77b0a1c798 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:27.060872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e370f92b-6b9e-45c5-9fdf-7e77b0a1c798 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:27.061651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e370f92b-6b9e-45c5-9fdf-7e77b0a1c798 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:27.406244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d4ac5616-19ca-4c9b-89b0-013b69719796 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:27.424215 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d4ac5616-19ca-4c9b-89b0-013b69719796 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1521 microversion: 2.1 time: 0.600272 Aug 02 06:48:27.437675 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 305/669] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:26 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1521 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:27.449049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0bfc7280-ea88-4ee1-9239-a263f3f19262 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:27.450222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0bfc7280-ea88-4ee1-9239-a263f3f19262 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:27.460631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bfc7280-ea88-4ee1-9239-a263f3f19262 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:27.461324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bfc7280-ea88-4ee1-9239-a263f3f19262 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:27.462301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bfc7280-ea88-4ee1-9239-a263f3f19262 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:27.463049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bfc7280-ea88-4ee1-9239-a263f3f19262 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:27.506402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bfc7280-ea88-4ee1-9239-a263f3f19262 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:27.507168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bfc7280-ea88-4ee1-9239-a263f3f19262 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:27.507894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-0bfc7280-ea88-4ee1-9239-a263f3f19262 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lazy-loading 'fault' on Instance uuid d9733613-ae5d-4c27-bf69-3958cd6e459c {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:48:27.586070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e370f92b-6b9e-45c5-9fdf-7e77b0a1c798 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:27.589983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:27.595954 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e370f92b-6b9e-45c5-9fdf-7e77b0a1c798 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1312 microversion: 2.1 time: 0.571680 Aug 02 06:48:27.617232 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 365/670] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:27 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1312 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:27.654701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0af675a3-314e-4920-9354-6c869ed39bdb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:27.655625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0af675a3-314e-4920-9354-6c869ed39bdb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:27.715748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0af675a3-314e-4920-9354-6c869ed39bdb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:27.716528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0af675a3-314e-4920-9354-6c869ed39bdb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:27.717788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0af675a3-314e-4920-9354-6c869ed39bdb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:27.719234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0af675a3-314e-4920-9354-6c869ed39bdb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:27.957508 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0bfc7280-ea88-4ee1-9239-a263f3f19262 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1596 microversion: 2.1 time: 0.518410 Aug 02 06:48:27.959591 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 306/671] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:27 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1596 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:27.973436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dc8c6605-96ea-4929-9efb-8f4c6715b809 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:27.974547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dc8c6605-96ea-4929-9efb-8f4c6715b809 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:28.019640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc8c6605-96ea-4929-9efb-8f4c6715b809 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:28.020829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc8c6605-96ea-4929-9efb-8f4c6715b809 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:28.022250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc8c6605-96ea-4929-9efb-8f4c6715b809 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:28.022860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc8c6605-96ea-4929-9efb-8f4c6715b809 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:28.387331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0af675a3-314e-4920-9354-6c869ed39bdb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:28.403004 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0af675a3-314e-4920-9354-6c869ed39bdb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1319 microversion: 2.1 time: 0.781356 Aug 02 06:48:28.417060 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 366/672] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:27 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1319 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:28.436626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a871bce2-0745-4234-8f3b-f4db89541a00 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1836237890", "metadata": {"": ""}}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a871bce2-0745-4234-8f3b-f4db89541a00 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Request method failure captured: Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593/action HTTP/1.1 Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 107 Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mics1p1wCl4AqIUegQm3d_pITBwYatFLhRipYelRyLmShzntTbvDif13hJU68Dr75PS5-_PVH2rlUrC3GCvZKy-mXcsTS2uVfBsDy9F9AEKbH8bLuQNqUkYQSS9whNQEqNGjlGMPbf7vASEghxC68ftUIES6H21F7o83_JNpyen0zM Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:48:28.456609 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:48:28.458397 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}] Aug 02 06:48:28.458397 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:28.458397 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:48:28.458397 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:28.458397 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:48:28.458397 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:48:28.458397 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:48:28.458397 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b519574e86e841c3a31851e1f4657dd8 Aug 02 06:48:28.458397 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:48:28.458397 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:48:28.458397 n-d-851337-3 devstack@n-api.service[126120]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1836237890", "metadata": {"": ""}}} Aug 02 06:48:28.458397 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '1cfd7980-48fb-428b-a177-51e0ca0f7593', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1836237890', 'metadata': {'': ''}}}} Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'': ''} Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:28.459326 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:28.460892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:28.464723 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:28.464723 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:28.464723 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:48:28.464723 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:48:28.464723 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 06:48:28.464723 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:28.467704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a871bce2-0745-4234-8f3b-f4db89541a00 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:48:28.475561 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a871bce2-0745-4234-8f3b-f4db89541a00 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "POST /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593/action" status: 400 len: 170 microversion: 2.1 time: 0.055696 Aug 02 06:48:28.481981 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 367/673] 10.222.0.79 () {60 vars in 1279 bytes} [Tue Aug 2 06:48:28 2022] POST /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593/action => generated 170 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:48:28.506075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3a50f813-6421-49aa-bf8d-f9eef93fae68 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:28.508987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3a50f813-6421-49aa-bf8d-f9eef93fae68 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:28.536443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a50f813-6421-49aa-bf8d-f9eef93fae68 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:28.536926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a50f813-6421-49aa-bf8d-f9eef93fae68 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:28.537739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a50f813-6421-49aa-bf8d-f9eef93fae68 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:28.538207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a50f813-6421-49aa-bf8d-f9eef93fae68 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:28.569152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dc8c6605-96ea-4929-9efb-8f4c6715b809 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:28.583930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dc8c6605-96ea-4929-9efb-8f4c6715b809 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:28.591958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dc8c6605-96ea-4929-9efb-8f4c6715b809 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:28.595760 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dc8c6605-96ea-4929-9efb-8f4c6715b809 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1568 microversion: 2.25 time: 0.634938 Aug 02 06:48:28.599608 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 307/674] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:27 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1568 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:28.612231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8a416605-c499-4e0f-9a0d-082473b33ca8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:28.618434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8a416605-c499-4e0f-9a0d-082473b33ca8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:28.642760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a416605-c499-4e0f-9a0d-082473b33ca8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:28.645942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a416605-c499-4e0f-9a0d-082473b33ca8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:28.659417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a416605-c499-4e0f-9a0d-082473b33ca8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:28.660043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a416605-c499-4e0f-9a0d-082473b33ca8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:28.793107 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3a50f813-6421-49aa-bf8d-f9eef93fae68 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c/action" status: 202 len: 0 microversion: 2.1 time: 0.298617 Aug 02 06:48:28.795032 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 368/675] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:48:28 2022] POST /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:48:28.801676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44e2ff7c-5084-4031-a387-dc2110f2966f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:28.802794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-44e2ff7c-5084-4031-a387-dc2110f2966f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:28.819145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44e2ff7c-5084-4031-a387-dc2110f2966f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:28.819786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44e2ff7c-5084-4031-a387-dc2110f2966f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:28.820640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44e2ff7c-5084-4031-a387-dc2110f2966f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:28.822679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44e2ff7c-5084-4031-a387-dc2110f2966f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:29.085877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8a416605-c499-4e0f-9a0d-082473b33ca8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:29.094958 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8a416605-c499-4e0f-9a0d-082473b33ca8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1521 microversion: 2.1 time: 0.494067 Aug 02 06:48:29.099499 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 308/676] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:28 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:29.111993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f316d376-5247-433f-8d93-19fd40d37179 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:29.115664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f316d376-5247-433f-8d93-19fd40d37179 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:29.130207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f316d376-5247-433f-8d93-19fd40d37179 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:29.132158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f316d376-5247-433f-8d93-19fd40d37179 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:29.135419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f316d376-5247-433f-8d93-19fd40d37179 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:29.136431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f316d376-5247-433f-8d93-19fd40d37179 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:29.159583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-44e2ff7c-5084-4031-a387-dc2110f2966f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:29.172716 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-44e2ff7c-5084-4031-a387-dc2110f2966f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1312 microversion: 2.1 time: 0.372664 Aug 02 06:48:29.173993 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 369/677] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:28 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1312 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:29.178953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d35174a4-7338-42b6-8fc0-4abc8b8bf181 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:29.182167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d35174a4-7338-42b6-8fc0-4abc8b8bf181 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:29.190496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d35174a4-7338-42b6-8fc0-4abc8b8bf181 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:29.191328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d35174a4-7338-42b6-8fc0-4abc8b8bf181 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:29.192347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d35174a4-7338-42b6-8fc0-4abc8b8bf181 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:29.193151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d35174a4-7338-42b6-8fc0-4abc8b8bf181 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:29.552934 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f316d376-5247-433f-8d93-19fd40d37179 tempest-ServersAdminTestJSON-1492061143 tempest-ServersAdminTestJSON-1492061143-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1613 microversion: 2.1 time: 0.452125 Aug 02 06:48:29.569276 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 309/678] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:29 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1613 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:29.587837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-06e992f2-1841-48a9-b30a-3a965d1e3af4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:29.590813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-06e992f2-1841-48a9-b30a-3a965d1e3af4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:29.607703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06e992f2-1841-48a9-b30a-3a965d1e3af4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:29.612120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06e992f2-1841-48a9-b30a-3a965d1e3af4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:29.613290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06e992f2-1841-48a9-b30a-3a965d1e3af4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:29.614481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06e992f2-1841-48a9-b30a-3a965d1e3af4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:29.628903 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d35174a4-7338-42b6-8fc0-4abc8b8bf181 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:29.639913 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d35174a4-7338-42b6-8fc0-4abc8b8bf181 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1521 microversion: 2.1 time: 0.464536 Aug 02 06:48:29.655886 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 370/679] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:29 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1521 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:29.664150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2f71c1fe-57bb-41e1-9a40-8386d587aa77 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:29.673189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2f71c1fe-57bb-41e1-9a40-8386d587aa77 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:29.691807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f71c1fe-57bb-41e1-9a40-8386d587aa77 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:29.692834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f71c1fe-57bb-41e1-9a40-8386d587aa77 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:29.693845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f71c1fe-57bb-41e1-9a40-8386d587aa77 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:29.701215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f71c1fe-57bb-41e1-9a40-8386d587aa77 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:29.761374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2f71c1fe-57bb-41e1-9a40-8386d587aa77 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:48:29.937527 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2f71c1fe-57bb-41e1-9a40-8386d587aa77 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881" status: 204 len: 0 microversion: 2.1 time: 0.279863 Aug 02 06:48:29.938541 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 371/680] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:48:29 2022] DELETE /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:48:29.944013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c78f3a94-9723-43a4-ab3f-471ee849294d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:29.945020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c78f3a94-9723-43a4-ab3f-471ee849294d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:29.958010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c78f3a94-9723-43a4-ab3f-471ee849294d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:29.959989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c78f3a94-9723-43a4-ab3f-471ee849294d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:29.961040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c78f3a94-9723-43a4-ab3f-471ee849294d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:29.962403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c78f3a94-9723-43a4-ab3f-471ee849294d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:30.153113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-06e992f2-1841-48a9-b30a-3a965d1e3af4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:30.185596 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-06e992f2-1841-48a9-b30a-3a965d1e3af4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1319 microversion: 2.1 time: 0.603694 Aug 02 06:48:30.199920 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 310/681] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:29 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1319 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:30.222241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-485e1575-9633-49a8-ab3d-82fdb13860b8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-428345161", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-485e1575-9633-49a8-ab3d-82fdb13860b8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Request method failure captured: Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593/action HTTP/1.1 Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 618 Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mics1p1wCl4AqIUegQm3d_pITBwYatFLhRipYelRyLmShzntTbvDif13hJU68Dr75PS5-_PVH2rlUrC3GCvZKy-mXcsTS2uVfBsDy9F9AEKbH8bLuQNqUkYQSS9whNQEqNGjlGMPbf7vASEghxC68ftUIES6H21F7o83_JNpyen0zM Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:48:30.233928 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:48:30.235349 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}] Aug 02 06:48:30.235349 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:30.235349 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:48:30.235349 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:30.235349 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:48:30.235349 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:48:30.235349 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:48:30.235349 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b519574e86e841c3a31851e1f4657dd8 Aug 02 06:48:30.235349 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:48:30.235349 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:48:30.236003 n-d-851337-3 devstack@n-api.service[126119]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-428345161", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 02 06:48:30.236003 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:48:30.236003 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 06:48:30.236253 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1cfd7980-48fb-428b-a177-51e0ca0f7593', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-428345161', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 02 06:48:30.236253 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:48:30.236253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:30.236253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:48:30.236253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:48:30.236253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:48:30.236253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:48:30.236253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 06:48:30.236253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:30.236253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 02 06:48:30.236253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:48:30.236945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:48:30.238028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:48:30.238028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:48:30.238028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:48:30.238028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:48:30.238028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:48:30.238028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:48:30.238028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:48:30.238028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 06:48:30.238028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:30.238028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:30.238028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:30.238028 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:30.238778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:30.238778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:30.238778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:48:30.238778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:48:30.238778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 06:48:30.238778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:30.245728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-485e1575-9633-49a8-ab3d-82fdb13860b8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:48:30.248590 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-485e1575-9633-49a8-ab3d-82fdb13860b8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "POST /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593/action" status: 400 len: 938 microversion: 2.1 time: 0.046527 Aug 02 06:48:30.251777 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 311/682] 10.222.0.79 () {60 vars in 1279 bytes} [Tue Aug 2 06:48:30 2022] POST /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593/action => generated 938 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:48:30.269677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ea5d3ef-39eb-4001-9899-9361aac10c83 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:30.271371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ea5d3ef-39eb-4001-9899-9361aac10c83 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:30.293110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c78f3a94-9723-43a4-ab3f-471ee849294d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:30.299322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ea5d3ef-39eb-4001-9899-9361aac10c83 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:30.299498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ea5d3ef-39eb-4001-9899-9361aac10c83 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:30.304561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ea5d3ef-39eb-4001-9899-9361aac10c83 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:30.304703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c78f3a94-9723-43a4-ab3f-471ee849294d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:30.309073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c78f3a94-9723-43a4-ab3f-471ee849294d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:30.310056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ea5d3ef-39eb-4001-9899-9361aac10c83 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:30.310922 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c78f3a94-9723-43a4-ab3f-471ee849294d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1568 microversion: 2.25 time: 0.371087 Aug 02 06:48:30.312023 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 372/683] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:29 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1568 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:30.331428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ba89274b-1670-48f3-b9ef-70cb6b2f118a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:30.342519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ba89274b-1670-48f3-b9ef-70cb6b2f118a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:30.369253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba89274b-1670-48f3-b9ef-70cb6b2f118a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:30.374388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba89274b-1670-48f3-b9ef-70cb6b2f118a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:30.375474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba89274b-1670-48f3-b9ef-70cb6b2f118a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:30.376032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba89274b-1670-48f3-b9ef-70cb6b2f118a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:30.864297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ba89274b-1670-48f3-b9ef-70cb6b2f118a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:30.880476 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ba89274b-1670-48f3-b9ef-70cb6b2f118a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1312 microversion: 2.1 time: 0.558290 Aug 02 06:48:30.889116 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 373/684] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:30 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1312 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:30.905637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83216963-da66-4942-8e0e-f406625846b2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:30.910495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-83216963-da66-4942-8e0e-f406625846b2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:30.917627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83216963-da66-4942-8e0e-f406625846b2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:30.918361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83216963-da66-4942-8e0e-f406625846b2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:30.919466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83216963-da66-4942-8e0e-f406625846b2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:30.920064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83216963-da66-4942-8e0e-f406625846b2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:30.942067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ea5d3ef-39eb-4001-9899-9361aac10c83 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:30.952064 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ea5d3ef-39eb-4001-9899-9361aac10c83 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881" status: 200 len: 1468 microversion: 2.1 time: 0.696884 Aug 02 06:48:30.963290 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 312/685] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:30 2022] GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 => generated 1468 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:31.168951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-83216963-da66-4942-8e0e-f406625846b2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:31.180573 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-83216963-da66-4942-8e0e-f406625846b2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1521 microversion: 2.1 time: 0.289530 Aug 02 06:48:31.191771 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 374/686] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:30 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:31.219533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ee29049e-3d28-466c-93f0-d7728c0b2be4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:31.222786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ee29049e-3d28-466c-93f0-d7728c0b2be4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:31.230066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-68f3c441-243e-4d22-9fdb-e937208347be tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:31.232035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-68f3c441-243e-4d22-9fdb-e937208347be tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:31.242220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee29049e-3d28-466c-93f0-d7728c0b2be4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:31.248405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee29049e-3d28-466c-93f0-d7728c0b2be4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:31.251587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee29049e-3d28-466c-93f0-d7728c0b2be4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:31.252601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee29049e-3d28-466c-93f0-d7728c0b2be4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:31.256552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68f3c441-243e-4d22-9fdb-e937208347be tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:31.262159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68f3c441-243e-4d22-9fdb-e937208347be tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:31.274514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68f3c441-243e-4d22-9fdb-e937208347be tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:31.276957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68f3c441-243e-4d22-9fdb-e937208347be tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:32.450366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:32.852974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-68f3c441-243e-4d22-9fdb-e937208347be tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:32.857111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ee29049e-3d28-466c-93f0-d7728c0b2be4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:32.902473 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ee29049e-3d28-466c-93f0-d7728c0b2be4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1521 microversion: 2.1 time: 1.682944 Aug 02 06:48:32.907603 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-68f3c441-243e-4d22-9fdb-e937208347be tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1319 microversion: 2.1 time: 1.686269 Aug 02 06:48:32.918120 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 313/687] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:31 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1521 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:32.927753 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 375/688] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:31 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1319 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:32.931837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a31ea945-9b1b-40f8-ab99-90d4937c0d6d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:32.936271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a31ea945-9b1b-40f8-ab99-90d4937c0d6d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:32.951112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-33d73971-8b00-42d3-99de-f5b8aafe6162 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:32.952593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a31ea945-9b1b-40f8-ab99-90d4937c0d6d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:32.953399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-33d73971-8b00-42d3-99de-f5b8aafe6162 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:32.955966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a31ea945-9b1b-40f8-ab99-90d4937c0d6d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:32.957979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a31ea945-9b1b-40f8-ab99-90d4937c0d6d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:32.961253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a31ea945-9b1b-40f8-ab99-90d4937c0d6d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:32.976357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33d73971-8b00-42d3-99de-f5b8aafe6162 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:32.980288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33d73971-8b00-42d3-99de-f5b8aafe6162 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:32.983379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33d73971-8b00-42d3-99de-f5b8aafe6162 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:32.987629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33d73971-8b00-42d3-99de-f5b8aafe6162 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:34.674126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-33d73971-8b00-42d3-99de-f5b8aafe6162 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:34.697825 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-33d73971-8b00-42d3-99de-f5b8aafe6162 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1312 microversion: 2.1 time: 1.761741 Aug 02 06:48:34.718099 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 376/689] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:32 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1312 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:34.723369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a31ea945-9b1b-40f8-ab99-90d4937c0d6d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:34.738022 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a31ea945-9b1b-40f8-ab99-90d4937c0d6d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:34.740241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a31ea945-9b1b-40f8-ab99-90d4937c0d6d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:34.742861 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a31ea945-9b1b-40f8-ab99-90d4937c0d6d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1568 microversion: 2.25 time: 1.823536 Aug 02 06:48:34.751442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ec0a22d0-abd3-41c3-9c92-dd06e7402e55 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:34.752827 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 314/690] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:32 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1568 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:34.753786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ec0a22d0-abd3-41c3-9c92-dd06e7402e55 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:34.775861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-d27677a0-71f8-40cf-9316-0b31b35b917b req-c60aba31-57a6-433f-b310-d4d2ca41c59b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cfc9e6-596f-46db-a461-358881324e73", "name": "network-vif-plugged", "status": "completed", "tag": "a823a2eb-10f1-4619-aff3-00267fcfd035"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:34.789078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec0a22d0-abd3-41c3-9c92-dd06e7402e55 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:34.790962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec0a22d0-abd3-41c3-9c92-dd06e7402e55 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:34.793749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec0a22d0-abd3-41c3-9c92-dd06e7402e55 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:34.799274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec0a22d0-abd3-41c3-9c92-dd06e7402e55 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:34.803323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d27677a0-71f8-40cf-9316-0b31b35b917b req-c60aba31-57a6-433f-b310-d4d2ca41c59b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:34.807884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d27677a0-71f8-40cf-9316-0b31b35b917b req-c60aba31-57a6-433f-b310-d4d2ca41c59b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:34.871666 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-d27677a0-71f8-40cf-9316-0b31b35b917b req-c60aba31-57a6-433f-b310-d4d2ca41c59b service nova] Creating event network-vif-plugged:a823a2eb-10f1-4619-aff3-00267fcfd035 for instance f1cfc9e6-596f-46db-a461-358881324e73 on n-h1-851337-3 Aug 02 06:48:34.879405 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-d27677a0-71f8-40cf-9316-0b31b35b917b req-c60aba31-57a6-433f-b310-d4d2ca41c59b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124943 Aug 02 06:48:34.881361 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 315/691] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:34.890516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f285da5-e6bb-478f-953b-a3ea1f6b4546 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f285da5-e6bb-478f-953b-a3ea1f6b4546 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Request method failure captured: Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593/action HTTP/1.1 Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 285 Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mics1p1wCl4AqIUegQm3d_pITBwYatFLhRipYelRyLmShzntTbvDif13hJU68Dr75PS5-_PVH2rlUrC3GCvZKy-mXcsTS2uVfBsDy9F9AEKbH8bLuQNqUkYQSS9whNQEqNGjlGMPbf7vASEghxC68ftUIES6H21F7o83_JNpyen0zM Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:48:34.901239 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:48:34.903129 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}] Aug 02 06:48:34.903129 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:34.903129 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:48:34.903129 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:34.903129 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:48:34.903129 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:48:34.903129 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:48:34.903129 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b519574e86e841c3a31851e1f4657dd8 Aug 02 06:48:34.903129 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:48:34.903129 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:48:34.903129 n-d-851337-3 devstack@n-api.service[126119]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 02 06:48:34.903891 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:48:34.903891 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 06:48:34.903891 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1cfd7980-48fb-428b-a177-51e0ca0f7593', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 02 06:48:34.903891 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:48:34.903891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:34.903891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:48:34.903891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:48:34.903891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:48:34.903891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:48:34.903891 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:48:34.904568 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:48:34.905825 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:48:34.905825 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:48:34.905825 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:48:34.905825 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:48:34.905825 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 06:48:34.905825 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:34.905825 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:34.905825 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:34.905825 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:34.905825 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:34.905825 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:34.905825 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:48:34.905825 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:48:34.910022 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 06:48:34.910022 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:34.914085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f285da5-e6bb-478f-953b-a3ea1f6b4546 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:48:34.919898 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3f285da5-e6bb-478f-953b-a3ea1f6b4546 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "POST /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593/action" status: 400 len: 619 microversion: 2.1 time: 0.034210 Aug 02 06:48:34.926717 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 316/692] 10.222.0.79 () {60 vars in 1279 bytes} [Tue Aug 2 06:48:34 2022] POST /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593/action => generated 619 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:48:34.932592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-4b737314-8fa1-43a2-8823-a1170139e531 req-0c374c34-1a49-4213-82ab-80a163d3d18a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3ace8b-df75-4505-b172-20b320c1156b", "name": "network-vif-unplugged", "status": "completed", "tag": "e5ea5923-841a-4c78-814d-259e79bcfef7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:34.987153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-4b737314-8fa1-43a2-8823-a1170139e531 req-0c374c34-1a49-4213-82ab-80a163d3d18a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:34.987620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-4b737314-8fa1-43a2-8823-a1170139e531 req-0c374c34-1a49-4213-82ab-80a163d3d18a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:35.016336 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-4b737314-8fa1-43a2-8823-a1170139e531 req-0c374c34-1a49-4213-82ab-80a163d3d18a service nova] Creating event network-vif-unplugged:e5ea5923-841a-4c78-814d-259e79bcfef7 for instance 0a3ace8b-df75-4505-b172-20b320c1156b on n-h1-851337-3 Aug 02 06:48:35.029232 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-4b737314-8fa1-43a2-8823-a1170139e531 req-0c374c34-1a49-4213-82ab-80a163d3d18a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100502 Aug 02 06:48:35.031759 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 317/693] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:35.047445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-205d5b6c-f991-4f74-8e6f-7e11f3205095 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:35.052856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-205d5b6c-f991-4f74-8e6f-7e11f3205095 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:35.071235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-205d5b6c-f991-4f74-8e6f-7e11f3205095 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:35.071701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-205d5b6c-f991-4f74-8e6f-7e11f3205095 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:35.074808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-205d5b6c-f991-4f74-8e6f-7e11f3205095 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:35.075304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-205d5b6c-f991-4f74-8e6f-7e11f3205095 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:35.176368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ec0a22d0-abd3-41c3-9c92-dd06e7402e55 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:35.204514 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ec0a22d0-abd3-41c3-9c92-dd06e7402e55 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881" status: 200 len: 1298 microversion: 2.1 time: 0.483426 Aug 02 06:48:35.207209 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 377/694] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:34 2022] GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 => generated 1298 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:35.221049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c9dd63f-66a8-462c-96fd-97b1b2c09d75 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:35.229453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1c9dd63f-66a8-462c-96fd-97b1b2c09d75 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:35.252140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c9dd63f-66a8-462c-96fd-97b1b2c09d75 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:35.252592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c9dd63f-66a8-462c-96fd-97b1b2c09d75 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:35.266326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c9dd63f-66a8-462c-96fd-97b1b2c09d75 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:35.266794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c9dd63f-66a8-462c-96fd-97b1b2c09d75 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:35.813413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-205d5b6c-f991-4f74-8e6f-7e11f3205095 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:35.845379 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-205d5b6c-f991-4f74-8e6f-7e11f3205095 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1319 microversion: 2.1 time: 0.812158 Aug 02 06:48:35.861467 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 318/695] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:35 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1319 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:35.871200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fa319427-e104-41b2-9ff7-82e707cd8e51 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:35.872480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fa319427-e104-41b2-9ff7-82e707cd8e51 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:35.884411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa319427-e104-41b2-9ff7-82e707cd8e51 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:35.885116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa319427-e104-41b2-9ff7-82e707cd8e51 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:35.886165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa319427-e104-41b2-9ff7-82e707cd8e51 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:35.887527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa319427-e104-41b2-9ff7-82e707cd8e51 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:36.039428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1c9dd63f-66a8-462c-96fd-97b1b2c09d75 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:36.053153 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1c9dd63f-66a8-462c-96fd-97b1b2c09d75 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1521 microversion: 2.1 time: 0.843613 Aug 02 06:48:36.057930 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 378/696] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:35 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1521 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:36.074504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b787b1a3-d912-48eb-82c0-3cb68d6927e0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:36.075278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b787b1a3-d912-48eb-82c0-3cb68d6927e0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:36.082588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b787b1a3-d912-48eb-82c0-3cb68d6927e0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:36.084194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b787b1a3-d912-48eb-82c0-3cb68d6927e0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:36.085243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b787b1a3-d912-48eb-82c0-3cb68d6927e0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:36.085856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b787b1a3-d912-48eb-82c0-3cb68d6927e0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:36.242123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fa319427-e104-41b2-9ff7-82e707cd8e51 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:36.244173 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fa319427-e104-41b2-9ff7-82e707cd8e51 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1312 microversion: 2.1 time: 0.381050 Aug 02 06:48:36.256785 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 319/697] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:35 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1312 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:36.275143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a014403c-afa3-4697-a1a0-55b731197ddb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:36.278754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a014403c-afa3-4697-a1a0-55b731197ddb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:36.285814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a014403c-afa3-4697-a1a0-55b731197ddb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:36.286821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a014403c-afa3-4697-a1a0-55b731197ddb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:36.287866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a014403c-afa3-4697-a1a0-55b731197ddb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:36.288515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a014403c-afa3-4697-a1a0-55b731197ddb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:36.389216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b787b1a3-d912-48eb-82c0-3cb68d6927e0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:36.398053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b787b1a3-d912-48eb-82c0-3cb68d6927e0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:36.399937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b787b1a3-d912-48eb-82c0-3cb68d6927e0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:36.401351 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b787b1a3-d912-48eb-82c0-3cb68d6927e0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1568 microversion: 2.25 time: 0.344555 Aug 02 06:48:36.402119 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 379/698] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:36 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1568 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:36.553518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a014403c-afa3-4697-a1a0-55b731197ddb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:36.577490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-31cecca1-cfc2-4ba0-bf88-a23c1564c5c3 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Action: 'create', calling method: .version_select at 0x7f927b2518b0>, body: {"keypair": {"name": "tempest-keypair-1755333763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVw6UdBFZVvxNIv5yJJiMZKnE0pBlDgKuMi8DifAXik3fJVuFSu54JO+W33tLuIlX1wqRU4C/9cWdidpdWrlHkF+wSDnEr/nO8oVyAdRLNEdDBtxaZMipWr2A57oQUBNg=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:36.585648 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a014403c-afa3-4697-a1a0-55b731197ddb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1521 microversion: 2.1 time: 0.326987 Aug 02 06:48:36.586793 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 320/699] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:36 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:36.593886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f6fae350-ecc1-44d6-9599-20f242de8e4b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:36.594577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f6fae350-ecc1-44d6-9599-20f242de8e4b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: ffeec79d-f13b-43f6-8da2-70944a5ed881] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:36.601289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-31cecca1-cfc2-4ba0-bf88-a23c1564c5c3 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Getting quotas for project 4138fe8339db45d7ac0c174ad9e61a1a. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:36.607640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-31cecca1-cfc2-4ba0-bf88-a23c1564c5c3 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Getting quotas for user 7a686659246f4e828823861e173802a4 and project 4138fe8339db45d7ac0c174ad9e61a1a. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:36.608754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6fae350-ecc1-44d6-9599-20f242de8e4b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:36.609200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6fae350-ecc1-44d6-9599-20f242de8e4b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:36.610354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6fae350-ecc1-44d6-9599-20f242de8e4b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:36.610784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6fae350-ecc1-44d6-9599-20f242de8e4b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:36.643080 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-31cecca1-cfc2-4ba0-bf88-a23c1564c5c3 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.239735 Aug 02 06:48:36.644578 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 380/700] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:48:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:36.656863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-805ca442-7472-48df-8edb-de3c07aed9b9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-789000593"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:36.664389 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-f6fae350-ecc1-44d6-9599-20f242de8e4b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] HTTP exception thrown: Instance ffeec79d-f13b-43f6-8da2-70944a5ed881 could not be found. Aug 02 06:48:36.664922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-805ca442-7472-48df-8edb-de3c07aed9b9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f6fae350-ecc1-44d6-9599-20f242de8e4b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Request method failure captured: Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 HTTP/1.1 Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MhRHA_yWJ9UgbCBTKNLaFApegTh-BLmyUy05t4QpN174qgxVFpvd5U8rpzc_h6LcNLNPCnPGPUsuvHjsYZHcZy7XYa9_X96DGtZ-pwfALB4VzelDJz07sx5S7PWRJ3sn2mbFNIweqxRik-RtSvLgIhFATYOouO5G_kcYkZpS0QzRRw Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 3573e2fa6bf04720b7fb8d85b6cc5a54 Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersAdminTestJSON-608281431 Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:48:36.669429 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:48:36.673055 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3573e2fa6bf04720b7fb8d85b6cc5a54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3573e2fa6bf04720b7fb8d85b6cc5a54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3573e2fa6bf04720b7fb8d85b6cc5a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3573e2fa6bf04720b7fb8d85b6cc5a54"}]}] Aug 02 06:48:36.673055 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersAdminTestJSON-608281431 Aug 02 06:48:36.673055 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 3573e2fa6bf04720b7fb8d85b6cc5a54 Aug 02 06:48:36.673055 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersAdminTestJSON-608281431 Aug 02 06:48:36.673055 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersAdminTestJSON-608281431-project Aug 02 06:48:36.673055 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:48:36.673055 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:48:36.673055 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b5122454fd05436fb394a44cef1db729 Aug 02 06:48:36.673055 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersAdminTestJSON-608281431-project Aug 02 06:48:36.673055 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:48:36.673055 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance ffeec79d-f13b-43f6-8da2-70944a5ed881 could not be found. Aug 02 06:48:36.673055 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'ffeec79d-f13b-43f6-8da2-70944a5ed881'} Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffeec79d-f13b-43f6-8da2-70944a5ed881 could not be found. Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:48:36.673954 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffeec79d-f13b-43f6-8da2-70944a5ed881 could not be found. Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffeec79d-f13b-43f6-8da2-70944a5ed881 could not be found. Aug 02 06:48:36.675174 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:36.678653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f6fae350-ecc1-44d6-9599-20f242de8e4b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Returning 404 to user: Instance ffeec79d-f13b-43f6-8da2-70944a5ed881 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:48:36.682897 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f6fae350-ecc1-44d6-9599-20f242de8e4b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881" status: 404 len: 111 microversion: 2.1 time: 0.092081 Aug 02 06:48:36.688744 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 321/701] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:36 2022] GET /compute/v2.1/servers/ffeec79d-f13b-43f6-8da2-70944a5ed881 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:48:36.701953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-805ca442-7472-48df-8edb-de3c07aed9b9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:36.701953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-805ca442-7472-48df-8edb-de3c07aed9b9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:36.707084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-805ca442-7472-48df-8edb-de3c07aed9b9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:36.707195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7364bf2c-a10d-45ee-bdb3-6d435847b03a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:36.707195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7364bf2c-a10d-45ee-bdb3-6d435847b03a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:36.708380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-805ca442-7472-48df-8edb-de3c07aed9b9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:36.726501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7364bf2c-a10d-45ee-bdb3-6d435847b03a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:36.726501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7364bf2c-a10d-45ee-bdb3-6d435847b03a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:36.727487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7364bf2c-a10d-45ee-bdb3-6d435847b03a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:36.732355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7364bf2c-a10d-45ee-bdb3-6d435847b03a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:36.760650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:36.800855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7364bf2c-a10d-45ee-bdb3-6d435847b03a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:48:36.810929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:37.040674 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7364bf2c-a10d-45ee-bdb3-6d435847b03a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 204 len: 0 microversion: 2.1 time: 0.350296 Aug 02 06:48:37.044498 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 322/702] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:48:36 2022] DELETE /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:48:37.053044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d097948f-adee-4efb-9d13-14c13f139ac2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:37.053757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d097948f-adee-4efb-9d13-14c13f139ac2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:37.073969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d097948f-adee-4efb-9d13-14c13f139ac2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:37.077454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d097948f-adee-4efb-9d13-14c13f139ac2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:37.078333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d097948f-adee-4efb-9d13-14c13f139ac2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:37.079681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d097948f-adee-4efb-9d13-14c13f139ac2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:37.146223 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-805ca442-7472-48df-8edb-de3c07aed9b9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "POST /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593/action" status: 202 len: 0 microversion: 2.1 time: 0.499935 Aug 02 06:48:37.153684 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 381/703] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:48:36 2022] POST /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 02 06:48:37.163263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-11118fc0-6b17-4d65-a5f0-45164f9d9251 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:37.165395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-11118fc0-6b17-4d65-a5f0-45164f9d9251 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:37.177460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11118fc0-6b17-4d65-a5f0-45164f9d9251 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:37.177949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11118fc0-6b17-4d65-a5f0-45164f9d9251 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:37.178995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11118fc0-6b17-4d65-a5f0-45164f9d9251 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:37.179430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11118fc0-6b17-4d65-a5f0-45164f9d9251 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:37.346245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d097948f-adee-4efb-9d13-14c13f139ac2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:37.378180 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d097948f-adee-4efb-9d13-14c13f139ac2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1319 microversion: 2.1 time: 0.311217 Aug 02 06:48:37.379662 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 323/704] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:37 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:37.397527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-7a650662-1b3d-41e8-8e50-bf20a3d3ed28 req-b52ee17c-0455-4ec3-b15b-4f3b904efa41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffeec79d-f13b-43f6-8da2-70944a5ed881", "name": "network-vif-deleted", "tag": "9335a2d8-f37b-4e9e-91fb-01c497886dd6"}, {"name": "network-changed", "server_uuid": "0a3ace8b-df75-4505-b172-20b320c1156b", "tag": "e5ea5923-841a-4c78-814d-259e79bcfef7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:37.460126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7a650662-1b3d-41e8-8e50-bf20a3d3ed28 req-b52ee17c-0455-4ec3-b15b-4f3b904efa41 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:37.460579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7a650662-1b3d-41e8-8e50-bf20a3d3ed28 req-b52ee17c-0455-4ec3-b15b-4f3b904efa41 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:37.485146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-11118fc0-6b17-4d65-a5f0-45164f9d9251 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:37.487289 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-7a650662-1b3d-41e8-8e50-bf20a3d3ed28 req-b52ee17c-0455-4ec3-b15b-4f3b904efa41 service nova] Creating event network-vif-deleted:9335a2d8-f37b-4e9e-91fb-01c497886dd6 for instance ffeec79d-f13b-43f6-8da2-70944a5ed881 on n-h2-851337-3 Aug 02 06:48:37.488995 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-7a650662-1b3d-41e8-8e50-bf20a3d3ed28 req-b52ee17c-0455-4ec3-b15b-4f3b904efa41 service nova] Creating event network-changed:e5ea5923-841a-4c78-814d-259e79bcfef7 for instance 0a3ace8b-df75-4505-b172-20b320c1156b on n-h1-851337-3 Aug 02 06:48:37.502016 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-7a650662-1b3d-41e8-8e50-bf20a3d3ed28 req-b52ee17c-0455-4ec3-b15b-4f3b904efa41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.120045 Aug 02 06:48:37.503331 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 324/705] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:37.511422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4a95cad8-de95-4919-8c76-455c18651ec2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1603615916"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:37.514198 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-11118fc0-6b17-4d65-a5f0-45164f9d9251 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 200 len: 1470 microversion: 2.1 time: 0.351798 Aug 02 06:48:37.515068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4a95cad8-de95-4919-8c76-455c18651ec2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:37.519363 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 382/706] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:37 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 1470 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:37.523422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a95cad8-de95-4919-8c76-455c18651ec2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:37.524218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a95cad8-de95-4919-8c76-455c18651ec2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:37.525463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a95cad8-de95-4919-8c76-455c18651ec2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:37.526402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a95cad8-de95-4919-8c76-455c18651ec2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:37.537128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4fa7559b-0c89-4379-bbad-ca595e31574f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:37.540735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4fa7559b-0c89-4379-bbad-ca595e31574f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:37.559415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fa7559b-0c89-4379-bbad-ca595e31574f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:37.559825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fa7559b-0c89-4379-bbad-ca595e31574f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:37.560606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fa7559b-0c89-4379-bbad-ca595e31574f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:37.561039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fa7559b-0c89-4379-bbad-ca595e31574f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:37.574683 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-4a95cad8-de95-4919-8c76-455c18651ec2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] HTTP exception thrown: Cannot 'createImage' instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 while it is in task_state image_snapshot_pending Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4a95cad8-de95-4919-8c76-455c18651ec2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Request method failure captured: Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593/action HTTP/1.1 Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 85 Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mics1p1wCl4AqIUegQm3d_pITBwYatFLhRipYelRyLmShzntTbvDif13hJU68Dr75PS5-_PVH2rlUrC3GCvZKy-mXcsTS2uVfBsDy9F9AEKbH8bLuQNqUkYQSS9whNQEqNGjlGMPbf7vASEghxC68ftUIES6H21F7o83_JNpyen0zM Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:48:37.576561 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:48:37.578197 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}] Aug 02 06:48:37.578197 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:37.578197 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:48:37.578197 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:37.578197 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:48:37.578197 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:48:37.578197 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:48:37.578197 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b519574e86e841c3a31851e1f4657dd8 Aug 02 06:48:37.578197 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:48:37.578197 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:48:37.578197 n-d-851337-3 devstack@n-api.service[126119]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1603615916"}} Aug 02 06:48:37.578197 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: exception: Cannot 'createImage' instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 while it is in task_state image_snapshot_pending Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1cfd7980-48fb-428b-a177-51e0ca0f7593', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1603615916'}}} Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:48:37.579114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 while it is in task_state image_snapshot_pending Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 while it is in task_state image_snapshot_pending Aug 02 06:48:37.580441 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:37.583018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4a95cad8-de95-4919-8c76-455c18651ec2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Returning 409 to user: Cannot 'createImage' instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 while it is in task_state image_snapshot_pending {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:48:37.584142 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4a95cad8-de95-4919-8c76-455c18651ec2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "POST /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593/action" status: 409 len: 167 microversion: 2.1 time: 0.079211 Aug 02 06:48:37.585207 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 325/707] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:48:37 2022] POST /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593/action => generated 167 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:48:37.607096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a62ddfd0-40cd-475e-98ea-8259dc9e6669 req-ea741e31-f629-4512-bb49-456c7b4e16e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdafac79-c3d1-43ea-b9cf-ecd696afc300", "name": "network-vif-plugged", "status": "completed", "tag": "dc2c12d9-5559-413b-a059-a00cb0322123"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:37.636251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a62ddfd0-40cd-475e-98ea-8259dc9e6669 req-ea741e31-f629-4512-bb49-456c7b4e16e4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:37.636695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a62ddfd0-40cd-475e-98ea-8259dc9e6669 req-ea741e31-f629-4512-bb49-456c7b4e16e4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:37.650456 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a62ddfd0-40cd-475e-98ea-8259dc9e6669 req-ea741e31-f629-4512-bb49-456c7b4e16e4 service nova] Creating event network-vif-plugged:dc2c12d9-5559-413b-a059-a00cb0322123 for instance fdafac79-c3d1-43ea-b9cf-ecd696afc300 on n-h1-851337-3 Aug 02 06:48:37.661418 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a62ddfd0-40cd-475e-98ea-8259dc9e6669 req-ea741e31-f629-4512-bb49-456c7b4e16e4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053199 Aug 02 06:48:37.666296 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 326/708] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:37.672023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c25f7a46-db73-4738-8c62-6788a0c9147d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:37.672723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c25f7a46-db73-4738-8c62-6788a0c9147d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:37.699600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c25f7a46-db73-4738-8c62-6788a0c9147d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:37.700181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c25f7a46-db73-4738-8c62-6788a0c9147d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:37.705373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c25f7a46-db73-4738-8c62-6788a0c9147d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:37.706066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c25f7a46-db73-4738-8c62-6788a0c9147d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:38.095358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4fa7559b-0c89-4379-bbad-ca595e31574f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:38.115756 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4fa7559b-0c89-4379-bbad-ca595e31574f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1312 microversion: 2.1 time: 0.589503 Aug 02 06:48:38.118717 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 383/709] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:37 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1312 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:38.135361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c25f7a46-db73-4738-8c62-6788a0c9147d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:38.137457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ebfbcda7-55dc-4122-9f19-aaf23a41cd63 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '.version_select at 0x7f927b6258b0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:38.147309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c25f7a46-db73-4738-8c62-6788a0c9147d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:38.157068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c25f7a46-db73-4738-8c62-6788a0c9147d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:38.159838 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c25f7a46-db73-4738-8c62-6788a0c9147d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1568 microversion: 2.25 time: 0.491755 Aug 02 06:48:38.167056 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 327/710] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:37 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1568 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:38.352498 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ebfbcda7-55dc-4122-9f19-aaf23a41cd63 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "DELETE /compute/v2.1/images/0cc71d22-947f-4f0d-ab0f-98ef8a8cb1fa" status: 204 len: 0 microversion: 2.1 time: 0.230501 Aug 02 06:48:38.353958 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 384/711] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:38 2022] DELETE /compute/v2.1/images/0cc71d22-947f-4f0d-ab0f-98ef8a8cb1fa => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:48:38.362702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-00d9baf0-d3d8-4d4a-b45d-65ac1ad8cbfe tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:38.363548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-00d9baf0-d3d8-4d4a-b45d-65ac1ad8cbfe tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:38.371277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00d9baf0-d3d8-4d4a-b45d-65ac1ad8cbfe tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:38.378599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00d9baf0-d3d8-4d4a-b45d-65ac1ad8cbfe tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:38.379878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00d9baf0-d3d8-4d4a-b45d-65ac1ad8cbfe tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:38.382495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00d9baf0-d3d8-4d4a-b45d-65ac1ad8cbfe tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:38.401155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4bbd613a-8c86-41bb-91f3-37056ae55d13 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:38.402214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4bbd613a-8c86-41bb-91f3-37056ae55d13 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:38.419135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bbd613a-8c86-41bb-91f3-37056ae55d13 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:38.425722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bbd613a-8c86-41bb-91f3-37056ae55d13 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:38.428695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bbd613a-8c86-41bb-91f3-37056ae55d13 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:38.431321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bbd613a-8c86-41bb-91f3-37056ae55d13 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:38.827006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-00d9baf0-d3d8-4d4a-b45d-65ac1ad8cbfe tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:38.834827 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-00d9baf0-d3d8-4d4a-b45d-65ac1ad8cbfe tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1541 microversion: 2.1 time: 0.476384 Aug 02 06:48:38.835567 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 328/712] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:38 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1541 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:38.840403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4bbd613a-8c86-41bb-91f3-37056ae55d13 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:38.848827 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4bbd613a-8c86-41bb-91f3-37056ae55d13 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1319 microversion: 2.1 time: 0.453321 Aug 02 06:48:38.849407 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 385/713] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:38 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1319 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:48:38.850267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-be24b96e-f4f3-4ad3-99f6-e96ae7048e10 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:38.850880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-be24b96e-f4f3-4ad3-99f6-e96ae7048e10 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:38.863150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be24b96e-f4f3-4ad3-99f6-e96ae7048e10 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:38.864383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be24b96e-f4f3-4ad3-99f6-e96ae7048e10 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:38.869038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be24b96e-f4f3-4ad3-99f6-e96ae7048e10 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:38.871610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be24b96e-f4f3-4ad3-99f6-e96ae7048e10 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:39.143795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-21c739f2-af4e-49ee-875f-9cb351ec341d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:39.144667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-21c739f2-af4e-49ee-875f-9cb351ec341d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:39.153429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21c739f2-af4e-49ee-875f-9cb351ec341d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:39.153877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21c739f2-af4e-49ee-875f-9cb351ec341d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:39.158945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21c739f2-af4e-49ee-875f-9cb351ec341d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:39.159402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21c739f2-af4e-49ee-875f-9cb351ec341d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:39.287628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-be24b96e-f4f3-4ad3-99f6-e96ae7048e10 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:39.296185 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-be24b96e-f4f3-4ad3-99f6-e96ae7048e10 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 200 len: 1470 microversion: 2.1 time: 0.459791 Aug 02 06:48:39.314093 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 329/714] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:38 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 1470 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:39.319525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-219f1368-18aa-49ab-818f-ce9ff3325134 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:39.321423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-219f1368-18aa-49ab-818f-ce9ff3325134 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:39.328986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-219f1368-18aa-49ab-818f-ce9ff3325134 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:39.329788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-219f1368-18aa-49ab-818f-ce9ff3325134 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:39.330803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-219f1368-18aa-49ab-818f-ce9ff3325134 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:39.331442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-219f1368-18aa-49ab-818f-ce9ff3325134 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:40.210485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-21c739f2-af4e-49ee-875f-9cb351ec341d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:40.234755 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-21c739f2-af4e-49ee-875f-9cb351ec341d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1461 microversion: 2.1 time: 1.095552 Aug 02 06:48:40.235355 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 386/715] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:39 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1461 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:40.252358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7ea39a1a-a8dd-4a76-b2d8-c189541779e6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:40.258505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7ea39a1a-a8dd-4a76-b2d8-c189541779e6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:40.279011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ea39a1a-a8dd-4a76-b2d8-c189541779e6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:40.281152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ea39a1a-a8dd-4a76-b2d8-c189541779e6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:40.283870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ea39a1a-a8dd-4a76-b2d8-c189541779e6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:40.286001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ea39a1a-a8dd-4a76-b2d8-c189541779e6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:40.350174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-219f1368-18aa-49ab-818f-ce9ff3325134 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:40.359297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-219f1368-18aa-49ab-818f-ce9ff3325134 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:40.365997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-219f1368-18aa-49ab-818f-ce9ff3325134 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:40.367432 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-219f1368-18aa-49ab-818f-ce9ff3325134 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1568 microversion: 2.25 time: 1.051864 Aug 02 06:48:40.370646 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 330/716] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:39 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1568 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:40.384487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-73d1df88-2d2a-4730-9b98-744d859d9a9b req-f7be646b-163a-409a-81af-ae5ba02807e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83", "name": "network-vif-plugged", "status": "completed", "tag": "9c10bb5f-0f1e-49f1-b818-534784fee842"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:40.386262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-73d1df88-2d2a-4730-9b98-744d859d9a9b req-f7be646b-163a-409a-81af-ae5ba02807e8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:40.386945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-73d1df88-2d2a-4730-9b98-744d859d9a9b req-f7be646b-163a-409a-81af-ae5ba02807e8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:40.411478 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-73d1df88-2d2a-4730-9b98-744d859d9a9b req-f7be646b-163a-409a-81af-ae5ba02807e8 service nova] Creating event network-vif-plugged:9c10bb5f-0f1e-49f1-b818-534784fee842 for instance 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 on n-h1-851337-3 Aug 02 06:48:40.435758 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-73d1df88-2d2a-4730-9b98-744d859d9a9b req-f7be646b-163a-409a-81af-ae5ba02807e8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063713 Aug 02 06:48:40.436655 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 331/717] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:40.441834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-43b872dc-cc83-4da8-9fff-c02fa95f6183 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:40.442742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-43b872dc-cc83-4da8-9fff-c02fa95f6183 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:40.460724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43b872dc-cc83-4da8-9fff-c02fa95f6183 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:40.461527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43b872dc-cc83-4da8-9fff-c02fa95f6183 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:40.462485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43b872dc-cc83-4da8-9fff-c02fa95f6183 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:40.463069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43b872dc-cc83-4da8-9fff-c02fa95f6183 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:40.965265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7ea39a1a-a8dd-4a76-b2d8-c189541779e6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:40.969424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-43b872dc-cc83-4da8-9fff-c02fa95f6183 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:40.980940 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-43b872dc-cc83-4da8-9fff-c02fa95f6183 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1319 microversion: 2.1 time: 0.542913 Aug 02 06:48:40.981592 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 332/718] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:40 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1319 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:40.997742 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7ea39a1a-a8dd-4a76-b2d8-c189541779e6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1539 microversion: 2.1 time: 0.745504 Aug 02 06:48:41.032399 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 387/719] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:40 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1539 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:41.039014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1b0e2926-541d-49d7-9939-628b1deb6982 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:41.039632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1b0e2926-541d-49d7-9939-628b1deb6982 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:41.079797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b0e2926-541d-49d7-9939-628b1deb6982 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:41.090359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b0e2926-541d-49d7-9939-628b1deb6982 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:41.095340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b0e2926-541d-49d7-9939-628b1deb6982 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:41.097361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b0e2926-541d-49d7-9939-628b1deb6982 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:41.234537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1b0e2926-541d-49d7-9939-628b1deb6982 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:41.249288 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1b0e2926-541d-49d7-9939-628b1deb6982 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 200 len: 1428 microversion: 2.1 time: 0.215594 Aug 02 06:48:41.255052 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 388/720] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:41 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 1428 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:41.271928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-177174882", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "592af707-a0db-4c0f-85b9-4f9019744c12"}], "security_groups": [{"name": "tempest-securitygroup--1104655553"}], "key_name": "tempest-keypair-1755333763", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:41.304881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bc29b50f-9a98-4ce1-a9a4-d244f4d07238 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:41.306725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bc29b50f-9a98-4ce1-a9a4-d244f4d07238 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:41.313708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc29b50f-9a98-4ce1-a9a4-d244f4d07238 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:41.314338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc29b50f-9a98-4ce1-a9a4-d244f4d07238 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:41.315627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc29b50f-9a98-4ce1-a9a4-d244f4d07238 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:41.318375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc29b50f-9a98-4ce1-a9a4-d244f4d07238 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:41.500726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] validate_networks() for [('592af707-a0db-4c0f-85b9-4f9019744c12', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:48:42.032088 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bc29b50f-9a98-4ce1-a9a4-d244f4d07238 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1612 microversion: 2.1 time: 1.049212 Aug 02 06:48:42.033124 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 333/721] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:40 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1612 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:42.038159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-0e5be82e-1588-4e69-983f-22ecfbd47437 req-e286b432-0417-42fa-83a8-382d17e7a248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b607f5e-31c1-40c5-bf8c-bd097275d4b6", "name": "network-vif-deleted", "tag": "48058daa-15c6-43b5-9ea7-30316b9ebd93"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:42.050767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0e5be82e-1588-4e69-983f-22ecfbd47437 req-e286b432-0417-42fa-83a8-382d17e7a248 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:42.051497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0e5be82e-1588-4e69-983f-22ecfbd47437 req-e286b432-0417-42fa-83a8-382d17e7a248 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:42.071906 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-0e5be82e-1588-4e69-983f-22ecfbd47437 req-e286b432-0417-42fa-83a8-382d17e7a248 service nova] Creating event network-vif-deleted:48058daa-15c6-43b5-9ea7-30316b9ebd93 for instance 2b607f5e-31c1-40c5-bf8c-bd097275d4b6 on n-h2-851337-3 Aug 02 06:48:42.077655 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-0e5be82e-1588-4e69-983f-22ecfbd47437 req-e286b432-0417-42fa-83a8-382d17e7a248 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043139 Aug 02 06:48:42.078605 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 334/722] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:42.083830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4d19bf37-149a-45c4-a830-c32ee8f41a6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:42.084943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4d19bf37-149a-45c4-a830-c32ee8f41a6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:42.094193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d19bf37-149a-45c4-a830-c32ee8f41a6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:42.095053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d19bf37-149a-45c4-a830-c32ee8f41a6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:42.096897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d19bf37-149a-45c4-a830-c32ee8f41a6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:42.097636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d19bf37-149a-45c4-a830-c32ee8f41a6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:42.499159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:48:42.499750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:48:42.500080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:48:42.500672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:48:42.501279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:48:42.517981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:42.520935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:42.521981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:42.522632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:42.535960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4d19bf37-149a-45c4-a830-c32ee8f41a6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:42.548537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4d19bf37-149a-45c4-a830-c32ee8f41a6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:42.550780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4d19bf37-149a-45c4-a830-c32ee8f41a6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:42.552546 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4d19bf37-149a-45c4-a830-c32ee8f41a6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1568 microversion: 2.25 time: 0.472839 Aug 02 06:48:42.553311 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 335/723] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:42 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1568 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:42.558768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-82d7bdae-abd6-4639-8d4d-dd2b98652e4c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:42.560130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-82d7bdae-abd6-4639-8d4d-dd2b98652e4c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:42.568515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82d7bdae-abd6-4639-8d4d-dd2b98652e4c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:42.569728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82d7bdae-abd6-4639-8d4d-dd2b98652e4c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:42.570995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82d7bdae-abd6-4639-8d4d-dd2b98652e4c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:42.572008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82d7bdae-abd6-4639-8d4d-dd2b98652e4c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:42.574279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Getting quotas for project 4138fe8339db45d7ac0c174ad9e61a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:42.589761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Getting quotas for user 7a686659246f4e828823861e173802a4 and project 4138fe8339db45d7ac0c174ad9e61a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:42.612265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:48:42.620597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:48:42.691026 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5c7a9c34-a154-4663-a769-2a3a1c9becd5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.434649 Aug 02 06:48:42.703152 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 389/724] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:48:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:48:42.708649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ae58f98-7b2f-45b0-bc07-67b3773b611e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:42.710188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2ae58f98-7b2f-45b0-bc07-67b3773b611e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:42.720096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ae58f98-7b2f-45b0-bc07-67b3773b611e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:42.720826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ae58f98-7b2f-45b0-bc07-67b3773b611e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:42.722042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ae58f98-7b2f-45b0-bc07-67b3773b611e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:42.722661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ae58f98-7b2f-45b0-bc07-67b3773b611e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:42.804614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-82d7bdae-abd6-4639-8d4d-dd2b98652e4c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:42.816669 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-82d7bdae-abd6-4639-8d4d-dd2b98652e4c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1469 microversion: 2.1 time: 0.261819 Aug 02 06:48:42.844814 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 336/725] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:42 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1469 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:42.844814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b92c1e43-3e69-4254-9fcc-555c23e05e84 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:42.844814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b92c1e43-3e69-4254-9fcc-555c23e05e84 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:42.863165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b92c1e43-3e69-4254-9fcc-555c23e05e84 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:42.863165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b92c1e43-3e69-4254-9fcc-555c23e05e84 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:42.863165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b92c1e43-3e69-4254-9fcc-555c23e05e84 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:42.867117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b92c1e43-3e69-4254-9fcc-555c23e05e84 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:43.140498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b92c1e43-3e69-4254-9fcc-555c23e05e84 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a6293839950f4d21b045f997108b9482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f036676a594d05b9883e65b915048b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:43.141130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b92c1e43-3e69-4254-9fcc-555c23e05e84 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] [instance: f1cfc9e6-596f-46db-a461-358881324e73] flavor_id is None. Assuming migration. {{(pid=126119) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 02 06:48:43.147257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b92c1e43-3e69-4254-9fcc-555c23e05e84 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126119) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 06:48:43.194115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2ae58f98-7b2f-45b0-bc07-67b3773b611e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:43.205712 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2ae58f98-7b2f-45b0-bc07-67b3773b611e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1534 microversion: 2.1 time: 0.501139 Aug 02 06:48:43.209582 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 390/726] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:42 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1534 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:43.234509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cc0e05c2-9cee-4820-a5e3-9131e7057830 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:43.235580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cc0e05c2-9cee-4820-a5e3-9131e7057830 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: 2b607f5e-31c1-40c5-bf8c-bd097275d4b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:43.247105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc0e05c2-9cee-4820-a5e3-9131e7057830 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:43.249581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc0e05c2-9cee-4820-a5e3-9131e7057830 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:43.250665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc0e05c2-9cee-4820-a5e3-9131e7057830 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:43.251108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc0e05c2-9cee-4820-a5e3-9131e7057830 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:43.278562 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-cc0e05c2-9cee-4820-a5e3-9131e7057830 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] HTTP exception thrown: Instance 2b607f5e-31c1-40c5-bf8c-bd097275d4b6 could not be found. Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cc0e05c2-9cee-4820-a5e3-9131e7057830 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Request method failure captured: Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 HTTP/1.1 Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MhRHA_yWJ9UgbCBTKNLaFApegTh-BLmyUy05t4QpN174qgxVFpvd5U8rpzc_h6LcNLNPCnPGPUsuvHjsYZHcZy7XYa9_X96DGtZ-pwfALB4VzelDJz07sx5S7PWRJ3sn2mbFNIweqxRik-RtSvLgIhFATYOouO5G_kcYkZpS0QzRRw Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 3573e2fa6bf04720b7fb8d85b6cc5a54 Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersAdminTestJSON-608281431 Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:48:43.280206 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:48:43.281754 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3573e2fa6bf04720b7fb8d85b6cc5a54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3573e2fa6bf04720b7fb8d85b6cc5a54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3573e2fa6bf04720b7fb8d85b6cc5a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3573e2fa6bf04720b7fb8d85b6cc5a54"}]}] Aug 02 06:48:43.281754 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersAdminTestJSON-608281431 Aug 02 06:48:43.281754 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 3573e2fa6bf04720b7fb8d85b6cc5a54 Aug 02 06:48:43.281754 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersAdminTestJSON-608281431 Aug 02 06:48:43.281754 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersAdminTestJSON-608281431-project Aug 02 06:48:43.281754 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:48:43.281754 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:48:43.281754 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b5122454fd05436fb394a44cef1db729 Aug 02 06:48:43.281754 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersAdminTestJSON-608281431-project Aug 02 06:48:43.281754 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:48:43.281754 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 2b607f5e-31c1-40c5-bf8c-bd097275d4b6 could not be found. Aug 02 06:48:43.281754 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '2b607f5e-31c1-40c5-bf8c-bd097275d4b6'} Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b607f5e-31c1-40c5-bf8c-bd097275d4b6 could not be found. Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:48:43.282652 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b607f5e-31c1-40c5-bf8c-bd097275d4b6 could not be found. Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b607f5e-31c1-40c5-bf8c-bd097275d4b6 could not be found. Aug 02 06:48:43.283788 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:43.284794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cc0e05c2-9cee-4820-a5e3-9131e7057830 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Returning 404 to user: Instance 2b607f5e-31c1-40c5-bf8c-bd097275d4b6 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:48:43.284794 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cc0e05c2-9cee-4820-a5e3-9131e7057830 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6" status: 404 len: 111 microversion: 2.1 time: 0.060178 Aug 02 06:48:43.292951 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 391/727] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:43 2022] GET /compute/v2.1/servers/2b607f5e-31c1-40c5-bf8c-bd097275d4b6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:48:43.305718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1920d51a-0210-4c99-bf86-efe026c99ac0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:43.306284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1920d51a-0210-4c99-bf86-efe026c99ac0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:43.506679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1920d51a-0210-4c99-bf86-efe026c99ac0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:43.522280 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1920d51a-0210-4c99-bf86-efe026c99ac0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1241 microversion: 2.1 time: 0.222319 Aug 02 06:48:43.538244 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 392/728] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:43 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1241 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:43.549772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-52d29a3a-dedc-4f59-90e0-24e80100f72d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:43.551470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-52d29a3a-dedc-4f59-90e0-24e80100f72d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: fdafac79-c3d1-43ea-b9cf-ecd696afc300] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:43.572441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52d29a3a-dedc-4f59-90e0-24e80100f72d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:43.572917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52d29a3a-dedc-4f59-90e0-24e80100f72d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:43.584026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52d29a3a-dedc-4f59-90e0-24e80100f72d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:43.584496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52d29a3a-dedc-4f59-90e0-24e80100f72d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:43.806723 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b92c1e43-3e69-4254-9fcc-555c23e05e84 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73/action" status: 202 len: 0 microversion: 2.1 time: 0.988097 Aug 02 06:48:43.807722 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 337/729] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:48:42 2022] POST /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73/action => generated 0 bytes in 990 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:48:43.817597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-508dcb07-9796-4ecb-b1e0-0dd74cf75760 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:43.818158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-508dcb07-9796-4ecb-b1e0-0dd74cf75760 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:43.835447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-508dcb07-9796-4ecb-b1e0-0dd74cf75760 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:43.835897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-508dcb07-9796-4ecb-b1e0-0dd74cf75760 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:43.836853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-508dcb07-9796-4ecb-b1e0-0dd74cf75760 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:43.837293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-508dcb07-9796-4ecb-b1e0-0dd74cf75760 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:43.907419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-508dcb07-9796-4ecb-b1e0-0dd74cf75760 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:48:43.919781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:44.141013 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-508dcb07-9796-4ecb-b1e0-0dd74cf75760 tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 204 len: 0 microversion: 2.1 time: 0.331589 Aug 02 06:48:44.142893 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 338/730] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:48:43 2022] DELETE /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:48:44.149704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e771dbaa-8995-434a-9381-59a59dd5d7a5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:44.151042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e771dbaa-8995-434a-9381-59a59dd5d7a5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:44.159682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e771dbaa-8995-434a-9381-59a59dd5d7a5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:44.160806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e771dbaa-8995-434a-9381-59a59dd5d7a5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:44.161969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e771dbaa-8995-434a-9381-59a59dd5d7a5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:44.162806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e771dbaa-8995-434a-9381-59a59dd5d7a5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:44.217065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-52d29a3a-dedc-4f59-90e0-24e80100f72d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:44.225953 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-52d29a3a-dedc-4f59-90e0-24e80100f72d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300" status: 200 len: 1469 microversion: 2.1 time: 0.693860 Aug 02 06:48:44.226540 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 393/731] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:43 2022] GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300 => generated 1469 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:44.242178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aa9391c4-7571-4367-903d-0000d1f385d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:44.243360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aa9391c4-7571-4367-903d-0000d1f385d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:44.251995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa9391c4-7571-4367-903d-0000d1f385d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:44.252450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa9391c4-7571-4367-903d-0000d1f385d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:44.253230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa9391c4-7571-4367-903d-0000d1f385d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:44.253695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa9391c4-7571-4367-903d-0000d1f385d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:44.357422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e771dbaa-8995-434a-9381-59a59dd5d7a5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:44.372024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e771dbaa-8995-434a-9381-59a59dd5d7a5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:44.395832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e771dbaa-8995-434a-9381-59a59dd5d7a5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:44.402220 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e771dbaa-8995-434a-9381-59a59dd5d7a5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1568 microversion: 2.25 time: 0.257118 Aug 02 06:48:44.414983 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 339/732] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:44 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:44.419810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3bc69de1-fa5f-4202-894c-7465f852930e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:44.420422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3bc69de1-fa5f-4202-894c-7465f852930e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:44.427186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bc69de1-fa5f-4202-894c-7465f852930e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:44.427624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bc69de1-fa5f-4202-894c-7465f852930e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:44.428391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bc69de1-fa5f-4202-894c-7465f852930e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:44.428990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bc69de1-fa5f-4202-894c-7465f852930e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:44.513002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-aa9391c4-7571-4367-903d-0000d1f385d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:44.531599 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aa9391c4-7571-4367-903d-0000d1f385d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1470 microversion: 2.1 time: 0.303232 Aug 02 06:48:44.554854 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 394/733] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:44 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1470 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:44.563053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-369dfc90-629a-40ca-9649-2578a170ed12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:44.565169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-369dfc90-629a-40ca-9649-2578a170ed12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:44.577491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-369dfc90-629a-40ca-9649-2578a170ed12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:44.578406 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-369dfc90-629a-40ca-9649-2578a170ed12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:44.579579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-369dfc90-629a-40ca-9649-2578a170ed12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:44.580944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-369dfc90-629a-40ca-9649-2578a170ed12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:44.629051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3bc69de1-fa5f-4202-894c-7465f852930e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:44.639855 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3bc69de1-fa5f-4202-894c-7465f852930e tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1468 microversion: 2.1 time: 0.223845 Aug 02 06:48:44.640442 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 340/734] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:44 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1468 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:44.655632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d65aa499-12c9-417f-8de4-dedc73ebccca tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:44.660917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d65aa499-12c9-417f-8de4-dedc73ebccca tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:44.661788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d65aa499-12c9-417f-8de4-dedc73ebccca tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Searching by: {'reservation_id': 'r-jo5m2dkq', 'deleted': False, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:48:44.681998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d65aa499-12c9-417f-8de4-dedc73ebccca tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:44.682819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d65aa499-12c9-417f-8de4-dedc73ebccca tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:44.684748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d65aa499-12c9-417f-8de4-dedc73ebccca tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:44.685397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d65aa499-12c9-417f-8de4-dedc73ebccca tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:44.800682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-369dfc90-629a-40ca-9649-2578a170ed12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:44.812521 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-369dfc90-629a-40ca-9649-2578a170ed12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1521 microversion: 2.1 time: 0.254910 Aug 02 06:48:44.813665 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 395/735] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:44 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:44.819091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b4a2f368-dc25-40a0-9351-34e84956452d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:44.819918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b4a2f368-dc25-40a0-9351-34e84956452d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:44.826603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b4a2f368-dc25-40a0-9351-34e84956452d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:44.827356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b4a2f368-dc25-40a0-9351-34e84956452d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:44.828449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b4a2f368-dc25-40a0-9351-34e84956452d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:44.829204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b4a2f368-dc25-40a0-9351-34e84956452d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:44.877809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-d65aa499-12c9-417f-8de4-dedc73ebccca tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:48:44.914219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b4a2f368-dc25-40a0-9351-34e84956452d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:44.923318 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b4a2f368-dc25-40a0-9351-34e84956452d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1237 microversion: 2.1 time: 0.108249 Aug 02 06:48:44.924357 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 396/736] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:44 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1237 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:44.929596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-71090aaa-547f-4d70-aad4-04883bb9cdc2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:44.930394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-71090aaa-547f-4d70-aad4-04883bb9cdc2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:44.939931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:44.942262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71090aaa-547f-4d70-aad4-04883bb9cdc2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:44.942991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71090aaa-547f-4d70-aad4-04883bb9cdc2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:44.943978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71090aaa-547f-4d70-aad4-04883bb9cdc2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:44.944892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71090aaa-547f-4d70-aad4-04883bb9cdc2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:44.977643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-71090aaa-547f-4d70-aad4-04883bb9cdc2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:48:45.066761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d65aa499-12c9-417f-8de4-dedc73ebccca tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:45.078231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d65aa499-12c9-417f-8de4-dedc73ebccca tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:45.078683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d65aa499-12c9-417f-8de4-dedc73ebccca tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:45.108949 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-71090aaa-547f-4d70-aad4-04883bb9cdc2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 204 len: 0 microversion: 2.1 time: 0.182940 Aug 02 06:48:45.116935 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 397/737] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:48:44 2022] DELETE /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:48:45.130332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c9904b16-32fa-433a-bdcc-bb54b60311e0 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:45.131374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c9904b16-32fa-433a-bdcc-bb54b60311e0 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:45.138739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9904b16-32fa-433a-bdcc-bb54b60311e0 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:45.139188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9904b16-32fa-433a-bdcc-bb54b60311e0 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:45.139960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9904b16-32fa-433a-bdcc-bb54b60311e0 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:45.140391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9904b16-32fa-433a-bdcc-bb54b60311e0 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:45.157575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:45.286551 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d65aa499-12c9-417f-8de4-dedc73ebccca tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?reservation_id=r-jo5m2dkq" status: 200 len: 2931 microversion: 2.1 time: 0.642239 Aug 02 06:48:45.287617 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 341/738] 10.222.0.79 () {58 vars in 1197 bytes} [Tue Aug 2 06:48:44 2022] GET /compute/v2.1/servers/detail?reservation_id=r-jo5m2dkq => generated 2931 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:45.291789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-57eff381-e5ed-4344-bfb7-49112e3f77f6 req-9b462f82-61ba-4d5a-aa0e-6134675c099f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cfd7980-48fb-428b-a177-51e0ca0f7593", "name": "network-vif-plugged", "status": "completed", "tag": "5c6f370a-cb79-4c1d-a629-d389679669b1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:45.303989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:45.308673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-57eff381-e5ed-4344-bfb7-49112e3f77f6 req-9b462f82-61ba-4d5a-aa0e-6134675c099f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:45.309030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-57eff381-e5ed-4344-bfb7-49112e3f77f6 req-9b462f82-61ba-4d5a-aa0e-6134675c099f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:45.325213 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-57eff381-e5ed-4344-bfb7-49112e3f77f6 req-9b462f82-61ba-4d5a-aa0e-6134675c099f service nova] Creating event network-vif-plugged:5c6f370a-cb79-4c1d-a629-d389679669b1 for instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 on n-h2-851337-3 Aug 02 06:48:45.338455 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-57eff381-e5ed-4344-bfb7-49112e3f77f6 req-9b462f82-61ba-4d5a-aa0e-6134675c099f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049929 Aug 02 06:48:45.346272 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 342/739] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:45.353220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a0301f18-f13e-4dc4-af44-202217dc3fbf tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:45.392864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.compute.server_groups [None req-a0301f18-f13e-4dc4-af44-202217dc3fbf tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Querying cell c3b7f982-e927-4a3f-b699-817c726d55c4(cell1) for 2 instances {{(pid=126119) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 02 06:48:45.393582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a0301f18-f13e-4dc4-af44-202217dc3fbf tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:45.394047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a0301f18-f13e-4dc4-af44-202217dc3fbf tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:45.404996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c9904b16-32fa-433a-bdcc-bb54b60311e0 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:45.415070 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c9904b16-32fa-433a-bdcc-bb54b60311e0 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1527 microversion: 2.1 time: 0.295088 Aug 02 06:48:45.416353 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 398/740] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:45 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1527 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:45.425924 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a0301f18-f13e-4dc4-af44-202217dc3fbf tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/2196c523-b960-4841-9622-3734bf03701d" status: 200 len: 266 microversion: 2.1 time: 0.078456 Aug 02 06:48:45.428509 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 343/741] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 06:48:45 2022] GET /compute/v2.1/os-server-groups/2196c523-b960-4841-9622-3734bf03701d => generated 266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:45.438229 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-50385426-a04f-487a-8329-85d49ac77a18 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:45.438756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b130ffa0-8880-4d58-9261-0f7a93198657 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:45.438876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-50385426-a04f-487a-8329-85d49ac77a18 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:45.439961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b130ffa0-8880-4d58-9261-0f7a93198657 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:45.446150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50385426-a04f-487a-8329-85d49ac77a18 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:45.446636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50385426-a04f-487a-8329-85d49ac77a18 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:45.447441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50385426-a04f-487a-8329-85d49ac77a18 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:45.448063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50385426-a04f-487a-8329-85d49ac77a18 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:45.449033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b130ffa0-8880-4d58-9261-0f7a93198657 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:45.449532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b130ffa0-8880-4d58-9261-0f7a93198657 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:45.450583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b130ffa0-8880-4d58-9261-0f7a93198657 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:45.451081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b130ffa0-8880-4d58-9261-0f7a93198657 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:45.696706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-50385426-a04f-487a-8329-85d49ac77a18 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:45.711085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-50385426-a04f-487a-8329-85d49ac77a18 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:45.713787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-50385426-a04f-487a-8329-85d49ac77a18 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:45.715570 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-50385426-a04f-487a-8329-85d49ac77a18 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1568 microversion: 2.25 time: 0.284893 Aug 02 06:48:45.734251 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 399/742] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:45 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1568 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:45.740943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2141ab9d-3045-459b-8f44-8c14187be2f5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:45.743798 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b130ffa0-8880-4d58-9261-0f7a93198657 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 200 len: 1620 microversion: 2.1 time: 0.308712 Aug 02 06:48:45.744558 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 344/743] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:45 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 1620 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:45.746241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2141ab9d-3045-459b-8f44-8c14187be2f5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:45.753141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2141ab9d-3045-459b-8f44-8c14187be2f5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:45.753587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2141ab9d-3045-459b-8f44-8c14187be2f5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:45.754390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2141ab9d-3045-459b-8f44-8c14187be2f5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:45.754817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2141ab9d-3045-459b-8f44-8c14187be2f5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:45.767183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9abeeaef-f810-43e2-8f67-04956dd1969a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:45.768053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9abeeaef-f810-43e2-8f67-04956dd1969a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:45.779244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9abeeaef-f810-43e2-8f67-04956dd1969a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:45.780223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9abeeaef-f810-43e2-8f67-04956dd1969a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:45.781227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9abeeaef-f810-43e2-8f67-04956dd1969a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:45.781814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9abeeaef-f810-43e2-8f67-04956dd1969a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:45.998911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2141ab9d-3045-459b-8f44-8c14187be2f5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:46.003310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9abeeaef-f810-43e2-8f67-04956dd1969a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:46.013117 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2141ab9d-3045-459b-8f44-8c14187be2f5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1470 microversion: 2.1 time: 0.277383 Aug 02 06:48:46.015072 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9abeeaef-f810-43e2-8f67-04956dd1969a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1468 microversion: 2.1 time: 0.254371 Aug 02 06:48:46.015662 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 345/744] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:45 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1468 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:46.028877 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 400/745] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:45 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1470 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:46.030252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-07caf7dc-bb93-4577-a67d-c1591deb8d2f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:46.030950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-07caf7dc-bb93-4577-a67d-c1591deb8d2f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] [instance: fdafac79-c3d1-43ea-b9cf-ecd696afc300] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:46.035722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6cda45c8-7e34-4010-8f3d-288b03225e6c tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:46.036333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6cda45c8-7e34-4010-8f3d-288b03225e6c tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:46.038129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07caf7dc-bb93-4577-a67d-c1591deb8d2f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:46.038717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07caf7dc-bb93-4577-a67d-c1591deb8d2f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:46.039553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07caf7dc-bb93-4577-a67d-c1591deb8d2f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:46.040057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07caf7dc-bb93-4577-a67d-c1591deb8d2f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:46.043900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6cda45c8-7e34-4010-8f3d-288b03225e6c tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:46.044349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6cda45c8-7e34-4010-8f3d-288b03225e6c tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:46.045108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6cda45c8-7e34-4010-8f3d-288b03225e6c tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:46.045543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6cda45c8-7e34-4010-8f3d-288b03225e6c tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:46.138390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6cda45c8-7e34-4010-8f3d-288b03225e6c tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:46.146297 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6cda45c8-7e34-4010-8f3d-288b03225e6c tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1293 microversion: 2.1 time: 0.115604 Aug 02 06:48:46.146877 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 346/746] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:46 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:46.206155 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-07caf7dc-bb93-4577-a67d-c1591deb8d2f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300" status: 200 len: 1620 microversion: 2.1 time: 0.189002 Aug 02 06:48:46.208010 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 401/747] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:46 2022] GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300 => generated 1620 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:46.231277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-acb5588f-3142-40da-adff-1bf6a76fbf20 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Action: 'create', calling method: .version_select at 0x7f927b590790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1043937428", "policies": ["anti-affinity"]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:46.255069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-acb5588f-3142-40da-adff-1bf6a76fbf20 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_groups'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:46.261389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-acb5588f-3142-40da-adff-1bf6a76fbf20 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_groups'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:46.327039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-acb5588f-3142-40da-adff-1bf6a76fbf20 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_groups'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:46.332238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-acb5588f-3142-40da-adff-1bf6a76fbf20 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_groups'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:46.347160 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-acb5588f-3142-40da-adff-1bf6a76fbf20 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.121603 Aug 02 06:48:46.347739 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 347/748] 10.222.0.79 () {60 vars in 1174 bytes} [Tue Aug 2 06:48:46 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:46.437404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6924bf22-b5ac-42f2-9927-6b6f3de118dc tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:46.438489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6924bf22-b5ac-42f2-9927-6b6f3de118dc tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:46.446656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6924bf22-b5ac-42f2-9927-6b6f3de118dc tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:46.447196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6924bf22-b5ac-42f2-9927-6b6f3de118dc tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:46.448659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6924bf22-b5ac-42f2-9927-6b6f3de118dc tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:46.453482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6924bf22-b5ac-42f2-9927-6b6f3de118dc tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:46.462404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-873604903", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ccf652e2-05d6-4b0e-b156-c3354d043b8c"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:46.525220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:48:46.696449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6924bf22-b5ac-42f2-9927-6b6f3de118dc tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:46.704982 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6924bf22-b5ac-42f2-9927-6b6f3de118dc tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1527 microversion: 2.1 time: 0.271652 Aug 02 06:48:46.710936 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 402/749] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:46 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1527 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:46.740260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eec3e91d-3604-42fe-8ee8-e8497c5774b5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:46.741190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-eec3e91d-3604-42fe-8ee8-e8497c5774b5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:46.748058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eec3e91d-3604-42fe-8ee8-e8497c5774b5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:46.748502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eec3e91d-3604-42fe-8ee8-e8497c5774b5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:46.749275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eec3e91d-3604-42fe-8ee8-e8497c5774b5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:46.749699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eec3e91d-3604-42fe-8ee8-e8497c5774b5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:46.832426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:48:46.833112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:48:46.833739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:48:46.834205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:48:46.834868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:48:46.859137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:46.859898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:46.860689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:46.861122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:46.882473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:46.888513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:46.901952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Going to run 2 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:48:46.904507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 3d5f31c5-23d0-4a18-95a0-6947d96566a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:48:46.913255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-eec3e91d-3604-42fe-8ee8-e8497c5774b5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:46.924698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-eec3e91d-3604-42fe-8ee8-e8497c5774b5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:46.926542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-eec3e91d-3604-42fe-8ee8-e8497c5774b5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:46.927780 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-eec3e91d-3604-42fe-8ee8-e8497c5774b5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1568 microversion: 2.25 time: 0.192295 Aug 02 06:48:46.928759 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 403/750] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:46 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:46.956241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126119) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 02 06:48:46.977134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:46.982542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:47.031762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:47.037987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:47.039008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-19509da0-c3ea-4a58-bdb0-0de09d2f0e50 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:47.040075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-19509da0-c3ea-4a58-bdb0-0de09d2f0e50 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:47.047428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19509da0-c3ea-4a58-bdb0-0de09d2f0e50 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:47.048154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19509da0-c3ea-4a58-bdb0-0de09d2f0e50 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:47.049350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19509da0-c3ea-4a58-bdb0-0de09d2f0e50 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:47.050058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19509da0-c3ea-4a58-bdb0-0de09d2f0e50 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:47.053701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=3d5f31c5-23d0-4a18-95a0-6947d96566a5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:48:47.157804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:47.163609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:47.191126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:47.204071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:47.209955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'server_group_members'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:47.222555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-19509da0-c3ea-4a58-bdb0-0de09d2f0e50 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:47.239827 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-19509da0-c3ea-4a58-bdb0-0de09d2f0e50 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1470 microversion: 2.1 time: 0.205061 Aug 02 06:48:47.240423 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 404/751] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:47 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1470 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:47.249778 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1b014e55-12b2-47cc-8715-efac32e55fe7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.795053 Aug 02 06:48:47.250704 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 348/752] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:48:46 2022] POST /compute/v2.1/servers => generated 32 bytes in 797 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 02 06:48:47.255566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cc5faeb9-e48d-40ad-a241-52fdf7d2133b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:47.256175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cc5faeb9-e48d-40ad-a241-52fdf7d2133b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:47.263099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc5faeb9-e48d-40ad-a241-52fdf7d2133b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:47.263550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc5faeb9-e48d-40ad-a241-52fdf7d2133b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:47.264319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc5faeb9-e48d-40ad-a241-52fdf7d2133b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:47.264747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc5faeb9-e48d-40ad-a241-52fdf7d2133b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:47.278776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0d5a6916-4ef4-49f2-bb0b-8981c0dc600b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:47.280169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0d5a6916-4ef4-49f2-bb0b-8981c0dc600b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:47.310362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d5a6916-4ef4-49f2-bb0b-8981c0dc600b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:47.313920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d5a6916-4ef4-49f2-bb0b-8981c0dc600b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:47.319514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d5a6916-4ef4-49f2-bb0b-8981c0dc600b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:47.320007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d5a6916-4ef4-49f2-bb0b-8981c0dc600b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:47.414268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cc5faeb9-e48d-40ad-a241-52fdf7d2133b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:47.425786 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cc5faeb9-e48d-40ad-a241-52fdf7d2133b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1293 microversion: 2.1 time: 0.173791 Aug 02 06:48:47.427172 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 349/753] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:47 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1293 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:47.433731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0ca6e3fd-a494-4ecd-86b9-e9261fb6ca32 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:47.439363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0ca6e3fd-a494-4ecd-86b9-e9261fb6ca32 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:47.440656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0ca6e3fd-a494-4ecd-86b9-e9261fb6ca32 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Searching by: {'deleted': False, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:48:47.463234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ca6e3fd-a494-4ecd-86b9-e9261fb6ca32 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:47.463749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ca6e3fd-a494-4ecd-86b9-e9261fb6ca32 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:47.464653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ca6e3fd-a494-4ecd-86b9-e9261fb6ca32 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:47.465190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ca6e3fd-a494-4ecd-86b9-e9261fb6ca32 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:47.500639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-0ca6e3fd-a494-4ecd-86b9-e9261fb6ca32 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:48:47.540924 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0ca6e3fd-a494-4ecd-86b9-e9261fb6ca32 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.112431 Aug 02 06:48:47.548462 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 350/754] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Aug 2 06:48:47 2022] GET /compute/v2.1/servers => generated 1663 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:47.554398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e968519f-dfc7-4726-8481-2e35c5ab379b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:47.555046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e968519f-dfc7-4726-8481-2e35c5ab379b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:47.617874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0d5a6916-4ef4-49f2-bb0b-8981c0dc600b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:47.630885 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0d5a6916-4ef4-49f2-bb0b-8981c0dc600b tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1468 microversion: 2.1 time: 0.369487 Aug 02 06:48:47.642119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e968519f-dfc7-4726-8481-2e35c5ab379b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:47.647630 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 405/755] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:47 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1468 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:47.653969 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e968519f-dfc7-4726-8481-2e35c5ab379b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1218 microversion: 2.1 time: 0.104043 Aug 02 06:48:47.667225 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 351/756] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:47 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:48:47.732384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ae979c90-6c10-45f0-bc9c-21e3e2a61a22 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:47.733862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae979c90-6c10-45f0-bc9c-21e3e2a61a22 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:47.748232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae979c90-6c10-45f0-bc9c-21e3e2a61a22 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:47.749170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae979c90-6c10-45f0-bc9c-21e3e2a61a22 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:47.750192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae979c90-6c10-45f0-bc9c-21e3e2a61a22 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:47.750839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae979c90-6c10-45f0-bc9c-21e3e2a61a22 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:47.953172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6aa9bfd7-cd3d-4be7-8e6f-6adb8c313553 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:47.953769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6aa9bfd7-cd3d-4be7-8e6f-6adb8c313553 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:47.967656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6aa9bfd7-cd3d-4be7-8e6f-6adb8c313553 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:47.968296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6aa9bfd7-cd3d-4be7-8e6f-6adb8c313553 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:47.969251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6aa9bfd7-cd3d-4be7-8e6f-6adb8c313553 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:47.970064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6aa9bfd7-cd3d-4be7-8e6f-6adb8c313553 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:48.529521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ae979c90-6c10-45f0-bc9c-21e3e2a61a22 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:48.545178 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ae979c90-6c10-45f0-bc9c-21e3e2a61a22 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1527 microversion: 2.1 time: 0.815629 Aug 02 06:48:48.564340 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 406/757] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:47 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1527 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:48.582263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a8aa2d63-fe36-4c80-96d1-8c81b1e93386 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:48.583689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a8aa2d63-fe36-4c80-96d1-8c81b1e93386 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:48.600789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8aa2d63-fe36-4c80-96d1-8c81b1e93386 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:48.605501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8aa2d63-fe36-4c80-96d1-8c81b1e93386 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:48.606677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8aa2d63-fe36-4c80-96d1-8c81b1e93386 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:48.607393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8aa2d63-fe36-4c80-96d1-8c81b1e93386 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:48.626501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6aa9bfd7-cd3d-4be7-8e6f-6adb8c313553 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:48.637033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6aa9bfd7-cd3d-4be7-8e6f-6adb8c313553 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:48.647274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6aa9bfd7-cd3d-4be7-8e6f-6adb8c313553 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:48.648764 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6aa9bfd7-cd3d-4be7-8e6f-6adb8c313553 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1568 microversion: 2.25 time: 0.700567 Aug 02 06:48:48.649953 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 352/758] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:47 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1568 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:48:48.655299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1a10be0b-a836-4ace-a735-a72693a1b466 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:48.662814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1a10be0b-a836-4ace-a735-a72693a1b466 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:48.680894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1a10be0b-a836-4ace-a735-a72693a1b466 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:48.683903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1a10be0b-a836-4ace-a735-a72693a1b466 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:48.685244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1a10be0b-a836-4ace-a735-a72693a1b466 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:48.687232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1a10be0b-a836-4ace-a735-a72693a1b466 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:49.176681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1a10be0b-a836-4ace-a735-a72693a1b466 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:49.185121 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1a10be0b-a836-4ace-a735-a72693a1b466 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1299 microversion: 2.1 time: 0.533805 Aug 02 06:48:49.185797 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 353/759] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:48 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1299 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:49.192551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ee62a615-2f24-442b-9b61-c022f74cc24a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:49.193254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ee62a615-2f24-442b-9b61-c022f74cc24a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:49.214628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee62a615-2f24-442b-9b61-c022f74cc24a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:49.215173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee62a615-2f24-442b-9b61-c022f74cc24a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:49.216388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee62a615-2f24-442b-9b61-c022f74cc24a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:49.217357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee62a615-2f24-442b-9b61-c022f74cc24a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:49.284381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a8aa2d63-fe36-4c80-96d1-8c81b1e93386 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:49.295350 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a8aa2d63-fe36-4c80-96d1-8c81b1e93386 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1470 microversion: 2.1 time: 0.728838 Aug 02 06:48:49.296585 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 407/760] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:48 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1470 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:49.303539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-007123f5-2141-44af-b3cb-e6cde3d35ceb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:49.304189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-007123f5-2141-44af-b3cb-e6cde3d35ceb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:49.318114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-007123f5-2141-44af-b3cb-e6cde3d35ceb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:49.318699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-007123f5-2141-44af-b3cb-e6cde3d35ceb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:49.319620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-007123f5-2141-44af-b3cb-e6cde3d35ceb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:49.320319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-007123f5-2141-44af-b3cb-e6cde3d35ceb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:49.604526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-007123f5-2141-44af-b3cb-e6cde3d35ceb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:49.619345 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-007123f5-2141-44af-b3cb-e6cde3d35ceb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1270 microversion: 2.1 time: 0.321707 Aug 02 06:48:49.622400 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 408/761] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:49 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1270 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:49.649531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7731db1a-f09c-4ade-9105-92d24008caac req-c57e599e-0848-4268-b5f4-00432210edec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cfd7980-48fb-428b-a177-51e0ca0f7593", "name": "network-vif-deleted", "tag": "5c6f370a-cb79-4c1d-a629-d389679669b1"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:49.670076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7731db1a-f09c-4ade-9105-92d24008caac req-c57e599e-0848-4268-b5f4-00432210edec service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:49.670522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7731db1a-f09c-4ade-9105-92d24008caac req-c57e599e-0848-4268-b5f4-00432210edec service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:49.696364 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7731db1a-f09c-4ade-9105-92d24008caac req-c57e599e-0848-4268-b5f4-00432210edec service nova] Creating event network-vif-deleted:5c6f370a-cb79-4c1d-a629-d389679669b1 for instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 on n-h2-851337-3 Aug 02 06:48:49.711878 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7731db1a-f09c-4ade-9105-92d24008caac req-c57e599e-0848-4268-b5f4-00432210edec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072428 Aug 02 06:48:49.712490 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 409/762] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:49.718322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e6d9881c-5649-4f33-9cc5-3adb3090be5c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:49.721826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e6d9881c-5649-4f33-9cc5-3adb3090be5c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:49.735311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6d9881c-5649-4f33-9cc5-3adb3090be5c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:49.740618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6d9881c-5649-4f33-9cc5-3adb3090be5c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:49.741797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6d9881c-5649-4f33-9cc5-3adb3090be5c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:49.754698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6d9881c-5649-4f33-9cc5-3adb3090be5c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:49.819729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6d9881c-5649-4f33-9cc5-3adb3090be5c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:49.820429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6d9881c-5649-4f33-9cc5-3adb3090be5c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:49.821070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-e6d9881c-5649-4f33-9cc5-3adb3090be5c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lazy-loading 'fault' on Instance uuid 1cfd7980-48fb-428b-a177-51e0ca0f7593 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:48:49.871099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ee62a615-2f24-442b-9b61-c022f74cc24a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5122454fd05436fb394a44cef1db729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573e2fa6bf04720b7fb8d85b6cc5a54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:49.880964 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ee62a615-2f24-442b-9b61-c022f74cc24a tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 200 len: 1468 microversion: 2.1 time: 0.694008 Aug 02 06:48:49.883506 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 354/763] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:49 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 1468 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:49.910413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-61846cc8-d722-491d-9679-c0ab72bdb18e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:49.911388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-61846cc8-d722-491d-9679-c0ab72bdb18e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:49.928765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61846cc8-d722-491d-9679-c0ab72bdb18e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:49.929477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61846cc8-d722-491d-9679-c0ab72bdb18e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:49.930494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61846cc8-d722-491d-9679-c0ab72bdb18e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:49.931068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61846cc8-d722-491d-9679-c0ab72bdb18e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:49.988415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e6d9881c-5649-4f33-9cc5-3adb3090be5c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:49.996414 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e6d9881c-5649-4f33-9cc5-3adb3090be5c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 200 len: 1315 microversion: 2.1 time: 0.282350 Aug 02 06:48:49.997189 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 410/764] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:49 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:50.206641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8ac0dfc5-3861-42c8-912a-ad4fc8a494f9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:50.207261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8ac0dfc5-3861-42c8-912a-ad4fc8a494f9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:50.224394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ac0dfc5-3861-42c8-912a-ad4fc8a494f9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:50.224626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ac0dfc5-3861-42c8-912a-ad4fc8a494f9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:50.225400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ac0dfc5-3861-42c8-912a-ad4fc8a494f9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:50.225833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ac0dfc5-3861-42c8-912a-ad4fc8a494f9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:50.436752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8ac0dfc5-3861-42c8-912a-ad4fc8a494f9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:50.464161 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8ac0dfc5-3861-42c8-912a-ad4fc8a494f9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1299 microversion: 2.1 time: 0.260983 Aug 02 06:48:50.466133 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 411/765] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:50 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1299 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:48:50.472987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ae82ddff-e6c3-4568-9189-12e31ab54a0c req-d76340a9-57c3-4739-ab2e-6eeb849173e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9733613-ae5d-4c27-bf69-3958cd6e459c", "name": "network-vif-deleted", "tag": "0020b2b9-f4f6-4a11-bb9e-d97035e3f4d9"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:50.488138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ae82ddff-e6c3-4568-9189-12e31ab54a0c req-d76340a9-57c3-4739-ab2e-6eeb849173e1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:50.488750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ae82ddff-e6c3-4568-9189-12e31ab54a0c req-d76340a9-57c3-4739-ab2e-6eeb849173e1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:50.509798 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ae82ddff-e6c3-4568-9189-12e31ab54a0c req-d76340a9-57c3-4739-ab2e-6eeb849173e1 service nova] Creating event network-vif-deleted:0020b2b9-f4f6-4a11-bb9e-d97035e3f4d9 for instance d9733613-ae5d-4c27-bf69-3958cd6e459c on n-h2-851337-3 Aug 02 06:48:50.512601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-61846cc8-d722-491d-9679-c0ab72bdb18e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:50.515936 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ae82ddff-e6c3-4568-9189-12e31ab54a0c req-d76340a9-57c3-4739-ab2e-6eeb849173e1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048140 Aug 02 06:48:50.517158 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 412/766] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:50.523924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4505337d-481f-4bac-8c71-bbda43d930f3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:50.525020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4505337d-481f-4bac-8c71-bbda43d930f3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:50.529475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-61846cc8-d722-491d-9679-c0ab72bdb18e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:50.531134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-61846cc8-d722-491d-9679-c0ab72bdb18e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:50.532346 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-61846cc8-d722-491d-9679-c0ab72bdb18e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1558 microversion: 2.25 time: 0.630134 Aug 02 06:48:50.533233 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 355/767] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:49 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1558 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:50.535307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4505337d-481f-4bac-8c71-bbda43d930f3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:50.536024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4505337d-481f-4bac-8c71-bbda43d930f3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:50.536909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4505337d-481f-4bac-8c71-bbda43d930f3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:50.537437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4505337d-481f-4bac-8c71-bbda43d930f3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:50.561764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-df158aa9-dfd0-4787-9c0e-766dd256dd9b tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '.version_select at 0x7f927b18edc0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:50.566636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-df158aa9-dfd0-4787-9c0e-766dd256dd9b tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:50.567417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-df158aa9-dfd0-4787-9c0e-766dd256dd9b tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:50.624260 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-df158aa9-dfd0-4787-9c0e-766dd256dd9b tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1108 microversion: 2.25 time: 0.070189 Aug 02 06:48:50.626012 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 356/768] 10.222.0.79 () {60 vars in 1184 bytes} [Tue Aug 2 06:48:50 2022] GET /compute/v2.1/os-migrations => generated 1108 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:50.640335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-09dee746-0112-4af3-be72-09fd4c9e4f94 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:50.640954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-09dee746-0112-4af3-be72-09fd4c9e4f94 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:50.661774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09dee746-0112-4af3-be72-09fd4c9e4f94 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:50.662248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09dee746-0112-4af3-be72-09fd4c9e4f94 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:50.663034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09dee746-0112-4af3-be72-09fd4c9e4f94 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:50.663464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09dee746-0112-4af3-be72-09fd4c9e4f94 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:50.674058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:51.083577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4505337d-481f-4bac-8c71-bbda43d930f3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:51.095069 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4505337d-481f-4bac-8c71-bbda43d930f3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1470 microversion: 2.1 time: 0.576421 Aug 02 06:48:51.095996 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 413/769] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:50 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1470 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:51.102200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-22644371-95d0-4df6-8203-f86043157d83 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:51.103129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-22644371-95d0-4df6-8203-f86043157d83 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:51.110719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22644371-95d0-4df6-8203-f86043157d83 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:51.111533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22644371-95d0-4df6-8203-f86043157d83 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:51.113213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22644371-95d0-4df6-8203-f86043157d83 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:51.113918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22644371-95d0-4df6-8203-f86043157d83 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:51.357782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-09dee746-0112-4af3-be72-09fd4c9e4f94 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 0a3ace8b-df75-4505-b172-20b320c1156b {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:48:51.398575 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-09dee746-0112-4af3-be72-09fd4c9e4f94 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 2050 microversion: 2.25 time: 0.762311 Aug 02 06:48:51.437030 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 357/770] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:50 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 2050 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:51.453953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab471394-9a5a-4986-9de9-43657d776eef tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:51.454607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ab471394-9a5a-4986-9de9-43657d776eef tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] [instance: d9733613-ae5d-4c27-bf69-3958cd6e459c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:51.470578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-22644371-95d0-4df6-8203-f86043157d83 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:51.471724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab471394-9a5a-4986-9de9-43657d776eef tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:51.472160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab471394-9a5a-4986-9de9-43657d776eef tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:51.477540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab471394-9a5a-4986-9de9-43657d776eef tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:51.479255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab471394-9a5a-4986-9de9-43657d776eef tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:51.485543 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-22644371-95d0-4df6-8203-f86043157d83 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1276 microversion: 2.1 time: 0.385841 Aug 02 06:48:51.487008 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 414/771] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:51 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1276 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:51.499061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-57237f19-bcd1-47b2-a17f-a5d3eeabe02c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:51.504923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-57237f19-bcd1-47b2-a17f-a5d3eeabe02c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:51.528636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57237f19-bcd1-47b2-a17f-a5d3eeabe02c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:51.529437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57237f19-bcd1-47b2-a17f-a5d3eeabe02c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:51.535590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57237f19-bcd1-47b2-a17f-a5d3eeabe02c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:51.536440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57237f19-bcd1-47b2-a17f-a5d3eeabe02c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:51.537282 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-ab471394-9a5a-4986-9de9-43657d776eef tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] HTTP exception thrown: Instance d9733613-ae5d-4c27-bf69-3958cd6e459c could not be found. Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab471394-9a5a-4986-9de9-43657d776eef tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Request method failure captured: Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c HTTP/1.1 Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MhRHA_yWJ9UgbCBTKNLaFApegTh-BLmyUy05t4QpN174qgxVFpvd5U8rpzc_h6LcNLNPCnPGPUsuvHjsYZHcZy7XYa9_X96DGtZ-pwfALB4VzelDJz07sx5S7PWRJ3sn2mbFNIweqxRik-RtSvLgIhFATYOouO5G_kcYkZpS0QzRRw Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 3573e2fa6bf04720b7fb8d85b6cc5a54 Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersAdminTestJSON-608281431 Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:48:51.539701 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:48:51.541055 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3573e2fa6bf04720b7fb8d85b6cc5a54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3573e2fa6bf04720b7fb8d85b6cc5a54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3573e2fa6bf04720b7fb8d85b6cc5a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3573e2fa6bf04720b7fb8d85b6cc5a54"}]}] Aug 02 06:48:51.541055 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersAdminTestJSON-608281431 Aug 02 06:48:51.541055 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 3573e2fa6bf04720b7fb8d85b6cc5a54 Aug 02 06:48:51.541055 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersAdminTestJSON-608281431 Aug 02 06:48:51.541055 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersAdminTestJSON-608281431-project Aug 02 06:48:51.541055 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:48:51.541055 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:48:51.541055 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b5122454fd05436fb394a44cef1db729 Aug 02 06:48:51.541055 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersAdminTestJSON-608281431-project Aug 02 06:48:51.541055 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:48:51.541055 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance d9733613-ae5d-4c27-bf69-3958cd6e459c could not be found. Aug 02 06:48:51.541055 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'd9733613-ae5d-4c27-bf69-3958cd6e459c'} Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9733613-ae5d-4c27-bf69-3958cd6e459c could not be found. Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:48:51.541819 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9733613-ae5d-4c27-bf69-3958cd6e459c could not be found. Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9733613-ae5d-4c27-bf69-3958cd6e459c could not be found. Aug 02 06:48:51.542984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:48:51.545924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab471394-9a5a-4986-9de9-43657d776eef tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] Returning 404 to user: Instance d9733613-ae5d-4c27-bf69-3958cd6e459c could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:48:51.545924 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ab471394-9a5a-4986-9de9-43657d776eef tempest-ServersAdminTestJSON-608281431 tempest-ServersAdminTestJSON-608281431-project] 10.222.0.79 "GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c" status: 404 len: 111 microversion: 2.1 time: 0.102475 Aug 02 06:48:51.546262 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 358/772] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:51 2022] GET /compute/v2.1/servers/d9733613-ae5d-4c27-bf69-3958cd6e459c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:48:51.551779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-86da4eed-cfd0-4bdc-b1f9-905a528c0e36 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:51.552391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-86da4eed-cfd0-4bdc-b1f9-905a528c0e36 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:51.559618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86da4eed-cfd0-4bdc-b1f9-905a528c0e36 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:51.560056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86da4eed-cfd0-4bdc-b1f9-905a528c0e36 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:51.561569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86da4eed-cfd0-4bdc-b1f9-905a528c0e36 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:51.562369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86da4eed-cfd0-4bdc-b1f9-905a528c0e36 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:51.593871 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-57237f19-bcd1-47b2-a17f-a5d3eeabe02c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] HTTP exception thrown: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-57237f19-bcd1-47b2-a17f-a5d3eeabe02c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Request method failure captured: Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 HTTP/1.1 Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mics1p1wCl4AqIUegQm3d_pITBwYatFLhRipYelRyLmShzntTbvDif13hJU68Dr75PS5-_PVH2rlUrC3GCvZKy-mXcsTS2uVfBsDy9F9AEKbH8bLuQNqUkYQSS9whNQEqNGjlGMPbf7vASEghxC68ftUIES6H21F7o83_JNpyen0zM Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:48:51.596133 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:48:51.597674 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}] Aug 02 06:48:51.597674 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:51.597674 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:48:51.597674 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:48:51.597674 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:48:51.597674 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:48:51.597674 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:48:51.597674 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b519574e86e841c3a31851e1f4657dd8 Aug 02 06:48:51.597674 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:48:51.597674 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:48:51.597674 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:48:51.597674 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '1cfd7980-48fb-428b-a177-51e0ca0f7593'} Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:48:51.598572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:48:51.599963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:48:51.604202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-57237f19-bcd1-47b2-a17f-a5d3eeabe02c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Returning 404 to user: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:48:51.607792 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-57237f19-bcd1-47b2-a17f-a5d3eeabe02c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 404 len: 111 microversion: 2.1 time: 0.117288 Aug 02 06:48:51.610295 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 415/773] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:51 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:48:51.623388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f43ef4fc-75fb-4064-bcaf-8cbb6ce9e04e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Action: 'create', calling method: .version_select at 0x7f927b251d30>, body: {"keypair": {"name": "tempest-keypair-1271553455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGLt7bRcTEXosQlBiF6rxYnwdXzz77QLWj1CJ1inrEMbDlm4sJrT3XUANSBfwGcZ+8zZPs8o4c3aUZfbwasBnvhLUmGMByS+UxMQuYa3WYwIIN8OmznFIPjxArRZ+vHDw=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:51.648024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-f43ef4fc-75fb-4064-bcaf-8cbb6ce9e04e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Getting quotas for project a972437b40d745b2a16e01593bfaa1e5. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:51.657969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-f43ef4fc-75fb-4064-bcaf-8cbb6ce9e04e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Getting quotas for user b519574e86e841c3a31851e1f4657dd8 and project a972437b40d745b2a16e01593bfaa1e5. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:51.704134 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f43ef4fc-75fb-4064-bcaf-8cbb6ce9e04e tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.086396 Aug 02 06:48:51.705550 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 416/774] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:48:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:48:51.747572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-484572616", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "d2cb6aa5-9974-46cb-9343-692a25f49887"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:51.874929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] validate_networks() for [('d2cb6aa5-9974-46cb-9343-692a25f49887', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:48:52.540920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:52.667149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-86da4eed-cfd0-4bdc-b1f9-905a528c0e36 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:52.687634 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-86da4eed-cfd0-4bdc-b1f9-905a528c0e36 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1367 microversion: 2.1 time: 1.140281 Aug 02 06:48:52.688739 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 359/775] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:51 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1367 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:52.695495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-14d58cd8-b8d5-462b-afb2-0d108cb7eb09 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:52.696623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-14d58cd8-b8d5-462b-afb2-0d108cb7eb09 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:52.711274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14d58cd8-b8d5-462b-afb2-0d108cb7eb09 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:52.711963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14d58cd8-b8d5-462b-afb2-0d108cb7eb09 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:52.713422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14d58cd8-b8d5-462b-afb2-0d108cb7eb09 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:52.714594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14d58cd8-b8d5-462b-afb2-0d108cb7eb09 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:53.418054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:48:53.445809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:48:53.447509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:48:53.450696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:48:53.455382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:48:53.503324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:53.504780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:53.508762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:53.510157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:53.518420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-14d58cd8-b8d5-462b-afb2-0d108cb7eb09 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:53.527005 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-14d58cd8-b8d5-462b-afb2-0d108cb7eb09 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1475 microversion: 2.1 time: 0.836745 Aug 02 06:48:53.534957 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 360/776] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:52 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1475 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:53.548374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1c8b69cf-8e3b-42d5-bc78-224df7516227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:53.554762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1c8b69cf-8e3b-42d5-bc78-224df7516227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:53.565628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c8b69cf-8e3b-42d5-bc78-224df7516227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:53.570545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c8b69cf-8e3b-42d5-bc78-224df7516227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:53.571609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c8b69cf-8e3b-42d5-bc78-224df7516227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:53.572181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c8b69cf-8e3b-42d5-bc78-224df7516227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:53.611382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Getting quotas for project 28c28ea506a34625bf388395b06b67f5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:53.661285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Getting quotas for user a53fed20dabb4e45895da813d4c6538c and project 28c28ea506a34625bf388395b06b67f5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:53.723660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:48:53.731755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:48:53.865299 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-32a7c431-ba54-4d57-bfdd-a453b4795b0b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.127774 Aug 02 06:48:53.866591 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 417/777] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 06:48:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2130 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 06:48:53.871614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-995501cf-cbf1-4559-bbac-3c2586687c7b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:53.873153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-995501cf-cbf1-4559-bbac-3c2586687c7b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:53.899426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-995501cf-cbf1-4559-bbac-3c2586687c7b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:53.900361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-995501cf-cbf1-4559-bbac-3c2586687c7b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:53.902859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-995501cf-cbf1-4559-bbac-3c2586687c7b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:53.904401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-995501cf-cbf1-4559-bbac-3c2586687c7b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:53.949049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:54.713183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1c8b69cf-8e3b-42d5-bc78-224df7516227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:54.727649 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1c8b69cf-8e3b-42d5-bc78-224df7516227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1318 microversion: 2.1 time: 1.189384 Aug 02 06:48:54.744846 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 361/778] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:53 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1318 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:54.755775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ce008bb9-78b1-4a82-a13f-678d6232ed6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:54.756406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ce008bb9-78b1-4a82-a13f-678d6232ed6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:54.773527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-995501cf-cbf1-4559-bbac-3c2586687c7b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:54.784804 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-995501cf-cbf1-4559-bbac-3c2586687c7b tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1367 microversion: 2.1 time: 0.915528 Aug 02 06:48:54.805014 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 418/779] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:53 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1367 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:54.810439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-09a8bcdb-8781-4ef9-a9c8-a3eaf38ec97d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:54.818849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-09a8bcdb-8781-4ef9-a9c8-a3eaf38ec97d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:54.831930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09a8bcdb-8781-4ef9-a9c8-a3eaf38ec97d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:54.832627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09a8bcdb-8781-4ef9-a9c8-a3eaf38ec97d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:54.833593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09a8bcdb-8781-4ef9-a9c8-a3eaf38ec97d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:54.834198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09a8bcdb-8781-4ef9-a9c8-a3eaf38ec97d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:54.931462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ce008bb9-78b1-4a82-a13f-678d6232ed6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:54.941969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ce008bb9-78b1-4a82-a13f-678d6232ed6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:54.952679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ce008bb9-78b1-4a82-a13f-678d6232ed6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:54.953959 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ce008bb9-78b1-4a82-a13f-678d6232ed6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1261 microversion: 2.25 time: 0.207744 Aug 02 06:48:54.954526 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 362/780] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:54 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:54.974480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-9b7b8ffc-ebae-4005-ae25-22d85818fae7 req-ae02ab90-a12e-4998-96d2-12f966787c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5f31c5-23d0-4a18-95a0-6947d96566a5", "tag": "98583515-8e9a-4647-ba0a-76dbcec655ae"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:54.999254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9b7b8ffc-ebae-4005-ae25-22d85818fae7 req-ae02ab90-a12e-4998-96d2-12f966787c38 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:55.000972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9b7b8ffc-ebae-4005-ae25-22d85818fae7 req-ae02ab90-a12e-4998-96d2-12f966787c38 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:55.014836 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-9b7b8ffc-ebae-4005-ae25-22d85818fae7 req-ae02ab90-a12e-4998-96d2-12f966787c38 service nova] Creating event network-changed:98583515-8e9a-4647-ba0a-76dbcec655ae for instance 3d5f31c5-23d0-4a18-95a0-6947d96566a5 on n-h2-851337-3 Aug 02 06:48:55.023269 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-9b7b8ffc-ebae-4005-ae25-22d85818fae7 req-ae02ab90-a12e-4998-96d2-12f966787c38 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052331 Aug 02 06:48:55.027462 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 363/781] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:55.419299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-09a8bcdb-8781-4ef9-a9c8-a3eaf38ec97d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:55.427209 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-09a8bcdb-8781-4ef9-a9c8-a3eaf38ec97d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1475 microversion: 2.1 time: 0.620639 Aug 02 06:48:55.438096 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 419/782] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:54 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1475 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:55.522994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8d93ebc7-8702-4d44-a9e4-f71b7b9a5827 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Action: 'create', calling method: .version_select at 0x7f927b185430>, body: {"keypair": {"name": "tempest-keypair-820102506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB75mhu9FdkOJyBCZfvPOZ8AZ++CUcm0jnYRR/7vz+4XT6lWqmdhypqYAB3rR7EfAUGyWqvQwDbiOazhVCPJ4PgDH87gwYj0LvNd51zzWuwJVT7uFoFK4ZzJY6dQtNy7yA=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:55.549709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-8d93ebc7-8702-4d44-a9e4-f71b7b9a5827 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Getting quotas for project 36057db08ef64298a219d1bf6388e06f. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:55.554993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-8d93ebc7-8702-4d44-a9e4-f71b7b9a5827 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Getting quotas for user af91cd457125470fa8f4fbbd628c5d82 and project 36057db08ef64298a219d1bf6388e06f. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:55.587155 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8d93ebc7-8702-4d44-a9e4-f71b7b9a5827 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.419420 Aug 02 06:48:55.589151 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 364/783] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:48:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:48:55.727100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-d9ceea19-78ee-4e14-a83b-ae083116b2b0 req-f34c281a-b16e-44fe-a03d-e728413c8450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170e8209-d15a-4598-9d57-3c5973fd8733", "tag": "65a2a3cd-0c7c-49a0-a06d-803fedac083b"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:55.737745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d9ceea19-78ee-4e14-a83b-ae083116b2b0 req-f34c281a-b16e-44fe-a03d-e728413c8450 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:55.741219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d9ceea19-78ee-4e14-a83b-ae083116b2b0 req-f34c281a-b16e-44fe-a03d-e728413c8450 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:55.752240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-172e83da-81c8-475e-bf12-c3e59b078487 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:55.752972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-172e83da-81c8-475e-bf12-c3e59b078487 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:55.763012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-172e83da-81c8-475e-bf12-c3e59b078487 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:55.763977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-172e83da-81c8-475e-bf12-c3e59b078487 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:55.765418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-172e83da-81c8-475e-bf12-c3e59b078487 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:55.766444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-172e83da-81c8-475e-bf12-c3e59b078487 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:55.782025 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-d9ceea19-78ee-4e14-a83b-ae083116b2b0 req-f34c281a-b16e-44fe-a03d-e728413c8450 service nova] Creating event network-changed:65a2a3cd-0c7c-49a0-a06d-803fedac083b for instance 170e8209-d15a-4598-9d57-3c5973fd8733 on n-h2-851337-3 Aug 02 06:48:55.795072 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-d9ceea19-78ee-4e14-a83b-ae083116b2b0 req-f34c281a-b16e-44fe-a03d-e728413c8450 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071348 Aug 02 06:48:55.798129 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 420/784] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:55.810266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2186fe65-2eb6-4178-aba5-f550d686884e tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:55.812475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2186fe65-2eb6-4178-aba5-f550d686884e tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:55.824608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2186fe65-2eb6-4178-aba5-f550d686884e tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:55.829098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2186fe65-2eb6-4178-aba5-f550d686884e tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:55.830850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2186fe65-2eb6-4178-aba5-f550d686884e tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:55.833571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2186fe65-2eb6-4178-aba5-f550d686884e tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:56.172376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-172e83da-81c8-475e-bf12-c3e59b078487 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:56.183155 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-172e83da-81c8-475e-bf12-c3e59b078487 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1318 microversion: 2.1 time: 0.434219 Aug 02 06:48:56.184309 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 365/785] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:55 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:56.276601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2186fe65-2eb6-4178-aba5-f550d686884e tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:56.286315 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2186fe65-2eb6-4178-aba5-f550d686884e tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1367 microversion: 2.1 time: 0.484128 Aug 02 06:48:56.289579 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 421/786] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:55 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1367 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:56.300062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4168c669-e70c-4cb8-babd-aa7e06f1bbb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:56.304220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4168c669-e70c-4cb8-babd-aa7e06f1bbb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:56.317301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4168c669-e70c-4cb8-babd-aa7e06f1bbb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:56.318446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4168c669-e70c-4cb8-babd-aa7e06f1bbb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:56.322363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4168c669-e70c-4cb8-babd-aa7e06f1bbb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:56.323081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4168c669-e70c-4cb8-babd-aa7e06f1bbb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:56.345297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-24335f20-eb8a-45a0-b82e-4ea25f8bac28 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:56.348214 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:48:56.348214 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:48:56.352215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24335f20-eb8a-45a0-b82e-4ea25f8bac28 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:56.352896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24335f20-eb8a-45a0-b82e-4ea25f8bac28 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:56.354632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24335f20-eb8a-45a0-b82e-4ea25f8bac28 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:56.355389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24335f20-eb8a-45a0-b82e-4ea25f8bac28 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:56.390674 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-24335f20-eb8a-45a0-b82e-4ea25f8bac28 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.204504 Aug 02 06:48:56.391456 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 366/787] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:48:56 2022] GET /compute/v2.1/os-services => generated 944 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:56.404115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6fea0f06-6dbc-41ac-84fe-dcce9d590d34 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:56.406697 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:48:56.406697 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:48:56.407972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6fea0f06-6dbc-41ac-84fe-dcce9d590d34 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:56.408417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6fea0f06-6dbc-41ac-84fe-dcce9d590d34 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:56.409205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6fea0f06-6dbc-41ac-84fe-dcce9d590d34 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:56.409639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6fea0f06-6dbc-41ac-84fe-dcce9d590d34 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:56.435734 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6fea0f06-6dbc-41ac-84fe-dcce9d590d34 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=n-d-851337-3" status: 200 len: 578 microversion: 2.1 time: 0.035668 Aug 02 06:48:56.436392 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 367/788] 10.222.0.79 () {58 vars in 1172 bytes} [Tue Aug 2 06:48:56 2022] GET /compute/v2.1/os-services?host=n-d-851337-3 => generated 578 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:48:56.450555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e654dbfd-cd50-4460-9ce0-89d46bbe6759 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:56.451440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e654dbfd-cd50-4460-9ce0-89d46bbe6759 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:56.458364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e654dbfd-cd50-4460-9ce0-89d46bbe6759 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:56.459091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e654dbfd-cd50-4460-9ce0-89d46bbe6759 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:56.460078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e654dbfd-cd50-4460-9ce0-89d46bbe6759 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:56.460661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e654dbfd-cd50-4460-9ce0-89d46bbe6759 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:56.506388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4168c669-e70c-4cb8-babd-aa7e06f1bbb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:56.527671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4168c669-e70c-4cb8-babd-aa7e06f1bbb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:56.531147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4168c669-e70c-4cb8-babd-aa7e06f1bbb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:56.533239 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4168c669-e70c-4cb8-babd-aa7e06f1bbb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1319 microversion: 2.25 time: 0.241237 Aug 02 06:48:56.534163 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 422/789] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:56 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:56.558621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43967ab5-b932-4a89-b370-34fc623a3749 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:56.562693 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:48:56.562693 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:48:56.564208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43967ab5-b932-4a89-b370-34fc623a3749 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:56.564767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43967ab5-b932-4a89-b370-34fc623a3749 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:56.565680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43967ab5-b932-4a89-b370-34fc623a3749 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:56.566250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43967ab5-b932-4a89-b370-34fc623a3749 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:56.602130 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43967ab5-b932-4a89-b370-34fc623a3749 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.051682 Aug 02 06:48:56.603238 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 423/790] 10.222.0.79 () {58 vars in 1176 bytes} [Tue Aug 2 06:48:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:56.618355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ca7100db-78d1-43ba-850a-a168b2c66b22 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:56.622208 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:48:56.622208 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:48:56.625085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca7100db-78d1-43ba-850a-a168b2c66b22 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:56.625682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca7100db-78d1-43ba-850a-a168b2c66b22 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:56.626879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca7100db-78d1-43ba-850a-a168b2c66b22 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:56.627417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca7100db-78d1-43ba-850a-a168b2c66b22 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:56.657005 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ca7100db-78d1-43ba-850a-a168b2c66b22 tempest-ServicesAdminTestJSON-1666416319 tempest-ServicesAdminTestJSON-1666416319-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.044927 Aug 02 06:48:56.658565 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 424/791] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:48:56 2022] GET /compute/v2.1/os-services => generated 944 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:56.916359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e654dbfd-cd50-4460-9ce0-89d46bbe6759 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:56.930203 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e654dbfd-cd50-4460-9ce0-89d46bbe6759 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1475 microversion: 2.1 time: 0.483057 Aug 02 06:48:56.931656 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 368/792] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:56 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1475 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:57.208281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-def5d8df-b619-4d3b-9621-d8839af13a81 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:57.209632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-def5d8df-b619-4d3b-9621-d8839af13a81 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:57.218785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-def5d8df-b619-4d3b-9621-d8839af13a81 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:57.219348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-def5d8df-b619-4d3b-9621-d8839af13a81 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:57.220416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-def5d8df-b619-4d3b-9621-d8839af13a81 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:57.220954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-def5d8df-b619-4d3b-9621-d8839af13a81 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:57.323402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79f4ebd1-1aa3-46c5-b1e2-b2baaa16579f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:57.324242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79f4ebd1-1aa3-46c5-b1e2-b2baaa16579f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:57.343753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79f4ebd1-1aa3-46c5-b1e2-b2baaa16579f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:57.344404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79f4ebd1-1aa3-46c5-b1e2-b2baaa16579f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:57.345261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79f4ebd1-1aa3-46c5-b1e2-b2baaa16579f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:57.346370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79f4ebd1-1aa3-46c5-b1e2-b2baaa16579f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:58.249397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-def5d8df-b619-4d3b-9621-d8839af13a81 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:58.258602 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-def5d8df-b619-4d3b-9621-d8839af13a81 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1318 microversion: 2.1 time: 1.054709 Aug 02 06:48:58.265324 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 425/793] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:57 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1318 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:48:58.277017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79f4ebd1-1aa3-46c5-b1e2-b2baaa16579f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:58.283326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-db3d2f61-7794-428b-b60b-7202158c684f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:58.284113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-db3d2f61-7794-428b-b60b-7202158c684f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:58.290361 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79f4ebd1-1aa3-46c5-b1e2-b2baaa16579f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1367 microversion: 2.1 time: 0.979433 Aug 02 06:48:58.292036 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 369/794] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:57 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1367 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:58.293217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db3d2f61-7794-428b-b60b-7202158c684f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:58.293946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db3d2f61-7794-428b-b60b-7202158c684f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:58.294801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db3d2f61-7794-428b-b60b-7202158c684f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:58.296023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db3d2f61-7794-428b-b60b-7202158c684f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:58.313026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1315958703", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:58.378953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] validate_networks() for [('c92a3ed1-d696-472e-a733-75a14b7c8a60', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:48:58.931054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-db3d2f61-7794-428b-b60b-7202158c684f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:58.953713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-db3d2f61-7794-428b-b60b-7202158c684f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:58.964513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-db3d2f61-7794-428b-b60b-7202158c684f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:58.967935 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-db3d2f61-7794-428b-b60b-7202158c684f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1361 microversion: 2.25 time: 0.700023 Aug 02 06:48:58.969791 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 426/795] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:58 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1361 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:48:58.979759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-5d2ca518-566a-444a-89d4-893e8090fc15 req-9818d6ab-beaf-4e87-ac39-855e67720d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb8bd9f-6e06-4f62-8b64-af297e6157da", "tag": "2c205ec2-e3c8-4f45-8657-90c30a174006"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:59.006874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-5d2ca518-566a-444a-89d4-893e8090fc15 req-9818d6ab-beaf-4e87-ac39-855e67720d7b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:59.008936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-5d2ca518-566a-444a-89d4-893e8090fc15 req-9818d6ab-beaf-4e87-ac39-855e67720d7b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:59.039844 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-5d2ca518-566a-444a-89d4-893e8090fc15 req-9818d6ab-beaf-4e87-ac39-855e67720d7b service nova] Creating event network-changed:2c205ec2-e3c8-4f45-8657-90c30a174006 for instance 9fb8bd9f-6e06-4f62-8b64-af297e6157da on n-h1-851337-3 Aug 02 06:48:59.057862 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-5d2ca518-566a-444a-89d4-893e8090fc15 req-9818d6ab-beaf-4e87-ac39-855e67720d7b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077720 Aug 02 06:48:59.061400 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 427/796] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:59.079306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3a784b9e-def8-4604-a9c6-451ead70a65a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:59.086701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3a784b9e-def8-4604-a9c6-451ead70a65a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:59.103571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a784b9e-def8-4604-a9c6-451ead70a65a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:59.106116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a784b9e-def8-4604-a9c6-451ead70a65a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:59.108121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a784b9e-def8-4604-a9c6-451ead70a65a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:59.109421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a784b9e-def8-4604-a9c6-451ead70a65a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:59.540445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3a784b9e-def8-4604-a9c6-451ead70a65a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:59.554246 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3a784b9e-def8-4604-a9c6-451ead70a65a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1475 microversion: 2.1 time: 0.490885 Aug 02 06:48:59.568430 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 428/797] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:59 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1475 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:59.568430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-9744234a-ce86-4a25-b582-d5a98ffa39dc req-77933ca4-846b-4a9e-84a5-71be60d2e26e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c9613bb-0914-4f6f-b55c-8c3d990cc2e4", "tag": "3156e550-5a09-4594-b16e-ac202d43d82a"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:48:59.571756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:48:59.576532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9744234a-ce86-4a25-b582-d5a98ffa39dc req-77933ca4-846b-4a9e-84a5-71be60d2e26e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:59.576968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9744234a-ce86-4a25-b582-d5a98ffa39dc req-77933ca4-846b-4a9e-84a5-71be60d2e26e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:59.593536 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-9744234a-ce86-4a25-b582-d5a98ffa39dc req-77933ca4-846b-4a9e-84a5-71be60d2e26e service nova] Creating event network-changed:3156e550-5a09-4594-b16e-ac202d43d82a for instance 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 on n-h1-851337-3 Aug 02 06:48:59.598733 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-9744234a-ce86-4a25-b582-d5a98ffa39dc req-77933ca4-846b-4a9e-84a5-71be60d2e26e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042775 Aug 02 06:48:59.599445 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 429/798] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:48:59.604534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a55815f3-c761-498b-b549-d332ec11f2c7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:59.605669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a55815f3-c761-498b-b549-d332ec11f2c7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:59.612362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a55815f3-c761-498b-b549-d332ec11f2c7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:59.613107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a55815f3-c761-498b-b549-d332ec11f2c7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:59.613993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a55815f3-c761-498b-b549-d332ec11f2c7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:59.614656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a55815f3-c761-498b-b549-d332ec11f2c7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:59.687939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:48:59.688381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:48:59.688826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:48:59.689231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:48:59.689641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:48:59.703913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:59.704680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:59.705914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:59.706576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:59.733618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Getting quotas for project a972437b40d745b2a16e01593bfaa1e5. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:48:59.740567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Getting quotas for user b519574e86e841c3a31851e1f4657dd8 and project a972437b40d745b2a16e01593bfaa1e5. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:48:59.754718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:48:59.757219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:48:59.807595 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4e927d2e-f82a-4bed-8d4a-728fc631c84a tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.512933 Aug 02 06:48:59.808741 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 370/799] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:48:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:48:59.813471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-18064768-d80b-498a-baaf-8ebaac11b430 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:59.814161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-18064768-d80b-498a-baaf-8ebaac11b430 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:59.821141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18064768-d80b-498a-baaf-8ebaac11b430 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:59.821839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18064768-d80b-498a-baaf-8ebaac11b430 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:59.822892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18064768-d80b-498a-baaf-8ebaac11b430 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:48:59.823481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18064768-d80b-498a-baaf-8ebaac11b430 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:48:59.851141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a55815f3-c761-498b-b549-d332ec11f2c7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:59.865525 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a55815f3-c761-498b-b549-d332ec11f2c7 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1318 microversion: 2.1 time: 0.264795 Aug 02 06:48:59.867888 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 430/800] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:59 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:59.879765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-230fd86d-dc39-4569-852f-7a302d061129 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:59.881064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-230fd86d-dc39-4569-852f-7a302d061129 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:48:59.963648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-230fd86d-dc39-4569-852f-7a302d061129 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:48:59.971040 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-230fd86d-dc39-4569-852f-7a302d061129 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1225 microversion: 2.1 time: 0.097263 Aug 02 06:48:59.971791 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 431/801] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:59 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:48:59.993477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-78037b34-cf8e-49e0-9f7e-0d1a830fb486 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:48:59.994205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-78037b34-cf8e-49e0-9f7e-0d1a830fb486 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:00.001081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78037b34-cf8e-49e0-9f7e-0d1a830fb486 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:00.001747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78037b34-cf8e-49e0-9f7e-0d1a830fb486 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:00.003000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78037b34-cf8e-49e0-9f7e-0d1a830fb486 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:00.003655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78037b34-cf8e-49e0-9f7e-0d1a830fb486 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:00.111201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-18064768-d80b-498a-baaf-8ebaac11b430 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:00.119101 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-18064768-d80b-498a-baaf-8ebaac11b430 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1367 microversion: 2.1 time: 0.309190 Aug 02 06:49:00.119911 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 371/802] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:48:59 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:00.259732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-78037b34-cf8e-49e0-9f7e-0d1a830fb486 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:00.268791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-78037b34-cf8e-49e0-9f7e-0d1a830fb486 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:00.270900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-78037b34-cf8e-49e0-9f7e-0d1a830fb486 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:00.272267 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-78037b34-cf8e-49e0-9f7e-0d1a830fb486 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1361 microversion: 2.25 time: 0.282857 Aug 02 06:49:00.273056 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 432/803] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:48:59 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1361 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:49:00.576195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d901e3f1-e82b-4548-b738-a7dd3b72fd7b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:00.576805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d901e3f1-e82b-4548-b738-a7dd3b72fd7b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:00.583815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d901e3f1-e82b-4548-b738-a7dd3b72fd7b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:00.584258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d901e3f1-e82b-4548-b738-a7dd3b72fd7b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:00.585020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d901e3f1-e82b-4548-b738-a7dd3b72fd7b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:00.585644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d901e3f1-e82b-4548-b738-a7dd3b72fd7b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:00.810073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d901e3f1-e82b-4548-b738-a7dd3b72fd7b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:00.820892 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d901e3f1-e82b-4548-b738-a7dd3b72fd7b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1475 microversion: 2.1 time: 0.248673 Aug 02 06:49:00.821910 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 372/804] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:00 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1475 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:00.887777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ea671e25-f393-4a01-9731-780286bdd961 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:00.888397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ea671e25-f393-4a01-9731-780286bdd961 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:00.895555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea671e25-f393-4a01-9731-780286bdd961 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:00.896007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea671e25-f393-4a01-9731-780286bdd961 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:00.897019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea671e25-f393-4a01-9731-780286bdd961 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:00.897163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-75502159", "imageRef": "6f3f4435-159e-4f49-a01d-0316af76ccc4", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1c1e1c95-febb-4735-9ecd-11a1a4cb4663"}], "security_groups": [{"name": "tempest-securitygroup--191811005"}], "key_name": "tempest-keypair-820102506", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:00.897839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea671e25-f393-4a01-9731-780286bdd961 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:01.083978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] validate_networks() for [('1c1e1c95-febb-4735-9ecd-11a1a4cb4663', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:49:01.145258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ea671e25-f393-4a01-9731-780286bdd961 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:01.154529 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ea671e25-f393-4a01-9731-780286bdd961 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1318 microversion: 2.1 time: 0.270764 Aug 02 06:49:01.167776 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 433/805] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:00 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:01.167776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4a5b680f-9e07-4e45-9632-9a60c4661dd9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:01.167776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4a5b680f-9e07-4e45-9632-9a60c4661dd9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:01.167776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a5b680f-9e07-4e45-9632-9a60c4661dd9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:01.168420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a5b680f-9e07-4e45-9632-9a60c4661dd9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:01.168420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a5b680f-9e07-4e45-9632-9a60c4661dd9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:01.168420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a5b680f-9e07-4e45-9632-9a60c4661dd9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:01.273000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4a5b680f-9e07-4e45-9632-9a60c4661dd9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:01.288904 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4a5b680f-9e07-4e45-9632-9a60c4661dd9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1285 microversion: 2.1 time: 0.132426 Aug 02 06:49:01.291852 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 434/806] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:01 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:01.299985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-24591cda-53f8-4701-bdd2-4735ab8ad578 req-78f56934-5db2-4601-9542-5134416ce6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5f31c5-23d0-4a18-95a0-6947d96566a5", "name": "network-vif-plugged", "status": "completed", "tag": "98583515-8e9a-4647-ba0a-76dbcec655ae"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:01.311243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-24591cda-53f8-4701-bdd2-4735ab8ad578 req-78f56934-5db2-4601-9542-5134416ce6cf service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:01.312049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-24591cda-53f8-4701-bdd2-4735ab8ad578 req-78f56934-5db2-4601-9542-5134416ce6cf service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:01.324068 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-24591cda-53f8-4701-bdd2-4735ab8ad578 req-78f56934-5db2-4601-9542-5134416ce6cf service nova] Creating event network-vif-plugged:98583515-8e9a-4647-ba0a-76dbcec655ae for instance 3d5f31c5-23d0-4a18-95a0-6947d96566a5 on n-h2-851337-3 Aug 02 06:49:01.329077 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-24591cda-53f8-4701-bdd2-4735ab8ad578 req-78f56934-5db2-4601-9542-5134416ce6cf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035876 Aug 02 06:49:01.329685 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 435/807] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:01.334860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3821223b-bc9b-4efe-b84d-ab287f429417 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:01.335571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3821223b-bc9b-4efe-b84d-ab287f429417 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:01.342039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3821223b-bc9b-4efe-b84d-ab287f429417 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:01.342697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3821223b-bc9b-4efe-b84d-ab287f429417 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:01.343641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3821223b-bc9b-4efe-b84d-ab287f429417 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:01.344085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3821223b-bc9b-4efe-b84d-ab287f429417 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:01.693631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3821223b-bc9b-4efe-b84d-ab287f429417 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:01.703785 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3821223b-bc9b-4efe-b84d-ab287f429417 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1367 microversion: 2.1 time: 0.372348 Aug 02 06:49:01.704557 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 436/808] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:01 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:01.737199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a1b0b54a-f7d2-4fe5-8967-bc6577a727f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:01.740519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a1b0b54a-f7d2-4fe5-8967-bc6577a727f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:01.747388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1b0b54a-f7d2-4fe5-8967-bc6577a727f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:01.747848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1b0b54a-f7d2-4fe5-8967-bc6577a727f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:01.748727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1b0b54a-f7d2-4fe5-8967-bc6577a727f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:01.749155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1b0b54a-f7d2-4fe5-8967-bc6577a727f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:02.209803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:49:02.210349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:49:02.210768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:49:02.211209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:49:02.211615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:49:02.214615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a1b0b54a-f7d2-4fe5-8967-bc6577a727f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:02.221795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:02.222269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:02.223298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:02.223452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a1b0b54a-f7d2-4fe5-8967-bc6577a727f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:02.223725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:02.224920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a1b0b54a-f7d2-4fe5-8967-bc6577a727f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:02.226259 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a1b0b54a-f7d2-4fe5-8967-bc6577a727f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1361 microversion: 2.25 time: 0.510628 Aug 02 06:49:02.227015 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 437/809] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:01 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1361 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:02.242013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Getting quotas for project 36057db08ef64298a219d1bf6388e06f. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:49:02.247505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Getting quotas for user af91cd457125470fa8f4fbbd628c5d82 and project 36057db08ef64298a219d1bf6388e06f. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:49:02.256997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:02.263794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:49:02.266430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6f3f4435-159e-4f49-a01d-0316af76ccc4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:49:02.320542 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fa6107f6-c992-4af1-8e47-18f2d71ce14b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.428413 Aug 02 06:49:02.321544 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 373/810] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:49:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:49:02.326297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e8c985ed-2605-463f-9568-cd272f7ff01b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:02.327423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e8c985ed-2605-463f-9568-cd272f7ff01b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:02.335113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8c985ed-2605-463f-9568-cd272f7ff01b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:02.335785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8c985ed-2605-463f-9568-cd272f7ff01b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:02.336748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8c985ed-2605-463f-9568-cd272f7ff01b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:02.337470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8c985ed-2605-463f-9568-cd272f7ff01b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:02.387774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-221fbe49-344c-461b-a4b2-11db4dc7cae0 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:02.390984 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:02.390984 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:02.392257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-221fbe49-344c-461b-a4b2-11db4dc7cae0 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:02.392706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-221fbe49-344c-461b-a4b2-11db4dc7cae0 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:02.393523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-221fbe49-344c-461b-a4b2-11db4dc7cae0 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:02.394992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-221fbe49-344c-461b-a4b2-11db4dc7cae0 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:02.421215 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-221fbe49-344c-461b-a4b2-11db4dc7cae0 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.192721 Aug 02 06:49:02.422386 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 438/811] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:49:02 2022] GET /compute/v2.1/os-services => generated 944 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:02.427368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c5da6014-b225-4480-9a54-7a1e581a5643 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:02.427984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c5da6014-b225-4480-9a54-7a1e581a5643 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:02.434747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5da6014-b225-4480-9a54-7a1e581a5643 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:02.435193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5da6014-b225-4480-9a54-7a1e581a5643 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:02.435966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5da6014-b225-4480-9a54-7a1e581a5643 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:02.436402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5da6014-b225-4480-9a54-7a1e581a5643 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:02.766700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e8c985ed-2605-463f-9568-cd272f7ff01b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:02.775215 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e8c985ed-2605-463f-9568-cd272f7ff01b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1475 microversion: 2.1 time: 0.452545 Aug 02 06:49:02.775801 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 374/812] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:02 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1475 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:02.784601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c5da6014-b225-4480-9a54-7a1e581a5643 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:02.786586 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9875c5e9-c2bc-4840-8967-051c0fe8dfd5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:02.787683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9875c5e9-c2bc-4840-8967-051c0fe8dfd5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:02.794802 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c5da6014-b225-4480-9a54-7a1e581a5643 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1318 microversion: 2.1 time: 0.371222 Aug 02 06:49:02.795930 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 439/813] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:02 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:02.801060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-160a778a-dc89-4c58-bd53-e7ffeb032704 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:02.801738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-160a778a-dc89-4c58-bd53-e7ffeb032704 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:02.808873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9875c5e9-c2bc-4840-8967-051c0fe8dfd5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:02.808873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9875c5e9-c2bc-4840-8967-051c0fe8dfd5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:02.811626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9875c5e9-c2bc-4840-8967-051c0fe8dfd5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:02.812252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9875c5e9-c2bc-4840-8967-051c0fe8dfd5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:02.968205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-160a778a-dc89-4c58-bd53-e7ffeb032704 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:02.970593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=25 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:02.986087 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-160a778a-dc89-4c58-bd53-e7ffeb032704 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1243 microversion: 2.1 time: 0.188814 Aug 02 06:49:02.986690 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 440/814] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:02 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1243 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:02.997780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b7a159de-876a-4043-af09-e472ace3cfdd tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:03.000507 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:03.000507 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:03.001788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7a159de-876a-4043-af09-e472ace3cfdd tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:03.002449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7a159de-876a-4043-af09-e472ace3cfdd tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:03.003412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7a159de-876a-4043-af09-e472ace3cfdd tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:03.004214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7a159de-876a-4043-af09-e472ace3cfdd tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:03.042366 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b7a159de-876a-4043-af09-e472ace3cfdd tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.054553 Aug 02 06:49:03.043655 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 441/815] 10.222.0.79 () {58 vars in 1170 bytes} [Tue Aug 2 06:49:02 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:03.057485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b209146d-bb66-4115-a909-6b664bd3be71 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:03.058590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b209146d-bb66-4115-a909-6b664bd3be71 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:03.069834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b209146d-bb66-4115-a909-6b664bd3be71 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:03.070397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b209146d-bb66-4115-a909-6b664bd3be71 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:03.071769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b209146d-bb66-4115-a909-6b664bd3be71 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:03.072299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b209146d-bb66-4115-a909-6b664bd3be71 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:03.102839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:03.581111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9875c5e9-c2bc-4840-8967-051c0fe8dfd5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:03.598498 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9875c5e9-c2bc-4840-8967-051c0fe8dfd5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1325 microversion: 2.1 time: 0.820948 Aug 02 06:49:03.599387 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 375/816] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:02 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1325 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:03.604033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e335df9e-34db-4233-ae80-17a7fe7041b1 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:03.606888 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:03.606888 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:49:03.613015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e335df9e-34db-4233-ae80-17a7fe7041b1 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:03.613694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e335df9e-34db-4233-ae80-17a7fe7041b1 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:03.614725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e335df9e-34db-4233-ae80-17a7fe7041b1 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:03.615395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e335df9e-34db-4233-ae80-17a7fe7041b1 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:03.681999 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e335df9e-34db-4233-ae80-17a7fe7041b1 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.081276 Aug 02 06:49:03.683510 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 376/817] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:49:03 2022] GET /compute/v2.1/os-services => generated 944 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:03.701971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dbb95ffa-ad37-42e2-a2f0-44ea3c294086 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:03.702897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dbb95ffa-ad37-42e2-a2f0-44ea3c294086 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:03.717616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbb95ffa-ad37-42e2-a2f0-44ea3c294086 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:03.718091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbb95ffa-ad37-42e2-a2f0-44ea3c294086 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:03.718866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbb95ffa-ad37-42e2-a2f0-44ea3c294086 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:03.719299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbb95ffa-ad37-42e2-a2f0-44ea3c294086 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:03.828063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b209146d-bb66-4115-a909-6b664bd3be71 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:03.836178 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b209146d-bb66-4115-a909-6b664bd3be71 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1367 microversion: 2.1 time: 0.791246 Aug 02 06:49:03.837450 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 442/818] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:03 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1367 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:03.843495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0970f883-9a53-4094-8396-c50a420e997e tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:03.848040 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:03.848040 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:03.849317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0970f883-9a53-4094-8396-c50a420e997e tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:03.849934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0970f883-9a53-4094-8396-c50a420e997e tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:03.851177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0970f883-9a53-4094-8396-c50a420e997e tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:03.851177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0970f883-9a53-4094-8396-c50a420e997e tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:03.876761 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0970f883-9a53-4094-8396-c50a420e997e tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=n-d-851337-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.037512 Aug 02 06:49:03.877734 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 443/819] 10.222.0.79 () {58 vars in 1194 bytes} [Tue Aug 2 06:49:03 2022] GET /compute/v2.1/os-services?host=n-d-851337-3&binary=xxx => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:49:03.882942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f0a65d9-aeab-4de4-8494-495251f68e08 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:03.883534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5f0a65d9-aeab-4de4-8494-495251f68e08 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:03.904607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0a65d9-aeab-4de4-8494-495251f68e08 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:03.905056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0a65d9-aeab-4de4-8494-495251f68e08 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:03.905837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0a65d9-aeab-4de4-8494-495251f68e08 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:03.906300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0a65d9-aeab-4de4-8494-495251f68e08 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:04.111462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dbb95ffa-ad37-42e2-a2f0-44ea3c294086 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:04.122069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dbb95ffa-ad37-42e2-a2f0-44ea3c294086 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:04.125426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dbb95ffa-ad37-42e2-a2f0-44ea3c294086 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:04.127697 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dbb95ffa-ad37-42e2-a2f0-44ea3c294086 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1361 microversion: 2.25 time: 0.439476 Aug 02 06:49:04.129142 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 377/820] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:03 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1361 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:04.134858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f775d608-5756-4605-90f1-c482d53b6e31 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:04.135743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f775d608-5756-4605-90f1-c482d53b6e31 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:04.142492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f775d608-5756-4605-90f1-c482d53b6e31 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:04.143176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f775d608-5756-4605-90f1-c482d53b6e31 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:04.144441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f775d608-5756-4605-90f1-c482d53b6e31 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:04.145082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f775d608-5756-4605-90f1-c482d53b6e31 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:04.188381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5f0a65d9-aeab-4de4-8494-495251f68e08 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:04.196828 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5f0a65d9-aeab-4de4-8494-495251f68e08 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1475 microversion: 2.1 time: 0.317961 Aug 02 06:49:04.207421 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 444/821] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:03 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1475 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:04.225833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1fa68d33-5384-45d8-a05f-4a606e6b493e tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:04.228820 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:04.228820 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:04.235810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fa68d33-5384-45d8-a05f-4a606e6b493e tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:04.236628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fa68d33-5384-45d8-a05f-4a606e6b493e tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:04.241556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fa68d33-5384-45d8-a05f-4a606e6b493e tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:04.242646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fa68d33-5384-45d8-a05f-4a606e6b493e tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:04.295605 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1fa68d33-5384-45d8-a05f-4a606e6b493e tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.091884 Aug 02 06:49:04.296555 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 445/822] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:49:04 2022] GET /compute/v2.1/os-services => generated 944 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:04.307093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c4e62d01-ab36-48e1-bc32-b1318644f2e4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:04.308265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c4e62d01-ab36-48e1-bc32-b1318644f2e4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:04.326341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4e62d01-ab36-48e1-bc32-b1318644f2e4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:04.327412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4e62d01-ab36-48e1-bc32-b1318644f2e4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:04.329147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4e62d01-ab36-48e1-bc32-b1318644f2e4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:04.330106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4e62d01-ab36-48e1-bc32-b1318644f2e4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:04.360700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f775d608-5756-4605-90f1-c482d53b6e31 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:04.373142 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f775d608-5756-4605-90f1-c482d53b6e31 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1318 microversion: 2.1 time: 0.242322 Aug 02 06:49:04.390462 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 378/823] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:04 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:04.399884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a1fda903-8f45-4c0f-be08-22bc707e2f17 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:04.403307 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:04.403307 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:49:04.404850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1fda903-8f45-4c0f-be08-22bc707e2f17 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:04.405512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1fda903-8f45-4c0f-be08-22bc707e2f17 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:04.406622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1fda903-8f45-4c0f-be08-22bc707e2f17 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:04.407250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1fda903-8f45-4c0f-be08-22bc707e2f17 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:04.468816 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a1fda903-8f45-4c0f-be08-22bc707e2f17 tempest-ServicesAdminNegativeTestJSON-174776901 tempest-ServicesAdminNegativeTestJSON-174776901-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.076677 Aug 02 06:49:04.470441 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 379/824] 10.222.0.79 () {58 vars in 1198 bytes} [Tue Aug 2 06:49:04 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:49:04.799612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3eabacbc-82a1-4f84-9cc4-ef690c96ba9d tempest-ServicesAdminNegativeTestJSON-848652592 tempest-ServicesAdminNegativeTestJSON-848652592-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:04.803594 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:04.803594 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:49:04.807678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3eabacbc-82a1-4f84-9cc4-ef690c96ba9d tempest-ServicesAdminNegativeTestJSON-848652592 tempest-ServicesAdminNegativeTestJSON-848652592-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1ee741181b5d4402a017a60b843caf39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93642acf339040709337924ffb7968dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3eabacbc-82a1-4f84-9cc4-ef690c96ba9d tempest-ServicesAdminNegativeTestJSON-848652592 tempest-ServicesAdminNegativeTestJSON-848652592-project] Request method failure captured: Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MjcornKoPi71uOVJIWCPZ8keHNBhSoF_SSana8YJPhTBixygAmidD1-FlLO8_GszIZTrZPJqIQsbp6GcBKmy7vrwGGtZVFOeblulosDGBbI-MjTi3-fCA4NrF4EC2jtDfqCLUeCh4Q2VJ8P2vqoPFEFt1r8IgRgZEcRZo0Y65jE3ZQ Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 93642acf339040709337924ffb7968dd Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-848652592 Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:49:04.812930 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:49:04.814729 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/93642acf339040709337924ffb7968dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93642acf339040709337924ffb7968dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_93642acf339040709337924ffb7968dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/93642acf339040709337924ffb7968dd"}]}] Aug 02 06:49:04.814729 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-848652592 Aug 02 06:49:04.814729 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 93642acf339040709337924ffb7968dd Aug 02 06:49:04.814729 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-848652592 Aug 02 06:49:04.814729 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServicesAdminNegativeTestJSON-848652592-project Aug 02 06:49:04.814729 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:49:04.814729 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:49:04.814729 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 1ee741181b5d4402a017a60b843caf39 Aug 02 06:49:04.814729 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-848652592-project Aug 02 06:49:04.814729 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:49:04.814729 n-d-851337-3 devstack@n-api.service[126119]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 02 06:49:04.814729 n-d-851337-3 devstack@n-api.service[126119]: action_args: {} Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:49:04.815777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 02 06:49:04.817334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:04.822259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3eabacbc-82a1-4f84-9cc4-ef690c96ba9d tempest-ServicesAdminNegativeTestJSON-848652592 tempest-ServicesAdminNegativeTestJSON-848652592-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:04.825477 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3eabacbc-82a1-4f84-9cc4-ef690c96ba9d tempest-ServicesAdminNegativeTestJSON-848652592 tempest-ServicesAdminNegativeTestJSON-848652592-project] 10.222.0.79 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.344589 Aug 02 06:49:04.828697 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 380/825] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:49:04 2022] GET /compute/v2.1/os-services => generated 112 bytes in 349 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:49:04.842379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-09445986-d5e6-41da-92d9-8036de105cd4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:04.845275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-09445986-d5e6-41da-92d9-8036de105cd4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:04.866687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09445986-d5e6-41da-92d9-8036de105cd4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:04.867544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09445986-d5e6-41da-92d9-8036de105cd4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:04.870382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09445986-d5e6-41da-92d9-8036de105cd4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:04.871654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09445986-d5e6-41da-92d9-8036de105cd4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:04.982798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c4e62d01-ab36-48e1-bc32-b1318644f2e4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:04.996175 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c4e62d01-ab36-48e1-bc32-b1318644f2e4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1368 microversion: 2.1 time: 0.696448 Aug 02 06:49:05.002238 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 446/826] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:04 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1368 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:05.010571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0f88ad8a-9229-42bc-b089-0ee814d19239 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:05.011208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0f88ad8a-9229-42bc-b089-0ee814d19239 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:05.029029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f88ad8a-9229-42bc-b089-0ee814d19239 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:05.029570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f88ad8a-9229-42bc-b089-0ee814d19239 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:05.030409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f88ad8a-9229-42bc-b089-0ee814d19239 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:05.030847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f88ad8a-9229-42bc-b089-0ee814d19239 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:05.348625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0f88ad8a-9229-42bc-b089-0ee814d19239 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:05.357596 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0f88ad8a-9229-42bc-b089-0ee814d19239 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1367 microversion: 2.1 time: 0.353851 Aug 02 06:49:05.367209 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 447/827] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:05 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:05.370966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-09445986-d5e6-41da-92d9-8036de105cd4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:05.384875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b1039575-f040-4985-a1eb-99bdc91c3bd9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:05.385926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b1039575-f040-4985-a1eb-99bdc91c3bd9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:05.391613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:05.400711 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-09445986-d5e6-41da-92d9-8036de105cd4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1325 microversion: 2.1 time: 0.569750 Aug 02 06:49:05.401389 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 381/828] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:04 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1325 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:05.406495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1039575-f040-4985-a1eb-99bdc91c3bd9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:05.406988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1039575-f040-4985-a1eb-99bdc91c3bd9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:05.407625 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-68f167a6-c034-454c-a9eb-efe2b52c4b6e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:05.408475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-68f167a6-c034-454c-a9eb-efe2b52c4b6e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:05.411220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1039575-f040-4985-a1eb-99bdc91c3bd9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:05.413935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1039575-f040-4985-a1eb-99bdc91c3bd9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:05.416140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68f167a6-c034-454c-a9eb-efe2b52c4b6e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:05.416920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68f167a6-c034-454c-a9eb-efe2b52c4b6e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:05.439080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68f167a6-c034-454c-a9eb-efe2b52c4b6e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:05.444353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68f167a6-c034-454c-a9eb-efe2b52c4b6e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:06.315152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-68f167a6-c034-454c-a9eb-efe2b52c4b6e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:06.319224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b1039575-f040-4985-a1eb-99bdc91c3bd9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:06.329469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b1039575-f040-4985-a1eb-99bdc91c3bd9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:06.332617 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-68f167a6-c034-454c-a9eb-efe2b52c4b6e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1475 microversion: 2.1 time: 0.926852 Aug 02 06:49:06.348540 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 382/829] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:05 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1475 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:06.348540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-51cd3044-5dc7-49b6-89fb-8fdb6beb4706 req-d4391322-7683-426b-a53b-a7d33a0a9f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170e8209-d15a-4598-9d57-3c5973fd8733", "name": "network-vif-plugged", "status": "completed", "tag": "65a2a3cd-0c7c-49a0-a06d-803fedac083b"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:06.351586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b1039575-f040-4985-a1eb-99bdc91c3bd9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:06.354770 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b1039575-f040-4985-a1eb-99bdc91c3bd9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1361 microversion: 2.25 time: 0.984650 Aug 02 06:49:06.356146 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 448/830] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:05 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1361 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:06.366904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-962e58af-9b00-4a90-a858-963c3a32bdde tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:06.367797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-962e58af-9b00-4a90-a858-963c3a32bdde tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:06.381597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-51cd3044-5dc7-49b6-89fb-8fdb6beb4706 req-d4391322-7683-426b-a53b-a7d33a0a9f15 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:06.382078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-51cd3044-5dc7-49b6-89fb-8fdb6beb4706 req-d4391322-7683-426b-a53b-a7d33a0a9f15 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:06.385853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-962e58af-9b00-4a90-a858-963c3a32bdde tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:06.386357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-962e58af-9b00-4a90-a858-963c3a32bdde tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:06.396934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-962e58af-9b00-4a90-a858-963c3a32bdde tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:06.397389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-962e58af-9b00-4a90-a858-963c3a32bdde tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:06.426934 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-51cd3044-5dc7-49b6-89fb-8fdb6beb4706 req-d4391322-7683-426b-a53b-a7d33a0a9f15 service nova] Creating event network-vif-plugged:65a2a3cd-0c7c-49a0-a06d-803fedac083b for instance 170e8209-d15a-4598-9d57-3c5973fd8733 on n-h2-851337-3 Aug 02 06:49:06.439829 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-51cd3044-5dc7-49b6-89fb-8fdb6beb4706 req-d4391322-7683-426b-a53b-a7d33a0a9f15 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099244 Aug 02 06:49:06.441078 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 383/831] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:06.453151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-d2267dd5-65f4-4ef2-a498-1c0b4804c5dd req-4b8cad25-05a1-4ce4-bae5-a9068e9673f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52787eee-3cd0-49f7-a881-16d055348a8c", "tag": "823028dd-19e9-472a-a5b5-80182eab9a74"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:06.464738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d2267dd5-65f4-4ef2-a498-1c0b4804c5dd req-4b8cad25-05a1-4ce4-bae5-a9068e9673f9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:06.465179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d2267dd5-65f4-4ef2-a498-1c0b4804c5dd req-4b8cad25-05a1-4ce4-bae5-a9068e9673f9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:06.497687 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-d2267dd5-65f4-4ef2-a498-1c0b4804c5dd req-4b8cad25-05a1-4ce4-bae5-a9068e9673f9 service nova] Creating event network-changed:823028dd-19e9-472a-a5b5-80182eab9a74 for instance 52787eee-3cd0-49f7-a881-16d055348a8c on n-h2-851337-3 Aug 02 06:49:06.504039 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-d2267dd5-65f4-4ef2-a498-1c0b4804c5dd req-4b8cad25-05a1-4ce4-bae5-a9068e9673f9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054760 Aug 02 06:49:06.510434 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 384/832] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:06.510434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8ad8fa18-6a49-4c5c-842b-fd2395b8511b req-57ec9117-c79e-4475-b76f-5c67283d0f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69991b6b-468d-45c0-b658-297b210ae988", "tag": "b5f97f41-8484-419a-ac2c-d049deaf4ea4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:06.524386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8ad8fa18-6a49-4c5c-842b-fd2395b8511b req-57ec9117-c79e-4475-b76f-5c67283d0f66 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:06.524821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8ad8fa18-6a49-4c5c-842b-fd2395b8511b req-57ec9117-c79e-4475-b76f-5c67283d0f66 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:06.539433 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8ad8fa18-6a49-4c5c-842b-fd2395b8511b req-57ec9117-c79e-4475-b76f-5c67283d0f66 service nova] Creating event network-changed:b5f97f41-8484-419a-ac2c-d049deaf4ea4 for instance 69991b6b-468d-45c0-b658-297b210ae988 on n-h2-851337-3 Aug 02 06:49:06.545499 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8ad8fa18-6a49-4c5c-842b-fd2395b8511b req-57ec9117-c79e-4475-b76f-5c67283d0f66 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039421 Aug 02 06:49:06.558079 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 385/833] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:06.572358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e93fb0c9-2839-42f5-9b12-a81bb63387a8 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:06.573225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e93fb0c9-2839-42f5-9b12-a81bb63387a8 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:06.589015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e93fb0c9-2839-42f5-9b12-a81bb63387a8 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:06.589448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e93fb0c9-2839-42f5-9b12-a81bb63387a8 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:06.594293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-962e58af-9b00-4a90-a858-963c3a32bdde tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:06.595661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e93fb0c9-2839-42f5-9b12-a81bb63387a8 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:06.596194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e93fb0c9-2839-42f5-9b12-a81bb63387a8 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:06.602674 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-962e58af-9b00-4a90-a858-963c3a32bdde tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1318 microversion: 2.1 time: 0.243913 Aug 02 06:49:06.604582 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 449/834] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:06 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:06.610021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-07270155-78ad-4cb4-a8b4-be1e62ee8676 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:06.610627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-07270155-78ad-4cb4-a8b4-be1e62ee8676 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:06.617617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07270155-78ad-4cb4-a8b4-be1e62ee8676 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:06.618936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07270155-78ad-4cb4-a8b4-be1e62ee8676 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:06.619981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07270155-78ad-4cb4-a8b4-be1e62ee8676 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:06.620557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07270155-78ad-4cb4-a8b4-be1e62ee8676 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:07.047496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e93fb0c9-2839-42f5-9b12-a81bb63387a8 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:07.052545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-07270155-78ad-4cb4-a8b4-be1e62ee8676 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:07.059007 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e93fb0c9-2839-42f5-9b12-a81bb63387a8 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1368 microversion: 2.1 time: 0.499663 Aug 02 06:49:07.062549 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 386/835] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:06 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1368 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:07.064624 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-07270155-78ad-4cb4-a8b4-be1e62ee8676 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1367 microversion: 2.1 time: 0.458390 Aug 02 06:49:07.074452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-be0e0f24-6bc0-4eb3-98d5-8a8c72597f82 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:07.075452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-be0e0f24-6bc0-4eb3-98d5-8a8c72597f82 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:07.078385 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 450/836] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:06 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1367 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:07.083651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1746f341-648c-451b-b246-2f39d6ff202f tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:07.084395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1746f341-648c-451b-b246-2f39d6ff202f tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:07.090942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be0e0f24-6bc0-4eb3-98d5-8a8c72597f82 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:07.091668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1746f341-648c-451b-b246-2f39d6ff202f tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:07.092042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be0e0f24-6bc0-4eb3-98d5-8a8c72597f82 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:07.092492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1746f341-648c-451b-b246-2f39d6ff202f tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:07.093266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1746f341-648c-451b-b246-2f39d6ff202f tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:07.093927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1746f341-648c-451b-b246-2f39d6ff202f tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:07.094050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be0e0f24-6bc0-4eb3-98d5-8a8c72597f82 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:07.096259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be0e0f24-6bc0-4eb3-98d5-8a8c72597f82 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:07.146048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1746f341-648c-451b-b246-2f39d6ff202f tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:49:07.329721 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1746f341-648c-451b-b246-2f39d6ff202f tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "DELETE /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 204 len: 0 microversion: 2.1 time: 0.249802 Aug 02 06:49:07.330467 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 451/837] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:49:07 2022] DELETE /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:49:07.344482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-24a3690e-e535-43d2-adc2-915e849e492e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:07.345233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-24a3690e-e535-43d2-adc2-915e849e492e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:07.361958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24a3690e-e535-43d2-adc2-915e849e492e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:07.362450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24a3690e-e535-43d2-adc2-915e849e492e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:07.363348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24a3690e-e535-43d2-adc2-915e849e492e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:07.363782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24a3690e-e535-43d2-adc2-915e849e492e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:07.545240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-be0e0f24-6bc0-4eb3-98d5-8a8c72597f82 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:07.569731 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-be0e0f24-6bc0-4eb3-98d5-8a8c72597f82 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1325 microversion: 2.1 time: 0.504680 Aug 02 06:49:07.573337 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 387/838] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:07 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1325 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:07.614609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1f9bf8b8-9677-4ec3-9401-54eba321d1ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:07.615343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1f9bf8b8-9677-4ec3-9401-54eba321d1ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:07.635283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f9bf8b8-9677-4ec3-9401-54eba321d1ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:07.636303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f9bf8b8-9677-4ec3-9401-54eba321d1ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:07.637546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f9bf8b8-9677-4ec3-9401-54eba321d1ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:07.638588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f9bf8b8-9677-4ec3-9401-54eba321d1ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:07.829137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-24a3690e-e535-43d2-adc2-915e849e492e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:07.854752 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-24a3690e-e535-43d2-adc2-915e849e492e tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1713 microversion: 2.1 time: 0.517174 Aug 02 06:49:07.859951 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 452/839] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:07 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1713 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:07.870902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9dee01a8-ff4e-42b3-912e-5286917fd04e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:07.871796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9dee01a8-ff4e-42b3-912e-5286917fd04e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:07.887662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9dee01a8-ff4e-42b3-912e-5286917fd04e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:07.888467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9dee01a8-ff4e-42b3-912e-5286917fd04e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:07.889507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9dee01a8-ff4e-42b3-912e-5286917fd04e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:07.893142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9dee01a8-ff4e-42b3-912e-5286917fd04e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:08.190481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1f9bf8b8-9677-4ec3-9401-54eba321d1ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:08.200197 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1f9bf8b8-9677-4ec3-9401-54eba321d1ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1475 microversion: 2.1 time: 0.623127 Aug 02 06:49:08.221690 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 388/840] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:07 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1475 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:08.227357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e8956301-2e3e-4b07-b1b9-d2e8dcb5a309 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:08.236810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e8956301-2e3e-4b07-b1b9-d2e8dcb5a309 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:08.251129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8956301-2e3e-4b07-b1b9-d2e8dcb5a309 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:08.252876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8956301-2e3e-4b07-b1b9-d2e8dcb5a309 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:08.254362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8956301-2e3e-4b07-b1b9-d2e8dcb5a309 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:08.255824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8956301-2e3e-4b07-b1b9-d2e8dcb5a309 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:08.357011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9dee01a8-ff4e-42b3-912e-5286917fd04e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:08.372038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9dee01a8-ff4e-42b3-912e-5286917fd04e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:08.377732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9dee01a8-ff4e-42b3-912e-5286917fd04e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:08.380935 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9dee01a8-ff4e-42b3-912e-5286917fd04e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1361 microversion: 2.25 time: 0.519457 Aug 02 06:49:08.384809 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 453/841] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:07 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1361 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:08.402121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-864ffde3-dfc0-49b3-937e-08376c53c361 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:08.404618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-864ffde3-dfc0-49b3-937e-08376c53c361 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:08.423592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-864ffde3-dfc0-49b3-937e-08376c53c361 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:08.431182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-864ffde3-dfc0-49b3-937e-08376c53c361 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:08.434972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-864ffde3-dfc0-49b3-937e-08376c53c361 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:08.435737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-864ffde3-dfc0-49b3-937e-08376c53c361 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:08.567267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e8956301-2e3e-4b07-b1b9-d2e8dcb5a309 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:08.583449 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e8956301-2e3e-4b07-b1b9-d2e8dcb5a309 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1318 microversion: 2.1 time: 0.360241 Aug 02 06:49:08.584047 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 389/842] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:08 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:08.596419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fa531bab-e421-4f28-8d79-44d7be9a3a99 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:08.597043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fa531bab-e421-4f28-8d79-44d7be9a3a99 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:08.612849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa531bab-e421-4f28-8d79-44d7be9a3a99 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:08.613365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa531bab-e421-4f28-8d79-44d7be9a3a99 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:08.614197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa531bab-e421-4f28-8d79-44d7be9a3a99 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:08.614536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa531bab-e421-4f28-8d79-44d7be9a3a99 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:08.916026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-864ffde3-dfc0-49b3-937e-08376c53c361 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:08.930619 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-864ffde3-dfc0-49b3-937e-08376c53c361 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1368 microversion: 2.1 time: 0.543511 Aug 02 06:49:08.941992 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 454/843] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:08 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1368 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:08.948043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-819160e7-5674-44e1-8527-3823bb078c2a req-d4082743-8c27-43e7-b4cd-dd71e72caca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb8bd9f-6e06-4f62-8b64-af297e6157da", "name": "network-vif-plugged", "status": "completed", "tag": "2c205ec2-e3c8-4f45-8657-90c30a174006"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:08.963074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-819160e7-5674-44e1-8527-3823bb078c2a req-d4082743-8c27-43e7-b4cd-dd71e72caca0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:08.967719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-819160e7-5674-44e1-8527-3823bb078c2a req-d4082743-8c27-43e7-b4cd-dd71e72caca0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:08.992976 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-819160e7-5674-44e1-8527-3823bb078c2a req-d4082743-8c27-43e7-b4cd-dd71e72caca0 service nova] Creating event network-vif-plugged:2c205ec2-e3c8-4f45-8657-90c30a174006 for instance 9fb8bd9f-6e06-4f62-8b64-af297e6157da on n-h1-851337-3 Aug 02 06:49:09.015100 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-819160e7-5674-44e1-8527-3823bb078c2a req-d4082743-8c27-43e7-b4cd-dd71e72caca0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082116 Aug 02 06:49:09.016294 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 455/844] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:09.022613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-61dcd598-3d80-4e59-8940-7e63529e2ba8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:09.023905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-61dcd598-3d80-4e59-8940-7e63529e2ba8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:09.043583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61dcd598-3d80-4e59-8940-7e63529e2ba8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:09.044366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61dcd598-3d80-4e59-8940-7e63529e2ba8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:09.045300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61dcd598-3d80-4e59-8940-7e63529e2ba8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:09.045884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61dcd598-3d80-4e59-8940-7e63529e2ba8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:09.072200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fa531bab-e421-4f28-8d79-44d7be9a3a99 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:09.084710 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fa531bab-e421-4f28-8d79-44d7be9a3a99 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1367 microversion: 2.1 time: 0.499522 Aug 02 06:49:09.088732 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 390/845] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:08 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:09.100245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e5a9878b-157e-4ac3-a6d6-d4b6fe253fe7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:09.103608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e5a9878b-157e-4ac3-a6d6-d4b6fe253fe7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:09.119233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5a9878b-157e-4ac3-a6d6-d4b6fe253fe7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:09.127182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5a9878b-157e-4ac3-a6d6-d4b6fe253fe7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:09.136448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5a9878b-157e-4ac3-a6d6-d4b6fe253fe7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:09.137421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5a9878b-157e-4ac3-a6d6-d4b6fe253fe7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:09.561774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e5a9878b-157e-4ac3-a6d6-d4b6fe253fe7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:09.567141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-61dcd598-3d80-4e59-8940-7e63529e2ba8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:09.585165 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-61dcd598-3d80-4e59-8940-7e63529e2ba8 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1325 microversion: 2.1 time: 0.564195 Aug 02 06:49:09.586797 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e5a9878b-157e-4ac3-a6d6-d4b6fe253fe7 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1713 microversion: 2.1 time: 0.494469 Aug 02 06:49:09.587421 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 391/846] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:09 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1713 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:09.599271 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 456/847] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:09 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1325 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:09.615523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c1d5e524-1a7f-415d-9e77-0b82601c3f66 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:09.616474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c1d5e524-1a7f-415d-9e77-0b82601c3f66 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:09.627681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1d5e524-1a7f-415d-9e77-0b82601c3f66 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:09.628353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1d5e524-1a7f-415d-9e77-0b82601c3f66 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:09.629598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1d5e524-1a7f-415d-9e77-0b82601c3f66 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:09.630140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1d5e524-1a7f-415d-9e77-0b82601c3f66 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:09.636440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6d5901be-666e-4858-84a7-6d56c4de2d85 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:09.637220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6d5901be-666e-4858-84a7-6d56c4de2d85 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:09.652707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d5901be-666e-4858-84a7-6d56c4de2d85 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:09.653379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d5901be-666e-4858-84a7-6d56c4de2d85 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:09.656039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d5901be-666e-4858-84a7-6d56c4de2d85 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:09.657879 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d5901be-666e-4858-84a7-6d56c4de2d85 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:09.917260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6d5901be-666e-4858-84a7-6d56c4de2d85 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:09.929743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c1d5e524-1a7f-415d-9e77-0b82601c3f66 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:09.948175 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6d5901be-666e-4858-84a7-6d56c4de2d85 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1475 microversion: 2.1 time: 0.343176 Aug 02 06:49:09.949168 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 392/848] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:09 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1475 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:09.950349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c1d5e524-1a7f-415d-9e77-0b82601c3f66 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:09.956049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c1d5e524-1a7f-415d-9e77-0b82601c3f66 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:09.960302 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c1d5e524-1a7f-415d-9e77-0b82601c3f66 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1361 microversion: 2.25 time: 0.359674 Aug 02 06:49:09.964687 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 457/849] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:09 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1361 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:09.972914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-756dbe2b-b8d4-45df-a44d-148e35d0ad18 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:09.973748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-756dbe2b-b8d4-45df-a44d-148e35d0ad18 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:09.986991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-756dbe2b-b8d4-45df-a44d-148e35d0ad18 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:09.989703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-756dbe2b-b8d4-45df-a44d-148e35d0ad18 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:09.990777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-756dbe2b-b8d4-45df-a44d-148e35d0ad18 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:09.993938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-756dbe2b-b8d4-45df-a44d-148e35d0ad18 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:10.217232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c30915b9-bf3d-4855-b3e3-d76afab58731 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:10.246383 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c30915b9-bf3d-4855-b3e3-d76afab58731 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.293623 Aug 02 06:49:10.247402 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 393/850] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:49:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:10.252613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-144f6ad6-170b-4b78-881f-5fcf27189a33 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:10.253184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-144f6ad6-170b-4b78-881f-5fcf27189a33 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:10.274612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-144f6ad6-170b-4b78-881f-5fcf27189a33 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:10.276322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-144f6ad6-170b-4b78-881f-5fcf27189a33 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:10.279981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-144f6ad6-170b-4b78-881f-5fcf27189a33 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:10.280633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-144f6ad6-170b-4b78-881f-5fcf27189a33 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:10.863905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-756dbe2b-b8d4-45df-a44d-148e35d0ad18 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:10.872256 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-756dbe2b-b8d4-45df-a44d-148e35d0ad18 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1318 microversion: 2.1 time: 0.906217 Aug 02 06:49:10.872857 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 458/851] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:09 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1318 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:10.892193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-168123e0-f08e-4cd2-8861-1da93b555741 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:10.899599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-168123e0-f08e-4cd2-8861-1da93b555741 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:10.911742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-168123e0-f08e-4cd2-8861-1da93b555741 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:10.912566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-168123e0-f08e-4cd2-8861-1da93b555741 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:10.913707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-168123e0-f08e-4cd2-8861-1da93b555741 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:10.914379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-168123e0-f08e-4cd2-8861-1da93b555741 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:10.949181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:11.011467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-144f6ad6-170b-4b78-881f-5fcf27189a33 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:11.032587 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-144f6ad6-170b-4b78-881f-5fcf27189a33 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1368 microversion: 2.1 time: 0.783738 Aug 02 06:49:11.033129 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 394/852] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:10 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1368 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:11.037669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7b36141d-af97-433f-aeac-16c81b434fa6 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:11.127406 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7b36141d-af97-433f-aeac-16c81b434fa6 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors" status: 200 len: 3081 microversion: 2.1 time: 0.093132 Aug 02 06:49:11.128012 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 395/853] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Aug 2 06:49:11 2022] GET /compute/v2.1/flavors => generated 3081 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:11.153228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5fbe8a8b-9e49-44ff-b93f-db3a5e5fb4bd tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:11.157399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5fbe8a8b-9e49-44ff-b93f-db3a5e5fb4bd tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:11.170882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5fbe8a8b-9e49-44ff-b93f-db3a5e5fb4bd tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:11.174470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5fbe8a8b-9e49-44ff-b93f-db3a5e5fb4bd tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:11.175499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5fbe8a8b-9e49-44ff-b93f-db3a5e5fb4bd tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:11.177836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5fbe8a8b-9e49-44ff-b93f-db3a5e5fb4bd tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:11.398621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-168123e0-f08e-4cd2-8861-1da93b555741 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:11.414222 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-168123e0-f08e-4cd2-8861-1da93b555741 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1367 microversion: 2.1 time: 0.525173 Aug 02 06:49:11.416795 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 459/854] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:10 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1367 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:11.422892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-82582ab1-13b3-43ca-8684-280d96a0d051 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:11.425153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-82582ab1-13b3-43ca-8684-280d96a0d051 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:11.441349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82582ab1-13b3-43ca-8684-280d96a0d051 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:11.442464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82582ab1-13b3-43ca-8684-280d96a0d051 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:11.443483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82582ab1-13b3-43ca-8684-280d96a0d051 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:11.444120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82582ab1-13b3-43ca-8684-280d96a0d051 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:11.581427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-82582ab1-13b3-43ca-8684-280d96a0d051 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:11.600074 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-82582ab1-13b3-43ca-8684-280d96a0d051 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1646 microversion: 2.1 time: 0.181534 Aug 02 06:49:11.601693 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 460/855] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:11 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1646 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:11.608752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ffab84f-9b52-4c60-b795-d339799f89d9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:11.612355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9ffab84f-9b52-4c60-b795-d339799f89d9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:11.628138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ffab84f-9b52-4c60-b795-d339799f89d9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:11.630237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ffab84f-9b52-4c60-b795-d339799f89d9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:11.634089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5fbe8a8b-9e49-44ff-b93f-db3a5e5fb4bd tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:11.634277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ffab84f-9b52-4c60-b795-d339799f89d9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:11.635027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ffab84f-9b52-4c60-b795-d339799f89d9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:11.643340 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5fbe8a8b-9e49-44ff-b93f-db3a5e5fb4bd tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1325 microversion: 2.1 time: 0.500465 Aug 02 06:49:11.647735 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 396/856] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:11 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1325 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:11.654000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b47864ff-c770-4761-9e57-9fd58f2320ed tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:11.655363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b47864ff-c770-4761-9e57-9fd58f2320ed tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:11.670193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b47864ff-c770-4761-9e57-9fd58f2320ed tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:11.670930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b47864ff-c770-4761-9e57-9fd58f2320ed tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:11.671877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b47864ff-c770-4761-9e57-9fd58f2320ed tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:11.672460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b47864ff-c770-4761-9e57-9fd58f2320ed tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:11.970597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b47864ff-c770-4761-9e57-9fd58f2320ed tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:11.999202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b47864ff-c770-4761-9e57-9fd58f2320ed tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:12.003755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b47864ff-c770-4761-9e57-9fd58f2320ed tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:12.008518 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b47864ff-c770-4761-9e57-9fd58f2320ed tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1361 microversion: 2.25 time: 0.359485 Aug 02 06:49:12.012676 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 397/857] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:11 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1361 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:12.038528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-acc4fbaa-3a46-4ed0-b377-c651e2d6f6cc req-087bd680-3cf4-40c7-9a90-d9ebf97baa35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9613bb-0914-4f6f-b55c-8c3d990cc2e4", "name": "network-vif-plugged", "status": "completed", "tag": "3156e550-5a09-4594-b16e-ac202d43d82a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:12.058447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-acc4fbaa-3a46-4ed0-b377-c651e2d6f6cc req-087bd680-3cf4-40c7-9a90-d9ebf97baa35 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:12.059194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-acc4fbaa-3a46-4ed0-b377-c651e2d6f6cc req-087bd680-3cf4-40c7-9a90-d9ebf97baa35 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:12.085353 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-acc4fbaa-3a46-4ed0-b377-c651e2d6f6cc req-087bd680-3cf4-40c7-9a90-d9ebf97baa35 service nova] Creating event network-vif-plugged:3156e550-5a09-4594-b16e-ac202d43d82a for instance 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 on n-h1-851337-3 Aug 02 06:49:12.099728 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-acc4fbaa-3a46-4ed0-b377-c651e2d6f6cc req-087bd680-3cf4-40c7-9a90-d9ebf97baa35 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084766 Aug 02 06:49:12.115389 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 398/858] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:12.130563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-833c3a55-1eb7-43d0-a2d0-725b34fbd2e1 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:12.155612 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-833c3a55-1eb7-43d0-a2d0-725b34fbd2e1 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037377 Aug 02 06:49:12.156208 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 399/859] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:49:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:12.168682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9ffab84f-9b52-4c60-b795-d339799f89d9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:12.181317 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9ffab84f-9b52-4c60-b795-d339799f89d9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1475 microversion: 2.1 time: 0.578138 Aug 02 06:49:12.182342 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 461/860] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:11 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1475 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:12.189556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-a12ec7b6-5cbd-4bb4-8646-a402423e3c56 req-9bc4cfe5-d3f0-4817-8212-23003e75a31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428968c0-25cc-47b2-bfa1-6147889fdcdf", "name": "network-vif-deleted", "tag": "4565e0ac-4aff-4f72-a7b3-08e4dfc5a210"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:12.201470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-38da623e-a9d0-4dad-bff9-58d3f15dad9b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:12.214596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-38da623e-a9d0-4dad-bff9-58d3f15dad9b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:12.220624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a12ec7b6-5cbd-4bb4-8646-a402423e3c56 req-9bc4cfe5-d3f0-4817-8212-23003e75a31a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:12.223634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a12ec7b6-5cbd-4bb4-8646-a402423e3c56 req-9bc4cfe5-d3f0-4817-8212-23003e75a31a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:12.226323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38da623e-a9d0-4dad-bff9-58d3f15dad9b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:12.227374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38da623e-a9d0-4dad-bff9-58d3f15dad9b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:12.228207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38da623e-a9d0-4dad-bff9-58d3f15dad9b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:12.230473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38da623e-a9d0-4dad-bff9-58d3f15dad9b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:12.245290 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-a12ec7b6-5cbd-4bb4-8646-a402423e3c56 req-9bc4cfe5-d3f0-4817-8212-23003e75a31a service nova] Creating event network-vif-deleted:4565e0ac-4aff-4f72-a7b3-08e4dfc5a210 for instance 428968c0-25cc-47b2-bfa1-6147889fdcdf on n-h1-851337-3 Aug 02 06:49:12.251364 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-a12ec7b6-5cbd-4bb4-8646-a402423e3c56 req-9bc4cfe5-d3f0-4817-8212-23003e75a31a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067265 Aug 02 06:49:12.252589 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 462/861] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:12.259022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a4d0ec0c-2a16-41de-a14b-fad02fa88e4d tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:12.260018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a4d0ec0c-2a16-41de-a14b-fad02fa88e4d tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:12.268207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=52 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:12.269573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4d0ec0c-2a16-41de-a14b-fad02fa88e4d tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:12.270523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4d0ec0c-2a16-41de-a14b-fad02fa88e4d tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:12.271855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4d0ec0c-2a16-41de-a14b-fad02fa88e4d tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:12.272556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4d0ec0c-2a16-41de-a14b-fad02fa88e4d tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:12.574837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-38da623e-a9d0-4dad-bff9-58d3f15dad9b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:12.585188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a4d0ec0c-2a16-41de-a14b-fad02fa88e4d tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:12.602249 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-38da623e-a9d0-4dad-bff9-58d3f15dad9b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1468 microversion: 2.1 time: 0.430497 Aug 02 06:49:12.622265 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a4d0ec0c-2a16-41de-a14b-fad02fa88e4d tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1368 microversion: 2.1 time: 0.368123 Aug 02 06:49:12.631455 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 400/862] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:12 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1468 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:12.631668 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 463/863] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:12 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1368 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:12.631668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-29c49758-4b53-4252-beea-2dad618a1649 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:12.631668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-29c49758-4b53-4252-beea-2dad618a1649 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:12.638246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-23455e2e-bfce-4a12-a00d-65854c1b309b tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:12.647281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29c49758-4b53-4252-beea-2dad618a1649 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:12.647735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29c49758-4b53-4252-beea-2dad618a1649 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:12.650671 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-23455e2e-bfce-4a12-a00d-65854c1b309b tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026473 Aug 02 06:49:12.651733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29c49758-4b53-4252-beea-2dad618a1649 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:12.652236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29c49758-4b53-4252-beea-2dad618a1649 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:12.654626 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 401/864] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:49:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:12.667135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-59878f7d-df29-438c-a14a-9868a0648193 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:12.667830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-59878f7d-df29-438c-a14a-9868a0648193 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 3d5f31c5-23d0-4a18-95a0-6947d96566a5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:12.691665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59878f7d-df29-438c-a14a-9868a0648193 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:12.692009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59878f7d-df29-438c-a14a-9868a0648193 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:12.692782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59878f7d-df29-438c-a14a-9868a0648193 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:12.693784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59878f7d-df29-438c-a14a-9868a0648193 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:12.905609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-29c49758-4b53-4252-beea-2dad618a1649 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:12.916258 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-29c49758-4b53-4252-beea-2dad618a1649 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1556 microversion: 2.1 time: 0.290457 Aug 02 06:49:12.929919 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 464/865] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:12 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1556 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:12.929919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-55b91df9-271f-4a45-a3da-ca9f2234aadf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:12.929919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-55b91df9-271f-4a45-a3da-ca9f2234aadf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:12.936641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55b91df9-271f-4a45-a3da-ca9f2234aadf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:12.936860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55b91df9-271f-4a45-a3da-ca9f2234aadf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:12.937823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55b91df9-271f-4a45-a3da-ca9f2234aadf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:12.938363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55b91df9-271f-4a45-a3da-ca9f2234aadf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:12.997344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:13.008892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-59878f7d-df29-438c-a14a-9868a0648193 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:13.020596 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-59878f7d-df29-438c-a14a-9868a0648193 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5" status: 200 len: 1467 microversion: 2.1 time: 0.357930 Aug 02 06:49:13.023750 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 402/866] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:12 2022] GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5 => generated 1467 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:13.036867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-55b91df9-271f-4a45-a3da-ca9f2234aadf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:13.042154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-43232f79-1e79-4c18-bffa-e7df7b1e6538 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:13.048575 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-55b91df9-271f-4a45-a3da-ca9f2234aadf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1350 microversion: 2.1 time: 0.127706 Aug 02 06:49:13.049539 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 465/867] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:12 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:13.054659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0825ac93-add9-49a1-8055-152545dadb26 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:13.055275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0825ac93-add9-49a1-8055-152545dadb26 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:13.064308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0825ac93-add9-49a1-8055-152545dadb26 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:13.064820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0825ac93-add9-49a1-8055-152545dadb26 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:13.065669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0825ac93-add9-49a1-8055-152545dadb26 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:13.066234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0825ac93-add9-49a1-8055-152545dadb26 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:13.102150 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-43232f79-1e79-4c18-bffa-e7df7b1e6538 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.066851 Aug 02 06:49:13.110120 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 403/868] 10.222.0.79 () {58 vars in 1165 bytes} [Tue Aug 2 06:49:13 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:13.121608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3e478b1a-60ce-4977-ac80-463c2cbb42a1 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:13.121716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3e478b1a-60ce-4977-ac80-463c2cbb42a1 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:13.130884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e478b1a-60ce-4977-ac80-463c2cbb42a1 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:13.131344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e478b1a-60ce-4977-ac80-463c2cbb42a1 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:13.132219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e478b1a-60ce-4977-ac80-463c2cbb42a1 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:13.133124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e478b1a-60ce-4977-ac80-463c2cbb42a1 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:13.241985 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3e478b1a-60ce-4977-ac80-463c2cbb42a1 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130470 Aug 02 06:49:13.242846 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 404/869] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 06:49:13 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:13.253669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-680a399a-2e56-4f22-86f2-cc48fb3e06c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:13.254380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-680a399a-2e56-4f22-86f2-cc48fb3e06c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:13.261676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-680a399a-2e56-4f22-86f2-cc48fb3e06c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:13.262267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-680a399a-2e56-4f22-86f2-cc48fb3e06c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:13.263115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-680a399a-2e56-4f22-86f2-cc48fb3e06c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:13.263736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-680a399a-2e56-4f22-86f2-cc48fb3e06c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:13.305449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0825ac93-add9-49a1-8055-152545dadb26 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:13.314390 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0825ac93-add9-49a1-8055-152545dadb26 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1325 microversion: 2.1 time: 0.263648 Aug 02 06:49:13.315659 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 466/870] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:13 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1325 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:13.320730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a41d6060-3a89-4427-9389-23e48c6af57b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:13.326427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a41d6060-3a89-4427-9389-23e48c6af57b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:13.327673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a41d6060-3a89-4427-9389-23e48c6af57b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Searching by: {'reservation_id': 'r-4o2wgz7z', 'deleted': False, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:49:13.336639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a41d6060-3a89-4427-9389-23e48c6af57b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:13.337439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a41d6060-3a89-4427-9389-23e48c6af57b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:13.338375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a41d6060-3a89-4427-9389-23e48c6af57b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:13.341839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a41d6060-3a89-4427-9389-23e48c6af57b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:13.515655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-a41d6060-3a89-4427-9389-23e48c6af57b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:49:13.586094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a41d6060-3a89-4427-9389-23e48c6af57b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:13.593862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a41d6060-3a89-4427-9389-23e48c6af57b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:13.594341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a41d6060-3a89-4427-9389-23e48c6af57b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:13.594831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-680a399a-2e56-4f22-86f2-cc48fb3e06c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:13.607188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-680a399a-2e56-4f22-86f2-cc48fb3e06c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:13.608707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-680a399a-2e56-4f22-86f2-cc48fb3e06c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:13.609862 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-680a399a-2e56-4f22-86f2-cc48fb3e06c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1361 microversion: 2.25 time: 0.365861 Aug 02 06:49:13.610464 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 405/871] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:13 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1361 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:13.626039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4832c24d-9d89-477c-9ee3-eda9ca25cf39 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:13.647810 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4832c24d-9d89-477c-9ee3-eda9ca25cf39 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036257 Aug 02 06:49:13.648408 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 406/872] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:49:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:13.654782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-39380285-7508-4a78-a14e-0e6a2a186141 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:13.656681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-39380285-7508-4a78-a14e-0e6a2a186141 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:13.663371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39380285-7508-4a78-a14e-0e6a2a186141 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:13.663910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39380285-7508-4a78-a14e-0e6a2a186141 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:13.664764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39380285-7508-4a78-a14e-0e6a2a186141 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:13.665279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39380285-7508-4a78-a14e-0e6a2a186141 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:13.686096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:13.977724 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a41d6060-3a89-4427-9389-23e48c6af57b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?reservation_id=r-4o2wgz7z" status: 200 len: 2928 microversion: 2.1 time: 0.660715 Aug 02 06:49:13.978447 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 467/873] 10.222.0.79 () {58 vars in 1197 bytes} [Tue Aug 2 06:49:13 2022] GET /compute/v2.1/servers/detail?reservation_id=r-4o2wgz7z => generated 2928 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:13.994108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-181729f8-59f8-44c5-abd2-fc997c993692 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:13.994108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-181729f8-59f8-44c5-abd2-fc997c993692 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:13.994108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-181729f8-59f8-44c5-abd2-fc997c993692 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:13.994108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-181729f8-59f8-44c5-abd2-fc997c993692 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:13.994501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-181729f8-59f8-44c5-abd2-fc997c993692 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:13.994501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-181729f8-59f8-44c5-abd2-fc997c993692 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:14.101986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-39380285-7508-4a78-a14e-0e6a2a186141 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:14.110638 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-39380285-7508-4a78-a14e-0e6a2a186141 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1475 microversion: 2.1 time: 0.460936 Aug 02 06:49:14.111218 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 407/874] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:13 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1475 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:14.115690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9136c2ee-6737-4cfa-95c5-3244867b7b27 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:14.140934 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9136c2ee-6737-4cfa-95c5-3244867b7b27 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.028633 Aug 02 06:49:14.141680 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 408/875] 10.222.0.79 () {58 vars in 1169 bytes} [Tue Aug 2 06:49:14 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:14.146187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b5976a30-4933-4688-b22b-16bc7baca31f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:14.162659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.compute.server_groups [None req-b5976a30-4933-4688-b22b-16bc7baca31f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Querying cell c3b7f982-e927-4a3f-b699-817c726d55c4(cell1) for 2 instances {{(pid=126119) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 02 06:49:14.163463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5976a30-4933-4688-b22b-16bc7baca31f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:14.163903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5976a30-4933-4688-b22b-16bc7baca31f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:14.183999 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b5976a30-4933-4688-b22b-16bc7baca31f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/ccf652e2-05d6-4b0e-b156-c3354d043b8c" status: 200 len: 271 microversion: 2.1 time: 0.041247 Aug 02 06:49:14.184574 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 409/876] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 06:49:14 2022] GET /compute/v2.1/os-server-groups/ccf652e2-05d6-4b0e-b156-c3354d043b8c => generated 271 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:14.190256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b67bb888-5545-40b0-a22c-6d45c3f31969 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:14.190256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b67bb888-5545-40b0-a22c-6d45c3f31969 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:14.195920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b67bb888-5545-40b0-a22c-6d45c3f31969 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:14.196499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b67bb888-5545-40b0-a22c-6d45c3f31969 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:14.197593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b67bb888-5545-40b0-a22c-6d45c3f31969 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:14.198063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b67bb888-5545-40b0-a22c-6d45c3f31969 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:14.230023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b67bb888-5545-40b0-a22c-6d45c3f31969 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:14.230596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b67bb888-5545-40b0-a22c-6d45c3f31969 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:14.231033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-b67bb888-5545-40b0-a22c-6d45c3f31969 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lazy-loading 'fault' on Instance uuid 428968c0-25cc-47b2-bfa1-6147889fdcdf {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:49:14.245504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-181729f8-59f8-44c5-abd2-fc997c993692 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:14.253174 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-181729f8-59f8-44c5-abd2-fc997c993692 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1368 microversion: 2.1 time: 0.273757 Aug 02 06:49:14.253748 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 468/877] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:13 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:14.258754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-064304ba-8cf3-4f26-a455-1b0db3070578 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:14.279083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:14.282537 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-064304ba-8cf3-4f26-a455-1b0db3070578 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.027785 Aug 02 06:49:14.283119 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 469/878] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:49:14 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:14.288119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8bb01d62-24d8-43fe-b8c0-76fb838e0e5f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:14.289052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8bb01d62-24d8-43fe-b8c0-76fb838e0e5f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:14.294759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b67bb888-5545-40b0-a22c-6d45c3f31969 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e925155c248be81bfc65bc7652ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf8ed73c2f64b7194098acb56270897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:14.296373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bb01d62-24d8-43fe-b8c0-76fb838e0e5f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:14.296624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bb01d62-24d8-43fe-b8c0-76fb838e0e5f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:14.297385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bb01d62-24d8-43fe-b8c0-76fb838e0e5f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:14.297843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bb01d62-24d8-43fe-b8c0-76fb838e0e5f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:14.309428 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b67bb888-5545-40b0-a22c-6d45c3f31969 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 200 len: 1355 microversion: 2.1 time: 0.123719 Aug 02 06:49:14.323680 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 410/879] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:14 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 1355 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:14.330674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-01ea02de-35a8-47f8-af5b-12d1d4f761f3 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:14.342874 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-01ea02de-35a8-47f8-af5b-12d1d4f761f3 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021139 Aug 02 06:49:14.346236 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 411/880] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:49:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:14.354063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-951aacde-3e76-4fc2-b924-6ee5e7c256af tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:14.354780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-951aacde-3e76-4fc2-b924-6ee5e7c256af tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:14.361372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-951aacde-3e76-4fc2-b924-6ee5e7c256af tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:14.361956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-951aacde-3e76-4fc2-b924-6ee5e7c256af tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:14.362907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-951aacde-3e76-4fc2-b924-6ee5e7c256af tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:14.363424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-951aacde-3e76-4fc2-b924-6ee5e7c256af tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:14.416952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=18 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:14.628990 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8bb01d62-24d8-43fe-b8c0-76fb838e0e5f tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 200 len: 1619 microversion: 2.1 time: 0.344597 Aug 02 06:49:14.629922 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 470/881] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:14 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 1619 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:14.649608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d8a77581-9847-45da-973b-05ef79525b8b tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:14.702624 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d8a77581-9847-45da-973b-05ef79525b8b tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.059005 Aug 02 06:49:14.710025 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 471/882] 10.222.0.79 () {58 vars in 1167 bytes} [Tue Aug 2 06:49:14 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:14.713790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-951aacde-3e76-4fc2-b924-6ee5e7c256af tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:14.715687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-920ea459-5462-4e22-9f66-a676bce8920c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:14.716310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-920ea459-5462-4e22-9f66-a676bce8920c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:14.721934 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-951aacde-3e76-4fc2-b924-6ee5e7c256af tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1325 microversion: 2.1 time: 0.374351 Aug 02 06:49:14.722719 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 412/883] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:14 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1325 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:14.725049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-920ea459-5462-4e22-9f66-a676bce8920c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:14.725501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-920ea459-5462-4e22-9f66-a676bce8920c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:14.726511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-920ea459-5462-4e22-9f66-a676bce8920c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:14.726951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-920ea459-5462-4e22-9f66-a676bce8920c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:14.739678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a05fb32d-2985-4c93-9fde-e0c88d725f9c tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:14.740812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a05fb32d-2985-4c93-9fde-e0c88d725f9c tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] [instance: 3d5f31c5-23d0-4a18-95a0-6947d96566a5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:14.750686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a05fb32d-2985-4c93-9fde-e0c88d725f9c tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:14.751643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a05fb32d-2985-4c93-9fde-e0c88d725f9c tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:14.752643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a05fb32d-2985-4c93-9fde-e0c88d725f9c tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:14.753613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a05fb32d-2985-4c93-9fde-e0c88d725f9c tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:15.477299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-920ea459-5462-4e22-9f66-a676bce8920c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:15.489349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-920ea459-5462-4e22-9f66-a676bce8920c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:15.492478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-920ea459-5462-4e22-9f66-a676bce8920c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:15.494507 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-920ea459-5462-4e22-9f66-a676bce8920c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1361 microversion: 2.25 time: 0.782547 Aug 02 06:49:15.495084 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 472/884] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:14 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1361 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:15.500790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-59487a9e-0696-4eba-98e6-8233de4cb705 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:15.513386 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-59487a9e-0696-4eba-98e6-8233de4cb705 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016506 Aug 02 06:49:15.514320 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 473/885] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:49:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:15.519710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-d3136edc-1201-4418-afff-eb703a61dcb9 req-e7f975e0-fc76-421b-a726-fca220af8b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cfc9e6-596f-46db-a461-358881324e73", "name": "network-vif-unplugged", "status": "completed", "tag": "a823a2eb-10f1-4619-aff3-00267fcfd035"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:15.527849 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a05fb32d-2985-4c93-9fde-e0c88d725f9c tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5" status: 200 len: 1618 microversion: 2.1 time: 0.800041 Aug 02 06:49:15.529126 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 413/886] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:14 2022] GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5 => generated 1618 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:15.532657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d3136edc-1201-4418-afff-eb703a61dcb9 req-e7f975e0-fc76-421b-a726-fca220af8b8a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:15.533102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d3136edc-1201-4418-afff-eb703a61dcb9 req-e7f975e0-fc76-421b-a726-fca220af8b8a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:15.534964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2f932405-9fb7-490a-b114-1854d686f2cc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:15.535800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2f932405-9fb7-490a-b114-1854d686f2cc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:15.547467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f932405-9fb7-490a-b114-1854d686f2cc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:15.548381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f932405-9fb7-490a-b114-1854d686f2cc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:15.549418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f932405-9fb7-490a-b114-1854d686f2cc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:15.550113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f932405-9fb7-490a-b114-1854d686f2cc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:15.552042 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-d3136edc-1201-4418-afff-eb703a61dcb9 req-e7f975e0-fc76-421b-a726-fca220af8b8a service nova] Creating event network-vif-unplugged:a823a2eb-10f1-4619-aff3-00267fcfd035 for instance f1cfc9e6-596f-46db-a461-358881324e73 on n-h2-851337-3 Aug 02 06:49:15.568219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-d3136edc-1201-4418-afff-eb703a61dcb9 req-e7f975e0-fc76-421b-a726-fca220af8b8a service nova] Instance f1cfc9e6-596f-46db-a461-358881324e73 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 06:49:15.582527 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-d3136edc-1201-4418-afff-eb703a61dcb9 req-e7f975e0-fc76-421b-a726-fca220af8b8a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066279 Aug 02 06:49:15.583433 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 474/887] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:15.590246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6dfe8017-98ca-45ba-9bad-01fb1d1b657c tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:15.591932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6dfe8017-98ca-45ba-9bad-01fb1d1b657c tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:15.599598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dfe8017-98ca-45ba-9bad-01fb1d1b657c tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:15.600034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dfe8017-98ca-45ba-9bad-01fb1d1b657c tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:15.600797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dfe8017-98ca-45ba-9bad-01fb1d1b657c tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:15.601256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dfe8017-98ca-45ba-9bad-01fb1d1b657c tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.047464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2f932405-9fb7-490a-b114-1854d686f2cc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:16.058191 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2f932405-9fb7-490a-b114-1854d686f2cc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1474 microversion: 2.1 time: 0.526681 Aug 02 06:49:16.058833 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 414/888] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:15 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1474 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:16.063920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7b004781-3ed4-4a0a-acad-e9ad6b0a6cc3 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.064619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7b004781-3ed4-4a0a-acad-e9ad6b0a6cc3 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:16.085734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b004781-3ed4-4a0a-acad-e9ad6b0a6cc3 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.086301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b004781-3ed4-4a0a-acad-e9ad6b0a6cc3 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.087169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b004781-3ed4-4a0a-acad-e9ad6b0a6cc3 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.087613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b004781-3ed4-4a0a-acad-e9ad6b0a6cc3 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.107096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6dfe8017-98ca-45ba-9bad-01fb1d1b657c tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:16.108871 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-7b004781-3ed4-4a0a-acad-e9ad6b0a6cc3 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] HTTP exception thrown: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7b004781-3ed4-4a0a-acad-e9ad6b0a6cc3 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Request method failure captured: Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf HTTP/1.1 Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MgvTnCthc6EbtRHUaCnGISmU7X4swStZNYQB16nby41h-HuMujnqmOCYyJv-uKdyJCUN9sk_benXYXxnXbF2JkNg3ZJO100XNEtKgEa7U_K4dE2TtLqLjf7hp3rQrEnWZ28VVCWjvpADidUt6Kufqju-T_Qpvz7GiP6YC3Ul0VW3EI Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: fcf8ed73c2f64b7194098acb56270897 Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:49:16.111142 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:49:16.112818 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fcf8ed73c2f64b7194098acb56270897"}]}] Aug 02 06:49:16.112818 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:16.112818 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: fcf8ed73c2f64b7194098acb56270897 Aug 02 06:49:16.112818 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:16.112818 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersWithSpecificFlavorTestJSON-719288984-project Aug 02 06:49:16.112818 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:49:16.112818 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:49:16.112818 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 5c5e925155c248be81bfc65bc7652ab6 Aug 02 06:49:16.112818 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984-project Aug 02 06:49:16.112818 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:49:16.112818 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:16.112818 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '428968c0-25cc-47b2-bfa1-6147889fdcdf'} Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:16.113790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:16.115465 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.116776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7b004781-3ed4-4a0a-acad-e9ad6b0a6cc3 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Returning 404 to user: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:16.117424 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7b004781-3ed4-4a0a-acad-e9ad6b0a6cc3 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 404 len: 111 microversion: 2.1 time: 0.057338 Aug 02 06:49:16.118440 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 415/889] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:16 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:16.123579 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6dfe8017-98ca-45ba-9bad-01fb1d1b657c tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1368 microversion: 2.1 time: 0.538720 Aug 02 06:49:16.124176 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 475/890] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:15 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1368 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:16.124539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a4d8c276-7cf1-41ac-8f46-8c661fa1b4e8 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.129416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-821366468", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "75ae3b2d-b9db-4285-a9d1-665045b4d168"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:16.149096 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a4d8c276-7cf1-41ac-8f46-8c661fa1b4e8 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.029480 Aug 02 06:49:16.149679 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 416/891] 10.222.0.79 () {58 vars in 1144 bytes} [Tue Aug 2 06:49:16 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:16.154659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a925dec3-71df-4e8b-b9d1-ef26870a2ff6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.155253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a925dec3-71df-4e8b-b9d1-ef26870a2ff6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:16.162853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a925dec3-71df-4e8b-b9d1-ef26870a2ff6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.163300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a925dec3-71df-4e8b-b9d1-ef26870a2ff6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.164061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a925dec3-71df-4e8b-b9d1-ef26870a2ff6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.164482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a925dec3-71df-4e8b-b9d1-ef26870a2ff6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.198647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:49:16.398571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a925dec3-71df-4e8b-b9d1-ef26870a2ff6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:16.406373 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a925dec3-71df-4e8b-b9d1-ef26870a2ff6 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1325 microversion: 2.1 time: 0.255615 Aug 02 06:49:16.407302 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 417/892] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:16 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1325 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:16.411631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-72df7275-a29f-4ae9-b6b6-2f830d860e01 req-fcf81228-6fe4-4b99-9a22-a1a0889d814e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170e8209-d15a-4598-9d57-3c5973fd8733", "tag": "65a2a3cd-0c7c-49a0-a06d-803fedac083b"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:16.416662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:16.428697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-72df7275-a29f-4ae9-b6b6-2f830d860e01 req-fcf81228-6fe4-4b99-9a22-a1a0889d814e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.429252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-72df7275-a29f-4ae9-b6b6-2f830d860e01 req-fcf81228-6fe4-4b99-9a22-a1a0889d814e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.447572 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-72df7275-a29f-4ae9-b6b6-2f830d860e01 req-fcf81228-6fe4-4b99-9a22-a1a0889d814e service nova] Creating event network-changed:65a2a3cd-0c7c-49a0-a06d-803fedac083b for instance 170e8209-d15a-4598-9d57-3c5973fd8733 on n-h2-851337-3 Aug 02 06:49:16.453179 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-72df7275-a29f-4ae9-b6b6-2f830d860e01 req-fcf81228-6fe4-4b99-9a22-a1a0889d814e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044823 Aug 02 06:49:16.454132 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 418/893] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:16.459507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f33f4016-6b90-4193-8972-e2d286921316 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.460128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f33f4016-6b90-4193-8972-e2d286921316 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:16.466602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f33f4016-6b90-4193-8972-e2d286921316 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.467121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f33f4016-6b90-4193-8972-e2d286921316 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.467960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f33f4016-6b90-4193-8972-e2d286921316 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.468390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f33f4016-6b90-4193-8972-e2d286921316 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.483187 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-f33f4016-6b90-4193-8972-e2d286921316 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] HTTP exception thrown: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f33f4016-6b90-4193-8972-e2d286921316 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Request method failure captured: Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 HTTP/1.1 Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MgvTnCthc6EbtRHUaCnGISmU7X4swStZNYQB16nby41h-HuMujnqmOCYyJv-uKdyJCUN9sk_benXYXxnXbF2JkNg3ZJO100XNEtKgEa7U_K4dE2TtLqLjf7hp3rQrEnWZ28VVCWjvpADidUt6Kufqju-T_Qpvz7GiP6YC3Ul0VW3EI Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: fcf8ed73c2f64b7194098acb56270897 Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:49:16.485295 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:49:16.487492 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fcf8ed73c2f64b7194098acb56270897"}]}] Aug 02 06:49:16.487492 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:16.487492 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: fcf8ed73c2f64b7194098acb56270897 Aug 02 06:49:16.487492 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:16.487492 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersWithSpecificFlavorTestJSON-719288984-project Aug 02 06:49:16.487492 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:49:16.487492 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:49:16.487492 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 5c5e925155c248be81bfc65bc7652ab6 Aug 02 06:49:16.487492 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984-project Aug 02 06:49:16.487492 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:49:16.487492 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:16.487492 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '996312b8-1c9c-4def-aa0b-4eaf8f74e3c8'} Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:16.488942 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:16.490348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.491754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f33f4016-6b90-4193-8972-e2d286921316 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Returning 404 to user: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:16.491754 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f33f4016-6b90-4193-8972-e2d286921316 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "DELETE /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 404 len: 111 microversion: 2.1 time: 0.032130 Aug 02 06:49:16.491754 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 419/894] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:49:16 2022] DELETE /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:16.495476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-752a9a65-60dd-44bf-a105-3c8f0bf151d5 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.502135 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-752a9a65-60dd-44bf-a105-3c8f0bf151d5 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013064 Aug 02 06:49:16.503004 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 420/895] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:49:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:16.507858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:49:16.508180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dfbbd63f-ac8d-471d-918c-eaba266f5aca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.508390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:49:16.508774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dfbbd63f-ac8d-471d-918c-eaba266f5aca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:16.508970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:49:16.509586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:49:16.511378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:49:16.515300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfbbd63f-ac8d-471d-918c-eaba266f5aca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.515744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfbbd63f-ac8d-471d-918c-eaba266f5aca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.516811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfbbd63f-ac8d-471d-918c-eaba266f5aca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.517433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfbbd63f-ac8d-471d-918c-eaba266f5aca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.519698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.520210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.521080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.521728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.531044 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-dfbbd63f-ac8d-471d-918c-eaba266f5aca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] HTTP exception thrown: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dfbbd63f-ac8d-471d-918c-eaba266f5aca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Request method failure captured: Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 HTTP/1.1 Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MgvTnCthc6EbtRHUaCnGISmU7X4swStZNYQB16nby41h-HuMujnqmOCYyJv-uKdyJCUN9sk_benXYXxnXbF2JkNg3ZJO100XNEtKgEa7U_K4dE2TtLqLjf7hp3rQrEnWZ28VVCWjvpADidUt6Kufqju-T_Qpvz7GiP6YC3Ul0VW3EI Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: fcf8ed73c2f64b7194098acb56270897 Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:49:16.532647 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:49:16.534368 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fcf8ed73c2f64b7194098acb56270897"}]}] Aug 02 06:49:16.534368 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:16.534368 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: fcf8ed73c2f64b7194098acb56270897 Aug 02 06:49:16.534368 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:16.534368 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersWithSpecificFlavorTestJSON-719288984-project Aug 02 06:49:16.534368 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:49:16.534368 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:49:16.534368 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 5c5e925155c248be81bfc65bc7652ab6 Aug 02 06:49:16.534368 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984-project Aug 02 06:49:16.534368 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:49:16.534368 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:16.534368 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '996312b8-1c9c-4def-aa0b-4eaf8f74e3c8'} Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:16.535237 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:16.537075 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:16.538166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dfbbd63f-ac8d-471d-918c-eaba266f5aca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Returning 404 to user: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:16.538166 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dfbbd63f-ac8d-471d-918c-eaba266f5aca tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 404 len: 111 microversion: 2.1 time: 0.031125 Aug 02 06:49:16.538166 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 421/896] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:16 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:16.539210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:49:16.545185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ead8c033-3eac-4258-832f-c949ef3b4f8d tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.546066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:49:16.564680 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ead8c033-3eac-4258-832f-c949ef3b4f8d tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.023441 Aug 02 06:49:16.574397 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 422/897] 10.222.0.79 () {58 vars in 1148 bytes} [Tue Aug 2 06:49:16 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:16.574397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-037183bc-29c7-4f66-a280-d89f29654697 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.574397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-037183bc-29c7-4f66-a280-d89f29654697 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:16.577160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:49:16.580344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-037183bc-29c7-4f66-a280-d89f29654697 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.580974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-037183bc-29c7-4f66-a280-d89f29654697 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.581911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-037183bc-29c7-4f66-a280-d89f29654697 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.582486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:49:16.582623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-037183bc-29c7-4f66-a280-d89f29654697 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.634569 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-59d269da-a3d1-42f5-8de4-6b39e0a0aa8e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508866 Aug 02 06:49:16.638654 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 476/898] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:49:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:49:16.646259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8d3db221-6961-4c04-b518-7b74b12e5506 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '.version_select at 0x7f927b165ca0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.672428 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8d3db221-6961-4c04-b518-7b74b12e5506 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309647087" status: 202 len: 0 microversion: 2.1 time: 0.032487 Aug 02 06:49:16.676533 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 477/899] 10.222.0.79 () {58 vars in 1221 bytes} [Tue Aug 2 06:49:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309647087 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:49:16.678358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e6e3c896-3282-4a3c-bc85-9861f5c0e17f tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.692852 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e6e3c896-3282-4a3c-bc85-9861f5c0e17f tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.017764 Aug 02 06:49:16.693294 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 478/900] 10.222.0.79 () {58 vars in 1140 bytes} [Tue Aug 2 06:49:16 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:16.697954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc427e96-8ffe-4bec-9f86-be596c51421e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.698725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bc427e96-8ffe-4bec-9f86-be596c51421e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:16.779193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bc427e96-8ffe-4bec-9f86-be596c51421e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:16.787368 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc427e96-8ffe-4bec-9f86-be596c51421e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 200 len: 1216 microversion: 2.1 time: 0.092878 Aug 02 06:49:16.792957 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 479/901] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:16 2022] GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 1216 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:16.807305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-016cf479-c6a4-480d-b372-73ad36cb4700 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.826663 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-016cf479-c6a4-480d-b372-73ad36cb4700 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029178 Aug 02 06:49:16.827202 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 480/902] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:49:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:16.829365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-037183bc-29c7-4f66-a280-d89f29654697 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:16.838165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-037183bc-29c7-4f66-a280-d89f29654697 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:16.841628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-037183bc-29c7-4f66-a280-d89f29654697 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:16.843122 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-037183bc-29c7-4f66-a280-d89f29654697 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1557 microversion: 2.25 time: 0.276819 Aug 02 06:49:16.843887 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 423/903] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:16 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1557 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:16.849922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f316a7aa-8a99-4e73-aa2d-4d34e1573222 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.867956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-44410f9f-fa42-4f86-b7fc-dbc98819ec12 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.868936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-44410f9f-fa42-4f86-b7fc-dbc98819ec12 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:16.875158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44410f9f-fa42-4f86-b7fc-dbc98819ec12 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.875849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44410f9f-fa42-4f86-b7fc-dbc98819ec12 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.876611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44410f9f-fa42-4f86-b7fc-dbc98819ec12 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:16.877193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44410f9f-fa42-4f86-b7fc-dbc98819ec12 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:16.892863 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f316a7aa-8a99-4e73-aa2d-4d34e1573222 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.056312 Aug 02 06:49:16.894081 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 481/904] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:49:16 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:49:16.918549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b055f66-aaa8-4fe6-b57f-05ea2eec6ec1 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.953015 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b055f66-aaa8-4fe6-b57f-05ea2eec6ec1 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.045146 Aug 02 06:49:16.954420 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 482/905] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:49:16 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:16.981223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5011e9dc-421f-4cbb-9b53-a463bbc838c6 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:16.997982 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5011e9dc-421f-4cbb-9b53-a463bbc838c6 tempest-FlavorsV2TestJSON-835722233 tempest-FlavorsV2TestJSON-835722233-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026172 Aug 02 06:49:17.000918 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 483/906] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:49:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:17.081793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fad76322-2257-4e37-81da-61a95e0176c6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:17.082481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fad76322-2257-4e37-81da-61a95e0176c6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:17.098338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fad76322-2257-4e37-81da-61a95e0176c6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:17.098731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fad76322-2257-4e37-81da-61a95e0176c6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:17.099578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fad76322-2257-4e37-81da-61a95e0176c6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:17.099927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fad76322-2257-4e37-81da-61a95e0176c6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:17.214956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-44410f9f-fa42-4f86-b7fc-dbc98819ec12 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:49:17.264972 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-44410f9f-fa42-4f86-b7fc-dbc98819ec12 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 2049 microversion: 2.25 time: 0.400431 Aug 02 06:49:17.267626 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 424/907] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:16 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 2049 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:17.279346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a3cdb6e5-4b61-42ac-9b45-57a9929d3340 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:17.280881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a3cdb6e5-4b61-42ac-9b45-57a9929d3340 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:17.311534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3cdb6e5-4b61-42ac-9b45-57a9929d3340 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:17.315948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3cdb6e5-4b61-42ac-9b45-57a9929d3340 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:17.318734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3cdb6e5-4b61-42ac-9b45-57a9929d3340 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:17.319805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3cdb6e5-4b61-42ac-9b45-57a9929d3340 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:17.702642 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fad76322-2257-4e37-81da-61a95e0176c6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:17.726961 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fad76322-2257-4e37-81da-61a95e0176c6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1472 microversion: 2.1 time: 0.650254 Aug 02 06:49:17.745810 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 484/908] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:17 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1472 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:17.752217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7cf315a2-8518-4548-9aa5-facf7ab4e239 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:17.754197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7cf315a2-8518-4548-9aa5-facf7ab4e239 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:17.763399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7cf315a2-8518-4548-9aa5-facf7ab4e239 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:17.764158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7cf315a2-8518-4548-9aa5-facf7ab4e239 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:17.764948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7cf315a2-8518-4548-9aa5-facf7ab4e239 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:17.765372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7cf315a2-8518-4548-9aa5-facf7ab4e239 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:17.771580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a3cdb6e5-4b61-42ac-9b45-57a9929d3340 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:17.781164 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a3cdb6e5-4b61-42ac-9b45-57a9929d3340 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1368 microversion: 2.1 time: 0.510776 Aug 02 06:49:17.782391 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 425/909] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:17 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1368 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:17.787555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-171fb30b-483b-4e8e-9bd4-3231d4c08ccb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:17.788245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-171fb30b-483b-4e8e-9bd4-3231d4c08ccb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:17.795763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-171fb30b-483b-4e8e-9bd4-3231d4c08ccb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:17.796448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-171fb30b-483b-4e8e-9bd4-3231d4c08ccb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:17.797360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-171fb30b-483b-4e8e-9bd4-3231d4c08ccb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:17.797862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-171fb30b-483b-4e8e-9bd4-3231d4c08ccb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.070128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-171fb30b-483b-4e8e-9bd4-3231d4c08ccb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:18.089046 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-171fb30b-483b-4e8e-9bd4-3231d4c08ccb tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1325 microversion: 2.1 time: 0.305358 Aug 02 06:49:18.089645 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 426/910] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:17 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1325 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:18.103399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-35b6fa9c-ae20-4c6f-8ceb-05f9077d9506 req-89b93cd7-182c-4713-ac73-15a1c2685209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1cfc9e6-596f-46db-a461-358881324e73", "tag": "a823a2eb-10f1-4619-aff3-00267fcfd035"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:18.103574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-7cf315a2-8518-4548-9aa5-facf7ab4e239 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:49:18.104703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-35b6fa9c-ae20-4c6f-8ceb-05f9077d9506 req-89b93cd7-182c-4713-ac73-15a1c2685209 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.105191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-35b6fa9c-ae20-4c6f-8ceb-05f9077d9506 req-89b93cd7-182c-4713-ac73-15a1c2685209 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.118336 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-35b6fa9c-ae20-4c6f-8ceb-05f9077d9506 req-89b93cd7-182c-4713-ac73-15a1c2685209 service nova] Creating event network-changed:a823a2eb-10f1-4619-aff3-00267fcfd035 for instance f1cfc9e6-596f-46db-a461-358881324e73 on n-h2-851337-3 Aug 02 06:49:18.120734 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7cf315a2-8518-4548-9aa5-facf7ab4e239 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 2049 microversion: 2.25 time: 0.376293 Aug 02 06:49:18.121709 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 485/911] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:17 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 2049 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:18.126427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8773596a-eaa3-4d64-a48c-77960a1645e4 tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:18.127294 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:18.127294 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:18.144564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-35b6fa9c-ae20-4c6f-8ceb-05f9077d9506 req-89b93cd7-182c-4713-ac73-15a1c2685209 service nova] Instance f1cfc9e6-596f-46db-a461-358881324e73 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 06:49:18.153387 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8773596a-eaa3-4d64-a48c-77960a1645e4 tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/2050779305" status: 202 len: 0 microversion: 2.1 time: 0.029375 Aug 02 06:49:18.156091 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-35b6fa9c-ae20-4c6f-8ceb-05f9077d9506 req-89b93cd7-182c-4713-ac73-15a1c2685209 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065143 Aug 02 06:49:18.156991 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 427/912] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:18.160156 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 486/913] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:49:18 2022] DELETE /compute/v2.1/flavors/2050779305 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:49:18.162744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a8592a4a-c354-40b7-92c0-1b5924ad9829 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:18.163639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a8592a4a-c354-40b7-92c0-1b5924ad9829 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:18.168088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-00535ba6-1bda-4f09-817d-841941b35fae tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:18.170821 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:18.170821 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:18.171184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8592a4a-c354-40b7-92c0-1b5924ad9829 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.171662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8592a4a-c354-40b7-92c0-1b5924ad9829 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.172093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00535ba6-1bda-4f09-817d-841941b35fae tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.172572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00535ba6-1bda-4f09-817d-841941b35fae tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.172691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8592a4a-c354-40b7-92c0-1b5924ad9829 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.173125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8592a4a-c354-40b7-92c0-1b5924ad9829 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.173446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00535ba6-1bda-4f09-817d-841941b35fae tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.174326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00535ba6-1bda-4f09-817d-841941b35fae tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.201691 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-00535ba6-1bda-4f09-817d-841941b35fae tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.039670 Aug 02 06:49:18.202733 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 487/914] 10.222.0.79 () {60 vars in 1217 bytes} [Tue Aug 2 06:49:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:49:18.207131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ad4bbd68-138d-4680-92db-a8f1c179cb23 tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:18.231196 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ad4bbd68-138d-4680-92db-a8f1c179cb23 tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.027095 Aug 02 06:49:18.242078 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 488/915] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:49:18 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:18.247563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bb0d875f-c3c5-4213-9df4-8edf783378a6 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:18.260450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bb0d875f-c3c5-4213-9df4-8edf783378a6 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:18.284338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb0d875f-c3c5-4213-9df4-8edf783378a6 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.284971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb0d875f-c3c5-4213-9df4-8edf783378a6 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.286026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb0d875f-c3c5-4213-9df4-8edf783378a6 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.287103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb0d875f-c3c5-4213-9df4-8edf783378a6 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.302351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a8592a4a-c354-40b7-92c0-1b5924ad9829 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:18.327819 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a8592a4a-c354-40b7-92c0-1b5924ad9829 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 200 len: 1268 microversion: 2.1 time: 0.169313 Aug 02 06:49:18.329424 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 428/916] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:18 2022] GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:18.344579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4984ee59-abe8-4330-afb2-15f044acfff7 tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:18.348403 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:18.348403 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:49:18.352653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:18.374260 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4984ee59-abe8-4330-afb2-15f044acfff7 tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1804928652" status: 202 len: 0 microversion: 2.1 time: 0.043107 Aug 02 06:49:18.375772 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 429/917] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 06:49:18 2022] DELETE /compute/v2.1/flavors/1804928652 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:49:18.385899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a519e6a0-d875-4861-920a-1b784387dfb7 tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:18.416727 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a519e6a0-d875-4861-920a-1b784387dfb7 tempest-ServersWithSpecificFlavorTestJSON-1512311435 tempest-ServersWithSpecificFlavorTestJSON-1512311435-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036437 Aug 02 06:49:18.417681 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bb0d875f-c3c5-4213-9df4-8edf783378a6 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4/action" status: 202 len: 0 microversion: 2.25 time: 0.173596 Aug 02 06:49:18.418360 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 430/918] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:49:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:18.422172 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 489/919] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Aug 2 06:49:18 2022] POST /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:49:18.442684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7c7db226-30c6-4dc1-9200-ad9911bc888d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:18.443700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7c7db226-30c6-4dc1-9200-ad9911bc888d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:18.453052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2cd7a1d5-3291-4bba-a9d2-a0521dff0cd1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:18.454265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2cd7a1d5-3291-4bba-a9d2-a0521dff0cd1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:18.454917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c7db226-30c6-4dc1-9200-ad9911bc888d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.455667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c7db226-30c6-4dc1-9200-ad9911bc888d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.456969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c7db226-30c6-4dc1-9200-ad9911bc888d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.458153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c7db226-30c6-4dc1-9200-ad9911bc888d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.461993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2cd7a1d5-3291-4bba-a9d2-a0521dff0cd1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.462761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2cd7a1d5-3291-4bba-a9d2-a0521dff0cd1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.463783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2cd7a1d5-3291-4bba-a9d2-a0521dff0cd1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.465142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2cd7a1d5-3291-4bba-a9d2-a0521dff0cd1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.480946 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-2cd7a1d5-3291-4bba-a9d2-a0521dff0cd1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] HTTP exception thrown: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2cd7a1d5-3291-4bba-a9d2-a0521dff0cd1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Request method failure captured: Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf HTTP/1.1 Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgvTnCthc6EbtRHUaCnGISmU7X4swStZNYQB16nby41h-HuMujnqmOCYyJv-uKdyJCUN9sk_benXYXxnXbF2JkNg3ZJO100XNEtKgEa7U_K4dE2TtLqLjf7hp3rQrEnWZ28VVCWjvpADidUt6Kufqju-T_Qpvz7GiP6YC3Ul0VW3EI Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: fcf8ed73c2f64b7194098acb56270897 Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:49:18.483159 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:49:18.484636 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fcf8ed73c2f64b7194098acb56270897"}]}] Aug 02 06:49:18.484636 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:18.484636 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: fcf8ed73c2f64b7194098acb56270897 Aug 02 06:49:18.484636 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:18.484636 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersWithSpecificFlavorTestJSON-719288984-project Aug 02 06:49:18.484636 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:18.484636 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:18.484636 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5c5e925155c248be81bfc65bc7652ab6 Aug 02 06:49:18.484636 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984-project Aug 02 06:49:18.484636 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:49:18.484636 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:18.484636 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '428968c0-25cc-47b2-bfa1-6147889fdcdf'} Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:18.485392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:18.486789 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.488835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2cd7a1d5-3291-4bba-a9d2-a0521dff0cd1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Returning 404 to user: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:18.490093 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2cd7a1d5-3291-4bba-a9d2-a0521dff0cd1 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "DELETE /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 404 len: 111 microversion: 2.1 time: 0.043921 Aug 02 06:49:18.491177 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 490/920] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:49:18 2022] DELETE /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:18.502303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-caa5e12b-1b80-4e57-b447-57ef11d59321 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:18.504725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-caa5e12b-1b80-4e57-b447-57ef11d59321 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 428968c0-25cc-47b2-bfa1-6147889fdcdf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:18.513459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa5e12b-1b80-4e57-b447-57ef11d59321 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.514252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa5e12b-1b80-4e57-b447-57ef11d59321 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.515189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa5e12b-1b80-4e57-b447-57ef11d59321 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.515780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa5e12b-1b80-4e57-b447-57ef11d59321 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.537450 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-caa5e12b-1b80-4e57-b447-57ef11d59321 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] HTTP exception thrown: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-caa5e12b-1b80-4e57-b447-57ef11d59321 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Request method failure captured: Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf HTTP/1.1 Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgvTnCthc6EbtRHUaCnGISmU7X4swStZNYQB16nby41h-HuMujnqmOCYyJv-uKdyJCUN9sk_benXYXxnXbF2JkNg3ZJO100XNEtKgEa7U_K4dE2TtLqLjf7hp3rQrEnWZ28VVCWjvpADidUt6Kufqju-T_Qpvz7GiP6YC3Ul0VW3EI Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: fcf8ed73c2f64b7194098acb56270897 Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:49:18.540800 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:49:18.542789 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fcf8ed73c2f64b7194098acb56270897"}]}] Aug 02 06:49:18.542789 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:18.542789 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: fcf8ed73c2f64b7194098acb56270897 Aug 02 06:49:18.542789 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:18.542789 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersWithSpecificFlavorTestJSON-719288984-project Aug 02 06:49:18.542789 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:18.542789 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:18.542789 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5c5e925155c248be81bfc65bc7652ab6 Aug 02 06:49:18.542789 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984-project Aug 02 06:49:18.542789 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:49:18.542789 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:18.542789 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '428968c0-25cc-47b2-bfa1-6147889fdcdf'} Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:18.543667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. Aug 02 06:49:18.544925 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.550240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-caa5e12b-1b80-4e57-b447-57ef11d59321 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Returning 404 to user: Instance 428968c0-25cc-47b2-bfa1-6147889fdcdf could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:18.551147 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-caa5e12b-1b80-4e57-b447-57ef11d59321 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf" status: 404 len: 111 microversion: 2.1 time: 0.055709 Aug 02 06:49:18.551724 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 491/921] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:18 2022] GET /compute/v2.1/servers/428968c0-25cc-47b2-bfa1-6147889fdcdf => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:18.562938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-52358d46-80be-4125-83f2-a1ff2ede39cf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:18.563595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-52358d46-80be-4125-83f2-a1ff2ede39cf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:18.570366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52358d46-80be-4125-83f2-a1ff2ede39cf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.571011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52358d46-80be-4125-83f2-a1ff2ede39cf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.572752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52358d46-80be-4125-83f2-a1ff2ede39cf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.572752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52358d46-80be-4125-83f2-a1ff2ede39cf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.591201 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-52358d46-80be-4125-83f2-a1ff2ede39cf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] HTTP exception thrown: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-52358d46-80be-4125-83f2-a1ff2ede39cf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Request method failure captured: Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 HTTP/1.1 Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgvTnCthc6EbtRHUaCnGISmU7X4swStZNYQB16nby41h-HuMujnqmOCYyJv-uKdyJCUN9sk_benXYXxnXbF2JkNg3ZJO100XNEtKgEa7U_K4dE2TtLqLjf7hp3rQrEnWZ28VVCWjvpADidUt6Kufqju-T_Qpvz7GiP6YC3Ul0VW3EI Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: fcf8ed73c2f64b7194098acb56270897 Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:49:18.592843 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:49:18.594165 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fcf8ed73c2f64b7194098acb56270897"}]}] Aug 02 06:49:18.594165 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:18.594165 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: fcf8ed73c2f64b7194098acb56270897 Aug 02 06:49:18.594165 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:18.594165 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersWithSpecificFlavorTestJSON-719288984-project Aug 02 06:49:18.594165 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:18.594165 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:18.594165 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5c5e925155c248be81bfc65bc7652ab6 Aug 02 06:49:18.594165 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984-project Aug 02 06:49:18.594165 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:49:18.594165 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:18.594165 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '996312b8-1c9c-4def-aa0b-4eaf8f74e3c8'} Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:18.594932 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:18.596232 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.597549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-52358d46-80be-4125-83f2-a1ff2ede39cf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Returning 404 to user: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:18.597549 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-52358d46-80be-4125-83f2-a1ff2ede39cf tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "DELETE /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 404 len: 111 microversion: 2.1 time: 0.037389 Aug 02 06:49:18.597549 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 492/922] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:49:18 2022] DELETE /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:18.608523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e642ee96-a9cf-4ce3-b42c-a99d7dfd51b5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:18.609364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e642ee96-a9cf-4ce3-b42c-a99d7dfd51b5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] [instance: 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:18.618511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e642ee96-a9cf-4ce3-b42c-a99d7dfd51b5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.618966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e642ee96-a9cf-4ce3-b42c-a99d7dfd51b5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.619795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e642ee96-a9cf-4ce3-b42c-a99d7dfd51b5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.620230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e642ee96-a9cf-4ce3-b42c-a99d7dfd51b5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.636979 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-e642ee96-a9cf-4ce3-b42c-a99d7dfd51b5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] HTTP exception thrown: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e642ee96-a9cf-4ce3-b42c-a99d7dfd51b5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Request method failure captured: Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 HTTP/1.1 Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MgvTnCthc6EbtRHUaCnGISmU7X4swStZNYQB16nby41h-HuMujnqmOCYyJv-uKdyJCUN9sk_benXYXxnXbF2JkNg3ZJO100XNEtKgEa7U_K4dE2TtLqLjf7hp3rQrEnWZ28VVCWjvpADidUt6Kufqju-T_Qpvz7GiP6YC3Ul0VW3EI Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: fcf8ed73c2f64b7194098acb56270897 Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:49:18.639022 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:49:18.640360 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fcf8ed73c2f64b7194098acb56270897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fcf8ed73c2f64b7194098acb56270897"}]}] Aug 02 06:49:18.640360 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:18.640360 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: fcf8ed73c2f64b7194098acb56270897 Aug 02 06:49:18.640360 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984 Aug 02 06:49:18.640360 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersWithSpecificFlavorTestJSON-719288984-project Aug 02 06:49:18.640360 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:18.640360 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:18.640360 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5c5e925155c248be81bfc65bc7652ab6 Aug 02 06:49:18.640360 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-719288984-project Aug 02 06:49:18.640360 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:49:18.640360 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:18.640360 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '996312b8-1c9c-4def-aa0b-4eaf8f74e3c8'} Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:18.641048 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. Aug 02 06:49:18.642193 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:18.643230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e642ee96-a9cf-4ce3-b42c-a99d7dfd51b5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] Returning 404 to user: Instance 996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:18.643230 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e642ee96-a9cf-4ce3-b42c-a99d7dfd51b5 tempest-ServersWithSpecificFlavorTestJSON-719288984 tempest-ServersWithSpecificFlavorTestJSON-719288984-project] 10.222.0.79 "GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8" status: 404 len: 111 microversion: 2.1 time: 0.040280 Aug 02 06:49:18.643230 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 493/923] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:18 2022] GET /compute/v2.1/servers/996312b8-1c9c-4def-aa0b-4eaf8f74e3c8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:49:18.754193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0da7819b-4598-4641-98a0-2e0bfdff5850 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:18.755096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0da7819b-4598-4641-98a0-2e0bfdff5850 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:18.769991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0da7819b-4598-4641-98a0-2e0bfdff5850 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.770494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0da7819b-4598-4641-98a0-2e0bfdff5850 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.771691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0da7819b-4598-4641-98a0-2e0bfdff5850 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:18.772128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0da7819b-4598-4641-98a0-2e0bfdff5850 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:18.974611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-7c7db226-30c6-4dc1-9200-ad9911bc888d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:49:19.002667 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7c7db226-30c6-4dc1-9200-ad9911bc888d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 2054 microversion: 2.25 time: 0.563981 Aug 02 06:49:19.005430 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 431/924] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:18 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 2054 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:19.013218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85167449-b941-4e0e-a522-5d62b1e62c25 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:19.015030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-85167449-b941-4e0e-a522-5d62b1e62c25 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:19.022791 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85167449-b941-4e0e-a522-5d62b1e62c25 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:19.023503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85167449-b941-4e0e-a522-5d62b1e62c25 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:19.024488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85167449-b941-4e0e-a522-5d62b1e62c25 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:19.025718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85167449-b941-4e0e-a522-5d62b1e62c25 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:19.326790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0da7819b-4598-4641-98a0-2e0bfdff5850 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:19.338614 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0da7819b-4598-4641-98a0-2e0bfdff5850 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1472 microversion: 2.1 time: 0.589465 Aug 02 06:49:19.341975 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 494/925] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:18 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1472 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:19.351369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c31297a9-9946-4423-91d6-97474e70dfae tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:19.351369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c31297a9-9946-4423-91d6-97474e70dfae tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:19.370190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c31297a9-9946-4423-91d6-97474e70dfae tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:19.371640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c31297a9-9946-4423-91d6-97474e70dfae tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:19.373019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c31297a9-9946-4423-91d6-97474e70dfae tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:19.374413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c31297a9-9946-4423-91d6-97474e70dfae tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:20.120496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-85167449-b941-4e0e-a522-5d62b1e62c25 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:20.167925 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-85167449-b941-4e0e-a522-5d62b1e62c25 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1368 microversion: 2.1 time: 1.159362 Aug 02 06:49:20.169558 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 432/926] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:19 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1368 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:20.186661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-36f2359f-6991-4c73-b6cf-fa4d055b7b75 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:20.190756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-36f2359f-6991-4c73-b6cf-fa4d055b7b75 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:20.206454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36f2359f-6991-4c73-b6cf-fa4d055b7b75 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:20.207427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36f2359f-6991-4c73-b6cf-fa4d055b7b75 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:20.210193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36f2359f-6991-4c73-b6cf-fa4d055b7b75 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:20.211321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36f2359f-6991-4c73-b6cf-fa4d055b7b75 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:20.250935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:20.344857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c31297a9-9946-4423-91d6-97474e70dfae tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:20.357377 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c31297a9-9946-4423-91d6-97474e70dfae tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1325 microversion: 2.1 time: 1.012998 Aug 02 06:49:20.359650 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 495/927] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:19 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1325 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:20.367865 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6812d56c-6bdb-4e67-bc91-2920c010359f req-0313a7a6-38c1-48ea-8bab-84cdfc7607fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52787eee-3cd0-49f7-a881-16d055348a8c", "name": "network-vif-plugged", "status": "completed", "tag": "823028dd-19e9-472a-a5b5-80182eab9a74"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:20.395967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6812d56c-6bdb-4e67-bc91-2920c010359f req-0313a7a6-38c1-48ea-8bab-84cdfc7607fd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:20.397158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6812d56c-6bdb-4e67-bc91-2920c010359f req-0313a7a6-38c1-48ea-8bab-84cdfc7607fd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:20.445232 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-6812d56c-6bdb-4e67-bc91-2920c010359f req-0313a7a6-38c1-48ea-8bab-84cdfc7607fd service nova] Creating event network-vif-plugged:823028dd-19e9-472a-a5b5-80182eab9a74 for instance 52787eee-3cd0-49f7-a881-16d055348a8c on n-h2-851337-3 Aug 02 06:49:20.450963 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6812d56c-6bdb-4e67-bc91-2920c010359f req-0313a7a6-38c1-48ea-8bab-84cdfc7607fd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089880 Aug 02 06:49:20.455284 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 496/928] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:20.459851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1d2b6c44-e641-49e1-9829-76777dc65179 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:20.460843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1d2b6c44-e641-49e1-9829-76777dc65179 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:20.468808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d2b6c44-e641-49e1-9829-76777dc65179 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:20.469492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d2b6c44-e641-49e1-9829-76777dc65179 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:20.470582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d2b6c44-e641-49e1-9829-76777dc65179 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:20.471174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d2b6c44-e641-49e1-9829-76777dc65179 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:20.923669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-36f2359f-6991-4c73-b6cf-fa4d055b7b75 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:20.932759 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-36f2359f-6991-4c73-b6cf-fa4d055b7b75 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 200 len: 1316 microversion: 2.1 time: 0.758738 Aug 02 06:49:20.946848 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 433/929] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:20 2022] GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 1316 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:20.947974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-31b22243-e433-42b1-a6c6-77887e2ab2e4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:20.948892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-31b22243-e433-42b1-a6c6-77887e2ab2e4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:20.958660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31b22243-e433-42b1-a6c6-77887e2ab2e4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:20.959549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31b22243-e433-42b1-a6c6-77887e2ab2e4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:20.960556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31b22243-e433-42b1-a6c6-77887e2ab2e4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:20.961095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31b22243-e433-42b1-a6c6-77887e2ab2e4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:21.006390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-1d2b6c44-e641-49e1-9829-76777dc65179 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:49:21.022724 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1d2b6c44-e641-49e1-9829-76777dc65179 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 2034 microversion: 2.25 time: 0.566709 Aug 02 06:49:21.023600 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 497/930] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:20 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 2034 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:21.028566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6675bdd2-1554-41c8-b9ab-73e783558525 req-1320965e-f1a6-467b-b033-d5f74c0d303e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a822ec0-2e44-4a7e-a000-087f2814a941", "tag": "e351a644-769d-4826-a9df-f6f401f53d95"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:21.038186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6675bdd2-1554-41c8-b9ab-73e783558525 req-1320965e-f1a6-467b-b033-d5f74c0d303e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:21.038870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6675bdd2-1554-41c8-b9ab-73e783558525 req-1320965e-f1a6-467b-b033-d5f74c0d303e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:21.050108 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-6675bdd2-1554-41c8-b9ab-73e783558525 req-1320965e-f1a6-467b-b033-d5f74c0d303e service nova] Creating event network-changed:e351a644-769d-4826-a9df-f6f401f53d95 for instance 4a822ec0-2e44-4a7e-a000-087f2814a941 on n-h1-851337-3 Aug 02 06:49:21.056371 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6675bdd2-1554-41c8-b9ab-73e783558525 req-1320965e-f1a6-467b-b033-d5f74c0d303e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031250 Aug 02 06:49:21.056975 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 498/931] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:21.063153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2618ff75-87a8-420f-8e71-2916459324d0 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851337-3", "block_migration": "auto"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:21.066288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2618ff75-87a8-420f-8e71-2916459324d0 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:21.073834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2618ff75-87a8-420f-8e71-2916459324d0 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:21.074695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2618ff75-87a8-420f-8e71-2916459324d0 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:21.075942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2618ff75-87a8-420f-8e71-2916459324d0 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:21.076614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2618ff75-87a8-420f-8e71-2916459324d0 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:21.112381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-2618ff75-87a8-420f-8e71-2916459324d0 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'flavor' on Instance uuid 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:49:21.142762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2618ff75-87a8-420f-8e71-2916459324d0 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Going to try to live migrate instance to n-h2-851337-3 {{(pid=126120) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 02 06:49:21.417865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-31b22243-e433-42b1-a6c6-77887e2ab2e4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:21.426940 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-31b22243-e433-42b1-a6c6-77887e2ab2e4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1469 microversion: 2.1 time: 0.484495 Aug 02 06:49:21.429643 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 434/932] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:20 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1469 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:21.434851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79c90502-8647-4571-b735-2a0c81b3554a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:21.435721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79c90502-8647-4571-b735-2a0c81b3554a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:21.443927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79c90502-8647-4571-b735-2a0c81b3554a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:21.457970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79c90502-8647-4571-b735-2a0c81b3554a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:21.459222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79c90502-8647-4571-b735-2a0c81b3554a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:21.459823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79c90502-8647-4571-b735-2a0c81b3554a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:22.123182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79c90502-8647-4571-b735-2a0c81b3554a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:22.136079 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79c90502-8647-4571-b735-2a0c81b3554a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1368 microversion: 2.1 time: 0.702789 Aug 02 06:49:22.137385 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 435/933] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:21 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1368 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:22.146099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-89afd797-91e8-4f73-b618-6e85d6272a90 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:22.146958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-89afd797-91e8-4f73-b618-6e85d6272a90 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:22.170653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89afd797-91e8-4f73-b618-6e85d6272a90 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:22.174166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89afd797-91e8-4f73-b618-6e85d6272a90 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:22.175188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89afd797-91e8-4f73-b618-6e85d6272a90 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:22.177757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89afd797-91e8-4f73-b618-6e85d6272a90 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:22.452631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-89afd797-91e8-4f73-b618-6e85d6272a90 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:22.462887 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-89afd797-91e8-4f73-b618-6e85d6272a90 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1325 microversion: 2.1 time: 0.324017 Aug 02 06:49:22.464713 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 436/934] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:22 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1325 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:22.485994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a5c5e74b-546e-4883-8384-dea1c0f55544 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:22.487670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a5c5e74b-546e-4883-8384-dea1c0f55544 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:22.496145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5c5e74b-546e-4883-8384-dea1c0f55544 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:22.497031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5c5e74b-546e-4883-8384-dea1c0f55544 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:22.498212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5c5e74b-546e-4883-8384-dea1c0f55544 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:22.499421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5c5e74b-546e-4883-8384-dea1c0f55544 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:22.622182 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a5c5e74b-546e-4883-8384-dea1c0f55544 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "POST /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73/action" status: 204 len: 0 microversion: 2.1 time: 0.156015 Aug 02 06:49:22.623562 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 437/935] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:49:22 2022] POST /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73/action => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:49:22.629369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-312d9849-46da-4c25-9f6a-b99cfe3dfaf2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:22.630489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-312d9849-46da-4c25-9f6a-b99cfe3dfaf2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:22.639464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-312d9849-46da-4c25-9f6a-b99cfe3dfaf2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:22.640382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-312d9849-46da-4c25-9f6a-b99cfe3dfaf2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:22.641402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-312d9849-46da-4c25-9f6a-b99cfe3dfaf2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:22.642066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-312d9849-46da-4c25-9f6a-b99cfe3dfaf2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:22.916935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-312d9849-46da-4c25-9f6a-b99cfe3dfaf2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:22.928233 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-312d9849-46da-4c25-9f6a-b99cfe3dfaf2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 200 len: 1316 microversion: 2.1 time: 0.302665 Aug 02 06:49:22.929596 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 438/936] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:22 2022] GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:22.936839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-9c08d67d-c169-4711-baa9-0e0dc37437b7 req-524a79eb-a556-4924-81b2-b2079a81aff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69991b6b-468d-45c0-b658-297b210ae988", "name": "network-vif-plugged", "status": "completed", "tag": "b5f97f41-8484-419a-ac2c-d049deaf4ea4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:22.948853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9c08d67d-c169-4711-baa9-0e0dc37437b7 req-524a79eb-a556-4924-81b2-b2079a81aff0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:22.950521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9c08d67d-c169-4711-baa9-0e0dc37437b7 req-524a79eb-a556-4924-81b2-b2079a81aff0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:22.971782 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-9c08d67d-c169-4711-baa9-0e0dc37437b7 req-524a79eb-a556-4924-81b2-b2079a81aff0 service nova] Creating event network-vif-plugged:b5f97f41-8484-419a-ac2c-d049deaf4ea4 for instance 69991b6b-468d-45c0-b658-297b210ae988 on n-h2-851337-3 Aug 02 06:49:22.978016 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-9c08d67d-c169-4711-baa9-0e0dc37437b7 req-524a79eb-a556-4924-81b2-b2079a81aff0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046837 Aug 02 06:49:22.978835 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 439/937] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:22.985606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f19ac655-2742-41c7-99cc-3839b87b6c5d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:22.986403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f19ac655-2742-41c7-99cc-3839b87b6c5d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:22.993525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f19ac655-2742-41c7-99cc-3839b87b6c5d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:22.993760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f19ac655-2742-41c7-99cc-3839b87b6c5d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:22.995625 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f19ac655-2742-41c7-99cc-3839b87b6c5d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:22.996044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f19ac655-2742-41c7-99cc-3839b87b6c5d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:23.308061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f19ac655-2742-41c7-99cc-3839b87b6c5d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:23.316906 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f19ac655-2742-41c7-99cc-3839b87b6c5d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1469 microversion: 2.1 time: 0.336789 Aug 02 06:49:23.317496 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 440/938] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:22 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1469 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:23.322218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-86be0136-0b4d-474c-b866-5e0350373c64 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:23.322816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-86be0136-0b4d-474c-b866-5e0350373c64 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:23.344325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86be0136-0b4d-474c-b866-5e0350373c64 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:23.344737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86be0136-0b4d-474c-b866-5e0350373c64 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:23.345695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86be0136-0b4d-474c-b866-5e0350373c64 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:23.346322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86be0136-0b4d-474c-b866-5e0350373c64 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:23.532383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-86be0136-0b4d-474c-b866-5e0350373c64 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:23.541630 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-86be0136-0b4d-474c-b866-5e0350373c64 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1368 microversion: 2.1 time: 0.222842 Aug 02 06:49:23.556150 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 441/939] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:23 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:23.561443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6d02f35c-46e4-4a3a-8119-a0785a655738 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:23.562095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6d02f35c-46e4-4a3a-8119-a0785a655738 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:23.569599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d02f35c-46e4-4a3a-8119-a0785a655738 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:23.570075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d02f35c-46e4-4a3a-8119-a0785a655738 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:23.570846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d02f35c-46e4-4a3a-8119-a0785a655738 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:23.571271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d02f35c-46e4-4a3a-8119-a0785a655738 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:23.759345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6d02f35c-46e4-4a3a-8119-a0785a655738 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:23.773867 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6d02f35c-46e4-4a3a-8119-a0785a655738 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1522 microversion: 2.1 time: 0.215781 Aug 02 06:49:23.775590 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 442/940] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:23 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:23.805789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2128a410-1f1d-45b6-88da-23e0885d5680 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:23.806316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2128a410-1f1d-45b6-88da-23e0885d5680 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:23.813677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2128a410-1f1d-45b6-88da-23e0885d5680 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:23.814288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2128a410-1f1d-45b6-88da-23e0885d5680 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:23.815167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2128a410-1f1d-45b6-88da-23e0885d5680 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:23.815811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2128a410-1f1d-45b6-88da-23e0885d5680 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:24.019081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2128a410-1f1d-45b6-88da-23e0885d5680 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:24.029774 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2128a410-1f1d-45b6-88da-23e0885d5680 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1522 microversion: 2.1 time: 0.227849 Aug 02 06:49:24.042099 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 443/941] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:23 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:49:24.042099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c2644024-4eba-43c7-8109-3eb55179f86f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:24.042099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c2644024-4eba-43c7-8109-3eb55179f86f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:24.043640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2644024-4eba-43c7-8109-3eb55179f86f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:24.044172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2644024-4eba-43c7-8109-3eb55179f86f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:24.045058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2644024-4eba-43c7-8109-3eb55179f86f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:24.048097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2644024-4eba-43c7-8109-3eb55179f86f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:24.340560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c2644024-4eba-43c7-8109-3eb55179f86f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:24.354594 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c2644024-4eba-43c7-8109-3eb55179f86f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 200 len: 1316 microversion: 2.1 time: 0.322517 Aug 02 06:49:24.358881 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 444/942] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:24 2022] GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:24.375820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7524c4f6-c9e6-4e0f-9b7d-176745807995 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1207171355"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:24.381130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7524c4f6-c9e6-4e0f-9b7d-176745807995 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:24.395761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7524c4f6-c9e6-4e0f-9b7d-176745807995 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:24.396495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7524c4f6-c9e6-4e0f-9b7d-176745807995 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:24.397767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7524c4f6-c9e6-4e0f-9b7d-176745807995 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:24.398387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7524c4f6-c9e6-4e0f-9b7d-176745807995 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:24.829193 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7524c4f6-c9e6-4e0f-9b7d-176745807995 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "POST /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c/action" status: 202 len: 0 microversion: 2.1 time: 0.468768 Aug 02 06:49:24.830903 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 445/943] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:49:24 2022] POST /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 02 06:49:24.845296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-afa9e524-162f-47e0-befa-eaf3a9e590fe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:24.846035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-afa9e524-162f-47e0-befa-eaf3a9e590fe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:24.853675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-afa9e524-162f-47e0-befa-eaf3a9e590fe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:24.854155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-afa9e524-162f-47e0-befa-eaf3a9e590fe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:24.855063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-afa9e524-162f-47e0-befa-eaf3a9e590fe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:24.855701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-afa9e524-162f-47e0-befa-eaf3a9e590fe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:25.603835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-afa9e524-162f-47e0-befa-eaf3a9e590fe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:25.612803 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-afa9e524-162f-47e0-befa-eaf3a9e590fe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1469 microversion: 2.1 time: 0.773787 Aug 02 06:49:25.618403 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 446/944] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:24 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1469 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:25.623505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2474c7af-9dba-4a88-b6ae-6ded9ac1995b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:25.630801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2474c7af-9dba-4a88-b6ae-6ded9ac1995b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:25.645974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2474c7af-9dba-4a88-b6ae-6ded9ac1995b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:25.646610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2474c7af-9dba-4a88-b6ae-6ded9ac1995b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:25.647437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2474c7af-9dba-4a88-b6ae-6ded9ac1995b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:25.648065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2474c7af-9dba-4a88-b6ae-6ded9ac1995b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:26.057949 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2618ff75-87a8-420f-8e71-2916459324d0 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4/action" status: 202 len: 0 microversion: 2.25 time: 4.999374 Aug 02 06:49:26.062415 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 499/945] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Aug 2 06:49:21 2022] POST /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4/action => generated 0 bytes in 5005 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:49:26.067412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5c8a1299-3987-492b-a6e4-3d4075c5b497 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '.version_select at 0x7f927b14b310>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:26.307597 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5c8a1299-3987-492b-a6e4-3d4075c5b497 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "DELETE /compute/v2.1/images/28ffb600-577c-4ba2-9854-9d1ef771f16c" status: 204 len: 0 microversion: 2.1 time: 0.243963 Aug 02 06:49:26.308403 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 500/946] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:26 2022] DELETE /compute/v2.1/images/28ffb600-577c-4ba2-9854-9d1ef771f16c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:49:26.312949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-345a5b22-3aed-4c34-920f-40b9abbde131 req-4da5f3ab-d2b2-4f54-ae47-47c32e7fee44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cfc9e6-596f-46db-a461-358881324e73", "name": "network-vif-plugged", "status": "completed", "tag": "a823a2eb-10f1-4619-aff3-00267fcfd035"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:26.324611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-345a5b22-3aed-4c34-920f-40b9abbde131 req-4da5f3ab-d2b2-4f54-ae47-47c32e7fee44 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:26.325055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-345a5b22-3aed-4c34-920f-40b9abbde131 req-4da5f3ab-d2b2-4f54-ae47-47c32e7fee44 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:26.336529 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-345a5b22-3aed-4c34-920f-40b9abbde131 req-4da5f3ab-d2b2-4f54-ae47-47c32e7fee44 service nova] Creating event network-vif-plugged:a823a2eb-10f1-4619-aff3-00267fcfd035 for instance f1cfc9e6-596f-46db-a461-358881324e73 on n-h2-851337-3 Aug 02 06:49:26.342501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-345a5b22-3aed-4c34-920f-40b9abbde131 req-4da5f3ab-d2b2-4f54-ae47-47c32e7fee44 service nova] Instance f1cfc9e6-596f-46db-a461-358881324e73 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 06:49:26.353472 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-345a5b22-3aed-4c34-920f-40b9abbde131 req-4da5f3ab-d2b2-4f54-ae47-47c32e7fee44 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043883 Aug 02 06:49:26.354551 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 501/947] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:26.359879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ce6efab8-8d3f-4707-9c21-9f56bbafff04 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:26.360786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ce6efab8-8d3f-4707-9c21-9f56bbafff04 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:26.371516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce6efab8-8d3f-4707-9c21-9f56bbafff04 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:26.372244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce6efab8-8d3f-4707-9c21-9f56bbafff04 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:26.373304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce6efab8-8d3f-4707-9c21-9f56bbafff04 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:26.373836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce6efab8-8d3f-4707-9c21-9f56bbafff04 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:26.580861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2474c7af-9dba-4a88-b6ae-6ded9ac1995b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:26.592865 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2474c7af-9dba-4a88-b6ae-6ded9ac1995b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1554 microversion: 2.1 time: 0.972897 Aug 02 06:49:26.593527 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 447/948] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:25 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1554 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:26.617452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4d0656c9-a23d-4aaa-841a-502aa400c050 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:26.618086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4d0656c9-a23d-4aaa-841a-502aa400c050 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:26.624892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d0656c9-a23d-4aaa-841a-502aa400c050 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:26.625691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d0656c9-a23d-4aaa-841a-502aa400c050 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:26.626641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d0656c9-a23d-4aaa-841a-502aa400c050 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:26.627221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d0656c9-a23d-4aaa-841a-502aa400c050 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:26.647157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:26.783851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=10 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:27.023988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ce6efab8-8d3f-4707-9c21-9f56bbafff04 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:27.032345 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ce6efab8-8d3f-4707-9c21-9f56bbafff04 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 200 len: 1316 microversion: 2.1 time: 0.676381 Aug 02 06:49:27.033462 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 502/949] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:26 2022] GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 1316 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:27.049779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5ff5ccd8-1a4a-457f-84e6-ef027e22cfc2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '.version_select at 0x7f927b1495e0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:27.075906 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-5ff5ccd8-1a4a-457f-84e6-ef027e22cfc2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] HTTP exception thrown: Image not found. Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5ff5ccd8-1a4a-457f-84e6-ef027e22cfc2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Request method failure captured: Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/images/28ffb600-577c-4ba2-9854-9d1ef771f16c HTTP/1.1 Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mics1p1wCl4AqIUegQm3d_pITBwYatFLhRipYelRyLmShzntTbvDif13hJU68Dr75PS5-_PVH2rlUrC3GCvZKy-mXcsTS2uVfBsDy9F9AEKbH8bLuQNqUkYQSS9whNQEqNGjlGMPbf7vASEghxC68ftUIES6H21F7o83_JNpyen0zM Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:49:27.078440 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:49:27.079989 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}] Aug 02 06:49:27.079989 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:27.079989 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:49:27.079989 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:27.079989 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:49:27.079989 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:27.079989 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:27.079989 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b519574e86e841c3a31851e1f4657dd8 Aug 02 06:49:27.079989 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:49:27.079989 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:49:27.079989 n-d-851337-3 devstack@n-api.service[126120]: exception: Image not found. Aug 02 06:49:27.079989 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '28ffb600-577c-4ba2-9854-9d1ef771f16c'} Aug 02 06:49:27.079989 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:49:27.081144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 28ffb600-577c-4ba2-9854-9d1ef771f16c Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:49:27.082400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 28ffb600-577c-4ba2-9854-9d1ef771f16c could not be found. Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:27.083589 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:49:27.084686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:27.087150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5ff5ccd8-1a4a-457f-84e6-ef027e22cfc2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Returning 404 to user: Image not found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:27.088169 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5ff5ccd8-1a4a-457f-84e6-ef027e22cfc2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/images/28ffb600-577c-4ba2-9854-9d1ef771f16c" status: 404 len: 62 microversion: 2.1 time: 0.045012 Aug 02 06:49:27.092143 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 503/950] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:49:27 2022] GET /compute/v2.1/images/28ffb600-577c-4ba2-9854-9d1ef771f16c => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:49:27.095517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-530eff99-8fcc-4a50-b4d7-90c53d7811a4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:27.096229 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-530eff99-8fcc-4a50-b4d7-90c53d7811a4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:27.103806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-530eff99-8fcc-4a50-b4d7-90c53d7811a4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:27.104901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-530eff99-8fcc-4a50-b4d7-90c53d7811a4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:27.105910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-530eff99-8fcc-4a50-b4d7-90c53d7811a4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:27.106454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-530eff99-8fcc-4a50-b4d7-90c53d7811a4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:27.218625 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4d0656c9-a23d-4aaa-841a-502aa400c050 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:27.229850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4d0656c9-a23d-4aaa-841a-502aa400c050 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:27.231425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4d0656c9-a23d-4aaa-841a-502aa400c050 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:27.232604 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4d0656c9-a23d-4aaa-841a-502aa400c050 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1567 microversion: 2.25 time: 0.619284 Aug 02 06:49:27.237930 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 448/951] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:26 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1567 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:27.244438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8984e1ac-6c7f-4e07-a4c8-eebcdd1fd774 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:27.245311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8984e1ac-6c7f-4e07-a4c8-eebcdd1fd774 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:27.251668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8984e1ac-6c7f-4e07-a4c8-eebcdd1fd774 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:27.252117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8984e1ac-6c7f-4e07-a4c8-eebcdd1fd774 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:27.252888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8984e1ac-6c7f-4e07-a4c8-eebcdd1fd774 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:27.253318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8984e1ac-6c7f-4e07-a4c8-eebcdd1fd774 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:27.524384 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-530eff99-8fcc-4a50-b4d7-90c53d7811a4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.432615 Aug 02 06:49:27.524781 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 504/952] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 06:49:27 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988/os-interface => generated 285 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:27.535968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-956282d0-24cb-4fd8-bd01-5b861d03bf12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:27.536603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-956282d0-24cb-4fd8-bd01-5b861d03bf12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:27.546917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-956282d0-24cb-4fd8-bd01-5b861d03bf12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:27.547933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-956282d0-24cb-4fd8-bd01-5b861d03bf12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:27.548912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-956282d0-24cb-4fd8-bd01-5b861d03bf12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:27.549509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-956282d0-24cb-4fd8-bd01-5b861d03bf12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:28.163936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8984e1ac-6c7f-4e07-a4c8-eebcdd1fd774 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:28.172954 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8984e1ac-6c7f-4e07-a4c8-eebcdd1fd774 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1469 microversion: 2.1 time: 0.932376 Aug 02 06:49:28.188227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=20 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:28.188698 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 449/953] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:27 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1469 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:28.196524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b7fd4a43-293d-4928-89c4-2f08f1ff7cfe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:28.200172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b7fd4a43-293d-4928-89c4-2f08f1ff7cfe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:28.214661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7fd4a43-293d-4928-89c4-2f08f1ff7cfe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:28.216342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7fd4a43-293d-4928-89c4-2f08f1ff7cfe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:28.217658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7fd4a43-293d-4928-89c4-2f08f1ff7cfe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:28.218290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7fd4a43-293d-4928-89c4-2f08f1ff7cfe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:28.511402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-956282d0-24cb-4fd8-bd01-5b861d03bf12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:28.537645 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-956282d0-24cb-4fd8-bd01-5b861d03bf12 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1540 microversion: 2.1 time: 1.004707 Aug 02 06:49:28.539307 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 505/954] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:27 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1540 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:28.553565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bdeba4b6-5902-419b-acf6-7aaa6d6cb420 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:28.554474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bdeba4b6-5902-419b-acf6-7aaa6d6cb420 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:28.569498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdeba4b6-5902-419b-acf6-7aaa6d6cb420 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:28.570402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdeba4b6-5902-419b-acf6-7aaa6d6cb420 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:28.571415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdeba4b6-5902-419b-acf6-7aaa6d6cb420 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:28.572062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdeba4b6-5902-419b-acf6-7aaa6d6cb420 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:28.835076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b7fd4a43-293d-4928-89c4-2f08f1ff7cfe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:28.843977 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b7fd4a43-293d-4928-89c4-2f08f1ff7cfe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 200 len: 1316 microversion: 2.1 time: 0.657022 Aug 02 06:49:28.853850 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 450/955] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:28 2022] GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 1316 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:28.997688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-637ddd85-4e10-45ca-96ee-a431f208e2bc req-b637400e-cf56-4450-9373-170c19d334fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69991b6b-468d-45c0-b658-297b210ae988", "tag": "b5f97f41-8484-419a-ac2c-d049deaf4ea4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:29.018890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-637ddd85-4e10-45ca-96ee-a431f208e2bc req-b637400e-cf56-4450-9373-170c19d334fa service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:29.019719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-637ddd85-4e10-45ca-96ee-a431f208e2bc req-b637400e-cf56-4450-9373-170c19d334fa service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:29.048780 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-637ddd85-4e10-45ca-96ee-a431f208e2bc req-b637400e-cf56-4450-9373-170c19d334fa service nova] Creating event network-changed:b5f97f41-8484-419a-ac2c-d049deaf4ea4 for instance 69991b6b-468d-45c0-b658-297b210ae988 on n-h2-851337-3 Aug 02 06:49:29.062841 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-637ddd85-4e10-45ca-96ee-a431f208e2bc req-b637400e-cf56-4450-9373-170c19d334fa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069749 Aug 02 06:49:29.068506 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 451/956] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:49:29.085025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-2fc04566-8cf3-4067-b8cb-4930ee8f2967 req-ed064755-beed-45bc-9268-74a64e16a258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a822ec0-2e44-4a7e-a000-087f2814a941", "name": "network-vif-plugged", "status": "completed", "tag": "e351a644-769d-4826-a9df-f6f401f53d95"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:29.099864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2fc04566-8cf3-4067-b8cb-4930ee8f2967 req-ed064755-beed-45bc-9268-74a64e16a258 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:29.100681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2fc04566-8cf3-4067-b8cb-4930ee8f2967 req-ed064755-beed-45bc-9268-74a64e16a258 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:29.116110 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-2fc04566-8cf3-4067-b8cb-4930ee8f2967 req-ed064755-beed-45bc-9268-74a64e16a258 service nova] Creating event network-vif-plugged:e351a644-769d-4826-a9df-f6f401f53d95 for instance 4a822ec0-2e44-4a7e-a000-087f2814a941 on n-h1-851337-3 Aug 02 06:49:29.124729 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-2fc04566-8cf3-4067-b8cb-4930ee8f2967 req-ed064755-beed-45bc-9268-74a64e16a258 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044320 Aug 02 06:49:29.126062 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 452/957] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:29.196693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2c414afe-d8f5-4654-896f-04954e191195 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:29.199083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2c414afe-d8f5-4654-896f-04954e191195 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:29.213089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c414afe-d8f5-4654-896f-04954e191195 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:29.215255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c414afe-d8f5-4654-896f-04954e191195 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:29.217881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c414afe-d8f5-4654-896f-04954e191195 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:29.218377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c414afe-d8f5-4654-896f-04954e191195 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:29.619125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bdeba4b6-5902-419b-acf6-7aaa6d6cb420 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:29.633383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bdeba4b6-5902-419b-acf6-7aaa6d6cb420 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:29.638291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bdeba4b6-5902-419b-acf6-7aaa6d6cb420 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:29.640256 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bdeba4b6-5902-419b-acf6-7aaa6d6cb420 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1567 microversion: 2.25 time: 1.098755 Aug 02 06:49:29.643516 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 506/958] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:28 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1567 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:29.668239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b7e95606-4fa6-46cb-90c3-4b6661a160ef tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:29.670367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b7e95606-4fa6-46cb-90c3-4b6661a160ef tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:29.676233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:29.691647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7e95606-4fa6-46cb-90c3-4b6661a160ef tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:29.692753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7e95606-4fa6-46cb-90c3-4b6661a160ef tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:29.699944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7e95606-4fa6-46cb-90c3-4b6661a160ef tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:29.701229 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7e95606-4fa6-46cb-90c3-4b6661a160ef tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:29.978661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2c414afe-d8f5-4654-896f-04954e191195 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:29.986423 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2c414afe-d8f5-4654-896f-04954e191195 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1469 microversion: 2.1 time: 0.794862 Aug 02 06:49:29.995271 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 453/959] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:29 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1469 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:30.002349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-99b8b9ab-cbf2-49dd-877f-9dc29e2529aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:30.010060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-99b8b9ab-cbf2-49dd-877f-9dc29e2529aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:30.022910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99b8b9ab-cbf2-49dd-877f-9dc29e2529aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:30.023546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99b8b9ab-cbf2-49dd-877f-9dc29e2529aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:30.024612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99b8b9ab-cbf2-49dd-877f-9dc29e2529aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:30.025331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99b8b9ab-cbf2-49dd-877f-9dc29e2529aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:30.363872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b7e95606-4fa6-46cb-90c3-4b6661a160ef tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:30.379598 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b7e95606-4fa6-46cb-90c3-4b6661a160ef tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1522 microversion: 2.1 time: 0.733653 Aug 02 06:49:30.398761 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 507/960] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:29 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1522 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:30.404123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a91e0341-e515-4983-983e-c439a784ee2c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:30.405018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a91e0341-e515-4983-983e-c439a784ee2c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:30.413083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a91e0341-e515-4983-983e-c439a784ee2c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:30.413766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a91e0341-e515-4983-983e-c439a784ee2c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:30.415261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a91e0341-e515-4983-983e-c439a784ee2c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:30.415857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a91e0341-e515-4983-983e-c439a784ee2c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:30.449738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a91e0341-e515-4983-983e-c439a784ee2c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:49:30.480403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:30.581390 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a91e0341-e515-4983-983e-c439a784ee2c tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "DELETE /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 204 len: 0 microversion: 2.1 time: 0.180940 Aug 02 06:49:30.582434 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 508/961] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:49:30 2022] DELETE /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:49:30.591975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-26cf535c-2958-4052-bf5f-935407b5fb8b tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:30.593312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-26cf535c-2958-4052-bf5f-935407b5fb8b tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:30.599908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26cf535c-2958-4052-bf5f-935407b5fb8b tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:30.600622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26cf535c-2958-4052-bf5f-935407b5fb8b tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:30.602652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26cf535c-2958-4052-bf5f-935407b5fb8b tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:30.604181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26cf535c-2958-4052-bf5f-935407b5fb8b tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:30.848479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-99b8b9ab-cbf2-49dd-877f-9dc29e2529aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:30.877207 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-99b8b9ab-cbf2-49dd-877f-9dc29e2529aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 200 len: 1316 microversion: 2.1 time: 0.880648 Aug 02 06:49:30.892281 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 454/962] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:29 2022] GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 1316 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:30.896817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d8df903e-ccd7-4570-8fa8-10de4b862391 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:30.899096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d8df903e-ccd7-4570-8fa8-10de4b862391 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:30.912534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8df903e-ccd7-4570-8fa8-10de4b862391 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:30.913505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8df903e-ccd7-4570-8fa8-10de4b862391 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:30.914803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8df903e-ccd7-4570-8fa8-10de4b862391 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:30.915447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8df903e-ccd7-4570-8fa8-10de4b862391 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:31.130684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-26cf535c-2958-4052-bf5f-935407b5fb8b tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:31.140368 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-26cf535c-2958-4052-bf5f-935407b5fb8b tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1528 microversion: 2.1 time: 0.552917 Aug 02 06:49:31.141612 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 509/963] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:30 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1528 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:49:31.146982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-009e6208-2e17-4a21-a96d-e64d674870d8 req-3bf2ee59-edc0-4ef9-aae7-a2f75b49914a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9613bb-0914-4f6f-b55c-8c3d990cc2e4", "name": "network-vif-unplugged", "status": "completed", "tag": "3156e550-5a09-4594-b16e-ac202d43d82a"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:31.158043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-009e6208-2e17-4a21-a96d-e64d674870d8 req-3bf2ee59-edc0-4ef9-aae7-a2f75b49914a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:31.159358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-009e6208-2e17-4a21-a96d-e64d674870d8 req-3bf2ee59-edc0-4ef9-aae7-a2f75b49914a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:31.179872 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-009e6208-2e17-4a21-a96d-e64d674870d8 req-3bf2ee59-edc0-4ef9-aae7-a2f75b49914a service nova] Creating event network-vif-unplugged:3156e550-5a09-4594-b16e-ac202d43d82a for instance 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 on n-h1-851337-3 Aug 02 06:49:31.186881 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-009e6208-2e17-4a21-a96d-e64d674870d8 req-3bf2ee59-edc0-4ef9-aae7-a2f75b49914a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043228 Aug 02 06:49:31.188809 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 510/964] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:31.196725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bcf0180e-be2a-4b09-8097-202d83974772 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:31.198441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bcf0180e-be2a-4b09-8097-202d83974772 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:31.207927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcf0180e-be2a-4b09-8097-202d83974772 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:31.208796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcf0180e-be2a-4b09-8097-202d83974772 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:31.210062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcf0180e-be2a-4b09-8097-202d83974772 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:31.210664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcf0180e-be2a-4b09-8097-202d83974772 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:31.287741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d8df903e-ccd7-4570-8fa8-10de4b862391 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:31.299818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d8df903e-ccd7-4570-8fa8-10de4b862391 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:31.301353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d8df903e-ccd7-4570-8fa8-10de4b862391 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:31.302639 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d8df903e-ccd7-4570-8fa8-10de4b862391 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1567 microversion: 2.25 time: 0.416811 Aug 02 06:49:31.303219 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 455/965] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:30 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1567 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:31.662832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bcf0180e-be2a-4b09-8097-202d83974772 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:31.674065 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bcf0180e-be2a-4b09-8097-202d83974772 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1461 microversion: 2.1 time: 0.483757 Aug 02 06:49:31.674858 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 511/966] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:31 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1461 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:31.699558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d344a353-a4cc-4097-b5a9-178052f5f563 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:31.700386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d344a353-a4cc-4097-b5a9-178052f5f563 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:31.706813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d344a353-a4cc-4097-b5a9-178052f5f563 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:31.707252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d344a353-a4cc-4097-b5a9-178052f5f563 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:31.708112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d344a353-a4cc-4097-b5a9-178052f5f563 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:31.708541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d344a353-a4cc-4097-b5a9-178052f5f563 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:31.903954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b955b143-8995-43e9-9ace-ef368c0fb6b9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:31.904755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b955b143-8995-43e9-9ace-ef368c0fb6b9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:31.913714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b955b143-8995-43e9-9ace-ef368c0fb6b9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:31.914650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b955b143-8995-43e9-9ace-ef368c0fb6b9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:31.916191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b955b143-8995-43e9-9ace-ef368c0fb6b9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:31.916896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b955b143-8995-43e9-9ace-ef368c0fb6b9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:31.943825 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d344a353-a4cc-4097-b5a9-178052f5f563 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1612 microversion: 2.1 time: 0.248132 Aug 02 06:49:31.945756 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 456/967] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:31 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1612 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:31.969767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4785a39d-a968-430a-81ae-91ca6047bcbf tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Calling method '.version_select at 0x7f927bac10d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:31.979358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4785a39d-a968-430a-81ae-91ca6047bcbf tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:31.980055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4785a39d-a968-430a-81ae-91ca6047bcbf tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:31.995184 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4785a39d-a968-430a-81ae-91ca6047bcbf tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.029890 Aug 02 06:49:31.996536 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 457/968] 10.222.0.79 () {58 vars in 1143 bytes} [Tue Aug 2 06:49:31 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:49:32.181820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b955b143-8995-43e9-9ace-ef368c0fb6b9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:32.190411 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b955b143-8995-43e9-9ace-ef368c0fb6b9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 200 len: 1466 microversion: 2.1 time: 0.294424 Aug 02 06:49:32.193881 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 512/969] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:31 2022] GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 1466 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:49:32.204136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-247228366", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:32.286776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:49:32.299253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-25e17324-acb2-4a27-a079-2e4bee3249c4 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] Action: 'create', calling method: .version_select at 0x7f927b0c05e0>, body: {"pool": null} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:33.502045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:49:33.502541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:49:33.503102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:49:33.503567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:49:33.504155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:49:33.531190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:33.531657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:33.532479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:33.532914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:33.558012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Getting quotas for project 1e08c65240da4f90a190b2da77a8ff92. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:49:33.565626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Getting quotas for user 87d1c9cb22d34aaa8b86860b84a1086d and project 1e08c65240da4f90a190b2da77a8ff92. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:49:33.581317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:49:33.583979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:49:33.675991 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8770ba20-2ebc-4993-9cf1-c126b580bf25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.480967 Aug 02 06:49:33.686366 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 513/970] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:49:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:49:33.691502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dab82b38-4907-4685-8ccb-08d198d209ad tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:33.692365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dab82b38-4907-4685-8ccb-08d198d209ad tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:33.727776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dab82b38-4907-4685-8ccb-08d198d209ad tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:33.728218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dab82b38-4907-4685-8ccb-08d198d209ad tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:33.728999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dab82b38-4907-4685-8ccb-08d198d209ad tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:33.729553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dab82b38-4907-4685-8ccb-08d198d209ad tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:34.159249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dab82b38-4907-4685-8ccb-08d198d209ad tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:34.171195 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dab82b38-4907-4685-8ccb-08d198d209ad tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 200 len: 1528 microversion: 2.1 time: 0.483523 Aug 02 06:49:34.179374 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 514/971] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:33 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 1528 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:34.192549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c6606d4c-8d15-4924-902f-38882c158864 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:34.194538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c6606d4c-8d15-4924-902f-38882c158864 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:34.227368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6606d4c-8d15-4924-902f-38882c158864 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:34.230367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6606d4c-8d15-4924-902f-38882c158864 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:34.231311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6606d4c-8d15-4924-902f-38882c158864 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:34.233437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6606d4c-8d15-4924-902f-38882c158864 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:34.566766 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c6606d4c-8d15-4924-902f-38882c158864 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 200 len: 1617 microversion: 2.1 time: 0.391750 Aug 02 06:49:34.583077 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 515/972] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:34 2022] GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 1617 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:34.603086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b5baa213-9b8e-49d9-8386-49b6eab4fa6c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:34.603707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b5baa213-9b8e-49d9-8386-49b6eab4fa6c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:34.619341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5baa213-9b8e-49d9-8386-49b6eab4fa6c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:34.622685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5baa213-9b8e-49d9-8386-49b6eab4fa6c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:34.623954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5baa213-9b8e-49d9-8386-49b6eab4fa6c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:34.631364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5baa213-9b8e-49d9-8386-49b6eab4fa6c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:34.980489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b5baa213-9b8e-49d9-8386-49b6eab4fa6c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:34.994219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b5baa213-9b8e-49d9-8386-49b6eab4fa6c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:34.996620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b5baa213-9b8e-49d9-8386-49b6eab4fa6c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:34.997946 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b5baa213-9b8e-49d9-8386-49b6eab4fa6c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1567 microversion: 2.25 time: 0.412396 Aug 02 06:49:35.002169 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 516/973] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:34 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1567 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:35.013149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-64df8d5e-feb0-4a30-983c-37c9bdb75198 req-5f1378a2-d680-4627-878b-8456bc8e05d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c9613bb-0914-4f6f-b55c-8c3d990cc2e4", "tag": "3156e550-5a09-4594-b16e-ac202d43d82a"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:35.033296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-64df8d5e-feb0-4a30-983c-37c9bdb75198 req-5f1378a2-d680-4627-878b-8456bc8e05d8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:35.034057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-64df8d5e-feb0-4a30-983c-37c9bdb75198 req-5f1378a2-d680-4627-878b-8456bc8e05d8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:35.059139 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-64df8d5e-feb0-4a30-983c-37c9bdb75198 req-5f1378a2-d680-4627-878b-8456bc8e05d8 service nova] Creating event network-changed:3156e550-5a09-4594-b16e-ac202d43d82a for instance 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 on n-h1-851337-3 Aug 02 06:49:35.080092 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-64df8d5e-feb0-4a30-983c-37c9bdb75198 req-5f1378a2-d680-4627-878b-8456bc8e05d8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076569 Aug 02 06:49:35.081660 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 517/974] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:35.089747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1266b2ad-f4e0-4d9f-9541-44b00dec59fc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:35.090909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1266b2ad-f4e0-4d9f-9541-44b00dec59fc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:35.099514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1266b2ad-f4e0-4d9f-9541-44b00dec59fc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:35.101143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1266b2ad-f4e0-4d9f-9541-44b00dec59fc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:35.102135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1266b2ad-f4e0-4d9f-9541-44b00dec59fc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:35.102842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1266b2ad-f4e0-4d9f-9541-44b00dec59fc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:35.191236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1266b2ad-f4e0-4d9f-9541-44b00dec59fc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:35.199446 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1266b2ad-f4e0-4d9f-9541-44b00dec59fc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1264 microversion: 2.1 time: 0.114983 Aug 02 06:49:35.200036 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 518/975] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:35 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1264 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:35.217662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2146442666", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["75ae3b2d-b9db-4285-a9d1-665045b4d168"]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:35.276249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:49:35.886577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:49:35.887864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:49:35.888607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:49:35.889447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:49:35.890388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:49:35.901688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:35.902416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:35.903578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:35.904320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:35.913514 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-25e17324-acb2-4a27-a079-2e4bee3249c4 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.822127 Aug 02 06:49:35.914147 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 458/976] 10.222.0.79 () {60 vars in 1170 bytes} [Tue Aug 2 06:49:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:35.919475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-106a7f51-ebdb-45e8-841a-ef88dde67536 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:35.920267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-106a7f51-ebdb-45e8-841a-ef88dde67536 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:35.938558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:49:35.938974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-106a7f51-ebdb-45e8-841a-ef88dde67536 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:35.939416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-106a7f51-ebdb-45e8-841a-ef88dde67536 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:35.940181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-106a7f51-ebdb-45e8-841a-ef88dde67536 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:35.940606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-106a7f51-ebdb-45e8-841a-ef88dde67536 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:35.946146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:49:35.964509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:49:35.967022 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-106a7f51-ebdb-45e8-841a-ef88dde67536 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] HTTP exception thrown: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:35.967774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-106a7f51-ebdb-45e8-841a-ef88dde67536 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Request method failure captured: Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c HTTP/1.1 Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mics1p1wCl4AqIUegQm3d_pITBwYatFLhRipYelRyLmShzntTbvDif13hJU68Dr75PS5-_PVH2rlUrC3GCvZKy-mXcsTS2uVfBsDy9F9AEKbH8bLuQNqUkYQSS9whNQEqNGjlGMPbf7vASEghxC68ftUIES6H21F7o83_JNpyen0zM Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:49:35.968736 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:49:35.970332 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}] Aug 02 06:49:35.970332 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:35.970332 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:49:35.970332 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:35.970332 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:49:35.970332 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:49:35.970332 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:49:35.970332 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b519574e86e841c3a31851e1f4657dd8 Aug 02 06:49:35.970332 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:49:35.970332 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:49:35.970332 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:35.970332 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '52787eee-3cd0-49f7-a881-16d055348a8c'} Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:35.971214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:35.973325 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:35.974658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-106a7f51-ebdb-45e8-841a-ef88dde67536 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Returning 404 to user: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:35.974658 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-106a7f51-ebdb-45e8-841a-ef88dde67536 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 404 len: 111 microversion: 2.1 time: 0.054613 Aug 02 06:49:35.986420 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 459/977] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:35 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:35.999267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-82219354-0b11-491e-bf58-6f9d05843aff tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] Calling method '.version_select at 0x7f927b1b2ca0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:36.051973 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aada9984-b73f-4fe1-908e-41d905bcb05a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840361 Aug 02 06:49:36.054549 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 519/978] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:49:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:49:36.068052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bf696439-a158-41cb-b0fc-08e4842fe09a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:36.068961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bf696439-a158-41cb-b0fc-08e4842fe09a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:36.076030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf696439-a158-41cb-b0fc-08e4842fe09a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:36.077060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf696439-a158-41cb-b0fc-08e4842fe09a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:36.078137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf696439-a158-41cb-b0fc-08e4842fe09a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:36.079023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf696439-a158-41cb-b0fc-08e4842fe09a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:36.869953 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-82219354-0b11-491e-bf58-6f9d05843aff tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/7a1f025d-8af2-4b38-ae54-8fb0d327a9b1" status: 200 len: 141 microversion: 2.1 time: 0.880461 Aug 02 06:49:36.874653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bf696439-a158-41cb-b0fc-08e4842fe09a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:36.879717 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 460/979] 10.222.0.79 () {58 vars in 1260 bytes} [Tue Aug 2 06:49:35 2022] GET /compute/v2.1/os-floating-ips/7a1f025d-8af2-4b38-ae54-8fb0d327a9b1 => generated 141 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:36.884754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bf696439-a158-41cb-b0fc-08e4842fe09a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:36.888024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bf696439-a158-41cb-b0fc-08e4842fe09a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:36.890809 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bf696439-a158-41cb-b0fc-08e4842fe09a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1567 microversion: 2.25 time: 0.834898 Aug 02 06:49:36.893390 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 520/980] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:36 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1567 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:36.894565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-587e800b-a503-491c-8e3a-6ed66d760419 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:36.895489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-587e800b-a503-491c-8e3a-6ed66d760419 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:36.906826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-587e800b-a503-491c-8e3a-6ed66d760419 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:36.907506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-587e800b-a503-491c-8e3a-6ed66d760419 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:36.915574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-587e800b-a503-491c-8e3a-6ed66d760419 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:36.916293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-587e800b-a503-491c-8e3a-6ed66d760419 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:36.937371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-289693698", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:37.058311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] validate_networks() for [('c92a3ed1-d696-472e-a733-75a14b7c8a60', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:49:37.092101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-587e800b-a503-491c-8e3a-6ed66d760419 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:37.101174 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-587e800b-a503-491c-8e3a-6ed66d760419 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1213 microversion: 2.1 time: 0.218117 Aug 02 06:49:37.101748 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 461/981] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:36 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1213 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:37.106675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7156905a-5645-400c-b292-5baedc8eedc4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:37.107276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7156905a-5645-400c-b292-5baedc8eedc4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:37.113786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7156905a-5645-400c-b292-5baedc8eedc4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:37.114440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7156905a-5645-400c-b292-5baedc8eedc4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:37.115611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7156905a-5645-400c-b292-5baedc8eedc4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:37.116690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7156905a-5645-400c-b292-5baedc8eedc4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:37.641298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7156905a-5645-400c-b292-5baedc8eedc4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:37.669931 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7156905a-5645-400c-b292-5baedc8eedc4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1312 microversion: 2.1 time: 0.556734 Aug 02 06:49:37.670959 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 462/982] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:37 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1312 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:37.697193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d11e0278-a9d5-4ac8-ad2f-130e98e6fd12 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] Calling method '.version_select at 0x7f927b10d670>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:38.323666 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d11e0278-a9d5-4ac8-ad2f-130e98e6fd12 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.633421 Aug 02 06:49:38.324414 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 463/983] 10.222.0.79 () {58 vars in 1149 bytes} [Tue Aug 2 06:49:37 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:38.329298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-38906ab6-7507-4d1e-a749-6da5880a9cbe req-d8263573-34c8-4ca5-b9ba-2e87cdef2a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52787eee-3cd0-49f7-a881-16d055348a8c", "name": "network-vif-deleted", "tag": "823028dd-19e9-472a-a5b5-80182eab9a74"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:38.340391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-38906ab6-7507-4d1e-a749-6da5880a9cbe req-d8263573-34c8-4ca5-b9ba-2e87cdef2a3e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:38.340937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-38906ab6-7507-4d1e-a749-6da5880a9cbe req-d8263573-34c8-4ca5-b9ba-2e87cdef2a3e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:38.351946 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-38906ab6-7507-4d1e-a749-6da5880a9cbe req-d8263573-34c8-4ca5-b9ba-2e87cdef2a3e service nova] Creating event network-vif-deleted:823028dd-19e9-472a-a5b5-80182eab9a74 for instance 52787eee-3cd0-49f7-a881-16d055348a8c on n-h2-851337-3 Aug 02 06:49:38.357176 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-38906ab6-7507-4d1e-a749-6da5880a9cbe req-d8263573-34c8-4ca5-b9ba-2e87cdef2a3e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031261 Aug 02 06:49:38.357876 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 464/984] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:38.363527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9d3bc9f4-71bc-4832-af9a-bf45320abbfc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:38.364366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9d3bc9f4-71bc-4832-af9a-bf45320abbfc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:38.371195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d3bc9f4-71bc-4832-af9a-bf45320abbfc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:38.371870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d3bc9f4-71bc-4832-af9a-bf45320abbfc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:38.372806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d3bc9f4-71bc-4832-af9a-bf45320abbfc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:38.373230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d3bc9f4-71bc-4832-af9a-bf45320abbfc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:38.622425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:49:38.625838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:49:38.626660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:49:38.627356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:49:38.628958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:49:38.644773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:38.645702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:38.646722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:38.647869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:38.711791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Getting quotas for project a972437b40d745b2a16e01593bfaa1e5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:49:38.729875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Getting quotas for user b519574e86e841c3a31851e1f4657dd8 and project a972437b40d745b2a16e01593bfaa1e5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:49:38.744305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9d3bc9f4-71bc-4832-af9a-bf45320abbfc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:38.756198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:49:38.765233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9d3bc9f4-71bc-4832-af9a-bf45320abbfc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:38.766300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:49:38.767284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9d3bc9f4-71bc-4832-af9a-bf45320abbfc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:38.768745 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9d3bc9f4-71bc-4832-af9a-bf45320abbfc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1567 microversion: 2.25 time: 0.409447 Aug 02 06:49:38.771532 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 465/985] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:38 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1567 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:38.796451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-1041d74d-7d51-43f1-9389-af04f0e9767f req-5179bc83-a51a-4fb9-afcb-1795f2e38d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c976a871-9aa2-4330-9e0c-363aadd04223", "tag": "9b2e2b0e-a0fa-4b06-96ce-29c660765c8f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:38.851362 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-636e96bc-a7a2-4583-8dd7-b415a8dc76f9 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.940538 Aug 02 06:49:38.851739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1041d74d-7d51-43f1-9389-af04f0e9767f req-5179bc83-a51a-4fb9-afcb-1795f2e38d38 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:38.852257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1041d74d-7d51-43f1-9389-af04f0e9767f req-5179bc83-a51a-4fb9-afcb-1795f2e38d38 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:38.852905 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 521/986] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:49:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:49:38.858352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9dcde046-4bb4-4ef9-b18f-2eeb12c9ff84 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:38.859195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9dcde046-4bb4-4ef9-b18f-2eeb12c9ff84 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:38.876104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9dcde046-4bb4-4ef9-b18f-2eeb12c9ff84 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:38.876690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9dcde046-4bb4-4ef9-b18f-2eeb12c9ff84 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:38.877701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9dcde046-4bb4-4ef9-b18f-2eeb12c9ff84 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:38.878581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9dcde046-4bb4-4ef9-b18f-2eeb12c9ff84 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:38.889786 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-1041d74d-7d51-43f1-9389-af04f0e9767f req-5179bc83-a51a-4fb9-afcb-1795f2e38d38 service nova] Creating event network-changed:9b2e2b0e-a0fa-4b06-96ce-29c660765c8f for instance c976a871-9aa2-4330-9e0c-363aadd04223 on n-h1-851337-3 Aug 02 06:49:38.915797 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-1041d74d-7d51-43f1-9389-af04f0e9767f req-5179bc83-a51a-4fb9-afcb-1795f2e38d38 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141427 Aug 02 06:49:38.922506 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 466/987] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:39.147666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ba2b29cb-5aba-42d6-8edf-5d33ea4e092e tempest-FlavorsV255TestJSON-1482038124 tempest-FlavorsV255TestJSON-1482038124-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-54044746", "id": 768072046, "os-flavor-access:is_public": "True"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:39.151211 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:39.151211 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:49:39.184476 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ba2b29cb-5aba-42d6-8edf-5d33ea4e092e tempest-FlavorsV255TestJSON-1482038124 tempest-FlavorsV255TestJSON-1482038124-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 444 microversion: 2.55 time: 0.260268 Aug 02 06:49:39.194091 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 467/988] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 06:49:38 2022] POST /compute/v2.1/flavors => generated 444 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:49:39.216105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7a63c5db-432a-44a4-9e0e-c09b42ad49d3 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] Calling method '.version_select at 0x7f927b11ff70>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:39.484012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9dcde046-4bb4-4ef9-b18f-2eeb12c9ff84 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:39.495326 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9dcde046-4bb4-4ef9-b18f-2eeb12c9ff84 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1317 microversion: 2.1 time: 0.640895 Aug 02 06:49:39.501118 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 522/989] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:38 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1317 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:39.506362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0eef9fc5-9964-44ce-b002-681d0e567884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:39.510760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0eef9fc5-9964-44ce-b002-681d0e567884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:39.524005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0eef9fc5-9964-44ce-b002-681d0e567884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:39.529364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0eef9fc5-9964-44ce-b002-681d0e567884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:39.531229 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0eef9fc5-9964-44ce-b002-681d0e567884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:39.531698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0eef9fc5-9964-44ce-b002-681d0e567884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:40.083385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0eef9fc5-9964-44ce-b002-681d0e567884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:40.092586 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0eef9fc5-9964-44ce-b002-681d0e567884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1312 microversion: 2.1 time: 0.589818 Aug 02 06:49:40.093254 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 523/990] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:39 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1312 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:40.098185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f038db19-89f1-454b-a5c3-d7056d5e50b5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:40.098837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f038db19-89f1-454b-a5c3-d7056d5e50b5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:40.106101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f038db19-89f1-454b-a5c3-d7056d5e50b5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:40.106553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f038db19-89f1-454b-a5c3-d7056d5e50b5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:40.107338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f038db19-89f1-454b-a5c3-d7056d5e50b5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:40.107777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f038db19-89f1-454b-a5c3-d7056d5e50b5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:40.232778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f038db19-89f1-454b-a5c3-d7056d5e50b5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:40.241341 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f038db19-89f1-454b-a5c3-d7056d5e50b5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 200 len: 1276 microversion: 2.1 time: 0.147031 Aug 02 06:49:40.241907 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 524/991] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:40 2022] GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:40.361787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5a81224b-ec22-4558-a1e2-620c6f1fdd89 tempest-FlavorsV255TestJSON-1997851518 tempest-FlavorsV255TestJSON-1997851518-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:40.370214 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5a81224b-ec22-4558-a1e2-620c6f1fdd89 tempest-FlavorsV255TestJSON-1997851518 tempest-FlavorsV255TestJSON-1997851518-project] 10.222.0.79 "GET /compute/v2.1/flavors/768072046" status: 200 len: 444 microversion: 2.55 time: 0.127059 Aug 02 06:49:40.371076 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 525/992] 10.222.0.79 () {60 vars in 1196 bytes} [Tue Aug 2 06:49:40 2022] GET /compute/v2.1/flavors/768072046 => generated 444 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:49:40.384513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2baa46dc-96db-425e-8898-46261a3c0d93 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:40.385222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2baa46dc-96db-425e-8898-46261a3c0d93 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:40.392874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2baa46dc-96db-425e-8898-46261a3c0d93 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:40.393327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2baa46dc-96db-425e-8898-46261a3c0d93 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:40.394183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2baa46dc-96db-425e-8898-46261a3c0d93 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:40.394620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2baa46dc-96db-425e-8898-46261a3c0d93 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:40.860439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2baa46dc-96db-425e-8898-46261a3c0d93 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:40.869187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2baa46dc-96db-425e-8898-46261a3c0d93 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:40.870895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2baa46dc-96db-425e-8898-46261a3c0d93 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:40.872065 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2baa46dc-96db-425e-8898-46261a3c0d93 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1567 microversion: 2.25 time: 0.492163 Aug 02 06:49:40.872628 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 526/993] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:40 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1567 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:40.877008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3bf91267-ca9a-46eb-83b5-eae55c104062 tempest-FlavorsV255TestJSON-1482038124 tempest-FlavorsV255TestJSON-1482038124-project-admin] Action: 'update', calling method: .version_select at 0x7f9289f67550>, body: {"flavor": {"description": "new"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:40.888837 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:40.888837 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:40.914728 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3bf91267-ca9a-46eb-83b5-eae55c104062 tempest-FlavorsV255TestJSON-1482038124 tempest-FlavorsV255TestJSON-1482038124-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/768072046" status: 200 len: 445 microversion: 2.55 time: 0.041058 Aug 02 06:49:40.915342 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 527/994] 10.222.0.79 () {62 vars in 1216 bytes} [Tue Aug 2 06:49:40 2022] PUT /compute/v2.1/flavors/768072046 => generated 445 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:49:40.920311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b76024f4-4984-4b2c-b1e1-0f396d14b9da tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:40.920916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b76024f4-4984-4b2c-b1e1-0f396d14b9da tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:40.929195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b76024f4-4984-4b2c-b1e1-0f396d14b9da tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:40.929660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b76024f4-4984-4b2c-b1e1-0f396d14b9da tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:40.930462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b76024f4-4984-4b2c-b1e1-0f396d14b9da tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:40.930934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b76024f4-4984-4b2c-b1e1-0f396d14b9da tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:41.261436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b76024f4-4984-4b2c-b1e1-0f396d14b9da tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:41.269797 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b76024f4-4984-4b2c-b1e1-0f396d14b9da tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1317 microversion: 2.1 time: 0.353417 Aug 02 06:49:41.270613 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 528/995] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:40 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:41.282806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2c33bc13-c099-4849-ae3b-0d37fed3be9f tempest-FlavorsV255TestJSON-1997851518 tempest-FlavorsV255TestJSON-1997851518-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:41.305933 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2c33bc13-c099-4849-ae3b-0d37fed3be9f tempest-FlavorsV255TestJSON-1997851518 tempest-FlavorsV255TestJSON-1997851518-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5720 microversion: 2.55 time: 0.026745 Aug 02 06:49:41.306520 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 529/996] 10.222.0.79 () {60 vars in 1187 bytes} [Tue Aug 2 06:49:41 2022] GET /compute/v2.1/flavors/detail => generated 5720 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:41.313037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-983ea919-5fa8-48c2-87bb-23ff4d17d824 req-6c090431-ef55-4367-ad09-de3b713b7858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1477c63-2792-4918-ae17-613e7850c874", "tag": "1cadd2c0-6321-4b11-ae6d-e1a6d8551eeb"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:41.322539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:41.324826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-983ea919-5fa8-48c2-87bb-23ff4d17d824 req-6c090431-ef55-4367-ad09-de3b713b7858 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:41.325478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-983ea919-5fa8-48c2-87bb-23ff4d17d824 req-6c090431-ef55-4367-ad09-de3b713b7858 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:41.338060 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-983ea919-5fa8-48c2-87bb-23ff4d17d824 req-6c090431-ef55-4367-ad09-de3b713b7858 service nova] Creating event network-changed:1cadd2c0-6321-4b11-ae6d-e1a6d8551eeb for instance c1477c63-2792-4918-ae17-613e7850c874 on n-h1-851337-3 Aug 02 06:49:41.343241 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-983ea919-5fa8-48c2-87bb-23ff4d17d824 req-6c090431-ef55-4367-ad09-de3b713b7858 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033669 Aug 02 06:49:41.344163 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 530/997] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:41.350199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2bf61266-5b07-425d-9557-6a4065fa44cd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:41.350993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2bf61266-5b07-425d-9557-6a4065fa44cd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:41.358001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bf61266-5b07-425d-9557-6a4065fa44cd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:41.358448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bf61266-5b07-425d-9557-6a4065fa44cd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:41.359236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bf61266-5b07-425d-9557-6a4065fa44cd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:41.359667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bf61266-5b07-425d-9557-6a4065fa44cd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:41.375581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:41.380469 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7a63c5db-432a-44a4-9e0e-c09b42ad49d3 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/7a1f025d-8af2-4b38-ae54-8fb0d327a9b1" status: 202 len: 0 microversion: 2.1 time: 2.193340 Aug 02 06:49:41.383542 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 468/998] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 06:49:39 2022] DELETE /compute/v2.1/os-floating-ips/7a1f025d-8af2-4b38-ae54-8fb0d327a9b1 => generated 0 bytes in 2197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:49:41.390504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-078bd347-798a-4d66-9add-4169b7d46640 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:41.391566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-078bd347-798a-4d66-9add-4169b7d46640 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:41.395518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:41.401096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-078bd347-798a-4d66-9add-4169b7d46640 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:41.402093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-078bd347-798a-4d66-9add-4169b7d46640 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:41.403055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-078bd347-798a-4d66-9add-4169b7d46640 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:41.403995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-078bd347-798a-4d66-9add-4169b7d46640 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:41.528874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-078bd347-798a-4d66-9add-4169b7d46640 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:41.538646 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-078bd347-798a-4d66-9add-4169b7d46640 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 200 len: 1282 microversion: 2.1 time: 0.153655 Aug 02 06:49:41.539582 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 469/999] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:41 2022] GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 1282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:41.555629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8482e338-2416-4830-b15b-9bcfb44a9511 tempest-FlavorsV255TestJSON-1997851518 tempest-FlavorsV255TestJSON-1997851518-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:41.576342 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8482e338-2416-4830-b15b-9bcfb44a9511 tempest-FlavorsV255TestJSON-1997851518 tempest-FlavorsV255TestJSON-1997851518-project] 10.222.0.79 "GET /compute/v2.1/flavors" status: 200 len: 3152 microversion: 2.55 time: 0.024395 Aug 02 06:49:41.577026 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 470/1000] 10.222.0.79 () {60 vars in 1166 bytes} [Tue Aug 2 06:49:41 2022] GET /compute/v2.1/flavors => generated 3152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:41.581464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6f12db8e-00fc-4f2e-8fb5-26e45bd71987 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] Action: 'create', calling method: .version_select at 0x7f927b0c0d30>, body: {"pool": null} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:41.769763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2bf61266-5b07-425d-9557-6a4065fa44cd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:41.777932 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2bf61266-5b07-425d-9557-6a4065fa44cd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1312 microversion: 2.1 time: 0.432426 Aug 02 06:49:41.778918 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 531/1001] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:41 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1312 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:41.793170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-280cc66e-fa30-449f-b6fe-3d52be9885a0 tempest-FlavorsV255TestJSON-1482038124 tempest-FlavorsV255TestJSON-1482038124-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:41.794067 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:41.794067 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:41.814056 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-280cc66e-fa30-449f-b6fe-3d52be9885a0 tempest-FlavorsV255TestJSON-1482038124 tempest-FlavorsV255TestJSON-1482038124-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/768072046" status: 202 len: 0 microversion: 2.55 time: 0.034059 Aug 02 06:49:41.815302 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 532/1002] 10.222.0.79 () {60 vars in 1199 bytes} [Tue Aug 2 06:49:41 2022] DELETE /compute/v2.1/flavors/768072046 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:49:41.823036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6ab82a5b-850f-416a-996d-6e8ee586d06b tempest-FlavorsV255TestJSON-1482038124 tempest-FlavorsV255TestJSON-1482038124-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:41.844017 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6ab82a5b-850f-416a-996d-6e8ee586d06b tempest-FlavorsV255TestJSON-1482038124 tempest-FlavorsV255TestJSON-1482038124-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.024367 Aug 02 06:49:41.845000 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 533/1003] 10.222.0.79 () {60 vars in 1187 bytes} [Tue Aug 2 06:49:41 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:41.897281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cef86861-dcbc-4c3d-9653-b3e02dc36260 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:41.898144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cef86861-dcbc-4c3d-9653-b3e02dc36260 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:41.911979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cef86861-dcbc-4c3d-9653-b3e02dc36260 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:41.912428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cef86861-dcbc-4c3d-9653-b3e02dc36260 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:41.913236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cef86861-dcbc-4c3d-9653-b3e02dc36260 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:41.913878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cef86861-dcbc-4c3d-9653-b3e02dc36260 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:42.285269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cef86861-dcbc-4c3d-9653-b3e02dc36260 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:42.302787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cef86861-dcbc-4c3d-9653-b3e02dc36260 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:42.304106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cef86861-dcbc-4c3d-9653-b3e02dc36260 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:42.305313 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cef86861-dcbc-4c3d-9653-b3e02dc36260 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1542 microversion: 2.25 time: 0.413134 Aug 02 06:49:42.317918 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 534/1004] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:41 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1542 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:49:42.317918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3d06e3e1-183b-43b6-8f7c-f3acada98df9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:42.317918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3d06e3e1-183b-43b6-8f7c-f3acada98df9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:42.327744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d06e3e1-183b-43b6-8f7c-f3acada98df9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:42.328783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d06e3e1-183b-43b6-8f7c-f3acada98df9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:42.329778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d06e3e1-183b-43b6-8f7c-f3acada98df9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:42.330423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d06e3e1-183b-43b6-8f7c-f3acada98df9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:43.079473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3d06e3e1-183b-43b6-8f7c-f3acada98df9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:43.091289 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3d06e3e1-183b-43b6-8f7c-f3acada98df9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1317 microversion: 2.1 time: 0.783635 Aug 02 06:49:43.105534 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 535/1005] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:42 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1317 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:43.112424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-30ea5827-65b5-46c6-8775-97e8317b3809 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '.version_select at 0x7f927b14b310>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:43.130138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30ea5827-65b5-46c6-8775-97e8317b3809 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:43.130944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30ea5827-65b5-46c6-8775-97e8317b3809 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:43.147041 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-30ea5827-65b5-46c6-8775-97e8317b3809 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1280 microversion: 2.25 time: 0.040173 Aug 02 06:49:43.147642 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 536/1006] 10.222.0.79 () {60 vars in 1184 bytes} [Tue Aug 2 06:49:43 2022] GET /compute/v2.1/os-migrations => generated 1280 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:43.152820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-57e52151-0466-436d-b072-cbfb905fafa5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:43.153719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-57e52151-0466-436d-b072-cbfb905fafa5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:43.160401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57e52151-0466-436d-b072-cbfb905fafa5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:43.161116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57e52151-0466-436d-b072-cbfb905fafa5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:43.162084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57e52151-0466-436d-b072-cbfb905fafa5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:43.162674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57e52151-0466-436d-b072-cbfb905fafa5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:43.637046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-57e52151-0466-436d-b072-cbfb905fafa5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:43.645690 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-57e52151-0466-436d-b072-cbfb905fafa5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 200 len: 1324 microversion: 2.1 time: 0.496701 Aug 02 06:49:43.646294 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 537/1007] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:43 2022] GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 1324 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:43.660433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5d4444c7-dc56-42d5-8aed-83072020157e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:43.661135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5d4444c7-dc56-42d5-8aed-83072020157e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:43.670646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d4444c7-dc56-42d5-8aed-83072020157e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:43.671086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d4444c7-dc56-42d5-8aed-83072020157e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:43.671872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d4444c7-dc56-42d5-8aed-83072020157e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:43.672302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d4444c7-dc56-42d5-8aed-83072020157e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:44.145155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5d4444c7-dc56-42d5-8aed-83072020157e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:44.155276 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5d4444c7-dc56-42d5-8aed-83072020157e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1312 microversion: 2.1 time: 0.504273 Aug 02 06:49:44.168858 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 538/1008] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:43 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1312 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:44.175795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-381ba290-6c25-4ca2-86d8-c0e495941494 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:44.176652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-381ba290-6c25-4ca2-86d8-c0e495941494 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:44.185966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-381ba290-6c25-4ca2-86d8-c0e495941494 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:44.186616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-381ba290-6c25-4ca2-86d8-c0e495941494 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:44.188985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-381ba290-6c25-4ca2-86d8-c0e495941494 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:44.189594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-381ba290-6c25-4ca2-86d8-c0e495941494 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:44.492094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-381ba290-6c25-4ca2-86d8-c0e495941494 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:49:44.506063 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-381ba290-6c25-4ca2-86d8-c0e495941494 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 2034 microversion: 2.25 time: 0.335716 Aug 02 06:49:44.507281 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 539/1009] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:44 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 2034 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:44.523501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5e97c570-a320-41f6-bb29-3a42a806d5af tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:44.524111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5e97c570-a320-41f6-bb29-3a42a806d5af tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:44.540921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e97c570-a320-41f6-bb29-3a42a806d5af tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:44.541649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e97c570-a320-41f6-bb29-3a42a806d5af tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:44.542962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e97c570-a320-41f6-bb29-3a42a806d5af tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:44.543905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e97c570-a320-41f6-bb29-3a42a806d5af tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:44.940050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5e97c570-a320-41f6-bb29-3a42a806d5af tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:44.954213 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5e97c570-a320-41f6-bb29-3a42a806d5af tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1317 microversion: 2.1 time: 0.444723 Aug 02 06:49:44.955376 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 540/1010] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:44 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:44.961040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-32814968-0672-4983-9812-23040f9fc745 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Action: 'create', calling method: .version_select at 0x7f927b795670>, body: {"keypair": {"name": "tempest-keypair-1508174386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9HCgyCZH386zeMUTMT/6SpO3/cxAC84wJJdHWpm+gsPKduIwcTLJeSx2AL31VDSBpMoME0o1/It662oOF7wwmSbDEUdz0UTZyWe0SyKQyD6gSm035mHDv/hHlOYYuEWA=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:44.982020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-32814968-0672-4983-9812-23040f9fc745 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Getting quotas for project 28c28ea506a34625bf388395b06b67f5. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:49:44.987383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-32814968-0672-4983-9812-23040f9fc745 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Getting quotas for user a53fed20dabb4e45895da813d4c6538c and project 28c28ea506a34625bf388395b06b67f5. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:49:45.014153 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-32814968-0672-4983-9812-23040f9fc745 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.057427 Aug 02 06:49:45.014741 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 541/1011] 10.222.0.79 () {62 vars in 1200 bytes} [Tue Aug 2 06:49:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 06:49:45.023487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e0d509cd-d973-4dd0-a5e0-9d93976119f7 req-47d75289-a15e-4322-a72f-68de91bad879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3cf2f0-d6c3-48fa-8846-9e6ac9622220", "tag": "a1df2f8c-99bc-49b6-8596-fe6113bfa182"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:45.037156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e0d509cd-d973-4dd0-a5e0-9d93976119f7 req-47d75289-a15e-4322-a72f-68de91bad879 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:45.037606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e0d509cd-d973-4dd0-a5e0-9d93976119f7 req-47d75289-a15e-4322-a72f-68de91bad879 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:45.051860 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e0d509cd-d973-4dd0-a5e0-9d93976119f7 req-47d75289-a15e-4322-a72f-68de91bad879 service nova] Creating event network-changed:a1df2f8c-99bc-49b6-8596-fe6113bfa182 for instance 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 on n-h2-851337-3 Aug 02 06:49:45.057861 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e0d509cd-d973-4dd0-a5e0-9d93976119f7 req-47d75289-a15e-4322-a72f-68de91bad879 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041588 Aug 02 06:49:45.058953 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 542/1012] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:45.065570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-37169399-2374-4617-b3d4-71fcab925350 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:45.066364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-37169399-2374-4617-b3d4-71fcab925350 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:45.074290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37169399-2374-4617-b3d4-71fcab925350 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:45.074934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37169399-2374-4617-b3d4-71fcab925350 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:45.076341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37169399-2374-4617-b3d4-71fcab925350 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:45.076785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37169399-2374-4617-b3d4-71fcab925350 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:45.083871 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6f12db8e-00fc-4f2e-8fb5-26e45bd71987 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.505785 Aug 02 06:49:45.085102 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 471/1013] 10.222.0.79 () {60 vars in 1170 bytes} [Tue Aug 2 06:49:41 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:45.097147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-726c78c9-2bb2-4ae4-b0f6-f12b271a81a7 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] Calling method '.version_select at 0x7f927b0c9040>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:45.453812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-37169399-2374-4617-b3d4-71fcab925350 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:45.471576 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-37169399-2374-4617-b3d4-71fcab925350 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 200 len: 1324 microversion: 2.1 time: 0.410868 Aug 02 06:49:45.472605 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 543/1014] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:45 2022] GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 1324 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:45.479558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a43423a2-b7df-4cf4-b361-2d1f8c524dc7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:45.480767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a43423a2-b7df-4cf4-b361-2d1f8c524dc7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:45.494843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a43423a2-b7df-4cf4-b361-2d1f8c524dc7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:45.497922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a43423a2-b7df-4cf4-b361-2d1f8c524dc7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:45.498972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a43423a2-b7df-4cf4-b361-2d1f8c524dc7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:45.499645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a43423a2-b7df-4cf4-b361-2d1f8c524dc7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:46.128606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a43423a2-b7df-4cf4-b361-2d1f8c524dc7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:46.136934 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a43423a2-b7df-4cf4-b361-2d1f8c524dc7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1312 microversion: 2.1 time: 0.663232 Aug 02 06:49:46.137497 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 544/1015] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:45 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1312 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:46.142241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-0c576a07-397f-4f56-b2aa-fef756ef688c req-ed383399-1f84-49cc-bf80-3131020220a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c976a871-9aa2-4330-9e0c-363aadd04223", "name": "network-vif-plugged", "status": "completed", "tag": "9b2e2b0e-a0fa-4b06-96ce-29c660765c8f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:46.159030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0c576a07-397f-4f56-b2aa-fef756ef688c req-ed383399-1f84-49cc-bf80-3131020220a9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:46.159470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0c576a07-397f-4f56-b2aa-fef756ef688c req-ed383399-1f84-49cc-bf80-3131020220a9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:46.175578 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-0c576a07-397f-4f56-b2aa-fef756ef688c req-ed383399-1f84-49cc-bf80-3131020220a9 service nova] Creating event network-vif-plugged:9b2e2b0e-a0fa-4b06-96ce-29c660765c8f for instance c976a871-9aa2-4330-9e0c-363aadd04223 on n-h1-851337-3 Aug 02 06:49:46.181544 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-0c576a07-397f-4f56-b2aa-fef756ef688c req-ed383399-1f84-49cc-bf80-3131020220a9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042438 Aug 02 06:49:46.182564 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 545/1016] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:46.330285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b6b1e648-87a9-4a69-8225-284838e3a84e tempest-FlavorsV261TestJSON-315020434 tempest-FlavorsV261TestJSON-315020434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-420778478", "id": 440290705, "os-flavor-access:is_public": "True"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:46.333340 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:46.333340 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:46.352944 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b6b1e648-87a9-4a69-8225-284838e3a84e tempest-FlavorsV261TestJSON-315020434 tempest-FlavorsV261TestJSON-315020434-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.168766 Aug 02 06:49:46.353518 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 546/1017] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 06:49:46 2022] POST /compute/v2.1/flavors => generated 464 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:49:46.358540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ab420ac-733a-4b74-a5e5-f64240474182 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:46.359414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9ab420ac-733a-4b74-a5e5-f64240474182 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:46.366267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ab420ac-733a-4b74-a5e5-f64240474182 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:46.366719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ab420ac-733a-4b74-a5e5-f64240474182 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:46.367496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ab420ac-733a-4b74-a5e5-f64240474182 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:46.367937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ab420ac-733a-4b74-a5e5-f64240474182 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:46.592453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9ab420ac-733a-4b74-a5e5-f64240474182 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:46.593063 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-726c78c9-2bb2-4ae4-b0f6-f12b271a81a7 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/279d06bb-83d6-4abf-802c-d6d74ff1832c" status: 202 len: 0 microversion: 2.1 time: 1.500035 Aug 02 06:49:46.596882 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 472/1018] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 06:49:45 2022] DELETE /compute/v2.1/os-floating-ips/279d06bb-83d6-4abf-802c-d6d74ff1832c => generated 0 bytes in 1501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:49:46.601807 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9ab420ac-733a-4b74-a5e5-f64240474182 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1317 microversion: 2.1 time: 0.246956 Aug 02 06:49:46.603147 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 547/1019] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:46 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:46.609854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-13a95526-75bf-43c2-98dd-b841c08dc0c5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:46.610707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-13a95526-75bf-43c2-98dd-b841c08dc0c5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:46.617599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13a95526-75bf-43c2-98dd-b841c08dc0c5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:46.618447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13a95526-75bf-43c2-98dd-b841c08dc0c5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:46.619471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13a95526-75bf-43c2-98dd-b841c08dc0c5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:46.620280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13a95526-75bf-43c2-98dd-b841c08dc0c5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:46.732694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2482b900-5a7a-41af-8ccc-9c39e3522fc1 tempest-FlavorsV261TestJSON-751138705 tempest-FlavorsV261TestJSON-751138705-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:46.748186 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2482b900-5a7a-41af-8ccc-9c39e3522fc1 tempest-FlavorsV261TestJSON-751138705 tempest-FlavorsV261TestJSON-751138705-project] 10.222.0.79 "GET /compute/v2.1/flavors/440290705" status: 200 len: 464 microversion: 2.61 time: 0.153431 Aug 02 06:49:46.749427 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 473/1020] 10.222.0.79 () {60 vars in 1196 bytes} [Tue Aug 2 06:49:46 2022] GET /compute/v2.1/flavors/440290705 => generated 464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:49:46.754762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb80b354-2411-4866-bb6f-a5bcb7a9a273 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] Calling method '.version_select at 0x7f927b1ab790>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:46.813630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG neutronclient.v2_0.client [None req-cb80b354-2411-4866-bb6f-a5bcb7a9a273 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 279d06bb-83d6-4abf-802c-d6d74ff1832c could not be found", "detail": ""}} {{(pid=126119) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:49:46.814435 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-cb80b354-2411-4866-bb6f-a5bcb7a9a273 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] HTTP exception thrown: Floating IP not found for ID 279d06bb-83d6-4abf-802c-d6d74ff1832c Aug 02 06:49:46.820862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-13a95526-75bf-43c2-98dd-b841c08dc0c5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:46.829461 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-13a95526-75bf-43c2-98dd-b841c08dc0c5 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 200 len: 1324 microversion: 2.1 time: 0.224859 Aug 02 06:49:46.830296 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 548/1021] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:46 2022] GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 1324 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:46.836634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6d005735-164c-4a0c-85ae-cbe4c7d659dc tempest-FlavorsV261TestJSON-315020434 tempest-FlavorsV261TestJSON-315020434-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:46.839648 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:46.839648 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb80b354-2411-4866-bb6f-a5bcb7a9a273 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] Request method failure captured: Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-floating-ips/279d06bb-83d6-4abf-802c-d6d74ff1832c HTTP/1.1 Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mj7Wz5JerHP1hwL1tSnPA4lot57v9qN3N02rybv4c91lLwHLR8lYUErQJ9HUifTVLLvwkMhgS8KH_ZXiBGKoZaYhiipwIqx8SevDs5wwOXwIAW502JOTwjPg5wsjxH-yVtSziuBkAtFiFHdX-m1FPYPZxBXc6ZVV2Eq4VYhI95rVTY Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 5bf3adc648b9440884e9cb94c609fc3e Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FloatingIPsTestJSON-206682182 Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:49:46.843675 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:49:46.845088 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bf3adc648b9440884e9cb94c609fc3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bf3adc648b9440884e9cb94c609fc3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bf3adc648b9440884e9cb94c609fc3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bf3adc648b9440884e9cb94c609fc3e"}]}] Aug 02 06:49:46.845088 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FloatingIPsTestJSON-206682182 Aug 02 06:49:46.845088 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 5bf3adc648b9440884e9cb94c609fc3e Aug 02 06:49:46.845088 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FloatingIPsTestJSON-206682182 Aug 02 06:49:46.845088 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FloatingIPsTestJSON-206682182-project Aug 02 06:49:46.845088 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:49:46.845088 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:49:46.845088 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 01c2fa33686947cea3276ecfec9dfb17 Aug 02 06:49:46.845088 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FloatingIPsTestJSON-206682182-project Aug 02 06:49:46.845088 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:49:46.845088 n-d-851337-3 devstack@n-api.service[126119]: exception: Floating IP not found for ID 279d06bb-83d6-4abf-802c-d6d74ff1832c Aug 02 06:49:46.845088 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '279d06bb-83d6-4abf-802c-d6d74ff1832c'} Aug 02 06:49:46.845088 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:49:46.846003 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 279d06bb-83d6-4abf-802c-d6d74ff1832c could not be found Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59f46ad6-f787-48b1-ba40-4b287f88e379'] Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 279d06bb-83d6-4abf-802c-d6d74ff1832c. Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:46.847225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 279d06bb-83d6-4abf-802c-d6d74ff1832c Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:46.848931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:46.850513 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 279d06bb-83d6-4abf-802c-d6d74ff1832c Aug 02 06:49:46.850513 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:46.850513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb80b354-2411-4866-bb6f-a5bcb7a9a273 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] Returning 404 to user: Floating IP not found for ID 279d06bb-83d6-4abf-802c-d6d74ff1832c {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:46.850513 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cb80b354-2411-4866-bb6f-a5bcb7a9a273 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/279d06bb-83d6-4abf-802c-d6d74ff1832c" status: 404 len: 111 microversion: 2.1 time: 0.095229 Aug 02 06:49:46.850849 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 474/1022] 10.222.0.79 () {58 vars in 1260 bytes} [Tue Aug 2 06:49:46 2022] GET /compute/v2.1/os-floating-ips/279d06bb-83d6-4abf-802c-d6d74ff1832c => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:46.857078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9058b0c3-de45-4c5e-a555-4b939ac0a5c6 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] Calling method '.version_select at 0x7f927b0363a0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:46.878639 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6d005735-164c-4a0c-85ae-cbe4c7d659dc tempest-FlavorsV261TestJSON-315020434 tempest-FlavorsV261TestJSON-315020434-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/440290705" status: 200 len: 465 microversion: 2.61 time: 0.047270 Aug 02 06:49:46.879470 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 549/1023] 10.222.0.79 () {62 vars in 1216 bytes} [Tue Aug 2 06:49:46 2022] PUT /compute/v2.1/flavors/440290705 => generated 465 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:49:46.893087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-66c78369-2bea-4a5d-917d-d944e96a5918 tempest-FlavorsV261TestJSON-751138705 tempest-FlavorsV261TestJSON-751138705-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:46.915906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG neutronclient.v2_0.client [None req-9058b0c3-de45-4c5e-a555-4b939ac0a5c6 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 279d06bb-83d6-4abf-802c-d6d74ff1832c could not be found", "detail": ""}} {{(pid=126119) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:49:46.916717 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-9058b0c3-de45-4c5e-a555-4b939ac0a5c6 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] HTTP exception thrown: Floating IP not found for ID 279d06bb-83d6-4abf-802c-d6d74ff1832c Aug 02 06:49:46.917170 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-66c78369-2bea-4a5d-917d-d944e96a5918 tempest-FlavorsV261TestJSON-751138705 tempest-FlavorsV261TestJSON-751138705-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.028478 Aug 02 06:49:46.917753 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 550/1024] 10.222.0.79 () {60 vars in 1187 bytes} [Tue Aug 2 06:49:46 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9058b0c3-de45-4c5e-a555-4b939ac0a5c6 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] Request method failure captured: Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/os-floating-ips/279d06bb-83d6-4abf-802c-d6d74ff1832c HTTP/1.1 Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mj7Wz5JerHP1hwL1tSnPA4lot57v9qN3N02rybv4c91lLwHLR8lYUErQJ9HUifTVLLvwkMhgS8KH_ZXiBGKoZaYhiipwIqx8SevDs5wwOXwIAW502JOTwjPg5wsjxH-yVtSziuBkAtFiFHdX-m1FPYPZxBXc6ZVV2Eq4VYhI95rVTY Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 5bf3adc648b9440884e9cb94c609fc3e Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FloatingIPsTestJSON-206682182 Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:49:46.919208 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:49:46.920796 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bf3adc648b9440884e9cb94c609fc3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bf3adc648b9440884e9cb94c609fc3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bf3adc648b9440884e9cb94c609fc3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bf3adc648b9440884e9cb94c609fc3e"}]}] Aug 02 06:49:46.920796 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FloatingIPsTestJSON-206682182 Aug 02 06:49:46.920796 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 5bf3adc648b9440884e9cb94c609fc3e Aug 02 06:49:46.920796 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FloatingIPsTestJSON-206682182 Aug 02 06:49:46.920796 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FloatingIPsTestJSON-206682182-project Aug 02 06:49:46.920796 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:49:46.920796 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:49:46.920796 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 01c2fa33686947cea3276ecfec9dfb17 Aug 02 06:49:46.920796 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FloatingIPsTestJSON-206682182-project Aug 02 06:49:46.920796 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:49:46.920796 n-d-851337-3 devstack@n-api.service[126119]: exception: Floating IP not found for ID 279d06bb-83d6-4abf-802c-d6d74ff1832c Aug 02 06:49:46.920796 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '279d06bb-83d6-4abf-802c-d6d74ff1832c'} Aug 02 06:49:46.920796 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:49:46.921749 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 279d06bb-83d6-4abf-802c-d6d74ff1832c could not be found Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc5d933d-a595-4b79-a2da-5006c7982bc4'] Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 279d06bb-83d6-4abf-802c-d6d74ff1832c. Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:46.923143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 279d06bb-83d6-4abf-802c-d6d74ff1832c Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:46.924565 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:46.926017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 279d06bb-83d6-4abf-802c-d6d74ff1832c Aug 02 06:49:46.926017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:46.926017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9058b0c3-de45-4c5e-a555-4b939ac0a5c6 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] Returning 404 to user: Floating IP not found for ID 279d06bb-83d6-4abf-802c-d6d74ff1832c {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:46.926736 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9058b0c3-de45-4c5e-a555-4b939ac0a5c6 tempest-FloatingIPsTestJSON-206682182 tempest-FloatingIPsTestJSON-206682182-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/279d06bb-83d6-4abf-802c-d6d74ff1832c" status: 404 len: 111 microversion: 2.1 time: 0.074927 Aug 02 06:49:46.927545 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 475/1025] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 06:49:46 2022] DELETE /compute/v2.1/os-floating-ips/279d06bb-83d6-4abf-802c-d6d74ff1832c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:46.944873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b3be3d64-fc86-4f95-8d3b-8069ea68bb79 tempest-FlavorsV261TestJSON-751138705 tempest-FlavorsV261TestJSON-751138705-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:46.964200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1026190359", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "d2cb6aa5-9974-46cb-9343-692a25f49887"}], "security_groups": [{"name": "tempest-securitygroup--175971219"}], "key_name": "tempest-keypair-1508174386", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:46.968582 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b3be3d64-fc86-4f95-8d3b-8069ea68bb79 tempest-FlavorsV261TestJSON-751138705 tempest-FlavorsV261TestJSON-751138705-project] 10.222.0.79 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.029391 Aug 02 06:49:46.980240 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 551/1026] 10.222.0.79 () {60 vars in 1166 bytes} [Tue Aug 2 06:49:46 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:46.985043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7c9e2704-cd9b-4c99-b63a-3deb28ae1c85 tempest-FlavorsV261TestJSON-315020434 tempest-FlavorsV261TestJSON-315020434-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:46.986239 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:46.986239 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:47.004618 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7c9e2704-cd9b-4c99-b63a-3deb28ae1c85 tempest-FlavorsV261TestJSON-315020434 tempest-FlavorsV261TestJSON-315020434-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/440290705" status: 202 len: 0 microversion: 2.61 time: 0.023055 Aug 02 06:49:47.009162 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 552/1027] 10.222.0.79 () {60 vars in 1199 bytes} [Tue Aug 2 06:49:46 2022] DELETE /compute/v2.1/flavors/440290705 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:49:47.015732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-89bb32bd-2c00-4f95-8de1-b7a58703022e tempest-FlavorsV261TestJSON-315020434 tempest-FlavorsV261TestJSON-315020434-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:47.039077 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-89bb32bd-2c00-4f95-8de1-b7a58703022e tempest-FlavorsV261TestJSON-315020434 tempest-FlavorsV261TestJSON-315020434-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.028329 Aug 02 06:49:47.049671 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 553/1028] 10.222.0.79 () {60 vars in 1187 bytes} [Tue Aug 2 06:49:47 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:47.094186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] validate_networks() for [('d2cb6aa5-9974-46cb-9343-692a25f49887', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:49:47.160292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bfc86070-2755-44e4-95d3-d5998d66a4d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:47.163418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bfc86070-2755-44e4-95d3-d5998d66a4d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:47.174725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfc86070-2755-44e4-95d3-d5998d66a4d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:47.175317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfc86070-2755-44e4-95d3-d5998d66a4d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:47.176210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfc86070-2755-44e4-95d3-d5998d66a4d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:47.176737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfc86070-2755-44e4-95d3-d5998d66a4d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:47.553564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bfc86070-2755-44e4-95d3-d5998d66a4d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:47.562176 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bfc86070-2755-44e4-95d3-d5998d66a4d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1312 microversion: 2.1 time: 0.407025 Aug 02 06:49:47.563203 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 554/1029] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:47 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1312 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:47.622927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-de19ad67-a21d-4856-8431-bcb118715c0e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:47.623768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-de19ad67-a21d-4856-8431-bcb118715c0e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:47.630995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de19ad67-a21d-4856-8431-bcb118715c0e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:47.631464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de19ad67-a21d-4856-8431-bcb118715c0e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:47.632601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de19ad67-a21d-4856-8431-bcb118715c0e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:47.633033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de19ad67-a21d-4856-8431-bcb118715c0e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:47.940635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-de19ad67-a21d-4856-8431-bcb118715c0e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:47.950075 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-de19ad67-a21d-4856-8431-bcb118715c0e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1317 microversion: 2.1 time: 0.331321 Aug 02 06:49:47.950779 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 555/1030] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:47 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:49:47.969208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b1de73a0-a300-4dc3-b2db-e13b54d3adb2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:47.969876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b1de73a0-a300-4dc3-b2db-e13b54d3adb2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:47.977409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1de73a0-a300-4dc3-b2db-e13b54d3adb2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:47.977956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1de73a0-a300-4dc3-b2db-e13b54d3adb2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:47.978908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1de73a0-a300-4dc3-b2db-e13b54d3adb2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:47.979405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1de73a0-a300-4dc3-b2db-e13b54d3adb2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:47.993005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:49:47.993516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:49:47.994221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:49:47.994892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:49:47.995931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:49:48.005509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:48.006412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:48.007787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:48.008470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:48.046003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Getting quotas for project 28c28ea506a34625bf388395b06b67f5. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:49:48.052453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Getting quotas for user a53fed20dabb4e45895da813d4c6538c and project 28c28ea506a34625bf388395b06b67f5. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:49:48.066037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:49:48.069058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:49:48.149524 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e38780a0-6f9d-45b3-b4b9-6f56019c8029 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.190177 Aug 02 06:49:48.154736 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 476/1031] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 06:49:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 02 06:49:48.182607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-974ef2cc-0ef8-4d3c-880d-3510973bb9e6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:48.183431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-974ef2cc-0ef8-4d3c-880d-3510973bb9e6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:48.327480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b1de73a0-a300-4dc3-b2db-e13b54d3adb2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:48.336620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-974ef2cc-0ef8-4d3c-880d-3510973bb9e6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:48.338197 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b1de73a0-a300-4dc3-b2db-e13b54d3adb2 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 200 len: 1324 microversion: 2.1 time: 0.374173 Aug 02 06:49:48.340386 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 556/1032] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:47 2022] GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 1324 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:48.361794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-974ef2cc-0ef8-4d3c-880d-3510973bb9e6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:48.363607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-974ef2cc-0ef8-4d3c-880d-3510973bb9e6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:48.365724 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-974ef2cc-0ef8-4d3c-880d-3510973bb9e6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1286 microversion: 2.25 time: 0.201033 Aug 02 06:49:48.377920 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 477/1033] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:48 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1286 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:48.584151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eb85e137-72b6-4e0e-b0ca-d5b6d23a0e97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:48.584937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-eb85e137-72b6-4e0e-b0ca-d5b6d23a0e97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:48.595779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eb85e137-72b6-4e0e-b0ca-d5b6d23a0e97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:48.596257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eb85e137-72b6-4e0e-b0ca-d5b6d23a0e97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:48.597125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eb85e137-72b6-4e0e-b0ca-d5b6d23a0e97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:48.597589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eb85e137-72b6-4e0e-b0ca-d5b6d23a0e97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:48.686293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:48.787787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-eb85e137-72b6-4e0e-b0ca-d5b6d23a0e97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:48.799024 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-eb85e137-72b6-4e0e-b0ca-d5b6d23a0e97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1312 microversion: 2.1 time: 0.217919 Aug 02 06:49:48.800814 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 557/1034] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:48 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1312 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:48.972517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bad2f362-9f6b-47b5-8948-f9ecbef23c73 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:48.973580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bad2f362-9f6b-47b5-8948-f9ecbef23c73 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:48.980193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bad2f362-9f6b-47b5-8948-f9ecbef23c73 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:48.981543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bad2f362-9f6b-47b5-8948-f9ecbef23c73 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:48.982629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bad2f362-9f6b-47b5-8948-f9ecbef23c73 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:48.984156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bad2f362-9f6b-47b5-8948-f9ecbef23c73 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:49.212640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bad2f362-9f6b-47b5-8948-f9ecbef23c73 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:49.224647 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bad2f362-9f6b-47b5-8948-f9ecbef23c73 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1317 microversion: 2.1 time: 0.255823 Aug 02 06:49:49.234577 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 478/1035] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:48 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:49.363277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bbc98c7b-00f9-4fdd-ac30-59a9f82069b1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:49.364004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bbc98c7b-00f9-4fdd-ac30-59a9f82069b1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:49.379416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbc98c7b-00f9-4fdd-ac30-59a9f82069b1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:49.379958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbc98c7b-00f9-4fdd-ac30-59a9f82069b1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:49.382691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbc98c7b-00f9-4fdd-ac30-59a9f82069b1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:49.390048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c9a84a6f-c2c3-4ea5-ad81-dae6d50d1234 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:49.390766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c9a84a6f-c2c3-4ea5-ad81-dae6d50d1234 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:49.397498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbc98c7b-00f9-4fdd-ac30-59a9f82069b1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:49.405385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9a84a6f-c2c3-4ea5-ad81-dae6d50d1234 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:49.405851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9a84a6f-c2c3-4ea5-ad81-dae6d50d1234 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:49.406648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9a84a6f-c2c3-4ea5-ad81-dae6d50d1234 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:49.418056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9a84a6f-c2c3-4ea5-ad81-dae6d50d1234 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:49.575913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c9a84a6f-c2c3-4ea5-ad81-dae6d50d1234 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:49.588386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c9a84a6f-c2c3-4ea5-ad81-dae6d50d1234 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:49.590101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c9a84a6f-c2c3-4ea5-ad81-dae6d50d1234 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:49.591756 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c9a84a6f-c2c3-4ea5-ad81-dae6d50d1234 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1338 microversion: 2.25 time: 0.206143 Aug 02 06:49:49.592863 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 479/1036] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:49 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1338 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:49.686572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bbc98c7b-00f9-4fdd-ac30-59a9f82069b1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:49.689722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:49.701919 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bbc98c7b-00f9-4fdd-ac30-59a9f82069b1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 200 len: 1324 microversion: 2.1 time: 0.346085 Aug 02 06:49:49.704243 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 558/1037] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:49 2022] GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 1324 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:49.840150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8035e634-d127-449a-8ff8-4cfae99e9308 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:49.841157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8035e634-d127-449a-8ff8-4cfae99e9308 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:49.865420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8035e634-d127-449a-8ff8-4cfae99e9308 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:49.865873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8035e634-d127-449a-8ff8-4cfae99e9308 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:49.867406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8035e634-d127-449a-8ff8-4cfae99e9308 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:49.867847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8035e634-d127-449a-8ff8-4cfae99e9308 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:50.193510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8035e634-d127-449a-8ff8-4cfae99e9308 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:50.205604 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8035e634-d127-449a-8ff8-4cfae99e9308 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1461 microversion: 2.1 time: 0.386946 Aug 02 06:49:50.208094 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 480/1038] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:49 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1461 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:50.236174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6692887e-c647-4d20-ab4f-9f59c17d3e30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:50.238581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6692887e-c647-4d20-ab4f-9f59c17d3e30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:50.254306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c89d1328-6d35-404d-b569-2e1849c6d4de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:50.256286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c89d1328-6d35-404d-b569-2e1849c6d4de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:50.263514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c89d1328-6d35-404d-b569-2e1849c6d4de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:50.264252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c89d1328-6d35-404d-b569-2e1849c6d4de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:50.265298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c89d1328-6d35-404d-b569-2e1849c6d4de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:50.268126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c89d1328-6d35-404d-b569-2e1849c6d4de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:50.274193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6692887e-c647-4d20-ab4f-9f59c17d3e30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:50.274934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6692887e-c647-4d20-ab4f-9f59c17d3e30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:50.276957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6692887e-c647-4d20-ab4f-9f59c17d3e30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:50.278942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6692887e-c647-4d20-ab4f-9f59c17d3e30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:50.481809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6692887e-c647-4d20-ab4f-9f59c17d3e30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:50.491099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6692887e-c647-4d20-ab4f-9f59c17d3e30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Old instance type m1.heat2, new instance type m1.heat {{(pid=126120) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 06:49:50.499285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6692887e-c647-4d20-ab4f-9f59c17d3e30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:49:50.499548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6692887e-c647-4d20-ab4f-9f59c17d3e30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:49:50.500033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6692887e-c647-4d20-ab4f-9f59c17d3e30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:49:50.500430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6692887e-c647-4d20-ab4f-9f59c17d3e30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:49:50.500842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6692887e-c647-4d20-ab4f-9f59c17d3e30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:49:50.773971 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6692887e-c647-4d20-ab4f-9f59c17d3e30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "POST /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223/action" status: 202 len: 0 microversion: 2.1 time: 0.545447 Aug 02 06:49:50.776013 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 559/1039] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:49:50 2022] POST /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:49:50.781841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-01134756-5df5-401f-ab92-917d81aab7fe req-ee2a978f-e4ff-462e-929a-b7c0b7240f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3cf2f0-d6c3-48fa-8846-9e6ac9622220", "name": "network-vif-plugged", "status": "completed", "tag": "a1df2f8c-99bc-49b6-8596-fe6113bfa182"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:50.796801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-01134756-5df5-401f-ab92-917d81aab7fe req-ee2a978f-e4ff-462e-929a-b7c0b7240f19 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:50.797333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-01134756-5df5-401f-ab92-917d81aab7fe req-ee2a978f-e4ff-462e-929a-b7c0b7240f19 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:50.817096 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-01134756-5df5-401f-ab92-917d81aab7fe req-ee2a978f-e4ff-462e-929a-b7c0b7240f19 service nova] Creating event network-vif-plugged:a1df2f8c-99bc-49b6-8596-fe6113bfa182 for instance 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 on n-h2-851337-3 Aug 02 06:49:50.824957 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-01134756-5df5-401f-ab92-917d81aab7fe req-ee2a978f-e4ff-462e-929a-b7c0b7240f19 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047422 Aug 02 06:49:50.825556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c89d1328-6d35-404d-b569-2e1849c6d4de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:50.826346 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 560/1040] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:50.828111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:50.845637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-71c3bf99-62ac-4949-a0ce-73a7c46b73bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:50.846996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-71c3bf99-62ac-4949-a0ce-73a7c46b73bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:50.856066 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c89d1328-6d35-404d-b569-2e1849c6d4de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1317 microversion: 2.1 time: 0.612356 Aug 02 06:49:50.858281 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 481/1041] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:50 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:49:50.868802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-91b96ede-f1d3-46a8-98ae-f0fbc30dcf81 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:50.869562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71c3bf99-62ac-4949-a0ce-73a7c46b73bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:50.884923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71c3bf99-62ac-4949-a0ce-73a7c46b73bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:50.886617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-91b96ede-f1d3-46a8-98ae-f0fbc30dcf81 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:50.890903 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71c3bf99-62ac-4949-a0ce-73a7c46b73bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:50.891499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71c3bf99-62ac-4949-a0ce-73a7c46b73bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:50.906460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91b96ede-f1d3-46a8-98ae-f0fbc30dcf81 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:50.907043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91b96ede-f1d3-46a8-98ae-f0fbc30dcf81 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:50.907935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91b96ede-f1d3-46a8-98ae-f0fbc30dcf81 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:50.910155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91b96ede-f1d3-46a8-98ae-f0fbc30dcf81 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:51.160690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-71c3bf99-62ac-4949-a0ce-73a7c46b73bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:51.181345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-71c3bf99-62ac-4949-a0ce-73a7c46b73bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:51.183032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-71c3bf99-62ac-4949-a0ce-73a7c46b73bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:51.184176 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-71c3bf99-62ac-4949-a0ce-73a7c46b73bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1344 microversion: 2.25 time: 0.355931 Aug 02 06:49:51.184755 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 561/1042] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:50 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1344 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:51.201929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-98aebef7-65aa-41a3-a0c7-16a5737c94bd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:51.202805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-98aebef7-65aa-41a3-a0c7-16a5737c94bd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:51.219887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98aebef7-65aa-41a3-a0c7-16a5737c94bd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:51.220345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98aebef7-65aa-41a3-a0c7-16a5737c94bd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:51.221137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98aebef7-65aa-41a3-a0c7-16a5737c94bd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:51.221796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98aebef7-65aa-41a3-a0c7-16a5737c94bd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:51.465428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-91b96ede-f1d3-46a8-98ae-f0fbc30dcf81 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:51.476458 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-91b96ede-f1d3-46a8-98ae-f0fbc30dcf81 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 200 len: 1324 microversion: 2.1 time: 0.615131 Aug 02 06:49:51.477057 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 482/1043] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:50 2022] GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 1324 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:51.632474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-98aebef7-65aa-41a3-a0c7-16a5737c94bd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:51.641147 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-98aebef7-65aa-41a3-a0c7-16a5737c94bd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1470 microversion: 2.1 time: 0.455330 Aug 02 06:49:51.643170 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 562/1044] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:51 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1470 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:51.724040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d17a9d10-dc86-48d7-b70b-a87907dfbb65 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Calling method '.version_select at 0x7f927b09cca0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:51.728380 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:51.728380 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:49:51.730685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d17a9d10-dc86-48d7-b70b-a87907dfbb65 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:51.731920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d17a9d10-dc86-48d7-b70b-a87907dfbb65 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:51.733830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d17a9d10-dc86-48d7-b70b-a87907dfbb65 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:51.750832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d17a9d10-dc86-48d7-b70b-a87907dfbb65 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:51.793031 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d17a9d10-dc86-48d7-b70b-a87907dfbb65 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.287783 Aug 02 06:49:51.793911 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 483/1045] 10.222.0.79 () {58 vars in 1128 bytes} [Tue Aug 2 06:49:51 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:49:51.882771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4732d182-9c5c-46e5-a83e-818f2e88e699 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:51.883998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4732d182-9c5c-46e5-a83e-818f2e88e699 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:51.898407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4732d182-9c5c-46e5-a83e-818f2e88e699 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:51.900424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4732d182-9c5c-46e5-a83e-818f2e88e699 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:51.903154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4732d182-9c5c-46e5-a83e-818f2e88e699 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:51.903638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4732d182-9c5c-46e5-a83e-818f2e88e699 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:52.086605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8d8fd825-67b7-471c-b31a-872a43993ff5 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Calling method '.version_select at 0x7f927b20b9d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:52.089442 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:52.089442 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:52.090641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8d8fd825-67b7-471c-b31a-872a43993ff5 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'f16211727c0a4989a84941f1cb25cb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c0dc503344623b030b9e79a18c131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8d8fd825-67b7-471c-b31a-872a43993ff5 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Request method failure captured: Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MkOQmAAKxoQgUnlD6ahNhiylkO2Ido4B8vldRwB9hLjmJuG8KlZcodtuTjPCkZg-01cILiznHuruiTd7gCm_cJbtCbOLwx994hQ4FBHkW30OSii0uPNDLeM4Ulfq68CwAB8aZTF-Hg5yqR4wDWb7K9bm_Azbt9QdrlXWjujfypUbN4 Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6e0c0dc503344623b030b9e79a18c131 Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:49:52.093270 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:49:52.094737 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6e0c0dc503344623b030b9e79a18c131"}]}] Aug 02 06:49:52.094737 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.094737 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6e0c0dc503344623b030b9e79a18c131 Aug 02 06:49:52.094737 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.094737 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HostsAdminNegativeTestJSON-960201057-project Aug 02 06:49:52.094737 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:52.094737 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:52.094737 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: f16211727c0a4989a84941f1cb25cb1c Aug 02 06:49:52.094737 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HostsAdminNegativeTestJSON-960201057-project Aug 02 06:49:52.094737 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:49:52.094737 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 02 06:49:52.094737 n-d-851337-3 devstack@n-api.service[126120]: action_args: {} Aug 02 06:49:52.094737 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:49:52.095545 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 02 06:49:52.096755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.097968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8d8fd825-67b7-471c-b31a-872a43993ff5 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:52.097968 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8d8fd825-67b7-471c-b31a-872a43993ff5 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.292576 Aug 02 06:49:52.099744 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 563/1046] 10.222.0.79 () {58 vars in 1128 bytes} [Tue Aug 2 06:49:51 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 299 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:52.106088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9f65c86c-2e5e-4f97-9f98-6410784169f2 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Calling method '.version_select at 0x7f928c3d9310>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:52.106878 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:52.106878 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:52.108713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9f65c86c-2e5e-4f97-9f98-6410784169f2 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'f16211727c0a4989a84941f1cb25cb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c0dc503344623b030b9e79a18c131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9f65c86c-2e5e-4f97-9f98-6410784169f2 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Request method failure captured: Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hosts/n-d-851337-3/reboot HTTP/1.1 Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MkOQmAAKxoQgUnlD6ahNhiylkO2Ido4B8vldRwB9hLjmJuG8KlZcodtuTjPCkZg-01cILiznHuruiTd7gCm_cJbtCbOLwx994hQ4FBHkW30OSii0uPNDLeM4Ulfq68CwAB8aZTF-Hg5yqR4wDWb7K9bm_Azbt9QdrlXWjujfypUbN4 Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6e0c0dc503344623b030b9e79a18c131 Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:49:52.110415 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:49:52.111757 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6e0c0dc503344623b030b9e79a18c131"}]}] Aug 02 06:49:52.111757 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.111757 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6e0c0dc503344623b030b9e79a18c131 Aug 02 06:49:52.111757 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.111757 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HostsAdminNegativeTestJSON-960201057-project Aug 02 06:49:52.111757 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:52.111757 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:52.111757 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: f16211727c0a4989a84941f1cb25cb1c Aug 02 06:49:52.111757 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HostsAdminNegativeTestJSON-960201057-project Aug 02 06:49:52.111757 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:49:52.111757 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 02 06:49:52.111757 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'n-d-851337-3'} Aug 02 06:49:52.111757 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:49:52.112968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 02 06:49:52.114473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.117573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9f65c86c-2e5e-4f97-9f98-6410784169f2 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:52.117573 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9f65c86c-2e5e-4f97-9f98-6410784169f2 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-851337-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.010623 Aug 02 06:49:52.117573 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 564/1047] 10.222.0.79 () {58 vars in 1188 bytes} [Tue Aug 2 06:49:52 2022] GET /compute/v2.1/os-hosts/n-d-851337-3/reboot => generated 111 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:52.122263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-78688761-bcbe-4c8a-b313-073ea4758cde tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Calling method '.version_select at 0x7f928c3d9c10>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:52.131975 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-78688761-bcbe-4c8a-b313-073ea4758cde tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-78688761-bcbe-4c8a-b313-073ea4758cde tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Request method failure captured: Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MkPh8dXGenCQEbEewnr0k6-z_gyIUNCW50ZYOL0LS3-hKnimAYFKR4hGJ3WdF8-1YhtJkyyERI0MaWZeNwOk87TOoAXe_OICPgUFpAvij4vtTN518BRIYz6jFILsHdoAUJChrQXFvueUPl4aU3j_M0TuGgsNYRh5-z0JjeyU5Dp8jc Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:49:52.133980 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:49:52.135442 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b291131f849448a49c95604bacac90cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b291131f849448a49c95604bacac90cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}] Aug 02 06:49:52.135442 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:52.135442 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:52.135442 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:52.135442 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:52.135442 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:52.135442 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:52.135442 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 807fd73403df4c56acd7d7053bd66fa7 Aug 02 06:49:52.135442 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:52.135442 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:49:52.135442 n-d-851337-3 devstack@n-api.service[126120]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.135442 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'nonexistent_hostname'} Aug 02 06:49:52.135442 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:49:52.136255 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 02 06:49:52.137501 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:52.138856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.138856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.138856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:52.138856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.138856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.138856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.138856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.138856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:52.138856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:52.138856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.138856 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.138856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-78688761-bcbe-4c8a-b313-073ea4758cde tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:52.138856 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-78688761-bcbe-4c8a-b313-073ea4758cde tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.019053 Aug 02 06:49:52.143373 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 565/1048] 10.222.0.79 () {58 vars in 1212 bytes} [Tue Aug 2 06:49:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:49:52.148271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-90811131-7d9f-46bd-9153-077ec4ce9612 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Calling method '.version_select at 0x7f927b149f70>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:52.149077 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:52.149077 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:52.150182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-90811131-7d9f-46bd-9153-077ec4ce9612 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'f16211727c0a4989a84941f1cb25cb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c0dc503344623b030b9e79a18c131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-90811131-7d9f-46bd-9153-077ec4ce9612 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Request method failure captured: Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hosts/n-d-851337-3 HTTP/1.1 Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MkOQmAAKxoQgUnlD6ahNhiylkO2Ido4B8vldRwB9hLjmJuG8KlZcodtuTjPCkZg-01cILiznHuruiTd7gCm_cJbtCbOLwx994hQ4FBHkW30OSii0uPNDLeM4Ulfq68CwAB8aZTF-Hg5yqR4wDWb7K9bm_Azbt9QdrlXWjujfypUbN4 Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6e0c0dc503344623b030b9e79a18c131 Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:49:52.151878 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:49:52.153459 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6e0c0dc503344623b030b9e79a18c131"}]}] Aug 02 06:49:52.153459 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.153459 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6e0c0dc503344623b030b9e79a18c131 Aug 02 06:49:52.153459 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.153459 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HostsAdminNegativeTestJSON-960201057-project Aug 02 06:49:52.153459 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:52.153459 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:52.153459 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: f16211727c0a4989a84941f1cb25cb1c Aug 02 06:49:52.153459 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HostsAdminNegativeTestJSON-960201057-project Aug 02 06:49:52.153459 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:49:52.153459 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 02 06:49:52.153459 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'n-d-851337-3'} Aug 02 06:49:52.153459 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:49:52.154637 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 02 06:49:52.155761 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.156755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-90811131-7d9f-46bd-9153-077ec4ce9612 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:52.156755 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-90811131-7d9f-46bd-9153-077ec4ce9612 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-851337-3" status: 403 len: 109 microversion: 2.1 time: 0.008845 Aug 02 06:49:52.156755 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 566/1049] 10.222.0.79 () {58 vars in 1167 bytes} [Tue Aug 2 06:49:52 2022] GET /compute/v2.1/os-hosts/n-d-851337-3 => generated 109 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:52.164463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-710a9373-7076-472e-bb8c-515d48b65a0c tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Calling method '.version_select at 0x7f927b14b040>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:52.172069 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-710a9373-7076-472e-bb8c-515d48b65a0c tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-710a9373-7076-472e-bb8c-515d48b65a0c tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Request method failure captured: Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MkPh8dXGenCQEbEewnr0k6-z_gyIUNCW50ZYOL0LS3-hKnimAYFKR4hGJ3WdF8-1YhtJkyyERI0MaWZeNwOk87TOoAXe_OICPgUFpAvij4vtTN518BRIYz6jFILsHdoAUJChrQXFvueUPl4aU3j_M0TuGgsNYRh5-z0JjeyU5Dp8jc Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:49:52.173653 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:49:52.175125 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b291131f849448a49c95604bacac90cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b291131f849448a49c95604bacac90cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}] Aug 02 06:49:52.175125 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:52.175125 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:52.175125 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:52.175125 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:52.175125 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:52.175125 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:52.175125 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 807fd73403df4c56acd7d7053bd66fa7 Aug 02 06:49:52.175125 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:52.175125 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:49:52.175125 n-d-851337-3 devstack@n-api.service[126120]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.175125 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'nonexistent_hostname'} Aug 02 06:49:52.175125 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.175904 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.177037 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.178121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-710a9373-7076-472e-bb8c-515d48b65a0c tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:52.178121 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-710a9373-7076-472e-bb8c-515d48b65a0c tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.014641 Aug 02 06:49:52.178121 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 567/1050] 10.222.0.79 () {58 vars in 1191 bytes} [Tue Aug 2 06:49:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 02 06:49:52.189101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6de42014-e72d-488c-8841-8b54f972ee56 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Calling method '.version_select at 0x7f927b149f70>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:52.189940 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:52.189940 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:52.190997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6de42014-e72d-488c-8841-8b54f972ee56 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'f16211727c0a4989a84941f1cb25cb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c0dc503344623b030b9e79a18c131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6de42014-e72d-488c-8841-8b54f972ee56 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Request method failure captured: Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hosts/n-d-851337-3/shutdown HTTP/1.1 Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MkOQmAAKxoQgUnlD6ahNhiylkO2Ido4B8vldRwB9hLjmJuG8KlZcodtuTjPCkZg-01cILiznHuruiTd7gCm_cJbtCbOLwx994hQ4FBHkW30OSii0uPNDLeM4Ulfq68CwAB8aZTF-Hg5yqR4wDWb7K9bm_Azbt9QdrlXWjujfypUbN4 Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6e0c0dc503344623b030b9e79a18c131 Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:49:52.192573 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:49:52.193857 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6e0c0dc503344623b030b9e79a18c131"}]}] Aug 02 06:49:52.193857 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.193857 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6e0c0dc503344623b030b9e79a18c131 Aug 02 06:49:52.193857 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.193857 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HostsAdminNegativeTestJSON-960201057-project Aug 02 06:49:52.193857 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:52.193857 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:52.193857 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: f16211727c0a4989a84941f1cb25cb1c Aug 02 06:49:52.193857 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HostsAdminNegativeTestJSON-960201057-project Aug 02 06:49:52.193857 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:49:52.193857 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 02 06:49:52.193857 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'n-d-851337-3'} Aug 02 06:49:52.193857 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:49:52.199547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 02 06:49:52.201235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.202528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6de42014-e72d-488c-8841-8b54f972ee56 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:52.202528 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6de42014-e72d-488c-8841-8b54f972ee56 tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-851337-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009075 Aug 02 06:49:52.202528 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 568/1051] 10.222.0.79 () {58 vars in 1194 bytes} [Tue Aug 2 06:49:52 2022] GET /compute/v2.1/os-hosts/n-d-851337-3/shutdown => generated 113 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:49:52.205911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-451705f2-b371-4b34-a69e-e8a11d1c8874 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Calling method '.version_select at 0x7f928c3d9dc0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:52.217301 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-451705f2-b371-4b34-a69e-e8a11d1c8874 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-451705f2-b371-4b34-a69e-e8a11d1c8874 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Request method failure captured: Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MkPh8dXGenCQEbEewnr0k6-z_gyIUNCW50ZYOL0LS3-hKnimAYFKR4hGJ3WdF8-1YhtJkyyERI0MaWZeNwOk87TOoAXe_OICPgUFpAvij4vtTN518BRIYz6jFILsHdoAUJChrQXFvueUPl4aU3j_M0TuGgsNYRh5-z0JjeyU5Dp8jc Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:49:52.218998 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:49:52.220306 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b291131f849448a49c95604bacac90cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b291131f849448a49c95604bacac90cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}] Aug 02 06:49:52.220306 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:52.220306 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:52.220306 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:52.220306 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:52.220306 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:52.220306 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:52.220306 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 807fd73403df4c56acd7d7053bd66fa7 Aug 02 06:49:52.220306 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:52.220306 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:49:52.220306 n-d-851337-3 devstack@n-api.service[126120]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.220306 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'nonexistent_hostname'} Aug 02 06:49:52.220306 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:49:52.221400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 02 06:49:52.222820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:52.224075 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.224075 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.224075 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:52.224075 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.224075 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.224075 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.224075 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.224075 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:52.224075 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:52.224075 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:52.224075 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.224075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-451705f2-b371-4b34-a69e-e8a11d1c8874 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:52.224075 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-451705f2-b371-4b34-a69e-e8a11d1c8874 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.020211 Aug 02 06:49:52.224075 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 569/1052] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Aug 2 06:49:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:49:52.229111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fc340e8b-a9a0-46db-8813-64934644d8bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:52.229804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fc340e8b-a9a0-46db-8813-64934644d8bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:52.232026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:52.238279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc340e8b-a9a0-46db-8813-64934644d8bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:52.238855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc340e8b-a9a0-46db-8813-64934644d8bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:52.239728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc340e8b-a9a0-46db-8813-64934644d8bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:52.240436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc340e8b-a9a0-46db-8813-64934644d8bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:52.605721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4732d182-9c5c-46e5-a83e-818f2e88e699 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:52.608288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fc340e8b-a9a0-46db-8813-64934644d8bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:52.618978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fc340e8b-a9a0-46db-8813-64934644d8bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:52.619981 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4732d182-9c5c-46e5-a83e-818f2e88e699 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1317 microversion: 2.1 time: 0.744720 Aug 02 06:49:52.620529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fc340e8b-a9a0-46db-8813-64934644d8bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:52.621652 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fc340e8b-a9a0-46db-8813-64934644d8bb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1411 microversion: 2.25 time: 0.399594 Aug 02 06:49:52.622015 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 484/1053] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:51 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1317 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:52.637866 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 570/1054] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:52 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1411 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:52.643489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-68f1c651-e730-4c11-b5c2-adb02589f43a tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Calling method '.version_select at 0x7f927b412f70>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:52.645801 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:52.645801 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:49:52.648680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e4edbf76-a5a4-461a-a953-680df56a93b7 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:52.648905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-68f1c651-e730-4c11-b5c2-adb02589f43a tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'f16211727c0a4989a84941f1cb25cb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c0dc503344623b030b9e79a18c131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:52.650558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e4edbf76-a5a4-461a-a953-680df56a93b7 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-68f1c651-e730-4c11-b5c2-adb02589f43a tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Request method failure captured: Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-hosts/n-d-851337-3/startup HTTP/1.1 Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MkOQmAAKxoQgUnlD6ahNhiylkO2Ido4B8vldRwB9hLjmJuG8KlZcodtuTjPCkZg-01cILiznHuruiTd7gCm_cJbtCbOLwx994hQ4FBHkW30OSii0uPNDLeM4Ulfq68CwAB8aZTF-Hg5yqR4wDWb7K9bm_Azbt9QdrlXWjujfypUbN4 Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 6e0c0dc503344623b030b9e79a18c131 Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:49:52.651335 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:49:52.653011 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6e0c0dc503344623b030b9e79a18c131"}]}] Aug 02 06:49:52.653011 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.653011 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 6e0c0dc503344623b030b9e79a18c131 Aug 02 06:49:52.653011 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:52.653011 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-HostsAdminNegativeTestJSON-960201057-project Aug 02 06:49:52.653011 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:49:52.653011 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:49:52.653011 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: f16211727c0a4989a84941f1cb25cb1c Aug 02 06:49:52.653011 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-HostsAdminNegativeTestJSON-960201057-project Aug 02 06:49:52.653011 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:49:52.653011 n-d-851337-3 devstack@n-api.service[126119]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 02 06:49:52.653011 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'n-d-851337-3'} Aug 02 06:49:52.653011 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:49:52.654124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 02 06:49:52.655564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:52.658468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-68f1c651-e730-4c11-b5c2-adb02589f43a tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:52.658468 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-68f1c651-e730-4c11-b5c2-adb02589f43a tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-851337-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.029501 Aug 02 06:49:52.660996 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 485/1055] 10.222.0.79 () {58 vars in 1191 bytes} [Tue Aug 2 06:49:52 2022] GET /compute/v2.1/os-hosts/n-d-851337-3/startup => generated 110 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:52.661719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e4edbf76-a5a4-461a-a953-680df56a93b7 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:52.662288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e4edbf76-a5a4-461a-a953-680df56a93b7 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:52.663222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e4edbf76-a5a4-461a-a953-680df56a93b7 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:52.663707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e4edbf76-a5a4-461a-a953-680df56a93b7 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:52.667942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-00cbcf43-fa0d-4aac-a414-f9ef80c83849 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:52.668543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-00cbcf43-fa0d-4aac-a414-f9ef80c83849 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:52.677445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00cbcf43-fa0d-4aac-a414-f9ef80c83849 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:52.677927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00cbcf43-fa0d-4aac-a414-f9ef80c83849 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:52.679183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00cbcf43-fa0d-4aac-a414-f9ef80c83849 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:52.679667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00cbcf43-fa0d-4aac-a414-f9ef80c83849 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:53.090636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e4edbf76-a5a4-461a-a953-680df56a93b7 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:53.101749 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e4edbf76-a5a4-461a-a953-680df56a93b7 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 200 len: 1324 microversion: 2.1 time: 0.461311 Aug 02 06:49:53.103576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-00cbcf43-fa0d-4aac-a414-f9ef80c83849 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:53.104272 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 571/1056] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:52 2022] GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 1324 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:53.109396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a86c4ed8-7937-44fc-9fe3-15b60c2b390f tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Calling method '.version_select at 0x7f928c402940>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:53.110889 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:53.110889 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:49:53.122020 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-00cbcf43-fa0d-4aac-a414-f9ef80c83849 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1470 microversion: 2.1 time: 0.459841 Aug 02 06:49:53.122193 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-a86c4ed8-7937-44fc-9fe3-15b60c2b390f tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:53.123247 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 486/1057] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:52 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1470 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a86c4ed8-7937-44fc-9fe3-15b60c2b390f tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Request method failure captured: Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MkPh8dXGenCQEbEewnr0k6-z_gyIUNCW50ZYOL0LS3-hKnimAYFKR4hGJ3WdF8-1YhtJkyyERI0MaWZeNwOk87TOoAXe_OICPgUFpAvij4vtTN518BRIYz6jFILsHdoAUJChrQXFvueUPl4aU3j_M0TuGgsNYRh5-z0JjeyU5Dp8jc Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:49:53.124573 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:49:53.125970 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b291131f849448a49c95604bacac90cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b291131f849448a49c95604bacac90cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}] Aug 02 06:49:53.125970 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.125970 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:53.125970 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.125970 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:53.125970 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:53.125970 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:53.125970 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 807fd73403df4c56acd7d7053bd66fa7 Aug 02 06:49:53.125970 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:53.125970 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:49:53.125970 n-d-851337-3 devstack@n-api.service[126120]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:53.125970 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'nonexistent_hostname'} Aug 02 06:49:53.125970 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:49:53.126843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 02 06:49:53.127942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:53.129033 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:53.129033 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.129033 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:53.129033 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.129033 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.129033 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:53.129033 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:53.129033 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:53.129033 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:53.129033 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:53.129033 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.133545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a86c4ed8-7937-44fc-9fe3-15b60c2b390f tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:53.135031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8be2d8fc-4858-4ad8-b176-28d74fb5c491 req-fab41f3f-e689-4064-9f66-5646278b85f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1477c63-2792-4918-ae17-613e7850c874", "name": "network-vif-plugged", "status": "completed", "tag": "1cadd2c0-6321-4b11-ae6d-e1a6d8551eeb"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:53.135935 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a86c4ed8-7937-44fc-9fe3-15b60c2b390f tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.030536 Aug 02 06:49:53.142472 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 572/1058] 10.222.0.79 () {58 vars in 1215 bytes} [Tue Aug 2 06:49:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:49:53.151470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5eea70b2-a295-488d-a770-313f10bd9d87 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Action: 'update', calling method: .version_select at 0x7f927b0ca700>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:53.159481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8be2d8fc-4858-4ad8-b176-28d74fb5c491 req-fab41f3f-e689-4064-9f66-5646278b85f7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:53.159930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8be2d8fc-4858-4ad8-b176-28d74fb5c491 req-fab41f3f-e689-4064-9f66-5646278b85f7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5eea70b2-a295-488d-a770-313f10bd9d87 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Request method failure captured: Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: request: PUT /compute/v2.1/os-hosts/n-d-851337-3 HTTP/1.1 Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 51 Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MkPh8dXGenCQEbEewnr0k6-z_gyIUNCW50ZYOL0LS3-hKnimAYFKR4hGJ3WdF8-1YhtJkyyERI0MaWZeNwOk87TOoAXe_OICPgUFpAvij4vtTN518BRIYz6jFILsHdoAUJChrQXFvueUPl4aU3j_M0TuGgsNYRh5-z0JjeyU5Dp8jc Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:49:53.161371 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:49:53.162691 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b291131f849448a49c95604bacac90cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b291131f849448a49c95604bacac90cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}] Aug 02 06:49:53.162691 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.162691 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:53.162691 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.162691 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:53.162691 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:53.162691 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:53.162691 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 807fd73403df4c56acd7d7053bd66fa7 Aug 02 06:49:53.162691 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:53.162691 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:49:53.162691 n-d-851337-3 devstack@n-api.service[126120]: {"status": "enable", "maintenance_mode": "invalid"} Aug 02 06:49:53.162691 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:49:53.162691 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'n-d-851337-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'disable', Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'Enable', Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'Disable', Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance: Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'invalid' Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.163605 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.165126 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:53.166342 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:53.166342 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:49:53.166342 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:49:53.166342 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 02 06:49:53.166342 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.166342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5eea70b2-a295-488d-a770-313f10bd9d87 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:53.170785 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5eea70b2-a295-488d-a770-313f10bd9d87 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-851337-3" status: 400 len: 199 microversion: 2.1 time: 0.022297 Aug 02 06:49:53.171423 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 573/1059] 10.222.0.79 () {60 vars in 1187 bytes} [Tue Aug 2 06:49:53 2022] PUT /compute/v2.1/os-hosts/n-d-851337-3 => generated 199 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 06:49:53.186443 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8be2d8fc-4858-4ad8-b176-28d74fb5c491 req-fab41f3f-e689-4064-9f66-5646278b85f7 service nova] Creating event network-vif-plugged:1cadd2c0-6321-4b11-ae6d-e1a6d8551eeb for instance c1477c63-2792-4918-ae17-613e7850c874 on n-h1-851337-3 Aug 02 06:49:53.190109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-527ae0e2-d4ca-4258-9337-9051ac25f104 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Action: 'update', calling method: .version_select at 0x7f927b0eeaf0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:53.193649 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8be2d8fc-4858-4ad8-b176-28d74fb5c491 req-fab41f3f-e689-4064-9f66-5646278b85f7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068927 Aug 02 06:49:53.194942 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 487/1060] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-527ae0e2-d4ca-4258-9337-9051ac25f104 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Request method failure captured: Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: request: PUT /compute/v2.1/os-hosts/n-d-851337-3 HTTP/1.1 Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 51 Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MkPh8dXGenCQEbEewnr0k6-z_gyIUNCW50ZYOL0LS3-hKnimAYFKR4hGJ3WdF8-1YhtJkyyERI0MaWZeNwOk87TOoAXe_OICPgUFpAvij4vtTN518BRIYz6jFILsHdoAUJChrQXFvueUPl4aU3j_M0TuGgsNYRh5-z0JjeyU5Dp8jc Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:49:53.197602 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:49:53.199189 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b291131f849448a49c95604bacac90cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b291131f849448a49c95604bacac90cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}] Aug 02 06:49:53.199189 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.199189 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:53.199189 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.199189 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:53.199189 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:53.199189 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:53.199189 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 807fd73403df4c56acd7d7053bd66fa7 Aug 02 06:49:53.199189 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:53.199189 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:49:53.199189 n-d-851337-3 devstack@n-api.service[126120]: {"status": "invalid", "maintenance_mode": "enable"} Aug 02 06:49:53.199189 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:49:53.199189 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'n-d-851337-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'disable', Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'Enable', Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'Disable', Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance: Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'invalid' Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.199988 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.201442 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:53.202619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:53.202619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:49:53.202619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:49:53.202619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 02 06:49:53.202619 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.202619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-527ae0e2-d4ca-4258-9337-9051ac25f104 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:53.202619 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-527ae0e2-d4ca-4258-9337-9051ac25f104 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-851337-3" status: 400 len: 189 microversion: 2.1 time: 0.014617 Aug 02 06:49:53.205625 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 574/1061] 10.222.0.79 () {60 vars in 1187 bytes} [Tue Aug 2 06:49:53 2022] PUT /compute/v2.1/os-hosts/n-d-851337-3 => generated 189 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 06:49:53.211343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ea592041-c329-467c-add2-7db338a0c16e tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Action: 'update', calling method: .version_select at 0x7f927b1abdc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:53.215931 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:49:53.215931 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:49:53.218603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ea592041-c329-467c-add2-7db338a0c16e tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'f16211727c0a4989a84941f1cb25cb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0c0dc503344623b030b9e79a18c131', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ea592041-c329-467c-add2-7db338a0c16e tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Request method failure captured: Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: request: PUT /compute/v2.1/os-hosts/n-d-851337-3 HTTP/1.1 Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 50 Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MkOQmAAKxoQgUnlD6ahNhiylkO2Ido4B8vldRwB9hLjmJuG8KlZcodtuTjPCkZg-01cILiznHuruiTd7gCm_cJbtCbOLwx994hQ4FBHkW30OSii0uPNDLeM4Ulfq68CwAB8aZTF-Hg5yqR4wDWb7K9bm_Azbt9QdrlXWjujfypUbN4 Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 6e0c0dc503344623b030b9e79a18c131 Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:49:53.220368 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:49:53.227423 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6e0c0dc503344623b030b9e79a18c131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6e0c0dc503344623b030b9e79a18c131"}]}] Aug 02 06:49:53.227423 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:53.227423 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 6e0c0dc503344623b030b9e79a18c131 Aug 02 06:49:53.227423 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-960201057 Aug 02 06:49:53.227423 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-HostsAdminNegativeTestJSON-960201057-project Aug 02 06:49:53.227423 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:49:53.227423 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:49:53.227423 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: f16211727c0a4989a84941f1cb25cb1c Aug 02 06:49:53.227423 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-HostsAdminNegativeTestJSON-960201057-project Aug 02 06:49:53.227423 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:49:53.227423 n-d-851337-3 devstack@n-api.service[126119]: {"status": "enable", "maintenance_mode": "enable"} Aug 02 06:49:53.227423 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:49:53.227423 n-d-851337-3 devstack@n-api.service[126119]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 02 06:49:53.227423 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'n-d-851337-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:49:53.228989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 02 06:49:53.234842 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.238500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ea592041-c329-467c-add2-7db338a0c16e tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:53.238500 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ea592041-c329-467c-add2-7db338a0c16e tempest-HostsAdminNegativeTestJSON-960201057 tempest-HostsAdminNegativeTestJSON-960201057-project] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-851337-3" status: 403 len: 111 microversion: 2.1 time: 0.015103 Aug 02 06:49:53.238500 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 488/1062] 10.222.0.79 () {60 vars in 1187 bytes} [Tue Aug 2 06:49:53 2022] PUT /compute/v2.1/os-hosts/n-d-851337-3 => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:49:53.239060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-58b57241-071c-47c0-9d70-b5479d0166f2 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Action: 'update', calling method: .version_select at 0x7f928c402ca0>, body: {"status": null, "maintenance_mode": null} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-58b57241-071c-47c0-9d70-b5479d0166f2 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Request method failure captured: Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: request: PUT /compute/v2.1/os-hosts/n-d-851337-3 HTTP/1.1 Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 42 Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MkPh8dXGenCQEbEewnr0k6-z_gyIUNCW50ZYOL0LS3-hKnimAYFKR4hGJ3WdF8-1YhtJkyyERI0MaWZeNwOk87TOoAXe_OICPgUFpAvij4vtTN518BRIYz6jFILsHdoAUJChrQXFvueUPl4aU3j_M0TuGgsNYRh5-z0JjeyU5Dp8jc Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:49:53.240669 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:49:53.243784 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b291131f849448a49c95604bacac90cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b291131f849448a49c95604bacac90cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}] Aug 02 06:49:53.243784 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.243784 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:53.243784 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.243784 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:53.243784 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:53.243784 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:53.243784 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 807fd73403df4c56acd7d7053bd66fa7 Aug 02 06:49:53.243784 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:53.243784 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:49:53.243784 n-d-851337-3 devstack@n-api.service[126120]: {"status": null, "maintenance_mode": null} Aug 02 06:49:53.243784 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:49:53.243784 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 02 06:49:53.243784 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'n-d-851337-3', 'body': {'status': None, 'maintenance_mode': None}} Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'disable', Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'Enable', Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'Disable', Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance: Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi None Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:53.245885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:53.249438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:53.254013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:49:53.254013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:49:53.254013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 02 06:49:53.254013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.254013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-58b57241-071c-47c0-9d70-b5479d0166f2 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:53.254013 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-58b57241-071c-47c0-9d70-b5479d0166f2 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-851337-3" status: 400 len: 127 microversion: 2.1 time: 0.013641 Aug 02 06:49:53.254874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0c57294-42c2-4117-b657-046efa86bc67 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Action: 'update', calling method: .version_select at 0x7f927b036160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:53.260567 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.hosts [None req-d0c57294-42c2-4117-b657-046efa86bc67 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Enabling host nonexistent_hostname. Aug 02 06:49:53.264696 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 575/1063] 10.222.0.79 () {60 vars in 1187 bytes} [Tue Aug 2 06:49:53 2022] PUT /compute/v2.1/os-hosts/n-d-851337-3 => generated 127 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:49:53.269494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-976d95b3-043f-40dd-a15e-9c4b591ca633 req-c73b7276-c02a-4f15-a01b-860a8adad0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62927d0b-7f85-4ce4-a606-2c0ddb2b896e", "tag": "cbca7b5a-a5a7-4e60-8b1c-996099aebce3"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:53.278378 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-d0c57294-42c2-4117-b657-046efa86bc67 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0c57294-42c2-4117-b657-046efa86bc67 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Request method failure captured: Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 50 Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MkPh8dXGenCQEbEewnr0k6-z_gyIUNCW50ZYOL0LS3-hKnimAYFKR4hGJ3WdF8-1YhtJkyyERI0MaWZeNwOk87TOoAXe_OICPgUFpAvij4vtTN518BRIYz6jFILsHdoAUJChrQXFvueUPl4aU3j_M0TuGgsNYRh5-z0JjeyU5Dp8jc Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:49:53.281635 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:49:53.283183 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b291131f849448a49c95604bacac90cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b291131f849448a49c95604bacac90cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b291131f849448a49c95604bacac90cb"}]}] Aug 02 06:49:53.283183 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.283183 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: b291131f849448a49c95604bacac90cb Aug 02 06:49:53.283183 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591072157 Aug 02 06:49:53.283183 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:53.283183 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:49:53.283183 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:49:53.283183 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 807fd73403df4c56acd7d7053bd66fa7 Aug 02 06:49:53.283183 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591072157-project-admin Aug 02 06:49:53.283183 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:49:53.283183 n-d-851337-3 devstack@n-api.service[126119]: {"status": "enable", "maintenance_mode": "enable"} Aug 02 06:49:53.283183 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:49:53.283183 n-d-851337-3 devstack@n-api.service[126119]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:53.283183 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 02 06:49:53.284026 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:49:53.285150 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 02 06:49:53.286455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 02 06:49:53.286455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 02 06:49:53.286455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:53.286455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:53.286455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.286455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:53.286455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.286455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:53.286455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:53.286455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:53.286455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:53.286455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:53.286455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 02 06:49:53.286455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:53.288669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0c57294-42c2-4117-b657-046efa86bc67 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:53.290470 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d0c57294-42c2-4117-b657-046efa86bc67 tempest-HostsAdminNegativeTestJSON-1591072157 tempest-HostsAdminNegativeTestJSON-1591072157-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039573 Aug 02 06:49:53.291863 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 489/1064] 10.222.0.79 () {60 vars in 1211 bytes} [Tue Aug 2 06:49:53 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 02 06:49:53.312898 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-976d95b3-043f-40dd-a15e-9c4b591ca633 req-c73b7276-c02a-4f15-a01b-860a8adad0d0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:53.313349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-976d95b3-043f-40dd-a15e-9c4b591ca633 req-c73b7276-c02a-4f15-a01b-860a8adad0d0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:53.329226 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-976d95b3-043f-40dd-a15e-9c4b591ca633 req-c73b7276-c02a-4f15-a01b-860a8adad0d0 service nova] Creating event network-changed:cbca7b5a-a5a7-4e60-8b1c-996099aebce3 for instance 62927d0b-7f85-4ce4-a606-2c0ddb2b896e on n-h1-851337-3 Aug 02 06:49:53.334730 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-976d95b3-043f-40dd-a15e-9c4b591ca633 req-c73b7276-c02a-4f15-a01b-860a8adad0d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068839 Aug 02 06:49:53.335650 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 576/1065] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:53.644466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1b1ea631-d0e2-449a-9111-7ee1188bbbf6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:53.646075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1b1ea631-d0e2-449a-9111-7ee1188bbbf6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:53.653791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b1ea631-d0e2-449a-9111-7ee1188bbbf6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:53.654311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b1ea631-d0e2-449a-9111-7ee1188bbbf6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:53.655210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b1ea631-d0e2-449a-9111-7ee1188bbbf6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:53.655748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b1ea631-d0e2-449a-9111-7ee1188bbbf6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:53.671228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-430337772", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:53.738613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:49:54.071946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1b1ea631-d0e2-449a-9111-7ee1188bbbf6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:54.080372 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1b1ea631-d0e2-449a-9111-7ee1188bbbf6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1317 microversion: 2.1 time: 0.440288 Aug 02 06:49:54.080928 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 577/1066] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:53 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:54.085841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b82a99c8-3f5d-44a1-abed-ef9f7ae2a34c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:54.086456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b82a99c8-3f5d-44a1-abed-ef9f7ae2a34c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:54.093044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b82a99c8-3f5d-44a1-abed-ef9f7ae2a34c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:54.093791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b82a99c8-3f5d-44a1-abed-ef9f7ae2a34c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:54.094731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b82a99c8-3f5d-44a1-abed-ef9f7ae2a34c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:54.095471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b82a99c8-3f5d-44a1-abed-ef9f7ae2a34c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:54.282135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:49:54.282568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:49:54.283283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:49:54.283697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:49:54.284108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:49:54.294013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:54.294462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:54.295394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:54.295956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:54.314059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Getting quotas for project 59657b9384a5459982ab107427b52c49. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:49:54.316335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b82a99c8-3f5d-44a1-abed-ef9f7ae2a34c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:54.319503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Getting quotas for user ce9ac912dfe54f3783fa943de17bcef7 and project 59657b9384a5459982ab107427b52c49. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:49:54.324526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b82a99c8-3f5d-44a1-abed-ef9f7ae2a34c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:54.326061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b82a99c8-3f5d-44a1-abed-ef9f7ae2a34c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:54.327178 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b82a99c8-3f5d-44a1-abed-ef9f7ae2a34c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1411 microversion: 2.25 time: 0.245342 Aug 02 06:49:54.327726 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 578/1067] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:54 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1411 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:54.332354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fb7c62b0-2d23-44d4-b5f5-03b6844bb761 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:54.333189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fb7c62b0-2d23-44d4-b5f5-03b6844bb761 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:54.335628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:49:54.338263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:49:54.339795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb7c62b0-2d23-44d4-b5f5-03b6844bb761 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:54.340407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb7c62b0-2d23-44d4-b5f5-03b6844bb761 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:54.341336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb7c62b0-2d23-44d4-b5f5-03b6844bb761 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:54.341949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb7c62b0-2d23-44d4-b5f5-03b6844bb761 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:54.392844 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6edce41c-6480-45d6-917e-b4ff9cf643a8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842535 Aug 02 06:49:54.393868 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 490/1068] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:49:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:49:54.398738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1736cda2-dd5c-40a9-bebf-3d3fa311bb30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:54.399347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1736cda2-dd5c-40a9-bebf-3d3fa311bb30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:54.406369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1736cda2-dd5c-40a9-bebf-3d3fa311bb30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:54.406814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1736cda2-dd5c-40a9-bebf-3d3fa311bb30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:54.407589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1736cda2-dd5c-40a9-bebf-3d3fa311bb30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:54.408019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1736cda2-dd5c-40a9-bebf-3d3fa311bb30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:54.570761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fb7c62b0-2d23-44d4-b5f5-03b6844bb761 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:54.587486 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fb7c62b0-2d23-44d4-b5f5-03b6844bb761 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 200 len: 1521 microversion: 2.1 time: 0.258538 Aug 02 06:49:54.588397 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 579/1069] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:54 2022] GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:54.593175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0d60bfcb-8d06-4021-a563-360f42da30a4 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:54.597874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0d60bfcb-8d06-4021-a563-360f42da30a4 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:54.648074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1736cda2-dd5c-40a9-bebf-3d3fa311bb30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:54.656787 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1736cda2-dd5c-40a9-bebf-3d3fa311bb30 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1470 microversion: 2.1 time: 0.261863 Aug 02 06:49:54.658363 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 491/1070] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:54 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1470 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:54.664849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-32049bcb-6046-4de8-b0c1-5f7901418b10 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:54.669293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0d60bfcb-8d06-4021-a563-360f42da30a4 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:54.671608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-32049bcb-6046-4de8-b0c1-5f7901418b10 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:54.680191 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0d60bfcb-8d06-4021-a563-360f42da30a4 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1216 microversion: 2.1 time: 0.090487 Aug 02 06:49:54.683398 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 580/1071] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:54 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1216 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:54.684773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32049bcb-6046-4de8-b0c1-5f7901418b10 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:54.686602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32049bcb-6046-4de8-b0c1-5f7901418b10 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:54.690752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32049bcb-6046-4de8-b0c1-5f7901418b10 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:54.691380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32049bcb-6046-4de8-b0c1-5f7901418b10 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:54.724009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-32049bcb-6046-4de8-b0c1-5f7901418b10 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:49:54.819307 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-32049bcb-6046-4de8-b0c1-5f7901418b10 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 204 len: 0 microversion: 2.1 time: 0.159205 Aug 02 06:49:54.820032 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 492/1072] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:49:54 2022] DELETE /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:49:54.832725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bccb062e-b6c9-42ab-9acd-a155cce54733 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:54.833506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bccb062e-b6c9-42ab-9acd-a155cce54733 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:54.841027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bccb062e-b6c9-42ab-9acd-a155cce54733 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:54.841463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bccb062e-b6c9-42ab-9acd-a155cce54733 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:54.842504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bccb062e-b6c9-42ab-9acd-a155cce54733 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:54.843291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bccb062e-b6c9-42ab-9acd-a155cce54733 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:54.995641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bccb062e-b6c9-42ab-9acd-a155cce54733 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:55.003647 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bccb062e-b6c9-42ab-9acd-a155cce54733 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 200 len: 1527 microversion: 2.1 time: 0.175953 Aug 02 06:49:55.004218 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 581/1073] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:54 2022] GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 1527 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:55.103852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-317320c6-8096-4d06-abfe-40008d70d97d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:55.104922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-317320c6-8096-4d06-abfe-40008d70d97d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:55.112233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-317320c6-8096-4d06-abfe-40008d70d97d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:55.112699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-317320c6-8096-4d06-abfe-40008d70d97d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:55.113473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-317320c6-8096-4d06-abfe-40008d70d97d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:55.113921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-317320c6-8096-4d06-abfe-40008d70d97d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:55.278609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-317320c6-8096-4d06-abfe-40008d70d97d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:55.286387 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-317320c6-8096-4d06-abfe-40008d70d97d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1317 microversion: 2.1 time: 0.186996 Aug 02 06:49:55.287404 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 493/1074] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:55 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:55.349932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4d427b00-0a84-4f49-b0e6-14a421043e76 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:55.350801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4d427b00-0a84-4f49-b0e6-14a421043e76 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:55.357420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d427b00-0a84-4f49-b0e6-14a421043e76 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:55.357861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d427b00-0a84-4f49-b0e6-14a421043e76 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:55.358694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d427b00-0a84-4f49-b0e6-14a421043e76 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:55.359159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d427b00-0a84-4f49-b0e6-14a421043e76 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:55.493127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4d427b00-0a84-4f49-b0e6-14a421043e76 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:55.502034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4d427b00-0a84-4f49-b0e6-14a421043e76 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:55.503522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4d427b00-0a84-4f49-b0e6-14a421043e76 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:55.504727 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4d427b00-0a84-4f49-b0e6-14a421043e76 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1411 microversion: 2.25 time: 0.158802 Aug 02 06:49:55.505280 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 582/1075] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:55 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:55.679523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d23d6d37-795d-4b73-90ee-8ca1e5195039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:55.680146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d23d6d37-795d-4b73-90ee-8ca1e5195039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:55.687938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d23d6d37-795d-4b73-90ee-8ca1e5195039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:55.688579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d23d6d37-795d-4b73-90ee-8ca1e5195039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:55.689226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d23d6d37-795d-4b73-90ee-8ca1e5195039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:55.689659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d23d6d37-795d-4b73-90ee-8ca1e5195039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:55.700723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-62fbe127-8141-4c97-a554-32704be942cc tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:55.701378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-62fbe127-8141-4c97-a554-32704be942cc tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:55.709111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62fbe127-8141-4c97-a554-32704be942cc tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:55.709559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62fbe127-8141-4c97-a554-32704be942cc tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:55.710711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62fbe127-8141-4c97-a554-32704be942cc tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:55.710841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62fbe127-8141-4c97-a554-32704be942cc tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:55.792246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-62fbe127-8141-4c97-a554-32704be942cc tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:55.800912 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-62fbe127-8141-4c97-a554-32704be942cc tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1220 microversion: 2.1 time: 0.104112 Aug 02 06:49:55.801515 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 583/1076] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:55 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:49:55.859635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d23d6d37-795d-4b73-90ee-8ca1e5195039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:55.867330 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d23d6d37-795d-4b73-90ee-8ca1e5195039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1470 microversion: 2.1 time: 0.191978 Aug 02 06:49:55.867906 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 494/1077] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:55 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:56.025048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-de59c00f-d563-4c00-8b3d-b33eda90af8d tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:56.025802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-de59c00f-d563-4c00-8b3d-b33eda90af8d tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:56.032413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de59c00f-d563-4c00-8b3d-b33eda90af8d tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:56.032977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de59c00f-d563-4c00-8b3d-b33eda90af8d tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:56.033753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de59c00f-d563-4c00-8b3d-b33eda90af8d tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:56.034267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de59c00f-d563-4c00-8b3d-b33eda90af8d tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:56.164689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-de59c00f-d563-4c00-8b3d-b33eda90af8d tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:56.172380 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-de59c00f-d563-4c00-8b3d-b33eda90af8d tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 200 len: 1527 microversion: 2.1 time: 0.151376 Aug 02 06:49:56.172949 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 584/1078] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:56 2022] GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 1527 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:56.309873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6aad96a1-42dd-4a57-9eb3-34541e1a5be6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:56.310663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6aad96a1-42dd-4a57-9eb3-34541e1a5be6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:56.317403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6aad96a1-42dd-4a57-9eb3-34541e1a5be6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:56.317844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6aad96a1-42dd-4a57-9eb3-34541e1a5be6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:56.321152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6aad96a1-42dd-4a57-9eb3-34541e1a5be6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:56.323331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6aad96a1-42dd-4a57-9eb3-34541e1a5be6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:56.528149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2056631f-a9d9-4b99-8f56-8a0fd127d619 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:56.529468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2056631f-a9d9-4b99-8f56-8a0fd127d619 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:56.535667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2056631f-a9d9-4b99-8f56-8a0fd127d619 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:56.536383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2056631f-a9d9-4b99-8f56-8a0fd127d619 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:56.537206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2056631f-a9d9-4b99-8f56-8a0fd127d619 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:56.537702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2056631f-a9d9-4b99-8f56-8a0fd127d619 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:56.547022 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6aad96a1-42dd-4a57-9eb3-34541e1a5be6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:56.561649 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6aad96a1-42dd-4a57-9eb3-34541e1a5be6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1317 microversion: 2.1 time: 0.256996 Aug 02 06:49:56.562806 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 495/1079] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:56 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:56.757841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2056631f-a9d9-4b99-8f56-8a0fd127d619 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:56.770574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2056631f-a9d9-4b99-8f56-8a0fd127d619 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:56.772178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2056631f-a9d9-4b99-8f56-8a0fd127d619 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:56.773539 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2056631f-a9d9-4b99-8f56-8a0fd127d619 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1411 microversion: 2.25 time: 0.249228 Aug 02 06:49:56.788258 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 585/1080] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:56 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1411 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:49:56.822773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-83d865f4-e0b3-4970-b5ac-801c85aafdce tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:56.823673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-83d865f4-e0b3-4970-b5ac-801c85aafdce tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:56.830551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-83d865f4-e0b3-4970-b5ac-801c85aafdce tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:56.830997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-83d865f4-e0b3-4970-b5ac-801c85aafdce tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:56.831779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-83d865f4-e0b3-4970-b5ac-801c85aafdce tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:56.832197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-83d865f4-e0b3-4970-b5ac-801c85aafdce tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:56.889502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cff9edd7-36fc-4c72-974f-804ad49bf582 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:56.890437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cff9edd7-36fc-4c72-974f-804ad49bf582 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:56.897651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cff9edd7-36fc-4c72-974f-804ad49bf582 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:56.898139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cff9edd7-36fc-4c72-974f-804ad49bf582 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:56.898915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cff9edd7-36fc-4c72-974f-804ad49bf582 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:56.899411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cff9edd7-36fc-4c72-974f-804ad49bf582 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:56.914469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-83d865f4-e0b3-4970-b5ac-801c85aafdce tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:56.924577 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-83d865f4-e0b3-4970-b5ac-801c85aafdce tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1220 microversion: 2.1 time: 0.106534 Aug 02 06:49:56.925381 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 496/1081] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:56 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1220 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:57.114585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cff9edd7-36fc-4c72-974f-804ad49bf582 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:57.124476 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cff9edd7-36fc-4c72-974f-804ad49bf582 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1470 microversion: 2.1 time: 0.239247 Aug 02 06:49:57.125376 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 586/1082] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:56 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:57.133583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6e642f47-532c-40be-bec3-2e8b8dd2596b req-78dbd309-f856-483a-ade9-22ba5b445471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3cf2f0-d6c3-48fa-8846-9e6ac9622220", "name": "network-vif-deleted", "tag": "a1df2f8c-99bc-49b6-8596-fe6113bfa182"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:57.150786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6e642f47-532c-40be-bec3-2e8b8dd2596b req-78dbd309-f856-483a-ade9-22ba5b445471 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:57.151006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6e642f47-532c-40be-bec3-2e8b8dd2596b req-78dbd309-f856-483a-ade9-22ba5b445471 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:57.163978 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-6e642f47-532c-40be-bec3-2e8b8dd2596b req-78dbd309-f856-483a-ade9-22ba5b445471 service nova] Creating event network-vif-deleted:a1df2f8c-99bc-49b6-8596-fe6113bfa182 for instance 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 on n-h2-851337-3 Aug 02 06:49:57.169723 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6e642f47-532c-40be-bec3-2e8b8dd2596b req-78dbd309-f856-483a-ade9-22ba5b445471 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042950 Aug 02 06:49:57.170344 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 587/1083] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:57.172915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8b538992-790c-4a81-b8ce-98c1b233715d tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Calling method '.version_select at 0x7f927b09ce50>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:57.200381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-30fd6f2a-739c-4b25-a941-92fd5606d8e4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:57.202741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-30fd6f2a-739c-4b25-a941-92fd5606d8e4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:57.215502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30fd6f2a-739c-4b25-a941-92fd5606d8e4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:57.218357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30fd6f2a-739c-4b25-a941-92fd5606d8e4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:57.219336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30fd6f2a-739c-4b25-a941-92fd5606d8e4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:57.219945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30fd6f2a-739c-4b25-a941-92fd5606d8e4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:57.223475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:57.237923 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8b538992-790c-4a81-b8ce-98c1b233715d tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/5d84c394f942481a9aa9a0c2ebb40102" status: 200 len: 371 microversion: 2.1 time: 0.234215 Aug 02 06:49:57.238806 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 497/1084] 10.222.0.79 () {58 vars in 1242 bytes} [Tue Aug 2 06:49:57 2022] GET /compute/v2.1/os-quota-sets/5d84c394f942481a9aa9a0c2ebb40102 => generated 371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:57.249863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8ad3a5b0-7d01-4e57-83c9-602836345a5c tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Action: 'update', calling method: .version_select at 0x7f927b035b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:57.255455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30fd6f2a-739c-4b25-a941-92fd5606d8e4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:57.255906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30fd6f2a-739c-4b25-a941-92fd5606d8e4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:57.256350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-30fd6f2a-739c-4b25-a941-92fd5606d8e4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lazy-loading 'fault' on Instance uuid 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:49:57.299451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-30fd6f2a-739c-4b25-a941-92fd5606d8e4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b519574e86e841c3a31851e1f4657dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a972437b40d745b2a16e01593bfaa1e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:57.307063 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-30fd6f2a-739c-4b25-a941-92fd5606d8e4 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 200 len: 1314 microversion: 2.1 time: 0.117436 Aug 02 06:49:57.307724 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 588/1085] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:57 2022] GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 1314 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:57.311908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ad3a5b0-7d01-4e57-83c9-602836345a5c tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:57.312359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ad3a5b0-7d01-4e57-83c9-602836345a5c tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:57.313150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ad3a5b0-7d01-4e57-83c9-602836345a5c tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:57.313580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ad3a5b0-7d01-4e57-83c9-602836345a5c tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:57.361622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:57.366295 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8ad3a5b0-7d01-4e57-83c9-602836345a5c tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/5d84c394f942481a9aa9a0c2ebb40102" status: 200 len: 328 microversion: 2.1 time: 0.119919 Aug 02 06:49:57.366921 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 498/1086] 10.222.0.79 () {60 vars in 1262 bytes} [Tue Aug 2 06:49:57 2022] PUT /compute/v2.1/os-quota-sets/5d84c394f942481a9aa9a0c2ebb40102 => generated 328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:49:57.378106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1e409f1e-dfea-44e6-850b-c71169f361cb tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:57.392541 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1e409f1e-dfea-44e6-850b-c71169f361cb tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-quota-sets/5d84c394f942481a9aa9a0c2ebb40102" status: 202 len: 0 microversion: 2.1 time: 0.018240 Aug 02 06:49:57.393120 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 589/1087] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 06:49:57 2022] DELETE /compute/v2.1/os-quota-sets/5d84c394f942481a9aa9a0c2ebb40102 => generated 0 bytes in 20 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:49:57.401094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-118c462f-b745-4066-926b-a8fd3e584eed tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Calling method '.version_select at 0x7f927b036ee0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:57.469060 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-118c462f-b745-4066-926b-a8fd3e584eed tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/5d84c394f942481a9aa9a0c2ebb40102" status: 200 len: 371 microversion: 2.1 time: 0.071641 Aug 02 06:49:57.469625 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 499/1088] 10.222.0.79 () {58 vars in 1242 bytes} [Tue Aug 2 06:49:57 2022] GET /compute/v2.1/os-quota-sets/5d84c394f942481a9aa9a0c2ebb40102 => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:57.583340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9953ed56-e8b7-4c3e-9987-fdb3fb4c20e1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:57.584143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9953ed56-e8b7-4c3e-9987-fdb3fb4c20e1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:57.591487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9953ed56-e8b7-4c3e-9987-fdb3fb4c20e1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:57.592235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9953ed56-e8b7-4c3e-9987-fdb3fb4c20e1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:57.593061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9953ed56-e8b7-4c3e-9987-fdb3fb4c20e1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:57.593611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9953ed56-e8b7-4c3e-9987-fdb3fb4c20e1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:57.598491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7d07fbff-7785-4422-b767-e1bcbbf38a6d tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Calling method '.version_select at 0x7f927b0948b0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:57.731867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9953ed56-e8b7-4c3e-9987-fdb3fb4c20e1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:57.739778 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9953ed56-e8b7-4c3e-9987-fdb3fb4c20e1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1317 microversion: 2.1 time: 0.160477 Aug 02 06:49:57.740563 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 590/1089] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:57 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:57.782775 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7d07fbff-7785-4422-b767-e1bcbbf38a6d tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/ab7a79ad3ed6474b9496f16abfeee99e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.187533 Aug 02 06:49:57.783705 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 500/1090] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 06:49:57 2022] GET /compute/v2.1/os-quota-sets/ab7a79ad3ed6474b9496f16abfeee99e/defaults => generated 371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:57.796995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ad07fbfc-2ffc-4894-9a7b-99554c347ebc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:57.797612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ad07fbfc-2ffc-4894-9a7b-99554c347ebc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:57.804528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad07fbfc-2ffc-4894-9a7b-99554c347ebc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:57.804906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad07fbfc-2ffc-4894-9a7b-99554c347ebc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:57.805666 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad07fbfc-2ffc-4894-9a7b-99554c347ebc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:57.806525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad07fbfc-2ffc-4894-9a7b-99554c347ebc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:57.944672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-06b4c6b2-de1b-4a6f-9485-d645bf6b8034 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:57.946152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-06b4c6b2-de1b-4a6f-9485-d645bf6b8034 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:57.952695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06b4c6b2-de1b-4a6f-9485-d645bf6b8034 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:57.953128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06b4c6b2-de1b-4a6f-9485-d645bf6b8034 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:57.954265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06b4c6b2-de1b-4a6f-9485-d645bf6b8034 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:57.954878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06b4c6b2-de1b-4a6f-9485-d645bf6b8034 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:57.961105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ad07fbfc-2ffc-4894-9a7b-99554c347ebc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:57.969802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ad07fbfc-2ffc-4894-9a7b-99554c347ebc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:57.971577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ad07fbfc-2ffc-4894-9a7b-99554c347ebc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:57.972846 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ad07fbfc-2ffc-4894-9a7b-99554c347ebc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1411 microversion: 2.25 time: 0.180212 Aug 02 06:49:57.973419 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 591/1091] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:57 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1411 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:49:58.048284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bccfae3b-e3a1-4abe-8243-df603a81dc0e tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Action: 'update', calling method: .version_select at 0x7f928c3d98b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:58.086253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-06b4c6b2-de1b-4a6f-9485-d645bf6b8034 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:58.094215 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-06b4c6b2-de1b-4a6f-9485-d645bf6b8034 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1212 microversion: 2.1 time: 0.153440 Aug 02 06:49:58.094801 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 501/1092] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:57 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1212 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:49:58.145920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5ed430cd-27fc-48ac-9753-066debe42273 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:58.146559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5ed430cd-27fc-48ac-9753-066debe42273 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:58.153276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ed430cd-27fc-48ac-9753-066debe42273 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.153718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ed430cd-27fc-48ac-9753-066debe42273 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.154506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ed430cd-27fc-48ac-9753-066debe42273 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.154937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ed430cd-27fc-48ac-9753-066debe42273 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.195162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=25 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:49:58.200606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bccfae3b-e3a1-4abe-8243-df603a81dc0e tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.201126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bccfae3b-e3a1-4abe-8243-df603a81dc0e tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.202080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bccfae3b-e3a1-4abe-8243-df603a81dc0e tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.202733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bccfae3b-e3a1-4abe-8243-df603a81dc0e tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.265907 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bccfae3b-e3a1-4abe-8243-df603a81dc0e tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/b1336984da1c4571a08c097cbc092db7" status: 200 len: 328 microversion: 2.1 time: 0.221586 Aug 02 06:49:58.270085 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 592/1093] 10.222.0.79 () {60 vars in 1262 bytes} [Tue Aug 2 06:49:58 2022] PUT /compute/v2.1/os-quota-sets/b1336984da1c4571a08c097cbc092db7 => generated 328 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:58.288101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5b8373da-b8de-4410-bfde-7b47d8a6f623 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Calling method '.version_select at 0x7f927b2bc790>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:58.379031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b8373da-b8de-4410-bfde-7b47d8a6f623 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.379482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b8373da-b8de-4410-bfde-7b47d8a6f623 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.380346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b8373da-b8de-4410-bfde-7b47d8a6f623 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.381847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b8373da-b8de-4410-bfde-7b47d8a6f623 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.405929 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5b8373da-b8de-4410-bfde-7b47d8a6f623 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/b1336984da1c4571a08c097cbc092db7/detail" status: 200 len: 916 microversion: 2.1 time: 0.131108 Aug 02 06:49:58.406725 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 593/1094] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 06:49:58 2022] GET /compute/v2.1/os-quota-sets/b1336984da1c4571a08c097cbc092db7/detail => generated 916 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:58.411763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7d5eb433-8fe8-4724-a21d-245112609bd1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:58.412353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7d5eb433-8fe8-4724-a21d-245112609bd1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:58.420218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d5eb433-8fe8-4724-a21d-245112609bd1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.420696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d5eb433-8fe8-4724-a21d-245112609bd1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.421535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d5eb433-8fe8-4724-a21d-245112609bd1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.421923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d5eb433-8fe8-4724-a21d-245112609bd1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.436138 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-7d5eb433-8fe8-4724-a21d-245112609bd1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] HTTP exception thrown: Instance 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 could not be found. Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7d5eb433-8fe8-4724-a21d-245112609bd1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Request method failure captured: Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 HTTP/1.1 Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mics1p1wCl4AqIUegQm3d_pITBwYatFLhRipYelRyLmShzntTbvDif13hJU68Dr75PS5-_PVH2rlUrC3GCvZKy-mXcsTS2uVfBsDy9F9AEKbH8bLuQNqUkYQSS9whNQEqNGjlGMPbf7vASEghxC68ftUIES6H21F7o83_JNpyen0zM Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:49:58.437848 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:49:58.439449 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}] Aug 02 06:49:58.439449 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:58.439449 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:49:58.439449 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:58.439449 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:49:58.439449 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:58.439449 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:58.439449 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b519574e86e841c3a31851e1f4657dd8 Aug 02 06:49:58.439449 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:49:58.439449 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:49:58.439449 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 could not be found. Aug 02 06:49:58.439449 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '9b3cf2f0-d6c3-48fa-8846-9e6ac9622220'} Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 could not be found. Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:58.440333 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 could not be found. Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 could not be found. Aug 02 06:49:58.441771 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.444957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7d5eb433-8fe8-4724-a21d-245112609bd1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Returning 404 to user: Instance 9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:58.444957 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7d5eb433-8fe8-4724-a21d-245112609bd1 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220" status: 404 len: 111 microversion: 2.1 time: 0.031611 Aug 02 06:49:58.444957 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 594/1095] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:58 2022] GET /compute/v2.1/servers/9b3cf2f0-d6c3-48fa-8846-9e6ac9622220 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:58.447864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c21fe74-e6ae-468f-bdfa-fc180a275cf3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '.version_select at 0x7f927b795550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:58.460182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5ed430cd-27fc-48ac-9753-066debe42273 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:58.470868 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-1c21fe74-e6ae-468f-bdfa-fc180a275cf3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] HTTP exception thrown: Image not found. Aug 02 06:49:58.471503 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5ed430cd-27fc-48ac-9753-066debe42273 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1470 microversion: 2.1 time: 0.328753 Aug 02 06:49:58.472276 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 502/1096] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:58 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1470 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c21fe74-e6ae-468f-bdfa-fc180a275cf3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Request method failure captured: Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/images/28ffb600-577c-4ba2-9854-9d1ef771f16c HTTP/1.1 Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mics1p1wCl4AqIUegQm3d_pITBwYatFLhRipYelRyLmShzntTbvDif13hJU68Dr75PS5-_PVH2rlUrC3GCvZKy-mXcsTS2uVfBsDy9F9AEKbH8bLuQNqUkYQSS9whNQEqNGjlGMPbf7vASEghxC68ftUIES6H21F7o83_JNpyen0zM Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:49:58.472689 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:49:58.474406 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}] Aug 02 06:49:58.474406 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:58.474406 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:49:58.474406 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:58.474406 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:49:58.474406 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:58.474406 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:58.474406 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b519574e86e841c3a31851e1f4657dd8 Aug 02 06:49:58.474406 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:49:58.474406 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:49:58.474406 n-d-851337-3 devstack@n-api.service[126120]: exception: Image not found. Aug 02 06:49:58.474406 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '28ffb600-577c-4ba2-9854-9d1ef771f16c'} Aug 02 06:49:58.474406 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 28ffb600-577c-4ba2-9854-9d1ef771f16c to delete Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:58.475555 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 28ffb600-577c-4ba2-9854-9d1ef771f16c could not be found. Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:58.477194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c21fe74-e6ae-468f-bdfa-fc180a275cf3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Returning 404 to user: Image not found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:58.478870 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1c21fe74-e6ae-468f-bdfa-fc180a275cf3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "DELETE /compute/v2.1/images/28ffb600-577c-4ba2-9854-9d1ef771f16c" status: 404 len: 62 microversion: 2.1 time: 0.030127 Aug 02 06:49:58.482025 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 595/1097] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:58 2022] DELETE /compute/v2.1/images/28ffb600-577c-4ba2-9854-9d1ef771f16c => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:49:58.483839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c7f05c21-5ed6-4047-8f0c-fd4c6632eb48 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:58.484494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c7f05c21-5ed6-4047-8f0c-fd4c6632eb48 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:58.491883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7f05c21-5ed6-4047-8f0c-fd4c6632eb48 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.492615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7f05c21-5ed6-4047-8f0c-fd4c6632eb48 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.493963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7f05c21-5ed6-4047-8f0c-fd4c6632eb48 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.495179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7f05c21-5ed6-4047-8f0c-fd4c6632eb48 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.511440 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-c7f05c21-5ed6-4047-8f0c-fd4c6632eb48 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] HTTP exception thrown: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c7f05c21-5ed6-4047-8f0c-fd4c6632eb48 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Request method failure captured: Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c HTTP/1.1 Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mics1p1wCl4AqIUegQm3d_pITBwYatFLhRipYelRyLmShzntTbvDif13hJU68Dr75PS5-_PVH2rlUrC3GCvZKy-mXcsTS2uVfBsDy9F9AEKbH8bLuQNqUkYQSS9whNQEqNGjlGMPbf7vASEghxC68ftUIES6H21F7o83_JNpyen0zM Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:49:58.513415 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:49:58.514781 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}] Aug 02 06:49:58.514781 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:58.514781 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:49:58.514781 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:58.514781 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:49:58.514781 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:49:58.514781 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:49:58.514781 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b519574e86e841c3a31851e1f4657dd8 Aug 02 06:49:58.514781 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:49:58.514781 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:49:58.514781 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:58.514781 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '52787eee-3cd0-49f7-a881-16d055348a8c'} Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:58.515824 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:58.517184 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.518794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c7f05c21-5ed6-4047-8f0c-fd4c6632eb48 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Returning 404 to user: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:58.518794 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c7f05c21-5ed6-4047-8f0c-fd4c6632eb48 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "DELETE /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 404 len: 111 microversion: 2.1 time: 0.035267 Aug 02 06:49:58.523586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3de3e0f5-2bcf-4c68-863d-0a47957b4760 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:58.524217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3de3e0f5-2bcf-4c68-863d-0a47957b4760 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 52787eee-3cd0-49f7-a881-16d055348a8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:58.526528 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 503/1098] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:49:58 2022] DELETE /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:58.533776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3de3e0f5-2bcf-4c68-863d-0a47957b4760 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.534334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3de3e0f5-2bcf-4c68-863d-0a47957b4760 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.535106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3de3e0f5-2bcf-4c68-863d-0a47957b4760 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.535532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3de3e0f5-2bcf-4c68-863d-0a47957b4760 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.549648 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-3de3e0f5-2bcf-4c68-863d-0a47957b4760 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] HTTP exception thrown: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3de3e0f5-2bcf-4c68-863d-0a47957b4760 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Request method failure captured: Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c HTTP/1.1 Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mics1p1wCl4AqIUegQm3d_pITBwYatFLhRipYelRyLmShzntTbvDif13hJU68Dr75PS5-_PVH2rlUrC3GCvZKy-mXcsTS2uVfBsDy9F9AEKbH8bLuQNqUkYQSS9whNQEqNGjlGMPbf7vASEghxC68ftUIES6H21F7o83_JNpyen0zM Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:49:58.551231 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:49:58.552902 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}] Aug 02 06:49:58.552902 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:58.552902 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:49:58.552902 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:49:58.552902 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:49:58.552902 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:49:58.552902 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:49:58.552902 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b519574e86e841c3a31851e1f4657dd8 Aug 02 06:49:58.552902 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:49:58.552902 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:49:58.552902 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:58.552902 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '52787eee-3cd0-49f7-a881-16d055348a8c'} Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:49:58.553954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. Aug 02 06:49:58.555377 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:49:58.557096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3de3e0f5-2bcf-4c68-863d-0a47957b4760 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Returning 404 to user: Instance 52787eee-3cd0-49f7-a881-16d055348a8c could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:49:58.557096 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3de3e0f5-2bcf-4c68-863d-0a47957b4760 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c" status: 404 len: 111 microversion: 2.1 time: 0.033278 Aug 02 06:49:58.557096 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 596/1099] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:58 2022] GET /compute/v2.1/servers/52787eee-3cd0-49f7-a881-16d055348a8c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:49:58.562081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e8e7ef9b-bb68-4d5b-a7a0-8d2dacefb18f tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '.version_select at 0x7f927b590a60>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:58.583869 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e8e7ef9b-bb68-4d5b-a7a0-8d2dacefb18f tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271553455" status: 202 len: 0 microversion: 2.1 time: 0.025555 Aug 02 06:49:58.584948 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 504/1100] 10.222.0.79 () {58 vars in 1221 bytes} [Tue Aug 2 06:49:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271553455 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:49:58.601875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0e44a243-3d17-433a-9802-7bc470d6c417 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Action: 'update', calling method: .version_select at 0x7f927b226a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:49:58.672335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e44a243-3d17-433a-9802-7bc470d6c417 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.673035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e44a243-3d17-433a-9802-7bc470d6c417 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.673840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e44a243-3d17-433a-9802-7bc470d6c417 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.674308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e44a243-3d17-433a-9802-7bc470d6c417 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.710991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e44a243-3d17-433a-9802-7bc470d6c417 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.711445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e44a243-3d17-433a-9802-7bc470d6c417 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.712313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e44a243-3d17-433a-9802-7bc470d6c417 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.712964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e44a243-3d17-433a-9802-7bc470d6c417 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.763428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-926c42d4-fec2-4acc-8aa6-43c26cf57c7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:58.764647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-926c42d4-fec2-4acc-8aa6-43c26cf57c7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:58.783926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-926c42d4-fec2-4acc-8aa6-43c26cf57c7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.786093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-926c42d4-fec2-4acc-8aa6-43c26cf57c7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.788859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-926c42d4-fec2-4acc-8aa6-43c26cf57c7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:58.790567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-926c42d4-fec2-4acc-8aa6-43c26cf57c7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:58.817681 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0e44a243-3d17-433a-9802-7bc470d6c417 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/b1336984da1c4571a08c097cbc092db7?user_id=98b48827e84d4b9ea79fdba5a0e0d0c0" status: 200 len: 328 microversion: 2.1 time: 0.219470 Aug 02 06:49:58.825603 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 597/1101] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 06:49:58 2022] PUT /compute/v2.1/os-quota-sets/b1336984da1c4571a08c097cbc092db7?user_id=98b48827e84d4b9ea79fdba5a0e0d0c0 => generated 328 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:58.832364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f5687e6b-1a53-4d32-b48d-34b522de547f tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Calling method '.version_select at 0x7f927b20b9d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:58.952691 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f5687e6b-1a53-4d32-b48d-34b522de547f tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/b1336984da1c4571a08c097cbc092db7?user_id=98b48827e84d4b9ea79fdba5a0e0d0c0" status: 200 len: 370 microversion: 2.1 time: 0.124571 Aug 02 06:49:58.953603 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 598/1102] 10.222.0.79 () {58 vars in 1323 bytes} [Tue Aug 2 06:49:58 2022] GET /compute/v2.1/os-quota-sets/b1336984da1c4571a08c097cbc092db7?user_id=98b48827e84d4b9ea79fdba5a0e0d0c0 => generated 370 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:59.000196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1bda70a3-606f-4fb7-adf7-92be276f2fb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:59.002230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1bda70a3-606f-4fb7-adf7-92be276f2fb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:59.016880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1bda70a3-606f-4fb7-adf7-92be276f2fb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:59.017865 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1bda70a3-606f-4fb7-adf7-92be276f2fb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:59.018944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1bda70a3-606f-4fb7-adf7-92be276f2fb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:59.019574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1bda70a3-606f-4fb7-adf7-92be276f2fb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:59.554834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-926c42d4-fec2-4acc-8aa6-43c26cf57c7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:59.563600 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-926c42d4-fec2-4acc-8aa6-43c26cf57c7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1467 microversion: 2.1 time: 0.806321 Aug 02 06:49:59.564498 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 505/1103] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:58 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1467 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:49:59.569513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cdc1fe3d-80db-4a98-809d-be7822e30670 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:59.570129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cdc1fe3d-80db-4a98-809d-be7822e30670 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:59.576156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdc1fe3d-80db-4a98-809d-be7822e30670 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:59.576600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdc1fe3d-80db-4a98-809d-be7822e30670 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:59.577479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdc1fe3d-80db-4a98-809d-be7822e30670 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:59.577956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdc1fe3d-80db-4a98-809d-be7822e30670 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:59.708331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cdc1fe3d-80db-4a98-809d-be7822e30670 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:59.717400 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cdc1fe3d-80db-4a98-809d-be7822e30670 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1274 microversion: 2.1 time: 0.151428 Aug 02 06:49:59.726488 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 506/1104] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:59 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1274 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:49:59.726488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3596daff-71c2-4317-afc2-2fae6cda46af tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Calling method '.version_select at 0x7f927b094670>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:59.856879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1bda70a3-606f-4fb7-adf7-92be276f2fb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:59.867187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1bda70a3-606f-4fb7-adf7-92be276f2fb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:59.869079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1bda70a3-606f-4fb7-adf7-92be276f2fb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:49:59.870432 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1bda70a3-606f-4fb7-adf7-92be276f2fb7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1411 microversion: 2.25 time: 0.878814 Aug 02 06:49:59.870985 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 599/1105] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:49:58 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1411 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:49:59.875569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a5ec2a87-3b42-405a-9349-3b517d11700a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:59.876369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a5ec2a87-3b42-405a-9349-3b517d11700a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:59.883847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5ec2a87-3b42-405a-9349-3b517d11700a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:59.884807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5ec2a87-3b42-405a-9349-3b517d11700a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:59.885778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5ec2a87-3b42-405a-9349-3b517d11700a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:59.887295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5ec2a87-3b42-405a-9349-3b517d11700a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:59.944774 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3596daff-71c2-4317-afc2-2fae6cda46af tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/ab7a79ad3ed6474b9496f16abfeee99e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.225880 Aug 02 06:49:59.945355 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 507/1106] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 06:49:59 2022] GET /compute/v2.1/os-quota-sets/ab7a79ad3ed6474b9496f16abfeee99e/defaults => generated 371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:49:59.949946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-91063184-a929-4c6c-bc1b-7858ebf0aeeb tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:49:59.952087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-91063184-a929-4c6c-bc1b-7858ebf0aeeb tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:49:59.958201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91063184-a929-4c6c-bc1b-7858ebf0aeeb tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:59.958616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91063184-a929-4c6c-bc1b-7858ebf0aeeb tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:59.959432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91063184-a929-4c6c-bc1b-7858ebf0aeeb tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:49:59.959861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91063184-a929-4c6c-bc1b-7858ebf0aeeb tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:49:59.962598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:00.357245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a5ec2a87-3b42-405a-9349-3b517d11700a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:00.378058 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-91063184-a929-4c6c-bc1b-7858ebf0aeeb tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1618 microversion: 2.1 time: 0.430775 Aug 02 06:50:00.379337 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a5ec2a87-3b42-405a-9349-3b517d11700a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.506897 Aug 02 06:50:00.381120 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 508/1107] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:59 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1618 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:00.384270 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 600/1108] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:49:59 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:00.389230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9d43f127-dc43-41c0-a67f-6cc8a4160829 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Action: 'update', calling method: .version_select at 0x7f927b035430>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:00.501159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d43f127-dc43-41c0-a67f-6cc8a4160829 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:00.501959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d43f127-dc43-41c0-a67f-6cc8a4160829 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:00.503009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d43f127-dc43-41c0-a67f-6cc8a4160829 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:00.503702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d43f127-dc43-41c0-a67f-6cc8a4160829 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:00.545665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-844206134", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "75ae3b2d-b9db-4285-a9d1-665045b4d168"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:00.561557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:00.635800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:50:00.844424 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9d43f127-dc43-41c0-a67f-6cc8a4160829 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/ab7a79ad3ed6474b9496f16abfeee99e" status: 200 len: 329 microversion: 2.1 time: 0.461371 Aug 02 06:50:00.845384 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 509/1109] 10.222.0.79 () {60 vars in 1263 bytes} [Tue Aug 2 06:50:00 2022] PUT /compute/v2.1/os-quota-sets/ab7a79ad3ed6474b9496f16abfeee99e => generated 329 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:00.849920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-00c3c883-ed87-43d8-8186-9ca6e04f6fee tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:00.850633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-00c3c883-ed87-43d8-8186-9ca6e04f6fee tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:00.857449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00c3c883-ed87-43d8-8186-9ca6e04f6fee tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:00.857908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00c3c883-ed87-43d8-8186-9ca6e04f6fee tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:00.858772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00c3c883-ed87-43d8-8186-9ca6e04f6fee tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:00.859206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00c3c883-ed87-43d8-8186-9ca6e04f6fee tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:00.962558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-00c3c883-ed87-43d8-8186-9ca6e04f6fee tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:00.971024 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-00c3c883-ed87-43d8-8186-9ca6e04f6fee tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1274 microversion: 2.1 time: 0.124583 Aug 02 06:50:00.980793 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 510/1110] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:00 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:00.989532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-30e93606-dd23-49dd-bf2a-540c093cffb0 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Action: 'update', calling method: .version_select at 0x7f927b094280>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:01.066040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30e93606-dd23-49dd-bf2a-540c093cffb0 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:01.066479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30e93606-dd23-49dd-bf2a-540c093cffb0 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:01.067264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30e93606-dd23-49dd-bf2a-540c093cffb0 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:01.067719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30e93606-dd23-49dd-bf2a-540c093cffb0 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:01.170071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:50:01.171496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:50:01.172153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:50:01.172908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:50:01.173490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:50:01.188305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:01.189455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:01.190883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:01.192029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:01.215219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:50:01.223804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Getting quotas for user c0327068ab564b05ac50b0efd4c61a0f and project cda701cc9bd24a8d909e1f8adf55c296. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:50:01.239888 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:50:01.242332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=21,nova_api:UPDATE=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:01.245343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:50:01.306803 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b8146c0-60ae-4b1e-b19e-d0415f47dd7c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765924 Aug 02 06:50:01.307868 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 601/1111] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:50:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 06:50:01.318066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3cfd62c7-1989-4819-8549-dba9443f000b tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '.version_select at 0x7f927b0cfca0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:01.344410 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-3cfd62c7-1989-4819-8549-dba9443f000b tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] HTTP exception thrown: Image not found. Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3cfd62c7-1989-4819-8549-dba9443f000b tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Request method failure captured: Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/images/0cc71d22-947f-4f0d-ab0f-98ef8a8cb1fa HTTP/1.1 Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mics1p1wCl4AqIUegQm3d_pITBwYatFLhRipYelRyLmShzntTbvDif13hJU68Dr75PS5-_PVH2rlUrC3GCvZKy-mXcsTS2uVfBsDy9F9AEKbH8bLuQNqUkYQSS9whNQEqNGjlGMPbf7vASEghxC68ftUIES6H21F7o83_JNpyen0zM Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:50:01.346314 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:50:01.347689 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}] Aug 02 06:50:01.347689 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:50:01.347689 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:50:01.347689 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:50:01.347689 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:50:01.347689 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:50:01.347689 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:50:01.347689 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b519574e86e841c3a31851e1f4657dd8 Aug 02 06:50:01.347689 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:50:01.347689 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:50:01.347689 n-d-851337-3 devstack@n-api.service[126120]: exception: Image not found. Aug 02 06:50:01.347689 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '0cc71d22-947f-4f0d-ab0f-98ef8a8cb1fa'} Aug 02 06:50:01.347689 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0cc71d22-947f-4f0d-ab0f-98ef8a8cb1fa to delete Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:01.348543 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0cc71d22-947f-4f0d-ab0f-98ef8a8cb1fa could not be found. Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:01.349755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3cfd62c7-1989-4819-8549-dba9443f000b tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Returning 404 to user: Image not found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:01.356067 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3cfd62c7-1989-4819-8549-dba9443f000b tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "DELETE /compute/v2.1/images/0cc71d22-947f-4f0d-ab0f-98ef8a8cb1fa" status: 404 len: 62 microversion: 2.1 time: 0.039157 Aug 02 06:50:01.359648 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 602/1112] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:01 2022] DELETE /compute/v2.1/images/0cc71d22-947f-4f0d-ab0f-98ef8a8cb1fa => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:50:01.359648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9decece2-22ec-4f57-9cd8-a9640c67d9dd tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:01.359648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9decece2-22ec-4f57-9cd8-a9640c67d9dd tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:01.363748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9decece2-22ec-4f57-9cd8-a9640c67d9dd tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:01.364268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9decece2-22ec-4f57-9cd8-a9640c67d9dd tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:01.365657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9decece2-22ec-4f57-9cd8-a9640c67d9dd tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:01.366249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9decece2-22ec-4f57-9cd8-a9640c67d9dd tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:01.536646 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-30e93606-dd23-49dd-bf2a-540c093cffb0 tempest-QuotasAdminTestJSON-278807533 tempest-QuotasAdminTestJSON-278807533-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/ab7a79ad3ed6474b9496f16abfeee99e" status: 200 len: 329 microversion: 2.1 time: 0.562109 Aug 02 06:50:01.538373 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 511/1113] 10.222.0.79 () {60 vars in 1263 bytes} [Tue Aug 2 06:50:00 2022] PUT /compute/v2.1/os-quota-sets/ab7a79ad3ed6474b9496f16abfeee99e => generated 329 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:01.545101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-32b1004f-0255-4d63-9ab0-a79af4bfd59f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:01.555464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-32b1004f-0255-4d63-9ab0-a79af4bfd59f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:01.572087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9decece2-22ec-4f57-9cd8-a9640c67d9dd tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:01.581400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9decece2-22ec-4f57-9cd8-a9640c67d9dd tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:01.586167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9decece2-22ec-4f57-9cd8-a9640c67d9dd tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:01.590636 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9decece2-22ec-4f57-9cd8-a9640c67d9dd tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1411 microversion: 2.25 time: 0.240964 Aug 02 06:50:01.591163 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 603/1114] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:50:01 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1411 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:50:01.606304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6d78cb89-f421-4450-a72a-837d5536b347 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:01.606957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6d78cb89-f421-4450-a72a-837d5536b347 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:01.621844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d78cb89-f421-4450-a72a-837d5536b347 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:01.622388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d78cb89-f421-4450-a72a-837d5536b347 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:01.624924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d78cb89-f421-4450-a72a-837d5536b347 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:01.625392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d78cb89-f421-4450-a72a-837d5536b347 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:01.649930 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-6d78cb89-f421-4450-a72a-837d5536b347 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] HTTP exception thrown: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6d78cb89-f421-4450-a72a-837d5536b347 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Request method failure captured: Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 HTTP/1.1 Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mics1p1wCl4AqIUegQm3d_pITBwYatFLhRipYelRyLmShzntTbvDif13hJU68Dr75PS5-_PVH2rlUrC3GCvZKy-mXcsTS2uVfBsDy9F9AEKbH8bLuQNqUkYQSS9whNQEqNGjlGMPbf7vASEghxC68ftUIES6H21F7o83_JNpyen0zM Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:50:01.664740 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:50:01.666460 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}] Aug 02 06:50:01.666460 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:50:01.666460 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:50:01.666460 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:50:01.666460 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:50:01.666460 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:50:01.666460 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:50:01.666460 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b519574e86e841c3a31851e1f4657dd8 Aug 02 06:50:01.666460 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:50:01.666460 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:50:01.666460 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:50:01.666460 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '1cfd7980-48fb-428b-a177-51e0ca0f7593'} Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:01.667194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:50:01.668450 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.669689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6d78cb89-f421-4450-a72a-837d5536b347 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Returning 404 to user: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:01.669689 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6d78cb89-f421-4450-a72a-837d5536b347 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 404 len: 111 microversion: 2.1 time: 0.071249 Aug 02 06:50:01.674891 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 604/1115] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:50:01 2022] DELETE /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:50:01.686752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-28c5c61a-8bee-4169-9e47-0e4286884102 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:01.687364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-28c5c61a-8bee-4169-9e47-0e4286884102 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:01.701851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28c5c61a-8bee-4169-9e47-0e4286884102 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:01.702354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28c5c61a-8bee-4169-9e47-0e4286884102 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:01.703120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28c5c61a-8bee-4169-9e47-0e4286884102 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:01.703562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28c5c61a-8bee-4169-9e47-0e4286884102 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:01.744318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-32b1004f-0255-4d63-9ab0-a79af4bfd59f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:01.755395 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-32b1004f-0255-4d63-9ab0-a79af4bfd59f tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1216 microversion: 2.1 time: 0.215611 Aug 02 06:50:01.756098 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 512/1116] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:01 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1216 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:01.769282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c1759c09-2738-4c71-95d8-c29107bd82c3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:01.770550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c1759c09-2738-4c71-95d8-c29107bd82c3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] [instance: 1cfd7980-48fb-428b-a177-51e0ca0f7593] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:01.800496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1759c09-2738-4c71-95d8-c29107bd82c3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:01.801223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1759c09-2738-4c71-95d8-c29107bd82c3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:01.801787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1759c09-2738-4c71-95d8-c29107bd82c3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:01.805714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1759c09-2738-4c71-95d8-c29107bd82c3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:01.861107 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-c1759c09-2738-4c71-95d8-c29107bd82c3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] HTTP exception thrown: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c1759c09-2738-4c71-95d8-c29107bd82c3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Request method failure captured: Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 HTTP/1.1 Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mics1p1wCl4AqIUegQm3d_pITBwYatFLhRipYelRyLmShzntTbvDif13hJU68Dr75PS5-_PVH2rlUrC3GCvZKy-mXcsTS2uVfBsDy9F9AEKbH8bLuQNqUkYQSS9whNQEqNGjlGMPbf7vASEghxC68ftUIES6H21F7o83_JNpyen0zM Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:50:01.862910 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:50:01.864507 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a972437b40d745b2a16e01593bfaa1e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a972437b40d745b2a16e01593bfaa1e5"}]}] Aug 02 06:50:01.864507 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:50:01.864507 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a972437b40d745b2a16e01593bfaa1e5 Aug 02 06:50:01.864507 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916 Aug 02 06:50:01.864507 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:50:01.864507 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:50:01.864507 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:50:01.864507 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b519574e86e841c3a31851e1f4657dd8 Aug 02 06:50:01.864507 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1007226916-project Aug 02 06:50:01.864507 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:50:01.864507 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:50:01.864507 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1cfd7980-48fb-428b-a177-51e0ca0f7593'} Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:01.865404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. Aug 02 06:50:01.869885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:01.871654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c1759c09-2738-4c71-95d8-c29107bd82c3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] Returning 404 to user: Instance 1cfd7980-48fb-428b-a177-51e0ca0f7593 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:01.871654 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c1759c09-2738-4c71-95d8-c29107bd82c3 tempest-ImagesOneServerNegativeTestJSON-1007226916 tempest-ImagesOneServerNegativeTestJSON-1007226916-project] 10.222.0.79 "GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593" status: 404 len: 111 microversion: 2.1 time: 0.099031 Aug 02 06:50:01.871654 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 513/1117] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:01 2022] GET /compute/v2.1/servers/1cfd7980-48fb-428b-a177-51e0ca0f7593 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:50:01.996383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-80a739a1-bc0f-4453-be8e-9cdf7f22ca49 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:01.997565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-80a739a1-bc0f-4453-be8e-9cdf7f22ca49 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:02.008037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-80a739a1-bc0f-4453-be8e-9cdf7f22ca49 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:02.009241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-80a739a1-bc0f-4453-be8e-9cdf7f22ca49 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:02.010344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-80a739a1-bc0f-4453-be8e-9cdf7f22ca49 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:02.012235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-80a739a1-bc0f-4453-be8e-9cdf7f22ca49 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:02.139910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-28c5c61a-8bee-4169-9e47-0e4286884102 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:02.153624 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-28c5c61a-8bee-4169-9e47-0e4286884102 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.477637 Aug 02 06:50:02.154520 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 605/1118] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:01 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:02.369321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-80a739a1-bc0f-4453-be8e-9cdf7f22ca49 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:02.388967 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-80a739a1-bc0f-4453-be8e-9cdf7f22ca49 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1316 microversion: 2.1 time: 0.399498 Aug 02 06:50:02.390337 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 514/1119] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:01 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:02.454673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-3d8403b0-1164-485d-b8e3-9897d2c76982 req-2e02feb7-8b63-4c1c-9c15-9d31223b3336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62927d0b-7f85-4ce4-a606-2c0ddb2b896e", "name": "network-vif-plugged", "status": "completed", "tag": "cbca7b5a-a5a7-4e60-8b1c-996099aebce3"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:02.473254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-3d8403b0-1164-485d-b8e3-9897d2c76982 req-2e02feb7-8b63-4c1c-9c15-9d31223b3336 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:02.474433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-3d8403b0-1164-485d-b8e3-9897d2c76982 req-2e02feb7-8b63-4c1c-9c15-9d31223b3336 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:02.510964 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-3d8403b0-1164-485d-b8e3-9897d2c76982 req-2e02feb7-8b63-4c1c-9c15-9d31223b3336 service nova] Creating event network-vif-plugged:cbca7b5a-a5a7-4e60-8b1c-996099aebce3 for instance 62927d0b-7f85-4ce4-a606-2c0ddb2b896e on n-h1-851337-3 Aug 02 06:50:02.516445 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-3d8403b0-1164-485d-b8e3-9897d2c76982 req-2e02feb7-8b63-4c1c-9c15-9d31223b3336 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065695 Aug 02 06:50:02.517186 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 606/1120] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:02.620840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f171704d-eeec-4396-8b96-f745630d78a7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:02.621569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f171704d-eeec-4396-8b96-f745630d78a7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:02.640216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f171704d-eeec-4396-8b96-f745630d78a7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:02.640817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f171704d-eeec-4396-8b96-f745630d78a7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:02.641909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f171704d-eeec-4396-8b96-f745630d78a7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:02.642626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f171704d-eeec-4396-8b96-f745630d78a7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:02.780061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-970a0229-32df-454e-ba1c-92a9b233603b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:02.780773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-970a0229-32df-454e-ba1c-92a9b233603b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:02.802207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-970a0229-32df-454e-ba1c-92a9b233603b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:02.802636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-970a0229-32df-454e-ba1c-92a9b233603b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:02.803431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-970a0229-32df-454e-ba1c-92a9b233603b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:02.803859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-970a0229-32df-454e-ba1c-92a9b233603b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:02.958807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-970a0229-32df-454e-ba1c-92a9b233603b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:02.986067 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-970a0229-32df-454e-ba1c-92a9b233603b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1268 microversion: 2.1 time: 0.210770 Aug 02 06:50:02.988600 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 607/1121] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:02 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1268 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:03.064148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f171704d-eeec-4396-8b96-f745630d78a7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:03.076131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f171704d-eeec-4396-8b96-f745630d78a7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:03.078166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f171704d-eeec-4396-8b96-f745630d78a7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:03.079297 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f171704d-eeec-4396-8b96-f745630d78a7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1411 microversion: 2.25 time: 0.463125 Aug 02 06:50:03.079857 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 515/1122] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:50:02 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1411 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:50:03.175640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-842cdd04-ca33-4b88-a62a-814541b12268 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:03.176262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-842cdd04-ca33-4b88-a62a-814541b12268 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:03.186449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-842cdd04-ca33-4b88-a62a-814541b12268 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:03.187481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-842cdd04-ca33-4b88-a62a-814541b12268 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:03.189101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-842cdd04-ca33-4b88-a62a-814541b12268 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:03.189610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-842cdd04-ca33-4b88-a62a-814541b12268 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:03.258157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-f7229498-bbaa-42fa-a6ec-3354dca7009d req-1f185002-3586-4429-b12c-1cf8d567e88c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94a113f2-1afe-411d-9477-350acce2a793", "tag": "31c431f1-495f-40ae-ba60-1586f6059b74"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:03.269419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f7229498-bbaa-42fa-a6ec-3354dca7009d req-1f185002-3586-4429-b12c-1cf8d567e88c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:03.269991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f7229498-bbaa-42fa-a6ec-3354dca7009d req-1f185002-3586-4429-b12c-1cf8d567e88c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:03.284672 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-f7229498-bbaa-42fa-a6ec-3354dca7009d req-1f185002-3586-4429-b12c-1cf8d567e88c service nova] Creating event network-changed:31c431f1-495f-40ae-ba60-1586f6059b74 for instance 94a113f2-1afe-411d-9477-350acce2a793 on n-h1-851337-3 Aug 02 06:50:03.290488 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-f7229498-bbaa-42fa-a6ec-3354dca7009d req-1f185002-3586-4429-b12c-1cf8d567e88c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036483 Aug 02 06:50:03.291496 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 516/1123] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:50:03.413664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a7701f64-fa64-4a10-84eb-55537de26672 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:03.415662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a7701f64-fa64-4a10-84eb-55537de26672 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:03.432098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7701f64-fa64-4a10-84eb-55537de26672 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:03.432814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7701f64-fa64-4a10-84eb-55537de26672 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:03.434214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7701f64-fa64-4a10-84eb-55537de26672 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:03.435396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7701f64-fa64-4a10-84eb-55537de26672 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:03.608923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-842cdd04-ca33-4b88-a62a-814541b12268 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:03.640546 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-842cdd04-ca33-4b88-a62a-814541b12268 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.466872 Aug 02 06:50:03.641342 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 608/1124] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:03 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:03.754487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a7701f64-fa64-4a10-84eb-55537de26672 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:03.763985 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a7701f64-fa64-4a10-84eb-55537de26672 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1316 microversion: 2.1 time: 0.356405 Aug 02 06:50:03.778138 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 517/1125] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:03 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:04.010382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-069f40eb-6622-4a54-a839-7cba3d0e62b3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:04.011239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-069f40eb-6622-4a54-a839-7cba3d0e62b3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:04.017999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-069f40eb-6622-4a54-a839-7cba3d0e62b3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:04.018750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-069f40eb-6622-4a54-a839-7cba3d0e62b3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:04.020332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-069f40eb-6622-4a54-a839-7cba3d0e62b3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:04.020927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-069f40eb-6622-4a54-a839-7cba3d0e62b3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:04.103789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a71667dc-dbb9-4d9d-99a7-6ad3037009a1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:04.105381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a71667dc-dbb9-4d9d-99a7-6ad3037009a1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:04.115240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a71667dc-dbb9-4d9d-99a7-6ad3037009a1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:04.115679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a71667dc-dbb9-4d9d-99a7-6ad3037009a1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:04.116452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a71667dc-dbb9-4d9d-99a7-6ad3037009a1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:04.131144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a71667dc-dbb9-4d9d-99a7-6ad3037009a1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:04.243998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-069f40eb-6622-4a54-a839-7cba3d0e62b3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:04.262751 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-069f40eb-6622-4a54-a839-7cba3d0e62b3 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1274 microversion: 2.1 time: 0.258034 Aug 02 06:50:04.277464 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 609/1126] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:04 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1274 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:04.282676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0074346a-6039-4aa7-932a-7a9e88398833 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd6314fe-0ece-4f4c-9dd8-d998e4fc3ddb"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:04.285632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0074346a-6039-4aa7-932a-7a9e88398833 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:04.292145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0074346a-6039-4aa7-932a-7a9e88398833 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:04.292863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0074346a-6039-4aa7-932a-7a9e88398833 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:04.293911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0074346a-6039-4aa7-932a-7a9e88398833 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:04.294536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0074346a-6039-4aa7-932a-7a9e88398833 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:04.744930 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0074346a-6039-4aa7-932a-7a9e88398833 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "POST /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466087 Aug 02 06:50:04.745953 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 610/1127] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 06:50:04 2022] POST /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments => generated 194 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:04.751396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fccbfc49-6d8a-4053-bfa3-980ffa0fcacd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:04.752474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fccbfc49-6d8a-4053-bfa3-980ffa0fcacd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:04.760668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fccbfc49-6d8a-4053-bfa3-980ffa0fcacd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:04.761492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fccbfc49-6d8a-4053-bfa3-980ffa0fcacd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:04.762532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fccbfc49-6d8a-4053-bfa3-980ffa0fcacd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:04.763171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fccbfc49-6d8a-4053-bfa3-980ffa0fcacd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:05.182925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a71667dc-dbb9-4d9d-99a7-6ad3037009a1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:05.195568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a71667dc-dbb9-4d9d-99a7-6ad3037009a1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:05.198368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a71667dc-dbb9-4d9d-99a7-6ad3037009a1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:05.199952 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a71667dc-dbb9-4d9d-99a7-6ad3037009a1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1411 microversion: 2.25 time: 1.100756 Aug 02 06:50:05.214730 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 518/1128] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:50:04 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1411 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:50:05.226183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a6c4f7b3-9e6d-4355-a90e-d9492f7a3f9e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:05.227182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a6c4f7b3-9e6d-4355-a90e-d9492f7a3f9e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:05.246089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6c4f7b3-9e6d-4355-a90e-d9492f7a3f9e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:05.247135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6c4f7b3-9e6d-4355-a90e-d9492f7a3f9e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:05.248414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6c4f7b3-9e6d-4355-a90e-d9492f7a3f9e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:05.249354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6c4f7b3-9e6d-4355-a90e-d9492f7a3f9e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:05.392653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fccbfc49-6d8a-4053-bfa3-980ffa0fcacd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:05.396523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:05.403971 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fccbfc49-6d8a-4053-bfa3-980ffa0fcacd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.656530 Aug 02 06:50:05.408787 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 611/1129] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:04 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:05.425143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-098a5e41-3bd1-461e-b733-a7b72b9eac87 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:05.426176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-098a5e41-3bd1-461e-b733-a7b72b9eac87 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:05.445877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-098a5e41-3bd1-461e-b733-a7b72b9eac87 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:05.450690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-098a5e41-3bd1-461e-b733-a7b72b9eac87 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:05.451387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-098a5e41-3bd1-461e-b733-a7b72b9eac87 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:05.451819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-098a5e41-3bd1-461e-b733-a7b72b9eac87 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:06.293841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-098a5e41-3bd1-461e-b733-a7b72b9eac87 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:06.306987 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-098a5e41-3bd1-461e-b733-a7b72b9eac87 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1316 microversion: 2.1 time: 0.895426 Aug 02 06:50:06.309526 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 612/1130] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:05 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1316 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:06.323110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7768f501-7c18-4486-b061-e1878530e873 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:06.323737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7768f501-7c18-4486-b061-e1878530e873 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:06.342799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7768f501-7c18-4486-b061-e1878530e873 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:06.343266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7768f501-7c18-4486-b061-e1878530e873 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:06.344069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7768f501-7c18-4486-b061-e1878530e873 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:06.344683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7768f501-7c18-4486-b061-e1878530e873 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:06.425835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a6c4f7b3-9e6d-4355-a90e-d9492f7a3f9e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:06.442541 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a6c4f7b3-9e6d-4355-a90e-d9492f7a3f9e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1316 microversion: 2.1 time: 1.225189 Aug 02 06:50:06.443586 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 519/1131] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:05 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1316 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:06.448500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-01c1fcf4-aabf-41ad-aa93-c846bbe1f431 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:06.449175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-01c1fcf4-aabf-41ad-aa93-c846bbe1f431 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:06.467844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01c1fcf4-aabf-41ad-aa93-c846bbe1f431 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:06.468521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01c1fcf4-aabf-41ad-aa93-c846bbe1f431 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:06.469459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01c1fcf4-aabf-41ad-aa93-c846bbe1f431 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:06.470091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01c1fcf4-aabf-41ad-aa93-c846bbe1f431 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:07.160709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-01c1fcf4-aabf-41ad-aa93-c846bbe1f431 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:07.168654 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-01c1fcf4-aabf-41ad-aa93-c846bbe1f431 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.723892 Aug 02 06:50:07.182372 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 520/1132] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:06 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:07.201625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7768f501-7c18-4486-b061-e1878530e873 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:07.211431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7768f501-7c18-4486-b061-e1878530e873 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:07.213335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7768f501-7c18-4486-b061-e1878530e873 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:07.214749 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7768f501-7c18-4486-b061-e1878530e873 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1608 microversion: 2.25 time: 0.903849 Aug 02 06:50:07.216451 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 613/1133] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:50:06 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1608 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:50:07.239463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0ba38bc8-2f84-4c23-859e-7deddd90c80b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:07.240273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0ba38bc8-2f84-4c23-859e-7deddd90c80b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:07.246751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ba38bc8-2f84-4c23-859e-7deddd90c80b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:07.247199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ba38bc8-2f84-4c23-859e-7deddd90c80b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:07.247971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ba38bc8-2f84-4c23-859e-7deddd90c80b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:07.248553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ba38bc8-2f84-4c23-859e-7deddd90c80b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:07.328929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a524d1be-2da0-431a-a294-a383e00822b8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:07.330489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a524d1be-2da0-431a-a294-a383e00822b8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:07.337259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a524d1be-2da0-431a-a294-a383e00822b8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:07.337873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a524d1be-2da0-431a-a294-a383e00822b8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:07.338804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a524d1be-2da0-431a-a294-a383e00822b8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:07.339326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a524d1be-2da0-431a-a294-a383e00822b8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:07.488976 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0ba38bc8-2f84-4c23-859e-7deddd90c80b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.253774 Aug 02 06:50:07.497225 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 521/1134] 10.222.0.79 () {60 vars in 1316 bytes} [Tue Aug 2 06:50:07 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-interface => generated 285 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:50:07.500335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c59c36a4-883a-42d3-bf36-93c76537a89a tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:07.501494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c59c36a4-883a-42d3-bf36-93c76537a89a tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:07.516802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c59c36a4-883a-42d3-bf36-93c76537a89a tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:07.517534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c59c36a4-883a-42d3-bf36-93c76537a89a tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:07.518542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c59c36a4-883a-42d3-bf36-93c76537a89a tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:07.519170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c59c36a4-883a-42d3-bf36-93c76537a89a tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:07.817563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a524d1be-2da0-431a-a294-a383e00822b8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:07.828435 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a524d1be-2da0-431a-a294-a383e00822b8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1316 microversion: 2.1 time: 0.503482 Aug 02 06:50:07.849463 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 614/1135] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:07 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1316 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:08.019298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c59c36a4-883a-42d3-bf36-93c76537a89a tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:08.033853 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c59c36a4-883a-42d3-bf36-93c76537a89a tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1316 microversion: 2.1 time: 0.540082 Aug 02 06:50:08.035072 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 522/1136] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:07 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:08.191001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7cf401ce-dc85-4a1b-8c0f-4089dcf73ef3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:08.191527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7cf401ce-dc85-4a1b-8c0f-4089dcf73ef3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:08.205733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7cf401ce-dc85-4a1b-8c0f-4089dcf73ef3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:08.206271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7cf401ce-dc85-4a1b-8c0f-4089dcf73ef3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:08.207073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7cf401ce-dc85-4a1b-8c0f-4089dcf73ef3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:08.207514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7cf401ce-dc85-4a1b-8c0f-4089dcf73ef3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:08.416104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a9d8a638-2cce-403c-8826-221b2fdfa265 req-1033c464-65fe-4dfc-960b-99897cb41b03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4a547f-b973-43f1-a4ab-5d1f4581a10e", "tag": "a1124101-3f39-4792-951d-369323291f84"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:08.431405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a9d8a638-2cce-403c-8826-221b2fdfa265 req-1033c464-65fe-4dfc-960b-99897cb41b03 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:08.432118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a9d8a638-2cce-403c-8826-221b2fdfa265 req-1033c464-65fe-4dfc-960b-99897cb41b03 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:08.445181 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a9d8a638-2cce-403c-8826-221b2fdfa265 req-1033c464-65fe-4dfc-960b-99897cb41b03 service nova] Creating event network-changed:a1124101-3f39-4792-951d-369323291f84 for instance 8c4a547f-b973-43f1-a4ab-5d1f4581a10e on n-h2-851337-3 Aug 02 06:50:08.447252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7cf401ce-dc85-4a1b-8c0f-4089dcf73ef3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:08.452274 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a9d8a638-2cce-403c-8826-221b2fdfa265 req-1033c464-65fe-4dfc-960b-99897cb41b03 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040745 Aug 02 06:50:08.454308 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 523/1137] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:50:08.458689 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7cf401ce-dc85-4a1b-8c0f-4089dcf73ef3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.271595 Aug 02 06:50:08.476117 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 615/1138] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:08 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:08.860582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c886aa09-7fcc-46bf-9d76-765feb9b737e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:08.862215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c886aa09-7fcc-46bf-9d76-765feb9b737e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:08.880164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c886aa09-7fcc-46bf-9d76-765feb9b737e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:08.881043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c886aa09-7fcc-46bf-9d76-765feb9b737e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:08.883315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c886aa09-7fcc-46bf-9d76-765feb9b737e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:08.885611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c886aa09-7fcc-46bf-9d76-765feb9b737e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:09.058501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-52459fc0-499e-40df-8671-45772ce460c9 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:09.059899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-52459fc0-499e-40df-8671-45772ce460c9 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:09.102550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52459fc0-499e-40df-8671-45772ce460c9 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:09.105566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52459fc0-499e-40df-8671-45772ce460c9 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:09.106672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52459fc0-499e-40df-8671-45772ce460c9 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:09.109701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52459fc0-499e-40df-8671-45772ce460c9 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:09.113627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c886aa09-7fcc-46bf-9d76-765feb9b737e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:09.125065 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c886aa09-7fcc-46bf-9d76-765feb9b737e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1316 microversion: 2.1 time: 0.273523 Aug 02 06:50:09.139104 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 524/1139] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:08 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:09.340839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-11c6fb79-2327-425f-a57b-8498778f1d8e req-04faed98-8e7e-4394-97ef-721e61ba6029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62927d0b-7f85-4ce4-a606-2c0ddb2b896e", "tag": "cbca7b5a-a5a7-4e60-8b1c-996099aebce3"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:09.382674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-11c6fb79-2327-425f-a57b-8498778f1d8e req-04faed98-8e7e-4394-97ef-721e61ba6029 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:09.385831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-11c6fb79-2327-425f-a57b-8498778f1d8e req-04faed98-8e7e-4394-97ef-721e61ba6029 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:09.425658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-52459fc0-499e-40df-8671-45772ce460c9 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:09.434836 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-11c6fb79-2327-425f-a57b-8498778f1d8e req-04faed98-8e7e-4394-97ef-721e61ba6029 service nova] Creating event network-changed:cbca7b5a-a5a7-4e60-8b1c-996099aebce3 for instance 62927d0b-7f85-4ce4-a606-2c0ddb2b896e on n-h1-851337-3 Aug 02 06:50:09.436132 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-52459fc0-499e-40df-8671-45772ce460c9 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1316 microversion: 2.1 time: 0.382396 Aug 02 06:50:09.439360 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 616/1140] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:09 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:09.463733 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-11c6fb79-2327-425f-a57b-8498778f1d8e req-04faed98-8e7e-4394-97ef-721e61ba6029 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120102 Aug 02 06:50:09.469957 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 525/1141] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:09.481204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-692a12b6-1b49-4a1a-abe8-0e6782cecb83 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:09.482619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-692a12b6-1b49-4a1a-abe8-0e6782cecb83 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:09.495620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-692a12b6-1b49-4a1a-abe8-0e6782cecb83 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:09.498604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-692a12b6-1b49-4a1a-abe8-0e6782cecb83 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:09.501935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-692a12b6-1b49-4a1a-abe8-0e6782cecb83 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:09.502579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-692a12b6-1b49-4a1a-abe8-0e6782cecb83 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:09.801164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-692a12b6-1b49-4a1a-abe8-0e6782cecb83 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:09.809536 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-692a12b6-1b49-4a1a-abe8-0e6782cecb83 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.332674 Aug 02 06:50:09.812698 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 617/1142] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:09 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:10.148676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dce145bb-38c4-4938-bcab-5cc3ea170541 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:10.150047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dce145bb-38c4-4938-bcab-5cc3ea170541 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:10.162479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dce145bb-38c4-4938-bcab-5cc3ea170541 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:10.162928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dce145bb-38c4-4938-bcab-5cc3ea170541 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:10.170640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dce145bb-38c4-4938-bcab-5cc3ea170541 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:10.174485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dce145bb-38c4-4938-bcab-5cc3ea170541 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:10.606257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b7586cc7-3dd6-49d3-9509-dc84523abe31 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Action: 'create', calling method: .version_select at 0x7f928c2e1790>, body: {"keypair": {"name": "tempest-keypair-77755809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+2KsqyKgXgYgS39i0HrnacFCqyVEfLVLqNwuuBgjfZjgnxar3eDns2bAWI7KzqbQ5zOyZbGQ8WmiwhV3gAJJAD8bHa7CRukUqXhQ9JUUdF/hkYwlS+uEXc4ts7VlZTAA=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:10.643243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-b7586cc7-3dd6-49d3-9509-dc84523abe31 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Getting quotas for project e5ec0c0267a04fa5b62cab266ea51501. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:50:10.654849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-b7586cc7-3dd6-49d3-9509-dc84523abe31 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Getting quotas for user 1b1e88b1189e4d13a5b57988ebf97346 and project e5ec0c0267a04fa5b62cab266ea51501. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:50:10.717163 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b7586cc7-3dd6-49d3-9509-dc84523abe31 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.464979 Aug 02 06:50:10.718870 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 618/1143] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:50:10 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:10.724194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a54d0ec-fbc8-477e-8c69-c7dc8832f978 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:10.729276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8a54d0ec-fbc8-477e-8c69-c7dc8832f978 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:10.737493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a54d0ec-fbc8-477e-8c69-c7dc8832f978 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:10.742197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a54d0ec-fbc8-477e-8c69-c7dc8832f978 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:10.743309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a54d0ec-fbc8-477e-8c69-c7dc8832f978 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:10.747530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a54d0ec-fbc8-477e-8c69-c7dc8832f978 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:10.800627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dce145bb-38c4-4938-bcab-5cc3ea170541 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:10.809317 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dce145bb-38c4-4938-bcab-5cc3ea170541 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1316 microversion: 2.1 time: 0.664874 Aug 02 06:50:10.813834 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 526/1144] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:10 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:10.826961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-11e621d6-acc4-423a-9f63-a085f33ae4b7 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Calling method '.version_select at 0x7f927af89160>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:10.849873 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-11e621d6-acc4-423a-9f63-a085f33ae4b7 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-77755809" status: 200 len: 495 microversion: 2.1 time: 0.034648 Aug 02 06:50:10.850818 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 527/1145] 10.222.0.79 () {58 vars in 1212 bytes} [Tue Aug 2 06:50:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-77755809 => generated 495 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:10.868246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c5181720-9bb8-488b-bea1-25ae956294a4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:10.869195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c5181720-9bb8-488b-bea1-25ae956294a4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:10.883311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5181720-9bb8-488b-bea1-25ae956294a4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:10.884114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5181720-9bb8-488b-bea1-25ae956294a4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:10.886873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5181720-9bb8-488b-bea1-25ae956294a4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:10.887548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5181720-9bb8-488b-bea1-25ae956294a4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:11.076285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=12 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:11.203400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=11 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:11.547883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8a54d0ec-fbc8-477e-8c69-c7dc8832f978 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:11.557866 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8a54d0ec-fbc8-477e-8c69-c7dc8832f978 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1316 microversion: 2.1 time: 0.837668 Aug 02 06:50:11.566766 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 619/1146] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:10 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1316 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:11.574322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab03011e-c0e4-4562-8eca-0d76dcf927d3 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Calling method '.version_select at 0x7f928c2e1dc0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:11.612958 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab03011e-c0e4-4562-8eca-0d76dcf927d3 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-77755809" status: 202 len: 0 microversion: 2.1 time: 0.043559 Aug 02 06:50:11.614684 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 620/1147] 10.222.0.79 () {58 vars in 1215 bytes} [Tue Aug 2 06:50:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-77755809 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:50:11.628836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ef869cd3-4454-4c76-9dde-1795d3366f8d tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Action: 'create', calling method: .version_select at 0x7f928c2d6ee0>, body: {"keypair": {"name": "tempest-keypair-20319302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOWKmwoCJx1KV6YRV7wQTRr9gDqh8FNVdD9WH3gpHGPT6DrvZLQeEUEDiuQnIypFAD6c0qeItFi/tEClwzrT11wCBRxjFUkAqon2sY0V3LiI6SuM4dEvA78cBwnNqFJkA=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:11.670181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-ef869cd3-4454-4c76-9dde-1795d3366f8d tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Getting quotas for project e5ec0c0267a04fa5b62cab266ea51501. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:50:11.689855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-ef869cd3-4454-4c76-9dde-1795d3366f8d tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Getting quotas for user 1b1e88b1189e4d13a5b57988ebf97346 and project e5ec0c0267a04fa5b62cab266ea51501. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:50:11.751528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=96 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:11.757024 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ef869cd3-4454-4c76-9dde-1795d3366f8d tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.134745 Aug 02 06:50:11.764580 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 621/1148] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:50:11 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:11.777476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-00ac875a-dd46-402c-bb4b-155c5d74c3aa tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Calling method '.version_select at 0x7f928c2d69d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:11.836587 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-00ac875a-dd46-402c-bb4b-155c5d74c3aa tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-20319302" status: 202 len: 0 microversion: 2.1 time: 0.063416 Aug 02 06:50:11.858319 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 622/1149] 10.222.0.79 () {58 vars in 1215 bytes} [Tue Aug 2 06:50:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-20319302 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:50:11.868539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7719bc73-d5bd-415d-90d2-e3706c8d4c53 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:11.869410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7719bc73-d5bd-415d-90d2-e3706c8d4c53 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:11.885135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7719bc73-d5bd-415d-90d2-e3706c8d4c53 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:11.885697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7719bc73-d5bd-415d-90d2-e3706c8d4c53 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:11.888727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7719bc73-d5bd-415d-90d2-e3706c8d4c53 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:11.889271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7719bc73-d5bd-415d-90d2-e3706c8d4c53 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:12.263445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c5181720-9bb8-488b-bea1-25ae956294a4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:12.272526 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c5181720-9bb8-488b-bea1-25ae956294a4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 1.413335 Aug 02 06:50:12.273672 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 528/1150] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:10 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:12.279846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0d33fc7a-c1d1-4a55-9ad3-de7ce5edf0d0 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Action: 'create', calling method: .version_select at 0x7f927b22d280>, body: {"keypair": {"name": "tempest-keypair-1019001345", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:12.323085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-0d33fc7a-c1d1-4a55-9ad3-de7ce5edf0d0 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Getting quotas for project e5ec0c0267a04fa5b62cab266ea51501. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:50:12.344203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-0d33fc7a-c1d1-4a55-9ad3-de7ce5edf0d0 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Getting quotas for user 1b1e88b1189e4d13a5b57988ebf97346 and project e5ec0c0267a04fa5b62cab266ea51501. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:50:12.409111 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0d33fc7a-c1d1-4a55-9ad3-de7ce5edf0d0 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.133683 Aug 02 06:50:12.415197 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 529/1151] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:50:12 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:12.421105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-300eaf35-acbb-4c46-b2ee-1ebac1208b0f tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Calling method '.version_select at 0x7f927affb0d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:12.452888 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-300eaf35-acbb-4c46-b2ee-1ebac1208b0f tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019001345" status: 202 len: 0 microversion: 2.1 time: 0.035334 Aug 02 06:50:12.461967 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 530/1152] 10.222.0.79 () {58 vars in 1221 bytes} [Tue Aug 2 06:50:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019001345 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:50:12.462197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7719bc73-d5bd-415d-90d2-e3706c8d4c53 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:12.476359 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7719bc73-d5bd-415d-90d2-e3706c8d4c53 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1316 microversion: 2.1 time: 0.616896 Aug 02 06:50:12.491493 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 623/1153] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:11 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1316 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:12.495351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8d925bfe-f7c7-4fad-832c-11ded4edf4dd tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Action: 'create', calling method: .version_select at 0x7f927af96790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-899677793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEjwlrhkO+efb/91ICFr8y0f5QTwFBCeVN+mRKAFx9WhPLEeKArrD8ooLLPU6RMpz4J0iy3gQ/jZ5G5SC3rSTN/IEIRsg9pQwtuRkY0b2UNkMoiGcYezPi1h7V6vaSIDg=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:12.521032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-8d925bfe-f7c7-4fad-832c-11ded4edf4dd tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Getting quotas for project e5ec0c0267a04fa5b62cab266ea51501. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:50:12.529136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-8d925bfe-f7c7-4fad-832c-11ded4edf4dd tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Getting quotas for user 1b1e88b1189e4d13a5b57988ebf97346 and project e5ec0c0267a04fa5b62cab266ea51501. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:50:12.566685 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8d925bfe-f7c7-4fad-832c-11ded4edf4dd tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.097794 Aug 02 06:50:12.568616 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 531/1154] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:50:12 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:12.582024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6d3d418b-1215-42fc-b927-156666267511 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Action: 'create', calling method: .version_select at 0x7f928c2eb670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1349207926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/QDHiCKUX0OXjrg8ZWCG54ZcfyS7OMIOxGxL2v9bq39hnH+Qn4+QXqD4Sxy/xzV04y50wbv3PsAjGpSP+wllFX0DaQitRlje7WgdZPFsdV+p/eAWds/qZq7HzUZQIh7g=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:12.594421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-056e7f4c-42b8-4d0e-9652-544a1b675392 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:12.595079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-056e7f4c-42b8-4d0e-9652-544a1b675392 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:12.601192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=8,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:12.608704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-056e7f4c-42b8-4d0e-9652-544a1b675392 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:12.609156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-056e7f4c-42b8-4d0e-9652-544a1b675392 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:12.609994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-056e7f4c-42b8-4d0e-9652-544a1b675392 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:12.615359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-056e7f4c-42b8-4d0e-9652-544a1b675392 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:12.623975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-6d3d418b-1215-42fc-b927-156666267511 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Getting quotas for project e5ec0c0267a04fa5b62cab266ea51501. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:50:12.634206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-6d3d418b-1215-42fc-b927-156666267511 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Getting quotas for user 1b1e88b1189e4d13a5b57988ebf97346 and project e5ec0c0267a04fa5b62cab266ea51501. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:50:12.687905 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6d3d418b-1215-42fc-b927-156666267511 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.110745 Aug 02 06:50:12.696617 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 624/1155] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:50:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:12.701902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-957d6753-36db-4a02-87af-36ba51e8f57e tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Action: 'create', calling method: .version_select at 0x7f928c2d6790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1250566327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPY0YbK1XRqsEasvl/qVpyvAnhpCXxNbKH7pLPeK5cbS2sCIHp0rYto41wNKr9iQOTrPBYwTgc+2Npc8kar33PwD6u4tQf0ouEnhsi39STSriAzTa30hdH2vHSFmbTwjg=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:12.742098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-957d6753-36db-4a02-87af-36ba51e8f57e tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Getting quotas for project e5ec0c0267a04fa5b62cab266ea51501. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:50:12.759990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-957d6753-36db-4a02-87af-36ba51e8f57e tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Getting quotas for user 1b1e88b1189e4d13a5b57988ebf97346 and project e5ec0c0267a04fa5b62cab266ea51501. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:50:12.778524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:12.829848 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-957d6753-36db-4a02-87af-36ba51e8f57e tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.131767 Aug 02 06:50:12.830924 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 625/1156] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:50:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:50:12.842667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8ce74dc5-c2c0-4e7c-84f9-a09da0963e74 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Calling method '.version_select at 0x7f928c330a60>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:12.851308 n-d-851337-3 devstack@n-api.service[126120]: WARNING oslo_db.sqlalchemy.utils [None req-8ce74dc5-c2c0-4e7c-84f9-a09da0963e74 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 02 06:50:12.872977 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8ce74dc5-c2c0-4e7c-84f9-a09da0963e74 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.031827 Aug 02 06:50:12.874266 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 626/1157] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:50:12 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:12.885615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5456278f-812d-44ed-a14c-579133551a7e tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Calling method '.version_select at 0x7f928c2f9280>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:12.944009 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5456278f-812d-44ed-a14c-579133551a7e tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1250566327" status: 202 len: 0 microversion: 2.1 time: 0.062605 Aug 02 06:50:12.945077 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 627/1158] 10.222.0.79 () {58 vars in 1278 bytes} [Tue Aug 2 06:50:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1250566327 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:50:12.957114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e720296e-9775-4cab-921e-a238d49ce97f tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Calling method '.version_select at 0x7f928c2eb430>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:12.998817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-056e7f4c-42b8-4d0e-9652-544a1b675392 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:13.024970 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-056e7f4c-42b8-4d0e-9652-544a1b675392 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1316 microversion: 2.1 time: 0.435124 Aug 02 06:50:13.027014 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e720296e-9775-4cab-921e-a238d49ce97f tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1349207926" status: 202 len: 0 microversion: 2.1 time: 0.077302 Aug 02 06:50:13.028103 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 628/1159] 10.222.0.79 () {58 vars in 1278 bytes} [Tue Aug 2 06:50:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1349207926 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:50:13.029199 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 532/1160] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:12 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:13.040951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d26148ec-7b73-431e-a50e-887df50655d3 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] Calling method '.version_select at 0x7f928c2d6160>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:13.086063 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d26148ec-7b73-431e-a50e-887df50655d3 tempest-KeyPairsV2TestJSON-75484889 tempest-KeyPairsV2TestJSON-75484889-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-899677793" status: 202 len: 0 microversion: 2.1 time: 0.049177 Aug 02 06:50:13.087368 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 629/1161] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 06:50:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-899677793 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:50:13.294023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fff651ba-100a-4a26-8ac0-7af78bd25ae6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:13.294794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fff651ba-100a-4a26-8ac0-7af78bd25ae6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:13.307463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fff651ba-100a-4a26-8ac0-7af78bd25ae6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:13.308296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fff651ba-100a-4a26-8ac0-7af78bd25ae6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:13.310807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fff651ba-100a-4a26-8ac0-7af78bd25ae6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:13.311466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fff651ba-100a-4a26-8ac0-7af78bd25ae6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:13.497848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-860a7a61-4dc2-447b-8d30-2316490102de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:13.498492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-860a7a61-4dc2-447b-8d30-2316490102de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:13.505099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fff651ba-100a-4a26-8ac0-7af78bd25ae6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:13.514760 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fff651ba-100a-4a26-8ac0-7af78bd25ae6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.225077 Aug 02 06:50:13.526728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-860a7a61-4dc2-447b-8d30-2316490102de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:13.527182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-860a7a61-4dc2-447b-8d30-2316490102de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:13.527961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-860a7a61-4dc2-447b-8d30-2316490102de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:13.528396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-860a7a61-4dc2-447b-8d30-2316490102de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:13.530256 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 533/1162] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:13 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:13.839573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-860a7a61-4dc2-447b-8d30-2316490102de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:13.849963 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-860a7a61-4dc2-447b-8d30-2316490102de tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1316 microversion: 2.1 time: 0.356894 Aug 02 06:50:13.873230 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 630/1163] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:13 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:14.050261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b812b09e-c3d2-461c-8eac-03a19b7440e1 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:14.050878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b812b09e-c3d2-461c-8eac-03a19b7440e1 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:14.058278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b812b09e-c3d2-461c-8eac-03a19b7440e1 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:14.059056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b812b09e-c3d2-461c-8eac-03a19b7440e1 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:14.060189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b812b09e-c3d2-461c-8eac-03a19b7440e1 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:14.060984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b812b09e-c3d2-461c-8eac-03a19b7440e1 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:14.068207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:14.392291 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b812b09e-c3d2-461c-8eac-03a19b7440e1 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:14.404517 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b812b09e-c3d2-461c-8eac-03a19b7440e1 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1316 microversion: 2.1 time: 0.357210 Aug 02 06:50:14.406702 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 534/1164] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:14 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:14.536953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-88835bfb-c098-4c90-ab17-8c9c6b5697bb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:14.537577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-88835bfb-c098-4c90-ab17-8c9c6b5697bb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:14.578631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88835bfb-c098-4c90-ab17-8c9c6b5697bb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:14.580587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88835bfb-c098-4c90-ab17-8c9c6b5697bb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:14.581445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88835bfb-c098-4c90-ab17-8c9c6b5697bb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:14.581914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88835bfb-c098-4c90-ab17-8c9c6b5697bb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:14.854263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-88835bfb-c098-4c90-ab17-8c9c6b5697bb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:14.866052 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-88835bfb-c098-4c90-ab17-8c9c6b5697bb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.330764 Aug 02 06:50:14.866917 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 631/1165] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:14 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:14.895860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3d3ffd75-e210-48d0-a918-6bc81b37b995 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:14.896475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3d3ffd75-e210-48d0-a918-6bc81b37b995 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:14.912101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d3ffd75-e210-48d0-a918-6bc81b37b995 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:14.912545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d3ffd75-e210-48d0-a918-6bc81b37b995 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:14.913339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d3ffd75-e210-48d0-a918-6bc81b37b995 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:14.913868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d3ffd75-e210-48d0-a918-6bc81b37b995 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:14.928070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-9e1df956-4783-4ba6-bcd9-c3fe2c657fd6 req-6270dc4d-394a-4d9f-9b97-58c0f9f117ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4a547f-b973-43f1-a4ab-5d1f4581a10e", "name": "network-vif-plugged", "status": "completed", "tag": "a1124101-3f39-4792-951d-369323291f84"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:14.946945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9e1df956-4783-4ba6-bcd9-c3fe2c657fd6 req-6270dc4d-394a-4d9f-9b97-58c0f9f117ae service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:14.947407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9e1df956-4783-4ba6-bcd9-c3fe2c657fd6 req-6270dc4d-394a-4d9f-9b97-58c0f9f117ae service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:14.992171 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-9e1df956-4783-4ba6-bcd9-c3fe2c657fd6 req-6270dc4d-394a-4d9f-9b97-58c0f9f117ae service nova] Creating event network-vif-plugged:a1124101-3f39-4792-951d-369323291f84 for instance 8c4a547f-b973-43f1-a4ab-5d1f4581a10e on n-h2-851337-3 Aug 02 06:50:15.009190 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-9e1df956-4783-4ba6-bcd9-c3fe2c657fd6 req-6270dc4d-394a-4d9f-9b97-58c0f9f117ae service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082056 Aug 02 06:50:15.010536 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 632/1166] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:15.217207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3d3ffd75-e210-48d0-a918-6bc81b37b995 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:15.226684 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3d3ffd75-e210-48d0-a918-6bc81b37b995 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1316 microversion: 2.1 time: 0.334790 Aug 02 06:50:15.227272 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 535/1167] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:14 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:15.429071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5b8fdb07-35d8-4b6d-9c51-672da88f2710 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:15.429777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5b8fdb07-35d8-4b6d-9c51-672da88f2710 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:15.437442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b8fdb07-35d8-4b6d-9c51-672da88f2710 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:15.437981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b8fdb07-35d8-4b6d-9c51-672da88f2710 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:15.438705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b8fdb07-35d8-4b6d-9c51-672da88f2710 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:15.439138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b8fdb07-35d8-4b6d-9c51-672da88f2710 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:15.803520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5b8fdb07-35d8-4b6d-9c51-672da88f2710 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:15.818057 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5b8fdb07-35d8-4b6d-9c51-672da88f2710 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1316 microversion: 2.1 time: 0.391221 Aug 02 06:50:15.836456 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 633/1168] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:15 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:15.893822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-53472ac5-bb94-4ca6-80f2-041c2f52fe97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:15.894947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-53472ac5-bb94-4ca6-80f2-041c2f52fe97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:15.907757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53472ac5-bb94-4ca6-80f2-041c2f52fe97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:15.909928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53472ac5-bb94-4ca6-80f2-041c2f52fe97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:15.911691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53472ac5-bb94-4ca6-80f2-041c2f52fe97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:15.918990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53472ac5-bb94-4ca6-80f2-041c2f52fe97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:16.165316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-53472ac5-bb94-4ca6-80f2-041c2f52fe97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:16.178919 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-53472ac5-bb94-4ca6-80f2-041c2f52fe97 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.289160 Aug 02 06:50:16.188415 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 536/1169] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:15 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:16.251698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6e605dfc-3e07-4476-a89f-3f98b0229af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:16.253409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6e605dfc-3e07-4476-a89f-3f98b0229af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:16.262047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e605dfc-3e07-4476-a89f-3f98b0229af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:16.262914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e605dfc-3e07-4476-a89f-3f98b0229af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:16.264128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e605dfc-3e07-4476-a89f-3f98b0229af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:16.265927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e605dfc-3e07-4476-a89f-3f98b0229af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:16.476151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6e605dfc-3e07-4476-a89f-3f98b0229af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:16.486149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d4565bb4-9587-4160-8d43-d5881d394442 tempest-FloatingIPsNegativeTestJSON-1835965824 tempest-FloatingIPsNegativeTestJSON-1835965824-project] Calling method '.version_select at 0x7f927b036d30>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:16.488666 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6e605dfc-3e07-4476-a89f-3f98b0229af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1316 microversion: 2.1 time: 0.241014 Aug 02 06:50:16.489328 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 634/1170] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:16 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:16.537181 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d4565bb4-9587-4160-8d43-d5881d394442 tempest-FloatingIPsNegativeTestJSON-1835965824 tempest-FloatingIPsNegativeTestJSON-1835965824-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.267934 Aug 02 06:50:16.537956 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 537/1171] 10.222.0.79 () {58 vars in 1149 bytes} [Tue Aug 2 06:50:16 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 06:50:16.555558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-284b72c0-6bd8-45ca-9507-f9a56297a912 tempest-FloatingIPsNegativeTestJSON-1835965824 tempest-FloatingIPsNegativeTestJSON-1835965824-project] Action: 'create', calling method: .version_select at 0x7f928c299670>, body: {"pool": "non_exist_pool"} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:16.596322 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-284b72c0-6bd8-45ca-9507-f9a56297a912 tempest-FloatingIPsNegativeTestJSON-1835965824 tempest-FloatingIPsNegativeTestJSON-1835965824-project] HTTP exception thrown: Floating IP pool not found. Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-284b72c0-6bd8-45ca-9507-f9a56297a912 tempest-FloatingIPsNegativeTestJSON-1835965824 tempest-FloatingIPsNegativeTestJSON-1835965824-project] Request method failure captured: Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 26 Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MkoKefVJ00M_3Nty6587m-UJwyJkpdU54JLXMzi_ysu7wF6HAVYpqsZcZbbbBRDtCAdNdfn4iW4sW8-HtpdbDCxJJ8YAROC3p3PQQMsaj6RD0PLXfHdGTPR67LUF5-lkF3KfqUqzhcjMZgbY_wQWOhQZsU_8eM-B-xUzXaq7ATMpj4 Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 31bc3e202bd54c0a8360d7cc29a712a5 Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1835965824 Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:50:16.599524 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/31bc3e202bd54c0a8360d7cc29a712a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/31bc3e202bd54c0a8360d7cc29a712a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_31bc3e202bd54c0a8360d7cc29a712a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/31bc3e202bd54c0a8360d7cc29a712a5"}]}] Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1835965824 Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 31bc3e202bd54c0a8360d7cc29a712a5 Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1835965824 Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-FloatingIPsNegativeTestJSON-1835965824-project Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 73facd9385c4409f8b5395aa768d7140 Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1835965824-project Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: {"pool": "non_exist_pool"} Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: exception: Floating IP pool not found. Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 02 06:50:16.601283 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:16.602754 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-284b72c0-6bd8-45ca-9507-f9a56297a912 tempest-FloatingIPsNegativeTestJSON-1835965824 tempest-FloatingIPsNegativeTestJSON-1835965824-project] Returning 404 to user: Floating IP pool not found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:16.604320 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-284b72c0-6bd8-45ca-9507-f9a56297a912 tempest-FloatingIPsNegativeTestJSON-1835965824 tempest-FloatingIPsNegativeTestJSON-1835965824-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.051472 Aug 02 06:50:16.612032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-39c6dcbf-c43d-4f05-a271-e476eff18413 tempest-FloatingIPsNegativeTestJSON-1835965824 tempest-FloatingIPsNegativeTestJSON-1835965824-project] Calling method '.version_select at 0x7f927afdaee0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:16.615538 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 635/1172] 10.222.0.79 () {60 vars in 1170 bytes} [Tue Aug 2 06:50:16 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:50:16.659849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG neutronclient.v2_0.client [None req-39c6dcbf-c43d-4f05-a271-e476eff18413 tempest-FloatingIPsNegativeTestJSON-1835965824 tempest-FloatingIPsNegativeTestJSON-1835965824-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a434e0d1-4419-4a2b-aba5-8c355eca6f0d could not be found", "detail": ""}} {{(pid=126119) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:50:16.661116 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-39c6dcbf-c43d-4f05-a271-e476eff18413 tempest-FloatingIPsNegativeTestJSON-1835965824 tempest-FloatingIPsNegativeTestJSON-1835965824-project] HTTP exception thrown: Floating IP not found for ID a434e0d1-4419-4a2b-aba5-8c355eca6f0d Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-39c6dcbf-c43d-4f05-a271-e476eff18413 tempest-FloatingIPsNegativeTestJSON-1835965824 tempest-FloatingIPsNegativeTestJSON-1835965824-project] Request method failure captured: Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/os-floating-ips/a434e0d1-4419-4a2b-aba5-8c355eca6f0d HTTP/1.1 Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MkoKefVJ00M_3Nty6587m-UJwyJkpdU54JLXMzi_ysu7wF6HAVYpqsZcZbbbBRDtCAdNdfn4iW4sW8-HtpdbDCxJJ8YAROC3p3PQQMsaj6RD0PLXfHdGTPR67LUF5-lkF3KfqUqzhcjMZgbY_wQWOhQZsU_8eM-B-xUzXaq7ATMpj4 Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 31bc3e202bd54c0a8360d7cc29a712a5 Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1835965824 Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:50:16.663177 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:50:16.664590 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/31bc3e202bd54c0a8360d7cc29a712a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/31bc3e202bd54c0a8360d7cc29a712a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_31bc3e202bd54c0a8360d7cc29a712a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/31bc3e202bd54c0a8360d7cc29a712a5"}]}] Aug 02 06:50:16.664590 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1835965824 Aug 02 06:50:16.664590 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 31bc3e202bd54c0a8360d7cc29a712a5 Aug 02 06:50:16.664590 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1835965824 Aug 02 06:50:16.664590 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FloatingIPsNegativeTestJSON-1835965824-project Aug 02 06:50:16.664590 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:50:16.664590 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:50:16.664590 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 73facd9385c4409f8b5395aa768d7140 Aug 02 06:50:16.664590 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1835965824-project Aug 02 06:50:16.664590 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:50:16.664590 n-d-851337-3 devstack@n-api.service[126119]: exception: Floating IP not found for ID a434e0d1-4419-4a2b-aba5-8c355eca6f0d Aug 02 06:50:16.664590 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'a434e0d1-4419-4a2b-aba5-8c355eca6f0d'} Aug 02 06:50:16.664590 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:50:16.665564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a434e0d1-4419-4a2b-aba5-8c355eca6f0d could not be found Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6dfa3df-7f48-4a57-916c-4f22f906b9f0'] Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a434e0d1-4419-4a2b-aba5-8c355eca6f0d. Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:16.666853 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a434e0d1-4419-4a2b-aba5-8c355eca6f0d Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:16.668095 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:16.669331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a434e0d1-4419-4a2b-aba5-8c355eca6f0d Aug 02 06:50:16.669331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:16.669331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-39c6dcbf-c43d-4f05-a271-e476eff18413 tempest-FloatingIPsNegativeTestJSON-1835965824 tempest-FloatingIPsNegativeTestJSON-1835965824-project] Returning 404 to user: Floating IP not found for ID a434e0d1-4419-4a2b-aba5-8c355eca6f0d {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:16.669331 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-39c6dcbf-c43d-4f05-a271-e476eff18413 tempest-FloatingIPsNegativeTestJSON-1835965824 tempest-FloatingIPsNegativeTestJSON-1835965824-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/a434e0d1-4419-4a2b-aba5-8c355eca6f0d" status: 404 len: 111 microversion: 2.1 time: 0.056745 Aug 02 06:50:16.669331 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 538/1173] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 06:50:16 2022] DELETE /compute/v2.1/os-floating-ips/a434e0d1-4419-4a2b-aba5-8c355eca6f0d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:50:16.773247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-99134967-d4f9-4331-aac8-ebc808845159 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8c87488-8866-4e9d-969f-f6883e112970"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:16.776654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-99134967-d4f9-4331-aac8-ebc808845159 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:16.786179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99134967-d4f9-4331-aac8-ebc808845159 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:16.786983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99134967-d4f9-4331-aac8-ebc808845159 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:16.787786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99134967-d4f9-4331-aac8-ebc808845159 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:16.788217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99134967-d4f9-4331-aac8-ebc808845159 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:16.840715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6ae24d8f-291f-486d-8c5e-975b9ca75911 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:16.841619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6ae24d8f-291f-486d-8c5e-975b9ca75911 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:16.854786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ae24d8f-291f-486d-8c5e-975b9ca75911 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:16.861998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ae24d8f-291f-486d-8c5e-975b9ca75911 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:16.865798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ae24d8f-291f-486d-8c5e-975b9ca75911 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:16.866613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ae24d8f-291f-486d-8c5e-975b9ca75911 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:17.200046 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-99134967-d4f9-4331-aac8-ebc808845159 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "POST /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432336 Aug 02 06:50:17.201341 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 636/1174] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 06:50:16 2022] POST /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988/os-volume_attachments => generated 194 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:17.206892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-1cf910df-f375-4411-9788-8fd121d64fec req-7d19f6a6-99bd-4066-9509-221b5517e940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a113f2-1afe-411d-9477-350acce2a793", "name": "network-vif-plugged", "status": "completed", "tag": "31c431f1-495f-40ae-ba60-1586f6059b74"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:17.219866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-1cf910df-f375-4411-9788-8fd121d64fec req-7d19f6a6-99bd-4066-9509-221b5517e940 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:17.220643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-1cf910df-f375-4411-9788-8fd121d64fec req-7d19f6a6-99bd-4066-9509-221b5517e940 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:17.242447 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-1cf910df-f375-4411-9788-8fd121d64fec req-7d19f6a6-99bd-4066-9509-221b5517e940 service nova] Creating event network-vif-plugged:31c431f1-495f-40ae-ba60-1586f6059b74 for instance 94a113f2-1afe-411d-9477-350acce2a793 on n-h1-851337-3 Aug 02 06:50:17.250565 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-1cf910df-f375-4411-9788-8fd121d64fec req-7d19f6a6-99bd-4066-9509-221b5517e940 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047343 Aug 02 06:50:17.251897 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 637/1175] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:17.260389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6ba24774-e002-4ad2-93b3-65d755b7d196 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:17.261263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6ba24774-e002-4ad2-93b3-65d755b7d196 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:17.269764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ba24774-e002-4ad2-93b3-65d755b7d196 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:17.272725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ba24774-e002-4ad2-93b3-65d755b7d196 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:17.274000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ba24774-e002-4ad2-93b3-65d755b7d196 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:17.274660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ba24774-e002-4ad2-93b3-65d755b7d196 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:17.313927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6ae24d8f-291f-486d-8c5e-975b9ca75911 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:17.328322 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6ae24d8f-291f-486d-8c5e-975b9ca75911 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1316 microversion: 2.1 time: 0.491462 Aug 02 06:50:17.345920 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 539/1176] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:16 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1316 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:17.514527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cd4f8498-2111-427e-bfb4-61e11f6a7b1e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:17.515359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cd4f8498-2111-427e-bfb4-61e11f6a7b1e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:17.531152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd4f8498-2111-427e-bfb4-61e11f6a7b1e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:17.531850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd4f8498-2111-427e-bfb4-61e11f6a7b1e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:17.533506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd4f8498-2111-427e-bfb4-61e11f6a7b1e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:17.535733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd4f8498-2111-427e-bfb4-61e11f6a7b1e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:17.624574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6ba24774-e002-4ad2-93b3-65d755b7d196 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:17.637488 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6ba24774-e002-4ad2-93b3-65d755b7d196 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.383461 Aug 02 06:50:17.639803 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 638/1177] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:17 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:17.961267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cd4f8498-2111-427e-bfb4-61e11f6a7b1e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:17.969301 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cd4f8498-2111-427e-bfb4-61e11f6a7b1e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1466 microversion: 2.1 time: 0.462998 Aug 02 06:50:17.969912 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 540/1178] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:17 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1466 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:17.991395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f5f87b29-0e33-4bcb-8c7e-15001f5954b4 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:17.992270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f5f87b29-0e33-4bcb-8c7e-15001f5954b4 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:17.998812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5f87b29-0e33-4bcb-8c7e-15001f5954b4 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:17.999501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5f87b29-0e33-4bcb-8c7e-15001f5954b4 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:18.000434 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5f87b29-0e33-4bcb-8c7e-15001f5954b4 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:18.001027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5f87b29-0e33-4bcb-8c7e-15001f5954b4 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:18.045549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:18.317475 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f5f87b29-0e33-4bcb-8c7e-15001f5954b4 tempest-ServersOnMultiNodesTest-668580957 tempest-ServersOnMultiNodesTest-668580957-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1617 microversion: 2.1 time: 0.328728 Aug 02 06:50:18.329916 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 639/1179] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:17 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1617 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:18.344301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-93c149c1-ebe3-4309-8aab-898d85de07d4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:18.345119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-93c149c1-ebe3-4309-8aab-898d85de07d4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:18.357506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-48109d65-009b-43c6-b4fa-90d22741f094 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:18.358425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-48109d65-009b-43c6-b4fa-90d22741f094 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:18.364825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93c149c1-ebe3-4309-8aab-898d85de07d4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:18.369430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93c149c1-ebe3-4309-8aab-898d85de07d4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:18.371147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93c149c1-ebe3-4309-8aab-898d85de07d4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:18.373286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93c149c1-ebe3-4309-8aab-898d85de07d4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:18.385028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48109d65-009b-43c6-b4fa-90d22741f094 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:18.390695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48109d65-009b-43c6-b4fa-90d22741f094 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:18.398146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48109d65-009b-43c6-b4fa-90d22741f094 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:18.398712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48109d65-009b-43c6-b4fa-90d22741f094 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:18.428771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-93c149c1-ebe3-4309-8aab-898d85de07d4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:50:18.636819 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-93c149c1-ebe3-4309-8aab-898d85de07d4 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 204 len: 0 microversion: 2.1 time: 0.296201 Aug 02 06:50:18.640996 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 541/1180] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:50:18 2022] DELETE /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:50:18.647853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2ff07535-db80-4b18-be39-ba2612e9eb12 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:18.649008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2ff07535-db80-4b18-be39-ba2612e9eb12 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:18.668071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ff07535-db80-4b18-be39-ba2612e9eb12 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:18.668510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ff07535-db80-4b18-be39-ba2612e9eb12 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:18.669505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ff07535-db80-4b18-be39-ba2612e9eb12 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:18.670130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ff07535-db80-4b18-be39-ba2612e9eb12 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:18.940644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-48109d65-009b-43c6-b4fa-90d22741f094 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:18.955199 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-48109d65-009b-43c6-b4fa-90d22741f094 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1316 microversion: 2.1 time: 0.601394 Aug 02 06:50:18.956162 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 640/1181] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:18 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:18.970420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-28e0f411-9662-4b22-9841-242df1348263 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:18.971659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-28e0f411-9662-4b22-9841-242df1348263 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:18.982155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28e0f411-9662-4b22-9841-242df1348263 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:18.982607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28e0f411-9662-4b22-9841-242df1348263 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:18.983391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28e0f411-9662-4b22-9841-242df1348263 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:18.983822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28e0f411-9662-4b22-9841-242df1348263 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:19.225547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2ff07535-db80-4b18-be39-ba2612e9eb12 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:19.235408 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2ff07535-db80-4b18-be39-ba2612e9eb12 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1472 microversion: 2.1 time: 0.593007 Aug 02 06:50:19.239949 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 542/1182] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:18 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1472 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:19.569291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-28e0f411-9662-4b22-9841-242df1348263 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:19.582042 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-28e0f411-9662-4b22-9841-242df1348263 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.624504 Aug 02 06:50:19.582822 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 641/1183] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:18 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:19.979561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d60b4010-bfb0-4d09-9d22-0249403fae50 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:19.980265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d60b4010-bfb0-4d09-9d22-0249403fae50 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:19.994761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d60b4010-bfb0-4d09-9d22-0249403fae50 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:19.995209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d60b4010-bfb0-4d09-9d22-0249403fae50 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:19.996016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d60b4010-bfb0-4d09-9d22-0249403fae50 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:19.996444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d60b4010-bfb0-4d09-9d22-0249403fae50 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:20.261438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-47e85ceb-737d-4395-a927-f6bde97b7093 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:20.262110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-47e85ceb-737d-4395-a927-f6bde97b7093 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:20.276467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47e85ceb-737d-4395-a927-f6bde97b7093 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:20.276928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47e85ceb-737d-4395-a927-f6bde97b7093 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:20.281284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47e85ceb-737d-4395-a927-f6bde97b7093 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:20.281746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47e85ceb-737d-4395-a927-f6bde97b7093 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:20.805837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d60b4010-bfb0-4d09-9d22-0249403fae50 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:20.814579 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d60b4010-bfb0-4d09-9d22-0249403fae50 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1466 microversion: 2.1 time: 0.839373 Aug 02 06:50:20.815847 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 543/1184] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:19 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1466 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:20.820787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ba321e4e-7a38-4216-bc92-52876929d0a5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:20.825499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ba321e4e-7a38-4216-bc92-52876929d0a5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:20.854135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba321e4e-7a38-4216-bc92-52876929d0a5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:20.854736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba321e4e-7a38-4216-bc92-52876929d0a5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:20.856440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba321e4e-7a38-4216-bc92-52876929d0a5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:20.857138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba321e4e-7a38-4216-bc92-52876929d0a5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:21.174494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-47e85ceb-737d-4395-a927-f6bde97b7093 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:21.185494 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-47e85ceb-737d-4395-a927-f6bde97b7093 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1472 microversion: 2.1 time: 0.927585 Aug 02 06:50:21.204612 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 642/1185] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:20 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1472 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:21.226290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6bacae26-a555-42d5-9c84-cb33e866dc34 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-2100326838", "metadata": {"image_type": "test"}}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:21.229447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6bacae26-a555-42d5-9c84-cb33e866dc34 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:21.251970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bacae26-a555-42d5-9c84-cb33e866dc34 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:21.259806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bacae26-a555-42d5-9c84-cb33e866dc34 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:21.261919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bacae26-a555-42d5-9c84-cb33e866dc34 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:21.262781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bacae26-a555-42d5-9c84-cb33e866dc34 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:21.388815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-6bacae26-a555-42d5-9c84-cb33e866dc34 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Getting quotas for project 59657b9384a5459982ab107427b52c49. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:50:21.405685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-6bacae26-a555-42d5-9c84-cb33e866dc34 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Getting quotas for user ce9ac912dfe54f3783fa943de17bcef7 and project 59657b9384a5459982ab107427b52c49. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:50:21.546979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ba321e4e-7a38-4216-bc92-52876929d0a5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:21.562417 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ba321e4e-7a38-4216-bc92-52876929d0a5 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.738363 Aug 02 06:50:21.563897 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 544/1186] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:20 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:21.804252 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6bacae26-a555-42d5-9c84-cb33e866dc34 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "POST /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793/action" status: 202 len: 0 microversion: 2.1 time: 0.595989 Aug 02 06:50:21.806997 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 643/1187] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:50:21 2022] POST /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 02 06:50:21.819595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-29607dbd-d1db-4417-8d72-ab6c8bc4be9e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f928c2823a0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:21.918902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-738df07a-9669-4787-b0b1-dfeb8177be3b tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "66ae9c9d-9734-4abe-99c2-da61a4a86018"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:21.921346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-738df07a-9669-4787-b0b1-dfeb8177be3b tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:21.926061 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-29607dbd-d1db-4417-8d72-ab6c8bc4be9e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.112695 Aug 02 06:50:21.931520 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 644/1188] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:21 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:21.939083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-738df07a-9669-4787-b0b1-dfeb8177be3b tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:21.939448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-738df07a-9669-4787-b0b1-dfeb8177be3b tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:21.940219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-738df07a-9669-4787-b0b1-dfeb8177be3b tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:21.940647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-738df07a-9669-4787-b0b1-dfeb8177be3b tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:22.213002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bf35d22e-7c91-435e-b48e-65bb762acd27 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:22.214151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bf35d22e-7c91-435e-b48e-65bb762acd27 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:22.240209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf35d22e-7c91-435e-b48e-65bb762acd27 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:22.242555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf35d22e-7c91-435e-b48e-65bb762acd27 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:22.248737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf35d22e-7c91-435e-b48e-65bb762acd27 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:22.249572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf35d22e-7c91-435e-b48e-65bb762acd27 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:22.537116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=8 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:22.545183 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-738df07a-9669-4787-b0b1-dfeb8177be3b tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] HTTP exception thrown: Volume 66ae9c9d-9734-4abe-99c2-da61a4a86018 could not be found. Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-738df07a-9669-4787-b0b1-dfeb8177be3b tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] Request method failure captured: Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: request: PUT /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments/fd6314fe-0ece-4f4c-9dd8-d998e4fc3ddb HTTP/1.1 Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 74 Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MjER5zEX7wYt-M-mwuNAKZzij98yWl4LwNW5wCDw_hRVEuv5ZGhs5WNJeyQaeirfARL4geY2-JIBGmKslwh8-F-hP8ABUF0egLXljoSbt_n8gSmXRdlN_xBjiPbDNbmm8FoDxKMCZpu8Zx01jo2yehvaTME9d6esr3JCcND1ngK4Sk Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 4eaf1d07ee7348ef84dbd197b75f9d18 Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-VolumesAdminNegativeTest-1288987858 Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:50:22.596624 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:50:22.598482 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4eaf1d07ee7348ef84dbd197b75f9d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eaf1d07ee7348ef84dbd197b75f9d18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4eaf1d07ee7348ef84dbd197b75f9d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eaf1d07ee7348ef84dbd197b75f9d18"}]}] Aug 02 06:50:22.598482 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-VolumesAdminNegativeTest-1288987858 Aug 02 06:50:22.598482 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 4eaf1d07ee7348ef84dbd197b75f9d18 Aug 02 06:50:22.598482 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1288987858 Aug 02 06:50:22.598482 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-VolumesAdminNegativeTest-1288987858-project-admin Aug 02 06:50:22.598482 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:50:22.598482 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:50:22.598482 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: d5cd643585c94d5e945098abe8eebd72 Aug 02 06:50:22.598482 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-VolumesAdminNegativeTest-1288987858-project-admin Aug 02 06:50:22.598482 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:50:22.598482 n-d-851337-3 devstack@n-api.service[126119]: {"volumeAttachment": {"volumeId": "66ae9c9d-9734-4abe-99c2-da61a4a86018"}} Aug 02 06:50:22.598482 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:50:22.598482 n-d-851337-3 devstack@n-api.service[126119]: exception: Volume 66ae9c9d-9734-4abe-99c2-da61a4a86018 could not be found. Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'server_id': '170e8209-d15a-4598-9d57-3c5973fd8733', 'id': 'fd6314fe-0ece-4f4c-9dd8-d998e4fc3ddb', 'body': {'volumeAttachment': {'volumeId': '66ae9c9d-9734-4abe-99c2-da61a4a86018'}}} Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 06:50:22.599318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66ae9c9d-9734-4abe-99c2-da61a4a86018 could not be found. (HTTP 404) (Request-ID: req-0e152e02-1dbd-4309-b5b1-42a98727e5d9) Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 06:50:22.600389 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66ae9c9d-9734-4abe-99c2-da61a4a86018 could not be found. Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:22.601667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 66ae9c9d-9734-4abe-99c2-da61a4a86018 could not be found. Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66ae9c9d-9734-4abe-99c2-da61a4a86018 could not be found. Aug 02 06:50:22.602930 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:22.604111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-738df07a-9669-4787-b0b1-dfeb8177be3b tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] Returning 400 to user: Volume 66ae9c9d-9734-4abe-99c2-da61a4a86018 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:22.604111 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-738df07a-9669-4787-b0b1-dfeb8177be3b tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] 10.222.0.79 "PUT /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments/fd6314fe-0ece-4f4c-9dd8-d998e4fc3ddb" status: 400 len: 107 microversion: 2.1 time: 0.966236 Aug 02 06:50:22.604111 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 545/1189] 10.222.0.79 () {60 vars in 1433 bytes} [Tue Aug 2 06:50:21 2022] PUT /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments/fd6314fe-0ece-4f4c-9dd8-d998e4fc3ddb => generated 107 bytes in 968 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 06:50:22.604335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-77627990-1975-4a25-a1af-f526106c2dce tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:22.606109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-77627990-1975-4a25-a1af-f526106c2dce tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:22.622094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77627990-1975-4a25-a1af-f526106c2dce tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:22.622959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77627990-1975-4a25-a1af-f526106c2dce tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:22.624071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77627990-1975-4a25-a1af-f526106c2dce tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:22.624663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77627990-1975-4a25-a1af-f526106c2dce tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:22.789842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=47 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:23.492821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bf35d22e-7c91-435e-b48e-65bb762acd27 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:23.501683 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bf35d22e-7c91-435e-b48e-65bb762acd27 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1472 microversion: 2.1 time: 1.294432 Aug 02 06:50:23.505714 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 645/1190] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:22 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1472 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:23.515471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fc58cfd4-826b-404c-840f-2cb6c43060e7 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:23.518506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fc58cfd4-826b-404c-840f-2cb6c43060e7 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:23.536182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc58cfd4-826b-404c-840f-2cb6c43060e7 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:23.536643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc58cfd4-826b-404c-840f-2cb6c43060e7 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:23.537433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc58cfd4-826b-404c-840f-2cb6c43060e7 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:23.537862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc58cfd4-826b-404c-840f-2cb6c43060e7 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:23.783691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-fc58cfd4-826b-404c-840f-2cb6c43060e7 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lazy-loading 'services' on Instance uuid 170e8209-d15a-4598-9d57-3c5973fd8733 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:50:23.884304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-77627990-1975-4a25-a1af-f526106c2dce tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:23.897263 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-77627990-1975-4a25-a1af-f526106c2dce tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 1.297295 Aug 02 06:50:23.897858 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 546/1191] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:22 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:23.909383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9bea7cec-7dae-44aa-bcf5-2846cfdbcd87 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927afbbca0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:24.001199 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9bea7cec-7dae-44aa-bcf5-2846cfdbcd87 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.100302 Aug 02 06:50:24.001902 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 547/1192] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:23 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:24.075142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b3a06a6b-f532-415c-aef3-3ae81294a995 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Action: 'create', calling method: .version_select at 0x7f927af2bca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1856638383", "description": "tempest-description-1515518175"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:24.094961 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fc58cfd4-826b-404c-840f-2cb6c43060e7 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "DELETE /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments/fd6314fe-0ece-4f4c-9dd8-d998e4fc3ddb" status: 202 len: 0 microversion: 2.1 time: 0.587152 Aug 02 06:50:24.095857 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 646/1193] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 06:50:23 2022] DELETE /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments/fd6314fe-0ece-4f4c-9dd8-d998e4fc3ddb => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:50:24.101637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e4d6a482-f400-4fc8-8938-65222db7d6e2 req-309d80b6-d01a-454c-998c-ef8a2f6232ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4a547f-b973-43f1-a4ab-5d1f4581a10e", "name": "network-vif-deleted", "tag": "a1124101-3f39-4792-951d-369323291f84"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:24.114933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e4d6a482-f400-4fc8-8938-65222db7d6e2 req-309d80b6-d01a-454c-998c-ef8a2f6232ee service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:24.116226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e4d6a482-f400-4fc8-8938-65222db7d6e2 req-309d80b6-d01a-454c-998c-ef8a2f6232ee service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:24.136442 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e4d6a482-f400-4fc8-8938-65222db7d6e2 req-309d80b6-d01a-454c-998c-ef8a2f6232ee service nova] Creating event network-vif-deleted:a1124101-3f39-4792-951d-369323291f84 for instance 8c4a547f-b973-43f1-a4ab-5d1f4581a10e on n-h2-851337-3 Aug 02 06:50:24.142509 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e4d6a482-f400-4fc8-8938-65222db7d6e2 req-309d80b6-d01a-454c-998c-ef8a2f6232ee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044823 Aug 02 06:50:24.143438 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 647/1194] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:24.148875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6a69820-5e54-4f02-904e-0ef51b53e484 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:24.151546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d6a69820-5e54-4f02-904e-0ef51b53e484 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:24.158922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6a69820-5e54-4f02-904e-0ef51b53e484 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:24.159731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6a69820-5e54-4f02-904e-0ef51b53e484 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:24.160727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6a69820-5e54-4f02-904e-0ef51b53e484 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:24.161347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6a69820-5e54-4f02-904e-0ef51b53e484 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:24.265710 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d6a69820-5e54-4f02-904e-0ef51b53e484 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120744 Aug 02 06:50:24.268356 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 648/1195] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 06:50:24 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:24.531863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ee3fe5e0-28ea-496d-a7b9-423643895ff6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:24.532528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ee3fe5e0-28ea-496d-a7b9-423643895ff6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:24.550674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee3fe5e0-28ea-496d-a7b9-423643895ff6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:24.551140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee3fe5e0-28ea-496d-a7b9-423643895ff6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:24.560299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee3fe5e0-28ea-496d-a7b9-423643895ff6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:24.560764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee3fe5e0-28ea-496d-a7b9-423643895ff6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:24.602538 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b3a06a6b-f532-415c-aef3-3ae81294a995 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.599578 Aug 02 06:50:24.603873 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 548/1196] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:50:24 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:24.625918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dcea5d1b-1293-44e5-8f99-e00c8f4847ca tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Action: 'create', calling method: .version_select at 0x7f927af11310>, body: {"security_group_rule": {"parent_group_id": "12595296-d18b-46e2-b6e8-ac032586963c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:24.687720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee3fe5e0-28ea-496d-a7b9-423643895ff6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:24.688396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee3fe5e0-28ea-496d-a7b9-423643895ff6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:24.690049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-ee3fe5e0-28ea-496d-a7b9-423643895ff6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lazy-loading 'fault' on Instance uuid 8c4a547f-b973-43f1-a4ab-5d1f4581a10e {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:50:24.804190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ee3fe5e0-28ea-496d-a7b9-423643895ff6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:24.830898 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ee3fe5e0-28ea-496d-a7b9-423643895ff6 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 200 len: 1306 microversion: 2.1 time: 0.303026 Aug 02 06:50:24.849982 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 649/1197] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:24 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 1306 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:24.919465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0226c456-0a70-48d9-aa49-73ad8d76e605 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:24.920554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0226c456-0a70-48d9-aa49-73ad8d76e605 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:24.930571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0226c456-0a70-48d9-aa49-73ad8d76e605 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:24.931024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0226c456-0a70-48d9-aa49-73ad8d76e605 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:24.931825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0226c456-0a70-48d9-aa49-73ad8d76e605 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:24.932260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0226c456-0a70-48d9-aa49-73ad8d76e605 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:25.127517 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dcea5d1b-1293-44e5-8f99-e00c8f4847ca tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.508240 Aug 02 06:50:25.128621 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 549/1198] 10.222.0.79 () {60 vars in 1195 bytes} [Tue Aug 2 06:50:24 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:25.135960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4c31f38c-ec52-4f28-9ade-2e3a1c23b50f tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927b09c700>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:25.220011 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4c31f38c-ec52-4f28-9ade-2e3a1c23b50f tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.090277 Aug 02 06:50:25.220959 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 550/1199] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:25 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:25.233944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-50b5b2cd-253e-4708-9ed5-1a0b9d108888 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Action: 'create', calling method: .version_select at 0x7f927af0caf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1291604547", "description": "tempest-description-2109387350"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:25.266212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0226c456-0a70-48d9-aa49-73ad8d76e605 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:25.274895 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0226c456-0a70-48d9-aa49-73ad8d76e605 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.360496 Aug 02 06:50:25.278701 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 650/1200] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:24 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:25.290619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f0a07136-f4f9-48ab-82a9-fa95a02f9308 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:25.295882 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f0a07136-f4f9-48ab-82a9-fa95a02f9308 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:25.307754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0a07136-f4f9-48ab-82a9-fa95a02f9308 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:25.311412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0a07136-f4f9-48ab-82a9-fa95a02f9308 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:25.315287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0a07136-f4f9-48ab-82a9-fa95a02f9308 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:25.316909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0a07136-f4f9-48ab-82a9-fa95a02f9308 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:25.387494 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f0a07136-f4f9-48ab-82a9-fa95a02f9308 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107088 Aug 02 06:50:25.390212 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 651/1201] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 06:50:25 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:25.507063 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-50b5b2cd-253e-4708-9ed5-1a0b9d108888 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.277535 Aug 02 06:50:25.507678 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 551/1202] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:50:25 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:25.520269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b3916df-f05e-42cd-8000-a9a9ced1eb39 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Action: 'create', calling method: .version_select at 0x7f928c2eb310>, body: {"security_group_rule": {"parent_group_id": "eddc76c7-cfc6-41f9-9faf-36d92c1c575a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:25.869738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34c188ac-d70d-4e37-8047-0dff40579a6e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:25.870657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-34c188ac-d70d-4e37-8047-0dff40579a6e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 8c4a547f-b973-43f1-a4ab-5d1f4581a10e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:25.878249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34c188ac-d70d-4e37-8047-0dff40579a6e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:25.878720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34c188ac-d70d-4e37-8047-0dff40579a6e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:25.879471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34c188ac-d70d-4e37-8047-0dff40579a6e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:25.882255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34c188ac-d70d-4e37-8047-0dff40579a6e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:25.928398 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-34c188ac-d70d-4e37-8047-0dff40579a6e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] HTTP exception thrown: Instance 8c4a547f-b973-43f1-a4ab-5d1f4581a10e could not be found. Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34c188ac-d70d-4e37-8047-0dff40579a6e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Request method failure captured: Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e HTTP/1.1 Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiP0QH7i_IXK_4JWtYj3HrgwHLsXsGtff-Mc558oWyxLOMs39SkcY535RJSybe5b5I6ZUX77Rjwuk1nlC1mvc_DV8M2K2mc7F4t5W6mRuXQ5jz-P4SqXjiGZGpTEG_iI4wzNZlPyAagEm70iD4im2lOWSJ0djax-9JSk8M47fdG6l8 Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:50:25.932688 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:50:25.935509 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}] Aug 02 06:50:25.935509 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:25.935509 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:50:25.935509 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:25.935509 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:50:25.935509 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:50:25.935509 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:50:25.935509 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: c0327068ab564b05ac50b0efd4c61a0f Aug 02 06:50:25.935509 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:50:25.935509 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:50:25.935509 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 8c4a547f-b973-43f1-a4ab-5d1f4581a10e could not be found. Aug 02 06:50:25.935509 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '8c4a547f-b973-43f1-a4ab-5d1f4581a10e'} Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4a547f-b973-43f1-a4ab-5d1f4581a10e could not be found. Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:25.936468 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4a547f-b973-43f1-a4ab-5d1f4581a10e could not be found. Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4a547f-b973-43f1-a4ab-5d1f4581a10e could not be found. Aug 02 06:50:25.939502 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:25.948911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34c188ac-d70d-4e37-8047-0dff40579a6e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Returning 404 to user: Instance 8c4a547f-b973-43f1-a4ab-5d1f4581a10e could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:25.951685 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-34c188ac-d70d-4e37-8047-0dff40579a6e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e" status: 404 len: 111 microversion: 2.1 time: 0.086420 Aug 02 06:50:25.953032 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 552/1203] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:25 2022] GET /compute/v2.1/servers/8c4a547f-b973-43f1-a4ab-5d1f4581a10e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:50:25.955656 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b3916df-f05e-42cd-8000-a9a9ced1eb39 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.436656 Aug 02 06:50:25.956814 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 652/1204] 10.222.0.79 () {60 vars in 1195 bytes} [Tue Aug 2 06:50:25 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:25.964815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cde89a57-477c-4662-ad6e-7bead090adfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:25.965324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cde89a57-477c-4662-ad6e-7bead090adfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:25.969569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc11f019-3149-4dc6-9fea-805ceada4d44 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Action: 'create', calling method: .version_select at 0x7f928c27b700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1388427863", "description": "tempest-description-1867508281"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:25.974581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cde89a57-477c-4662-ad6e-7bead090adfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:25.975087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cde89a57-477c-4662-ad6e-7bead090adfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:25.975944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cde89a57-477c-4662-ad6e-7bead090adfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:25.976592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cde89a57-477c-4662-ad6e-7bead090adfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:26.011674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cde89a57-477c-4662-ad6e-7bead090adfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:50:26.166281 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cde89a57-477c-4662-ad6e-7bead090adfc tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 204 len: 0 microversion: 2.1 time: 0.208625 Aug 02 06:50:26.167952 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 553/1205] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:50:25 2022] DELETE /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 06:50:26.192070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bc0b82d9-1ae9-452c-bca0-dab3b5ab0664 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:26.193514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bc0b82d9-1ae9-452c-bca0-dab3b5ab0664 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:26.211492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc0b82d9-1ae9-452c-bca0-dab3b5ab0664 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:26.217875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc0b82d9-1ae9-452c-bca0-dab3b5ab0664 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:26.219584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc0b82d9-1ae9-452c-bca0-dab3b5ab0664 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:26.220641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc0b82d9-1ae9-452c-bca0-dab3b5ab0664 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:26.252665 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc11f019-3149-4dc6-9fea-805ceada4d44 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.287287 Aug 02 06:50:26.253258 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 653/1206] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:50:25 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:26.266267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5d800720-97f5-49bf-8242-b7bd4e2eb445 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f928c299b80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:26.332361 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5d800720-97f5-49bf-8242-b7bd4e2eb445 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.069744 Aug 02 06:50:26.333355 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 654/1207] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:26 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:26.341167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-12cd20d6-11bd-4f93-afc6-6d5292cf7ba9 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Action: 'create', calling method: .version_select at 0x7f928c3b8dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-837743549", "description": "tempest-description-695707487"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:26.527165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bc0b82d9-1ae9-452c-bca0-dab3b5ab0664 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:26.540576 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bc0b82d9-1ae9-452c-bca0-dab3b5ab0664 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1473 microversion: 2.1 time: 0.366199 Aug 02 06:50:26.541199 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 554/1208] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:26 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1473 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:26.557644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-49b5cb4c-655d-48dd-b140-988533c9026b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:26.561280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-49b5cb4c-655d-48dd-b140-988533c9026b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:26.585298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49b5cb4c-655d-48dd-b140-988533c9026b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:26.585748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49b5cb4c-655d-48dd-b140-988533c9026b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:26.587022 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49b5cb4c-655d-48dd-b140-988533c9026b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:26.587511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49b5cb4c-655d-48dd-b140-988533c9026b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:26.631583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:26.791585 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-12cd20d6-11bd-4f93-afc6-6d5292cf7ba9 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.456897 Aug 02 06:50:26.801915 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 655/1209] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:50:26 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:26.815330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7517ed1e-19c9-4ac5-b702-6eeacd6ebf81 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:26.818276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7517ed1e-19c9-4ac5-b702-6eeacd6ebf81 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:26.835498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7517ed1e-19c9-4ac5-b702-6eeacd6ebf81 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:26.835932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7517ed1e-19c9-4ac5-b702-6eeacd6ebf81 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:26.837244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7517ed1e-19c9-4ac5-b702-6eeacd6ebf81 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:26.837676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7517ed1e-19c9-4ac5-b702-6eeacd6ebf81 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:26.878070 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7517ed1e-19c9-4ac5-b702-6eeacd6ebf81 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074398 Aug 02 06:50:26.883971 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 656/1210] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 06:50:26 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:26.890441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-926b64ba-8cd8-4543-a71d-06fc39dacb3f tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Action: 'create', calling method: .version_select at 0x7f928c33aa60>, body: {"security_group_rule": {"parent_group_id": "9d704e6c-8a92-4a61-afa2-cc43d039d1d5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "77d249de-bf9e-4f25-ad26-8a4e18194736"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:26.948150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-49b5cb4c-655d-48dd-b140-988533c9026b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:26.959328 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-49b5cb4c-655d-48dd-b140-988533c9026b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.414392 Aug 02 06:50:26.964085 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 555/1211] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:26 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:27.280514 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-926b64ba-8cd8-4543-a71d-06fc39dacb3f tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.393974 Aug 02 06:50:27.281128 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 657/1212] 10.222.0.79 () {60 vars in 1195 bytes} [Tue Aug 2 06:50:26 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:27.295730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b24381ea-fbae-40bc-b2e6-0e6e2d4a11e5 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Action: 'create', calling method: .version_select at 0x7f927af2b310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1501681184", "description": "tempest-description-1061195945"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:27.348390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-72c93489-982f-4eb7-a279-1aa0c1b3f9cd tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f928c299670>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:27.428075 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-72c93489-982f-4eb7-a279-1aa0c1b3f9cd tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.083524 Aug 02 06:50:27.429930 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 658/1213] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:27 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:27.502259 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b24381ea-fbae-40bc-b2e6-0e6e2d4a11e5 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.211689 Aug 02 06:50:27.504353 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 556/1214] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:50:27 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:27.518329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7eea0506-7a6d-4e72-9a78-ae859f82766c tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Action: 'create', calling method: .version_select at 0x7f928c33a040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-863587806", "description": "tempest-description-1115063909"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:27.562630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6f107e54-1f88-4768-bf30-3c0a494b2226 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:27.563555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6f107e54-1f88-4768-bf30-3c0a494b2226 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:27.575907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f107e54-1f88-4768-bf30-3c0a494b2226 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:27.578701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f107e54-1f88-4768-bf30-3c0a494b2226 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:27.579507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f107e54-1f88-4768-bf30-3c0a494b2226 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:27.582547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f107e54-1f88-4768-bf30-3c0a494b2226 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:27.848522 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7eea0506-7a6d-4e72-9a78-ae859f82766c tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.335325 Aug 02 06:50:27.849451 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 659/1215] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:50:27 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:27.862420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-06a1f5cb-484e-421b-b59b-dd224b1c9a57 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Action: 'create', calling method: .version_select at 0x7f928c2e1ee0>, body: {"security_group_rule": {"parent_group_id": "897dea3a-ea37-4e82-b505-0801e88bac80", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "91b70a30-9e62-48ff-af5c-1d1649979582"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:27.908230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6f107e54-1f88-4768-bf30-3c0a494b2226 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:27.948226 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6f107e54-1f88-4768-bf30-3c0a494b2226 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1473 microversion: 2.1 time: 0.390195 Aug 02 06:50:27.952497 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 557/1216] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:27 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1473 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:27.961973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1ee43bd0-eb09-43fb-8216-60dd5be02b29 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:27.966189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1ee43bd0-eb09-43fb-8216-60dd5be02b29 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:27.981507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ee43bd0-eb09-43fb-8216-60dd5be02b29 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:27.982002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ee43bd0-eb09-43fb-8216-60dd5be02b29 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:27.983070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ee43bd0-eb09-43fb-8216-60dd5be02b29 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:27.983511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ee43bd0-eb09-43fb-8216-60dd5be02b29 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:28.069344 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1ee43bd0-eb09-43fb-8216-60dd5be02b29 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096215 Aug 02 06:50:28.070072 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 558/1217] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 06:50:27 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:28.089716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ec93b54e-48fc-4f7e-8306-73284fd37dcf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:28.090953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ec93b54e-48fc-4f7e-8306-73284fd37dcf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:28.101967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec93b54e-48fc-4f7e-8306-73284fd37dcf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:28.104140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec93b54e-48fc-4f7e-8306-73284fd37dcf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:28.106444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec93b54e-48fc-4f7e-8306-73284fd37dcf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:28.107062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec93b54e-48fc-4f7e-8306-73284fd37dcf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:28.356256 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-06a1f5cb-484e-421b-b59b-dd224b1c9a57 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.498093 Aug 02 06:50:28.357062 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 660/1218] 10.222.0.79 () {60 vars in 1195 bytes} [Tue Aug 2 06:50:27 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:28.371678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0de0a5cc-9caa-4f55-91e3-63efb9be5a4f tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Calling method '.version_select at 0x7f927ab39040>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:28.429934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ec93b54e-48fc-4f7e-8306-73284fd37dcf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:28.445631 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ec93b54e-48fc-4f7e-8306-73284fd37dcf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.372018 Aug 02 06:50:28.457922 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 559/1219] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:28 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:28.457922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f395a202-82ae-42be-a438-62a64b7f9606 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927af2bc10>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:28.514193 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f395a202-82ae-42be-a438-62a64b7f9606 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.066002 Aug 02 06:50:28.516946 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 560/1220] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:28 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:28.693773 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0de0a5cc-9caa-4f55-91e3-63efb9be5a4f tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/91b70a30-9e62-48ff-af5c-1d1649979582" status: 202 len: 0 microversion: 2.1 time: 0.327627 Aug 02 06:50:28.694452 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 661/1221] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:50:28 2022] DELETE /compute/v2.1/os-security-groups/91b70a30-9e62-48ff-af5c-1d1649979582 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:50:28.704231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5a21edf8-d827-4f88-b254-9975026045d3 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Calling method '.version_select at 0x7f927b035430>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:28.859140 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5a21edf8-d827-4f88-b254-9975026045d3 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/897dea3a-ea37-4e82-b505-0801e88bac80" status: 200 len: 248 microversion: 2.1 time: 0.159711 Aug 02 06:50:28.860065 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 561/1222] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 06:50:28 2022] GET /compute/v2.1/os-security-groups/897dea3a-ea37-4e82-b505-0801e88bac80 => generated 248 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:28.874079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b76454cd-d96b-4baa-ac02-12492d3beaba tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Action: 'create', calling method: .version_select at 0x7f927ab39670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1925869737", "description": "tempest-description-231947326"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:28.975697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-12ae4498-dc43-4481-9bfc-c15802a43c68 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:28.976640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-12ae4498-dc43-4481-9bfc-c15802a43c68 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:28.996358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12ae4498-dc43-4481-9bfc-c15802a43c68 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:28.997070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12ae4498-dc43-4481-9bfc-c15802a43c68 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:28.998270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12ae4498-dc43-4481-9bfc-c15802a43c68 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:28.998959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12ae4498-dc43-4481-9bfc-c15802a43c68 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:29.340385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-12ae4498-dc43-4481-9bfc-c15802a43c68 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:29.355002 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-12ae4498-dc43-4481-9bfc-c15802a43c68 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1473 microversion: 2.1 time: 0.384623 Aug 02 06:50:29.355600 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 562/1223] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:28 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1473 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:29.360420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-782d56f8-1901-4af7-867b-73054ade0f19 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:29.376316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-782d56f8-1901-4af7-867b-73054ade0f19 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:29.383307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-782d56f8-1901-4af7-867b-73054ade0f19 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:29.383756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-782d56f8-1901-4af7-867b-73054ade0f19 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:29.384540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-782d56f8-1901-4af7-867b-73054ade0f19 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:29.384970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-782d56f8-1901-4af7-867b-73054ade0f19 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:29.395122 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b76454cd-d96b-4baa-ac02-12492d3beaba tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.523049 Aug 02 06:50:29.395122 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 662/1224] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:50:28 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:29.406715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ca9cbfb-0856-4b6b-89a0-cd36000a9587 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Action: 'create', calling method: .version_select at 0x7f927ab1f550>, body: {"security_group_rule": {"parent_group_id": "3c470aba-0204-4ccb-92d5-04e6c36302bd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:29.478910 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-782d56f8-1901-4af7-867b-73054ade0f19 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122145 Aug 02 06:50:29.479513 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 563/1225] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 06:50:29 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:29.498957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5216bdd0-1d49-443d-a6ef-608d77872fc0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:29.499838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5216bdd0-1d49-443d-a6ef-608d77872fc0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:29.514444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5216bdd0-1d49-443d-a6ef-608d77872fc0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:29.515275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5216bdd0-1d49-443d-a6ef-608d77872fc0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:29.516208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5216bdd0-1d49-443d-a6ef-608d77872fc0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:29.516917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5216bdd0-1d49-443d-a6ef-608d77872fc0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:29.949359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5216bdd0-1d49-443d-a6ef-608d77872fc0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:29.959289 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5216bdd0-1d49-443d-a6ef-608d77872fc0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.473617 Aug 02 06:50:29.962684 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 564/1226] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:29 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:29.973939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-87417763-497d-4647-9a55-f318b2d83276 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927aef20d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:30.068536 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2ca9cbfb-0856-4b6b-89a0-cd36000a9587 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.665872 Aug 02 06:50:30.074496 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-87417763-497d-4647-9a55-f318b2d83276 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.109216 Aug 02 06:50:30.076039 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 663/1227] 10.222.0.79 () {60 vars in 1195 bytes} [Tue Aug 2 06:50:29 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:30.078107 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 565/1228] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:29 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:30.087398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-fbe29523-ae58-4fce-a715-ae08527ab83d req-ae880444-a0d1-495d-9308-9d785c3dde0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1477c63-2792-4918-ae17-613e7850c874", "name": "network-vif-deleted", "tag": "1cadd2c0-6321-4b11-ae6d-e1a6d8551eeb"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:30.088710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f31ca9e2-bfc1-4f3f-b9f6-9d22980d7197 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Action: 'create', calling method: .version_select at 0x7f927af2b8b0>, body: {"security_group_rule": {"parent_group_id": "3c470aba-0204-4ccb-92d5-04e6c36302bd", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:30.103328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-fbe29523-ae58-4fce-a715-ae08527ab83d req-ae880444-a0d1-495d-9308-9d785c3dde0d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:30.103772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-fbe29523-ae58-4fce-a715-ae08527ab83d req-ae880444-a0d1-495d-9308-9d785c3dde0d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:30.147687 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-fbe29523-ae58-4fce-a715-ae08527ab83d req-ae880444-a0d1-495d-9308-9d785c3dde0d service nova] Creating event network-vif-deleted:1cadd2c0-6321-4b11-ae6d-e1a6d8551eeb for instance c1477c63-2792-4918-ae17-613e7850c874 on n-h1-851337-3 Aug 02 06:50:30.165622 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-fbe29523-ae58-4fce-a715-ae08527ab83d req-ae880444-a0d1-495d-9308-9d785c3dde0d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087987 Aug 02 06:50:30.178138 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 664/1229] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:30.346431 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f31ca9e2-bfc1-4f3f-b9f6-9d22980d7197 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.265191 Aug 02 06:50:30.347205 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 566/1230] 10.222.0.79 () {60 vars in 1195 bytes} [Tue Aug 2 06:50:30 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:30.359763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a57f09ed-b98b-471f-8e23-82f5ba0c3bbf tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Calling method '.version_select at 0x7f928c22c550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:30.377107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e62742f0-71b0-44fb-bb66-d48ad36c2e38 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:30.377726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e62742f0-71b0-44fb-bb66-d48ad36c2e38 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:30.396067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e62742f0-71b0-44fb-bb66-d48ad36c2e38 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:30.396526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e62742f0-71b0-44fb-bb66-d48ad36c2e38 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:30.397316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e62742f0-71b0-44fb-bb66-d48ad36c2e38 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:30.397753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e62742f0-71b0-44fb-bb66-d48ad36c2e38 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:30.425636 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a57f09ed-b98b-471f-8e23-82f5ba0c3bbf tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/3c470aba-0204-4ccb-92d5-04e6c36302bd" status: 200 len: 664 microversion: 2.1 time: 0.070630 Aug 02 06:50:30.427271 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 665/1231] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 06:50:30 2022] GET /compute/v2.1/os-security-groups/3c470aba-0204-4ccb-92d5-04e6c36302bd => generated 664 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:30.449466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-389547ab-18f6-443f-8b5f-751e0fd77944 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Calling method '.version_select at 0x7f927ab1ff70>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:30.470226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e62742f0-71b0-44fb-bb66-d48ad36c2e38 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:30.470678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e62742f0-71b0-44fb-bb66-d48ad36c2e38 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:30.471131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-e62742f0-71b0-44fb-bb66-d48ad36c2e38 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lazy-loading 'fault' on Instance uuid c1477c63-2792-4918-ae17-613e7850c874 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:50:30.567920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e62742f0-71b0-44fb-bb66-d48ad36c2e38 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:30.578232 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e62742f0-71b0-44fb-bb66-d48ad36c2e38 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 200 len: 1307 microversion: 2.1 time: 0.204893 Aug 02 06:50:30.581177 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 567/1232] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:30 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 1307 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:30.589883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cbba28a0-ff2a-4870-bacc-678cea7563a9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:30.594020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cbba28a0-ff2a-4870-bacc-678cea7563a9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:30.604392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbba28a0-ff2a-4870-bacc-678cea7563a9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:30.605104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbba28a0-ff2a-4870-bacc-678cea7563a9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:30.606181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbba28a0-ff2a-4870-bacc-678cea7563a9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:30.606764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbba28a0-ff2a-4870-bacc-678cea7563a9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:30.675232 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-389547ab-18f6-443f-8b5f-751e0fd77944 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-group-rules/61c7081c-20bf-45cd-8eaa-7d919bc0880e" status: 202 len: 0 microversion: 2.1 time: 0.234197 Aug 02 06:50:30.676354 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 666/1233] 10.222.0.79 () {58 vars in 1287 bytes} [Tue Aug 2 06:50:30 2022] DELETE /compute/v2.1/os-security-group-rules/61c7081c-20bf-45cd-8eaa-7d919bc0880e => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:50:30.688205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-48407912-1e73-42a9-a525-25f65aa95674 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Calling method '.version_select at 0x7f927aac5790>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:30.710279 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cbba28a0-ff2a-4870-bacc-678cea7563a9 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125483 Aug 02 06:50:30.716663 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 568/1234] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 06:50:30 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:30.985671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-444a034a-f9d7-41ad-8ad5-0d44eabd9060 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:30.986547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-444a034a-f9d7-41ad-8ad5-0d44eabd9060 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:31.000856 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-48407912-1e73-42a9-a525-25f65aa95674 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/3c470aba-0204-4ccb-92d5-04e6c36302bd" status: 202 len: 0 microversion: 2.1 time: 0.317967 Aug 02 06:50:31.001545 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 667/1235] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:50:30 2022] DELETE /compute/v2.1/os-security-groups/3c470aba-0204-4ccb-92d5-04e6c36302bd => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:50:31.004081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-444a034a-f9d7-41ad-8ad5-0d44eabd9060 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:31.007290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-444a034a-f9d7-41ad-8ad5-0d44eabd9060 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:31.010902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-444a034a-f9d7-41ad-8ad5-0d44eabd9060 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:31.011737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-444a034a-f9d7-41ad-8ad5-0d44eabd9060 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:31.017565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2c02386-5041-4e25-89f7-756a58e8709e tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Calling method '.version_select at 0x7f927aac5160>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:31.102820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG neutronclient.v2_0.client [None req-f2c02386-5041-4e25-89f7-756a58e8709e tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 91b70a30-9e62-48ff-af5c-1d1649979582 does not exist", "detail": ""}} {{(pid=126120) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:50:31.108100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.security_group_api [None req-f2c02386-5041-4e25-89f7-756a58e8709e tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Neutron security group 91b70a30-9e62-48ff-af5c-1d1649979582 not found {{(pid=126120) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 06:50:31.111970 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-f2c02386-5041-4e25-89f7-756a58e8709e tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] HTTP exception thrown: Security group 91b70a30-9e62-48ff-af5c-1d1649979582 does not exist Aug 02 06:50:31.111970 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-899683e9-1a26-4a9e-b634-2d36136ef451'] Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2c02386-5041-4e25-89f7-756a58e8709e tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Request method failure captured: Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-security-groups/91b70a30-9e62-48ff-af5c-1d1649979582 HTTP/1.1 Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mkvoeoe4MehqOguKq4IgDEeRHPyLW6hgUwryYYNddURWKzU39YGnAltn5exWjBjZqRfPp505sdgb23yGYA9hg04NJD_r8mtHJJVTjgNMgdb3LXncwhUJNm5NbbZxXr5ixfOAW9ZeouVZa5Ha_joFgn0pHlTxUF2hDW5guu9p_NTGU8 Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a73b8f0ee1f64e1397f7de13afb77e2a Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-274807442 Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:50:31.141290 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:50:31.142921 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a73b8f0ee1f64e1397f7de13afb77e2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a73b8f0ee1f64e1397f7de13afb77e2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a73b8f0ee1f64e1397f7de13afb77e2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a73b8f0ee1f64e1397f7de13afb77e2a"}]}] Aug 02 06:50:31.142921 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupRulesTestJSON-274807442 Aug 02 06:50:31.142921 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a73b8f0ee1f64e1397f7de13afb77e2a Aug 02 06:50:31.142921 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-274807442 Aug 02 06:50:31.142921 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupRulesTestJSON-274807442-project Aug 02 06:50:31.142921 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:50:31.142921 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:50:31.142921 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3fba267d0f2441cab4369aae386b648d Aug 02 06:50:31.142921 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupRulesTestJSON-274807442-project Aug 02 06:50:31.142921 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:50:31.142921 n-d-851337-3 devstack@n-api.service[126120]: exception: Security group 91b70a30-9e62-48ff-af5c-1d1649979582 does not exist Aug 02 06:50:31.142921 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-899683e9-1a26-4a9e-b634-2d36136ef451'] Aug 02 06:50:31.142921 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '91b70a30-9e62-48ff-af5c-1d1649979582'} Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:31.143971 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 91b70a30-9e62-48ff-af5c-1d1649979582 does not exist Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-899683e9-1a26-4a9e-b634-2d36136ef451'] Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 06:50:31.145325 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 91b70a30-9e62-48ff-af5c-1d1649979582 does not exist Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-899683e9-1a26-4a9e-b634-2d36136ef451'] Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 91b70a30-9e62-48ff-af5c-1d1649979582 does not exist Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-899683e9-1a26-4a9e-b634-2d36136ef451'] Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:31.146693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:31.148247 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:31.148247 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:31.148247 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:31.148247 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:31.148247 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 91b70a30-9e62-48ff-af5c-1d1649979582 does not exist Aug 02 06:50:31.148247 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-899683e9-1a26-4a9e-b634-2d36136ef451'] Aug 02 06:50:31.148247 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:31.154077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2c02386-5041-4e25-89f7-756a58e8709e tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Returning 404 to user: Security group 91b70a30-9e62-48ff-af5c-1d1649979582 does not exist Aug 02 06:50:31.154077 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-899683e9-1a26-4a9e-b634-2d36136ef451'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:31.156034 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f2c02386-5041-4e25-89f7-756a58e8709e tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/91b70a30-9e62-48ff-af5c-1d1649979582" status: 404 len: 194 microversion: 2.1 time: 0.150261 Aug 02 06:50:31.157403 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 668/1236] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:50:31 2022] DELETE /compute/v2.1/os-security-groups/91b70a30-9e62-48ff-af5c-1d1649979582 => generated 194 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:50:31.184248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f92d0d67-7471-4239-9cc7-2d2931a2e943 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927aac5b80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:31.275938 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f92d0d67-7471-4239-9cc7-2d2931a2e943 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.113258 Aug 02 06:50:31.278267 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 669/1237] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:31 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:31.287260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43b10fc4-4328-45b1-a16e-eb87e152069f tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Calling method '.version_select at 0x7f927aac5040>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:31.360734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-444a034a-f9d7-41ad-8ad5-0d44eabd9060 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:31.393052 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-444a034a-f9d7-41ad-8ad5-0d44eabd9060 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.410388 Aug 02 06:50:31.395877 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 569/1238] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:30 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:31.603076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d0e16a8-6b5c-4478-abea-6f373532c227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:31.605546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5d0e16a8-6b5c-4478-abea-6f373532c227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: c1477c63-2792-4918-ae17-613e7850c874] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:31.618747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d0e16a8-6b5c-4478-abea-6f373532c227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:31.619388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d0e16a8-6b5c-4478-abea-6f373532c227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:31.620270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d0e16a8-6b5c-4478-abea-6f373532c227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:31.622401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d0e16a8-6b5c-4478-abea-6f373532c227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:31.656951 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43b10fc4-4328-45b1-a16e-eb87e152069f tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/897dea3a-ea37-4e82-b505-0801e88bac80" status: 202 len: 0 microversion: 2.1 time: 0.376994 Aug 02 06:50:31.658266 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 670/1239] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:50:31 2022] DELETE /compute/v2.1/os-security-groups/897dea3a-ea37-4e82-b505-0801e88bac80 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:50:31.667660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fc607a6d-3626-498c-b39d-96384c5d492d tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Calling method '.version_select at 0x7f927aac5670>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:31.674118 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-5d0e16a8-6b5c-4478-abea-6f373532c227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] HTTP exception thrown: Instance c1477c63-2792-4918-ae17-613e7850c874 could not be found. Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d0e16a8-6b5c-4478-abea-6f373532c227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Request method failure captured: Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 HTTP/1.1 Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiP0QH7i_IXK_4JWtYj3HrgwHLsXsGtff-Mc558oWyxLOMs39SkcY535RJSybe5b5I6ZUX77Rjwuk1nlC1mvc_DV8M2K2mc7F4t5W6mRuXQ5jz-P4SqXjiGZGpTEG_iI4wzNZlPyAagEm70iD4im2lOWSJ0djax-9JSk8M47fdG6l8 Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:50:31.676373 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:50:31.678082 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}] Aug 02 06:50:31.678082 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:31.678082 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:50:31.678082 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:31.678082 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:50:31.678082 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:50:31.678082 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:50:31.678082 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: c0327068ab564b05ac50b0efd4c61a0f Aug 02 06:50:31.678082 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:50:31.678082 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:50:31.678082 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance c1477c63-2792-4918-ae17-613e7850c874 could not be found. Aug 02 06:50:31.678082 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'c1477c63-2792-4918-ae17-613e7850c874'} Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1477c63-2792-4918-ae17-613e7850c874 could not be found. Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:31.678938 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1477c63-2792-4918-ae17-613e7850c874 could not be found. Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1477c63-2792-4918-ae17-613e7850c874 could not be found. Aug 02 06:50:31.680397 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:31.682428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d0e16a8-6b5c-4478-abea-6f373532c227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Returning 404 to user: Instance c1477c63-2792-4918-ae17-613e7850c874 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:31.682428 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5d0e16a8-6b5c-4478-abea-6f373532c227 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874" status: 404 len: 111 microversion: 2.1 time: 0.079258 Aug 02 06:50:31.682428 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 570/1240] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:31 2022] GET /compute/v2.1/servers/c1477c63-2792-4918-ae17-613e7850c874 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:50:31.691138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0d232da6-faac-44ed-bbe2-f07a43e949e9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:31.691651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0d232da6-faac-44ed-bbe2-f07a43e949e9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:31.702835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d232da6-faac-44ed-bbe2-f07a43e949e9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:31.703207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d232da6-faac-44ed-bbe2-f07a43e949e9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:31.712778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d232da6-faac-44ed-bbe2-f07a43e949e9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:31.714579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d232da6-faac-44ed-bbe2-f07a43e949e9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:31.760042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0d232da6-faac-44ed-bbe2-f07a43e949e9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:50:31.939818 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0d232da6-faac-44ed-bbe2-f07a43e949e9 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 204 len: 0 microversion: 2.1 time: 0.249511 Aug 02 06:50:31.941649 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 571/1241] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:50:31 2022] DELETE /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:50:31.949410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-109483c1-fa48-415c-b942-09e7eb2f27c1 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:31.955120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-109483c1-fa48-415c-b942-09e7eb2f27c1 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:31.964864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-109483c1-fa48-415c-b942-09e7eb2f27c1 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:31.965345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-109483c1-fa48-415c-b942-09e7eb2f27c1 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:31.967292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-109483c1-fa48-415c-b942-09e7eb2f27c1 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:31.967839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-109483c1-fa48-415c-b942-09e7eb2f27c1 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:32.022322 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-109483c1-fa48-415c-b942-09e7eb2f27c1 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078445 Aug 02 06:50:32.027338 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 572/1242] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 06:50:31 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:32.033339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-256c2ab6-33d6-4e4e-801c-4715e9a02cda tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:32.033777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-256c2ab6-33d6-4e4e-801c-4715e9a02cda tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:32.041197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-256c2ab6-33d6-4e4e-801c-4715e9a02cda tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:32.041650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-256c2ab6-33d6-4e4e-801c-4715e9a02cda tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:32.042510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-256c2ab6-33d6-4e4e-801c-4715e9a02cda tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:32.042947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-256c2ab6-33d6-4e4e-801c-4715e9a02cda tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:32.320854 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fc607a6d-3626-498c-b39d-96384c5d492d tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/77d249de-bf9e-4f25-ad26-8a4e18194736" status: 202 len: 0 microversion: 2.1 time: 0.657166 Aug 02 06:50:32.322262 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 671/1243] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:50:31 2022] DELETE /compute/v2.1/os-security-groups/77d249de-bf9e-4f25-ad26-8a4e18194736 => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:50:32.336896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a3c29395-ac55-4848-abff-1786705788c5 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927aa97790>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:32.435605 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a3c29395-ac55-4848-abff-1786705788c5 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.108984 Aug 02 06:50:32.438139 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 672/1244] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:32 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:32.444029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5fcab4b0-8596-4328-8d7f-43c52a7f1e81 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Calling method '.version_select at 0x7f927aac6280>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:32.455211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-256c2ab6-33d6-4e4e-801c-4715e9a02cda tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:32.472904 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-256c2ab6-33d6-4e4e-801c-4715e9a02cda tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 200 len: 1472 microversion: 2.1 time: 0.437680 Aug 02 06:50:32.473944 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 573/1245] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:32 2022] GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 1472 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:32.488637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9acb4e3e-fbcf-4a7d-a1dc-24025e812270 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:32.489716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9acb4e3e-fbcf-4a7d-a1dc-24025e812270 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:32.517327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9acb4e3e-fbcf-4a7d-a1dc-24025e812270 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:32.524747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9acb4e3e-fbcf-4a7d-a1dc-24025e812270 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:32.525596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9acb4e3e-fbcf-4a7d-a1dc-24025e812270 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:32.528870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9acb4e3e-fbcf-4a7d-a1dc-24025e812270 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:32.928106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9acb4e3e-fbcf-4a7d-a1dc-24025e812270 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:32.943234 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9acb4e3e-fbcf-4a7d-a1dc-24025e812270 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.466618 Aug 02 06:50:32.945591 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 574/1246] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:32 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:32.949192 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5fcab4b0-8596-4328-8d7f-43c52a7f1e81 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/9d704e6c-8a92-4a61-afa2-cc43d039d1d5" status: 202 len: 0 microversion: 2.1 time: 0.509488 Aug 02 06:50:32.950620 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 673/1247] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:50:32 2022] DELETE /compute/v2.1/os-security-groups/9d704e6c-8a92-4a61-afa2-cc43d039d1d5 => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:50:32.959241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aae5f597-3b13-4027-9d7d-8d60b862bd23 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Calling method '.version_select at 0x7f927aac5700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:32.972435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fe7a8f94-6f23-40fd-b6c7-ab3d2b310289 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:32.985232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fe7a8f94-6f23-40fd-b6c7-ab3d2b310289 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:32.993247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe7a8f94-6f23-40fd-b6c7-ab3d2b310289 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:32.994486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe7a8f94-6f23-40fd-b6c7-ab3d2b310289 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:33.002488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe7a8f94-6f23-40fd-b6c7-ab3d2b310289 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:33.004524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe7a8f94-6f23-40fd-b6c7-ab3d2b310289 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:33.062028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:33.065739 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fe7a8f94-6f23-40fd-b6c7-ab3d2b310289 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113763 Aug 02 06:50:33.067264 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 575/1248] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 06:50:32 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:33.087881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d857ca35-9c09-4ca2-b6e8-d5e29e0c5145 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:33.091687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d857ca35-9c09-4ca2-b6e8-d5e29e0c5145 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:33.103774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d857ca35-9c09-4ca2-b6e8-d5e29e0c5145 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:33.104475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d857ca35-9c09-4ca2-b6e8-d5e29e0c5145 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:33.106939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d857ca35-9c09-4ca2-b6e8-d5e29e0c5145 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:33.109124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d857ca35-9c09-4ca2-b6e8-d5e29e0c5145 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:33.150978 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d857ca35-9c09-4ca2-b6e8-d5e29e0c5145 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080845 Aug 02 06:50:33.152179 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 576/1249] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 06:50:33 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:33.162010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a96ef1f6-e27f-46cd-8b0b-6d83dd87ded4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:33.162823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a96ef1f6-e27f-46cd-8b0b-6d83dd87ded4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:33.172008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a96ef1f6-e27f-46cd-8b0b-6d83dd87ded4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:33.172732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a96ef1f6-e27f-46cd-8b0b-6d83dd87ded4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:33.174881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a96ef1f6-e27f-46cd-8b0b-6d83dd87ded4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:33.175628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a96ef1f6-e27f-46cd-8b0b-6d83dd87ded4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:33.345746 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aae5f597-3b13-4027-9d7d-8d60b862bd23 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/eddc76c7-cfc6-41f9-9faf-36d92c1c575a" status: 202 len: 0 microversion: 2.1 time: 0.390713 Aug 02 06:50:33.350281 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 674/1250] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:50:32 2022] DELETE /compute/v2.1/os-security-groups/eddc76c7-cfc6-41f9-9faf-36d92c1c575a => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:50:33.355869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8b018beb-0d87-472c-bae0-3dcd8225b851 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] Calling method '.version_select at 0x7f928c2e1d30>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:33.388424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-a96ef1f6-e27f-46cd-8b0b-6d83dd87ded4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lazy-loading 'services' on Instance uuid 69991b6b-468d-45c0-b658-297b210ae988 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:50:33.545644 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a96ef1f6-e27f-46cd-8b0b-6d83dd87ded4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "DELETE /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988/os-volume_attachments/e8c87488-8866-4e9d-969f-f6883e112970" status: 202 len: 0 microversion: 2.1 time: 0.388192 Aug 02 06:50:33.547027 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 577/1251] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 06:50:33 2022] DELETE /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988/os-volume_attachments/e8c87488-8866-4e9d-969f-f6883e112970 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:50:33.572722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-33066ebb-53a4-41c0-baa1-c33a2f5c0dec tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927afbbdc0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:33.683899 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-33066ebb-53a4-41c0-baa1-c33a2f5c0dec tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.135433 Aug 02 06:50:33.687466 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 578/1252] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:33 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:33.700451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c4cce23f-0256-4741-a43a-4dbbee20d85b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:33.701186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c4cce23f-0256-4741-a43a-4dbbee20d85b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:33.711615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4cce23f-0256-4741-a43a-4dbbee20d85b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:33.712106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4cce23f-0256-4741-a43a-4dbbee20d85b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:33.712912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4cce23f-0256-4741-a43a-4dbbee20d85b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:33.714055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4cce23f-0256-4741-a43a-4dbbee20d85b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:34.057198 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8b018beb-0d87-472c-bae0-3dcd8225b851 tempest-SecurityGroupRulesTestJSON-274807442 tempest-SecurityGroupRulesTestJSON-274807442-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/12595296-d18b-46e2-b6e8-ac032586963c" status: 202 len: 0 microversion: 2.1 time: 0.705481 Aug 02 06:50:34.062181 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 675/1253] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:50:33 2022] DELETE /compute/v2.1/os-security-groups/12595296-d18b-46e2-b6e8-ac032586963c => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:50:34.067663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4453f443-8105-4ece-91aa-92e29f7c4837 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:34.068413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4453f443-8105-4ece-91aa-92e29f7c4837 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:34.087358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4453f443-8105-4ece-91aa-92e29f7c4837 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:34.087892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4453f443-8105-4ece-91aa-92e29f7c4837 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:34.088919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4453f443-8105-4ece-91aa-92e29f7c4837 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:34.089838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4453f443-8105-4ece-91aa-92e29f7c4837 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:34.146792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c4cce23f-0256-4741-a43a-4dbbee20d85b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:34.161204 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c4cce23f-0256-4741-a43a-4dbbee20d85b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 200 len: 1472 microversion: 2.1 time: 0.472274 Aug 02 06:50:34.167009 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 579/1254] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:33 2022] GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 1472 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:34.183864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-17fa2523-ece5-4572-9aca-60d132aa4f1d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:34.186673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-17fa2523-ece5-4572-9aca-60d132aa4f1d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:34.200204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17fa2523-ece5-4572-9aca-60d132aa4f1d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:34.200950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17fa2523-ece5-4572-9aca-60d132aa4f1d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:34.201940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17fa2523-ece5-4572-9aca-60d132aa4f1d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:34.205208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17fa2523-ece5-4572-9aca-60d132aa4f1d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:34.276624 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-17fa2523-ece5-4572-9aca-60d132aa4f1d tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107635 Aug 02 06:50:34.282700 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 580/1255] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 06:50:34 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:50:34.513469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4453f443-8105-4ece-91aa-92e29f7c4837 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:34.525007 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4453f443-8105-4ece-91aa-92e29f7c4837 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.461651 Aug 02 06:50:34.525560 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 676/1256] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:34 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:34.704830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-91478a8f-5dd8-4ec1-a16b-608c8bc52fcf tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927b1abee0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:34.785272 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-91478a8f-5dd8-4ec1-a16b-608c8bc52fcf tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.086565 Aug 02 06:50:34.793363 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 581/1257] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:34 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:34.828119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-526604929", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "592af707-a0db-4c0f-85b9-4f9019744c12"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:34.989529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] validate_networks() for [('592af707-a0db-4c0f-85b9-4f9019744c12', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:50:35.191712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-667b4187-5832-42c8-9dda-83e505223e76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:35.192324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-667b4187-5832-42c8-9dda-83e505223e76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:35.202043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-667b4187-5832-42c8-9dda-83e505223e76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:35.202490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-667b4187-5832-42c8-9dda-83e505223e76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:35.203268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-667b4187-5832-42c8-9dda-83e505223e76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:35.216434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-667b4187-5832-42c8-9dda-83e505223e76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:35.386338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-667b4187-5832-42c8-9dda-83e505223e76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:35.400574 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-667b4187-5832-42c8-9dda-83e505223e76 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 200 len: 1430 microversion: 2.1 time: 0.212554 Aug 02 06:50:35.415885 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 582/1258] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:35 2022] GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 1430 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:35.436722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-12f8f814-ebd7-4c86-b2e0-f5fc33abbc1b req-17d94d2b-ebf2-4115-aba8-0798b1d07bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a822ec0-2e44-4a7e-a000-087f2814a941", "name": "network-vif-deleted", "tag": "e351a644-769d-4826-a9df-f6f401f53d95"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:35.459961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-12f8f814-ebd7-4c86-b2e0-f5fc33abbc1b req-17d94d2b-ebf2-4115-aba8-0798b1d07bcf service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:35.462506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-12f8f814-ebd7-4c86-b2e0-f5fc33abbc1b req-17d94d2b-ebf2-4115-aba8-0798b1d07bcf service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:35.499746 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-12f8f814-ebd7-4c86-b2e0-f5fc33abbc1b req-17d94d2b-ebf2-4115-aba8-0798b1d07bcf service nova] Creating event network-vif-deleted:e351a644-769d-4826-a9df-f6f401f53d95 for instance 4a822ec0-2e44-4a7e-a000-087f2814a941 on n-h1-851337-3 Aug 02 06:50:35.507115 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-12f8f814-ebd7-4c86-b2e0-f5fc33abbc1b req-17d94d2b-ebf2-4115-aba8-0798b1d07bcf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086347 Aug 02 06:50:35.508913 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 583/1259] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:35.549392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72cca597-b309-4b9c-b582-1c75c4acee70 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:35.550348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-72cca597-b309-4b9c-b582-1c75c4acee70 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:35.569410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72cca597-b309-4b9c-b582-1c75c4acee70 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:35.571727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72cca597-b309-4b9c-b582-1c75c4acee70 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:35.574119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72cca597-b309-4b9c-b582-1c75c4acee70 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:35.582112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72cca597-b309-4b9c-b582-1c75c4acee70 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:36.100522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-72cca597-b309-4b9c-b582-1c75c4acee70 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:36.113221 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-72cca597-b309-4b9c-b582-1c75c4acee70 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.568147 Aug 02 06:50:36.116854 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 584/1260] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:35 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:36.131512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3c89cfd2-b731-4f80-bbc3-35b62692aa37 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927b035dc0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:36.256156 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3c89cfd2-b731-4f80-bbc3-35b62692aa37 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.136194 Aug 02 06:50:36.256824 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 585/1261] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:36 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:36.433997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:50:36.434973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:50:36.435632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:50:36.436202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:50:36.436764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:50:36.456720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:36.457506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:36.458007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:36.458444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:36.502166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bad00a7d-0a60-4123-b1db-37398838ac11 tempest-FloatingIPDetailsNegativeTestJSON-1783826629 tempest-FloatingIPDetailsNegativeTestJSON-1783826629-project] Calling method '.version_select at 0x7f927af37f70>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:36.524841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Getting quotas for project 4138fe8339db45d7ac0c174ad9e61a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:50:36.531276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Getting quotas for user 7a686659246f4e828823861e173802a4 and project 4138fe8339db45d7ac0c174ad9e61a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:50:36.566073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:50:36.568645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:50:36.604090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG neutronclient.v2_0.client [None req-bad00a7d-0a60-4123-b1db-37398838ac11 tempest-FloatingIPDetailsNegativeTestJSON-1783826629 tempest-FloatingIPDetailsNegativeTestJSON-1783826629-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f0bbd2a9-e11c-405d-8a66-43df110286b0 could not be found", "detail": ""}} {{(pid=126119) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:50:36.604940 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-bad00a7d-0a60-4123-b1db-37398838ac11 tempest-FloatingIPDetailsNegativeTestJSON-1783826629 tempest-FloatingIPDetailsNegativeTestJSON-1783826629-project] HTTP exception thrown: Floating IP not found for ID f0bbd2a9-e11c-405d-8a66-43df110286b0 Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bad00a7d-0a60-4123-b1db-37398838ac11 tempest-FloatingIPDetailsNegativeTestJSON-1783826629 tempest-FloatingIPDetailsNegativeTestJSON-1783826629-project] Request method failure captured: Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-floating-ips/f0bbd2a9-e11c-405d-8a66-43df110286b0 HTTP/1.1 Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mk8erh91G_W5wLoAk06Ei13uzeE-FIsJZiEJPWnMm_nyBqECztJzdHjJgG9yrQ7Y0DPNtf5Me80RZ3_0FXtZOMLinuIHKuUC4c_A2KxY7bfyeRFMnKMhYvq1YvbcRIDp1wvvWJWhWZLsow3YdK9dVGJwINU483aQTGYry7OJPW0W5Q Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: b8bc6de5416f4b41b96adf16adcc1a31 Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1783826629 Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:50:36.607424 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:50:36.609084 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8bc6de5416f4b41b96adf16adcc1a31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8bc6de5416f4b41b96adf16adcc1a31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8bc6de5416f4b41b96adf16adcc1a31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8bc6de5416f4b41b96adf16adcc1a31"}]}] Aug 02 06:50:36.609084 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1783826629 Aug 02 06:50:36.609084 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: b8bc6de5416f4b41b96adf16adcc1a31 Aug 02 06:50:36.609084 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1783826629 Aug 02 06:50:36.609084 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1783826629-project Aug 02 06:50:36.609084 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:50:36.609084 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:50:36.609084 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 92343ec821924b73aced90aa6fc8f8e7 Aug 02 06:50:36.609084 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1783826629-project Aug 02 06:50:36.609084 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:50:36.609084 n-d-851337-3 devstack@n-api.service[126119]: exception: Floating IP not found for ID f0bbd2a9-e11c-405d-8a66-43df110286b0 Aug 02 06:50:36.609084 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'f0bbd2a9-e11c-405d-8a66-43df110286b0'} Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:36.610006 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f0bbd2a9-e11c-405d-8a66-43df110286b0 could not be found Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a49832f-d359-43c5-8bc6-c5cae93b3f4f'] Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f0bbd2a9-e11c-405d-8a66-43df110286b0. Aug 02 06:50:36.611906 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f0bbd2a9-e11c-405d-8a66-43df110286b0 Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:36.614166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:36.616447 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:36.616447 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f0bbd2a9-e11c-405d-8a66-43df110286b0 Aug 02 06:50:36.616447 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:36.616447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bad00a7d-0a60-4123-b1db-37398838ac11 tempest-FloatingIPDetailsNegativeTestJSON-1783826629 tempest-FloatingIPDetailsNegativeTestJSON-1783826629-project] Returning 404 to user: Floating IP not found for ID f0bbd2a9-e11c-405d-8a66-43df110286b0 {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:36.616447 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bad00a7d-0a60-4123-b1db-37398838ac11 tempest-FloatingIPDetailsNegativeTestJSON-1783826629 tempest-FloatingIPDetailsNegativeTestJSON-1783826629-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/f0bbd2a9-e11c-405d-8a66-43df110286b0" status: 404 len: 111 microversion: 2.1 time: 0.345609 Aug 02 06:50:36.616447 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 586/1262] 10.222.0.79 () {58 vars in 1260 bytes} [Tue Aug 2 06:50:36 2022] GET /compute/v2.1/os-floating-ips/f0bbd2a9-e11c-405d-8a66-43df110286b0 => generated 111 bytes in 349 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:50:36.631915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b2859239-48a0-42f8-bbeb-121689503d7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:36.633923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b2859239-48a0-42f8-bbeb-121689503d7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 4a822ec0-2e44-4a7e-a000-087f2814a941] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:36.656024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2859239-48a0-42f8-bbeb-121689503d7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:36.657784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2859239-48a0-42f8-bbeb-121689503d7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:36.661422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2859239-48a0-42f8-bbeb-121689503d7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:36.664377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2859239-48a0-42f8-bbeb-121689503d7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:36.698877 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c9fcf81a-d222-4dda-9a54-ca58f06b0fe0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.876268 Aug 02 06:50:36.703064 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 677/1263] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:50:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:50:36.716371 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-b2859239-48a0-42f8-bbeb-121689503d7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] HTTP exception thrown: Instance 4a822ec0-2e44-4a7e-a000-087f2814a941 could not be found. Aug 02 06:50:36.719737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c2c4fc63-c6fd-468a-8fa6-63332ed6eee4 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b2859239-48a0-42f8-bbeb-121689503d7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Request method failure captured: Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 HTTP/1.1 Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiP0QH7i_IXK_4JWtYj3HrgwHLsXsGtff-Mc558oWyxLOMs39SkcY535RJSybe5b5I6ZUX77Rjwuk1nlC1mvc_DV8M2K2mc7F4t5W6mRuXQ5jz-P4SqXjiGZGpTEG_iI4wzNZlPyAagEm70iD4im2lOWSJ0djax-9JSk8M47fdG6l8 Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:50:36.720802 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:50:36.722163 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}] Aug 02 06:50:36.722163 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:36.722163 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:50:36.722163 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:36.722163 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:50:36.722163 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:50:36.722163 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:50:36.722163 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: c0327068ab564b05ac50b0efd4c61a0f Aug 02 06:50:36.722163 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:50:36.722163 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:50:36.722163 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 4a822ec0-2e44-4a7e-a000-087f2814a941 could not be found. Aug 02 06:50:36.722163 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '4a822ec0-2e44-4a7e-a000-087f2814a941'} Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a822ec0-2e44-4a7e-a000-087f2814a941 could not be found. Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:36.722911 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a822ec0-2e44-4a7e-a000-087f2814a941 could not be found. Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a822ec0-2e44-4a7e-a000-087f2814a941 could not be found. Aug 02 06:50:36.724143 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:36.725205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b2859239-48a0-42f8-bbeb-121689503d7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Returning 404 to user: Instance 4a822ec0-2e44-4a7e-a000-087f2814a941 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:36.727122 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b2859239-48a0-42f8-bbeb-121689503d7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941" status: 404 len: 111 microversion: 2.1 time: 0.106472 Aug 02 06:50:36.730838 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 587/1264] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:36 2022] GET /compute/v2.1/servers/4a822ec0-2e44-4a7e-a000-087f2814a941 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:50:36.732068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c2c4fc63-c6fd-468a-8fa6-63332ed6eee4 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:36.743563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dc877a36-8a1a-4c21-8198-b68d429983c2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:36.745015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dc877a36-8a1a-4c21-8198-b68d429983c2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 3d5f31c5-23d0-4a18-95a0-6947d96566a5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:36.752119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:36.756547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc877a36-8a1a-4c21-8198-b68d429983c2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:36.758132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc877a36-8a1a-4c21-8198-b68d429983c2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:36.758132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc877a36-8a1a-4c21-8198-b68d429983c2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:36.758513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc877a36-8a1a-4c21-8198-b68d429983c2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:36.822161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dc877a36-8a1a-4c21-8198-b68d429983c2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 3d5f31c5-23d0-4a18-95a0-6947d96566a5] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:50:36.865327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c2c4fc63-c6fd-468a-8fa6-63332ed6eee4 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:36.876095 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c2c4fc63-c6fd-468a-8fa6-63332ed6eee4 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1217 microversion: 2.1 time: 0.165946 Aug 02 06:50:36.881575 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 678/1265] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:36 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:37.059703 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dc877a36-8a1a-4c21-8198-b68d429983c2 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5" status: 204 len: 0 microversion: 2.1 time: 0.326999 Aug 02 06:50:37.061412 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 588/1266] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:50:36 2022] DELETE /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:50:37.069437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3d3c6a77-9200-4852-8b3f-9f5aca9ed4fe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:37.069961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3d3c6a77-9200-4852-8b3f-9f5aca9ed4fe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:37.094605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d3c6a77-9200-4852-8b3f-9f5aca9ed4fe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:37.094605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d3c6a77-9200-4852-8b3f-9f5aca9ed4fe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:37.094605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d3c6a77-9200-4852-8b3f-9f5aca9ed4fe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:37.094605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d3c6a77-9200-4852-8b3f-9f5aca9ed4fe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:37.113873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:37.137580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2abb2874-bb1c-45cc-9775-0d214085f58b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:37.138418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2abb2874-bb1c-45cc-9775-0d214085f58b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:37.157108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2abb2874-bb1c-45cc-9775-0d214085f58b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:37.161750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3d3c6a77-9200-4852-8b3f-9f5aca9ed4fe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:50:37.161915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2abb2874-bb1c-45cc-9775-0d214085f58b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:37.169504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2abb2874-bb1c-45cc-9775-0d214085f58b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:37.169810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2abb2874-bb1c-45cc-9775-0d214085f58b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:37.395204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:37.403878 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3d3c6a77-9200-4852-8b3f-9f5aca9ed4fe tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 204 len: 0 microversion: 2.1 time: 0.338157 Aug 02 06:50:37.405322 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 679/1267] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:50:37 2022] DELETE /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:50:37.417161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9be6d893-acfd-4a99-b199-6cba5d306f36 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927aac5ca0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:37.535294 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9be6d893-acfd-4a99-b199-6cba5d306f36 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.126180 Aug 02 06:50:37.537026 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 680/1268] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:37 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:37.543892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2e9fef89-b7f8-4a01-9e12-44cce5c6ea69 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:37.552796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2e9fef89-b7f8-4a01-9e12-44cce5c6ea69 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 3d5f31c5-23d0-4a18-95a0-6947d96566a5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:37.569827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e9fef89-b7f8-4a01-9e12-44cce5c6ea69 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:37.581537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e9fef89-b7f8-4a01-9e12-44cce5c6ea69 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:37.586444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e9fef89-b7f8-4a01-9e12-44cce5c6ea69 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:37.588619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e9fef89-b7f8-4a01-9e12-44cce5c6ea69 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:37.627765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2abb2874-bb1c-45cc-9775-0d214085f58b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:37.638297 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2abb2874-bb1c-45cc-9775-0d214085f58b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 0.505330 Aug 02 06:50:37.638880 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 589/1269] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:37 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:37.656424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b068d735-ad23-47fe-bc26-785405965e56 req-a705d10d-66c2-45da-9157-5c901b3437a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a113f2-1afe-411d-9477-350acce2a793", "name": "network-vif-plugged", "status": "completed", "tag": "31c431f1-495f-40ae-ba60-1586f6059b74"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:37.703600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b068d735-ad23-47fe-bc26-785405965e56 req-a705d10d-66c2-45da-9157-5c901b3437a6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:37.706344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b068d735-ad23-47fe-bc26-785405965e56 req-a705d10d-66c2-45da-9157-5c901b3437a6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:37.750311 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b068d735-ad23-47fe-bc26-785405965e56 req-a705d10d-66c2-45da-9157-5c901b3437a6 service nova] Creating event network-vif-plugged:31c431f1-495f-40ae-ba60-1586f6059b74 for instance 94a113f2-1afe-411d-9477-350acce2a793 on n-h1-851337-3 Aug 02 06:50:37.766608 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b068d735-ad23-47fe-bc26-785405965e56 req-a705d10d-66c2-45da-9157-5c901b3437a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119410 Aug 02 06:50:37.767245 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 590/1270] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:37.898901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-95e9c301-a645-4173-a240-47b96e81d9c3 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:37.899928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-95e9c301-a645-4173-a240-47b96e81d9c3 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:37.924251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95e9c301-a645-4173-a240-47b96e81d9c3 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:37.928724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95e9c301-a645-4173-a240-47b96e81d9c3 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:37.930806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95e9c301-a645-4173-a240-47b96e81d9c3 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:37.931453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95e9c301-a645-4173-a240-47b96e81d9c3 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:38.282056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-95e9c301-a645-4173-a240-47b96e81d9c3 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:38.293336 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-95e9c301-a645-4173-a240-47b96e81d9c3 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1221 microversion: 2.1 time: 0.397057 Aug 02 06:50:38.294418 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 591/1271] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:37 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1221 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:38.447956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2e9fef89-b7f8-4a01-9e12-44cce5c6ea69 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:38.468416 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2e9fef89-b7f8-4a01-9e12-44cce5c6ea69 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5" status: 200 len: 1473 microversion: 2.1 time: 0.929978 Aug 02 06:50:38.469680 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 681/1272] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:37 2022] GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5 => generated 1473 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:38.551488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a05b2433-2a11-4731-9429-8ea56425ac11 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927ae96ee0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:38.625246 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a05b2433-2a11-4731-9429-8ea56425ac11 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.077926 Aug 02 06:50:38.633157 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 592/1273] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:38 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:38.663880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-03bfed84-169c-4e34-b03b-17bd4112833b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:38.668837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-03bfed84-169c-4e34-b03b-17bd4112833b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:38.682184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03bfed84-169c-4e34-b03b-17bd4112833b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:38.684189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03bfed84-169c-4e34-b03b-17bd4112833b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:38.687799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03bfed84-169c-4e34-b03b-17bd4112833b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:38.689198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03bfed84-169c-4e34-b03b-17bd4112833b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:39.315569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4a5eafd6-3624-4ba5-accd-d10380bc251f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:39.316613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4a5eafd6-3624-4ba5-accd-d10380bc251f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:39.330257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a5eafd6-3624-4ba5-accd-d10380bc251f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:39.331182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a5eafd6-3624-4ba5-accd-d10380bc251f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:39.332211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a5eafd6-3624-4ba5-accd-d10380bc251f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:39.334435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a5eafd6-3624-4ba5-accd-d10380bc251f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:40.636756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4a5eafd6-3624-4ba5-accd-d10380bc251f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:40.657193 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4a5eafd6-3624-4ba5-accd-d10380bc251f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1287 microversion: 2.1 time: 1.345513 Aug 02 06:50:40.665825 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 593/1274] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:39 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1287 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:40.678439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-03bfed84-169c-4e34-b03b-17bd4112833b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:40.694064 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-03bfed84-169c-4e34-b03b-17bd4112833b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 2.032535 Aug 02 06:50:40.708073 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 682/1275] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:38 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:40.713068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f1f98fea-ae20-4246-8718-0e046b56138a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:40.715917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f1f98fea-ae20-4246-8718-0e046b56138a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 3d5f31c5-23d0-4a18-95a0-6947d96566a5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:40.726881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ae155051-68ba-438b-8e38-2cf68ec0b3ea tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927aa4f9d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:40.741002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1f98fea-ae20-4246-8718-0e046b56138a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:40.741389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1f98fea-ae20-4246-8718-0e046b56138a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:40.751502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1f98fea-ae20-4246-8718-0e046b56138a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:40.752496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1f98fea-ae20-4246-8718-0e046b56138a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:40.853707 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ae155051-68ba-438b-8e38-2cf68ec0b3ea tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.140036 Aug 02 06:50:40.854376 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 683/1276] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:40 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:41.692189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8f18eda7-398c-454d-beb4-b445cd8a270a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:41.693398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8f18eda7-398c-454d-beb4-b445cd8a270a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:41.715806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f18eda7-398c-454d-beb4-b445cd8a270a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:41.716255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f18eda7-398c-454d-beb4-b445cd8a270a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:41.717079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f18eda7-398c-454d-beb4-b445cd8a270a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:41.717483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f18eda7-398c-454d-beb4-b445cd8a270a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:41.901772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8f18eda7-398c-454d-beb4-b445cd8a270a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:41.916741 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8f18eda7-398c-454d-beb4-b445cd8a270a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1275 microversion: 2.1 time: 0.227947 Aug 02 06:50:41.923296 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 684/1277] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:41 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1275 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:41.935192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8e26b95f-dbee-48e8-82a2-df3a26df9491 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:41.937558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8e26b95f-dbee-48e8-82a2-df3a26df9491 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:41.957195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e26b95f-dbee-48e8-82a2-df3a26df9491 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:41.957555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e26b95f-dbee-48e8-82a2-df3a26df9491 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:41.961612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e26b95f-dbee-48e8-82a2-df3a26df9491 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:41.964160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e26b95f-dbee-48e8-82a2-df3a26df9491 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:42.000196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f1f98fea-ae20-4246-8718-0e046b56138a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:42.019592 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f1f98fea-ae20-4246-8718-0e046b56138a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5" status: 200 len: 1473 microversion: 2.1 time: 1.342134 Aug 02 06:50:42.034675 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 594/1278] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:40 2022] GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5 => generated 1473 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:42.053056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72dfa89f-ff8c-408e-bd68-1cacccbf9ed7 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927ae1c3a0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:42.173228 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-72dfa89f-ff8c-408e-bd68-1cacccbf9ed7 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.135590 Aug 02 06:50:42.174377 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 595/1279] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:42 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:42.191648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-d33d710d-9103-497f-af9b-57c867c83a12 req-7665121f-0aed-4832-bd4a-748142ce414d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb8bd9f-6e06-4f62-8b64-af297e6157da", "name": "network-vif-deleted", "tag": "2c205ec2-e3c8-4f45-8657-90c30a174006"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:42.278391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d33d710d-9103-497f-af9b-57c867c83a12 req-7665121f-0aed-4832-bd4a-748142ce414d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:42.286966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d33d710d-9103-497f-af9b-57c867c83a12 req-7665121f-0aed-4832-bd4a-748142ce414d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:42.324475 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-d33d710d-9103-497f-af9b-57c867c83a12 req-7665121f-0aed-4832-bd4a-748142ce414d service nova] Creating event network-vif-deleted:2c205ec2-e3c8-4f45-8657-90c30a174006 for instance 9fb8bd9f-6e06-4f62-8b64-af297e6157da on n-h1-851337-3 Aug 02 06:50:42.341651 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-d33d710d-9103-497f-af9b-57c867c83a12 req-7665121f-0aed-4832-bd4a-748142ce414d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165410 Aug 02 06:50:42.345826 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 596/1280] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:42.945162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f9bf4f3-904e-45b3-a939-140ebe0f7d7a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:42.948784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3f9bf4f3-904e-45b3-a939-140ebe0f7d7a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:42.960479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f9bf4f3-904e-45b3-a939-140ebe0f7d7a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:42.970680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f9bf4f3-904e-45b3-a939-140ebe0f7d7a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:42.978031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f9bf4f3-904e-45b3-a939-140ebe0f7d7a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:42.981826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f9bf4f3-904e-45b3-a939-140ebe0f7d7a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:43.749177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3f9bf4f3-904e-45b3-a939-140ebe0f7d7a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:43.761417 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3f9bf4f3-904e-45b3-a939-140ebe0f7d7a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1275 microversion: 2.1 time: 0.817221 Aug 02 06:50:43.762452 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 597/1281] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:42 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1275 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:43.775570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ff62fa57-a7ac-4ef8-8da1-9881ba5bdfea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:43.776198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ff62fa57-a7ac-4ef8-8da1-9881ba5bdfea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 3d5f31c5-23d0-4a18-95a0-6947d96566a5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:43.809837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff62fa57-a7ac-4ef8-8da1-9881ba5bdfea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:43.810320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff62fa57-a7ac-4ef8-8da1-9881ba5bdfea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:43.811168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff62fa57-a7ac-4ef8-8da1-9881ba5bdfea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:43.815520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff62fa57-a7ac-4ef8-8da1-9881ba5bdfea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:44.204161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ff62fa57-a7ac-4ef8-8da1-9881ba5bdfea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:44.207991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:44.222127 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ff62fa57-a7ac-4ef8-8da1-9881ba5bdfea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5" status: 200 len: 1431 microversion: 2.1 time: 0.452695 Aug 02 06:50:44.223353 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 598/1282] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:43 2022] GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5 => generated 1431 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:44.237656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c9b87860-e9b3-4ce0-acc7-bce63f3541e7 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927b1abee0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:44.337807 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c9b87860-e9b3-4ce0-acc7-bce63f3541e7 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.112901 Aug 02 06:50:44.339221 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 599/1283] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:44 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:44.352913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8e26b95f-dbee-48e8-82a2-df3a26df9491 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:44.372149 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8e26b95f-dbee-48e8-82a2-df3a26df9491 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1475 microversion: 2.1 time: 2.447320 Aug 02 06:50:44.374354 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 685/1284] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:41 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1475 bytes in 2450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:44.734220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-79390c8c-d2d1-440a-867d-23d408faf5ed req-38bf428a-17bf-44c4-96be-e343cf4a6e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5f31c5-23d0-4a18-95a0-6947d96566a5", "name": "network-vif-deleted", "tag": "98583515-8e9a-4647-ba0a-76dbcec655ae"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:44.761876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-79390c8c-d2d1-440a-867d-23d408faf5ed req-38bf428a-17bf-44c4-96be-e343cf4a6e07 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:44.762639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-79390c8c-d2d1-440a-867d-23d408faf5ed req-38bf428a-17bf-44c4-96be-e343cf4a6e07 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:44.782998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5bd552fa-bc0a-40f9-a799-07ae9f64351a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:44.783682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5bd552fa-bc0a-40f9-a799-07ae9f64351a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:44.813388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bd552fa-bc0a-40f9-a799-07ae9f64351a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:44.814073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bd552fa-bc0a-40f9-a799-07ae9f64351a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:44.814685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bd552fa-bc0a-40f9-a799-07ae9f64351a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:44.821280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bd552fa-bc0a-40f9-a799-07ae9f64351a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:44.861658 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-79390c8c-d2d1-440a-867d-23d408faf5ed req-38bf428a-17bf-44c4-96be-e343cf4a6e07 service nova] Creating event network-vif-deleted:98583515-8e9a-4647-ba0a-76dbcec655ae for instance 3d5f31c5-23d0-4a18-95a0-6947d96566a5 on n-h2-851337-3 Aug 02 06:50:44.897570 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-79390c8c-d2d1-440a-867d-23d408faf5ed req-38bf428a-17bf-44c4-96be-e343cf4a6e07 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159885 Aug 02 06:50:44.898876 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 600/1285] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:45.067407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b88b6228-af8c-4404-8b07-a6487c00e5ec tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:45.072320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b88b6228-af8c-4404-8b07-a6487c00e5ec tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:45.103792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b88b6228-af8c-4404-8b07-a6487c00e5ec tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:45.107765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b88b6228-af8c-4404-8b07-a6487c00e5ec tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:45.108635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b88b6228-af8c-4404-8b07-a6487c00e5ec tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:45.109056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b88b6228-af8c-4404-8b07-a6487c00e5ec tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:45.192105 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b88b6228-af8c-4404-8b07-a6487c00e5ec tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129898 Aug 02 06:50:45.193319 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 601/1286] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 06:50:45 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:50:45.247579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b8cdce8f-209f-49cc-841c-1952f1fb03ea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:45.248851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b8cdce8f-209f-49cc-841c-1952f1fb03ea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 3d5f31c5-23d0-4a18-95a0-6947d96566a5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:45.272597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8cdce8f-209f-49cc-841c-1952f1fb03ea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:45.275973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8cdce8f-209f-49cc-841c-1952f1fb03ea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:45.277566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8cdce8f-209f-49cc-841c-1952f1fb03ea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:45.282394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8cdce8f-209f-49cc-841c-1952f1fb03ea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:45.387153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8cdce8f-209f-49cc-841c-1952f1fb03ea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:45.387946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8cdce8f-209f-49cc-841c-1952f1fb03ea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:45.389520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-b8cdce8f-209f-49cc-841c-1952f1fb03ea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lazy-loading 'fault' on Instance uuid 3d5f31c5-23d0-4a18-95a0-6947d96566a5 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:50:45.682205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b8cdce8f-209f-49cc-841c-1952f1fb03ea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:45.703039 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b8cdce8f-209f-49cc-841c-1952f1fb03ea tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5" status: 200 len: 1308 microversion: 2.1 time: 0.459863 Aug 02 06:50:45.712484 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 602/1287] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:45 2022] GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5 => generated 1308 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:45.726981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2810e327-92df-494a-90eb-bdfb7f49a385 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:45.733680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2810e327-92df-494a-90eb-bdfb7f49a385 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:45.749835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2810e327-92df-494a-90eb-bdfb7f49a385 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:45.750424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2810e327-92df-494a-90eb-bdfb7f49a385 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:45.754976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2810e327-92df-494a-90eb-bdfb7f49a385 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:45.755970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2810e327-92df-494a-90eb-bdfb7f49a385 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:45.803882 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2810e327-92df-494a-90eb-bdfb7f49a385 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090104 Aug 02 06:50:45.805612 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 603/1288] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 06:50:45 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:50:45.818262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d2a9a57c-2eeb-4ab8-b7b4-2845d8d0eb57 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927aef2310>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:45.893444 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d2a9a57c-2eeb-4ab8-b7b4-2845d8d0eb57 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.086405 Aug 02 06:50:45.895642 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 604/1289] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:45 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:45.909126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-506a6cf1-e54e-4f99-8a79-d889ec6ce5b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:45.909744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-506a6cf1-e54e-4f99-8a79-d889ec6ce5b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:45.926158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-506a6cf1-e54e-4f99-8a79-d889ec6ce5b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:45.926913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-506a6cf1-e54e-4f99-8a79-d889ec6ce5b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:45.928447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-506a6cf1-e54e-4f99-8a79-d889ec6ce5b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:45.929598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-506a6cf1-e54e-4f99-8a79-d889ec6ce5b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:46.489980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:46.523472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5bd552fa-bc0a-40f9-a799-07ae9f64351a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:46.532040 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5bd552fa-bc0a-40f9-a799-07ae9f64351a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1317 microversion: 2.1 time: 1.753697 Aug 02 06:50:46.552255 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 686/1290] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:44 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1317 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:46.565734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-573eac23-7b04-4cb5-8baa-2d9964801e34 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:46.569998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-573eac23-7b04-4cb5-8baa-2d9964801e34 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:46.584470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-573eac23-7b04-4cb5-8baa-2d9964801e34 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:46.584920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-573eac23-7b04-4cb5-8baa-2d9964801e34 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:46.585735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-573eac23-7b04-4cb5-8baa-2d9964801e34 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:46.611831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-573eac23-7b04-4cb5-8baa-2d9964801e34 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:46.690808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-573eac23-7b04-4cb5-8baa-2d9964801e34 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:50:46.818361 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-573eac23-7b04-4cb5-8baa-2d9964801e34 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "DELETE /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 204 len: 0 microversion: 2.1 time: 0.260849 Aug 02 06:50:46.820761 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 687/1291] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:50:46 2022] DELETE /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:50:46.829326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e55e52bc-49ce-44bb-81e9-0e1a29546450 req-b9f48bf0-c6ca-4e8d-8600-c38debe1f5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c976a871-9aa2-4330-9e0c-363aadd04223", "name": "network-vif-unplugged", "status": "completed", "tag": "9b2e2b0e-a0fa-4b06-96ce-29c660765c8f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:46.843637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e55e52bc-49ce-44bb-81e9-0e1a29546450 req-b9f48bf0-c6ca-4e8d-8600-c38debe1f5be service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:46.844462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e55e52bc-49ce-44bb-81e9-0e1a29546450 req-b9f48bf0-c6ca-4e8d-8600-c38debe1f5be service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:46.858239 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e55e52bc-49ce-44bb-81e9-0e1a29546450 req-b9f48bf0-c6ca-4e8d-8600-c38debe1f5be service nova] Creating event network-vif-unplugged:9b2e2b0e-a0fa-4b06-96ce-29c660765c8f for instance c976a871-9aa2-4330-9e0c-363aadd04223 on n-h1-851337-3 Aug 02 06:50:46.871779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-e55e52bc-49ce-44bb-81e9-0e1a29546450 req-b9f48bf0-c6ca-4e8d-8600-c38debe1f5be service nova] Instance c976a871-9aa2-4330-9e0c-363aadd04223 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 06:50:46.882832 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e55e52bc-49ce-44bb-81e9-0e1a29546450 req-b9f48bf0-c6ca-4e8d-8600-c38debe1f5be service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058547 Aug 02 06:50:46.884621 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 688/1292] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:46.892332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bac4ad87-1100-4acb-a92d-e7bd06d03b77 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:46.893509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bac4ad87-1100-4acb-a92d-e7bd06d03b77 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 3d5f31c5-23d0-4a18-95a0-6947d96566a5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:46.900376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:46.902689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bac4ad87-1100-4acb-a92d-e7bd06d03b77 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:46.903476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bac4ad87-1100-4acb-a92d-e7bd06d03b77 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:46.904652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bac4ad87-1100-4acb-a92d-e7bd06d03b77 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:46.905310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bac4ad87-1100-4acb-a92d-e7bd06d03b77 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:46.922619 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-bac4ad87-1100-4acb-a92d-e7bd06d03b77 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] HTTP exception thrown: Instance 3d5f31c5-23d0-4a18-95a0-6947d96566a5 could not be found. Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bac4ad87-1100-4acb-a92d-e7bd06d03b77 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Request method failure captured: Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5 HTTP/1.1 Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MiP0QH7i_IXK_4JWtYj3HrgwHLsXsGtff-Mc558oWyxLOMs39SkcY535RJSybe5b5I6ZUX77Rjwuk1nlC1mvc_DV8M2K2mc7F4t5W6mRuXQ5jz-P4SqXjiGZGpTEG_iI4wzNZlPyAagEm70iD4im2lOWSJ0djax-9JSk8M47fdG6l8 Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:50:46.924641 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:50:46.926343 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}] Aug 02 06:50:46.926343 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:46.926343 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:50:46.926343 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:46.926343 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:50:46.926343 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:50:46.926343 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:50:46.926343 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: c0327068ab564b05ac50b0efd4c61a0f Aug 02 06:50:46.926343 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:50:46.926343 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:50:46.926343 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 3d5f31c5-23d0-4a18-95a0-6947d96566a5 could not be found. Aug 02 06:50:46.926343 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '3d5f31c5-23d0-4a18-95a0-6947d96566a5'} Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5f31c5-23d0-4a18-95a0-6947d96566a5 could not be found. Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:46.927303 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5f31c5-23d0-4a18-95a0-6947d96566a5 could not be found. Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5f31c5-23d0-4a18-95a0-6947d96566a5 could not be found. Aug 02 06:50:46.928819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:50:46.931532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bac4ad87-1100-4acb-a92d-e7bd06d03b77 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Returning 404 to user: Instance 3d5f31c5-23d0-4a18-95a0-6947d96566a5 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:46.933361 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bac4ad87-1100-4acb-a92d-e7bd06d03b77 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5" status: 404 len: 111 microversion: 2.1 time: 0.047386 Aug 02 06:50:46.934453 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 689/1293] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:46 2022] GET /compute/v2.1/servers/3d5f31c5-23d0-4a18-95a0-6947d96566a5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:50:46.939338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-55f14449-76ba-416f-904d-20bb50f159ef tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:46.942912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-55f14449-76ba-416f-904d-20bb50f159ef tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:46.958282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55f14449-76ba-416f-904d-20bb50f159ef tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:46.959130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55f14449-76ba-416f-904d-20bb50f159ef tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:46.960100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55f14449-76ba-416f-904d-20bb50f159ef tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:46.960852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55f14449-76ba-416f-904d-20bb50f159ef tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:47.365347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-506a6cf1-e54e-4f99-8a79-d889ec6ce5b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:47.381058 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-506a6cf1-e54e-4f99-8a79-d889ec6ce5b4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1474 microversion: 2.1 time: 1.478825 Aug 02 06:50:47.384171 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 605/1294] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:45 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1474 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:47.402728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7ba6c91a-4dd1-4e6b-8e42-2d8b0fe2a17d tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927ae209d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:47.485206 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7ba6c91a-4dd1-4e6b-8e42-2d8b0fe2a17d tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.097147 Aug 02 06:50:47.492358 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 606/1295] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:47 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:47.499828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1ce598ac-9c48-4a97-b254-45346cf886eb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:47.504392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1ce598ac-9c48-4a97-b254-45346cf886eb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 9fb8bd9f-6e06-4f62-8b64-af297e6157da] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:47.520498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ce598ac-9c48-4a97-b254-45346cf886eb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:47.525650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ce598ac-9c48-4a97-b254-45346cf886eb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:47.528982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ce598ac-9c48-4a97-b254-45346cf886eb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:47.531314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ce598ac-9c48-4a97-b254-45346cf886eb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:47.582634 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-1ce598ac-9c48-4a97-b254-45346cf886eb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] HTTP exception thrown: Instance 9fb8bd9f-6e06-4f62-8b64-af297e6157da could not be found. Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1ce598ac-9c48-4a97-b254-45346cf886eb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Request method failure captured: Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da HTTP/1.1 Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiP0QH7i_IXK_4JWtYj3HrgwHLsXsGtff-Mc558oWyxLOMs39SkcY535RJSybe5b5I6ZUX77Rjwuk1nlC1mvc_DV8M2K2mc7F4t5W6mRuXQ5jz-P4SqXjiGZGpTEG_iI4wzNZlPyAagEm70iD4im2lOWSJ0djax-9JSk8M47fdG6l8 Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:50:47.589981 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:50:47.591506 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}] Aug 02 06:50:47.591506 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:47.591506 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:50:47.591506 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:47.591506 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:50:47.591506 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:50:47.591506 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:50:47.591506 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: c0327068ab564b05ac50b0efd4c61a0f Aug 02 06:50:47.591506 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:50:47.591506 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:50:47.591506 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 9fb8bd9f-6e06-4f62-8b64-af297e6157da could not be found. Aug 02 06:50:47.591506 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '9fb8bd9f-6e06-4f62-8b64-af297e6157da'} Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fb8bd9f-6e06-4f62-8b64-af297e6157da could not be found. Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:47.592294 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fb8bd9f-6e06-4f62-8b64-af297e6157da could not be found. Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fb8bd9f-6e06-4f62-8b64-af297e6157da could not be found. Aug 02 06:50:47.594102 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:47.595220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1ce598ac-9c48-4a97-b254-45346cf886eb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Returning 404 to user: Instance 9fb8bd9f-6e06-4f62-8b64-af297e6157da could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:47.595220 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1ce598ac-9c48-4a97-b254-45346cf886eb tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da" status: 404 len: 111 microversion: 2.1 time: 0.097892 Aug 02 06:50:47.603009 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 607/1296] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:47 2022] GET /compute/v2.1/servers/9fb8bd9f-6e06-4f62-8b64-af297e6157da => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:50:47.606604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-55f14449-76ba-416f-904d-20bb50f159ef tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:47.616272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6cdba1fd-3f98-4df9-b5e8-b64734eb5d2f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:47.616967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6cdba1fd-3f98-4df9-b5e8-b64734eb5d2f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:47.621734 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-55f14449-76ba-416f-904d-20bb50f159ef tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1678 microversion: 2.1 time: 0.685558 Aug 02 06:50:47.633916 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 690/1297] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:46 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1678 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:47.634520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0850ee48-0912-42ec-b0ee-0df23deb832b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:47.634670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6cdba1fd-3f98-4df9-b5e8-b64734eb5d2f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:47.635045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6cdba1fd-3f98-4df9-b5e8-b64734eb5d2f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:47.644953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6cdba1fd-3f98-4df9-b5e8-b64734eb5d2f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:47.645585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6cdba1fd-3f98-4df9-b5e8-b64734eb5d2f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:47.728582 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0850ee48-0912-42ec-b0ee-0df23deb832b tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/ccf652e2-05d6-4b0e-b156-c3354d043b8c" status: 204 len: 0 microversion: 2.1 time: 0.104609 Aug 02 06:50:47.729707 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 691/1298] 10.222.0.79 () {58 vars in 1266 bytes} [Tue Aug 2 06:50:47 2022] DELETE /compute/v2.1/os-server-groups/ccf652e2-05d6-4b0e-b156-c3354d043b8c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:50:47.738685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1d6966bb-0248-4e0d-9727-e76745402ee1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:47.740019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1d6966bb-0248-4e0d-9727-e76745402ee1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: fdafac79-c3d1-43ea-b9cf-ecd696afc300] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:47.758465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d6966bb-0248-4e0d-9727-e76745402ee1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:47.759220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d6966bb-0248-4e0d-9727-e76745402ee1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:47.760217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d6966bb-0248-4e0d-9727-e76745402ee1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:47.765476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d6966bb-0248-4e0d-9727-e76745402ee1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:47.829726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1d6966bb-0248-4e0d-9727-e76745402ee1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: fdafac79-c3d1-43ea-b9cf-ecd696afc300] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:50:48.015616 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1d6966bb-0248-4e0d-9727-e76745402ee1 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300" status: 204 len: 0 microversion: 2.1 time: 0.281709 Aug 02 06:50:48.016554 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 692/1299] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:50:47 2022] DELETE /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:50:48.027496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-19001112-a460-4023-8a38-5ab604075af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:48.028522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-19001112-a460-4023-8a38-5ab604075af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:48.051376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19001112-a460-4023-8a38-5ab604075af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:48.052235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19001112-a460-4023-8a38-5ab604075af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:48.053528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19001112-a460-4023-8a38-5ab604075af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:48.054288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19001112-a460-4023-8a38-5ab604075af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:48.108813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-19001112-a460-4023-8a38-5ab604075af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:50:48.209047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:48.325055 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-19001112-a460-4023-8a38-5ab604075af8 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "DELETE /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 204 len: 0 microversion: 2.1 time: 0.303719 Aug 02 06:50:48.329067 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 693/1300] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:50:48 2022] DELETE /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 06:50:48.339554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a886007a-bd49-4af8-bb60-910cc778c992 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:48.340282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a886007a-bd49-4af8-bb60-910cc778c992 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: fdafac79-c3d1-43ea-b9cf-ecd696afc300] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:48.352933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a886007a-bd49-4af8-bb60-910cc778c992 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:48.353592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a886007a-bd49-4af8-bb60-910cc778c992 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:48.355086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a886007a-bd49-4af8-bb60-910cc778c992 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:48.355677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a886007a-bd49-4af8-bb60-910cc778c992 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:48.760793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6cdba1fd-3f98-4df9-b5e8-b64734eb5d2f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:48.772154 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6cdba1fd-3f98-4df9-b5e8-b64734eb5d2f tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1317 microversion: 2.1 time: 1.167940 Aug 02 06:50:48.773156 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 608/1301] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:47 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1317 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:48.783377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e31c2445-baeb-4e8d-9ad6-a2de1455dcfe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:48.784002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e31c2445-baeb-4e8d-9ad6-a2de1455dcfe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:48.802236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e31c2445-baeb-4e8d-9ad6-a2de1455dcfe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:48.802713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e31c2445-baeb-4e8d-9ad6-a2de1455dcfe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:48.804085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e31c2445-baeb-4e8d-9ad6-a2de1455dcfe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:48.804526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e31c2445-baeb-4e8d-9ad6-a2de1455dcfe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:49.229437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a886007a-bd49-4af8-bb60-910cc778c992 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:49.240135 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a886007a-bd49-4af8-bb60-910cc778c992 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300" status: 200 len: 1475 microversion: 2.1 time: 0.909753 Aug 02 06:50:49.246682 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 694/1302] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:48 2022] GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300 => generated 1475 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:49.255370 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1e3f9ed9-006e-469e-b6db-7061fade6080 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927aac6f70>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:49.345270 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1e3f9ed9-006e-469e-b6db-7061fade6080 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.096902 Aug 02 06:50:49.346043 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 695/1303] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:49 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:49.359325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cff853f9-e1a9-4ded-a706-06fb19dc26db tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:49.362407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cff853f9-e1a9-4ded-a706-06fb19dc26db tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:49.377590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cff853f9-e1a9-4ded-a706-06fb19dc26db tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:49.378362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cff853f9-e1a9-4ded-a706-06fb19dc26db tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:49.379309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cff853f9-e1a9-4ded-a706-06fb19dc26db tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:49.379905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cff853f9-e1a9-4ded-a706-06fb19dc26db tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:49.651893 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e31c2445-baeb-4e8d-9ad6-a2de1455dcfe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:49.664312 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e31c2445-baeb-4e8d-9ad6-a2de1455dcfe tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1474 microversion: 2.1 time: 0.888598 Aug 02 06:50:49.665961 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 609/1304] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:48 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1474 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:49.782033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-481f0e25-af46-48ac-af59-4184053efe0d req-2b62be66-0747-4227-af81-020c2c140432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c0d87b-6113-4acd-8d91-d0d75d8a6157", "tag": "a1a37f29-a08b-4598-92e1-d377587f42f1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:49.805254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-481f0e25-af46-48ac-af59-4184053efe0d req-2b62be66-0747-4227-af81-020c2c140432 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:49.806123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-481f0e25-af46-48ac-af59-4184053efe0d req-2b62be66-0747-4227-af81-020c2c140432 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:49.822592 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-481f0e25-af46-48ac-af59-4184053efe0d req-2b62be66-0747-4227-af81-020c2c140432 service nova] Creating event network-changed:a1a37f29-a08b-4598-92e1-d377587f42f1 for instance a6c0d87b-6113-4acd-8d91-d0d75d8a6157 on n-h2-851337-3 Aug 02 06:50:49.828751 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-481f0e25-af46-48ac-af59-4184053efe0d req-2b62be66-0747-4227-af81-020c2c140432 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085324 Aug 02 06:50:49.831244 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 610/1305] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:49.843100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ddb7a4ba-02f7-4dd5-9f49-fe739ecb9d53 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:49.844405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ddb7a4ba-02f7-4dd5-9f49-fe739ecb9d53 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:49.852663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ddb7a4ba-02f7-4dd5-9f49-fe739ecb9d53 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:49.853862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ddb7a4ba-02f7-4dd5-9f49-fe739ecb9d53 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:49.855115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ddb7a4ba-02f7-4dd5-9f49-fe739ecb9d53 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:49.856742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ddb7a4ba-02f7-4dd5-9f49-fe739ecb9d53 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:50.019507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cff853f9-e1a9-4ded-a706-06fb19dc26db tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:50.034572 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cff853f9-e1a9-4ded-a706-06fb19dc26db tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1678 microversion: 2.1 time: 0.683286 Aug 02 06:50:50.035165 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 696/1306] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:49 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1678 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:50.268123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ed732bf-58b3-4999-b7e0-95be93285a5e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:50.268749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9ed732bf-58b3-4999-b7e0-95be93285a5e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: fdafac79-c3d1-43ea-b9cf-ecd696afc300] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:50.287267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ed732bf-58b3-4999-b7e0-95be93285a5e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:50.291169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ed732bf-58b3-4999-b7e0-95be93285a5e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:50.295920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ed732bf-58b3-4999-b7e0-95be93285a5e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:50.296598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ed732bf-58b3-4999-b7e0-95be93285a5e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:51.826505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9ed732bf-58b3-4999-b7e0-95be93285a5e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:51.836840 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9ed732bf-58b3-4999-b7e0-95be93285a5e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300" status: 200 len: 1475 microversion: 2.1 time: 1.572821 Aug 02 06:50:51.863255 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 697/1307] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:50 2022] GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300 => generated 1475 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:51.872634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cee08b22-2ddd-4769-872f-55200d186fb4 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927aa97f70>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:51.920547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ddb7a4ba-02f7-4dd5-9f49-fe739ecb9d53 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:51.935230 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ddb7a4ba-02f7-4dd5-9f49-fe739ecb9d53 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1317 microversion: 2.1 time: 2.097183 Aug 02 06:50:51.940282 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 611/1308] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:49 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1317 bytes in 2108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:51.959048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bd7b12ae-d367-4d31-af50-bd52d377a127 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:51.962761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bd7b12ae-d367-4d31-af50-bd52d377a127 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:51.976086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd7b12ae-d367-4d31-af50-bd52d377a127 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:51.977133 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cee08b22-2ddd-4769-872f-55200d186fb4 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.112113 Aug 02 06:50:51.978156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd7b12ae-d367-4d31-af50-bd52d377a127 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:51.980698 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 698/1309] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:51 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:51.980959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd7b12ae-d367-4d31-af50-bd52d377a127 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:51.981431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd7b12ae-d367-4d31-af50-bd52d377a127 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:51.992698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-788cf187-0877-4571-9e72-abf9c51d4948 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:51.993753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-788cf187-0877-4571-9e72-abf9c51d4948 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:52.012259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-788cf187-0877-4571-9e72-abf9c51d4948 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:52.012948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-788cf187-0877-4571-9e72-abf9c51d4948 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:52.018595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-788cf187-0877-4571-9e72-abf9c51d4948 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:52.019289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-788cf187-0877-4571-9e72-abf9c51d4948 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:52.961436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bd7b12ae-d367-4d31-af50-bd52d377a127 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:52.976705 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bd7b12ae-d367-4d31-af50-bd52d377a127 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1472 microversion: 2.1 time: 1.031803 Aug 02 06:50:52.977619 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 612/1310] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:51 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1472 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:52.990952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-5def6beb-5bd2-49f8-b72d-ff4213b8d8ef req-31d24224-14a1-4a35-ac2c-3c3817c82147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69991b6b-468d-45c0-b658-297b210ae988", "name": "network-vif-unplugged", "status": "completed", "tag": "b5f97f41-8484-419a-ac2c-d049deaf4ea4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:52.993580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-788cf187-0877-4571-9e72-abf9c51d4948 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:53.001574 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-788cf187-0877-4571-9e72-abf9c51d4948 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1678 microversion: 2.1 time: 1.019255 Aug 02 06:50:53.007685 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 699/1311] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:51 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1678 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:53.016249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ac13cbc8-f5dc-44d3-8cf7-28dc7876a468 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:53.019504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ac13cbc8-f5dc-44d3-8cf7-28dc7876a468 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: fdafac79-c3d1-43ea-b9cf-ecd696afc300] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:53.029569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5def6beb-5bd2-49f8-b72d-ff4213b8d8ef req-31d24224-14a1-4a35-ac2c-3c3817c82147 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:53.030059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5def6beb-5bd2-49f8-b72d-ff4213b8d8ef req-31d24224-14a1-4a35-ac2c-3c3817c82147 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:53.035394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac13cbc8-f5dc-44d3-8cf7-28dc7876a468 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:53.038794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac13cbc8-f5dc-44d3-8cf7-28dc7876a468 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:53.039869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac13cbc8-f5dc-44d3-8cf7-28dc7876a468 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:53.040539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac13cbc8-f5dc-44d3-8cf7-28dc7876a468 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:53.058586 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-5def6beb-5bd2-49f8-b72d-ff4213b8d8ef req-31d24224-14a1-4a35-ac2c-3c3817c82147 service nova] Creating event network-vif-unplugged:b5f97f41-8484-419a-ac2c-d049deaf4ea4 for instance 69991b6b-468d-45c0-b658-297b210ae988 on n-h2-851337-3 Aug 02 06:50:53.073554 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-5def6beb-5bd2-49f8-b72d-ff4213b8d8ef req-31d24224-14a1-4a35-ac2c-3c3817c82147 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092503 Aug 02 06:50:53.074752 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 613/1312] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:53.083878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-da8e9042-3b19-450a-8705-c2424c2c5cc2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:53.087927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-da8e9042-3b19-450a-8705-c2424c2c5cc2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:53.102649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da8e9042-3b19-450a-8705-c2424c2c5cc2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:53.103474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da8e9042-3b19-450a-8705-c2424c2c5cc2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:53.104487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da8e9042-3b19-450a-8705-c2424c2c5cc2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:53.108830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da8e9042-3b19-450a-8705-c2424c2c5cc2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:53.659709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ac13cbc8-f5dc-44d3-8cf7-28dc7876a468 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:53.668017 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ac13cbc8-f5dc-44d3-8cf7-28dc7876a468 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300" status: 200 len: 1475 microversion: 2.1 time: 0.658996 Aug 02 06:50:53.672717 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 700/1313] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:53 2022] GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300 => generated 1475 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:53.697363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-882288fe-ff6d-4337-acd7-866f6f45f539 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f928c343700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:53.776819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-da8e9042-3b19-450a-8705-c2424c2c5cc2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:53.786095 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-da8e9042-3b19-450a-8705-c2424c2c5cc2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1317 microversion: 2.1 time: 0.709805 Aug 02 06:50:53.791485 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 614/1314] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:53 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1317 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:53.812512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-25646f59-c0b0-4347-bc92-48b4d44c3bc7 req-e36a69c5-dfc1-4f92-9d66-f792864941fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69991b6b-468d-45c0-b658-297b210ae988", "name": "network-vif-deleted", "tag": "b5f97f41-8484-419a-ac2c-d049deaf4ea4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:53.826957 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-882288fe-ff6d-4337-acd7-866f6f45f539 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.152403 Aug 02 06:50:53.827534 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 701/1315] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:53 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:53.829792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-25646f59-c0b0-4347-bc92-48b4d44c3bc7 req-e36a69c5-dfc1-4f92-9d66-f792864941fb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:53.830545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-25646f59-c0b0-4347-bc92-48b4d44c3bc7 req-e36a69c5-dfc1-4f92-9d66-f792864941fb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:53.871458 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-25646f59-c0b0-4347-bc92-48b4d44c3bc7 req-e36a69c5-dfc1-4f92-9d66-f792864941fb service nova] Creating event network-vif-deleted:b5f97f41-8484-419a-ac2c-d049deaf4ea4 for instance 69991b6b-468d-45c0-b658-297b210ae988 on n-h2-851337-3 Aug 02 06:50:53.889058 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-25646f59-c0b0-4347-bc92-48b4d44c3bc7 req-e36a69c5-dfc1-4f92-9d66-f792864941fb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079411 Aug 02 06:50:53.890303 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 615/1316] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:50:54.006127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd13bc02-981a-4321-b595-0c3c1a365047 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:54.008051 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dd13bc02-981a-4321-b595-0c3c1a365047 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:54.029290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-28fb040b-548a-4a8b-8041-2ee53996ab05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:54.030013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-28fb040b-548a-4a8b-8041-2ee53996ab05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:54.038212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd13bc02-981a-4321-b595-0c3c1a365047 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:54.038732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd13bc02-981a-4321-b595-0c3c1a365047 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:54.040836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28fb040b-548a-4a8b-8041-2ee53996ab05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:54.043700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28fb040b-548a-4a8b-8041-2ee53996ab05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:54.044970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd13bc02-981a-4321-b595-0c3c1a365047 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:54.045738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28fb040b-548a-4a8b-8041-2ee53996ab05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:54.046426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28fb040b-548a-4a8b-8041-2ee53996ab05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:54.050833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd13bc02-981a-4321-b595-0c3c1a365047 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:54.385032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-28fb040b-548a-4a8b-8041-2ee53996ab05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af91cd457125470fa8f4fbbd628c5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36057db08ef64298a219d1bf6388e06f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:54.436025 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-28fb040b-548a-4a8b-8041-2ee53996ab05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 200 len: 1611 microversion: 2.1 time: 0.387487 Aug 02 06:50:54.445359 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 616/1317] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:54 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 1611 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:54.693159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a4c2aafa-d758-490d-8a17-3d0a81bfee7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:54.694078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a4c2aafa-d758-490d-8a17-3d0a81bfee7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: fdafac79-c3d1-43ea-b9cf-ecd696afc300] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:54.703516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4c2aafa-d758-490d-8a17-3d0a81bfee7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:54.706311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4c2aafa-d758-490d-8a17-3d0a81bfee7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:54.709311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4c2aafa-d758-490d-8a17-3d0a81bfee7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:54.710027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4c2aafa-d758-490d-8a17-3d0a81bfee7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:55.178459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dd13bc02-981a-4321-b595-0c3c1a365047 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:55.192237 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dd13bc02-981a-4321-b595-0c3c1a365047 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1472 microversion: 2.1 time: 1.192977 Aug 02 06:50:55.209970 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 702/1318] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:53 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1472 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:55.234598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a4c2aafa-d758-490d-8a17-3d0a81bfee7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:55.245332 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a4c2aafa-d758-490d-8a17-3d0a81bfee7a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300" status: 200 len: 1475 microversion: 2.1 time: 0.556494 Aug 02 06:50:55.264886 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 617/1319] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:54 2022] GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300 => generated 1475 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:50:55.277730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0dbbf804-939b-4e21-baae-54992ae627a0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:55.284095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0dbbf804-939b-4e21-baae-54992ae627a0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:55.309782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0dbbf804-939b-4e21-baae-54992ae627a0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:55.310261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0dbbf804-939b-4e21-baae-54992ae627a0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:55.311015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0dbbf804-939b-4e21-baae-54992ae627a0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:55.311438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0dbbf804-939b-4e21-baae-54992ae627a0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:55.636023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3613aff4-1314-4274-8994-aeda5299d8ad tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Action: 'create', calling method: .version_select at 0x7f928c22cdc0>, body: {"keypair": {"name": "tempest-keypair-71942948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHztKyxiwrnF8OFKPrefi1jFANjt6ZFzLTfp+inlh74FbTaes2lXY9qqPLX5aEjqY1G2Szgh7iA2zbYqPf02PQorE2Gyas5DdCd4BtVa4xfuRHGoK3JrNcAZ80QaaZAEJg=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:55.688215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-3613aff4-1314-4274-8994-aeda5299d8ad tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Getting quotas for project 33e0c0cd8e0848ad85a389e2aed4129d. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:50:55.702914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-3613aff4-1314-4274-8994-aeda5299d8ad tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Getting quotas for user 9511242e31e54439b66b917cf6419e70 and project 33e0c0cd8e0848ad85a389e2aed4129d. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:50:55.779396 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3613aff4-1314-4274-8994-aeda5299d8ad tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.565618 Aug 02 06:50:55.781159 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 703/1320] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:50:55 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:55.799203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1edeb7c9-e96f-4154-8904-3729fa50acdc tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f928c2f9e50>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:55.940218 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1edeb7c9-e96f-4154-8904-3729fa50acdc tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.156898 Aug 02 06:50:55.940837 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 704/1321] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:55 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:55.965199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-d6303024-9e4a-45e3-b00b-b5d90ed1faf5 req-48d92f86-39cf-4ba5-bea0-1d599364c588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdafac79-c3d1-43ea-b9cf-ecd696afc300", "name": "network-vif-unplugged", "status": "completed", "tag": "dc2c12d9-5559-413b-a059-a00cb0322123"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:56.038002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d6303024-9e4a-45e3-b00b-b5d90ed1faf5 req-48d92f86-39cf-4ba5-bea0-1d599364c588 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:56.051028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d6303024-9e4a-45e3-b00b-b5d90ed1faf5 req-48d92f86-39cf-4ba5-bea0-1d599364c588 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:56.122769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0dbbf804-939b-4e21-baae-54992ae627a0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:56.131907 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-d6303024-9e4a-45e3-b00b-b5d90ed1faf5 req-48d92f86-39cf-4ba5-bea0-1d599364c588 service nova] Creating event network-vif-unplugged:dc2c12d9-5559-413b-a059-a00cb0322123 for instance fdafac79-c3d1-43ea-b9cf-ecd696afc300 on n-h1-851337-3 Aug 02 06:50:56.141803 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0dbbf804-939b-4e21-baae-54992ae627a0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1317 microversion: 2.1 time: 0.873585 Aug 02 06:50:56.143102 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 618/1322] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:55 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1317 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:56.153209 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-d6303024-9e4a-45e3-b00b-b5d90ed1faf5 req-48d92f86-39cf-4ba5-bea0-1d599364c588 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.207776 Aug 02 06:50:56.154019 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 705/1323] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:56.161232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ee9975aa-b0cd-48ff-9a3e-676842399bd5 req-10a09914-e74e-465f-bfc9-4a787ca113d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83", "name": "network-vif-deleted", "tag": "9c10bb5f-0f1e-49f1-b818-534784fee842"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:56.172822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-98f85737-06ab-4630-8783-2571090a5c05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:56.176202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-98f85737-06ab-4630-8783-2571090a5c05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:56.208520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98f85737-06ab-4630-8783-2571090a5c05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:56.209025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98f85737-06ab-4630-8783-2571090a5c05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:56.219896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98f85737-06ab-4630-8783-2571090a5c05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:56.220870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98f85737-06ab-4630-8783-2571090a5c05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:56.221545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ee9975aa-b0cd-48ff-9a3e-676842399bd5 req-10a09914-e74e-465f-bfc9-4a787ca113d2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:56.229322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ee9975aa-b0cd-48ff-9a3e-676842399bd5 req-10a09914-e74e-465f-bfc9-4a787ca113d2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:56.267588 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ee9975aa-b0cd-48ff-9a3e-676842399bd5 req-10a09914-e74e-465f-bfc9-4a787ca113d2 service nova] Creating event network-vif-deleted:9c10bb5f-0f1e-49f1-b818-534784fee842 for instance 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 on n-h1-851337-3 Aug 02 06:50:56.275984 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-98f85737-06ab-4630-8783-2571090a5c05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] HTTP exception thrown: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:50:56.282886 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ee9975aa-b0cd-48ff-9a3e-676842399bd5 req-10a09914-e74e-465f-bfc9-4a787ca113d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127312 Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-98f85737-06ab-4630-8783-2571090a5c05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Request method failure captured: Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 HTTP/1.1 Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MinIgKrHTH_xSfanF2wFggnDR9YtG1Hw7-DcvlLCvMKeXv1MsXSfEpzYaR4sA6aYOpOPgPXyYk8p4jz3RikXusuAubl-Edohjmv_etaD88e7rXj7b6MJBQw3OPMJF0svj9xik4VeCKFfS0jMmh5hMRgATaMDI1D7kzctvCVB8jLyP8 Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 36057db08ef64298a219d1bf6388e06f Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2022593089 Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:50:56.284633 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:50:56.286323 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/36057db08ef64298a219d1bf6388e06f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/36057db08ef64298a219d1bf6388e06f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_36057db08ef64298a219d1bf6388e06f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/36057db08ef64298a219d1bf6388e06f"}]}] Aug 02 06:50:56.286323 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2022593089 Aug 02 06:50:56.286323 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 36057db08ef64298a219d1bf6388e06f Aug 02 06:50:56.286323 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2022593089 Aug 02 06:50:56.286323 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachSCSIVolumeTestJSON-2022593089-project Aug 02 06:50:56.286323 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:50:56.286323 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:50:56.286323 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: af91cd457125470fa8f4fbbd628c5d82 Aug 02 06:50:56.286323 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2022593089-project Aug 02 06:50:56.286323 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:50:56.286323 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:50:56.286323 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '69991b6b-468d-45c0-b658-297b210ae988'} Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:56.287274 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:50:56.288901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:56.290350 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 706/1324] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:56.294524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-98f85737-06ab-4630-8783-2571090a5c05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Returning 404 to user: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:56.298565 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-98f85737-06ab-4630-8783-2571090a5c05 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 404 len: 111 microversion: 2.1 time: 0.152276 Aug 02 06:50:56.302937 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 619/1325] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:56 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:50:56.310098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-db0e594c-7756-4c5f-ba7c-7ccbaba49615 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:56.310765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-db0e594c-7756-4c5f-ba7c-7ccbaba49615 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:56.322809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7ff4ffd7-1777-4250-a665-8c176259f4b5 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:56.325035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7ff4ffd7-1777-4250-a665-8c176259f4b5 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: fdafac79-c3d1-43ea-b9cf-ecd696afc300] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:56.351380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ff4ffd7-1777-4250-a665-8c176259f4b5 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:56.356565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ff4ffd7-1777-4250-a665-8c176259f4b5 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:56.359129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ff4ffd7-1777-4250-a665-8c176259f4b5 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:56.359629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ff4ffd7-1777-4250-a665-8c176259f4b5 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:56.362950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db0e594c-7756-4c5f-ba7c-7ccbaba49615 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:56.365760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db0e594c-7756-4c5f-ba7c-7ccbaba49615 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:56.369201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db0e594c-7756-4c5f-ba7c-7ccbaba49615 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:56.372883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db0e594c-7756-4c5f-ba7c-7ccbaba49615 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:57.118026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7ff4ffd7-1777-4250-a665-8c176259f4b5 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:57.128053 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7ff4ffd7-1777-4250-a665-8c176259f4b5 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300" status: 200 len: 1433 microversion: 2.1 time: 0.823762 Aug 02 06:50:57.132807 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 620/1326] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:56 2022] GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300 => generated 1433 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:57.146642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-812e7bd0-181f-4742-b082-9d71634992a4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '.version_select at 0x7f927ae349d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:57.244740 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-812e7bd0-181f-4742-b082-9d71634992a4 tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-820102506" status: 202 len: 0 microversion: 2.1 time: 0.104684 Aug 02 06:50:57.246676 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 621/1327] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Aug 2 06:50:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-820102506 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:50:57.261620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-d1102e62-f719-40ee-9747-9da29636a92d req-84cfe25b-8061-4920-930f-d0442914dac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdafac79-c3d1-43ea-b9cf-ecd696afc300", "name": "network-vif-deleted", "tag": "dc2c12d9-5559-413b-a059-a00cb0322123"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:57.306374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d1102e62-f719-40ee-9747-9da29636a92d req-84cfe25b-8061-4920-930f-d0442914dac8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:57.309324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d1102e62-f719-40ee-9747-9da29636a92d req-84cfe25b-8061-4920-930f-d0442914dac8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:57.354446 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-d1102e62-f719-40ee-9747-9da29636a92d req-84cfe25b-8061-4920-930f-d0442914dac8 service nova] Creating event network-vif-deleted:dc2c12d9-5559-413b-a059-a00cb0322123 for instance fdafac79-c3d1-43ea-b9cf-ecd696afc300 on n-h1-851337-3 Aug 02 06:50:57.365398 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-d1102e62-f719-40ee-9747-9da29636a92d req-84cfe25b-8061-4920-930f-d0442914dac8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117401 Aug 02 06:50:57.369181 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 622/1328] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:50:57.405399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-db0e594c-7756-4c5f-ba7c-7ccbaba49615 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:57.407688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-43c47aea-9d9d-4f6a-8836-df649d6ed7e4 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927af37670>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:57.423888 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-db0e594c-7756-4c5f-ba7c-7ccbaba49615 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1469 microversion: 2.1 time: 1.135093 Aug 02 06:50:57.426484 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 707/1329] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:56 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1469 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:57.444502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-404317cb-a79a-4051-9d8e-cf3c0ecb57cb tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:57.450483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-404317cb-a79a-4051-9d8e-cf3c0ecb57cb tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:57.471011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-404317cb-a79a-4051-9d8e-cf3c0ecb57cb tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:57.473296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-404317cb-a79a-4051-9d8e-cf3c0ecb57cb tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:57.474631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-404317cb-a79a-4051-9d8e-cf3c0ecb57cb tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:57.476195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-404317cb-a79a-4051-9d8e-cf3c0ecb57cb tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:57.531272 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-43c47aea-9d9d-4f6a-8836-df649d6ed7e4 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.157760 Aug 02 06:50:57.532301 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 623/1330] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:57 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:57.560905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-53450207-3064-4d98-b566-699313713b6b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:50:57.561646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-53450207-3064-4d98-b566-699313713b6b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:57.595209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53450207-3064-4d98-b566-699313713b6b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:57.598487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53450207-3064-4d98-b566-699313713b6b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:57.599837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53450207-3064-4d98-b566-699313713b6b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:57.601744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53450207-3064-4d98-b566-699313713b6b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:57.735098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:50:57.815257 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-53450207-3064-4d98-b566-699313713b6b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "POST /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223/action" status: 204 len: 0 microversion: 2.1 time: 0.278857 Aug 02 06:50:57.819944 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 624/1331] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:50:57 2022] POST /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223/action => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:50:57.831360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5291befc-5590-43d6-b922-628e1e311fd8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:57.840026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5291befc-5590-43d6-b922-628e1e311fd8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:57.876460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5291befc-5590-43d6-b922-628e1e311fd8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:57.877988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5291befc-5590-43d6-b922-628e1e311fd8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:57.881328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5291befc-5590-43d6-b922-628e1e311fd8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:57.882329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5291befc-5590-43d6-b922-628e1e311fd8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:58.804890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5291befc-5590-43d6-b922-628e1e311fd8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:58.814166 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5291befc-5590-43d6-b922-628e1e311fd8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1469 microversion: 2.1 time: 0.989903 Aug 02 06:50:58.814757 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 625/1332] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:57 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1469 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:58.835769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6eda5b81-f357-4006-aa4a-552cc599ec78 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:58.836387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6eda5b81-f357-4006-aa4a-552cc599ec78 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: fdafac79-c3d1-43ea-b9cf-ecd696afc300] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:58.846023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-404317cb-a79a-4051-9d8e-cf3c0ecb57cb tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:50:58.862634 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-404317cb-a79a-4051-9d8e-cf3c0ecb57cb tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1317 microversion: 2.1 time: 1.428521 Aug 02 06:50:58.863529 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 708/1333] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:57 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1317 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:58.879138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f5e24e97-42a5-4f76-8ced-47acafef2fd8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927aac6ee0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:58.881770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6eda5b81-f357-4006-aa4a-552cc599ec78 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:58.882761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6eda5b81-f357-4006-aa4a-552cc599ec78 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:58.883550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6eda5b81-f357-4006-aa4a-552cc599ec78 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:58.884078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6eda5b81-f357-4006-aa4a-552cc599ec78 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:58.914101 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-6eda5b81-f357-4006-aa4a-552cc599ec78 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] HTTP exception thrown: Instance fdafac79-c3d1-43ea-b9cf-ecd696afc300 could not be found. Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6eda5b81-f357-4006-aa4a-552cc599ec78 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Request method failure captured: Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300 HTTP/1.1 Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiP0QH7i_IXK_4JWtYj3HrgwHLsXsGtff-Mc558oWyxLOMs39SkcY535RJSybe5b5I6ZUX77Rjwuk1nlC1mvc_DV8M2K2mc7F4t5W6mRuXQ5jz-P4SqXjiGZGpTEG_iI4wzNZlPyAagEm70iD4im2lOWSJ0djax-9JSk8M47fdG6l8 Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:50:58.924955 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:50:58.927639 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}] Aug 02 06:50:58.927639 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:58.927639 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:50:58.927639 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:58.927639 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:50:58.927639 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:50:58.927639 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:50:58.927639 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: c0327068ab564b05ac50b0efd4c61a0f Aug 02 06:50:58.927639 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:50:58.927639 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:50:58.927639 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance fdafac79-c3d1-43ea-b9cf-ecd696afc300 could not be found. Aug 02 06:50:58.927639 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'fdafac79-c3d1-43ea-b9cf-ecd696afc300'} Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdafac79-c3d1-43ea-b9cf-ecd696afc300 could not be found. Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:58.928602 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdafac79-c3d1-43ea-b9cf-ecd696afc300 could not be found. Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdafac79-c3d1-43ea-b9cf-ecd696afc300 could not be found. Aug 02 06:50:58.930285 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:58.931496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6eda5b81-f357-4006-aa4a-552cc599ec78 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Returning 404 to user: Instance fdafac79-c3d1-43ea-b9cf-ecd696afc300 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:58.943045 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6eda5b81-f357-4006-aa4a-552cc599ec78 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300" status: 404 len: 111 microversion: 2.1 time: 0.111908 Aug 02 06:50:58.943898 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 626/1334] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:58 2022] GET /compute/v2.1/servers/fdafac79-c3d1-43ea-b9cf-ecd696afc300 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:50:58.952703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6398fb20-4189-4364-80c2-219c1768429e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:58.953494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6398fb20-4189-4364-80c2-219c1768429e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:58.964349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6398fb20-4189-4364-80c2-219c1768429e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:58.971499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6398fb20-4189-4364-80c2-219c1768429e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:58.973526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6398fb20-4189-4364-80c2-219c1768429e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:58.975088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6398fb20-4189-4364-80c2-219c1768429e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:59.007873 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-6398fb20-4189-4364-80c2-219c1768429e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] HTTP exception thrown: Instance 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 could not be found. Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6398fb20-4189-4364-80c2-219c1768429e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Request method failure captured: Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 HTTP/1.1 Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiP0QH7i_IXK_4JWtYj3HrgwHLsXsGtff-Mc558oWyxLOMs39SkcY535RJSybe5b5I6ZUX77Rjwuk1nlC1mvc_DV8M2K2mc7F4t5W6mRuXQ5jz-P4SqXjiGZGpTEG_iI4wzNZlPyAagEm70iD4im2lOWSJ0djax-9JSk8M47fdG6l8 Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:50:59.009779 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:50:59.011235 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}] Aug 02 06:50:59.011235 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:59.011235 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:50:59.011235 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:50:59.011235 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:50:59.011235 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:50:59.011235 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:50:59.011235 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: c0327068ab564b05ac50b0efd4c61a0f Aug 02 06:50:59.011235 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:50:59.011235 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:50:59.011235 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 could not be found. Aug 02 06:50:59.011235 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83'} Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 could not be found. Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:50:59.012083 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 could not be found. Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 could not be found. Aug 02 06:50:59.013290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:50:59.023875 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f5e24e97-42a5-4f76-8ced-47acafef2fd8 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1422 microversion: 2.1 time: 0.159054 Aug 02 06:50:59.034826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6398fb20-4189-4364-80c2-219c1768429e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Returning 404 to user: Instance 78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:50:59.035998 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6398fb20-4189-4364-80c2-219c1768429e tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83" status: 404 len: 111 microversion: 2.1 time: 0.087719 Aug 02 06:50:59.036151 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 709/1335] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:50:58 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1422 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:50:59.044258 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 627/1336] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:58 2022] GET /compute/v2.1/servers/78c7e9d7-ae24-4f48-bc1e-0b3632cc1a83 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:50:59.048097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6374a91-bcc6-40fa-89ff-567e2af4ec43 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:59.189561 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d6374a91-bcc6-40fa-89ff-567e2af4ec43 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/2196c523-b960-4841-9622-3734bf03701d" status: 204 len: 0 microversion: 2.1 time: 0.145452 Aug 02 06:50:59.191717 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 710/1337] 10.222.0.79 () {58 vars in 1266 bytes} [Tue Aug 2 06:50:59 2022] DELETE /compute/v2.1/os-server-groups/2196c523-b960-4841-9622-3734bf03701d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 06:50:59.206674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a23e6d14-9772-4a9d-b4d6-565cb805d25d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:59.209174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a23e6d14-9772-4a9d-b4d6-565cb805d25d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:59.282182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a23e6d14-9772-4a9d-b4d6-565cb805d25d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:59.288416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a23e6d14-9772-4a9d-b4d6-565cb805d25d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:59.289678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a23e6d14-9772-4a9d-b4d6-565cb805d25d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:59.291645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a23e6d14-9772-4a9d-b4d6-565cb805d25d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:59.339051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a23e6d14-9772-4a9d-b4d6-565cb805d25d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:50:59.521126 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a23e6d14-9772-4a9d-b4d6-565cb805d25d tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "DELETE /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 204 len: 0 microversion: 2.1 time: 0.314425 Aug 02 06:50:59.525653 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 628/1338] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:50:59 2022] DELETE /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:50:59.534402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3110a971-9d4d-41cf-830a-dc7497f907aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:50:59.535247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3110a971-9d4d-41cf-830a-dc7497f907aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:50:59.546479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3110a971-9d4d-41cf-830a-dc7497f907aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:59.563441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3110a971-9d4d-41cf-830a-dc7497f907aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:59.565739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3110a971-9d4d-41cf-830a-dc7497f907aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:50:59.569580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3110a971-9d4d-41cf-830a-dc7497f907aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:50:59.681439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "0021ee16-9939-4e73-a5ff-3559db5b9259"}], "security_groups": [{"name": "tempest-securitygroup--1134687635"}], "key_name": "tempest-keypair-71942948", "user_data": "}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:00.121990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3110a971-9d4d-41cf-830a-dc7497f907aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:00.138090 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3110a971-9d4d-41cf-830a-dc7497f907aa tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 200 len: 1472 microversion: 2.1 time: 0.608113 Aug 02 06:51:00.141269 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 711/1339] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:50:59 2022] GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 1472 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:00.149479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-13634c32-c97b-4f14-afcf-56ad6c2112c4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:00.151924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-13634c32-c97b-4f14-afcf-56ad6c2112c4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:00.167157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13634c32-c97b-4f14-afcf-56ad6c2112c4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:00.169609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13634c32-c97b-4f14-afcf-56ad6c2112c4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:00.170905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13634c32-c97b-4f14-afcf-56ad6c2112c4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:00.171368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13634c32-c97b-4f14-afcf-56ad6c2112c4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:00.196963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] validate_networks() for [('0021ee16-9939-4e73-a5ff-3559db5b9259', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:51:01.027969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-13634c32-c97b-4f14-afcf-56ad6c2112c4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:01.035627 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-13634c32-c97b-4f14-afcf-56ad6c2112c4 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1469 microversion: 2.1 time: 0.892965 Aug 02 06:51:01.046251 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 712/1340] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:00 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1469 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:01.051461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6dc9cc64-6a28-4d6a-a2fa-a5662abd945a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:01.052368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6dc9cc64-6a28-4d6a-a2fa-a5662abd945a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:01.071170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc64-6a28-4d6a-a2fa-a5662abd945a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:01.071959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc64-6a28-4d6a-a2fa-a5662abd945a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:01.072984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc64-6a28-4d6a-a2fa-a5662abd945a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:01.073623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc64-6a28-4d6a-a2fa-a5662abd945a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:02.149945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:51:02.150920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:51:02.151554 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:51:02.152130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:51:02.152709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:51:02.180194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:02.181222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:02.182234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:02.182830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:02.244261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Getting quotas for project 33e0c0cd8e0848ad85a389e2aed4129d. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:51:02.270014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Getting quotas for user 9511242e31e54439b66b917cf6419e70 and project 33e0c0cd8e0848ad85a389e2aed4129d. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:51:02.289528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:51:02.294638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:51:02.314095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:02.319067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6dc9cc64-6a28-4d6a-a2fa-a5662abd945a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:02.340448 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6dc9cc64-6a28-4d6a-a2fa-a5662abd945a tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1317 microversion: 2.1 time: 1.292732 Aug 02 06:51:02.364450 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 713/1341] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:01 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1317 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:02.377291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-72c145c5-4baf-4c52-9a4b-923962f8aaef req-e07b92ce-758d-4b9c-b17c-e70ffbc9d10f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c0d87b-6113-4acd-8d91-d0d75d8a6157", "name": "network-vif-plugged", "status": "completed", "tag": "a1a37f29-a08b-4598-92e1-d377587f42f1"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:02.418384 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0fd9f65a-78df-4566-adf9-8176604e7bff tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.741997 Aug 02 06:51:02.419017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-72c145c5-4baf-4c52-9a4b-923962f8aaef req-e07b92ce-758d-4b9c-b17c-e70ffbc9d10f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:02.419602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-72c145c5-4baf-4c52-9a4b-923962f8aaef req-e07b92ce-758d-4b9c-b17c-e70ffbc9d10f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:02.420487 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 629/1342] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:50:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 2745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:51:02.433277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-11d30125-1e96-4123-8fbb-8be467b16898 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927af37310>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:02.461026 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-72c145c5-4baf-4c52-9a4b-923962f8aaef req-e07b92ce-758d-4b9c-b17c-e70ffbc9d10f service nova] Creating event network-vif-plugged:a1a37f29-a08b-4598-92e1-d377587f42f1 for instance a6c0d87b-6113-4acd-8d91-d0d75d8a6157 on n-h2-851337-3 Aug 02 06:51:02.495140 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-72c145c5-4baf-4c52-9a4b-923962f8aaef req-e07b92ce-758d-4b9c-b17c-e70ffbc9d10f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128230 Aug 02 06:51:02.497378 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 714/1343] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:02.513027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a182c0f1-5885-493f-a43c-fe38f80a933a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:02.519927 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-11d30125-1e96-4123-8fbb-8be467b16898 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1431 microversion: 2.1 time: 0.098048 Aug 02 06:51:02.528716 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 630/1344] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:02 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1431 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:02.529197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a182c0f1-5885-493f-a43c-fe38f80a933a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:02.533787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=4,nova_api:DELETE=6,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:02.551358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-67648524-6257-4ec7-9db1-c3148a5f9aef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:02.551980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-67648524-6257-4ec7-9db1-c3148a5f9aef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:02.564011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a182c0f1-5885-493f-a43c-fe38f80a933a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:02.564840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a182c0f1-5885-493f-a43c-fe38f80a933a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:02.565844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a182c0f1-5885-493f-a43c-fe38f80a933a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:02.567604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a182c0f1-5885-493f-a43c-fe38f80a933a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:02.568220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67648524-6257-4ec7-9db1-c3148a5f9aef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:02.568673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67648524-6257-4ec7-9db1-c3148a5f9aef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:02.569521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67648524-6257-4ec7-9db1-c3148a5f9aef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:02.569974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67648524-6257-4ec7-9db1-c3148a5f9aef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:03.202854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a182c0f1-5885-493f-a43c-fe38f80a933a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:03.218261 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a182c0f1-5885-493f-a43c-fe38f80a933a tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 200 len: 1472 microversion: 2.1 time: 0.715137 Aug 02 06:51:03.219833 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 715/1345] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:02 2022] GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 1472 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:03.226082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8d4e719c-07d4-4cbf-b25b-1d81dc2508a4 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:03.227305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8d4e719c-07d4-4cbf-b25b-1d81dc2508a4 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:03.413764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-67648524-6257-4ec7-9db1-c3148a5f9aef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:03.445873 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-67648524-6257-4ec7-9db1-c3148a5f9aef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1469 microversion: 2.1 time: 0.923909 Aug 02 06:51:03.447093 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 631/1346] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:02 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1469 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:03.464143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-664457f8-75e9-4f07-9f73-c42dd297f696 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927ae969d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:03.495715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8d4e719c-07d4-4cbf-b25b-1d81dc2508a4 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:03.512107 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8d4e719c-07d4-4cbf-b25b-1d81dc2508a4 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1224 microversion: 2.1 time: 0.288742 Aug 02 06:51:03.518623 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 716/1347] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:03 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1224 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:03.532147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-33c8383c-9afa-4c1e-8765-c1e1dba4a551 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:03.533104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-33c8383c-9afa-4c1e-8765-c1e1dba4a551 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:03.544611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33c8383c-9afa-4c1e-8765-c1e1dba4a551 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:03.546187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33c8383c-9afa-4c1e-8765-c1e1dba4a551 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:03.547912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33c8383c-9afa-4c1e-8765-c1e1dba4a551 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:03.549173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33c8383c-9afa-4c1e-8765-c1e1dba4a551 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:03.557643 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-664457f8-75e9-4f07-9f73-c42dd297f696 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 200 len: 1431 microversion: 2.1 time: 0.109209 Aug 02 06:51:03.558265 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 632/1348] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:03 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 1431 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:03.599399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e37a1e19-a87d-4ac8-bc77-bf67b9118942 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:03.603384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e37a1e19-a87d-4ac8-bc77-bf67b9118942 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:03.623002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e37a1e19-a87d-4ac8-bc77-bf67b9118942 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:03.626423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e37a1e19-a87d-4ac8-bc77-bf67b9118942 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:03.632715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e37a1e19-a87d-4ac8-bc77-bf67b9118942 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:03.633487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e37a1e19-a87d-4ac8-bc77-bf67b9118942 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:04.054832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-33c8383c-9afa-4c1e-8765-c1e1dba4a551 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:04.066159 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-33c8383c-9afa-4c1e-8765-c1e1dba4a551 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1317 microversion: 2.1 time: 0.545490 Aug 02 06:51:04.078392 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 717/1349] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:03 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:04.094895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-84bcdd14-0e97-4303-a574-d108a8c89053 req-9e8a0b72-0980-4d97-8220-18916cda37e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ae3b2d-b9db-4285-a9d1-665045b4d168", "name": "network-vif-deleted", "tag": "f735bcbb-19dc-417d-9bdf-5cb12315ce1c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:04.117574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e37a1e19-a87d-4ac8-bc77-bf67b9118942 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:04.121501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-84bcdd14-0e97-4303-a574-d108a8c89053 req-9e8a0b72-0980-4d97-8220-18916cda37e3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:04.122417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-84bcdd14-0e97-4303-a574-d108a8c89053 req-9e8a0b72-0980-4d97-8220-18916cda37e3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:04.132247 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e37a1e19-a87d-4ac8-bc77-bf67b9118942 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1466 microversion: 2.1 time: 0.558398 Aug 02 06:51:04.135812 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 633/1350] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:03 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1466 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:04.153210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ce6759af-746e-4760-b947-78387db0e132 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927ae34310>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:04.157856 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-84bcdd14-0e97-4303-a574-d108a8c89053 req-9e8a0b72-0980-4d97-8220-18916cda37e3 service nova] Creating event network-vif-deleted:f735bcbb-19dc-417d-9bdf-5cb12315ce1c for instance 75ae3b2d-b9db-4285-a9d1-665045b4d168 on n-h2-851337-3 Aug 02 06:51:04.186607 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-84bcdd14-0e97-4303-a574-d108a8c89053 req-9e8a0b72-0980-4d97-8220-18916cda37e3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114212 Aug 02 06:51:04.187334 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 718/1351] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:04.220513 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ce6759af-746e-4760-b947-78387db0e132 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/fbc11386-7cb6-4309-932b-7acee00d4676" status: 200 len: 784 microversion: 2.1 time: 0.071138 Aug 02 06:51:04.232791 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 634/1352] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:04 2022] GET /compute/v2.1/images/fbc11386-7cb6-4309-932b-7acee00d4676 => generated 784 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:04.241805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d29bdd54-88df-4f59-911d-52b4aeff20ca tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:04.245190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d61a76b1-b61d-4b28-b9d6-667f92b72496 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:04.246429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d61a76b1-b61d-4b28-b9d6-667f92b72496 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:04.267951 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d29bdd54-88df-4f59-911d-52b4aeff20ca tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034850 Aug 02 06:51:04.274620 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 719/1353] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:51:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:51:04.282035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d61a76b1-b61d-4b28-b9d6-667f92b72496 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:04.282482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d61a76b1-b61d-4b28-b9d6-667f92b72496 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:04.287145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d61a76b1-b61d-4b28-b9d6-667f92b72496 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:04.290519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d61a76b1-b61d-4b28-b9d6-667f92b72496 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:04.293357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43e04bc8-95ab-4c26-9e27-1cc701218a3e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f928c330430>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:04.327567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d61a76b1-b61d-4b28-b9d6-667f92b72496 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:04.328013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d61a76b1-b61d-4b28-b9d6-667f92b72496 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:04.328467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-d61a76b1-b61d-4b28-b9d6-667f92b72496 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lazy-loading 'fault' on Instance uuid 75ae3b2d-b9db-4285-a9d1-665045b4d168 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:51:04.417301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d61a76b1-b61d-4b28-b9d6-667f92b72496 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0327068ab564b05ac50b0efd4c61a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda701cc9bd24a8d909e1f8adf55c296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:04.428340 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d61a76b1-b61d-4b28-b9d6-667f92b72496 tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 200 len: 1306 microversion: 2.1 time: 0.189975 Aug 02 06:51:04.429652 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 635/1354] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:04 2022] GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 1306 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:04.470237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-76be25c3-42ac-4ea3-b7d7-510970bf229e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:04.470855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-76be25c3-42ac-4ea3-b7d7-510970bf229e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:04.479759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76be25c3-42ac-4ea3-b7d7-510970bf229e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:04.480282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76be25c3-42ac-4ea3-b7d7-510970bf229e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:04.481070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76be25c3-42ac-4ea3-b7d7-510970bf229e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:04.481600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76be25c3-42ac-4ea3-b7d7-510970bf229e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:04.646593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-76be25c3-42ac-4ea3-b7d7-510970bf229e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:04.656839 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-76be25c3-42ac-4ea3-b7d7-510970bf229e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1461 microversion: 2.1 time: 0.190939 Aug 02 06:51:04.657794 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 636/1355] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:04 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1461 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:04.663473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-be98abcd-fcfc-497a-9b37-f608c511f2c0 req-acbd448c-9248-45b9-ad54-4858aa8f4371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c976a871-9aa2-4330-9e0c-363aadd04223", "name": "network-vif-plugged", "status": "completed", "tag": "9b2e2b0e-a0fa-4b06-96ce-29c660765c8f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:04.677718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-be98abcd-fcfc-497a-9b37-f608c511f2c0 req-acbd448c-9248-45b9-ad54-4858aa8f4371 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:04.678134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-be98abcd-fcfc-497a-9b37-f608c511f2c0 req-acbd448c-9248-45b9-ad54-4858aa8f4371 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:04.695720 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-be98abcd-fcfc-497a-9b37-f608c511f2c0 req-acbd448c-9248-45b9-ad54-4858aa8f4371 service nova] Creating event network-vif-plugged:9b2e2b0e-a0fa-4b06-96ce-29c660765c8f for instance c976a871-9aa2-4330-9e0c-363aadd04223 on n-h1-851337-3 Aug 02 06:51:04.706736 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-be98abcd-fcfc-497a-9b37-f608c511f2c0 req-acbd448c-9248-45b9-ad54-4858aa8f4371 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046125 Aug 02 06:51:04.708432 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 637/1356] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:04.716771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b7437906-075c-4485-8b8c-f5633de63ed9 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:04.717971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b7437906-075c-4485-8b8c-f5633de63ed9 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:04.728175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7437906-075c-4485-8b8c-f5633de63ed9 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:04.728837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7437906-075c-4485-8b8c-f5633de63ed9 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:04.730037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7437906-075c-4485-8b8c-f5633de63ed9 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:04.730630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7437906-075c-4485-8b8c-f5633de63ed9 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:04.808521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b7437906-075c-4485-8b8c-f5633de63ed9 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:04.816844 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b7437906-075c-4485-8b8c-f5633de63ed9 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1276 microversion: 2.1 time: 0.106737 Aug 02 06:51:04.817962 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 638/1357] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:04 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1276 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:04.823595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aa82f528-9446-4fd5-8d8d-cdc6830c3ef7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:04.825213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aa82f528-9446-4fd5-8d8d-cdc6830c3ef7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:04.861446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa82f528-9446-4fd5-8d8d-cdc6830c3ef7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:04.862940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa82f528-9446-4fd5-8d8d-cdc6830c3ef7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:04.864252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa82f528-9446-4fd5-8d8d-cdc6830c3ef7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:04.864863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa82f528-9446-4fd5-8d8d-cdc6830c3ef7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:05.120762 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43e04bc8-95ab-4c26-9e27-1cc701218a3e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "DELETE /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 204 len: 0 microversion: 2.1 time: 0.838598 Aug 02 06:51:05.122209 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 720/1358] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:04 2022] DELETE /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:51:05.127553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5dec6a93-ca4d-4f01-a933-d27baf18a778 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:05.128587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5dec6a93-ca4d-4f01-a933-d27baf18a778 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:05.150881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dec6a93-ca4d-4f01-a933-d27baf18a778 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:05.151602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dec6a93-ca4d-4f01-a933-d27baf18a778 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:05.152554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dec6a93-ca4d-4f01-a933-d27baf18a778 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:05.153354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dec6a93-ca4d-4f01-a933-d27baf18a778 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:05.783405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aa82f528-9446-4fd5-8d8d-cdc6830c3ef7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:05.796707 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aa82f528-9446-4fd5-8d8d-cdc6830c3ef7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1461 microversion: 2.1 time: 0.974092 Aug 02 06:51:05.816064 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 639/1359] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:04 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1461 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:05.833163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fafbdc30-da6b-4a4e-b570-48b348d0bef1 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927af2b310>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:05.881836 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-fafbdc30-da6b-4a4e-b570-48b348d0bef1 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] HTTP exception thrown: Image not found. Aug 02 06:51:05.885027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5dec6a93-ca4d-4f01-a933-d27baf18a778 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fafbdc30-da6b-4a4e-b570-48b348d0bef1 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Request method failure captured: Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 HTTP/1.1 Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MkRT_Gzi9azaIgqLKO3ZzkzrAIZmJ20WQCzkqMJphisMLz1pRtSOTqSQiQGAIbzr6rZNAUGX5mFZL0y1d34yqcpYrjIRS2vhNDjPB94ZJ7CrDtvSOYYk5fEUZkNsAn40GJqczKMFA2OZkp4iwWw5nfWQGHMIRoc2k37RvjHR481nJ4 Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 59657b9384a5459982ab107427b52c49 Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesOneServerTestJSON-370216888 Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:51:05.886111 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:51:05.887860 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59657b9384a5459982ab107427b52c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59657b9384a5459982ab107427b52c49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59657b9384a5459982ab107427b52c49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59657b9384a5459982ab107427b52c49"}]}] Aug 02 06:51:05.887860 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesOneServerTestJSON-370216888 Aug 02 06:51:05.887860 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 59657b9384a5459982ab107427b52c49 Aug 02 06:51:05.887860 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-370216888 Aug 02 06:51:05.887860 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesOneServerTestJSON-370216888-project Aug 02 06:51:05.887860 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:51:05.887860 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:51:05.887860 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: ce9ac912dfe54f3783fa943de17bcef7 Aug 02 06:51:05.887860 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesOneServerTestJSON-370216888-project Aug 02 06:51:05.887860 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:51:05.887860 n-d-851337-3 devstack@n-api.service[126119]: exception: Image not found. Aug 02 06:51:05.887860 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '9598563a-bfde-4a86-af3e-b2d0774996f9'} Aug 02 06:51:05.887860 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:51:05.889221 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9598563a-bfde-4a86-af3e-b2d0774996f9 Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:51:05.890882 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9598563a-bfde-4a86-af3e-b2d0774996f9 could not be found. Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:51:05.893390 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:51:05.895195 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:05.900588 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5dec6a93-ca4d-4f01-a933-d27baf18a778 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1506 microversion: 2.1 time: 0.773814 Aug 02 06:51:05.900773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fafbdc30-da6b-4a4e-b570-48b348d0bef1 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Returning 404 to user: Image not found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:51:05.900773 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fafbdc30-da6b-4a4e-b570-48b348d0bef1 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 404 len: 62 microversion: 2.1 time: 0.081509 Aug 02 06:51:05.900773 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 640/1360] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:05 2022] GET /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:51:05.910374 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 721/1361] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:05 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1506 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:05.912194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2b9d8e93-7fbb-4ff1-af44-63eac7f33ed7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Action: 'create', calling method: .version_select at 0x7f928c299ee0>, body: {"keypair": {"name": "tempest-keypair-947657374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcWS/HWWgK5UO6V5JjAFAf/PlAL6WBIL7ynk3ZUxY+wwfMQnfswFzHVBoTryT8hx9Gri4n5eokX6Ea5IUy9j9Kp+EL1ddBo9fBfVX3GXlo66GXxSEH2k89xLDWU0DLdLA=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:05.915100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b371fbfe-6c36-4810-9efe-a1bf2544e39c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:05.916086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b371fbfe-6c36-4810-9efe-a1bf2544e39c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] [instance: 75ae3b2d-b9db-4285-a9d1-665045b4d168] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:05.941025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b371fbfe-6c36-4810-9efe-a1bf2544e39c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:05.949264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b371fbfe-6c36-4810-9efe-a1bf2544e39c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:05.951179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b371fbfe-6c36-4810-9efe-a1bf2544e39c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:05.952322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b371fbfe-6c36-4810-9efe-a1bf2544e39c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:05.973182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2b9d8e93-7fbb-4ff1-af44-63eac7f33ed7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Getting quotas for project 1e08c65240da4f90a190b2da77a8ff92. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:51:05.986438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2b9d8e93-7fbb-4ff1-af44-63eac7f33ed7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Getting quotas for user 87d1c9cb22d34aaa8b86860b84a1086d and project 1e08c65240da4f90a190b2da77a8ff92. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:51:05.994110 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-b371fbfe-6c36-4810-9efe-a1bf2544e39c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] HTTP exception thrown: Instance 75ae3b2d-b9db-4285-a9d1-665045b4d168 could not be found. Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b371fbfe-6c36-4810-9efe-a1bf2544e39c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Request method failure captured: Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 HTTP/1.1 Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiP0QH7i_IXK_4JWtYj3HrgwHLsXsGtff-Mc558oWyxLOMs39SkcY535RJSybe5b5I6ZUX77Rjwuk1nlC1mvc_DV8M2K2mc7F4t5W6mRuXQ5jz-P4SqXjiGZGpTEG_iI4wzNZlPyAagEm70iD4im2lOWSJ0djax-9JSk8M47fdG6l8 Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:51:06.000072 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:51:06.001831 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cda701cc9bd24a8d909e1f8adf55c296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cda701cc9bd24a8d909e1f8adf55c296"}]}] Aug 02 06:51:06.001831 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:51:06.001831 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: cda701cc9bd24a8d909e1f8adf55c296 Aug 02 06:51:06.001831 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-215470438 Aug 02 06:51:06.001831 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:51:06.001831 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:51:06.001831 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:51:06.001831 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: c0327068ab564b05ac50b0efd4c61a0f Aug 02 06:51:06.001831 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersOnMultiNodesTest-215470438-project Aug 02 06:51:06.001831 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:51:06.001831 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 75ae3b2d-b9db-4285-a9d1-665045b4d168 could not be found. Aug 02 06:51:06.001831 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '75ae3b2d-b9db-4285-a9d1-665045b4d168'} Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ae3b2d-b9db-4285-a9d1-665045b4d168 could not be found. Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:51:06.003198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ae3b2d-b9db-4285-a9d1-665045b4d168 could not be found. Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ae3b2d-b9db-4285-a9d1-665045b4d168 could not be found. Aug 02 06:51:06.004743 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:06.007046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b371fbfe-6c36-4810-9efe-a1bf2544e39c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] Returning 404 to user: Instance 75ae3b2d-b9db-4285-a9d1-665045b4d168 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:51:06.007046 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b371fbfe-6c36-4810-9efe-a1bf2544e39c tempest-ServersOnMultiNodesTest-215470438 tempest-ServersOnMultiNodesTest-215470438-project] 10.222.0.79 "GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168" status: 404 len: 111 microversion: 2.1 time: 0.101269 Aug 02 06:51:06.007648 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 641/1362] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:05 2022] GET /compute/v2.1/servers/75ae3b2d-b9db-4285-a9d1-665045b4d168 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:51:06.020401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-081a925c-e26f-42ae-9d45-fb63cd7abc67 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:06.023019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-081a925c-e26f-42ae-9d45-fb63cd7abc67 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:06.036152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-081a925c-e26f-42ae-9d45-fb63cd7abc67 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:06.040654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-081a925c-e26f-42ae-9d45-fb63cd7abc67 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:06.041850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-081a925c-e26f-42ae-9d45-fb63cd7abc67 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:06.047119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-081a925c-e26f-42ae-9d45-fb63cd7abc67 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:06.090669 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2b9d8e93-7fbb-4ff1-af44-63eac7f33ed7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.186426 Aug 02 06:51:06.092633 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 722/1363] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:51:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:06.112096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-008200d1-5ef2-4278-b8f4-d582690f9f27 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1606114524"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:06.122273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-008200d1-5ef2-4278-b8f4-d582690f9f27 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:06.147509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-008200d1-5ef2-4278-b8f4-d582690f9f27 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:06.152823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-008200d1-5ef2-4278-b8f4-d582690f9f27 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:06.155625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-008200d1-5ef2-4278-b8f4-d582690f9f27 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:06.158608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-008200d1-5ef2-4278-b8f4-d582690f9f27 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:06.219388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:06.233085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-081a925c-e26f-42ae-9d45-fb63cd7abc67 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:06.242198 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-081a925c-e26f-42ae-9d45-fb63cd7abc67 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1282 microversion: 2.1 time: 0.233221 Aug 02 06:51:06.246204 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 642/1364] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:06 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1282 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:06.696257 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-008200d1-5ef2-4278-b8f4-d582690f9f27 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "POST /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793/action" status: 202 len: 0 microversion: 2.1 time: 0.597902 Aug 02 06:51:06.699956 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 723/1365] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:51:06 2022] POST /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 02 06:51:06.710809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-abd17977-d4d8-4652-9479-0a0be37a2413 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927ade5700>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:06.800073 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-abd17977-d4d8-4652-9479-0a0be37a2413 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.093354 Aug 02 06:51:06.800769 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 643/1366] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:06 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:06.828011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-9428b15c-c0a5-4cc1-b50a-fca4420b91e6 req-679c9c15-5d86-4cae-8d06-502ac13dddf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a113f2-1afe-411d-9477-350acce2a793", "name": "network-vif-unplugged", "status": "completed", "tag": "31c431f1-495f-40ae-ba60-1586f6059b74"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:06.854662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9428b15c-c0a5-4cc1-b50a-fca4420b91e6 req-679c9c15-5d86-4cae-8d06-502ac13dddf5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:06.855094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9428b15c-c0a5-4cc1-b50a-fca4420b91e6 req-679c9c15-5d86-4cae-8d06-502ac13dddf5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:06.874021 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-9428b15c-c0a5-4cc1-b50a-fca4420b91e6 req-679c9c15-5d86-4cae-8d06-502ac13dddf5 service nova] Creating event network-vif-unplugged:31c431f1-495f-40ae-ba60-1586f6059b74 for instance 94a113f2-1afe-411d-9477-350acce2a793 on n-h1-851337-3 Aug 02 06:51:06.889232 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-9428b15c-c0a5-4cc1-b50a-fca4420b91e6 req-679c9c15-5d86-4cae-8d06-502ac13dddf5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065234 Aug 02 06:51:06.890139 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 724/1367] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:07.281416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-319b0917-2eba-4fe8-92fd-0dfcb568f427 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:07.284101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-319b0917-2eba-4fe8-92fd-0dfcb568f427 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:07.311014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-319b0917-2eba-4fe8-92fd-0dfcb568f427 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:07.311465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-319b0917-2eba-4fe8-92fd-0dfcb568f427 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:07.319042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-319b0917-2eba-4fe8-92fd-0dfcb568f427 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:07.319827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-319b0917-2eba-4fe8-92fd-0dfcb568f427 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:07.817732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-551e8c5e-c222-49b6-8360-fe0a1e680762 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f928c282820>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:07.909819 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-551e8c5e-c222-49b6-8360-fe0a1e680762 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.097860 Aug 02 06:51:07.910435 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 725/1368] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:07 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:08.192431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-319b0917-2eba-4fe8-92fd-0dfcb568f427 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:08.217415 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-319b0917-2eba-4fe8-92fd-0dfcb568f427 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1350 microversion: 2.1 time: 0.954392 Aug 02 06:51:08.219205 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 644/1369] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:07 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1350 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:08.649196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c3eef018-54dc-496f-bc34-06829a19f34b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:08.649864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c3eef018-54dc-496f-bc34-06829a19f34b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:08.673160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3eef018-54dc-496f-bc34-06829a19f34b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:08.678141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3eef018-54dc-496f-bc34-06829a19f34b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:08.680392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3eef018-54dc-496f-bc34-06829a19f34b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:08.681367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3eef018-54dc-496f-bc34-06829a19f34b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:08.732585 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-c3eef018-54dc-496f-bc34-06829a19f34b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] HTTP exception thrown: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c3eef018-54dc-496f-bc34-06829a19f34b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Request method failure captured: Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 HTTP/1.1 Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MinIgKrHTH_xSfanF2wFggnDR9YtG1Hw7-DcvlLCvMKeXv1MsXSfEpzYaR4sA6aYOpOPgPXyYk8p4jz3RikXusuAubl-Edohjmv_etaD88e7rXj7b6MJBQw3OPMJF0svj9xik4VeCKFfS0jMmh5hMRgATaMDI1D7kzctvCVB8jLyP8 Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 36057db08ef64298a219d1bf6388e06f Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2022593089 Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:51:08.734571 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:51:08.736202 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/36057db08ef64298a219d1bf6388e06f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/36057db08ef64298a219d1bf6388e06f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_36057db08ef64298a219d1bf6388e06f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/36057db08ef64298a219d1bf6388e06f"}]}] Aug 02 06:51:08.736202 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2022593089 Aug 02 06:51:08.736202 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 36057db08ef64298a219d1bf6388e06f Aug 02 06:51:08.736202 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2022593089 Aug 02 06:51:08.736202 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachSCSIVolumeTestJSON-2022593089-project Aug 02 06:51:08.736202 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:51:08.736202 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:51:08.736202 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: af91cd457125470fa8f4fbbd628c5d82 Aug 02 06:51:08.736202 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2022593089-project Aug 02 06:51:08.736202 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:51:08.736202 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:51:08.736202 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '69991b6b-468d-45c0-b658-297b210ae988'} Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:51:08.737125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:51:08.738631 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:08.741510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c3eef018-54dc-496f-bc34-06829a19f34b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Returning 404 to user: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:51:08.746501 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c3eef018-54dc-496f-bc34-06829a19f34b tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "DELETE /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 404 len: 111 microversion: 2.1 time: 0.101407 Aug 02 06:51:08.747667 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 645/1370] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:51:08 2022] DELETE /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:51:08.762474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8a510475-0984-4cd6-a07e-cbd87720120a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:08.763290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8a510475-0984-4cd6-a07e-cbd87720120a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] [instance: 69991b6b-468d-45c0-b658-297b210ae988] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:08.789297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a510475-0984-4cd6-a07e-cbd87720120a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:08.792730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a510475-0984-4cd6-a07e-cbd87720120a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:08.795096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a510475-0984-4cd6-a07e-cbd87720120a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:08.795947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a510475-0984-4cd6-a07e-cbd87720120a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:08.811625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-886784d7-a1dc-445b-9e3e-afe948883870 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Action: 'create', calling method: .version_select at 0x7f928c330430>, body: {"keypair": {"name": "tempest-keypair-768242891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT4AenS8a8Fe4/yfExjKEeNMWF7y1D9D7em2Y60pIGkx4XwFNGnpFN7sZ58g2CGfw/CyuTmfEY45D9F/6GJROMYe/pqtoTDLA+gAmr80fSChihJjDNE5Oaq6XWTLicvOA=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:08.825263 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-8a510475-0984-4cd6-a07e-cbd87720120a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] HTTP exception thrown: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8a510475-0984-4cd6-a07e-cbd87720120a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Request method failure captured: Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 HTTP/1.1 Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MinIgKrHTH_xSfanF2wFggnDR9YtG1Hw7-DcvlLCvMKeXv1MsXSfEpzYaR4sA6aYOpOPgPXyYk8p4jz3RikXusuAubl-Edohjmv_etaD88e7rXj7b6MJBQw3OPMJF0svj9xik4VeCKFfS0jMmh5hMRgATaMDI1D7kzctvCVB8jLyP8 Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 36057db08ef64298a219d1bf6388e06f Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2022593089 Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:51:08.827485 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:51:08.829164 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/36057db08ef64298a219d1bf6388e06f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/36057db08ef64298a219d1bf6388e06f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_36057db08ef64298a219d1bf6388e06f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/36057db08ef64298a219d1bf6388e06f"}]}] Aug 02 06:51:08.829164 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2022593089 Aug 02 06:51:08.829164 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 36057db08ef64298a219d1bf6388e06f Aug 02 06:51:08.829164 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2022593089 Aug 02 06:51:08.829164 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachSCSIVolumeTestJSON-2022593089-project Aug 02 06:51:08.829164 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:51:08.829164 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:51:08.829164 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: af91cd457125470fa8f4fbbd628c5d82 Aug 02 06:51:08.829164 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2022593089-project Aug 02 06:51:08.829164 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:51:08.829164 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:51:08.829164 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '69991b6b-468d-45c0-b658-297b210ae988'} Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:51:08.830310 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. Aug 02 06:51:08.831800 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:08.834356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8a510475-0984-4cd6-a07e-cbd87720120a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] Returning 404 to user: Instance 69991b6b-468d-45c0-b658-297b210ae988 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:51:08.836479 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8a510475-0984-4cd6-a07e-cbd87720120a tempest-AttachSCSIVolumeTestJSON-2022593089 tempest-AttachSCSIVolumeTestJSON-2022593089-project] 10.222.0.79 "GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988" status: 404 len: 111 microversion: 2.1 time: 0.084199 Aug 02 06:51:08.838529 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 646/1371] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:08 2022] GET /compute/v2.1/servers/69991b6b-468d-45c0-b658-297b210ae988 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:51:08.880515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-886784d7-a1dc-445b-9e3e-afe948883870 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Getting quotas for project d7ee242495424ef7b1b69b3587825949. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:51:08.905707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-886784d7-a1dc-445b-9e3e-afe948883870 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Getting quotas for user 0fab1cad29b94aef8f0435a65e668720 and project d7ee242495424ef7b1b69b3587825949. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:51:08.926348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-25293143-6224-4394-8dcc-012c3d3468e0 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927ad840d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:08.976605 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-886784d7-a1dc-445b-9e3e-afe948883870 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.699976 Aug 02 06:51:08.986519 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 726/1372] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:51:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:09.004292 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-25293143-6224-4394-8dcc-012c3d3468e0 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.082868 Aug 02 06:51:09.007716 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 647/1373] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:08 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:09.104635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c892f67d-33a2-4eff-aa52-3c29ffa8e8da tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2b002be5-587a-412e-a7cc-a200ebac78ba"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:09.107216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c892f67d-33a2-4eff-aa52-3c29ffa8e8da tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:09.128504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c892f67d-33a2-4eff-aa52-3c29ffa8e8da tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:09.129251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c892f67d-33a2-4eff-aa52-3c29ffa8e8da tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:09.130661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c892f67d-33a2-4eff-aa52-3c29ffa8e8da tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:09.134610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c892f67d-33a2-4eff-aa52-3c29ffa8e8da tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:09.226998 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-c892f67d-33a2-4eff-aa52-3c29ffa8e8da tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] HTTP exception thrown: Volume 4a139d9d-231c-4e04-bcb4-bf14771650ee could not be found. Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c892f67d-33a2-4eff-aa52-3c29ffa8e8da tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] Request method failure captured: Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: request: PUT /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157/os-volume_attachments/4a139d9d-231c-4e04-bcb4-bf14771650ee HTTP/1.1 Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 74 Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MjER5zEX7wYt-M-mwuNAKZzij98yWl4LwNW5wCDw_hRVEuv5ZGhs5WNJeyQaeirfARL4geY2-JIBGmKslwh8-F-hP8ABUF0egLXljoSbt_n8gSmXRdlN_xBjiPbDNbmm8FoDxKMCZpu8Zx01jo2yehvaTME9d6esr3JCcND1ngK4Sk Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 4eaf1d07ee7348ef84dbd197b75f9d18 Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-VolumesAdminNegativeTest-1288987858 Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 06:51:09.231020 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 06:51:09.234276 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4eaf1d07ee7348ef84dbd197b75f9d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eaf1d07ee7348ef84dbd197b75f9d18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4eaf1d07ee7348ef84dbd197b75f9d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eaf1d07ee7348ef84dbd197b75f9d18"}]}] Aug 02 06:51:09.234276 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-VolumesAdminNegativeTest-1288987858 Aug 02 06:51:09.234276 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 4eaf1d07ee7348ef84dbd197b75f9d18 Aug 02 06:51:09.234276 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1288987858 Aug 02 06:51:09.234276 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-VolumesAdminNegativeTest-1288987858-project-admin Aug 02 06:51:09.234276 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:51:09.234276 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:51:09.234276 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: d5cd643585c94d5e945098abe8eebd72 Aug 02 06:51:09.234276 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-VolumesAdminNegativeTest-1288987858-project-admin Aug 02 06:51:09.234276 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:51:09.234276 n-d-851337-3 devstack@n-api.service[126120]: {"volumeAttachment": {"volumeId": "2b002be5-587a-412e-a7cc-a200ebac78ba"}} Aug 02 06:51:09.234276 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:51:09.234276 n-d-851337-3 devstack@n-api.service[126120]: exception: Volume 4a139d9d-231c-4e04-bcb4-bf14771650ee could not be found. Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'server_id': 'a6c0d87b-6113-4acd-8d91-d0d75d8a6157', 'id': '4a139d9d-231c-4e04-bcb4-bf14771650ee', 'body': {'volumeAttachment': {'volumeId': '2b002be5-587a-412e-a7cc-a200ebac78ba'}}} Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 06:51:09.235344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4a139d9d-231c-4e04-bcb4-bf14771650ee could not be found. (HTTP 404) (Request-ID: req-f55c305b-9ab1-46f4-b901-619a962a1ff7) Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 06:51:09.236684 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4a139d9d-231c-4e04-bcb4-bf14771650ee could not be found. Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:51:09.238107 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4a139d9d-231c-4e04-bcb4-bf14771650ee could not be found. Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4a139d9d-231c-4e04-bcb4-bf14771650ee could not be found. Aug 02 06:51:09.239513 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:09.241062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d74a8aa3-9816-49a9-88ea-fb7c0b67360c tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:09.241062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d74a8aa3-9816-49a9-88ea-fb7c0b67360c tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:09.242633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c892f67d-33a2-4eff-aa52-3c29ffa8e8da tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] Returning 404 to user: Volume 4a139d9d-231c-4e04-bcb4-bf14771650ee could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:51:09.243896 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c892f67d-33a2-4eff-aa52-3c29ffa8e8da tempest-VolumesAdminNegativeTest-1288987858 tempest-VolumesAdminNegativeTest-1288987858-project-admin] 10.222.0.79 "PUT /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157/os-volume_attachments/4a139d9d-231c-4e04-bcb4-bf14771650ee" status: 404 len: 109 microversion: 2.1 time: 0.143553 Aug 02 06:51:09.251337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d74a8aa3-9816-49a9-88ea-fb7c0b67360c tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:09.251890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d74a8aa3-9816-49a9-88ea-fb7c0b67360c tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:09.252881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d74a8aa3-9816-49a9-88ea-fb7c0b67360c tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:09.253402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d74a8aa3-9816-49a9-88ea-fb7c0b67360c tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:09.261927 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 727/1374] 10.222.0.79 () {60 vars in 1433 bytes} [Tue Aug 2 06:51:09 2022] PUT /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157/os-volume_attachments/4a139d9d-231c-4e04-bcb4-bf14771650ee => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:51:10.021612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cf4c0714-3971-4ffd-9b5c-efba79cb54f7 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f928c22ca60>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:10.112376 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cf4c0714-3971-4ffd-9b5c-efba79cb54f7 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.095158 Aug 02 06:51:10.126497 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 728/1375] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:10 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:10.318956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-da943358-470a-4b91-9397-f6b4b07de36c tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Calling method '.version_select at 0x7f928c352940>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:10.323058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-da943358-470a-4b91-9397-f6b4b07de36c tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:10.323518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-da943358-470a-4b91-9397-f6b4b07de36c tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:10.352583 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-da943358-470a-4b91-9397-f6b4b07de36c tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.037545 Aug 02 06:51:10.364643 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 729/1376] 10.222.0.79 () {58 vars in 1143 bytes} [Tue Aug 2 06:51:10 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:10.394863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0e84f8f3-a86e-431b-af38-95ff98daf5e7 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:10.407705 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0e84f8f3-a86e-431b-af38-95ff98daf5e7 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014483 Aug 02 06:51:10.409430 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 730/1377] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:51:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:10.452291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1ad58eb7-0802-4af3-97a0-b72dd4a9dff5 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-43464346", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:10.460481 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:51:10.460481 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:51:10.533815 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1ad58eb7-0802-4af3-97a0-b72dd4a9dff5 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 497 microversion: 2.1 time: 0.111305 Aug 02 06:51:10.540019 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 731/1378] 10.222.0.79 () {60 vars in 1146 bytes} [Tue Aug 2 06:51:10 2022] POST /compute/v2.1/flavors => generated 497 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:10.567108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6a7d3fe1-b684-48e5-94b6-144a410dfd4d tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:10.620683 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6a7d3fe1-b684-48e5-94b6-144a410dfd4d tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.066968 Aug 02 06:51:10.624915 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 732/1379] 10.222.0.79 () {58 vars in 1182 bytes} [Tue Aug 2 06:51:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:51:10.769661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-208e651c-08d0-4841-8485-7318e140e172 req-9af607c5-a7b9-4e87-97e3-b793390dd983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b003bc53-efff-4972-b91f-708548e21cdc", "tag": "cc670dfd-7324-4c85-af7b-b8939618558c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:10.792558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-208e651c-08d0-4841-8485-7318e140e172 req-9af607c5-a7b9-4e87-97e3-b793390dd983 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:10.793943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-208e651c-08d0-4841-8485-7318e140e172 req-9af607c5-a7b9-4e87-97e3-b793390dd983 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:10.844658 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-208e651c-08d0-4841-8485-7318e140e172 req-9af607c5-a7b9-4e87-97e3-b793390dd983 service nova] Creating event network-changed:cc670dfd-7324-4c85-af7b-b8939618558c for instance b003bc53-efff-4972-b91f-708548e21cdc on n-h2-851337-3 Aug 02 06:51:10.868930 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-208e651c-08d0-4841-8485-7318e140e172 req-9af607c5-a7b9-4e87-97e3-b793390dd983 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099462 Aug 02 06:51:10.871443 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 733/1380] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:10.895050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1232450434", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "47937a84-20ae-42cf-9c27-72f4a9a26a4d"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:10.932054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d74a8aa3-9816-49a9-88ea-fb7c0b67360c tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:10.938017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:10.954224 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d74a8aa3-9816-49a9-88ea-fb7c0b67360c tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1350 microversion: 2.1 time: 1.711068 Aug 02 06:51:10.956677 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 648/1381] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:09 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1350 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:11.029380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:51:11.128762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1839e8c4-341b-4892-926d-2175bd0461e3 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927ae20310>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:11.623778 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1839e8c4-341b-4892-926d-2175bd0461e3 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.499534 Aug 02 06:51:11.624367 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 649/1382] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:11 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:11.976272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3feb6e31-8cd1-475f-b7ee-8e14b29b4727 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:11.977645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3feb6e31-8cd1-475f-b7ee-8e14b29b4727 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:11.990414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3feb6e31-8cd1-475f-b7ee-8e14b29b4727 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:11.990911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3feb6e31-8cd1-475f-b7ee-8e14b29b4727 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:11.991700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3feb6e31-8cd1-475f-b7ee-8e14b29b4727 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:11.992136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3feb6e31-8cd1-475f-b7ee-8e14b29b4727 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:12.211265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:12.280707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:12.363348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:51:12.364521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:51:12.365216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:51:12.365956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:51:12.366718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:51:12.381646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:12.382408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:12.383428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:12.384031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:12.446839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Getting quotas for project 1e08c65240da4f90a190b2da77a8ff92. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:51:12.455706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Getting quotas for user 87d1c9cb22d34aaa8b86860b84a1086d and project 1e08c65240da4f90a190b2da77a8ff92. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:51:12.483726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:51:12.488348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:51:12.551675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3feb6e31-8cd1-475f-b7ee-8e14b29b4727 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:12.567171 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3feb6e31-8cd1-475f-b7ee-8e14b29b4727 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1350 microversion: 2.1 time: 0.595587 Aug 02 06:51:12.574148 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 650/1383] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:11 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1350 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:12.580607 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1df11d4f-19b3-44be-a473-18338ca687fd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.693938 Aug 02 06:51:12.581260 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 734/1384] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:51:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:51:12.599002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4cef3bce-9256-453e-9c8c-4b059bb48495 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:12.602623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4cef3bce-9256-453e-9c8c-4b059bb48495 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:12.641466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e3a2abcb-78b6-4432-adeb-ee34af6249ac tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927aac6550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:12.719405 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e3a2abcb-78b6-4432-adeb-ee34af6249ac tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.083065 Aug 02 06:51:12.729069 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 735/1385] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:12 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:12.980447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2122983526", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f696754e-9e3d-48a0-95ab-5dad15be18b8"}], "security_groups": [{"name": "tempest-securitygroup--559201857"}], "key_name": "tempest-keypair-768242891", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:13.239378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4cef3bce-9256-453e-9c8c-4b059bb48495 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:13.249120 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4cef3bce-9256-453e-9c8c-4b059bb48495 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1279 microversion: 2.1 time: 0.655251 Aug 02 06:51:13.250389 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 651/1386] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:12 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1279 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:13.491457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] validate_networks() for [('f696754e-9e3d-48a0-95ab-5dad15be18b8', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:51:13.527727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-399b9698-bb22-449b-9c01-5075d904e24c req-02ad3c83-f8d1-4059-ac7f-82665c01a39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a113f2-1afe-411d-9477-350acce2a793", "name": "network-vif-plugged", "status": "completed", "tag": "31c431f1-495f-40ae-ba60-1586f6059b74"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:13.555726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-399b9698-bb22-449b-9c01-5075d904e24c req-02ad3c83-f8d1-4059-ac7f-82665c01a39a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:13.556532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-399b9698-bb22-449b-9c01-5075d904e24c req-02ad3c83-f8d1-4059-ac7f-82665c01a39a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:13.598421 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-399b9698-bb22-449b-9c01-5075d904e24c req-02ad3c83-f8d1-4059-ac7f-82665c01a39a service nova] Creating event network-vif-plugged:31c431f1-495f-40ae-ba60-1586f6059b74 for instance 94a113f2-1afe-411d-9477-350acce2a793 on n-h1-851337-3 Aug 02 06:51:13.614244 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-399b9698-bb22-449b-9c01-5075d904e24c req-02ad3c83-f8d1-4059-ac7f-82665c01a39a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090227 Aug 02 06:51:13.615404 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 652/1387] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:13.623795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-790f7d9b-8a78-4f7c-96d2-9929eeb72be1 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927ad84040>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:13.707869 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-790f7d9b-8a78-4f7c-96d2-9929eeb72be1 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/55d088dd-5057-45c8-b81c-3a1fd76bfa04" status: 200 len: 661 microversion: 2.1 time: 0.090938 Aug 02 06:51:13.708627 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 653/1388] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:13 2022] GET /compute/v2.1/images/55d088dd-5057-45c8-b81c-3a1fd76bfa04 => generated 661 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:13.716274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8868adba-16a2-449e-91d6-df7aaf8c3b47 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:13.717396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8868adba-16a2-449e-91d6-df7aaf8c3b47 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:13.725079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8868adba-16a2-449e-91d6-df7aaf8c3b47 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:13.725763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8868adba-16a2-449e-91d6-df7aaf8c3b47 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:13.726967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8868adba-16a2-449e-91d6-df7aaf8c3b47 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:13.727674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8868adba-16a2-449e-91d6-df7aaf8c3b47 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:14.231767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8868adba-16a2-449e-91d6-df7aaf8c3b47 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:14.242676 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8868adba-16a2-449e-91d6-df7aaf8c3b47 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1350 microversion: 2.1 time: 0.530188 Aug 02 06:51:14.244544 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 654/1389] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:13 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1350 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:14.252471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5a2872c7-9e35-4976-864a-71804634f403 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927ad84280>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:14.327361 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5a2872c7-9e35-4976-864a-71804634f403 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/55d088dd-5057-45c8-b81c-3a1fd76bfa04" status: 200 len: 661 microversion: 2.1 time: 0.080377 Aug 02 06:51:14.328060 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 655/1390] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:14 2022] GET /compute/v2.1/images/55d088dd-5057-45c8-b81c-3a1fd76bfa04 => generated 661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:14.332839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-51441084-5c09-48c4-8735-0b3027098a12 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927ad84820>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:14.407115 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-51441084-5c09-48c4-8735-0b3027098a12 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.076911 Aug 02 06:51:14.407875 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 656/1391] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:14 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:14.417914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-95983d16-b57e-44db-bce5-d6f5115a254a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:14.423028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-95983d16-b57e-44db-bce5-d6f5115a254a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:14.444041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95983d16-b57e-44db-bce5-d6f5115a254a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:14.444498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95983d16-b57e-44db-bce5-d6f5115a254a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:14.450081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95983d16-b57e-44db-bce5-d6f5115a254a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:14.451298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95983d16-b57e-44db-bce5-d6f5115a254a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:14.613434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-95983d16-b57e-44db-bce5-d6f5115a254a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:14.622685 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-95983d16-b57e-44db-bce5-d6f5115a254a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1331 microversion: 2.1 time: 0.213513 Aug 02 06:51:14.623942 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 657/1392] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:14 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1331 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:15.006927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d8a70886-92f5-4376-b7fc-7ee6067c0a16 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:15.007699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d8a70886-92f5-4376-b7fc-7ee6067c0a16 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:15.015270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8a70886-92f5-4376-b7fc-7ee6067c0a16 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:15.015857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8a70886-92f5-4376-b7fc-7ee6067c0a16 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:15.016668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8a70886-92f5-4376-b7fc-7ee6067c0a16 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:15.017184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8a70886-92f5-4376-b7fc-7ee6067c0a16 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:15.051950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d8a70886-92f5-4376-b7fc-7ee6067c0a16 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:51:15.201336 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d8a70886-92f5-4376-b7fc-7ee6067c0a16 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 204 len: 0 microversion: 2.1 time: 0.197645 Aug 02 06:51:15.202597 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 658/1393] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:51:15 2022] DELETE /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 06:51:15.217853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f05e4326-389f-4ab1-adfe-d1ec4ea0c264 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:15.220445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f05e4326-389f-4ab1-adfe-d1ec4ea0c264 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:15.229832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f05e4326-389f-4ab1-adfe-d1ec4ea0c264 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:15.231163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f05e4326-389f-4ab1-adfe-d1ec4ea0c264 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:15.232188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f05e4326-389f-4ab1-adfe-d1ec4ea0c264 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:15.232940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f05e4326-389f-4ab1-adfe-d1ec4ea0c264 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:15.422095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Getting quotas for project d7ee242495424ef7b1b69b3587825949. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:51:15.429618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Getting quotas for user 0fab1cad29b94aef8f0435a65e668720 and project d7ee242495424ef7b1b69b3587825949. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:51:15.448122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f05e4326-389f-4ab1-adfe-d1ec4ea0c264 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:15.452407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:51:15.453039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:51:15.454527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:51:15.455227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:51:15.455820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:51:15.460964 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f05e4326-389f-4ab1-adfe-d1ec4ea0c264 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1512 microversion: 2.1 time: 0.249567 Aug 02 06:51:15.462579 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 659/1394] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:15 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:15.468205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d269148b-c822-41f8-b270-e4deb0044c73 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:15.468843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d269148b-c822-41f8-b270-e4deb0044c73 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:15.469496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:15.470153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:15.471119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:15.472188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:15.490846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d269148b-c822-41f8-b270-e4deb0044c73 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:15.491320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d269148b-c822-41f8-b270-e4deb0044c73 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:15.496646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d269148b-c822-41f8-b270-e4deb0044c73 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:15.500591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d269148b-c822-41f8-b270-e4deb0044c73 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:15.513928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Getting quotas for project d7ee242495424ef7b1b69b3587825949. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:51:15.522928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Getting quotas for user 0fab1cad29b94aef8f0435a65e668720 and project d7ee242495424ef7b1b69b3587825949. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:51:15.556009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:51:15.567059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:51:15.707570 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-16e268c5-681f-4cf6-a11d-721c5a450d94 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.726876 Aug 02 06:51:15.708363 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 736/1395] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:51:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 2734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 06:51:15.728367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-029f4281-af05-44db-9c36-0fa10e9db613 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f928c33a310>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:15.821665 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-029f4281-af05-44db-9c36-0fa10e9db613 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.105287 Aug 02 06:51:15.829412 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 737/1396] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:15 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:15.836639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ad1faa13-9157-4baa-8872-848943844f64 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:15.836837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d269148b-c822-41f8-b270-e4deb0044c73 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:15.847367 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d269148b-c822-41f8-b270-e4deb0044c73 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1350 microversion: 2.1 time: 0.383682 Aug 02 06:51:15.848280 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 660/1397] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:15 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1350 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:15.851351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ad1faa13-9157-4baa-8872-848943844f64 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:15.855380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d659e1ad-f1e4-431c-ba6d-f345870ae3bc tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:15.855992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d659e1ad-f1e4-431c-ba6d-f345870ae3bc tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:15.878477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad1faa13-9157-4baa-8872-848943844f64 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:15.878941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad1faa13-9157-4baa-8872-848943844f64 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:15.879754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad1faa13-9157-4baa-8872-848943844f64 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:15.880546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad1faa13-9157-4baa-8872-848943844f64 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:16.029368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d659e1ad-f1e4-431c-ba6d-f345870ae3bc tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:16.039964 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d659e1ad-f1e4-431c-ba6d-f345870ae3bc tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1269 microversion: 2.1 time: 0.190256 Aug 02 06:51:16.040560 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 661/1398] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:15 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1269 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:16.092204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3bc6f949-ecd1-476e-8ab6-a50f34e946b8 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927ae1c550>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:16.141002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ad1faa13-9157-4baa-8872-848943844f64 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:16.156309 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ad1faa13-9157-4baa-8872-848943844f64 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1337 microversion: 2.1 time: 0.323953 Aug 02 06:51:16.159832 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 738/1399] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:15 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1337 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:16.162955 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3bc6f949-ecd1-476e-8ab6-a50f34e946b8 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/caba34ca-707a-4fe1-9524-43057886e856" status: 200 len: 661 microversion: 2.1 time: 0.093837 Aug 02 06:51:16.163529 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 662/1400] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:16 2022] GET /compute/v2.1/images/caba34ca-707a-4fe1-9524-43057886e856 => generated 661 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:16.185230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e49aabbb-32bb-4f57-9ebf-99d5867f85e0 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927aa97e50>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:16.236229 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e49aabbb-32bb-4f57-9ebf-99d5867f85e0 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/caba34ca-707a-4fe1-9524-43057886e856" status: 200 len: 661 microversion: 2.1 time: 0.055504 Aug 02 06:51:16.236828 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 739/1401] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:16 2022] GET /compute/v2.1/images/caba34ca-707a-4fe1-9524-43057886e856 => generated 661 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:16.483260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bb14b39e-1b80-4aa5-9b90-306802e392f5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:16.484649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bb14b39e-1b80-4aa5-9b90-306802e392f5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:16.498750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb14b39e-1b80-4aa5-9b90-306802e392f5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:16.499352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb14b39e-1b80-4aa5-9b90-306802e392f5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:16.500728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb14b39e-1b80-4aa5-9b90-306802e392f5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:16.501274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb14b39e-1b80-4aa5-9b90-306802e392f5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:16.844148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e27a8d9c-41f4-4fb1-942d-f44b8cda3571 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927aa97ee0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:16.927925 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e27a8d9c-41f4-4fb1-942d-f44b8cda3571 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.087666 Aug 02 06:51:16.932631 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 740/1402] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:16 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:16.944166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f30c8e41-9b06-4b9c-8567-8f7b1418fd1f tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:16.954894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f30c8e41-9b06-4b9c-8567-8f7b1418fd1f tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:16.964475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f30c8e41-9b06-4b9c-8567-8f7b1418fd1f tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:16.965298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f30c8e41-9b06-4b9c-8567-8f7b1418fd1f tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:16.966580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f30c8e41-9b06-4b9c-8567-8f7b1418fd1f tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:16.967191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f30c8e41-9b06-4b9c-8567-8f7b1418fd1f tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:17.097064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bb14b39e-1b80-4aa5-9b90-306802e392f5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:17.108199 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bb14b39e-1b80-4aa5-9b90-306802e392f5 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1512 microversion: 2.1 time: 0.629275 Aug 02 06:51:17.110272 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 663/1403] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:16 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1512 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:17.116377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-82c9433d-84bd-4e9d-b377-6f5e957ac67d tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:17.117334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-82c9433d-84bd-4e9d-b377-6f5e957ac67d tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:17.125714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82c9433d-84bd-4e9d-b377-6f5e957ac67d tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:17.126523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82c9433d-84bd-4e9d-b377-6f5e957ac67d tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:17.127705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82c9433d-84bd-4e9d-b377-6f5e957ac67d tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:17.128368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82c9433d-84bd-4e9d-b377-6f5e957ac67d tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:17.232420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-82c9433d-84bd-4e9d-b377-6f5e957ac67d tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:17.242035 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-82c9433d-84bd-4e9d-b377-6f5e957ac67d tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1321 microversion: 2.1 time: 0.130156 Aug 02 06:51:17.242744 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 664/1404] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:17 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1321 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:17.249067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-307f48a4-ed15-469d-8050-2d93b8d57039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:17.249910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-307f48a4-ed15-469d-8050-2d93b8d57039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:17.257606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-307f48a4-ed15-469d-8050-2d93b8d57039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:17.258115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-307f48a4-ed15-469d-8050-2d93b8d57039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:17.259087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-307f48a4-ed15-469d-8050-2d93b8d57039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:17.259697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-307f48a4-ed15-469d-8050-2d93b8d57039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:17.526273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f30c8e41-9b06-4b9c-8567-8f7b1418fd1f tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:17.544504 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f30c8e41-9b06-4b9c-8567-8f7b1418fd1f tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1350 microversion: 2.1 time: 0.604685 Aug 02 06:51:17.560974 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 741/1405] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:16 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1350 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:17.945202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-643e25f5-6a8a-4d25-8c6c-961decde6d27 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927aa97550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:18.057350 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-643e25f5-6a8a-4d25-8c6c-961decde6d27 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/374cb39f-aed6-455a-a979-e34f73a15880" status: 200 len: 662 microversion: 2.1 time: 0.118636 Aug 02 06:51:18.058816 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 742/1406] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:17 2022] GET /compute/v2.1/images/374cb39f-aed6-455a-a979-e34f73a15880 => generated 662 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:18.081062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-307f48a4-ed15-469d-8050-2d93b8d57039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:18.093293 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-307f48a4-ed15-469d-8050-2d93b8d57039 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1379 microversion: 2.1 time: 0.848751 Aug 02 06:51:18.097648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-60c01f48-d2ee-4dcd-926c-04d321a5074b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f928c343550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:18.100251 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 665/1407] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:17 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1379 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:18.124592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1c5893be-afe9-4080-857e-4a7667aed987 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927ae1cf70>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:18.217237 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-60c01f48-d2ee-4dcd-926c-04d321a5074b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.156751 Aug 02 06:51:18.217834 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 743/1408] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:18 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:18.233650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e9c1633f-3969-460e-a348-34cc8fee97ef tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:18.234516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e9c1633f-3969-460e-a348-34cc8fee97ef tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:18.244052 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1c5893be-afe9-4080-857e-4a7667aed987 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/374cb39f-aed6-455a-a979-e34f73a15880" status: 200 len: 662 microversion: 2.1 time: 0.142457 Aug 02 06:51:18.244861 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 666/1409] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:18 2022] GET /compute/v2.1/images/374cb39f-aed6-455a-a979-e34f73a15880 => generated 662 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:18.265695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:18.268425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8297d0c4-2215-4c5b-99a5-85058b431a9e tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:18.272347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8297d0c4-2215-4c5b-99a5-85058b431a9e tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:18.280189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9c1633f-3969-460e-a348-34cc8fee97ef tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:18.282554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9c1633f-3969-460e-a348-34cc8fee97ef tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:18.283578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9c1633f-3969-460e-a348-34cc8fee97ef tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:18.285704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9c1633f-3969-460e-a348-34cc8fee97ef tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:18.292277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8297d0c4-2215-4c5b-99a5-85058b431a9e tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:18.293113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8297d0c4-2215-4c5b-99a5-85058b431a9e tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:18.294147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8297d0c4-2215-4c5b-99a5-85058b431a9e tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:18.294741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8297d0c4-2215-4c5b-99a5-85058b431a9e tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:18.535237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8297d0c4-2215-4c5b-99a5-85058b431a9e tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:18.536654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e9c1633f-3969-460e-a348-34cc8fee97ef tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:18.544914 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e9c1633f-3969-460e-a348-34cc8fee97ef tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 200 len: 1470 microversion: 2.1 time: 0.324816 Aug 02 06:51:18.549231 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8297d0c4-2215-4c5b-99a5-85058b431a9e tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1327 microversion: 2.1 time: 0.288705 Aug 02 06:51:18.549584 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 744/1410] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:18 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 1470 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:18.567857 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 667/1411] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:18 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1327 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:18.569037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1720044972", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:18.579237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e874745d-930a-48c0-9cc3-2e3d4ce00760 req-870e0923-9a2e-4141-b7d6-bc020ebea6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c0d87b-6113-4acd-8d91-d0d75d8a6157", "name": "network-vif-deleted", "tag": "a1a37f29-a08b-4598-92e1-d377587f42f1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:18.612820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e874745d-930a-48c0-9cc3-2e3d4ce00760 req-870e0923-9a2e-4141-b7d6-bc020ebea6b7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:18.614338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e874745d-930a-48c0-9cc3-2e3d4ce00760 req-870e0923-9a2e-4141-b7d6-bc020ebea6b7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:18.666028 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e874745d-930a-48c0-9cc3-2e3d4ce00760 req-870e0923-9a2e-4141-b7d6-bc020ebea6b7 service nova] Creating event network-vif-deleted:a1a37f29-a08b-4598-92e1-d377587f42f1 for instance a6c0d87b-6113-4acd-8d91-d0d75d8a6157 on n-h2-851337-3 Aug 02 06:51:18.685464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:51:18.702445 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e874745d-930a-48c0-9cc3-2e3d4ce00760 req-870e0923-9a2e-4141-b7d6-bc020ebea6b7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129211 Aug 02 06:51:18.706559 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 668/1412] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:18.718305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7d2acef6-f4bc-42af-a64e-627ac2550f72 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:18.719424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7d2acef6-f4bc-42af-a64e-627ac2550f72 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:18.730110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d2acef6-f4bc-42af-a64e-627ac2550f72 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:18.730917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d2acef6-f4bc-42af-a64e-627ac2550f72 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:18.731931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d2acef6-f4bc-42af-a64e-627ac2550f72 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:18.732526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d2acef6-f4bc-42af-a64e-627ac2550f72 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:19.592173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7d2acef6-f4bc-42af-a64e-627ac2550f72 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:19.606529 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7d2acef6-f4bc-42af-a64e-627ac2550f72 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1350 microversion: 2.1 time: 0.895724 Aug 02 06:51:19.608511 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 669/1413] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:18 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1350 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:19.619384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fde9473d-4e9a-43c3-86d9-4f1403747ff3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:19.620854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fde9473d-4e9a-43c3-86d9-4f1403747ff3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:19.631749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fde9473d-4e9a-43c3-86d9-4f1403747ff3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:19.632460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fde9473d-4e9a-43c3-86d9-4f1403747ff3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:19.633413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fde9473d-4e9a-43c3-86d9-4f1403747ff3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:19.633992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fde9473d-4e9a-43c3-86d9-4f1403747ff3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:19.654826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:51:19.654826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:51:19.655581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:51:19.655581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:51:19.655979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:51:19.665049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=31 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:19.666837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:19.667531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:19.668541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:19.669149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:19.688689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Getting quotas for project aae511cbb16247e1aa14cfe1c0d285bd. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:51:19.694895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Getting quotas for user b857b54177bd4b9b9128a28d93ab6610 and project aae511cbb16247e1aa14cfe1c0d285bd. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:51:19.710395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:51:19.712913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: 6e35b665-80f8-4add-8c4f-edeb762a78fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:51:19.781623 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6db66b92-2275-4d15-80f8-17d93cd31041 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.229496 Aug 02 06:51:19.782687 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 745/1414] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:51:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:51:19.805209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0b43db09-788e-47e4-80e6-11801b446dde tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927aa97af0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:19.899735 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0b43db09-788e-47e4-80e6-11801b446dde tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.115734 Aug 02 06:51:19.907194 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 746/1415] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:19 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:19.918164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-8ab31aac-db5f-4dfa-9256-044b8f9daf8a req-ffbd9b25-fec7-4632-af11-b11fdf6a6b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b003bc53-efff-4972-b91f-708548e21cdc", "name": "network-vif-plugged", "status": "completed", "tag": "cc670dfd-7324-4c85-af7b-b8939618558c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:19.973307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8ab31aac-db5f-4dfa-9256-044b8f9daf8a req-ffbd9b25-fec7-4632-af11-b11fdf6a6b1c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:19.974158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8ab31aac-db5f-4dfa-9256-044b8f9daf8a req-ffbd9b25-fec7-4632-af11-b11fdf6a6b1c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:19.999765 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-8ab31aac-db5f-4dfa-9256-044b8f9daf8a req-ffbd9b25-fec7-4632-af11-b11fdf6a6b1c service nova] Creating event network-vif-plugged:cc670dfd-7324-4c85-af7b-b8939618558c for instance b003bc53-efff-4972-b91f-708548e21cdc on n-h2-851337-3 Aug 02 06:51:20.019646 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-8ab31aac-db5f-4dfa-9256-044b8f9daf8a req-ffbd9b25-fec7-4632-af11-b11fdf6a6b1c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117095 Aug 02 06:51:20.029749 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 747/1416] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:20.054108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44b9afd7-7508-43d2-ae40-b2bdd63069c6 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:20.054851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-44b9afd7-7508-43d2-ae40-b2bdd63069c6 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: a6c0d87b-6113-4acd-8d91-d0d75d8a6157] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:20.085103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44b9afd7-7508-43d2-ae40-b2bdd63069c6 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:20.085560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44b9afd7-7508-43d2-ae40-b2bdd63069c6 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:20.086386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44b9afd7-7508-43d2-ae40-b2bdd63069c6 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:20.086848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44b9afd7-7508-43d2-ae40-b2bdd63069c6 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:20.091017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fde9473d-4e9a-43c3-86d9-4f1403747ff3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:20.105460 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fde9473d-4e9a-43c3-86d9-4f1403747ff3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1379 microversion: 2.1 time: 0.490805 Aug 02 06:51:20.110698 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 670/1417] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:19 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1379 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:20.125010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e433e7df-c67f-4026-bb50-859f57cfb987 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:20.132878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e433e7df-c67f-4026-bb50-859f57cfb987 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:20.140853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e433e7df-c67f-4026-bb50-859f57cfb987 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:20.141662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e433e7df-c67f-4026-bb50-859f57cfb987 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:20.145599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e433e7df-c67f-4026-bb50-859f57cfb987 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:20.147635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e433e7df-c67f-4026-bb50-859f57cfb987 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:20.150828 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-44b9afd7-7508-43d2-ae40-b2bdd63069c6 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] HTTP exception thrown: Instance a6c0d87b-6113-4acd-8d91-d0d75d8a6157 could not be found. Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44b9afd7-7508-43d2-ae40-b2bdd63069c6 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Request method failure captured: Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 HTTP/1.1 Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mi3OvFD2_qFi7KTiVLTH1hjrUNYlTM8p2ybFOSkMbjt6GmNdKNXIxaDOClKDe8YyQ0Hx-zfWREki2d1AzxtPCFU2WkaHTbMlAxwlngBaHxDZCWSU0BoOos8eomX0z6Y0UAtazaqL7MGmIEtTJNPwt6zbY12leFm-BIwzKSGH9tXXVA Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 4138fe8339db45d7ac0c174ad9e61a1a Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-VolumesAdminNegativeTest-374969300 Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:51:20.152524 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:51:20.154384 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4138fe8339db45d7ac0c174ad9e61a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4138fe8339db45d7ac0c174ad9e61a1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4138fe8339db45d7ac0c174ad9e61a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4138fe8339db45d7ac0c174ad9e61a1a"}]}] Aug 02 06:51:20.154384 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-VolumesAdminNegativeTest-374969300 Aug 02 06:51:20.154384 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 4138fe8339db45d7ac0c174ad9e61a1a Aug 02 06:51:20.154384 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-374969300 Aug 02 06:51:20.154384 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-VolumesAdminNegativeTest-374969300-project Aug 02 06:51:20.154384 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:51:20.154384 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:51:20.154384 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 7a686659246f4e828823861e173802a4 Aug 02 06:51:20.154384 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-VolumesAdminNegativeTest-374969300-project Aug 02 06:51:20.154384 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:51:20.154384 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance a6c0d87b-6113-4acd-8d91-d0d75d8a6157 could not be found. Aug 02 06:51:20.154384 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'a6c0d87b-6113-4acd-8d91-d0d75d8a6157'} Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6c0d87b-6113-4acd-8d91-d0d75d8a6157 could not be found. Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:51:20.155406 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6c0d87b-6113-4acd-8d91-d0d75d8a6157 could not be found. Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6c0d87b-6113-4acd-8d91-d0d75d8a6157 could not be found. Aug 02 06:51:20.157083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:20.175724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44b9afd7-7508-43d2-ae40-b2bdd63069c6 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Returning 404 to user: Instance a6c0d87b-6113-4acd-8d91-d0d75d8a6157 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:51:20.176625 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-44b9afd7-7508-43d2-ae40-b2bdd63069c6 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157" status: 404 len: 111 microversion: 2.1 time: 0.143361 Aug 02 06:51:20.185411 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 748/1418] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:20 2022] GET /compute/v2.1/servers/a6c0d87b-6113-4acd-8d91-d0d75d8a6157 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:51:20.206206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1622364265", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:20.404352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:51:20.840678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e433e7df-c67f-4026-bb50-859f57cfb987 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:20.851159 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e433e7df-c67f-4026-bb50-859f57cfb987 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1394 microversion: 2.1 time: 0.737396 Aug 02 06:51:20.865547 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 671/1419] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:20 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1394 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:20.870869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1d10305-a4cf-418c-b0dd-3025cc0963a2 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:20.874696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b1d10305-a4cf-418c-b0dd-3025cc0963a2 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:20.893257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1d10305-a4cf-418c-b0dd-3025cc0963a2 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:20.894635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1d10305-a4cf-418c-b0dd-3025cc0963a2 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:20.895570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1d10305-a4cf-418c-b0dd-3025cc0963a2 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:20.896253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1d10305-a4cf-418c-b0dd-3025cc0963a2 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:21.134319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:51:21.135225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:51:21.135340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:51:21.135964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:51:21.136396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:51:21.154588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:21.155043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:21.155838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:21.156279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:21.197205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Getting quotas for project aae511cbb16247e1aa14cfe1c0d285bd. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:51:21.216656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Getting quotas for user b857b54177bd4b9b9128a28d93ab6610 and project aae511cbb16247e1aa14cfe1c0d285bd. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:51:21.240902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:51:21.243156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:51:21.344186 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2d4d8e06-1129-45b9-8417-0729c6857aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.157459 Aug 02 06:51:21.345142 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 749/1420] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:51:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:51:21.350855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-92a9033a-44af-4a08-9e0f-ba04079ee122 req-375a844e-6c53-4ce0-a71e-d790e4b66ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd4d0bb5-a719-464e-89ef-83065ae7f8bd", "tag": "2cfda67e-633a-4a79-a15b-8314f7622ae0"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:21.371215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-92a9033a-44af-4a08-9e0f-ba04079ee122 req-375a844e-6c53-4ce0-a71e-d790e4b66ec6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:21.371872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-92a9033a-44af-4a08-9e0f-ba04079ee122 req-375a844e-6c53-4ce0-a71e-d790e4b66ec6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:21.398267 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-92a9033a-44af-4a08-9e0f-ba04079ee122 req-375a844e-6c53-4ce0-a71e-d790e4b66ec6 service nova] Creating event network-changed:2cfda67e-633a-4a79-a15b-8314f7622ae0 for instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd on n-h1-851337-3 Aug 02 06:51:21.403354 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-92a9033a-44af-4a08-9e0f-ba04079ee122 req-375a844e-6c53-4ce0-a71e-d790e4b66ec6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056927 Aug 02 06:51:21.408268 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 750/1421] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:21.422661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-028cb0d7-1899-4bfd-a76f-dea664018bd3 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927b0eeca0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:21.431225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b1d10305-a4cf-418c-b0dd-3025cc0963a2 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:21.446796 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b1d10305-a4cf-418c-b0dd-3025cc0963a2 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1350 microversion: 2.1 time: 0.592410 Aug 02 06:51:21.447392 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 672/1422] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:20 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1350 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:21.472371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ed90d1a8-82fb-4faf-8058-115ffbf6f0d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:21.472992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ed90d1a8-82fb-4faf-8058-115ffbf6f0d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:21.492991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed90d1a8-82fb-4faf-8058-115ffbf6f0d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:21.493620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed90d1a8-82fb-4faf-8058-115ffbf6f0d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:21.494677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed90d1a8-82fb-4faf-8058-115ffbf6f0d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:21.495266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed90d1a8-82fb-4faf-8058-115ffbf6f0d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:21.500334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:21.505860 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-028cb0d7-1899-4bfd-a76f-dea664018bd3 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.095207 Aug 02 06:51:21.510439 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 751/1423] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:21 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:21.530478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fb63c9bb-902e-444d-b71c-02dadbc65705 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:21.531241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fb63c9bb-902e-444d-b71c-02dadbc65705 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:21.632678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fb63c9bb-902e-444d-b71c-02dadbc65705 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:21.649638 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fb63c9bb-902e-444d-b71c-02dadbc65705 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1218 microversion: 2.1 time: 0.128801 Aug 02 06:51:21.664928 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 752/1424] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:21 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:21.875194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8b4f5822-5386-4258-afac-43729becb49b tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:21.876166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8b4f5822-5386-4258-afac-43729becb49b tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:21.894049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b4f5822-5386-4258-afac-43729becb49b tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:21.895133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b4f5822-5386-4258-afac-43729becb49b tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:21.896311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b4f5822-5386-4258-afac-43729becb49b tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:21.896819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b4f5822-5386-4258-afac-43729becb49b tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:21.900524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ed90d1a8-82fb-4faf-8058-115ffbf6f0d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:21.911622 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ed90d1a8-82fb-4faf-8058-115ffbf6f0d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1379 microversion: 2.1 time: 0.463171 Aug 02 06:51:21.915273 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 673/1425] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:21 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1379 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:22.257297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8b4f5822-5386-4258-afac-43729becb49b tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:22.268096 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8b4f5822-5386-4258-afac-43729becb49b tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1394 microversion: 2.1 time: 0.397936 Aug 02 06:51:22.268612 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 753/1426] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:21 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1394 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:22.470468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0e3c384c-e128-4551-8ef6-8c5482251a44 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:22.471519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0e3c384c-e128-4551-8ef6-8c5482251a44 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:22.487681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e3c384c-e128-4551-8ef6-8c5482251a44 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:22.488428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e3c384c-e128-4551-8ef6-8c5482251a44 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:22.489402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e3c384c-e128-4551-8ef6-8c5482251a44 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:22.490096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e3c384c-e128-4551-8ef6-8c5482251a44 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:22.524993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2a60f1b-b170-4104-a9c8-17492b51c54b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f928c2d6af0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:22.580839 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f2a60f1b-b170-4104-a9c8-17492b51c54b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.059906 Aug 02 06:51:22.590330 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 754/1427] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:22 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:22.675262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-73d02a98-26f0-484d-a3ac-a0e6adaf0fad tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:22.678842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-73d02a98-26f0-484d-a3ac-a0e6adaf0fad tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:22.691067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73d02a98-26f0-484d-a3ac-a0e6adaf0fad tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:22.699690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73d02a98-26f0-484d-a3ac-a0e6adaf0fad tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:22.701049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73d02a98-26f0-484d-a3ac-a0e6adaf0fad tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:22.701784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73d02a98-26f0-484d-a3ac-a0e6adaf0fad tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:22.998945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-73d02a98-26f0-484d-a3ac-a0e6adaf0fad tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:23.010962 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-73d02a98-26f0-484d-a3ac-a0e6adaf0fad tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1214 microversion: 2.1 time: 0.343832 Aug 02 06:51:23.015831 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 755/1428] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:22 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1214 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:23.032417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0e3c384c-e128-4551-8ef6-8c5482251a44 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:23.034353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bfc48ce0-5866-4bdd-aa98-4cd17cf1d5a7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:23.034973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bfc48ce0-5866-4bdd-aa98-4cd17cf1d5a7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:23.046650 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0e3c384c-e128-4551-8ef6-8c5482251a44 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1539 microversion: 2.1 time: 0.580866 Aug 02 06:51:23.047459 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 674/1429] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:22 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1539 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:23.051470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfc48ce0-5866-4bdd-aa98-4cd17cf1d5a7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:23.058844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfc48ce0-5866-4bdd-aa98-4cd17cf1d5a7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:23.059778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfc48ce0-5866-4bdd-aa98-4cd17cf1d5a7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:23.060221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfc48ce0-5866-4bdd-aa98-4cd17cf1d5a7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:23.179270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-3e2e40c2-be20-4179-a539-08e599afa431 req-48c66c64-b022-4883-bf54-a3cdf44cfc11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f42060-ec57-4124-bf32-e4781f17e2a8", "tag": "d16b9b14-019b-4bb7-9858-c56d4a641026"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:23.211938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3e2e40c2-be20-4179-a539-08e599afa431 req-48c66c64-b022-4883-bf54-a3cdf44cfc11 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:23.212602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3e2e40c2-be20-4179-a539-08e599afa431 req-48c66c64-b022-4883-bf54-a3cdf44cfc11 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:23.244574 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-3e2e40c2-be20-4179-a539-08e599afa431 req-48c66c64-b022-4883-bf54-a3cdf44cfc11 service nova] Creating event network-changed:d16b9b14-019b-4bb7-9858-c56d4a641026 for instance 70f42060-ec57-4124-bf32-e4781f17e2a8 on n-h1-851337-3 Aug 02 06:51:23.251707 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-3e2e40c2-be20-4179-a539-08e599afa431 req-48c66c64-b022-4883-bf54-a3cdf44cfc11 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202645 Aug 02 06:51:23.258210 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 675/1430] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:23.268947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-03d3753c-68cd-47c2-90a1-2bc4ef25e4a8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:23.269538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-03d3753c-68cd-47c2-90a1-2bc4ef25e4a8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:23.277806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-03d3753c-68cd-47c2-90a1-2bc4ef25e4a8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:23.278349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-03d3753c-68cd-47c2-90a1-2bc4ef25e4a8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:23.279117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-03d3753c-68cd-47c2-90a1-2bc4ef25e4a8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:23.279739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-03d3753c-68cd-47c2-90a1-2bc4ef25e4a8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:23.594192 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-03d3753c-68cd-47c2-90a1-2bc4ef25e4a8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.334467 Aug 02 06:51:23.594810 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 676/1431] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 06:51:23 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc/os-interface => generated 285 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:23.611296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-09c53c45-1e77-4882-8833-454024da6f4f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:23.612725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-09c53c45-1e77-4882-8833-454024da6f4f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:23.634210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09c53c45-1e77-4882-8833-454024da6f4f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:23.635202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09c53c45-1e77-4882-8833-454024da6f4f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:23.637206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09c53c45-1e77-4882-8833-454024da6f4f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:23.637866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09c53c45-1e77-4882-8833-454024da6f4f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:23.736119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bfc48ce0-5866-4bdd-aa98-4cd17cf1d5a7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:23.746958 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bfc48ce0-5866-4bdd-aa98-4cd17cf1d5a7 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1379 microversion: 2.1 time: 0.729693 Aug 02 06:51:23.748620 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 756/1432] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:23 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1379 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:23.756199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ea762d3f-c36b-483f-8225-1d61e05c68c9 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927b14b310>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:23.822939 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ea762d3f-c36b-483f-8225-1d61e05c68c9 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.069756 Aug 02 06:51:23.832221 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 757/1433] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:23 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:24.038253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-97df5f7a-a50e-4bae-b192-6f985b1a7736 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:24.038875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-97df5f7a-a50e-4bae-b192-6f985b1a7736 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:24.052081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97df5f7a-a50e-4bae-b192-6f985b1a7736 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:24.053803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97df5f7a-a50e-4bae-b192-6f985b1a7736 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:24.055130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97df5f7a-a50e-4bae-b192-6f985b1a7736 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:24.055819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97df5f7a-a50e-4bae-b192-6f985b1a7736 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:24.903377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-09c53c45-1e77-4882-8833-454024da6f4f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:24.918372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-97df5f7a-a50e-4bae-b192-6f985b1a7736 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:24.927695 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-09c53c45-1e77-4882-8833-454024da6f4f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1394 microversion: 2.1 time: 1.320553 Aug 02 06:51:24.949703 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-97df5f7a-a50e-4bae-b192-6f985b1a7736 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1276 microversion: 2.1 time: 0.916300 Aug 02 06:51:24.950285 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 677/1434] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:23 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1394 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:24.955254 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 758/1435] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:24 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1276 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:24.960160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e68ee9f5-a655-407e-8cb3-1f1dbd6e2d15 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927b14b310>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:24.965397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2fe101ce-568c-461c-8b7a-58a46b5ed2f1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:24.970153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2fe101ce-568c-461c-8b7a-58a46b5ed2f1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:24.992393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2fe101ce-568c-461c-8b7a-58a46b5ed2f1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:24.993239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2fe101ce-568c-461c-8b7a-58a46b5ed2f1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:24.994599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2fe101ce-568c-461c-8b7a-58a46b5ed2f1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:24.995660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2fe101ce-568c-461c-8b7a-58a46b5ed2f1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:25.071169 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e68ee9f5-a655-407e-8cb3-1f1dbd6e2d15 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.114605 Aug 02 06:51:25.071769 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 759/1436] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:24 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:25.949004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0623126c-181f-41ca-a24b-24d517bbe1ed tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:25.949694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0623126c-181f-41ca-a24b-24d517bbe1ed tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:25.961539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0623126c-181f-41ca-a24b-24d517bbe1ed tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:25.971416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0623126c-181f-41ca-a24b-24d517bbe1ed tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:25.972604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0623126c-181f-41ca-a24b-24d517bbe1ed tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:25.973054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0623126c-181f-41ca-a24b-24d517bbe1ed tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:26.035024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:26.174471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2fe101ce-568c-461c-8b7a-58a46b5ed2f1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:26.185073 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2fe101ce-568c-461c-8b7a-58a46b5ed2f1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1379 microversion: 2.1 time: 1.233424 Aug 02 06:51:26.187022 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 678/1437] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:24 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1379 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:26.203108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-206d4912-27e6-4582-9a89-7df8327b284b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:26.203728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-206d4912-27e6-4582-9a89-7df8327b284b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:26.219902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-206d4912-27e6-4582-9a89-7df8327b284b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:26.220349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-206d4912-27e6-4582-9a89-7df8327b284b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:26.221145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-206d4912-27e6-4582-9a89-7df8327b284b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:26.221579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-206d4912-27e6-4582-9a89-7df8327b284b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:26.571179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-206d4912-27e6-4582-9a89-7df8327b284b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:26.587026 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-206d4912-27e6-4582-9a89-7df8327b284b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1276 microversion: 2.1 time: 0.396957 Aug 02 06:51:26.591643 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 679/1438] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:26 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1276 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:26.599392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c64a2d62-5c86-4fac-9073-ce4fb1560d54 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927af96e50>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:26.679989 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c64a2d62-5c86-4fac-9073-ce4fb1560d54 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.086908 Aug 02 06:51:26.685934 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 680/1439] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:26 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:26.688813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f97a6372-0e62-4f72-a241-93e20609b6d2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:26.691556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f97a6372-0e62-4f72-a241-93e20609b6d2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:26.706028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f97a6372-0e62-4f72-a241-93e20609b6d2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:26.706793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f97a6372-0e62-4f72-a241-93e20609b6d2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:26.707614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f97a6372-0e62-4f72-a241-93e20609b6d2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:26.708101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f97a6372-0e62-4f72-a241-93e20609b6d2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:26.751055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f97a6372-0e62-4f72-a241-93e20609b6d2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:51:26.887790 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f97a6372-0e62-4f72-a241-93e20609b6d2 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "DELETE /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 204 len: 0 microversion: 2.1 time: 0.205559 Aug 02 06:51:26.892911 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 681/1440] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:51:26 2022] DELETE /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:51:26.922085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-411074e7-70be-4aa2-aad5-a8abbac11b39 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:26.925671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-411074e7-70be-4aa2-aad5-a8abbac11b39 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:26.941865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:26.955210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-411074e7-70be-4aa2-aad5-a8abbac11b39 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:26.956799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-411074e7-70be-4aa2-aad5-a8abbac11b39 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:26.957704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-411074e7-70be-4aa2-aad5-a8abbac11b39 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:26.958182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-411074e7-70be-4aa2-aad5-a8abbac11b39 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:27.406373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0623126c-181f-41ca-a24b-24d517bbe1ed tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:27.429872 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0623126c-181f-41ca-a24b-24d517bbe1ed tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1394 microversion: 2.1 time: 1.484600 Aug 02 06:51:27.431163 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 760/1441] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:25 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1394 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:27.455966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-58f480e3-12f3-4333-ab99-7949e3ddbd8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:27.456827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-58f480e3-12f3-4333-ab99-7949e3ddbd8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:27.465630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58f480e3-12f3-4333-ab99-7949e3ddbd8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:27.466631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58f480e3-12f3-4333-ab99-7949e3ddbd8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:27.467616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58f480e3-12f3-4333-ab99-7949e3ddbd8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:27.486033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58f480e3-12f3-4333-ab99-7949e3ddbd8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:28.054728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-411074e7-70be-4aa2-aad5-a8abbac11b39 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:28.064347 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-411074e7-70be-4aa2-aad5-a8abbac11b39 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1681 microversion: 2.1 time: 1.164063 Aug 02 06:51:28.077776 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 682/1442] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:26 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1681 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:28.083256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-20f6c9fa-ac35-4235-9f59-a889468c51c3 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:28.084200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-20f6c9fa-ac35-4235-9f59-a889468c51c3 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:28.090767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20f6c9fa-ac35-4235-9f59-a889468c51c3 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:28.091418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20f6c9fa-ac35-4235-9f59-a889468c51c3 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:28.092343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20f6c9fa-ac35-4235-9f59-a889468c51c3 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:28.092946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20f6c9fa-ac35-4235-9f59-a889468c51c3 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:28.766076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-58f480e3-12f3-4333-ab99-7949e3ddbd8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:28.786324 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-58f480e3-12f3-4333-ab99-7949e3ddbd8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1379 microversion: 2.1 time: 1.334804 Aug 02 06:51:28.787933 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 761/1443] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:27 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1379 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:28.797355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a2db651e-354d-4fe1-9010-98b6a7afd49c tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927b0ee280>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:28.817548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-20f6c9fa-ac35-4235-9f59-a889468c51c3 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:28.825691 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-20f6c9fa-ac35-4235-9f59-a889468c51c3 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1318 microversion: 2.1 time: 0.746382 Aug 02 06:51:28.827072 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 683/1444] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:28 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1318 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:28.832225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-83b18ce6-9554-4161-9e87-1ea1ba71c562 req-7a4c67d2-c5c5-4921-8e7e-9ae0124d8edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4d0bb5-a719-464e-89ef-83065ae7f8bd", "name": "network-vif-plugged", "status": "completed", "tag": "2cfda67e-633a-4a79-a15b-8314f7622ae0"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:28.860366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-83b18ce6-9554-4161-9e87-1ea1ba71c562 req-7a4c67d2-c5c5-4921-8e7e-9ae0124d8edb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:28.860896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-83b18ce6-9554-4161-9e87-1ea1ba71c562 req-7a4c67d2-c5c5-4921-8e7e-9ae0124d8edb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:28.873801 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-83b18ce6-9554-4161-9e87-1ea1ba71c562 req-7a4c67d2-c5c5-4921-8e7e-9ae0124d8edb service nova] Creating event network-vif-plugged:2cfda67e-633a-4a79-a15b-8314f7622ae0 for instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd on n-h1-851337-3 Aug 02 06:51:28.879148 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-83b18ce6-9554-4161-9e87-1ea1ba71c562 req-7a4c67d2-c5c5-4921-8e7e-9ae0124d8edb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050455 Aug 02 06:51:28.880224 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 684/1445] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:28.886015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b7ed709b-4a82-44f6-beb3-4b4910d59906 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:28.886541 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a2db651e-354d-4fe1-9010-98b6a7afd49c tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.096804 Aug 02 06:51:28.886753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b7ed709b-4a82-44f6-beb3-4b4910d59906 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:28.887784 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 762/1446] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:28 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:28.903896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7ed709b-4a82-44f6-beb3-4b4910d59906 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:28.904344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7ed709b-4a82-44f6-beb3-4b4910d59906 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:28.905185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7ed709b-4a82-44f6-beb3-4b4910d59906 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:28.905626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7ed709b-4a82-44f6-beb3-4b4910d59906 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:29.085269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-71b305fc-7676-41c1-a0d4-632858ff8a34 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:29.086302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-71b305fc-7676-41c1-a0d4-632858ff8a34 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:29.102902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71b305fc-7676-41c1-a0d4-632858ff8a34 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:29.103464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71b305fc-7676-41c1-a0d4-632858ff8a34 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:29.104570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71b305fc-7676-41c1-a0d4-632858ff8a34 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:29.105244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71b305fc-7676-41c1-a0d4-632858ff8a34 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:29.620561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b7ed709b-4a82-44f6-beb3-4b4910d59906 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:29.629647 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b7ed709b-4a82-44f6-beb3-4b4910d59906 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1394 microversion: 2.1 time: 0.748103 Aug 02 06:51:29.634754 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 685/1447] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:28 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1394 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:29.811306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-07ff2a87-6c82-4e75-baed-1aa6dedf6727 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:29.812014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-07ff2a87-6c82-4e75-baed-1aa6dedf6727 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:29.825583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07ff2a87-6c82-4e75-baed-1aa6dedf6727 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:29.826075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07ff2a87-6c82-4e75-baed-1aa6dedf6727 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:29.826954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07ff2a87-6c82-4e75-baed-1aa6dedf6727 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:29.827398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07ff2a87-6c82-4e75-baed-1aa6dedf6727 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:30.211598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-71b305fc-7676-41c1-a0d4-632858ff8a34 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a686659246f4e828823861e173802a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4138fe8339db45d7ac0c174ad9e61a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:30.223917 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-71b305fc-7676-41c1-a0d4-632858ff8a34 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 200 len: 1681 microversion: 2.1 time: 1.142852 Aug 02 06:51:30.224982 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 763/1448] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:29 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 1681 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:30.239735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a51d135d-ec08-40e6-8655-c6161066f132 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:30.240160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a51d135d-ec08-40e6-8655-c6161066f132 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:30.252154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a51d135d-ec08-40e6-8655-c6161066f132 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:30.252504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a51d135d-ec08-40e6-8655-c6161066f132 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:30.253503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a51d135d-ec08-40e6-8655-c6161066f132 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:30.253958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a51d135d-ec08-40e6-8655-c6161066f132 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:31.175902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:31.329586 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-07ff2a87-6c82-4e75-baed-1aa6dedf6727 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:31.338844 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-07ff2a87-6c82-4e75-baed-1aa6dedf6727 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1379 microversion: 2.1 time: 1.534287 Aug 02 06:51:31.339353 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 686/1449] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:29 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1379 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:31.344164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-bb58c591-b617-43c4-9789-ae047ec80a89 req-1a2f0a6e-5c9a-4efb-b00d-bcc16831d1cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170e8209-d15a-4598-9d57-3c5973fd8733", "name": "network-vif-deleted", "tag": "65a2a3cd-0c7c-49a0-a06d-803fedac083b"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:31.374904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-bb58c591-b617-43c4-9789-ae047ec80a89 req-1a2f0a6e-5c9a-4efb-b00d-bcc16831d1cc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:31.377560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-bb58c591-b617-43c4-9789-ae047ec80a89 req-1a2f0a6e-5c9a-4efb-b00d-bcc16831d1cc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:31.396736 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-bb58c591-b617-43c4-9789-ae047ec80a89 req-1a2f0a6e-5c9a-4efb-b00d-bcc16831d1cc service nova] Creating event network-vif-deleted:65a2a3cd-0c7c-49a0-a06d-803fedac083b for instance 170e8209-d15a-4598-9d57-3c5973fd8733 on n-h2-851337-3 Aug 02 06:51:31.415011 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-bb58c591-b617-43c4-9789-ae047ec80a89 req-1a2f0a6e-5c9a-4efb-b00d-bcc16831d1cc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074408 Aug 02 06:51:31.429451 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 687/1450] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:31.434980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c76c1a3e-250c-4b9c-9159-76441fcb70a2 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927ae1cdc0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:31.514462 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c76c1a3e-250c-4b9c-9159-76441fcb70a2 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.083531 Aug 02 06:51:31.515360 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 688/1451] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:31 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:31.523525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-06c03d64-60b7-45a3-b05d-610216db2550 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:31.528405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-06c03d64-60b7-45a3-b05d-610216db2550 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:31.543345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06c03d64-60b7-45a3-b05d-610216db2550 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:31.544070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06c03d64-60b7-45a3-b05d-610216db2550 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:31.544864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06c03d64-60b7-45a3-b05d-610216db2550 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:31.545297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06c03d64-60b7-45a3-b05d-610216db2550 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:31.638443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=13 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:31.671053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a51d135d-ec08-40e6-8655-c6161066f132 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:31.676472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:31.702381 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a51d135d-ec08-40e6-8655-c6161066f132 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1318 microversion: 2.1 time: 1.476154 Aug 02 06:51:31.725587 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 764/1452] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:30 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1318 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:31.749279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-36c3a8d0-add6-4e06-9c9c-ede4591e7985 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:31.749951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-36c3a8d0-add6-4e06-9c9c-ede4591e7985 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] [instance: 170e8209-d15a-4598-9d57-3c5973fd8733] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:31.790220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36c3a8d0-add6-4e06-9c9c-ede4591e7985 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:31.790680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36c3a8d0-add6-4e06-9c9c-ede4591e7985 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:31.791477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36c3a8d0-add6-4e06-9c9c-ede4591e7985 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:31.791917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36c3a8d0-add6-4e06-9c9c-ede4591e7985 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:31.920085 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-36c3a8d0-add6-4e06-9c9c-ede4591e7985 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] HTTP exception thrown: Instance 170e8209-d15a-4598-9d57-3c5973fd8733 could not be found. Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-36c3a8d0-add6-4e06-9c9c-ede4591e7985 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Request method failure captured: Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 HTTP/1.1 Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mi3OvFD2_qFi7KTiVLTH1hjrUNYlTM8p2ybFOSkMbjt6GmNdKNXIxaDOClKDe8YyQ0Hx-zfWREki2d1AzxtPCFU2WkaHTbMlAxwlngBaHxDZCWSU0BoOos8eomX0z6Y0UAtazaqL7MGmIEtTJNPwt6zbY12leFm-BIwzKSGH9tXXVA Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 4138fe8339db45d7ac0c174ad9e61a1a Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-VolumesAdminNegativeTest-374969300 Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:51:31.936904 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:51:31.938734 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4138fe8339db45d7ac0c174ad9e61a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4138fe8339db45d7ac0c174ad9e61a1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4138fe8339db45d7ac0c174ad9e61a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4138fe8339db45d7ac0c174ad9e61a1a"}]}] Aug 02 06:51:31.938734 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-VolumesAdminNegativeTest-374969300 Aug 02 06:51:31.938734 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 4138fe8339db45d7ac0c174ad9e61a1a Aug 02 06:51:31.938734 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-374969300 Aug 02 06:51:31.938734 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-VolumesAdminNegativeTest-374969300-project Aug 02 06:51:31.938734 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:51:31.938734 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:51:31.938734 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 7a686659246f4e828823861e173802a4 Aug 02 06:51:31.938734 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-VolumesAdminNegativeTest-374969300-project Aug 02 06:51:31.938734 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:51:31.938734 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 170e8209-d15a-4598-9d57-3c5973fd8733 could not be found. Aug 02 06:51:31.938734 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '170e8209-d15a-4598-9d57-3c5973fd8733'} Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 170e8209-d15a-4598-9d57-3c5973fd8733 could not be found. Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:51:31.939662 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 170e8209-d15a-4598-9d57-3c5973fd8733 could not be found. Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 170e8209-d15a-4598-9d57-3c5973fd8733 could not be found. Aug 02 06:51:31.941146 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:31.942577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-36c3a8d0-add6-4e06-9c9c-ede4591e7985 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Returning 404 to user: Instance 170e8209-d15a-4598-9d57-3c5973fd8733 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:51:31.950817 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-36c3a8d0-add6-4e06-9c9c-ede4591e7985 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733" status: 404 len: 111 microversion: 2.1 time: 0.222613 Aug 02 06:51:31.951449 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 765/1453] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:31 2022] GET /compute/v2.1/servers/170e8209-d15a-4598-9d57-3c5973fd8733 => generated 111 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:51:32.079830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-2f264497-4a6c-4ef8-b0f4-a87be5c08765 req-b046c263-c907-4969-ba3e-86703e3348c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b003bc53-efff-4972-b91f-708548e21cdc", "tag": "cc670dfd-7324-4c85-af7b-b8939618558c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:32.091281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2f264497-4a6c-4ef8-b0f4-a87be5c08765 req-b046c263-c907-4969-ba3e-86703e3348c2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:32.092135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2f264497-4a6c-4ef8-b0f4-a87be5c08765 req-b046c263-c907-4969-ba3e-86703e3348c2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:32.107430 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-2f264497-4a6c-4ef8-b0f4-a87be5c08765 req-b046c263-c907-4969-ba3e-86703e3348c2 service nova] Creating event network-changed:cc670dfd-7324-4c85-af7b-b8939618558c for instance b003bc53-efff-4972-b91f-708548e21cdc on n-h2-851337-3 Aug 02 06:51:32.113942 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-2f264497-4a6c-4ef8-b0f4-a87be5c08765 req-b046c263-c907-4969-ba3e-86703e3348c2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155867 Aug 02 06:51:32.117193 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 766/1454] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:32.125537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-05168df2-b6c7-4481-a695-7e9bf71537a0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] Calling method '.version_select at 0x7f927b7a8700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:32.149779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-06c03d64-60b7-45a3-b05d-610216db2550 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:32.188031 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-06c03d64-60b7-45a3-b05d-610216db2550 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1394 microversion: 2.1 time: 0.671009 Aug 02 06:51:32.191039 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-05168df2-b6c7-4481-a695-7e9bf71537a0 tempest-VolumesAdminNegativeTest-374969300 tempest-VolumesAdminNegativeTest-374969300-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1755333763" status: 202 len: 0 microversion: 2.1 time: 0.070619 Aug 02 06:51:32.195623 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 689/1455] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:31 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1394 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:32.195938 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 767/1456] 10.222.0.79 () {58 vars in 1221 bytes} [Tue Aug 2 06:51:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1755333763 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:51:32.364733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ac294d6b-14f5-40e0-a304-0e3d25727c53 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:32.366362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ac294d6b-14f5-40e0-a304-0e3d25727c53 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:32.376851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ac294d6b-14f5-40e0-a304-0e3d25727c53 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:32.377298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ac294d6b-14f5-40e0-a304-0e3d25727c53 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:32.378106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ac294d6b-14f5-40e0-a304-0e3d25727c53 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:32.383656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ac294d6b-14f5-40e0-a304-0e3d25727c53 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:32.530315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d971ec9a-50ba-4781-8da6-056f69a879a3 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f928c343f70>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:32.593441 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d971ec9a-50ba-4781-8da6-056f69a879a3 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.067145 Aug 02 06:51:32.594046 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 768/1457] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:32 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:32.728003 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b2a05c02-e9d6-4029-acec-44448cb27e85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:32.729186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b2a05c02-e9d6-4029-acec-44448cb27e85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:32.739253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2a05c02-e9d6-4029-acec-44448cb27e85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:32.739717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2a05c02-e9d6-4029-acec-44448cb27e85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:32.740619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2a05c02-e9d6-4029-acec-44448cb27e85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:32.745659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2a05c02-e9d6-4029-acec-44448cb27e85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:33.113358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ac294d6b-14f5-40e0-a304-0e3d25727c53 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:33.126497 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ac294d6b-14f5-40e0-a304-0e3d25727c53 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1379 microversion: 2.1 time: 0.766922 Aug 02 06:51:33.130894 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 690/1458] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:32 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1379 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:33.148935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b2a05c02-e9d6-4029-acec-44448cb27e85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:33.179439 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b2a05c02-e9d6-4029-acec-44448cb27e85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1318 microversion: 2.1 time: 0.453076 Aug 02 06:51:33.181060 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 769/1459] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:32 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:33.217349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6e71d80c-fdf8-4240-846c-a063079a5ba7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:33.217680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6e71d80c-fdf8-4240-846c-a063079a5ba7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:33.229692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e71d80c-fdf8-4240-846c-a063079a5ba7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:33.230169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e71d80c-fdf8-4240-846c-a063079a5ba7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:33.230964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e71d80c-fdf8-4240-846c-a063079a5ba7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:33.246882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e71d80c-fdf8-4240-846c-a063079a5ba7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:33.611032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5ac69ec8-262f-46a6-bacc-6b20744f7cf9 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927b14b310>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:33.696965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6e71d80c-fdf8-4240-846c-a063079a5ba7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:33.699519 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5ac69ec8-262f-46a6-bacc-6b20744f7cf9 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.092244 Aug 02 06:51:33.700419 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 770/1460] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:33 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:33.707395 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6e71d80c-fdf8-4240-846c-a063079a5ba7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1394 microversion: 2.1 time: 0.493778 Aug 02 06:51:33.710421 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 691/1461] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:33 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1394 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:34.149297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8ecc2050-8f41-4a2e-828b-3df9ed1b5afb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:34.150081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8ecc2050-8f41-4a2e-828b-3df9ed1b5afb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:34.191648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-45f5543a-f362-4f3f-85c6-ffe065634337 req-f2ea7356-bd17-4a76-bc59-b73e22c8937a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e35b665-80f8-4add-8c4f-edeb762a78fa", "tag": "97677ae9-daf0-4a17-a2c1-087df4aa5df7"}, {"name": "network-changed", "server_uuid": "a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b", "tag": "d7483d94-2d0f-4ad6-bb8f-b89e8f73637f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:34.192507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ecc2050-8f41-4a2e-828b-3df9ed1b5afb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:34.195109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ecc2050-8f41-4a2e-828b-3df9ed1b5afb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:34.196267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ecc2050-8f41-4a2e-828b-3df9ed1b5afb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:34.199616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ecc2050-8f41-4a2e-828b-3df9ed1b5afb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:34.212808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-45f5543a-f362-4f3f-85c6-ffe065634337 req-f2ea7356-bd17-4a76-bc59-b73e22c8937a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:34.213932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-45f5543a-f362-4f3f-85c6-ffe065634337 req-f2ea7356-bd17-4a76-bc59-b73e22c8937a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:34.233159 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-45f5543a-f362-4f3f-85c6-ffe065634337 req-f2ea7356-bd17-4a76-bc59-b73e22c8937a service nova] Creating event network-changed:97677ae9-daf0-4a17-a2c1-087df4aa5df7 for instance 6e35b665-80f8-4add-8c4f-edeb762a78fa on n-h2-851337-3 Aug 02 06:51:34.234349 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-45f5543a-f362-4f3f-85c6-ffe065634337 req-f2ea7356-bd17-4a76-bc59-b73e22c8937a service nova] Creating event network-changed:d7483d94-2d0f-4ad6-bb8f-b89e8f73637f for instance a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b on n-h2-851337-3 Aug 02 06:51:34.242121 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-45f5543a-f362-4f3f-85c6-ffe065634337 req-f2ea7356-bd17-4a76-bc59-b73e22c8937a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.063808 Aug 02 06:51:34.243352 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 692/1462] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:34.251413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a1f97410-145a-4378-997b-2e1ae2df1a3b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:34.252465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a1f97410-145a-4378-997b-2e1ae2df1a3b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:34.261956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1f97410-145a-4378-997b-2e1ae2df1a3b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:34.262674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1f97410-145a-4378-997b-2e1ae2df1a3b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:34.263866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1f97410-145a-4378-997b-2e1ae2df1a3b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:34.264797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1f97410-145a-4378-997b-2e1ae2df1a3b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:34.272981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:34.450765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8ecc2050-8f41-4a2e-828b-3df9ed1b5afb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:34.476013 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8ecc2050-8f41-4a2e-828b-3df9ed1b5afb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1529 microversion: 2.1 time: 0.330616 Aug 02 06:51:34.476636 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 771/1463] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:34 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1529 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:34.496995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7558debb-cc43-4874-b4c1-38215ba5cf15 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:34.497630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7558debb-cc43-4874-b4c1-38215ba5cf15 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:34.501949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a1f97410-145a-4378-997b-2e1ae2df1a3b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:34.513742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7558debb-cc43-4874-b4c1-38215ba5cf15 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:34.514254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7558debb-cc43-4874-b4c1-38215ba5cf15 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:34.515102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7558debb-cc43-4874-b4c1-38215ba5cf15 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:34.515563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7558debb-cc43-4874-b4c1-38215ba5cf15 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:34.518152 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a1f97410-145a-4378-997b-2e1ae2df1a3b tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1318 microversion: 2.1 time: 0.272914 Aug 02 06:51:34.531436 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 693/1464] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:34 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:34.716378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-282c56c4-8a17-4a5b-b5a8-4f58a8d2cbc0 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927b0944c0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:34.776114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7558debb-cc43-4874-b4c1-38215ba5cf15 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:34.787497 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7558debb-cc43-4874-b4c1-38215ba5cf15 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1529 microversion: 2.1 time: 0.294352 Aug 02 06:51:34.799672 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 772/1465] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:34 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1529 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:34.857533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b32e044d-67c4-49e4-add6-9d0a9adde019 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:34.861381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b32e044d-67c4-49e4-add6-9d0a9adde019 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:34.875380 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-282c56c4-8a17-4a5b-b5a8-4f58a8d2cbc0 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.163383 Aug 02 06:51:34.877026 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 694/1466] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:34 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:34.882663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b32e044d-67c4-49e4-add6-9d0a9adde019 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:34.883698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d9a4f6a1-2b50-4ac9-95b3-c0f4fba53545 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:34.884533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b32e044d-67c4-49e4-add6-9d0a9adde019 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:34.884917 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:51:34.884917 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:51:34.885923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b32e044d-67c4-49e4-add6-9d0a9adde019 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:34.887397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b32e044d-67c4-49e4-add6-9d0a9adde019 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:34.927074 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d9a4f6a1-2b50-4ac9-95b3-c0f4fba53545 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/47937a84-20ae-42cf-9c27-72f4a9a26a4d" status: 202 len: 0 microversion: 2.1 time: 0.041593 Aug 02 06:51:34.931393 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 695/1467] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:51:34 2022] DELETE /compute/v2.1/flavors/47937a84-20ae-42cf-9c27-72f4a9a26a4d => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:51:34.940963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15c21b0c-913a-451a-88ef-fc4720f760a0 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:35.006670 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-15c21b0c-913a-451a-88ef-fc4720f760a0 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071338 Aug 02 06:51:35.018185 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 696/1468] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:51:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:35.036767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-45a058e9-5bda-4d45-bd3a-f2d7c733bc3a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:35.045301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-45a058e9-5bda-4d45-bd3a-f2d7c733bc3a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:35.061512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45a058e9-5bda-4d45-bd3a-f2d7c733bc3a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:35.062314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45a058e9-5bda-4d45-bd3a-f2d7c733bc3a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:35.065011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45a058e9-5bda-4d45-bd3a-f2d7c733bc3a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:35.066294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45a058e9-5bda-4d45-bd3a-f2d7c733bc3a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:35.348027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b32e044d-67c4-49e4-add6-9d0a9adde019 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:35.357866 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b32e044d-67c4-49e4-add6-9d0a9adde019 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1394 microversion: 2.1 time: 0.532313 Aug 02 06:51:35.362156 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 773/1469] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:34 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1394 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:35.440346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-45a058e9-5bda-4d45-bd3a-f2d7c733bc3a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:35.454348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-45a058e9-5bda-4d45-bd3a-f2d7c733bc3a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Old instance type tempest-test_resize_flavor_-43464346, new instance type m1.heat {{(pid=126119) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 06:51:35.467978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-45a058e9-5bda-4d45-bd3a-f2d7c733bc3a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:51:35.469093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-45a058e9-5bda-4d45-bd3a-f2d7c733bc3a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:51:35.471584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-45a058e9-5bda-4d45-bd3a-f2d7c733bc3a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:51:35.472007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-45a058e9-5bda-4d45-bd3a-f2d7c733bc3a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:51:35.477555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-45a058e9-5bda-4d45-bd3a-f2d7c733bc3a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:51:35.539151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a376598c-253f-4efe-8319-62940c121de9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:35.540053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a376598c-253f-4efe-8319-62940c121de9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:35.547451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a376598c-253f-4efe-8319-62940c121de9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:35.551096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a376598c-253f-4efe-8319-62940c121de9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:35.554770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a376598c-253f-4efe-8319-62940c121de9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:35.559204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a376598c-253f-4efe-8319-62940c121de9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:35.711995 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-45a058e9-5bda-4d45-bd3a-f2d7c733bc3a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "POST /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd/action" status: 202 len: 0 microversion: 2.1 time: 0.685145 Aug 02 06:51:35.717657 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 697/1470] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:51:35 2022] POST /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd/action => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:51:35.730166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8009128f-eeee-493e-8284-f6b4993dd94e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:35.731125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8009128f-eeee-493e-8284-f6b4993dd94e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:35.745288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8009128f-eeee-493e-8284-f6b4993dd94e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:35.745781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8009128f-eeee-493e-8284-f6b4993dd94e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:35.746880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8009128f-eeee-493e-8284-f6b4993dd94e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:35.747319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8009128f-eeee-493e-8284-f6b4993dd94e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:35.860920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a376598c-253f-4efe-8319-62940c121de9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:35.879098 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a376598c-253f-4efe-8319-62940c121de9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1318 microversion: 2.1 time: 0.343852 Aug 02 06:51:35.880877 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 774/1471] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:35 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:35.901168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1ccb2806-6551-4a19-9935-aee78507bf85 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f928c2e1820>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:35.992897 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1ccb2806-6551-4a19-9935-aee78507bf85 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1427 microversion: 2.1 time: 0.104728 Aug 02 06:51:36.000008 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 775/1472] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:35 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:36.149296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8009128f-eeee-493e-8284-f6b4993dd94e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:36.161387 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8009128f-eeee-493e-8284-f6b4993dd94e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1538 microversion: 2.1 time: 0.441591 Aug 02 06:51:36.163915 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 698/1473] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:35 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1538 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:36.245139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6e2aa49a-cff3-4fbb-a5fd-c3aee1bf6bb0 req-f011ca06-7016-4623-b20f-9054bd8f6775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f42060-ec57-4124-bf32-e4781f17e2a8", "name": "network-vif-plugged", "status": "completed", "tag": "d16b9b14-019b-4bb7-9858-c56d4a641026"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:36.270073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6e2aa49a-cff3-4fbb-a5fd-c3aee1bf6bb0 req-f011ca06-7016-4623-b20f-9054bd8f6775 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:36.270781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6e2aa49a-cff3-4fbb-a5fd-c3aee1bf6bb0 req-f011ca06-7016-4623-b20f-9054bd8f6775 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:36.304917 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-6e2aa49a-cff3-4fbb-a5fd-c3aee1bf6bb0 req-f011ca06-7016-4623-b20f-9054bd8f6775 service nova] Creating event network-vif-plugged:d16b9b14-019b-4bb7-9858-c56d4a641026 for instance 70f42060-ec57-4124-bf32-e4781f17e2a8 on n-h1-851337-3 Aug 02 06:51:36.315434 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6e2aa49a-cff3-4fbb-a5fd-c3aee1bf6bb0 req-f011ca06-7016-4623-b20f-9054bd8f6775 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075987 Aug 02 06:51:36.316987 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 776/1474] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:51:36.390417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-db1c0cb3-59d8-44ac-af38-553dc2e58b3f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:36.391245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-db1c0cb3-59d8-44ac-af38-553dc2e58b3f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:36.400517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db1c0cb3-59d8-44ac-af38-553dc2e58b3f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:36.412250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db1c0cb3-59d8-44ac-af38-553dc2e58b3f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:36.415414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db1c0cb3-59d8-44ac-af38-553dc2e58b3f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:36.415871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db1c0cb3-59d8-44ac-af38-553dc2e58b3f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:36.756685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-db1c0cb3-59d8-44ac-af38-553dc2e58b3f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:36.766829 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-db1c0cb3-59d8-44ac-af38-553dc2e58b3f tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1394 microversion: 2.1 time: 0.387650 Aug 02 06:51:36.767870 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 699/1475] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:36 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1394 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:36.903163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-56cd3810-6279-479b-bc47-031943c9e777 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:36.903874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-56cd3810-6279-479b-bc47-031943c9e777 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:36.916429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56cd3810-6279-479b-bc47-031943c9e777 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:36.917102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56cd3810-6279-479b-bc47-031943c9e777 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:36.921518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56cd3810-6279-479b-bc47-031943c9e777 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:36.921975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56cd3810-6279-479b-bc47-031943c9e777 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:37.011162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dc4928d1-8c7a-462b-b97a-e7ead0dfb8ac tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927b094310>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:37.110635 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dc4928d1-8c7a-462b-b97a-e7ead0dfb8ac tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1436 microversion: 2.1 time: 0.105771 Aug 02 06:51:37.111745 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 700/1476] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:37 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1436 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:37.137101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-930fe605-e720-4adb-b21f-90429d4e3eb5 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927af37af0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:37.243706 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-930fe605-e720-4adb-b21f-90429d4e3eb5 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 200 len: 1436 microversion: 2.1 time: 0.119787 Aug 02 06:51:37.244582 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 701/1477] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:37 2022] GET /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 1436 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:37.257916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a51b47c3-0e06-41dc-bcb1-efe79a97f68b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:37.263684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a51b47c3-0e06-41dc-bcb1-efe79a97f68b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:37.293362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a51b47c3-0e06-41dc-bcb1-efe79a97f68b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:37.295766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a51b47c3-0e06-41dc-bcb1-efe79a97f68b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:37.299700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a51b47c3-0e06-41dc-bcb1-efe79a97f68b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:37.300259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a51b47c3-0e06-41dc-bcb1-efe79a97f68b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:37.978553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-56cd3810-6279-479b-bc47-031943c9e777 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:37.987574 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-56cd3810-6279-479b-bc47-031943c9e777 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1318 microversion: 2.1 time: 1.090322 Aug 02 06:51:37.994106 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 777/1478] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:36 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1318 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:38.001843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-575eadc5-85ae-4328-b7b2-acce2cf1c65e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:38.002482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-575eadc5-85ae-4328-b7b2-acce2cf1c65e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:38.021306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-575eadc5-85ae-4328-b7b2-acce2cf1c65e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:38.022002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-575eadc5-85ae-4328-b7b2-acce2cf1c65e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:38.022933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-575eadc5-85ae-4328-b7b2-acce2cf1c65e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:38.023519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-575eadc5-85ae-4328-b7b2-acce2cf1c65e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:38.239351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a51b47c3-0e06-41dc-bcb1-efe79a97f68b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:38.251380 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a51b47c3-0e06-41dc-bcb1-efe79a97f68b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1538 microversion: 2.1 time: 1.005740 Aug 02 06:51:38.252489 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 702/1479] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:37 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1538 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:38.269631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0fc45c84-bb0f-4f9d-9e52-a275299b5f33 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:38.270527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0fc45c84-bb0f-4f9d-9e52-a275299b5f33 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:38.281283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fc45c84-bb0f-4f9d-9e52-a275299b5f33 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:38.282236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fc45c84-bb0f-4f9d-9e52-a275299b5f33 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:38.285029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fc45c84-bb0f-4f9d-9e52-a275299b5f33 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:38.285473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fc45c84-bb0f-4f9d-9e52-a275299b5f33 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:38.413979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-575eadc5-85ae-4328-b7b2-acce2cf1c65e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:38.448464 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-575eadc5-85ae-4328-b7b2-acce2cf1c65e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1466 microversion: 2.1 time: 0.452383 Aug 02 06:51:38.449281 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 778/1480] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:37 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1466 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:38.460498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4c45356d-4309-44dd-9c18-639dd2c569f3 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:38.461348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4c45356d-4309-44dd-9c18-639dd2c569f3 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:38.469630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c45356d-4309-44dd-9c18-639dd2c569f3 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:38.470390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c45356d-4309-44dd-9c18-639dd2c569f3 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:38.471516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c45356d-4309-44dd-9c18-639dd2c569f3 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:38.472640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c45356d-4309-44dd-9c18-639dd2c569f3 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:38.514413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-0fc45c84-bb0f-4f9d-9e52-a275299b5f33 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 62927d0b-7f85-4ce4-a606-2c0ddb2b896e {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:51:38.539756 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0fc45c84-bb0f-4f9d-9e52-a275299b5f33 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 2345 microversion: 2.25 time: 0.285835 Aug 02 06:51:38.541505 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 703/1481] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:51:38 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 2345 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:51:38.548451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-08188a96-409a-4141-92cf-4fe8c0d5c38b req-22baecb1-445f-4c5f-8bb5-2655c95f968a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e35b665-80f8-4add-8c4f-edeb762a78fa", "name": "network-vif-plugged", "status": "completed", "tag": "97677ae9-daf0-4a17-a2c1-087df4aa5df7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:38.562465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-08188a96-409a-4141-92cf-4fe8c0d5c38b req-22baecb1-445f-4c5f-8bb5-2655c95f968a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:38.563237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-08188a96-409a-4141-92cf-4fe8c0d5c38b req-22baecb1-445f-4c5f-8bb5-2655c95f968a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:38.625520 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-08188a96-409a-4141-92cf-4fe8c0d5c38b req-22baecb1-445f-4c5f-8bb5-2655c95f968a service nova] Creating event network-vif-plugged:97677ae9-daf0-4a17-a2c1-087df4aa5df7 for instance 6e35b665-80f8-4add-8c4f-edeb762a78fa on n-h2-851337-3 Aug 02 06:51:38.633807 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-08188a96-409a-4141-92cf-4fe8c0d5c38b req-22baecb1-445f-4c5f-8bb5-2655c95f968a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089904 Aug 02 06:51:38.634752 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 704/1482] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:38.641687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fe4f3621-978e-4102-ae08-43bd347f37bc tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927af0c160>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:38.708313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4c45356d-4309-44dd-9c18-639dd2c569f3 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:38.717716 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4c45356d-4309-44dd-9c18-639dd2c569f3 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1394 microversion: 2.1 time: 0.265143 Aug 02 06:51:38.719325 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 779/1483] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:38 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1394 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:38.727663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b04c5fd2-385a-4fc9-b620-439cac17504c tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:38.732868 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:51:38.732868 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:51:38.734861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b04c5fd2-385a-4fc9-b620-439cac17504c tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:38.735321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b04c5fd2-385a-4fc9-b620-439cac17504c tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:38.736294 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b04c5fd2-385a-4fc9-b620-439cac17504c tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:38.737141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b04c5fd2-385a-4fc9-b620-439cac17504c tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:38.764713 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b04c5fd2-385a-4fc9-b620-439cac17504c tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.042974 Aug 02 06:51:38.765164 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 780/1484] 10.222.0.79 () {60 vars in 1217 bytes} [Tue Aug 2 06:51:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:51:39.015302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9e5d7586-640b-4128-9f2b-7baa8cde91cb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:39.016009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9e5d7586-640b-4128-9f2b-7baa8cde91cb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:39.025586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e5d7586-640b-4128-9f2b-7baa8cde91cb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:39.027857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e5d7586-640b-4128-9f2b-7baa8cde91cb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:39.036690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e5d7586-640b-4128-9f2b-7baa8cde91cb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:39.038884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e5d7586-640b-4128-9f2b-7baa8cde91cb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:39.418207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9e5d7586-640b-4128-9f2b-7baa8cde91cb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:39.430359 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9e5d7586-640b-4128-9f2b-7baa8cde91cb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1318 microversion: 2.1 time: 0.419182 Aug 02 06:51:39.442490 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 781/1485] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:39 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:39.464808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2b801c29-4633-4d2f-ad5c-30b379751610 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:39.467186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2b801c29-4633-4d2f-ad5c-30b379751610 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:39.475555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b801c29-4633-4d2f-ad5c-30b379751610 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:39.480713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b801c29-4633-4d2f-ad5c-30b379751610 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:39.481773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b801c29-4633-4d2f-ad5c-30b379751610 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:39.482521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b801c29-4633-4d2f-ad5c-30b379751610 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:39.649769 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fe4f3621-978e-4102-ae08-43bd347f37bc tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "DELETE /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3" status: 204 len: 0 microversion: 2.1 time: 1.013220 Aug 02 06:51:39.650401 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 705/1486] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:38 2022] DELETE /compute/v2.1/images/f2798a5a-c7c9-498b-8f74-e3ff66f489e3 => generated 0 bytes in 1015 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:51:39.658811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-415d3701-dbe2-4cff-9e9a-b4ba107be012 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '.version_select at 0x7f927b094f70>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:39.721506 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-415d3701-dbe2-4cff-9e9a-b4ba107be012 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] HTTP exception thrown: Image not found. Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-415d3701-dbe2-4cff-9e9a-b4ba107be012 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Request method failure captured: Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 HTTP/1.1 Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MkRT_Gzi9azaIgqLKO3ZzkzrAIZmJ20WQCzkqMJphisMLz1pRtSOTqSQiQGAIbzr6rZNAUGX5mFZL0y1d34yqcpYrjIRS2vhNDjPB94ZJ7CrDtvSOYYk5fEUZkNsAn40GJqczKMFA2OZkp4iwWw5nfWQGHMIRoc2k37RvjHR481nJ4 Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 59657b9384a5459982ab107427b52c49 Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesOneServerTestJSON-370216888 Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:51:39.724418 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:51:39.725837 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59657b9384a5459982ab107427b52c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59657b9384a5459982ab107427b52c49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59657b9384a5459982ab107427b52c49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59657b9384a5459982ab107427b52c49"}]}] Aug 02 06:51:39.725837 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesOneServerTestJSON-370216888 Aug 02 06:51:39.725837 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 59657b9384a5459982ab107427b52c49 Aug 02 06:51:39.725837 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-370216888 Aug 02 06:51:39.725837 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesOneServerTestJSON-370216888-project Aug 02 06:51:39.725837 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:51:39.725837 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:51:39.725837 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: ce9ac912dfe54f3783fa943de17bcef7 Aug 02 06:51:39.725837 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesOneServerTestJSON-370216888-project Aug 02 06:51:39.725837 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:51:39.725837 n-d-851337-3 devstack@n-api.service[126119]: exception: Image not found. Aug 02 06:51:39.725837 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '9598563a-bfde-4a86-af3e-b2d0774996f9'} Aug 02 06:51:39.725837 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9598563a-bfde-4a86-af3e-b2d0774996f9 to delete Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:39.726895 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9598563a-bfde-4a86-af3e-b2d0774996f9 could not be found. Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:51:39.728375 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-415d3701-dbe2-4cff-9e9a-b4ba107be012 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Returning 404 to user: Image not found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:51:39.729751 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-415d3701-dbe2-4cff-9e9a-b4ba107be012 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "DELETE /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9" status: 404 len: 62 microversion: 2.1 time: 0.071358 Aug 02 06:51:39.731125 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 706/1487] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:39 2022] DELETE /compute/v2.1/images/9598563a-bfde-4a86-af3e-b2d0774996f9 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:51:39.739272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b17c716e-bb32-4559-ae1d-ac71ae4ef4ff tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:39.741220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b17c716e-bb32-4559-ae1d-ac71ae4ef4ff tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:39.750175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b17c716e-bb32-4559-ae1d-ac71ae4ef4ff tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:39.750881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b17c716e-bb32-4559-ae1d-ac71ae4ef4ff tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:39.752411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b17c716e-bb32-4559-ae1d-ac71ae4ef4ff tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:39.753780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b17c716e-bb32-4559-ae1d-ac71ae4ef4ff tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:39.784807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b17c716e-bb32-4559-ae1d-ac71ae4ef4ff tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:51:39.893848 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b17c716e-bb32-4559-ae1d-ac71ae4ef4ff tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "DELETE /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 204 len: 0 microversion: 2.1 time: 0.159925 Aug 02 06:51:39.895167 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 707/1488] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:51:39 2022] DELETE /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:51:39.903941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-61c5a056-1c00-45d6-a878-bd0126c50397 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:39.905040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-61c5a056-1c00-45d6-a878-bd0126c50397 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:39.914414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61c5a056-1c00-45d6-a878-bd0126c50397 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:39.915689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61c5a056-1c00-45d6-a878-bd0126c50397 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:39.916982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61c5a056-1c00-45d6-a878-bd0126c50397 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:39.917847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61c5a056-1c00-45d6-a878-bd0126c50397 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:39.935656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2b801c29-4633-4d2f-ad5c-30b379751610 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:39.947399 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2b801c29-4633-4d2f-ad5c-30b379751610 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1538 microversion: 2.1 time: 0.495526 Aug 02 06:51:39.948218 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 782/1489] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:39 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1538 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:39.963054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-284a92e8-b497-4428-8c80-50b4355beb26 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:39.964483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-284a92e8-b497-4428-8c80-50b4355beb26 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:39.980226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-284a92e8-b497-4428-8c80-50b4355beb26 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:39.982527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-284a92e8-b497-4428-8c80-50b4355beb26 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:39.983593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-284a92e8-b497-4428-8c80-50b4355beb26 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:39.987595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-284a92e8-b497-4428-8c80-50b4355beb26 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:40.305205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-61c5a056-1c00-45d6-a878-bd0126c50397 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:40.316826 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-61c5a056-1c00-45d6-a878-bd0126c50397 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1576 microversion: 2.1 time: 0.417879 Aug 02 06:51:40.320619 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 708/1490] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:39 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1576 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:40.348133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0d027271-726f-440f-a7a5-fc6ae16c98cb tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:40.348941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0d027271-726f-440f-a7a5-fc6ae16c98cb tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:40.356010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-284a92e8-b497-4428-8c80-50b4355beb26 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:40.362287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d027271-726f-440f-a7a5-fc6ae16c98cb tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:40.366711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d027271-726f-440f-a7a5-fc6ae16c98cb tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:40.368198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d027271-726f-440f-a7a5-fc6ae16c98cb tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:40.368990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d027271-726f-440f-a7a5-fc6ae16c98cb tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:40.371519 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-284a92e8-b497-4428-8c80-50b4355beb26 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1472 microversion: 2.1 time: 0.420281 Aug 02 06:51:40.374454 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 783/1491] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:39 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1472 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:40.462091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d3343071-c156-40fb-8ce7-09a4a9744f85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:40.464454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d3343071-c156-40fb-8ce7-09a4a9744f85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:40.485039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3343071-c156-40fb-8ce7-09a4a9744f85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:40.499603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3343071-c156-40fb-8ce7-09a4a9744f85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:40.501928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3343071-c156-40fb-8ce7-09a4a9744f85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:40.505768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3343071-c156-40fb-8ce7-09a4a9744f85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:40.549555 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0d027271-726f-440f-a7a5-fc6ae16c98cb tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.205153 Aug 02 06:51:40.551529 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 709/1492] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 06:51:40 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8/os-interface => generated 285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:40.978537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d3343071-c156-40fb-8ce7-09a4a9744f85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:40.988157 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d3343071-c156-40fb-8ce7-09a4a9744f85 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1318 microversion: 2.1 time: 0.532782 Aug 02 06:51:40.993776 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 784/1493] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:40 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:41.001801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b670a764-07d3-47b2-a399-c77b625ee2f6 req-deb67d96-fe46-40f2-bf8b-f49a583ada0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b", "name": "network-vif-plugged", "status": "completed", "tag": "d7483d94-2d0f-4ad6-bb8f-b89e8f73637f"}, {"server_uuid": "94a113f2-1afe-411d-9477-350acce2a793", "name": "network-vif-unplugged", "status": "completed", "tag": "31c431f1-495f-40ae-ba60-1586f6059b74"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:41.012380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e14da6c0-e651-437e-9729-0b2c9078dada tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:41.013611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e14da6c0-e651-437e-9729-0b2c9078dada tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:41.017866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b670a764-07d3-47b2-a399-c77b625ee2f6 req-deb67d96-fe46-40f2-bf8b-f49a583ada0e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:41.023447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b670a764-07d3-47b2-a399-c77b625ee2f6 req-deb67d96-fe46-40f2-bf8b-f49a583ada0e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:41.025414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e14da6c0-e651-437e-9729-0b2c9078dada tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:41.029857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e14da6c0-e651-437e-9729-0b2c9078dada tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:41.031011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e14da6c0-e651-437e-9729-0b2c9078dada tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:41.031651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e14da6c0-e651-437e-9729-0b2c9078dada tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:41.055015 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b670a764-07d3-47b2-a399-c77b625ee2f6 req-deb67d96-fe46-40f2-bf8b-f49a583ada0e service nova] Creating event network-vif-plugged:d7483d94-2d0f-4ad6-bb8f-b89e8f73637f for instance a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b on n-h2-851337-3 Aug 02 06:51:41.060320 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b670a764-07d3-47b2-a399-c77b625ee2f6 req-deb67d96-fe46-40f2-bf8b-f49a583ada0e service nova] Creating event network-vif-unplugged:31c431f1-495f-40ae-ba60-1586f6059b74 for instance 94a113f2-1afe-411d-9477-350acce2a793 on n-h1-851337-3 Aug 02 06:51:41.079754 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b670a764-07d3-47b2-a399-c77b625ee2f6 req-deb67d96-fe46-40f2-bf8b-f49a583ada0e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.333907 Aug 02 06:51:41.080688 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 710/1494] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:51:41.396761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-87899a93-360b-4a36-8393-881999421a85 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:41.397882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-87899a93-360b-4a36-8393-881999421a85 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:41.404542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87899a93-360b-4a36-8393-881999421a85 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:41.405334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87899a93-360b-4a36-8393-881999421a85 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:41.406938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87899a93-360b-4a36-8393-881999421a85 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:41.407684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87899a93-360b-4a36-8393-881999421a85 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:41.547354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e14da6c0-e651-437e-9729-0b2c9078dada tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:41.558979 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e14da6c0-e651-437e-9729-0b2c9078dada tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1538 microversion: 2.1 time: 0.563298 Aug 02 06:51:41.560445 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 785/1495] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:40 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1538 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:41.653496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-41473003-9f64-4ca6-a11c-3ac07308af09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf75ef4d-753c-4e71-a9bf-d531aaef8cd1", "device": "/dev/xvdb"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:41.656758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-41473003-9f64-4ca6-a11c-3ac07308af09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:41.662721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:41.664516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41473003-9f64-4ca6-a11c-3ac07308af09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:41.665145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41473003-9f64-4ca6-a11c-3ac07308af09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:41.666151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41473003-9f64-4ca6-a11c-3ac07308af09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:41.666736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41473003-9f64-4ca6-a11c-3ac07308af09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:41.754408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-87899a93-360b-4a36-8393-881999421a85 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:41.769557 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-87899a93-360b-4a36-8393-881999421a85 tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1472 microversion: 2.1 time: 0.377503 Aug 02 06:51:41.770092 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 711/1496] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:41 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1472 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:42.015392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-279a078f-5b0e-4614-a148-5e7200947875 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:42.016001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-279a078f-5b0e-4614-a148-5e7200947875 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:42.022600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-279a078f-5b0e-4614-a148-5e7200947875 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:42.023037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-279a078f-5b0e-4614-a148-5e7200947875 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:42.023802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-279a078f-5b0e-4614-a148-5e7200947875 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:42.024248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-279a078f-5b0e-4614-a148-5e7200947875 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:42.122659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:42.142908 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-41473003-9f64-4ca6-a11c-3ac07308af09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "POST /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.493201 Aug 02 06:51:42.143613 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 786/1497] 10.222.0.79 () {62 vars in 1364 bytes} [Tue Aug 2 06:51:41 2022] POST /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments => generated 194 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 06:51:42.399487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-279a078f-5b0e-4614-a148-5e7200947875 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:42.407315 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-279a078f-5b0e-4614-a148-5e7200947875 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1318 microversion: 2.1 time: 0.395894 Aug 02 06:51:42.420689 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 712/1498] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:42 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:42.558013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0fcbfc61-4fc3-4d7a-8fda-3a0619c02e48 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:42.558720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0fcbfc61-4fc3-4d7a-8fda-3a0619c02e48 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:42.563846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-3f8567d4-b17f-49a5-a36d-07aeecd82a38 req-21cd0733-e31a-4b9a-b3f0-c38542287560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f42060-ec57-4124-bf32-e4781f17e2a8", "tag": "d16b9b14-019b-4bb7-9858-c56d4a641026"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:42.577180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0fcbfc61-4fc3-4d7a-8fda-3a0619c02e48 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:42.578116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0fcbfc61-4fc3-4d7a-8fda-3a0619c02e48 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:42.579066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0fcbfc61-4fc3-4d7a-8fda-3a0619c02e48 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:42.579653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0fcbfc61-4fc3-4d7a-8fda-3a0619c02e48 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:42.594261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3f8567d4-b17f-49a5-a36d-07aeecd82a38 req-21cd0733-e31a-4b9a-b3f0-c38542287560 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:42.594707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3f8567d4-b17f-49a5-a36d-07aeecd82a38 req-21cd0733-e31a-4b9a-b3f0-c38542287560 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:42.626105 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-3f8567d4-b17f-49a5-a36d-07aeecd82a38 req-21cd0733-e31a-4b9a-b3f0-c38542287560 service nova] Creating event network-changed:d16b9b14-019b-4bb7-9858-c56d4a641026 for instance 70f42060-ec57-4124-bf32-e4781f17e2a8 on n-h1-851337-3 Aug 02 06:51:42.638397 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-3f8567d4-b17f-49a5-a36d-07aeecd82a38 req-21cd0733-e31a-4b9a-b3f0-c38542287560 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080842 Aug 02 06:51:42.642468 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 713/1499] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:51:42.654985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3870d4dd-cac5-4644-8574-a3840283fcd1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:42.658936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3870d4dd-cac5-4644-8574-a3840283fcd1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:42.681679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3870d4dd-cac5-4644-8574-a3840283fcd1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:42.687816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3870d4dd-cac5-4644-8574-a3840283fcd1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:42.688935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3870d4dd-cac5-4644-8574-a3840283fcd1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:42.690173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3870d4dd-cac5-4644-8574-a3840283fcd1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:43.510271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0fcbfc61-4fc3-4d7a-8fda-3a0619c02e48 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:43.518727 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0fcbfc61-4fc3-4d7a-8fda-3a0619c02e48 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1576 microversion: 2.1 time: 0.966974 Aug 02 06:51:43.541812 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 787/1500] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:42 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1576 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:43.549931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e3455361-bf99-4f8b-8f67-ba6d08dc475e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:43.550744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e3455361-bf99-4f8b-8f67-ba6d08dc475e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:43.568083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3870d4dd-cac5-4644-8574-a3840283fcd1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:43.581332 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3870d4dd-cac5-4644-8574-a3840283fcd1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1538 microversion: 2.1 time: 0.931555 Aug 02 06:51:43.583561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3455361-bf99-4f8b-8f67-ba6d08dc475e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:43.584026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3455361-bf99-4f8b-8f67-ba6d08dc475e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:43.584696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3455361-bf99-4f8b-8f67-ba6d08dc475e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:43.585132 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 714/1501] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:42 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1538 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:43.590405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1302b44c-f291-4c21-9348-94571e58cb34 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:43.591215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3455361-bf99-4f8b-8f67-ba6d08dc475e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:43.596077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1302b44c-f291-4c21-9348-94571e58cb34 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:43.617198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1302b44c-f291-4c21-9348-94571e58cb34 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:43.617938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1302b44c-f291-4c21-9348-94571e58cb34 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:43.618930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1302b44c-f291-4c21-9348-94571e58cb34 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:43.619530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1302b44c-f291-4c21-9348-94571e58cb34 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:44.073652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1302b44c-f291-4c21-9348-94571e58cb34 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:44.077364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:44.089743 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1302b44c-f291-4c21-9348-94571e58cb34 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1468 microversion: 2.1 time: 0.503240 Aug 02 06:51:44.090709 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 715/1502] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:43 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1468 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:44.110676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5f29fc37-2183-40ed-a90a-16ee3ce08515 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:44.111292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5f29fc37-2183-40ed-a90a-16ee3ce08515 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: 6e35b665-80f8-4add-8c4f-edeb762a78fa] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:44.117792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f29fc37-2183-40ed-a90a-16ee3ce08515 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:44.118263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f29fc37-2183-40ed-a90a-16ee3ce08515 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:44.124650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f29fc37-2183-40ed-a90a-16ee3ce08515 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:44.128183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e3455361-bf99-4f8b-8f67-ba6d08dc475e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:44.128863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f29fc37-2183-40ed-a90a-16ee3ce08515 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:44.141272 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e3455361-bf99-4f8b-8f67-ba6d08dc475e tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1472 microversion: 2.1 time: 0.595363 Aug 02 06:51:44.142532 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 788/1503] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:43 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1472 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:44.516461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5f29fc37-2183-40ed-a90a-16ee3ce08515 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:44.529277 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5f29fc37-2183-40ed-a90a-16ee3ce08515 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa" status: 200 len: 1468 microversion: 2.1 time: 0.422626 Aug 02 06:51:44.530413 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 716/1504] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:44 2022] GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa => generated 1468 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:44.552289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a95cd681-582e-49c6-9a08-af0459f3c435 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1648381954"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:44.555235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a95cd681-582e-49c6-9a08-af0459f3c435 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: 6e35b665-80f8-4add-8c4f-edeb762a78fa] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:44.563016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a95cd681-582e-49c6-9a08-af0459f3c435 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:44.563601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a95cd681-582e-49c6-9a08-af0459f3c435 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:44.564397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a95cd681-582e-49c6-9a08-af0459f3c435 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:44.564831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a95cd681-582e-49c6-9a08-af0459f3c435 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:44.609185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e36f0710-7360-45a8-82d8-8c25e5c58108 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:44.610583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e36f0710-7360-45a8-82d8-8c25e5c58108 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:44.620407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e36f0710-7360-45a8-82d8-8c25e5c58108 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:44.623550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e36f0710-7360-45a8-82d8-8c25e5c58108 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:44.627431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e36f0710-7360-45a8-82d8-8c25e5c58108 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:44.627897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e36f0710-7360-45a8-82d8-8c25e5c58108 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:44.881084 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a95cd681-582e-49c6-9a08-af0459f3c435 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "POST /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa/action" status: 202 len: 0 microversion: 2.1 time: 0.333220 Aug 02 06:51:44.882935 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 789/1505] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:51:44 2022] POST /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 02 06:51:44.889948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-2809b4da-494d-4437-9100-4f44ff90eccb req-3887a97f-bb17-46c9-99ca-c94fef8cff71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a113f2-1afe-411d-9477-350acce2a793", "name": "network-vif-deleted", "tag": "31c431f1-495f-40ae-ba60-1586f6059b74"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:44.903264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2809b4da-494d-4437-9100-4f44ff90eccb req-3887a97f-bb17-46c9-99ca-c94fef8cff71 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:44.904177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2809b4da-494d-4437-9100-4f44ff90eccb req-3887a97f-bb17-46c9-99ca-c94fef8cff71 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:44.913128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e36f0710-7360-45a8-82d8-8c25e5c58108 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:44.924329 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e36f0710-7360-45a8-82d8-8c25e5c58108 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1543 microversion: 2.1 time: 0.320040 Aug 02 06:51:44.936752 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 717/1506] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:44 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1543 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:44.939419 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-2809b4da-494d-4437-9100-4f44ff90eccb req-3887a97f-bb17-46c9-99ca-c94fef8cff71 service nova] Creating event network-vif-deleted:31c431f1-495f-40ae-ba60-1586f6059b74 for instance 94a113f2-1afe-411d-9477-350acce2a793 on n-h1-851337-3 Aug 02 06:51:44.946068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fff95d5d-0797-4c10-9122-53159af86f9f tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927af89820>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:44.949540 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-2809b4da-494d-4437-9100-4f44ff90eccb req-3887a97f-bb17-46c9-99ca-c94fef8cff71 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064314 Aug 02 06:51:44.954269 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 790/1507] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:45.017301 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fff95d5d-0797-4c10-9122-53159af86f9f tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.078391 Aug 02 06:51:45.018112 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 718/1508] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:44 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:45.166840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7112fb5b-42cc-4a7d-9055-553294384a0b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:45.167966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7112fb5b-42cc-4a7d-9055-553294384a0b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:45.177530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7112fb5b-42cc-4a7d-9055-553294384a0b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:45.178480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7112fb5b-42cc-4a7d-9055-553294384a0b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:45.180321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7112fb5b-42cc-4a7d-9055-553294384a0b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:45.180999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7112fb5b-42cc-4a7d-9055-553294384a0b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:45.228425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7112fb5b-42cc-4a7d-9055-553294384a0b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:45.229144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7112fb5b-42cc-4a7d-9055-553294384a0b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:45.231035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-7112fb5b-42cc-4a7d-9055-553294384a0b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lazy-loading 'fault' on Instance uuid 94a113f2-1afe-411d-9477-350acce2a793 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:51:45.293779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7112fb5b-42cc-4a7d-9055-553294384a0b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9ac912dfe54f3783fa943de17bcef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59657b9384a5459982ab107427b52c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:45.306685 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7112fb5b-42cc-4a7d-9055-553294384a0b tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 200 len: 1306 microversion: 2.1 time: 0.146961 Aug 02 06:51:45.307810 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 791/1509] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:45 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 1306 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:45.949952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-585b9ee1-9638-4bfc-8951-c08b162788d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:45.951460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-585b9ee1-9638-4bfc-8951-c08b162788d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:45.962095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-585b9ee1-9638-4bfc-8951-c08b162788d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:45.963125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-585b9ee1-9638-4bfc-8951-c08b162788d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:45.964282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-585b9ee1-9638-4bfc-8951-c08b162788d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:45.964953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-585b9ee1-9638-4bfc-8951-c08b162788d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:46.032267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b24f1425-3d04-4310-9788-54ccef1817d3 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b226dc0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:46.110999 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b24f1425-3d04-4310-9788-54ccef1817d3 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.080933 Aug 02 06:51:46.112840 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 792/1510] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:46 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:46.166718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-585b9ee1-9638-4bfc-8951-c08b162788d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:46.176319 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-585b9ee1-9638-4bfc-8951-c08b162788d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1543 microversion: 2.1 time: 0.230674 Aug 02 06:51:46.177062 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 719/1511] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:45 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1543 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:46.327122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1cf01230-ec0e-4e2d-b1e4-42d1efd6391f tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:46.327653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1cf01230-ec0e-4e2d-b1e4-42d1efd6391f tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] [instance: 94a113f2-1afe-411d-9477-350acce2a793] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:46.334820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1cf01230-ec0e-4e2d-b1e4-42d1efd6391f tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:46.335504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1cf01230-ec0e-4e2d-b1e4-42d1efd6391f tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:46.336482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1cf01230-ec0e-4e2d-b1e4-42d1efd6391f tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:46.337084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1cf01230-ec0e-4e2d-b1e4-42d1efd6391f tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:46.358657 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-1cf01230-ec0e-4e2d-b1e4-42d1efd6391f tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] HTTP exception thrown: Instance 94a113f2-1afe-411d-9477-350acce2a793 could not be found. Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1cf01230-ec0e-4e2d-b1e4-42d1efd6391f tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Request method failure captured: Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 HTTP/1.1 Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MkRT_Gzi9azaIgqLKO3ZzkzrAIZmJ20WQCzkqMJphisMLz1pRtSOTqSQiQGAIbzr6rZNAUGX5mFZL0y1d34yqcpYrjIRS2vhNDjPB94ZJ7CrDtvSOYYk5fEUZkNsAn40GJqczKMFA2OZkp4iwWw5nfWQGHMIRoc2k37RvjHR481nJ4 Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 59657b9384a5459982ab107427b52c49 Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesOneServerTestJSON-370216888 Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:51:46.360595 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:51:46.362181 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59657b9384a5459982ab107427b52c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59657b9384a5459982ab107427b52c49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59657b9384a5459982ab107427b52c49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59657b9384a5459982ab107427b52c49"}]}] Aug 02 06:51:46.362181 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesOneServerTestJSON-370216888 Aug 02 06:51:46.362181 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 59657b9384a5459982ab107427b52c49 Aug 02 06:51:46.362181 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-370216888 Aug 02 06:51:46.362181 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesOneServerTestJSON-370216888-project Aug 02 06:51:46.362181 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:51:46.362181 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:51:46.362181 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: ce9ac912dfe54f3783fa943de17bcef7 Aug 02 06:51:46.362181 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesOneServerTestJSON-370216888-project Aug 02 06:51:46.362181 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:51:46.362181 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 94a113f2-1afe-411d-9477-350acce2a793 could not be found. Aug 02 06:51:46.362181 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '94a113f2-1afe-411d-9477-350acce2a793'} Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94a113f2-1afe-411d-9477-350acce2a793 could not be found. Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:51:46.363109 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94a113f2-1afe-411d-9477-350acce2a793 could not be found. Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94a113f2-1afe-411d-9477-350acce2a793 could not be found. Aug 02 06:51:46.364693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:51:46.366784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1cf01230-ec0e-4e2d-b1e4-42d1efd6391f tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] Returning 404 to user: Instance 94a113f2-1afe-411d-9477-350acce2a793 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:51:46.367897 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1cf01230-ec0e-4e2d-b1e4-42d1efd6391f tempest-ImagesOneServerTestJSON-370216888 tempest-ImagesOneServerTestJSON-370216888-project] 10.222.0.79 "GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793" status: 404 len: 111 microversion: 2.1 time: 0.044956 Aug 02 06:51:46.369035 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 793/1512] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:46 2022] GET /compute/v2.1/servers/94a113f2-1afe-411d-9477-350acce2a793 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:51:47.130918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7f67c4c0-f1dc-48fb-987c-f7a0b1f46b30 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b09c9d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:47.195463 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7f67c4c0-f1dc-48fb-987c-f7a0b1f46b30 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.068825 Aug 02 06:51:47.202992 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 720/1513] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:47 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:47.203252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ce96c6ac-0ea1-401c-a889-fee264757d8d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:47.203252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ce96c6ac-0ea1-401c-a889-fee264757d8d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:47.218981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce96c6ac-0ea1-401c-a889-fee264757d8d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:47.219594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce96c6ac-0ea1-401c-a889-fee264757d8d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:47.220569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce96c6ac-0ea1-401c-a889-fee264757d8d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:47.221025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce96c6ac-0ea1-401c-a889-fee264757d8d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:47.628641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ce96c6ac-0ea1-401c-a889-fee264757d8d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:47.637772 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ce96c6ac-0ea1-401c-a889-fee264757d8d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1543 microversion: 2.1 time: 0.443962 Aug 02 06:51:47.643332 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 794/1514] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:47 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1543 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:48.214221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-da538ba6-3d28-4698-8adc-97f9cc2b4ef8 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b035430>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:48.317185 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-da538ba6-3d28-4698-8adc-97f9cc2b4ef8 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.109985 Aug 02 06:51:48.317838 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 721/1515] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:48 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:48.663955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c4fdbb24-0ee7-4d0f-bd61-9723e8af3f02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:48.669741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c4fdbb24-0ee7-4d0f-bd61-9723e8af3f02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:48.686798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4fdbb24-0ee7-4d0f-bd61-9723e8af3f02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:48.692429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4fdbb24-0ee7-4d0f-bd61-9723e8af3f02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:48.702188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4fdbb24-0ee7-4d0f-bd61-9723e8af3f02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:48.702661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4fdbb24-0ee7-4d0f-bd61-9723e8af3f02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:48.776120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:49.331668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f239e716-ccbf-43b8-b566-7f80f9bc77b8 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b0944c0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:49.424298 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f239e716-ccbf-43b8-b566-7f80f9bc77b8 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.096675 Aug 02 06:51:49.432906 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 722/1516] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:49 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:49.625136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c4fdbb24-0ee7-4d0f-bd61-9723e8af3f02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:49.634986 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c4fdbb24-0ee7-4d0f-bd61-9723e8af3f02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1543 microversion: 2.1 time: 0.975305 Aug 02 06:51:49.657015 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 795/1517] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:48 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1543 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:49.670934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-c41844b3-4ab7-4cb5-b529-a623c07bc4c2 req-8b94e03f-0330-4aad-96cf-bad7d2e04b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e35b665-80f8-4add-8c4f-edeb762a78fa", "name": "network-vif-plugged", "status": "completed", "tag": "97677ae9-daf0-4a17-a2c1-087df4aa5df7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:49.705052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c41844b3-4ab7-4cb5-b529-a623c07bc4c2 req-8b94e03f-0330-4aad-96cf-bad7d2e04b12 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:49.712210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c41844b3-4ab7-4cb5-b529-a623c07bc4c2 req-8b94e03f-0330-4aad-96cf-bad7d2e04b12 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:49.768655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-03221809-25b9-45b8-ac30-62ef7b7319b7 tempest-ListImageFiltersNegativeTestJSON-1730855231 tempest-ListImageFiltersNegativeTestJSON-1730855231-project] Calling method '.version_select at 0x7f927ad84820>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:49.775427 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-c41844b3-4ab7-4cb5-b529-a623c07bc4c2 req-8b94e03f-0330-4aad-96cf-bad7d2e04b12 service nova] Creating event network-vif-plugged:97677ae9-daf0-4a17-a2c1-087df4aa5df7 for instance 6e35b665-80f8-4add-8c4f-edeb762a78fa on n-h2-851337-3 Aug 02 06:51:49.796946 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-c41844b3-4ab7-4cb5-b529-a623c07bc4c2 req-8b94e03f-0330-4aad-96cf-bad7d2e04b12 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137911 Aug 02 06:51:49.801016 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 796/1518] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:49.814532 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-03221809-25b9-45b8-ac30-62ef7b7319b7 tempest-ListImageFiltersNegativeTestJSON-1730855231 tempest-ListImageFiltersNegativeTestJSON-1730855231-project] HTTP exception thrown: Image not found. Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-03221809-25b9-45b8-ac30-62ef7b7319b7 tempest-ListImageFiltersNegativeTestJSON-1730855231 tempest-ListImageFiltersNegativeTestJSON-1730855231-project] Request method failure captured: Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/images/f2a8aca1-b78a-41c6-b7cc-837861d7b796 HTTP/1.1 Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmF3pS0Bi2LlZUH36JFhOjnj6LyyUcdw4KQmBozxYr-TarVUW4IbWedPg62386ZUY7NfYgZBCba-olKg8znvvKvQuSzNq4swBgTIYPYy6NqeEy7sgnnIdcEgaRYeHnrnv12XHK7J4u9WFSi29FPYoqPxIX19TUzG9kue6gev6-VMx0 Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 7a799c17556740c6af24e5882e5b2c8e Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1730855231 Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:51:49.816783 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:51:49.818718 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7a799c17556740c6af24e5882e5b2c8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7a799c17556740c6af24e5882e5b2c8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7a799c17556740c6af24e5882e5b2c8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7a799c17556740c6af24e5882e5b2c8e"}]}] Aug 02 06:51:49.818718 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1730855231 Aug 02 06:51:49.818718 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 7a799c17556740c6af24e5882e5b2c8e Aug 02 06:51:49.818718 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1730855231 Aug 02 06:51:49.818718 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ListImageFiltersNegativeTestJSON-1730855231-project Aug 02 06:51:49.818718 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:51:49.818718 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:51:49.818718 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: a01eecb8e2b345b489a2518e86f16879 Aug 02 06:51:49.818718 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1730855231-project Aug 02 06:51:49.818718 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:51:49.818718 n-d-851337-3 devstack@n-api.service[126119]: exception: Image not found. Aug 02 06:51:49.818718 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'f2a8aca1-b78a-41c6-b7cc-837861d7b796'} Aug 02 06:51:49.818718 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:51:49.819974 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f2a8aca1-b78a-41c6-b7cc-837861d7b796 Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:51:49.821391 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f2a8aca1-b78a-41c6-b7cc-837861d7b796 could not be found. Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:51:49.823017 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:51:49.824557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-03221809-25b9-45b8-ac30-62ef7b7319b7 tempest-ListImageFiltersNegativeTestJSON-1730855231 tempest-ListImageFiltersNegativeTestJSON-1730855231-project] Returning 404 to user: Image not found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:51:49.826628 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-03221809-25b9-45b8-ac30-62ef7b7319b7 tempest-ListImageFiltersNegativeTestJSON-1730855231 tempest-ListImageFiltersNegativeTestJSON-1730855231-project] 10.222.0.79 "GET /compute/v2.1/images/f2a8aca1-b78a-41c6-b7cc-837861d7b796" status: 404 len: 62 microversion: 2.1 time: 0.315613 Aug 02 06:51:49.831300 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 723/1519] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:49 2022] GET /compute/v2.1/images/f2a8aca1-b78a-41c6-b7cc-837861d7b796 => generated 62 bytes in 324 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 02 06:51:50.157754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1953979592", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "db7d01d8-40e0-493b-8992-76c9b63bb01d"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:50.284190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] validate_networks() for [('db7d01d8-40e0-493b-8992-76c9b63bb01d', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:51:50.440459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5c0ca406-adec-427c-935d-456e4c5d127a tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b0edaf0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:50.533542 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5c0ca406-adec-427c-935d-456e4c5d127a tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.096349 Aug 02 06:51:50.534340 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 724/1520] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:50 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:50.671455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-29f666dd-bd44-4e5a-a187-d62016767d43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:50.672317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-29f666dd-bd44-4e5a-a187-d62016767d43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:50.687915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f666dd-bd44-4e5a-a187-d62016767d43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:50.690522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f666dd-bd44-4e5a-a187-d62016767d43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:50.692259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f666dd-bd44-4e5a-a187-d62016767d43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:50.695286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f666dd-bd44-4e5a-a187-d62016767d43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:51.401510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-29f666dd-bd44-4e5a-a187-d62016767d43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:51.416034 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-29f666dd-bd44-4e5a-a187-d62016767d43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1543 microversion: 2.1 time: 0.748639 Aug 02 06:51:51.436507 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 725/1521] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:50 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1543 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:51.512683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:51:51.513167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:51:51.513607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:51:51.517104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:51:51.517684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:51:51.540661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:51.541117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:51.546528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:51.547137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:51.550488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b166f89d-e61a-4667-ae89-efad0ccdafc6 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b1b2b80>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:51.581179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Getting quotas for project 2a8dc75e5ba647e3b128c31a49f069ca. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:51:51.601594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Getting quotas for user 793620d46a6c42fb955f1fe5075b040b and project 2a8dc75e5ba647e3b128c31a49f069ca. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:51:51.641462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:51:51.644266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:51:51.646802 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b166f89d-e61a-4667-ae89-efad0ccdafc6 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.101337 Aug 02 06:51:51.655777 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 726/1522] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:51 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:51.781494 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cff0118e-a609-45ea-845d-b827ecb4a9a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.757657 Aug 02 06:51:51.798681 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 797/1523] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:51:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:51:51.806957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-64a36459-c496-46a3-b59b-270790bfb491 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:51.815550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-64a36459-c496-46a3-b59b-270790bfb491 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:51.953380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-64a36459-c496-46a3-b59b-270790bfb491 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:51.963001 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-64a36459-c496-46a3-b59b-270790bfb491 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 200 len: 1208 microversion: 2.1 time: 0.163107 Aug 02 06:51:51.967421 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 727/1524] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:51 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 1208 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:52.444502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-942011cd-b9da-41b7-8a45-6d0dbf4a61fb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:52.445427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-942011cd-b9da-41b7-8a45-6d0dbf4a61fb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:52.461097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-942011cd-b9da-41b7-8a45-6d0dbf4a61fb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:52.464048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-942011cd-b9da-41b7-8a45-6d0dbf4a61fb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:52.465021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-942011cd-b9da-41b7-8a45-6d0dbf4a61fb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:52.465627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-942011cd-b9da-41b7-8a45-6d0dbf4a61fb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:52.663206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bf52fa99-1fdb-4364-88e0-2bb0d952952a tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927afbbca0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:52.772584 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bf52fa99-1fdb-4364-88e0-2bb0d952952a tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.113487 Aug 02 06:51:52.794768 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 728/1525] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:52 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:52.897359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-942011cd-b9da-41b7-8a45-6d0dbf4a61fb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:52.907265 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-942011cd-b9da-41b7-8a45-6d0dbf4a61fb tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1543 microversion: 2.1 time: 0.466777 Aug 02 06:51:52.908852 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 798/1526] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:52 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1543 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:52.992124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-66f4b8df-205f-427c-8e35-9dccbbc328fc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:52.992856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-66f4b8df-205f-427c-8e35-9dccbbc328fc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:53.004214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66f4b8df-205f-427c-8e35-9dccbbc328fc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:53.005061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66f4b8df-205f-427c-8e35-9dccbbc328fc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:53.008396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66f4b8df-205f-427c-8e35-9dccbbc328fc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:53.008895 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66f4b8df-205f-427c-8e35-9dccbbc328fc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:53.158920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-66f4b8df-205f-427c-8e35-9dccbbc328fc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:53.175743 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-66f4b8df-205f-427c-8e35-9dccbbc328fc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 200 len: 1204 microversion: 2.1 time: 0.189482 Aug 02 06:51:53.176345 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 729/1527] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:52 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 1204 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:53.788955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ebee76c5-659d-4797-bc11-79071586beb9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f928c343790>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:53.878303 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ebee76c5-659d-4797-bc11-79071586beb9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.093958 Aug 02 06:51:53.880026 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 799/1528] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:53 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:53.937814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ae1271ea-062c-46d5-b9d9-2d9e2d8c517c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:53.939738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ae1271ea-062c-46d5-b9d9-2d9e2d8c517c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:53.980728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae1271ea-062c-46d5-b9d9-2d9e2d8c517c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:53.982204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae1271ea-062c-46d5-b9d9-2d9e2d8c517c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:53.983256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae1271ea-062c-46d5-b9d9-2d9e2d8c517c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:53.983900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae1271ea-062c-46d5-b9d9-2d9e2d8c517c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:54.198440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-635f2000-6e74-4ce5-a22b-1a88ed5d4b4c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:54.199874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-635f2000-6e74-4ce5-a22b-1a88ed5d4b4c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:54.221017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-635f2000-6e74-4ce5-a22b-1a88ed5d4b4c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:54.225252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-635f2000-6e74-4ce5-a22b-1a88ed5d4b4c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:54.226298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-635f2000-6e74-4ce5-a22b-1a88ed5d4b4c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:54.229573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-635f2000-6e74-4ce5-a22b-1a88ed5d4b4c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:54.246057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ae1271ea-062c-46d5-b9d9-2d9e2d8c517c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:54.255022 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ae1271ea-062c-46d5-b9d9-2d9e2d8c517c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1543 microversion: 2.1 time: 0.329375 Aug 02 06:51:54.255858 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 730/1529] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:53 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1543 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:54.359511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-635f2000-6e74-4ce5-a22b-1a88ed5d4b4c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:54.368379 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-635f2000-6e74-4ce5-a22b-1a88ed5d4b4c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 200 len: 1266 microversion: 2.1 time: 0.174999 Aug 02 06:51:54.380242 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 800/1530] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:54 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:54.895497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bc318c20-bd71-4a9e-acd7-ddbf3ac003b9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927ae1c940>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:54.962590 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bc318c20-bd71-4a9e-acd7-ddbf3ac003b9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.071637 Aug 02 06:51:54.975510 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 731/1531] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:54 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:55.278208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-84a9bb2b-c03e-4d59-a954-4fbda51a9cde tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:55.278834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-84a9bb2b-c03e-4d59-a954-4fbda51a9cde tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:55.290497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84a9bb2b-c03e-4d59-a954-4fbda51a9cde tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:55.296135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84a9bb2b-c03e-4d59-a954-4fbda51a9cde tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:55.297246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84a9bb2b-c03e-4d59-a954-4fbda51a9cde tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:55.297380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84a9bb2b-c03e-4d59-a954-4fbda51a9cde tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:55.411219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e6100f65-b8ee-4168-a83f-6eb063de8943 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:55.412624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e6100f65-b8ee-4168-a83f-6eb063de8943 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:55.435900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6100f65-b8ee-4168-a83f-6eb063de8943 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:55.437993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6100f65-b8ee-4168-a83f-6eb063de8943 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:55.461993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6100f65-b8ee-4168-a83f-6eb063de8943 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:55.462593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6100f65-b8ee-4168-a83f-6eb063de8943 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:55.862246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84a9bb2b-c03e-4d59-a954-4fbda51a9cde tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:55.877426 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-84a9bb2b-c03e-4d59-a954-4fbda51a9cde tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1543 microversion: 2.1 time: 0.603390 Aug 02 06:51:55.878077 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 801/1532] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:55 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1543 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:55.909064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e6100f65-b8ee-4168-a83f-6eb063de8943 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:55.920957 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e6100f65-b8ee-4168-a83f-6eb063de8943 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 200 len: 1308 microversion: 2.1 time: 0.515240 Aug 02 06:51:55.934272 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 732/1533] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:55 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 1308 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:55.980456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c8d48ed-1d35-45da-9098-1908a720022c tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f928c343af0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:56.047540 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1c8d48ed-1d35-45da-9098-1908a720022c tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.072083 Aug 02 06:51:56.048131 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 802/1534] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:55 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:51:56.776258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-12263387-069e-461f-b4d3-0f014bc7334e req-4ff195ec-a4d5-408b-9221-7908f4c8d6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "218c6c00-857e-42d7-82d4-eb818faf1f07", "tag": "d333a6ac-1957-4aac-9862-415ec3c70230"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:51:56.820913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-12263387-069e-461f-b4d3-0f014bc7334e req-4ff195ec-a4d5-408b-9221-7908f4c8d6aa service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:56.830861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-12263387-069e-461f-b4d3-0f014bc7334e req-4ff195ec-a4d5-408b-9221-7908f4c8d6aa service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:56.871950 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-12263387-069e-461f-b4d3-0f014bc7334e req-4ff195ec-a4d5-408b-9221-7908f4c8d6aa service nova] Creating event network-changed:d333a6ac-1957-4aac-9862-415ec3c70230 for instance 218c6c00-857e-42d7-82d4-eb818faf1f07 on n-h1-851337-3 Aug 02 06:51:56.888056 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-12263387-069e-461f-b4d3-0f014bc7334e req-4ff195ec-a4d5-408b-9221-7908f4c8d6aa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128168 Aug 02 06:51:56.892770 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 733/1535] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:51:56.912241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fb005a79-d843-4a33-9ba2-bc9a1b25a307 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:56.913807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fb005a79-d843-4a33-9ba2-bc9a1b25a307 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:56.930492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb005a79-d843-4a33-9ba2-bc9a1b25a307 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:56.930936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb005a79-d843-4a33-9ba2-bc9a1b25a307 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:56.931715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb005a79-d843-4a33-9ba2-bc9a1b25a307 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:56.932148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb005a79-d843-4a33-9ba2-bc9a1b25a307 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:56.954217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-424177d8-aa5f-4f19-bf0f-f142690e4bb7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:56.955343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-424177d8-aa5f-4f19-bf0f-f142690e4bb7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:56.975697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-424177d8-aa5f-4f19-bf0f-f142690e4bb7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:56.976443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-424177d8-aa5f-4f19-bf0f-f142690e4bb7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:56.977431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-424177d8-aa5f-4f19-bf0f-f142690e4bb7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:56.981348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-424177d8-aa5f-4f19-bf0f-f142690e4bb7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:57.356376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-424177d8-aa5f-4f19-bf0f-f142690e4bb7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:57.367516 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-424177d8-aa5f-4f19-bf0f-f142690e4bb7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 200 len: 1308 microversion: 2.1 time: 0.418553 Aug 02 06:51:57.370952 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 734/1536] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:56 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:57.382385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-37b5feca-17d4-4393-9bf8-7046ad84a9e2 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b1b2310>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:57.463120 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-37b5feca-17d4-4393-9bf8-7046ad84a9e2 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.090758 Aug 02 06:51:57.465478 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 735/1537] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:57 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:57.470194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fb005a79-d843-4a33-9ba2-bc9a1b25a307 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:57.481139 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fb005a79-d843-4a33-9ba2-bc9a1b25a307 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1543 microversion: 2.1 time: 0.573994 Aug 02 06:51:57.487883 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 803/1538] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:56 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1543 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:58.398948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dca1a346-beea-4b7f-ab69-8b896ebdaa2d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:58.401041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dca1a346-beea-4b7f-ab69-8b896ebdaa2d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:58.416534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:51:58.420223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dca1a346-beea-4b7f-ab69-8b896ebdaa2d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:58.421486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dca1a346-beea-4b7f-ab69-8b896ebdaa2d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:58.425319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dca1a346-beea-4b7f-ab69-8b896ebdaa2d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:58.426495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dca1a346-beea-4b7f-ab69-8b896ebdaa2d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:58.482092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-59941630-be7a-4e7a-b210-80c64f17f26d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f928c2823a0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:58.574656 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-59941630-be7a-4e7a-b210-80c64f17f26d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.097398 Aug 02 06:51:58.575656 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 804/1539] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:58 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:58.589476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-16a0dc2b-0934-4507-94d4-78a45c0afccc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:58.593138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-16a0dc2b-0934-4507-94d4-78a45c0afccc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:58.617128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16a0dc2b-0934-4507-94d4-78a45c0afccc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:58.618990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16a0dc2b-0934-4507-94d4-78a45c0afccc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:58.620115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16a0dc2b-0934-4507-94d4-78a45c0afccc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:58.620724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16a0dc2b-0934-4507-94d4-78a45c0afccc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:59.456014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-16a0dc2b-0934-4507-94d4-78a45c0afccc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:59.481052 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-16a0dc2b-0934-4507-94d4-78a45c0afccc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1543 microversion: 2.1 time: 0.904046 Aug 02 06:51:59.481684 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 805/1540] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:58 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1543 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:59.500319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-963d6ae3-3a6e-40e0-be62-ec427eabfe13 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:59.500908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-963d6ae3-3a6e-40e0-be62-ec427eabfe13 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:51:59.547430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-963d6ae3-3a6e-40e0-be62-ec427eabfe13 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:59.550685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-963d6ae3-3a6e-40e0-be62-ec427eabfe13 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:59.554511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-963d6ae3-3a6e-40e0-be62-ec427eabfe13 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:51:59.557534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-963d6ae3-3a6e-40e0-be62-ec427eabfe13 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:51:59.574901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dca1a346-beea-4b7f-ab69-8b896ebdaa2d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:51:59.588662 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dca1a346-beea-4b7f-ab69-8b896ebdaa2d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 200 len: 1308 microversion: 2.1 time: 1.195776 Aug 02 06:51:59.596283 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 736/1541] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:51:58 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 1308 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:51:59.613444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-df5f0b59-14d7-4cf9-a815-37b59e1ed140 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b0c9c10>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:51:59.735918 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-df5f0b59-14d7-4cf9-a815-37b59e1ed140 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.137278 Aug 02 06:51:59.737230 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 737/1542] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:51:59 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:00.265442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-963d6ae3-3a6e-40e0-be62-ec427eabfe13 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 62927d0b-7f85-4ce4-a606-2c0ddb2b896e {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:52:00.312675 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-963d6ae3-3a6e-40e0-be62-ec427eabfe13 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 2423 microversion: 2.25 time: 0.823408 Aug 02 06:52:00.313276 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 806/1543] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:51:59 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 2423 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:00.346079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4b1a9e13-d1be-4f96-989d-d9efacbc90f2 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851337-3", "block_migration": "auto"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:00.351236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4b1a9e13-d1be-4f96-989d-d9efacbc90f2 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:00.381435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b1a9e13-d1be-4f96-989d-d9efacbc90f2 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:00.383009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b1a9e13-d1be-4f96-989d-d9efacbc90f2 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:00.387443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b1a9e13-d1be-4f96-989d-d9efacbc90f2 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:00.387976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b1a9e13-d1be-4f96-989d-d9efacbc90f2 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:00.506397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-477bda10-d3de-4420-a220-87eb1d1d2b74 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:00.507023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-477bda10-d3de-4420-a220-87eb1d1d2b74 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:00.526559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-477bda10-d3de-4420-a220-87eb1d1d2b74 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:00.530046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-477bda10-d3de-4420-a220-87eb1d1d2b74 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:00.534145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-477bda10-d3de-4420-a220-87eb1d1d2b74 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:00.534622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-477bda10-d3de-4420-a220-87eb1d1d2b74 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:00.588540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-4b1a9e13-d1be-4f96-989d-d9efacbc90f2 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'flavor' on Instance uuid 62927d0b-7f85-4ce4-a606-2c0ddb2b896e {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:52:00.732648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4b1a9e13-d1be-4f96-989d-d9efacbc90f2 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Going to try to live migrate instance to n-h2-851337-3 {{(pid=126119) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 02 06:52:01.084950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-477bda10-d3de-4420-a220-87eb1d1d2b74 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:01.100767 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-477bda10-d3de-4420-a220-87eb1d1d2b74 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1543 microversion: 2.1 time: 0.597062 Aug 02 06:52:01.118690 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 807/1544] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:00 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1543 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:52:01.123691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f433574b-c682-449b-9df8-4c5bd6c14697 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:01.124316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f433574b-c682-449b-9df8-4c5bd6c14697 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:01.164189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f433574b-c682-449b-9df8-4c5bd6c14697 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:01.164638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f433574b-c682-449b-9df8-4c5bd6c14697 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:01.165420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f433574b-c682-449b-9df8-4c5bd6c14697 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:01.165846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f433574b-c682-449b-9df8-4c5bd6c14697 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:01.179042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:01.567017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:01.628292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:01.766171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f433574b-c682-449b-9df8-4c5bd6c14697 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:01.779820 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f433574b-c682-449b-9df8-4c5bd6c14697 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 200 len: 1308 microversion: 2.1 time: 0.657367 Aug 02 06:52:01.781772 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 808/1545] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:01 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 1308 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:01.795373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-51fe000f-5a29-4a38-918f-96fd4ab6b72f tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b2be4c0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:01.879982 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-51fe000f-5a29-4a38-918f-96fd4ab6b72f tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.095052 Aug 02 06:52:01.880826 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 809/1546] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:01 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:01.961998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:02.123586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-daad56b5-b2ba-4de3-87af-769d00c644db tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:02.124771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-daad56b5-b2ba-4de3-87af-769d00c644db tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:02.144684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-daad56b5-b2ba-4de3-87af-769d00c644db tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:02.145714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-daad56b5-b2ba-4de3-87af-769d00c644db tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:02.148482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-daad56b5-b2ba-4de3-87af-769d00c644db tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:02.149131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-daad56b5-b2ba-4de3-87af-769d00c644db tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:02.530806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-daad56b5-b2ba-4de3-87af-769d00c644db tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:02.542283 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-daad56b5-b2ba-4de3-87af-769d00c644db tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1543 microversion: 2.1 time: 0.422730 Aug 02 06:52:02.545422 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 810/1547] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:02 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1543 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:52:02.802759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fe5830ef-d78b-4d39-a528-abc92f92a6b8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:02.804091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fe5830ef-d78b-4d39-a528-abc92f92a6b8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:02.822122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe5830ef-d78b-4d39-a528-abc92f92a6b8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:02.825611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe5830ef-d78b-4d39-a528-abc92f92a6b8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:02.826733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe5830ef-d78b-4d39-a528-abc92f92a6b8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:02.827432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe5830ef-d78b-4d39-a528-abc92f92a6b8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:03.298556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fe5830ef-d78b-4d39-a528-abc92f92a6b8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:03.310956 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fe5830ef-d78b-4d39-a528-abc92f92a6b8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 200 len: 1308 microversion: 2.1 time: 0.512398 Aug 02 06:52:03.327858 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 811/1548] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:02 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 1308 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:52:03.334264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0338d1ae-c038-4603-9e54-314b9fd362c9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b2bedc0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:03.447453 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0338d1ae-c038-4603-9e54-314b9fd362c9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.118286 Aug 02 06:52:03.448571 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 812/1549] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:03 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:03.571013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-af8d93aa-e3a8-47d6-ab52-7fd030c1db43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:03.571639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-af8d93aa-e3a8-47d6-ab52-7fd030c1db43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:03.578575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af8d93aa-e3a8-47d6-ab52-7fd030c1db43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:03.588016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af8d93aa-e3a8-47d6-ab52-7fd030c1db43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:03.593577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af8d93aa-e3a8-47d6-ab52-7fd030c1db43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:03.594365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af8d93aa-e3a8-47d6-ab52-7fd030c1db43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:03.972511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-af8d93aa-e3a8-47d6-ab52-7fd030c1db43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:03.985022 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-af8d93aa-e3a8-47d6-ab52-7fd030c1db43 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1543 microversion: 2.1 time: 0.417964 Aug 02 06:52:03.985640 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 813/1550] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:03 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1543 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:52:04.335386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7a44f173-85d7-4d50-b285-7057fe97582a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:04.336248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7a44f173-85d7-4d50-b285-7057fe97582a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:04.354576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a44f173-85d7-4d50-b285-7057fe97582a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:04.354934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a44f173-85d7-4d50-b285-7057fe97582a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:04.355745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a44f173-85d7-4d50-b285-7057fe97582a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:04.356253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a44f173-85d7-4d50-b285-7057fe97582a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:04.678299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7a44f173-85d7-4d50-b285-7057fe97582a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:04.691324 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7a44f173-85d7-4d50-b285-7057fe97582a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 200 len: 1308 microversion: 2.1 time: 0.359933 Aug 02 06:52:04.691987 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 814/1551] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:04 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 1308 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:04.706715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-124c878e-951f-44c2-9854-238b5aec2bc9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927ab1f4c0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:04.827572 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-124c878e-951f-44c2-9854-238b5aec2bc9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.134221 Aug 02 06:52:04.836526 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 815/1552] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:04 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:04.946237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6dc0282c-84a5-47dc-a8bc-14598ea3f218 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:04.949005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6dc0282c-84a5-47dc-a8bc-14598ea3f218 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:04.967035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dc0282c-84a5-47dc-a8bc-14598ea3f218 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:04.981474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dc0282c-84a5-47dc-a8bc-14598ea3f218 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:04.983315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dc0282c-84a5-47dc-a8bc-14598ea3f218 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:04.983957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dc0282c-84a5-47dc-a8bc-14598ea3f218 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:05.053580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6dc0282c-84a5-47dc-a8bc-14598ea3f218 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:52:05.298605 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6dc0282c-84a5-47dc-a8bc-14598ea3f218 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 204 len: 0 microversion: 2.1 time: 0.359209 Aug 02 06:52:05.299205 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 816/1553] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:52:04 2022] DELETE /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:52:05.305282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6fb16be1-1bdc-47e7-8135-b03f14771e02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:05.308887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6fb16be1-1bdc-47e7-8135-b03f14771e02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:05.334693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fb16be1-1bdc-47e7-8135-b03f14771e02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:05.335436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fb16be1-1bdc-47e7-8135-b03f14771e02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:05.337556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fb16be1-1bdc-47e7-8135-b03f14771e02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:05.338265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fb16be1-1bdc-47e7-8135-b03f14771e02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:05.589834 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4b1a9e13-d1be-4f96-989d-d9efacbc90f2 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/action" status: 202 len: 0 microversion: 2.25 time: 5.250221 Aug 02 06:52:05.593222 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 738/1554] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Aug 2 06:52:00 2022] POST /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/action => generated 0 bytes in 5254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:52:05.601365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-89d6a7f0-ef91-4a81-8b01-36aa338e598b tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:05.602439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-89d6a7f0-ef91-4a81-8b01-36aa338e598b tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:05.611818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89d6a7f0-ef91-4a81-8b01-36aa338e598b tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:05.612599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89d6a7f0-ef91-4a81-8b01-36aa338e598b tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:05.616516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89d6a7f0-ef91-4a81-8b01-36aa338e598b tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:05.617328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89d6a7f0-ef91-4a81-8b01-36aa338e598b tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:05.693180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6fb16be1-1bdc-47e7-8135-b03f14771e02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:05.707960 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6fb16be1-1bdc-47e7-8135-b03f14771e02 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1543 microversion: 2.1 time: 0.407142 Aug 02 06:52:05.708646 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 817/1555] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:05 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1543 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:05.928825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-581413701", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "e7daa7c3-28da-4cd4-bd17-d442f225add5"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:05.974855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-89d6a7f0-ef91-4a81-8b01-36aa338e598b tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:05.993578 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-89d6a7f0-ef91-4a81-8b01-36aa338e598b tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1663 microversion: 2.1 time: 0.398878 Aug 02 06:52:05.999917 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 739/1556] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:05 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1663 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:06.008017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7f83f473-2b16-49bb-b39d-72d24c594f70 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:06.010366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7f83f473-2b16-49bb-b39d-72d24c594f70 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:06.021795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f83f473-2b16-49bb-b39d-72d24c594f70 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:06.022657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f83f473-2b16-49bb-b39d-72d24c594f70 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:06.024459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f83f473-2b16-49bb-b39d-72d24c594f70 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:06.025085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f83f473-2b16-49bb-b39d-72d24c594f70 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:06.027038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] validate_networks() for [('e7daa7c3-28da-4cd4-bd17-d442f225add5', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:52:06.326549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7f83f473-2b16-49bb-b39d-72d24c594f70 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:06.335993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7f83f473-2b16-49bb-b39d-72d24c594f70 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:06.348312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7f83f473-2b16-49bb-b39d-72d24c594f70 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:06.349560 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7f83f473-2b16-49bb-b39d-72d24c594f70 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.347826 Aug 02 06:52:06.351085 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 740/1557] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:06 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:06.536763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4bc7e3cd-f2a0-4a35-99d5-a6118cf188d8 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'create', calling method: .version_select at 0x7f927b141790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1321247131", "description": "tempest-description-593933110"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:06.980433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:52:06.981308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:52:06.982059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:52:06.982634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:52:06.983442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:52:07.008180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:07.012516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:07.022600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:07.026000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:07.114221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Getting quotas for project 94205b5eec33455abafdf92687a0b44d. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:52:07.124907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Getting quotas for user 2907eb104d5a42a98df533459ce7b19a and project 94205b5eec33455abafdf92687a0b44d. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:52:07.197921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:52:07.214147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:52:07.344800 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aae214ad-f80d-4d49-b567-8c2c01258b65 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.635046 Aug 02 06:52:07.353231 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 818/1558] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:52:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:52:07.358636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1429be79-5fca-4ef6-a42f-6d56b99c4d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:07.365978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1429be79-5fca-4ef6-a42f-6d56b99c4d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:07.374692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1429be79-5fca-4ef6-a42f-6d56b99c4d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:07.375647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1429be79-5fca-4ef6-a42f-6d56b99c4d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:07.376852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1429be79-5fca-4ef6-a42f-6d56b99c4d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:07.377616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1429be79-5fca-4ef6-a42f-6d56b99c4d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:08.360074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1429be79-5fca-4ef6-a42f-6d56b99c4d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:08.384191 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1429be79-5fca-4ef6-a42f-6d56b99c4d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 200 len: 1308 microversion: 2.1 time: 1.024722 Aug 02 06:52:08.387948 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 819/1559] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:07 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 1308 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:08.407272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f59fd9d7-a939-4827-89d1-c29f62aed6dd tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b8dad30>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:08.428321 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4bc7e3cd-f2a0-4a35-99d5-a6118cf188d8 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.075918 Aug 02 06:52:08.428930 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 741/1560] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:52:06 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:08.444506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e819328e-0198-4c67-a0ea-211a3b16556d req-cdfd0669-9564-474a-bcc3-82695085fd19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4d0bb5-a719-464e-89ef-83065ae7f8bd", "name": "network-vif-unplugged", "status": "completed", "tag": "2cfda67e-633a-4a79-a15b-8314f7622ae0"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:08.529205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e819328e-0198-4c67-a0ea-211a3b16556d req-cdfd0669-9564-474a-bcc3-82695085fd19 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:08.532380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e819328e-0198-4c67-a0ea-211a3b16556d req-cdfd0669-9564-474a-bcc3-82695085fd19 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:08.573789 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f59fd9d7-a939-4827-89d1-c29f62aed6dd tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.180150 Aug 02 06:52:08.576777 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e819328e-0198-4c67-a0ea-211a3b16556d req-cdfd0669-9564-474a-bcc3-82695085fd19 service nova] Creating event network-vif-unplugged:2cfda67e-633a-4a79-a15b-8314f7622ae0 for instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd on n-h1-851337-3 Aug 02 06:52:08.592837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-e819328e-0198-4c67-a0ea-211a3b16556d req-cdfd0669-9564-474a-bcc3-82695085fd19 service nova] Instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 06:52:08.605719 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 820/1561] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:08 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:08.606700 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e819328e-0198-4c67-a0ea-211a3b16556d req-cdfd0669-9564-474a-bcc3-82695085fd19 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167225 Aug 02 06:52:08.609751 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 742/1562] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:08.618688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-46124148-0795-4674-ab80-c94a0ec0cf79 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:08.619696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-46124148-0795-4674-ab80-c94a0ec0cf79 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:08.625024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc342813-2acc-4100-812c-4ed406723f31 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:08.625871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bc342813-2acc-4100-812c-4ed406723f31 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:08.640796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46124148-0795-4674-ab80-c94a0ec0cf79 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:08.641598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46124148-0795-4674-ab80-c94a0ec0cf79 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:08.642696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46124148-0795-4674-ab80-c94a0ec0cf79 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:08.643524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46124148-0795-4674-ab80-c94a0ec0cf79 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:08.650540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc342813-2acc-4100-812c-4ed406723f31 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:08.652340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc342813-2acc-4100-812c-4ed406723f31 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:08.655834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc342813-2acc-4100-812c-4ed406723f31 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:08.656372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc342813-2acc-4100-812c-4ed406723f31 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:09.338242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-46124148-0795-4674-ab80-c94a0ec0cf79 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:09.348200 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-46124148-0795-4674-ab80-c94a0ec0cf79 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1663 microversion: 2.1 time: 0.736689 Aug 02 06:52:09.356075 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 743/1563] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:08 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1663 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:09.361909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1be541a7-00fa-4cd6-a68d-c9723067ed55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:09.366705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1be541a7-00fa-4cd6-a68d-c9723067ed55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:09.381815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1be541a7-00fa-4cd6-a68d-c9723067ed55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:09.390396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1be541a7-00fa-4cd6-a68d-c9723067ed55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:09.398797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1be541a7-00fa-4cd6-a68d-c9723067ed55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:09.399277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1be541a7-00fa-4cd6-a68d-c9723067ed55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:09.418696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bc342813-2acc-4100-812c-4ed406723f31 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:09.426565 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc342813-2acc-4100-812c-4ed406723f31 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1474 microversion: 2.1 time: 0.817398 Aug 02 06:52:09.427444 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 821/1564] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:08 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1474 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:09.454955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-36af15c3-a351-4193-b25a-23b7b96ce7bc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:09.471354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-36af15c3-a351-4193-b25a-23b7b96ce7bc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:09.485353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36af15c3-a351-4193-b25a-23b7b96ce7bc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:09.487887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36af15c3-a351-4193-b25a-23b7b96ce7bc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:09.490512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36af15c3-a351-4193-b25a-23b7b96ce7bc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:09.491149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36af15c3-a351-4193-b25a-23b7b96ce7bc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:09.514694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:09.700081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1be541a7-00fa-4cd6-a68d-c9723067ed55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2907eb104d5a42a98df533459ce7b19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94205b5eec33455abafdf92687a0b44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:09.709043 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1be541a7-00fa-4cd6-a68d-c9723067ed55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 200 len: 1275 microversion: 2.1 time: 0.351485 Aug 02 06:52:09.711513 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 744/1565] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:09 2022] GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 1275 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:09.725450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-81a02404-c9c5-4586-ac9d-7956614d2ab9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'create', calling method: .version_select at 0x7f927afbb700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1529541122", "description": "tempest-description-1582416762"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:10.213379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-36af15c3-a351-4193-b25a-23b7b96ce7bc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:10.227552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-36af15c3-a351-4193-b25a-23b7b96ce7bc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:10.229546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-36af15c3-a351-4193-b25a-23b7b96ce7bc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:10.237253 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-36af15c3-a351-4193-b25a-23b7b96ce7bc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.798666 Aug 02 06:52:10.238614 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 822/1566] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:09 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:10.255000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bee49ba4-ef7c-4ff0-86df-a95ba0d088eb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:10.255915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bee49ba4-ef7c-4ff0-86df-a95ba0d088eb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:10.263763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bee49ba4-ef7c-4ff0-86df-a95ba0d088eb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:10.266616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bee49ba4-ef7c-4ff0-86df-a95ba0d088eb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:10.270505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bee49ba4-ef7c-4ff0-86df-a95ba0d088eb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:10.271182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bee49ba4-ef7c-4ff0-86df-a95ba0d088eb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:10.877772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bee49ba4-ef7c-4ff0-86df-a95ba0d088eb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:10.895163 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bee49ba4-ef7c-4ff0-86df-a95ba0d088eb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 200 len: 1308 microversion: 2.1 time: 0.655054 Aug 02 06:52:10.899698 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 823/1567] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:10 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 1308 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:10.917313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-865af4fc-f959-474e-8862-e6ed8cec9b76 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b2bcaf0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:11.045121 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-865af4fc-f959-474e-8862-e6ed8cec9b76 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.141943 Aug 02 06:52:11.054228 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 824/1568] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:10 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:11.070441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5c91e360-59ab-454b-a8de-4e79455e4eb8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:11.071397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5c91e360-59ab-454b-a8de-4e79455e4eb8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:11.088603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c91e360-59ab-454b-a8de-4e79455e4eb8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:11.089666 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c91e360-59ab-454b-a8de-4e79455e4eb8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:11.090812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c91e360-59ab-454b-a8de-4e79455e4eb8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:11.092871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c91e360-59ab-454b-a8de-4e79455e4eb8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:11.197705 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-81a02404-c9c5-4586-ac9d-7956614d2ab9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.484998 Aug 02 06:52:11.200060 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 745/1569] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:52:09 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:11.205099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e19f273d-379a-432f-ae7d-c5098af7608f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:11.205866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e19f273d-379a-432f-ae7d-c5098af7608f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:11.220129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e19f273d-379a-432f-ae7d-c5098af7608f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:11.223376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e19f273d-379a-432f-ae7d-c5098af7608f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:11.227879 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e19f273d-379a-432f-ae7d-c5098af7608f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:11.228504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e19f273d-379a-432f-ae7d-c5098af7608f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:11.589621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5c91e360-59ab-454b-a8de-4e79455e4eb8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9511242e31e54439b66b917cf6419e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e0c0cd8e0848ad85a389e2aed4129d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:11.636316 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5c91e360-59ab-454b-a8de-4e79455e4eb8 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 200 len: 1595 microversion: 2.1 time: 0.569690 Aug 02 06:52:11.638511 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 825/1570] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:11 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 1595 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:11.667175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-21f7116b-dbf1-44ee-80d1-957d7a2aa1b3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:11.667827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-21f7116b-dbf1-44ee-80d1-957d7a2aa1b3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:11.681372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21f7116b-dbf1-44ee-80d1-957d7a2aa1b3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:11.687537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21f7116b-dbf1-44ee-80d1-957d7a2aa1b3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:11.688677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21f7116b-dbf1-44ee-80d1-957d7a2aa1b3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:11.689277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21f7116b-dbf1-44ee-80d1-957d7a2aa1b3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:12.690299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e19f273d-379a-432f-ae7d-c5098af7608f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:12.699646 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e19f273d-379a-432f-ae7d-c5098af7608f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1471 microversion: 2.1 time: 1.498305 Aug 02 06:52:12.704831 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 746/1571] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:11 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1471 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:12.715375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ded3ba19-5be6-40e3-8a13-872aed126d08 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:12.715773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-21f7116b-dbf1-44ee-80d1-957d7a2aa1b3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2907eb104d5a42a98df533459ce7b19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94205b5eec33455abafdf92687a0b44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:12.724504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ded3ba19-5be6-40e3-8a13-872aed126d08 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:12.738496 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-21f7116b-dbf1-44ee-80d1-957d7a2aa1b3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 200 len: 1315 microversion: 2.1 time: 1.078351 Aug 02 06:52:12.740354 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 826/1572] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:11 2022] GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 1315 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:12.762671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ded3ba19-5be6-40e3-8a13-872aed126d08 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:12.768084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ded3ba19-5be6-40e3-8a13-872aed126d08 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:12.768862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-465c08c1-79d4-47e8-a6e8-9c2824494f02 req-8f6ddbe2-b4e2-4281-9764-05cd41a7e22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "218c6c00-857e-42d7-82d4-eb818faf1f07", "name": "network-vif-plugged", "status": "completed", "tag": "d333a6ac-1957-4aac-9862-415ec3c70230"}, {"server_uuid": "b003bc53-efff-4972-b91f-708548e21cdc", "name": "network-vif-unplugged", "status": "completed", "tag": "cc670dfd-7324-4c85-af7b-b8939618558c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:12.771015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ded3ba19-5be6-40e3-8a13-872aed126d08 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:12.775075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ded3ba19-5be6-40e3-8a13-872aed126d08 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:12.818089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:12.829053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-465c08c1-79d4-47e8-a6e8-9c2824494f02 req-8f6ddbe2-b4e2-4281-9764-05cd41a7e22d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:12.829685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-465c08c1-79d4-47e8-a6e8-9c2824494f02 req-8f6ddbe2-b4e2-4281-9764-05cd41a7e22d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:12.908187 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-465c08c1-79d4-47e8-a6e8-9c2824494f02 req-8f6ddbe2-b4e2-4281-9764-05cd41a7e22d service nova] Creating event network-vif-plugged:d333a6ac-1957-4aac-9862-415ec3c70230 for instance 218c6c00-857e-42d7-82d4-eb818faf1f07 on n-h1-851337-3 Aug 02 06:52:12.910593 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-465c08c1-79d4-47e8-a6e8-9c2824494f02 req-8f6ddbe2-b4e2-4281-9764-05cd41a7e22d service nova] Creating event network-vif-unplugged:cc670dfd-7324-4c85-af7b-b8939618558c for instance b003bc53-efff-4972-b91f-708548e21cdc on n-h2-851337-3 Aug 02 06:52:12.982484 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-465c08c1-79d4-47e8-a6e8-9c2824494f02 req-8f6ddbe2-b4e2-4281-9764-05cd41a7e22d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.236921 Aug 02 06:52:12.991437 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 827/1573] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:13.009226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1192200775", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "e898f800-f4dc-4788-bd44-0759af836ad2"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:13.181255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] validate_networks() for [('e898f800-f4dc-4788-bd44-0759af836ad2', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:52:13.661519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ded3ba19-5be6-40e3-8a13-872aed126d08 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:13.675952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ded3ba19-5be6-40e3-8a13-872aed126d08 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:13.678839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ded3ba19-5be6-40e3-8a13-872aed126d08 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:13.691663 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ded3ba19-5be6-40e3-8a13-872aed126d08 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.984927 Aug 02 06:52:13.714054 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 747/1574] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:12 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:13.719582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-671daf06-5cb5-4f7c-b160-60a6dc963785 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:13.730629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-671daf06-5cb5-4f7c-b160-60a6dc963785 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:13.766501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-671daf06-5cb5-4f7c-b160-60a6dc963785 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:13.767354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-671daf06-5cb5-4f7c-b160-60a6dc963785 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:13.773299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-671daf06-5cb5-4f7c-b160-60a6dc963785 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:13.774127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-671daf06-5cb5-4f7c-b160-60a6dc963785 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:14.307171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:52:14.308533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:52:14.309244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:52:14.309851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:52:14.310496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:52:14.316749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-671daf06-5cb5-4f7c-b160-60a6dc963785 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:14.324512 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-671daf06-5cb5-4f7c-b160-60a6dc963785 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 200 len: 1308 microversion: 2.1 time: 0.608885 Aug 02 06:52:14.326320 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 748/1575] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:13 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 1308 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:14.326966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:14.327420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:14.331697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:14.332226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-99e0f637-459b-465d-a484-2fdb930ce693 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b10d1f0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:14.332352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:14.402616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Getting quotas for project ab7a54e20f2c4619b6bc10fd918cc539. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:52:14.408776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Getting quotas for user 3ac74e3e74b24a6a861fbc774fd9fab6 and project ab7a54e20f2c4619b6bc10fd918cc539. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:52:14.416964 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-99e0f637-459b-465d-a484-2fdb930ce693 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1453 microversion: 2.1 time: 0.088893 Aug 02 06:52:14.418209 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 749/1576] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:14 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:14.429714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-26062e94-ec9d-4d8b-8139-2a0343956bc1 req-5009fcd9-8d5f-4756-baa6-bd9da1bf703c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b003bc53-efff-4972-b91f-708548e21cdc", "name": "network-vif-deleted", "tag": "cc670dfd-7324-4c85-af7b-b8939618558c"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:14.452240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-26062e94-ec9d-4d8b-8139-2a0343956bc1 req-5009fcd9-8d5f-4756-baa6-bd9da1bf703c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:14.455901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-26062e94-ec9d-4d8b-8139-2a0343956bc1 req-5009fcd9-8d5f-4756-baa6-bd9da1bf703c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:14.457241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:52:14.464543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:52:14.475512 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-26062e94-ec9d-4d8b-8139-2a0343956bc1 req-5009fcd9-8d5f-4756-baa6-bd9da1bf703c service nova] Creating event network-vif-deleted:cc670dfd-7324-4c85-af7b-b8939618558c for instance b003bc53-efff-4972-b91f-708548e21cdc on n-h2-851337-3 Aug 02 06:52:14.497208 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-26062e94-ec9d-4d8b-8139-2a0343956bc1 req-5009fcd9-8d5f-4756-baa6-bd9da1bf703c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071810 Aug 02 06:52:14.501163 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 750/1577] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:14.510215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cd119216-dabb-4fa1-a39f-781dc162457a tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:14.511277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cd119216-dabb-4fa1-a39f-781dc162457a tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] [instance: b003bc53-efff-4972-b91f-708548e21cdc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:14.530920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd119216-dabb-4fa1-a39f-781dc162457a tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:14.534239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd119216-dabb-4fa1-a39f-781dc162457a tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:14.535562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd119216-dabb-4fa1-a39f-781dc162457a tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:14.539851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd119216-dabb-4fa1-a39f-781dc162457a tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:14.567655 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-cd119216-dabb-4fa1-a39f-781dc162457a tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] HTTP exception thrown: Instance b003bc53-efff-4972-b91f-708548e21cdc could not be found. Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cd119216-dabb-4fa1-a39f-781dc162457a tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Request method failure captured: Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc HTTP/1.1 Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MlOQPzSZC5lLSJbdZiRgHYCICghuI38jS_gdV-mVKtbj4btw7pIBSZERT2lxSCshMchc-I-oRSpfNHJnKkfTE1z7weTJxJnlu2WnDJeupqQT-JF3hu6OwFI_iljkmRTUt6LOMnWj3zyPgQnfNr7jTM0LzAqRyWCE9NLcfnXm_L7xvw Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 33e0c0cd8e0848ad85a389e2aed4129d Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersTestFqdnHostnames-1643106260 Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:52:14.569662 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:52:14.571202 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/33e0c0cd8e0848ad85a389e2aed4129d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/33e0c0cd8e0848ad85a389e2aed4129d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_33e0c0cd8e0848ad85a389e2aed4129d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/33e0c0cd8e0848ad85a389e2aed4129d"}]}] Aug 02 06:52:14.571202 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersTestFqdnHostnames-1643106260 Aug 02 06:52:14.571202 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 33e0c0cd8e0848ad85a389e2aed4129d Aug 02 06:52:14.571202 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1643106260 Aug 02 06:52:14.571202 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersTestFqdnHostnames-1643106260-project Aug 02 06:52:14.571202 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:52:14.571202 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:52:14.571202 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 9511242e31e54439b66b917cf6419e70 Aug 02 06:52:14.571202 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersTestFqdnHostnames-1643106260-project Aug 02 06:52:14.571202 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:52:14.571202 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance b003bc53-efff-4972-b91f-708548e21cdc could not be found. Aug 02 06:52:14.571202 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'b003bc53-efff-4972-b91f-708548e21cdc'} Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b003bc53-efff-4972-b91f-708548e21cdc could not be found. Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:14.572931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b003bc53-efff-4972-b91f-708548e21cdc could not be found. Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b003bc53-efff-4972-b91f-708548e21cdc could not be found. Aug 02 06:52:14.574576 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:14.577192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cd119216-dabb-4fa1-a39f-781dc162457a tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Returning 404 to user: Instance b003bc53-efff-4972-b91f-708548e21cdc could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:14.578253 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cd119216-dabb-4fa1-a39f-781dc162457a tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc" status: 404 len: 111 microversion: 2.1 time: 0.075685 Aug 02 06:52:14.579465 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 751/1578] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:14 2022] GET /compute/v2.1/servers/b003bc53-efff-4972-b91f-708548e21cdc => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:52:14.590397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-663d5eb4-27a3-41fe-a3f3-b6c71068cf92 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:14.591184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-663d5eb4-27a3-41fe-a3f3-b6c71068cf92 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:14.602402 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-267ae500-5a86-443d-b240-0c8c38be1e63 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.608525 Aug 02 06:52:14.604418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-663d5eb4-27a3-41fe-a3f3-b6c71068cf92 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:14.605270 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 828/1579] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:52:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:52:14.607681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-663d5eb4-27a3-41fe-a3f3-b6c71068cf92 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:14.608728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-663d5eb4-27a3-41fe-a3f3-b6c71068cf92 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:14.609332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-663d5eb4-27a3-41fe-a3f3-b6c71068cf92 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:14.618114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1884d1d0-4f03-4b4b-99d1-33c9423d559a tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:14.621810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1884d1d0-4f03-4b4b-99d1-33c9423d559a tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:14.641620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1884d1d0-4f03-4b4b-99d1-33c9423d559a tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:14.642475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1884d1d0-4f03-4b4b-99d1-33c9423d559a tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:14.644166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1884d1d0-4f03-4b4b-99d1-33c9423d559a tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:14.644983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1884d1d0-4f03-4b4b-99d1-33c9423d559a tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:14.731708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-663d5eb4-27a3-41fe-a3f3-b6c71068cf92 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:14.733592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-663d5eb4-27a3-41fe-a3f3-b6c71068cf92 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:14.736835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-663d5eb4-27a3-41fe-a3f3-b6c71068cf92 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:14.738947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-663d5eb4-27a3-41fe-a3f3-b6c71068cf92 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:14.856380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-663d5eb4-27a3-41fe-a3f3-b6c71068cf92 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Getting quotas for project 1e08c65240da4f90a190b2da77a8ff92. Resources: {'ram', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:52:14.868408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-663d5eb4-27a3-41fe-a3f3-b6c71068cf92 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Getting quotas for user 87d1c9cb22d34aaa8b86860b84a1086d and project 1e08c65240da4f90a190b2da77a8ff92. Resources: {'ram', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:52:15.025469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1884d1d0-4f03-4b4b-99d1-33c9423d559a tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2907eb104d5a42a98df533459ce7b19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94205b5eec33455abafdf92687a0b44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:15.054271 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1884d1d0-4f03-4b4b-99d1-33c9423d559a tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 200 len: 1315 microversion: 2.1 time: 0.441454 Aug 02 06:52:15.055309 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 829/1580] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:14 2022] GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:15.071710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6212e26f-6125-48e3-a7c9-a7f3382350cf req-cb28f0ad-9a17-41d0-ad63-f9acb775ee1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed0a557-785a-4d8d-b61b-dc832c917a27", "tag": "1beed784-ff8a-4f34-ac51-cd23533e8be7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:15.147315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6212e26f-6125-48e3-a7c9-a7f3382350cf req-cb28f0ad-9a17-41d0-ad63-f9acb775ee1f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:15.147760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6212e26f-6125-48e3-a7c9-a7f3382350cf req-cb28f0ad-9a17-41d0-ad63-f9acb775ee1f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:15.162757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:15.193260 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-6212e26f-6125-48e3-a7c9-a7f3382350cf req-cb28f0ad-9a17-41d0-ad63-f9acb775ee1f service nova] Creating event network-changed:1beed784-ff8a-4f34-ac51-cd23533e8be7 for instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 on n-h2-851337-3 Aug 02 06:52:15.202047 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-663d5eb4-27a3-41fe-a3f3-b6c71068cf92 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "POST /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd/action" status: 202 len: 0 microversion: 2.1 time: 0.617823 Aug 02 06:52:15.204242 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 752/1581] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:52:14 2022] POST /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:52:15.220574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-adb9aaf0-3b39-4dbc-b332-5654ef40df36 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] Calling method '.version_select at 0x7f927b6ca0d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:15.236197 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6212e26f-6125-48e3-a7c9-a7f3382350cf req-cb28f0ad-9a17-41d0-ad63-f9acb775ee1f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179348 Aug 02 06:52:15.237474 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 830/1582] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:15.264969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f9f414f0-e369-4402-bdcb-2ef24c52c642 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:15.267791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f9f414f0-e369-4402-bdcb-2ef24c52c642 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:15.282329 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-adb9aaf0-3b39-4dbc-b332-5654ef40df36 tempest-ServersTestFqdnHostnames-1643106260 tempest-ServersTestFqdnHostnames-1643106260-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-71942948" status: 202 len: 0 microversion: 2.1 time: 0.075574 Aug 02 06:52:15.287530 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 753/1583] 10.222.0.79 () {58 vars in 1215 bytes} [Tue Aug 2 06:52:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-71942948 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:52:15.292973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e3894639-1f67-4843-b8c9-b7dfcfd9388f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:15.294907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e3894639-1f67-4843-b8c9-b7dfcfd9388f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:15.316764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3894639-1f67-4843-b8c9-b7dfcfd9388f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:15.318739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3894639-1f67-4843-b8c9-b7dfcfd9388f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:15.321570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3894639-1f67-4843-b8c9-b7dfcfd9388f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:15.322416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3894639-1f67-4843-b8c9-b7dfcfd9388f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:15.581157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f9f414f0-e369-4402-bdcb-2ef24c52c642 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:15.590873 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f9f414f0-e369-4402-bdcb-2ef24c52c642 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1216 microversion: 2.1 time: 0.350495 Aug 02 06:52:15.594949 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 831/1584] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:15 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1216 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:15.661596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b304ad71-0b5a-4c43-b42d-4f19fff52f78 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:15.662876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b304ad71-0b5a-4c43-b42d-4f19fff52f78 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:15.671551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b304ad71-0b5a-4c43-b42d-4f19fff52f78 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:15.672409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b304ad71-0b5a-4c43-b42d-4f19fff52f78 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:15.673471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b304ad71-0b5a-4c43-b42d-4f19fff52f78 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:15.674147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b304ad71-0b5a-4c43-b42d-4f19fff52f78 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:16.036005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e3894639-1f67-4843-b8c9-b7dfcfd9388f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:16.070575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e3894639-1f67-4843-b8c9-b7dfcfd9388f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:16.072382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e3894639-1f67-4843-b8c9-b7dfcfd9388f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:16.073940 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e3894639-1f67-4843-b8c9-b7dfcfd9388f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.785825 Aug 02 06:52:16.077868 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 754/1585] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:15 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:16.094885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-44613ae5-b3a3-40c5-85db-2a44d8830f2a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:16.095668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-44613ae5-b3a3-40c5-85db-2a44d8830f2a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:16.102400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44613ae5-b3a3-40c5-85db-2a44d8830f2a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:16.103008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44613ae5-b3a3-40c5-85db-2a44d8830f2a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:16.103937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44613ae5-b3a3-40c5-85db-2a44d8830f2a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:16.104225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b304ad71-0b5a-4c43-b42d-4f19fff52f78 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:16.105266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44613ae5-b3a3-40c5-85db-2a44d8830f2a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:16.117040 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b304ad71-0b5a-4c43-b42d-4f19fff52f78 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1470 microversion: 2.1 time: 0.517960 Aug 02 06:52:16.120055 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 832/1586] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:15 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1470 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:16.125050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-63632ba9-4e69-45b9-b7bd-7949503a4491 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b25d4c0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:16.182826 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-63632ba9-4e69-45b9-b7bd-7949503a4491 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1462 microversion: 2.1 time: 0.061656 Aug 02 06:52:16.201080 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 833/1587] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:16 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1462 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:16.223081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-76b6b5d7-f5aa-4998-9759-f8730393b244 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:16.224453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-76b6b5d7-f5aa-4998-9759-f8730393b244 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:16.278573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76b6b5d7-f5aa-4998-9759-f8730393b244 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:16.279024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76b6b5d7-f5aa-4998-9759-f8730393b244 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:16.280297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76b6b5d7-f5aa-4998-9759-f8730393b244 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:16.286709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76b6b5d7-f5aa-4998-9759-f8730393b244 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:16.600122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-76b6b5d7-f5aa-4998-9759-f8730393b244 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2907eb104d5a42a98df533459ce7b19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94205b5eec33455abafdf92687a0b44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:16.611288 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-76b6b5d7-f5aa-4998-9759-f8730393b244 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 200 len: 1315 microversion: 2.1 time: 0.417371 Aug 02 06:52:16.612047 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 834/1588] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:16 2022] GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:16.617858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44613ae5-b3a3-40c5-85db-2a44d8830f2a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:16.630330 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-44613ae5-b3a3-40c5-85db-2a44d8830f2a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 200 len: 1488 microversion: 2.1 time: 0.551146 Aug 02 06:52:16.630930 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 755/1589] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:16 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 1488 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:16.654996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-13a4ebf0-4ca7-4f54-afb4-8304fa4bb9ee req-060a7bb7-c506-465e-b7be-69d542268f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4d0bb5-a719-464e-89ef-83065ae7f8bd", "name": "network-vif-plugged", "status": "completed", "tag": "2cfda67e-633a-4a79-a15b-8314f7622ae0"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:16.656214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b4365bac-587b-4187-b1db-b273e13840db tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f928c2e1820>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:16.675111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-13a4ebf0-4ca7-4f54-afb4-8304fa4bb9ee req-060a7bb7-c506-465e-b7be-69d542268f0d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:16.678734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-13a4ebf0-4ca7-4f54-afb4-8304fa4bb9ee req-060a7bb7-c506-465e-b7be-69d542268f0d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:16.712404 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-13a4ebf0-4ca7-4f54-afb4-8304fa4bb9ee req-060a7bb7-c506-465e-b7be-69d542268f0d service nova] Creating event network-vif-plugged:2cfda67e-633a-4a79-a15b-8314f7622ae0 for instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd on n-h1-851337-3 Aug 02 06:52:16.728542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-13a4ebf0-4ca7-4f54-afb4-8304fa4bb9ee req-060a7bb7-c506-465e-b7be-69d542268f0d service nova] Instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 06:52:16.745602 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b4365bac-587b-4187-b1db-b273e13840db tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 200 len: 1462 microversion: 2.1 time: 0.130980 Aug 02 06:52:16.754886 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-13a4ebf0-4ca7-4f54-afb4-8304fa4bb9ee req-060a7bb7-c506-465e-b7be-69d542268f0d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097309 Aug 02 06:52:16.754886 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 756/1590] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:16.755135 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 835/1591] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:16 2022] GET /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 1462 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:16.759734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a4ef3f58-df51-4e18-9bd3-b721e3b2545a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:16.764058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a4ef3f58-df51-4e18-9bd3-b721e3b2545a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:16.764226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d888a25e-47ae-4c28-b39d-a2670d303a7f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:16.764664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d888a25e-47ae-4c28-b39d-a2670d303a7f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:16.777770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4ef3f58-df51-4e18-9bd3-b721e3b2545a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:16.780461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4ef3f58-df51-4e18-9bd3-b721e3b2545a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:16.781460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4ef3f58-df51-4e18-9bd3-b721e3b2545a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:16.785049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4ef3f58-df51-4e18-9bd3-b721e3b2545a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:16.805013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d888a25e-47ae-4c28-b39d-a2670d303a7f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:16.810286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d888a25e-47ae-4c28-b39d-a2670d303a7f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:16.812034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d888a25e-47ae-4c28-b39d-a2670d303a7f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:16.814006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d888a25e-47ae-4c28-b39d-a2670d303a7f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:17.003154 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d888a25e-47ae-4c28-b39d-a2670d303a7f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "POST /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07/action" status: 202 len: 0 microversion: 2.1 time: 0.248680 Aug 02 06:52:17.004356 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 836/1592] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:52:16 2022] POST /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:52:17.014979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f3721a0c-4312-4905-9464-87499e8f15af tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:17.016682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f3721a0c-4312-4905-9464-87499e8f15af tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: 6e35b665-80f8-4add-8c4f-edeb762a78fa] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:17.025310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3721a0c-4312-4905-9464-87499e8f15af tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:17.026415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3721a0c-4312-4905-9464-87499e8f15af tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:17.027508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3721a0c-4312-4905-9464-87499e8f15af tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:17.028150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3721a0c-4312-4905-9464-87499e8f15af tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:17.599231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a4ef3f58-df51-4e18-9bd3-b721e3b2545a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:17.612663 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a4ef3f58-df51-4e18-9bd3-b721e3b2545a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1276 microversion: 2.1 time: 0.860281 Aug 02 06:52:17.626137 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 757/1593] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:16 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1276 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:17.626137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c6cbf27a-85e1-4b8d-a8c3-2cac2be342e1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:17.626752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c6cbf27a-85e1-4b8d-a8c3-2cac2be342e1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:17.642276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6cbf27a-85e1-4b8d-a8c3-2cac2be342e1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:17.642753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6cbf27a-85e1-4b8d-a8c3-2cac2be342e1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:17.643548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6cbf27a-85e1-4b8d-a8c3-2cac2be342e1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:17.647071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6cbf27a-85e1-4b8d-a8c3-2cac2be342e1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:17.691046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f3721a0c-4312-4905-9464-87499e8f15af tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:17.703398 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f3721a0c-4312-4905-9464-87499e8f15af tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa" status: 200 len: 1468 microversion: 2.1 time: 0.692490 Aug 02 06:52:17.713962 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 837/1594] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:17 2022] GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa => generated 1468 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:17.713962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e9f755dc-0b4b-4ef3-837d-75bdb0778d83 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:17.713962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e9f755dc-0b4b-4ef3-837d-75bdb0778d83 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:17.721261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9f755dc-0b4b-4ef3-837d-75bdb0778d83 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:17.722115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9f755dc-0b4b-4ef3-837d-75bdb0778d83 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:17.723862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9f755dc-0b4b-4ef3-837d-75bdb0778d83 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:17.724734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9f755dc-0b4b-4ef3-837d-75bdb0778d83 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:17.899043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c6cbf27a-85e1-4b8d-a8c3-2cac2be342e1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:17.912486 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c6cbf27a-85e1-4b8d-a8c3-2cac2be342e1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 200 len: 1473 microversion: 2.1 time: 0.295768 Aug 02 06:52:17.917747 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 758/1595] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:17 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 1473 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:17.923293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0a78d28f-08ac-44e1-98d4-bdd723103017 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:17.924198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0a78d28f-08ac-44e1-98d4-bdd723103017 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:17.945063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a78d28f-08ac-44e1-98d4-bdd723103017 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:17.946178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a78d28f-08ac-44e1-98d4-bdd723103017 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:17.947223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a78d28f-08ac-44e1-98d4-bdd723103017 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:17.948493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a78d28f-08ac-44e1-98d4-bdd723103017 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:17.977240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e9f755dc-0b4b-4ef3-837d-75bdb0778d83 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:17.991445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e9f755dc-0b4b-4ef3-837d-75bdb0778d83 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:17.994750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e9f755dc-0b4b-4ef3-837d-75bdb0778d83 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:17.996768 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e9f755dc-0b4b-4ef3-837d-75bdb0778d83 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.290308 Aug 02 06:52:18.011096 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 838/1596] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:17 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:18.020803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-36dff489-3435-4667-b8c8-6765e6060fb9 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:18.022274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-36dff489-3435-4667-b8c8-6765e6060fb9 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:18.043156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36dff489-3435-4667-b8c8-6765e6060fb9 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:18.051101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36dff489-3435-4667-b8c8-6765e6060fb9 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:18.052520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36dff489-3435-4667-b8c8-6765e6060fb9 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:18.053187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36dff489-3435-4667-b8c8-6765e6060fb9 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:18.203070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0a78d28f-08ac-44e1-98d4-bdd723103017 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:18.216778 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0a78d28f-08ac-44e1-98d4-bdd723103017 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1470 microversion: 2.1 time: 0.297548 Aug 02 06:52:18.218189 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 759/1597] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:17 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:18.237482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b8b6306f-8b06-43d4-bde2-365077538442 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-383122095"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:18.241624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b8b6306f-8b06-43d4-bde2-365077538442 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:18.245148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-36dff489-3435-4667-b8c8-6765e6060fb9 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2907eb104d5a42a98df533459ce7b19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94205b5eec33455abafdf92687a0b44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:18.249239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8b6306f-8b06-43d4-bde2-365077538442 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:18.249929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8b6306f-8b06-43d4-bde2-365077538442 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:18.251936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8b6306f-8b06-43d4-bde2-365077538442 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:18.253117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8b6306f-8b06-43d4-bde2-365077538442 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:18.254244 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-36dff489-3435-4667-b8c8-6765e6060fb9 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 200 len: 1315 microversion: 2.1 time: 0.241174 Aug 02 06:52:18.255356 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 839/1598] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:18 2022] GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:18.260141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a31416ed-9aa4-4e52-9bcb-c066dc2d9faf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-905107525"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:18.262893 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a31416ed-9aa4-4e52-9bcb-c066dc2d9faf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:18.269311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a31416ed-9aa4-4e52-9bcb-c066dc2d9faf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:18.269830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a31416ed-9aa4-4e52-9bcb-c066dc2d9faf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:18.271034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a31416ed-9aa4-4e52-9bcb-c066dc2d9faf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:18.271446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a31416ed-9aa4-4e52-9bcb-c066dc2d9faf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:18.512474 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a31416ed-9aa4-4e52-9bcb-c066dc2d9faf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "POST /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07/action" status: 202 len: 0 microversion: 2.1 time: 0.255688 Aug 02 06:52:18.513489 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 840/1599] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:52:18 2022] POST /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 02 06:52:18.525252 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b8b6306f-8b06-43d4-bde2-365077538442 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "POST /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b/action" status: 202 len: 0 microversion: 2.1 time: 0.293147 Aug 02 06:52:18.526006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a0920a8b-f02d-482e-9d23-ebac384f1deb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927b2bea60>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:18.532774 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 760/1600] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:52:18 2022] POST /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 02 06:52:18.539976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d2b593df-5b9d-4db1-91f9-a821098ddd21 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b22d430>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:18.639409 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a0920a8b-f02d-482e-9d23-ebac384f1deb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 200 len: 1413 microversion: 2.1 time: 0.118218 Aug 02 06:52:18.639998 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 841/1601] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:18 2022] GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:18.642655 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d2b593df-5b9d-4db1-91f9-a821098ddd21 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3" status: 200 len: 1452 microversion: 2.1 time: 0.108197 Aug 02 06:52:18.651543 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 761/1602] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:18 2022] GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3 => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:18.653099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bf13e19a-fcaa-4bd4-956f-e30b091cc78c tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:18.653939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bf13e19a-fcaa-4bd4-956f-e30b091cc78c tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:18.662348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf13e19a-fcaa-4bd4-956f-e30b091cc78c tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:18.662825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf13e19a-fcaa-4bd4-956f-e30b091cc78c tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:18.663820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf13e19a-fcaa-4bd4-956f-e30b091cc78c tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:18.664428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf13e19a-fcaa-4bd4-956f-e30b091cc78c tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:18.758116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bf13e19a-fcaa-4bd4-956f-e30b091cc78c tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:18.769865 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bf13e19a-fcaa-4bd4-956f-e30b091cc78c tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1274 microversion: 2.1 time: 0.128399 Aug 02 06:52:18.785175 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 842/1603] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:18 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:19.021177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab74f632-2542-417f-908d-fdef59db5ff9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:19.022376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ab74f632-2542-417f-908d-fdef59db5ff9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:19.036922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab74f632-2542-417f-908d-fdef59db5ff9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:19.038649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab74f632-2542-417f-908d-fdef59db5ff9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:19.039787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab74f632-2542-417f-908d-fdef59db5ff9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:19.054915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab74f632-2542-417f-908d-fdef59db5ff9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:19.084880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:19.246041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ed05d2da-5516-4c73-9e2c-62d487f345de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:19.248074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ed05d2da-5516-4c73-9e2c-62d487f345de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:19.265681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ed05d2da-5516-4c73-9e2c-62d487f345de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:19.266472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ed05d2da-5516-4c73-9e2c-62d487f345de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:19.270398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ed05d2da-5516-4c73-9e2c-62d487f345de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:19.273259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ed05d2da-5516-4c73-9e2c-62d487f345de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:19.273734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ab74f632-2542-417f-908d-fdef59db5ff9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:19.283465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ab74f632-2542-417f-908d-fdef59db5ff9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:19.285104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ab74f632-2542-417f-908d-fdef59db5ff9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:19.286325 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ab74f632-2542-417f-908d-fdef59db5ff9 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.269892 Aug 02 06:52:19.298312 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 762/1604] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:19 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:19.317873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0b539ffe-453d-4fe7-87d7-68866f5f2762 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:19.320020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0b539ffe-453d-4fe7-87d7-68866f5f2762 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:19.330520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b539ffe-453d-4fe7-87d7-68866f5f2762 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:19.331318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b539ffe-453d-4fe7-87d7-68866f5f2762 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:19.332454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b539ffe-453d-4fe7-87d7-68866f5f2762 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:19.333185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b539ffe-453d-4fe7-87d7-68866f5f2762 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:19.893209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0b539ffe-453d-4fe7-87d7-68866f5f2762 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2907eb104d5a42a98df533459ce7b19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94205b5eec33455abafdf92687a0b44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:19.903943 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0b539ffe-453d-4fe7-87d7-68866f5f2762 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 200 len: 1315 microversion: 2.1 time: 0.603999 Aug 02 06:52:19.910779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ed05d2da-5516-4c73-9e2c-62d487f345de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:19.919200 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 763/1605] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:19 2022] GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:19.921178 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ed05d2da-5516-4c73-9e2c-62d487f345de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1470 microversion: 2.1 time: 0.682199 Aug 02 06:52:19.926223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-213e7510-357b-413a-ac8b-5dc52837169f req-dc0ec0a8-8149-4ea5-bf0d-c5977e16913a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed0a557-785a-4d8d-b61b-dc832c917a27", "name": "network-vif-plugged", "status": "completed", "tag": "1beed784-ff8a-4f34-ac51-cd23533e8be7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:19.937977 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 843/1606] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:19 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1470 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:19.939046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-213e7510-357b-413a-ac8b-5dc52837169f req-dc0ec0a8-8149-4ea5-bf0d-c5977e16913a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:19.940045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-213e7510-357b-413a-ac8b-5dc52837169f req-dc0ec0a8-8149-4ea5-bf0d-c5977e16913a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:19.945710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-38771a50-a0ae-4720-8950-22cbfc9746d7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f928c22c8b0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:19.966871 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-213e7510-357b-413a-ac8b-5dc52837169f req-dc0ec0a8-8149-4ea5-bf0d-c5977e16913a service nova] Creating event network-vif-plugged:1beed784-ff8a-4f34-ac51-cd23533e8be7 for instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 on n-h2-851337-3 Aug 02 06:52:19.974468 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-213e7510-357b-413a-ac8b-5dc52837169f req-dc0ec0a8-8149-4ea5-bf0d-c5977e16913a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053700 Aug 02 06:52:19.976476 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 764/1607] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:19.981224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8cb1d225-eea3-4ef0-9697-9f0b7b5ce9f7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b590940>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:20.020326 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-38771a50-a0ae-4720-8950-22cbfc9746d7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 200 len: 1413 microversion: 2.1 time: 0.081172 Aug 02 06:52:20.021530 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 844/1608] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:19 2022] GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:20.041260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7eeb2103-ee53-4e96-ae49-df0edc2e75ce tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:20.052219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7eeb2103-ee53-4e96-ae49-df0edc2e75ce tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:20.069340 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8cb1d225-eea3-4ef0-9697-9f0b7b5ce9f7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3" status: 200 len: 1452 microversion: 2.1 time: 0.092311 Aug 02 06:52:20.076919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7eeb2103-ee53-4e96-ae49-df0edc2e75ce tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:20.077191 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 765/1609] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:19 2022] GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:20.077312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7eeb2103-ee53-4e96-ae49-df0edc2e75ce tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:20.077312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7eeb2103-ee53-4e96-ae49-df0edc2e75ce tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:20.077312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7eeb2103-ee53-4e96-ae49-df0edc2e75ce tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:20.319587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-02c5f0d1-8bb2-4f04-bb48-af7d2274c7ee tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:20.320213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-02c5f0d1-8bb2-4f04-bb48-af7d2274c7ee tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:20.327925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02c5f0d1-8bb2-4f04-bb48-af7d2274c7ee tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:20.328378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02c5f0d1-8bb2-4f04-bb48-af7d2274c7ee tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:20.331070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02c5f0d1-8bb2-4f04-bb48-af7d2274c7ee tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:20.331530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02c5f0d1-8bb2-4f04-bb48-af7d2274c7ee tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:20.377836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7eeb2103-ee53-4e96-ae49-df0edc2e75ce tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:20.387183 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7eeb2103-ee53-4e96-ae49-df0edc2e75ce tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1316 microversion: 2.1 time: 0.363917 Aug 02 06:52:20.387858 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 845/1610] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:20 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:20.624950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-02c5f0d1-8bb2-4f04-bb48-af7d2274c7ee tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:20.658680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-02c5f0d1-8bb2-4f04-bb48-af7d2274c7ee tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:20.668448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-02c5f0d1-8bb2-4f04-bb48-af7d2274c7ee tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:20.672049 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-02c5f0d1-8bb2-4f04-bb48-af7d2274c7ee tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.356787 Aug 02 06:52:20.675532 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 766/1611] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:20 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:20.928633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e4e4c5c-ff8f-4c49-bdad-d79e85187261 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:20.929990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7e4e4c5c-ff8f-4c49-bdad-d79e85187261 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:20.939170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e4e4c5c-ff8f-4c49-bdad-d79e85187261 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:20.946095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e4e4c5c-ff8f-4c49-bdad-d79e85187261 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:20.946964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e4e4c5c-ff8f-4c49-bdad-d79e85187261 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:20.947411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e4e4c5c-ff8f-4c49-bdad-d79e85187261 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:20.953476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-38cdb79d-4544-4269-b8c6-6d0c6f197420 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:20.955194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-38cdb79d-4544-4269-b8c6-6d0c6f197420 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:20.969359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38cdb79d-4544-4269-b8c6-6d0c6f197420 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:20.970005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38cdb79d-4544-4269-b8c6-6d0c6f197420 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:20.973239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38cdb79d-4544-4269-b8c6-6d0c6f197420 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:20.973997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38cdb79d-4544-4269-b8c6-6d0c6f197420 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:21.367671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-38cdb79d-4544-4269-b8c6-6d0c6f197420 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:21.376195 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-38cdb79d-4544-4269-b8c6-6d0c6f197420 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1536 microversion: 2.1 time: 0.435300 Aug 02 06:52:21.377041 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 767/1612] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:20 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1536 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:52:21.382304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d53aaeaa-cd0e-4723-93cb-83be1eaf0a90 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927b035700>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:21.389591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7e4e4c5c-ff8f-4c49-bdad-d79e85187261 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2907eb104d5a42a98df533459ce7b19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94205b5eec33455abafdf92687a0b44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:21.400419 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7e4e4c5c-ff8f-4c49-bdad-d79e85187261 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 200 len: 1315 microversion: 2.1 time: 0.476626 Aug 02 06:52:21.415204 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 846/1613] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:20 2022] GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:21.418896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2a6b61af-e73a-472e-9cd8-c50d7e551325 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f928c453700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:21.442769 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d53aaeaa-cd0e-4723-93cb-83be1eaf0a90 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 200 len: 1413 microversion: 2.1 time: 0.064497 Aug 02 06:52:21.444006 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 768/1614] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:21 2022] GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 1413 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:21.449143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-09695f38-cee1-40e6-97fd-0b2ea5bab833 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:21.449757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-09695f38-cee1-40e6-97fd-0b2ea5bab833 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:21.456384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09695f38-cee1-40e6-97fd-0b2ea5bab833 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:21.457177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09695f38-cee1-40e6-97fd-0b2ea5bab833 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:21.458206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09695f38-cee1-40e6-97fd-0b2ea5bab833 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:21.458810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09695f38-cee1-40e6-97fd-0b2ea5bab833 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:21.489152 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2a6b61af-e73a-472e-9cd8-c50d7e551325 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3" status: 200 len: 1452 microversion: 2.1 time: 0.073155 Aug 02 06:52:21.497457 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 847/1615] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:21 2022] GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3 => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:21.507145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-506f330f-01f8-4007-a32b-3b1c2e3c2d60 req-ec7477d7-122b-4f0d-a948-e7ed1aa843ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512a9538-20ac-4af8-8431-f19a2011b693", "tag": "7d292896-8b1c-40f9-a7df-43b03a97eb97"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:21.518093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-506f330f-01f8-4007-a32b-3b1c2e3c2d60 req-ec7477d7-122b-4f0d-a948-e7ed1aa843ee service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:21.518579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-506f330f-01f8-4007-a32b-3b1c2e3c2d60 req-ec7477d7-122b-4f0d-a948-e7ed1aa843ee service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:21.530145 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-506f330f-01f8-4007-a32b-3b1c2e3c2d60 req-ec7477d7-122b-4f0d-a948-e7ed1aa843ee service nova] Creating event network-changed:7d292896-8b1c-40f9-a7df-43b03a97eb97 for instance 512a9538-20ac-4af8-8431-f19a2011b693 on n-h1-851337-3 Aug 02 06:52:21.535408 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-506f330f-01f8-4007-a32b-3b1c2e3c2d60 req-ec7477d7-122b-4f0d-a948-e7ed1aa843ee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032482 Aug 02 06:52:21.536079 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 848/1616] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:52:21.699733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-717da6b2-fac9-4cad-92c9-756e931604eb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:21.700646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-717da6b2-fac9-4cad-92c9-756e931604eb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:21.710730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-717da6b2-fac9-4cad-92c9-756e931604eb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:21.711254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-717da6b2-fac9-4cad-92c9-756e931604eb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:21.713275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-717da6b2-fac9-4cad-92c9-756e931604eb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:21.714386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-717da6b2-fac9-4cad-92c9-756e931604eb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:21.723271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-09695f38-cee1-40e6-97fd-0b2ea5bab833 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:21.734112 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-09695f38-cee1-40e6-97fd-0b2ea5bab833 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1316 microversion: 2.1 time: 0.288772 Aug 02 06:52:21.746692 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 769/1617] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:21 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:22.019910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-7bd98d52-ddeb-41a3-ba33-f9aa4e7bfdc8 req-2b889cf3-b9f3-4f55-99a7-fe1c2692fe65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e35b665-80f8-4add-8c4f-edeb762a78fa", "name": "network-vif-unplugged", "status": "completed", "tag": "97677ae9-daf0-4a17-a2c1-087df4aa5df7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:22.031384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7bd98d52-ddeb-41a3-ba33-f9aa4e7bfdc8 req-2b889cf3-b9f3-4f55-99a7-fe1c2692fe65 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:22.032186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7bd98d52-ddeb-41a3-ba33-f9aa4e7bfdc8 req-2b889cf3-b9f3-4f55-99a7-fe1c2692fe65 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:22.036011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-717da6b2-fac9-4cad-92c9-756e931604eb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:22.045127 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-7bd98d52-ddeb-41a3-ba33-f9aa4e7bfdc8 req-2b889cf3-b9f3-4f55-99a7-fe1c2692fe65 service nova] Creating event network-vif-unplugged:97677ae9-daf0-4a17-a2c1-087df4aa5df7 for instance 6e35b665-80f8-4add-8c4f-edeb762a78fa on n-h2-851337-3 Aug 02 06:52:22.045793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-717da6b2-fac9-4cad-92c9-756e931604eb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:22.047984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-717da6b2-fac9-4cad-92c9-756e931604eb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:22.052526 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-7bd98d52-ddeb-41a3-ba33-f9aa4e7bfdc8 req-2b889cf3-b9f3-4f55-99a7-fe1c2692fe65 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034331 Aug 02 06:52:22.052526 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 770/1618] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:22.054344 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-717da6b2-fac9-4cad-92c9-756e931604eb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.355082 Aug 02 06:52:22.055149 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 849/1619] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:21 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:22.399434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d9978381-0cec-43f6-9c2a-4d94b13918bf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:22.400533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d9978381-0cec-43f6-9c2a-4d94b13918bf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:22.407330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9978381-0cec-43f6-9c2a-4d94b13918bf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:22.408066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9978381-0cec-43f6-9c2a-4d94b13918bf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:22.409068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9978381-0cec-43f6-9c2a-4d94b13918bf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:22.409535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9978381-0cec-43f6-9c2a-4d94b13918bf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:22.423401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4ca7447f-3dc3-4bb4-85c7-0a738d209212 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:22.424199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4ca7447f-3dc3-4bb4-85c7-0a738d209212 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:22.434894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ca7447f-3dc3-4bb4-85c7-0a738d209212 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:22.435573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ca7447f-3dc3-4bb4-85c7-0a738d209212 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:22.436546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ca7447f-3dc3-4bb4-85c7-0a738d209212 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:22.437225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ca7447f-3dc3-4bb4-85c7-0a738d209212 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:22.822982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4ca7447f-3dc3-4bb4-85c7-0a738d209212 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2907eb104d5a42a98df533459ce7b19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94205b5eec33455abafdf92687a0b44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:22.831838 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4ca7447f-3dc3-4bb4-85c7-0a738d209212 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 200 len: 1503 microversion: 2.1 time: 0.412628 Aug 02 06:52:22.832825 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 850/1620] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:22 2022] GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 1503 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:22.856701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-98f779e0-64e6-4a5c-b570-9f6dc32b72c0 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f928c2e1280>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:22.884833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d9978381-0cec-43f6-9c2a-4d94b13918bf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:22.898931 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d9978381-0cec-43f6-9c2a-4d94b13918bf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1536 microversion: 2.1 time: 0.502005 Aug 02 06:52:22.899950 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 771/1621] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:22 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1536 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:22.909029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-69a2ebb6-b830-49ef-99e1-636ac9a336fd tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b99c3a0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:22.923383 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-98f779e0-64e6-4a5c-b570-9f6dc32b72c0 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 200 len: 1413 microversion: 2.1 time: 0.089186 Aug 02 06:52:22.924513 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 851/1622] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:22 2022] GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:22.929669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-49dbdfc2-8887-4ac0-aaf0-135050654a30 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:22.930548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-49dbdfc2-8887-4ac0-aaf0-135050654a30 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:22.937510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49dbdfc2-8887-4ac0-aaf0-135050654a30 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:22.938069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49dbdfc2-8887-4ac0-aaf0-135050654a30 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:22.938913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49dbdfc2-8887-4ac0-aaf0-135050654a30 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:22.939417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49dbdfc2-8887-4ac0-aaf0-135050654a30 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:23.002398 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-69a2ebb6-b830-49ef-99e1-636ac9a336fd tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3" status: 200 len: 1452 microversion: 2.1 time: 0.098314 Aug 02 06:52:23.002980 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 772/1623] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:22 2022] GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3 => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:23.013183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cf2ef891-a485-4d5b-a164-c1fd7ec13b96 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:23.013681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cf2ef891-a485-4d5b-a164-c1fd7ec13b96 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:23.021202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf2ef891-a485-4d5b-a164-c1fd7ec13b96 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:23.022343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf2ef891-a485-4d5b-a164-c1fd7ec13b96 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:23.023307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf2ef891-a485-4d5b-a164-c1fd7ec13b96 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:23.023923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf2ef891-a485-4d5b-a164-c1fd7ec13b96 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:23.054668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cf2ef891-a485-4d5b-a164-c1fd7ec13b96 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:52:23.163986 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cf2ef891-a485-4d5b-a164-c1fd7ec13b96 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 204 len: 0 microversion: 2.1 time: 0.158020 Aug 02 06:52:23.169341 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 773/1624] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:52:23 2022] DELETE /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:52:23.173416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9991b184-7874-4e43-b020-d0f0fdfe1e3f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:23.174307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9991b184-7874-4e43-b020-d0f0fdfe1e3f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:23.192969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9991b184-7874-4e43-b020-d0f0fdfe1e3f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:23.192969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9991b184-7874-4e43-b020-d0f0fdfe1e3f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:23.193284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9991b184-7874-4e43-b020-d0f0fdfe1e3f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:23.197842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9991b184-7874-4e43-b020-d0f0fdfe1e3f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:23.371875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-49dbdfc2-8887-4ac0-aaf0-135050654a30 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:23.379461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:23.384275 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-49dbdfc2-8887-4ac0-aaf0-135050654a30 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1316 microversion: 2.1 time: 0.458350 Aug 02 06:52:23.385751 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 852/1625] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:22 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1316 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:23.397729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d228b487-ac45-4305-926b-b13c3ebf9e19 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:23.398521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d228b487-ac45-4305-926b-b13c3ebf9e19 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:23.408131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d228b487-ac45-4305-926b-b13c3ebf9e19 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:23.408680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d228b487-ac45-4305-926b-b13c3ebf9e19 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:23.410457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d228b487-ac45-4305-926b-b13c3ebf9e19 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:23.410934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d228b487-ac45-4305-926b-b13c3ebf9e19 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:23.590414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9991b184-7874-4e43-b020-d0f0fdfe1e3f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:23.628647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9991b184-7874-4e43-b020-d0f0fdfe1e3f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:23.631910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9991b184-7874-4e43-b020-d0f0fdfe1e3f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:23.634261 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9991b184-7874-4e43-b020-d0f0fdfe1e3f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.466122 Aug 02 06:52:23.635276 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 774/1626] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:23 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:23.678859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d228b487-ac45-4305-926b-b13c3ebf9e19 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2907eb104d5a42a98df533459ce7b19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94205b5eec33455abafdf92687a0b44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:23.687127 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d228b487-ac45-4305-926b-b13c3ebf9e19 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 200 len: 1509 microversion: 2.1 time: 0.295952 Aug 02 06:52:23.687719 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 853/1627] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:23 2022] GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:23.920801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c30d73ab-f5a6-488b-b3c4-576ebaba799c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:23.921513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c30d73ab-f5a6-488b-b3c4-576ebaba799c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:23.932503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c30d73ab-f5a6-488b-b3c4-576ebaba799c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:23.932944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c30d73ab-f5a6-488b-b3c4-576ebaba799c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:23.934107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c30d73ab-f5a6-488b-b3c4-576ebaba799c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:23.934834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c30d73ab-f5a6-488b-b3c4-576ebaba799c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:23.940183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f1fe422d-765a-4349-9639-d69116cb3d1c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927b8dc310>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:24.002533 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f1fe422d-765a-4349-9639-d69116cb3d1c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 200 len: 1413 microversion: 2.1 time: 0.067299 Aug 02 06:52:24.012747 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 854/1628] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:23 2022] GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:52:24.024963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-494ac113-6256-4bba-9fff-b1eaccf81f44 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b20b160>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:24.082370 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-494ac113-6256-4bba-9fff-b1eaccf81f44 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3" status: 200 len: 1452 microversion: 2.1 time: 0.062453 Aug 02 06:52:24.084919 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 855/1629] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:24 2022] GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3 => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:24.093525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-786bdf70-7d7a-42d0-aae2-8ef30c334963 req-a7dac52a-3a32-42b9-ba61-07b95ac09f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4d0bb5-a719-464e-89ef-83065ae7f8bd", "name": "network-vif-unplugged", "status": "completed", "tag": "2cfda67e-633a-4a79-a15b-8314f7622ae0"}, {"server_uuid": "a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b", "name": "network-vif-plugged", "status": "completed", "tag": "d7483d94-2d0f-4ad6-bb8f-b89e8f73637f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:24.105220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-786bdf70-7d7a-42d0-aae2-8ef30c334963 req-a7dac52a-3a32-42b9-ba61-07b95ac09f6d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:24.105694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-786bdf70-7d7a-42d0-aae2-8ef30c334963 req-a7dac52a-3a32-42b9-ba61-07b95ac09f6d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:24.123968 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-786bdf70-7d7a-42d0-aae2-8ef30c334963 req-a7dac52a-3a32-42b9-ba61-07b95ac09f6d service nova] Creating event network-vif-unplugged:2cfda67e-633a-4a79-a15b-8314f7622ae0 for instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd on n-h1-851337-3 Aug 02 06:52:24.124486 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-786bdf70-7d7a-42d0-aae2-8ef30c334963 req-a7dac52a-3a32-42b9-ba61-07b95ac09f6d service nova] Creating event network-vif-plugged:d7483d94-2d0f-4ad6-bb8f-b89e8f73637f for instance a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b on n-h2-851337-3 Aug 02 06:52:24.133417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-786bdf70-7d7a-42d0-aae2-8ef30c334963 req-a7dac52a-3a32-42b9-ba61-07b95ac09f6d service nova] Instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 06:52:24.146318 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-786bdf70-7d7a-42d0-aae2-8ef30c334963 req-a7dac52a-3a32-42b9-ba61-07b95ac09f6d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.059094 Aug 02 06:52:24.147562 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 856/1630] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:24.203980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c30d73ab-f5a6-488b-b3c4-576ebaba799c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:24.213214 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c30d73ab-f5a6-488b-b3c4-576ebaba799c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1536 microversion: 2.1 time: 0.296367 Aug 02 06:52:24.230018 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 775/1631] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:23 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1536 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:24.405059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:24.410740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8893e554-fe93-4ad7-9d3e-41c63efef096 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:24.411601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8893e554-fe93-4ad7-9d3e-41c63efef096 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:24.444027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8893e554-fe93-4ad7-9d3e-41c63efef096 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:24.444807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8893e554-fe93-4ad7-9d3e-41c63efef096 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:24.446053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8893e554-fe93-4ad7-9d3e-41c63efef096 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:24.446851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8893e554-fe93-4ad7-9d3e-41c63efef096 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:24.662189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e4377016-a290-42de-830d-59afa01f99a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:24.662958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e4377016-a290-42de-830d-59afa01f99a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:24.672393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4377016-a290-42de-830d-59afa01f99a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:24.673202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4377016-a290-42de-830d-59afa01f99a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:24.674534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4377016-a290-42de-830d-59afa01f99a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:24.675282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4377016-a290-42de-830d-59afa01f99a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:24.812250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:25.237132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8893e554-fe93-4ad7-9d3e-41c63efef096 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:25.248908 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8893e554-fe93-4ad7-9d3e-41c63efef096 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1316 microversion: 2.1 time: 0.845009 Aug 02 06:52:25.266530 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 857/1632] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:24 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1316 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:25.278333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-275b7084-ecee-4581-af1c-72dd5c7a84ff tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:25.279848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-275b7084-ecee-4581-af1c-72dd5c7a84ff tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:25.314532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-275b7084-ecee-4581-af1c-72dd5c7a84ff tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:25.319006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-275b7084-ecee-4581-af1c-72dd5c7a84ff tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:25.323439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-275b7084-ecee-4581-af1c-72dd5c7a84ff tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:25.324884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-275b7084-ecee-4581-af1c-72dd5c7a84ff tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:25.361663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e4377016-a290-42de-830d-59afa01f99a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:25.372318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e4377016-a290-42de-830d-59afa01f99a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:25.379996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e4377016-a290-42de-830d-59afa01f99a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:25.384295 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e4377016-a290-42de-830d-59afa01f99a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.726208 Aug 02 06:52:25.398612 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 776/1633] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:24 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:52:25.411299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-51469ef2-6fe1-4eb8-a4f4-12a67fa7c003 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927b62d9d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:25.482457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-275b7084-ecee-4581-af1c-72dd5c7a84ff tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2907eb104d5a42a98df533459ce7b19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94205b5eec33455abafdf92687a0b44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:25.498757 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-51469ef2-6fe1-4eb8-a4f4-12a67fa7c003 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 200 len: 1413 microversion: 2.1 time: 0.098765 Aug 02 06:52:25.506949 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 777/1634] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:25 2022] GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:25.512072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bcb74a66-6abc-41ab-9fbe-8623d86b3bed tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927ba37b80>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:25.526486 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-275b7084-ecee-4581-af1c-72dd5c7a84ff tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 200 len: 1467 microversion: 2.1 time: 0.256614 Aug 02 06:52:25.534042 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 858/1635] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:25 2022] GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 1467 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:25.551337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-20c92769-630a-4885-8ec5-f569ed227146 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:25.556077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-20c92769-630a-4885-8ec5-f569ed227146 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:25.578200 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bcb74a66-6abc-41ab-9fbe-8623d86b3bed tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3" status: 200 len: 1452 microversion: 2.1 time: 0.070274 Aug 02 06:52:25.588907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-20c92769-630a-4885-8ec5-f569ed227146 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:25.590233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-20c92769-630a-4885-8ec5-f569ed227146 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:25.592350 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 778/1636] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:25 2022] GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3 => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:25.593713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-20c92769-630a-4885-8ec5-f569ed227146 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:25.595369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-20c92769-630a-4885-8ec5-f569ed227146 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:25.599060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=14 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:25.674560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-56183a27-7489-49f9-92b2-f2e973c0d001 req-d9d9d4a6-9bc6-4b2a-a40e-7c47e409990e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed0a557-785a-4d8d-b61b-dc832c917a27", "name": "network-vif-deleted", "tag": "1beed784-ff8a-4f34-ac51-cd23533e8be7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:25.707425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-56183a27-7489-49f9-92b2-f2e973c0d001 req-d9d9d4a6-9bc6-4b2a-a40e-7c47e409990e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:25.710652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-56183a27-7489-49f9-92b2-f2e973c0d001 req-d9d9d4a6-9bc6-4b2a-a40e-7c47e409990e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:25.757924 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-56183a27-7489-49f9-92b2-f2e973c0d001 req-d9d9d4a6-9bc6-4b2a-a40e-7c47e409990e service nova] Creating event network-vif-deleted:1beed784-ff8a-4f34-ac51-cd23533e8be7 for instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 on n-h2-851337-3 Aug 02 06:52:25.769467 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-56183a27-7489-49f9-92b2-f2e973c0d001 req-d9d9d4a6-9bc6-4b2a-a40e-7c47e409990e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096565 Aug 02 06:52:25.770810 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 779/1637] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:52:25.980258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-20c92769-630a-4885-8ec5-f569ed227146 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:25.990306 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-20c92769-630a-4885-8ec5-f569ed227146 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1536 microversion: 2.1 time: 0.452811 Aug 02 06:52:26.004211 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 859/1638] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:25 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1536 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:26.185966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-cb0adf8a-ebb0-47fd-98b4-479063731e76 req-6e15624f-16df-45ca-983c-b4e61f9a0415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "218c6c00-857e-42d7-82d4-eb818faf1f07", "name": "network-vif-plugged", "status": "completed", "tag": "d333a6ac-1957-4aac-9862-415ec3c70230"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:26.215640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cb0adf8a-ebb0-47fd-98b4-479063731e76 req-6e15624f-16df-45ca-983c-b4e61f9a0415 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:26.217981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cb0adf8a-ebb0-47fd-98b4-479063731e76 req-6e15624f-16df-45ca-983c-b4e61f9a0415 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:26.242946 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-cb0adf8a-ebb0-47fd-98b4-479063731e76 req-6e15624f-16df-45ca-983c-b4e61f9a0415 service nova] Creating event network-vif-plugged:d333a6ac-1957-4aac-9862-415ec3c70230 for instance 218c6c00-857e-42d7-82d4-eb818faf1f07 on n-h1-851337-3 Aug 02 06:52:26.273940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df045215-530c-4cbb-96c1-65e345dfb29a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:26.275393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df045215-530c-4cbb-96c1-65e345dfb29a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:26.290269 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-cb0adf8a-ebb0-47fd-98b4-479063731e76 req-6e15624f-16df-45ca-983c-b4e61f9a0415 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093260 Aug 02 06:52:26.293442 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 780/1639] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:26.299961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df045215-530c-4cbb-96c1-65e345dfb29a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:26.301059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df045215-530c-4cbb-96c1-65e345dfb29a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:26.303089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df045215-530c-4cbb-96c1-65e345dfb29a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:26.303709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df045215-530c-4cbb-96c1-65e345dfb29a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:26.414223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-36314018-046c-4bf3-8e37-0311cea77c09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:26.415807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-36314018-046c-4bf3-8e37-0311cea77c09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:26.423205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36314018-046c-4bf3-8e37-0311cea77c09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:26.423657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36314018-046c-4bf3-8e37-0311cea77c09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:26.424563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36314018-046c-4bf3-8e37-0311cea77c09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:26.425002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36314018-046c-4bf3-8e37-0311cea77c09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:26.719479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-df045215-530c-4cbb-96c1-65e345dfb29a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:26.727909 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df045215-530c-4cbb-96c1-65e345dfb29a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1316 microversion: 2.1 time: 0.459887 Aug 02 06:52:26.735449 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 860/1640] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:26 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1316 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:52:26.787030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-36314018-046c-4bf3-8e37-0311cea77c09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:26.800755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-36314018-046c-4bf3-8e37-0311cea77c09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:26.802832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-36314018-046c-4bf3-8e37-0311cea77c09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:26.804302 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-36314018-046c-4bf3-8e37-0311cea77c09 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.395146 Aug 02 06:52:26.805052 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 781/1641] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:26 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:26.810030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b104473a-c1dc-43aa-a01e-0d625f87afe0 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927b448280>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:26.890044 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b104473a-c1dc-43aa-a01e-0d625f87afe0 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 200 len: 1413 microversion: 2.1 time: 0.083188 Aug 02 06:52:26.892786 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 782/1642] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:26 2022] GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:26.898382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cd92c278-a800-4160-beee-396d8a7b8950 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:26.900049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cd92c278-a800-4160-beee-396d8a7b8950 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:26.906976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd92c278-a800-4160-beee-396d8a7b8950 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:26.907724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd92c278-a800-4160-beee-396d8a7b8950 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:26.908692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd92c278-a800-4160-beee-396d8a7b8950 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:26.909306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd92c278-a800-4160-beee-396d8a7b8950 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:26.957113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7c583321-3eb0-4ed4-8801-74461bbe2b7f tempest-ComputeTenantNetworksTest-1138541386 tempest-ComputeTenantNetworksTest-1138541386-project] Calling method '.version_select at 0x7f927b226040>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:26.990528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:26.995395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd92c278-a800-4160-beee-396d8a7b8950 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:26.996066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd92c278-a800-4160-beee-396d8a7b8950 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:26.996692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-cd92c278-a800-4160-beee-396d8a7b8950 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lazy-loading 'fault' on Instance uuid 0ed0a557-785a-4d8d-b61b-dc832c917a27 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:52:27.299445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cd92c278-a800-4160-beee-396d8a7b8950 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2907eb104d5a42a98df533459ce7b19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94205b5eec33455abafdf92687a0b44d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:27.315988 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cd92c278-a800-4160-beee-396d8a7b8950 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 200 len: 1305 microversion: 2.1 time: 0.421671 Aug 02 06:52:27.318375 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 783/1643] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:26 2022] GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 1305 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:27.334732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8a4902f8-f6d9-46f6-8636-110ad23c7c64 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b412820>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:27.376076 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7c583321-3eb0-4ed4-8801-74461bbe2b7f tempest-ComputeTenantNetworksTest-1138541386 tempest-ComputeTenantNetworksTest-1138541386-project] 10.222.0.79 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.637526 Aug 02 06:52:27.376727 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 861/1644] 10.222.0.79 () {58 vars in 1158 bytes} [Tue Aug 2 06:52:26 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:27.383199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1e563513-0ea1-48a7-9e3a-0cfb9a2caf77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:27.384421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1e563513-0ea1-48a7-9e3a-0cfb9a2caf77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:27.399943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e563513-0ea1-48a7-9e3a-0cfb9a2caf77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:27.401376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e563513-0ea1-48a7-9e3a-0cfb9a2caf77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:27.402911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e563513-0ea1-48a7-9e3a-0cfb9a2caf77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:27.405032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e563513-0ea1-48a7-9e3a-0cfb9a2caf77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:27.426511 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8a4902f8-f6d9-46f6-8636-110ad23c7c64 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3" status: 200 len: 1452 microversion: 2.1 time: 0.104078 Aug 02 06:52:27.427601 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 784/1645] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:27 2022] GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:27.452486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e4ec6097-4b35-4b01-b3ea-f2882dbf4810 tempest-ComputeTenantNetworksTest-1138541386 tempest-ComputeTenantNetworksTest-1138541386-project] Calling method '.version_select at 0x7f927b4480d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:27.818032 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e4ec6097-4b35-4b01-b3ea-f2882dbf4810 tempest-ComputeTenantNetworksTest-1138541386 tempest-ComputeTenantNetworksTest-1138541386-project] 10.222.0.79 "GET /compute/v2.1/os-tenant-networks/c907e825-7b11-42e7-8014-9a0c24fcacfe" status: 200 len: 139 microversion: 2.1 time: 0.342815 Aug 02 06:52:27.818032 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 785/1646] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 06:52:27 2022] GET /compute/v2.1/os-tenant-networks/c907e825-7b11-42e7-8014-9a0c24fcacfe => generated 139 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:27.818032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6901d8d7-e4ea-45c5-b638-0b47ede0d7ab tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:27.818032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6901d8d7-e4ea-45c5-b638-0b47ede0d7ab tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:27.818032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6901d8d7-e4ea-45c5-b638-0b47ede0d7ab tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:27.818824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6901d8d7-e4ea-45c5-b638-0b47ede0d7ab tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:27.818824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6901d8d7-e4ea-45c5-b638-0b47ede0d7ab tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:27.818824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6901d8d7-e4ea-45c5-b638-0b47ede0d7ab tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:27.912798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1e563513-0ea1-48a7-9e3a-0cfb9a2caf77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:27.930226 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1e563513-0ea1-48a7-9e3a-0cfb9a2caf77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1529 microversion: 2.1 time: 0.551835 Aug 02 06:52:27.930844 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 862/1647] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:27 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1529 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:27.963060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-9ddc85bb-35f7-400e-926c-25f1ba13a539 req-35fd1076-7a14-4c52-b372-ad095b7a22d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62927d0b-7f85-4ce4-a606-2c0ddb2b896e", "name": "network-vif-unplugged", "status": "completed", "tag": "cbca7b5a-a5a7-4e60-8b1c-996099aebce3"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:27.975871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9ddc85bb-35f7-400e-926c-25f1ba13a539 req-35fd1076-7a14-4c52-b372-ad095b7a22d8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:27.976607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9ddc85bb-35f7-400e-926c-25f1ba13a539 req-35fd1076-7a14-4c52-b372-ad095b7a22d8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:27.989795 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-9ddc85bb-35f7-400e-926c-25f1ba13a539 req-35fd1076-7a14-4c52-b372-ad095b7a22d8 service nova] Creating event network-vif-unplugged:cbca7b5a-a5a7-4e60-8b1c-996099aebce3 for instance 62927d0b-7f85-4ce4-a606-2c0ddb2b896e on n-h1-851337-3 Aug 02 06:52:28.013402 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-9ddc85bb-35f7-400e-926c-25f1ba13a539 req-35fd1076-7a14-4c52-b372-ad095b7a22d8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056671 Aug 02 06:52:28.014480 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 863/1648] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:28.027915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ebd2b96b-a9e6-4ad8-b6ef-1f4f3f77d5d1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:28.036929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ebd2b96b-a9e6-4ad8-b6ef-1f4f3f77d5d1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:28.046489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebd2b96b-a9e6-4ad8-b6ef-1f4f3f77d5d1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:28.047244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebd2b96b-a9e6-4ad8-b6ef-1f4f3f77d5d1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:28.048757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebd2b96b-a9e6-4ad8-b6ef-1f4f3f77d5d1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:28.049362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebd2b96b-a9e6-4ad8-b6ef-1f4f3f77d5d1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:28.116856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6901d8d7-e4ea-45c5-b638-0b47ede0d7ab tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:28.131723 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6901d8d7-e4ea-45c5-b638-0b47ede0d7ab tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1316 microversion: 2.1 time: 0.349631 Aug 02 06:52:28.145963 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 786/1649] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:27 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:28.163453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-821f7613-be1f-4576-a2a7-edf740b08ef5 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927b4251f0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:28.716510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ebd2b96b-a9e6-4ad8-b6ef-1f4f3f77d5d1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:28.744281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ebd2b96b-a9e6-4ad8-b6ef-1f4f3f77d5d1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:28.748218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ebd2b96b-a9e6-4ad8-b6ef-1f4f3f77d5d1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:28.754486 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ebd2b96b-a9e6-4ad8-b6ef-1f4f3f77d5d1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.734407 Aug 02 06:52:28.755752 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 864/1650] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:28 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:28.769940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-21920fa9-2c57-4783-afe6-949bb9352a0f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:28.773256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-21920fa9-2c57-4783-afe6-949bb9352a0f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:28.788304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21920fa9-2c57-4783-afe6-949bb9352a0f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:28.788785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21920fa9-2c57-4783-afe6-949bb9352a0f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:28.789719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21920fa9-2c57-4783-afe6-949bb9352a0f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:28.795525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21920fa9-2c57-4783-afe6-949bb9352a0f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:29.131648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-21920fa9-2c57-4783-afe6-949bb9352a0f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:29.142584 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-21920fa9-2c57-4783-afe6-949bb9352a0f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1529 microversion: 2.1 time: 0.386143 Aug 02 06:52:29.144316 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 865/1651] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:28 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1529 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:29.158773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dff6bb1e-fe84-44ed-bd34-34ee1536eff3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:29.164672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dff6bb1e-fe84-44ed-bd34-34ee1536eff3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:29.181467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dff6bb1e-fe84-44ed-bd34-34ee1536eff3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:29.182138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dff6bb1e-fe84-44ed-bd34-34ee1536eff3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:29.183680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dff6bb1e-fe84-44ed-bd34-34ee1536eff3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:29.185045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dff6bb1e-fe84-44ed-bd34-34ee1536eff3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:29.240292 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-dff6bb1e-fe84-44ed-bd34-34ee1536eff3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] HTTP exception thrown: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dff6bb1e-fe84-44ed-bd34-34ee1536eff3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Request method failure captured: Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 HTTP/1.1 Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmVZZkj6mwnMYjfreBzQNVzz62WcFu-dRXgebrlIHIdrMLk4Y07W750ukhO_e36R1BbYmKmZAbs3__c0LBD9YRO8i9kEB-2bcc0CvhpaCiSDqQdtlUVVSjkNnhLLVy-d_0zW2klQZGpVxAAlSj2ttpNko0ioumQT1u3YNjyA3M81rg Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 94205b5eec33455abafdf92687a0b44d Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:52:29.242454 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:52:29.244378 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/94205b5eec33455abafdf92687a0b44d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94205b5eec33455abafdf92687a0b44d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_94205b5eec33455abafdf92687a0b44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94205b5eec33455abafdf92687a0b44d"}]}] Aug 02 06:52:29.244378 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:29.244378 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 94205b5eec33455abafdf92687a0b44d Aug 02 06:52:29.244378 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:29.244378 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesNegativeTestJSON-1533883741-project Aug 02 06:52:29.244378 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:52:29.244378 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:52:29.244378 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 2907eb104d5a42a98df533459ce7b19a Aug 02 06:52:29.244378 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesNegativeTestJSON-1533883741-project Aug 02 06:52:29.244378 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:52:29.244378 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:29.244378 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '0ed0a557-785a-4d8d-b61b-dc832c917a27'} Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:29.245474 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:29.247218 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:29.252287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dff6bb1e-fe84-44ed-bd34-34ee1536eff3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Returning 404 to user: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:29.260432 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dff6bb1e-fe84-44ed-bd34-34ee1536eff3 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 404 len: 111 microversion: 2.1 time: 0.110745 Aug 02 06:52:29.262251 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 866/1652] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:29 2022] GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:52:29.267506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-76a20040-e313-4a99-8ecc-6a303d930e49 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b1490d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:36.298530 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-821f7613-be1f-4576-a2a7-edf740b08ef5 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 200 len: 1413 microversion: 2.1 time: 8.155255 Aug 02 06:52:36.299138 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 787/1653] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:28 2022] GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 1413 bytes in 8157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:36.306520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-6b277b2f-9af2-4cb6-badd-50a9e0da8523 req-75bff600-ad14-4ac6-bbc3-baa88ea1bcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4d0bb5-a719-464e-89ef-83065ae7f8bd", "name": "network-vif-plugged", "status": "completed", "tag": "2cfda67e-633a-4a79-a15b-8314f7622ae0"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:36.322669 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-76a20040-e313-4a99-8ecc-6a303d930e49 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3" status: 200 len: 1461 microversion: 2.1 time: 7.059080 Aug 02 06:52:36.333048 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 867/1654] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:29 2022] GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3 => generated 1461 bytes in 7070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:36.335540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6b277b2f-9af2-4cb6-badd-50a9e0da8523 req-75bff600-ad14-4ac6-bbc3-baa88ea1bcd9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:36.335979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6b277b2f-9af2-4cb6-badd-50a9e0da8523 req-75bff600-ad14-4ac6-bbc3-baa88ea1bcd9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:36.339332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-194002b8-68a0-428f-b4ab-77d6b6caaebc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:36.341178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-194002b8-68a0-428f-b4ab-77d6b6caaebc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:36.349043 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-6b277b2f-9af2-4cb6-badd-50a9e0da8523 req-75bff600-ad14-4ac6-bbc3-baa88ea1bcd9 service nova] Creating event network-vif-plugged:2cfda67e-633a-4a79-a15b-8314f7622ae0 for instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd on n-h1-851337-3 Aug 02 06:52:36.349298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-194002b8-68a0-428f-b4ab-77d6b6caaebc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:36.350202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-194002b8-68a0-428f-b4ab-77d6b6caaebc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:36.351225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-194002b8-68a0-428f-b4ab-77d6b6caaebc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:36.352081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-194002b8-68a0-428f-b4ab-77d6b6caaebc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:36.356173 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-6b277b2f-9af2-4cb6-badd-50a9e0da8523 req-75bff600-ad14-4ac6-bbc3-baa88ea1bcd9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055679 Aug 02 06:52:36.357098 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 788/1655] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:36.368295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-23b53f13-f7f2-4186-9a73-b82e10fd533d tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:36.369742 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:52:36.369742 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:52:36.386327 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-23b53f13-f7f2-4186-9a73-b82e10fd533d tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] HTTP exception thrown: Flavor 47937a84-20ae-42cf-9c27-72f4a9a26a4d could not be found. Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-23b53f13-f7f2-4186-9a73-b82e10fd533d tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Request method failure captured: Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/flavors/47937a84-20ae-42cf-9c27-72f4a9a26a4d HTTP/1.1 Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MimaK9w1_ZC7ae8x5hZ1Ij5avLjrJsaGX-byu3E4nNeozFSO9QqMB-qJuSLOsGcBtkoAjYQuWCHRAccnZllQzknsS05Ot5YbG4n_9F6YdmEXqR0DOpQaQeABjOOKTgnVC3U_G17Y3y8mIeXeK6AgBjgil29pI1mWSItXQqJSzjHe-s Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a7f036676a594d05b9883e65b915048b Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-MigrationsAdminTest-821130581 Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 06:52:36.397168 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 06:52:36.398780 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a7f036676a594d05b9883e65b915048b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7f036676a594d05b9883e65b915048b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a7f036676a594d05b9883e65b915048b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7f036676a594d05b9883e65b915048b"}]}] Aug 02 06:52:36.398780 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-MigrationsAdminTest-821130581 Aug 02 06:52:36.398780 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a7f036676a594d05b9883e65b915048b Aug 02 06:52:36.398780 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-MigrationsAdminTest-821130581 Aug 02 06:52:36.398780 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-MigrationsAdminTest-821130581-project-admin Aug 02 06:52:36.398780 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:52:36.398780 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:52:36.398780 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: a6293839950f4d21b045f997108b9482 Aug 02 06:52:36.398780 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-MigrationsAdminTest-821130581-project-admin Aug 02 06:52:36.398780 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:52:36.398780 n-d-851337-3 devstack@n-api.service[126119]: exception: Flavor 47937a84-20ae-42cf-9c27-72f4a9a26a4d could not be found. Aug 02 06:52:36.398780 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '47937a84-20ae-42cf-9c27-72f4a9a26a4d'} Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 47937a84-20ae-42cf-9c27-72f4a9a26a4d could not be found. Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:36.399688 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 47937a84-20ae-42cf-9c27-72f4a9a26a4d could not be found. Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 47937a84-20ae-42cf-9c27-72f4a9a26a4d could not be found. Aug 02 06:52:36.401132 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.403998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-23b53f13-f7f2-4186-9a73-b82e10fd533d tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Returning 404 to user: Flavor 47937a84-20ae-42cf-9c27-72f4a9a26a4d could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:36.403998 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-23b53f13-f7f2-4186-9a73-b82e10fd533d tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/47937a84-20ae-42cf-9c27-72f4a9a26a4d" status: 404 len: 109 microversion: 2.1 time: 0.043062 Aug 02 06:52:36.403998 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 789/1656] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:52:36 2022] DELETE /compute/v2.1/flavors/47937a84-20ae-42cf-9c27-72f4a9a26a4d => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:52:36.409708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7bb70619-733b-47f1-a300-efb5480d0f55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-112006202", "metadata": {"image_type": "test"}}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:36.413352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7bb70619-733b-47f1-a300-efb5480d0f55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:36.430630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bb70619-733b-47f1-a300-efb5480d0f55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:36.431422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bb70619-733b-47f1-a300-efb5480d0f55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:36.432877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bb70619-733b-47f1-a300-efb5480d0f55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:36.434502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bb70619-733b-47f1-a300-efb5480d0f55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:36.458239 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-7bb70619-733b-47f1-a300-efb5480d0f55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] HTTP exception thrown: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7bb70619-733b-47f1-a300-efb5480d0f55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Request method failure captured: Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27/action HTTP/1.1 Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 111 Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmVZZkj6mwnMYjfreBzQNVzz62WcFu-dRXgebrlIHIdrMLk4Y07W750ukhO_e36R1BbYmKmZAbs3__c0LBD9YRO8i9kEB-2bcc0CvhpaCiSDqQdtlUVVSjkNnhLLVy-d_0zW2klQZGpVxAAlSj2ttpNko0ioumQT1u3YNjyA3M81rg Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 94205b5eec33455abafdf92687a0b44d Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:52:36.460170 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:52:36.461684 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/94205b5eec33455abafdf92687a0b44d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94205b5eec33455abafdf92687a0b44d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_94205b5eec33455abafdf92687a0b44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94205b5eec33455abafdf92687a0b44d"}]}] Aug 02 06:52:36.461684 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:36.461684 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 94205b5eec33455abafdf92687a0b44d Aug 02 06:52:36.461684 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:36.461684 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesNegativeTestJSON-1533883741-project Aug 02 06:52:36.461684 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:52:36.461684 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:52:36.461684 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 2907eb104d5a42a98df533459ce7b19a Aug 02 06:52:36.461684 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesNegativeTestJSON-1533883741-project Aug 02 06:52:36.461684 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:52:36.461684 n-d-851337-3 devstack@n-api.service[126119]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-112006202", "metadata": {"image_type": "test"}}} Aug 02 06:52:36.461684 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '0ed0a557-785a-4d8d-b61b-dc832c917a27', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-112006202', 'metadata': {'image_type': 'test'}}}} Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:36.462579 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:36.463926 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:36.465287 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:36.465287 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:36.465287 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:36.465287 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:36.465287 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.467176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7bb70619-733b-47f1-a300-efb5480d0f55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Returning 404 to user: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:36.468261 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7bb70619-733b-47f1-a300-efb5480d0f55 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "POST /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27/action" status: 404 len: 111 microversion: 2.1 time: 0.063574 Aug 02 06:52:36.469809 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 790/1657] 10.222.0.79 () {60 vars in 1279 bytes} [Tue Aug 2 06:52:36 2022] POST /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:52:36.480152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1a88cf99-2e22-43a7-9e67-060317d0290a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:36.481118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1a88cf99-2e22-43a7-9e67-060317d0290a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:36.489857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1a88cf99-2e22-43a7-9e67-060317d0290a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:36.491130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1a88cf99-2e22-43a7-9e67-060317d0290a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:36.492552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1a88cf99-2e22-43a7-9e67-060317d0290a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:36.493210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1a88cf99-2e22-43a7-9e67-060317d0290a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:36.498401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:36.649647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-194002b8-68a0-428f-b4ab-77d6b6caaebc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:36.662008 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-194002b8-68a0-428f-b4ab-77d6b6caaebc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1316 microversion: 2.1 time: 0.324379 Aug 02 06:52:36.662764 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 868/1658] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:36 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:36.679509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e3679963-7e74-4f08-acef-307ee648ec79 req-92b55774-bb35-484c-8088-43ebe2e3ab89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62927d0b-7f85-4ce4-a606-2c0ddb2b896e", "tag": "cbca7b5a-a5a7-4e60-8b1c-996099aebce3"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:36.706069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e3679963-7e74-4f08-acef-307ee648ec79 req-92b55774-bb35-484c-8088-43ebe2e3ab89 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:36.716606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e3679963-7e74-4f08-acef-307ee648ec79 req-92b55774-bb35-484c-8088-43ebe2e3ab89 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:36.749207 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e3679963-7e74-4f08-acef-307ee648ec79 req-92b55774-bb35-484c-8088-43ebe2e3ab89 service nova] Creating event network-changed:cbca7b5a-a5a7-4e60-8b1c-996099aebce3 for instance 62927d0b-7f85-4ce4-a606-2c0ddb2b896e on n-h1-851337-3 Aug 02 06:52:36.759542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1a88cf99-2e22-43a7-9e67-060317d0290a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:36.759908 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e3679963-7e74-4f08-acef-307ee648ec79 req-92b55774-bb35-484c-8088-43ebe2e3ab89 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090772 Aug 02 06:52:36.761078 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 869/1659] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:36.763278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e3679963-7e74-4f08-acef-307ee648ec79 req-92b55774-bb35-484c-8088-43ebe2e3ab89 service nova] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:36.764386 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e3679963-7e74-4f08-acef-307ee648ec79 req-92b55774-bb35-484c-8088-43ebe2e3ab89 service nova] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002177 Aug 02 06:52:36.764729 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 870/1660] 10.222.0.79 () {56 vars in 886 bytes} [Tue Aug 2 06:52:36 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 02 06:52:36.771149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1a88cf99-2e22-43a7-9e67-060317d0290a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:36.772897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1a88cf99-2e22-43a7-9e67-060317d0290a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:36.774566 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1a88cf99-2e22-43a7-9e67-060317d0290a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.303558 Aug 02 06:52:36.775590 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 791/1661] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:36 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:36.781477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9730ef4e-0d04-4b6c-b01c-0894fbdb5241 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1128365152", "metadata": {"image_type": "test"}}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:36.785492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9730ef4e-0d04-4b6c-b01c-0894fbdb5241 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Failed to fetch instance by id tempest-invalid-793071908 {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 02 06:52:36.786269 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-9730ef4e-0d04-4b6c-b01c-0894fbdb5241 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] HTTP exception thrown: Instance tempest-invalid-793071908 could not be found. Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9730ef4e-0d04-4b6c-b01c-0894fbdb5241 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Request method failure captured: Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/tempest-invalid-793071908/action HTTP/1.1 Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 112 Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmVZZkj6mwnMYjfreBzQNVzz62WcFu-dRXgebrlIHIdrMLk4Y07W750ukhO_e36R1BbYmKmZAbs3__c0LBD9YRO8i9kEB-2bcc0CvhpaCiSDqQdtlUVVSjkNnhLLVy-d_0zW2klQZGpVxAAlSj2ttpNko0ioumQT1u3YNjyA3M81rg Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 94205b5eec33455abafdf92687a0b44d Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:52:36.788160 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:52:36.789979 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/94205b5eec33455abafdf92687a0b44d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94205b5eec33455abafdf92687a0b44d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_94205b5eec33455abafdf92687a0b44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94205b5eec33455abafdf92687a0b44d"}]}] Aug 02 06:52:36.789979 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:36.789979 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 94205b5eec33455abafdf92687a0b44d Aug 02 06:52:36.789979 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:36.789979 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesNegativeTestJSON-1533883741-project Aug 02 06:52:36.789979 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:52:36.789979 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:52:36.789979 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 2907eb104d5a42a98df533459ce7b19a Aug 02 06:52:36.789979 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesNegativeTestJSON-1533883741-project Aug 02 06:52:36.789979 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:52:36.789979 n-d-851337-3 devstack@n-api.service[126119]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1128365152", "metadata": {"image_type": "test"}}} Aug 02 06:52:36.789979 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance tempest-invalid-793071908 could not be found. Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'tempest-invalid-793071908', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1128365152', 'metadata': {'image_type': 'test'}}}} Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-793071908 could not be found. Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:36.790987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-793071908 could not be found. Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-793071908 could not be found. Aug 02 06:52:36.792753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.794429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1abf105f-5da6-4108-aca7-961f1466d2a5 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b0ca430>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:36.795653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9730ef4e-0d04-4b6c-b01c-0894fbdb5241 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Returning 404 to user: Instance tempest-invalid-793071908 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:36.796836 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9730ef4e-0d04-4b6c-b01c-0894fbdb5241 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "POST /compute/v2.1/servers/tempest-invalid-793071908/action" status: 404 len: 100 microversion: 2.1 time: 0.019823 Aug 02 06:52:36.798009 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 792/1662] 10.222.0.79 () {60 vars in 1246 bytes} [Tue Aug 2 06:52:36 2022] POST /compute/v2.1/servers/tempest-invalid-793071908/action => generated 100 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:52:36.803076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1753597650", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:36.921279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:52:36.934132 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1abf105f-5da6-4108-aca7-961f1466d2a5 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3" status: 200 len: 1461 microversion: 2.1 time: 0.154951 Aug 02 06:52:36.934899 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 871/1663] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:36 2022] GET /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3 => generated 1461 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:36.943418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1abf105f-5da6-4108-aca7-961f1466d2a5 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:36.943418 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1abf105f-5da6-4108-aca7-961f1466d2a5 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001535 Aug 02 06:52:36.943418 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 872/1664] 10.222.0.79 () {54 vars in 1035 bytes} [Tue Aug 2 06:52:36 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 02 06:52:36.948210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0466d2d7-9f55-41ee-b893-21e1a3d6ebb1 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1816816832"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:36.960499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0466d2d7-9f55-41ee-b893-21e1a3d6ebb1 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 02 06:52:36.961401 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-0466d2d7-9f55-41ee-b893-21e1a3d6ebb1 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0466d2d7-9f55-41ee-b893-21e1a3d6ebb1 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Request method failure captured: Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 57 Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmVZZkj6mwnMYjfreBzQNVzz62WcFu-dRXgebrlIHIdrMLk4Y07W750ukhO_e36R1BbYmKmZAbs3__c0LBD9YRO8i9kEB-2bcc0CvhpaCiSDqQdtlUVVSjkNnhLLVy-d_0zW2klQZGpVxAAlSj2ttpNko0ioumQT1u3YNjyA3M81rg Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 94205b5eec33455abafdf92687a0b44d Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:52:36.963186 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:52:36.964707 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/94205b5eec33455abafdf92687a0b44d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94205b5eec33455abafdf92687a0b44d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_94205b5eec33455abafdf92687a0b44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94205b5eec33455abafdf92687a0b44d"}]}] Aug 02 06:52:36.964707 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:36.964707 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 94205b5eec33455abafdf92687a0b44d Aug 02 06:52:36.964707 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:36.964707 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesNegativeTestJSON-1533883741-project Aug 02 06:52:36.964707 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:52:36.964707 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:52:36.964707 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 2907eb104d5a42a98df533459ce7b19a Aug 02 06:52:36.964707 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesNegativeTestJSON-1533883741-project Aug 02 06:52:36.964707 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:52:36.964707 n-d-851337-3 devstack@n-api.service[126120]: {"createImage": {"name": "tempest-test-snap-1816816832"}} Aug 02 06:52:36.964707 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:52:36.964707 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1816816832'}}} Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:36.965732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 02 06:52:36.971101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:36.974120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0466d2d7-9f55-41ee-b893-21e1a3d6ebb1 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:36.974120 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0466d2d7-9f55-41ee-b893-21e1a3d6ebb1 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.021712 Aug 02 06:52:36.974120 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 873/1665] 10.222.0.79 () {60 vars in 1275 bytes} [Tue Aug 2 06:52:36 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:52:36.975836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f0022c3b-964b-4797-b0bf-3a63f7866e5d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:36.976556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f0022c3b-964b-4797-b0bf-3a63f7866e5d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:36.993840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0022c3b-964b-4797-b0bf-3a63f7866e5d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:36.994643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0022c3b-964b-4797-b0bf-3a63f7866e5d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:36.995592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0022c3b-964b-4797-b0bf-3a63f7866e5d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:36.996223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0022c3b-964b-4797-b0bf-3a63f7866e5d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:37.392762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f0022c3b-964b-4797-b0bf-3a63f7866e5d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:37.404481 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f0022c3b-964b-4797-b0bf-3a63f7866e5d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1468 microversion: 2.1 time: 0.432872 Aug 02 06:52:37.405759 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 874/1666] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:36 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1468 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:37.408087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f0022c3b-964b-4797-b0bf-3a63f7866e5d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:37.409403 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f0022c3b-964b-4797-b0bf-3a63f7866e5d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Aug 02 06:52:37.418678 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 875/1667] 10.222.0.79 () {54 vars in 1041 bytes} [Tue Aug 2 06:52:37 2022] GET /compute/v2.1/ => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:37.426399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-64628bfa-195f-4fb5-bedb-50d942b4346c tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1083564768"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:37.429462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-64628bfa-195f-4fb5-bedb-50d942b4346c tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 02 06:52:37.430272 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-64628bfa-195f-4fb5-bedb-50d942b4346c tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-64628bfa-195f-4fb5-bedb-50d942b4346c tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Request method failure captured: Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 57 Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmVZZkj6mwnMYjfreBzQNVzz62WcFu-dRXgebrlIHIdrMLk4Y07W750ukhO_e36R1BbYmKmZAbs3__c0LBD9YRO8i9kEB-2bcc0CvhpaCiSDqQdtlUVVSjkNnhLLVy-d_0zW2klQZGpVxAAlSj2ttpNko0ioumQT1u3YNjyA3M81rg Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 94205b5eec33455abafdf92687a0b44d Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:52:37.432092 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:52:37.433864 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/94205b5eec33455abafdf92687a0b44d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94205b5eec33455abafdf92687a0b44d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_94205b5eec33455abafdf92687a0b44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94205b5eec33455abafdf92687a0b44d"}]}] Aug 02 06:52:37.433864 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:37.433864 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 94205b5eec33455abafdf92687a0b44d Aug 02 06:52:37.433864 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:37.433864 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesNegativeTestJSON-1533883741-project Aug 02 06:52:37.433864 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:52:37.433864 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:52:37.433864 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 2907eb104d5a42a98df533459ce7b19a Aug 02 06:52:37.433864 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesNegativeTestJSON-1533883741-project Aug 02 06:52:37.433864 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:52:37.433864 n-d-851337-3 devstack@n-api.service[126120]: {"createImage": {"name": "tempest-test-snap-1083564768"}} Aug 02 06:52:37.433864 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:52:37.433864 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1083564768'}}} Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:37.434893 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 02 06:52:37.436438 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:37.437999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-64628bfa-195f-4fb5-bedb-50d942b4346c tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:37.439045 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-64628bfa-195f-4fb5-bedb-50d942b4346c tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.018833 Aug 02 06:52:37.444989 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 876/1668] 10.222.0.79 () {60 vars in 1281 bytes} [Tue Aug 2 06:52:37 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:52:37.450875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83613831-392c-4068-b299-0b4de9f11620 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927b25d430>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:37.484269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:52:37.484816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:52:37.485072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:52:37.485486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:52:37.485932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:52:37.507242 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-83613831-392c-4068-b299-0b4de9f11620 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 200 len: 1413 microversion: 2.1 time: 0.060777 Aug 02 06:52:37.508533 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 877/1669] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:37 2022] GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 1413 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:37.509734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83613831-392c-4068-b299-0b4de9f11620 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:37.510476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:37.510930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:37.511452 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-83613831-392c-4068-b299-0b4de9f11620 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001637 Aug 02 06:52:37.511730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:37.512180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:37.520609 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 878/1670] 10.222.0.79 () {56 vars in 886 bytes} [Tue Aug 2 06:52:37 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 02 06:52:37.528341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df56fdbe-e5fe-4460-b26a-a3cb47d292a6 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1345884554"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:37.534405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df56fdbe-e5fe-4460-b26a-a3cb47d292a6 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: 6e35b665-80f8-4add-8c4f-edeb762a78fa] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:37.544603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df56fdbe-e5fe-4460-b26a-a3cb47d292a6 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:37.545599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df56fdbe-e5fe-4460-b26a-a3cb47d292a6 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:37.546637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df56fdbe-e5fe-4460-b26a-a3cb47d292a6 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:37.547296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df56fdbe-e5fe-4460-b26a-a3cb47d292a6 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:37.589439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Getting quotas for project 1e08c65240da4f90a190b2da77a8ff92. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:52:37.599944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Getting quotas for user 87d1c9cb22d34aaa8b86860b84a1086d and project 1e08c65240da4f90a190b2da77a8ff92. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:52:37.616171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:52:37.628940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:52:37.717766 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-45bd5439-7408-4df6-bbf0-9b5ea8237d58 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.918345 Aug 02 06:52:37.719145 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 793/1671] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:52:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:52:37.734150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-61019818-86a7-4d66-ad69-810f0fc52932 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:37.734958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-61019818-86a7-4d66-ad69-810f0fc52932 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:37.748196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61019818-86a7-4d66-ad69-810f0fc52932 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:37.751162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61019818-86a7-4d66-ad69-810f0fc52932 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:37.757274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61019818-86a7-4d66-ad69-810f0fc52932 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:37.758151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61019818-86a7-4d66-ad69-810f0fc52932 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:37.810132 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-61019818-86a7-4d66-ad69-810f0fc52932 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] HTTP exception thrown: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-61019818-86a7-4d66-ad69-810f0fc52932 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Request method failure captured: Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 HTTP/1.1 Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmVZZkj6mwnMYjfreBzQNVzz62WcFu-dRXgebrlIHIdrMLk4Y07W750ukhO_e36R1BbYmKmZAbs3__c0LBD9YRO8i9kEB-2bcc0CvhpaCiSDqQdtlUVVSjkNnhLLVy-d_0zW2klQZGpVxAAlSj2ttpNko0ioumQT1u3YNjyA3M81rg Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 94205b5eec33455abafdf92687a0b44d Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:52:37.820044 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:52:37.822008 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/94205b5eec33455abafdf92687a0b44d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94205b5eec33455abafdf92687a0b44d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_94205b5eec33455abafdf92687a0b44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94205b5eec33455abafdf92687a0b44d"}]}] Aug 02 06:52:37.822008 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:37.822008 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 94205b5eec33455abafdf92687a0b44d Aug 02 06:52:37.822008 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:37.822008 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesNegativeTestJSON-1533883741-project Aug 02 06:52:37.822008 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:52:37.822008 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:52:37.822008 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 2907eb104d5a42a98df533459ce7b19a Aug 02 06:52:37.822008 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesNegativeTestJSON-1533883741-project Aug 02 06:52:37.822008 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:52:37.822008 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:37.822008 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '0ed0a557-785a-4d8d-b61b-dc832c917a27'} Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:37.823021 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:37.824652 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:37.827467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-61019818-86a7-4d66-ad69-810f0fc52932 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Returning 404 to user: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:37.832580 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-61019818-86a7-4d66-ad69-810f0fc52932 tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 404 len: 111 microversion: 2.1 time: 0.112094 Aug 02 06:52:37.836867 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 794/1672] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:52:37 2022] DELETE /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:52:37.857080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4f4675ad-660c-4288-a79e-52982c0be4c1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:37.864314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4f4675ad-660c-4288-a79e-52982c0be4c1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:37.884857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f4675ad-660c-4288-a79e-52982c0be4c1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:37.885308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f4675ad-660c-4288-a79e-52982c0be4c1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:37.886132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f4675ad-660c-4288-a79e-52982c0be4c1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:37.893102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f4675ad-660c-4288-a79e-52982c0be4c1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:37.945478 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df56fdbe-e5fe-4460-b26a-a3cb47d292a6 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "POST /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa/action" status: 202 len: 0 microversion: 2.1 time: 0.422465 Aug 02 06:52:37.955542 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 879/1673] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:52:37 2022] POST /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 02 06:52:37.975696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-31e1f2d7-6f73-45af-ade5-bf7e0e6bef4a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:37.976431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-31e1f2d7-6f73-45af-ade5-bf7e0e6bef4a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:38.205991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-31e1f2d7-6f73-45af-ade5-bf7e0e6bef4a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:38.214017 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-31e1f2d7-6f73-45af-ade5-bf7e0e6bef4a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1213 microversion: 2.1 time: 0.256854 Aug 02 06:52:38.226292 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 880/1674] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:37 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1213 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:38.243617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-581691bf-e4c4-4a8c-8e6c-a4a93dc3482b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:38.244515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-581691bf-e4c4-4a8c-8e6c-a4a93dc3482b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:38.275532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-581691bf-e4c4-4a8c-8e6c-a4a93dc3482b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:38.276519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-581691bf-e4c4-4a8c-8e6c-a4a93dc3482b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:38.280151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-581691bf-e4c4-4a8c-8e6c-a4a93dc3482b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:38.280725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-581691bf-e4c4-4a8c-8e6c-a4a93dc3482b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:38.425832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4f4675ad-660c-4288-a79e-52982c0be4c1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:38.440646 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4f4675ad-660c-4288-a79e-52982c0be4c1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1316 microversion: 2.1 time: 0.596403 Aug 02 06:52:38.441244 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 795/1675] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:37 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1316 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:38.446073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5e5c9ee5-e294-48c7-a675-e6b762ca9c4e tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:38.446685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5e5c9ee5-e294-48c7-a675-e6b762ca9c4e tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] [instance: 0ed0a557-785a-4d8d-b61b-dc832c917a27] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:38.458183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e5c9ee5-e294-48c7-a675-e6b762ca9c4e tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:38.474695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e5c9ee5-e294-48c7-a675-e6b762ca9c4e tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:38.475615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e5c9ee5-e294-48c7-a675-e6b762ca9c4e tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:38.476063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e5c9ee5-e294-48c7-a675-e6b762ca9c4e tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:38.490744 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-5e5c9ee5-e294-48c7-a675-e6b762ca9c4e tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] HTTP exception thrown: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5e5c9ee5-e294-48c7-a675-e6b762ca9c4e tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Request method failure captured: Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 HTTP/1.1 Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmVZZkj6mwnMYjfreBzQNVzz62WcFu-dRXgebrlIHIdrMLk4Y07W750ukhO_e36R1BbYmKmZAbs3__c0LBD9YRO8i9kEB-2bcc0CvhpaCiSDqQdtlUVVSjkNnhLLVy-d_0zW2klQZGpVxAAlSj2ttpNko0ioumQT1u3YNjyA3M81rg Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 94205b5eec33455abafdf92687a0b44d Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:52:38.502437 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:52:38.504367 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/94205b5eec33455abafdf92687a0b44d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94205b5eec33455abafdf92687a0b44d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_94205b5eec33455abafdf92687a0b44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94205b5eec33455abafdf92687a0b44d"}]}] Aug 02 06:52:38.504367 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:38.504367 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 94205b5eec33455abafdf92687a0b44d Aug 02 06:52:38.504367 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1533883741 Aug 02 06:52:38.504367 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesNegativeTestJSON-1533883741-project Aug 02 06:52:38.504367 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:52:38.504367 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:52:38.504367 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 2907eb104d5a42a98df533459ce7b19a Aug 02 06:52:38.504367 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesNegativeTestJSON-1533883741-project Aug 02 06:52:38.504367 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:52:38.504367 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:38.504367 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '0ed0a557-785a-4d8d-b61b-dc832c917a27'} Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:38.505716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. Aug 02 06:52:38.507205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:38.509319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5e5c9ee5-e294-48c7-a675-e6b762ca9c4e tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] Returning 404 to user: Instance 0ed0a557-785a-4d8d-b61b-dc832c917a27 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:38.509319 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5e5c9ee5-e294-48c7-a675-e6b762ca9c4e tempest-ImagesNegativeTestJSON-1533883741 tempest-ImagesNegativeTestJSON-1533883741-project] 10.222.0.79 "GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27" status: 404 len: 111 microversion: 2.1 time: 0.061901 Aug 02 06:52:38.509319 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 796/1676] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:38 2022] GET /compute/v2.1/servers/0ed0a557-785a-4d8d-b61b-dc832c917a27 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:52:38.515721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c649dd41-1975-4785-b29d-81d2b5da39aa tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b82d0d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:38.602780 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c649dd41-1975-4785-b29d-81d2b5da39aa tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.096437 Aug 02 06:52:38.603616 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 797/1677] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:38 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:38.615384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8d3cfebd-17de-4ce7-a495-347472a6a937 req-4b2a53df-568b-40ac-931f-67aca320e11c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512a9538-20ac-4af8-8431-f19a2011b693", "name": "network-vif-plugged", "status": "completed", "tag": "7d292896-8b1c-40f9-a7df-43b03a97eb97"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:38.630181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-581691bf-e4c4-4a8c-8e6c-a4a93dc3482b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:38.644031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-581691bf-e4c4-4a8c-8e6c-a4a93dc3482b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:38.645548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8d3cfebd-17de-4ce7-a495-347472a6a937 req-4b2a53df-568b-40ac-931f-67aca320e11c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:38.646045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8d3cfebd-17de-4ce7-a495-347472a6a937 req-4b2a53df-568b-40ac-931f-67aca320e11c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:38.646373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-581691bf-e4c4-4a8c-8e6c-a4a93dc3482b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:38.647735 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-581691bf-e4c4-4a8c-8e6c-a4a93dc3482b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.420012 Aug 02 06:52:38.648937 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 881/1678] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:38 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:38.654111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-560d7fb0-6b19-409a-b67e-99553aadc775 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927b149550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:38.684955 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8d3cfebd-17de-4ce7-a495-347472a6a937 req-4b2a53df-568b-40ac-931f-67aca320e11c service nova] Creating event network-vif-plugged:7d292896-8b1c-40f9-a7df-43b03a97eb97 for instance 512a9538-20ac-4af8-8431-f19a2011b693 on n-h1-851337-3 Aug 02 06:52:38.703018 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8d3cfebd-17de-4ce7-a495-347472a6a937 req-4b2a53df-568b-40ac-931f-67aca320e11c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085602 Aug 02 06:52:38.705354 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 798/1679] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:38.720148 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-560d7fb0-6b19-409a-b67e-99553aadc775 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 200 len: 1413 microversion: 2.1 time: 0.069988 Aug 02 06:52:38.720748 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 882/1680] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:38 2022] GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 1413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:39.245764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8575036e-b016-4cbb-8f92-349901a7512b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:39.246653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8575036e-b016-4cbb-8f92-349901a7512b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:39.258753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8575036e-b016-4cbb-8f92-349901a7512b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:39.260789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8575036e-b016-4cbb-8f92-349901a7512b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:39.264540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8575036e-b016-4cbb-8f92-349901a7512b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:39.267627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8575036e-b016-4cbb-8f92-349901a7512b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:39.462437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-98136bfa-d70d-4855-bad3-ecceee93a4a4 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:39.463063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-98136bfa-d70d-4855-bad3-ecceee93a4a4 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:39.472753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8575036e-b016-4cbb-8f92-349901a7512b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:39.492545 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8575036e-b016-4cbb-8f92-349901a7512b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1265 microversion: 2.1 time: 0.248436 Aug 02 06:52:39.506771 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 799/1681] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:39 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:39.515699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98136bfa-d70d-4855-bad3-ecceee93a4a4 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:39.519597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98136bfa-d70d-4855-bad3-ecceee93a4a4 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:39.524871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98136bfa-d70d-4855-bad3-ecceee93a4a4 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:39.525655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98136bfa-d70d-4855-bad3-ecceee93a4a4 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:39.644063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fa740acb-150b-4cfa-9f8e-8f6a5f99b5ba tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927afbb700>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:39.752620 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fa740acb-150b-4cfa-9f8e-8f6a5f99b5ba tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.113008 Aug 02 06:52:39.754893 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 800/1682] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:39 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:52:39.781881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2f5f6e30-4d80-4fcf-97fb-9bf351fe78f3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:39.782537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2f5f6e30-4d80-4fcf-97fb-9bf351fe78f3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:39.808476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f5f6e30-4d80-4fcf-97fb-9bf351fe78f3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:39.808917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f5f6e30-4d80-4fcf-97fb-9bf351fe78f3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:39.819225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f5f6e30-4d80-4fcf-97fb-9bf351fe78f3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:39.825055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f5f6e30-4d80-4fcf-97fb-9bf351fe78f3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:39.868598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-98136bfa-d70d-4855-bad3-ecceee93a4a4 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:39.876558 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-98136bfa-d70d-4855-bad3-ecceee93a4a4 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1316 microversion: 2.1 time: 0.419028 Aug 02 06:52:39.894114 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 883/1683] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:39 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:52:39.900222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fda8efa2-a2af-4c31-b129-a4390ae44ce5 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f928c343160>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:39.997486 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fda8efa2-a2af-4c31-b129-a4390ae44ce5 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 200 len: 1413 microversion: 2.1 time: 0.101771 Aug 02 06:52:39.998258 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 884/1684] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:39 2022] GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:40.154975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2f5f6e30-4d80-4fcf-97fb-9bf351fe78f3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:40.169464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2f5f6e30-4d80-4fcf-97fb-9bf351fe78f3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:40.171530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2f5f6e30-4d80-4fcf-97fb-9bf351fe78f3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:40.173719 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2f5f6e30-4d80-4fcf-97fb-9bf351fe78f3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.415355 Aug 02 06:52:40.187649 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 801/1685] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:39 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:40.520413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2a37d11d-82b7-4d5e-b4e8-8ebb3f778b25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:40.521624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2a37d11d-82b7-4d5e-b4e8-8ebb3f778b25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:40.549410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a37d11d-82b7-4d5e-b4e8-8ebb3f778b25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:40.554586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a37d11d-82b7-4d5e-b4e8-8ebb3f778b25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:40.556686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a37d11d-82b7-4d5e-b4e8-8ebb3f778b25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:40.558613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a37d11d-82b7-4d5e-b4e8-8ebb3f778b25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:40.615620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:40.687203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2a37d11d-82b7-4d5e-b4e8-8ebb3f778b25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:40.705277 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2a37d11d-82b7-4d5e-b4e8-8ebb3f778b25 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1271 microversion: 2.1 time: 0.189410 Aug 02 06:52:40.726770 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 885/1686] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:40 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1271 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:40.732933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b43bbd24-cedb-4891-8ac2-117b70fc4d99 req-ca64f5c2-e42f-438a-a777-e81106310120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b", "name": "network-vif-unplugged", "status": "completed", "tag": "d7483d94-2d0f-4ad6-bb8f-b89e8f73637f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:40.746168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b43bbd24-cedb-4891-8ac2-117b70fc4d99 req-ca64f5c2-e42f-438a-a777-e81106310120 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:40.746622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b43bbd24-cedb-4891-8ac2-117b70fc4d99 req-ca64f5c2-e42f-438a-a777-e81106310120 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:40.762568 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b43bbd24-cedb-4891-8ac2-117b70fc4d99 req-ca64f5c2-e42f-438a-a777-e81106310120 service nova] Creating event network-vif-unplugged:d7483d94-2d0f-4ad6-bb8f-b89e8f73637f for instance a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b on n-h2-851337-3 Aug 02 06:52:40.768437 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b43bbd24-cedb-4891-8ac2-117b70fc4d99 req-ca64f5c2-e42f-438a-a777-e81106310120 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041158 Aug 02 06:52:40.769327 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 802/1687] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:52:40.774072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c154585-7cfb-40a7-b84d-d4736b44a162 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f928c22c8b0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:40.848425 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1c154585-7cfb-40a7-b84d-d4736b44a162 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.084151 Aug 02 06:52:40.850971 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 886/1688] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:40 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:40.902512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-00421fef-8d60-4ba6-bbfb-c0a61fc16db8 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:40.903218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-00421fef-8d60-4ba6-bbfb-c0a61fc16db8 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:40.917656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00421fef-8d60-4ba6-bbfb-c0a61fc16db8 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:40.918156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00421fef-8d60-4ba6-bbfb-c0a61fc16db8 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:40.918982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00421fef-8d60-4ba6-bbfb-c0a61fc16db8 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:40.919446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00421fef-8d60-4ba6-bbfb-c0a61fc16db8 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:41.013638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3c07272a-fdb3-4985-8cb8-118d0b78ffe9 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f928c33aee0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:41.081782 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3c07272a-fdb3-4985-8cb8-118d0b78ffe9 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 200 len: 1422 microversion: 2.1 time: 0.072985 Aug 02 06:52:41.082338 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 887/1689] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:41 2022] GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 1422 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:41.096119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4c44fb6c-7e64-4132-a781-f6df9621ca2a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927aa974c0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:41.147675 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4c44fb6c-7e64-4132-a781-f6df9621ca2a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 200 len: 1422 microversion: 2.1 time: 0.055669 Aug 02 06:52:41.148379 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 888/1690] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:41 2022] GET /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 1422 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:41.170660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2b512e98-d704-404e-8e3f-d180ac854e8d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927b3e7790>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:41.224391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-00421fef-8d60-4ba6-bbfb-c0a61fc16db8 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:41.253216 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-00421fef-8d60-4ba6-bbfb-c0a61fc16db8 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1505 microversion: 2.1 time: 0.355933 Aug 02 06:52:41.258424 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 803/1691] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:40 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:41.278337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5f0348fc-61fb-42fa-8279-56f4b02634f4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:41.279967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5f0348fc-61fb-42fa-8279-56f4b02634f4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:41.298156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f0348fc-61fb-42fa-8279-56f4b02634f4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:41.299954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f0348fc-61fb-42fa-8279-56f4b02634f4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:41.301987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f0348fc-61fb-42fa-8279-56f4b02634f4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:41.303129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f0348fc-61fb-42fa-8279-56f4b02634f4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:41.567369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5f0348fc-61fb-42fa-8279-56f4b02634f4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:41.578942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5f0348fc-61fb-42fa-8279-56f4b02634f4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:41.585027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5f0348fc-61fb-42fa-8279-56f4b02634f4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:41.592830 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5f0348fc-61fb-42fa-8279-56f4b02634f4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1814 microversion: 2.25 time: 0.332718 Aug 02 06:52:41.595219 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 804/1692] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:41 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1814 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:41.614213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-004d9509-b66d-4fbc-b5c9-59ec02727073 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1321247131"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:41.615475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-004d9509-b66d-4fbc-b5c9-59ec02727073 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:41.628739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-004d9509-b66d-4fbc-b5c9-59ec02727073 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:41.634694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-004d9509-b66d-4fbc-b5c9-59ec02727073 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:41.636557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-004d9509-b66d-4fbc-b5c9-59ec02727073 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:41.642504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-004d9509-b66d-4fbc-b5c9-59ec02727073 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:42.214848 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2b512e98-d704-404e-8e3f-d180ac854e8d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 204 len: 0 microversion: 2.1 time: 1.047931 Aug 02 06:52:42.219660 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 889/1693] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:41 2022] DELETE /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 0 bytes in 1049 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:52:42.223294 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8fc3b691-6b5d-4a9d-a69b-9b287dd2d160 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:42.223641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8fc3b691-6b5d-4a9d-a69b-9b287dd2d160 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:42.233046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fc3b691-6b5d-4a9d-a69b-9b287dd2d160 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:42.233366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fc3b691-6b5d-4a9d-a69b-9b287dd2d160 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:42.234220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fc3b691-6b5d-4a9d-a69b-9b287dd2d160 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:42.234667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fc3b691-6b5d-4a9d-a69b-9b287dd2d160 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:42.853237 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.network.security_group_api [None req-004d9509-b66d-4fbc-b5c9-59ec02727073 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Adding security group e08328fc-c070-4b63-814b-2b66e4b366fe to port 7d292896-8b1c-40f9-a7df-43b03a97eb97 Aug 02 06:52:42.922710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8fc3b691-6b5d-4a9d-a69b-9b287dd2d160 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:42.930880 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8fc3b691-6b5d-4a9d-a69b-9b287dd2d160 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1313 microversion: 2.1 time: 0.714060 Aug 02 06:52:42.936985 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 890/1694] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:42 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1313 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:42.943230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-73cec1cc-3450-4bc4-96c0-993ea1714f11 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b8dc310>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:43.022910 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-73cec1cc-3450-4bc4-96c0-993ea1714f11 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.084505 Aug 02 06:52:43.030163 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 891/1695] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:42 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:43.043055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-81de887e-f297-44df-a84b-ef7150db5aa6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:43.043479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-81de887e-f297-44df-a84b-ef7150db5aa6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:43.049678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:43.051875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81de887e-f297-44df-a84b-ef7150db5aa6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:43.052090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81de887e-f297-44df-a84b-ef7150db5aa6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:43.054428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81de887e-f297-44df-a84b-ef7150db5aa6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:43.054862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81de887e-f297-44df-a84b-ef7150db5aa6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:43.109028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-81de887e-f297-44df-a84b-ef7150db5aa6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:52:43.305846 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-81de887e-f297-44df-a84b-ef7150db5aa6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 204 len: 0 microversion: 2.1 time: 0.279976 Aug 02 06:52:43.306654 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 892/1696] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:52:43 2022] DELETE /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:52:43.320249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f4f890c-43ad-4a42-a6c5-631cf59f48fc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:43.324383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1f4f890c-43ad-4a42-a6c5-631cf59f48fc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:43.352299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f4f890c-43ad-4a42-a6c5-631cf59f48fc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:43.352795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f4f890c-43ad-4a42-a6c5-631cf59f48fc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:43.355046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f4f890c-43ad-4a42-a6c5-631cf59f48fc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:43.356212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f4f890c-43ad-4a42-a6c5-631cf59f48fc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:43.748721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f4f890c-43ad-4a42-a6c5-631cf59f48fc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:43.760855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f4f890c-43ad-4a42-a6c5-631cf59f48fc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:43.762402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f4f890c-43ad-4a42-a6c5-631cf59f48fc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:43.763601 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f4f890c-43ad-4a42-a6c5-631cf59f48fc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1804 microversion: 2.25 time: 0.455971 Aug 02 06:52:43.774253 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 893/1697] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:43 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1804 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:43.781771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-fb39dfd7-7226-439e-a1bd-a6557272b383 req-494ad9ea-d789-45a8-8519-e0b92f4408b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e35b665-80f8-4add-8c4f-edeb762a78fa", "name": "network-vif-plugged", "status": "completed", "tag": "97677ae9-daf0-4a17-a2c1-087df4aa5df7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:43.816952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-fb39dfd7-7226-439e-a1bd-a6557272b383 req-494ad9ea-d789-45a8-8519-e0b92f4408b4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:43.817771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-fb39dfd7-7226-439e-a1bd-a6557272b383 req-494ad9ea-d789-45a8-8519-e0b92f4408b4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:43.831976 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-fb39dfd7-7226-439e-a1bd-a6557272b383 req-494ad9ea-d789-45a8-8519-e0b92f4408b4 service nova] Creating event network-vif-plugged:97677ae9-daf0-4a17-a2c1-087df4aa5df7 for instance 6e35b665-80f8-4add-8c4f-edeb762a78fa on n-h2-851337-3 Aug 02 06:52:43.856997 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-fb39dfd7-7226-439e-a1bd-a6557272b383 req-494ad9ea-d789-45a8-8519-e0b92f4408b4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077917 Aug 02 06:52:43.859158 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 894/1698] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:43.867815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-751196533", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "db7d01d8-40e0-493b-8992-76c9b63bb01d"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:43.956216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] validate_networks() for [('db7d01d8-40e0-493b-8992-76c9b63bb01d', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:52:44.181128 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-004d9509-b66d-4fbc-b5c9-59ec02727073 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693/action" status: 202 len: 0 microversion: 2.1 time: 2.584650 Aug 02 06:52:44.183493 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 805/1699] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:52:41 2022] POST /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693/action => generated 0 bytes in 2587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:52:44.190002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-01e4ca44-5d6a-474f-a28c-d68954f3c2a0 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '.version_select at 0x7f927b425940>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:44.195375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01e4ca44-5d6a-474f-a28c-d68954f3c2a0 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:44.196082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01e4ca44-5d6a-474f-a28c-d68954f3c2a0 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:44.210572 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-01e4ca44-5d6a-474f-a28c-d68954f3c2a0 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.025802 Aug 02 06:52:44.213023 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 806/1700] 10.222.0.79 () {60 vars in 1184 bytes} [Tue Aug 2 06:52:44 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:44.234943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f5130f5d-7b7c-40b6-b4a4-e5506f88396b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:44.235861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f5130f5d-7b7c-40b6-b4a4-e5506f88396b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:44.249835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5130f5d-7b7c-40b6-b4a4-e5506f88396b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:44.251810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5130f5d-7b7c-40b6-b4a4-e5506f88396b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:44.259683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5130f5d-7b7c-40b6-b4a4-e5506f88396b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:44.260547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5130f5d-7b7c-40b6-b4a4-e5506f88396b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:44.677132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f5130f5d-7b7c-40b6-b4a4-e5506f88396b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:44.688737 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f5130f5d-7b7c-40b6-b4a4-e5506f88396b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1313 microversion: 2.1 time: 0.472231 Aug 02 06:52:44.690469 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 807/1701] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:44 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1313 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:44.713557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-52871818-d368-40c3-88e7-71c87e045b7e tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b590dc0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:44.793052 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-52871818-d368-40c3-88e7-71c87e045b7e tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.099128 Aug 02 06:52:44.793953 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 808/1702] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:44 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:44.806480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-50311d61-1934-4b8b-bc11-361cf787cb1d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1529541122"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:44.806826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-50311d61-1934-4b8b-bc11-361cf787cb1d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:44.826420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50311d61-1934-4b8b-bc11-361cf787cb1d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:44.826924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50311d61-1934-4b8b-bc11-361cf787cb1d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:44.829028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50311d61-1934-4b8b-bc11-361cf787cb1d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:44.831808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50311d61-1934-4b8b-bc11-361cf787cb1d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:44.982125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:52:44.984485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:52:44.985458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:52:44.986547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:52:44.987284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:52:45.007379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:45.008139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:45.009136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:45.017295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:45.058783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Getting quotas for project 2a8dc75e5ba647e3b128c31a49f069ca. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:52:45.086869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Getting quotas for user 793620d46a6c42fb955f1fe5075b040b and project 2a8dc75e5ba647e3b128c31a49f069ca. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:52:45.128131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:52:45.131770 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.network.security_group_api [None req-50311d61-1934-4b8b-bc11-361cf787cb1d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Adding security group ff4b66aa-acf3-4fe4-8ae8-1d154a8ad1e1 to port 7d292896-8b1c-40f9-a7df-43b03a97eb97 Aug 02 06:52:45.136101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:52:45.240551 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c2467344-eece-426c-bf0a-c31a106ebfda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.378023 Aug 02 06:52:45.241221 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 895/1703] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:52:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:52:45.259816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6d1163ba-6941-4260-ad35-48a39b8603d3 req-139432e8-5549-42f4-b8a7-8b692fe922d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512a9538-20ac-4af8-8431-f19a2011b693", "tag": "7d292896-8b1c-40f9-a7df-43b03a97eb97"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:45.287615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6d1163ba-6941-4260-ad35-48a39b8603d3 req-139432e8-5549-42f4-b8a7-8b692fe922d3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:45.288065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6d1163ba-6941-4260-ad35-48a39b8603d3 req-139432e8-5549-42f4-b8a7-8b692fe922d3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:45.306517 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-6d1163ba-6941-4260-ad35-48a39b8603d3 req-139432e8-5549-42f4-b8a7-8b692fe922d3 service nova] Creating event network-changed:7d292896-8b1c-40f9-a7df-43b03a97eb97 for instance 512a9538-20ac-4af8-8431-f19a2011b693 on n-h1-851337-3 Aug 02 06:52:45.322542 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6d1163ba-6941-4260-ad35-48a39b8603d3 req-139432e8-5549-42f4-b8a7-8b692fe922d3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080023 Aug 02 06:52:45.324404 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 896/1704] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:45.343953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-665fc4bb-d4bc-4955-aba7-15001b5ca1c9 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:45.344959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-665fc4bb-d4bc-4955-aba7-15001b5ca1c9 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:45.361063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-665fc4bb-d4bc-4955-aba7-15001b5ca1c9 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:45.362183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-665fc4bb-d4bc-4955-aba7-15001b5ca1c9 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:45.363145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-665fc4bb-d4bc-4955-aba7-15001b5ca1c9 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:45.366621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-665fc4bb-d4bc-4955-aba7-15001b5ca1c9 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:45.894794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-665fc4bb-d4bc-4955-aba7-15001b5ca1c9 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 62927d0b-7f85-4ce4-a606-2c0ddb2b896e {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:52:45.930382 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-665fc4bb-d4bc-4955-aba7-15001b5ca1c9 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 2423 microversion: 2.25 time: 0.597650 Aug 02 06:52:45.933074 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 897/1705] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:45 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 2423 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:45.959517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-cecfa303-36cd-4c41-9fd3-c6bbfa508669 req-c9c3d846-a054-4cb7-a9a0-4cae36c23f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "303b535b-cea0-4219-ad1b-3849b9042a53", "tag": "78a224c6-e169-4c15-906f-64fc36ce7044"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:45.995205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-cecfa303-36cd-4c41-9fd3-c6bbfa508669 req-c9c3d846-a054-4cb7-a9a0-4cae36c23f52 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:45.996860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-cecfa303-36cd-4c41-9fd3-c6bbfa508669 req-c9c3d846-a054-4cb7-a9a0-4cae36c23f52 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:46.054299 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-cecfa303-36cd-4c41-9fd3-c6bbfa508669 req-c9c3d846-a054-4cb7-a9a0-4cae36c23f52 service nova] Creating event network-changed:78a224c6-e169-4c15-906f-64fc36ce7044 for instance 303b535b-cea0-4219-ad1b-3849b9042a53 on n-h2-851337-3 Aug 02 06:52:46.068721 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-cecfa303-36cd-4c41-9fd3-c6bbfa508669 req-c9c3d846-a054-4cb7-a9a0-4cae36c23f52 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132523 Aug 02 06:52:46.071593 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 898/1706] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:46.085449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f3263ea3-581c-432f-a672-12dfa745f38c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:46.088110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f3263ea3-581c-432f-a672-12dfa745f38c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:46.265827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f3263ea3-581c-432f-a672-12dfa745f38c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:46.282098 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f3263ea3-581c-432f-a672-12dfa745f38c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1207 microversion: 2.1 time: 0.205733 Aug 02 06:52:46.282831 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 899/1707] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:46 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1207 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:46.305917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b73478a-97be-4405-b70b-1da87090ff8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:46.310946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6b73478a-97be-4405-b70b-1da87090ff8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:46.336480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b73478a-97be-4405-b70b-1da87090ff8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:46.352705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b73478a-97be-4405-b70b-1da87090ff8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:46.359425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b73478a-97be-4405-b70b-1da87090ff8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:46.363443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b73478a-97be-4405-b70b-1da87090ff8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:46.403967 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-50311d61-1934-4b8b-bc11-361cf787cb1d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693/action" status: 202 len: 0 microversion: 2.1 time: 1.608828 Aug 02 06:52:46.405222 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 809/1708] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:52:44 2022] POST /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693/action => generated 0 bytes in 1611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:52:46.416722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-722d3ac3-31d6-48b5-b148-1889a1fc0fe3 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b9593a0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:46.532247 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-722d3ac3-31d6-48b5-b148-1889a1fc0fe3 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.125576 Aug 02 06:52:46.540262 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 810/1709] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:46 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:46.546570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f72f49af-22f1-4f98-9a5a-0f0cd18cef53 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:46.557532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f72f49af-22f1-4f98-9a5a-0f0cd18cef53 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:46.576044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f72f49af-22f1-4f98-9a5a-0f0cd18cef53 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:46.576827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f72f49af-22f1-4f98-9a5a-0f0cd18cef53 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:46.577948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f72f49af-22f1-4f98-9a5a-0f0cd18cef53 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:46.578641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f72f49af-22f1-4f98-9a5a-0f0cd18cef53 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:47.280221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-f72f49af-22f1-4f98-9a5a-0f0cd18cef53 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 62927d0b-7f85-4ce4-a606-2c0ddb2b896e {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:52:47.284208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6b73478a-97be-4405-b70b-1da87090ff8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:47.296276 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6b73478a-97be-4405-b70b-1da87090ff8a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1313 microversion: 2.1 time: 1.007381 Aug 02 06:52:47.299872 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 900/1710] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:46 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1313 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:47.309645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-f99e65ee-e461-4d11-b2d4-c7abb69d238a req-6ea8b616-097d-4de8-8033-6be80274bbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "218c6c00-857e-42d7-82d4-eb818faf1f07", "name": "network-vif-unplugged", "status": "completed", "tag": "d333a6ac-1957-4aac-9862-415ec3c70230"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:47.317310 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f72f49af-22f1-4f98-9a5a-0f0cd18cef53 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 2423 microversion: 2.25 time: 0.782705 Aug 02 06:52:47.318413 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 811/1711] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:52:46 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 2423 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:52:47.324704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f99e65ee-e461-4d11-b2d4-c7abb69d238a req-6ea8b616-097d-4de8-8033-6be80274bbe7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:47.325140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f99e65ee-e461-4d11-b2d4-c7abb69d238a req-6ea8b616-097d-4de8-8033-6be80274bbe7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:47.333695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-19320fcf-58b3-46ea-8c0b-57267e2a227f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:47.334536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-19320fcf-58b3-46ea-8c0b-57267e2a227f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:47.346922 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f99e65ee-e461-4d11-b2d4-c7abb69d238a req-6ea8b616-097d-4de8-8033-6be80274bbe7 service nova] Creating event network-vif-unplugged:d333a6ac-1957-4aac-9862-415ec3c70230 for instance 218c6c00-857e-42d7-82d4-eb818faf1f07 on n-h1-851337-3 Aug 02 06:52:47.354769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19320fcf-58b3-46ea-8c0b-57267e2a227f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:47.357577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19320fcf-58b3-46ea-8c0b-57267e2a227f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:47.360034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19320fcf-58b3-46ea-8c0b-57267e2a227f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:47.363625 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-f99e65ee-e461-4d11-b2d4-c7abb69d238a req-6ea8b616-097d-4de8-8033-6be80274bbe7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058939 Aug 02 06:52:47.364410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19320fcf-58b3-46ea-8c0b-57267e2a227f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:47.364577 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 901/1712] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:47.373330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bd23ff52-d657-47bd-ab94-880e852c9801 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:47.376397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bd23ff52-d657-47bd-ab94-880e852c9801 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:47.394607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd23ff52-d657-47bd-ab94-880e852c9801 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:47.395291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd23ff52-d657-47bd-ab94-880e852c9801 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:47.396258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd23ff52-d657-47bd-ab94-880e852c9801 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:47.399913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd23ff52-d657-47bd-ab94-880e852c9801 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:47.531119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bd23ff52-d657-47bd-ab94-880e852c9801 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:47.547408 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bd23ff52-d657-47bd-ab94-880e852c9801 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1267 microversion: 2.1 time: 0.180475 Aug 02 06:52:47.548703 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 902/1713] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:47 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:47.555972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-c2c65d26-2bd8-440f-838e-184cdb16729a req-14e96e0f-4234-48de-8f13-ce6184eb2b2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512a9538-20ac-4af8-8431-f19a2011b693", "tag": "7d292896-8b1c-40f9-a7df-43b03a97eb97"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:47.557176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:47.573818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c2c65d26-2bd8-440f-838e-184cdb16729a req-14e96e0f-4234-48de-8f13-ce6184eb2b2c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:47.574561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c2c65d26-2bd8-440f-838e-184cdb16729a req-14e96e0f-4234-48de-8f13-ce6184eb2b2c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:47.593720 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-c2c65d26-2bd8-440f-838e-184cdb16729a req-14e96e0f-4234-48de-8f13-ce6184eb2b2c service nova] Creating event network-changed:7d292896-8b1c-40f9-a7df-43b03a97eb97 for instance 512a9538-20ac-4af8-8431-f19a2011b693 on n-h1-851337-3 Aug 02 06:52:47.603883 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-c2c65d26-2bd8-440f-838e-184cdb16729a req-14e96e0f-4234-48de-8f13-ce6184eb2b2c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052882 Aug 02 06:52:47.605061 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 903/1714] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:47.611044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:47.612171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7469febe-ade8-4552-8d52-1d254ae7ec6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:47.612766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7469febe-ade8-4552-8d52-1d254ae7ec6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:47.615091 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-19320fcf-58b3-46ea-8c0b-57267e2a227f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.294506 Aug 02 06:52:47.616116 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 812/1715] 10.222.0.79 () {58 vars in 1293 bytes} [Tue Aug 2 06:52:47 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693/os-security-groups => generated 1158 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:47.620719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7469febe-ade8-4552-8d52-1d254ae7ec6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:47.621204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7469febe-ade8-4552-8d52-1d254ae7ec6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:47.622053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7469febe-ade8-4552-8d52-1d254ae7ec6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:47.622485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7469febe-ade8-4552-8d52-1d254ae7ec6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:47.623569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d5fdd6f7-d26b-49d2-aeed-932a930fcf68 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b185b80>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:47.719445 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d5fdd6f7-d26b-49d2-aeed-932a930fcf68 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.101809 Aug 02 06:52:47.733297 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 813/1716] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:47 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:47.738588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6769fe5f-6382-4b6f-8332-a8360b87f45b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'create', calling method: .version_select at 0x7f927ade5dc0>, body: {"security_group": {"name": " tempest-securitygroup -1952489977 ", "description": "tempest-description-138208889"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:47.855068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-7469febe-ade8-4552-8d52-1d254ae7ec6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lazy-loading 'services' on Instance uuid 62927d0b-7f85-4ce4-a606-2c0ddb2b896e {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:52:48.083719 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7469febe-ade8-4552-8d52-1d254ae7ec6a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "DELETE /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments/bf75ef4d-753c-4e71-a9bf-d531aaef8cd1" status: 202 len: 0 microversion: 2.25 time: 0.476600 Aug 02 06:52:48.084877 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 904/1717] 10.222.0.79 () {60 vars in 1457 bytes} [Tue Aug 2 06:52:47 2022] DELETE /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments/bf75ef4d-753c-4e71-a9bf-d531aaef8cd1 => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:52:48.096983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cbd1c497-3c31-4191-b9a2-e91237300ec7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:48.105005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cbd1c497-3c31-4191-b9a2-e91237300ec7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:48.129339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbd1c497-3c31-4191-b9a2-e91237300ec7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:48.129866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbd1c497-3c31-4191-b9a2-e91237300ec7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:48.130714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbd1c497-3c31-4191-b9a2-e91237300ec7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:48.131533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbd1c497-3c31-4191-b9a2-e91237300ec7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:48.214557 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cbd1c497-3c31-4191-b9a2-e91237300ec7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125414 Aug 02 06:52:48.221014 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 905/1718] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 06:52:48 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:52:48.320879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f37617cb-b246-426b-93ce-d6e58b53b31f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:48.322669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f37617cb-b246-426b-93ce-d6e58b53b31f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:48.351760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f37617cb-b246-426b-93ce-d6e58b53b31f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:48.361105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f37617cb-b246-426b-93ce-d6e58b53b31f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:48.362635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f37617cb-b246-426b-93ce-d6e58b53b31f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:48.363174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f37617cb-b246-426b-93ce-d6e58b53b31f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:49.013220 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6769fe5f-6382-4b6f-8332-a8360b87f45b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.278373 Aug 02 06:52:49.020858 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 814/1719] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:52:47 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:49.020858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b5a18646-548f-4bec-8c47-fe84c804cf46 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:49.021397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b5a18646-548f-4bec-8c47-fe84c804cf46 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:49.041494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f37617cb-b246-426b-93ce-d6e58b53b31f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:49.050816 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f37617cb-b246-426b-93ce-d6e58b53b31f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1313 microversion: 2.1 time: 0.734447 Aug 02 06:52:49.054618 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 906/1720] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:48 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:49.066766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5a18646-548f-4bec-8c47-fe84c804cf46 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:49.067149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5a18646-548f-4bec-8c47-fe84c804cf46 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:49.067672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a4ec688d-c664-4a7e-8a36-398ad1bdd625 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927ab39550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:49.077408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5a18646-548f-4bec-8c47-fe84c804cf46 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:49.078139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5a18646-548f-4bec-8c47-fe84c804cf46 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:49.152836 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a4ec688d-c664-4a7e-8a36-398ad1bdd625 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.096791 Aug 02 06:52:49.153930 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 907/1721] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:49 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:49.168898 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d05d5be0-de8a-40c8-888d-ea085df1cacd tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f928c343700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:49.331716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b5a18646-548f-4bec-8c47-fe84c804cf46 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:49.347933 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b5a18646-548f-4bec-8c47-fe84c804cf46 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1265 microversion: 2.1 time: 0.332363 Aug 02 06:52:49.348852 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 815/1722] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:49 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1265 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:49.368012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-f2b2aa62-610f-4fa6-812a-9d24c61a3bb7 req-e55c8f60-cabc-4db1-b3e3-a877011dae90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "218c6c00-857e-42d7-82d4-eb818faf1f07", "name": "network-vif-deleted", "tag": "d333a6ac-1957-4aac-9862-415ec3c70230"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:49.391878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f2b2aa62-610f-4fa6-812a-9d24c61a3bb7 req-e55c8f60-cabc-4db1-b3e3-a877011dae90 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:49.400179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f2b2aa62-610f-4fa6-812a-9d24c61a3bb7 req-e55c8f60-cabc-4db1-b3e3-a877011dae90 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:49.470908 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-f2b2aa62-610f-4fa6-812a-9d24c61a3bb7 req-e55c8f60-cabc-4db1-b3e3-a877011dae90 service nova] Creating event network-vif-deleted:d333a6ac-1957-4aac-9862-415ec3c70230 for instance 218c6c00-857e-42d7-82d4-eb818faf1f07 on n-h1-851337-3 Aug 02 06:52:49.482912 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-f2b2aa62-610f-4fa6-812a-9d24c61a3bb7 req-e55c8f60-cabc-4db1-b3e3-a877011dae90 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123100 Aug 02 06:52:49.484159 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 816/1723] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:49.502779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-783e7792-010c-43fa-b94d-731c01829da8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:49.505710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-783e7792-010c-43fa-b94d-731c01829da8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:49.518544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-783e7792-010c-43fa-b94d-731c01829da8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:49.519163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-783e7792-010c-43fa-b94d-731c01829da8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:49.519871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-783e7792-010c-43fa-b94d-731c01829da8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:49.523836 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d05d5be0-de8a-40c8-888d-ea085df1cacd tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/223951ac-e88b-4052-a290-c150001f5f7e" status: 200 len: 223 microversion: 2.1 time: 0.366658 Aug 02 06:52:49.531943 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 908/1724] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 06:52:49 2022] GET /compute/v2.1/os-security-groups/223951ac-e88b-4052-a290-c150001f5f7e => generated 223 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:49.537305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fddce63a-e603-43b4-9618-c711953d6d19 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927aa97af0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:49.544000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-783e7792-010c-43fa-b94d-731c01829da8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:49.625797 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-783e7792-010c-43fa-b94d-731c01829da8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.140153 Aug 02 06:52:49.632914 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 817/1725] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 06:52:49 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:52:50.075116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ce64e977-1938-4dd1-af9a-869e0ae5b99f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:50.075800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ce64e977-1938-4dd1-af9a-869e0ae5b99f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:50.088840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ce64e977-1938-4dd1-af9a-869e0ae5b99f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:50.089286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ce64e977-1938-4dd1-af9a-869e0ae5b99f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:50.105035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ce64e977-1938-4dd1-af9a-869e0ae5b99f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:50.105652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ce64e977-1938-4dd1-af9a-869e0ae5b99f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:51.470571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ce64e977-1938-4dd1-af9a-869e0ae5b99f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:51.480963 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ce64e977-1938-4dd1-af9a-869e0ae5b99f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1313 microversion: 2.1 time: 1.409687 Aug 02 06:52:51.484743 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 818/1726] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:50 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1313 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:52:51.489978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-531aee56-6e1d-41c6-8281-c23f3a2da129 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b62d820>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:51.580479 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-531aee56-6e1d-41c6-8281-c23f3a2da129 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.094251 Aug 02 06:52:51.581425 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 819/1727] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:51 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:51.593231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c8ee4d48-dfeb-4155-85b0-797188d5c51c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:51.596126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c8ee4d48-dfeb-4155-85b0-797188d5c51c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:51.609880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8ee4d48-dfeb-4155-85b0-797188d5c51c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:51.610734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8ee4d48-dfeb-4155-85b0-797188d5c51c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:51.614832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8ee4d48-dfeb-4155-85b0-797188d5c51c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:51.615550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8ee4d48-dfeb-4155-85b0-797188d5c51c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:52.183261 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fddce63a-e603-43b4-9618-c711953d6d19 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/223951ac-e88b-4052-a290-c150001f5f7e" status: 202 len: 0 microversion: 2.1 time: 2.650075 Aug 02 06:52:52.184535 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 909/1728] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:52:49 2022] DELETE /compute/v2.1/os-security-groups/223951ac-e88b-4052-a290-c150001f5f7e => generated 0 bytes in 2652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:52:52.192710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-462a62b7-05af-43bf-bcc6-c3729d1cd197 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:52.195354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-462a62b7-05af-43bf-bcc6-c3729d1cd197 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:52.219061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-462a62b7-05af-43bf-bcc6-c3729d1cd197 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:52.222090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-462a62b7-05af-43bf-bcc6-c3729d1cd197 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:52.224818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-462a62b7-05af-43bf-bcc6-c3729d1cd197 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:52.234298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-462a62b7-05af-43bf-bcc6-c3729d1cd197 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:52.314926 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-462a62b7-05af-43bf-bcc6-c3729d1cd197 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.126048 Aug 02 06:52:52.328111 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 910/1729] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 06:52:52 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:52:52.337739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-58b1d47c-a33e-4ea1-8fd0-0d1ac868c976 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927ab39040>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:52.401210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG neutronclient.v2_0.client [None req-58b1d47c-a33e-4ea1-8fd0-0d1ac868c976 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist", "detail": ""}} {{(pid=126120) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:52:52.402211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.security_group_api [None req-58b1d47c-a33e-4ea1-8fd0-0d1ac868c976 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Neutron security group 223951ac-e88b-4052-a290-c150001f5f7e not found {{(pid=126120) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 06:52:52.402916 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-58b1d47c-a33e-4ea1-8fd0-0d1ac868c976 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist Aug 02 06:52:52.402916 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-f9bc8f2e-ab35-45fd-9eee-7213a3388527'] Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-58b1d47c-a33e-4ea1-8fd0-0d1ac868c976 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-security-groups/223951ac-e88b-4052-a290-c150001f5f7e HTTP/1.1 Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:52:52.405256 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:52:52.407164 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:52:52.407164 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:52:52.407164 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:52:52.407164 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:52:52.407164 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:52:52.407164 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:52:52.407164 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:52:52.407164 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:52:52.407164 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:52:52.407164 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:52:52.407164 n-d-851337-3 devstack@n-api.service[126120]: exception: Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist Aug 02 06:52:52.407164 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-f9bc8f2e-ab35-45fd-9eee-7213a3388527'] Aug 02 06:52:52.407164 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '223951ac-e88b-4052-a290-c150001f5f7e'} Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:52.408350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9bc8f2e-ab35-45fd-9eee-7213a3388527'] Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 06:52:52.410875 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9bc8f2e-ab35-45fd-9eee-7213a3388527'] Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9bc8f2e-ab35-45fd-9eee-7213a3388527'] Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:52.413166 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:52.415828 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:52.415828 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:52.415828 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:52.415828 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:52.415828 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist Aug 02 06:52:52.415828 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9bc8f2e-ab35-45fd-9eee-7213a3388527'] Aug 02 06:52:52.415828 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:52.423096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c8ee4d48-dfeb-4155-85b0-797188d5c51c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:52.423437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-58b1d47c-a33e-4ea1-8fd0-0d1ac868c976 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 404 to user: Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist Aug 02 06:52:52.423437 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-f9bc8f2e-ab35-45fd-9eee-7213a3388527'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:52.423437 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-58b1d47c-a33e-4ea1-8fd0-0d1ac868c976 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/223951ac-e88b-4052-a290-c150001f5f7e" status: 404 len: 194 microversion: 2.1 time: 0.087729 Aug 02 06:52:52.424181 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 911/1730] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 06:52:52 2022] GET /compute/v2.1/os-security-groups/223951ac-e88b-4052-a290-c150001f5f7e => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:52:52.427453 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c8ee4d48-dfeb-4155-85b0-797188d5c51c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1307 microversion: 2.1 time: 0.844631 Aug 02 06:52:52.438032 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 820/1731] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:51 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1307 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:52.444791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d0fdc660-4c1f-45d4-8b06-8de93664a2a3 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'create', calling method: .version_select at 0x7f927b251e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1674837555", "description": "tempest-description-1448465688"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:52.510878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-785bf89f-04bc-41e0-8e87-e4b4192882f0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:52.511489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-785bf89f-04bc-41e0-8e87-e4b4192882f0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:52.536427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-785bf89f-04bc-41e0-8e87-e4b4192882f0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:52.537299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-785bf89f-04bc-41e0-8e87-e4b4192882f0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:52.538550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-785bf89f-04bc-41e0-8e87-e4b4192882f0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:52.539614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-785bf89f-04bc-41e0-8e87-e4b4192882f0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:52.591316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:52.925370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-785bf89f-04bc-41e0-8e87-e4b4192882f0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:52.937264 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-785bf89f-04bc-41e0-8e87-e4b4192882f0 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1313 microversion: 2.1 time: 0.434988 Aug 02 06:52:52.937878 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 821/1732] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:52 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:52.944401 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d0fdc660-4c1f-45d4-8b06-8de93664a2a3 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.518804 Aug 02 06:52:52.945070 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 912/1733] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:52:52 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:52.947082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6b3aadfc-c79f-410b-a3c2-f3a55669d9f7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b1ab550>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:52.962828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-25527ec1-e26b-47d6-8da2-488784e175a8 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'create', calling method: .version_select at 0x7f927b251dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1516575382", "description": "tempest-description-604314485"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:53.024049 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6b3aadfc-c79f-410b-a3c2-f3a55669d9f7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.085024 Aug 02 06:52:53.024655 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 822/1734] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:52 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:53.346308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b9338ec7-20e2-4873-8c68-1a46f3a4cb68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:53.353817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b9338ec7-20e2-4873-8c68-1a46f3a4cb68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:53.379350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9338ec7-20e2-4873-8c68-1a46f3a4cb68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:53.382547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9338ec7-20e2-4873-8c68-1a46f3a4cb68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:53.384066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9338ec7-20e2-4873-8c68-1a46f3a4cb68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:53.385647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9338ec7-20e2-4873-8c68-1a46f3a4cb68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:53.423072 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-25527ec1-e26b-47d6-8da2-488784e175a8 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.463953 Aug 02 06:52:53.424302 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 913/1735] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:52:52 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:52:53.437424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-13b790fb-c728-4095-9a8a-96f74ffa6b90 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'create', calling method: .version_select at 0x7f927aa97ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-795323379", "description": "tempest-description-2075214841"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:53.482802 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b9338ec7-20e2-4873-8c68-1a46f3a4cb68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.146039 Aug 02 06:52:53.483715 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 823/1736] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 06:52:53 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:52:53.488455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8df43a54-30af-401d-bbab-c02d8bf346af tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:53.489060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8df43a54-30af-401d-bbab-c02d8bf346af tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:53.503656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8df43a54-30af-401d-bbab-c02d8bf346af tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:53.504099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8df43a54-30af-401d-bbab-c02d8bf346af tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:53.504872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8df43a54-30af-401d-bbab-c02d8bf346af tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:53.505298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8df43a54-30af-401d-bbab-c02d8bf346af tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:54.007268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8df43a54-30af-401d-bbab-c02d8bf346af tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:54.027186 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8df43a54-30af-401d-bbab-c02d8bf346af tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1307 microversion: 2.1 time: 0.538661 Aug 02 06:52:54.029686 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-13b790fb-c728-4095-9a8a-96f74ffa6b90 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.597108 Aug 02 06:52:54.030791 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 914/1737] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:52:53 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:54.036999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7bdf6b02-64ee-49a7-92fc-1fcdc2da870e req-c9ea45de-95b5-4b0b-95b2-daac607e1b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4790820-2d09-47ab-9c4d-ec909dc7e1c1", "tag": "8406eedb-691b-4d88-a1e7-a1e3cfda7983"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:54.038289 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 824/1738] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:53 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1307 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:54.060065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4395c908-a43c-4374-9773-3676b0bf9025 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:54.066104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4395c908-a43c-4374-9773-3676b0bf9025 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:54.069332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7bdf6b02-64ee-49a7-92fc-1fcdc2da870e req-c9ea45de-95b5-4b0b-95b2-daac607e1b08 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:54.071007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7bdf6b02-64ee-49a7-92fc-1fcdc2da870e req-c9ea45de-95b5-4b0b-95b2-daac607e1b08 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:54.099753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4395c908-a43c-4374-9773-3676b0bf9025 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:54.100238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4395c908-a43c-4374-9773-3676b0bf9025 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:54.101436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4395c908-a43c-4374-9773-3676b0bf9025 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:54.101566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4395c908-a43c-4374-9773-3676b0bf9025 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:54.123732 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7bdf6b02-64ee-49a7-92fc-1fcdc2da870e req-c9ea45de-95b5-4b0b-95b2-daac607e1b08 service nova] Creating event network-changed:8406eedb-691b-4d88-a1e7-a1e3cfda7983 for instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 on n-h2-851337-3 Aug 02 06:52:54.143604 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7bdf6b02-64ee-49a7-92fc-1fcdc2da870e req-c9ea45de-95b5-4b0b-95b2-daac607e1b08 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107286 Aug 02 06:52:54.145924 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 915/1739] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:54.164772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-23e7b9be-2c53-483a-9389-864fff88bd02 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927aa55c10>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:54.253510 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-23e7b9be-2c53-483a-9389-864fff88bd02 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.105876 Aug 02 06:52:54.260478 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 916/1740] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:54 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:54.269195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b63a789e-6a16-4df5-84f2-5660f74a4ee0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927aa974c0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:54.557088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4395c908-a43c-4374-9773-3676b0bf9025 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:54.573226 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4395c908-a43c-4374-9773-3676b0bf9025 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1313 microversion: 2.1 time: 0.521125 Aug 02 06:52:54.575976 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 825/1741] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:54 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:54.590474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-9ca9e3aa-fe9c-4e2b-bdc8-2476cacf1975 req-8a3ccd05-f993-47f8-aee8-44b4edc9e569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303b535b-cea0-4219-ad1b-3849b9042a53", "name": "network-vif-plugged", "status": "completed", "tag": "78a224c6-e169-4c15-906f-64fc36ce7044"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:54.619633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9ca9e3aa-fe9c-4e2b-bdc8-2476cacf1975 req-8a3ccd05-f993-47f8-aee8-44b4edc9e569 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:54.621300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9ca9e3aa-fe9c-4e2b-bdc8-2476cacf1975 req-8a3ccd05-f993-47f8-aee8-44b4edc9e569 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:54.660556 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-9ca9e3aa-fe9c-4e2b-bdc8-2476cacf1975 req-8a3ccd05-f993-47f8-aee8-44b4edc9e569 service nova] Creating event network-vif-plugged:78a224c6-e169-4c15-906f-64fc36ce7044 for instance 303b535b-cea0-4219-ad1b-3849b9042a53 on n-h2-851337-3 Aug 02 06:52:54.672903 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-9ca9e3aa-fe9c-4e2b-bdc8-2476cacf1975 req-8a3ccd05-f993-47f8-aee8-44b4edc9e569 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094623 Aug 02 06:52:54.675000 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 826/1742] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:54.753075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79ea09dc-f2d8-4e34-b297-333d4c56163d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:54.770276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79ea09dc-f2d8-4e34-b297-333d4c56163d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:54.800531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79ea09dc-f2d8-4e34-b297-333d4c56163d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:54.802706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79ea09dc-f2d8-4e34-b297-333d4c56163d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:54.804479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79ea09dc-f2d8-4e34-b297-333d4c56163d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:54.807581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79ea09dc-f2d8-4e34-b297-333d4c56163d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:54.928948 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79ea09dc-f2d8-4e34-b297-333d4c56163d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.252387 Aug 02 06:52:54.938898 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 827/1743] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 06:52:54 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments => generated 197 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:52:55.040644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:55.062919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cd1fc5ba-bdd2-4646-a373-fde2b68f5923 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:55.064254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cd1fc5ba-bdd2-4646-a373-fde2b68f5923 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:55.074784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd1fc5ba-bdd2-4646-a373-fde2b68f5923 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:55.076120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd1fc5ba-bdd2-4646-a373-fde2b68f5923 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:55.078474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd1fc5ba-bdd2-4646-a373-fde2b68f5923 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:55.078922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd1fc5ba-bdd2-4646-a373-fde2b68f5923 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:55.257528 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b63a789e-6a16-4df5-84f2-5660f74a4ee0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.995854 Aug 02 06:52:55.259780 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 917/1744] 10.222.0.79 () {58 vars in 1158 bytes} [Tue Aug 2 06:52:54 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:55.273510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e06bd882-0f58-4b6e-8f06-1ca60ff5cf3a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927ab39550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:55.477843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cd1fc5ba-bdd2-4646-a373-fde2b68f5923 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:55.488602 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cd1fc5ba-bdd2-4646-a373-fde2b68f5923 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1307 microversion: 2.1 time: 0.429744 Aug 02 06:52:55.491754 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 828/1745] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:55 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1307 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:55.499343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f47fb1ea-78f7-4469-9aef-4c7d2427fa23 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b5078b0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:55.598813 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f47fb1ea-78f7-4469-9aef-4c7d2427fa23 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.105641 Aug 02 06:52:55.599762 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 829/1746] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:55 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:55.874385 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e06bd882-0f58-4b6e-8f06-1ca60ff5cf3a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/4866f524-4f82-42e9-a812-5febee877d0b" status: 202 len: 0 microversion: 2.1 time: 0.605242 Aug 02 06:52:55.875581 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 918/1747] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:52:55 2022] DELETE /compute/v2.1/os-security-groups/4866f524-4f82-42e9-a812-5febee877d0b => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:52:55.881408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-68db4aa8-4407-4df8-9f9d-baf259caea44 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:55.882432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-68db4aa8-4407-4df8-9f9d-baf259caea44 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:55.898787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68db4aa8-4407-4df8-9f9d-baf259caea44 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:55.904349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68db4aa8-4407-4df8-9f9d-baf259caea44 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:55.907576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68db4aa8-4407-4df8-9f9d-baf259caea44 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:55.908462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68db4aa8-4407-4df8-9f9d-baf259caea44 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:55.922081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8f33e9d3-3c4a-4f34-a945-52add1263430 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Action: 'create', calling method: .version_select at 0x7f927b590550>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4a5xDcpQWT72RSXvY4P9k2aW8qf3B6yVh/cuFXUTiJgN7aMQpZ9kMAgbLkJhrXV0vhbf6AGkAGwtXiV0/zGIRvwzbX650qcU42eNHtC66FvKa5OAUDz6FcL6kpYAMVKA=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8f33e9d3-3c4a-4f34-a945-52add1263430 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Request method failure captured: Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 257 Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MnHyd43DZrBhEZgjlj_Z-Gnljm4fCBOWKvJCS-6K7B4ekN7wOP8TNIhHsoleyu3GMjsIjYh86cHTZ2BJHLOwxmyP-a84lX5xHsLvWCSx5kikkzgc0-K9Yw4C-0aU8p20Xs1W_1dtwgOHfAt0frVC0x9y7qxtrRfcPdg1IsUxSX-IhQ Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:52:55.935077 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:52:55.936850 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2210633b204646538cc37d72c6aea0ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}] Aug 02 06:52:55.936850 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:55.936850 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:55.936850 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:55.936850 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:55.936850 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:52:55.936850 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:52:55.936850 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 88417cf6f3434ee0b8b2c527294f1632 Aug 02 06:52:55.936850 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:55.936850 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:52:55.936850 n-d-851337-3 devstack@n-api.service[126119]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4a5xDcpQWT72RSXvY4P9k2aW8qf3B6yVh/cuFXUTiJgN7aMQpZ9kMAgbLkJhrXV0vhbf6AGkAGwtXiV0/zGIRvwzbX650qcU42eNHtC66FvKa5OAUDz6FcL6kpYAMVKA=="}} Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4a5xDcpQWT72RSXvY4P9k2aW8qf3B6yVh/cuFXUTiJgN7aMQpZ9kMAgbLkJhrXV0vhbf6AGkAGwtXiV0/zGIRvwzbX650qcU42eNHtC66FvKa5OAUDz6FcL6kpYAMVKA=='}}} Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:55.937767 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:52:55.940066 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:52:55.945505 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:52:55.949515 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 02 06:52:55.949515 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:55.949515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8f33e9d3-3c4a-4f34-a945-52add1263430 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:55.949515 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8f33e9d3-3c4a-4f34-a945-52add1263430 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.335886 Aug 02 06:52:55.952950 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 830/1748] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:52:55 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 352 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:52:55.965005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f9b4133-4c6d-4a6b-924a-97028e8ea6a0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927bbde700>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:56.069033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG neutronclient.v2_0.client [None req-3f9b4133-4c6d-4a6b-924a-97028e8ea6a0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist", "detail": ""}} {{(pid=126119) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:52:56.069669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.security_group_api [None req-3f9b4133-4c6d-4a6b-924a-97028e8ea6a0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Neutron security group 4866f524-4f82-42e9-a812-5febee877d0b not found {{(pid=126119) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 06:52:56.070221 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-3f9b4133-4c6d-4a6b-924a-97028e8ea6a0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist Aug 02 06:52:56.070221 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-401d97e0-e5df-4b2f-87b7-176be55d7a7d'] Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f9b4133-4c6d-4a6b-924a-97028e8ea6a0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-security-groups/4866f524-4f82-42e9-a812-5febee877d0b HTTP/1.1 Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:52:56.081538 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:52:56.083435 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:52:56.083435 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:52:56.083435 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:52:56.083435 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:52:56.083435 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:52:56.083435 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:52:56.083435 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:52:56.083435 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:52:56.083435 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:52:56.083435 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:52:56.083435 n-d-851337-3 devstack@n-api.service[126119]: exception: Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist Aug 02 06:52:56.083435 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-401d97e0-e5df-4b2f-87b7-176be55d7a7d'] Aug 02 06:52:56.083435 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '4866f524-4f82-42e9-a812-5febee877d0b'} Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:56.084379 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-401d97e0-e5df-4b2f-87b7-176be55d7a7d'] Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 06:52:56.085732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-401d97e0-e5df-4b2f-87b7-176be55d7a7d'] Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-401d97e0-e5df-4b2f-87b7-176be55d7a7d'] Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.087016 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:56.088445 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:56.088445 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:56.088445 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:56.088445 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:56.088445 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist Aug 02 06:52:56.088445 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-401d97e0-e5df-4b2f-87b7-176be55d7a7d'] Aug 02 06:52:56.088445 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.088445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f9b4133-4c6d-4a6b-924a-97028e8ea6a0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 404 to user: Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist Aug 02 06:52:56.088445 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-401d97e0-e5df-4b2f-87b7-176be55d7a7d'] {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:56.088445 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3f9b4133-4c6d-4a6b-924a-97028e8ea6a0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/4866f524-4f82-42e9-a812-5febee877d0b" status: 404 len: 194 microversion: 2.1 time: 0.131778 Aug 02 06:52:56.091007 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 831/1749] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 06:52:55 2022] GET /compute/v2.1/os-security-groups/4866f524-4f82-42e9-a812-5febee877d0b => generated 194 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:52:56.105463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9db767f7-e7f8-4dfc-8662-47949b78b26f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:56.107803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9db767f7-e7f8-4dfc-8662-47949b78b26f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:56.134655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9db767f7-e7f8-4dfc-8662-47949b78b26f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:56.135139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9db767f7-e7f8-4dfc-8662-47949b78b26f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:56.137195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9db767f7-e7f8-4dfc-8662-47949b78b26f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:56.137648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9db767f7-e7f8-4dfc-8662-47949b78b26f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:56.190555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-68db4aa8-4407-4df8-9f9d-baf259caea44 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:56.200156 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-68db4aa8-4407-4df8-9f9d-baf259caea44 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1313 microversion: 2.1 time: 0.323250 Aug 02 06:52:56.215080 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 919/1750] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:55 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:56.222181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cd2c5026-75b1-4bd9-a159-46098cc61de0 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Action: 'create', calling method: .version_select at 0x7f927aa555e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2069545225", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:56.244323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-cd2c5026-75b1-4bd9-a159-46098cc61de0 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Getting quotas for project 2210633b204646538cc37d72c6aea0ad. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:52:56.244772 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9db767f7-e7f8-4dfc-8662-47949b78b26f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.152557 Aug 02 06:52:56.255622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-cd2c5026-75b1-4bd9-a159-46098cc61de0 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Getting quotas for user 88417cf6f3434ee0b8b2c527294f1632 and project 2210633b204646538cc37d72c6aea0ad. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:52:56.260860 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 832/1751] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 06:52:56 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:52:56.270942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-57f04d53-198a-4ad9-be95-25f96b880056 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927b425940>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:56.277099 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-cd2c5026-75b1-4bd9-a159-46098cc61de0 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cd2c5026-75b1-4bd9-a159-46098cc61de0 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Request method failure captured: Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 2167 Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MnHyd43DZrBhEZgjlj_Z-Gnljm4fCBOWKvJCS-6K7B4ekN7wOP8TNIhHsoleyu3GMjsIjYh86cHTZ2BJHLOwxmyP-a84lX5xHsLvWCSx5kikkzgc0-K9Yw4C-0aU8p20Xs1W_1dtwgOHfAt0frVC0x9y7qxtrRfcPdg1IsUxSX-IhQ Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2210633b204646538cc37d72c6aea0ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}] Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 88417cf6f3434ee0b8b2c527294f1632 Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2069545225", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:52:56.307705 n-d-851337-3 devstack@n-api.service[126120]: exception: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2069545225', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:56.310504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:56.316375 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.320985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cd2c5026-75b1-4bd9-a159-46098cc61de0 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:56.322134 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cd2c5026-75b1-4bd9-a159-46098cc61de0 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.105454 Aug 02 06:52:56.330514 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 920/1752] 10.222.0.79 () {60 vars in 1160 bytes} [Tue Aug 2 06:52:56 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 02 06:52:56.336720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3ab994ae-3055-4928-8b66-d70895aef59b tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Action: 'create', calling method: .version_select at 0x7f927a9e0310>, body: {"keypair": {"name": "tempest-keypair-43263134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8MpQnYc3OJdRZ73Leb+2ErR2QQ/yCaWNo8gMZfIhlRG+WIxXFH6SL9UumVyQOxfEqE/L0h+Eywimgvg0ZaifTNX0UtrgEzk7uZruvQbST/I+yWpGwXe+NSRqS/Es3iog=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:56.356594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-3ab994ae-3055-4928-8b66-d70895aef59b tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Getting quotas for project 2210633b204646538cc37d72c6aea0ad. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:52:56.365237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-3ab994ae-3055-4928-8b66-d70895aef59b tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Getting quotas for user 88417cf6f3434ee0b8b2c527294f1632 and project 2210633b204646538cc37d72c6aea0ad. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:52:56.416868 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3ab994ae-3055-4928-8b66-d70895aef59b tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.076887 Aug 02 06:52:56.427279 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 921/1753] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:52:56 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:56.433151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df8f84ba-50e9-4a40-ba6e-4396238178d1 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Action: 'create', calling method: .version_select at 0x7f927a9ceca0>, body: {"keypair": {"name": "tempest-keypair-43263134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBuQV/8q5D7vTBwc0yEg7vvO1ekaRg9vwtfolD4AUATcOzlwgT1l+UfvDzgHh6bXkPHYF7neC1jEuognCh/pkc5BfdOCnHqcQzSUS5bOmaGxkrJ2BMxr+3kbkrNlgG7Cw=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:56.453336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-df8f84ba-50e9-4a40-ba6e-4396238178d1 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Getting quotas for project 2210633b204646538cc37d72c6aea0ad. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:52:56.460881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-df8f84ba-50e9-4a40-ba6e-4396238178d1 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Getting quotas for user 88417cf6f3434ee0b8b2c527294f1632 and project 2210633b204646538cc37d72c6aea0ad. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:52:56.506403 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-df8f84ba-50e9-4a40-ba6e-4396238178d1 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] HTTP exception thrown: Key pair 'tempest-keypair-43263134' already exists. Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df8f84ba-50e9-4a40-ba6e-4396238178d1 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Request method failure captured: Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 271 Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MnHyd43DZrBhEZgjlj_Z-Gnljm4fCBOWKvJCS-6K7B4ekN7wOP8TNIhHsoleyu3GMjsIjYh86cHTZ2BJHLOwxmyP-a84lX5xHsLvWCSx5kikkzgc0-K9Yw4C-0aU8p20Xs1W_1dtwgOHfAt0frVC0x9y7qxtrRfcPdg1IsUxSX-IhQ Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2210633b204646538cc37d72c6aea0ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}] Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 88417cf6f3434ee0b8b2c527294f1632 Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: {"keypair": {"name": "tempest-keypair-43263134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBuQV/8q5D7vTBwc0yEg7vvO1ekaRg9vwtfolD4AUATcOzlwgT1l+UfvDzgHh6bXkPHYF7neC1jEuognCh/pkc5BfdOCnHqcQzSUS5bOmaGxkrJ2BMxr+3kbkrNlgG7Cw=="}} Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: exception: Key pair 'tempest-keypair-43263134' already exists. Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-43263134', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBuQV/8q5D7vTBwc0yEg7vvO1ekaRg9vwtfolD4AUATcOzlwgT1l+UfvDzgHh6bXkPHYF7neC1jEuognCh/pkc5BfdOCnHqcQzSUS5bOmaGxkrJ2BMxr+3kbkrNlgG7Cw=='}}} Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result.read() Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '88417cf6f3434ee0b8b2c527294f1632-tempest-keypair-43263134' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 02 06:52:56.521564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi session.flush() Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result.read() Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 02 06:52:56.526961 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '88417cf6f3434ee0b8b2c527294f1632-tempest-keypair-43263134' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 2, 6, 52, 56, 492078), 'updated_at': None, 'name': 'tempest-keypair-43263134', 'user_id': '88417cf6f3434ee0b8b2c527294f1632', 'fingerprint': '88:5d:97:da:28:51:7d:3c:6f:38:fa:03:1b:94:8d:5d', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBuQV/8q5D7vTBwc0yEg7vvO1ekaRg9vwtfolD4AUATcOzlwgT1l+UfvDzgHh6bXkPHYF7neC1jEuognCh/pkc5BfdOCnHqcQzSUS5bOmaGxkrJ2BMxr+3kbkrNlgG7Cw==', 'type': 'ssh'}] Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6730, in import_key_pair Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi keypair.create() Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._create() Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-43263134' already exists. Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 02 06:52:56.539642 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-43263134' already exists. Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-43263134' already exists. Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df8f84ba-50e9-4a40-ba6e-4396238178d1 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Returning 409 to user: Key pair 'tempest-keypair-43263134' already exists. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df8f84ba-50e9-4a40-ba6e-4396238178d1 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 409 len: 103 microversion: 2.1 time: 0.099155 Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 922/1754] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:52:56 2022] POST /compute/v2.1/os-keypairs => generated 103 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-76a2ab15-b752-4a4f-80ec-63a62d35301a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:56.554696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-76a2ab15-b752-4a4f-80ec-63a62d35301a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:56.560638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76a2ab15-b752-4a4f-80ec-63a62d35301a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:56.561100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76a2ab15-b752-4a4f-80ec-63a62d35301a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:56.561919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76a2ab15-b752-4a4f-80ec-63a62d35301a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:56.562369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76a2ab15-b752-4a4f-80ec-63a62d35301a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:56.581849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:57.015343 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-57f04d53-198a-4ad9-be95-25f96b880056 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/f63a29d3-61c9-4cd5-8948-3ac0668a871a" status: 202 len: 0 microversion: 2.1 time: 0.752797 Aug 02 06:52:57.019251 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 833/1755] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:52:56 2022] DELETE /compute/v2.1/os-security-groups/f63a29d3-61c9-4cd5-8948-3ac0668a871a => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:52:57.024595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9531723a-547a-4150-8e76-eefb7b4c1e93 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Calling method '.version_select at 0x7f927af2baf0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:57.052486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:57.081147 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9531723a-547a-4150-8e76-eefb7b4c1e93 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-43263134" status: 202 len: 0 microversion: 2.1 time: 0.060245 Aug 02 06:52:57.082909 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 834/1756] 10.222.0.79 () {58 vars in 1215 bytes} [Tue Aug 2 06:52:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-43263134 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:52:57.096501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-825e3fcd-92a6-49e0-a645-2ee9951fac94 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927ade5f70>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:57.172821 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-825e3fcd-92a6-49e0-a645-2ee9951fac94 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.088077 Aug 02 06:52:57.173743 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 835/1757] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:57 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:57.179296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b857df86-22d3-44f8-8d07-64e44398035f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927ade5040>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:57.190020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-76a2ab15-b752-4a4f-80ec-63a62d35301a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:57.200439 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-76a2ab15-b752-4a4f-80ec-63a62d35301a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1307 microversion: 2.1 time: 0.667607 Aug 02 06:52:57.205927 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 923/1758] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:56 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1307 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:57.219451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f502565-381d-4004-ae91-3c53776d68ce tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Action: 'create', calling method: .version_select at 0x7f927a9e0dc0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk3chJY0oisDCRmOnCLLcXOlQH8yjjWzvRt3Oa5UoOpXomurVaNRTBtIK7sn7AHoY6+NOZGBFPQYM+i6uICpokh+gumezTmprQTTuhELMInLb+JuwKq5BAj3hrM7O1IMQ=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f502565-381d-4004-ae91-3c53776d68ce tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Request method failure captured: Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 247 Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MnHyd43DZrBhEZgjlj_Z-Gnljm4fCBOWKvJCS-6K7B4ekN7wOP8TNIhHsoleyu3GMjsIjYh86cHTZ2BJHLOwxmyP-a84lX5xHsLvWCSx5kikkzgc0-K9Yw4C-0aU8p20Xs1W_1dtwgOHfAt0frVC0x9y7qxtrRfcPdg1IsUxSX-IhQ Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2210633b204646538cc37d72c6aea0ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}] Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 88417cf6f3434ee0b8b2c527294f1632 Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk3chJY0oisDCRmOnCLLcXOlQH8yjjWzvRt3Oa5UoOpXomurVaNRTBtIK7sn7AHoY6+NOZGBFPQYM+i6uICpokh+gumezTmprQTTuhELMInLb+JuwKq5BAj3hrM7O1IMQ=="}} Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk3chJY0oisDCRmOnCLLcXOlQH8yjjWzvRt3Oa5UoOpXomurVaNRTBtIK7sn7AHoY6+NOZGBFPQYM+i6uICpokh+gumezTmprQTTuhELMInLb+JuwKq5BAj3hrM7O1IMQ=='}}} Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi '' Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:52:57.225062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 02 06:52:57.233649 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.245321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f502565-381d-4004-ae91-3c53776d68ce tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:57.246579 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5f502565-381d-4004-ae91-3c53776d68ce tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.039160 Aug 02 06:52:57.249746 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 924/1759] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:52:57 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:52:57.256926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG neutronclient.v2_0.client [None req-b857df86-22d3-44f8-8d07-64e44398035f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist", "detail": ""}} {{(pid=126119) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:52:57.257599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.security_group_api [None req-b857df86-22d3-44f8-8d07-64e44398035f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Neutron security group f63a29d3-61c9-4cd5-8948-3ac0668a871a not found {{(pid=126119) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 06:52:57.258219 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-b857df86-22d3-44f8-8d07-64e44398035f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist Aug 02 06:52:57.258219 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-f5827ed7-140b-4175-8bfe-0f8cd22a80a0'] Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b857df86-22d3-44f8-8d07-64e44398035f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-security-groups/f63a29d3-61c9-4cd5-8948-3ac0668a871a HTTP/1.1 Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: exception: Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-f5827ed7-140b-4175-8bfe-0f8cd22a80a0'] Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'f63a29d3-61c9-4cd5-8948-3ac0668a871a'} Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:52:57.262223 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5827ed7-140b-4175-8bfe-0f8cd22a80a0'] Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5827ed7-140b-4175-8bfe-0f8cd22a80a0'] Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5827ed7-140b-4175-8bfe-0f8cd22a80a0'] Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5827ed7-140b-4175-8bfe-0f8cd22a80a0'] Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b857df86-22d3-44f8-8d07-64e44398035f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 404 to user: Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-f5827ed7-140b-4175-8bfe-0f8cd22a80a0'] {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b857df86-22d3-44f8-8d07-64e44398035f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/f63a29d3-61c9-4cd5-8948-3ac0668a871a" status: 404 len: 194 microversion: 2.1 time: 0.088734 Aug 02 06:52:57.266717 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 836/1760] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 06:52:57 2022] GET /compute/v2.1/os-security-groups/f63a29d3-61c9-4cd5-8948-3ac0668a871a => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:52:57.278954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b4b5d6ae-226a-42c5-bcaf-cc476678240a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:57.279729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b4b5d6ae-226a-42c5-bcaf-cc476678240a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:57.289721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4b5d6ae-226a-42c5-bcaf-cc476678240a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:57.290488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4b5d6ae-226a-42c5-bcaf-cc476678240a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:57.292071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4b5d6ae-226a-42c5-bcaf-cc476678240a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:57.293024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4b5d6ae-226a-42c5-bcaf-cc476678240a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:57.367794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-59382381-5710-42f7-8bf3-b11ad58d693d tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Action: 'create', calling method: .version_select at 0x7f927a9e11f0>, body: {"keypair": {"name": "tempest-keypair-1991769641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLO/BkmjDL3cKb4JCQs/vjYS5scWCB4RSwntpaqvg8ql8GrCNEIBetHzvUtWFNshRhVkEMNTJjY36ojXdFglHa2P0WsDs4Fh8rOf2rHm6zE9f3YvsAZS1Yzm4VrBFwcIMQ=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:57.440674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-59382381-5710-42f7-8bf3-b11ad58d693d tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Getting quotas for project c21684e149204ae7afe06a3097411bd0. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:52:57.447138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-59382381-5710-42f7-8bf3-b11ad58d693d tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Getting quotas for user 391135debbcb49de8b47dea807d9a4ea and project c21684e149204ae7afe06a3097411bd0. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:52:57.453151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:52:57.522867 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-59382381-5710-42f7-8bf3-b11ad58d693d tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.271185 Aug 02 06:52:57.523526 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 925/1761] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:52:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:57.537513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cec14803-7f2d-43b9-ba03-6f5fffb98840 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Action: 'create', calling method: .version_select at 0x7f927a9e1af0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-990025364", "public_key": " "}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:57.579458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-cec14803-7f2d-43b9-ba03-6f5fffb98840 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Getting quotas for project 2210633b204646538cc37d72c6aea0ad. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:52:57.584780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b4b5d6ae-226a-42c5-bcaf-cc476678240a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:57.591156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-cec14803-7f2d-43b9-ba03-6f5fffb98840 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Getting quotas for user 88417cf6f3434ee0b8b2c527294f1632 and project 2210633b204646538cc37d72c6aea0ad. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:52:57.595168 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b4b5d6ae-226a-42c5-bcaf-cc476678240a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1313 microversion: 2.1 time: 0.328342 Aug 02 06:52:57.598838 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 837/1762] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:57 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:57.611304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4fcdacb1-3afd-46a8-bb9a-359ffcbba8c5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:57.616807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4fcdacb1-3afd-46a8-bb9a-359ffcbba8c5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:57.630986 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-cec14803-7f2d-43b9-ba03-6f5fffb98840 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:57.635161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4fcdacb1-3afd-46a8-bb9a-359ffcbba8c5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:57.636009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4fcdacb1-3afd-46a8-bb9a-359ffcbba8c5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:57.638105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4fcdacb1-3afd-46a8-bb9a-359ffcbba8c5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cec14803-7f2d-43b9-ba03-6f5fffb98840 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Request method failure captured: Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 94 Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MnHyd43DZrBhEZgjlj_Z-Gnljm4fCBOWKvJCS-6K7B4ekN7wOP8TNIhHsoleyu3GMjsIjYh86cHTZ2BJHLOwxmyP-a84lX5xHsLvWCSx5kikkzgc0-K9Yw4C-0aU8p20Xs1W_1dtwgOHfAt0frVC0x9y7qxtrRfcPdg1IsUxSX-IhQ Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2210633b204646538cc37d72c6aea0ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}] Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 88417cf6f3434ee0b8b2c527294f1632 Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-990025364", "public_key": " "}} Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: exception: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-990025364', 'public_key': ' '}}} Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.639227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cec14803-7f2d-43b9-ba03-6f5fffb98840 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cec14803-7f2d-43b9-ba03-6f5fffb98840 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.116590 Aug 02 06:52:57.646197 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 926/1763] 10.222.0.79 () {60 vars in 1158 bytes} [Tue Aug 2 06:52:57 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 02 06:52:57.650500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4fcdacb1-3afd-46a8-bb9a-359ffcbba8c5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:57.681403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8d27b481-c7fe-497f-b436-b2ba6c5df5bd tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927a9ce310>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:57.741697 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4fcdacb1-3afd-46a8-bb9a-359ffcbba8c5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.141546 Aug 02 06:52:57.747221 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 838/1764] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 06:52:57 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:52:57.757259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-342c2bf6-a261-4137-b484-7a6ed5298a23 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Action: 'create', calling method: .version_select at 0x7f927af2bca0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBO20PpZgBsZiM/eDX9eH9VsDMJFIFrLbYppWibLMro0OTHvWcujKxVJpxOZ/Lj8Hq/3fSQ83v/vB1Ar9LMlIoek0vJK2WpqvDWhD1ToHUCdsQ0TVPi+ND5KO0oLCEssbg=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-342c2bf6-a261-4137-b484-7a6ed5298a23 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Request method failure captured: Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 507 Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MnHyd43DZrBhEZgjlj_Z-Gnljm4fCBOWKvJCS-6K7B4ekN7wOP8TNIhHsoleyu3GMjsIjYh86cHTZ2BJHLOwxmyP-a84lX5xHsLvWCSx5kikkzgc0-K9Yw4C-0aU8p20Xs1W_1dtwgOHfAt0frVC0x9y7qxtrRfcPdg1IsUxSX-IhQ Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2210633b204646538cc37d72c6aea0ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}] Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 88417cf6f3434ee0b8b2c527294f1632 Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBO20PpZgBsZiM/eDX9eH9VsDMJFIFrLbYppWibLMro0OTHvWcujKxVJpxOZ/Lj8Hq/3fSQ83v/vB1Ar9LMlIoek0vJK2WpqvDWhD1ToHUCdsQ0TVPi+ND5KO0oLCEssbg=="}} Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBO20PpZgBsZiM/eDX9eH9VsDMJFIFrLbYppWibLMro0OTHvWcujKxVJpxOZ/Lj8Hq/3fSQ83v/vB1Ar9LMlIoek0vJK2WpqvDWhD1ToHUCdsQ0TVPi+ND5KO0oLCEssbg=='}}} Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 02 06:52:57.767124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 02 06:52:57.771588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.777138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-342c2bf6-a261-4137-b484-7a6ed5298a23 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:57.778286 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-342c2bf6-a261-4137-b484-7a6ed5298a23 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.029818 Aug 02 06:52:57.781049 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 839/1765] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:52:57 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:52:57.796221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b6212f82-e35f-4b4f-8c8e-166a35c93548 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Action: 'create', calling method: .version_select at 0x7f927ac53280>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-183362178", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:57.850647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-b6212f82-e35f-4b4f-8c8e-166a35c93548 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Getting quotas for project 2210633b204646538cc37d72c6aea0ad. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:52:57.864082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-b6212f82-e35f-4b4f-8c8e-166a35c93548 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Getting quotas for user 88417cf6f3434ee0b8b2c527294f1632 and project 2210633b204646538cc37d72c6aea0ad. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:52:57.910691 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-b6212f82-e35f-4b4f-8c8e-166a35c93548 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b6212f82-e35f-4b4f-8c8e-166a35c93548 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Request method failure captured: Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 117 Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MnHyd43DZrBhEZgjlj_Z-Gnljm4fCBOWKvJCS-6K7B4ekN7wOP8TNIhHsoleyu3GMjsIjYh86cHTZ2BJHLOwxmyP-a84lX5xHsLvWCSx5kikkzgc0-K9Yw4C-0aU8p20Xs1W_1dtwgOHfAt0frVC0x9y7qxtrRfcPdg1IsUxSX-IhQ Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2210633b204646538cc37d72c6aea0ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}] Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 88417cf6f3434ee0b8b2c527294f1632 Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-183362178", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: exception: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-183362178', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 02 06:52:57.917642 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b6212f82-e35f-4b4f-8c8e-166a35c93548 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b6212f82-e35f-4b4f-8c8e-166a35c93548 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.131875 Aug 02 06:52:57.929382 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 840/1766] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:52:57 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 02 06:52:57.937132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5b5492d1-43df-45a9-94ab-55f4b9293892 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Calling method '.version_select at 0x7f927ac53e50>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:57.966426 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-5b5492d1-43df-45a9-94ab-55f4b9293892 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-432618187 not found for user 88417cf6f3434ee0b8b2c527294f1632 Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5b5492d1-43df-45a9-94ab-55f4b9293892 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Request method failure captured: Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-432618187 HTTP/1.1 Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MnHyd43DZrBhEZgjlj_Z-Gnljm4fCBOWKvJCS-6K7B4ekN7wOP8TNIhHsoleyu3GMjsIjYh86cHTZ2BJHLOwxmyP-a84lX5xHsLvWCSx5kikkzgc0-K9Yw4C-0aU8p20Xs1W_1dtwgOHfAt0frVC0x9y7qxtrRfcPdg1IsUxSX-IhQ Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2210633b204646538cc37d72c6aea0ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2210633b204646538cc37d72c6aea0ad"}]}] Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2210633b204646538cc37d72c6aea0ad Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-670007236 Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 88417cf6f3434ee0b8b2c527294f1632 Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-KeyPairsNegativeTestJSON-670007236-project Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: exception: Keypair tempest-keypair-non-existent-432618187 not found for user 88417cf6f3434ee0b8b2c527294f1632 Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'tempest-keypair-non-existent-432618187'} Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6814, in delete_key_pair Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6835, in get_key_pair Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-432618187 not found for user 88417cf6f3434ee0b8b2c527294f1632 Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.968519 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-432618187 not found for user 88417cf6f3434ee0b8b2c527294f1632 Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-432618187 not found for user 88417cf6f3434ee0b8b2c527294f1632 Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5b5492d1-43df-45a9-94ab-55f4b9293892 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] Returning 404 to user: Keypair tempest-keypair-non-existent-432618187 not found for user 88417cf6f3434ee0b8b2c527294f1632 {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:57.976288 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5b5492d1-43df-45a9-94ab-55f4b9293892 tempest-KeyPairsNegativeTestJSON-670007236 tempest-KeyPairsNegativeTestJSON-670007236-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-432618187" status: 404 len: 144 microversion: 2.1 time: 0.041424 Aug 02 06:52:57.981627 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 841/1767] 10.222.0.79 () {58 vars in 1257 bytes} [Tue Aug 2 06:52:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-432618187 => generated 144 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:52:58.170507 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8d27b481-c7fe-497f-b436-b2ba6c5df5bd tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/7f274577-c614-4b4e-85d1-035a6ca1da96" status: 202 len: 0 microversion: 2.1 time: 0.509267 Aug 02 06:52:58.171672 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 927/1768] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:52:57 2022] DELETE /compute/v2.1/os-security-groups/7f274577-c614-4b4e-85d1-035a6ca1da96 => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:52:58.181397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-149235b3-2a18-4177-bbb1-537e08d9c07a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927bbde700>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:58.191224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7a6a90fd-876e-494a-9338-628f2ae2b3c7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927a9e0700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:58.260645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG neutronclient.v2_0.client [None req-149235b3-2a18-4177-bbb1-537e08d9c07a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist", "detail": ""}} {{(pid=126119) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:52:58.261746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.security_group_api [None req-149235b3-2a18-4177-bbb1-537e08d9c07a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Neutron security group 7f274577-c614-4b4e-85d1-035a6ca1da96 not found {{(pid=126119) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 06:52:58.262621 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-149235b3-2a18-4177-bbb1-537e08d9c07a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist Aug 02 06:52:58.262621 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-67e90227-749f-4457-9a13-c054f4687e33'] Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-149235b3-2a18-4177-bbb1-537e08d9c07a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-security-groups/7f274577-c614-4b4e-85d1-035a6ca1da96 HTTP/1.1 Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: exception: Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-67e90227-749f-4457-9a13-c054f4687e33'] Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '7f274577-c614-4b4e-85d1-035a6ca1da96'} Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:52:58.266065 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67e90227-749f-4457-9a13-c054f4687e33'] Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67e90227-749f-4457-9a13-c054f4687e33'] Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67e90227-749f-4457-9a13-c054f4687e33'] Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67e90227-749f-4457-9a13-c054f4687e33'] Aug 02 06:52:58.271376 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:52:58.277508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-149235b3-2a18-4177-bbb1-537e08d9c07a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 404 to user: Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist Aug 02 06:52:58.277508 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-67e90227-749f-4457-9a13-c054f4687e33'] {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:52:58.278868 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-149235b3-2a18-4177-bbb1-537e08d9c07a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/7f274577-c614-4b4e-85d1-035a6ca1da96" status: 404 len: 194 microversion: 2.1 time: 0.102858 Aug 02 06:52:58.279865 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 842/1769] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 06:52:58 2022] GET /compute/v2.1/os-security-groups/7f274577-c614-4b4e-85d1-035a6ca1da96 => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:52:58.289632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7600bbe3-d8bc-4645-9394-4e5e02bb7a78 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:58.293048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7600bbe3-d8bc-4645-9394-4e5e02bb7a78 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:58.307355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7600bbe3-d8bc-4645-9394-4e5e02bb7a78 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:58.308186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7600bbe3-d8bc-4645-9394-4e5e02bb7a78 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:58.309261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7600bbe3-d8bc-4645-9394-4e5e02bb7a78 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:58.309915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7600bbe3-d8bc-4645-9394-4e5e02bb7a78 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:58.327444 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7a6a90fd-876e-494a-9338-628f2ae2b3c7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.141912 Aug 02 06:52:58.328352 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 928/1770] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:58 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:58.334094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-524f8092-3393-4438-8e47-0c382c83d7c1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f928c27aca0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:58.636038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7600bbe3-d8bc-4645-9394-4e5e02bb7a78 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:58.655216 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7600bbe3-d8bc-4645-9394-4e5e02bb7a78 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1307 microversion: 2.1 time: 0.373990 Aug 02 06:52:58.656537 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 843/1771] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:58 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1307 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:58.675261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-874a872c-59e2-4e24-a21b-ad5856c4ae81 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:58.675915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-874a872c-59e2-4e24-a21b-ad5856c4ae81 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:58.697652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-874a872c-59e2-4e24-a21b-ad5856c4ae81 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:58.707531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-874a872c-59e2-4e24-a21b-ad5856c4ae81 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:58.712629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-874a872c-59e2-4e24-a21b-ad5856c4ae81 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:58.713084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-874a872c-59e2-4e24-a21b-ad5856c4ae81 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:58.996156 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-524f8092-3393-4438-8e47-0c382c83d7c1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.666686 Aug 02 06:52:58.997348 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 929/1772] 10.222.0.79 () {58 vars in 1158 bytes} [Tue Aug 2 06:52:58 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:59.002913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-40233563-cfdc-4cda-9717-4a77db9eb8e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:59.015412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-40233563-cfdc-4cda-9717-4a77db9eb8e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:59.027883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40233563-cfdc-4cda-9717-4a77db9eb8e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:59.028621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40233563-cfdc-4cda-9717-4a77db9eb8e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:59.029663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40233563-cfdc-4cda-9717-4a77db9eb8e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:59.032929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40233563-cfdc-4cda-9717-4a77db9eb8e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:59.109122 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-40233563-cfdc-4cda-9717-4a77db9eb8e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.110426 Aug 02 06:52:59.113249 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 930/1773] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 06:52:58 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:52:59.125512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-10509f3f-1518-485f-b66e-45a20b53f6fd tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'create', calling method: .version_select at 0x7f927a9e13a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-796549308", "description": "tempest-description-1790645780"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:59.282188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-874a872c-59e2-4e24-a21b-ad5856c4ae81 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:52:59.291931 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-874a872c-59e2-4e24-a21b-ad5856c4ae81 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1463 microversion: 2.1 time: 0.631867 Aug 02 06:52:59.300948 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 844/1774] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:58 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1463 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:59.320636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aae34892-8afa-43ae-a37c-13b40b7c8780 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:59.321391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aae34892-8afa-43ae-a37c-13b40b7c8780 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:59.329357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aae34892-8afa-43ae-a37c-13b40b7c8780 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:59.333030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aae34892-8afa-43ae-a37c-13b40b7c8780 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:59.336042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aae34892-8afa-43ae-a37c-13b40b7c8780 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:59.338982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aae34892-8afa-43ae-a37c-13b40b7c8780 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:59.627774 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-10509f3f-1518-485f-b66e-45a20b53f6fd tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.512635 Aug 02 06:52:59.630911 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 931/1775] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:52:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:52:59.643787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1fb38999-2f70-4d28-8af3-d4d0e01a5c68 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927a9e0670>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:59.732665 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1fb38999-2f70-4d28-8af3-d4d0e01a5c68 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.093358 Aug 02 06:52:59.733261 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 932/1776] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:52:59 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:52:59.741435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-61d0ba6e-da40-484c-a477-f94028faea5f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'create', calling method: .version_select at 0x7f927a9e03a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1643366490", "description": "tempest-description-2138369113"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:52:59.761190 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aae34892-8afa-43ae-a37c-13b40b7c8780 tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1614 microversion: 2.1 time: 0.444150 Aug 02 06:52:59.761793 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 845/1777] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:59 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1614 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:52:59.775572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0aa5b396-0d76-44c7-be23-cdcfa75dae89 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:52:59.776949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0aa5b396-0d76-44c7-be23-cdcfa75dae89 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:52:59.793101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0aa5b396-0d76-44c7-be23-cdcfa75dae89 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:59.794330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0aa5b396-0d76-44c7-be23-cdcfa75dae89 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:52:59.795390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0aa5b396-0d76-44c7-be23-cdcfa75dae89 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:52:59.795982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0aa5b396-0d76-44c7-be23-cdcfa75dae89 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:00.100292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0aa5b396-0d76-44c7-be23-cdcfa75dae89 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:00.115881 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0aa5b396-0d76-44c7-be23-cdcfa75dae89 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1307 microversion: 2.1 time: 0.350188 Aug 02 06:53:00.119400 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 846/1778] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:52:59 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1307 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:00.125218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6410e200-c4e2-4950-bbf9-76b90029a5ba tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:00.133278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6410e200-c4e2-4950-bbf9-76b90029a5ba tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:00.134684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6410e200-c4e2-4950-bbf9-76b90029a5ba tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Searching by: {'deleted': False, 'project_id': 'd7ee242495424ef7b1b69b3587825949'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:53:00.143732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6410e200-c4e2-4950-bbf9-76b90029a5ba tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:00.144308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6410e200-c4e2-4950-bbf9-76b90029a5ba tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:00.145327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6410e200-c4e2-4950-bbf9-76b90029a5ba tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:00.146032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6410e200-c4e2-4950-bbf9-76b90029a5ba tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:00.184582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-6410e200-c4e2-4950-bbf9-76b90029a5ba tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:53:00.196779 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-61d0ba6e-da40-484c-a477-f94028faea5f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.458701 Aug 02 06:53:00.196779 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 933/1779] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:52:59 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:00.199454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ae3b81a1-3c76-48c0-a66a-1f5bd67658bd tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:00.200030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae3b81a1-3c76-48c0-a66a-1f5bd67658bd tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:00.217480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae3b81a1-3c76-48c0-a66a-1f5bd67658bd tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:00.217820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae3b81a1-3c76-48c0-a66a-1f5bd67658bd tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:00.218646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae3b81a1-3c76-48c0-a66a-1f5bd67658bd tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:00.219089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae3b81a1-3c76-48c0-a66a-1f5bd67658bd tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:00.264260 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6410e200-c4e2-4950-bbf9-76b90029a5ba tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.143101 Aug 02 06:53:00.265179 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 847/1780] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Aug 2 06:53:00 2022] GET /compute/v2.1/servers => generated 334 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:00.270329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-481710fa-8399-4300-880d-5d59b676d08b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:00.279123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-481710fa-8399-4300-880d-5d59b676d08b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:00.307999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-481710fa-8399-4300-880d-5d59b676d08b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:00.307999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-481710fa-8399-4300-880d-5d59b676d08b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:00.308689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-481710fa-8399-4300-880d-5d59b676d08b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:00.308908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-481710fa-8399-4300-880d-5d59b676d08b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:00.416891 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-481710fa-8399-4300-880d-5d59b676d08b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.150501 Aug 02 06:53:00.417507 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 848/1781] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 06:53:00 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e/os-volume_attachments => generated 25 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:00.422360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-224027c8-8817-4292-880d-b620875cc296 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:00.428319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-224027c8-8817-4292-880d-b620875cc296 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:00.429677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-224027c8-8817-4292-880d-b620875cc296 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Searching by: {'deleted': False, 'project_id': 'd7ee242495424ef7b1b69b3587825949'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:53:00.460142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-224027c8-8817-4292-880d-b620875cc296 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:00.460920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-224027c8-8817-4292-880d-b620875cc296 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:00.462123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-224027c8-8817-4292-880d-b620875cc296 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:00.462755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-224027c8-8817-4292-880d-b620875cc296 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:00.468208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ae3b81a1-3c76-48c0-a66a-1f5bd67658bd tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a6293839950f4d21b045f997108b9482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f036676a594d05b9883e65b915048b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:00.468807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae3b81a1-3c76-48c0-a66a-1f5bd67658bd tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] flavor_id is None. Assuming migration. {{(pid=126120) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 02 06:53:00.469255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae3b81a1-3c76-48c0-a66a-1f5bd67658bd tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126120) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 06:53:00.496534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-224027c8-8817-4292-880d-b620875cc296 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:53:00.553589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:00.612858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-224027c8-8817-4292-880d-b620875cc296 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:00.627593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-224027c8-8817-4292-880d-b620875cc296 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:00.630561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-224027c8-8817-4292-880d-b620875cc296 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:00.887364 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-224027c8-8817-4292-880d-b620875cc296 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.468717 Aug 02 06:53:00.903135 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 849/1782] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:53:00 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:00.908392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-539284847", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "e898f800-f4dc-4788-bd44-0759af836ad2"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:01.087456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] validate_networks() for [('e898f800-f4dc-4788-bd44-0759af836ad2', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:53:01.648479 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ae3b81a1-3c76-48c0-a66a-1f5bd67658bd tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53/action" status: 202 len: 0 microversion: 2.1 time: 1.452491 Aug 02 06:53:01.651447 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 934/1783] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:53:00 2022] POST /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53/action => generated 0 bytes in 1456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:53:01.673638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9e4c76ec-bc36-4ae2-a79a-9cae95b5fb5d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927a9e0c10>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:01.762580 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9e4c76ec-bc36-4ae2-a79a-9cae95b5fb5d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1453 microversion: 2.1 time: 0.099421 Aug 02 06:53:01.771069 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 935/1784] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:01 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:01.793998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-2ae044fc-a3d7-4a07-838f-0eed6a0ea26b req-9b841949-7e06-47c2-b4e1-2972d54a123d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4790820-2d09-47ab-9c4d-ec909dc7e1c1", "name": "network-vif-plugged", "status": "completed", "tag": "8406eedb-691b-4d88-a1e7-a1e3cfda7983"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:01.829295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2ae044fc-a3d7-4a07-838f-0eed6a0ea26b req-9b841949-7e06-47c2-b4e1-2972d54a123d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:01.831165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2ae044fc-a3d7-4a07-838f-0eed6a0ea26b req-9b841949-7e06-47c2-b4e1-2972d54a123d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:01.866756 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-2ae044fc-a3d7-4a07-838f-0eed6a0ea26b req-9b841949-7e06-47c2-b4e1-2972d54a123d service nova] Creating event network-vif-plugged:8406eedb-691b-4d88-a1e7-a1e3cfda7983 for instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 on n-h2-851337-3 Aug 02 06:53:01.880209 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-2ae044fc-a3d7-4a07-838f-0eed6a0ea26b req-9b841949-7e06-47c2-b4e1-2972d54a123d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113101 Aug 02 06:53:01.884532 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 936/1785] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:01.908774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02208d2a-8d98-4e37-84bb-9a784c1cdd88 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:01.959203 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-02208d2a-8d98-4e37-84bb-9a784c1cdd88 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.068216 Aug 02 06:53:01.969309 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 937/1786] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:53:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:01.975999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f7d3cef9-8475-4804-8288-a0004688aa75 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:01.976793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f7d3cef9-8475-4804-8288-a0004688aa75 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:01.985489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7d3cef9-8475-4804-8288-a0004688aa75 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:01.985973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7d3cef9-8475-4804-8288-a0004688aa75 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:01.986891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7d3cef9-8475-4804-8288-a0004688aa75 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:01.987421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7d3cef9-8475-4804-8288-a0004688aa75 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:02.146682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:53:02.147249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:53:02.147990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:53:02.148577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:53:02.149302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:53:02.168908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:02.169744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:02.171019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:02.173206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:02.232464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Getting quotas for project ab7a54e20f2c4619b6bc10fd918cc539. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:53:02.253688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Getting quotas for user 3ac74e3e74b24a6a861fbc774fd9fab6 and project ab7a54e20f2c4619b6bc10fd918cc539. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:53:02.295553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:53:02.305191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:53:02.466727 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-183674d0-b357-4ef5-a733-a33dc2f35759 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.562349 Aug 02 06:53:02.473029 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 850/1787] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:53:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:53:02.713599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f7d3cef9-8475-4804-8288-a0004688aa75 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:02.726930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-98610dc8-d1bd-456f-a284-cdd95026f974 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Action: 'create', calling method: .version_select at 0x7f927af2bd30>, body: {"keypair": {"name": "tempest-keypair-2001741288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+N8T+gFll3u3uZ1MMajaaT0losjEI2nLo3giXE5VmOh6c1l/c/W8jd63ApdNMMHCHo+nqVQ9dUH5FaebfDkXPYXquVKqz12IR13mOVHjcvuT3vVJ04Q5nmT55odbWoXw=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:02.727199 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f7d3cef9-8475-4804-8288-a0004688aa75 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1307 microversion: 2.1 time: 0.755826 Aug 02 06:53:02.741919 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 938/1788] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:01 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1307 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:02.742163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f926607-fd1a-4c7a-bfed-f394bec8c804 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:02.742685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4f926607-fd1a-4c7a-bfed-f394bec8c804 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:02.758279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f926607-fd1a-4c7a-bfed-f394bec8c804 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:02.758742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f926607-fd1a-4c7a-bfed-f394bec8c804 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:02.759539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f926607-fd1a-4c7a-bfed-f394bec8c804 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:02.759982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f926607-fd1a-4c7a-bfed-f394bec8c804 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:02.769492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-98610dc8-d1bd-456f-a284-cdd95026f974 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:53:02.777542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-98610dc8-d1bd-456f-a284-cdd95026f974 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for user 1c2fbcec7aff42bbb34dfc306bb4cb36 and project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:53:02.855276 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-98610dc8-d1bd-456f-a284-cdd95026f974 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.380212 Aug 02 06:53:02.856404 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 851/1789] 10.222.0.79 () {62 vars in 1199 bytes} [Tue Aug 2 06:53:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 382 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 02 06:53:02.864433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8a366a6d-edf6-4f8b-9908-16ed78978669 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:02.868112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8a366a6d-edf6-4f8b-9908-16ed78978669 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:02.893265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a366a6d-edf6-4f8b-9908-16ed78978669 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:02.894051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a366a6d-edf6-4f8b-9908-16ed78978669 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:02.896154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a366a6d-edf6-4f8b-9908-16ed78978669 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:02.897710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a366a6d-edf6-4f8b-9908-16ed78978669 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:02.977049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8a366a6d-edf6-4f8b-9908-16ed78978669 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:53:03.100708 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4f926607-fd1a-4c7a-bfed-f394bec8c804 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:03.110769 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4f926607-fd1a-4c7a-bfed-f394bec8c804 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1472 microversion: 2.1 time: 0.378529 Aug 02 06:53:03.125677 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 939/1790] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:02 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1472 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:03.131624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b006deba-076f-4c00-a486-d38c464574e9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:03.132560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b006deba-076f-4c00-a486-d38c464574e9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:03.208422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b006deba-076f-4c00-a486-d38c464574e9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:03.220143 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b006deba-076f-4c00-a486-d38c464574e9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1215 microversion: 2.1 time: 0.092903 Aug 02 06:53:03.237804 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 940/1791] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:03 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1215 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:03.245799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-97079294-a383-40f3-a924-9534cffb9918 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927aa55430>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:03.255407 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8a366a6d-edf6-4f8b-9908-16ed78978669 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "DELETE /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 204 len: 0 microversion: 2.1 time: 0.397070 Aug 02 06:53:03.260176 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 852/1792] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:53:02 2022] DELETE /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:03.266859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-55c98af1-8e55-4a38-a5c6-d6968d9b322d tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Calling method '.version_select at 0x7f927ac53b80>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:03.288563 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-55c98af1-8e55-4a38-a5c6-d6968d9b322d tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-2001741288" status: 200 len: 513 microversion: 2.2 time: 0.025848 Aug 02 06:53:03.290281 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 853/1793] 10.222.0.79 () {60 vars in 1258 bytes} [Tue Aug 2 06:53:03 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2001741288 => generated 513 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:03.308828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0de458e1-8e7d-49ab-aa1b-1b888ed19a64 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:03.311932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0de458e1-8e7d-49ab-aa1b-1b888ed19a64 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:03.333775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0de458e1-8e7d-49ab-aa1b-1b888ed19a64 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:03.335045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0de458e1-8e7d-49ab-aa1b-1b888ed19a64 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:03.336072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0de458e1-8e7d-49ab-aa1b-1b888ed19a64 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:03.338108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0de458e1-8e7d-49ab-aa1b-1b888ed19a64 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:03.654219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0de458e1-8e7d-49ab-aa1b-1b888ed19a64 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fab1cad29b94aef8f0435a65e668720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ee242495424ef7b1b69b3587825949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:03.664001 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0de458e1-8e7d-49ab-aa1b-1b888ed19a64 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 200 len: 1701 microversion: 2.1 time: 0.371628 Aug 02 06:53:03.664600 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 854/1794] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:03 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 1701 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:03.669124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8dc1069a-11e5-4865-976c-7898e6c81a4b tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Calling method '.version_select at 0x7f927ba39550>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:03.698051 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8dc1069a-11e5-4865-976c-7898e6c81a4b tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2001741288" status: 204 len: 0 microversion: 2.2 time: 0.032369 Aug 02 06:53:03.698976 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 855/1795] 10.222.0.79 () {60 vars in 1261 bytes} [Tue Aug 2 06:53:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2001741288 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:03.712057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c3580008-345b-4064-a2ee-bb6ec4d05cae tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Action: 'create', calling method: .version_select at 0x7f927abc58b0>, body: {"keypair": {"name": "tempest-keypair-1396233479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCh7HjRORUudbEr8wuCBAYvP+ftvcVMzCGd7fQL3vyUFIrGeeXeLRuX/+iwOQwoHzWP1GIW/ExI4YndmA2APt0h8Y1R88+pHdACc7cmk6MHjapV+GFSdWVZmAAv2nhlMg=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:03.736724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-c3580008-345b-4064-a2ee-bb6ec4d05cae tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:53:03.743469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-c3580008-345b-4064-a2ee-bb6ec4d05cae tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for user 1c2fbcec7aff42bbb34dfc306bb4cb36 and project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:53:03.775564 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c3580008-345b-4064-a2ee-bb6ec4d05cae tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.067877 Aug 02 06:53:03.776495 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 856/1796] 10.222.0.79 () {62 vars in 1199 bytes} [Tue Aug 2 06:53:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 02 06:53:03.791725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9d450a98-bca3-4319-9613-3eefe6ace65e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:03.792990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9d450a98-bca3-4319-9613-3eefe6ace65e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:03.801383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d450a98-bca3-4319-9613-3eefe6ace65e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:03.802404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d450a98-bca3-4319-9613-3eefe6ace65e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:03.803705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d450a98-bca3-4319-9613-3eefe6ace65e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:03.804429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d450a98-bca3-4319-9613-3eefe6ace65e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:04.049789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9d450a98-bca3-4319-9613-3eefe6ace65e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:04.073591 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9d450a98-bca3-4319-9613-3eefe6ace65e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1307 microversion: 2.1 time: 0.288873 Aug 02 06:53:04.086171 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 857/1797] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:03 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1307 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:04.086171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-92feb0cc-84dd-4ead-b031-f501a0a9b061 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Calling method '.version_select at 0x7f927b18ed30>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:04.123374 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-92feb0cc-84dd-4ead-b031-f501a0a9b061 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396233479" status: 204 len: 0 microversion: 2.2 time: 0.045475 Aug 02 06:53:04.124024 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 858/1798] 10.222.0.79 () {60 vars in 1261 bytes} [Tue Aug 2 06:53:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396233479 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:04.129862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1372625588", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "599126f7-4a02-46ed-bb8a-6a61dd3bec17"}], "security_groups": [{"name": "tempest-securitygroup--353433888"}], "key_name": "tempest-keypair-1991769641", "user_data": "}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:06.546939 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-97079294-a383-40f3-a924-9534cffb9918 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1462 microversion: 2.1 time: 3.307433 Aug 02 06:53:06.548114 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 941/1799] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:03 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1462 bytes in 3309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:06.558948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cd2476ff-05eb-4e42-b3fb-4ea7595b2854 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:06.561177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cd2476ff-05eb-4e42-b3fb-4ea7595b2854 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:06.582696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd2476ff-05eb-4e42-b3fb-4ea7595b2854 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:06.584733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd2476ff-05eb-4e42-b3fb-4ea7595b2854 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:06.588567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd2476ff-05eb-4e42-b3fb-4ea7595b2854 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:06.591468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd2476ff-05eb-4e42-b3fb-4ea7595b2854 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:06.787336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] validate_networks() for [('599126f7-4a02-46ed-bb8a-6a61dd3bec17', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:53:06.990795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cd2476ff-05eb-4e42-b3fb-4ea7595b2854 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:07.001590 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cd2476ff-05eb-4e42-b3fb-4ea7595b2854 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1472 microversion: 2.1 time: 0.451801 Aug 02 06:53:07.006655 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 942/1800] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:06 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1472 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:07.011965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4be51003-d590-4323-9c67-ac6fa06d6d26 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Action: 'create', calling method: .version_select at 0x7f927bbacd30>, body: {"keypair": {"name": "tempest-keypair-585118532", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:07.037402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=33 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:07.039832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-4be51003-d590-4323-9c67-ac6fa06d6d26 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:53:07.048059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-4be51003-d590-4323-9c67-ac6fa06d6d26 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for user 1c2fbcec7aff42bbb34dfc306bb4cb36 and project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:53:07.091822 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4be51003-d590-4323-9c67-ac6fa06d6d26 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.083572 Aug 02 06:53:07.098427 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 943/1801] 10.222.0.79 () {62 vars in 1199 bytes} [Tue Aug 2 06:53:07 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 02 06:53:07.106262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6eca514e-0120-439d-838d-e0895ce19271 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:07.108273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6eca514e-0120-439d-838d-e0895ce19271 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:07.119907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6eca514e-0120-439d-838d-e0895ce19271 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:07.120419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6eca514e-0120-439d-838d-e0895ce19271 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:07.121875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6eca514e-0120-439d-838d-e0895ce19271 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:07.122359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6eca514e-0120-439d-838d-e0895ce19271 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:07.159657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:07.640795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:53:07.641489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:53:07.642287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:53:07.642943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:53:07.643575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:53:07.654598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:07.655439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:07.656442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:07.657113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:07.680199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Getting quotas for project c21684e149204ae7afe06a3097411bd0. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:53:07.686704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Getting quotas for user 391135debbcb49de8b47dea807d9a4ea and project c21684e149204ae7afe06a3097411bd0. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:53:07.687306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6eca514e-0120-439d-838d-e0895ce19271 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:07.703890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:53:07.704883 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6eca514e-0120-439d-838d-e0895ce19271 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1315 microversion: 2.1 time: 0.610839 Aug 02 06:53:07.705504 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 944/1802] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:07 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:07.707254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:53:07.717014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-de609ddd-9003-44ab-a9d9-80c9cefaeaf7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:07.717643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-de609ddd-9003-44ab-a9d9-80c9cefaeaf7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] [instance: 70f42060-ec57-4124-bf32-e4781f17e2a8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:07.748871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de609ddd-9003-44ab-a9d9-80c9cefaeaf7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:07.759219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de609ddd-9003-44ab-a9d9-80c9cefaeaf7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:07.760469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de609ddd-9003-44ab-a9d9-80c9cefaeaf7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:07.763327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de609ddd-9003-44ab-a9d9-80c9cefaeaf7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:07.784173 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7a01be76-01de-48bb-b71c-c2bf591a3f30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.659031 Aug 02 06:53:07.794650 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 859/1803] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:53:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 3665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:53:07.800054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bc84ec25-d685-45ab-a18a-d270d0078d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:07.804224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bc84ec25-d685-45ab-a18a-d270d0078d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:07.808140 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-de609ddd-9003-44ab-a9d9-80c9cefaeaf7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] HTTP exception thrown: Instance 70f42060-ec57-4124-bf32-e4781f17e2a8 could not be found. Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-de609ddd-9003-44ab-a9d9-80c9cefaeaf7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Request method failure captured: Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 HTTP/1.1 Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mlcv9ZlyAbuBKee6vy4B7ren7JSDSfqLq4MGj4NhL7kqUXjZAy9luTfnnXlpaSwyovoxbO4YBUGuwXWGBWhQ7jKjk8zYnKSVdVwpyqkOtkL3_SDKlD8w1fBTZg5845waBTfidBKuZHulMYo_37GAQyV7FNEihrwJzf7vQgnyIqRjWY Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: d7ee242495424ef7b1b69b3587825949 Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestJSON-1935910064 Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d7ee242495424ef7b1b69b3587825949"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7ee242495424ef7b1b69b3587825949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d7ee242495424ef7b1b69b3587825949"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d7ee242495424ef7b1b69b3587825949"}]}] Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestJSON-1935910064 Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: d7ee242495424ef7b1b69b3587825949 Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestJSON-1935910064 Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestJSON-1935910064-project Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0fab1cad29b94aef8f0435a65e668720 Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestJSON-1935910064-project Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 70f42060-ec57-4124-bf32-e4781f17e2a8 could not be found. Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '70f42060-ec57-4124-bf32-e4781f17e2a8'} Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f42060-ec57-4124-bf32-e4781f17e2a8 could not be found. Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f42060-ec57-4124-bf32-e4781f17e2a8 could not be found. Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:07.834132 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:07.840959 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:07.840959 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:07.840959 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:07.840959 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:07.840959 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:07.840959 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f42060-ec57-4124-bf32-e4781f17e2a8 could not be found. Aug 02 06:53:07.840959 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:07.840959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-de609ddd-9003-44ab-a9d9-80c9cefaeaf7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Returning 404 to user: Instance 70f42060-ec57-4124-bf32-e4781f17e2a8 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:07.840959 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-de609ddd-9003-44ab-a9d9-80c9cefaeaf7 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8" status: 404 len: 111 microversion: 2.1 time: 0.130578 Aug 02 06:53:07.854865 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 945/1804] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:07 2022] GET /compute/v2.1/servers/70f42060-ec57-4124-bf32-e4781f17e2a8 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:53:07.855851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc84ec25-d685-45ab-a18a-d270d0078d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:07.856299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc84ec25-d685-45ab-a18a-d270d0078d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:07.868134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd50b8d3-8cd9-4dfe-9a99-4eafb5d06aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927a913af0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:07.868432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc84ec25-d685-45ab-a18a-d270d0078d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:07.868777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc84ec25-d685-45ab-a18a-d270d0078d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:07.944945 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dd50b8d3-8cd9-4dfe-9a99-4eafb5d06aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 200 len: 1462 microversion: 2.1 time: 0.088320 Aug 02 06:53:07.945743 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 946/1805] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:07 2022] GET /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 1462 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:07.961449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-23546346-4390-459e-9a71-0d471428036b req-90c2492c-7cbb-4ed2-ab45-b2bcd1d34c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f42060-ec57-4124-bf32-e4781f17e2a8", "name": "network-vif-deleted", "tag": "d16b9b14-019b-4bb7-9858-c56d4a641026"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:07.973955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-23546346-4390-459e-9a71-0d471428036b req-90c2492c-7cbb-4ed2-ab45-b2bcd1d34c6c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:07.974464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-23546346-4390-459e-9a71-0d471428036b req-90c2492c-7cbb-4ed2-ab45-b2bcd1d34c6c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:07.988909 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-23546346-4390-459e-9a71-0d471428036b req-90c2492c-7cbb-4ed2-ab45-b2bcd1d34c6c service nova] Creating event network-vif-deleted:d16b9b14-019b-4bb7-9858-c56d4a641026 for instance 70f42060-ec57-4124-bf32-e4781f17e2a8 on n-h1-851337-3 Aug 02 06:53:07.994499 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-23546346-4390-459e-9a71-0d471428036b req-90c2492c-7cbb-4ed2-ab45-b2bcd1d34c6c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036787 Aug 02 06:53:07.995571 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 947/1806] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:08.000968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-660e0afb-8582-458d-94ac-ab2222410293 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Calling method '.version_select at 0x7f927b261280>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:08.033689 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-660e0afb-8582-458d-94ac-ab2222410293 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-585118532" status: 204 len: 0 microversion: 2.2 time: 0.034689 Aug 02 06:53:08.043644 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 948/1807] 10.222.0.79 () {60 vars in 1258 bytes} [Tue Aug 2 06:53:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-585118532 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:08.051931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-769460df-01ea-40bf-9b46-c1b0231e29e5 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:08.052648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-769460df-01ea-40bf-9b46-c1b0231e29e5 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:08.215216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-769460df-01ea-40bf-9b46-c1b0231e29e5 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:08.223234 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-769460df-01ea-40bf-9b46-c1b0231e29e5 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1238 microversion: 2.1 time: 0.177405 Aug 02 06:53:08.223817 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 949/1808] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:08 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1238 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:08.239411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a3b2f13-d84f-4090-8a7f-8924228edfe8 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] Calling method '.version_select at 0x7f927a9e1160>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:08.287158 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8a3b2f13-d84f-4090-8a7f-8924228edfe8 tempest-ServersTestJSON-1935910064 tempest-ServersTestJSON-1935910064-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-768242891" status: 202 len: 0 microversion: 2.1 time: 0.062095 Aug 02 06:53:08.288026 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 950/1809] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Aug 2 06:53:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-768242891 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:53:08.293191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8ee66fed-eb13-432c-b1db-0886467d0d03 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:08.293814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8ee66fed-eb13-432c-b1db-0886467d0d03 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: 6e35b665-80f8-4add-8c4f-edeb762a78fa] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:08.311015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ee66fed-eb13-432c-b1db-0886467d0d03 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:08.311665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ee66fed-eb13-432c-b1db-0886467d0d03 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:08.316813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ee66fed-eb13-432c-b1db-0886467d0d03 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:08.317488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ee66fed-eb13-432c-b1db-0886467d0d03 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:08.450946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bc84ec25-d685-45ab-a18a-d270d0078d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:08.464129 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bc84ec25-d685-45ab-a18a-d270d0078d9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1487 microversion: 2.1 time: 0.672053 Aug 02 06:53:08.494232 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 860/1810] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:07 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1487 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:08.713192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2564002a-1c10-4137-a823-fadc93fb12b8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:08.713815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2564002a-1c10-4137-a823-fadc93fb12b8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:08.723111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8ee66fed-eb13-432c-b1db-0886467d0d03 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:08.732514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2564002a-1c10-4137-a823-fadc93fb12b8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:08.733072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2564002a-1c10-4137-a823-fadc93fb12b8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:08.733784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2564002a-1c10-4137-a823-fadc93fb12b8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:08.734248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2564002a-1c10-4137-a823-fadc93fb12b8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:08.734971 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8ee66fed-eb13-432c-b1db-0886467d0d03 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa" status: 200 len: 1468 microversion: 2.1 time: 0.445483 Aug 02 06:53:08.736808 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 951/1811] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:08 2022] GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa => generated 1468 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:08.742876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-03b9062c-c0d7-4e24-9b23-b9a7d23bb055 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Action: 'create', calling method: .version_select at 0x7f927b2be670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-10711518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNeMuA5uUHerwP/K+J3U+HO3W2jly0t+VzJ03aoRXqTfZjvUoY0dQaOrzYjfRuT5zDogrmrqnooWRzbif/cHNEDgVqyaMRYU1CmBEkSff7Qw8h6xoQ3wBbjF7hWy4xzxA=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:08.770035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-03b9062c-c0d7-4e24-9b23-b9a7d23bb055 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:53:08.777286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-03b9062c-c0d7-4e24-9b23-b9a7d23bb055 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for user 1c2fbcec7aff42bbb34dfc306bb4cb36 and project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:53:08.812837 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-03b9062c-c0d7-4e24-9b23-b9a7d23bb055 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.2 time: 0.074568 Aug 02 06:53:08.816096 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 952/1812] 10.222.0.79 () {62 vars in 1199 bytes} [Tue Aug 2 06:53:08 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 02 06:53:08.821307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-36523362-38a3-4b8c-b7e3-8c5569acefbc req-82d1d196-fa48-4ed0-91ae-7a5ae63298fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba796c7-da1f-4aa8-9dce-014658905cc4", "tag": "037cd849-dce0-499f-9464-cf45471f908a"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:08.835541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-36523362-38a3-4b8c-b7e3-8c5569acefbc req-82d1d196-fa48-4ed0-91ae-7a5ae63298fe service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:08.835973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-36523362-38a3-4b8c-b7e3-8c5569acefbc req-82d1d196-fa48-4ed0-91ae-7a5ae63298fe service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:08.868789 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-36523362-38a3-4b8c-b7e3-8c5569acefbc req-82d1d196-fa48-4ed0-91ae-7a5ae63298fe service nova] Creating event network-changed:037cd849-dce0-499f-9464-cf45471f908a for instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 on n-h1-851337-3 Aug 02 06:53:08.883168 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-36523362-38a3-4b8c-b7e3-8c5569acefbc req-82d1d196-fa48-4ed0-91ae-7a5ae63298fe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065138 Aug 02 06:53:08.886354 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 953/1813] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:08.905571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4102a5b7-eedf-45d6-9ace-245ee3192ab8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:08.924269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4102a5b7-eedf-45d6-9ace-245ee3192ab8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:08.927737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4102a5b7-eedf-45d6-9ace-245ee3192ab8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:09.009752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4102a5b7-eedf-45d6-9ace-245ee3192ab8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Going to try to stop instance {{(pid=126120) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 06:53:09.071233 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4102a5b7-eedf-45d6-9ace-245ee3192ab8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "POST /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1/action" status: 202 len: 0 microversion: 2.1 time: 0.183063 Aug 02 06:53:09.073843 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 954/1814] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:53:08 2022] POST /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:53:09.084900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7bafac75-4348-47aa-ad2a-9387c8f4efd9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:09.085862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7bafac75-4348-47aa-ad2a-9387c8f4efd9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:09.102609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bafac75-4348-47aa-ad2a-9387c8f4efd9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:09.105765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bafac75-4348-47aa-ad2a-9387c8f4efd9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:09.107449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bafac75-4348-47aa-ad2a-9387c8f4efd9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:09.108273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bafac75-4348-47aa-ad2a-9387c8f4efd9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:09.317694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2564002a-1c10-4137-a823-fadc93fb12b8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:09.329313 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2564002a-1c10-4137-a823-fadc93fb12b8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1477 microversion: 2.1 time: 0.832146 Aug 02 06:53:09.332915 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 861/1815] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:08 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1477 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:09.341796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2192893b-31f2-4354-9e10-21f2539e75ae tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b8303a0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:09.586204 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2192893b-31f2-4354-9e10-21f2539e75ae tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images?changes-since=2022-08-02T06%3A51%3A16Z" status: 200 len: 2375 microversion: 2.1 time: 0.250328 Aug 02 06:53:09.601923 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 862/1816] 10.222.0.79 () {58 vars in 1199 bytes} [Tue Aug 2 06:53:09 2022] GET /compute/v2.1/images?changes-since=2022-08-02T06%3A51%3A16Z => generated 2375 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:09.618735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2cc665ff-0ea4-40bd-88ba-8f3a8037d00e tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Action: 'create', calling method: .version_select at 0x7f927abd6af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1370430568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALi/BzFYhVqaponDSKpPy/8V5mUbbGPVAERTZfaYmpuEl34rbKWD5KAYNnIXWIeshV5XKUz2IE4iBmMeV47c8+h3+sF39M260xWQLbhxAHlof7aqycq6qUmIm7jAEm/OA=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:09.648426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2cc665ff-0ea4-40bd-88ba-8f3a8037d00e tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:53:09.659436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2cc665ff-0ea4-40bd-88ba-8f3a8037d00e tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for user 1c2fbcec7aff42bbb34dfc306bb4cb36 and project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:53:09.698806 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2cc665ff-0ea4-40bd-88ba-8f3a8037d00e tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.094701 Aug 02 06:53:09.700564 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 863/1817] 10.222.0.79 () {62 vars in 1199 bytes} [Tue Aug 2 06:53:09 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 02 06:53:09.721932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-81578c32-fd68-498b-a4b0-31ce85b4fe73 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:09.723008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-81578c32-fd68-498b-a4b0-31ce85b4fe73 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:09.734802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81578c32-fd68-498b-a4b0-31ce85b4fe73 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:09.735701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81578c32-fd68-498b-a4b0-31ce85b4fe73 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:09.738569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81578c32-fd68-498b-a4b0-31ce85b4fe73 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:09.739268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81578c32-fd68-498b-a4b0-31ce85b4fe73 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:09.747083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7bafac75-4348-47aa-ad2a-9387c8f4efd9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:09.757283 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7bafac75-4348-47aa-ad2a-9387c8f4efd9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1315 microversion: 2.1 time: 0.683711 Aug 02 06:53:09.757877 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 955/1818] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:09 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:09.771799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7fa12cb9-bd29-4359-b5c6-c32d29781e88 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:09.772401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7fa12cb9-bd29-4359-b5c6-c32d29781e88 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:09.792572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7fa12cb9-bd29-4359-b5c6-c32d29781e88 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:09.793397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7fa12cb9-bd29-4359-b5c6-c32d29781e88 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:09.794523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7fa12cb9-bd29-4359-b5c6-c32d29781e88 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:09.795183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7fa12cb9-bd29-4359-b5c6-c32d29781e88 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:10.270736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7fa12cb9-bd29-4359-b5c6-c32d29781e88 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:10.279031 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7fa12cb9-bd29-4359-b5c6-c32d29781e88 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1298 microversion: 2.1 time: 0.511143 Aug 02 06:53:10.283222 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 956/1819] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:09 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1298 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:10.298825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-415c7ede-20f3-442a-92a7-9c74c441b583 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927a9c6040>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:10.413154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-81578c32-fd68-498b-a4b0-31ce85b4fe73 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:10.422447 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-81578c32-fd68-498b-a4b0-31ce85b4fe73 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1497 microversion: 2.1 time: 0.720275 Aug 02 06:53:10.424108 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 864/1820] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:09 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1497 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:10.429577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3a6e7a3c-fead-4130-8c7a-097749b2ed67 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Action: 'create', calling method: .version_select at 0x7f927abd63a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-480573704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLokxfWnDLzHq6tXlzlH9mml0SNYvVPqU43IeCzb1ZmuUWFBRiOrZ8QszVcvYHsb11/bG8eZmdbiTEiLUWfnCxxUEUJ8tphr079gjIGaTwrE8T6PL7p0gsDQbOx/ufdPng=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:10.453059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3a6e7a3c-fead-4130-8c7a-097749b2ed67 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:53:10.462544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3a6e7a3c-fead-4130-8c7a-097749b2ed67 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for user 1c2fbcec7aff42bbb34dfc306bb4cb36 and project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:53:10.482786 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-415c7ede-20f3-442a-92a7-9c74c441b583 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-136905550" status: 200 len: 484 microversion: 2.1 time: 0.197920 Aug 02 06:53:10.491807 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 957/1821] 10.222.0.79 () {58 vars in 1229 bytes} [Tue Aug 2 06:53:10 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-136905550 => generated 484 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:10.505136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-905c2753-f85b-4b72-8b40-27bcb77d4010 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:10.507539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-905c2753-f85b-4b72-8b40-27bcb77d4010 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:10.525588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-905c2753-f85b-4b72-8b40-27bcb77d4010 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:10.526134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-905c2753-f85b-4b72-8b40-27bcb77d4010 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:10.527588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-905c2753-f85b-4b72-8b40-27bcb77d4010 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:10.527588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-905c2753-f85b-4b72-8b40-27bcb77d4010 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:10.533414 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3a6e7a3c-fead-4130-8c7a-097749b2ed67 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.107010 Aug 02 06:53:10.534502 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 865/1822] 10.222.0.79 () {62 vars in 1199 bytes} [Tue Aug 2 06:53:10 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 02 06:53:10.543295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f434a55-30d6-477e-b413-d9e1304816bc tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927abe0550>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:10.731521 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3f434a55-30d6-477e-b413-d9e1304816bc tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images?server=6e35b665-80f8-4add-8c4f-edeb762a78fa" status: 200 len: 958 microversion: 2.1 time: 0.192926 Aug 02 06:53:10.734269 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 866/1823] 10.222.0.79 () {58 vars in 1209 bytes} [Tue Aug 2 06:53:10 2022] GET /compute/v2.1/images?server=6e35b665-80f8-4add-8c4f-edeb762a78fa => generated 958 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:10.751407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-369414f4-7a3a-4aac-acb4-5db6d08c79b8 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Calling method '.version_select at 0x7f927abc8310>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:10.780184 n-d-851337-3 devstack@n-api.service[126119]: WARNING oslo_db.sqlalchemy.utils [None req-369414f4-7a3a-4aac-acb4-5db6d08c79b8 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 02 06:53:10.798645 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-369414f4-7a3a-4aac-acb4-5db6d08c79b8 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.059039 Aug 02 06:53:10.802776 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 867/1824] 10.222.0.79 () {60 vars in 1177 bytes} [Tue Aug 2 06:53:10 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:10.816562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-fcdc0051-d3d0-4680-b1f4-0bb69a580dc8 req-6965bedd-2e9b-4fc6-bbb2-dfc0fd93c645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e35b665-80f8-4add-8c4f-edeb762a78fa", "name": "network-vif-unplugged", "status": "completed", "tag": "97677ae9-daf0-4a17-a2c1-087df4aa5df7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:10.852102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fcdc0051-d3d0-4680-b1f4-0bb69a580dc8 req-6965bedd-2e9b-4fc6-bbb2-dfc0fd93c645 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:10.853150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fcdc0051-d3d0-4680-b1f4-0bb69a580dc8 req-6965bedd-2e9b-4fc6-bbb2-dfc0fd93c645 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:10.869119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-905c2753-f85b-4b72-8b40-27bcb77d4010 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:10.874844 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-fcdc0051-d3d0-4680-b1f4-0bb69a580dc8 req-6965bedd-2e9b-4fc6-bbb2-dfc0fd93c645 service nova] Creating event network-vif-unplugged:97677ae9-daf0-4a17-a2c1-087df4aa5df7 for instance 6e35b665-80f8-4add-8c4f-edeb762a78fa on n-h2-851337-3 Aug 02 06:53:10.878592 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-905c2753-f85b-4b72-8b40-27bcb77d4010 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1477 microversion: 2.1 time: 0.384768 Aug 02 06:53:10.881878 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 958/1825] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:10 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1477 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:10.886880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-58bf75e1-f21f-4788-a5cd-f5b748dbf8d7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927a913b80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:10.896775 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-fcdc0051-d3d0-4680-b1f4-0bb69a580dc8 req-6965bedd-2e9b-4fc6-bbb2-dfc0fd93c645 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092547 Aug 02 06:53:10.899114 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 868/1826] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:10.914941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1aaecfbc-dede-4db1-9595-31ce410826d2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:10.915945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1aaecfbc-dede-4db1-9595-31ce410826d2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:10.924296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1aaecfbc-dede-4db1-9595-31ce410826d2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:10.924841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1aaecfbc-dede-4db1-9595-31ce410826d2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:10.925704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1aaecfbc-dede-4db1-9595-31ce410826d2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:10.926249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1aaecfbc-dede-4db1-9595-31ce410826d2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:10.945863 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-58bf75e1-f21f-4788-a5cd-f5b748dbf8d7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2Fa92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 484 microversion: 2.1 time: 0.062572 Aug 02 06:53:10.946789 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 959/1827] 10.222.0.79 () {58 vars in 1317 bytes} [Tue Aug 2 06:53:10 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2Fa92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 484 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:10.958676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7a52688b-0060-4442-8224-65f66516cf3a tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Calling method '.version_select at 0x7f927ab39040>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:10.982887 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7a52688b-0060-4442-8224-65f66516cf3a tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-480573704" status: 204 len: 0 microversion: 2.2 time: 0.031806 Aug 02 06:53:10.984069 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 960/1828] 10.222.0.79 () {60 vars in 1318 bytes} [Tue Aug 2 06:53:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-480573704 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:10.989372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7a912b50-bf64-4c68-8b4b-6bddae64b8f5 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927a88c1f0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:11.052365 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7a912b50-bf64-4c68-8b4b-6bddae64b8f5 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2Fa92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 484 microversion: 2.1 time: 0.066725 Aug 02 06:53:11.053384 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 961/1829] 10.222.0.79 () {58 vars in 1303 bytes} [Tue Aug 2 06:53:10 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2Fa92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 484 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:11.061068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b8c6973e-c98a-43f4-b44b-b12f0acea0a4 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Calling method '.version_select at 0x7f927b0cfd30>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:11.090115 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b8c6973e-c98a-43f4-b44b-b12f0acea0a4 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1370430568" status: 204 len: 0 microversion: 2.2 time: 0.035058 Aug 02 06:53:11.091097 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 962/1830] 10.222.0.79 () {60 vars in 1321 bytes} [Tue Aug 2 06:53:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1370430568 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:11.098675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8d3b8a91-656d-455f-8a9f-cf582edddef9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927a8801f0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:11.107231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1aaecfbc-dede-4db1-9595-31ce410826d2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:11.120821 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1aaecfbc-dede-4db1-9595-31ce410826d2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1315 microversion: 2.1 time: 0.218319 Aug 02 06:53:11.121968 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 869/1831] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:10 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:11.127425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72697e69-9c16-499e-941d-3c7b1f66e2c2 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Calling method '.version_select at 0x7f927abd6280>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:11.168515 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-72697e69-9c16-499e-941d-3c7b1f66e2c2 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-10711518" status: 204 len: 0 microversion: 2.2 time: 0.045040 Aug 02 06:53:11.169567 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 870/1832] 10.222.0.79 () {60 vars in 1315 bytes} [Tue Aug 2 06:53:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-10711518 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:11.181781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d5279d16-9e79-4e74-bd12-114c2de3f897 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Action: 'create', calling method: .version_select at 0x7f927abc88b0>, body: {"keypair": {"name": "tempest-keypair-425777727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvlIcj74mUF4hi4iwY1AJr4M58mH1FOgRATOmQYsqoTiurAZooUDtgm7pjpzLJUXWwzfzKb0Ng2uUiLX8hAn7lFqubxfa+66l9unYhUsy+etBQj7aCznmeFPJBxh533ag=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:11.210870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-d5279d16-9e79-4e74-bd12-114c2de3f897 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:53:11.224000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-d5279d16-9e79-4e74-bd12-114c2de3f897 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for user 1c2fbcec7aff42bbb34dfc306bb4cb36 and project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:53:11.257633 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8d3b8a91-656d-455f-8a9f-cf582edddef9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.164988 Aug 02 06:53:11.258687 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 963/1833] 10.222.0.79 () {58 vars in 1149 bytes} [Tue Aug 2 06:53:11 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:11.263505 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d5279d16-9e79-4e74-bd12-114c2de3f897 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.085717 Aug 02 06:53:11.265929 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 871/1834] 10.222.0.79 () {62 vars in 1199 bytes} [Tue Aug 2 06:53:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 02 06:53:11.275055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c24d63d5-7367-4ae2-9535-df480d6f0188 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f928c343dc0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:11.276207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-21480d21-e0b4-40d6-9656-81b95e543d62 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Calling method '.version_select at 0x7f927af2b040>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:11.289783 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-21480d21-e0b4-40d6-9656-81b95e543d62 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-425777727" status: 200 len: 512 microversion: 2.2 time: 0.018368 Aug 02 06:53:11.290439 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 872/1835] 10.222.0.79 () {60 vars in 1255 bytes} [Tue Aug 2 06:53:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-425777727 => generated 512 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:11.305000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6f55c992-d934-4e08-9f4a-47c4e9f947ed tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Calling method '.version_select at 0x7f927abd6310>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:11.309915 n-d-851337-3 devstack@n-api.service[126119]: WARNING oslo_db.sqlalchemy.utils [None req-6f55c992-d934-4e08-9f4a-47c4e9f947ed tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 02 06:53:11.317687 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6f55c992-d934-4e08-9f4a-47c4e9f947ed tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.019689 Aug 02 06:53:11.318614 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 873/1836] 10.222.0.79 () {60 vars in 1177 bytes} [Tue Aug 2 06:53:11 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:11.336828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-74cc1ed9-b108-4b3d-bd39-b95ab58a9683 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:11.337532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-74cc1ed9-b108-4b3d-bd39-b95ab58a9683 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:11.346093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74cc1ed9-b108-4b3d-bd39-b95ab58a9683 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:11.346807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74cc1ed9-b108-4b3d-bd39-b95ab58a9683 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:11.348286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74cc1ed9-b108-4b3d-bd39-b95ab58a9683 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:11.349283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74cc1ed9-b108-4b3d-bd39-b95ab58a9683 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:11.358806 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c24d63d5-7367-4ae2-9535-df480d6f0188 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.087498 Aug 02 06:53:11.359785 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 964/1837] 10.222.0.79 () {58 vars in 1149 bytes} [Tue Aug 2 06:53:11 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:11.368689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-42eb03e7-44ac-40cd-b217-5492da42f1cc tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Calling method '.version_select at 0x7f927b0cfd30>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:11.386353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:11.398451 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-42eb03e7-44ac-40cd-b217-5492da42f1cc tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-425777727" status: 204 len: 0 microversion: 2.2 time: 0.036539 Aug 02 06:53:11.399926 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 965/1838] 10.222.0.79 () {60 vars in 1258 bytes} [Tue Aug 2 06:53:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-425777727 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:11.408344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-450c4c5b-ab4c-4fde-bee5-6bdfa5da9aac tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b635040>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:11.454156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-74cc1ed9-b108-4b3d-bd39-b95ab58a9683 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:11.464330 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-74cc1ed9-b108-4b3d-bd39-b95ab58a9683 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1308 microversion: 2.1 time: 0.144276 Aug 02 06:53:11.465445 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 874/1839] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:11 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1308 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:11.471570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2e8349b1-3d57-426a-b9a2-b09f73a88d71 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Action: 'create', calling method: .version_select at 0x7f927b141040>, body: {"keypair": {"name": "tempest-keypair-369999607", "type": "x509"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:11.497263 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-450c4c5b-ab4c-4fde-bee5-6bdfa5da9aac tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.096045 Aug 02 06:53:11.497852 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 966/1840] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:53:11 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:11.507821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4aae3837-fbc9-49e2-8cc9-b112f15b8463 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:11.509633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2e8349b1-3d57-426a-b9a2-b09f73a88d71 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:53:11.510964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4aae3837-fbc9-49e2-8cc9-b112f15b8463 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:11.514934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2e8349b1-3d57-426a-b9a2-b09f73a88d71 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for user 1c2fbcec7aff42bbb34dfc306bb4cb36 and project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:53:11.519938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4aae3837-fbc9-49e2-8cc9-b112f15b8463 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:11.520694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4aae3837-fbc9-49e2-8cc9-b112f15b8463 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:11.521927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4aae3837-fbc9-49e2-8cc9-b112f15b8463 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:11.522352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4aae3837-fbc9-49e2-8cc9-b112f15b8463 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:11.538691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.processutils [None req-2e8349b1-3d57-426a-b9a2-b09f73a88d71 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpceqp5_3i/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpceqp5_3i/temp.key -subj /CN=1c2fbcec7aff42bbb34dfc306bb4cb36 -extensions v3_req_client {{(pid=126119) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 02 06:53:11.670781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4aae3837-fbc9-49e2-8cc9-b112f15b8463 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:11.674777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:11.680679 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4aae3837-fbc9-49e2-8cc9-b112f15b8463 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1497 microversion: 2.1 time: 0.181777 Aug 02 06:53:11.694924 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 967/1841] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:11 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:11.701056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-19c43c02-0704-4ff7-97c1-a398b22cb294 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927aa97820>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:11.813186 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-19c43c02-0704-4ff7-97c1-a398b22cb294 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/detail?changes-since=2022-08-02T06%3A51%3A12Z" status: 200 len: 6327 microversion: 2.1 time: 0.116740 Aug 02 06:53:11.815042 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 968/1842] 10.222.0.79 () {58 vars in 1220 bytes} [Tue Aug 2 06:53:11 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-02T06%3A51%3A12Z => generated 6327 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:11.838619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-38c6d929-66c2-4b05-b0cd-ceeaff2b9bb9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927a9e1ca0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:11.920227 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-38c6d929-66c2-4b05-b0cd-ceeaff2b9bb9 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-136905550" status: 200 len: 664 microversion: 2.1 time: 0.092193 Aug 02 06:53:11.930001 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 969/1843] 10.222.0.79 () {58 vars in 1250 bytes} [Tue Aug 2 06:53:11 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-136905550 => generated 664 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:53:11.930001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-94e86e94-57cb-4797-ac04-fa6838dc40ec tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:11.930001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-94e86e94-57cb-4797-ac04-fa6838dc40ec tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:11.945267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-94e86e94-57cb-4797-ac04-fa6838dc40ec tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:11.946103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-94e86e94-57cb-4797-ac04-fa6838dc40ec tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:11.957853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-94e86e94-57cb-4797-ac04-fa6838dc40ec tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:11.959345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-94e86e94-57cb-4797-ac04-fa6838dc40ec tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:12.015577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.processutils [None req-2e8349b1-3d57-426a-b9a2-b09f73a88d71 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpceqp5_3i/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpceqp5_3i/temp.key -subj /CN=1c2fbcec7aff42bbb34dfc306bb4cb36 -extensions v3_req_client" returned: 0 in 0.476s {{(pid=126119) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 02 06:53:12.017285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.processutils [None req-2e8349b1-3d57-426a-b9a2-b09f73a88d71 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpceqp5_3i/temp.key -password pass: {{(pid=126119) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 02 06:53:12.051896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.processutils [None req-2e8349b1-3d57-426a-b9a2-b09f73a88d71 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpceqp5_3i/temp.key -password pass:" returned: 0 in 0.034s {{(pid=126119) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 02 06:53:12.108967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2e8349b1-3d57-426a-b9a2-b09f73a88d71 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:53:12.117736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2e8349b1-3d57-426a-b9a2-b09f73a88d71 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Getting quotas for user 1c2fbcec7aff42bbb34dfc306bb4cb36 and project fdb78576ae4f446aacb7bb1d3cbf3464. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:53:12.146048 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2e8349b1-3d57-426a-b9a2-b09f73a88d71 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.679305 Aug 02 06:53:12.152491 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 875/1844] 10.222.0.79 () {62 vars in 1198 bytes} [Tue Aug 2 06:53:11 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 682 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:12.155825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb647c4b-d5e3-4b7c-8a61-7763d084caa5 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927abd60d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:12.254166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-94e86e94-57cb-4797-ac04-fa6838dc40ec tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:12.265228 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-94e86e94-57cb-4797-ac04-fa6838dc40ec tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1477 microversion: 2.1 time: 0.342503 Aug 02 06:53:12.273942 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 970/1845] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:11 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1477 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:12.273942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-926d55b4-fda8-4363-beea-2ee5504a544e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:12.273942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-926d55b4-fda8-4363-beea-2ee5504a544e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:12.279051 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-926d55b4-fda8-4363-beea-2ee5504a544e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:12.279528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-926d55b4-fda8-4363-beea-2ee5504a544e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:12.280477 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cb647c4b-d5e3-4b7c-8a61-7763d084caa5 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2Fa92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1464 microversion: 2.1 time: 0.130829 Aug 02 06:53:12.286118 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 876/1846] 10.222.0.79 () {58 vars in 1338 bytes} [Tue Aug 2 06:53:12 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2Fa92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1464 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:12.286308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-926d55b4-fda8-4363-beea-2ee5504a544e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:12.286308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-926d55b4-fda8-4363-beea-2ee5504a544e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:12.288358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3da62a1f-5c10-4fa9-98d0-69cc0817d129 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Calling method '.version_select at 0x7f927abd6c10>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:12.299024 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3da62a1f-5c10-4fa9-98d0-69cc0817d129 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-369999607" status: 200 len: 1533 microversion: 2.2 time: 0.016163 Aug 02 06:53:12.306066 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 877/1847] 10.222.0.79 () {60 vars in 1255 bytes} [Tue Aug 2 06:53:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-369999607 => generated 1533 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:12.313206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cda499a8-ad90-4384-8dbb-bb107166c010 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927abc5430>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:12.379041 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cda499a8-ad90-4384-8dbb-bb107166c010 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2Fa92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1464 microversion: 2.1 time: 0.071810 Aug 02 06:53:12.380383 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 878/1848] 10.222.0.79 () {58 vars in 1324 bytes} [Tue Aug 2 06:53:12 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2Fa92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1464 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:12.386556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0390d09e-4d9e-4e20-a0e6-97cf51ffe7c9 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Calling method '.version_select at 0x7f927abc8940>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:12.391069 n-d-851337-3 devstack@n-api.service[126119]: WARNING oslo_db.sqlalchemy.utils [None req-0390d09e-4d9e-4e20-a0e6-97cf51ffe7c9 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 02 06:53:12.399052 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0390d09e-4d9e-4e20-a0e6-97cf51ffe7c9 tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.017729 Aug 02 06:53:12.405885 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 879/1849] 10.222.0.79 () {60 vars in 1177 bytes} [Tue Aug 2 06:53:12 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:12.410973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6b8906aa-95a5-4983-9dc6-ed08d05bb5d3 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927abd60d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:12.530354 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6b8906aa-95a5-4983-9dc6-ed08d05bb5d3 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.122873 Aug 02 06:53:12.532814 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 880/1850] 10.222.0.79 () {58 vars in 1170 bytes} [Tue Aug 2 06:53:12 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:12.560430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a689ba07-e5b4-42e0-9e30-260a5d27414f tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] Calling method '.version_select at 0x7f927abc8160>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:12.579205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:12.615833 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a689ba07-e5b4-42e0-9e30-260a5d27414f tempest-KeyPairsV22TestJSON-1355457591 tempest-KeyPairsV22TestJSON-1355457591-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-369999607" status: 204 len: 0 microversion: 2.2 time: 0.070539 Aug 02 06:53:12.619481 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 881/1851] 10.222.0.79 () {60 vars in 1258 bytes} [Tue Aug 2 06:53:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-369999607 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:12.638216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-926d55b4-fda8-4363-beea-2ee5504a544e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:12.639146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ea3fada-6a20-425c-8a02-078fad2449d8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:12.643482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ea3fada-6a20-425c-8a02-078fad2449d8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:12.647490 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-926d55b4-fda8-4363-beea-2ee5504a544e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1315 microversion: 2.1 time: 0.379772 Aug 02 06:53:12.660033 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 971/1852] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:12 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:12.663276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ea3fada-6a20-425c-8a02-078fad2449d8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:12.666067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5ddca232-898e-4228-86e1-d320e0b3bcae tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927b336790>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:12.666925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ea3fada-6a20-425c-8a02-078fad2449d8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:12.668412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ea3fada-6a20-425c-8a02-078fad2449d8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:12.684426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ea3fada-6a20-425c-8a02-078fad2449d8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:12.835323 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5ddca232-898e-4228-86e1-d320e0b3bcae tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.185445 Aug 02 06:53:12.850039 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 972/1853] 10.222.0.79 () {58 vars in 1170 bytes} [Tue Aug 2 06:53:12 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:12.870557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-891108f6-bfeb-43ae-a611-68ce93a5ae4e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:12.871187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-891108f6-bfeb-43ae-a611-68ce93a5ae4e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:12.884994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ea3fada-6a20-425c-8a02-078fad2449d8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:12.895354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-891108f6-bfeb-43ae-a611-68ce93a5ae4e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:12.895810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-891108f6-bfeb-43ae-a611-68ce93a5ae4e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:12.900139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-891108f6-bfeb-43ae-a611-68ce93a5ae4e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:12.900599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-891108f6-bfeb-43ae-a611-68ce93a5ae4e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:12.900850 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ea3fada-6a20-425c-8a02-078fad2449d8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1296 microversion: 2.1 time: 0.272493 Aug 02 06:53:12.902056 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 882/1854] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:12 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1296 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:12.941508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-725beaee-2f12-4f3a-9268-35b9245aa8b6 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927af2be50>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:13.053246 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-725beaee-2f12-4f3a-9268-35b9245aa8b6 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/fbc11386-7cb6-4309-932b-7acee00d4676" status: 200 len: 784 microversion: 2.1 time: 0.146256 Aug 02 06:53:13.066533 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 883/1855] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:12 2022] GET /compute/v2.1/images/fbc11386-7cb6-4309-932b-7acee00d4676 => generated 784 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:13.069016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-345e45b1-dfde-4f44-9dcd-308ea3b96432 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927abc84c0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:13.186361 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-345e45b1-dfde-4f44-9dcd-308ea3b96432 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.121339 Aug 02 06:53:13.196605 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 884/1856] 10.222.0.79 () {58 vars in 1158 bytes} [Tue Aug 2 06:53:13 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:13.207162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ba3f0c6e-c234-4040-94bd-d0578462daf6 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927abd6b80>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:13.853371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-891108f6-bfeb-43ae-a611-68ce93a5ae4e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:13.861433 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-891108f6-bfeb-43ae-a611-68ce93a5ae4e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1497 microversion: 2.1 time: 1.009760 Aug 02 06:53:13.862055 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 973/1857] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:12 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1497 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:13.896784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a406afa4-702c-4433-8acc-e94068a5bd66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:13.897397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a406afa4-702c-4433-8acc-e94068a5bd66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:13.919409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a406afa4-702c-4433-8acc-e94068a5bd66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:13.919409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a406afa4-702c-4433-8acc-e94068a5bd66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:13.919409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a406afa4-702c-4433-8acc-e94068a5bd66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:13.919853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a406afa4-702c-4433-8acc-e94068a5bd66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:14.283260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a406afa4-702c-4433-8acc-e94068a5bd66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:14.305484 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a406afa4-702c-4433-8acc-e94068a5bd66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1477 microversion: 2.1 time: 0.422827 Aug 02 06:53:14.309056 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 974/1858] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:13 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1477 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:14.324088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-471b327f-d557-48db-8734-a093a319d8c0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:14.326773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-471b327f-d557-48db-8734-a093a319d8c0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:14.351555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-471b327f-d557-48db-8734-a093a319d8c0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:14.351927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-471b327f-d557-48db-8734-a093a319d8c0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:14.352795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-471b327f-d557-48db-8734-a093a319d8c0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:14.353154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-471b327f-d557-48db-8734-a093a319d8c0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:14.494912 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ba3f0c6e-c234-4040-94bd-d0578462daf6 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "DELETE /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41" status: 204 len: 0 microversion: 2.1 time: 1.295378 Aug 02 06:53:14.495620 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 885/1859] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:13 2022] DELETE /compute/v2.1/images/7ae37008-630e-4101-aa06-973e83dcca41 => generated 0 bytes in 1297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 06:53:14.513470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7c93f329-6051-4a32-a5a3-bc11c07b2342 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:14.516016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7c93f329-6051-4a32-a5a3-bc11c07b2342 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:14.568138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c93f329-6051-4a32-a5a3-bc11c07b2342 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:14.568735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c93f329-6051-4a32-a5a3-bc11c07b2342 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:14.571841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c93f329-6051-4a32-a5a3-bc11c07b2342 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:14.572540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c93f329-6051-4a32-a5a3-bc11c07b2342 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:14.957559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-471b327f-d557-48db-8734-a093a319d8c0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:14.992813 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-471b327f-d557-48db-8734-a093a319d8c0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1315 microversion: 2.1 time: 0.682060 Aug 02 06:53:15.012769 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 975/1860] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:14 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:15.024861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ea5c12bd-f92c-4793-8b57-ff86ae3661c7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927a88cca0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:15.038634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7c93f329-6051-4a32-a5a3-bc11c07b2342 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:15.048206 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7c93f329-6051-4a32-a5a3-bc11c07b2342 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1363 microversion: 2.1 time: 0.550480 Aug 02 06:53:15.049298 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 886/1861] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:14 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1363 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:15.054097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-609b0ef5-c273-4c32-876c-ec4c35c672cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:15.068641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-609b0ef5-c273-4c32-876c-ec4c35c672cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:15.092656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-609b0ef5-c273-4c32-876c-ec4c35c672cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:15.094027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-609b0ef5-c273-4c32-876c-ec4c35c672cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:15.095889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-609b0ef5-c273-4c32-876c-ec4c35c672cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:15.096465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-609b0ef5-c273-4c32-876c-ec4c35c672cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:15.467139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-609b0ef5-c273-4c32-876c-ec4c35c672cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:15.479405 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-609b0ef5-c273-4c32-876c-ec4c35c672cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1497 microversion: 2.1 time: 0.428853 Aug 02 06:53:15.480016 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 887/1862] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:15 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1497 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:15.498474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4c6bd793-63d6-4d4c-86b2-1e528427f097 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:15.500171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4c6bd793-63d6-4d4c-86b2-1e528427f097 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:15.525369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c6bd793-63d6-4d4c-86b2-1e528427f097 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:15.526229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c6bd793-63d6-4d4c-86b2-1e528427f097 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:15.527653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c6bd793-63d6-4d4c-86b2-1e528427f097 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:15.528803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c6bd793-63d6-4d4c-86b2-1e528427f097 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:15.917507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4c6bd793-63d6-4d4c-86b2-1e528427f097 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:15.928495 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4c6bd793-63d6-4d4c-86b2-1e528427f097 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1477 microversion: 2.1 time: 0.445111 Aug 02 06:53:15.947310 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 888/1863] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:15 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1477 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:15.959968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-794deda2-7c4e-4d2e-affe-47ca2eff7bcb req-d9c7c6c2-2cd6-4007-9210-2c86f2d41d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba796c7-da1f-4aa8-9dce-014658905cc4", "name": "network-vif-plugged", "status": "completed", "tag": "037cd849-dce0-499f-9464-cf45471f908a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:15.977998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-794deda2-7c4e-4d2e-affe-47ca2eff7bcb req-d9c7c6c2-2cd6-4007-9210-2c86f2d41d92 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:15.978441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-794deda2-7c4e-4d2e-affe-47ca2eff7bcb req-d9c7c6c2-2cd6-4007-9210-2c86f2d41d92 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:16.019744 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-794deda2-7c4e-4d2e-affe-47ca2eff7bcb req-d9c7c6c2-2cd6-4007-9210-2c86f2d41d92 service nova] Creating event network-vif-plugged:037cd849-dce0-499f-9464-cf45471f908a for instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 on n-h1-851337-3 Aug 02 06:53:16.032146 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-794deda2-7c4e-4d2e-affe-47ca2eff7bcb req-d9c7c6c2-2cd6-4007-9210-2c86f2d41d92 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079310 Aug 02 06:53:16.033603 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 889/1864] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:16.044269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-63f3dfea-0931-4908-b94b-e0dc6588e16a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:16.045393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-63f3dfea-0931-4908-b94b-e0dc6588e16a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:16.054584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f3dfea-0931-4908-b94b-e0dc6588e16a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:16.055410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f3dfea-0931-4908-b94b-e0dc6588e16a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:16.056551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f3dfea-0931-4908-b94b-e0dc6588e16a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:16.057151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f3dfea-0931-4908-b94b-e0dc6588e16a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:16.198585 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ea5c12bd-f92c-4793-8b57-ff86ae3661c7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "DELETE /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3" status: 204 len: 0 microversion: 2.1 time: 1.183542 Aug 02 06:53:16.199704 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 976/1865] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:15 2022] DELETE /compute/v2.1/images/6f66e43d-24f1-464d-84e8-5f0097f525c3 => generated 0 bytes in 1186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:16.210910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f8ed082-71fb-4dda-bdde-85a698c9cd45 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:16.211864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1f8ed082-71fb-4dda-bdde-85a698c9cd45 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:16.221073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f8ed082-71fb-4dda-bdde-85a698c9cd45 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:16.222133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f8ed082-71fb-4dda-bdde-85a698c9cd45 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:16.223149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f8ed082-71fb-4dda-bdde-85a698c9cd45 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:16.223780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f8ed082-71fb-4dda-bdde-85a698c9cd45 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:16.497802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-63f3dfea-0931-4908-b94b-e0dc6588e16a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:16.509922 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-63f3dfea-0931-4908-b94b-e0dc6588e16a tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1315 microversion: 2.1 time: 0.474382 Aug 02 06:53:16.511267 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 890/1866] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:16 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:16.519288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cecef28b-6f5e-4b78-b9e8-ccac4e94d250 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927abd6040>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:16.559091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f8ed082-71fb-4dda-bdde-85a698c9cd45 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:16.574908 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f8ed082-71fb-4dda-bdde-85a698c9cd45 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1363 microversion: 2.1 time: 0.373720 Aug 02 06:53:16.575537 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 977/1867] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:16 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1363 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:16.603758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-af738364-89b4-44d8-90c3-f61fd2075dd4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:16.608289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-af738364-89b4-44d8-90c3-f61fd2075dd4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:16.625412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af738364-89b4-44d8-90c3-f61fd2075dd4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:16.627466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af738364-89b4-44d8-90c3-f61fd2075dd4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:16.630768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af738364-89b4-44d8-90c3-f61fd2075dd4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:16.631312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af738364-89b4-44d8-90c3-f61fd2075dd4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:16.861700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-af738364-89b4-44d8-90c3-f61fd2075dd4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:16.869535 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-af738364-89b4-44d8-90c3-f61fd2075dd4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1497 microversion: 2.1 time: 0.290188 Aug 02 06:53:16.871768 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 978/1868] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:16 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1497 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:16.877606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-cb2a241c-8d0b-4369-b46f-44151c08be0a req-c4dbabd2-8f51-4b9b-8b1f-fbda9d58b737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8b07c5d-4324-4221-a77d-203f65ad3b04", "tag": "b40c75bb-1839-4d4f-98e5-444d01355d6a"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:16.889681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-cb2a241c-8d0b-4369-b46f-44151c08be0a req-c4dbabd2-8f51-4b9b-8b1f-fbda9d58b737 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:16.890149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-cb2a241c-8d0b-4369-b46f-44151c08be0a req-c4dbabd2-8f51-4b9b-8b1f-fbda9d58b737 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:16.910746 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-cb2a241c-8d0b-4369-b46f-44151c08be0a req-c4dbabd2-8f51-4b9b-8b1f-fbda9d58b737 service nova] Creating event network-changed:b40c75bb-1839-4d4f-98e5-444d01355d6a for instance f8b07c5d-4324-4221-a77d-203f65ad3b04 on n-h1-851337-3 Aug 02 06:53:16.917510 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-cb2a241c-8d0b-4369-b46f-44151c08be0a req-c4dbabd2-8f51-4b9b-8b1f-fbda9d58b737 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044203 Aug 02 06:53:16.918519 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 979/1869] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:16.955893 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e3744c9d-d780-4470-93bf-a28363b4a05d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:16.956750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e3744c9d-d780-4470-93bf-a28363b4a05d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:16.969934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3744c9d-d780-4470-93bf-a28363b4a05d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:16.970424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3744c9d-d780-4470-93bf-a28363b4a05d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:16.974762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3744c9d-d780-4470-93bf-a28363b4a05d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:16.975584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3744c9d-d780-4470-93bf-a28363b4a05d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:17.404619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e3744c9d-d780-4470-93bf-a28363b4a05d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:17.420256 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e3744c9d-d780-4470-93bf-a28363b4a05d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1477 microversion: 2.1 time: 0.466963 Aug 02 06:53:17.422631 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 980/1870] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:16 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1477 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:53:17.478829 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cecef28b-6f5e-4b78-b9e8-ccac4e94d250 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "DELETE /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51" status: 204 len: 0 microversion: 2.1 time: 0.965411 Aug 02 06:53:17.479411 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 891/1871] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:16 2022] DELETE /compute/v2.1/images/9848fd10-6a7e-42d9-b1b1-b9f449c57f51 => generated 0 bytes in 967 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:17.487573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7c5b0177-73f5-4b3b-99ea-43f6bcdbdea7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:17.488068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7c5b0177-73f5-4b3b-99ea-43f6bcdbdea7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:17.496698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c5b0177-73f5-4b3b-99ea-43f6bcdbdea7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:17.499783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c5b0177-73f5-4b3b-99ea-43f6bcdbdea7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:17.500675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c5b0177-73f5-4b3b-99ea-43f6bcdbdea7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:17.501332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c5b0177-73f5-4b3b-99ea-43f6bcdbdea7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:17.544297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-00afb9a8-cffc-4c00-8d5d-76bfbc222171 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:17.544961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-00afb9a8-cffc-4c00-8d5d-76bfbc222171 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:17.554073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7c5b0177-73f5-4b3b-99ea-43f6bcdbdea7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:53:17.558310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00afb9a8-cffc-4c00-8d5d-76bfbc222171 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:17.559082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00afb9a8-cffc-4c00-8d5d-76bfbc222171 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:17.560136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00afb9a8-cffc-4c00-8d5d-76bfbc222171 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:17.562107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00afb9a8-cffc-4c00-8d5d-76bfbc222171 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:17.572471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:17.672253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=8 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:17.681996 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7c5b0177-73f5-4b3b-99ea-43f6bcdbdea7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 204 len: 0 microversion: 2.1 time: 0.197299 Aug 02 06:53:17.683907 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 981/1872] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:53:17 2022] DELETE /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:17.697537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-57fb32ae-929c-4cf3-a054-29d044cf74ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:17.699443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-57fb32ae-929c-4cf3-a054-29d044cf74ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:17.710632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57fb32ae-929c-4cf3-a054-29d044cf74ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:17.711713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57fb32ae-929c-4cf3-a054-29d044cf74ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:17.713426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57fb32ae-929c-4cf3-a054-29d044cf74ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:17.714306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57fb32ae-929c-4cf3-a054-29d044cf74ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:17.885039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-00afb9a8-cffc-4c00-8d5d-76bfbc222171 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:17.902265 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-00afb9a8-cffc-4c00-8d5d-76bfbc222171 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1315 microversion: 2.1 time: 0.362218 Aug 02 06:53:17.906634 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 892/1873] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:17 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:53:17.911548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-04a5c1b0-2736-4a0d-b44a-2a78f464a61a tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:17.912178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-04a5c1b0-2736-4a0d-b44a-2a78f464a61a tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:17.930852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04a5c1b0-2736-4a0d-b44a-2a78f464a61a tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:17.931346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04a5c1b0-2736-4a0d-b44a-2a78f464a61a tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:17.932291 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04a5c1b0-2736-4a0d-b44a-2a78f464a61a tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:17.933538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04a5c1b0-2736-4a0d-b44a-2a78f464a61a tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:18.096138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-57fb32ae-929c-4cf3-a054-29d044cf74ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:18.104717 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-57fb32ae-929c-4cf3-a054-29d044cf74ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1363 microversion: 2.1 time: 0.417280 Aug 02 06:53:18.110774 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 982/1874] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:17 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1363 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:18.125534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dce596dd-4e74-4e7a-9fd2-b1634da73638 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:18.126694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dce596dd-4e74-4e7a-9fd2-b1634da73638 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:18.140189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dce596dd-4e74-4e7a-9fd2-b1634da73638 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:18.141232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dce596dd-4e74-4e7a-9fd2-b1634da73638 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:18.142427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dce596dd-4e74-4e7a-9fd2-b1634da73638 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:18.143134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dce596dd-4e74-4e7a-9fd2-b1634da73638 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:18.530410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-04a5c1b0-2736-4a0d-b44a-2a78f464a61a tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:18.548114 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-04a5c1b0-2736-4a0d-b44a-2a78f464a61a tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1474 microversion: 2.1 time: 0.635820 Aug 02 06:53:18.562059 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 893/1875] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:17 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1474 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:18.581497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2445724c-dad4-4bf8-9d89-4b64c37ee1b1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:18.582632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2445724c-dad4-4bf8-9d89-4b64c37ee1b1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:18.584585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dce596dd-4e74-4e7a-9fd2-b1634da73638 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:18.597767 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dce596dd-4e74-4e7a-9fd2-b1634da73638 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1497 microversion: 2.1 time: 0.485698 Aug 02 06:53:18.609952 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 983/1876] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:18 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1497 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:18.612926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2445724c-dad4-4bf8-9d89-4b64c37ee1b1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:18.615489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2445724c-dad4-4bf8-9d89-4b64c37ee1b1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:18.616603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2445724c-dad4-4bf8-9d89-4b64c37ee1b1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:18.617297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2445724c-dad4-4bf8-9d89-4b64c37ee1b1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:18.797133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2445724c-dad4-4bf8-9d89-4b64c37ee1b1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:18.805819 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2445724c-dad4-4bf8-9d89-4b64c37ee1b1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1477 microversion: 2.1 time: 0.240053 Aug 02 06:53:18.806433 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 894/1877] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:18 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1477 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:18.925456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6f57c166-0371-4576-ae4e-008548445ee0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:18.926147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6f57c166-0371-4576-ae4e-008548445ee0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:18.928191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=9 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:18.935503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f57c166-0371-4576-ae4e-008548445ee0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:18.935947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f57c166-0371-4576-ae4e-008548445ee0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:18.936714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f57c166-0371-4576-ae4e-008548445ee0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:18.937139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f57c166-0371-4576-ae4e-008548445ee0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:19.134949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4b5c1066-9f1c-4a1b-9f66-2235f93a0684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:19.136026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4b5c1066-9f1c-4a1b-9f66-2235f93a0684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:19.157540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b5c1066-9f1c-4a1b-9f66-2235f93a0684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:19.159158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6f57c166-0371-4576-ae4e-008548445ee0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:19.159809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b5c1066-9f1c-4a1b-9f66-2235f93a0684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:19.161360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b5c1066-9f1c-4a1b-9f66-2235f93a0684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:19.165400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b5c1066-9f1c-4a1b-9f66-2235f93a0684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:19.197868 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6f57c166-0371-4576-ae4e-008548445ee0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1503 microversion: 2.1 time: 0.276811 Aug 02 06:53:19.202004 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 984/1878] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:18 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1503 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:19.227627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f4c74a3-e173-47ab-9ecc-6a711190a69b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-796549308"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:19.227627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5f4c74a3-e173-47ab-9ecc-6a711190a69b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:19.250686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f4c74a3-e173-47ab-9ecc-6a711190a69b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:19.251184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f4c74a3-e173-47ab-9ecc-6a711190a69b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:19.251977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f4c74a3-e173-47ab-9ecc-6a711190a69b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:19.252414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f4c74a3-e173-47ab-9ecc-6a711190a69b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:19.454719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4b5c1066-9f1c-4a1b-9f66-2235f93a0684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:19.469333 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4b5c1066-9f1c-4a1b-9f66-2235f93a0684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1363 microversion: 2.1 time: 0.338372 Aug 02 06:53:19.481296 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 895/1879] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:19 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1363 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:19.578866 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.network.security_group_api [None req-5f4c74a3-e173-47ab-9ecc-6a711190a69b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Adding security group 11669366-4dc6-482e-be48-69add67ea1b2 to port 037cd849-dce0-499f-9464-cf45471f908a Aug 02 06:53:19.823028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-347766966", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": "none"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:19.918283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:53:19.919035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:53:19.919982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:53:19.920600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:53:19.921221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:53:19.955061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:19.962941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:19.964883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:19.965326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:19.988496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Getting quotas for project e9a8ff4325d4420f9ef7def2bc04d62c. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:53:19.994697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Getting quotas for user bd8ec7a35581458a89bd9a4b7d58154a and project e9a8ff4325d4420f9ef7def2bc04d62c. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:53:20.009555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:53:20.012634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:53:20.067821 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-65c4831d-f697-4722-a11f-575719a2cc52 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.586953 Aug 02 06:53:20.069538 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 896/1880] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 06:53:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 06:53:20.074949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-675dd67e-a2ee-46b8-9d48-a4194a3ee569 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:20.075984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-675dd67e-a2ee-46b8-9d48-a4194a3ee569 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:20.084349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-675dd67e-a2ee-46b8-9d48-a4194a3ee569 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:20.085209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-675dd67e-a2ee-46b8-9d48-a4194a3ee569 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:20.086245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-675dd67e-a2ee-46b8-9d48-a4194a3ee569 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:20.087032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-675dd67e-a2ee-46b8-9d48-a4194a3ee569 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:20.389643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-675dd67e-a2ee-46b8-9d48-a4194a3ee569 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:20.401798 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-675dd67e-a2ee-46b8-9d48-a4194a3ee569 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 200 len: 1474 microversion: 2.1 time: 0.327349 Aug 02 06:53:20.402491 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 897/1881] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:20 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 1474 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:20.409635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d78b0bf0-b59f-4528-8363-1c5fdd4e11fb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:20.410270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d78b0bf0-b59f-4528-8363-1c5fdd4e11fb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:20.425814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d78b0bf0-b59f-4528-8363-1c5fdd4e11fb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:20.426280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d78b0bf0-b59f-4528-8363-1c5fdd4e11fb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:20.431238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d78b0bf0-b59f-4528-8363-1c5fdd4e11fb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:20.431959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d78b0bf0-b59f-4528-8363-1c5fdd4e11fb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:20.770824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d78b0bf0-b59f-4528-8363-1c5fdd4e11fb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:20.779681 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d78b0bf0-b59f-4528-8363-1c5fdd4e11fb tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1497 microversion: 2.1 time: 0.376107 Aug 02 06:53:20.780500 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 898/1882] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:20 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1497 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:20.807040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ee183388-078f-4751-a852-c1cbc9af0c4f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:20.810471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ee183388-078f-4751-a852-c1cbc9af0c4f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:20.823809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee183388-078f-4751-a852-c1cbc9af0c4f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:20.824555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee183388-078f-4751-a852-c1cbc9af0c4f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:20.825122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee183388-078f-4751-a852-c1cbc9af0c4f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:20.825552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee183388-078f-4751-a852-c1cbc9af0c4f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:20.907294 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5f4c74a3-e173-47ab-9ecc-6a711190a69b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4/action" status: 202 len: 0 microversion: 2.1 time: 1.685740 Aug 02 06:53:20.913239 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 985/1883] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:53:19 2022] POST /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4/action => generated 0 bytes in 1693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:53:20.924960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-53d578c6-e0f7-41fd-83db-06271c72b0db tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:20.925536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-53d578c6-e0f7-41fd-83db-06271c72b0db tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:20.947506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53d578c6-e0f7-41fd-83db-06271c72b0db tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:20.951407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53d578c6-e0f7-41fd-83db-06271c72b0db tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:20.967063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53d578c6-e0f7-41fd-83db-06271c72b0db tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:20.970365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53d578c6-e0f7-41fd-83db-06271c72b0db tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:21.484428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-53d578c6-e0f7-41fd-83db-06271c72b0db tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:21.498341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-53d578c6-e0f7-41fd-83db-06271c72b0db tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:21.506910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-53d578c6-e0f7-41fd-83db-06271c72b0db tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:21.508579 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-53d578c6-e0f7-41fd-83db-06271c72b0db tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 200 len: 1284 microversion: 2.47 time: 0.593376 Aug 02 06:53:21.513886 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 986/1884] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:20 2022] GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 1284 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:21.524312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-262f0455-8e81-45de-b8b2-9ad65902573a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:21.527120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-262f0455-8e81-45de-b8b2-9ad65902573a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:21.545726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-262f0455-8e81-45de-b8b2-9ad65902573a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:21.547399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-262f0455-8e81-45de-b8b2-9ad65902573a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:21.548496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-262f0455-8e81-45de-b8b2-9ad65902573a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:21.550983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-262f0455-8e81-45de-b8b2-9ad65902573a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:21.778705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ee183388-078f-4751-a852-c1cbc9af0c4f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:21.791047 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ee183388-078f-4751-a852-c1cbc9af0c4f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1477 microversion: 2.1 time: 0.992902 Aug 02 06:53:21.791654 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 899/1885] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:20 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1477 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:21.812684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a068aa84-a275-4794-be2f-f19e7f80c44b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927b830c10>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:22.161876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-262f0455-8e81-45de-b8b2-9ad65902573a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:22.166049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:22.182720 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-262f0455-8e81-45de-b8b2-9ad65902573a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1363 microversion: 2.1 time: 0.667144 Aug 02 06:53:22.183346 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 987/1886] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:21 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1363 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:22.213410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-a700e011-0339-4e28-8b24-b4e3a1c344bc req-065376f1-f891-499f-b382-25da1a78f474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba796c7-da1f-4aa8-9dce-014658905cc4", "tag": "037cd849-dce0-499f-9464-cf45471f908a"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:22.233263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a700e011-0339-4e28-8b24-b4e3a1c344bc req-065376f1-f891-499f-b382-25da1a78f474 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:22.241176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a700e011-0339-4e28-8b24-b4e3a1c344bc req-065376f1-f891-499f-b382-25da1a78f474 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:22.267726 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-a700e011-0339-4e28-8b24-b4e3a1c344bc req-065376f1-f891-499f-b382-25da1a78f474 service nova] Creating event network-changed:037cd849-dce0-499f-9464-cf45471f908a for instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 on n-h1-851337-3 Aug 02 06:53:22.281108 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-a700e011-0339-4e28-8b24-b4e3a1c344bc req-065376f1-f891-499f-b382-25da1a78f474 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081787 Aug 02 06:53:22.294914 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 988/1887] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:22.302885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-48eabd67-8c90-4bc9-a75a-8025f5ffc491 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:22.303830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-48eabd67-8c90-4bc9-a75a-8025f5ffc491 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:22.317085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48eabd67-8c90-4bc9-a75a-8025f5ffc491 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:22.317908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48eabd67-8c90-4bc9-a75a-8025f5ffc491 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:22.318913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48eabd67-8c90-4bc9-a75a-8025f5ffc491 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:22.319521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48eabd67-8c90-4bc9-a75a-8025f5ffc491 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:22.341201 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-48eabd67-8c90-4bc9-a75a-8025f5ffc491 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] HTTP exception thrown: Instance a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b could not be found. Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-48eabd67-8c90-4bc9-a75a-8025f5ffc491 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Request method failure captured: Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b HTTP/1.1 Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MlfJJSI5-_3FCNCnbPOmLzJi3UpZSYYZdsnQgMUp0hSwKHRfTGFEZQ7jfb1DGcja_NZrpC3_Q6npB4U-dJyT8SoPHp6ENdtAly24M19CmO8cLnVohjMlOLOY7iTnKDAtWN7Ki_3qieeyO14NW3S77YItYFyf0VbdgjJVKFXDiETqNE Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: aae511cbb16247e1aa14cfe1c0d285bd Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ListImageFiltersTestJSON-234054173 Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/aae511cbb16247e1aa14cfe1c0d285bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aae511cbb16247e1aa14cfe1c0d285bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_aae511cbb16247e1aa14cfe1c0d285bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aae511cbb16247e1aa14cfe1c0d285bd"}]}] Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ListImageFiltersTestJSON-234054173 Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: aae511cbb16247e1aa14cfe1c0d285bd Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-234054173 Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ListImageFiltersTestJSON-234054173-project Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b857b54177bd4b9b9128a28d93ab6610 Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ListImageFiltersTestJSON-234054173-project Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b could not be found. Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b'} Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b could not be found. Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b could not be found. Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:22.344641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:22.352556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:22.352556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:22.352556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:22.352556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:22.352556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:22.352556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b could not be found. Aug 02 06:53:22.352556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:22.355176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-48eabd67-8c90-4bc9-a75a-8025f5ffc491 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Returning 404 to user: Instance a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:22.356303 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-48eabd67-8c90-4bc9-a75a-8025f5ffc491 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b" status: 404 len: 111 microversion: 2.1 time: 0.059926 Aug 02 06:53:22.358114 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 989/1888] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:22 2022] GET /compute/v2.1/servers/a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:53:22.365449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e9f6ef73-d759-4047-aae1-c5c3659dd611 req-22ea6f8f-07a0-46dd-86a3-3dd645f0d0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b", "name": "network-vif-deleted", "tag": "d7483d94-2d0f-4ad6-bb8f-b89e8f73637f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:22.378607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e9f6ef73-d759-4047-aae1-c5c3659dd611 req-22ea6f8f-07a0-46dd-86a3-3dd645f0d0e0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:22.379700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e9f6ef73-d759-4047-aae1-c5c3659dd611 req-22ea6f8f-07a0-46dd-86a3-3dd645f0d0e0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:22.402718 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e9f6ef73-d759-4047-aae1-c5c3659dd611 req-22ea6f8f-07a0-46dd-86a3-3dd645f0d0e0 service nova] Creating event network-vif-deleted:d7483d94-2d0f-4ad6-bb8f-b89e8f73637f for instance a92a427f-fcf5-4e9f-ac93-0104ac8c7f2b on n-h2-851337-3 Aug 02 06:53:22.408250 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e9f6ef73-d759-4047-aae1-c5c3659dd611 req-22ea6f8f-07a0-46dd-86a3-3dd645f0d0e0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048378 Aug 02 06:53:22.409326 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 990/1889] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:22.415631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-23584a1e-3436-4003-afae-75cdb6b06a7b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:22.416598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-23584a1e-3436-4003-afae-75cdb6b06a7b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:22.427269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23584a1e-3436-4003-afae-75cdb6b06a7b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:22.427722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23584a1e-3436-4003-afae-75cdb6b06a7b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:22.428510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23584a1e-3436-4003-afae-75cdb6b06a7b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:22.428941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23584a1e-3436-4003-afae-75cdb6b06a7b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:22.443731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG neutronclient.v2_0.client [None req-a068aa84-a275-4794-be2f-f19e7f80c44b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 11669366-4dc6-482e-be48-69add67ea1b2 in use.", "detail": ""}} {{(pid=126119) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:53:22.444501 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-a068aa84-a275-4794-be2f-f19e7f80c44b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Security Group 11669366-4dc6-482e-be48-69add67ea1b2 in use. Aug 02 06:53:22.444501 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-1f7ff362-1d63-406a-ab04-ae83fb377dcc'] Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a068aa84-a275-4794-be2f-f19e7f80c44b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/os-security-groups/11669366-4dc6-482e-be48-69add67ea1b2 HTTP/1.1 Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: exception: Security Group 11669366-4dc6-482e-be48-69add67ea1b2 in use. Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-1f7ff362-1d63-406a-ab04-ae83fb377dcc'] Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '11669366-4dc6-482e-be48-69add67ea1b2'} Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:53:22.446590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 11669366-4dc6-482e-be48-69add67ea1b2 in use. Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f7ff362-1d63-406a-ab04-ae83fb377dcc'] Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 11669366-4dc6-482e-be48-69add67ea1b2 in use. Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f7ff362-1d63-406a-ab04-ae83fb377dcc'] Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 11669366-4dc6-482e-be48-69add67ea1b2 in use. Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f7ff362-1d63-406a-ab04-ae83fb377dcc'] Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 11669366-4dc6-482e-be48-69add67ea1b2 in use. Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f7ff362-1d63-406a-ab04-ae83fb377dcc'] Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a068aa84-a275-4794-be2f-f19e7f80c44b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 400 to user: Security Group 11669366-4dc6-482e-be48-69add67ea1b2 in use. Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-1f7ff362-1d63-406a-ab04-ae83fb377dcc'] {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:22.452091 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a068aa84-a275-4794-be2f-f19e7f80c44b tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/11669366-4dc6-482e-be48-69add67ea1b2" status: 400 len: 185 microversion: 2.1 time: 0.647040 Aug 02 06:53:22.455603 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 900/1890] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:53:21 2022] DELETE /compute/v2.1/os-security-groups/11669366-4dc6-482e-be48-69add67ea1b2 => generated 185 bytes in 652 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:53:22.465197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0f0c03c2-7c4f-449f-9bc7-c8e2c8d83a09 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:22.465701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0f0c03c2-7c4f-449f-9bc7-c8e2c8d83a09 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: 6e35b665-80f8-4add-8c4f-edeb762a78fa] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:22.484001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f0c03c2-7c4f-449f-9bc7-c8e2c8d83a09 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:22.484445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f0c03c2-7c4f-449f-9bc7-c8e2c8d83a09 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:22.485264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f0c03c2-7c4f-449f-9bc7-c8e2c8d83a09 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:22.485695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f0c03c2-7c4f-449f-9bc7-c8e2c8d83a09 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:22.547355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0f0c03c2-7c4f-449f-9bc7-c8e2c8d83a09 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: 6e35b665-80f8-4add-8c4f-edeb762a78fa] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:53:22.743351 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0f0c03c2-7c4f-449f-9bc7-c8e2c8d83a09 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa" status: 204 len: 0 microversion: 2.1 time: 0.289223 Aug 02 06:53:22.748741 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 901/1891] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:53:22 2022] DELETE /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:22.760658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0ac364bb-ad73-480d-afe1-deecff0a5cdc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:22.766060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0ac364bb-ad73-480d-afe1-deecff0a5cdc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:22.782671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ac364bb-ad73-480d-afe1-deecff0a5cdc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:22.785567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ac364bb-ad73-480d-afe1-deecff0a5cdc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:22.786589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ac364bb-ad73-480d-afe1-deecff0a5cdc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:22.787370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ac364bb-ad73-480d-afe1-deecff0a5cdc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:22.815272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-23584a1e-3436-4003-afae-75cdb6b06a7b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:22.827163 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-23584a1e-3436-4003-afae-75cdb6b06a7b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1497 microversion: 2.1 time: 0.416253 Aug 02 06:53:22.840772 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 991/1892] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:22 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1497 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:22.840772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-989736b3-86d7-47e9-86a7-dd1ed5399cc4 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:22.840772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-989736b3-86d7-47e9-86a7-dd1ed5399cc4 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:22.866547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-989736b3-86d7-47e9-86a7-dd1ed5399cc4 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:22.869131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-989736b3-86d7-47e9-86a7-dd1ed5399cc4 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:22.873306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-989736b3-86d7-47e9-86a7-dd1ed5399cc4 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:22.874396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-989736b3-86d7-47e9-86a7-dd1ed5399cc4 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:22.996714 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0ac364bb-ad73-480d-afe1-deecff0a5cdc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4/action" status: 202 len: 0 microversion: 2.1 time: 0.245914 Aug 02 06:53:22.997959 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 902/1893] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:53:22 2022] POST /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:53:23.003677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bb396149-1b82-4261-86aa-6da3fb913e56 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:23.004370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bb396149-1b82-4261-86aa-6da3fb913e56 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: 6e35b665-80f8-4add-8c4f-edeb762a78fa] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:23.020059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb396149-1b82-4261-86aa-6da3fb913e56 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:23.020502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb396149-1b82-4261-86aa-6da3fb913e56 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:23.021285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb396149-1b82-4261-86aa-6da3fb913e56 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:23.021718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb396149-1b82-4261-86aa-6da3fb913e56 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:23.086228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-989736b3-86d7-47e9-86a7-dd1ed5399cc4 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:23.101622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-989736b3-86d7-47e9-86a7-dd1ed5399cc4 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:23.103416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-989736b3-86d7-47e9-86a7-dd1ed5399cc4 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:23.104843 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-989736b3-86d7-47e9-86a7-dd1ed5399cc4 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 200 len: 1338 microversion: 2.47 time: 0.274970 Aug 02 06:53:23.106400 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 992/1894] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:22 2022] GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 1338 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:23.122985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-acad231a-91db-432c-82bd-776ba1a1953a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:23.125049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-acad231a-91db-432c-82bd-776ba1a1953a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:23.140637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-acad231a-91db-432c-82bd-776ba1a1953a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:23.141391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-acad231a-91db-432c-82bd-776ba1a1953a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:23.142853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-acad231a-91db-432c-82bd-776ba1a1953a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:23.145020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-acad231a-91db-432c-82bd-776ba1a1953a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:23.459433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bb396149-1b82-4261-86aa-6da3fb913e56 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:23.472364 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bb396149-1b82-4261-86aa-6da3fb913e56 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa" status: 200 len: 1474 microversion: 2.1 time: 0.470894 Aug 02 06:53:23.474770 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 903/1895] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:22 2022] GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa => generated 1474 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:23.485864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-960af5f7-3861-40ec-ba86-0bf76656025d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:23.486757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-960af5f7-3861-40ec-ba86-0bf76656025d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:23.502279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-960af5f7-3861-40ec-ba86-0bf76656025d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:23.503491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-960af5f7-3861-40ec-ba86-0bf76656025d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:23.504527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-960af5f7-3861-40ec-ba86-0bf76656025d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:23.507247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-960af5f7-3861-40ec-ba86-0bf76656025d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:23.538619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-acad231a-91db-432c-82bd-776ba1a1953a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:23.556082 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-acad231a-91db-432c-82bd-776ba1a1953a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1477 microversion: 2.1 time: 0.447081 Aug 02 06:53:23.558730 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 993/1896] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:23 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1477 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:23.566300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a2901e4f-76df-45c4-8583-8fc4520ff667 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:23.568076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a2901e4f-76df-45c4-8583-8fc4520ff667 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:23.592875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a2901e4f-76df-45c4-8583-8fc4520ff667 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:23.594232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a2901e4f-76df-45c4-8583-8fc4520ff667 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:23.598972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a2901e4f-76df-45c4-8583-8fc4520ff667 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:23.600518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a2901e4f-76df-45c4-8583-8fc4520ff667 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:23.772706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-960af5f7-3861-40ec-ba86-0bf76656025d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:23.786520 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-960af5f7-3861-40ec-ba86-0bf76656025d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1573 microversion: 2.1 time: 0.307930 Aug 02 06:53:23.787449 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 904/1897] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:23 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1573 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:23.851417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-69041a70-4bb1-459a-b580-f0bee2396305 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:23.852468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-69041a70-4bb1-459a-b580-f0bee2396305 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:23.866154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69041a70-4bb1-459a-b580-f0bee2396305 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:23.866979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69041a70-4bb1-459a-b580-f0bee2396305 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:23.869518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69041a70-4bb1-459a-b580-f0bee2396305 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:23.870214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69041a70-4bb1-459a-b580-f0bee2396305 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:23.897866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a2901e4f-76df-45c4-8583-8fc4520ff667 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:23.908273 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a2901e4f-76df-45c4-8583-8fc4520ff667 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1363 microversion: 2.1 time: 0.345010 Aug 02 06:53:23.912489 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 994/1898] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:23 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:24.089183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-69041a70-4bb1-459a-b580-f0bee2396305 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:24.098720 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-69041a70-4bb1-459a-b580-f0bee2396305 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1497 microversion: 2.1 time: 0.252803 Aug 02 06:53:24.099458 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 905/1899] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:23 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1497 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:53:24.137211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9407d5a2-15f0-494a-a196-53af784d3506 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:24.138084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9407d5a2-15f0-494a-a196-53af784d3506 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:24.153651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9407d5a2-15f0-494a-a196-53af784d3506 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:24.154168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9407d5a2-15f0-494a-a196-53af784d3506 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:24.155422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9407d5a2-15f0-494a-a196-53af784d3506 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:24.155886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9407d5a2-15f0-494a-a196-53af784d3506 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:24.263042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9407d5a2-15f0-494a-a196-53af784d3506 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:24.275293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9407d5a2-15f0-494a-a196-53af784d3506 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:24.277210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9407d5a2-15f0-494a-a196-53af784d3506 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:24.278642 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9407d5a2-15f0-494a-a196-53af784d3506 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 200 len: 1338 microversion: 2.47 time: 0.145822 Aug 02 06:53:24.280489 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 995/1900] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:24 2022] GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 1338 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:53:24.495270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ceebce5d-ef7c-4675-b266-974019aa38d7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:24.495890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ceebce5d-ef7c-4675-b266-974019aa38d7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: 6e35b665-80f8-4add-8c4f-edeb762a78fa] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:24.509621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ceebce5d-ef7c-4675-b266-974019aa38d7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:24.510364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ceebce5d-ef7c-4675-b266-974019aa38d7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:24.511346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ceebce5d-ef7c-4675-b266-974019aa38d7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:24.512215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ceebce5d-ef7c-4675-b266-974019aa38d7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:24.582858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-778afeb6-c545-4e99-8768-f44adcc32222 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:24.583503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-778afeb6-c545-4e99-8768-f44adcc32222 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:24.599973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-778afeb6-c545-4e99-8768-f44adcc32222 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:24.600861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-778afeb6-c545-4e99-8768-f44adcc32222 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:24.601855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-778afeb6-c545-4e99-8768-f44adcc32222 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:24.602543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-778afeb6-c545-4e99-8768-f44adcc32222 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:24.881736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ceebce5d-ef7c-4675-b266-974019aa38d7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:24.893786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-778afeb6-c545-4e99-8768-f44adcc32222 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:24.895903 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ceebce5d-ef7c-4675-b266-974019aa38d7 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa" status: 200 len: 1474 microversion: 2.1 time: 0.404806 Aug 02 06:53:24.897416 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 906/1901] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:24 2022] GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa => generated 1474 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:24.903595 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-778afeb6-c545-4e99-8768-f44adcc32222 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1477 microversion: 2.1 time: 0.325222 Aug 02 06:53:24.913939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5212b13f-bd2c-4172-ae20-41bc7fecba0e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:24.915225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5212b13f-bd2c-4172-ae20-41bc7fecba0e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:24.917799 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 996/1902] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:24 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1477 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:53:24.932697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5212b13f-bd2c-4172-ae20-41bc7fecba0e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:24.933639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5212b13f-bd2c-4172-ae20-41bc7fecba0e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:24.936132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5212b13f-bd2c-4172-ae20-41bc7fecba0e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:24.936696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5212b13f-bd2c-4172-ae20-41bc7fecba0e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:24.937097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-598d56d2-4657-4cd1-b32f-91d2acf20ab4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:24.937792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-598d56d2-4657-4cd1-b32f-91d2acf20ab4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:24.947126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-598d56d2-4657-4cd1-b32f-91d2acf20ab4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:24.947587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-598d56d2-4657-4cd1-b32f-91d2acf20ab4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:24.949321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-598d56d2-4657-4cd1-b32f-91d2acf20ab4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:24.954995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-598d56d2-4657-4cd1-b32f-91d2acf20ab4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:25.196413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-598d56d2-4657-4cd1-b32f-91d2acf20ab4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:25.206492 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-598d56d2-4657-4cd1-b32f-91d2acf20ab4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1363 microversion: 2.1 time: 0.275577 Aug 02 06:53:25.207460 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 997/1903] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:24 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:25.215309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-365c9ece-e967-4452-9e96-78fa91909405 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:25.215309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-365c9ece-e967-4452-9e96-78fa91909405 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:25.222421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-365c9ece-e967-4452-9e96-78fa91909405 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:25.222421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-365c9ece-e967-4452-9e96-78fa91909405 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:25.222421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-365c9ece-e967-4452-9e96-78fa91909405 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:25.222421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-365c9ece-e967-4452-9e96-78fa91909405 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:25.281190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5212b13f-bd2c-4172-ae20-41bc7fecba0e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:25.293226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:25.301466 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5212b13f-bd2c-4172-ae20-41bc7fecba0e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1573 microversion: 2.1 time: 0.402508 Aug 02 06:53:25.314471 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 907/1904] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:24 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1573 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:25.328311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f9a51f04-cc55-41b3-a1c1-efd2c119ed05 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:25.329460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f9a51f04-cc55-41b3-a1c1-efd2c119ed05 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:25.343504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9a51f04-cc55-41b3-a1c1-efd2c119ed05 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:25.344217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9a51f04-cc55-41b3-a1c1-efd2c119ed05 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:25.345187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9a51f04-cc55-41b3-a1c1-efd2c119ed05 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:25.345978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9a51f04-cc55-41b3-a1c1-efd2c119ed05 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:25.570774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f9a51f04-cc55-41b3-a1c1-efd2c119ed05 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:25.596605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f9a51f04-cc55-41b3-a1c1-efd2c119ed05 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:25.599430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f9a51f04-cc55-41b3-a1c1-efd2c119ed05 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:25.600660 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f9a51f04-cc55-41b3-a1c1-efd2c119ed05 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 200 len: 1338 microversion: 2.47 time: 0.284854 Aug 02 06:53:25.605953 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 908/1905] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:25 2022] GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 1338 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:25.697464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-365c9ece-e967-4452-9e96-78fa91909405 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:25.713593 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-365c9ece-e967-4452-9e96-78fa91909405 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1497 microversion: 2.1 time: 0.504954 Aug 02 06:53:25.727686 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 998/1906] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:25 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1497 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:25.787154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-00c5ef6e-5f0d-4b3b-99ca-10650d870ac4 req-1de76a9b-2250-4f9c-b4b9-07dbac4ee409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e35b665-80f8-4add-8c4f-edeb762a78fa", "name": "network-vif-deleted", "tag": "97677ae9-daf0-4a17-a2c1-087df4aa5df7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:25.802293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-00c5ef6e-5f0d-4b3b-99ca-10650d870ac4 req-1de76a9b-2250-4f9c-b4b9-07dbac4ee409 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:25.803407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-00c5ef6e-5f0d-4b3b-99ca-10650d870ac4 req-1de76a9b-2250-4f9c-b4b9-07dbac4ee409 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:25.819983 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-00c5ef6e-5f0d-4b3b-99ca-10650d870ac4 req-1de76a9b-2250-4f9c-b4b9-07dbac4ee409 service nova] Creating event network-vif-deleted:97677ae9-daf0-4a17-a2c1-087df4aa5df7 for instance 6e35b665-80f8-4add-8c4f-edeb762a78fa on n-h2-851337-3 Aug 02 06:53:25.827505 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-00c5ef6e-5f0d-4b3b-99ca-10650d870ac4 req-1de76a9b-2250-4f9c-b4b9-07dbac4ee409 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043899 Aug 02 06:53:25.829291 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 909/1907] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:53:25.925033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d49f374d-5bd2-45ce-a68c-379e79316470 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:25.925866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d49f374d-5bd2-45ce-a68c-379e79316470 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: 6e35b665-80f8-4add-8c4f-edeb762a78fa] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:25.927402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cc8f66d0-2d1d-4816-a312-b5017aea008f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:25.928278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cc8f66d0-2d1d-4816-a312-b5017aea008f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:25.939235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc8f66d0-2d1d-4816-a312-b5017aea008f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:25.940355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc8f66d0-2d1d-4816-a312-b5017aea008f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:25.940673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d49f374d-5bd2-45ce-a68c-379e79316470 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:25.941216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d49f374d-5bd2-45ce-a68c-379e79316470 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:25.942491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d49f374d-5bd2-45ce-a68c-379e79316470 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:25.943716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc8f66d0-2d1d-4816-a312-b5017aea008f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:25.944125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d49f374d-5bd2-45ce-a68c-379e79316470 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:25.944271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc8f66d0-2d1d-4816-a312-b5017aea008f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:26.025688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d49f374d-5bd2-45ce-a68c-379e79316470 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:26.026259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d49f374d-5bd2-45ce-a68c-379e79316470 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:26.027659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-d49f374d-5bd2-45ce-a68c-379e79316470 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lazy-loading 'fault' on Instance uuid 6e35b665-80f8-4add-8c4f-edeb762a78fa {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:53:26.196058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d49f374d-5bd2-45ce-a68c-379e79316470 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857b54177bd4b9b9128a28d93ab6610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae511cbb16247e1aa14cfe1c0d285bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:26.204092 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d49f374d-5bd2-45ce-a68c-379e79316470 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa" status: 200 len: 1308 microversion: 2.1 time: 0.286957 Aug 02 06:53:26.206928 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 999/1908] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:25 2022] GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa => generated 1308 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:26.214409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7c0ba319-2b3a-4a5b-aa0a-75ce49cb98d2 req-c9f8a3e9-45c1-4557-8c8e-02dc58c5896e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b07c5d-4324-4221-a77d-203f65ad3b04", "name": "network-vif-plugged", "status": "completed", "tag": "b40c75bb-1839-4d4f-98e5-444d01355d6a"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:26.226292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7c0ba319-2b3a-4a5b-aa0a-75ce49cb98d2 req-c9f8a3e9-45c1-4557-8c8e-02dc58c5896e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:26.237326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7c0ba319-2b3a-4a5b-aa0a-75ce49cb98d2 req-c9f8a3e9-45c1-4557-8c8e-02dc58c5896e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:26.256294 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7c0ba319-2b3a-4a5b-aa0a-75ce49cb98d2 req-c9f8a3e9-45c1-4557-8c8e-02dc58c5896e service nova] Creating event network-vif-plugged:b40c75bb-1839-4d4f-98e5-444d01355d6a for instance f8b07c5d-4324-4221-a77d-203f65ad3b04 on n-h1-851337-3 Aug 02 06:53:26.268811 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7c0ba319-2b3a-4a5b-aa0a-75ce49cb98d2 req-c9f8a3e9-45c1-4557-8c8e-02dc58c5896e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060084 Aug 02 06:53:26.276506 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1000/1909] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:26.291534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c6583d8-f614-46e9-95d4-a39b45155372 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:26.292762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9c6583d8-f614-46e9-95d4-a39b45155372 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:26.313776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c6583d8-f614-46e9-95d4-a39b45155372 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:26.314902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c6583d8-f614-46e9-95d4-a39b45155372 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:26.317115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c6583d8-f614-46e9-95d4-a39b45155372 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:26.317772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c6583d8-f614-46e9-95d4-a39b45155372 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:26.385970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cc8f66d0-2d1d-4816-a312-b5017aea008f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:26.395629 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cc8f66d0-2d1d-4816-a312-b5017aea008f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1477 microversion: 2.1 time: 0.474550 Aug 02 06:53:26.402814 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 910/1910] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:25 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1477 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:26.412162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-403ba526-5e5f-448e-afbd-37ad32a2edfb tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:26.413260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-403ba526-5e5f-448e-afbd-37ad32a2edfb tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:26.426157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-403ba526-5e5f-448e-afbd-37ad32a2edfb tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:26.427343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-403ba526-5e5f-448e-afbd-37ad32a2edfb tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:26.428378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-403ba526-5e5f-448e-afbd-37ad32a2edfb tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:26.429013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-403ba526-5e5f-448e-afbd-37ad32a2edfb tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:26.670716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9c6583d8-f614-46e9-95d4-a39b45155372 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:26.683101 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9c6583d8-f614-46e9-95d4-a39b45155372 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1363 microversion: 2.1 time: 0.402445 Aug 02 06:53:26.698930 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1001/1911] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:26 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1363 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:26.705658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-28549788-95df-488b-ad62-9355b89d1b5a tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:26.707792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-28549788-95df-488b-ad62-9355b89d1b5a tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:26.716539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28549788-95df-488b-ad62-9355b89d1b5a tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:26.717225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28549788-95df-488b-ad62-9355b89d1b5a tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:26.718916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28549788-95df-488b-ad62-9355b89d1b5a tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:26.719548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28549788-95df-488b-ad62-9355b89d1b5a tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:26.839219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-403ba526-5e5f-448e-afbd-37ad32a2edfb tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:26.866695 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-403ba526-5e5f-448e-afbd-37ad32a2edfb tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1573 microversion: 2.1 time: 0.458243 Aug 02 06:53:26.880391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-28549788-95df-488b-ad62-9355b89d1b5a tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:26.880626 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 911/1912] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:26 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1573 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:26.880626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0dcba4e5-1edf-4cca-9496-8e6346810f8a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:26.880626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0dcba4e5-1edf-4cca-9496-8e6346810f8a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:26.899787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-28549788-95df-488b-ad62-9355b89d1b5a tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:26.907130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-28549788-95df-488b-ad62-9355b89d1b5a tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:26.908122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0dcba4e5-1edf-4cca-9496-8e6346810f8a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:26.909978 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-28549788-95df-488b-ad62-9355b89d1b5a tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 200 len: 1338 microversion: 2.47 time: 0.209137 Aug 02 06:53:26.910621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0dcba4e5-1edf-4cca-9496-8e6346810f8a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:26.936073 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1002/1913] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:26 2022] GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 1338 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:26.937712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0dcba4e5-1edf-4cca-9496-8e6346810f8a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:26.938508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0dcba4e5-1edf-4cca-9496-8e6346810f8a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:27.229838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4158834d-bf34-442d-8324-33df40ee8a31 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:27.230538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4158834d-bf34-442d-8324-33df40ee8a31 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] [instance: 6e35b665-80f8-4add-8c4f-edeb762a78fa] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:27.246489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4158834d-bf34-442d-8324-33df40ee8a31 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:27.247449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4158834d-bf34-442d-8324-33df40ee8a31 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:27.248944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4158834d-bf34-442d-8324-33df40ee8a31 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:27.250993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4158834d-bf34-442d-8324-33df40ee8a31 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:27.270633 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-4158834d-bf34-442d-8324-33df40ee8a31 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] HTTP exception thrown: Instance 6e35b665-80f8-4add-8c4f-edeb762a78fa could not be found. Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4158834d-bf34-442d-8324-33df40ee8a31 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Request method failure captured: Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa HTTP/1.1 Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MlfJJSI5-_3FCNCnbPOmLzJi3UpZSYYZdsnQgMUp0hSwKHRfTGFEZQ7jfb1DGcja_NZrpC3_Q6npB4U-dJyT8SoPHp6ENdtAly24M19CmO8cLnVohjMlOLOY7iTnKDAtWN7Ki_3qieeyO14NW3S77YItYFyf0VbdgjJVKFXDiETqNE Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: aae511cbb16247e1aa14cfe1c0d285bd Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ListImageFiltersTestJSON-234054173 Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/aae511cbb16247e1aa14cfe1c0d285bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aae511cbb16247e1aa14cfe1c0d285bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_aae511cbb16247e1aa14cfe1c0d285bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aae511cbb16247e1aa14cfe1c0d285bd"}]}] Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ListImageFiltersTestJSON-234054173 Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: aae511cbb16247e1aa14cfe1c0d285bd Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-234054173 Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ListImageFiltersTestJSON-234054173-project Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b857b54177bd4b9b9128a28d93ab6610 Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ListImageFiltersTestJSON-234054173-project Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 6e35b665-80f8-4add-8c4f-edeb762a78fa could not be found. Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '6e35b665-80f8-4add-8c4f-edeb762a78fa'} Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e35b665-80f8-4add-8c4f-edeb762a78fa could not be found. Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e35b665-80f8-4add-8c4f-edeb762a78fa could not be found. Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:27.272879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:27.278517 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:27.278517 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:27.278517 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:27.278517 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:27.278517 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:27.278517 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e35b665-80f8-4add-8c4f-edeb762a78fa could not be found. Aug 02 06:53:27.278517 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:27.279895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4158834d-bf34-442d-8324-33df40ee8a31 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Returning 404 to user: Instance 6e35b665-80f8-4add-8c4f-edeb762a78fa could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:27.280949 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4158834d-bf34-442d-8324-33df40ee8a31 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa" status: 404 len: 111 microversion: 2.1 time: 0.055717 Aug 02 06:53:27.282178 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1003/1914] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:27 2022] GET /compute/v2.1/servers/6e35b665-80f8-4add-8c4f-edeb762a78fa => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:53:27.291511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-308bff3d-8293-4d74-a94a-48bc9e1d992d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927a8808b0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:27.366371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0dcba4e5-1edf-4cca-9496-8e6346810f8a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:27.379364 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0dcba4e5-1edf-4cca-9496-8e6346810f8a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1497 microversion: 2.1 time: 0.506592 Aug 02 06:53:27.382029 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 912/1915] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:26 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1497 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:27.428868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ece8974d-1f6b-4ad4-96b3-77ede34d2abd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:27.430318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ece8974d-1f6b-4ad4-96b3-77ede34d2abd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:27.446535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ece8974d-1f6b-4ad4-96b3-77ede34d2abd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:27.447087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ece8974d-1f6b-4ad4-96b3-77ede34d2abd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:27.448344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ece8974d-1f6b-4ad4-96b3-77ede34d2abd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:27.448986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ece8974d-1f6b-4ad4-96b3-77ede34d2abd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:27.612140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ece8974d-1f6b-4ad4-96b3-77ede34d2abd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:27.623370 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ece8974d-1f6b-4ad4-96b3-77ede34d2abd tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1477 microversion: 2.1 time: 0.199817 Aug 02 06:53:27.625556 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 913/1916] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:27 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1477 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:53:27.705475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b4b7a36f-b4ae-457a-ad62-f25ef247814e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:27.706366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b4b7a36f-b4ae-457a-ad62-f25ef247814e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:27.716067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4b7a36f-b4ae-457a-ad62-f25ef247814e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:27.717459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4b7a36f-b4ae-457a-ad62-f25ef247814e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:27.718632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4b7a36f-b4ae-457a-ad62-f25ef247814e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:27.719754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4b7a36f-b4ae-457a-ad62-f25ef247814e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:27.904279 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-308bff3d-8293-4d74-a94a-48bc9e1d992d tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "DELETE /compute/v2.1/images/374cb39f-aed6-455a-a979-e34f73a15880" status: 204 len: 0 microversion: 2.1 time: 0.618140 Aug 02 06:53:27.905415 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1004/1917] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:27 2022] DELETE /compute/v2.1/images/374cb39f-aed6-455a-a979-e34f73a15880 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:27.911718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5403c7d2-102c-4071-8b6c-0edd87f7fdb0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:27.912544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5403c7d2-102c-4071-8b6c-0edd87f7fdb0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:27.934583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5403c7d2-102c-4071-8b6c-0edd87f7fdb0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:27.935267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5403c7d2-102c-4071-8b6c-0edd87f7fdb0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:27.936371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5403c7d2-102c-4071-8b6c-0edd87f7fdb0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:27.936829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5403c7d2-102c-4071-8b6c-0edd87f7fdb0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:27.955317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b4b7a36f-b4ae-457a-ad62-f25ef247814e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:27.964137 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b4b7a36f-b4ae-457a-ad62-f25ef247814e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1363 microversion: 2.1 time: 0.263106 Aug 02 06:53:27.965387 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 914/1918] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:27 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:27.970408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2987d3fd-9770-4af0-bea3-68a22f446aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927af2b4c0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:28.201207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5403c7d2-102c-4071-8b6c-0edd87f7fdb0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:28.213849 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5403c7d2-102c-4071-8b6c-0edd87f7fdb0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1573 microversion: 2.1 time: 0.307106 Aug 02 06:53:28.215739 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1005/1919] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:27 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1573 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:28.229317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0ec40c5d-3cda-41f2-9daa-994fef0b7682 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:28.232767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0ec40c5d-3cda-41f2-9daa-994fef0b7682 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:28.261353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ec40c5d-3cda-41f2-9daa-994fef0b7682 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:28.262946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ec40c5d-3cda-41f2-9daa-994fef0b7682 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:28.265555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ec40c5d-3cda-41f2-9daa-994fef0b7682 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:28.268163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ec40c5d-3cda-41f2-9daa-994fef0b7682 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:28.339731 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2987d3fd-9770-4af0-bea3-68a22f446aeb tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "DELETE /compute/v2.1/images/caba34ca-707a-4fe1-9524-43057886e856" status: 204 len: 0 microversion: 2.1 time: 0.372884 Aug 02 06:53:28.341821 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 915/1920] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:27 2022] DELETE /compute/v2.1/images/caba34ca-707a-4fe1-9524-43057886e856 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:28.353153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-24651d87-2e67-4118-ab22-48ab065d54d1 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] Calling method '.version_select at 0x7f927ac53ee0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:28.414583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0ec40c5d-3cda-41f2-9daa-994fef0b7682 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:28.431128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0ec40c5d-3cda-41f2-9daa-994fef0b7682 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:28.438957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0ec40c5d-3cda-41f2-9daa-994fef0b7682 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:28.447641 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0ec40c5d-3cda-41f2-9daa-994fef0b7682 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 200 len: 1359 microversion: 2.47 time: 0.229045 Aug 02 06:53:28.453176 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1006/1921] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:28 2022] GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:28.461704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3a87d50e-2888-4898-a399-7713a975692d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:28.465702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3a87d50e-2888-4898-a399-7713a975692d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:28.478174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a87d50e-2888-4898-a399-7713a975692d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:28.482750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a87d50e-2888-4898-a399-7713a975692d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:28.500803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a87d50e-2888-4898-a399-7713a975692d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:28.503310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a87d50e-2888-4898-a399-7713a975692d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:28.740131 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-24651d87-2e67-4118-ab22-48ab065d54d1 tempest-ListImageFiltersTestJSON-234054173 tempest-ListImageFiltersTestJSON-234054173-project] 10.222.0.79 "DELETE /compute/v2.1/images/55d088dd-5057-45c8-b81c-3a1fd76bfa04" status: 204 len: 0 microversion: 2.1 time: 0.393384 Aug 02 06:53:28.740696 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 916/1922] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:28 2022] DELETE /compute/v2.1/images/55d088dd-5057-45c8-b81c-3a1fd76bfa04 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:28.752302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-716761232", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "461d41af-4090-482c-92f8-bb83b1dbcf1e"}, {"uuid": "466b3e74-ab18-4c99-9820-07f06ff2e47f"}, {"uuid": "461d41af-4090-482c-92f8-bb83b1dbcf1e"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:28.816238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3a87d50e-2888-4898-a399-7713a975692d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:28.827710 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3a87d50e-2888-4898-a399-7713a975692d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1497 microversion: 2.1 time: 0.373008 Aug 02 06:53:28.828301 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1007/1923] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:28 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1497 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:28.836581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f935b9dd-dd4f-4b25-a906-5da05eb5ec96 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1227558672"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:28.839274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f935b9dd-dd4f-4b25-a906-5da05eb5ec96 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:28.843964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] validate_networks() for [('461d41af-4090-482c-92f8-bb83b1dbcf1e', None, None, None, None, None), ('466b3e74-ab18-4c99-9820-07f06ff2e47f', None, None, None, None, None), ('461d41af-4090-482c-92f8-bb83b1dbcf1e', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:53:28.845777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f935b9dd-dd4f-4b25-a906-5da05eb5ec96 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:28.846408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f935b9dd-dd4f-4b25-a906-5da05eb5ec96 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:28.847205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f935b9dd-dd4f-4b25-a906-5da05eb5ec96 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:28.847637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f935b9dd-dd4f-4b25-a906-5da05eb5ec96 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:28.880024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:29.357320 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f935b9dd-dd4f-4b25-a906-5da05eb5ec96 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "POST /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b/action" status: 202 len: 52 microversion: 2.47 time: 0.524384 Aug 02 06:53:29.370496 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1008/1924] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Aug 2 06:53:28 2022] POST /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b/action => generated 52 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 02 06:53:29.401180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1e913c12-b756-49e9-9d8d-cec1831be99a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:29.401180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1e913c12-b756-49e9-9d8d-cec1831be99a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:29.425758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e913c12-b756-49e9-9d8d-cec1831be99a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:29.426520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e913c12-b756-49e9-9d8d-cec1831be99a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:29.427351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e913c12-b756-49e9-9d8d-cec1831be99a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:29.427787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e913c12-b756-49e9-9d8d-cec1831be99a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:29.979283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:30.008605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=52 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:30.685357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1e913c12-b756-49e9-9d8d-cec1831be99a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:30.695204 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1e913c12-b756-49e9-9d8d-cec1831be99a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1477 microversion: 2.1 time: 1.322536 Aug 02 06:53:30.698998 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1009/1925] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:29 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1477 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:30.706773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8453d955-16e0-46a6-ae8c-a65f5bd98ed9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:30.710843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8453d955-16e0-46a6-ae8c-a65f5bd98ed9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:30.732634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8453d955-16e0-46a6-ae8c-a65f5bd98ed9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:30.733909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8453d955-16e0-46a6-ae8c-a65f5bd98ed9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:30.738376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8453d955-16e0-46a6-ae8c-a65f5bd98ed9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:30.739256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8453d955-16e0-46a6-ae8c-a65f5bd98ed9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:31.334601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8453d955-16e0-46a6-ae8c-a65f5bd98ed9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:31.348184 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8453d955-16e0-46a6-ae8c-a65f5bd98ed9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1550 microversion: 2.1 time: 0.645808 Aug 02 06:53:31.349340 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1010/1926] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:30 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1550 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:31.368244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1977fd8b-c6c0-4041-b417-1810d963b100 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:31.368866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1977fd8b-c6c0-4041-b417-1810d963b100 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:31.392107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1977fd8b-c6c0-4041-b417-1810d963b100 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:31.392387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1977fd8b-c6c0-4041-b417-1810d963b100 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:31.393184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1977fd8b-c6c0-4041-b417-1810d963b100 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:31.393612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1977fd8b-c6c0-4041-b417-1810d963b100 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:32.142010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1977fd8b-c6c0-4041-b417-1810d963b100 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:32.156473 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1977fd8b-c6c0-4041-b417-1810d963b100 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1573 microversion: 2.1 time: 0.792363 Aug 02 06:53:32.157192 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1011/1927] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:31 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1573 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:32.170017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c5b22f1-7882-4cf7-a482-68cb62e368bd tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:32.171209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1c5b22f1-7882-4cf7-a482-68cb62e368bd tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:32.180420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c5b22f1-7882-4cf7-a482-68cb62e368bd tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:32.180420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c5b22f1-7882-4cf7-a482-68cb62e368bd tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:32.180420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c5b22f1-7882-4cf7-a482-68cb62e368bd tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:32.180420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c5b22f1-7882-4cf7-a482-68cb62e368bd tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:32.226079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1c5b22f1-7882-4cf7-a482-68cb62e368bd tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:53:32.362144 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1c5b22f1-7882-4cf7-a482-68cb62e368bd tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "DELETE /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 204 len: 0 microversion: 2.47 time: 0.202613 Aug 02 06:53:32.366292 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1012/1928] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:53:32 2022] DELETE /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 06:53:32.366469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:53:32.366469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:53:32.368533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:53:32.368533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:53:32.368533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:53:32.378099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-639045c6-6f9c-4f8c-b51d-4b023f0039cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:32.396046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-639045c6-6f9c-4f8c-b51d-4b023f0039cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:32.407262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:32.408004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:32.424425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-639045c6-6f9c-4f8c-b51d-4b023f0039cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:32.424660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:32.424660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:32.426133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-639045c6-6f9c-4f8c-b51d-4b023f0039cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:32.427060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-639045c6-6f9c-4f8c-b51d-4b023f0039cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:32.429849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-639045c6-6f9c-4f8c-b51d-4b023f0039cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:32.483134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Getting quotas for project 76c70f1ab140418e813917aa08d23033. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:53:32.505256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Getting quotas for user a4d6484337c84897813ab767ad7d058b and project 76c70f1ab140418e813917aa08d23033. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:53:32.546713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:53:32.551262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:53:32.668627 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-564a54f5-3678-4552-bd02-435090e96974 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.926478 Aug 02 06:53:32.678859 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 917/1929] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:53:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:53:32.694172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0b019415-33b0-4b57-9e5e-7481142b59e0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:32.694974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0b019415-33b0-4b57-9e5e-7481142b59e0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:32.713212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b019415-33b0-4b57-9e5e-7481142b59e0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:32.713647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b019415-33b0-4b57-9e5e-7481142b59e0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:32.717000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b019415-33b0-4b57-9e5e-7481142b59e0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:32.717260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b019415-33b0-4b57-9e5e-7481142b59e0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:32.894166 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0b019415-33b0-4b57-9e5e-7481142b59e0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.211326 Aug 02 06:53:32.902021 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 918/1930] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 06:53:32 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/os-interface => generated 285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:33.162406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2a5e47ab-68c9-4f56-968b-c6a4aca6e2e6 tempest-ListImagesTestJSON-399939601 tempest-ListImagesTestJSON-399939601-project] Calling method '.version_select at 0x7f927ac53c10>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:33.198632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-639045c6-6f9c-4f8c-b51d-4b023f0039cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:33.208507 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-639045c6-6f9c-4f8c-b51d-4b023f0039cc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1497 microversion: 2.1 time: 0.842223 Aug 02 06:53:33.209375 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1013/1931] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:32 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1497 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:33.216416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-48f7d618-6ea9-481d-ab8b-a8e18708228f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:33.217297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-48f7d618-6ea9-481d-ab8b-a8e18708228f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:33.219656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:33.230331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48f7d618-6ea9-481d-ab8b-a8e18708228f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:33.230843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48f7d618-6ea9-481d-ab8b-a8e18708228f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:33.231878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48f7d618-6ea9-481d-ab8b-a8e18708228f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:33.232858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48f7d618-6ea9-481d-ab8b-a8e18708228f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:33.283586 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2a5e47ab-68c9-4f56-968b-c6a4aca6e2e6 tempest-ListImagesTestJSON-399939601 tempest-ListImagesTestJSON-399939601-project] 10.222.0.79 "GET /compute/v2.1/images/fbc11386-7cb6-4309-932b-7acee00d4676" status: 200 len: 784 microversion: 2.1 time: 0.380212 Aug 02 06:53:33.293407 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 919/1932] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:32 2022] GET /compute/v2.1/images/fbc11386-7cb6-4309-932b-7acee00d4676 => generated 784 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:33.293407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-767951319", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d2cb6aa5-9974-46cb-9343-692a25f49887"}], "block_device_mapping_v2": [{"uuid": "1e832466-a63f-4cca-83e1-988ed8970a42", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:33.414495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-48f7d618-6ea9-481d-ab8b-a8e18708228f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:33.417610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] validate_networks() for [('d2cb6aa5-9974-46cb-9343-692a25f49887', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:53:33.423717 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-48f7d618-6ea9-481d-ab8b-a8e18708228f tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1476 microversion: 2.1 time: 0.212945 Aug 02 06:53:33.428443 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1014/1933] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:33 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:33.444185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-0f2d4e78-188c-42d5-8522-053a26c82207 req-76b3f2d6-4bee-45ed-b449-7281ba93abb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303b535b-cea0-4219-ad1b-3849b9042a53", "name": "network-vif-unplugged", "status": "completed", "tag": "78a224c6-e169-4c15-906f-64fc36ce7044"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:33.478171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0f2d4e78-188c-42d5-8522-053a26c82207 req-76b3f2d6-4bee-45ed-b449-7281ba93abb3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:33.478978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0f2d4e78-188c-42d5-8522-053a26c82207 req-76b3f2d6-4bee-45ed-b449-7281ba93abb3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:33.492445 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-0f2d4e78-188c-42d5-8522-053a26c82207 req-76b3f2d6-4bee-45ed-b449-7281ba93abb3 service nova] Creating event network-vif-unplugged:78a224c6-e169-4c15-906f-64fc36ce7044 for instance 303b535b-cea0-4219-ad1b-3849b9042a53 on n-h1-851337-3 Aug 02 06:53:33.501188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-0f2d4e78-188c-42d5-8522-053a26c82207 req-76b3f2d6-4bee-45ed-b449-7281ba93abb3 service nova] Instance 303b535b-cea0-4219-ad1b-3849b9042a53 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 06:53:33.521139 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-0f2d4e78-188c-42d5-8522-053a26c82207 req-76b3f2d6-4bee-45ed-b449-7281ba93abb3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091159 Aug 02 06:53:33.522512 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1015/1934] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:33.529835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4baff9f8-7016-4b86-b501-a708e61ef6c6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:33.531020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4baff9f8-7016-4b86-b501-a708e61ef6c6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:33.539602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4baff9f8-7016-4b86-b501-a708e61ef6c6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:33.540304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4baff9f8-7016-4b86-b501-a708e61ef6c6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:33.541680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4baff9f8-7016-4b86-b501-a708e61ef6c6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:33.542318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4baff9f8-7016-4b86-b501-a708e61ef6c6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:33.694074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4baff9f8-7016-4b86-b501-a708e61ef6c6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:33.711100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4baff9f8-7016-4b86-b501-a708e61ef6c6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:33.712891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4baff9f8-7016-4b86-b501-a708e61ef6c6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:33.714275 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4baff9f8-7016-4b86-b501-a708e61ef6c6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 200 len: 1365 microversion: 2.47 time: 0.190076 Aug 02 06:53:33.715359 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1016/1935] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:33 2022] GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:33.720123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2c5c5fd3-aafd-47d8-8d8c-3f04354916bc tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:33.730837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2c5c5fd3-aafd-47d8-8d8c-3f04354916bc tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:33.742748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c5c5fd3-aafd-47d8-8d8c-3f04354916bc tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:33.743193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c5c5fd3-aafd-47d8-8d8c-3f04354916bc tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:33.743979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c5c5fd3-aafd-47d8-8d8c-3f04354916bc tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:33.744453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c5c5fd3-aafd-47d8-8d8c-3f04354916bc tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:33.871321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2c5c5fd3-aafd-47d8-8d8c-3f04354916bc tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:33.888213 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2c5c5fd3-aafd-47d8-8d8c-3f04354916bc tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1208 microversion: 2.1 time: 0.171480 Aug 02 06:53:33.899369 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1017/1936] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:33 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1208 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:33.905608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c11e998-13f5-4345-a4d7-0f88cdb2c14d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:33.906618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1c11e998-13f5-4345-a4d7-0f88cdb2c14d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:33.913818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c11e998-13f5-4345-a4d7-0f88cdb2c14d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:33.914661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c11e998-13f5-4345-a4d7-0f88cdb2c14d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:33.915541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c11e998-13f5-4345-a4d7-0f88cdb2c14d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:33.916072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c11e998-13f5-4345-a4d7-0f88cdb2c14d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:34.110845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:53:34.111462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:53:34.111940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:53:34.112394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:53:34.112811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:53:34.114976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:34.126741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:34.127873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:34.129113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:34.130436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:34.152680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1c11e998-13f5-4345-a4d7-0f88cdb2c14d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:34.156672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Getting quotas for project 28c28ea506a34625bf388395b06b67f5. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:53:34.161030 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1c11e998-13f5-4345-a4d7-0f88cdb2c14d tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1571 microversion: 2.1 time: 0.260139 Aug 02 06:53:34.173926 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1018/1937] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:33 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1571 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:34.173926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-48386e4f-413b-49b5-b7f7-02380b49a7cc tempest-ListImagesTestJSON-399939601 tempest-ListImagesTestJSON-399939601-project] Calling method '.version_select at 0x7f927b0cf670>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:34.183320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Getting quotas for user a53fed20dabb4e45895da813d4c6538c and project 28c28ea506a34625bf388395b06b67f5. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:53:34.256133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:53:34.257881 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-48386e4f-413b-49b5-b7f7-02380b49a7cc tempest-ListImagesTestJSON-399939601 tempest-ListImagesTestJSON-399939601-project] 10.222.0.79 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.092921 Aug 02 06:53:34.259031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e832466-a63f-4cca-83e1-988ed8970a42',volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:53:34.259321 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1019/1938] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 2 06:53:34 2022] GET /compute/v2.1/images => generated 445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:34.273299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4e2c3b42-152e-4a91-b8dc-d96b035f8dba tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1643366490"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:34.273847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4e2c3b42-152e-4a91-b8dc-d96b035f8dba tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:34.280984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e2c3b42-152e-4a91-b8dc-d96b035f8dba tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:34.281423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e2c3b42-152e-4a91-b8dc-d96b035f8dba tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:34.283625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e2c3b42-152e-4a91-b8dc-d96b035f8dba tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:34.284430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e2c3b42-152e-4a91-b8dc-d96b035f8dba tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:34.429338 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.network.security_group_api [None req-4e2c3b42-152e-4a91-b8dc-d96b035f8dba tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Adding security group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 to port 037cd849-dce0-499f-9464-cf45471f908a Aug 02 06:53:34.429512 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-04f627fb-606c-49d6-80bb-2e394a3975c6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.143466 Aug 02 06:53:34.432101 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 920/1939] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 06:53:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 06:53:34.448678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-250e411b-7ba5-4e41-989b-8a0ab23e5dda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:34.450082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-250e411b-7ba5-4e41-989b-8a0ab23e5dda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:34.459733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-250e411b-7ba5-4e41-989b-8a0ab23e5dda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:34.460998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-250e411b-7ba5-4e41-989b-8a0ab23e5dda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:34.462136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-250e411b-7ba5-4e41-989b-8a0ab23e5dda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:34.463772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-250e411b-7ba5-4e41-989b-8a0ab23e5dda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:34.837533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-250e411b-7ba5-4e41-989b-8a0ab23e5dda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:34.883201 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-250e411b-7ba5-4e41-989b-8a0ab23e5dda tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1497 microversion: 2.1 time: 0.448151 Aug 02 06:53:34.884116 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 921/1940] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:34 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1497 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:34.900062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c17d8f2d-1472-4890-a592-e0883897970b tempest-ListImagesTestJSON-399939601 tempest-ListImagesTestJSON-399939601-project] Calling method '.version_select at 0x7f927ab648b0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:34.957963 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c17d8f2d-1472-4890-a592-e0883897970b tempest-ListImagesTestJSON-399939601 tempest-ListImagesTestJSON-399939601-project] 10.222.0.79 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.069839 Aug 02 06:53:34.958719 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 922/1941] 10.222.0.79 () {58 vars in 1143 bytes} [Tue Aug 2 06:53:34 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:34.963460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6a8bf62d-c47c-4d68-b974-57c2e6df9e24 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:34.964066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6a8bf62d-c47c-4d68-b974-57c2e6df9e24 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:34.973123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a8bf62d-c47c-4d68-b974-57c2e6df9e24 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:34.973584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a8bf62d-c47c-4d68-b974-57c2e6df9e24 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:34.975146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a8bf62d-c47c-4d68-b974-57c2e6df9e24 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:34.975589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a8bf62d-c47c-4d68-b974-57c2e6df9e24 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:35.101626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6a8bf62d-c47c-4d68-b974-57c2e6df9e24 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:35.117432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6a8bf62d-c47c-4d68-b974-57c2e6df9e24 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:35.119622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6a8bf62d-c47c-4d68-b974-57c2e6df9e24 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:35.121705 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6a8bf62d-c47c-4d68-b974-57c2e6df9e24 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1184 microversion: 2.25 time: 0.161287 Aug 02 06:53:35.122813 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 923/1942] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:34 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1184 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:35.138679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a52f00a1-ca55-463a-8830-5d4c72c0b709 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:35.139621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a52f00a1-ca55-463a-8830-5d4c72c0b709 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:35.149597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a52f00a1-ca55-463a-8830-5d4c72c0b709 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:35.150708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a52f00a1-ca55-463a-8830-5d4c72c0b709 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:35.151981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a52f00a1-ca55-463a-8830-5d4c72c0b709 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:35.152598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a52f00a1-ca55-463a-8830-5d4c72c0b709 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:35.255671 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4e2c3b42-152e-4a91-b8dc-d96b035f8dba tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4/action" status: 202 len: 0 microversion: 2.1 time: 0.995023 Aug 02 06:53:35.267898 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1020/1943] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:53:34 2022] POST /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4/action => generated 0 bytes in 1008 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:53:35.285336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-39abd6f0-7e52-42bb-8f61-5298ef8b10ec tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:35.288852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-39abd6f0-7e52-42bb-8f61-5298ef8b10ec tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:35.311592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39abd6f0-7e52-42bb-8f61-5298ef8b10ec tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:35.314265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39abd6f0-7e52-42bb-8f61-5298ef8b10ec tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:35.315549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39abd6f0-7e52-42bb-8f61-5298ef8b10ec tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:35.317491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39abd6f0-7e52-42bb-8f61-5298ef8b10ec tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:35.628067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-39abd6f0-7e52-42bb-8f61-5298ef8b10ec tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:35.642166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-39abd6f0-7e52-42bb-8f61-5298ef8b10ec tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:35.655942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-39abd6f0-7e52-42bb-8f61-5298ef8b10ec tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:35.657495 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-39abd6f0-7e52-42bb-8f61-5298ef8b10ec tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 200 len: 1365 microversion: 2.47 time: 0.387395 Aug 02 06:53:35.658389 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1021/1944] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:35 2022] GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 1365 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:35.670384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-55d416ec-994d-4d34-96ab-29d4a0bf4a32 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:35.671008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-55d416ec-994d-4d34-96ab-29d4a0bf4a32 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:35.683835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55d416ec-994d-4d34-96ab-29d4a0bf4a32 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:35.685101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55d416ec-994d-4d34-96ab-29d4a0bf4a32 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:35.686150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55d416ec-994d-4d34-96ab-29d4a0bf4a32 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:35.687049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55d416ec-994d-4d34-96ab-29d4a0bf4a32 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:35.876958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a52f00a1-ca55-463a-8830-5d4c72c0b709 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:35.886882 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a52f00a1-ca55-463a-8830-5d4c72c0b709 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1476 microversion: 2.1 time: 0.762829 Aug 02 06:53:35.903973 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 924/1945] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:35 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1476 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:35.919746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-efd5a027-61fa-45a5-9b71-f58b24472dcc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927ab10280>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:36.143568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-55d416ec-994d-4d34-96ab-29d4a0bf4a32 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:36.152721 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-55d416ec-994d-4d34-96ab-29d4a0bf4a32 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1312 microversion: 2.1 time: 0.491983 Aug 02 06:53:36.164035 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1022/1946] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:35 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1312 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:36.168953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-c45f62e8-7f5f-430c-9451-412263ebb8a0 req-7e25598f-0f42-4c8a-8643-0233d38f9ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8b07c5d-4324-4221-a77d-203f65ad3b04", "tag": "b40c75bb-1839-4d4f-98e5-444d01355d6a"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:36.197712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c45f62e8-7f5f-430c-9451-412263ebb8a0 req-7e25598f-0f42-4c8a-8643-0233d38f9ec6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:36.199775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c45f62e8-7f5f-430c-9451-412263ebb8a0 req-7e25598f-0f42-4c8a-8643-0233d38f9ec6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:36.220941 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-c45f62e8-7f5f-430c-9451-412263ebb8a0 req-7e25598f-0f42-4c8a-8643-0233d38f9ec6 service nova] Creating event network-changed:b40c75bb-1839-4d4f-98e5-444d01355d6a for instance f8b07c5d-4324-4221-a77d-203f65ad3b04 on n-h1-851337-3 Aug 02 06:53:36.227535 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-c45f62e8-7f5f-430c-9451-412263ebb8a0 req-7e25598f-0f42-4c8a-8643-0233d38f9ec6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062328 Aug 02 06:53:36.228513 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1023/1947] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:36.235325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7e867787-d77d-4801-bb69-1134cfe54e39 req-83b08c6d-960a-4093-bbc5-2983089e57a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "303b535b-cea0-4219-ad1b-3849b9042a53", "tag": "78a224c6-e169-4c15-906f-64fc36ce7044"}, {"name": "network-changed", "server_uuid": "8ba796c7-da1f-4aa8-9dce-014658905cc4", "tag": "037cd849-dce0-499f-9464-cf45471f908a"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:36.249137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7e867787-d77d-4801-bb69-1134cfe54e39 req-83b08c6d-960a-4093-bbc5-2983089e57a5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:36.250066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7e867787-d77d-4801-bb69-1134cfe54e39 req-83b08c6d-960a-4093-bbc5-2983089e57a5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:36.268602 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7e867787-d77d-4801-bb69-1134cfe54e39 req-83b08c6d-960a-4093-bbc5-2983089e57a5 service nova] Creating event network-changed:78a224c6-e169-4c15-906f-64fc36ce7044 for instance 303b535b-cea0-4219-ad1b-3849b9042a53 on n-h1-851337-3 Aug 02 06:53:36.270056 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7e867787-d77d-4801-bb69-1134cfe54e39 req-83b08c6d-960a-4093-bbc5-2983089e57a5 service nova] Creating event network-changed:037cd849-dce0-499f-9464-cf45471f908a for instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 on n-h1-851337-3 Aug 02 06:53:36.273883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:36.280600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-7e867787-d77d-4801-bb69-1134cfe54e39 req-83b08c6d-960a-4093-bbc5-2983089e57a5 service nova] Instance 303b535b-cea0-4219-ad1b-3849b9042a53 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 06:53:36.298728 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7e867787-d77d-4801-bb69-1134cfe54e39 req-83b08c6d-960a-4093-bbc5-2983089e57a5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.068411 Aug 02 06:53:36.300154 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1024/1948] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:36.306178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-757cd596-bdd7-41ca-9bc0-96829d70a112 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:36.307315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-757cd596-bdd7-41ca-9bc0-96829d70a112 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:36.319107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-757cd596-bdd7-41ca-9bc0-96829d70a112 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:36.319985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-757cd596-bdd7-41ca-9bc0-96829d70a112 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:36.321129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-757cd596-bdd7-41ca-9bc0-96829d70a112 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:36.321995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-757cd596-bdd7-41ca-9bc0-96829d70a112 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:36.941377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG neutronclient.v2_0.client [None req-efd5a027-61fa-45a5-9b71-f58b24472dcc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 in use.", "detail": ""}} {{(pid=126119) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:53:36.943132 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-efd5a027-61fa-45a5-9b71-f58b24472dcc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Security Group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 in use. Aug 02 06:53:36.943132 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-caa01edc-d478-4dc9-8a8b-e1a83d39fceb'] Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-efd5a027-61fa-45a5-9b71-f58b24472dcc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/os-security-groups/6d2a237f-e7af-4c6a-88a9-d3a33facca84 HTTP/1.1 Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: exception: Security Group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 in use. Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-caa01edc-d478-4dc9-8a8b-e1a83d39fceb'] Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '6d2a237f-e7af-4c6a-88a9-d3a33facca84'} Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:53:36.947845 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 in use. Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caa01edc-d478-4dc9-8a8b-e1a83d39fceb'] Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 in use. Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caa01edc-d478-4dc9-8a8b-e1a83d39fceb'] Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 in use. Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caa01edc-d478-4dc9-8a8b-e1a83d39fceb'] Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 in use. Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caa01edc-d478-4dc9-8a8b-e1a83d39fceb'] Aug 02 06:53:36.953348 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:36.958396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-efd5a027-61fa-45a5-9b71-f58b24472dcc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 400 to user: Security Group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 in use. Aug 02 06:53:36.958396 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-caa01edc-d478-4dc9-8a8b-e1a83d39fceb'] {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:36.959592 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-efd5a027-61fa-45a5-9b71-f58b24472dcc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/6d2a237f-e7af-4c6a-88a9-d3a33facca84" status: 400 len: 185 microversion: 2.1 time: 1.054231 Aug 02 06:53:36.960711 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 925/1949] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:53:35 2022] DELETE /compute/v2.1/os-security-groups/6d2a237f-e7af-4c6a-88a9-d3a33facca84 => generated 185 bytes in 1056 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:53:36.969199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e0ccd141-a86b-4894-a170-340ecaedbbd5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:36.970481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e0ccd141-a86b-4894-a170-340ecaedbbd5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:36.982407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0ccd141-a86b-4894-a170-340ecaedbbd5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:36.983189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0ccd141-a86b-4894-a170-340ecaedbbd5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:36.984501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0ccd141-a86b-4894-a170-340ecaedbbd5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:36.985257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0ccd141-a86b-4894-a170-340ecaedbbd5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:37.132590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e0ccd141-a86b-4894-a170-340ecaedbbd5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:37.143888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e0ccd141-a86b-4894-a170-340ecaedbbd5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:37.147771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e0ccd141-a86b-4894-a170-340ecaedbbd5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:37.150042 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e0ccd141-a86b-4894-a170-340ecaedbbd5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1250 microversion: 2.25 time: 0.187922 Aug 02 06:53:37.150952 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 926/1950] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:36 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1250 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:37.156574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-68bca752-758b-401b-92ae-52609c1f888e tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:37.157514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-68bca752-758b-401b-92ae-52609c1f888e tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:37.180837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-757cd596-bdd7-41ca-9bc0-96829d70a112 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:37.182923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68bca752-758b-401b-92ae-52609c1f888e tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:37.183465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68bca752-758b-401b-92ae-52609c1f888e tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:37.184544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68bca752-758b-401b-92ae-52609c1f888e tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:37.186151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68bca752-758b-401b-92ae-52609c1f888e tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:37.188776 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-757cd596-bdd7-41ca-9bc0-96829d70a112 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 200 len: 1474 microversion: 2.1 time: 0.887026 Aug 02 06:53:37.189561 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1025/1951] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:36 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 1474 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:37.210013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e3c6d146-a2ce-4075-83e5-a057dbb13a62 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:37.211079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e3c6d146-a2ce-4075-83e5-a057dbb13a62 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:37.219678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3c6d146-a2ce-4075-83e5-a057dbb13a62 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:37.220447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3c6d146-a2ce-4075-83e5-a057dbb13a62 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:37.221433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3c6d146-a2ce-4075-83e5-a057dbb13a62 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:37.222070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3c6d146-a2ce-4075-83e5-a057dbb13a62 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:37.330226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-68bca752-758b-401b-92ae-52609c1f888e tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:37.338996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-68bca752-758b-401b-92ae-52609c1f888e tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:37.340559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-68bca752-758b-401b-92ae-52609c1f888e tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:37.342673 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-68bca752-758b-401b-92ae-52609c1f888e tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 200 len: 1365 microversion: 2.47 time: 0.190622 Aug 02 06:53:37.360095 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 927/1952] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:37 2022] GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:37.366025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2ee6d6eb-05fe-4719-acbb-7c014ff8f239 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:37.366513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2ee6d6eb-05fe-4719-acbb-7c014ff8f239 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:37.372927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ee6d6eb-05fe-4719-acbb-7c014ff8f239 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:37.373369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ee6d6eb-05fe-4719-acbb-7c014ff8f239 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:37.374367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ee6d6eb-05fe-4719-acbb-7c014ff8f239 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:37.374806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ee6d6eb-05fe-4719-acbb-7c014ff8f239 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:37.412394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2ee6d6eb-05fe-4719-acbb-7c014ff8f239 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:53:37.539068 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2ee6d6eb-05fe-4719-acbb-7c014ff8f239 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 204 len: 0 microversion: 2.1 time: 0.177012 Aug 02 06:53:37.540561 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 928/1953] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:53:37 2022] DELETE /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:37.550184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3dc2f829-195d-4f52-9621-3608eb5c25b4 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:37.551951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3dc2f829-195d-4f52-9621-3608eb5c25b4 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:37.562177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3dc2f829-195d-4f52-9621-3608eb5c25b4 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:37.563278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3dc2f829-195d-4f52-9621-3608eb5c25b4 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:37.564564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3dc2f829-195d-4f52-9621-3608eb5c25b4 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:37.565975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3dc2f829-195d-4f52-9621-3608eb5c25b4 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:37.580028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e3c6d146-a2ce-4075-83e5-a057dbb13a62 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:37.587803 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e3c6d146-a2ce-4075-83e5-a057dbb13a62 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1474 microversion: 2.1 time: 0.382117 Aug 02 06:53:37.590417 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1026/1954] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:37 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1474 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:37.604139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7ad0f211-9084-470d-b6ca-1c4b6b218186 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-934985424"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:37.609126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7ad0f211-9084-470d-b6ca-1c4b6b218186 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:37.625637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ad0f211-9084-470d-b6ca-1c4b6b218186 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:37.626607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ad0f211-9084-470d-b6ca-1c4b6b218186 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:37.627768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ad0f211-9084-470d-b6ca-1c4b6b218186 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:37.628307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ad0f211-9084-470d-b6ca-1c4b6b218186 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:37.855370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3dc2f829-195d-4f52-9621-3608eb5c25b4 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:37.868243 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3dc2f829-195d-4f52-9621-3608eb5c25b4 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1354 microversion: 2.1 time: 0.324580 Aug 02 06:53:37.869977 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 929/1955] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:37 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1354 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:37.877707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bed7e2f7-f427-4ced-ba3d-91908ff8fb88 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:37.878422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bed7e2f7-f427-4ced-ba3d-91908ff8fb88 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:37.900407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bed7e2f7-f427-4ced-ba3d-91908ff8fb88 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:37.901142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bed7e2f7-f427-4ced-ba3d-91908ff8fb88 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:37.902363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bed7e2f7-f427-4ced-ba3d-91908ff8fb88 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:37.902812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bed7e2f7-f427-4ced-ba3d-91908ff8fb88 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:37.908658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:37.923253 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7ad0f211-9084-470d-b6ca-1c4b6b218186 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "POST /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1/action" status: 202 len: 0 microversion: 2.1 time: 0.323084 Aug 02 06:53:37.924112 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1027/1956] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:53:37 2022] POST /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 02 06:53:37.947456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e1001748-63a3-4aad-a012-929345acde2b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927b226820>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:38.028844 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e1001748-63a3-4aad-a012-929345acde2b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.085531 Aug 02 06:53:38.030380 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1028/1957] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:37 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:38.173617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-53d803c4-82b2-4eba-a4f8-1c94c7e1d869 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:38.174444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-53d803c4-82b2-4eba-a4f8-1c94c7e1d869 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:38.183871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53d803c4-82b2-4eba-a4f8-1c94c7e1d869 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:38.184452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53d803c4-82b2-4eba-a4f8-1c94c7e1d869 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:38.185594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53d803c4-82b2-4eba-a4f8-1c94c7e1d869 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:38.186078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53d803c4-82b2-4eba-a4f8-1c94c7e1d869 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:38.211312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bed7e2f7-f427-4ced-ba3d-91908ff8fb88 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:38.226460 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bed7e2f7-f427-4ced-ba3d-91908ff8fb88 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1646 microversion: 2.1 time: 0.353082 Aug 02 06:53:38.227028 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 930/1958] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:37 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1646 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:38.276124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-53d803c4-82b2-4eba-a4f8-1c94c7e1d869 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:38.288394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-53d803c4-82b2-4eba-a4f8-1c94c7e1d869 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:38.289919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-53d803c4-82b2-4eba-a4f8-1c94c7e1d869 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:38.305803 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-53d803c4-82b2-4eba-a4f8-1c94c7e1d869 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1250 microversion: 2.25 time: 0.122411 Aug 02 06:53:38.305803 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1029/1959] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:38 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1250 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:53:38.307336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-81521a68-0dc8-43d5-a062-25e96178dbe2 req-68bdff93-68a3-44fa-b2f3-9ffba8bdb68e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea28a98b-bb58-40e2-8a62-635a752c0ecf", "tag": "51402711-5427-41b3-8ae6-77cfbc3a0afc"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:38.317485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-81521a68-0dc8-43d5-a062-25e96178dbe2 req-68bdff93-68a3-44fa-b2f3-9ffba8bdb68e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:38.318012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-81521a68-0dc8-43d5-a062-25e96178dbe2 req-68bdff93-68a3-44fa-b2f3-9ffba8bdb68e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:38.329939 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-81521a68-0dc8-43d5-a062-25e96178dbe2 req-68bdff93-68a3-44fa-b2f3-9ffba8bdb68e service nova] Creating event network-changed:51402711-5427-41b3-8ae6-77cfbc3a0afc for instance ea28a98b-bb58-40e2-8a62-635a752c0ecf on n-h2-851337-3 Aug 02 06:53:38.334486 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-81521a68-0dc8-43d5-a062-25e96178dbe2 req-68bdff93-68a3-44fa-b2f3-9ffba8bdb68e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032618 Aug 02 06:53:38.335142 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 931/1960] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:38.369112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-27b91b61-860f-4398-90fd-9e22306e06b1 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:38.369112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-27b91b61-860f-4398-90fd-9e22306e06b1 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:38.399859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27b91b61-860f-4398-90fd-9e22306e06b1 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:38.400303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27b91b61-860f-4398-90fd-9e22306e06b1 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:38.401288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27b91b61-860f-4398-90fd-9e22306e06b1 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:38.401908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27b91b61-860f-4398-90fd-9e22306e06b1 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:38.512769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-27b91b61-860f-4398-90fd-9e22306e06b1 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:38.522523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-27b91b61-860f-4398-90fd-9e22306e06b1 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:38.524883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-27b91b61-860f-4398-90fd-9e22306e06b1 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:38.526369 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-27b91b61-860f-4398-90fd-9e22306e06b1 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 200 len: 1365 microversion: 2.47 time: 0.163322 Aug 02 06:53:38.527542 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1030/1961] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:38 2022] GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:38.619575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-82463379-40b5-4e42-ae46-135bfe581e48 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:38.621379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-82463379-40b5-4e42-ae46-135bfe581e48 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:38.643016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82463379-40b5-4e42-ae46-135bfe581e48 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:38.643587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82463379-40b5-4e42-ae46-135bfe581e48 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:38.644500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82463379-40b5-4e42-ae46-135bfe581e48 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:38.645033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82463379-40b5-4e42-ae46-135bfe581e48 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:38.821592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-82463379-40b5-4e42-ae46-135bfe581e48 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:38.829272 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-82463379-40b5-4e42-ae46-135bfe581e48 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1474 microversion: 2.1 time: 0.217593 Aug 02 06:53:38.829847 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 932/1962] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:38 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1474 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:38.891691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5142f6ca-a4aa-42be-8e9f-db9cd9ea0085 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:38.892403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5142f6ca-a4aa-42be-8e9f-db9cd9ea0085 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:38.899027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5142f6ca-a4aa-42be-8e9f-db9cd9ea0085 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:38.899580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5142f6ca-a4aa-42be-8e9f-db9cd9ea0085 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:38.900408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5142f6ca-a4aa-42be-8e9f-db9cd9ea0085 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:38.901083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5142f6ca-a4aa-42be-8e9f-db9cd9ea0085 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:39.044960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0c4a35c4-d454-4572-9096-fb193a5cabd4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927ab10a60>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:39.063317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5142f6ca-a4aa-42be-8e9f-db9cd9ea0085 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:39.072191 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5142f6ca-a4aa-42be-8e9f-db9cd9ea0085 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1354 microversion: 2.1 time: 0.184927 Aug 02 06:53:39.073225 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1031/1963] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:38 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1354 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:39.100011 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0c4a35c4-d454-4572-9096-fb193a5cabd4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.059408 Aug 02 06:53:39.100942 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 933/1964] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:39 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:53:39.249430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b14d36cd-4863-4101-bbed-847d1c1d7c58 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:39.250065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b14d36cd-4863-4101-bbed-847d1c1d7c58 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:39.256746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b14d36cd-4863-4101-bbed-847d1c1d7c58 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:39.257199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b14d36cd-4863-4101-bbed-847d1c1d7c58 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:39.257991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b14d36cd-4863-4101-bbed-847d1c1d7c58 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:39.258431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b14d36cd-4863-4101-bbed-847d1c1d7c58 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:39.314463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-62b68186-14c0-452a-a060-efc6c86bdef6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:39.315126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-62b68186-14c0-452a-a060-efc6c86bdef6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:39.326482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62b68186-14c0-452a-a060-efc6c86bdef6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:39.327110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62b68186-14c0-452a-a060-efc6c86bdef6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:39.328646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62b68186-14c0-452a-a060-efc6c86bdef6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:39.329218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62b68186-14c0-452a-a060-efc6c86bdef6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:39.410963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-62b68186-14c0-452a-a060-efc6c86bdef6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:39.423226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-62b68186-14c0-452a-a060-efc6c86bdef6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:39.424987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-62b68186-14c0-452a-a060-efc6c86bdef6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:39.426202 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-62b68186-14c0-452a-a060-efc6c86bdef6 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1250 microversion: 2.25 time: 0.116591 Aug 02 06:53:39.434243 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 934/1965] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:39 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1250 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:39.513368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b14d36cd-4863-4101-bbed-847d1c1d7c58 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:39.525414 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b14d36cd-4863-4101-bbed-847d1c1d7c58 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1646 microversion: 2.1 time: 0.279845 Aug 02 06:53:39.539274 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1032/1966] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:39 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1646 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:39.552908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cc9ef645-5cd3-470b-92a8-6cb181d0d444 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:39.553957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cc9ef645-5cd3-470b-92a8-6cb181d0d444 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:39.563622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc9ef645-5cd3-470b-92a8-6cb181d0d444 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:39.564557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc9ef645-5cd3-470b-92a8-6cb181d0d444 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:39.566336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc9ef645-5cd3-470b-92a8-6cb181d0d444 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:39.567089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc9ef645-5cd3-470b-92a8-6cb181d0d444 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:39.654285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cc9ef645-5cd3-470b-92a8-6cb181d0d444 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:39.663042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cc9ef645-5cd3-470b-92a8-6cb181d0d444 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:39.664838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cc9ef645-5cd3-470b-92a8-6cb181d0d444 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:39.666293 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cc9ef645-5cd3-470b-92a8-6cb181d0d444 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 200 len: 1365 microversion: 2.47 time: 0.119271 Aug 02 06:53:39.667424 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 935/1967] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:39 2022] GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 1365 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:39.850477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-61cb15ce-a1a1-429a-9450-7ee2f59508cf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:39.852939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-61cb15ce-a1a1-429a-9450-7ee2f59508cf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:39.859645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61cb15ce-a1a1-429a-9450-7ee2f59508cf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:39.860378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61cb15ce-a1a1-429a-9450-7ee2f59508cf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:39.861320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61cb15ce-a1a1-429a-9450-7ee2f59508cf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:39.861931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61cb15ce-a1a1-429a-9450-7ee2f59508cf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:40.094121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d6a1ff44-3427-4369-a3f8-187192f1710b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:40.095054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d6a1ff44-3427-4369-a3f8-187192f1710b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:40.105668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6a1ff44-3427-4369-a3f8-187192f1710b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:40.106439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6a1ff44-3427-4369-a3f8-187192f1710b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:40.107381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6a1ff44-3427-4369-a3f8-187192f1710b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:40.109641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6a1ff44-3427-4369-a3f8-187192f1710b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:40.145548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-61cb15ce-a1a1-429a-9450-7ee2f59508cf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:40.162811 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-61cb15ce-a1a1-429a-9450-7ee2f59508cf tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1474 microversion: 2.1 time: 0.311021 Aug 02 06:53:40.164376 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1033/1968] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:39 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1474 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:40.187784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd36f3af-910c-43a2-9374-bb4a1ae504e3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a7d08b0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:40.263025 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dd36f3af-910c-43a2-9374-bb4a1ae504e3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.085491 Aug 02 06:53:40.270420 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1034/1969] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:40 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:40.432921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d6a1ff44-3427-4369-a3f8-187192f1710b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:40.443350 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d6a1ff44-3427-4369-a3f8-187192f1710b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1354 microversion: 2.1 time: 0.351984 Aug 02 06:53:40.446209 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 936/1970] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:40 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1354 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:40.475020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e91e5c1-ef09-40d5-8007-0371aafdd995 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:40.478073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7e91e5c1-ef09-40d5-8007-0371aafdd995 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:40.498904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e91e5c1-ef09-40d5-8007-0371aafdd995 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:40.499622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e91e5c1-ef09-40d5-8007-0371aafdd995 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:40.500682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e91e5c1-ef09-40d5-8007-0371aafdd995 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:40.501286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e91e5c1-ef09-40d5-8007-0371aafdd995 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:40.552828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-13787e4e-e729-4b01-92d3-e22122d38379 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:40.553469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-13787e4e-e729-4b01-92d3-e22122d38379 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:40.562284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13787e4e-e729-4b01-92d3-e22122d38379 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:40.563103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13787e4e-e729-4b01-92d3-e22122d38379 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:40.564382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13787e4e-e729-4b01-92d3-e22122d38379 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:40.565108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13787e4e-e729-4b01-92d3-e22122d38379 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:40.609408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7e91e5c1-ef09-40d5-8007-0371aafdd995 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:40.624067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7e91e5c1-ef09-40d5-8007-0371aafdd995 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:40.630537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7e91e5c1-ef09-40d5-8007-0371aafdd995 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:40.637738 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7e91e5c1-ef09-40d5-8007-0371aafdd995 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1250 microversion: 2.25 time: 0.186674 Aug 02 06:53:40.638419 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1035/1971] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:40 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1250 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:40.648587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-80f34e89-1b90-4a2d-9093-2a2fc5af474e req-961ba623-3a07-4415-8505-38e4ac7b2f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea28a98b-bb58-40e2-8a62-635a752c0ecf", "tag": "1c4033a4-9151-4c28-8690-54f55ef35bc7"}, {"name": "network-changed", "server_uuid": "ea28a98b-bb58-40e2-8a62-635a752c0ecf", "tag": "3083d4a4-9271-433f-b15d-aa9d26b3f2ec"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:40.672213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-80f34e89-1b90-4a2d-9093-2a2fc5af474e req-961ba623-3a07-4415-8505-38e4ac7b2f02 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:40.674221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-80f34e89-1b90-4a2d-9093-2a2fc5af474e req-961ba623-3a07-4415-8505-38e4ac7b2f02 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:40.706200 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-80f34e89-1b90-4a2d-9093-2a2fc5af474e req-961ba623-3a07-4415-8505-38e4ac7b2f02 service nova] Creating event network-changed:1c4033a4-9151-4c28-8690-54f55ef35bc7 for instance ea28a98b-bb58-40e2-8a62-635a752c0ecf on n-h2-851337-3 Aug 02 06:53:40.707074 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-80f34e89-1b90-4a2d-9093-2a2fc5af474e req-961ba623-3a07-4415-8505-38e4ac7b2f02 service nova] Creating event network-changed:3083d4a4-9271-433f-b15d-aa9d26b3f2ec for instance ea28a98b-bb58-40e2-8a62-635a752c0ecf on n-h2-851337-3 Aug 02 06:53:40.722638 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-80f34e89-1b90-4a2d-9093-2a2fc5af474e req-961ba623-3a07-4415-8505-38e4ac7b2f02 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077485 Aug 02 06:53:40.723522 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1036/1972] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:53:40.729151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0b3dee38-5c4e-42f2-b15a-9a173c9b57e6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:40.731348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0b3dee38-5c4e-42f2-b15a-9a173c9b57e6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:40.749395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b3dee38-5c4e-42f2-b15a-9a173c9b57e6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:40.750258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b3dee38-5c4e-42f2-b15a-9a173c9b57e6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:40.752147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b3dee38-5c4e-42f2-b15a-9a173c9b57e6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:40.753063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b3dee38-5c4e-42f2-b15a-9a173c9b57e6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:40.871848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0b3dee38-5c4e-42f2-b15a-9a173c9b57e6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:40.883286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0b3dee38-5c4e-42f2-b15a-9a173c9b57e6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:40.885143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0b3dee38-5c4e-42f2-b15a-9a173c9b57e6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:40.887230 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0b3dee38-5c4e-42f2-b15a-9a173c9b57e6 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 200 len: 1365 microversion: 2.47 time: 0.162294 Aug 02 06:53:40.897740 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1037/1973] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:40 2022] GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:41.114902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-13787e4e-e729-4b01-92d3-e22122d38379 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:41.123073 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-13787e4e-e729-4b01-92d3-e22122d38379 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1646 microversion: 2.1 time: 0.577314 Aug 02 06:53:41.123678 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 937/1974] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:40 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1646 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:41.185910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-61b981f8-2ddf-4f66-8dd0-4ede8835711d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:41.187191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-61b981f8-2ddf-4f66-8dd0-4ede8835711d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:41.214952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61b981f8-2ddf-4f66-8dd0-4ede8835711d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:41.224873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61b981f8-2ddf-4f66-8dd0-4ede8835711d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:41.227050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61b981f8-2ddf-4f66-8dd0-4ede8835711d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:41.229067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61b981f8-2ddf-4f66-8dd0-4ede8835711d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:41.280244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e048a4c7-d902-4daf-aceb-c3ab4f951ca6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927ab3c670>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:41.346754 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e048a4c7-d902-4daf-aceb-c3ab4f951ca6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.069782 Aug 02 06:53:41.353996 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 938/1975] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:41 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:41.482200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-67cf51fc-a570-478c-a6b5-7646aab07526 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:41.488866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-67cf51fc-a570-478c-a6b5-7646aab07526 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:41.507399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67cf51fc-a570-478c-a6b5-7646aab07526 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:41.507869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67cf51fc-a570-478c-a6b5-7646aab07526 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:41.508656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67cf51fc-a570-478c-a6b5-7646aab07526 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:41.509088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67cf51fc-a570-478c-a6b5-7646aab07526 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:41.535304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-61b981f8-2ddf-4f66-8dd0-4ede8835711d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:41.561996 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-61b981f8-2ddf-4f66-8dd0-4ede8835711d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1474 microversion: 2.1 time: 0.374205 Aug 02 06:53:41.565256 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1038/1976] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:41 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1474 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:41.674554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-61270746-1379-4d7b-a239-8a10a74e9790 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:41.676901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-61270746-1379-4d7b-a239-8a10a74e9790 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:41.699007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61270746-1379-4d7b-a239-8a10a74e9790 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:41.699942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61270746-1379-4d7b-a239-8a10a74e9790 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:41.718821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61270746-1379-4d7b-a239-8a10a74e9790 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:41.722341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61270746-1379-4d7b-a239-8a10a74e9790 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:42.244496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-61270746-1379-4d7b-a239-8a10a74e9790 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:42.250859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-67cf51fc-a570-478c-a6b5-7646aab07526 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:42.259112 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-67cf51fc-a570-478c-a6b5-7646aab07526 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1354 microversion: 2.1 time: 0.795067 Aug 02 06:53:42.259687 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 939/1977] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:41 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1354 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:53:42.278308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-61270746-1379-4d7b-a239-8a10a74e9790 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:42.278308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-61270746-1379-4d7b-a239-8a10a74e9790 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:42.278308 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-61270746-1379-4d7b-a239-8a10a74e9790 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1292 microversion: 2.25 time: 0.616277 Aug 02 06:53:42.278308 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1039/1978] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:41 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1292 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:53:42.297690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-20d8c4c8-cae5-4127-bc32-3918b7e1909d tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:42.298673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-20d8c4c8-cae5-4127-bc32-3918b7e1909d tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:42.306066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20d8c4c8-cae5-4127-bc32-3918b7e1909d tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:42.321835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20d8c4c8-cae5-4127-bc32-3918b7e1909d tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:42.322907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20d8c4c8-cae5-4127-bc32-3918b7e1909d tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:42.323371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20d8c4c8-cae5-4127-bc32-3918b7e1909d tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:42.347084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-15bc2a28-4c15-400b-bb2a-c0937f32f179 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:42.347847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-15bc2a28-4c15-400b-bb2a-c0937f32f179 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:42.380176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15bc2a28-4c15-400b-bb2a-c0937f32f179 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:42.380634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15bc2a28-4c15-400b-bb2a-c0937f32f179 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:42.384121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15bc2a28-4c15-400b-bb2a-c0937f32f179 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:42.384568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15bc2a28-4c15-400b-bb2a-c0937f32f179 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:43.057704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-20d8c4c8-cae5-4127-bc32-3918b7e1909d tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:43.086074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-20d8c4c8-cae5-4127-bc32-3918b7e1909d tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:43.093479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-20d8c4c8-cae5-4127-bc32-3918b7e1909d tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8ec7a35581458a89bd9a4b7d58154a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a8ff4325d4420f9ef7def2bc04d62c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:43.098690 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-20d8c4c8-cae5-4127-bc32-3918b7e1909d tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 200 len: 1365 microversion: 2.47 time: 0.837969 Aug 02 06:53:43.102555 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 940/1979] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:42 2022] GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 1365 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:43.139951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f6fadf0d-4ae9-48e7-8566-1607e1233200 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927ab019d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:43.260564 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f6fadf0d-4ae9-48e7-8566-1607e1233200 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.136086 Aug 02 06:53:43.261176 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 941/1980] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:43 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:43.276115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8a4d08fb-db93-4ef3-b48e-e9793a6fe409 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:43.287561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8a4d08fb-db93-4ef3-b48e-e9793a6fe409 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:43.312289 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a4d08fb-db93-4ef3-b48e-e9793a6fe409 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:43.319576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a4d08fb-db93-4ef3-b48e-e9793a6fe409 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:43.320696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a4d08fb-db93-4ef3-b48e-e9793a6fe409 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:43.321327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a4d08fb-db93-4ef3-b48e-e9793a6fe409 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:44.010478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-15bc2a28-4c15-400b-bb2a-c0937f32f179 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:44.027288 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-15bc2a28-4c15-400b-bb2a-c0937f32f179 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1646 microversion: 2.1 time: 1.743792 Aug 02 06:53:44.028196 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1040/1981] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:42 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1646 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:44.055491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-26b46dfb-dff1-4219-b115-7400fd63367c req-499ed4a3-3e90-45ea-a0d5-4d844690751b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4790820-2d09-47ab-9c4d-ec909dc7e1c1", "name": "network-vif-plugged", "status": "completed", "tag": "8406eedb-691b-4d88-a1e7-a1e3cfda7983"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:44.087438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-26b46dfb-dff1-4219-b115-7400fd63367c req-499ed4a3-3e90-45ea-a0d5-4d844690751b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:44.090504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-26b46dfb-dff1-4219-b115-7400fd63367c req-499ed4a3-3e90-45ea-a0d5-4d844690751b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:44.123483 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-26b46dfb-dff1-4219-b115-7400fd63367c req-499ed4a3-3e90-45ea-a0d5-4d844690751b service nova] Creating event network-vif-plugged:8406eedb-691b-4d88-a1e7-a1e3cfda7983 for instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 on n-h2-851337-3 Aug 02 06:53:44.139693 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-26b46dfb-dff1-4219-b115-7400fd63367c req-499ed4a3-3e90-45ea-a0d5-4d844690751b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089827 Aug 02 06:53:44.143992 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1041/1982] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:44.148186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:44.152916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-56e8903c-11c0-4a05-bbfd-1c589db60e6d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:44.153635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-56e8903c-11c0-4a05-bbfd-1c589db60e6d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:44.188018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56e8903c-11c0-4a05-bbfd-1c589db60e6d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:44.188018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56e8903c-11c0-4a05-bbfd-1c589db60e6d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:44.191368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56e8903c-11c0-4a05-bbfd-1c589db60e6d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:44.191831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56e8903c-11c0-4a05-bbfd-1c589db60e6d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:44.192759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=12 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:44.526364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8a4d08fb-db93-4ef3-b48e-e9793a6fe409 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:44.543833 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8a4d08fb-db93-4ef3-b48e-e9793a6fe409 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1471 microversion: 2.1 time: 1.281268 Aug 02 06:53:44.544801 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 942/1983] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:43 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1471 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:44.562528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a3fa7108-6110-4676-bfdc-a9ea4c73f735 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:44.563572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a3fa7108-6110-4676-bfdc-a9ea4c73f735 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:44.576271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3fa7108-6110-4676-bfdc-a9ea4c73f735 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:44.579279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3fa7108-6110-4676-bfdc-a9ea4c73f735 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:44.582956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3fa7108-6110-4676-bfdc-a9ea4c73f735 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:44.583689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3fa7108-6110-4676-bfdc-a9ea4c73f735 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:44.608814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-56e8903c-11c0-4a05-bbfd-1c589db60e6d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:44.620941 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-56e8903c-11c0-4a05-bbfd-1c589db60e6d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1354 microversion: 2.1 time: 0.476978 Aug 02 06:53:44.622435 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1042/1984] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:44 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1354 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:44.632781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eef7eb7a-bc7d-4572-9113-351007c710b5 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:44.633748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-eef7eb7a-bc7d-4572-9113-351007c710b5 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] [instance: 584a041a-eaca-4b3f-a9a2-534ef199512b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:44.649238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eef7eb7a-bc7d-4572-9113-351007c710b5 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:44.653471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eef7eb7a-bc7d-4572-9113-351007c710b5 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:44.654601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eef7eb7a-bc7d-4572-9113-351007c710b5 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:44.655210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eef7eb7a-bc7d-4572-9113-351007c710b5 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:44.672991 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-eef7eb7a-bc7d-4572-9113-351007c710b5 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] HTTP exception thrown: Instance 584a041a-eaca-4b3f-a9a2-534ef199512b could not be found. Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eef7eb7a-bc7d-4572-9113-351007c710b5 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Request method failure captured: Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b HTTP/1.1 Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MnfJdoeO-H8RudkbAYucx_6rsmpwTa5vOnHnhOB4rPQ9bS2UQ2vqV-IDbU51zRJVPIYNCPIRKCFsJaulFndDa1o0RzdUXRCNtMofbiDuqpoFoAxhLN-CJsFsfZ6jobOCcsyBS1ZMWIZ_YtnGcpw7ctZ6RVEP9Z16VCqWrwe3ZABjJE Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.47 Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: e9a8ff4325d4420f9ef7def2bc04d62c Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersAaction247Test-1178614636 Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e9a8ff4325d4420f9ef7def2bc04d62c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e9a8ff4325d4420f9ef7def2bc04d62c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e9a8ff4325d4420f9ef7def2bc04d62c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e9a8ff4325d4420f9ef7def2bc04d62c"}]}] Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersAaction247Test-1178614636 Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: e9a8ff4325d4420f9ef7def2bc04d62c Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersAaction247Test-1178614636 Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersAaction247Test-1178614636-project Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: bd8ec7a35581458a89bd9a4b7d58154a Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersAaction247Test-1178614636-project Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 584a041a-eaca-4b3f-a9a2-534ef199512b could not be found. Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '584a041a-eaca-4b3f-a9a2-534ef199512b'} Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 584a041a-eaca-4b3f-a9a2-534ef199512b could not be found. Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 584a041a-eaca-4b3f-a9a2-534ef199512b could not be found. Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:44.674762 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:44.680782 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:44.680782 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:44.680782 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:44.680782 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:44.680782 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:44.680782 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:44.680782 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 584a041a-eaca-4b3f-a9a2-534ef199512b could not be found. Aug 02 06:53:44.680782 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:44.680782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eef7eb7a-bc7d-4572-9113-351007c710b5 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] Returning 404 to user: Instance 584a041a-eaca-4b3f-a9a2-534ef199512b could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:44.680782 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-eef7eb7a-bc7d-4572-9113-351007c710b5 tempest-ServersAaction247Test-1178614636 tempest-ServersAaction247Test-1178614636-project] 10.222.0.79 "GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b" status: 404 len: 111 microversion: 2.47 time: 0.052694 Aug 02 06:53:44.680782 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1043/1985] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:44 2022] GET /compute/v2.1/servers/584a041a-eaca-4b3f-a9a2-534ef199512b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:53:44.685802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f91c43d-3def-4a21-b8dc-acc6306d8c80 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a80e0d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:44.769135 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f91c43d-3def-4a21-b8dc-acc6306d8c80 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.087402 Aug 02 06:53:44.780455 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1044/1986] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:44 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:44.787221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1280cfb8-6993-4009-b0e3-7ede4390b0ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:44.789654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1280cfb8-6993-4009-b0e3-7ede4390b0ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:44.800693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1280cfb8-6993-4009-b0e3-7ede4390b0ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:44.801245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1280cfb8-6993-4009-b0e3-7ede4390b0ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:44.802138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1280cfb8-6993-4009-b0e3-7ede4390b0ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:44.802645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1280cfb8-6993-4009-b0e3-7ede4390b0ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:44.808885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:45.191866 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1280cfb8-6993-4009-b0e3-7ede4390b0ea tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "POST /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53/action" status: 202 len: 0 microversion: 2.1 time: 0.409824 Aug 02 06:53:45.192567 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1045/1987] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:53:44 2022] POST /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:53:45.212892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1a6ae8b5-7c61-453f-aae7-57ab0357bc89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:45.213610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1a6ae8b5-7c61-453f-aae7-57ab0357bc89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:45.253027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a6ae8b5-7c61-453f-aae7-57ab0357bc89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:45.253483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a6ae8b5-7c61-453f-aae7-57ab0357bc89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:45.262646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a6ae8b5-7c61-453f-aae7-57ab0357bc89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:45.263184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a6ae8b5-7c61-453f-aae7-57ab0357bc89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:45.892774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1a6ae8b5-7c61-453f-aae7-57ab0357bc89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:45.898310 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1a6ae8b5-7c61-453f-aae7-57ab0357bc89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 200 len: 1467 microversion: 2.1 time: 0.689549 Aug 02 06:53:45.902187 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1046/1988] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:45 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 1467 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:45.916024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-87d927c6-f0b0-40f1-b8c7-9975d9582e66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:45.916656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-87d927c6-f0b0-40f1-b8c7-9975d9582e66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:45.924878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87d927c6-f0b0-40f1-b8c7-9975d9582e66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:45.925332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87d927c6-f0b0-40f1-b8c7-9975d9582e66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:45.930282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87d927c6-f0b0-40f1-b8c7-9975d9582e66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:45.930948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87d927c6-f0b0-40f1-b8c7-9975d9582e66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:46.073427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a3fa7108-6110-4676-bfdc-a9ea4c73f735 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:46.093753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a3fa7108-6110-4676-bfdc-a9ea4c73f735 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:46.096612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a3fa7108-6110-4676-bfdc-a9ea4c73f735 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:46.098944 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a3fa7108-6110-4676-bfdc-a9ea4c73f735 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1292 microversion: 2.25 time: 1.552745 Aug 02 06:53:46.099775 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 943/1989] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:44 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1292 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:46.106230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-4544301e-056d-4c19-ae17-db394c3b87a9 req-bb224a82-ef5b-45b3-b585-260f89ec7376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7780d516-e238-4ace-8533-903dd2a12caf", "tag": "ee71a9b8-bd05-4f42-b152-fb0af7d0ef95"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:46.119042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-4544301e-056d-4c19-ae17-db394c3b87a9 req-bb224a82-ef5b-45b3-b585-260f89ec7376 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:46.119946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-4544301e-056d-4c19-ae17-db394c3b87a9 req-bb224a82-ef5b-45b3-b585-260f89ec7376 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:46.149698 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-4544301e-056d-4c19-ae17-db394c3b87a9 req-bb224a82-ef5b-45b3-b585-260f89ec7376 service nova] Creating event network-changed:ee71a9b8-bd05-4f42-b152-fb0af7d0ef95 for instance 7780d516-e238-4ace-8533-903dd2a12caf on n-h1-851337-3 Aug 02 06:53:46.170150 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-4544301e-056d-4c19-ae17-db394c3b87a9 req-bb224a82-ef5b-45b3-b585-260f89ec7376 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063199 Aug 02 06:53:46.174192 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 944/1990] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:46.193522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b74e4ee2-10ef-43a7-b759-17d50e474cde tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:46.194620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b74e4ee2-10ef-43a7-b759-17d50e474cde tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:46.203125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b74e4ee2-10ef-43a7-b759-17d50e474cde tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:46.203969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b74e4ee2-10ef-43a7-b759-17d50e474cde tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:46.205170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b74e4ee2-10ef-43a7-b759-17d50e474cde tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:46.205851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b74e4ee2-10ef-43a7-b759-17d50e474cde tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:46.476669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-87d927c6-f0b0-40f1-b8c7-9975d9582e66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:46.486015 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-87d927c6-f0b0-40f1-b8c7-9975d9582e66 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1470 microversion: 2.1 time: 0.582663 Aug 02 06:53:46.493474 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1047/1991] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:45 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1470 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:46.517618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-59fe60e3-5e34-4cb6-b1fa-91925c0c46d0 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a7d0a60>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:46.602332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b74e4ee2-10ef-43a7-b759-17d50e474cde tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:46.621700 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-59fe60e3-5e34-4cb6-b1fa-91925c0c46d0 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.120884 Aug 02 06:53:46.623611 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1048/1992] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:46 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:46.627712 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b74e4ee2-10ef-43a7-b759-17d50e474cde tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1354 microversion: 2.1 time: 0.449285 Aug 02 06:53:46.648104 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 945/1993] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:46 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1354 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:46.654855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6465375d-4d8e-47fd-a0b5-bfda0302d6ea req-7f1a134b-e628-4f5e-90f7-6d01876aacad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba796c7-da1f-4aa8-9dce-014658905cc4", "name": "network-vif-deleted", "tag": "037cd849-dce0-499f-9464-cf45471f908a"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:46.659606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-f19bc2aa-d5b5-45bf-b419-6e0f6e9e8eac req-304ce4ff-e790-4e22-973d-2e022c58c863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303b535b-cea0-4219-ad1b-3849b9042a53", "name": "network-vif-plugged", "status": "completed", "tag": "78a224c6-e169-4c15-906f-64fc36ce7044"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:46.684948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6465375d-4d8e-47fd-a0b5-bfda0302d6ea req-7f1a134b-e628-4f5e-90f7-6d01876aacad service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:46.686075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f19bc2aa-d5b5-45bf-b419-6e0f6e9e8eac req-304ce4ff-e790-4e22-973d-2e022c58c863 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:46.686783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6465375d-4d8e-47fd-a0b5-bfda0302d6ea req-7f1a134b-e628-4f5e-90f7-6d01876aacad service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:46.689048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f19bc2aa-d5b5-45bf-b419-6e0f6e9e8eac req-304ce4ff-e790-4e22-973d-2e022c58c863 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:46.721731 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-6465375d-4d8e-47fd-a0b5-bfda0302d6ea req-7f1a134b-e628-4f5e-90f7-6d01876aacad service nova] Creating event network-vif-deleted:037cd849-dce0-499f-9464-cf45471f908a for instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 on n-h1-851337-3 Aug 02 06:53:46.723670 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-f19bc2aa-d5b5-45bf-b419-6e0f6e9e8eac req-304ce4ff-e790-4e22-973d-2e022c58c863 service nova] Creating event network-vif-plugged:78a224c6-e169-4c15-906f-64fc36ce7044 for instance 303b535b-cea0-4219-ad1b-3849b9042a53 on n-h1-851337-3 Aug 02 06:53:46.732871 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6465375d-4d8e-47fd-a0b5-bfda0302d6ea req-7f1a134b-e628-4f5e-90f7-6d01876aacad service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107675 Aug 02 06:53:46.736628 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1049/1994] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:46.736829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-f19bc2aa-d5b5-45bf-b419-6e0f6e9e8eac req-304ce4ff-e790-4e22-973d-2e022c58c863 service nova] Instance 303b535b-cea0-4219-ad1b-3849b9042a53 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 06:53:46.785997 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-f19bc2aa-d5b5-45bf-b419-6e0f6e9e8eac req-304ce4ff-e790-4e22-973d-2e022c58c863 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134694 Aug 02 06:53:46.790443 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 946/1995] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:46.921059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f4e96d7-92f0-41b2-b5f7-16bc90498c05 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:46.922334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4f4e96d7-92f0-41b2-b5f7-16bc90498c05 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:46.941050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f4e96d7-92f0-41b2-b5f7-16bc90498c05 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:46.941508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f4e96d7-92f0-41b2-b5f7-16bc90498c05 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:46.942334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f4e96d7-92f0-41b2-b5f7-16bc90498c05 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:46.942786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f4e96d7-92f0-41b2-b5f7-16bc90498c05 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:46.987843 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-4f4e96d7-92f0-41b2-b5f7-16bc90498c05 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f4e96d7-92f0-41b2-b5f7-16bc90498c05 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 HTTP/1.1 Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '8ba796c7-da1f-4aa8-9dce-014658905cc4'} Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:46.990514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:46.995558 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:46.995558 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:46.995558 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:46.995558 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:46.995558 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:46.995558 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:46.995558 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:46.996969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f4e96d7-92f0-41b2-b5f7-16bc90498c05 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 404 to user: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:46.998060 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4f4e96d7-92f0-41b2-b5f7-16bc90498c05 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 404 len: 111 microversion: 2.1 time: 0.082884 Aug 02 06:53:47.002636 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1050/1996] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:46 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:53:47.010602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72780184-743f-4527-9509-b76f353e195e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927ab35f70>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:47.128969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1af91b3c-4c1b-4701-bb6d-6b02366a762d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:47.129769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1af91b3c-4c1b-4701-bb6d-6b02366a762d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:47.141479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1af91b3c-4c1b-4701-bb6d-6b02366a762d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:47.141970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1af91b3c-4c1b-4701-bb6d-6b02366a762d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:47.142789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1af91b3c-4c1b-4701-bb6d-6b02366a762d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:47.145057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1af91b3c-4c1b-4701-bb6d-6b02366a762d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:47.483492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1af91b3c-4c1b-4701-bb6d-6b02366a762d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:47.499252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1af91b3c-4c1b-4701-bb6d-6b02366a762d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:47.508764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1af91b3c-4c1b-4701-bb6d-6b02366a762d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:47.510494 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1af91b3c-4c1b-4701-bb6d-6b02366a762d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1292 microversion: 2.25 time: 0.386649 Aug 02 06:53:47.511644 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1051/1997] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:47 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1292 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:53:47.516866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-28e24a94-753c-40a9-b3b1-952e7ac798be tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:47.526716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-28e24a94-753c-40a9-b3b1-952e7ac798be tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:47.537947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28e24a94-753c-40a9-b3b1-952e7ac798be tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:47.538689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28e24a94-753c-40a9-b3b1-952e7ac798be tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:47.539843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28e24a94-753c-40a9-b3b1-952e7ac798be tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:47.540597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28e24a94-753c-40a9-b3b1-952e7ac798be tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:47.982431 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-72780184-743f-4527-9509-b76f353e195e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/11669366-4dc6-482e-be48-69add67ea1b2" status: 202 len: 0 microversion: 2.1 time: 0.978353 Aug 02 06:53:47.983109 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 947/1998] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:53:47 2022] DELETE /compute/v2.1/os-security-groups/11669366-4dc6-482e-be48-69add67ea1b2 => generated 0 bytes in 980 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:53:47.988428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-22ccb412-e6a5-4902-90a7-7ece0b589c46 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927aacbd30>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:48.038803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-28e24a94-753c-40a9-b3b1-952e7ac798be tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:48.057009 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-28e24a94-753c-40a9-b3b1-952e7ac798be tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1470 microversion: 2.1 time: 0.544009 Aug 02 06:53:48.060165 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1052/1999] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:47 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1470 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:48.094839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5b3366bb-e933-4b79-92d1-7105a099d087 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:48.095501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5b3366bb-e933-4b79-92d1-7105a099d087 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:48.106569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b3366bb-e933-4b79-92d1-7105a099d087 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:48.107023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b3366bb-e933-4b79-92d1-7105a099d087 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:48.107827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b3366bb-e933-4b79-92d1-7105a099d087 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:48.108262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b3366bb-e933-4b79-92d1-7105a099d087 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:48.115816 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-22ccb412-e6a5-4902-90a7-7ece0b589c46 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.131399 Aug 02 06:53:48.116661 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 948/2000] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:47 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:48.127511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c35f2ae4-77fb-4112-9db6-70ca602d99c0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927ab01670>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:48.633638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5b3366bb-e933-4b79-92d1-7105a099d087 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:48.642736 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5b3366bb-e933-4b79-92d1-7105a099d087 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1354 microversion: 2.1 time: 0.581311 Aug 02 06:53:48.643319 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1053/2001] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:48 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1354 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:48.669822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43450e9c-161a-4760-9d65-8836d89ca791 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:48.682345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-43450e9c-161a-4760-9d65-8836d89ca791 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:48.715267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43450e9c-161a-4760-9d65-8836d89ca791 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:48.719913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43450e9c-161a-4760-9d65-8836d89ca791 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:48.724528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43450e9c-161a-4760-9d65-8836d89ca791 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:48.729923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43450e9c-161a-4760-9d65-8836d89ca791 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:49.050364 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c35f2ae4-77fb-4112-9db6-70ca602d99c0 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/6d2a237f-e7af-4c6a-88a9-d3a33facca84" status: 202 len: 0 microversion: 2.1 time: 0.932167 Aug 02 06:53:49.051751 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 949/2002] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:53:48 2022] DELETE /compute/v2.1/os-security-groups/6d2a237f-e7af-4c6a-88a9-d3a33facca84 => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:53:49.069685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4d7e69ba-e2a8-4967-87ca-2c7c3b9a9a89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'create', calling method: .version_select at 0x7f927ab35040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1417452951", "description": "tempest-description-784883693"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:49.423851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43450e9c-161a-4760-9d65-8836d89ca791 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:49.435170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43450e9c-161a-4760-9d65-8836d89ca791 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:49.450198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43450e9c-161a-4760-9d65-8836d89ca791 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:49.458620 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43450e9c-161a-4760-9d65-8836d89ca791 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1292 microversion: 2.25 time: 0.808637 Aug 02 06:53:49.459692 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1054/2003] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:48 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1292 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:49.488093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e6acbd52-a40b-46e0-9a17-e475cc7b35bc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:49.491661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e6acbd52-a40b-46e0-9a17-e475cc7b35bc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:49.529098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6acbd52-a40b-46e0-9a17-e475cc7b35bc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:49.536603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6acbd52-a40b-46e0-9a17-e475cc7b35bc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:49.537608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6acbd52-a40b-46e0-9a17-e475cc7b35bc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:49.538148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6acbd52-a40b-46e0-9a17-e475cc7b35bc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:49.825633 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4d7e69ba-e2a8-4967-87ca-2c7c3b9a9a89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.761716 Aug 02 06:53:49.826615 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 950/2004] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:53:49 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:49.831452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aa10249b-7b33-4ee3-ace3-c47211f906de tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927aadc160>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:49.952298 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aa10249b-7b33-4ee3-ace3-c47211f906de tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.124580 Aug 02 06:53:49.953028 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 951/2005] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:49 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:49.973024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9bb53abe-4b29-4dcd-9056-e22c60159b07 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:49.986507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9bb53abe-4b29-4dcd-9056-e22c60159b07 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:50.007118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bb53abe-4b29-4dcd-9056-e22c60159b07 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:50.007555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bb53abe-4b29-4dcd-9056-e22c60159b07 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:50.019688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bb53abe-4b29-4dcd-9056-e22c60159b07 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:50.021362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bb53abe-4b29-4dcd-9056-e22c60159b07 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:50.763945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e6acbd52-a40b-46e0-9a17-e475cc7b35bc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:50.773387 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e6acbd52-a40b-46e0-9a17-e475cc7b35bc tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1470 microversion: 2.1 time: 1.301455 Aug 02 06:53:50.774008 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1055/2006] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:49 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1470 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:50.805332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d82c8a0e-7ed5-408c-8061-3ddf89dc366f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Action: 'update', calling method: .version_select at 0x7f927a79d670>, body: {"security_group": {"name": "tempest-sg-hth-589228556", "description": "tempest-description-hth-722502611"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:51.073443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9bb53abe-4b29-4dcd-9056-e22c60159b07 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:51.094237 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9bb53abe-4b29-4dcd-9056-e22c60159b07 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1354 microversion: 2.1 time: 1.138820 Aug 02 06:53:51.112233 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 952/2007] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:49 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1354 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:51.124788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fdf9aeee-6fa4-4e1a-80b5-f00459528532 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:51.137560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fdf9aeee-6fa4-4e1a-80b5-f00459528532 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:51.152162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fdf9aeee-6fa4-4e1a-80b5-f00459528532 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:51.155220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fdf9aeee-6fa4-4e1a-80b5-f00459528532 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:51.156260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fdf9aeee-6fa4-4e1a-80b5-f00459528532 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:51.158401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fdf9aeee-6fa4-4e1a-80b5-f00459528532 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:51.935497 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d82c8a0e-7ed5-408c-8061-3ddf89dc366f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "PUT /compute/v2.1/os-security-groups/b7ddee63-86ba-4532-a492-367f56b817a0" status: 200 len: 216 microversion: 2.1 time: 1.160395 Aug 02 06:53:51.936670 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1056/2008] 10.222.0.79 () {60 vars in 1290 bytes} [Tue Aug 2 06:53:50 2022] PUT /compute/v2.1/os-security-groups/b7ddee63-86ba-4532-a492-367f56b817a0 => generated 216 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:51.941974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-feaeb29d-459c-4bff-96d9-d02d9e401b8a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a836f70>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:52.067270 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-feaeb29d-459c-4bff-96d9-d02d9e401b8a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.129120 Aug 02 06:53:52.068312 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1057/2009] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:51 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:52.082412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-11c8b958-0e61-474f-b021-a25457bd2401 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:52.088432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-11c8b958-0e61-474f-b021-a25457bd2401 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:52.104660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11c8b958-0e61-474f-b021-a25457bd2401 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:52.108384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11c8b958-0e61-474f-b021-a25457bd2401 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:52.109605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11c8b958-0e61-474f-b021-a25457bd2401 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:52.110120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11c8b958-0e61-474f-b021-a25457bd2401 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:52.622297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fdf9aeee-6fa4-4e1a-80b5-f00459528532 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:52.638309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fdf9aeee-6fa4-4e1a-80b5-f00459528532 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:52.640030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fdf9aeee-6fa4-4e1a-80b5-f00459528532 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:52.650296 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fdf9aeee-6fa4-4e1a-80b5-f00459528532 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1292 microversion: 2.25 time: 1.529082 Aug 02 06:53:52.664548 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 953/2010] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:51 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1292 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:52.679460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9b9922eb-f667-4cc0-8d75-323493c179d6 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927aacbc10>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:52.870093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-11c8b958-0e61-474f-b021-a25457bd2401 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:52.899612 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-11c8b958-0e61-474f-b021-a25457bd2401 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1470 microversion: 2.1 time: 0.829389 Aug 02 06:53:52.900230 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1058/2011] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:52 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1470 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:52.918855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0e28024c-762f-44e5-95a9-b538146e469f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:52.923545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0e28024c-762f-44e5-95a9-b538146e469f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:52.939727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e28024c-762f-44e5-95a9-b538146e469f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:52.940381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e28024c-762f-44e5-95a9-b538146e469f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:52.943208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e28024c-762f-44e5-95a9-b538146e469f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:52.943922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e28024c-762f-44e5-95a9-b538146e469f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:52.944913 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9b9922eb-f667-4cc0-8d75-323493c179d6 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/b7ddee63-86ba-4532-a492-367f56b817a0" status: 200 len: 216 microversion: 2.1 time: 0.269280 Aug 02 06:53:52.945623 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 954/2012] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 06:53:52 2022] GET /compute/v2.1/os-security-groups/b7ddee63-86ba-4532-a492-367f56b817a0 => generated 216 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:52.963592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-df86a3e5-5ce5-4b29-8ec6-79efa7e13efb tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927ab101f0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:53.886552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0e28024c-762f-44e5-95a9-b538146e469f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:53.901970 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0e28024c-762f-44e5-95a9-b538146e469f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1354 microversion: 2.1 time: 0.996251 Aug 02 06:53:53.903558 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1059/2013] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:52 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1354 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:53.916838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43bf8716-020e-4425-beba-f97e520d4b23 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a8438b0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:54.025478 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43bf8716-020e-4425-beba-f97e520d4b23 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.120814 Aug 02 06:53:54.026694 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1060/2014] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:53 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:54.044891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-45043ddd-7aaa-4976-bf29-6d9ed08c08e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:54.045538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-45043ddd-7aaa-4976-bf29-6d9ed08c08e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:54.064709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45043ddd-7aaa-4976-bf29-6d9ed08c08e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:54.065487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45043ddd-7aaa-4976-bf29-6d9ed08c08e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:54.066516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45043ddd-7aaa-4976-bf29-6d9ed08c08e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:54.067135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45043ddd-7aaa-4976-bf29-6d9ed08c08e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:54.516389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-45043ddd-7aaa-4976-bf29-6d9ed08c08e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:54.533387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-45043ddd-7aaa-4976-bf29-6d9ed08c08e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:54.534933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-45043ddd-7aaa-4976-bf29-6d9ed08c08e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:54.547693 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-45043ddd-7aaa-4976-bf29-6d9ed08c08e8 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1280 microversion: 2.25 time: 0.520508 Aug 02 06:53:54.548630 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1061/2015] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:54 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1280 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:54.553550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bd2755af-dd3d-41a2-8d80-85d16988b980 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:54.556565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bd2755af-dd3d-41a2-8d80-85d16988b980 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:54.570446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd2755af-dd3d-41a2-8d80-85d16988b980 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:54.573515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd2755af-dd3d-41a2-8d80-85d16988b980 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:54.574591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd2755af-dd3d-41a2-8d80-85d16988b980 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:54.578289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd2755af-dd3d-41a2-8d80-85d16988b980 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:54.586073 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-df86a3e5-5ce5-4b29-8ec6-79efa7e13efb tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/b7ddee63-86ba-4532-a492-367f56b817a0" status: 202 len: 0 microversion: 2.1 time: 1.626618 Aug 02 06:53:54.586800 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 955/2016] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:53:52 2022] DELETE /compute/v2.1/os-security-groups/b7ddee63-86ba-4532-a492-367f56b817a0 => generated 0 bytes in 1628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:53:54.967752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bb2d831e-523c-4a86-8d86-28bcee0938c2 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Action: 'create', calling method: .version_select at 0x7f927ab10a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1705510694", "description": "tempest-description-169357550"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:55.097679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bd2755af-dd3d-41a2-8d80-85d16988b980 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:55.124173 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bd2755af-dd3d-41a2-8d80-85d16988b980 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1470 microversion: 2.1 time: 0.574201 Aug 02 06:53:55.125128 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1062/2017] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:54 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1470 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:55.143362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b01b7020-555b-4fe3-926d-f0cb0971d815 req-36ff34e5-3f18-4038-9cea-d0ed8a483970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303b535b-cea0-4219-ad1b-3849b9042a53", "name": "network-vif-unplugged", "status": "completed", "tag": "78a224c6-e169-4c15-906f-64fc36ce7044"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:55.182562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b01b7020-555b-4fe3-926d-f0cb0971d815 req-36ff34e5-3f18-4038-9cea-d0ed8a483970 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:55.183073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b01b7020-555b-4fe3-926d-f0cb0971d815 req-36ff34e5-3f18-4038-9cea-d0ed8a483970 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:55.231917 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b01b7020-555b-4fe3-926d-f0cb0971d815 req-36ff34e5-3f18-4038-9cea-d0ed8a483970 service nova] Creating event network-vif-unplugged:78a224c6-e169-4c15-906f-64fc36ce7044 for instance 303b535b-cea0-4219-ad1b-3849b9042a53 on n-h2-851337-3 Aug 02 06:53:55.252829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-b01b7020-555b-4fe3-926d-f0cb0971d815 req-36ff34e5-3f18-4038-9cea-d0ed8a483970 service nova] Instance 303b535b-cea0-4219-ad1b-3849b9042a53 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 06:53:55.298427 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b01b7020-555b-4fe3-926d-f0cb0971d815 req-36ff34e5-3f18-4038-9cea-d0ed8a483970 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171180 Aug 02 06:53:55.299050 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1063/2018] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:55.307637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c635fd8e-50fb-4534-85b5-dc842d9d22e1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:55.314934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c635fd8e-50fb-4534-85b5-dc842d9d22e1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:55.333697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c635fd8e-50fb-4534-85b5-dc842d9d22e1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:55.334469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c635fd8e-50fb-4534-85b5-dc842d9d22e1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:55.335424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c635fd8e-50fb-4534-85b5-dc842d9d22e1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:55.336031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c635fd8e-50fb-4534-85b5-dc842d9d22e1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:55.378062 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-c635fd8e-50fb-4534-85b5-dc842d9d22e1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c635fd8e-50fb-4534-85b5-dc842d9d22e1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 HTTP/1.1 Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '8ba796c7-da1f-4aa8-9dce-014658905cc4'} Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:53:55.380141 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:53:55.387250 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:55.387250 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:55.387250 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:55.387250 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:55.387250 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:55.387250 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:55.387250 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:55.387250 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:55.387250 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:55.387250 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:55.387250 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:55.388973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c635fd8e-50fb-4534-85b5-dc842d9d22e1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 404 to user: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:55.390113 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c635fd8e-50fb-4534-85b5-dc842d9d22e1 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 404 len: 111 microversion: 2.1 time: 0.086727 Aug 02 06:53:55.394579 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1064/2019] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:53:55 2022] DELETE /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:53:55.400238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-99c0f999-47a9-40e4-843f-45fd9d2da65d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:55.401049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-99c0f999-47a9-40e4-843f-45fd9d2da65d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:55.407675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99c0f999-47a9-40e4-843f-45fd9d2da65d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:55.408378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99c0f999-47a9-40e4-843f-45fd9d2da65d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:55.409362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99c0f999-47a9-40e4-843f-45fd9d2da65d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:55.409993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99c0f999-47a9-40e4-843f-45fd9d2da65d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:55.608050 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bb2d831e-523c-4a86-8d86-28bcee0938c2 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.019634 Aug 02 06:53:55.609421 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 956/2020] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:53:54 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:55.616169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c78e6e2a-3084-4be6-8ca2-fd3ba1ee1de1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927ab10820>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:55.682257 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c78e6e2a-3084-4be6-8ca2-fd3ba1ee1de1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.071505 Aug 02 06:53:55.683488 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 957/2021] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:55 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:55.688787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-425fcd67-ae5f-4226-82e6-6d0834e538f5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:55.689577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-425fcd67-ae5f-4226-82e6-6d0834e538f5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 8ba796c7-da1f-4aa8-9dce-014658905cc4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:55.696145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-425fcd67-ae5f-4226-82e6-6d0834e538f5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:55.696829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-425fcd67-ae5f-4226-82e6-6d0834e538f5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:55.697781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-425fcd67-ae5f-4226-82e6-6d0834e538f5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:55.698408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-425fcd67-ae5f-4226-82e6-6d0834e538f5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:55.715920 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-425fcd67-ae5f-4226-82e6-6d0834e538f5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-425fcd67-ae5f-4226-82e6-6d0834e538f5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 HTTP/1.1 Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '8ba796c7-da1f-4aa8-9dce-014658905cc4'} Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:55.717996 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:55.724331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:55.724331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:55.724331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:55.724331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:55.724331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:55.724331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. Aug 02 06:53:55.724331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:55.726591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-425fcd67-ae5f-4226-82e6-6d0834e538f5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 404 to user: Instance 8ba796c7-da1f-4aa8-9dce-014658905cc4 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:55.727694 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-425fcd67-ae5f-4226-82e6-6d0834e538f5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4" status: 404 len: 111 microversion: 2.1 time: 0.043037 Aug 02 06:53:55.728866 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 958/2022] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:55 2022] GET /compute/v2.1/servers/8ba796c7-da1f-4aa8-9dce-014658905cc4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:53:55.736127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fea85277-db6d-469e-8ccf-628314dabe41 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:55.737074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fea85277-db6d-469e-8ccf-628314dabe41 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:55.744271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea85277-db6d-469e-8ccf-628314dabe41 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:55.745056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea85277-db6d-469e-8ccf-628314dabe41 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:55.746149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea85277-db6d-469e-8ccf-628314dabe41 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:55.746830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea85277-db6d-469e-8ccf-628314dabe41 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:55.892524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-99c0f999-47a9-40e4-843f-45fd9d2da65d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:55.904392 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-99c0f999-47a9-40e4-843f-45fd9d2da65d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1354 microversion: 2.1 time: 0.508273 Aug 02 06:53:55.917923 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1065/2023] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:55 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1354 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:55.917923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-51bc74f2-48d6-4061-a2ee-835621f0246e tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Action: 'create', calling method: .version_select at 0x7f927a7a0b80>, body: {"security_group_rule": {"parent_group_id": "0ac38155-988c-49b8-a86f-f9804b5f003f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:56.030905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fea85277-db6d-469e-8ccf-628314dabe41 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:56.040719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fea85277-db6d-469e-8ccf-628314dabe41 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:56.050853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fea85277-db6d-469e-8ccf-628314dabe41 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:56.056578 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fea85277-db6d-469e-8ccf-628314dabe41 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1280 microversion: 2.25 time: 0.325168 Aug 02 06:53:56.067302 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 959/2024] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:55 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1280 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:56.093550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bdda96f6-fb29-4d55-915f-a99a45e9138f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927aad7820>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:56.193926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG neutronclient.v2_0.client [None req-bdda96f6-fb29-4d55-915f-a99a45e9138f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 does not exist", "detail": ""}} {{(pid=126119) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:53:56.194872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.security_group_api [None req-bdda96f6-fb29-4d55-915f-a99a45e9138f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Neutron security group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 not found {{(pid=126119) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 06:53:56.195715 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-bdda96f6-fb29-4d55-915f-a99a45e9138f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Security group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 does not exist Aug 02 06:53:56.195715 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-1311a928-aa94-465c-97e5-09f7ecdbe5b7'] Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bdda96f6-fb29-4d55-915f-a99a45e9138f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/os-security-groups/6d2a237f-e7af-4c6a-88a9-d3a33facca84 HTTP/1.1 Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: exception: Security group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 does not exist Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-1311a928-aa94-465c-97e5-09f7ecdbe5b7'] Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '6d2a237f-e7af-4c6a-88a9-d3a33facca84'} Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:53:56.205562 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 does not exist Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1311a928-aa94-465c-97e5-09f7ecdbe5b7'] Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 does not exist Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1311a928-aa94-465c-97e5-09f7ecdbe5b7'] Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 does not exist Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1311a928-aa94-465c-97e5-09f7ecdbe5b7'] Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 does not exist Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1311a928-aa94-465c-97e5-09f7ecdbe5b7'] Aug 02 06:53:56.212516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.223082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bdda96f6-fb29-4d55-915f-a99a45e9138f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 404 to user: Security group 6d2a237f-e7af-4c6a-88a9-d3a33facca84 does not exist Aug 02 06:53:56.223082 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-1311a928-aa94-465c-97e5-09f7ecdbe5b7'] {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:56.224512 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bdda96f6-fb29-4d55-915f-a99a45e9138f tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/6d2a237f-e7af-4c6a-88a9-d3a33facca84" status: 404 len: 194 microversion: 2.1 time: 0.145485 Aug 02 06:53:56.230124 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 960/2025] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:53:56 2022] DELETE /compute/v2.1/os-security-groups/6d2a237f-e7af-4c6a-88a9-d3a33facca84 => generated 194 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:53:56.235613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-fc84325c-be99-4248-919d-06c3064893c4 req-530fc5b1-142c-4222-a621-ea2d353e2736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea28a98b-bb58-40e2-8a62-635a752c0ecf", "name": "network-vif-plugged", "status": "completed", "tag": "1c4033a4-9151-4c28-8690-54f55ef35bc7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:56.307766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fc84325c-be99-4248-919d-06c3064893c4 req-530fc5b1-142c-4222-a621-ea2d353e2736 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:56.308396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fc84325c-be99-4248-919d-06c3064893c4 req-530fc5b1-142c-4222-a621-ea2d353e2736 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:56.328335 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-fc84325c-be99-4248-919d-06c3064893c4 req-530fc5b1-142c-4222-a621-ea2d353e2736 service nova] Creating event network-vif-plugged:1c4033a4-9151-4c28-8690-54f55ef35bc7 for instance ea28a98b-bb58-40e2-8a62-635a752c0ecf on n-h2-851337-3 Aug 02 06:53:56.342990 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-fc84325c-be99-4248-919d-06c3064893c4 req-530fc5b1-142c-4222-a621-ea2d353e2736 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110597 Aug 02 06:53:56.345682 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 961/2026] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:56.351369 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-51bc74f2-48d6-4061-a2ee-835621f0246e tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.443433 Aug 02 06:53:56.353348 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1066/2027] 10.222.0.79 () {60 vars in 1195 bytes} [Tue Aug 2 06:53:55 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:56.354664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb4c0ce7-f8e9-4495-8beb-48ec99e74a14 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:56.359827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cb4c0ce7-f8e9-4495-8beb-48ec99e74a14 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:56.363577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a209d258-3778-422c-a705-b0da1543cc55 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927a82f280>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:56.368383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb4c0ce7-f8e9-4495-8beb-48ec99e74a14 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:56.369092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb4c0ce7-f8e9-4495-8beb-48ec99e74a14 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:56.370182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb4c0ce7-f8e9-4495-8beb-48ec99e74a14 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:56.370608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb4c0ce7-f8e9-4495-8beb-48ec99e74a14 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:56.412357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG neutronclient.v2_0.client [None req-a209d258-3778-422c-a705-b0da1543cc55 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 11669366-4dc6-482e-be48-69add67ea1b2 does not exist", "detail": ""}} {{(pid=126120) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:53:56.413224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.security_group_api [None req-a209d258-3778-422c-a705-b0da1543cc55 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Neutron security group 11669366-4dc6-482e-be48-69add67ea1b2 not found {{(pid=126120) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 06:53:56.413996 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-a209d258-3778-422c-a705-b0da1543cc55 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Security group 11669366-4dc6-482e-be48-69add67ea1b2 does not exist Aug 02 06:53:56.413996 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-1a922945-eaa0-400a-a225-60f5fe5e5deb'] Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a209d258-3778-422c-a705-b0da1543cc55 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-security-groups/11669366-4dc6-482e-be48-69add67ea1b2 HTTP/1.1 Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: exception: Security group 11669366-4dc6-482e-be48-69add67ea1b2 does not exist Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-1a922945-eaa0-400a-a225-60f5fe5e5deb'] Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '11669366-4dc6-482e-be48-69add67ea1b2'} Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:53:56.416557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 11669366-4dc6-482e-be48-69add67ea1b2 does not exist Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a922945-eaa0-400a-a225-60f5fe5e5deb'] Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 11669366-4dc6-482e-be48-69add67ea1b2 does not exist Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a922945-eaa0-400a-a225-60f5fe5e5deb'] Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 11669366-4dc6-482e-be48-69add67ea1b2 does not exist Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a922945-eaa0-400a-a225-60f5fe5e5deb'] Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 11669366-4dc6-482e-be48-69add67ea1b2 does not exist Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a922945-eaa0-400a-a225-60f5fe5e5deb'] Aug 02 06:53:56.422739 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.431327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a209d258-3778-422c-a705-b0da1543cc55 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 404 to user: Security group 11669366-4dc6-482e-be48-69add67ea1b2 does not exist Aug 02 06:53:56.431327 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-1a922945-eaa0-400a-a225-60f5fe5e5deb'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:56.433178 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a209d258-3778-422c-a705-b0da1543cc55 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/11669366-4dc6-482e-be48-69add67ea1b2" status: 404 len: 194 microversion: 2.1 time: 0.078516 Aug 02 06:53:56.435006 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1067/2028] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:53:56 2022] DELETE /compute/v2.1/os-security-groups/11669366-4dc6-482e-be48-69add67ea1b2 => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:53:56.443762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-312b5b1f-2838-4920-aa84-8fba2450b681 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Action: 'create', calling method: .version_select at 0x7f927a7bd0d0>, body: {"security_group_rule": {"parent_group_id": "0ac38155-988c-49b8-a86f-f9804b5f003f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:56.573347 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-312b5b1f-2838-4920-aa84-8fba2450b681 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] HTTP exception thrown: This rule already exists in group 0ac38155-988c-49b8-a86f-f9804b5f003f Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-312b5b1f-2838-4920-aa84-8fba2450b681 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Request method failure captured: Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 138 Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MoBKI9D0R1EIHCvCT5W0FPDKQcKUZVMrx_sCcZGX7XuNZTbzCdNvOJANXat188JVruFSQ7zxmXy1bUnShfdaDRfC-Ugs3dOJyx7i_WFruNetKxmttodxeUjyEZV0e5p95tlesIauYVLa9jBLBzgb1gU3rseg04-3c2EKi8SYblkYJ0 Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}] Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 94dddde725c148d48907a443121c324f Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: {"security_group_rule": {"parent_group_id": "0ac38155-988c-49b8-a86f-f9804b5f003f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: exception: This rule already exists in group 0ac38155-988c-49b8-a86f-f9804b5f003f Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0ac38155-988c-49b8-a86f-f9804b5f003f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 0ac38155-988c-49b8-a86f-f9804b5f003f Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 0ac38155-988c-49b8-a86f-f9804b5f003f Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:56.575252 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:56.579979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:56.579979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:56.579979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 0ac38155-988c-49b8-a86f-f9804b5f003f Aug 02 06:53:56.579979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.583015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-312b5b1f-2838-4920-aa84-8fba2450b681 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Returning 400 to user: This rule already exists in group 0ac38155-988c-49b8-a86f-f9804b5f003f {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:56.584166 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-312b5b1f-2838-4920-aa84-8fba2450b681 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.147498 Aug 02 06:53:56.585022 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1068/2029] 10.222.0.79 () {60 vars in 1195 bytes} [Tue Aug 2 06:53:56 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:53:56.601521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b7a12f0-b22e-4a03-8905-7eb23fe994a2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927a7d0a60>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:56.602905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cb4c0ce7-f8e9-4495-8beb-48ec99e74a14 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:56.606945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:56.611673 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cb4c0ce7-f8e9-4495-8beb-48ec99e74a14 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1470 microversion: 2.1 time: 0.264174 Aug 02 06:53:56.613311 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 962/2030] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:56 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:56.645480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-864cc807-c266-4661-8c4c-652189a0e487 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Calling method '.version_select at 0x7f927ac53790>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:56.670446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG neutronclient.v2_0.client [None req-7b7a12f0-b22e-4a03-8905-7eb23fe994a2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist", "detail": ""}} {{(pid=126120) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:53:56.671037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.security_group_api [None req-7b7a12f0-b22e-4a03-8905-7eb23fe994a2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Neutron security group 7f274577-c614-4b4e-85d1-035a6ca1da96 not found {{(pid=126120) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 06:53:56.671624 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-7b7a12f0-b22e-4a03-8905-7eb23fe994a2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist Aug 02 06:53:56.671624 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-0b2ecdc9-37e0-4ef9-91ec-e115956c0db2'] Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b7a12f0-b22e-4a03-8905-7eb23fe994a2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-security-groups/7f274577-c614-4b4e-85d1-035a6ca1da96 HTTP/1.1 Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: exception: Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-0b2ecdc9-37e0-4ef9-91ec-e115956c0db2'] Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '7f274577-c614-4b4e-85d1-035a6ca1da96'} Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:53:56.673493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b2ecdc9-37e0-4ef9-91ec-e115956c0db2'] Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b2ecdc9-37e0-4ef9-91ec-e115956c0db2'] Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b2ecdc9-37e0-4ef9-91ec-e115956c0db2'] Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b2ecdc9-37e0-4ef9-91ec-e115956c0db2'] Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b7a12f0-b22e-4a03-8905-7eb23fe994a2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 404 to user: Security group 7f274577-c614-4b4e-85d1-035a6ca1da96 does not exist Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-0b2ecdc9-37e0-4ef9-91ec-e115956c0db2'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b7a12f0-b22e-4a03-8905-7eb23fe994a2 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/7f274577-c614-4b4e-85d1-035a6ca1da96" status: 404 len: 194 microversion: 2.1 time: 0.085775 Aug 02 06:53:56.679549 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1069/2031] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:53:56 2022] DELETE /compute/v2.1/os-security-groups/7f274577-c614-4b4e-85d1-035a6ca1da96 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:53:56.687287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3a03f498-18ad-4997-886b-e80c0d839fa5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927a7a0af0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:56.728564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG neutronclient.v2_0.client [None req-3a03f498-18ad-4997-886b-e80c0d839fa5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist", "detail": ""}} {{(pid=126120) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:53:56.729176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.security_group_api [None req-3a03f498-18ad-4997-886b-e80c0d839fa5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Neutron security group f63a29d3-61c9-4cd5-8948-3ac0668a871a not found {{(pid=126120) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 06:53:56.729699 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-3a03f498-18ad-4997-886b-e80c0d839fa5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist Aug 02 06:53:56.729699 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-db5a684d-beeb-410d-a210-dd5bc4e77f3b'] Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3a03f498-18ad-4997-886b-e80c0d839fa5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-security-groups/f63a29d3-61c9-4cd5-8948-3ac0668a871a HTTP/1.1 Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: exception: Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-db5a684d-beeb-410d-a210-dd5bc4e77f3b'] Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'f63a29d3-61c9-4cd5-8948-3ac0668a871a'} Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:53:56.731839 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db5a684d-beeb-410d-a210-dd5bc4e77f3b'] Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db5a684d-beeb-410d-a210-dd5bc4e77f3b'] Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db5a684d-beeb-410d-a210-dd5bc4e77f3b'] Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db5a684d-beeb-410d-a210-dd5bc4e77f3b'] Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3a03f498-18ad-4997-886b-e80c0d839fa5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 404 to user: Security group f63a29d3-61c9-4cd5-8948-3ac0668a871a does not exist Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-db5a684d-beeb-410d-a210-dd5bc4e77f3b'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3a03f498-18ad-4997-886b-e80c0d839fa5 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/f63a29d3-61c9-4cd5-8948-3ac0668a871a" status: 404 len: 194 microversion: 2.1 time: 0.051704 Aug 02 06:53:56.737716 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1070/2032] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:53:56 2022] DELETE /compute/v2.1/os-security-groups/f63a29d3-61c9-4cd5-8948-3ac0668a871a => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:53:56.745960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-30301cca-eca8-4867-a54b-96376425e4a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a7d08b0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:56.865464 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-30301cca-eca8-4867-a54b-96376425e4a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.128206 Aug 02 06:53:56.866163 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1071/2033] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:56 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:56.885101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9dbfd2de-92ea-43b3-a59e-e97111cdcbb9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927a7a0b80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:57.020508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG neutronclient.v2_0.client [None req-9dbfd2de-92ea-43b3-a59e-e97111cdcbb9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist", "detail": ""}} {{(pid=126120) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:53:57.021386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.security_group_api [None req-9dbfd2de-92ea-43b3-a59e-e97111cdcbb9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Neutron security group 4866f524-4f82-42e9-a812-5febee877d0b not found {{(pid=126120) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 06:53:57.022111 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-9dbfd2de-92ea-43b3-a59e-e97111cdcbb9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist Aug 02 06:53:57.022111 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-67ebc072-609b-438a-b24a-836be45c927d'] Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9dbfd2de-92ea-43b3-a59e-e97111cdcbb9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-security-groups/4866f524-4f82-42e9-a812-5febee877d0b HTTP/1.1 Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: exception: Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-67ebc072-609b-438a-b24a-836be45c927d'] Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '4866f524-4f82-42e9-a812-5febee877d0b'} Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:53:57.024420 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67ebc072-609b-438a-b24a-836be45c927d'] Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67ebc072-609b-438a-b24a-836be45c927d'] Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67ebc072-609b-438a-b24a-836be45c927d'] Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67ebc072-609b-438a-b24a-836be45c927d'] Aug 02 06:53:57.030340 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:53:57.036156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9dbfd2de-92ea-43b3-a59e-e97111cdcbb9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 404 to user: Security group 4866f524-4f82-42e9-a812-5febee877d0b does not exist Aug 02 06:53:57.036156 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-67ebc072-609b-438a-b24a-836be45c927d'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:57.036722 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9dbfd2de-92ea-43b3-a59e-e97111cdcbb9 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/4866f524-4f82-42e9-a812-5febee877d0b" status: 404 len: 194 microversion: 2.1 time: 0.162152 Aug 02 06:53:57.037513 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1072/2034] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:53:56 2022] DELETE /compute/v2.1/os-security-groups/4866f524-4f82-42e9-a812-5febee877d0b => generated 194 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:53:57.059965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ea7b68f4-90f6-452c-9aed-4f967b3fbc3f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:57.065341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ea7b68f4-90f6-452c-9aed-4f967b3fbc3f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:57.071627 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-864cc807-c266-4661-8c4c-652189a0e487 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-group-rules/8532378e-c990-4e5a-bcbf-19435dc15ecf" status: 202 len: 0 microversion: 2.1 time: 0.438551 Aug 02 06:53:57.072538 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 963/2035] 10.222.0.79 () {58 vars in 1287 bytes} [Tue Aug 2 06:53:56 2022] DELETE /compute/v2.1/os-security-group-rules/8532378e-c990-4e5a-bcbf-19435dc15ecf => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:53:57.078223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c555f07a-889c-4a15-99c1-3a27108c68bd tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927aacbd30>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:57.078728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea7b68f4-90f6-452c-9aed-4f967b3fbc3f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:57.079260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea7b68f4-90f6-452c-9aed-4f967b3fbc3f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:57.080121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea7b68f4-90f6-452c-9aed-4f967b3fbc3f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:57.080651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea7b68f4-90f6-452c-9aed-4f967b3fbc3f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:57.131310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:57.139193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG neutronclient.v2_0.client [None req-c555f07a-889c-4a15-99c1-3a27108c68bd tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist", "detail": ""}} {{(pid=126119) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:53:57.140135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.security_group_api [None req-c555f07a-889c-4a15-99c1-3a27108c68bd tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Neutron security group 223951ac-e88b-4052-a290-c150001f5f7e not found {{(pid=126119) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 06:53:57.140901 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-c555f07a-889c-4a15-99c1-3a27108c68bd tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist Aug 02 06:53:57.140901 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-ceb469ef-839b-438a-bd4a-00bea3077f77'] Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c555f07a-889c-4a15-99c1-3a27108c68bd tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/os-security-groups/223951ac-e88b-4052-a290-c150001f5f7e HTTP/1.1 Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: exception: Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-ceb469ef-839b-438a-bd4a-00bea3077f77'] Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '223951ac-e88b-4052-a290-c150001f5f7e'} Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:53:57.143384 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ceb469ef-839b-438a-bd4a-00bea3077f77'] Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ceb469ef-839b-438a-bd4a-00bea3077f77'] Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ceb469ef-839b-438a-bd4a-00bea3077f77'] Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ceb469ef-839b-438a-bd4a-00bea3077f77'] Aug 02 06:53:57.148057 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:57.158262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c555f07a-889c-4a15-99c1-3a27108c68bd tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 404 to user: Security group 223951ac-e88b-4052-a290-c150001f5f7e does not exist Aug 02 06:53:57.158262 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-ceb469ef-839b-438a-bd4a-00bea3077f77'] {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:57.159578 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c555f07a-889c-4a15-99c1-3a27108c68bd tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/223951ac-e88b-4052-a290-c150001f5f7e" status: 404 len: 194 microversion: 2.1 time: 0.085791 Aug 02 06:53:57.161235 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 964/2036] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:53:57 2022] DELETE /compute/v2.1/os-security-groups/223951ac-e88b-4052-a290-c150001f5f7e => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:53:57.187079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d049e021-220a-4db1-b285-197d7c7ea38a tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Action: 'create', calling method: .version_select at 0x7f927ab7d3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-402438967", "description": "tempest-description-1886594491"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:57.396080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ea7b68f4-90f6-452c-9aed-4f967b3fbc3f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:57.406824 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ea7b68f4-90f6-452c-9aed-4f967b3fbc3f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1354 microversion: 2.1 time: 0.368081 Aug 02 06:53:57.407413 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1073/2037] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:57 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1354 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:57.427883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8e502bc5-52c5-4c40-b64d-3737981c80dc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:57.440371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8e502bc5-52c5-4c40-b64d-3737981c80dc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:57.478987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e502bc5-52c5-4c40-b64d-3737981c80dc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:57.479744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e502bc5-52c5-4c40-b64d-3737981c80dc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:57.480925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e502bc5-52c5-4c40-b64d-3737981c80dc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:57.482080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e502bc5-52c5-4c40-b64d-3737981c80dc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:57.848004 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d049e021-220a-4db1-b285-197d7c7ea38a tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.685201 Aug 02 06:53:57.849625 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 965/2038] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:53:57 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:57.855213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7147bf4f-8191-463d-8aa6-f4017143a9cc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:57.856021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7147bf4f-8191-463d-8aa6-f4017143a9cc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:57.871711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7147bf4f-8191-463d-8aa6-f4017143a9cc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:57.873490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7147bf4f-8191-463d-8aa6-f4017143a9cc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:57.877282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7147bf4f-8191-463d-8aa6-f4017143a9cc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:57.878678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7147bf4f-8191-463d-8aa6-f4017143a9cc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:57.918856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8e502bc5-52c5-4c40-b64d-3737981c80dc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:57.929995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8e502bc5-52c5-4c40-b64d-3737981c80dc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:57.935770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8e502bc5-52c5-4c40-b64d-3737981c80dc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:57.938908 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8e502bc5-52c5-4c40-b64d-3737981c80dc tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1280 microversion: 2.25 time: 0.530541 Aug 02 06:53:57.947707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7147bf4f-8191-463d-8aa6-f4017143a9cc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:53:57.957609 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1074/2039] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:57 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1280 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:53:57.969217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-9263e38d-6c90-4cbd-8179-4f98a3e22ce6 req-bf4a5d95-1fbe-4793-b8f0-e6f402affdaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "303b535b-cea0-4219-ad1b-3849b9042a53", "tag": "78a224c6-e169-4c15-906f-64fc36ce7044"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:57.989630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9263e38d-6c90-4cbd-8179-4f98a3e22ce6 req-bf4a5d95-1fbe-4793-b8f0-e6f402affdaa service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:57.990416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9263e38d-6c90-4cbd-8179-4f98a3e22ce6 req-bf4a5d95-1fbe-4793-b8f0-e6f402affdaa service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:58.020876 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-9263e38d-6c90-4cbd-8179-4f98a3e22ce6 req-bf4a5d95-1fbe-4793-b8f0-e6f402affdaa service nova] Creating event network-changed:78a224c6-e169-4c15-906f-64fc36ce7044 for instance 303b535b-cea0-4219-ad1b-3849b9042a53 on n-h2-851337-3 Aug 02 06:53:58.060734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-9263e38d-6c90-4cbd-8179-4f98a3e22ce6 req-bf4a5d95-1fbe-4793-b8f0-e6f402affdaa service nova] Instance 303b535b-cea0-4219-ad1b-3849b9042a53 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 06:53:58.090041 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-9263e38d-6c90-4cbd-8179-4f98a3e22ce6 req-bf4a5d95-1fbe-4793-b8f0-e6f402affdaa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130595 Aug 02 06:53:58.092045 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1075/2040] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:58.110574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f95e5ee3-950c-420e-b3f0-c8591ea99408 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:58.113463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f95e5ee3-950c-420e-b3f0-c8591ea99408 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:58.130670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f95e5ee3-950c-420e-b3f0-c8591ea99408 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:58.131638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f95e5ee3-950c-420e-b3f0-c8591ea99408 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:58.132707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f95e5ee3-950c-420e-b3f0-c8591ea99408 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:58.133501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f95e5ee3-950c-420e-b3f0-c8591ea99408 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:58.219349 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7147bf4f-8191-463d-8aa6-f4017143a9cc tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 204 len: 0 microversion: 2.1 time: 0.367740 Aug 02 06:53:58.220203 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 966/2041] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:53:57 2022] DELETE /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:53:58.232447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c2a11ec1-a514-43da-ba5b-611110c1ac36 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Action: 'create', calling method: .version_select at 0x7f927abc5550>, body: {"security_group_rule": {"parent_group_id": "f57cb059-aaca-414e-9439-0be4e5c5c73d", "ip_protocol": "tcp", "from_port": 1145790523, "to_port": 22}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:58.721506 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-c2a11ec1-a514-43da-ba5b-611110c1ac36 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] HTTP exception thrown: Invalid port range 1145790523:22. Former value cannot be greater than the later Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c2a11ec1-a514-43da-ba5b-611110c1ac36 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Request method failure captured: Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 146 Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MoBKI9D0R1EIHCvCT5W0FPDKQcKUZVMrx_sCcZGX7XuNZTbzCdNvOJANXat188JVruFSQ7zxmXy1bUnShfdaDRfC-Ugs3dOJyx7i_WFruNetKxmttodxeUjyEZV0e5p95tlesIauYVLa9jBLBzgb1gU3rseg04-3c2EKi8SYblkYJ0 Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}] Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 94dddde725c148d48907a443121c324f Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: {"security_group_rule": {"parent_group_id": "f57cb059-aaca-414e-9439-0be4e5c5c73d", "ip_protocol": "tcp", "from_port": 1145790523, "to_port": 22}} Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid port range 1145790523:22. Former value cannot be greater than the later Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f57cb059-aaca-414e-9439-0be4e5c5c73d', 'ip_protocol': 'tcp', 'from_port': 1145790523, 'to_port': 22}}} Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1145790523:22. Former value cannot be greater than the later Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1145790523:22. Former value cannot be greater than the later Aug 02 06:53:58.725804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:58.731929 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:58.731929 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:58.731929 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:58.731929 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:58.731929 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:58.731929 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:58.731929 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:58.731929 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1145790523:22. Former value cannot be greater than the later Aug 02 06:53:58.731929 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:58.731929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c2a11ec1-a514-43da-ba5b-611110c1ac36 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Returning 400 to user: Invalid port range 1145790523:22. Former value cannot be greater than the later {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:58.733776 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c2a11ec1-a514-43da-ba5b-611110c1ac36 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.511131 Aug 02 06:53:58.733776 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 967/2042] 10.222.0.79 () {60 vars in 1195 bytes} [Tue Aug 2 06:53:58 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 513 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:53:58.751256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72a39bc3-6735-4204-982c-3f5524a7b897 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927ab7d9d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:58.755975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f95e5ee3-950c-420e-b3f0-c8591ea99408 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:58.765769 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f95e5ee3-950c-420e-b3f0-c8591ea99408 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1470 microversion: 2.1 time: 0.668818 Aug 02 06:53:58.767191 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1076/2043] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:58 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1470 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:58.779495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d144709f-dbf8-4427-ac78-e1640346516e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:58.780401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d144709f-dbf8-4427-ac78-e1640346516e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:58.787908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:53:58.790855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d144709f-dbf8-4427-ac78-e1640346516e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:58.791782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d144709f-dbf8-4427-ac78-e1640346516e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:58.793157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d144709f-dbf8-4427-ac78-e1640346516e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:58.794108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d144709f-dbf8-4427-ac78-e1640346516e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:58.878914 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-72a39bc3-6735-4204-982c-3f5524a7b897 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.144096 Aug 02 06:53:58.879507 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 968/2044] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:53:58 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:58.909154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-267b61ef-357c-47d0-978a-f577a9a2b1aa req-75196dcb-6991-4cc2-a97f-71bdfb7eb55c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea28a98b-bb58-40e2-8a62-635a752c0ecf", "name": "network-vif-plugged", "status": "completed", "tag": "3083d4a4-9271-433f-b15d-aa9d26b3f2ec"}, {"server_uuid": "ea28a98b-bb58-40e2-8a62-635a752c0ecf", "name": "network-vif-plugged", "status": "completed", "tag": "51402711-5427-41b3-8ae6-77cfbc3a0afc"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:58.943648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-267b61ef-357c-47d0-978a-f577a9a2b1aa req-75196dcb-6991-4cc2-a97f-71bdfb7eb55c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:58.944476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-267b61ef-357c-47d0-978a-f577a9a2b1aa req-75196dcb-6991-4cc2-a97f-71bdfb7eb55c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:58.960085 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-267b61ef-357c-47d0-978a-f577a9a2b1aa req-75196dcb-6991-4cc2-a97f-71bdfb7eb55c service nova] Creating event network-vif-plugged:3083d4a4-9271-433f-b15d-aa9d26b3f2ec for instance ea28a98b-bb58-40e2-8a62-635a752c0ecf on n-h2-851337-3 Aug 02 06:53:58.961088 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-267b61ef-357c-47d0-978a-f577a9a2b1aa req-75196dcb-6991-4cc2-a97f-71bdfb7eb55c service nova] Creating event network-vif-plugged:51402711-5427-41b3-8ae6-77cfbc3a0afc for instance ea28a98b-bb58-40e2-8a62-635a752c0ecf on n-h2-851337-3 Aug 02 06:53:58.987291 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-267b61ef-357c-47d0-978a-f577a9a2b1aa req-75196dcb-6991-4cc2-a97f-71bdfb7eb55c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099703 Aug 02 06:53:58.988962 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 969/2045] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:53:58.994967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5cf949bc-7655-4510-bac6-c43960080821 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:58.997767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5cf949bc-7655-4510-bac6-c43960080821 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:59.018067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cf949bc-7655-4510-bac6-c43960080821 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:59.018963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cf949bc-7655-4510-bac6-c43960080821 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:59.020083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cf949bc-7655-4510-bac6-c43960080821 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:59.024394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cf949bc-7655-4510-bac6-c43960080821 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:59.817847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5cf949bc-7655-4510-bac6-c43960080821 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:53:59.843207 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5cf949bc-7655-4510-bac6-c43960080821 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1354 microversion: 2.1 time: 0.852465 Aug 02 06:53:59.847792 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 970/2046] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:58 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1354 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:53:59.866871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f1181085-3d50-4ef1-8971-fbc074fbf065 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Action: 'create', calling method: .version_select at 0x7f927ab01ca0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-936162717", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:53:59.874866 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-f1181085-3d50-4ef1-8971-fbc074fbf065 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] HTTP exception thrown: Security group id should be uuid Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f1181085-3d50-4ef1-8971-fbc074fbf065 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Request method failure captured: Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 130 Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MoBKI9D0R1EIHCvCT5W0FPDKQcKUZVMrx_sCcZGX7XuNZTbzCdNvOJANXat188JVruFSQ7zxmXy1bUnShfdaDRfC-Ugs3dOJyx7i_WFruNetKxmttodxeUjyEZV0e5p95tlesIauYVLa9jBLBzgb1gU3rseg04-3c2EKi8SYblkYJ0 Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}] Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 94dddde725c148d48907a443121c324f Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-936162717", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: exception: Security group id should be uuid Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-936162717', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:53:59.883934 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:53:59.891779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 02 06:53:59.891779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:53:59.891779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f1181085-3d50-4ef1-8971-fbc074fbf065 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Returning 400 to user: Security group id should be uuid {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:53:59.891779 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f1181085-3d50-4ef1-8971-fbc074fbf065 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.034973 Aug 02 06:53:59.902881 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 971/2047] 10.222.0.79 () {60 vars in 1195 bytes} [Tue Aug 2 06:53:59 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 02 06:53:59.908569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-62ef4d15-6dea-401e-a83a-273bd5dcfe81 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:53:59.909178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-62ef4d15-6dea-401e-a83a-273bd5dcfe81 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:53:59.939483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62ef4d15-6dea-401e-a83a-273bd5dcfe81 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:59.939930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62ef4d15-6dea-401e-a83a-273bd5dcfe81 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:53:59.940732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62ef4d15-6dea-401e-a83a-273bd5dcfe81 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:53:59.941174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62ef4d15-6dea-401e-a83a-273bd5dcfe81 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:00.027619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d144709f-dbf8-4427-ac78-e1640346516e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:00.037575 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d144709f-dbf8-4427-ac78-e1640346516e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1649 microversion: 2.1 time: 1.266670 Aug 02 06:54:00.042855 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1077/2048] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:53:58 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1649 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:00.057118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6ee67e19-7338-4b85-ab67-a143695959d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:00.059816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6ee67e19-7338-4b85-ab67-a143695959d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:00.077661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ee67e19-7338-4b85-ab67-a143695959d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:00.078271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ee67e19-7338-4b85-ab67-a143695959d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:00.082091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ee67e19-7338-4b85-ab67-a143695959d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:00.082645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ee67e19-7338-4b85-ab67-a143695959d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:00.649027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-62ef4d15-6dea-401e-a83a-273bd5dcfe81 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:00.664184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-62ef4d15-6dea-401e-a83a-273bd5dcfe81 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:00.665718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-62ef4d15-6dea-401e-a83a-273bd5dcfe81 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:00.666961 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-62ef4d15-6dea-401e-a83a-273bd5dcfe81 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1280 microversion: 2.25 time: 0.763024 Aug 02 06:54:00.681826 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 972/2049] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:53:59 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1280 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:00.699621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-88e9a3bc-d9b6-44bf-ada4-7f0e66667442 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927ab06a60>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:00.822507 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-88e9a3bc-d9b6-44bf-ada4-7f0e66667442 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.138234 Aug 02 06:54:00.828759 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 973/2050] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:54:00 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:00.845314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-87b4dac4-b43c-44ad-848e-f5572fc15147 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Action: 'create', calling method: .version_select at 0x7f927ab06430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-728142305", "description": "tempest-description-576352582"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:01.643357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6ee67e19-7338-4b85-ab67-a143695959d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:01.658480 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6ee67e19-7338-4b85-ab67-a143695959d3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1463 microversion: 2.1 time: 1.612409 Aug 02 06:54:01.659059 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1078/2051] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:00 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1463 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:01.664229 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b6d821ef-ef26-41d1-8202-fb95f4168f2d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:01.666167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b6d821ef-ef26-41d1-8202-fb95f4168f2d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:01.693042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6d821ef-ef26-41d1-8202-fb95f4168f2d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:01.693757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6d821ef-ef26-41d1-8202-fb95f4168f2d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:01.694751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6d821ef-ef26-41d1-8202-fb95f4168f2d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:01.695588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6d821ef-ef26-41d1-8202-fb95f4168f2d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:01.754171 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-87b4dac4-b43c-44ad-848e-f5572fc15147 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.923282 Aug 02 06:54:01.767675 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 974/2052] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:54:00 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:01.792304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f6368bf7-5d99-4515-9546-4d4cf996933e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:01.796705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f6368bf7-5d99-4515-9546-4d4cf996933e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:01.872614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6368bf7-5d99-4515-9546-4d4cf996933e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:01.877480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6368bf7-5d99-4515-9546-4d4cf996933e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:01.878737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6368bf7-5d99-4515-9546-4d4cf996933e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:01.885143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6368bf7-5d99-4515-9546-4d4cf996933e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:03.044033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f6368bf7-5d99-4515-9546-4d4cf996933e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac74e3e74b24a6a861fbc774fd9fab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7a54e20f2c4619b6bc10fd918cc539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:03.052624 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f6368bf7-5d99-4515-9546-4d4cf996933e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 200 len: 1649 microversion: 2.1 time: 1.283393 Aug 02 06:54:03.064097 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 975/2053] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:01 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 1649 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:03.071369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b6d821ef-ef26-41d1-8202-fb95f4168f2d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:03.103459 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b6d821ef-ef26-41d1-8202-fb95f4168f2d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1804 microversion: 2.1 time: 1.443088 Aug 02 06:54:03.104374 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1079/2054] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:01 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1804 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:03.171948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-603afa19-c8c6-4a1d-910c-eef656733e04 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Action: 'create', calling method: .version_select at 0x7f927ab7d430>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1503972135", "policies": ["affinity"]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:03.219038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-603afa19-c8c6-4a1d-910c-eef656733e04 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:03.231102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-603afa19-c8c6-4a1d-910c-eef656733e04 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for user 8fe7395eb1c7492199b8446285b09bc2 and project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:03.261386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:03.366212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-603afa19-c8c6-4a1d-910c-eef656733e04 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:03.383652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-603afa19-c8c6-4a1d-910c-eef656733e04 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for user 8fe7395eb1c7492199b8446285b09bc2 and project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:03.421857 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-603afa19-c8c6-4a1d-910c-eef656733e04 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.365630 Aug 02 06:54:03.432500 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 976/2055] 10.222.0.79 () {60 vars in 1174 bytes} [Tue Aug 2 06:54:03 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:03.456620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8bfbe44a-2d08-4a5f-98ac-98d8624e1418 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:03.462842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8bfbe44a-2d08-4a5f-98ac-98d8624e1418 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:03.471453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bfbe44a-2d08-4a5f-98ac-98d8624e1418 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:03.474006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bfbe44a-2d08-4a5f-98ac-98d8624e1418 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:03.476638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bfbe44a-2d08-4a5f-98ac-98d8624e1418 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:03.481831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bfbe44a-2d08-4a5f-98ac-98d8624e1418 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:03.487539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a1dc7adf-9186-44c6-96f1-766888ee5a6a tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:03.488746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a1dc7adf-9186-44c6-96f1-766888ee5a6a tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:03.503466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1dc7adf-9186-44c6-96f1-766888ee5a6a tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:03.504227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1dc7adf-9186-44c6-96f1-766888ee5a6a tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:03.505235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1dc7adf-9186-44c6-96f1-766888ee5a6a tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:03.506041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1dc7adf-9186-44c6-96f1-766888ee5a6a tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:03.785342 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a1dc7adf-9186-44c6-96f1-766888ee5a6a tempest-MigrationsAdminTest-821130581 tempest-MigrationsAdminTest-821130581-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1614 microversion: 2.1 time: 0.679032 Aug 02 06:54:03.787171 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1080/2056] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:03 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1614 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:03.803515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-491bab8c-d6da-4ca7-b277-c078b72dd372 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Action: 'create', calling method: .version_select at 0x7f927a79d160>, body: {"security_group_rule": {"parent_group_id": "3247808d-5b63-4608-86d4-0e222627fe42", "ip_protocol": "tempest-999-1107116706", "from_port": 22, "to_port": 22}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:03.814601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8bfbe44a-2d08-4a5f-98ac-98d8624e1418 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:03.823757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8bfbe44a-2d08-4a5f-98ac-98d8624e1418 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:03.837617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8bfbe44a-2d08-4a5f-98ac-98d8624e1418 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:03.839556 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8bfbe44a-2d08-4a5f-98ac-98d8624e1418 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1280 microversion: 2.25 time: 0.402196 Aug 02 06:54:03.840724 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 977/2057] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:03 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1280 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:03.845719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c46a907a-32b7-494c-8423-7858f33ea842 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927ab35820>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:03.920648 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-491bab8c-d6da-4ca7-b277-c078b72dd372 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] HTTP exception thrown: Invalid IP protocol tempest-999-1107116706. Aug 02 06:54:03.920913 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c46a907a-32b7-494c-8423-7858f33ea842 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.078884 Aug 02 06:54:03.928307 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 978/2058] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:54:03 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-491bab8c-d6da-4ca7-b277-c078b72dd372 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Request method failure captured: Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 157 Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MoBKI9D0R1EIHCvCT5W0FPDKQcKUZVMrx_sCcZGX7XuNZTbzCdNvOJANXat188JVruFSQ7zxmXy1bUnShfdaDRfC-Ugs3dOJyx7i_WFruNetKxmttodxeUjyEZV0e5p95tlesIauYVLa9jBLBzgb1gU3rseg04-3c2EKi8SYblkYJ0 Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}] Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 94dddde725c148d48907a443121c324f Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: {"security_group_rule": {"parent_group_id": "3247808d-5b63-4608-86d4-0e222627fe42", "ip_protocol": "tempest-999-1107116706", "from_port": 22, "to_port": 22}} Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid IP protocol tempest-999-1107116706. Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3247808d-5b63-4608-86d4-0e222627fe42', 'ip_protocol': 'tempest-999-1107116706', 'from_port': 22, 'to_port': 22}}} Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1107116706. Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1107116706. Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:03.928480 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:03.933027 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:03.933027 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:03.933027 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:03.933027 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:03.933027 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:03.933027 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:03.933027 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1107116706. Aug 02 06:54:03.933027 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:03.933027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-491bab8c-d6da-4ca7-b277-c078b72dd372 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Returning 400 to user: Invalid IP protocol tempest-999-1107116706. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:03.933027 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-491bab8c-d6da-4ca7-b277-c078b72dd372 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.131553 Aug 02 06:54:03.933027 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1081/2059] 10.222.0.79 () {60 vars in 1195 bytes} [Tue Aug 2 06:54:03 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 02 06:54:03.933835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e68d51bb-0c43-4fc7-b136-2b5de349a775 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:03.933835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e68d51bb-0c43-4fc7-b136-2b5de349a775 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:03.935962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e68d51bb-0c43-4fc7-b136-2b5de349a775 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:03.936324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d0d3a10d-7f69-4e97-b815-52c20c53d70f tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Action: 'create', calling method: .version_select at 0x7f927a7bdc10>, body: {"server_group": {"name": "tempest-server-group-1321678897", "policies": ["affinity"]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:03.936467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e68d51bb-0c43-4fc7-b136-2b5de349a775 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:03.937252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e68d51bb-0c43-4fc7-b136-2b5de349a775 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:03.937684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e68d51bb-0c43-4fc7-b136-2b5de349a775 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:03.971920 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e68d51bb-0c43-4fc7-b136-2b5de349a775 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf/ips" status: 200 len: 218 microversion: 2.1 time: 0.048331 Aug 02 06:54:03.978793 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 979/2060] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 06:54:03 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf/ips => generated 218 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:03.978793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-fe64663f-d669-459c-beee-785adc18809b req-4d777992-6e62-41e0-b2da-33bf64119b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512a9538-20ac-4af8-8431-f19a2011b693", "name": "network-vif-deleted", "tag": "7d292896-8b1c-40f9-a7df-43b03a97eb97"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:03.983650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-d0d3a10d-7f69-4e97-b815-52c20c53d70f tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:03.990474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fe64663f-d669-459c-beee-785adc18809b req-4d777992-6e62-41e0-b2da-33bf64119b0c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:03.991080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fe64663f-d669-459c-beee-785adc18809b req-4d777992-6e62-41e0-b2da-33bf64119b0c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:03.991513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-d0d3a10d-7f69-4e97-b815-52c20c53d70f tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for user 8fe7395eb1c7492199b8446285b09bc2 and project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:04.024667 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-fe64663f-d669-459c-beee-785adc18809b req-4d777992-6e62-41e0-b2da-33bf64119b0c service nova] Creating event network-vif-deleted:7d292896-8b1c-40f9-a7df-43b03a97eb97 for instance 512a9538-20ac-4af8-8431-f19a2011b693 on n-h1-851337-3 Aug 02 06:54:04.036572 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-fe64663f-d669-459c-beee-785adc18809b req-4d777992-6e62-41e0-b2da-33bf64119b0c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062027 Aug 02 06:54:04.037557 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 980/2061] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:04.044756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7bbe33c1-d19b-47cf-ada8-439f5e57ca9d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:04.045478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7bbe33c1-d19b-47cf-ada8-439f5e57ca9d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:04.056421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bbe33c1-d19b-47cf-ada8-439f5e57ca9d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:04.058005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bbe33c1-d19b-47cf-ada8-439f5e57ca9d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:04.059065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bbe33c1-d19b-47cf-ada8-439f5e57ca9d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:04.059706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bbe33c1-d19b-47cf-ada8-439f5e57ca9d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:04.061003 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-d0d3a10d-7f69-4e97-b815-52c20c53d70f tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:04.076423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-d0d3a10d-7f69-4e97-b815-52c20c53d70f tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for user 8fe7395eb1c7492199b8446285b09bc2 and project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:04.113803 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d0d3a10d-7f69-4e97-b815-52c20c53d70f tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.183916 Aug 02 06:54:04.115449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7bbe33c1-d19b-47cf-ada8-439f5e57ca9d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:54:04.116550 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1082/2062] 10.222.0.79 () {60 vars in 1173 bytes} [Tue Aug 2 06:54:03 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:04.127646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e566be55-1c13-413a-8671-5ceb159dc501 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Action: 'create', calling method: .version_select at 0x7f927b2bca60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-83616783", "description": "tempest-description-1573999543"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:04.271228 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7bbe33c1-d19b-47cf-ada8-439f5e57ca9d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "DELETE /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 204 len: 0 microversion: 2.1 time: 0.229885 Aug 02 06:54:04.274037 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 981/2063] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:54:04 2022] DELETE /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:54:04.292919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0edb1f69-d2ef-4b74-963a-c3795489aa7b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:04.294123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0edb1f69-d2ef-4b74-963a-c3795489aa7b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:04.304175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0edb1f69-d2ef-4b74-963a-c3795489aa7b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:04.305173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0edb1f69-d2ef-4b74-963a-c3795489aa7b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:04.306355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0edb1f69-d2ef-4b74-963a-c3795489aa7b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:04.307845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0edb1f69-d2ef-4b74-963a-c3795489aa7b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:04.344570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0edb1f69-d2ef-4b74-963a-c3795489aa7b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:54:04.398107 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e566be55-1c13-413a-8671-5ceb159dc501 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.279980 Aug 02 06:54:04.398818 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1083/2064] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:54:04 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:04.411537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c25b5172-4aab-4f4f-83b2-80eb1020fb89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:04.412517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c25b5172-4aab-4f4f-83b2-80eb1020fb89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] [instance: 512a9538-20ac-4af8-8431-f19a2011b693] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:04.422289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c25b5172-4aab-4f4f-83b2-80eb1020fb89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:04.426230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c25b5172-4aab-4f4f-83b2-80eb1020fb89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:04.427943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c25b5172-4aab-4f4f-83b2-80eb1020fb89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:04.428590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c25b5172-4aab-4f4f-83b2-80eb1020fb89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:04.451445 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-c25b5172-4aab-4f4f-83b2-80eb1020fb89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] HTTP exception thrown: Instance 512a9538-20ac-4af8-8431-f19a2011b693 could not be found. Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c25b5172-4aab-4f4f-83b2-80eb1020fb89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Request method failure captured: Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 HTTP/1.1 Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmVSqiOCjhkwmuBknT1gZ_vDDLuTbPhjtsc2zyQM6OlENqpw5lGo2PKN3Pjtj9qoSkG3gAXiYZJlSbFRLLjK--Hfko_zAIJkpF3ypD_QUwknJ6da8QP9CfZ7dMz_Eprm7S84HRalc4IeaLVoVqbZS_t1Wl8fkBByzYC0NgiuyJr-Tw Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab7a54e20f2c4619b6bc10fd918cc539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab7a54e20f2c4619b6bc10fd918cc539"}]}] Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: ab7a54e20f2c4619b6bc10fd918cc539 Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1085129022 Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3ac74e3e74b24a6a861fbc774fd9fab6 Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupsTestJSON-1085129022-project Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 512a9538-20ac-4af8-8431-f19a2011b693 could not be found. Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '512a9538-20ac-4af8-8431-f19a2011b693'} Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512a9538-20ac-4af8-8431-f19a2011b693 could not be found. Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512a9538-20ac-4af8-8431-f19a2011b693 could not be found. Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:04.453556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:04.459454 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:04.459454 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:04.459454 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:04.459454 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:04.459454 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:04.459454 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512a9538-20ac-4af8-8431-f19a2011b693 could not be found. Aug 02 06:54:04.459454 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:04.459454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c25b5172-4aab-4f4f-83b2-80eb1020fb89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Returning 404 to user: Instance 512a9538-20ac-4af8-8431-f19a2011b693 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:04.459454 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c25b5172-4aab-4f4f-83b2-80eb1020fb89 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693" status: 404 len: 111 microversion: 2.1 time: 0.047417 Aug 02 06:54:04.459454 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1084/2065] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:04 2022] GET /compute/v2.1/servers/512a9538-20ac-4af8-8431-f19a2011b693 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:04.462055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-11089e34-724d-4925-b156-2d86e84ca548 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Action: 'create', calling method: .version_select at 0x7f927a79d160>, body: {"server_group": {"name": "tempest-server-group-1321678897", "policies": ["affinity"]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:04.465718 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0edb1f69-d2ef-4b74-963a-c3795489aa7b tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 204 len: 0 microversion: 2.1 time: 0.186110 Aug 02 06:54:04.470938 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 982/2066] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:54:04 2022] DELETE /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:54:04.486205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e87d1bf8-184b-4dae-bf71-d13c95f5d294 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:04.487464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e87d1bf8-184b-4dae-bf71-d13c95f5d294 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:04.506665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e87d1bf8-184b-4dae-bf71-d13c95f5d294 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:04.509993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e87d1bf8-184b-4dae-bf71-d13c95f5d294 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:04.510384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-11089e34-724d-4925-b156-2d86e84ca548 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:04.511833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e87d1bf8-184b-4dae-bf71-d13c95f5d294 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:04.513461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e87d1bf8-184b-4dae-bf71-d13c95f5d294 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:04.526363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-11089e34-724d-4925-b156-2d86e84ca548 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for user 8fe7395eb1c7492199b8446285b09bc2 and project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:04.600446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-11089e34-724d-4925-b156-2d86e84ca548 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:04.612799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-11089e34-724d-4925-b156-2d86e84ca548 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for user 8fe7395eb1c7492199b8446285b09bc2 and project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:04.629334 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-11089e34-724d-4925-b156-2d86e84ca548 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.171608 Aug 02 06:54:04.630649 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1085/2067] 10.222.0.79 () {60 vars in 1173 bytes} [Tue Aug 2 06:54:04 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:04.635236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ea8d8dc3-51f4-421a-8946-6b1cf26e0c0b req-44eff5b4-ef16-4c4e-bc34-dd7928ba3dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303b535b-cea0-4219-ad1b-3849b9042a53", "name": "network-vif-plugged", "status": "completed", "tag": "78a224c6-e169-4c15-906f-64fc36ce7044"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:04.645974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ea8d8dc3-51f4-421a-8946-6b1cf26e0c0b req-44eff5b4-ef16-4c4e-bc34-dd7928ba3dde service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:04.646530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ea8d8dc3-51f4-421a-8946-6b1cf26e0c0b req-44eff5b4-ef16-4c4e-bc34-dd7928ba3dde service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:04.660703 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ea8d8dc3-51f4-421a-8946-6b1cf26e0c0b req-44eff5b4-ef16-4c4e-bc34-dd7928ba3dde service nova] Creating event network-vif-plugged:78a224c6-e169-4c15-906f-64fc36ce7044 for instance 303b535b-cea0-4219-ad1b-3849b9042a53 on n-h2-851337-3 Aug 02 06:54:04.666624 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ea8d8dc3-51f4-421a-8946-6b1cf26e0c0b req-44eff5b4-ef16-4c4e-bc34-dd7928ba3dde service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034413 Aug 02 06:54:04.667358 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1086/2068] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:04.673415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-226670be-0b80-4355-911b-211229474839 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Action: 'create', calling method: .version_select at 0x7f927a79a430>, body: {"security_group_rule": {"parent_group_id": "39f1dc7c-6621-4879-bc08-cccd2b080dc5", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:04.737478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e87d1bf8-184b-4dae-bf71-d13c95f5d294 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:04.751349 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e87d1bf8-184b-4dae-bf71-d13c95f5d294 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1469 microversion: 2.1 time: 0.278537 Aug 02 06:54:04.754249 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 983/2069] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:04 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1469 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:04.763363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-186fe40b-33df-48cc-bef1-3cd3940ab62e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927ab355e0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:04.769635 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-226670be-0b80-4355-911b-211229474839 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-226670be-0b80-4355-911b-211229474839 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Request method failure captured: Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 138 Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MoBKI9D0R1EIHCvCT5W0FPDKQcKUZVMrx_sCcZGX7XuNZTbzCdNvOJANXat188JVruFSQ7zxmXy1bUnShfdaDRfC-Ugs3dOJyx7i_WFruNetKxmttodxeUjyEZV0e5p95tlesIauYVLa9jBLBzgb1gU3rseg04-3c2EKi8SYblkYJ0 Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}] Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 94dddde725c148d48907a443121c324f Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: {"security_group_rule": {"parent_group_id": "39f1dc7c-6621-4879-bc08-cccd2b080dc5", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'security_group_rule': {'parent_group_id': '39f1dc7c-6621-4879-bc08-cccd2b080dc5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 02 06:54:04.771357 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:04.775966 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:04.775966 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:04.775966 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:04.775966 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:04.775966 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:04.775966 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:04.775966 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:04.775966 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 02 06:54:04.775966 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:04.775966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-226670be-0b80-4355-911b-211229474839 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:04.775966 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-226670be-0b80-4355-911b-211229474839 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.104278 Aug 02 06:54:04.775966 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1087/2070] 10.222.0.79 () {60 vars in 1195 bytes} [Tue Aug 2 06:54:04 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:54:04.785530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-150cea21-0201-4ea8-b816-90bf8503443f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:04.792980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-150cea21-0201-4ea8-b816-90bf8503443f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:04.801839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-150cea21-0201-4ea8-b816-90bf8503443f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:04.802312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-150cea21-0201-4ea8-b816-90bf8503443f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:04.803580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-150cea21-0201-4ea8-b816-90bf8503443f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:04.803580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-150cea21-0201-4ea8-b816-90bf8503443f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:05.049809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-150cea21-0201-4ea8-b816-90bf8503443f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:05.062141 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-150cea21-0201-4ea8-b816-90bf8503443f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1810 microversion: 2.1 time: 0.287720 Aug 02 06:54:05.067685 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1088/2071] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:04 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1810 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:05.078827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6ef398ca-7537-4dd5-b665-c64d7595fdda tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:05.131756 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6ef398ca-7537-4dd5-b665-c64d7595fdda tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/f61c9b3b-e596-4c5b-8f4a-8d2747f38dcb" status: 204 len: 0 microversion: 2.1 time: 0.062589 Aug 02 06:54:05.134151 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1089/2072] 10.222.0.79 () {58 vars in 1266 bytes} [Tue Aug 2 06:54:05 2022] DELETE /compute/v2.1/os-server-groups/f61c9b3b-e596-4c5b-8f4a-8d2747f38dcb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:54:05.142450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b9acf34a-c158-4e16-8e9c-e59c6c38e2d6 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Action: 'create', calling method: .version_select at 0x7f927a7a0550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1080159779", "description": "tempest-description-2000256150"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:05.219901 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-186fe40b-33df-48cc-bef1-3cd3940ab62e tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/ff4b66aa-acf3-4fe4-8ae8-1d154a8ad1e1" status: 202 len: 0 microversion: 2.1 time: 0.464149 Aug 02 06:54:05.221278 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 984/2073] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:54:04 2022] DELETE /compute/v2.1/os-security-groups/ff4b66aa-acf3-4fe4-8ae8-1d154a8ad1e1 => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:54:05.232998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15599c23-2ea2-4e04-acfa-6b49d7b54beb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:05.234027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-15599c23-2ea2-4e04-acfa-6b49d7b54beb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:05.242136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15599c23-2ea2-4e04-acfa-6b49d7b54beb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:05.242995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15599c23-2ea2-4e04-acfa-6b49d7b54beb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:05.244306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15599c23-2ea2-4e04-acfa-6b49d7b54beb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:05.245092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15599c23-2ea2-4e04-acfa-6b49d7b54beb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:05.423363 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b9acf34a-c158-4e16-8e9c-e59c6c38e2d6 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.286793 Aug 02 06:54:05.425163 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1090/2074] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:54:05 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:05.430918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-14df3142-92ff-4546-b05f-c46e66262fe8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a7d0b80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:05.518347 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-14df3142-92ff-4546-b05f-c46e66262fe8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.091571 Aug 02 06:54:05.519144 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1091/2075] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:54:05 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:05.534866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-35d0cf07-0db9-4635-a02a-7f484be4e7c2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:05.540260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-15599c23-2ea2-4e04-acfa-6b49d7b54beb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:05.554115 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-35d0cf07-0db9-4635-a02a-7f484be4e7c2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.033639 Aug 02 06:54:05.561065 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1092/2076] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:54:05 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:05.567339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b7dbc79d-69b8-4588-b0fa-d594c898d612 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] Calling method '.version_select at 0x7f927a7a3ee0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:05.567945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-15599c23-2ea2-4e04-acfa-6b49d7b54beb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:05.571077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-15599c23-2ea2-4e04-acfa-6b49d7b54beb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:05.573027 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-15599c23-2ea2-4e04-acfa-6b49d7b54beb tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1280 microversion: 2.25 time: 0.350273 Aug 02 06:54:05.587592 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 985/2077] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:05 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1280 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:05.597320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8b3fa12f-fdc2-4d6e-9240-9ce779b87028 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Action: 'create', calling method: .version_select at 0x7f927ab10a60>, body: {"security_group_rule": {"parent_group_id": "038c96e4-ba64-4a73-a2a0-d86a96ad1fd4", "ip_protocol": "tcp", "from_port": 22, "to_port": 1263075514}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:05.742115 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-8b3fa12f-fdc2-4d6e-9240-9ce779b87028 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] HTTP exception thrown: Invalid port range 22:1263075514. Valid TCP ports should be between 1-65535 Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8b3fa12f-fdc2-4d6e-9240-9ce779b87028 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Request method failure captured: Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 146 Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MoBKI9D0R1EIHCvCT5W0FPDKQcKUZVMrx_sCcZGX7XuNZTbzCdNvOJANXat188JVruFSQ7zxmXy1bUnShfdaDRfC-Ugs3dOJyx7i_WFruNetKxmttodxeUjyEZV0e5p95tlesIauYVLa9jBLBzgb1gU3rseg04-3c2EKi8SYblkYJ0 Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}] Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 94dddde725c148d48907a443121c324f Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: {"security_group_rule": {"parent_group_id": "038c96e4-ba64-4a73-a2a0-d86a96ad1fd4", "ip_protocol": "tcp", "from_port": 22, "to_port": 1263075514}} Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid port range 22:1263075514. Valid TCP ports should be between 1-65535 Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'security_group_rule': {'parent_group_id': '038c96e4-ba64-4a73-a2a0-d86a96ad1fd4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1263075514}}} Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1263075514. Valid TCP ports should be between 1-65535 Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1263075514. Valid TCP ports should be between 1-65535 Aug 02 06:54:05.743885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:05.758317 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:05.758317 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:05.758317 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:05.758317 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:05.758317 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:05.758317 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:05.758317 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:05.758317 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1263075514. Valid TCP ports should be between 1-65535 Aug 02 06:54:05.758317 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:05.758317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8b3fa12f-fdc2-4d6e-9240-9ce779b87028 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Returning 400 to user: Invalid port range 22:1263075514. Valid TCP ports should be between 1-65535 {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:05.758317 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8b3fa12f-fdc2-4d6e-9240-9ce779b87028 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.156526 Aug 02 06:54:05.758317 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 986/2078] 10.222.0.79 () {60 vars in 1195 bytes} [Tue Aug 2 06:54:05 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:54:05.758317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2c6fb72e-4b9c-468d-b9ed-c17eb67c9651 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:05.826274 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2c6fb72e-4b9c-468d-b9ed-c17eb67c9651 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/fcc8e64c-ffa3-4121-a9c8-cba0aaf6cdf7" status: 204 len: 0 microversion: 2.1 time: 0.078915 Aug 02 06:54:05.831692 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 987/2079] 10.222.0.79 () {58 vars in 1266 bytes} [Tue Aug 2 06:54:05 2022] DELETE /compute/v2.1/os-server-groups/fcc8e64c-ffa3-4121-a9c8-cba0aaf6cdf7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:54:05.837064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15b58009-b3bf-4a16-b9d6-1d595c3849b7 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Action: 'create', calling method: .version_select at 0x7f927abc5f70>, body: {"security_group_rule": {"parent_group_id": "9183d924-89c1-4715-a271-681b2d513de6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:05.893406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG neutronclient.v2_0.client [None req-15b58009-b3bf-4a16-b9d6-1d595c3849b7 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9183d924-89c1-4715-a271-681b2d513de6 does not exist", "detail": ""}} {{(pid=126119) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:54:05.894341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.security_group_api [None req-15b58009-b3bf-4a16-b9d6-1d595c3849b7 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Neutron security group 9183d924-89c1-4715-a271-681b2d513de6 not found {{(pid=126119) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 06:54:05.895892 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-15b58009-b3bf-4a16-b9d6-1d595c3849b7 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] HTTP exception thrown: Security group 9183d924-89c1-4715-a271-681b2d513de6 does not exist Aug 02 06:54:05.895892 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-a85b57ea-49f3-4ff4-9c62-26bdb69f12dc'] Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15b58009-b3bf-4a16-b9d6-1d595c3849b7 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Request method failure captured: Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 138 Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MoBKI9D0R1EIHCvCT5W0FPDKQcKUZVMrx_sCcZGX7XuNZTbzCdNvOJANXat188JVruFSQ7zxmXy1bUnShfdaDRfC-Ugs3dOJyx7i_WFruNetKxmttodxeUjyEZV0e5p95tlesIauYVLa9jBLBzgb1gU3rseg04-3c2EKi8SYblkYJ0 Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}] Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 94dddde725c148d48907a443121c324f Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: {"security_group_rule": {"parent_group_id": "9183d924-89c1-4715-a271-681b2d513de6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: exception: Security group 9183d924-89c1-4715-a271-681b2d513de6 does not exist Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-a85b57ea-49f3-4ff4-9c62-26bdb69f12dc'] Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9183d924-89c1-4715-a271-681b2d513de6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:54:05.898378 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9183d924-89c1-4715-a271-681b2d513de6 does not exist Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a85b57ea-49f3-4ff4-9c62-26bdb69f12dc'] Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9183d924-89c1-4715-a271-681b2d513de6 does not exist Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a85b57ea-49f3-4ff4-9c62-26bdb69f12dc'] Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9183d924-89c1-4715-a271-681b2d513de6 does not exist Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a85b57ea-49f3-4ff4-9c62-26bdb69f12dc'] Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9183d924-89c1-4715-a271-681b2d513de6 does not exist Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a85b57ea-49f3-4ff4-9c62-26bdb69f12dc'] Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15b58009-b3bf-4a16-b9d6-1d595c3849b7 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Returning 404 to user: Security group 9183d924-89c1-4715-a271-681b2d513de6 does not exist Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-a85b57ea-49f3-4ff4-9c62-26bdb69f12dc'] {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-15b58009-b3bf-4a16-b9d6-1d595c3849b7 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.066843 Aug 02 06:54:05.903328 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 988/2080] 10.222.0.79 () {60 vars in 1195 bytes} [Tue Aug 2 06:54:05 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:05.913938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2855bf75-2d09-4461-8bce-2a52f3660070 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:05.918600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2855bf75-2d09-4461-8bce-2a52f3660070 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:05.935014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2855bf75-2d09-4461-8bce-2a52f3660070 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:05.935693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2855bf75-2d09-4461-8bce-2a52f3660070 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:05.937009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2855bf75-2d09-4461-8bce-2a52f3660070 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:05.937695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2855bf75-2d09-4461-8bce-2a52f3660070 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:05.942354 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b7dbc79d-69b8-4588-b0fa-d594c898d612 tempest-SecurityGroupsTestJSON-1085129022 tempest-SecurityGroupsTestJSON-1085129022-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/e08328fc-c070-4b63-814b-2b66e4b366fe" status: 202 len: 0 microversion: 2.1 time: 0.379474 Aug 02 06:54:05.943044 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1093/2081] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:54:05 2022] DELETE /compute/v2.1/os-security-groups/e08328fc-c070-4b63-814b-2b66e4b366fe => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:54:05.949975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dde792a9-1fe0-456c-9da8-4f4558933933 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:05.976228 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dde792a9-1fe0-456c-9da8-4f4558933933 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.031881 Aug 02 06:54:05.998665 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1094/2082] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:54:05 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:06.006636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f9a03866-fbbf-4417-b552-0d31fd2f526f tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Calling method '.version_select at 0x7f927a79d700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:06.046776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG neutronclient.v2_0.client [None req-f9a03866-fbbf-4417-b552-0d31fd2f526f tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 7fb09653-d4d8-4255-a0a0-8c9f9b79c534 does not exist", "detail": ""}} {{(pid=126120) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 06:54:06.046776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.security_group_api [None req-f9a03866-fbbf-4417-b552-0d31fd2f526f tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Neutron security group rule 7fb09653-d4d8-4255-a0a0-8c9f9b79c534 not found {{(pid=126120) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 02 06:54:06.046776 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-f9a03866-fbbf-4417-b552-0d31fd2f526f tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] HTTP exception thrown: Security group rule 7fb09653-d4d8-4255-a0a0-8c9f9b79c534 does not exist Aug 02 06:54:06.046776 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-bd32fe91-1826-47de-86b2-e6136af312ac'] Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f9a03866-fbbf-4417-b552-0d31fd2f526f tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Request method failure captured: Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-security-group-rules/7fb09653-d4d8-4255-a0a0-8c9f9b79c534 HTTP/1.1 Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MoBKI9D0R1EIHCvCT5W0FPDKQcKUZVMrx_sCcZGX7XuNZTbzCdNvOJANXat188JVruFSQ7zxmXy1bUnShfdaDRfC-Ugs3dOJyx7i_WFruNetKxmttodxeUjyEZV0e5p95tlesIauYVLa9jBLBzgb1gU3rseg04-3c2EKi8SYblkYJ0 Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8813b64a6d3b439ba46b6898050264b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8813b64a6d3b439ba46b6898050264b5"}]}] Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8813b64a6d3b439ba46b6898050264b5 Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855 Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 94dddde725c148d48907a443121c324f Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: exception: Security group rule 7fb09653-d4d8-4255-a0a0-8c9f9b79c534 does not exist Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-bd32fe91-1826-47de-86b2-e6136af312ac'] Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '7fb09653-d4d8-4255-a0a0-8c9f9b79c534'} Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 06:54:06.048514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 7fb09653-d4d8-4255-a0a0-8c9f9b79c534 does not exist Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd32fe91-1826-47de-86b2-e6136af312ac'] Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 7fb09653-d4d8-4255-a0a0-8c9f9b79c534 does not exist Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd32fe91-1826-47de-86b2-e6136af312ac'] Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 7fb09653-d4d8-4255-a0a0-8c9f9b79c534 does not exist Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd32fe91-1826-47de-86b2-e6136af312ac'] Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 7fb09653-d4d8-4255-a0a0-8c9f9b79c534 does not exist Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd32fe91-1826-47de-86b2-e6136af312ac'] Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f9a03866-fbbf-4417-b552-0d31fd2f526f tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Returning 404 to user: Security group rule 7fb09653-d4d8-4255-a0a0-8c9f9b79c534 does not exist Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-bd32fe91-1826-47de-86b2-e6136af312ac'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f9a03866-fbbf-4417-b552-0d31fd2f526f tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-group-rules/7fb09653-d4d8-4255-a0a0-8c9f9b79c534" status: 404 len: 199 microversion: 2.1 time: 0.050121 Aug 02 06:54:06.055870 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1095/2083] 10.222.0.79 () {58 vars in 1287 bytes} [Tue Aug 2 06:54:05 2022] DELETE /compute/v2.1/os-security-group-rules/7fb09653-d4d8-4255-a0a0-8c9f9b79c534 => generated 199 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:06.066999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-974d7cbd-9c68-4657-ba2f-54e1abab617e tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Action: 'create', calling method: .version_select at 0x7f927a79aaf0>, body: {"server_group": {"name": "tempest-server-group-857299609", "policies": ["affinity"]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:06.079418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-974d7cbd-9c68-4657-ba2f-54e1abab617e tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:06.085391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-974d7cbd-9c68-4657-ba2f-54e1abab617e tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for user 8fe7395eb1c7492199b8446285b09bc2 and project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:06.205860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:06.224124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-974d7cbd-9c68-4657-ba2f-54e1abab617e tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:06.227886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2855bf75-2d09-4461-8bce-2a52f3660070 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:06.237748 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2855bf75-2d09-4461-8bce-2a52f3660070 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1469 microversion: 2.1 time: 0.335438 Aug 02 06:54:06.240108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-974d7cbd-9c68-4657-ba2f-54e1abab617e tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for user 8fe7395eb1c7492199b8446285b09bc2 and project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:06.254995 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 989/2084] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:05 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1469 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:06.264446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3fc80c7e-bc36-4ed6-8da5-9777dc1e9f7b tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Calling method '.version_select at 0x7f927aadce50>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:06.297528 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-974d7cbd-9c68-4657-ba2f-54e1abab617e tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.245803 Aug 02 06:54:06.299257 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1096/2085] 10.222.0.79 () {60 vars in 1173 bytes} [Tue Aug 2 06:54:06 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:06.304328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ce177302-fee5-40d1-b470-c1e26fde7f14 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:06.308162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ce177302-fee5-40d1-b470-c1e26fde7f14 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:06.318594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce177302-fee5-40d1-b470-c1e26fde7f14 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:06.319330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce177302-fee5-40d1-b470-c1e26fde7f14 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:06.320795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce177302-fee5-40d1-b470-c1e26fde7f14 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:06.321395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce177302-fee5-40d1-b470-c1e26fde7f14 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:06.620218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ce177302-fee5-40d1-b470-c1e26fde7f14 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:06.643660 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ce177302-fee5-40d1-b470-c1e26fde7f14 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1810 microversion: 2.1 time: 0.343126 Aug 02 06:54:06.644387 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1097/2086] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:06 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1810 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:06.658886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-70784e65-eff9-46e7-98a8-affac585c958 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:06.703182 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-70784e65-eff9-46e7-98a8-affac585c958 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/ac074e8d-58fc-4eaa-8bcc-983476167bfd" status: 204 len: 0 microversion: 2.1 time: 0.055730 Aug 02 06:54:06.703801 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1098/2087] 10.222.0.79 () {58 vars in 1266 bytes} [Tue Aug 2 06:54:06 2022] DELETE /compute/v2.1/os-server-groups/ac074e8d-58fc-4eaa-8bcc-983476167bfd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:54:06.711009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-951b85cf-972f-436f-9e02-f8aa54c3b3c7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a7d0af0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:06.738480 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3fc80c7e-bc36-4ed6-8da5-9777dc1e9f7b tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/038c96e4-ba64-4a73-a2a0-d86a96ad1fd4" status: 202 len: 0 microversion: 2.1 time: 0.480374 Aug 02 06:54:06.739552 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 990/2088] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:54:06 2022] DELETE /compute/v2.1/os-security-groups/038c96e4-ba64-4a73-a2a0-d86a96ad1fd4 => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:54:06.744727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d322d8a8-5603-4e2e-9a6a-4e0547d30382 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:06.751385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d322d8a8-5603-4e2e-9a6a-4e0547d30382 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:06.768020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d322d8a8-5603-4e2e-9a6a-4e0547d30382 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:06.770445 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-951b85cf-972f-436f-9e02-f8aa54c3b3c7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1413 microversion: 2.1 time: 0.065297 Aug 02 06:54:06.771623 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1099/2089] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:54:06 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1413 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:06.774073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d322d8a8-5603-4e2e-9a6a-4e0547d30382 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:06.775071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d322d8a8-5603-4e2e-9a6a-4e0547d30382 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:06.777621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-14f407c8-c1de-4fa0-b174-01315d276476 req-65f631ae-6868-4629-90d8-61bd578b9af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7780d516-e238-4ace-8533-903dd2a12caf", "name": "network-vif-plugged", "status": "completed", "tag": "ee71a9b8-bd05-4f42-b152-fb0af7d0ef95"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:06.778205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d322d8a8-5603-4e2e-9a6a-4e0547d30382 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:06.786050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:06.790387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-14f407c8-c1de-4fa0-b174-01315d276476 req-65f631ae-6868-4629-90d8-61bd578b9af2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:06.791314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-14f407c8-c1de-4fa0-b174-01315d276476 req-65f631ae-6868-4629-90d8-61bd578b9af2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:06.805289 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-14f407c8-c1de-4fa0-b174-01315d276476 req-65f631ae-6868-4629-90d8-61bd578b9af2 service nova] Creating event network-vif-plugged:ee71a9b8-bd05-4f42-b152-fb0af7d0ef95 for instance 7780d516-e238-4ace-8533-903dd2a12caf on n-h1-851337-3 Aug 02 06:54:06.810867 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-14f407c8-c1de-4fa0-b174-01315d276476 req-65f631ae-6868-4629-90d8-61bd578b9af2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037822 Aug 02 06:54:06.811634 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1100/2090] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:06.817797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0650c388-0521-49e4-97c9-c2c6f21c604f tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:06.836444 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0650c388-0521-49e4-97c9-c2c6f21c604f tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.022965 Aug 02 06:54:06.844889 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1101/2091] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:54:06 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:06.850353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-868ff476-96b2-4748-9435-49f3e23201e6 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Calling method '.version_select at 0x7f927a839550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:07.334616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d322d8a8-5603-4e2e-9a6a-4e0547d30382 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:07.347194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d322d8a8-5603-4e2e-9a6a-4e0547d30382 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:07.348980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d322d8a8-5603-4e2e-9a6a-4e0547d30382 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:07.350378 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d322d8a8-5603-4e2e-9a6a-4e0547d30382 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1280 microversion: 2.25 time: 0.609725 Aug 02 06:54:07.365911 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 991/2092] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:06 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1280 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:07.371107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85b1f817-cf7f-4e0f-920a-65dbbe6fab89 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Action: 'create', calling method: .version_select at 0x7f927aadc3a0>, body: {"server_group": {"name": "tempest-server-group-1665466706", "policies": ["anti-affinity"]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:07.392109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-85b1f817-cf7f-4e0f-920a-65dbbe6fab89 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:07.399979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-85b1f817-cf7f-4e0f-920a-65dbbe6fab89 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for user 8fe7395eb1c7492199b8446285b09bc2 and project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:07.455218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-85b1f817-cf7f-4e0f-920a-65dbbe6fab89 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:07.460247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-85b1f817-cf7f-4e0f-920a-65dbbe6fab89 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for user 8fe7395eb1c7492199b8446285b09bc2 and project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_groups'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:07.478317 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-85b1f817-cf7f-4e0f-920a-65dbbe6fab89 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.110686 Aug 02 06:54:07.482515 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 992/2093] 10.222.0.79 () {60 vars in 1173 bytes} [Tue Aug 2 06:54:07 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:07.487566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-041f2b04-c829-4b81-b5ed-ddffac0c6ce3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:07.490616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-041f2b04-c829-4b81-b5ed-ddffac0c6ce3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:07.507447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-041f2b04-c829-4b81-b5ed-ddffac0c6ce3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:07.509311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-041f2b04-c829-4b81-b5ed-ddffac0c6ce3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:07.510965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-041f2b04-c829-4b81-b5ed-ddffac0c6ce3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:07.511421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-041f2b04-c829-4b81-b5ed-ddffac0c6ce3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:07.559664 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-868ff476-96b2-4748-9435-49f3e23201e6 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/39f1dc7c-6621-4879-bc08-cccd2b080dc5" status: 202 len: 0 microversion: 2.1 time: 0.713224 Aug 02 06:54:07.560955 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1102/2094] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:54:06 2022] DELETE /compute/v2.1/os-security-groups/39f1dc7c-6621-4879-bc08-cccd2b080dc5 => generated 0 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:54:07.566666 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ef8ac4a3-9859-43ca-8db6-26d9738676b2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:07.624261 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ef8ac4a3-9859-43ca-8db6-26d9738676b2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/86e11b05-8a94-4f1d-9583-2603f902975f" status: 204 len: 0 microversion: 2.1 time: 0.061223 Aug 02 06:54:07.625755 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1103/2095] 10.222.0.79 () {58 vars in 1266 bytes} [Tue Aug 2 06:54:07 2022] DELETE /compute/v2.1/os-server-groups/86e11b05-8a94-4f1d-9583-2603f902975f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:54:07.653154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ee63beea-1a9a-4b75-a93d-1b4f57337f77 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Calling method '.version_select at 0x7f927a7a08b0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:07.995824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-041f2b04-c829-4b81-b5ed-ddffac0c6ce3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:08.019020 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-041f2b04-c829-4b81-b5ed-ddffac0c6ce3 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 200 len: 1469 microversion: 2.1 time: 0.535248 Aug 02 06:54:08.019610 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 993/2096] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:07 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 1469 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:08.024559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a0761284-1493-44c0-8a92-c0c71d8fa895 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:08.081301 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a0761284-1493-44c0-8a92-c0c71d8fa895 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.060306 Aug 02 06:54:08.093417 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 994/2097] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:54:08 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:08.097366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85bf13ae-d3d5-4d4f-980a-c37d38efbda0 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:08.100878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-85bf13ae-d3d5-4d4f-980a-c37d38efbda0 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:08.115267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85bf13ae-d3d5-4d4f-980a-c37d38efbda0 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:08.115899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85bf13ae-d3d5-4d4f-980a-c37d38efbda0 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:08.117111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85bf13ae-d3d5-4d4f-980a-c37d38efbda0 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:08.117774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85bf13ae-d3d5-4d4f-980a-c37d38efbda0 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:08.505850 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ee63beea-1a9a-4b75-a93d-1b4f57337f77 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/3247808d-5b63-4608-86d4-0e222627fe42" status: 202 len: 0 microversion: 2.1 time: 0.878741 Aug 02 06:54:08.506463 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1104/2098] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:54:07 2022] DELETE /compute/v2.1/os-security-groups/3247808d-5b63-4608-86d4-0e222627fe42 => generated 0 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:54:08.514265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-78f855e1-f9fe-4258-aa81-fa0ef24d21a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a7d0430>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:08.562328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-85bf13ae-d3d5-4d4f-980a-c37d38efbda0 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:08.576663 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-85bf13ae-d3d5-4d4f-980a-c37d38efbda0 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1810 microversion: 2.1 time: 0.493421 Aug 02 06:54:08.578941 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 995/2099] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:08 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1810 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:08.585443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-106e5769-242f-46ed-9ad5-211a079fb280 req-bce24dd0-2b9e-4e64-8b9d-5b21e281e292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303b535b-cea0-4219-ad1b-3849b9042a53", "name": "network-vif-deleted", "tag": "78a224c6-e169-4c15-906f-64fc36ce7044"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:08.617393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-106e5769-242f-46ed-9ad5-211a079fb280 req-bce24dd0-2b9e-4e64-8b9d-5b21e281e292 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:08.618155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-106e5769-242f-46ed-9ad5-211a079fb280 req-bce24dd0-2b9e-4e64-8b9d-5b21e281e292 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:08.645249 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-106e5769-242f-46ed-9ad5-211a079fb280 req-bce24dd0-2b9e-4e64-8b9d-5b21e281e292 service nova] Creating event network-vif-deleted:78a224c6-e169-4c15-906f-64fc36ce7044 for instance 303b535b-cea0-4219-ad1b-3849b9042a53 on n-h2-851337-3 Aug 02 06:54:08.655958 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-106e5769-242f-46ed-9ad5-211a079fb280 req-bce24dd0-2b9e-4e64-8b9d-5b21e281e292 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075328 Aug 02 06:54:08.657430 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 996/2100] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:08.665147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-65630073", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "d3190559-f187-4a9e-82e6-60f11e504154"}]}, "os:scheduler_hints": {"group": "764fec44-f9b2-4b7d-b206-f233e1f45322"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:08.694688 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-78f855e1-f9fe-4258-aa81-fa0ef24d21a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1422 microversion: 2.1 time: 0.184058 Aug 02 06:54:08.705504 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1105/2101] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:54:08 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1422 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:08.718790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1a5c22d0-9cc3-47bc-818a-0d77d3d4148e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:08.719710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1a5c22d0-9cc3-47bc-818a-0d77d3d4148e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:08.732466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a5c22d0-9cc3-47bc-818a-0d77d3d4148e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:08.732722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a5c22d0-9cc3-47bc-818a-0d77d3d4148e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:08.742177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a5c22d0-9cc3-47bc-818a-0d77d3d4148e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:08.742808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a5c22d0-9cc3-47bc-818a-0d77d3d4148e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:08.813480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] validate_networks() for [('d3190559-f187-4a9e-82e6-60f11e504154', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:54:09.230868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1a5c22d0-9cc3-47bc-818a-0d77d3d4148e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:09.247069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1a5c22d0-9cc3-47bc-818a-0d77d3d4148e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:09.248563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1a5c22d0-9cc3-47bc-818a-0d77d3d4148e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:09.249756 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1a5c22d0-9cc3-47bc-818a-0d77d3d4148e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1280 microversion: 2.25 time: 0.542861 Aug 02 06:54:09.250348 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1106/2102] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:08 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1280 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:09.273297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-265016ee-be5c-4139-b73b-a02e95fb3091 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Calling method '.version_select at 0x7f927a7a0550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:09.897116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:54:09.897925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:54:09.898551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:54:09.899063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:54:09.899579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:54:09.917349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:09.937679 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-265016ee-be5c-4139-b73b-a02e95fb3091 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/f57cb059-aaca-414e-9439-0be4e5c5c73d" status: 202 len: 0 microversion: 2.1 time: 0.674445 Aug 02 06:54:09.938460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:09.940958 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1107/2103] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:54:09 2022] DELETE /compute/v2.1/os-security-groups/f57cb059-aaca-414e-9439-0be4e5c5c73d => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:54:09.943268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:09.943844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:09.949383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-c69934e1-6be3-44e0-9270-df478b250818 req-c4558ad0-a2bb-4026-97b9-f4ae5b6f12e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea28a98b-bb58-40e2-8a62-635a752c0ecf", "name": "network-vif-deleted", "tag": "1c4033a4-9151-4c28-8690-54f55ef35bc7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:09.965343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c69934e1-6be3-44e0-9270-df478b250818 req-c4558ad0-a2bb-4026-97b9-f4ae5b6f12e9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:09.967260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c69934e1-6be3-44e0-9270-df478b250818 req-c4558ad0-a2bb-4026-97b9-f4ae5b6f12e9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:09.992406 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-c69934e1-6be3-44e0-9270-df478b250818 req-c4558ad0-a2bb-4026-97b9-f4ae5b6f12e9 service nova] Creating event network-vif-deleted:1c4033a4-9151-4c28-8690-54f55ef35bc7 for instance ea28a98b-bb58-40e2-8a62-635a752c0ecf on n-h2-851337-3 Aug 02 06:54:09.994468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:10.004239 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-c69934e1-6be3-44e0-9270-df478b250818 req-c4558ad0-a2bb-4026-97b9-f4ae5b6f12e9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061882 Aug 02 06:54:10.007353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for user 8fe7395eb1c7492199b8446285b09bc2 and project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:10.007992 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1108/2104] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:10.031394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:10.053476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5e92df72-fcae-452f-8236-52eff6f7053d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a7a0550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:10.054873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:54:10.058216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:54:10.165958 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5e92df72-fcae-452f-8236-52eff6f7053d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 200 len: 1422 microversion: 2.1 time: 0.144506 Aug 02 06:54:10.167505 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1109/2105] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:54:10 2022] GET /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 1422 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:10.181142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-82172d8c-c766-43b5-afea-3b2890a266d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:10.183737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-82172d8c-c766-43b5-afea-3b2890a266d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: 303b535b-cea0-4219-ad1b-3849b9042a53] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:10.206182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82172d8c-c766-43b5-afea-3b2890a266d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:10.207842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82172d8c-c766-43b5-afea-3b2890a266d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:10.210500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82172d8c-c766-43b5-afea-3b2890a266d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:10.211018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82172d8c-c766-43b5-afea-3b2890a266d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:10.249500 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-82172d8c-c766-43b5-afea-3b2890a266d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] HTTP exception thrown: Instance 303b535b-cea0-4219-ad1b-3849b9042a53 could not be found. Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-82172d8c-c766-43b5-afea-3b2890a266d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Request method failure captured: Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 HTTP/1.1 Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mil14MrqUIflgbg_0m6eSvWnATGyi4dxApKFYL7uiPVfLQzElvfEtTHVs9oItTTFNLdGLaH5TlX5bUN7yaMEIhck3MjUYsbu0qEca4eDexanQN9ORFeDjdfV-_1gtk6WgSp1XM4giCm224UVntHDA9IjGBMojIWp9cBPmwrLH9mp5M Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 1e08c65240da4f90a190b2da77a8ff92 Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-MigrationsAdminTest-1968435112 Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1e08c65240da4f90a190b2da77a8ff92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1e08c65240da4f90a190b2da77a8ff92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1e08c65240da4f90a190b2da77a8ff92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1e08c65240da4f90a190b2da77a8ff92"}]}] Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-MigrationsAdminTest-1968435112 Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 1e08c65240da4f90a190b2da77a8ff92 Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-MigrationsAdminTest-1968435112 Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-MigrationsAdminTest-1968435112-project Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 87d1c9cb22d34aaa8b86860b84a1086d Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-MigrationsAdminTest-1968435112-project Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 303b535b-cea0-4219-ad1b-3849b9042a53 could not be found. Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '303b535b-cea0-4219-ad1b-3849b9042a53'} Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 303b535b-cea0-4219-ad1b-3849b9042a53 could not be found. Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 303b535b-cea0-4219-ad1b-3849b9042a53 could not be found. Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:10.264736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:10.269654 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:10.269654 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:10.269654 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:10.269654 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:10.269654 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:10.269654 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 303b535b-cea0-4219-ad1b-3849b9042a53 could not be found. Aug 02 06:54:10.269654 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:10.269654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-82172d8c-c766-43b5-afea-3b2890a266d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Returning 404 to user: Instance 303b535b-cea0-4219-ad1b-3849b9042a53 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:10.269654 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-82172d8c-c766-43b5-afea-3b2890a266d6 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53" status: 404 len: 111 microversion: 2.1 time: 0.097700 Aug 02 06:54:10.269654 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1110/2106] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:10 2022] GET /compute/v2.1/servers/303b535b-cea0-4219-ad1b-3849b9042a53 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:10.272048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_group_members'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:10.280209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-338fff94-ee04-4bfa-a07a-e63f76ae1dd7 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:10.280817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-338fff94-ee04-4bfa-a07a-e63f76ae1dd7 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:10.293813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for user 8fe7395eb1c7492199b8446285b09bc2 and project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_group_members'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:10.313884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-338fff94-ee04-4bfa-a07a-e63f76ae1dd7 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:10.326089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-338fff94-ee04-4bfa-a07a-e63f76ae1dd7 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:10.327171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-338fff94-ee04-4bfa-a07a-e63f76ae1dd7 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:10.327627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-338fff94-ee04-4bfa-a07a-e63f76ae1dd7 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:10.386419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_group_members'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:10.395711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Getting quotas for user 8fe7395eb1c7492199b8446285b09bc2 and project 6f0d57f417c04a65b3b39d6494cb71f7. Resources: {'server_group_members'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:10.434057 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0bcfb19c-e66e-4b6a-9fa2-824dc8be04e2 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.775122 Aug 02 06:54:10.440576 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 997/2107] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:54:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:54:10.441556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7b65ce85-2239-40c1-9096-ce466b1bb1a6 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] Calling method '.version_select at 0x7f927aaa2670>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:10.495132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-338fff94-ee04-4bfa-a07a-e63f76ae1dd7 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:10.504679 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-338fff94-ee04-4bfa-a07a-e63f76ae1dd7 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 200 len: 1569 microversion: 2.1 time: 0.228360 Aug 02 06:54:10.505428 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1111/2108] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:10 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:10.511656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-31339cbd-54ae-4b2a-8f12-c02a0a647623 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a7a00d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:10.965222 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7b65ce85-2239-40c1-9096-ce466b1bb1a6 tempest-SecurityGroupRulesNegativeTestJSON-1810510855 tempest-SecurityGroupRulesNegativeTestJSON-1810510855-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/0ac38155-988c-49b8-a86f-f9804b5f003f" status: 202 len: 0 microversion: 2.1 time: 0.528906 Aug 02 06:54:10.968097 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 998/2109] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:54:10 2022] DELETE /compute/v2.1/os-security-groups/0ac38155-988c-49b8-a86f-f9804b5f003f => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:54:10.975394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fdcd3d03-d09d-49ed-8c5a-22b2f738b19e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:10.977234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fdcd3d03-d09d-49ed-8c5a-22b2f738b19e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:11.016113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fdcd3d03-d09d-49ed-8c5a-22b2f738b19e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:11.017760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fdcd3d03-d09d-49ed-8c5a-22b2f738b19e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:11.020702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fdcd3d03-d09d-49ed-8c5a-22b2f738b19e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:11.021140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fdcd3d03-d09d-49ed-8c5a-22b2f738b19e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:11.099340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fdcd3d03-d09d-49ed-8c5a-22b2f738b19e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:54:11.255077 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fdcd3d03-d09d-49ed-8c5a-22b2f738b19e tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 204 len: 0 microversion: 2.1 time: 0.287445 Aug 02 06:54:11.256538 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 999/2110] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:54:10 2022] DELETE /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:54:11.280723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6349381d-5183-47dc-8dec-0947b0e12dbf tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:11.295043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6349381d-5183-47dc-8dec-0947b0e12dbf tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:11.314039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6349381d-5183-47dc-8dec-0947b0e12dbf tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:11.314958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6349381d-5183-47dc-8dec-0947b0e12dbf tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:11.317696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6349381d-5183-47dc-8dec-0947b0e12dbf tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:11.319115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6349381d-5183-47dc-8dec-0947b0e12dbf tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:11.573134 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-31339cbd-54ae-4b2a-8f12-c02a0a647623 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 204 len: 0 microversion: 2.1 time: 1.065867 Aug 02 06:54:11.573826 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1112/2111] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:10 2022] DELETE /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 0 bytes in 1068 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:54:11.582473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a2c3cb3-1a14-4114-b5a6-276adac002b3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:11.583322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8a2c3cb3-1a14-4114-b5a6-276adac002b3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:11.600744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a2c3cb3-1a14-4114-b5a6-276adac002b3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:11.601706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a2c3cb3-1a14-4114-b5a6-276adac002b3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:11.602749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a2c3cb3-1a14-4114-b5a6-276adac002b3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:11.603342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a2c3cb3-1a14-4114-b5a6-276adac002b3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:11.649057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6349381d-5183-47dc-8dec-0947b0e12dbf tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:11.657987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6349381d-5183-47dc-8dec-0947b0e12dbf tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:11.664290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6349381d-5183-47dc-8dec-0947b0e12dbf tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:11.665706 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6349381d-5183-47dc-8dec-0947b0e12dbf tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1476 microversion: 2.25 time: 0.407285 Aug 02 06:54:11.667702 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1000/2112] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:11 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1476 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:11.674564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7703ba3a-a14a-4bd5-8242-d3eb496650e1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:11.677769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7703ba3a-a14a-4bd5-8242-d3eb496650e1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:11.697619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7703ba3a-a14a-4bd5-8242-d3eb496650e1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:11.698123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7703ba3a-a14a-4bd5-8242-d3eb496650e1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:11.698912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7703ba3a-a14a-4bd5-8242-d3eb496650e1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:11.699550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7703ba3a-a14a-4bd5-8242-d3eb496650e1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:12.191909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8a2c3cb3-1a14-4114-b5a6-276adac002b3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:12.200034 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8a2c3cb3-1a14-4114-b5a6-276adac002b3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1215 microversion: 2.1 time: 0.624550 Aug 02 06:54:12.218009 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1113/2113] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:11 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1215 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:12.224767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-757300e7-6b39-4609-8187-78b73a742041 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:12.231205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-757300e7-6b39-4609-8187-78b73a742041 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:12.243039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-757300e7-6b39-4609-8187-78b73a742041 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:12.243752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-757300e7-6b39-4609-8187-78b73a742041 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:12.244718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-757300e7-6b39-4609-8187-78b73a742041 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:12.245316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-757300e7-6b39-4609-8187-78b73a742041 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:12.261046 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-757300e7-6b39-4609-8187-78b73a742041 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] HTTP exception thrown: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-757300e7-6b39-4609-8187-78b73a742041 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Request method failure captured: Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf HTTP/1.1 Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MnkSplIqiTShUeULuW9ojtK5Rt70xlSaP1csO2PNoBZ69-dXwhPa1ENkGZARrBLww2eUvEj77SS6gecRtwtBF0dajz1kxTfx1z1yVOm_R28SM3i4wnbQCZu55bC5SZzEK5KXjNKokmz7j2KqIQtG4edxg-gJKW5ylj5oL9jTCClCy4 Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 76c70f1ab140418e813917aa08d23033 Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestMultiNic-657139817 Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/76c70f1ab140418e813917aa08d23033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76c70f1ab140418e813917aa08d23033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_76c70f1ab140418e813917aa08d23033"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76c70f1ab140418e813917aa08d23033"}]}] Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestMultiNic-657139817 Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 76c70f1ab140418e813917aa08d23033 Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestMultiNic-657139817 Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestMultiNic-657139817-project Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a4d6484337c84897813ab767ad7d058b Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestMultiNic-657139817-project Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'ea28a98b-bb58-40e2-8a62-635a752c0ecf'} Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:12.262936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:12.268639 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:12.268639 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:12.268639 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:12.268639 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:12.268639 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:12.268639 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:54:12.268639 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:12.270810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-757300e7-6b39-4609-8187-78b73a742041 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Returning 404 to user: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:12.271860 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-757300e7-6b39-4609-8187-78b73a742041 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 404 len: 111 microversion: 2.1 time: 0.052199 Aug 02 06:54:12.272587 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1114/2114] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:12 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:12.277839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aa03588b-3aa4-4515-88d3-786732e542e4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:12.278554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aa03588b-3aa4-4515-88d3-786732e542e4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:12.285121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa03588b-3aa4-4515-88d3-786732e542e4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:12.285798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa03588b-3aa4-4515-88d3-786732e542e4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:12.286813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa03588b-3aa4-4515-88d3-786732e542e4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:12.287631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa03588b-3aa4-4515-88d3-786732e542e4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:12.331803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aa03588b-3aa4-4515-88d3-786732e542e4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:54:12.390372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:12.434724 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aa03588b-3aa4-4515-88d3-786732e542e4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 204 len: 0 microversion: 2.1 time: 0.159413 Aug 02 06:54:12.439985 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1115/2115] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:54:12 2022] DELETE /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:54:12.482246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7703ba3a-a14a-4bd5-8242-d3eb496650e1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:12.499730 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7703ba3a-a14a-4bd5-8242-d3eb496650e1 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1535 microversion: 2.1 time: 0.828792 Aug 02 06:54:12.514077 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1001/2116] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:11 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1535 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:12.520251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-1da0d6da-6bb4-4ed4-9fe2-1e800ec79867 req-bec061c2-7278-41db-9701-65a7ac1c0a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4790820-2d09-47ab-9c4d-ec909dc7e1c1", "name": "network-vif-unplugged", "status": "completed", "tag": "8406eedb-691b-4d88-a1e7-a1e3cfda7983"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:12.534135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1da0d6da-6bb4-4ed4-9fe2-1e800ec79867 req-bec061c2-7278-41db-9701-65a7ac1c0a41 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:12.534900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1da0d6da-6bb4-4ed4-9fe2-1e800ec79867 req-bec061c2-7278-41db-9701-65a7ac1c0a41 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:12.550637 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-1da0d6da-6bb4-4ed4-9fe2-1e800ec79867 req-bec061c2-7278-41db-9701-65a7ac1c0a41 service nova] Creating event network-vif-unplugged:8406eedb-691b-4d88-a1e7-a1e3cfda7983 for instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 on n-h2-851337-3 Aug 02 06:54:12.556891 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-1da0d6da-6bb4-4ed4-9fe2-1e800ec79867 req-bec061c2-7278-41db-9701-65a7ac1c0a41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040669 Aug 02 06:54:12.557735 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1002/2117] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:12.564318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-fea8a94d-2eee-4d0a-80f8-c059856c7bfa req-9382c000-434f-424e-911d-5bed2f29a8dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea28a98b-bb58-40e2-8a62-635a752c0ecf", "name": "network-vif-deleted", "tag": "3083d4a4-9271-433f-b15d-aa9d26b3f2ec"}, {"server_uuid": "ea28a98b-bb58-40e2-8a62-635a752c0ecf", "name": "network-vif-deleted", "tag": "51402711-5427-41b3-8ae6-77cfbc3a0afc"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:12.575754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fea8a94d-2eee-4d0a-80f8-c059856c7bfa req-9382c000-434f-424e-911d-5bed2f29a8dc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:12.576535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fea8a94d-2eee-4d0a-80f8-c059856c7bfa req-9382c000-434f-424e-911d-5bed2f29a8dc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:12.591431 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-fea8a94d-2eee-4d0a-80f8-c059856c7bfa req-9382c000-434f-424e-911d-5bed2f29a8dc service nova] Creating event network-vif-deleted:3083d4a4-9271-433f-b15d-aa9d26b3f2ec for instance ea28a98b-bb58-40e2-8a62-635a752c0ecf on n-h2-851337-3 Aug 02 06:54:12.592320 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-fea8a94d-2eee-4d0a-80f8-c059856c7bfa req-9382c000-434f-424e-911d-5bed2f29a8dc service nova] Creating event network-vif-deleted:51402711-5427-41b3-8ae6-77cfbc3a0afc for instance ea28a98b-bb58-40e2-8a62-635a752c0ecf on n-h2-851337-3 Aug 02 06:54:12.601161 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-fea8a94d-2eee-4d0a-80f8-c059856c7bfa req-9382c000-434f-424e-911d-5bed2f29a8dc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041592 Aug 02 06:54:12.602300 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1003/2118] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:12.676228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-355823223", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "db7d01d8-40e0-493b-8992-76c9b63bb01d"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:12.768919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] validate_networks() for [('db7d01d8-40e0-493b-8992-76c9b63bb01d', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:54:12.795291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2a0eb971-2fd9-4f7d-9a1f-8183d1914ba8 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:12.796831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2a0eb971-2fd9-4f7d-9a1f-8183d1914ba8 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:12.813843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a0eb971-2fd9-4f7d-9a1f-8183d1914ba8 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:12.814315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a0eb971-2fd9-4f7d-9a1f-8183d1914ba8 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:12.815375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a0eb971-2fd9-4f7d-9a1f-8183d1914ba8 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:12.815699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a0eb971-2fd9-4f7d-9a1f-8183d1914ba8 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:13.299839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-2a0eb971-2fd9-4f7d-9a1f-8183d1914ba8 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 7780d516-e238-4ace-8533-903dd2a12caf {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:54:13.332666 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2a0eb971-2fd9-4f7d-9a1f-8183d1914ba8 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1968 microversion: 2.25 time: 0.888437 Aug 02 06:54:13.333334 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1116/2119] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:12 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1968 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:13.344484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d9440eae-d346-49b5-aa26-95ec4ee09b0a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:13.345518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d9440eae-d346-49b5-aa26-95ec4ee09b0a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:13.372148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9440eae-d346-49b5-aa26-95ec4ee09b0a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:13.372601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9440eae-d346-49b5-aa26-95ec4ee09b0a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:13.373386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9440eae-d346-49b5-aa26-95ec4ee09b0a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:13.373909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9440eae-d346-49b5-aa26-95ec4ee09b0a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:13.521990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d9440eae-d346-49b5-aa26-95ec4ee09b0a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:13.534871 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d9440eae-d346-49b5-aa26-95ec4ee09b0a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1281 microversion: 2.1 time: 0.194623 Aug 02 06:54:13.535835 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1117/2120] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:13 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1281 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:13.559212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b3d09592-9088-40ef-9922-c07597b42e58 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:13.560070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b3d09592-9088-40ef-9922-c07597b42e58 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:13.567945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3d09592-9088-40ef-9922-c07597b42e58 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:13.568896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3d09592-9088-40ef-9922-c07597b42e58 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:13.569931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3d09592-9088-40ef-9922-c07597b42e58 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:13.570604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3d09592-9088-40ef-9922-c07597b42e58 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:14.109271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:54:14.111373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:54:14.112041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:54:14.112640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:54:14.114008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:54:14.125443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:14.126266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:14.127607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:14.128449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:14.158644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Getting quotas for project 2a8dc75e5ba647e3b128c31a49f069ca. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:14.169133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Getting quotas for user 793620d46a6c42fb955f1fe5075b040b and project 2a8dc75e5ba647e3b128c31a49f069ca. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:14.177424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-b3d09592-9088-40ef-9922-c07597b42e58 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 7780d516-e238-4ace-8533-903dd2a12caf {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:54:14.185439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:54:14.190564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:54:14.208922 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b3d09592-9088-40ef-9922-c07597b42e58 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1968 microversion: 2.25 time: 0.667184 Aug 02 06:54:14.210049 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1118/2121] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:13 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1968 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:14.217010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5c6abca8-b6f6-4392-be39-8cc1375cf6de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:14.219458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5c6abca8-b6f6-4392-be39-8cc1375cf6de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:14.236224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c6abca8-b6f6-4392-be39-8cc1375cf6de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:14.237164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c6abca8-b6f6-4392-be39-8cc1375cf6de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:14.238661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c6abca8-b6f6-4392-be39-8cc1375cf6de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:14.239339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c6abca8-b6f6-4392-be39-8cc1375cf6de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:14.272039 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2f84c002-7e1b-4d80-b706-0d8f73ff448c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.602274 Aug 02 06:54:14.273375 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1004/2122] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:54:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:54:14.290744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-995991c3-6e38-4628-8238-cfaef4d6ee90 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:14.293858 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:54:14.293858 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:54:14.295224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-995991c3-6e38-4628-8238-cfaef4d6ee90 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:14.295727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-995991c3-6e38-4628-8238-cfaef4d6ee90 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:14.296533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-995991c3-6e38-4628-8238-cfaef4d6ee90 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:14.296968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-995991c3-6e38-4628-8238-cfaef4d6ee90 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:14.324536 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-995991c3-6e38-4628-8238-cfaef4d6ee90 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.049712 Aug 02 06:54:14.332336 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1005/2123] 10.222.0.79 () {60 vars in 1217 bytes} [Tue Aug 2 06:54:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:54:14.332336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e3696803-4932-4dcc-a0a7-7d4d57631893 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:14.332336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e3696803-4932-4dcc-a0a7-7d4d57631893 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:14.458259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e3696803-4932-4dcc-a0a7-7d4d57631893 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:14.472565 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e3696803-4932-4dcc-a0a7-7d4d57631893 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1207 microversion: 2.1 time: 0.145925 Aug 02 06:54:14.485760 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1006/2124] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:14 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1207 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:14.497814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ba6d16f7-ea88-4dc5-af5b-099a73708c3d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851337-3", "block_migration": "auto"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:14.502773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ba6d16f7-ea88-4dc5-af5b-099a73708c3d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:14.511533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba6d16f7-ea88-4dc5-af5b-099a73708c3d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:14.512113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba6d16f7-ea88-4dc5-af5b-099a73708c3d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:14.512980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba6d16f7-ea88-4dc5-af5b-099a73708c3d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:14.513768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba6d16f7-ea88-4dc5-af5b-099a73708c3d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:14.567395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-ba6d16f7-ea88-4dc5-af5b-099a73708c3d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'flavor' on Instance uuid 7780d516-e238-4ace-8533-903dd2a12caf {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:54:14.590636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ba6d16f7-ea88-4dc5-af5b-099a73708c3d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Going to try to live migrate instance to n-h2-851337-3 {{(pid=126119) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 02 06:54:14.939711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5c6abca8-b6f6-4392-be39-8cc1375cf6de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:14.950274 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5c6abca8-b6f6-4392-be39-8cc1375cf6de tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1535 microversion: 2.1 time: 0.738867 Aug 02 06:54:14.953300 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1119/2125] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:14 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1535 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:14.960829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-252709fa-acc2-41d6-a1b1-8b487859fc53 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:14.962977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-252709fa-acc2-41d6-a1b1-8b487859fc53 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:14.976948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-252709fa-acc2-41d6-a1b1-8b487859fc53 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:14.980189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-252709fa-acc2-41d6-a1b1-8b487859fc53 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:14.982219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-252709fa-acc2-41d6-a1b1-8b487859fc53 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:14.984266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-252709fa-acc2-41d6-a1b1-8b487859fc53 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:15.521684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-252709fa-acc2-41d6-a1b1-8b487859fc53 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:15.546460 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-252709fa-acc2-41d6-a1b1-8b487859fc53 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1269 microversion: 2.1 time: 0.591612 Aug 02 06:54:15.547520 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1120/2126] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:14 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1269 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:15.554743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b3821b0a-b8c5-45ef-be12-a4350444cf0b req-912cf511-11b6-4758-94f1-b5d1995851ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4790820-2d09-47ab-9c4d-ec909dc7e1c1", "name": "network-vif-deleted", "tag": "8406eedb-691b-4d88-a1e7-a1e3cfda7983"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:15.575535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b3821b0a-b8c5-45ef-be12-a4350444cf0b req-912cf511-11b6-4758-94f1-b5d1995851ca service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:15.576293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b3821b0a-b8c5-45ef-be12-a4350444cf0b req-912cf511-11b6-4758-94f1-b5d1995851ca service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:15.592778 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b3821b0a-b8c5-45ef-be12-a4350444cf0b req-912cf511-11b6-4758-94f1-b5d1995851ca service nova] Creating event network-vif-deleted:8406eedb-691b-4d88-a1e7-a1e3cfda7983 for instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 on n-h2-851337-3 Aug 02 06:54:15.598484 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b3821b0a-b8c5-45ef-be12-a4350444cf0b req-912cf511-11b6-4758-94f1-b5d1995851ca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047884 Aug 02 06:54:15.599782 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1121/2127] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:15.607103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1d6839b3-1a5c-4f75-b045-bcec879b10a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:15.608500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1d6839b3-1a5c-4f75-b045-bcec879b10a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:15.617250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d6839b3-1a5c-4f75-b045-bcec879b10a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:15.618045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d6839b3-1a5c-4f75-b045-bcec879b10a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:15.619069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d6839b3-1a5c-4f75-b045-bcec879b10a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:15.619665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d6839b3-1a5c-4f75-b045-bcec879b10a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:16.090424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1d6839b3-1a5c-4f75-b045-bcec879b10a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:16.109512 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1d6839b3-1a5c-4f75-b045-bcec879b10a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1259 microversion: 2.1 time: 0.508304 Aug 02 06:54:16.120314 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1122/2128] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:15 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1259 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:16.142374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c5178057-08c9-4287-9ca6-a566cb0326b9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:16.145249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c5178057-08c9-4287-9ca6-a566cb0326b9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:16.160494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5178057-08c9-4287-9ca6-a566cb0326b9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:16.162782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5178057-08c9-4287-9ca6-a566cb0326b9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:16.163814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5178057-08c9-4287-9ca6-a566cb0326b9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:16.165505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5178057-08c9-4287-9ca6-a566cb0326b9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:16.285921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=24 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:16.492915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c5178057-08c9-4287-9ca6-a566cb0326b9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:16.510457 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c5178057-08c9-4287-9ca6-a566cb0326b9 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 200 len: 1493 microversion: 2.1 time: 0.386551 Aug 02 06:54:16.511947 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1123/2129] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:16 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 1493 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:16.550944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-935b0000-8c2c-4cae-a018-3395108fdc58 req-6e0a3d72-ffe3-4f41-a127-6ddd90f8d51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4d0bb5-a719-464e-89ef-83065ae7f8bd", "name": "network-vif-deleted", "tag": "2cfda67e-633a-4a79-a15b-8314f7622ae0"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:16.561711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-935b0000-8c2c-4cae-a018-3395108fdc58 req-6e0a3d72-ffe3-4f41-a127-6ddd90f8d51b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:16.562468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-935b0000-8c2c-4cae-a018-3395108fdc58 req-6e0a3d72-ffe3-4f41-a127-6ddd90f8d51b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:16.576007 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-935b0000-8c2c-4cae-a018-3395108fdc58 req-6e0a3d72-ffe3-4f41-a127-6ddd90f8d51b service nova] Creating event network-vif-deleted:2cfda67e-633a-4a79-a15b-8314f7622ae0 for instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd on n-h1-851337-3 Aug 02 06:54:16.581967 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-935b0000-8c2c-4cae-a018-3395108fdc58 req-6e0a3d72-ffe3-4f41-a127-6ddd90f8d51b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034890 Aug 02 06:54:16.583650 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1124/2130] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:16.590604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3d633e6f-6e9a-47a3-a778-f58b354b858a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:16.591639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3d633e6f-6e9a-47a3-a778-f58b354b858a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:16.598770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d633e6f-6e9a-47a3-a778-f58b354b858a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:16.599451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d633e6f-6e9a-47a3-a778-f58b354b858a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:16.600391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d633e6f-6e9a-47a3-a778-f58b354b858a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:16.601015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d633e6f-6e9a-47a3-a778-f58b354b858a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:16.775902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3d633e6f-6e9a-47a3-a778-f58b354b858a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:16.784180 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3d633e6f-6e9a-47a3-a778-f58b354b858a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1269 microversion: 2.1 time: 0.198061 Aug 02 06:54:16.784905 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1125/2131] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:16 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1269 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:17.145797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0f9a8860-497d-4023-916b-4214e4d6d69c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:17.146706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0f9a8860-497d-4023-916b-4214e4d6d69c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:17.158691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f9a8860-497d-4023-916b-4214e4d6d69c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:17.159174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f9a8860-497d-4023-916b-4214e4d6d69c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:17.159965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f9a8860-497d-4023-916b-4214e4d6d69c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:17.163090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f9a8860-497d-4023-916b-4214e4d6d69c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:17.368168 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ba6d16f7-ea88-4dc5-af5b-099a73708c3d tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf/action" status: 202 len: 0 microversion: 2.25 time: 2.879642 Aug 02 06:54:17.371149 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1007/2132] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Aug 2 06:54:14 2022] POST /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf/action => generated 0 bytes in 2884 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:54:17.388445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d6bdfee4-f88d-4019-b335-086f5cd165d7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:17.391918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d6bdfee4-f88d-4019-b335-086f5cd165d7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:17.408129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0f9a8860-497d-4023-916b-4214e4d6d69c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:17.426601 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0f9a8860-497d-4023-916b-4214e4d6d69c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1265 microversion: 2.1 time: 0.285255 Aug 02 06:54:17.428483 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1126/2133] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:17 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:54:17.433198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6bdfee4-f88d-4019-b335-086f5cd165d7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:17.435781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6bdfee4-f88d-4019-b335-086f5cd165d7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:17.440236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6bdfee4-f88d-4019-b335-086f5cd165d7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:17.443033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6bdfee4-f88d-4019-b335-086f5cd165d7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:17.533138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f29c90fa-a76e-4c10-b88d-01e736fe7399 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:17.533770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f29c90fa-a76e-4c10-b88d-01e736fe7399 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: cd4d0bb5-a719-464e-89ef-83065ae7f8bd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:17.549108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f29c90fa-a76e-4c10-b88d-01e736fe7399 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:17.550679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f29c90fa-a76e-4c10-b88d-01e736fe7399 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:17.553205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f29c90fa-a76e-4c10-b88d-01e736fe7399 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:17.554410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f29c90fa-a76e-4c10-b88d-01e736fe7399 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:17.592848 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-f29c90fa-a76e-4c10-b88d-01e736fe7399 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] HTTP exception thrown: Instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd could not be found. Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f29c90fa-a76e-4c10-b88d-01e736fe7399 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Request method failure captured: Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd HTTP/1.1 Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mil14MrqUIflgbg_0m6eSvWnATGyi4dxApKFYL7uiPVfLQzElvfEtTHVs9oItTTFNLdGLaH5TlX5bUN7yaMEIhck3MjUYsbu0qEca4eDexanQN9ORFeDjdfV-_1gtk6WgSp1XM4giCm224UVntHDA9IjGBMojIWp9cBPmwrLH9mp5M Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 1e08c65240da4f90a190b2da77a8ff92 Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-MigrationsAdminTest-1968435112 Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1e08c65240da4f90a190b2da77a8ff92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1e08c65240da4f90a190b2da77a8ff92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1e08c65240da4f90a190b2da77a8ff92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1e08c65240da4f90a190b2da77a8ff92"}]}] Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-MigrationsAdminTest-1968435112 Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 1e08c65240da4f90a190b2da77a8ff92 Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-MigrationsAdminTest-1968435112 Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-MigrationsAdminTest-1968435112-project Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 87d1c9cb22d34aaa8b86860b84a1086d Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-MigrationsAdminTest-1968435112-project Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd could not be found. Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'cd4d0bb5-a719-464e-89ef-83065ae7f8bd'} Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd could not be found. Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd could not be found. Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:17.596128 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:17.604206 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:17.604206 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:17.604206 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:17.604206 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:17.604206 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:17.604206 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd could not be found. Aug 02 06:54:17.604206 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:17.622180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f29c90fa-a76e-4c10-b88d-01e736fe7399 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Returning 404 to user: Instance cd4d0bb5-a719-464e-89ef-83065ae7f8bd could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:17.624989 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f29c90fa-a76e-4c10-b88d-01e736fe7399 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd" status: 404 len: 111 microversion: 2.1 time: 0.094402 Aug 02 06:54:17.629044 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1127/2134] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:17 2022] GET /compute/v2.1/servers/cd4d0bb5-a719-464e-89ef-83065ae7f8bd => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:54:17.637936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-af33e3b1-c897-412e-9f83-ecca36f72c85 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '.version_select at 0x7f927a79d550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:17.680329 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-af33e3b1-c897-412e-9f83-ecca36f72c85 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-947657374" status: 202 len: 0 microversion: 2.1 time: 0.048937 Aug 02 06:54:17.681939 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1128/2135] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Aug 2 06:54:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-947657374 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:54:17.807028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-87d54a7e-5f5a-4920-ad28-aa37644c26b0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:17.807645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-87d54a7e-5f5a-4920-ad28-aa37644c26b0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:17.822160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87d54a7e-5f5a-4920-ad28-aa37644c26b0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:17.822870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87d54a7e-5f5a-4920-ad28-aa37644c26b0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:17.823823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87d54a7e-5f5a-4920-ad28-aa37644c26b0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:17.824421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87d54a7e-5f5a-4920-ad28-aa37644c26b0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:18.208387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d6bdfee4-f88d-4019-b335-086f5cd165d7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:18.219978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d6bdfee4-f88d-4019-b335-086f5cd165d7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:18.224677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d6bdfee4-f88d-4019-b335-086f5cd165d7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:18.231968 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d6bdfee4-f88d-4019-b335-086f5cd165d7 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1486 microversion: 2.25 time: 0.852129 Aug 02 06:54:18.245072 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1008/2136] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:17 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1486 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:18.334384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-87d54a7e-5f5a-4920-ad28-aa37644c26b0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:18.346278 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-87d54a7e-5f5a-4920-ad28-aa37644c26b0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1311 microversion: 2.1 time: 0.543167 Aug 02 06:54:18.360478 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1129/2137] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:17 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1311 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:18.452123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4a0c123e-46bf-4dca-b35a-067a0f85ad47 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:18.452846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4a0c123e-46bf-4dca-b35a-067a0f85ad47 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:18.488244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a0c123e-46bf-4dca-b35a-067a0f85ad47 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:18.488244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a0c123e-46bf-4dca-b35a-067a0f85ad47 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:18.490115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a0c123e-46bf-4dca-b35a-067a0f85ad47 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:18.490802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a0c123e-46bf-4dca-b35a-067a0f85ad47 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:19.267272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b8f284a1-ddfe-484a-a479-58fb2f6b0180 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:19.268801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b8f284a1-ddfe-484a-a479-58fb2f6b0180 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:19.286297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8f284a1-ddfe-484a-a479-58fb2f6b0180 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:19.289565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8f284a1-ddfe-484a-a479-58fb2f6b0180 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:19.291702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8f284a1-ddfe-484a-a479-58fb2f6b0180 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:19.292873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8f284a1-ddfe-484a-a479-58fb2f6b0180 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:19.572905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4a0c123e-46bf-4dca-b35a-067a0f85ad47 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:19.585305 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4a0c123e-46bf-4dca-b35a-067a0f85ad47 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1307 microversion: 2.1 time: 1.138662 Aug 02 06:54:19.586225 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1009/2138] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:18 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1307 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:19.597176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-967cfebd-be4b-41fb-bd1c-8b49be7add71 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:19.602880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-967cfebd-be4b-41fb-bd1c-8b49be7add71 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:19.618904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-967cfebd-be4b-41fb-bd1c-8b49be7add71 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:19.620021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-967cfebd-be4b-41fb-bd1c-8b49be7add71 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:19.622588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-967cfebd-be4b-41fb-bd1c-8b49be7add71 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:19.623241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-967cfebd-be4b-41fb-bd1c-8b49be7add71 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:20.584623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b8f284a1-ddfe-484a-a479-58fb2f6b0180 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:20.602296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b8f284a1-ddfe-484a-a479-58fb2f6b0180 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:20.608782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b8f284a1-ddfe-484a-a479-58fb2f6b0180 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:20.615294 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b8f284a1-ddfe-484a-a479-58fb2f6b0180 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1486 microversion: 2.25 time: 1.347856 Aug 02 06:54:20.618251 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1130/2139] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:19 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1486 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:20.637858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b9984888-a77c-4e88-9a37-8bc652133f06 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:20.638891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b9984888-a77c-4e88-9a37-8bc652133f06 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:20.658320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9984888-a77c-4e88-9a37-8bc652133f06 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:20.658705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9984888-a77c-4e88-9a37-8bc652133f06 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:20.659626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9984888-a77c-4e88-9a37-8bc652133f06 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:20.660076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9984888-a77c-4e88-9a37-8bc652133f06 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:20.673300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-967cfebd-be4b-41fb-bd1c-8b49be7add71 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:20.693382 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-967cfebd-be4b-41fb-bd1c-8b49be7add71 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1311 microversion: 2.1 time: 1.102912 Aug 02 06:54:20.694345 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1010/2140] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:19 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1311 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:21.334091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-253d7e51-200d-48fb-8f73-1ed1d9423552 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:21.335775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-253d7e51-200d-48fb-8f73-1ed1d9423552 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:21.358405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-253d7e51-200d-48fb-8f73-1ed1d9423552 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:21.363111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-253d7e51-200d-48fb-8f73-1ed1d9423552 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:21.364381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-253d7e51-200d-48fb-8f73-1ed1d9423552 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:21.364944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-253d7e51-200d-48fb-8f73-1ed1d9423552 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:21.417949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-253d7e51-200d-48fb-8f73-1ed1d9423552 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:54:21.450808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:21.568776 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-253d7e51-200d-48fb-8f73-1ed1d9423552 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 204 len: 0 microversion: 2.1 time: 0.240577 Aug 02 06:54:21.573768 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1011/2141] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:54:21 2022] DELETE /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 06:54:21.583915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e633e095-218d-4ab2-b0e5-6194d3eb257d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:21.585240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e633e095-218d-4ab2-b0e5-6194d3eb257d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:21.594452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e633e095-218d-4ab2-b0e5-6194d3eb257d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:21.595543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e633e095-218d-4ab2-b0e5-6194d3eb257d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:21.596670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e633e095-218d-4ab2-b0e5-6194d3eb257d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:21.597350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e633e095-218d-4ab2-b0e5-6194d3eb257d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:22.207579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b9984888-a77c-4e88-9a37-8bc652133f06 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:22.222662 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b9984888-a77c-4e88-9a37-8bc652133f06 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1307 microversion: 2.1 time: 1.601408 Aug 02 06:54:22.223612 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1131/2142] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:20 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1307 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:22.228637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0eb71106-3972-42be-90a0-21a10041554d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:22.233186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0eb71106-3972-42be-90a0-21a10041554d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:22.245437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0eb71106-3972-42be-90a0-21a10041554d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:22.250962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0eb71106-3972-42be-90a0-21a10041554d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:22.252499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0eb71106-3972-42be-90a0-21a10041554d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:22.253193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0eb71106-3972-42be-90a0-21a10041554d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:22.543120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e633e095-218d-4ab2-b0e5-6194d3eb257d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:22.566294 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e633e095-218d-4ab2-b0e5-6194d3eb257d tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1467 microversion: 2.1 time: 0.988534 Aug 02 06:54:22.569222 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1012/2143] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:21 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1467 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:22.577021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ce4e501b-27a0-44b8-a952-e5077ff56796 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:22.579009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ce4e501b-27a0-44b8-a952-e5077ff56796 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:22.603233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ce4e501b-27a0-44b8-a952-e5077ff56796 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:22.603692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ce4e501b-27a0-44b8-a952-e5077ff56796 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:22.604730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ce4e501b-27a0-44b8-a952-e5077ff56796 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:22.605340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ce4e501b-27a0-44b8-a952-e5077ff56796 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:23.110925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0eb71106-3972-42be-90a0-21a10041554d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:23.122770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0eb71106-3972-42be-90a0-21a10041554d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:23.125291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0eb71106-3972-42be-90a0-21a10041554d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:23.127231 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0eb71106-3972-42be-90a0-21a10041554d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1486 microversion: 2.25 time: 0.902118 Aug 02 06:54:23.138921 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1132/2144] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:22 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1486 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:23.151411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-dd0ac848-34b1-4c5f-983c-f80ea00a17d1 req-e3fedaae-2160-43f0-af1c-5aa92cba1594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c456ed4-7594-41a2-b20b-586e70c56c68", "tag": "0da1f47c-356c-4cd1-9eb8-ca39540cb389"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:23.165349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-dd0ac848-34b1-4c5f-983c-f80ea00a17d1 req-e3fedaae-2160-43f0-af1c-5aa92cba1594 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:23.166191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-dd0ac848-34b1-4c5f-983c-f80ea00a17d1 req-e3fedaae-2160-43f0-af1c-5aa92cba1594 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:23.179809 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-dd0ac848-34b1-4c5f-983c-f80ea00a17d1 req-e3fedaae-2160-43f0-af1c-5aa92cba1594 service nova] Creating event network-changed:0da1f47c-356c-4cd1-9eb8-ca39540cb389 for instance 0c456ed4-7594-41a2-b20b-586e70c56c68 on n-h2-851337-3 Aug 02 06:54:23.188692 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-dd0ac848-34b1-4c5f-983c-f80ea00a17d1 req-e3fedaae-2160-43f0-af1c-5aa92cba1594 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042137 Aug 02 06:54:23.190023 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1133/2145] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:23.200077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1301698950", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "330c3778-abe2-4115-91fc-d4f28584fda0"}, {"uuid": "c78948c2-def8-43e0-ad47-2ac03fe9d13b"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:23.281960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] validate_networks() for [('330c3778-abe2-4115-91fc-d4f28584fda0', None, None, None, None, None), ('c78948c2-def8-43e0-ad47-2ac03fe9d13b', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:54:23.409828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ce4e501b-27a0-44b8-a952-e5077ff56796 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:23.421207 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ce4e501b-27a0-44b8-a952-e5077ff56796 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1311 microversion: 2.1 time: 0.850240 Aug 02 06:54:23.422800 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1013/2146] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:22 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1311 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:23.446037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1413f93d-3635-4977-a521-61b90e798cee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:23.448082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1413f93d-3635-4977-a521-61b90e798cee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:23.475095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1413f93d-3635-4977-a521-61b90e798cee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:23.475952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1413f93d-3635-4977-a521-61b90e798cee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:23.477500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1413f93d-3635-4977-a521-61b90e798cee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:23.478219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1413f93d-3635-4977-a521-61b90e798cee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:24.306967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:24.462871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=38 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:24.558451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1413f93d-3635-4977-a521-61b90e798cee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:24.573464 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1413f93d-3635-4977-a521-61b90e798cee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1307 microversion: 2.1 time: 1.131394 Aug 02 06:54:24.574430 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1014/2147] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:23 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1307 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:24.579918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3d6947ef-77dd-4b6d-bc38-1b9e60ddd495 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:24.580777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3d6947ef-77dd-4b6d-bc38-1b9e60ddd495 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:24.588040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d6947ef-77dd-4b6d-bc38-1b9e60ddd495 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:24.589000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d6947ef-77dd-4b6d-bc38-1b9e60ddd495 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:24.589972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d6947ef-77dd-4b6d-bc38-1b9e60ddd495 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:24.590626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d6947ef-77dd-4b6d-bc38-1b9e60ddd495 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:25.401038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3d6947ef-77dd-4b6d-bc38-1b9e60ddd495 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:25.410583 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3d6947ef-77dd-4b6d-bc38-1b9e60ddd495 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1467 microversion: 2.1 time: 0.834949 Aug 02 06:54:25.411380 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1015/2148] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:24 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1467 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:25.416268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c788bd80-3a4b-43a7-9505-22164a25c9a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:25.417068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c788bd80-3a4b-43a7-9505-22164a25c9a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:25.423486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c788bd80-3a4b-43a7-9505-22164a25c9a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:25.425324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c788bd80-3a4b-43a7-9505-22164a25c9a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:25.425324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c788bd80-3a4b-43a7-9505-22164a25c9a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:25.425668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c788bd80-3a4b-43a7-9505-22164a25c9a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:25.774690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c788bd80-3a4b-43a7-9505-22164a25c9a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:25.789690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c788bd80-3a4b-43a7-9505-22164a25c9a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:25.791537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c788bd80-3a4b-43a7-9505-22164a25c9a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:25.792890 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c788bd80-3a4b-43a7-9505-22164a25c9a4 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1486 microversion: 2.25 time: 0.380413 Aug 02 06:54:25.793699 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1016/2149] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:25 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1486 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:25.815053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72a76bca-6220-43e7-9dcb-5a1237e3d95b tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:25.815887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-72a76bca-6220-43e7-9dcb-5a1237e3d95b tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:25.817762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:25.825147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72a76bca-6220-43e7-9dcb-5a1237e3d95b tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:25.825994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72a76bca-6220-43e7-9dcb-5a1237e3d95b tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:25.826960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72a76bca-6220-43e7-9dcb-5a1237e3d95b tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:25.827462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72a76bca-6220-43e7-9dcb-5a1237e3d95b tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:26.384353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-72a76bca-6220-43e7-9dcb-5a1237e3d95b tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:26.396149 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-72a76bca-6220-43e7-9dcb-5a1237e3d95b tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1311 microversion: 2.1 time: 0.584555 Aug 02 06:54:26.397430 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1017/2150] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:25 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1311 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:26.403666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-20abd1ff-b827-4057-8c19-7b2803cb6654 req-b5411282-44f1-4150-add0-aa048aeeee99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27beb807-e873-4cfb-a895-c16a1bd7ad43", "tag": "d0b0f68c-057f-4516-89ae-466675ea705a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:26.416961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-20abd1ff-b827-4057-8c19-7b2803cb6654 req-b5411282-44f1-4150-add0-aa048aeeee99 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:26.417805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-20abd1ff-b827-4057-8c19-7b2803cb6654 req-b5411282-44f1-4150-add0-aa048aeeee99 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:26.437588 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-20abd1ff-b827-4057-8c19-7b2803cb6654 req-b5411282-44f1-4150-add0-aa048aeeee99 service nova] Creating event network-changed:d0b0f68c-057f-4516-89ae-466675ea705a for instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 on n-h1-851337-3 Aug 02 06:54:26.444905 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-20abd1ff-b827-4057-8c19-7b2803cb6654 req-b5411282-44f1-4150-add0-aa048aeeee99 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045797 Aug 02 06:54:26.446092 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1018/2151] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:26.453827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5e22b294-edef-45a2-af0f-960e2886602f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:26.454950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5e22b294-edef-45a2-af0f-960e2886602f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:26.463668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e22b294-edef-45a2-af0f-960e2886602f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:26.465492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e22b294-edef-45a2-af0f-960e2886602f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:26.468506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e22b294-edef-45a2-af0f-960e2886602f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:26.469924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e22b294-edef-45a2-af0f-960e2886602f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:26.980026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:54:26.980614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:54:26.981040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:54:26.981470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:54:26.982385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:54:26.995855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:26.996527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:26.997497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:27.011639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:27.055342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Getting quotas for project 76c70f1ab140418e813917aa08d23033. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:27.061580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Getting quotas for user a4d6484337c84897813ab767ad7d058b and project 76c70f1ab140418e813917aa08d23033. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:27.078645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:54:27.082223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:54:27.100977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=7,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:27.176075 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-deab8f81-58d1-43ae-8f7b-aa4475197266 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.982694 Aug 02 06:54:27.178571 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1134/2152] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:54:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:54:27.191823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a991f40d-1e1c-49f3-ad7f-6d29764bf1d8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:27.192674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a991f40d-1e1c-49f3-ad7f-6d29764bf1d8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:27.214767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a991f40d-1e1c-49f3-ad7f-6d29764bf1d8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:27.215428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a991f40d-1e1c-49f3-ad7f-6d29764bf1d8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:27.217525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a991f40d-1e1c-49f3-ad7f-6d29764bf1d8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:27.219100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a991f40d-1e1c-49f3-ad7f-6d29764bf1d8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:27.223399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5e22b294-edef-45a2-af0f-960e2886602f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:27.232149 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5e22b294-edef-45a2-af0f-960e2886602f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1307 microversion: 2.1 time: 0.784171 Aug 02 06:54:27.232746 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1019/2153] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:26 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1307 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:27.240920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-089470ff-e7cb-4d10-9e16-081d6e25b48c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:27.246850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-089470ff-e7cb-4d10-9e16-081d6e25b48c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:27.261380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-089470ff-e7cb-4d10-9e16-081d6e25b48c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:27.262210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-089470ff-e7cb-4d10-9e16-081d6e25b48c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:27.263306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-089470ff-e7cb-4d10-9e16-081d6e25b48c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:27.265052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-089470ff-e7cb-4d10-9e16-081d6e25b48c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:27.458273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a991f40d-1e1c-49f3-ad7f-6d29764bf1d8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:27.470292 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a991f40d-1e1c-49f3-ad7f-6d29764bf1d8 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1425 microversion: 2.1 time: 0.289765 Aug 02 06:54:27.481926 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1135/2154] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:27 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1425 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:27.487424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c430bb55-bb01-433f-b5d0-814a003eae34 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:27.489665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c430bb55-bb01-433f-b5d0-814a003eae34 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:27.679996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c430bb55-bb01-433f-b5d0-814a003eae34 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:27.694330 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c430bb55-bb01-433f-b5d0-814a003eae34 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1213 microversion: 2.1 time: 0.218864 Aug 02 06:54:27.696176 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1136/2155] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:27 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1213 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:27.719470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-14c0d23d-439c-4820-90c3-fbcd3a4f8196 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:27.720687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-14c0d23d-439c-4820-90c3-fbcd3a4f8196 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:27.757028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14c0d23d-439c-4820-90c3-fbcd3a4f8196 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:27.757477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14c0d23d-439c-4820-90c3-fbcd3a4f8196 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:27.764350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14c0d23d-439c-4820-90c3-fbcd3a4f8196 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:27.765656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14c0d23d-439c-4820-90c3-fbcd3a4f8196 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:27.790597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:27.834798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-089470ff-e7cb-4d10-9e16-081d6e25b48c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:27.850373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-089470ff-e7cb-4d10-9e16-081d6e25b48c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:27.866491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-089470ff-e7cb-4d10-9e16-081d6e25b48c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:27.873117 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-089470ff-e7cb-4d10-9e16-081d6e25b48c tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1486 microversion: 2.25 time: 0.635883 Aug 02 06:54:27.876309 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1020/2156] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:27 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1486 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:28.260365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-144d47ec-80e3-4d34-b2be-3e08322699bf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:28.264501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-144d47ec-80e3-4d34-b2be-3e08322699bf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:28.300129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-144d47ec-80e3-4d34-b2be-3e08322699bf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:28.303760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-144d47ec-80e3-4d34-b2be-3e08322699bf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:28.304603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-144d47ec-80e3-4d34-b2be-3e08322699bf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:28.307390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-144d47ec-80e3-4d34-b2be-3e08322699bf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:28.519801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-14c0d23d-439c-4820-90c3-fbcd3a4f8196 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:28.534250 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-14c0d23d-439c-4820-90c3-fbcd3a4f8196 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1311 microversion: 2.1 time: 0.835192 Aug 02 06:54:28.536180 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1137/2157] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:27 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1311 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:28.546029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ae707edf-56e3-47fe-aab2-59a45cfc9b90 req-3151edd6-2a29-4cc8-940f-2a86012239cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c976a871-9aa2-4330-9e0c-363aadd04223", "name": "network-vif-deleted", "tag": "9b2e2b0e-a0fa-4b06-96ce-29c660765c8f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:28.561457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ae707edf-56e3-47fe-aab2-59a45cfc9b90 req-3151edd6-2a29-4cc8-940f-2a86012239cc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:28.562592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ae707edf-56e3-47fe-aab2-59a45cfc9b90 req-3151edd6-2a29-4cc8-940f-2a86012239cc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:28.611996 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ae707edf-56e3-47fe-aab2-59a45cfc9b90 req-3151edd6-2a29-4cc8-940f-2a86012239cc service nova] Creating event network-vif-deleted:9b2e2b0e-a0fa-4b06-96ce-29c660765c8f for instance c976a871-9aa2-4330-9e0c-363aadd04223 on n-h1-851337-3 Aug 02 06:54:28.626004 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ae707edf-56e3-47fe-aab2-59a45cfc9b90 req-3151edd6-2a29-4cc8-940f-2a86012239cc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087646 Aug 02 06:54:28.628817 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1138/2158] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:28.640870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-856d1f41-ba24-49ec-8d64-37c79efc6d3b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:28.643750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-856d1f41-ba24-49ec-8d64-37c79efc6d3b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:28.661914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-856d1f41-ba24-49ec-8d64-37c79efc6d3b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:28.664692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-856d1f41-ba24-49ec-8d64-37c79efc6d3b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:28.665641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-856d1f41-ba24-49ec-8d64-37c79efc6d3b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:28.666793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-856d1f41-ba24-49ec-8d64-37c79efc6d3b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:28.698264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-144d47ec-80e3-4d34-b2be-3e08322699bf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:28.710204 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-144d47ec-80e3-4d34-b2be-3e08322699bf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1307 microversion: 2.1 time: 0.461004 Aug 02 06:54:28.715743 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1021/2159] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:28 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1307 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:28.727871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b77b6663-c526-49cd-bb00-b6e4accb17f8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:28.735110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b77b6663-c526-49cd-bb00-b6e4accb17f8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:28.755440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b77b6663-c526-49cd-bb00-b6e4accb17f8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:28.755885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b77b6663-c526-49cd-bb00-b6e4accb17f8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:28.761564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-856d1f41-ba24-49ec-8d64-37c79efc6d3b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:28.761844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b77b6663-c526-49cd-bb00-b6e4accb17f8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:28.762460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b77b6663-c526-49cd-bb00-b6e4accb17f8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:28.763035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-856d1f41-ba24-49ec-8d64-37c79efc6d3b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:28.763696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-856d1f41-ba24-49ec-8d64-37c79efc6d3b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lazy-loading 'fault' on Instance uuid c976a871-9aa2-4330-9e0c-363aadd04223 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:54:28.847188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-856d1f41-ba24-49ec-8d64-37c79efc6d3b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:28.866372 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-856d1f41-ba24-49ec-8d64-37c79efc6d3b tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 200 len: 1302 microversion: 2.1 time: 0.234953 Aug 02 06:54:28.867169 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1139/2160] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:28 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 1302 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:28.922094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b77b6663-c526-49cd-bb00-b6e4accb17f8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:28.937843 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b77b6663-c526-49cd-bb00-b6e4accb17f8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1209 microversion: 2.1 time: 0.217145 Aug 02 06:54:28.938504 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1022/2161] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:28 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1209 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:28.958645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f2a4b8ac-56d5-4ea7-ace6-9c710a646da0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:28.959012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f2a4b8ac-56d5-4ea7-ace6-9c710a646da0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:28.974525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2a4b8ac-56d5-4ea7-ace6-9c710a646da0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:28.975080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2a4b8ac-56d5-4ea7-ace6-9c710a646da0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:28.976699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2a4b8ac-56d5-4ea7-ace6-9c710a646da0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:28.979076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2a4b8ac-56d5-4ea7-ace6-9c710a646da0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:29.157368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d93705ba-deeb-4f37-9d45-a7d39f79d11c tempest-AZV2TestJSON-869397451 tempest-AZV2TestJSON-869397451-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:29.159730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d93705ba-deeb-4f37-9d45-a7d39f79d11c tempest-AZV2TestJSON-869397451 tempest-AZV2TestJSON-869397451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:29.160383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d93705ba-deeb-4f37-9d45-a7d39f79d11c tempest-AZV2TestJSON-869397451 tempest-AZV2TestJSON-869397451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:29.161360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d93705ba-deeb-4f37-9d45-a7d39f79d11c tempest-AZV2TestJSON-869397451 tempest-AZV2TestJSON-869397451-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:29.162437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d93705ba-deeb-4f37-9d45-a7d39f79d11c tempest-AZV2TestJSON-869397451 tempest-AZV2TestJSON-869397451-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:29.218907 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d93705ba-deeb-4f37-9d45-a7d39f79d11c tempest-AZV2TestJSON-869397451 tempest-AZV2TestJSON-869397451-project] 10.222.0.79 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.350433 Aug 02 06:54:29.220299 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1140/2162] 10.222.0.79 () {58 vars in 1164 bytes} [Tue Aug 2 06:54:28 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:54:29.340195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f2a4b8ac-56d5-4ea7-ace6-9c710a646da0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:29.360082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f2a4b8ac-56d5-4ea7-ace6-9c710a646da0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:29.365385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f2a4b8ac-56d5-4ea7-ace6-9c710a646da0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:29.367053 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f2a4b8ac-56d5-4ea7-ace6-9c710a646da0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1486 microversion: 2.25 time: 0.421639 Aug 02 06:54:29.368419 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1023/2163] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:28 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1486 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:29.557668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b3cd8ea2-0893-4430-86dc-22f7f0aba9c8 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:29.562220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b3cd8ea2-0893-4430-86dc-22f7f0aba9c8 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:29.574254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3cd8ea2-0893-4430-86dc-22f7f0aba9c8 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:29.574967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3cd8ea2-0893-4430-86dc-22f7f0aba9c8 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:29.575916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3cd8ea2-0893-4430-86dc-22f7f0aba9c8 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:29.576526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3cd8ea2-0893-4430-86dc-22f7f0aba9c8 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:29.738146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f9975030-e6b9-4f0a-8e6e-c21b656f51a8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:29.739091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f9975030-e6b9-4f0a-8e6e-c21b656f51a8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:29.760237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9975030-e6b9-4f0a-8e6e-c21b656f51a8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:29.761311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9975030-e6b9-4f0a-8e6e-c21b656f51a8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:29.762764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9975030-e6b9-4f0a-8e6e-c21b656f51a8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:29.763473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9975030-e6b9-4f0a-8e6e-c21b656f51a8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:29.899598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b3cd8ea2-0893-4430-86dc-22f7f0aba9c8 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:29.910423 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b3cd8ea2-0893-4430-86dc-22f7f0aba9c8 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1311 microversion: 2.1 time: 0.357625 Aug 02 06:54:29.911816 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1141/2164] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:29 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1311 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:30.046098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f9975030-e6b9-4f0a-8e6e-c21b656f51a8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:30.056839 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f9975030-e6b9-4f0a-8e6e-c21b656f51a8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1307 microversion: 2.1 time: 0.324851 Aug 02 06:54:30.059981 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1024/2165] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:29 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1307 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:30.070788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-d1e478b4-68c2-4d8b-9cc3-37bf6b8a004e req-861892c0-bf64-4ccf-b02d-ac3107d1299a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c456ed4-7594-41a2-b20b-586e70c56c68", "name": "network-vif-plugged", "status": "completed", "tag": "0da1f47c-356c-4cd1-9eb8-ca39540cb389"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:30.101598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d1e478b4-68c2-4d8b-9cc3-37bf6b8a004e req-861892c0-bf64-4ccf-b02d-ac3107d1299a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:30.102082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d1e478b4-68c2-4d8b-9cc3-37bf6b8a004e req-861892c0-bf64-4ccf-b02d-ac3107d1299a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:30.127715 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-d1e478b4-68c2-4d8b-9cc3-37bf6b8a004e req-861892c0-bf64-4ccf-b02d-ac3107d1299a service nova] Creating event network-vif-plugged:0da1f47c-356c-4cd1-9eb8-ca39540cb389 for instance 0c456ed4-7594-41a2-b20b-586e70c56c68 on n-h2-851337-3 Aug 02 06:54:30.137645 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-d1e478b4-68c2-4d8b-9cc3-37bf6b8a004e req-861892c0-bf64-4ccf-b02d-ac3107d1299a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076323 Aug 02 06:54:30.138619 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1025/2166] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:30.149281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1166160155", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "9b6a7afa-4e32-4948-bd23-d18a5d46daad"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:30.155488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1a534a9-20c4-432b-b25d-67b64a2fd86c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:30.158428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b1a534a9-20c4-432b-b25d-67b64a2fd86c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: c976a871-9aa2-4330-9e0c-363aadd04223] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:30.166725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1a534a9-20c4-432b-b25d-67b64a2fd86c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:30.167429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1a534a9-20c4-432b-b25d-67b64a2fd86c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:30.168388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1a534a9-20c4-432b-b25d-67b64a2fd86c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:30.169006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1a534a9-20c4-432b-b25d-67b64a2fd86c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:30.192739 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-b1a534a9-20c4-432b-b25d-67b64a2fd86c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] HTTP exception thrown: Instance c976a871-9aa2-4330-9e0c-363aadd04223 could not be found. Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1a534a9-20c4-432b-b25d-67b64a2fd86c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Request method failure captured: Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 HTTP/1.1 Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mil14MrqUIflgbg_0m6eSvWnATGyi4dxApKFYL7uiPVfLQzElvfEtTHVs9oItTTFNLdGLaH5TlX5bUN7yaMEIhck3MjUYsbu0qEca4eDexanQN9ORFeDjdfV-_1gtk6WgSp1XM4giCm224UVntHDA9IjGBMojIWp9cBPmwrLH9mp5M Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 1e08c65240da4f90a190b2da77a8ff92 Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-MigrationsAdminTest-1968435112 Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1e08c65240da4f90a190b2da77a8ff92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1e08c65240da4f90a190b2da77a8ff92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1e08c65240da4f90a190b2da77a8ff92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1e08c65240da4f90a190b2da77a8ff92"}]}] Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-MigrationsAdminTest-1968435112 Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 1e08c65240da4f90a190b2da77a8ff92 Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-MigrationsAdminTest-1968435112 Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-MigrationsAdminTest-1968435112-project Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 87d1c9cb22d34aaa8b86860b84a1086d Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-MigrationsAdminTest-1968435112-project Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance c976a871-9aa2-4330-9e0c-363aadd04223 could not be found. Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'c976a871-9aa2-4330-9e0c-363aadd04223'} Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c976a871-9aa2-4330-9e0c-363aadd04223 could not be found. Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c976a871-9aa2-4330-9e0c-363aadd04223 could not be found. Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:30.196329 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:30.203712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:30.203712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:30.203712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:30.203712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:30.203712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:30.203712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c976a871-9aa2-4330-9e0c-363aadd04223 could not be found. Aug 02 06:54:30.203712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:30.203712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1a534a9-20c4-432b-b25d-67b64a2fd86c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Returning 404 to user: Instance c976a871-9aa2-4330-9e0c-363aadd04223 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:30.203712 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b1a534a9-20c4-432b-b25d-67b64a2fd86c tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223" status: 404 len: 111 microversion: 2.1 time: 0.057487 Aug 02 06:54:30.203712 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1026/2167] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:30 2022] GET /compute/v2.1/servers/c976a871-9aa2-4330-9e0c-363aadd04223 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:30.203712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5b3d0b8c-e9d2-4449-a779-5343c367d00d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:30.204657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5b3d0b8c-e9d2-4449-a779-5343c367d00d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:30.210294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b3d0b8c-e9d2-4449-a779-5343c367d00d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:30.210666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b3d0b8c-e9d2-4449-a779-5343c367d00d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:30.211374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b3d0b8c-e9d2-4449-a779-5343c367d00d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:30.211800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b3d0b8c-e9d2-4449-a779-5343c367d00d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:30.225386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] validate_networks() for [('9b6a7afa-4e32-4948-bd23-d18a5d46daad', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:54:30.405197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5b3d0b8c-e9d2-4449-a779-5343c367d00d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:30.416942 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5b3d0b8c-e9d2-4449-a779-5343c367d00d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1271 microversion: 2.1 time: 0.217374 Aug 02 06:54:30.417812 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1027/2168] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:30 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1271 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:30.423054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-233cbcb5-5e06-41f1-8ef5-6cdf9ca12884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:30.423844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-233cbcb5-5e06-41f1-8ef5-6cdf9ca12884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:30.431517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-233cbcb5-5e06-41f1-8ef5-6cdf9ca12884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:30.432077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-233cbcb5-5e06-41f1-8ef5-6cdf9ca12884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:30.432988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-233cbcb5-5e06-41f1-8ef5-6cdf9ca12884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:30.433562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-233cbcb5-5e06-41f1-8ef5-6cdf9ca12884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:30.472645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-233cbcb5-5e06-41f1-8ef5-6cdf9ca12884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:54:30.491753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:30.595309 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-233cbcb5-5e06-41f1-8ef5-6cdf9ca12884 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 204 len: 0 microversion: 2.1 time: 0.175922 Aug 02 06:54:30.598770 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1028/2169] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:54:30 2022] DELETE /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:54:30.602589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-86877baa-2e70-41ea-8f61-ad79ca422e5a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:30.604242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-86877baa-2e70-41ea-8f61-ad79ca422e5a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:30.611315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86877baa-2e70-41ea-8f61-ad79ca422e5a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:30.612149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86877baa-2e70-41ea-8f61-ad79ca422e5a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:30.613087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86877baa-2e70-41ea-8f61-ad79ca422e5a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:30.613704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86877baa-2e70-41ea-8f61-ad79ca422e5a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:31.065992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-86877baa-2e70-41ea-8f61-ad79ca422e5a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:31.079346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-86877baa-2e70-41ea-8f61-ad79ca422e5a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:31.080873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-86877baa-2e70-41ea-8f61-ad79ca422e5a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:31.082062 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-86877baa-2e70-41ea-8f61-ad79ca422e5a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1486 microversion: 2.25 time: 0.485058 Aug 02 06:54:31.083144 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1029/2170] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:30 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1486 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:31.098666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-973ed151-ad5c-4980-b526-4ccbcc9322ef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:31.099757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-973ed151-ad5c-4980-b526-4ccbcc9322ef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:31.106634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-973ed151-ad5c-4980-b526-4ccbcc9322ef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:31.107357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-973ed151-ad5c-4980-b526-4ccbcc9322ef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:31.109310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-973ed151-ad5c-4980-b526-4ccbcc9322ef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:31.110033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-973ed151-ad5c-4980-b526-4ccbcc9322ef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:31.453009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:54:31.454038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:54:31.454740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:54:31.458829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:54:31.459465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:54:31.478219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-973ed151-ad5c-4980-b526-4ccbcc9322ef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:31.486143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:31.486912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:31.489261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:31.489927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:31.491924 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-973ed151-ad5c-4980-b526-4ccbcc9322ef tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1467 microversion: 2.1 time: 0.407480 Aug 02 06:54:31.492508 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1030/2171] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:31 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1467 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:31.497243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-42e2682d-63ca-465c-9182-f1c9953f94a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:31.500738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-42e2682d-63ca-465c-9182-f1c9953f94a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:31.515101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42e2682d-63ca-465c-9182-f1c9953f94a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:31.518796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42e2682d-63ca-465c-9182-f1c9953f94a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:31.519830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42e2682d-63ca-465c-9182-f1c9953f94a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:31.521065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42e2682d-63ca-465c-9182-f1c9953f94a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:31.565579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Getting quotas for project b2ada792b3034ca4a9e2c2257352c232. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:31.582638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Getting quotas for user 8c32574f81694c18bc3406735dc92bf0 and project b2ada792b3034ca4a9e2c2257352c232. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:31.614793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:54:31.617174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:54:31.689023 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.774765 Aug 02 06:54:31.692412 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1142/2172] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:54:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:54:31.705546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7dba1e15-cf87-4d59-a61e-e27343def0f0 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:31.706201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7dba1e15-cf87-4d59-a61e-e27343def0f0 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:31.723435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dba1e15-cf87-4d59-a61e-e27343def0f0 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:31.726208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dba1e15-cf87-4d59-a61e-e27343def0f0 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:31.727149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dba1e15-cf87-4d59-a61e-e27343def0f0 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:31.729123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dba1e15-cf87-4d59-a61e-e27343def0f0 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:31.952445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-42e2682d-63ca-465c-9182-f1c9953f94a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:31.960476 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-42e2682d-63ca-465c-9182-f1c9953f94a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1311 microversion: 2.1 time: 0.466746 Aug 02 06:54:31.961063 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1031/2173] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:31 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1311 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:31.978306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-894f6639-0572-4b8c-80f7-039f7254e8ca tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:31.978951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-894f6639-0572-4b8c-80f7-039f7254e8ca tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:31.985412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-894f6639-0572-4b8c-80f7-039f7254e8ca tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:31.986099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-894f6639-0572-4b8c-80f7-039f7254e8ca tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:31.987276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-894f6639-0572-4b8c-80f7-039f7254e8ca tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:31.987897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-894f6639-0572-4b8c-80f7-039f7254e8ca tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:32.217767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7dba1e15-cf87-4d59-a61e-e27343def0f0 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:32.229877 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7dba1e15-cf87-4d59-a61e-e27343def0f0 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1307 microversion: 2.1 time: 0.536241 Aug 02 06:54:32.230891 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1143/2174] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:31 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1307 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:32.244948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d31ec09e-0684-431d-aab9-9ffc98e5a3db tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:32.246054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d31ec09e-0684-431d-aab9-9ffc98e5a3db tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:32.845299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-894f6639-0572-4b8c-80f7-039f7254e8ca tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:32.861697 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-894f6639-0572-4b8c-80f7-039f7254e8ca tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1313 microversion: 2.1 time: 0.896700 Aug 02 06:54:32.862611 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1032/2175] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:31 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1313 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:32.873952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-24b175a6-b305-4b7f-a1d1-b177ea694c89 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:32.876078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-24b175a6-b305-4b7f-a1d1-b177ea694c89 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:32.885473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24b175a6-b305-4b7f-a1d1-b177ea694c89 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:32.886269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24b175a6-b305-4b7f-a1d1-b177ea694c89 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:32.887733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24b175a6-b305-4b7f-a1d1-b177ea694c89 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:32.888428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24b175a6-b305-4b7f-a1d1-b177ea694c89 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:32.988200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d31ec09e-0684-431d-aab9-9ffc98e5a3db tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:33.005296 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d31ec09e-0684-431d-aab9-9ffc98e5a3db tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1217 microversion: 2.1 time: 0.772878 Aug 02 06:54:33.006350 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1144/2176] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:32 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1217 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:33.016641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ea4d6ca7-c6f8-4661-a2a3-1e740110510a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:33.017462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ea4d6ca7-c6f8-4661-a2a3-1e740110510a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:33.066930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea4d6ca7-c6f8-4661-a2a3-1e740110510a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:33.067630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea4d6ca7-c6f8-4661-a2a3-1e740110510a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:33.068505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea4d6ca7-c6f8-4661-a2a3-1e740110510a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:33.069217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea4d6ca7-c6f8-4661-a2a3-1e740110510a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:34.091248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-24b175a6-b305-4b7f-a1d1-b177ea694c89 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:34.103938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-24b175a6-b305-4b7f-a1d1-b177ea694c89 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:34.105865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-24b175a6-b305-4b7f-a1d1-b177ea694c89 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:34.107339 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-24b175a6-b305-4b7f-a1d1-b177ea694c89 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1486 microversion: 2.25 time: 1.241424 Aug 02 06:54:34.108226 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1033/2177] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:32 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1486 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:34.113290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-fe364268-f04b-4fae-83d6-5f6960a5f6ed req-1987e547-9f10-40c3-a74e-1c56f3cc950f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27beb807-e873-4cfb-a895-c16a1bd7ad43", "name": "network-vif-plugged", "status": "completed", "tag": "d0b0f68c-057f-4516-89ae-466675ea705a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:34.123659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fe364268-f04b-4fae-83d6-5f6960a5f6ed req-1987e547-9f10-40c3-a74e-1c56f3cc950f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:34.124127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fe364268-f04b-4fae-83d6-5f6960a5f6ed req-1987e547-9f10-40c3-a74e-1c56f3cc950f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:34.140052 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-fe364268-f04b-4fae-83d6-5f6960a5f6ed req-1987e547-9f10-40c3-a74e-1c56f3cc950f service nova] Creating event network-vif-plugged:d0b0f68c-057f-4516-89ae-466675ea705a for instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 on n-h1-851337-3 Aug 02 06:54:34.145402 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-fe364268-f04b-4fae-83d6-5f6960a5f6ed req-1987e547-9f10-40c3-a74e-1c56f3cc950f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035613 Aug 02 06:54:34.146128 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1034/2178] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:34.153496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1d392fd1-58d2-462e-a397-a1e9af7f2a05 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:34.154545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1d392fd1-58d2-462e-a397-a1e9af7f2a05 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:34.164155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d392fd1-58d2-462e-a397-a1e9af7f2a05 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:34.164717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d392fd1-58d2-462e-a397-a1e9af7f2a05 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:34.165374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d392fd1-58d2-462e-a397-a1e9af7f2a05 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:34.165800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d392fd1-58d2-462e-a397-a1e9af7f2a05 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:34.204197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ea4d6ca7-c6f8-4661-a2a3-1e740110510a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:34.214843 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ea4d6ca7-c6f8-4661-a2a3-1e740110510a tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1467 microversion: 2.1 time: 1.207173 Aug 02 06:54:34.216221 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1145/2179] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:33 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1467 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:34.221388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d3d27c43-f2fb-4ad3-bbc8-5c6e8bc38bd2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:34.222146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d3d27c43-f2fb-4ad3-bbc8-5c6e8bc38bd2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:34.229254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3d27c43-f2fb-4ad3-bbc8-5c6e8bc38bd2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:34.230079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3d27c43-f2fb-4ad3-bbc8-5c6e8bc38bd2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:34.231110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3d27c43-f2fb-4ad3-bbc8-5c6e8bc38bd2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:34.231743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3d27c43-f2fb-4ad3-bbc8-5c6e8bc38bd2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:34.917718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1d392fd1-58d2-462e-a397-a1e9af7f2a05 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:34.927994 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1d392fd1-58d2-462e-a397-a1e9af7f2a05 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1495 microversion: 2.1 time: 0.780340 Aug 02 06:54:34.937588 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1035/2180] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:34 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1495 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:34.940354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-76fa92f9-e1d2-4e82-8f3c-4ec7fe185b5b req-37ed2ae6-aa5d-45a4-8182-0ab4b268de7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7780d516-e238-4ace-8533-903dd2a12caf", "name": "network-vif-unplugged", "status": "completed", "tag": "ee71a9b8-bd05-4f42-b152-fb0af7d0ef95"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:34.953306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-76fa92f9-e1d2-4e82-8f3c-4ec7fe185b5b req-37ed2ae6-aa5d-45a4-8182-0ab4b268de7a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:34.954273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-76fa92f9-e1d2-4e82-8f3c-4ec7fe185b5b req-37ed2ae6-aa5d-45a4-8182-0ab4b268de7a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:34.970617 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-76fa92f9-e1d2-4e82-8f3c-4ec7fe185b5b req-37ed2ae6-aa5d-45a4-8182-0ab4b268de7a service nova] Creating event network-vif-unplugged:ee71a9b8-bd05-4f42-b152-fb0af7d0ef95 for instance 7780d516-e238-4ace-8533-903dd2a12caf on n-h1-851337-3 Aug 02 06:54:34.971420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d3d27c43-f2fb-4ad3-bbc8-5c6e8bc38bd2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:34.977275 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-76fa92f9-e1d2-4e82-8f3c-4ec7fe185b5b req-37ed2ae6-aa5d-45a4-8182-0ab4b268de7a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043217 Aug 02 06:54:34.978512 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1036/2181] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:34.985121 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d3d27c43-f2fb-4ad3-bbc8-5c6e8bc38bd2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1307 microversion: 2.1 time: 0.767491 Aug 02 06:54:34.985279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fae7c53c-3dd4-456c-b902-d9834c51be5f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:34.985696 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1146/2182] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:34 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1307 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:34.992706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fae7c53c-3dd4-456c-b902-d9834c51be5f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:35.002154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-173079c3-6d1b-44f9-b54c-9f52e6fdceab tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:35.004478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-173079c3-6d1b-44f9-b54c-9f52e6fdceab tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:35.006678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fae7c53c-3dd4-456c-b902-d9834c51be5f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.007143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fae7c53c-3dd4-456c-b902-d9834c51be5f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:35.011387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fae7c53c-3dd4-456c-b902-d9834c51be5f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.011891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fae7c53c-3dd4-456c-b902-d9834c51be5f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:35.014282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-173079c3-6d1b-44f9-b54c-9f52e6fdceab tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.014910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-173079c3-6d1b-44f9-b54c-9f52e6fdceab tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:35.015907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-173079c3-6d1b-44f9-b54c-9f52e6fdceab tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.016384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-173079c3-6d1b-44f9-b54c-9f52e6fdceab tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:35.154647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-173079c3-6d1b-44f9-b54c-9f52e6fdceab tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:35.176892 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-173079c3-6d1b-44f9-b54c-9f52e6fdceab tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1275 microversion: 2.1 time: 0.184964 Aug 02 06:54:35.178840 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1147/2183] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:34 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:35.184488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5aa0b19c-2f01-4fab-84ea-397eecce32b8 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:35.205081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.compute.server_groups [None req-5aa0b19c-2f01-4fab-84ea-397eecce32b8 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Querying cell c3b7f982-e927-4a3f-b699-817c726d55c4(cell1) for 1 instances {{(pid=126120) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 02 06:54:35.206861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5aa0b19c-2f01-4fab-84ea-397eecce32b8 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.207508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5aa0b19c-2f01-4fab-84ea-397eecce32b8 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:35.246298 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5aa0b19c-2f01-4fab-84ea-397eecce32b8 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/764fec44-f9b2-4b7d-b206-f233e1f45322" status: 200 len: 222 microversion: 2.1 time: 0.066049 Aug 02 06:54:35.258267 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1148/2184] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 06:54:35 2022] GET /compute/v2.1/os-server-groups/764fec44-f9b2-4b7d-b206-f233e1f45322 => generated 222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:35.264932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-91468c62-ea89-41d1-8112-a379d6a83196 req-542ee6bb-9430-4083-82d8-0deda56eb66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cfc9e6-596f-46db-a461-358881324e73", "name": "network-vif-deleted", "tag": "a823a2eb-10f1-4619-aff3-00267fcfd035"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:35.282187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-91468c62-ea89-41d1-8112-a379d6a83196 req-542ee6bb-9430-4083-82d8-0deda56eb66f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.283699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-91468c62-ea89-41d1-8112-a379d6a83196 req-542ee6bb-9430-4083-82d8-0deda56eb66f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:35.307777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fae7c53c-3dd4-456c-b902-d9834c51be5f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:35.309877 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-91468c62-ea89-41d1-8112-a379d6a83196 req-542ee6bb-9430-4083-82d8-0deda56eb66f service nova] Creating event network-vif-deleted:a823a2eb-10f1-4619-aff3-00267fcfd035 for instance f1cfc9e6-596f-46db-a461-358881324e73 on n-h2-851337-3 Aug 02 06:54:35.317297 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-91468c62-ea89-41d1-8112-a379d6a83196 req-542ee6bb-9430-4083-82d8-0deda56eb66f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057170 Aug 02 06:54:35.317827 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fae7c53c-3dd4-456c-b902-d9834c51be5f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1334 microversion: 2.1 time: 0.337646 Aug 02 06:54:35.318503 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1149/2185] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:35.319551 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1037/2186] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:34 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1334 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:35.323553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-84999d1e-4c6f-49b0-86fd-792cc04d9829 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:35.324239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-84999d1e-4c6f-49b0-86fd-792cc04d9829 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:35.324916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-613b618f-6530-46a3-b913-a508b8287a00 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:35.325966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-613b618f-6530-46a3-b913-a508b8287a00 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:35.331330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84999d1e-4c6f-49b0-86fd-792cc04d9829 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.332169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84999d1e-4c6f-49b0-86fd-792cc04d9829 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:35.333230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84999d1e-4c6f-49b0-86fd-792cc04d9829 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.333878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84999d1e-4c6f-49b0-86fd-792cc04d9829 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:35.335569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-613b618f-6530-46a3-b913-a508b8287a00 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.336427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-613b618f-6530-46a3-b913-a508b8287a00 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:35.337587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-613b618f-6530-46a3-b913-a508b8287a00 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.338143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-613b618f-6530-46a3-b913-a508b8287a00 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:35.377369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-613b618f-6530-46a3-b913-a508b8287a00 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.378860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-613b618f-6530-46a3-b913-a508b8287a00 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:35.379322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-613b618f-6530-46a3-b913-a508b8287a00 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lazy-loading 'fault' on Instance uuid f1cfc9e6-596f-46db-a461-358881324e73 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:54:35.476855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-613b618f-6530-46a3-b913-a508b8287a00 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d1c9cb22d34aaa8b86860b84a1086d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e08c65240da4f90a190b2da77a8ff92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:35.494277 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-613b618f-6530-46a3-b913-a508b8287a00 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 200 len: 1302 microversion: 2.1 time: 0.173255 Aug 02 06:54:35.496380 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1038/2187] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:35 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 1302 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:35.512262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-78f4674d-3110-4010-a9a8-2c3456e745ca tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:35.513261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-78f4674d-3110-4010-a9a8-2c3456e745ca tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:35.523198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78f4674d-3110-4010-a9a8-2c3456e745ca tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.528440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78f4674d-3110-4010-a9a8-2c3456e745ca tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:35.530857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78f4674d-3110-4010-a9a8-2c3456e745ca tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.531556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78f4674d-3110-4010-a9a8-2c3456e745ca tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:35.588755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-78f4674d-3110-4010-a9a8-2c3456e745ca tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:54:35.669634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84999d1e-4c6f-49b0-86fd-792cc04d9829 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:35.683285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84999d1e-4c6f-49b0-86fd-792cc04d9829 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:35.693351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84999d1e-4c6f-49b0-86fd-792cc04d9829 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:35.694897 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-84999d1e-4c6f-49b0-86fd-792cc04d9829 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1486 microversion: 2.25 time: 0.375314 Aug 02 06:54:35.698036 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1150/2188] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:35 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1486 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:35.782243 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-78f4674d-3110-4010-a9a8-2c3456e745ca tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 204 len: 0 microversion: 2.1 time: 0.283897 Aug 02 06:54:35.783534 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1039/2189] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:54:35 2022] DELETE /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:54:35.792525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aacd79ab-fe86-4196-a940-ccadae1e9614 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:35.793492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aacd79ab-fe86-4196-a940-ccadae1e9614 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:35.808710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aacd79ab-fe86-4196-a940-ccadae1e9614 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.810654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aacd79ab-fe86-4196-a940-ccadae1e9614 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:35.812959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aacd79ab-fe86-4196-a940-ccadae1e9614 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:35.813753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aacd79ab-fe86-4196-a940-ccadae1e9614 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:36.008601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7ad81a75-25f4-4162-931e-a949a4a83f8e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:36.009585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7ad81a75-25f4-4162-931e-a949a4a83f8e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:36.023215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ad81a75-25f4-4162-931e-a949a4a83f8e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:36.023989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ad81a75-25f4-4162-931e-a949a4a83f8e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:36.025026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ad81a75-25f4-4162-931e-a949a4a83f8e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:36.025685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ad81a75-25f4-4162-931e-a949a4a83f8e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:36.236726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-aacd79ab-fe86-4196-a940-ccadae1e9614 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:36.268604 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aacd79ab-fe86-4196-a940-ccadae1e9614 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1501 microversion: 2.1 time: 0.480520 Aug 02 06:54:36.269773 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1151/2190] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:35 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1501 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:36.285993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-87d1e9d5-43f8-4c0d-8c0f-43fb05dc9265 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:36.287130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-87d1e9d5-43f8-4c0d-8c0f-43fb05dc9265 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:36.299603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87d1e9d5-43f8-4c0d-8c0f-43fb05dc9265 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:36.301302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87d1e9d5-43f8-4c0d-8c0f-43fb05dc9265 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:36.302766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87d1e9d5-43f8-4c0d-8c0f-43fb05dc9265 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:36.305004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87d1e9d5-43f8-4c0d-8c0f-43fb05dc9265 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:36.403352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7ad81a75-25f4-4162-931e-a949a4a83f8e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:36.420874 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7ad81a75-25f4-4162-931e-a949a4a83f8e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1307 microversion: 2.1 time: 0.417280 Aug 02 06:54:36.433967 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1040/2191] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:36 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1307 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:36.441193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-362fced2-d149-4a4d-a15d-5b0d91c443d6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:36.454030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-362fced2-d149-4a4d-a15d-5b0d91c443d6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:36.470595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-362fced2-d149-4a4d-a15d-5b0d91c443d6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:36.471038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-362fced2-d149-4a4d-a15d-5b0d91c443d6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:36.471808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-362fced2-d149-4a4d-a15d-5b0d91c443d6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:36.472230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-362fced2-d149-4a4d-a15d-5b0d91c443d6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:36.936199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-87d1e9d5-43f8-4c0d-8c0f-43fb05dc9265 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:36.937763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-362fced2-d149-4a4d-a15d-5b0d91c443d6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:36.948039 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-87d1e9d5-43f8-4c0d-8c0f-43fb05dc9265 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1317 microversion: 2.1 time: 0.676117 Aug 02 06:54:36.948630 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1152/2192] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:36 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1317 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:36.948926 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-362fced2-d149-4a4d-a15d-5b0d91c443d6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1334 microversion: 2.1 time: 0.512074 Aug 02 06:54:36.949553 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1041/2193] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:36 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1334 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:36.954325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-741acf92-86dd-4872-9d64-f34618b48d77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:36.955232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-741acf92-86dd-4872-9d64-f34618b48d77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] [instance: f1cfc9e6-596f-46db-a461-358881324e73] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:36.961032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0790e6b-90d2-4496-b165-7fcc0c4a828e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:36.961643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d0790e6b-90d2-4496-b165-7fcc0c4a828e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:36.970252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-741acf92-86dd-4872-9d64-f34618b48d77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:36.970503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0790e6b-90d2-4496-b165-7fcc0c4a828e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:36.970798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0790e6b-90d2-4496-b165-7fcc0c4a828e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:36.971410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-741acf92-86dd-4872-9d64-f34618b48d77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:36.971646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0790e6b-90d2-4496-b165-7fcc0c4a828e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:36.972129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0790e6b-90d2-4496-b165-7fcc0c4a828e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:36.972800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-741acf92-86dd-4872-9d64-f34618b48d77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:36.973554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-741acf92-86dd-4872-9d64-f34618b48d77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:36.990249 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-741acf92-86dd-4872-9d64-f34618b48d77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] HTTP exception thrown: Instance f1cfc9e6-596f-46db-a461-358881324e73 could not be found. Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-741acf92-86dd-4872-9d64-f34618b48d77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Request method failure captured: Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 HTTP/1.1 Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mil14MrqUIflgbg_0m6eSvWnATGyi4dxApKFYL7uiPVfLQzElvfEtTHVs9oItTTFNLdGLaH5TlX5bUN7yaMEIhck3MjUYsbu0qEca4eDexanQN9ORFeDjdfV-_1gtk6WgSp1XM4giCm224UVntHDA9IjGBMojIWp9cBPmwrLH9mp5M Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 1e08c65240da4f90a190b2da77a8ff92 Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-MigrationsAdminTest-1968435112 Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1e08c65240da4f90a190b2da77a8ff92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1e08c65240da4f90a190b2da77a8ff92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1e08c65240da4f90a190b2da77a8ff92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1e08c65240da4f90a190b2da77a8ff92"}]}] Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-MigrationsAdminTest-1968435112 Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 1e08c65240da4f90a190b2da77a8ff92 Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-MigrationsAdminTest-1968435112 Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-MigrationsAdminTest-1968435112-project Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 87d1c9cb22d34aaa8b86860b84a1086d Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-MigrationsAdminTest-1968435112-project Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance f1cfc9e6-596f-46db-a461-358881324e73 could not be found. Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'f1cfc9e6-596f-46db-a461-358881324e73'} Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1cfc9e6-596f-46db-a461-358881324e73 could not be found. Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1cfc9e6-596f-46db-a461-358881324e73 could not be found. Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:36.992369 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:36.998405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:36.998405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:36.998405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:36.998405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:36.998405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:36.998405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1cfc9e6-596f-46db-a461-358881324e73 could not be found. Aug 02 06:54:36.998405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:37.002761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-741acf92-86dd-4872-9d64-f34618b48d77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] Returning 404 to user: Instance f1cfc9e6-596f-46db-a461-358881324e73 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:37.004001 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-741acf92-86dd-4872-9d64-f34618b48d77 tempest-MigrationsAdminTest-1968435112 tempest-MigrationsAdminTest-1968435112-project] 10.222.0.79 "GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73" status: 404 len: 111 microversion: 2.1 time: 0.054383 Aug 02 06:54:37.005156 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1153/2194] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:36 2022] GET /compute/v2.1/servers/f1cfc9e6-596f-46db-a461-358881324e73 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:37.036359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-940088c1-727f-4325-bfc7-8333993b2bce req-15073c9d-ed78-4c10-b127-73c5442f617e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7780d516-e238-4ace-8533-903dd2a12caf", "tag": "ee71a9b8-bd05-4f42-b152-fb0af7d0ef95"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:37.055551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-940088c1-727f-4325-bfc7-8333993b2bce req-15073c9d-ed78-4c10-b127-73c5442f617e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:37.057627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-940088c1-727f-4325-bfc7-8333993b2bce req-15073c9d-ed78-4c10-b127-73c5442f617e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:37.076620 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-940088c1-727f-4325-bfc7-8333993b2bce req-15073c9d-ed78-4c10-b127-73c5442f617e service nova] Creating event network-changed:ee71a9b8-bd05-4f42-b152-fb0af7d0ef95 for instance 7780d516-e238-4ace-8533-903dd2a12caf on n-h1-851337-3 Aug 02 06:54:37.085272 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-940088c1-727f-4325-bfc7-8333993b2bce req-15073c9d-ed78-4c10-b127-73c5442f617e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054852 Aug 02 06:54:37.087300 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1154/2195] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:54:37.295896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2a3cda15-2b9c-4cdc-9a97-01ceb61bef39 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:37.297757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2a3cda15-2b9c-4cdc-9a97-01ceb61bef39 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:37.311836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a3cda15-2b9c-4cdc-9a97-01ceb61bef39 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:37.312753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a3cda15-2b9c-4cdc-9a97-01ceb61bef39 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:37.314888 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a3cda15-2b9c-4cdc-9a97-01ceb61bef39 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:37.318137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a3cda15-2b9c-4cdc-9a97-01ceb61bef39 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:38.111252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d0790e6b-90d2-4496-b165-7fcc0c4a828e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:38.131335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d0790e6b-90d2-4496-b165-7fcc0c4a828e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:38.140085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d0790e6b-90d2-4496-b165-7fcc0c4a828e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:38.141622 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d0790e6b-90d2-4496-b165-7fcc0c4a828e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1486 microversion: 2.25 time: 1.185264 Aug 02 06:54:38.155771 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1042/2196] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:36 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1486 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:38.171964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0d7937ea-94b0-4785-a04c-3b3c5deef26f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:38.172686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0d7937ea-94b0-4785-a04c-3b3c5deef26f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:38.190271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d7937ea-94b0-4785-a04c-3b3c5deef26f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:38.190754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d7937ea-94b0-4785-a04c-3b3c5deef26f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:38.191611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d7937ea-94b0-4785-a04c-3b3c5deef26f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:38.192078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d7937ea-94b0-4785-a04c-3b3c5deef26f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:38.241361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:39.239927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2a3cda15-2b9c-4cdc-9a97-01ceb61bef39 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:39.255353 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2a3cda15-2b9c-4cdc-9a97-01ceb61bef39 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1501 microversion: 2.1 time: 1.964474 Aug 02 06:54:39.257848 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1155/2197] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:37 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1501 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:54:39.259336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0d7937ea-94b0-4785-a04c-3b3c5deef26f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:39.270575 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0d7937ea-94b0-4785-a04c-3b3c5deef26f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1488 microversion: 2.1 time: 1.108978 Aug 02 06:54:39.274466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-01145b5f-3932-420b-8f7d-4dfb8d38269b req-68616945-c34e-490f-afa5-77e1ad1f0f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ae4954-4d53-456f-80b1-ecc81adccdbb", "tag": "078437fb-a745-4169-b5f1-62422ea79ebf"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:39.277057 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1043/2198] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:38 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1488 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:39.289503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bfb0a1be-7230-4e50-88b9-1578322207b8 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:39.290183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bfb0a1be-7230-4e50-88b9-1578322207b8 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:39.301241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-01145b5f-3932-420b-8f7d-4dfb8d38269b req-68616945-c34e-490f-afa5-77e1ad1f0f8a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:39.301532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfb0a1be-7230-4e50-88b9-1578322207b8 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:39.301991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-01145b5f-3932-420b-8f7d-4dfb8d38269b req-68616945-c34e-490f-afa5-77e1ad1f0f8a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:39.304827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfb0a1be-7230-4e50-88b9-1578322207b8 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:39.306720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfb0a1be-7230-4e50-88b9-1578322207b8 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:39.319204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfb0a1be-7230-4e50-88b9-1578322207b8 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:39.331332 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-01145b5f-3932-420b-8f7d-4dfb8d38269b req-68616945-c34e-490f-afa5-77e1ad1f0f8a service nova] Creating event network-changed:078437fb-a745-4169-b5f1-62422ea79ebf for instance d8ae4954-4d53-456f-80b1-ecc81adccdbb on n-h1-851337-3 Aug 02 06:54:39.346992 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-01145b5f-3932-420b-8f7d-4dfb8d38269b req-68616945-c34e-490f-afa5-77e1ad1f0f8a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084133 Aug 02 06:54:39.349421 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1156/2199] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:39.365215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d91a24b6-9e0d-4f68-884f-c0a6b6fa8172 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:39.367875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d91a24b6-9e0d-4f68-884f-c0a6b6fa8172 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:39.392258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d91a24b6-9e0d-4f68-884f-c0a6b6fa8172 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:39.392627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d91a24b6-9e0d-4f68-884f-c0a6b6fa8172 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:39.393495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d91a24b6-9e0d-4f68-884f-c0a6b6fa8172 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:39.393978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d91a24b6-9e0d-4f68-884f-c0a6b6fa8172 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:40.188691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d91a24b6-9e0d-4f68-884f-c0a6b6fa8172 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:40.204523 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d91a24b6-9e0d-4f68-884f-c0a6b6fa8172 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1334 microversion: 2.1 time: 0.852249 Aug 02 06:54:40.218473 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1157/2200] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:39 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1334 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:40.225096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43b24485-7596-4a02-8b4c-74a9ffd87b52 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:40.226261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-43b24485-7596-4a02-8b4c-74a9ffd87b52 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:40.233639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43b24485-7596-4a02-8b4c-74a9ffd87b52 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:40.234418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43b24485-7596-4a02-8b4c-74a9ffd87b52 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:40.235407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43b24485-7596-4a02-8b4c-74a9ffd87b52 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:40.236011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43b24485-7596-4a02-8b4c-74a9ffd87b52 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:40.245299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bfb0a1be-7230-4e50-88b9-1578322207b8 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:40.255775 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bfb0a1be-7230-4e50-88b9-1578322207b8 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1317 microversion: 2.1 time: 0.975270 Aug 02 06:54:40.259007 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1044/2201] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:39 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1317 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:40.267698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1054c5ca-5d85-4042-9657-701eef9989e3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:40.268227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1054c5ca-5d85-4042-9657-701eef9989e3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:40.287432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1054c5ca-5d85-4042-9657-701eef9989e3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:40.287961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1054c5ca-5d85-4042-9657-701eef9989e3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:40.288740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1054c5ca-5d85-4042-9657-701eef9989e3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:40.289197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1054c5ca-5d85-4042-9657-701eef9989e3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:40.350312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-1054c5ca-5d85-4042-9657-701eef9989e3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lazy-loading 'flavor' on Instance uuid 27beb807-e873-4cfb-a895-c16a1bd7ad43 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:54:40.504532 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1054c5ca-5d85-4042-9657-701eef9989e3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "POST /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43/action" status: 202 len: 0 microversion: 2.1 time: 0.244227 Aug 02 06:54:40.505736 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1045/2202] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:54:40 2022] POST /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:54:40.511085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e05a20b8-5cc9-43f3-978d-3da2ce482eb0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:40.514722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e05a20b8-5cc9-43f3-978d-3da2ce482eb0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:40.523525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e05a20b8-5cc9-43f3-978d-3da2ce482eb0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:40.524150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e05a20b8-5cc9-43f3-978d-3da2ce482eb0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:40.526075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e05a20b8-5cc9-43f3-978d-3da2ce482eb0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:40.526657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e05a20b8-5cc9-43f3-978d-3da2ce482eb0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:41.004552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43b24485-7596-4a02-8b4c-74a9ffd87b52 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:41.013780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43b24485-7596-4a02-8b4c-74a9ffd87b52 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:41.015393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43b24485-7596-4a02-8b4c-74a9ffd87b52 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:41.016653 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43b24485-7596-4a02-8b4c-74a9ffd87b52 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1486 microversion: 2.25 time: 0.796655 Aug 02 06:54:41.017215 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1158/2203] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:40 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1486 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:41.027187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7860f7d9-10f0-4921-8835-6b32be6dcff2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:41.028135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7860f7d9-10f0-4921-8835-6b32be6dcff2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:41.045078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7860f7d9-10f0-4921-8835-6b32be6dcff2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:41.045690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7860f7d9-10f0-4921-8835-6b32be6dcff2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:41.046562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7860f7d9-10f0-4921-8835-6b32be6dcff2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:41.047050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7860f7d9-10f0-4921-8835-6b32be6dcff2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:41.091304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:41.111613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e05a20b8-5cc9-43f3-978d-3da2ce482eb0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7395eb1c7492199b8446285b09bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0d57f417c04a65b3b39d6494cb71f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:41.120280 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e05a20b8-5cc9-43f3-978d-3da2ce482eb0 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 200 len: 1501 microversion: 2.1 time: 0.613131 Aug 02 06:54:41.125248 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1046/2204] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:40 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 1501 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:41.224993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d56b19f7-723d-425e-babf-ece58340292a tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:41.225866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d56b19f7-723d-425e-babf-ece58340292a tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:41.237846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d56b19f7-723d-425e-babf-ece58340292a tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:41.238211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d56b19f7-723d-425e-babf-ece58340292a tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:41.239145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d56b19f7-723d-425e-babf-ece58340292a tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:41.239727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d56b19f7-723d-425e-babf-ece58340292a tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:41.518545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:41.946712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7860f7d9-10f0-4921-8835-6b32be6dcff2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:41.957752 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7860f7d9-10f0-4921-8835-6b32be6dcff2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1496 microversion: 2.1 time: 0.939263 Aug 02 06:54:41.959744 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1159/2205] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:41 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1496 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:41.965647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ebd47f33-9103-41df-9b47-b3f11bb7d83e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:41.971921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ebd47f33-9103-41df-9b47-b3f11bb7d83e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:41.993862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebd47f33-9103-41df-9b47-b3f11bb7d83e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:41.995916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebd47f33-9103-41df-9b47-b3f11bb7d83e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:41.996930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebd47f33-9103-41df-9b47-b3f11bb7d83e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:41.999329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebd47f33-9103-41df-9b47-b3f11bb7d83e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:42.719161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d56b19f7-723d-425e-babf-ece58340292a tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:42.731633 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d56b19f7-723d-425e-babf-ece58340292a tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1334 microversion: 2.1 time: 1.510628 Aug 02 06:54:42.732367 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1047/2206] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:41 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1334 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:54:42.737060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8c6261c8-30e3-4777-bb23-bde372e612ef req-5c1c1989-d9c1-471e-8d69-0f8e19aa4c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ae4954-4d53-456f-80b1-ecc81adccdbb", "tag": "5c31d0c8-2ff2-4fde-b0cf-df3b18f0ca3e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:42.759250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8c6261c8-30e3-4777-bb23-bde372e612ef req-5c1c1989-d9c1-471e-8d69-0f8e19aa4c4a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:42.761772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8c6261c8-30e3-4777-bb23-bde372e612ef req-5c1c1989-d9c1-471e-8d69-0f8e19aa4c4a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:42.778382 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8c6261c8-30e3-4777-bb23-bde372e612ef req-5c1c1989-d9c1-471e-8d69-0f8e19aa4c4a service nova] Creating event network-changed:5c31d0c8-2ff2-4fde-b0cf-df3b18f0ca3e for instance d8ae4954-4d53-456f-80b1-ecc81adccdbb on n-h1-851337-3 Aug 02 06:54:42.784773 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8c6261c8-30e3-4777-bb23-bde372e612ef req-5c1c1989-d9c1-471e-8d69-0f8e19aa4c4a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050899 Aug 02 06:54:42.786519 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1048/2207] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:42.792281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c0568a6c-2c55-4009-b0eb-654902c1da4f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:42.794372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c0568a6c-2c55-4009-b0eb-654902c1da4f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:42.801968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0568a6c-2c55-4009-b0eb-654902c1da4f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:42.802677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0568a6c-2c55-4009-b0eb-654902c1da4f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:42.803671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0568a6c-2c55-4009-b0eb-654902c1da4f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:42.804210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0568a6c-2c55-4009-b0eb-654902c1da4f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:42.994494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=16 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:43.078895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ebd47f33-9103-41df-9b47-b3f11bb7d83e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:43.088565 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ebd47f33-9103-41df-9b47-b3f11bb7d83e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1317 microversion: 2.1 time: 1.127348 Aug 02 06:54:43.090535 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1160/2208] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:41 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1317 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:43.107387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b4ad4626-5a40-4550-871c-927813fa40a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:43.108179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b4ad4626-5a40-4550-871c-927813fa40a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:43.114904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b4ad4626-5a40-4550-871c-927813fa40a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:43.115539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b4ad4626-5a40-4550-871c-927813fa40a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:43.116439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b4ad4626-5a40-4550-871c-927813fa40a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:43.117236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b4ad4626-5a40-4550-871c-927813fa40a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:43.132186 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-b4ad4626-5a40-4550-871c-927813fa40a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] HTTP exception thrown: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b4ad4626-5a40-4550-871c-927813fa40a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Request method failure captured: Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 HTTP/1.1 Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MoIG-VqC-24pCLYKfp8R2B4G4PvQiwBrHudNr_yUS8cVW7dovpUZdkqRvBbuuJpn38gy4mWcALQLwXYpAXhf0OrKAqH2Jfl88u-qSht5aH5iprT3ZZsq0iu17OTEmwGEB2gfY9oFEGXWIF_FIVaAfvnan7hxyCBDMkPKsJwHHoduec Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6f0d57f417c04a65b3b39d6494cb71f7 Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f0d57f417c04a65b3b39d6494cb71f7"}]}] Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6f0d57f417c04a65b3b39d6494cb71f7 Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerGroupTestJSON-444922458-project Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 8fe7395eb1c7492199b8446285b09bc2 Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerGroupTestJSON-444922458-project Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '0c456ed4-7594-41a2-b20b-586e70c56c68'} Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:43.134070 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:43.137763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:43.137763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:43.137763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:43.137763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:43.137763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:43.137763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:43.137763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:43.139834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b4ad4626-5a40-4550-871c-927813fa40a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Returning 404 to user: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:43.140945 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b4ad4626-5a40-4550-871c-927813fa40a3 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 404 len: 111 microversion: 2.1 time: 0.049223 Aug 02 06:54:43.141981 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1161/2209] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:43 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:43.289116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-37ef1350-eee1-42eb-a0f5-45bf21973bf5 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Calling method '.version_select at 0x7f927a79d700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:43.366172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c0568a6c-2c55-4009-b0eb-654902c1da4f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:43.366377 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-37ef1350-eee1-42eb-a0f5-45bf21973bf5 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff" status: 200 len: 371 microversion: 2.1 time: 0.222355 Aug 02 06:54:43.374108 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1162/2210] 10.222.0.79 () {58 vars in 1242 bytes} [Tue Aug 2 06:54:43 2022] GET /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff => generated 371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:43.376361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c0568a6c-2c55-4009-b0eb-654902c1da4f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:43.378428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c0568a6c-2c55-4009-b0eb-654902c1da4f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:43.379804 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c0568a6c-2c55-4009-b0eb-654902c1da4f tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1486 microversion: 2.25 time: 0.591991 Aug 02 06:54:43.380506 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1049/2211] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:42 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1486 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:43.393645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-32e756a8-c25a-49ef-9d7d-5f789a111258 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:43.394725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-32e756a8-c25a-49ef-9d7d-5f789a111258 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:43.402403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32e756a8-c25a-49ef-9d7d-5f789a111258 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:43.403207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32e756a8-c25a-49ef-9d7d-5f789a111258 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:43.404346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32e756a8-c25a-49ef-9d7d-5f789a111258 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:43.405137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32e756a8-c25a-49ef-9d7d-5f789a111258 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:43.455511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1d35036c-d416-4b7f-be49-a0ea4a8498ee tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Action: 'create', calling method: .version_select at 0x7f927a7553a0>, body: {"keypair": {"name": "tempest-keypair-626367345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJO+Uhmxism/pOW85+ULhQHy553WgKEN64OuNcxSenw4fHWhfDm4omg0AqDpa0GJ0vw7EOwi6WhPhmATIO9thMOiwrtjxUaKxU7XQ427QXoMFb1hGObsVoc2wXXw8s8wVg=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:43.477621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-1d35036c-d416-4b7f-be49-a0ea4a8498ee tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Getting quotas for project 629c0175113f4f3d9ae413714345b45f. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:43.483655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-1d35036c-d416-4b7f-be49-a0ea4a8498ee tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Getting quotas for user 604e117f97c548b98ace652b760cdf0b and project 629c0175113f4f3d9ae413714345b45f. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:43.514823 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1d35036c-d416-4b7f-be49-a0ea4a8498ee tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.139257 Aug 02 06:54:43.515634 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1163/2212] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:54:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:43.520391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc311cbd-0a04-4b26-abb2-4e9e5784634e tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:43.533808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:43.538714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.compute.server_groups [None req-bc311cbd-0a04-4b26-abb2-4e9e5784634e tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Querying cell c3b7f982-e927-4a3f-b699-817c726d55c4(cell1) for 1 instances {{(pid=126120) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 02 06:54:43.539795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc311cbd-0a04-4b26-abb2-4e9e5784634e tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:43.540500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc311cbd-0a04-4b26-abb2-4e9e5784634e tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:43.554780 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc311cbd-0a04-4b26-abb2-4e9e5784634e tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.037779 Aug 02 06:54:43.562918 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1164/2213] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:54:43 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:43.569726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3201fadc-cba2-42aa-a998-c66e5acef393 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Action: 'update', calling method: .version_select at 0x7f927a7a0b80>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:43.667669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3201fadc-cba2-42aa-a998-c66e5acef393 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:43.669356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3201fadc-cba2-42aa-a998-c66e5acef393 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:43.670749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3201fadc-cba2-42aa-a998-c66e5acef393 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:43.671629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3201fadc-cba2-42aa-a998-c66e5acef393 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:43.766724 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3201fadc-cba2-42aa-a998-c66e5acef393 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff" status: 200 len: 328 microversion: 2.1 time: 0.201982 Aug 02 06:54:43.780085 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1165/2214] 10.222.0.79 () {60 vars in 1262 bytes} [Tue Aug 2 06:54:43 2022] PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff => generated 328 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:43.780085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-adfe2b14-0a4a-4a97-9df1-9621f325ef50 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:43.814884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.compute.server_groups [None req-adfe2b14-0a4a-4a97-9df1-9621f325ef50 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Querying cell c3b7f982-e927-4a3f-b699-817c726d55c4(cell1) for 1 instances {{(pid=126120) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 02 06:54:43.816042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-adfe2b14-0a4a-4a97-9df1-9621f325ef50 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:43.816663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-adfe2b14-0a4a-4a97-9df1-9621f325ef50 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:43.830607 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-adfe2b14-0a4a-4a97-9df1-9621f325ef50 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/764fec44-f9b2-4b7d-b206-f233e1f45322" status: 200 len: 184 microversion: 2.1 time: 0.059203 Aug 02 06:54:43.838905 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1166/2215] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 06:54:43 2022] GET /compute/v2.1/os-server-groups/764fec44-f9b2-4b7d-b206-f233e1f45322 => generated 184 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:43.845451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-58de5d7e-ddd6-4c5f-aade-bc3cdf4562fd tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:43.846472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-58de5d7e-ddd6-4c5f-aade-bc3cdf4562fd tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:43.857937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58de5d7e-ddd6-4c5f-aade-bc3cdf4562fd tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:43.858956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58de5d7e-ddd6-4c5f-aade-bc3cdf4562fd tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:43.859750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58de5d7e-ddd6-4c5f-aade-bc3cdf4562fd tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:43.860190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58de5d7e-ddd6-4c5f-aade-bc3cdf4562fd tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:43.992584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-32e756a8-c25a-49ef-9d7d-5f789a111258 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:44.031974 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-32e756a8-c25a-49ef-9d7d-5f789a111258 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 200 len: 1479 microversion: 2.1 time: 0.650243 Aug 02 06:54:44.063846 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1050/2216] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:43 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 1479 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:44.077536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dad47901-22dc-4647-a8f9-73907b6382d4 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:44.079238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dad47901-22dc-4647-a8f9-73907b6382d4 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:44.089204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dad47901-22dc-4647-a8f9-73907b6382d4 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:44.089962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dad47901-22dc-4647-a8f9-73907b6382d4 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:44.091063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dad47901-22dc-4647-a8f9-73907b6382d4 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:44.091717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dad47901-22dc-4647-a8f9-73907b6382d4 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:44.116568 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-dad47901-22dc-4647-a8f9-73907b6382d4 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] HTTP exception thrown: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dad47901-22dc-4647-a8f9-73907b6382d4 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Request method failure captured: Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 HTTP/1.1 Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MoIG-VqC-24pCLYKfp8R2B4G4PvQiwBrHudNr_yUS8cVW7dovpUZdkqRvBbuuJpn38gy4mWcALQLwXYpAXhf0OrKAqH2Jfl88u-qSht5aH5iprT3ZZsq0iu17OTEmwGEB2gfY9oFEGXWIF_FIVaAfvnan7hxyCBDMkPKsJwHHoduec Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 6f0d57f417c04a65b3b39d6494cb71f7 Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f0d57f417c04a65b3b39d6494cb71f7"}]}] Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 6f0d57f417c04a65b3b39d6494cb71f7 Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerGroupTestJSON-444922458-project Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 8fe7395eb1c7492199b8446285b09bc2 Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerGroupTestJSON-444922458-project Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '0c456ed4-7594-41a2-b20b-586e70c56c68'} Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:54:44.119522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:54:44.130217 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:44.130217 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:44.130217 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:44.130217 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:44.130217 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:44.130217 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:44.130217 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:44.130217 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:44.130217 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:44.130217 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:44.130217 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:44.130217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dad47901-22dc-4647-a8f9-73907b6382d4 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Returning 404 to user: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:44.130217 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dad47901-22dc-4647-a8f9-73907b6382d4 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 404 len: 111 microversion: 2.1 time: 0.055304 Aug 02 06:54:44.130217 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1051/2217] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:54:44 2022] DELETE /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:44.233495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-352601248", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:44.241646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-58de5d7e-ddd6-4c5f-aade-bc3cdf4562fd tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:44.252399 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-58de5d7e-ddd6-4c5f-aade-bc3cdf4562fd tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1334 microversion: 2.1 time: 0.410758 Aug 02 06:54:44.263086 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1167/2218] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:43 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1334 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:44.263086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a4499241-9adf-42b1-8937-80a858912ae7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2119579470"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:44.263086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a4499241-9adf-42b1-8937-80a858912ae7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:44.268857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4499241-9adf-42b1-8937-80a858912ae7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:44.269414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4499241-9adf-42b1-8937-80a858912ae7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:44.270509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4499241-9adf-42b1-8937-80a858912ae7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:44.271228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4499241-9adf-42b1-8937-80a858912ae7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:44.338197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:54:44.545131 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a4499241-9adf-42b1-8937-80a858912ae7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "POST /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43/action" status: 202 len: 0 microversion: 2.1 time: 0.291081 Aug 02 06:54:44.546331 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1168/2219] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:54:44 2022] POST /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 02 06:54:44.552961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b1727e06-4a93-4905-85c4-30c971713dc2 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:44.554018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b1727e06-4a93-4905-85c4-30c971713dc2 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:44.561262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1727e06-4a93-4905-85c4-30c971713dc2 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:44.562044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1727e06-4a93-4905-85c4-30c971713dc2 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:44.563286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1727e06-4a93-4905-85c4-30c971713dc2 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:44.563920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1727e06-4a93-4905-85c4-30c971713dc2 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:44.883745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:54:44.884195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:54:44.887304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:54:44.887900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:54:44.888506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:54:44.898847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:44.899289 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:44.900814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:44.901248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:44.922349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Getting quotas for project 447bf83b217b4274b58a7669fe4313ff. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:44.927842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Getting quotas for user 94c913197660429d8ec9ed2b5a7bed0f and project 447bf83b217b4274b58a7669fe4313ff. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:44.941565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.utils [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] cores quota exceeded for 447bf83b217b4274b58a7669fe4313ff, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126119) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 02 06:54:44.942565 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Request method failure captured: Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 144 Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MoxKsorNLyCkfWxbUNVkUgzgFVQ2E3AVi6xKE5JWQmuviIYcnbW1Yqcf63l4OvmsaoX6JPBpDoqhx9bHw4Zj94Mn-oeGNgooBOkotECzZWNlwPoJBvQl665obCSYNpHewJX2jUH0OBotolwW3yYMX4dOfmyF6ICCOGWDnImv6D3ipM Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 447bf83b217b4274b58a7669fe4313ff Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-QuotasAdminNegativeTest-1216151921 Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/447bf83b217b4274b58a7669fe4313ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/447bf83b217b4274b58a7669fe4313ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_447bf83b217b4274b58a7669fe4313ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/447bf83b217b4274b58a7669fe4313ff"}]}] Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-QuotasAdminNegativeTest-1216151921 Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 447bf83b217b4274b58a7669fe4313ff Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1216151921 Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-QuotasAdminNegativeTest-1216151921-project Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 94c913197660429d8ec9ed2b5a7bed0f Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-QuotasAdminNegativeTest-1216151921-project Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-352601248", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-352601248', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452'}}} Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 02 06:54:44.963660 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c722a8dd-3a3c-40cf-94c1-5c5c76d20d0f tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.842027 Aug 02 06:54:44.970940 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1052/2220] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:54:44 2022] POST /compute/v2.1/servers => generated 111 bytes in 844 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:44.975464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-92bdb0f7-7ab0-45f0-967b-10e7248a1419 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:44.976177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-92bdb0f7-7ab0-45f0-967b-10e7248a1419 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] [instance: 0c456ed4-7594-41a2-b20b-586e70c56c68] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:44.984388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92bdb0f7-7ab0-45f0-967b-10e7248a1419 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:44.984857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92bdb0f7-7ab0-45f0-967b-10e7248a1419 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:44.985654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92bdb0f7-7ab0-45f0-967b-10e7248a1419 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:44.986200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92bdb0f7-7ab0-45f0-967b-10e7248a1419 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:45.001633 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-92bdb0f7-7ab0-45f0-967b-10e7248a1419 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] HTTP exception thrown: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-92bdb0f7-7ab0-45f0-967b-10e7248a1419 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Request method failure captured: Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 HTTP/1.1 Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MoIG-VqC-24pCLYKfp8R2B4G4PvQiwBrHudNr_yUS8cVW7dovpUZdkqRvBbuuJpn38gy4mWcALQLwXYpAXhf0OrKAqH2Jfl88u-qSht5aH5iprT3ZZsq0iu17OTEmwGEB2gfY9oFEGXWIF_FIVaAfvnan7hxyCBDMkPKsJwHHoduec Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 6f0d57f417c04a65b3b39d6494cb71f7 Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f0d57f417c04a65b3b39d6494cb71f7"}]}] Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 6f0d57f417c04a65b3b39d6494cb71f7 Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerGroupTestJSON-444922458-project Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 8fe7395eb1c7492199b8446285b09bc2 Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerGroupTestJSON-444922458-project Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '0c456ed4-7594-41a2-b20b-586e70c56c68'} Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:45.003837 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.008334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.008334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:45.008334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:45.008334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:45.008334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:45.008334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. Aug 02 06:54:45.008334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.008334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-92bdb0f7-7ab0-45f0-967b-10e7248a1419 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Returning 404 to user: Instance 0c456ed4-7594-41a2-b20b-586e70c56c68 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:45.008334 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-92bdb0f7-7ab0-45f0-967b-10e7248a1419 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68" status: 404 len: 111 microversion: 2.1 time: 0.037445 Aug 02 06:54:45.008334 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1053/2221] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:44 2022] GET /compute/v2.1/servers/0c456ed4-7594-41a2-b20b-586e70c56c68 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:45.011138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-077ffd5c-6f70-451b-b794-304c77390529 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:45.011772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-077ffd5c-6f70-451b-b794-304c77390529 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:45.023772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-077ffd5c-6f70-451b-b794-304c77390529 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:45.024212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-077ffd5c-6f70-451b-b794-304c77390529 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:45.025094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-077ffd5c-6f70-451b-b794-304c77390529 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:45.025621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-077ffd5c-6f70-451b-b794-304c77390529 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:45.094837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b1727e06-4a93-4905-85c4-30c971713dc2 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:45.105706 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b1727e06-4a93-4905-85c4-30c971713dc2 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1317 microversion: 2.1 time: 0.556969 Aug 02 06:54:45.107121 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1169/2222] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:44 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:45.112428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-03e01980-ad5f-40d4-aed3-c4b6953d746f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a73b700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:45.169583 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-03e01980-ad5f-40d4-aed3-c4b6953d746f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7" status: 200 len: 1440 microversion: 2.1 time: 0.061038 Aug 02 06:54:45.170367 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1170/2223] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:54:45 2022] GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 => generated 1440 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:45.180364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-71d7020d-9598-4bc7-976a-a46c670edbfb req-4f97fcc4-9f37-47d5-b226-9161933554e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c456ed4-7594-41a2-b20b-586e70c56c68", "name": "network-vif-deleted", "tag": "0da1f47c-356c-4cd1-9eb8-ca39540cb389"}, {"name": "network-changed", "server_uuid": "cbf02507-5370-4194-8e06-804e90764111", "tag": "0d7101a6-b93d-4fdd-94ea-5a70295c3855"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:45.193934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-71d7020d-9598-4bc7-976a-a46c670edbfb req-4f97fcc4-9f37-47d5-b226-9161933554e4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:45.194462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-71d7020d-9598-4bc7-976a-a46c670edbfb req-4f97fcc4-9f37-47d5-b226-9161933554e4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:45.213419 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-71d7020d-9598-4bc7-976a-a46c670edbfb req-4f97fcc4-9f37-47d5-b226-9161933554e4 service nova] Creating event network-vif-deleted:0da1f47c-356c-4cd1-9eb8-ca39540cb389 for instance 0c456ed4-7594-41a2-b20b-586e70c56c68 on n-h2-851337-3 Aug 02 06:54:45.213828 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-71d7020d-9598-4bc7-976a-a46c670edbfb req-4f97fcc4-9f37-47d5-b226-9161933554e4 service nova] Creating event network-changed:0d7101a6-b93d-4fdd-94ea-5a70295c3855 for instance cbf02507-5370-4194-8e06-804e90764111 on n-h2-851337-3 Aug 02 06:54:45.221162 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-71d7020d-9598-4bc7-976a-a46c670edbfb req-4f97fcc4-9f37-47d5-b226-9161933554e4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045640 Aug 02 06:54:45.222119 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1171/2224] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:45.227615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-911e135c-b5ee-451c-87f3-b731612b2c5c tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Action: 'update', calling method: .version_select at 0x7f927a79dee0>, body: {"quota_set": {"cores": 20}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:45.301915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-911e135c-b5ee-451c-87f3-b731612b2c5c tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:45.302570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-911e135c-b5ee-451c-87f3-b731612b2c5c tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:45.303335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-911e135c-b5ee-451c-87f3-b731612b2c5c tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:45.303780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-911e135c-b5ee-451c-87f3-b731612b2c5c tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:45.372723 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-911e135c-b5ee-451c-87f3-b731612b2c5c tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff" status: 200 len: 329 microversion: 2.1 time: 0.149368 Aug 02 06:54:45.373585 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1172/2225] 10.222.0.79 () {60 vars in 1262 bytes} [Tue Aug 2 06:54:45 2022] PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff => generated 329 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:45.378020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-077ffd5c-6f70-451b-b794-304c77390529 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:45.388388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8c14864f-55ae-4179-8658-3abfebffa3ca tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:45.390593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-077ffd5c-6f70-451b-b794-304c77390529 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:45.394207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-077ffd5c-6f70-451b-b794-304c77390529 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:45.395904 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-077ffd5c-6f70-451b-b794-304c77390529 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1486 microversion: 2.25 time: 0.388861 Aug 02 06:54:45.397023 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1054/2226] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:45 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1486 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:45.399399 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-8c14864f-55ae-4179-8658-3abfebffa3ca tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] HTTP exception thrown: Instance group 86e11b05-8a94-4f1d-9583-2603f902975f could not be found. Aug 02 06:54:45.402472 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e6571459-01da-4657-b049-6371eedf1d7d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:45.403349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e6571459-01da-4657-b049-6371eedf1d7d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:45.405518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8c14864f-55ae-4179-8658-3abfebffa3ca tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Request method failure captured: Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-server-groups/86e11b05-8a94-4f1d-9583-2603f902975f HTTP/1.1 Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MoIG-VqC-24pCLYKfp8R2B4G4PvQiwBrHudNr_yUS8cVW7dovpUZdkqRvBbuuJpn38gy4mWcALQLwXYpAXhf0OrKAqH2Jfl88u-qSht5aH5iprT3ZZsq0iu17OTEmwGEB2gfY9oFEGXWIF_FIVaAfvnan7hxyCBDMkPKsJwHHoduec Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6f0d57f417c04a65b3b39d6494cb71f7 Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f0d57f417c04a65b3b39d6494cb71f7"}]}] Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6f0d57f417c04a65b3b39d6494cb71f7 Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerGroupTestJSON-444922458-project Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 8fe7395eb1c7492199b8446285b09bc2 Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerGroupTestJSON-444922458-project Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance group 86e11b05-8a94-4f1d-9583-2603f902975f could not be found. Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '86e11b05-8a94-4f1d-9583-2603f902975f'} Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 86e11b05-8a94-4f1d-9583-2603f902975f could not be found. Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 86e11b05-8a94-4f1d-9583-2603f902975f could not be found. Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.407725 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.410858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:45.410858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:45.410858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:45.410858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:45.410858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 86e11b05-8a94-4f1d-9583-2603f902975f could not be found. Aug 02 06:54:45.410858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.412476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6571459-01da-4657-b049-6371eedf1d7d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:45.413190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6571459-01da-4657-b049-6371eedf1d7d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:45.413484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8c14864f-55ae-4179-8658-3abfebffa3ca tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Returning 404 to user: Instance group 86e11b05-8a94-4f1d-9583-2603f902975f could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:45.414154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6571459-01da-4657-b049-6371eedf1d7d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:45.414659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6571459-01da-4657-b049-6371eedf1d7d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:45.414894 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8c14864f-55ae-4179-8658-3abfebffa3ca tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/86e11b05-8a94-4f1d-9583-2603f902975f" status: 404 len: 117 microversion: 2.1 time: 0.033733 Aug 02 06:54:45.418962 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1173/2227] 10.222.0.79 () {58 vars in 1266 bytes} [Tue Aug 2 06:54:45 2022] DELETE /compute/v2.1/os-server-groups/86e11b05-8a94-4f1d-9583-2603f902975f => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:45.423810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5b67e3d4-5dab-4005-8747-2006d698c6a3 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Calling method '.version_select at 0x7f927a7bd820>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:45.536558 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5b67e3d4-5dab-4005-8747-2006d698c6a3 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff" status: 200 len: 371 microversion: 2.1 time: 0.116720 Aug 02 06:54:45.537154 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1174/2228] 10.222.0.79 () {58 vars in 1242 bytes} [Tue Aug 2 06:54:45 2022] GET /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:45.546622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f9918a89-ca55-4b60-8baf-e3deb09f954a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:45.560284 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-f9918a89-ca55-4b60-8baf-e3deb09f954a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] HTTP exception thrown: Instance group ac074e8d-58fc-4eaa-8bcc-983476167bfd could not be found. Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f9918a89-ca55-4b60-8baf-e3deb09f954a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Request method failure captured: Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-server-groups/ac074e8d-58fc-4eaa-8bcc-983476167bfd HTTP/1.1 Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MoIG-VqC-24pCLYKfp8R2B4G4PvQiwBrHudNr_yUS8cVW7dovpUZdkqRvBbuuJpn38gy4mWcALQLwXYpAXhf0OrKAqH2Jfl88u-qSht5aH5iprT3ZZsq0iu17OTEmwGEB2gfY9oFEGXWIF_FIVaAfvnan7hxyCBDMkPKsJwHHoduec Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6f0d57f417c04a65b3b39d6494cb71f7 Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f0d57f417c04a65b3b39d6494cb71f7"}]}] Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6f0d57f417c04a65b3b39d6494cb71f7 Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerGroupTestJSON-444922458-project Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 8fe7395eb1c7492199b8446285b09bc2 Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerGroupTestJSON-444922458-project Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance group ac074e8d-58fc-4eaa-8bcc-983476167bfd could not be found. Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'ac074e8d-58fc-4eaa-8bcc-983476167bfd'} Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ac074e8d-58fc-4eaa-8bcc-983476167bfd could not be found. Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ac074e8d-58fc-4eaa-8bcc-983476167bfd could not be found. Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.562756 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.565921 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:45.565921 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:45.565921 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:45.565921 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:45.565921 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ac074e8d-58fc-4eaa-8bcc-983476167bfd could not be found. Aug 02 06:54:45.565921 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.566810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f9918a89-ca55-4b60-8baf-e3deb09f954a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Returning 404 to user: Instance group ac074e8d-58fc-4eaa-8bcc-983476167bfd could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:45.567651 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f9918a89-ca55-4b60-8baf-e3deb09f954a tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/ac074e8d-58fc-4eaa-8bcc-983476167bfd" status: 404 len: 117 microversion: 2.1 time: 0.029536 Aug 02 06:54:45.568213 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1175/2229] 10.222.0.79 () {58 vars in 1266 bytes} [Tue Aug 2 06:54:45 2022] DELETE /compute/v2.1/os-server-groups/ac074e8d-58fc-4eaa-8bcc-983476167bfd => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:45.573293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b9bc9ed6-fb11-4bbc-ade3-6e2005e47794 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Action: 'update', calling method: .version_select at 0x7f927a79daf0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:45.652641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9bc9ed6-fb11-4bbc-ade3-6e2005e47794 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:45.653086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9bc9ed6-fb11-4bbc-ade3-6e2005e47794 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:45.653908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9bc9ed6-fb11-4bbc-ade3-6e2005e47794 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:45.654344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9bc9ed6-fb11-4bbc-ade3-6e2005e47794 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:45.714311 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b9bc9ed6-fb11-4bbc-ade3-6e2005e47794 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff" status: 200 len: 328 microversion: 2.1 time: 0.144763 Aug 02 06:54:45.715317 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1176/2230] 10.222.0.79 () {60 vars in 1262 bytes} [Tue Aug 2 06:54:45 2022] PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff => generated 328 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:45.719952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6ea0c828-ed48-466f-8d06-bb27453019af tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:45.726740 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-6ea0c828-ed48-466f-8d06-bb27453019af tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] HTTP exception thrown: Instance group fcc8e64c-ffa3-4121-a9c8-cba0aaf6cdf7 could not be found. Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6ea0c828-ed48-466f-8d06-bb27453019af tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Request method failure captured: Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-server-groups/fcc8e64c-ffa3-4121-a9c8-cba0aaf6cdf7 HTTP/1.1 Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MoIG-VqC-24pCLYKfp8R2B4G4PvQiwBrHudNr_yUS8cVW7dovpUZdkqRvBbuuJpn38gy4mWcALQLwXYpAXhf0OrKAqH2Jfl88u-qSht5aH5iprT3ZZsq0iu17OTEmwGEB2gfY9oFEGXWIF_FIVaAfvnan7hxyCBDMkPKsJwHHoduec Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6f0d57f417c04a65b3b39d6494cb71f7 Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f0d57f417c04a65b3b39d6494cb71f7"}]}] Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6f0d57f417c04a65b3b39d6494cb71f7 Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerGroupTestJSON-444922458-project Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 8fe7395eb1c7492199b8446285b09bc2 Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerGroupTestJSON-444922458-project Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance group fcc8e64c-ffa3-4121-a9c8-cba0aaf6cdf7 could not be found. Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'fcc8e64c-ffa3-4121-a9c8-cba0aaf6cdf7'} Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fcc8e64c-ffa3-4121-a9c8-cba0aaf6cdf7 could not be found. Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fcc8e64c-ffa3-4121-a9c8-cba0aaf6cdf7 could not be found. Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.728296 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.736233 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:45.736233 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:45.736233 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:45.736233 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:45.736233 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fcc8e64c-ffa3-4121-a9c8-cba0aaf6cdf7 could not be found. Aug 02 06:54:45.736233 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.736233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6ea0c828-ed48-466f-8d06-bb27453019af tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Returning 404 to user: Instance group fcc8e64c-ffa3-4121-a9c8-cba0aaf6cdf7 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:45.736233 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6ea0c828-ed48-466f-8d06-bb27453019af tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/fcc8e64c-ffa3-4121-a9c8-cba0aaf6cdf7" status: 404 len: 117 microversion: 2.1 time: 0.013640 Aug 02 06:54:45.736233 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1177/2231] 10.222.0.79 () {58 vars in 1266 bytes} [Tue Aug 2 06:54:45 2022] DELETE /compute/v2.1/os-server-groups/fcc8e64c-ffa3-4121-a9c8-cba0aaf6cdf7 => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:45.738861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-448db9ca-5728-4513-9a92-4211027a4778 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:45.748187 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-448db9ca-5728-4513-9a92-4211027a4778 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] HTTP exception thrown: Instance group f61c9b3b-e596-4c5b-8f4a-8d2747f38dcb could not be found. Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-448db9ca-5728-4513-9a92-4211027a4778 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Request method failure captured: Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-server-groups/f61c9b3b-e596-4c5b-8f4a-8d2747f38dcb HTTP/1.1 Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MoIG-VqC-24pCLYKfp8R2B4G4PvQiwBrHudNr_yUS8cVW7dovpUZdkqRvBbuuJpn38gy4mWcALQLwXYpAXhf0OrKAqH2Jfl88u-qSht5aH5iprT3ZZsq0iu17OTEmwGEB2gfY9oFEGXWIF_FIVaAfvnan7hxyCBDMkPKsJwHHoduec Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6f0d57f417c04a65b3b39d6494cb71f7 Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6f0d57f417c04a65b3b39d6494cb71f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f0d57f417c04a65b3b39d6494cb71f7"}]}] Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6f0d57f417c04a65b3b39d6494cb71f7 Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerGroupTestJSON-444922458 Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerGroupTestJSON-444922458-project Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 8fe7395eb1c7492199b8446285b09bc2 Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerGroupTestJSON-444922458-project Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance group f61c9b3b-e596-4c5b-8f4a-8d2747f38dcb could not be found. Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'f61c9b3b-e596-4c5b-8f4a-8d2747f38dcb'} Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f61c9b3b-e596-4c5b-8f4a-8d2747f38dcb could not be found. Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f61c9b3b-e596-4c5b-8f4a-8d2747f38dcb could not be found. Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.750182 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:45.756984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:45.756984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:45.756984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:45.756984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:45.756984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f61c9b3b-e596-4c5b-8f4a-8d2747f38dcb could not be found. Aug 02 06:54:45.756984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:45.756984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-448db9ca-5728-4513-9a92-4211027a4778 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Returning 404 to user: Instance group f61c9b3b-e596-4c5b-8f4a-8d2747f38dcb could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:45.756984 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-448db9ca-5728-4513-9a92-4211027a4778 tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/f61c9b3b-e596-4c5b-8f4a-8d2747f38dcb" status: 404 len: 117 microversion: 2.1 time: 0.017296 Aug 02 06:54:45.756984 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1178/2232] 10.222.0.79 () {58 vars in 1266 bytes} [Tue Aug 2 06:54:45 2022] DELETE /compute/v2.1/os-server-groups/f61c9b3b-e596-4c5b-8f4a-8d2747f38dcb => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:45.764688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-25be4219-ec34-4d84-86a1-bc8f375ac3ae tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:45.796286 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-25be4219-ec34-4d84-86a1-bc8f375ac3ae tempest-ServerGroupTestJSON-444922458 tempest-ServerGroupTestJSON-444922458-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/764fec44-f9b2-4b7d-b206-f233e1f45322" status: 204 len: 0 microversion: 2.1 time: 0.035998 Aug 02 06:54:45.796866 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1179/2233] 10.222.0.79 () {58 vars in 1266 bytes} [Tue Aug 2 06:54:45 2022] DELETE /compute/v2.1/os-server-groups/764fec44-f9b2-4b7d-b206-f233e1f45322 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:54:45.808381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1704265156", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:45.882131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:54:46.282836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e6571459-01da-4657-b049-6371eedf1d7d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:46.295924 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e6571459-01da-4657-b049-6371eedf1d7d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1334 microversion: 2.1 time: 0.896675 Aug 02 06:54:46.305822 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1055/2234] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:45 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1334 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:46.313876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0191971f-28b7-4654-83d9-0fbd857de237 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:46.314538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0191971f-28b7-4654-83d9-0fbd857de237 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:46.321841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0191971f-28b7-4654-83d9-0fbd857de237 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:46.322637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0191971f-28b7-4654-83d9-0fbd857de237 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:46.323692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0191971f-28b7-4654-83d9-0fbd857de237 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:46.324330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0191971f-28b7-4654-83d9-0fbd857de237 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:46.706259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:54:46.706755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:54:46.707195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:54:46.707780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:54:46.708413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:54:46.718981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:46.719913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:46.720714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:46.721344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:46.740869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Getting quotas for project 447bf83b217b4274b58a7669fe4313ff. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:46.746994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Getting quotas for user 94c913197660429d8ec9ed2b5a7bed0f and project 447bf83b217b4274b58a7669fe4313ff. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:46.762235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.utils [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] instances quota exceeded for 447bf83b217b4274b58a7669fe4313ff, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126120) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 02 06:54:46.763130 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Request method failure captured: Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 145 Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MoxKsorNLyCkfWxbUNVkUgzgFVQ2E3AVi6xKE5JWQmuviIYcnbW1Yqcf63l4OvmsaoX6JPBpDoqhx9bHw4Zj94Mn-oeGNgooBOkotECzZWNlwPoJBvQl665obCSYNpHewJX2jUH0OBotolwW3yYMX4dOfmyF6ICCOGWDnImv6D3ipM Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 447bf83b217b4274b58a7669fe4313ff Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-QuotasAdminNegativeTest-1216151921 Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/447bf83b217b4274b58a7669fe4313ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/447bf83b217b4274b58a7669fe4313ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_447bf83b217b4274b58a7669fe4313ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/447bf83b217b4274b58a7669fe4313ff"}]}] Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-QuotasAdminNegativeTest-1216151921 Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 447bf83b217b4274b58a7669fe4313ff Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1216151921 Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-QuotasAdminNegativeTest-1216151921-project Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 94c913197660429d8ec9ed2b5a7bed0f Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-QuotasAdminNegativeTest-1216151921-project Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1704265156", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1704265156', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452'}}} Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 02 06:54:46.767298 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1c569bb6-f024-4ef3-abc1-b0890f24c9ed tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.965435 Aug 02 06:54:46.770412 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1180/2235] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:54:45 2022] POST /compute/v2.1/servers => generated 119 bytes in 967 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:46.778213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d4da8e32-e37e-4700-afd1-8ed4b4d39860 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a724ee0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:46.832606 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d4da8e32-e37e-4700-afd1-8ed4b4d39860 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7" status: 200 len: 1440 microversion: 2.1 time: 0.058940 Aug 02 06:54:46.833608 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1181/2236] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:54:46 2022] GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 => generated 1440 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:46.839230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-84b132d8-0cda-481a-94fd-cad9eff44c68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:46.840148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-84b132d8-0cda-481a-94fd-cad9eff44c68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:46.847612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84b132d8-0cda-481a-94fd-cad9eff44c68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:46.848099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84b132d8-0cda-481a-94fd-cad9eff44c68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:46.848983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84b132d8-0cda-481a-94fd-cad9eff44c68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:46.849581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84b132d8-0cda-481a-94fd-cad9eff44c68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:46.884972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0191971f-28b7-4654-83d9-0fbd857de237 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:46.894517 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0191971f-28b7-4654-83d9-0fbd857de237 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1317 microversion: 2.1 time: 0.587469 Aug 02 06:54:46.895637 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1056/2237] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:46 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1317 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:46.901063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5376424a-76c3-4414-92e4-8f7edcbb80e1 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Action: 'update', calling method: .version_select at 0x7f927a99f160>, body: {"quota_set": {"instances": 10}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:47.034229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5376424a-76c3-4414-92e4-8f7edcbb80e1 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:47.034945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5376424a-76c3-4414-92e4-8f7edcbb80e1 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:47.035962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5376424a-76c3-4414-92e4-8f7edcbb80e1 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:47.036616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5376424a-76c3-4414-92e4-8f7edcbb80e1 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:47.116598 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5376424a-76c3-4414-92e4-8f7edcbb80e1 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff" status: 200 len: 329 microversion: 2.1 time: 0.219072 Aug 02 06:54:47.117053 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1057/2238] 10.222.0.79 () {60 vars in 1262 bytes} [Tue Aug 2 06:54:46 2022] PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff => generated 329 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:47.131657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6068baa3-8d56-4bc1-9767-557be752e162 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Calling method '.version_select at 0x7f927aab7af0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:47.188650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84b132d8-0cda-481a-94fd-cad9eff44c68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:47.205886 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6068baa3-8d56-4bc1-9767-557be752e162 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff" status: 200 len: 371 microversion: 2.1 time: 0.080273 Aug 02 06:54:47.206117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84b132d8-0cda-481a-94fd-cad9eff44c68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:47.207274 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1058/2239] 10.222.0.79 () {58 vars in 1242 bytes} [Tue Aug 2 06:54:47 2022] GET /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff => generated 371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:54:47.215129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84b132d8-0cda-481a-94fd-cad9eff44c68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:47.216538 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-84b132d8-0cda-481a-94fd-cad9eff44c68 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1476 microversion: 2.25 time: 0.381740 Aug 02 06:54:47.217093 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1182/2240] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:46 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1476 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:47.218323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3a387920-84a3-45b9-928b-424e7252ac1c tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Action: 'update', calling method: .version_select at 0x7f927aab7160>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:47.239221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b473ea39-ea8f-4df0-a260-7d0d0ebbb781 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '.version_select at 0x7f927a79d940>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:47.245081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b473ea39-ea8f-4df0-a260-7d0d0ebbb781 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:47.246460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b473ea39-ea8f-4df0-a260-7d0d0ebbb781 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:47.258731 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b473ea39-ea8f-4df0-a260-7d0d0ebbb781 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.023556 Aug 02 06:54:47.260349 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1183/2241] 10.222.0.79 () {60 vars in 1184 bytes} [Tue Aug 2 06:54:47 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:54:47.278111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a698f873-a1ec-45de-a7de-f69b759615e3 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:47.279075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a698f873-a1ec-45de-a7de-f69b759615e3 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:47.290573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a698f873-a1ec-45de-a7de-f69b759615e3 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:47.291193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a698f873-a1ec-45de-a7de-f69b759615e3 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:47.292532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a698f873-a1ec-45de-a7de-f69b759615e3 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:47.293066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a698f873-a1ec-45de-a7de-f69b759615e3 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:47.322613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a387920-84a3-45b9-928b-424e7252ac1c tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:47.323619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a387920-84a3-45b9-928b-424e7252ac1c tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:47.324740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a387920-84a3-45b9-928b-424e7252ac1c tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:47.325466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a387920-84a3-45b9-928b-424e7252ac1c tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:47.390016 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3a387920-84a3-45b9-928b-424e7252ac1c tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff" status: 200 len: 325 microversion: 2.1 time: 0.175489 Aug 02 06:54:47.390911 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1059/2242] 10.222.0.79 () {60 vars in 1262 bytes} [Tue Aug 2 06:54:47 2022] PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff => generated 325 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:54:47.400436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c58228dc-68fe-49ba-8363-92806c3bce77 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:47.401107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c58228dc-68fe-49ba-8363-92806c3bce77 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:47.409104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c58228dc-68fe-49ba-8363-92806c3bce77 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:47.410062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c58228dc-68fe-49ba-8363-92806c3bce77 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:47.410812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c58228dc-68fe-49ba-8363-92806c3bce77 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:47.411333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c58228dc-68fe-49ba-8363-92806c3bce77 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:47.603676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-a698f873-a1ec-45de-a7de-f69b759615e3 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] Lazy-loading 'services' on Instance uuid 7780d516-e238-4ace-8533-903dd2a12caf {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:54:47.653086 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a698f873-a1ec-45de-a7de-f69b759615e3 tempest-LiveAutoBlockMigrationV225Test-1775884207 tempest-LiveAutoBlockMigrationV225Test-1775884207-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1968 microversion: 2.25 time: 0.379563 Aug 02 06:54:47.654617 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1184/2243] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:47 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1968 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:54:47.690188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1890427308", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:47.804929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:54:48.149438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c58228dc-68fe-49ba-8363-92806c3bce77 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:48.159657 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c58228dc-68fe-49ba-8363-92806c3bce77 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1334 microversion: 2.1 time: 0.766952 Aug 02 06:54:48.163204 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1060/2244] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:47 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1334 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:48.188878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-681cf694-b37e-46bd-b885-ce123fcc28d5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:48.194360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-681cf694-b37e-46bd-b885-ce123fcc28d5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:48.218733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-681cf694-b37e-46bd-b885-ce123fcc28d5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:48.219215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-681cf694-b37e-46bd-b885-ce123fcc28d5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:48.220025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-681cf694-b37e-46bd-b885-ce123fcc28d5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:48.220460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-681cf694-b37e-46bd-b885-ce123fcc28d5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:48.278203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-681cf694-b37e-46bd-b885-ce123fcc28d5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:54:48.304868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:54:48.305292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:54:48.305769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:54:48.306233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:54:48.306729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:54:48.326466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:48.326979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:48.327780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:48.328218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:48.366761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Getting quotas for project 447bf83b217b4274b58a7669fe4313ff. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:54:48.369476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:48.379742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Getting quotas for user 94c913197660429d8ec9ed2b5a7bed0f and project 447bf83b217b4274b58a7669fe4313ff. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:54:48.384132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:48.399323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.utils [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] ram quota exceeded for 447bf83b217b4274b58a7669fe4313ff, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126120) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 02 06:54:48.399977 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Request method failure captured: Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 145 Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MoxKsorNLyCkfWxbUNVkUgzgFVQ2E3AVi6xKE5JWQmuviIYcnbW1Yqcf63l4OvmsaoX6JPBpDoqhx9bHw4Zj94Mn-oeGNgooBOkotECzZWNlwPoJBvQl665obCSYNpHewJX2jUH0OBotolwW3yYMX4dOfmyF6ICCOGWDnImv6D3ipM Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 447bf83b217b4274b58a7669fe4313ff Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-QuotasAdminNegativeTest-1216151921 Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/447bf83b217b4274b58a7669fe4313ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/447bf83b217b4274b58a7669fe4313ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_447bf83b217b4274b58a7669fe4313ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/447bf83b217b4274b58a7669fe4313ff"}]}] Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-QuotasAdminNegativeTest-1216151921 Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 447bf83b217b4274b58a7669fe4313ff Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1216151921 Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-QuotasAdminNegativeTest-1216151921-project Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 94c913197660429d8ec9ed2b5a7bed0f Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-QuotasAdminNegativeTest-1216151921-project Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1890427308", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1890427308', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452'}}} Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 02 06:54:48.414680 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:48.418101 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0d003997-7581-442f-8bca-5d17afe17c85 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.753186 Aug 02 06:54:48.424693 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1185/2245] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:54:47 2022] POST /compute/v2.1/servers => generated 110 bytes in 764 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:48.433271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bd3ab7ba-5874-4844-85cc-12b4bb64708a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a642310>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:48.453500 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-681cf694-b37e-46bd-b885-ce123fcc28d5 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 204 len: 0 microversion: 2.25 time: 0.283176 Aug 02 06:54:48.457773 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1061/2246] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:54:48 2022] DELETE /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 06:54:48.463280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d59fb549-cc95-4e8a-9de7-2294033c9602 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:48.468005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d59fb549-cc95-4e8a-9de7-2294033c9602 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:48.482929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d59fb549-cc95-4e8a-9de7-2294033c9602 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:48.483712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d59fb549-cc95-4e8a-9de7-2294033c9602 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:48.484746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d59fb549-cc95-4e8a-9de7-2294033c9602 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:48.485694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d59fb549-cc95-4e8a-9de7-2294033c9602 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:48.498901 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bd3ab7ba-5874-4844-85cc-12b4bb64708a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7" status: 200 len: 1440 microversion: 2.1 time: 0.073002 Aug 02 06:54:48.499713 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1186/2247] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:54:48 2022] GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 => generated 1440 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:48.513059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b6e50aaf-bd58-4d7a-9fe7-c0ad6615e503 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Action: 'update', calling method: .version_select at 0x7f927a642160>, body: {"quota_set": {"ram": 51200}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:48.645706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6e50aaf-bd58-4d7a-9fe7-c0ad6615e503 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:48.646381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6e50aaf-bd58-4d7a-9fe7-c0ad6615e503 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:48.647522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6e50aaf-bd58-4d7a-9fe7-c0ad6615e503 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:48.648222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6e50aaf-bd58-4d7a-9fe7-c0ad6615e503 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:48.781109 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b6e50aaf-bd58-4d7a-9fe7-c0ad6615e503 tempest-QuotasAdminNegativeTest-509073079 tempest-QuotasAdminNegativeTest-509073079-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff" status: 200 len: 329 microversion: 2.1 time: 0.274864 Aug 02 06:54:48.784871 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1187/2248] 10.222.0.79 () {60 vars in 1262 bytes} [Tue Aug 2 06:54:48 2022] PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff => generated 329 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:48.823569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-336575f6-55d4-4855-bfa7-cf3e04c4b187 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:48.826979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-336575f6-55d4-4855-bfa7-cf3e04c4b187 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:48.847977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-336575f6-55d4-4855-bfa7-cf3e04c4b187 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:48.848764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-336575f6-55d4-4855-bfa7-cf3e04c4b187 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:48.851022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-336575f6-55d4-4855-bfa7-cf3e04c4b187 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:48.852315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-336575f6-55d4-4855-bfa7-cf3e04c4b187 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:49.159140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d59fb549-cc95-4e8a-9de7-2294033c9602 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:49.169308 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d59fb549-cc95-4e8a-9de7-2294033c9602 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1317 microversion: 2.1 time: 0.712516 Aug 02 06:54:49.170598 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1062/2249] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:48 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1317 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:49.178841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9dbacca5-2579-4ec7-94d6-0160deee7f77 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Action: 'update', calling method: .version_select at 0x7f927aa31280>, body: {"quota_set": {"ram": 0}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:49.187712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9dbacca5-2579-4ec7-94d6-0160deee7f77 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '94c913197660429d8ec9ed2b5a7bed0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447bf83b217b4274b58a7669fe4313ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9dbacca5-2579-4ec7-94d6-0160deee7f77 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Request method failure captured: Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: request: PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff HTTP/1.1 Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 25 Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MoxKsorNLyCkfWxbUNVkUgzgFVQ2E3AVi6xKE5JWQmuviIYcnbW1Yqcf63l4OvmsaoX6JPBpDoqhx9bHw4Zj94Mn-oeGNgooBOkotECzZWNlwPoJBvQl665obCSYNpHewJX2jUH0OBotolwW3yYMX4dOfmyF6ICCOGWDnImv6D3ipM Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 447bf83b217b4274b58a7669fe4313ff Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-QuotasAdminNegativeTest-1216151921 Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/447bf83b217b4274b58a7669fe4313ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/447bf83b217b4274b58a7669fe4313ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_447bf83b217b4274b58a7669fe4313ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/447bf83b217b4274b58a7669fe4313ff"}]}] Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-QuotasAdminNegativeTest-1216151921 Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 447bf83b217b4274b58a7669fe4313ff Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1216151921 Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-QuotasAdminNegativeTest-1216151921-project Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 94c913197660429d8ec9ed2b5a7bed0f Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-QuotasAdminNegativeTest-1216151921-project Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: {"quota_set": {"ram": 0}} Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '447bf83b217b4274b58a7669fe4313ff', 'body': {'quota_set': {'ram': 0}}} Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:54:49.197794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 02 06:54:49.200987 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:54:49.207872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9dbacca5-2579-4ec7-94d6-0160deee7f77 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:54:49.209043 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9dbacca5-2579-4ec7-94d6-0160deee7f77 tempest-QuotasAdminNegativeTest-1216151921 tempest-QuotasAdminNegativeTest-1216151921-project] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff" status: 403 len: 116 microversion: 2.1 time: 0.037257 Aug 02 06:54:49.225274 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1063/2250] 10.222.0.79 () {60 vars in 1262 bytes} [Tue Aug 2 06:54:49 2022] PUT /compute/v2.1/os-quota-sets/447bf83b217b4274b58a7669fe4313ff => generated 116 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:54:49.244461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c5facedf-4ad1-4680-9c1a-24b6d2f93e43 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:49.246613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c5facedf-4ad1-4680-9c1a-24b6d2f93e43 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:49.282435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5facedf-4ad1-4680-9c1a-24b6d2f93e43 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:49.283306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5facedf-4ad1-4680-9c1a-24b6d2f93e43 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:49.288750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5facedf-4ad1-4680-9c1a-24b6d2f93e43 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:49.290591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5facedf-4ad1-4680-9c1a-24b6d2f93e43 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:49.691696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-336575f6-55d4-4855-bfa7-cf3e04c4b187 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:49.707320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-336575f6-55d4-4855-bfa7-cf3e04c4b187 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:49.715751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-336575f6-55d4-4855-bfa7-cf3e04c4b187 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:49.716966 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-336575f6-55d4-4855-bfa7-cf3e04c4b187 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1482 microversion: 2.25 time: 0.929933 Aug 02 06:54:49.717596 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1188/2251] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:48 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1482 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:49.743254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7530f075-2bd1-4d7e-85c1-12d9ac8ec4e7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a724820>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:49.834155 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7530f075-2bd1-4d7e-85c1-12d9ac8ec4e7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7" status: 200 len: 1440 microversion: 2.1 time: 0.095907 Aug 02 06:54:49.834806 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1189/2252] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:54:49 2022] GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 => generated 1440 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:49.882895 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c5facedf-4ad1-4680-9c1a-24b6d2f93e43 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:49.891899 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c5facedf-4ad1-4680-9c1a-24b6d2f93e43 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1334 microversion: 2.1 time: 0.663365 Aug 02 06:54:49.899953 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1064/2253] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:49 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1334 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:49.923454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-da05dfdb-d324-47da-804d-59b6e067ecf4 req-fb370310-8ecc-4fe5-a139-9222a0a6328e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf02507-5370-4194-8e06-804e90764111", "name": "network-vif-plugged", "status": "completed", "tag": "0d7101a6-b93d-4fdd-94ea-5a70295c3855"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:49.948529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-da05dfdb-d324-47da-804d-59b6e067ecf4 req-fb370310-8ecc-4fe5-a139-9222a0a6328e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:49.951634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-da05dfdb-d324-47da-804d-59b6e067ecf4 req-fb370310-8ecc-4fe5-a139-9222a0a6328e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:49.979146 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-da05dfdb-d324-47da-804d-59b6e067ecf4 req-fb370310-8ecc-4fe5-a139-9222a0a6328e service nova] Creating event network-vif-plugged:0d7101a6-b93d-4fdd-94ea-5a70295c3855 for instance cbf02507-5370-4194-8e06-804e90764111 on n-h2-851337-3 Aug 02 06:54:49.998382 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-da05dfdb-d324-47da-804d-59b6e067ecf4 req-fb370310-8ecc-4fe5-a139-9222a0a6328e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077371 Aug 02 06:54:49.999364 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1190/2254] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:50.190913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a770517c-a145-41a5-a311-f3812963aa99 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:50.198091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a770517c-a145-41a5-a311-f3812963aa99 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:50.215816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a770517c-a145-41a5-a311-f3812963aa99 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:50.216511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a770517c-a145-41a5-a311-f3812963aa99 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:50.217530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a770517c-a145-41a5-a311-f3812963aa99 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:50.223260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a770517c-a145-41a5-a311-f3812963aa99 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:50.673120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a770517c-a145-41a5-a311-f3812963aa99 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:50.684569 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a770517c-a145-41a5-a311-f3812963aa99 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1317 microversion: 2.1 time: 0.496509 Aug 02 06:54:50.688093 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1065/2255] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:50 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:50.744611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-259345fd-8e13-40eb-9cdb-6586f4ba3c1a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:50.745550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-259345fd-8e13-40eb-9cdb-6586f4ba3c1a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:50.758225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-259345fd-8e13-40eb-9cdb-6586f4ba3c1a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:50.762090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-259345fd-8e13-40eb-9cdb-6586f4ba3c1a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:50.763213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-259345fd-8e13-40eb-9cdb-6586f4ba3c1a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:50.764756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-259345fd-8e13-40eb-9cdb-6586f4ba3c1a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:50.850036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c3035d76-5244-4e56-943f-1d8a2dfda522 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927aa31040>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:50.940090 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c3035d76-5244-4e56-943f-1d8a2dfda522 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7" status: 200 len: 1440 microversion: 2.1 time: 0.095228 Aug 02 06:54:50.941770 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1066/2256] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:54:50 2022] GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 => generated 1440 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:50.951238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e7cf82b8-3dcf-4b20-8772-ac5ecf8d3d30 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:50.959979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e7cf82b8-3dcf-4b20-8772-ac5ecf8d3d30 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:50.979351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7cf82b8-3dcf-4b20-8772-ac5ecf8d3d30 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:50.981145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7cf82b8-3dcf-4b20-8772-ac5ecf8d3d30 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:50.983832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7cf82b8-3dcf-4b20-8772-ac5ecf8d3d30 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:50.984351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7cf82b8-3dcf-4b20-8772-ac5ecf8d3d30 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:51.012064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-259345fd-8e13-40eb-9cdb-6586f4ba3c1a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:51.025514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-259345fd-8e13-40eb-9cdb-6586f4ba3c1a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:51.029722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-259345fd-8e13-40eb-9cdb-6586f4ba3c1a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:51.032383 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-259345fd-8e13-40eb-9cdb-6586f4ba3c1a tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1440 microversion: 2.25 time: 0.292683 Aug 02 06:54:51.036899 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1191/2257] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:50 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1440 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:51.050310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-02aeccb4-9292-4b5c-8b76-fbcea6a38670 req-0bddecd8-267d-42c0-9c6e-ed36bab0af8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7780d516-e238-4ace-8533-903dd2a12caf", "name": "network-vif-deleted", "tag": "ee71a9b8-bd05-4f42-b152-fb0af7d0ef95"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:51.064651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-02aeccb4-9292-4b5c-8b76-fbcea6a38670 req-0bddecd8-267d-42c0-9c6e-ed36bab0af8c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:51.065369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-02aeccb4-9292-4b5c-8b76-fbcea6a38670 req-0bddecd8-267d-42c0-9c6e-ed36bab0af8c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:51.094736 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-02aeccb4-9292-4b5c-8b76-fbcea6a38670 req-0bddecd8-267d-42c0-9c6e-ed36bab0af8c service nova] Creating event network-vif-deleted:ee71a9b8-bd05-4f42-b152-fb0af7d0ef95 for instance 7780d516-e238-4ace-8533-903dd2a12caf on n-h2-851337-3 Aug 02 06:54:51.104377 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-02aeccb4-9292-4b5c-8b76-fbcea6a38670 req-0bddecd8-267d-42c0-9c6e-ed36bab0af8c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063795 Aug 02 06:54:51.106572 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1192/2258] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:51.214995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e7cf82b8-3dcf-4b20-8772-ac5ecf8d3d30 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:51.233793 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e7cf82b8-3dcf-4b20-8772-ac5ecf8d3d30 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1334 microversion: 2.1 time: 0.290820 Aug 02 06:54:51.234483 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1067/2259] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:50 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1334 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:51.372090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f3518bcd-5c4b-4f18-9f4b-8aa34d3ffce1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:51.372766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f3518bcd-5c4b-4f18-9f4b-8aa34d3ffce1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:51.394355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3518bcd-5c4b-4f18-9f4b-8aa34d3ffce1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:51.397138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3518bcd-5c4b-4f18-9f4b-8aa34d3ffce1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:51.399079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3518bcd-5c4b-4f18-9f4b-8aa34d3ffce1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:51.400774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3518bcd-5c4b-4f18-9f4b-8aa34d3ffce1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:51.463265 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f3518bcd-5c4b-4f18-9f4b-8aa34d3ffce1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/ips" status: 200 len: 146 microversion: 2.1 time: 0.096736 Aug 02 06:54:51.498757 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1193/2260] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 06:54:51 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/ips => generated 146 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:51.707368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6a4e54a2-f6ba-40e0-8a9f-f317cc1665fa tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:51.708151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6a4e54a2-f6ba-40e0-8a9f-f317cc1665fa tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:51.730449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a4e54a2-f6ba-40e0-8a9f-f317cc1665fa tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:51.731406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a4e54a2-f6ba-40e0-8a9f-f317cc1665fa tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:51.735137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a4e54a2-f6ba-40e0-8a9f-f317cc1665fa tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:51.735588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a4e54a2-f6ba-40e0-8a9f-f317cc1665fa tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:51.962746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f820ed88-5746-41e7-b8f3-3bcefa952bd6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a730f70>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:52.028502 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f820ed88-5746-41e7-b8f3-3bcefa952bd6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7" status: 200 len: 1440 microversion: 2.1 time: 0.076570 Aug 02 06:54:52.029186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6a4e54a2-f6ba-40e0-8a9f-f317cc1665fa tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:52.030639 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1194/2261] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:54:51 2022] GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 => generated 1440 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:52.037118 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6a4e54a2-f6ba-40e0-8a9f-f317cc1665fa tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1505 microversion: 2.1 time: 0.334000 Aug 02 06:54:52.037680 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1068/2262] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:51 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:52.060647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-194bffa1-c1e4-4f29-b59d-43fe81641c8c tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:52.061334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-194bffa1-c1e4-4f29-b59d-43fe81641c8c tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:52.072851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-194bffa1-c1e4-4f29-b59d-43fe81641c8c tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:52.074841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d2a56ef4-f4a3-4772-9aef-d09eec238f87 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:52.075476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-194bffa1-c1e4-4f29-b59d-43fe81641c8c tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:52.077442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d2a56ef4-f4a3-4772-9aef-d09eec238f87 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:52.077704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-194bffa1-c1e4-4f29-b59d-43fe81641c8c tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:52.078436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-194bffa1-c1e4-4f29-b59d-43fe81641c8c tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:52.104987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2a56ef4-f4a3-4772-9aef-d09eec238f87 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:52.105677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2a56ef4-f4a3-4772-9aef-d09eec238f87 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:52.107315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2a56ef4-f4a3-4772-9aef-d09eec238f87 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:52.111427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2a56ef4-f4a3-4772-9aef-d09eec238f87 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:52.144157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-194bffa1-c1e4-4f29-b59d-43fe81641c8c tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:52.145508 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-194bffa1-c1e4-4f29-b59d-43fe81641c8c tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111/os-instance-actions/req-0f153b21-a9ef-4de3-970b-6c5f0702ea81" status: 200 len: 313 microversion: 2.1 time: 0.089509 Aug 02 06:54:52.156620 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1069/2263] 10.222.0.79 () {58 vars in 1419 bytes} [Tue Aug 2 06:54:52 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111/os-instance-actions/req-0f153b21-a9ef-4de3-970b-6c5f0702ea81 => generated 313 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:52.162094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1027fbef-6642-4577-9bf9-84605c194090 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:52.164848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1027fbef-6642-4577-9bf9-84605c194090 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:52.172066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1027fbef-6642-4577-9bf9-84605c194090 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:52.172938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1027fbef-6642-4577-9bf9-84605c194090 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:52.173885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1027fbef-6642-4577-9bf9-84605c194090 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:52.174919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1027fbef-6642-4577-9bf9-84605c194090 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:52.324737 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1027fbef-6642-4577-9bf9-84605c194090 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "POST /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111/action" status: 202 len: 0 microversion: 2.1 time: 0.161098 Aug 02 06:54:52.325521 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1070/2264] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:54:52 2022] POST /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:54:52.340674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fc023bec-8bbb-4d94-a228-689abde60ba3 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:52.348583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fc023bec-8bbb-4d94-a228-689abde60ba3 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:52.371960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc023bec-8bbb-4d94-a228-689abde60ba3 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:52.372449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc023bec-8bbb-4d94-a228-689abde60ba3 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:52.374888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc023bec-8bbb-4d94-a228-689abde60ba3 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:52.378995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc023bec-8bbb-4d94-a228-689abde60ba3 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:52.954649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d2a56ef4-f4a3-4772-9aef-d09eec238f87 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:52.968099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d2a56ef4-f4a3-4772-9aef-d09eec238f87 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:52.972070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d2a56ef4-f4a3-4772-9aef-d09eec238f87 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:52.975707 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d2a56ef4-f4a3-4772-9aef-d09eec238f87 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1265 microversion: 2.25 time: 0.909468 Aug 02 06:54:52.990778 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1195/2265] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:52 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1265 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:53.000679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6014e58-cf12-4a19-8312-1c1a3e18ded7 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:53.002035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d6014e58-cf12-4a19-8312-1c1a3e18ded7 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:53.012031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6014e58-cf12-4a19-8312-1c1a3e18ded7 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:53.012694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6014e58-cf12-4a19-8312-1c1a3e18ded7 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:53.013732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6014e58-cf12-4a19-8312-1c1a3e18ded7 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:53.014616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6014e58-cf12-4a19-8312-1c1a3e18ded7 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:53.032375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:53.458213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fc023bec-8bbb-4d94-a228-689abde60ba3 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:53.466744 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fc023bec-8bbb-4d94-a228-689abde60ba3 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1334 microversion: 2.1 time: 1.136035 Aug 02 06:54:53.472574 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1071/2266] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:52 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1334 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:53.500779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-af2b8554-7b5d-4b96-a0c6-f10d7c784957 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927aa4b790>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:53.678550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d6014e58-cf12-4a19-8312-1c1a3e18ded7 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:53.686695 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d6014e58-cf12-4a19-8312-1c1a3e18ded7 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1507 microversion: 2.1 time: 0.694493 Aug 02 06:54:53.687279 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1196/2267] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:52 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1507 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:53.720667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-501f1e65-b406-4c8d-8e80-770f5be276fe req-cc00ef82-b85c-4cc9-9455-3e0123e1c61b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ae4954-4d53-456f-80b1-ecc81adccdbb", "name": "network-vif-plugged", "status": "completed", "tag": "5c31d0c8-2ff2-4fde-b0cf-df3b18f0ca3e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:53.734939 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-af2b8554-7b5d-4b96-a0c6-f10d7c784957 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7" status: 200 len: 1440 microversion: 2.1 time: 0.257439 Aug 02 06:54:53.735727 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1072/2268] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:54:53 2022] GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 => generated 1440 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:53.755243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-501f1e65-b406-4c8d-8e80-770f5be276fe req-cc00ef82-b85c-4cc9-9455-3e0123e1c61b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:53.755782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-501f1e65-b406-4c8d-8e80-770f5be276fe req-cc00ef82-b85c-4cc9-9455-3e0123e1c61b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:53.795415 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-501f1e65-b406-4c8d-8e80-770f5be276fe req-cc00ef82-b85c-4cc9-9455-3e0123e1c61b service nova] Creating event network-vif-plugged:5c31d0c8-2ff2-4fde-b0cf-df3b18f0ca3e for instance d8ae4954-4d53-456f-80b1-ecc81adccdbb on n-h1-851337-3 Aug 02 06:54:53.810048 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-501f1e65-b406-4c8d-8e80-770f5be276fe req-cc00ef82-b85c-4cc9-9455-3e0123e1c61b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121406 Aug 02 06:54:53.818525 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1197/2269] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:54:54.003801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fa6ebbe5-83ea-4397-8072-3a4de60181f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:54.004805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fa6ebbe5-83ea-4397-8072-3a4de60181f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:54.015349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa6ebbe5-83ea-4397-8072-3a4de60181f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:54.015776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa6ebbe5-83ea-4397-8072-3a4de60181f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:54.016549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa6ebbe5-83ea-4397-8072-3a4de60181f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:54.028876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa6ebbe5-83ea-4397-8072-3a4de60181f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:54.348256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fa6ebbe5-83ea-4397-8072-3a4de60181f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:54.361037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fa6ebbe5-83ea-4397-8072-3a4de60181f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:54.371007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fa6ebbe5-83ea-4397-8072-3a4de60181f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:54.372635 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fa6ebbe5-83ea-4397-8072-3a4de60181f1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 200 len: 1265 microversion: 2.25 time: 0.374025 Aug 02 06:54:54.375391 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1073/2270] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:54:53 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 1265 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:54:54.494342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4d150df5-722a-42d9-a2da-3cb4ce881093 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:54.496374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4d150df5-722a-42d9-a2da-3cb4ce881093 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:54.514405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d150df5-722a-42d9-a2da-3cb4ce881093 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:54.516581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d150df5-722a-42d9-a2da-3cb4ce881093 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:54.518559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d150df5-722a-42d9-a2da-3cb4ce881093 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:54.519871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d150df5-722a-42d9-a2da-3cb4ce881093 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:54.726238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ecc90fcb-8fa5-4900-8229-b8e190dd772e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:54.727576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ecc90fcb-8fa5-4900-8229-b8e190dd772e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:54:54.734615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ecc90fcb-8fa5-4900-8229-b8e190dd772e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:54.737226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ecc90fcb-8fa5-4900-8229-b8e190dd772e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:54.738276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ecc90fcb-8fa5-4900-8229-b8e190dd772e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:54:54.738897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ecc90fcb-8fa5-4900-8229-b8e190dd772e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:54:55.313746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4d150df5-722a-42d9-a2da-3cb4ce881093 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:55.334992 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4d150df5-722a-42d9-a2da-3cb4ce881093 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1334 microversion: 2.1 time: 0.845899 Aug 02 06:54:55.348084 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1198/2271] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:54 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1334 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:55.366525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7d20eb0e-fdf5-410a-96b5-168611943f9f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a642820>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:54:55.430447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ecc90fcb-8fa5-4900-8229-b8e190dd772e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:54:55.439096 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ecc90fcb-8fa5-4900-8229-b8e190dd772e tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1512 microversion: 2.1 time: 0.731962 Aug 02 06:54:55.442583 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1074/2272] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:54:54 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1512 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:54:55.663972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1801397162", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:54:57.335298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:57.382373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=24 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:58.667254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=12 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:54:58.752127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=52 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:04.504127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:05.319037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=11 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:05.434734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:05.673722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:07.389099 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7d20eb0e-fdf5-410a-96b5-168611943f9f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7" status: 200 len: 1440 microversion: 2.1 time: 12.038943 Aug 02 06:55:07.389810 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1199/2273] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:54:55 2022] GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 => generated 1440 bytes in 12040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:07.397747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-52d3215f-b695-4bdc-951b-e4e6b58d401b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:07.399346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-52d3215f-b695-4bdc-951b-e4e6b58d401b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 7780d516-e238-4ace-8533-903dd2a12caf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:07.404715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:55:07.412473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52d3215f-b695-4bdc-951b-e4e6b58d401b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:07.415202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52d3215f-b695-4bdc-951b-e4e6b58d401b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:07.416379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52d3215f-b695-4bdc-951b-e4e6b58d401b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:07.416974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52d3215f-b695-4bdc-951b-e4e6b58d401b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:07.446641 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-52d3215f-b695-4bdc-951b-e4e6b58d401b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] HTTP exception thrown: Instance 7780d516-e238-4ace-8533-903dd2a12caf could not be found. Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-52d3215f-b695-4bdc-951b-e4e6b58d401b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Request method failure captured: Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf HTTP/1.1 Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MiCJxA4LlQuZQL7JgMZLDOG2dPXSgPZAkK6qvQ1nICKODGdO4NzGNYp8xFL0C65eEb0GyIb1yQ9RWXQd23ePaUBkXIkTyKIfG794qyQCwawN5aWJoarkoBvPOID7qY74-FfY3BhzIhEyr67rO9iQxi2WCzluQrr9mJh_RDCnsh2JQM Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.25 Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 28c28ea506a34625bf388395b06b67f5 Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1452829632 Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/28c28ea506a34625bf388395b06b67f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/28c28ea506a34625bf388395b06b67f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_28c28ea506a34625bf388395b06b67f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/28c28ea506a34625bf388395b06b67f5"}]}] Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1452829632 Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 28c28ea506a34625bf388395b06b67f5 Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1452829632 Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-LiveAutoBlockMigrationV225Test-1452829632-project Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a53fed20dabb4e45895da813d4c6538c Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1452829632-project Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 7780d516-e238-4ace-8533-903dd2a12caf could not be found. Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '7780d516-e238-4ace-8533-903dd2a12caf'} Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7780d516-e238-4ace-8533-903dd2a12caf could not be found. Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7780d516-e238-4ace-8533-903dd2a12caf could not be found. Aug 02 06:55:07.449383 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:07.453696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:07.453696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:07.453696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:07.453696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:07.453696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:07.453696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:07.453696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:07.453696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7780d516-e238-4ace-8533-903dd2a12caf could not be found. Aug 02 06:55:07.453696 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:07.456595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-52d3215f-b695-4bdc-951b-e4e6b58d401b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Returning 404 to user: Instance 7780d516-e238-4ace-8533-903dd2a12caf could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:07.458240 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-52d3215f-b695-4bdc-951b-e4e6b58d401b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf" status: 404 len: 111 microversion: 2.25 time: 0.067202 Aug 02 06:55:07.461305 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1200/2274] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:07 2022] GET /compute/v2.1/servers/7780d516-e238-4ace-8533-903dd2a12caf => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:55:07.485816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-84e66264-f422-4670-a91d-b28536c94cae req-d0cd80fe-68b2-4028-b956-008e51df8bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27beb807-e873-4cfb-a895-c16a1bd7ad43", "name": "network-vif-plugged", "status": "completed", "tag": "d0b0f68c-057f-4516-89ae-466675ea705a"}, {"server_uuid": "d8ae4954-4d53-456f-80b1-ecc81adccdbb", "name": "network-vif-plugged", "status": "completed", "tag": "078437fb-a745-4169-b5f1-62422ea79ebf"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:07.503562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-84e66264-f422-4670-a91d-b28536c94cae req-d0cd80fe-68b2-4028-b956-008e51df8bd9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:07.504277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-84e66264-f422-4670-a91d-b28536c94cae req-d0cd80fe-68b2-4028-b956-008e51df8bd9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:07.519016 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-84e66264-f422-4670-a91d-b28536c94cae req-d0cd80fe-68b2-4028-b956-008e51df8bd9 service nova] Creating event network-vif-plugged:d0b0f68c-057f-4516-89ae-466675ea705a for instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 on n-h1-851337-3 Aug 02 06:55:07.519779 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-84e66264-f422-4670-a91d-b28536c94cae req-d0cd80fe-68b2-4028-b956-008e51df8bd9 service nova] Creating event network-vif-plugged:078437fb-a745-4169-b5f1-62422ea79ebf for instance d8ae4954-4d53-456f-80b1-ecc81adccdbb on n-h1-851337-3 Aug 02 06:55:07.528132 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-84e66264-f422-4670-a91d-b28536c94cae req-d0cd80fe-68b2-4028-b956-008e51df8bd9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053806 Aug 02 06:55:07.528720 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1201/2275] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:07.540589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-af5c75fe-3b59-456e-8ecd-0017883cb752 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:07.541307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-af5c75fe-3b59-456e-8ecd-0017883cb752 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:07.559463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af5c75fe-3b59-456e-8ecd-0017883cb752 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:07.559911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af5c75fe-3b59-456e-8ecd-0017883cb752 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:07.561092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af5c75fe-3b59-456e-8ecd-0017883cb752 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:07.561538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af5c75fe-3b59-456e-8ecd-0017883cb752 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:07.809620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:55:07.810299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:55:07.810983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:55:07.812856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:55:07.813858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:55:07.834777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:07.835688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:07.837842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:07.838561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:07.884830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Getting quotas for project 52c51bd236584003aa9766619deafa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:55:07.896221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Getting quotas for user 78a743fbc9ca4dc0b07b41b022f8ebd2 and project 52c51bd236584003aa9766619deafa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:55:07.920517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:55:07.925435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:55:08.058671 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3be109db-c123-4bc8-984c-6ce5e87d8afc tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.613532 Aug 02 06:55:08.069448 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1075/2276] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:54:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 12625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:55:08.089995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cfb063eb-27db-4521-8fff-b349ad3a8bce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d815438a-890f-4ddf-a735-8d9a04380818"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:08.093788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cfb063eb-27db-4521-8fff-b349ad3a8bce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:08.100930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cfb063eb-27db-4521-8fff-b349ad3a8bce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:08.101616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cfb063eb-27db-4521-8fff-b349ad3a8bce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:08.102698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cfb063eb-27db-4521-8fff-b349ad3a8bce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:08.103266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cfb063eb-27db-4521-8fff-b349ad3a8bce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:08.154282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-af5c75fe-3b59-456e-8ecd-0017883cb752 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:08.163764 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-af5c75fe-3b59-456e-8ecd-0017883cb752 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1334 microversion: 2.1 time: 0.630924 Aug 02 06:55:08.181374 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1202/2277] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:07 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1334 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:08.186532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cef957da-3d10-483b-ab19-c75616de9ba9 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:08.191294 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cef957da-3d10-483b-ab19-c75616de9ba9 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:08.204131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cef957da-3d10-483b-ab19-c75616de9ba9 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:08.205032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cef957da-3d10-483b-ab19-c75616de9ba9 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:08.210727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cef957da-3d10-483b-ab19-c75616de9ba9 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:08.211254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cef957da-3d10-483b-ab19-c75616de9ba9 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:08.476657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cef957da-3d10-483b-ab19-c75616de9ba9 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:08.490368 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cef957da-3d10-483b-ab19-c75616de9ba9 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1505 microversion: 2.1 time: 0.307572 Aug 02 06:55:08.492262 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1203/2278] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:08 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:08.600897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-283245259", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:08.758001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] validate_networks() for [('635d7ef5-6ac0-47e7-ae50-ff36b1a4838c', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:55:08.888535 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cfb063eb-27db-4521-8fff-b349ad3a8bce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "POST /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.814132 Aug 02 06:55:08.891616 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1076/2279] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 06:55:08 2022] POST /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/os-volume_attachments => generated 194 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:08.916396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab6457b3-bc3c-41e0-bfde-15ccfadec2b7 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:08.926307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ab6457b3-bc3c-41e0-bfde-15ccfadec2b7 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:09.084398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ab6457b3-bc3c-41e0-bfde-15ccfadec2b7 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a743fbc9ca4dc0b07b41b022f8ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c51bd236584003aa9766619deafa2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:09.095369 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ab6457b3-bc3c-41e0-bfde-15ccfadec2b7 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 200 len: 1223 microversion: 2.1 time: 0.201039 Aug 02 06:55:09.095954 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1077/2280] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:08 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 1223 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:09.100582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9a9000a5-d290-4cd1-be26-33cd3147ffe2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a96a040>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:09.184075 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9a9000a5-d290-4cd1-be26-33cd3147ffe2 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7" status: 200 len: 1440 microversion: 2.1 time: 0.086945 Aug 02 06:55:09.184918 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1078/2281] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:55:09 2022] GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 => generated 1440 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:09.189985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a2ee3c0b-e498-44e4-a929-800ee1355d19 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '.version_select at 0x7f927a9aba60>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:09.190770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a2ee3c0b-e498-44e4-a929-800ee1355d19 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:09.198270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2ee3c0b-e498-44e4-a929-800ee1355d19 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:09.199094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2ee3c0b-e498-44e4-a929-800ee1355d19 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:09.200038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2ee3c0b-e498-44e4-a929-800ee1355d19 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:09.200623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2ee3c0b-e498-44e4-a929-800ee1355d19 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:09.281450 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a2ee3c0b-e498-44e4-a929-800ee1355d19 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.095314 Aug 02 06:55:09.282808 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1079/2282] 10.222.0.79 () {58 vars in 1296 bytes} [Tue Aug 2 06:55:09 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111/os-instance-actions => generated 611 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:09.287706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2f349ce4-62d6-4ae7-ae08-79557f0dcfc1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:09.288553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2f349ce4-62d6-4ae7-ae08-79557f0dcfc1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:09.320526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f349ce4-62d6-4ae7-ae08-79557f0dcfc1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:09.321443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f349ce4-62d6-4ae7-ae08-79557f0dcfc1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:09.322418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f349ce4-62d6-4ae7-ae08-79557f0dcfc1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:09.326643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f349ce4-62d6-4ae7-ae08-79557f0dcfc1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:09.980706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:55:09.981751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:55:09.982422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:55:09.983047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:55:09.983615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:55:10.003708 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:10.004448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:10.005427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:10.006073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:10.087384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Getting quotas for project 91617bcce34a4262a0fb661ddb4593bb. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:55:10.102674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Getting quotas for user daaba266be4e4b6b885eff24a3a56d61 and project 91617bcce34a4262a0fb661ddb4593bb. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:55:10.169871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:55:10.172432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:55:10.325309 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fc3c47d4-7b54-4853-a9e0-ffeabad9c777 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.831574 Aug 02 06:55:10.326332 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1204/2283] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:55:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:55:10.373762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f10f7726-7bc7-4a9a-bdf7-403745c7f6f5 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:10.374140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f10f7726-7bc7-4a9a-bdf7-403745c7f6f5 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:10.409432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f10f7726-7bc7-4a9a-bdf7-403745c7f6f5 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:10.409906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f10f7726-7bc7-4a9a-bdf7-403745c7f6f5 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:10.410912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f10f7726-7bc7-4a9a-bdf7-403745c7f6f5 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:10.411523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f10f7726-7bc7-4a9a-bdf7-403745c7f6f5 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:10.500105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f10f7726-7bc7-4a9a-bdf7-403745c7f6f5 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:55:10.777786 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f10f7726-7bc7-4a9a-bdf7-403745c7f6f5 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 204 len: 0 microversion: 2.1 time: 0.431857 Aug 02 06:55:10.778509 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1205/2284] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:55:10 2022] DELETE /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:55:10.785222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fb848862-28f5-46f3-9c90-2295aed9eeae tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:10.790783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fb848862-28f5-46f3-9c90-2295aed9eeae tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:10.813919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb848862-28f5-46f3-9c90-2295aed9eeae tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:10.814475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb848862-28f5-46f3-9c90-2295aed9eeae tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:10.815333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb848862-28f5-46f3-9c90-2295aed9eeae tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:10.823194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb848862-28f5-46f3-9c90-2295aed9eeae tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:11.332173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fb848862-28f5-46f3-9c90-2295aed9eeae tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a743fbc9ca4dc0b07b41b022f8ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c51bd236584003aa9766619deafa2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:11.343543 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fb848862-28f5-46f3-9c90-2295aed9eeae tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 200 len: 1281 microversion: 2.1 time: 0.563531 Aug 02 06:55:11.356838 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1206/2285] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:10 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 1281 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:11.363505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-55441e22-04c7-47e6-86bc-d8996ff0d5a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a7bdd30>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:11.455291 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-55441e22-04c7-47e6-86bc-d8996ff0d5a4 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7" status: 200 len: 1440 microversion: 2.1 time: 0.109565 Aug 02 06:55:11.455999 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1207/2286] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:55:11 2022] GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 => generated 1440 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:11.467431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f83226b2-e853-4ceb-bcf6-9c6bf918348f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:11.468220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f83226b2-e853-4ceb-bcf6-9c6bf918348f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:11.479602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f83226b2-e853-4ceb-bcf6-9c6bf918348f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:11.494237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f83226b2-e853-4ceb-bcf6-9c6bf918348f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:11.496259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f83226b2-e853-4ceb-bcf6-9c6bf918348f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:11.496931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f83226b2-e853-4ceb-bcf6-9c6bf918348f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:11.518764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2f349ce4-62d6-4ae7-ae08-79557f0dcfc1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:11.529052 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2f349ce4-62d6-4ae7-ae08-79557f0dcfc1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1334 microversion: 2.1 time: 2.244739 Aug 02 06:55:11.541986 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1080/2287] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:09 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1334 bytes in 2246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:11.562176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-53272366-13ae-4e2d-940d-866fbf0eab44 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:11.572411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-53272366-13ae-4e2d-940d-866fbf0eab44 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:11.589916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53272366-13ae-4e2d-940d-866fbf0eab44 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:11.590673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53272366-13ae-4e2d-940d-866fbf0eab44 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:11.591642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53272366-13ae-4e2d-940d-866fbf0eab44 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:11.592417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53272366-13ae-4e2d-940d-866fbf0eab44 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:11.800131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f83226b2-e853-4ceb-bcf6-9c6bf918348f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:11.809966 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f83226b2-e853-4ceb-bcf6-9c6bf918348f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1226 microversion: 2.1 time: 0.352792 Aug 02 06:55:11.814668 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1208/2288] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:11 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1226 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:12.366959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a711b627-047a-4105-b25e-0daaad06fef5 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:12.366959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a711b627-047a-4105-b25e-0daaad06fef5 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:12.382411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a711b627-047a-4105-b25e-0daaad06fef5 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:12.383687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a711b627-047a-4105-b25e-0daaad06fef5 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:12.386188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a711b627-047a-4105-b25e-0daaad06fef5 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:12.389471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a711b627-047a-4105-b25e-0daaad06fef5 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:13.004097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a711b627-047a-4105-b25e-0daaad06fef5 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a743fbc9ca4dc0b07b41b022f8ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c51bd236584003aa9766619deafa2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:13.015494 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a711b627-047a-4105-b25e-0daaad06fef5 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 200 len: 1281 microversion: 2.1 time: 0.651645 Aug 02 06:55:13.018621 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1209/2289] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:12 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 1281 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:55:13.031166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e9239325-c969-4e72-807c-842b47107276 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a67ed30>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:13.098059 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e9239325-c969-4e72-807c-842b47107276 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7" status: 200 len: 1449 microversion: 2.1 time: 0.077996 Aug 02 06:55:13.098656 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1210/2290] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:55:13 2022] GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 => generated 1449 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:13.124252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-098f28b2-b10f-41d8-948e-6461e1ae0540 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:13.125113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-098f28b2-b10f-41d8-948e-6461e1ae0540 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:13.149767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-098f28b2-b10f-41d8-948e-6461e1ae0540 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:13.150662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-098f28b2-b10f-41d8-948e-6461e1ae0540 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:13.155191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-098f28b2-b10f-41d8-948e-6461e1ae0540 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:13.155852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-098f28b2-b10f-41d8-948e-6461e1ae0540 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:13.307242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-53272366-13ae-4e2d-940d-866fbf0eab44 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:13.323670 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-53272366-13ae-4e2d-940d-866fbf0eab44 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1511 microversion: 2.1 time: 1.772640 Aug 02 06:55:13.326790 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1081/2291] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:11 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1511 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:13.343479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bfbc95fd-ce9f-400d-ab0e-d581841af5ec tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:13.344523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bfbc95fd-ce9f-400d-ab0e-d581841af5ec tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:13.360838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfbc95fd-ce9f-400d-ab0e-d581841af5ec tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:13.362900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfbc95fd-ce9f-400d-ab0e-d581841af5ec tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:13.363959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfbc95fd-ce9f-400d-ab0e-d581841af5ec tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:13.365283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfbc95fd-ce9f-400d-ab0e-d581841af5ec tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:13.580393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bfbc95fd-ce9f-400d-ab0e-d581841af5ec tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:13.603232 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bfbc95fd-ce9f-400d-ab0e-d581841af5ec tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1280 microversion: 2.1 time: 0.269716 Aug 02 06:55:13.613198 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1082/2292] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:13 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1280 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:13.636609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b6ff64d8-6735-48aa-8c2a-535b762e87b9 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927aa9f5e0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:13.725527 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b6ff64d8-6735-48aa-8c2a-535b762e87b9 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7" status: 200 len: 1449 microversion: 2.1 time: 0.107973 Aug 02 06:55:13.726263 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1083/2293] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:55:13 2022] GET /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 => generated 1449 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:13.743069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b8649461-f7bc-4f6c-a0ce-810089b66d0b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927aab71f0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:14.450266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-098f28b2-b10f-41d8-948e-6461e1ae0540 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:14.471774 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-098f28b2-b10f-41d8-948e-6461e1ae0540 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1669 microversion: 2.1 time: 1.359996 Aug 02 06:55:14.472612 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1211/2294] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:13 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1669 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:14.477254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f68624f7-5d9a-4b6c-8775-f1efef721502 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:14.490900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f68624f7-5d9a-4b6c-8775-f1efef721502 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:14.498972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f68624f7-5d9a-4b6c-8775-f1efef721502 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:14.500154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f68624f7-5d9a-4b6c-8775-f1efef721502 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:14.501358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f68624f7-5d9a-4b6c-8775-f1efef721502 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:14.502087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f68624f7-5d9a-4b6c-8775-f1efef721502 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:14.630843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f68624f7-5d9a-4b6c-8775-f1efef721502 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a743fbc9ca4dc0b07b41b022f8ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c51bd236584003aa9766619deafa2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:14.640462 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f68624f7-5d9a-4b6c-8775-f1efef721502 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 200 len: 1281 microversion: 2.1 time: 0.166617 Aug 02 06:55:14.642028 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1212/2295] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:14 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 1281 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:14.654522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8fe0d4c0-c3dc-4d50-99c9-434c3517b24e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:14.655822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8fe0d4c0-c3dc-4d50-99c9-434c3517b24e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:14.686520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fe0d4c0-c3dc-4d50-99c9-434c3517b24e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:14.687315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fe0d4c0-c3dc-4d50-99c9-434c3517b24e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:14.688295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fe0d4c0-c3dc-4d50-99c9-434c3517b24e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:14.690893 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fe0d4c0-c3dc-4d50-99c9-434c3517b24e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:14.745403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8fe0d4c0-c3dc-4d50-99c9-434c3517b24e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:55:14.931412 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8fe0d4c0-c3dc-4d50-99c9-434c3517b24e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "DELETE /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 204 len: 0 microversion: 2.25 time: 0.287916 Aug 02 06:55:14.940980 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1213/2296] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:55:14 2022] DELETE /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 06:55:14.947215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a583fa46-c2f4-4a63-b217-86db0f1bcc55 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:14.948235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a583fa46-c2f4-4a63-b217-86db0f1bcc55 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:14.963910 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b8649461-f7bc-4f6c-a0ce-810089b66d0b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7" status: 204 len: 0 microversion: 2.1 time: 1.224760 Aug 02 06:55:14.965858 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1084/2297] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:13 2022] DELETE /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 => generated 0 bytes in 1229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:55:14.974283 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a583fa46-c2f4-4a63-b217-86db0f1bcc55 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:14.974735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a583fa46-c2f4-4a63-b217-86db0f1bcc55 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:14.975586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a583fa46-c2f4-4a63-b217-86db0f1bcc55 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:14.975949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a583fa46-c2f4-4a63-b217-86db0f1bcc55 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:14.977558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-30e8d680-a109-4e20-871d-d84a347fa8a6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:14.978313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-30e8d680-a109-4e20-871d-d84a347fa8a6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:14.990473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30e8d680-a109-4e20-871d-d84a347fa8a6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:14.991255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30e8d680-a109-4e20-871d-d84a347fa8a6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:14.992582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30e8d680-a109-4e20-871d-d84a347fa8a6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:14.993367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30e8d680-a109-4e20-871d-d84a347fa8a6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:15.038730 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-30e8d680-a109-4e20-871d-d84a347fa8a6 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb/ips" status: 200 len: 179 microversion: 2.1 time: 0.071368 Aug 02 06:55:15.047817 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1085/2298] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 06:55:14 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb/ips => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:15.072352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2a78f138-4625-4d5a-9d61-42d26669bba1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:15.073601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2a78f138-4625-4d5a-9d61-42d26669bba1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:15.088620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a78f138-4625-4d5a-9d61-42d26669bba1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:15.089569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a78f138-4625-4d5a-9d61-42d26669bba1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:15.090865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a78f138-4625-4d5a-9d61-42d26669bba1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:15.092967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a78f138-4625-4d5a-9d61-42d26669bba1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:15.133264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a583fa46-c2f4-4a63-b217-86db0f1bcc55 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c32574f81694c18bc3406735dc92bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ada792b3034ca4a9e2c2257352c232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:15.158516 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a583fa46-c2f4-4a63-b217-86db0f1bcc55 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 200 len: 1469 microversion: 2.1 time: 0.202667 Aug 02 06:55:15.174387 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1214/2299] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:14 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 1469 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:15.181987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab6538f4-7d5d-45bd-b97b-528a8a56fda3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:15.183174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab6538f4-7d5d-45bd-b97b-528a8a56fda3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:15.192228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab6538f4-7d5d-45bd-b97b-528a8a56fda3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:15.193121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab6538f4-7d5d-45bd-b97b-528a8a56fda3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:15.194920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab6538f4-7d5d-45bd-b97b-528a8a56fda3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:15.195625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab6538f4-7d5d-45bd-b97b-528a8a56fda3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:15.790140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab6538f4-7d5d-45bd-b97b-528a8a56fda3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:15.799054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab6538f4-7d5d-45bd-b97b-528a8a56fda3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:15.812350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab6538f4-7d5d-45bd-b97b-528a8a56fda3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:15.813646 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab6538f4-7d5d-45bd-b97b-528a8a56fda3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1732 microversion: 2.25 time: 0.637424 Aug 02 06:55:15.814251 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1215/2300] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:15 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1732 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:15.864818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7672a024-29b4-4a5a-944c-a8be31975a3f req-e39214c6-60b3-48a4-8884-e702c701c7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf02507-5370-4194-8e06-804e90764111", "name": "network-vif-deleted", "tag": "0d7101a6-b93d-4fdd-94ea-5a70295c3855"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:15.908838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7672a024-29b4-4a5a-944c-a8be31975a3f req-e39214c6-60b3-48a4-8884-e702c701c7c2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:15.909532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7672a024-29b4-4a5a-944c-a8be31975a3f req-e39214c6-60b3-48a4-8884-e702c701c7c2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:15.962002 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7672a024-29b4-4a5a-944c-a8be31975a3f req-e39214c6-60b3-48a4-8884-e702c701c7c2 service nova] Creating event network-vif-deleted:0d7101a6-b93d-4fdd-94ea-5a70295c3855 for instance cbf02507-5370-4194-8e06-804e90764111 on n-h2-851337-3 Aug 02 06:55:15.972250 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7672a024-29b4-4a5a-944c-a8be31975a3f req-e39214c6-60b3-48a4-8884-e702c701c7c2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110975 Aug 02 06:55:15.975882 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1216/2301] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:15.984911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc30c965-e0da-4da0-89f1-64cc588fed92 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:15.985504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bc30c965-e0da-4da0-89f1-64cc588fed92 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:16.000653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc30c965-e0da-4da0-89f1-64cc588fed92 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:16.007424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc30c965-e0da-4da0-89f1-64cc588fed92 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:16.008899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc30c965-e0da-4da0-89f1-64cc588fed92 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:16.009372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc30c965-e0da-4da0-89f1-64cc588fed92 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:16.023002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2a78f138-4625-4d5a-9d61-42d26669bba1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:16.034465 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2a78f138-4625-4d5a-9d61-42d26669bba1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1322 microversion: 2.1 time: 0.985204 Aug 02 06:55:16.046288 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1086/2302] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:15 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1322 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:16.054232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-21ce4443-6d92-4e21-8469-b09e3cb494c8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:16.054973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-21ce4443-6d92-4e21-8469-b09e3cb494c8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:16.063161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21ce4443-6d92-4e21-8469-b09e3cb494c8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:16.064512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21ce4443-6d92-4e21-8469-b09e3cb494c8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:16.065528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21ce4443-6d92-4e21-8469-b09e3cb494c8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:16.066242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21ce4443-6d92-4e21-8469-b09e3cb494c8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:16.079164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bc30c965-e0da-4da0-89f1-64cc588fed92 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:55:16.086152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:16.130759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-21ce4443-6d92-4e21-8469-b09e3cb494c8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:55:16.230479 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc30c965-e0da-4da0-89f1-64cc588fed92 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 204 len: 0 microversion: 2.1 time: 0.252338 Aug 02 06:55:16.231494 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1217/2303] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:55:15 2022] DELETE /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:55:16.252500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ae8af6b0-be2b-4a76-ab25-ad07db35c6b1 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:16.260535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae8af6b0-be2b-4a76-ab25-ad07db35c6b1 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:16.291385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae8af6b0-be2b-4a76-ab25-ad07db35c6b1 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:16.291942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae8af6b0-be2b-4a76-ab25-ad07db35c6b1 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:16.292790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae8af6b0-be2b-4a76-ab25-ad07db35c6b1 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:16.293233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae8af6b0-be2b-4a76-ab25-ad07db35c6b1 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:16.340407 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-21ce4443-6d92-4e21-8469-b09e3cb494c8 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 204 len: 0 microversion: 2.1 time: 0.292408 Aug 02 06:55:16.341287 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1087/2304] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:55:16 2022] DELETE /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:55:16.353366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-af8fd940-1a2c-4130-97a4-bfb5a8c4cdb1 req-aa0343eb-9957-42b8-b974-2aad4b65e6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046c9460-b404-498d-8cae-05a4b2251d32", "tag": "7f8d31f5-4723-4ec2-9785-0a3dac02cdca"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:16.378967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-af8fd940-1a2c-4130-97a4-bfb5a8c4cdb1 req-aa0343eb-9957-42b8-b974-2aad4b65e6b7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:16.380672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-af8fd940-1a2c-4130-97a4-bfb5a8c4cdb1 req-aa0343eb-9957-42b8-b974-2aad4b65e6b7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:16.403048 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-af8fd940-1a2c-4130-97a4-bfb5a8c4cdb1 req-aa0343eb-9957-42b8-b974-2aad4b65e6b7 service nova] Creating event network-changed:7f8d31f5-4723-4ec2-9785-0a3dac02cdca for instance 046c9460-b404-498d-8cae-05a4b2251d32 on n-h1-851337-3 Aug 02 06:55:16.424411 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-af8fd940-1a2c-4130-97a4-bfb5a8c4cdb1 req-aa0343eb-9957-42b8-b974-2aad4b65e6b7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081250 Aug 02 06:55:16.425298 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1088/2305] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:16.430713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c68c7060-a788-4aee-992f-652df3912679 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:16.431414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c68c7060-a788-4aee-992f-652df3912679 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] [instance: cbf02507-5370-4194-8e06-804e90764111] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:16.439758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c68c7060-a788-4aee-992f-652df3912679 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:16.440764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c68c7060-a788-4aee-992f-652df3912679 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:16.441721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c68c7060-a788-4aee-992f-652df3912679 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:16.442404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c68c7060-a788-4aee-992f-652df3912679 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:16.465990 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-c68c7060-a788-4aee-992f-652df3912679 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] HTTP exception thrown: Instance cbf02507-5370-4194-8e06-804e90764111 could not be found. Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c68c7060-a788-4aee-992f-652df3912679 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Request method failure captured: Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 HTTP/1.1 Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mol5btD2TpM07gyAUPbxfP3kKtiV-36Cvukp0WXNubcJ1kZb-JiSNVu0KiNBF0kMbL7GxS2zdHU0CKaSAbVLMCi7acjPVtrQHf-AvXOsnhGFNW1T9-vmdf0n8p1k48jobpqAOXQUdsrYMy-XoIy5cacdTn_SVqWzSc2aaBHwDSM7Xk Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: b2ada792b3034ca4a9e2c2257352c232 Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-InstanceActionsTestJSON-624414614 Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b2ada792b3034ca4a9e2c2257352c232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b2ada792b3034ca4a9e2c2257352c232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b2ada792b3034ca4a9e2c2257352c232"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b2ada792b3034ca4a9e2c2257352c232"}]}] Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-InstanceActionsTestJSON-624414614 Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: b2ada792b3034ca4a9e2c2257352c232 Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-InstanceActionsTestJSON-624414614 Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-InstanceActionsTestJSON-624414614-project Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 8c32574f81694c18bc3406735dc92bf0 Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-InstanceActionsTestJSON-624414614-project Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance cbf02507-5370-4194-8e06-804e90764111 could not be found. Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'cbf02507-5370-4194-8e06-804e90764111'} Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbf02507-5370-4194-8e06-804e90764111 could not be found. Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbf02507-5370-4194-8e06-804e90764111 could not be found. Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:16.470124 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:16.473663 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:16.473663 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:16.473663 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:16.473663 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:16.473663 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:16.473663 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbf02507-5370-4194-8e06-804e90764111 could not be found. Aug 02 06:55:16.473663 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:16.479289 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c68c7060-a788-4aee-992f-652df3912679 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] Returning 404 to user: Instance cbf02507-5370-4194-8e06-804e90764111 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:16.481216 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c68c7060-a788-4aee-992f-652df3912679 tempest-InstanceActionsTestJSON-624414614 tempest-InstanceActionsTestJSON-624414614-project] 10.222.0.79 "GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111" status: 404 len: 111 microversion: 2.1 time: 0.054803 Aug 02 06:55:16.482287 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1089/2306] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:16 2022] GET /compute/v2.1/servers/cbf02507-5370-4194-8e06-804e90764111 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:55:16.502564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6f243ffa-6598-46e4-a14d-0990f6c3ac3c tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:16.503741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6f243ffa-6598-46e4-a14d-0990f6c3ac3c tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:16.518669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f243ffa-6598-46e4-a14d-0990f6c3ac3c tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:16.535556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f243ffa-6598-46e4-a14d-0990f6c3ac3c tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:16.536394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f243ffa-6598-46e4-a14d-0990f6c3ac3c tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:16.536831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f243ffa-6598-46e4-a14d-0990f6c3ac3c tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:16.875298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ae8af6b0-be2b-4a76-ab25-ad07db35c6b1 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a743fbc9ca4dc0b07b41b022f8ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c51bd236584003aa9766619deafa2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:16.890407 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ae8af6b0-be2b-4a76-ab25-ad07db35c6b1 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 200 len: 1323 microversion: 2.1 time: 0.656086 Aug 02 06:55:16.891359 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1218/2307] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:16 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 1323 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:16.903428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-681024307", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "db7d01d8-40e0-493b-8992-76c9b63bb01d"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:17.031447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] validate_networks() for [('db7d01d8-40e0-493b-8992-76c9b63bb01d', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:55:17.327546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6f243ffa-6598-46e4-a14d-0990f6c3ac3c tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:17.341292 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6f243ffa-6598-46e4-a14d-0990f6c3ac3c tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1675 microversion: 2.1 time: 0.856435 Aug 02 06:55:17.355028 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1090/2308] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:16 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1675 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:17.362634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-083ff375-999d-4592-9ad7-f946a77b562d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:17.363300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-083ff375-999d-4592-9ad7-f946a77b562d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:17.371534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-083ff375-999d-4592-9ad7-f946a77b562d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:17.371988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-083ff375-999d-4592-9ad7-f946a77b562d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:17.373104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-083ff375-999d-4592-9ad7-f946a77b562d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:17.373762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-083ff375-999d-4592-9ad7-f946a77b562d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:17.541080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-083ff375-999d-4592-9ad7-f946a77b562d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:17.557145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-083ff375-999d-4592-9ad7-f946a77b562d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:17.560214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-083ff375-999d-4592-9ad7-f946a77b562d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:17.563457 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-083ff375-999d-4592-9ad7-f946a77b562d tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 200 len: 1665 microversion: 2.25 time: 0.206143 Aug 02 06:55:17.579971 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1091/2309] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:17 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 1665 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:17.579971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ce220fa9-ca1e-4188-803b-f610d4dfee03 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:17.579971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ce220fa9-ca1e-4188-803b-f610d4dfee03 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:17.610394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ce220fa9-ca1e-4188-803b-f610d4dfee03 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:17.612866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ce220fa9-ca1e-4188-803b-f610d4dfee03 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:17.620095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ce220fa9-ca1e-4188-803b-f610d4dfee03 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:17.622081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ce220fa9-ca1e-4188-803b-f610d4dfee03 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:17.873222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:18.683521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ce220fa9-ca1e-4188-803b-f610d4dfee03 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:18.698283 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ce220fa9-ca1e-4188-803b-f610d4dfee03 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1322 microversion: 2.1 time: 1.126082 Aug 02 06:55:18.704731 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1092/2310] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:17 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1322 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:18.713924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-f41e8ffc-405d-4ea2-a385-e344dd99c04c req-2ef3f8e4-77d0-49fb-92e3-e67d9e120d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27beb807-e873-4cfb-a895-c16a1bd7ad43", "name": "network-vif-unplugged", "status": "completed", "tag": "d0b0f68c-057f-4516-89ae-466675ea705a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:18.751473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f41e8ffc-405d-4ea2-a385-e344dd99c04c req-2ef3f8e4-77d0-49fb-92e3-e67d9e120d92 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:18.752232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f41e8ffc-405d-4ea2-a385-e344dd99c04c req-2ef3f8e4-77d0-49fb-92e3-e67d9e120d92 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:18.778561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:55:18.779096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:55:18.779945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:55:18.780449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:55:18.780952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:55:18.809039 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-f41e8ffc-405d-4ea2-a385-e344dd99c04c req-2ef3f8e4-77d0-49fb-92e3-e67d9e120d92 service nova] Creating event network-vif-unplugged:d0b0f68c-057f-4516-89ae-466675ea705a for instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 on n-h1-851337-3 Aug 02 06:55:18.812993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:18.813829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:18.821025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:18.830320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:18.839427 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-f41e8ffc-405d-4ea2-a385-e344dd99c04c req-2ef3f8e4-77d0-49fb-92e3-e67d9e120d92 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132097 Aug 02 06:55:18.840322 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1093/2311] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:18.852841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5a1f00a9-65a2-41fe-827f-eaead6c87097 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:18.853558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5a1f00a9-65a2-41fe-827f-eaead6c87097 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:18.889814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a1f00a9-65a2-41fe-827f-eaead6c87097 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:18.890604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a1f00a9-65a2-41fe-827f-eaead6c87097 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:18.891112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a1f00a9-65a2-41fe-827f-eaead6c87097 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:18.891701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a1f00a9-65a2-41fe-827f-eaead6c87097 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:18.903616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Getting quotas for project 2a8dc75e5ba647e3b128c31a49f069ca. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:55:18.924966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Getting quotas for user 793620d46a6c42fb955f1fe5075b040b and project 2a8dc75e5ba647e3b128c31a49f069ca. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:55:18.973905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:55:18.977400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:55:19.089712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=8 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:19.111665 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-86139651-b6aa-45b6-92ae-277d4c97a89d tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.215638 Aug 02 06:55:19.119891 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1219/2312] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:55:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:55:19.128913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0d4970ab-48d0-4196-b7c5-0646f45f7254 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:19.139450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0d4970ab-48d0-4196-b7c5-0646f45f7254 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:19.162388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d4970ab-48d0-4196-b7c5-0646f45f7254 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:19.164921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d4970ab-48d0-4196-b7c5-0646f45f7254 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:19.166203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d4970ab-48d0-4196-b7c5-0646f45f7254 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:19.169140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d4970ab-48d0-4196-b7c5-0646f45f7254 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:19.916391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0d4970ab-48d0-4196-b7c5-0646f45f7254 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:19.925982 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0d4970ab-48d0-4196-b7c5-0646f45f7254 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1675 microversion: 2.1 time: 0.804589 Aug 02 06:55:19.928013 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1220/2313] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:19 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1675 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:19.941830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-73cb816d-4c97-43ab-878e-5493ebb08fc1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:19.941830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-73cb816d-4c97-43ab-878e-5493ebb08fc1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 62927d0b-7f85-4ce4-a606-2c0ddb2b896e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:19.957451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73cb816d-4c97-43ab-878e-5493ebb08fc1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:19.958076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73cb816d-4c97-43ab-878e-5493ebb08fc1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:19.959049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73cb816d-4c97-43ab-878e-5493ebb08fc1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:19.959643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73cb816d-4c97-43ab-878e-5493ebb08fc1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:19.990098 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-73cb816d-4c97-43ab-878e-5493ebb08fc1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] HTTP exception thrown: Instance 62927d0b-7f85-4ce4-a606-2c0ddb2b896e could not be found. Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-73cb816d-4c97-43ab-878e-5493ebb08fc1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Request method failure captured: Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e HTTP/1.1 Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MiCJxA4LlQuZQL7JgMZLDOG2dPXSgPZAkK6qvQ1nICKODGdO4NzGNYp8xFL0C65eEb0GyIb1yQ9RWXQd23ePaUBkXIkTyKIfG794qyQCwawN5aWJoarkoBvPOID7qY74-FfY3BhzIhEyr67rO9iQxi2WCzluQrr9mJh_RDCnsh2JQM Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.25 Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 28c28ea506a34625bf388395b06b67f5 Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1452829632 Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/28c28ea506a34625bf388395b06b67f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/28c28ea506a34625bf388395b06b67f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_28c28ea506a34625bf388395b06b67f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/28c28ea506a34625bf388395b06b67f5"}]}] Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1452829632 Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 28c28ea506a34625bf388395b06b67f5 Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1452829632 Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-LiveAutoBlockMigrationV225Test-1452829632-project Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a53fed20dabb4e45895da813d4c6538c Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1452829632-project Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 62927d0b-7f85-4ce4-a606-2c0ddb2b896e could not be found. Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '62927d0b-7f85-4ce4-a606-2c0ddb2b896e'} Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62927d0b-7f85-4ce4-a606-2c0ddb2b896e could not be found. Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62927d0b-7f85-4ce4-a606-2c0ddb2b896e could not be found. Aug 02 06:55:19.996093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:20.000288 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:20.000288 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:20.000288 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:20.000288 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:20.000288 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:20.000288 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:20.000288 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:20.000288 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62927d0b-7f85-4ce4-a606-2c0ddb2b896e could not be found. Aug 02 06:55:20.000288 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:20.001593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-73cb816d-4c97-43ab-878e-5493ebb08fc1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Returning 404 to user: Instance 62927d0b-7f85-4ce4-a606-2c0ddb2b896e could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:20.003153 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-73cb816d-4c97-43ab-878e-5493ebb08fc1 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e" status: 404 len: 111 microversion: 2.25 time: 0.071689 Aug 02 06:55:20.005458 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1221/2314] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:19 2022] GET /compute/v2.1/servers/62927d0b-7f85-4ce4-a606-2c0ddb2b896e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:55:20.017698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-0377e3f3-a674-41e9-b1f2-c1414d4b58b8 req-9f45a885-4156-4544-b8b5-eeea8f089bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62927d0b-7f85-4ce4-a606-2c0ddb2b896e", "name": "network-vif-deleted", "tag": "cbca7b5a-a5a7-4e60-8b1c-996099aebce3"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:20.041927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0377e3f3-a674-41e9-b1f2-c1414d4b58b8 req-9f45a885-4156-4544-b8b5-eeea8f089bb4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:20.042606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0377e3f3-a674-41e9-b1f2-c1414d4b58b8 req-9f45a885-4156-4544-b8b5-eeea8f089bb4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:20.072435 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-0377e3f3-a674-41e9-b1f2-c1414d4b58b8 req-9f45a885-4156-4544-b8b5-eeea8f089bb4 service nova] Creating event network-vif-deleted:cbca7b5a-a5a7-4e60-8b1c-996099aebce3 for instance 62927d0b-7f85-4ce4-a606-2c0ddb2b896e on n-h2-851337-3 Aug 02 06:55:20.086543 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-0377e3f3-a674-41e9-b1f2-c1414d4b58b8 req-9f45a885-4156-4544-b8b5-eeea8f089bb4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078106 Aug 02 06:55:20.087382 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1222/2315] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:20.093989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-79aaa9b0-cbf3-4e89-b4d0-59117977840e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:20.096122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-79aaa9b0-cbf3-4e89-b4d0-59117977840e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:20.212765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5a1f00a9-65a2-41fe-827f-eaead6c87097 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a743fbc9ca4dc0b07b41b022f8ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c51bd236584003aa9766619deafa2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:20.221197 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5a1f00a9-65a2-41fe-827f-eaead6c87097 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 200 len: 1323 microversion: 2.1 time: 1.372488 Aug 02 06:55:20.226982 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1094/2316] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:18 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 1323 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:20.229022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-79aaa9b0-cbf3-4e89-b4d0-59117977840e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:20.231835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bd110cc3-b3e3-45e6-962f-577a144633de tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:20.232452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bd110cc3-b3e3-45e6-962f-577a144633de tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:20.243941 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-79aaa9b0-cbf3-4e89-b4d0-59117977840e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1207 microversion: 2.1 time: 0.153997 Aug 02 06:55:20.244965 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1223/2317] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:20 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1207 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:20.249550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd110cc3-b3e3-45e6-962f-577a144633de tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:20.250061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd110cc3-b3e3-45e6-962f-577a144633de tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:20.251021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd110cc3-b3e3-45e6-962f-577a144633de tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:20.252333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-581f3c60-2f77-4658-9867-1ac66f3e5e46 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '.version_select at 0x7f927a7bd700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:20.254806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd110cc3-b3e3-45e6-962f-577a144633de tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:20.302203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:20.309732 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-581f3c60-2f77-4658-9867-1ac66f3e5e46 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508174386" status: 204 len: 0 microversion: 2.25 time: 0.063400 Aug 02 06:55:20.311098 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1224/2318] 10.222.0.79 () {60 vars in 1262 bytes} [Tue Aug 2 06:55:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508174386 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 06:55:20.695622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bd110cc3-b3e3-45e6-962f-577a144633de tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:20.711632 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bd110cc3-b3e3-45e6-962f-577a144633de tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1322 microversion: 2.1 time: 0.483069 Aug 02 06:55:20.721478 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1095/2319] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:20 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:20.784802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1091401804", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1a650db2-cc5b-4bf9-a3d9-769971c94bb7"}], "security_groups": [{"name": "tempest-securitygroup--1195522701"}], "key_name": "tempest-keypair-626367345", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "6020c8dc-7be8-4136-bed2-40710f374171", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:20.951927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9c82c4a7-dd46-45f3-8ab0-6b8e1bf519b1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:20.952553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9c82c4a7-dd46-45f3-8ab0-6b8e1bf519b1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:20.961602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c82c4a7-dd46-45f3-8ab0-6b8e1bf519b1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:20.962150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c82c4a7-dd46-45f3-8ab0-6b8e1bf519b1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:20.962931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c82c4a7-dd46-45f3-8ab0-6b8e1bf519b1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:20.963367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c82c4a7-dd46-45f3-8ab0-6b8e1bf519b1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:21.031762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] validate_networks() for [('1a650db2-cc5b-4bf9-a3d9-769971c94bb7', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:55:21.404752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9c82c4a7-dd46-45f3-8ab0-6b8e1bf519b1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:21.414122 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9c82c4a7-dd46-45f3-8ab0-6b8e1bf519b1 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1675 microversion: 2.1 time: 0.467374 Aug 02 06:55:21.414962 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1096/2320] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:20 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1675 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:21.420052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e99911fa-cc4c-4ee1-a707-2b0c49a54849 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:21.420818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e99911fa-cc4c-4ee1-a707-2b0c49a54849 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:21.427261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e99911fa-cc4c-4ee1-a707-2b0c49a54849 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:21.427735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e99911fa-cc4c-4ee1-a707-2b0c49a54849 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:21.428636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e99911fa-cc4c-4ee1-a707-2b0c49a54849 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:21.429356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e99911fa-cc4c-4ee1-a707-2b0c49a54849 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:21.655297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:21.980513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e99911fa-cc4c-4ee1-a707-2b0c49a54849 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a743fbc9ca4dc0b07b41b022f8ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c51bd236584003aa9766619deafa2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:21.990424 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e99911fa-cc4c-4ee1-a707-2b0c49a54849 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 200 len: 1323 microversion: 2.1 time: 0.573989 Aug 02 06:55:21.991093 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1097/2321] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:21 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 1323 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:21.995774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a030659b-3697-406f-9163-5b0eb8f400ff tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:21.996450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a030659b-3697-406f-9163-5b0eb8f400ff tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:22.007821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a030659b-3697-406f-9163-5b0eb8f400ff tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:22.008364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a030659b-3697-406f-9163-5b0eb8f400ff tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:22.009176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a030659b-3697-406f-9163-5b0eb8f400ff tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:22.009614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a030659b-3697-406f-9163-5b0eb8f400ff tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:22.178145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a030659b-3697-406f-9163-5b0eb8f400ff tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:22.187544 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a030659b-3697-406f-9163-5b0eb8f400ff tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1265 microversion: 2.1 time: 0.195349 Aug 02 06:55:22.202454 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1098/2322] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:21 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:22.207637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-934dbdd0-a78d-442b-9b38-825a430876d5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:22.208604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-934dbdd0-a78d-442b-9b38-825a430876d5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:22.220631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-934dbdd0-a78d-442b-9b38-825a430876d5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:22.221454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-934dbdd0-a78d-442b-9b38-825a430876d5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:22.222446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-934dbdd0-a78d-442b-9b38-825a430876d5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:22.223084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-934dbdd0-a78d-442b-9b38-825a430876d5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:23.032675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Getting quotas for project 629c0175113f4f3d9ae413714345b45f. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:55:23.043950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Getting quotas for user 604e117f97c548b98ace652b760cdf0b and project 629c0175113f4f3d9ae413714345b45f. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:55:23.062488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:55:23.063133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:55:23.063687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:55:23.064171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:55:23.064809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:55:23.075665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:23.076974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:23.078562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:23.079449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:23.100010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Getting quotas for project 629c0175113f4f3d9ae413714345b45f. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:55:23.107905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Getting quotas for user 604e117f97c548b98ace652b760cdf0b and project 629c0175113f4f3d9ae413714345b45f. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:55:23.151459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-934dbdd0-a78d-442b-9b38-825a430876d5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:23.164466 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-934dbdd0-a78d-442b-9b38-825a430876d5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1322 microversion: 2.1 time: 0.958155 Aug 02 06:55:23.166366 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1099/2323] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:22 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1322 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:23.175762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c4d16355-749f-41c5-9f94-2dd34ab69ba7 req-e0d13e91-107c-4f52-a868-6e82f011eaa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b4e83b-99ba-4a5a-bac1-497b2611608d", "tag": "4676935b-9f6f-4169-b34f-f21a84f3bfad"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:23.198788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c4d16355-749f-41c5-9f94-2dd34ab69ba7 req-e0d13e91-107c-4f52-a868-6e82f011eaa4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:23.203430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c4d16355-749f-41c5-9f94-2dd34ab69ba7 req-e0d13e91-107c-4f52-a868-6e82f011eaa4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:23.203634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:55:23.206938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6020c8dc-7be8-4136-bed2-40710f374171',volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:55:23.225115 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c4d16355-749f-41c5-9f94-2dd34ab69ba7 req-e0d13e91-107c-4f52-a868-6e82f011eaa4 service nova] Creating event network-changed:4676935b-9f6f-4169-b34f-f21a84f3bfad for instance 69b4e83b-99ba-4a5a-bac1-497b2611608d on n-h2-851337-3 Aug 02 06:55:23.255806 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c4d16355-749f-41c5-9f94-2dd34ab69ba7 req-e0d13e91-107c-4f52-a868-6e82f011eaa4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086524 Aug 02 06:55:23.269345 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1100/2324] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:23.276851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-118028cf-d250-4a33-90ef-2241a94c592f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:23.277770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-118028cf-d250-4a33-90ef-2241a94c592f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:23.286368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-118028cf-d250-4a33-90ef-2241a94c592f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:23.287051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-118028cf-d250-4a33-90ef-2241a94c592f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:23.288280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-118028cf-d250-4a33-90ef-2241a94c592f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:23.288844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-118028cf-d250-4a33-90ef-2241a94c592f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:23.461745 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c0c43621-c54d-4123-8b1d-d7a42e9209f0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.682008 Aug 02 06:55:23.471573 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1225/2325] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:55:20 2022] POST /compute/v2.1/servers => generated 407 bytes in 2692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:55:23.476966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c0228b1e-3b03-4d63-9373-51edf6a7dad2 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:23.477876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c0228b1e-3b03-4d63-9373-51edf6a7dad2 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:23.485177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0228b1e-3b03-4d63-9373-51edf6a7dad2 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:23.496736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0228b1e-3b03-4d63-9373-51edf6a7dad2 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:23.497665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0228b1e-3b03-4d63-9373-51edf6a7dad2 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:23.498136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0228b1e-3b03-4d63-9373-51edf6a7dad2 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:24.064744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-118028cf-d250-4a33-90ef-2241a94c592f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:24.076956 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-118028cf-d250-4a33-90ef-2241a94c592f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1675 microversion: 2.1 time: 0.805357 Aug 02 06:55:24.093982 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1101/2326] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:23 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1675 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:24.109485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0a44edcb-27da-422c-9abd-cc53afd208e3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:24.112048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0a44edcb-27da-422c-9abd-cc53afd208e3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:24.128977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a44edcb-27da-422c-9abd-cc53afd208e3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:24.129837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a44edcb-27da-422c-9abd-cc53afd208e3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:24.131090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a44edcb-27da-422c-9abd-cc53afd208e3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:24.131734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a44edcb-27da-422c-9abd-cc53afd208e3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:24.192079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0a44edcb-27da-422c-9abd-cc53afd208e3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:55:24.373954 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0a44edcb-27da-422c-9abd-cc53afd208e3 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 204 len: 0 microversion: 2.25 time: 0.278149 Aug 02 06:55:24.374890 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1102/2327] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:55:24 2022] DELETE /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 06:55:24.380592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-96358357-862d-465e-b851-9b226f5fb12e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:24.381594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-96358357-862d-465e-b851-9b226f5fb12e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:24.398759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96358357-862d-465e-b851-9b226f5fb12e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:24.399217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96358357-862d-465e-b851-9b226f5fb12e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:24.399992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96358357-862d-465e-b851-9b226f5fb12e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:24.400420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96358357-862d-465e-b851-9b226f5fb12e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:24.486666 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c0228b1e-3b03-4d63-9373-51edf6a7dad2 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a743fbc9ca4dc0b07b41b022f8ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c51bd236584003aa9766619deafa2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:24.495683 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c0228b1e-3b03-4d63-9373-51edf6a7dad2 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 200 len: 1323 microversion: 2.1 time: 1.022750 Aug 02 06:55:24.496575 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1226/2328] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:23 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 1323 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:24.501278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-187f5378-4b20-4aa7-b009-e01110e9079a req-a3683fcf-ed3c-4579-b320-888c4c62b733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ae4954-4d53-456f-80b1-ecc81adccdbb", "name": "network-vif-unplugged", "status": "completed", "tag": "5c31d0c8-2ff2-4fde-b0cf-df3b18f0ca3e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:24.520442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-187f5378-4b20-4aa7-b009-e01110e9079a req-a3683fcf-ed3c-4579-b320-888c4c62b733 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:24.520875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-187f5378-4b20-4aa7-b009-e01110e9079a req-a3683fcf-ed3c-4579-b320-888c4c62b733 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:24.544361 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-187f5378-4b20-4aa7-b009-e01110e9079a req-a3683fcf-ed3c-4579-b320-888c4c62b733 service nova] Creating event network-vif-unplugged:5c31d0c8-2ff2-4fde-b0cf-df3b18f0ca3e for instance d8ae4954-4d53-456f-80b1-ecc81adccdbb on n-h1-851337-3 Aug 02 06:55:24.554575 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-187f5378-4b20-4aa7-b009-e01110e9079a req-a3683fcf-ed3c-4579-b320-888c4c62b733 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056569 Aug 02 06:55:24.556678 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1227/2329] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:24.571028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ac9c6928-f4b2-4424-8bcf-1a0716c97772 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:24.572919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ac9c6928-f4b2-4424-8bcf-1a0716c97772 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:24.581100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac9c6928-f4b2-4424-8bcf-1a0716c97772 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:24.581475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac9c6928-f4b2-4424-8bcf-1a0716c97772 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:24.582313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac9c6928-f4b2-4424-8bcf-1a0716c97772 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:24.583026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac9c6928-f4b2-4424-8bcf-1a0716c97772 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:24.668697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-96358357-862d-465e-b851-9b226f5fb12e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:24.678335 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-96358357-862d-465e-b851-9b226f5fb12e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1265 microversion: 2.1 time: 0.301765 Aug 02 06:55:24.690428 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1103/2330] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:24 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:24.698979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e2ef29b5-3135-4735-8a69-9d92fa21e99a tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:24.700046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e2ef29b5-3135-4735-8a69-9d92fa21e99a tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:24.708854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e2ef29b5-3135-4735-8a69-9d92fa21e99a tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:24.709643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e2ef29b5-3135-4735-8a69-9d92fa21e99a tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:24.710855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e2ef29b5-3135-4735-8a69-9d92fa21e99a tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:24.711571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e2ef29b5-3135-4735-8a69-9d92fa21e99a tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:24.758202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ac9c6928-f4b2-4424-8bcf-1a0716c97772 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:24.767805 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ac9c6928-f4b2-4424-8bcf-1a0716c97772 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1163 microversion: 2.1 time: 0.209776 Aug 02 06:55:24.781646 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1228/2331] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:24 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1163 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:24.798546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab8e1a4b-8283-43f0-99e8-f183e415427b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:24.799416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab8e1a4b-8283-43f0-99e8-f183e415427b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:24.806585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab8e1a4b-8283-43f0-99e8-f183e415427b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:24.807043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab8e1a4b-8283-43f0-99e8-f183e415427b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:24.807830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab8e1a4b-8283-43f0-99e8-f183e415427b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:24.808271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab8e1a4b-8283-43f0-99e8-f183e415427b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:25.296734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e2ef29b5-3135-4735-8a69-9d92fa21e99a tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:25.312452 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e2ef29b5-3135-4735-8a69-9d92fa21e99a tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1322 microversion: 2.1 time: 0.620232 Aug 02 06:55:25.315867 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1104/2332] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:24 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1322 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:25.427627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab8e1a4b-8283-43f0-99e8-f183e415427b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:25.447566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab8e1a4b-8283-43f0-99e8-f183e415427b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:25.449363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab8e1a4b-8283-43f0-99e8-f183e415427b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:25.450807 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab8e1a4b-8283-43f0-99e8-f183e415427b tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 200 len: 1548 microversion: 2.25 time: 0.667907 Aug 02 06:55:25.451857 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1229/2333] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:24 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 1548 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:25.465682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-92467685-ee08-48f5-b3b1-6af2c520284d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:25.467430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-92467685-ee08-48f5-b3b1-6af2c520284d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:25.474975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-92467685-ee08-48f5-b3b1-6af2c520284d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:25.483675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-92467685-ee08-48f5-b3b1-6af2c520284d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:25.484843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-92467685-ee08-48f5-b3b1-6af2c520284d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:25.485468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-92467685-ee08-48f5-b3b1-6af2c520284d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:25.581528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5fb37c54-d85f-47c1-abcc-277ca580c5ad tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-399482068", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:25.586212 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-5fb37c54-d85f-47c1-abcc-277ca580c5ad tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] HTTP exception thrown: min_count must be <= max_count Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5fb37c54-d85f-47c1-abcc-277ca580c5ad tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Request method failure captured: Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 183 Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mpc-JrfBIPcoqQy3v0W0MIDWzJ45Wnz6TW4hzefUFdrGg0J3mgx9NbW4rKAqGsiOo6ilvLLOTz7bu6g9G9BILrMqfCShsfQkVY0rbGHaS5rzUVIF5_VJSVL1zidy2Z4yRR_4uD3z_S-0CB99t45AVcXEufwp963PX87Fpf3QbiQsSs Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a347144e53b94bc2b7d1c0432719bcd4 Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a347144e53b94bc2b7d1c0432719bcd4"}]}] Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a347144e53b94bc2b7d1c0432719bcd4 Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-MultipleCreateNegativeTestJSON-1942434413-project Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: dec3cae1c3c947749bfaf125130e3316 Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1942434413-project Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-399482068", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: exception: min_count must be <= max_count Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-399482068', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 02 06:55:25.589288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:25.593750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5fb37c54-d85f-47c1-abcc-277ca580c5ad tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Returning 400 to user: min_count must be <= max_count {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:25.593750 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5fb37c54-d85f-47c1-abcc-277ca580c5ad tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.271390 Aug 02 06:55:25.593750 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1105/2334] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:55:25 2022] POST /compute/v2.1/servers => generated 74 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 02 06:55:25.628973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-50218480-b9b7-468d-90c5-fa24e7920065 req-4793e81e-8905-4202-9ab0-01a59de58afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27beb807-e873-4cfb-a895-c16a1bd7ad43", "name": "network-vif-deleted", "tag": "d0b0f68c-057f-4516-89ae-466675ea705a"}, {"server_uuid": "d8ae4954-4d53-456f-80b1-ecc81adccdbb", "name": "network-vif-deleted", "tag": "078437fb-a745-4169-b5f1-62422ea79ebf"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:25.649585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-50218480-b9b7-468d-90c5-fa24e7920065 req-4793e81e-8905-4202-9ab0-01a59de58afa service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:25.650275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-50218480-b9b7-468d-90c5-fa24e7920065 req-4793e81e-8905-4202-9ab0-01a59de58afa service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:25.668453 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-50218480-b9b7-468d-90c5-fa24e7920065 req-4793e81e-8905-4202-9ab0-01a59de58afa service nova] Creating event network-vif-deleted:d0b0f68c-057f-4516-89ae-466675ea705a for instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 on n-h1-851337-3 Aug 02 06:55:25.669221 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-50218480-b9b7-468d-90c5-fa24e7920065 req-4793e81e-8905-4202-9ab0-01a59de58afa service nova] Creating event network-vif-deleted:078437fb-a745-4169-b5f1-62422ea79ebf for instance d8ae4954-4d53-456f-80b1-ecc81adccdbb on n-h1-851337-3 Aug 02 06:55:25.679412 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-50218480-b9b7-468d-90c5-fa24e7920065 req-4793e81e-8905-4202-9ab0-01a59de58afa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085826 Aug 02 06:55:25.683402 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1106/2335] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:25.692403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8c3c5eba-a760-455a-8afa-5507c1c55e55 req-9fbcc951-d8d5-475f-8f92-04295b1f7ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9613bb-0914-4f6f-b55c-8c3d990cc2e4", "name": "network-vif-deleted", "tag": "3156e550-5a09-4594-b16e-ac202d43d82a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:25.715131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8c3c5eba-a760-455a-8afa-5507c1c55e55 req-9fbcc951-d8d5-475f-8f92-04295b1f7ad5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:25.717223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8c3c5eba-a760-455a-8afa-5507c1c55e55 req-9fbcc951-d8d5-475f-8f92-04295b1f7ad5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:25.740670 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8c3c5eba-a760-455a-8afa-5507c1c55e55 req-9fbcc951-d8d5-475f-8f92-04295b1f7ad5 service nova] Creating event network-vif-deleted:3156e550-5a09-4594-b16e-ac202d43d82a for instance 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 on n-h2-851337-3 Aug 02 06:55:25.746188 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8c3c5eba-a760-455a-8afa-5507c1c55e55 req-9fbcc951-d8d5-475f-8f92-04295b1f7ad5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061358 Aug 02 06:55:25.747251 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1107/2336] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:25.758667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e3f6dfdf-43e2-4d3a-af47-4d6ad97d22d8 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:25.758667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e3f6dfdf-43e2-4d3a-af47-4d6ad97d22d8 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:25.765854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3f6dfdf-43e2-4d3a-af47-4d6ad97d22d8 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:25.766638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3f6dfdf-43e2-4d3a-af47-4d6ad97d22d8 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:25.767778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3f6dfdf-43e2-4d3a-af47-4d6ad97d22d8 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:25.768413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3f6dfdf-43e2-4d3a-af47-4d6ad97d22d8 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:26.148531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-92467685-ee08-48f5-b3b1-6af2c520284d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:26.157703 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-92467685-ee08-48f5-b3b1-6af2c520284d tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1654 microversion: 2.1 time: 0.704627 Aug 02 06:55:26.158879 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1230/2337] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:25 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1654 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:26.174781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-218ef243-ccad-4b47-b4c6-dc2bfa8138dd tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1890956841", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "max_count": 0}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-218ef243-ccad-4b47-b4c6-dc2bfa8138dd tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Request method failure captured: Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 168 Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mpc-JrfBIPcoqQy3v0W0MIDWzJ45Wnz6TW4hzefUFdrGg0J3mgx9NbW4rKAqGsiOo6ilvLLOTz7bu6g9G9BILrMqfCShsfQkVY0rbGHaS5rzUVIF5_VJSVL1zidy2Z4yRR_4uD3z_S-0CB99t45AVcXEufwp963PX87Fpf3QbiQsSs Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a347144e53b94bc2b7d1c0432719bcd4 Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a347144e53b94bc2b7d1c0432719bcd4"}]}] Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a347144e53b94bc2b7d1c0432719bcd4 Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-MultipleCreateNegativeTestJSON-1942434413-project Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: dec3cae1c3c947749bfaf125130e3316 Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1942434413-project Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1890956841", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "max_count": 0}} Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1890956841', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'max_count': 0}}} Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 0 Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:55:26.180056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 02 06:55:26.184082 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.186552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-218ef243-ccad-4b47-b4c6-dc2bfa8138dd tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:26.187729 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-218ef243-ccad-4b47-b4c6-dc2bfa8138dd tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.027703 Aug 02 06:55:26.189209 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1231/2338] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:55:26 2022] POST /compute/v2.1/servers => generated 130 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:55:26.197864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-788be9b4-a7de-4b13-8a7a-03d0ae06459b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:26.198998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-788be9b4-a7de-4b13-8a7a-03d0ae06459b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:26.220723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-788be9b4-a7de-4b13-8a7a-03d0ae06459b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:26.222521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-788be9b4-a7de-4b13-8a7a-03d0ae06459b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:26.230562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-788be9b4-a7de-4b13-8a7a-03d0ae06459b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:26.232047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-788be9b4-a7de-4b13-8a7a-03d0ae06459b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:26.316634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e3f6dfdf-43e2-4d3a-af47-4d6ad97d22d8 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a743fbc9ca4dc0b07b41b022f8ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c51bd236584003aa9766619deafa2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:26.340613 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e3f6dfdf-43e2-4d3a-af47-4d6ad97d22d8 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 200 len: 1323 microversion: 2.1 time: 0.588862 Aug 02 06:55:26.347240 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1108/2339] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:25 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 1323 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:26.369470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-14ccd833-3642-4313-8691-a74a21140679 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:26.370334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-14ccd833-3642-4313-8691-a74a21140679 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:26.378816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14ccd833-3642-4313-8691-a74a21140679 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:26.379256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14ccd833-3642-4313-8691-a74a21140679 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:26.380199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14ccd833-3642-4313-8691-a74a21140679 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:26.380634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14ccd833-3642-4313-8691-a74a21140679 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:26.532440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-14ccd833-3642-4313-8691-a74a21140679 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:26.541568 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-14ccd833-3642-4313-8691-a74a21140679 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1237 microversion: 2.1 time: 0.189291 Aug 02 06:55:26.544241 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1109/2340] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:26 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1237 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:26.562753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2af65878-360e-45b8-ba87-a8db2206119d tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1126640343", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "max_count": 2.5}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2af65878-360e-45b8-ba87-a8db2206119d tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Request method failure captured: Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 170 Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mpc-JrfBIPcoqQy3v0W0MIDWzJ45Wnz6TW4hzefUFdrGg0J3mgx9NbW4rKAqGsiOo6ilvLLOTz7bu6g9G9BILrMqfCShsfQkVY0rbGHaS5rzUVIF5_VJSVL1zidy2Z4yRR_4uD3z_S-0CB99t45AVcXEufwp963PX87Fpf3QbiQsSs Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a347144e53b94bc2b7d1c0432719bcd4 Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a347144e53b94bc2b7d1c0432719bcd4"}]}] Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a347144e53b94bc2b7d1c0432719bcd4 Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-MultipleCreateNegativeTestJSON-1942434413-project Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: dec3cae1c3c947749bfaf125130e3316 Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1942434413-project Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1126640343", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "max_count": 2.5}} Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1126640343', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'max_count': 2.5}}} Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 2.5 Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:55:26.567600 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 02 06:55:26.571777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.573429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2af65878-360e-45b8-ba87-a8db2206119d tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:26.574472 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2af65878-360e-45b8-ba87-a8db2206119d tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015793 Aug 02 06:55:26.575486 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1110/2341] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:55:26 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:55:26.583520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bedff130-2bd8-4fab-86bd-334f23ec4f81 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:26.586718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bedff130-2bd8-4fab-86bd-334f23ec4f81 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:26.606640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bedff130-2bd8-4fab-86bd-334f23ec4f81 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:26.606874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bedff130-2bd8-4fab-86bd-334f23ec4f81 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:26.610326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bedff130-2bd8-4fab-86bd-334f23ec4f81 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:26.611115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bedff130-2bd8-4fab-86bd-334f23ec4f81 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:26.661629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-788be9b4-a7de-4b13-8a7a-03d0ae06459b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:26.677742 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-788be9b4-a7de-4b13-8a7a-03d0ae06459b tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1307 microversion: 2.1 time: 0.486490 Aug 02 06:55:26.692932 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1232/2342] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:26 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1307 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:26.699021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f9d52af-4f6d-47db-8eca-c8440df98df0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:26.702228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4f9d52af-4f6d-47db-8eca-c8440df98df0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:26.713963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f9d52af-4f6d-47db-8eca-c8440df98df0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:26.714727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f9d52af-4f6d-47db-8eca-c8440df98df0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:26.715829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f9d52af-4f6d-47db-8eca-c8440df98df0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:26.716488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f9d52af-4f6d-47db-8eca-c8440df98df0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:26.748194 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-4f9d52af-4f6d-47db-8eca-c8440df98df0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] HTTP exception thrown: Instance 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 could not be found. Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f9d52af-4f6d-47db-8eca-c8440df98df0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Request method failure captured: Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 HTTP/1.1 Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MiCJxA4LlQuZQL7JgMZLDOG2dPXSgPZAkK6qvQ1nICKODGdO4NzGNYp8xFL0C65eEb0GyIb1yQ9RWXQd23ePaUBkXIkTyKIfG794qyQCwawN5aWJoarkoBvPOID7qY74-FfY3BhzIhEyr67rO9iQxi2WCzluQrr9mJh_RDCnsh2JQM Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.25 Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 28c28ea506a34625bf388395b06b67f5 Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1452829632 Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/28c28ea506a34625bf388395b06b67f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/28c28ea506a34625bf388395b06b67f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_28c28ea506a34625bf388395b06b67f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/28c28ea506a34625bf388395b06b67f5"}]}] Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1452829632 Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 28c28ea506a34625bf388395b06b67f5 Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1452829632 Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-LiveAutoBlockMigrationV225Test-1452829632-project Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a53fed20dabb4e45895da813d4c6538c Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1452829632-project Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 could not be found. Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '6c9613bb-0914-4f6f-b55c-8c3d990cc2e4'} Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 could not be found. Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 could not be found. Aug 02 06:55:26.751953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.756616 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:26.756616 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.756616 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:26.756616 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:26.756616 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:26.756616 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:26.756616 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:26.756616 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 could not be found. Aug 02 06:55:26.756616 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.763559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f9d52af-4f6d-47db-8eca-c8440df98df0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Returning 404 to user: Instance 6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:26.765493 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4f9d52af-4f6d-47db-8eca-c8440df98df0 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4" status: 404 len: 111 microversion: 2.25 time: 0.071386 Aug 02 06:55:26.766414 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1233/2343] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:26 2022] GET /compute/v2.1/servers/6c9613bb-0914-4f6f-b55c-8c3d990cc2e4 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:55:26.771774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-fbe5a55d-ede7-4c6b-bf64-55e42b640f2f req-66c54b2b-efc9-4711-b759-11b4725dfea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046c9460-b404-498d-8cae-05a4b2251d32", "name": "network-vif-plugged", "status": "completed", "tag": "7f8d31f5-4723-4ec2-9785-0a3dac02cdca"}, {"server_uuid": "69b4e83b-99ba-4a5a-bac1-497b2611608d", "name": "network-vif-plugged", "status": "completed", "tag": "4676935b-9f6f-4169-b34f-f21a84f3bfad"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:26.782600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-fbe5a55d-ede7-4c6b-bf64-55e42b640f2f req-66c54b2b-efc9-4711-b759-11b4725dfea8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:26.783045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-fbe5a55d-ede7-4c6b-bf64-55e42b640f2f req-66c54b2b-efc9-4711-b759-11b4725dfea8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:26.798480 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-fbe5a55d-ede7-4c6b-bf64-55e42b640f2f req-66c54b2b-efc9-4711-b759-11b4725dfea8 service nova] Creating event network-vif-plugged:7f8d31f5-4723-4ec2-9785-0a3dac02cdca for instance 046c9460-b404-498d-8cae-05a4b2251d32 on n-h1-851337-3 Aug 02 06:55:26.799249 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-fbe5a55d-ede7-4c6b-bf64-55e42b640f2f req-66c54b2b-efc9-4711-b759-11b4725dfea8 service nova] Creating event network-vif-plugged:4676935b-9f6f-4169-b34f-f21a84f3bfad for instance 69b4e83b-99ba-4a5a-bac1-497b2611608d on n-h2-851337-3 Aug 02 06:55:26.807676 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-fbe5a55d-ede7-4c6b-bf64-55e42b640f2f req-66c54b2b-efc9-4711-b759-11b4725dfea8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039866 Aug 02 06:55:26.808454 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1234/2344] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:26.817785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-73b0c859-8a64-4fca-a1bd-86fac3b98662 tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2044888655", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "min_count": 0}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-73b0c859-8a64-4fca-a1bd-86fac3b98662 tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Request method failure captured: Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 168 Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mpc-JrfBIPcoqQy3v0W0MIDWzJ45Wnz6TW4hzefUFdrGg0J3mgx9NbW4rKAqGsiOo6ilvLLOTz7bu6g9G9BILrMqfCShsfQkVY0rbGHaS5rzUVIF5_VJSVL1zidy2Z4yRR_4uD3z_S-0CB99t45AVcXEufwp963PX87Fpf3QbiQsSs Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a347144e53b94bc2b7d1c0432719bcd4 Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a347144e53b94bc2b7d1c0432719bcd4"}]}] Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a347144e53b94bc2b7d1c0432719bcd4 Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-MultipleCreateNegativeTestJSON-1942434413-project Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: dec3cae1c3c947749bfaf125130e3316 Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1942434413-project Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2044888655", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "min_count": 0}} Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2044888655', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'min_count': 0}}} Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 0 Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:55:26.822417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 02 06:55:26.825922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:26.828600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-73b0c859-8a64-4fca-a1bd-86fac3b98662 tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:26.829870 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-73b0c859-8a64-4fca-a1bd-86fac3b98662 tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016818 Aug 02 06:55:26.830670 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1235/2345] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:55:26 2022] POST /compute/v2.1/servers => generated 130 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:55:26.835466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9f090a05-50b3-4705-b392-ecd6097dc78e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:26.836326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9f090a05-50b3-4705-b392-ecd6097dc78e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:26.862787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f090a05-50b3-4705-b392-ecd6097dc78e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:26.863788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f090a05-50b3-4705-b392-ecd6097dc78e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:26.864964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f090a05-50b3-4705-b392-ecd6097dc78e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:26.865691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f090a05-50b3-4705-b392-ecd6097dc78e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:26.899043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9f090a05-50b3-4705-b392-ecd6097dc78e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:55:27.028396 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9f090a05-50b3-4705-b392-ecd6097dc78e tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 204 len: 0 microversion: 2.25 time: 0.195390 Aug 02 06:55:27.029435 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1236/2346] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:55:26 2022] DELETE /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 06:55:27.037477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cb7a69fd-6d73-466c-9d76-ea0dbaf6b098 tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-467799036", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "min_count": 2.5}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cb7a69fd-6d73-466c-9d76-ea0dbaf6b098 tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Request method failure captured: Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 169 Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mpc-JrfBIPcoqQy3v0W0MIDWzJ45Wnz6TW4hzefUFdrGg0J3mgx9NbW4rKAqGsiOo6ilvLLOTz7bu6g9G9BILrMqfCShsfQkVY0rbGHaS5rzUVIF5_VJSVL1zidy2Z4yRR_4uD3z_S-0CB99t45AVcXEufwp963PX87Fpf3QbiQsSs Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a347144e53b94bc2b7d1c0432719bcd4 Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a347144e53b94bc2b7d1c0432719bcd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a347144e53b94bc2b7d1c0432719bcd4"}]}] Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a347144e53b94bc2b7d1c0432719bcd4 Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1942434413 Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-MultipleCreateNegativeTestJSON-1942434413-project Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: dec3cae1c3c947749bfaf125130e3316 Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1942434413-project Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-467799036", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "min_count": 2.5}} Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-467799036', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'min_count': 2.5}}} Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 2.5 Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 06:55:27.041950 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cb7a69fd-6d73-466c-9d76-ea0dbaf6b098 tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cb7a69fd-6d73-466c-9d76-ea0dbaf6b098 tempest-MultipleCreateNegativeTestJSON-1942434413 tempest-MultipleCreateNegativeTestJSON-1942434413-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011695 Aug 02 06:55:27.046297 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1237/2347] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:55:27 2022] POST /compute/v2.1/servers => generated 139 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:55:27.057762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4a64e182-005e-479e-9ecc-9dc159f48e97 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:27.075234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4a64e182-005e-479e-9ecc-9dc159f48e97 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:27.075234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a64e182-005e-479e-9ecc-9dc159f48e97 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:27.075234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a64e182-005e-479e-9ecc-9dc159f48e97 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:27.075234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a64e182-005e-479e-9ecc-9dc159f48e97 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:27.075234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a64e182-005e-479e-9ecc-9dc159f48e97 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:27.611186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bedff130-2bd8-4fab-86bd-334f23ec4f81 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:27.626572 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bedff130-2bd8-4fab-86bd-334f23ec4f81 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1322 microversion: 2.1 time: 1.049818 Aug 02 06:55:27.627770 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1111/2348] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:26 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1322 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:27.632831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-50bf14c6-8061-4cb7-a71d-3e3e38230aac tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:27.635115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-50bf14c6-8061-4cb7-a71d-3e3e38230aac tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:27.648266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50bf14c6-8061-4cb7-a71d-3e3e38230aac tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:27.648974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50bf14c6-8061-4cb7-a71d-3e3e38230aac tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:27.651795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50bf14c6-8061-4cb7-a71d-3e3e38230aac tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:27.652692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50bf14c6-8061-4cb7-a71d-3e3e38230aac tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:27.726110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50bf14c6-8061-4cb7-a71d-3e3e38230aac tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:27.726798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50bf14c6-8061-4cb7-a71d-3e3e38230aac tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:27.727460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-50bf14c6-8061-4cb7-a71d-3e3e38230aac tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lazy-loading 'fault' on Instance uuid d8ae4954-4d53-456f-80b1-ecc81adccdbb {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:55:27.881798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4a64e182-005e-479e-9ecc-9dc159f48e97 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:27.901477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4a64e182-005e-479e-9ecc-9dc159f48e97 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:27.903028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4a64e182-005e-479e-9ecc-9dc159f48e97 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a53fed20dabb4e45895da813d4c6538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c28ea506a34625bf388395b06b67f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:27.904403 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4a64e182-005e-479e-9ecc-9dc159f48e97 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 200 len: 1564 microversion: 2.25 time: 0.853457 Aug 02 06:55:27.907907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-50bf14c6-8061-4cb7-a71d-3e3e38230aac tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d6484337c84897813ab767ad7d058b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c70f1ab140418e813917aa08d23033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:27.917612 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-50bf14c6-8061-4cb7-a71d-3e3e38230aac tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 200 len: 1303 microversion: 2.1 time: 0.288167 Aug 02 06:55:27.918643 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1238/2349] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:27 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 1564 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:27.923778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ac76211-4b86-444d-bf14-396b5b2f9cc4 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:27.924604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2ac76211-4b86-444d-bf14-396b5b2f9cc4 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:27.933069 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1112/2350] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:27 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 1303 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:27.939344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-37d71aee-911b-492c-b8a4-2237cda302ca tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:27.940319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-37d71aee-911b-492c-b8a4-2237cda302ca tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:27.947242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37d71aee-911b-492c-b8a4-2237cda302ca tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:27.948588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37d71aee-911b-492c-b8a4-2237cda302ca tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:27.950856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37d71aee-911b-492c-b8a4-2237cda302ca tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:27.952011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ac76211-4b86-444d-bf14-396b5b2f9cc4 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:27.952274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37d71aee-911b-492c-b8a4-2237cda302ca tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:27.952651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ac76211-4b86-444d-bf14-396b5b2f9cc4 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:27.953429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ac76211-4b86-444d-bf14-396b5b2f9cc4 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:27.953869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ac76211-4b86-444d-bf14-396b5b2f9cc4 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:28.154338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-37d71aee-911b-492c-b8a4-2237cda302ca tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:28.162694 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-37d71aee-911b-492c-b8a4-2237cda302ca tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1237 microversion: 2.1 time: 0.228279 Aug 02 06:55:28.163378 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1113/2351] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:27 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1237 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:28.168214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-93b1b981-c7ef-4d44-913d-ee3d927e7011 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:28.169083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-93b1b981-c7ef-4d44-913d-ee3d927e7011 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:28.176111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93b1b981-c7ef-4d44-913d-ee3d927e7011 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:28.177016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93b1b981-c7ef-4d44-913d-ee3d927e7011 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:28.177964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93b1b981-c7ef-4d44-913d-ee3d927e7011 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:28.182819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93b1b981-c7ef-4d44-913d-ee3d927e7011 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:28.190302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:28.501588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2ac76211-4b86-444d-bf14-396b5b2f9cc4 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a743fbc9ca4dc0b07b41b022f8ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c51bd236584003aa9766619deafa2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:28.511523 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2ac76211-4b86-444d-bf14-396b5b2f9cc4 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 200 len: 1323 microversion: 2.1 time: 0.591496 Aug 02 06:55:28.518028 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1239/2352] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:27 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 1323 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:28.523973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-3e55f684-a9c2-4fae-b578-e2c0c4a095b6 req-0ecc8373-b61b-4400-acbf-182a532ea7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ae4954-4d53-456f-80b1-ecc81adccdbb", "name": "network-vif-deleted", "tag": "5c31d0c8-2ff2-4fde-b0cf-df3b18f0ca3e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:28.535256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-3e55f684-a9c2-4fae-b578-e2c0c4a095b6 req-0ecc8373-b61b-4400-acbf-182a532ea7e9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:28.535830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-3e55f684-a9c2-4fae-b578-e2c0c4a095b6 req-0ecc8373-b61b-4400-acbf-182a532ea7e9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:28.551635 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-3e55f684-a9c2-4fae-b578-e2c0c4a095b6 req-0ecc8373-b61b-4400-acbf-182a532ea7e9 service nova] Creating event network-vif-deleted:5c31d0c8-2ff2-4fde-b0cf-df3b18f0ca3e for instance d8ae4954-4d53-456f-80b1-ecc81adccdbb on n-h1-851337-3 Aug 02 06:55:28.562384 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-3e55f684-a9c2-4fae-b578-e2c0c4a095b6 req-0ecc8373-b61b-4400-acbf-182a532ea7e9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042522 Aug 02 06:55:28.563750 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1240/2353] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:28.579404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-434013fb-7df1-4ed0-ac4c-fabdeaa1e6a3 req-a5ddbe5e-f8bc-4bfa-9a12-b23950a4e96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3ace8b-df75-4505-b172-20b320c1156b", "name": "network-vif-deleted", "tag": "e5ea5923-841a-4c78-814d-259e79bcfef7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:28.590112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-434013fb-7df1-4ed0-ac4c-fabdeaa1e6a3 req-a5ddbe5e-f8bc-4bfa-9a12-b23950a4e96a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:28.590809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-434013fb-7df1-4ed0-ac4c-fabdeaa1e6a3 req-a5ddbe5e-f8bc-4bfa-9a12-b23950a4e96a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:28.602763 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-434013fb-7df1-4ed0-ac4c-fabdeaa1e6a3 req-a5ddbe5e-f8bc-4bfa-9a12-b23950a4e96a service nova] Creating event network-vif-deleted:e5ea5923-841a-4c78-814d-259e79bcfef7 for instance 0a3ace8b-df75-4505-b172-20b320c1156b on n-h2-851337-3 Aug 02 06:55:28.608231 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-434013fb-7df1-4ed0-ac4c-fabdeaa1e6a3 req-a5ddbe5e-f8bc-4bfa-9a12-b23950a4e96a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042662 Aug 02 06:55:28.609191 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1241/2354] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:28.614680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b8d3d1c5-d4d3-4cbd-9510-a7f8cfcbca2d tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:28.621232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8d3d1c5-d4d3-4cbd-9510-a7f8cfcbca2d tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:28.621685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8d3d1c5-d4d3-4cbd-9510-a7f8cfcbca2d tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:28.625723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:28.646285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-93b1b981-c7ef-4d44-913d-ee3d927e7011 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:28.646977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b8d3d1c5-d4d3-4cbd-9510-a7f8cfcbca2d tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Going to try to stop instance {{(pid=126120) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 06:55:28.662266 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-93b1b981-c7ef-4d44-913d-ee3d927e7011 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1307 microversion: 2.1 time: 0.497605 Aug 02 06:55:28.664192 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1114/2355] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:28 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1307 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:28.670800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d7007edc-333b-4466-b100-57fa3b2514a5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:28.671648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d7007edc-333b-4466-b100-57fa3b2514a5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:28.674907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:28.679595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7007edc-333b-4466-b100-57fa3b2514a5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:28.680222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7007edc-333b-4466-b100-57fa3b2514a5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:28.681139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7007edc-333b-4466-b100-57fa3b2514a5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:28.682948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7007edc-333b-4466-b100-57fa3b2514a5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:28.726933 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b8d3d1c5-d4d3-4cbd-9510-a7f8cfcbca2d tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "POST /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/action" status: 202 len: 0 microversion: 2.1 time: 0.116334 Aug 02 06:55:28.728156 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1242/2356] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:55:28 2022] POST /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:55:28.737272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-794d23f3-14e3-4eac-bb82-b255f07be9c9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:28.738249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-794d23f3-14e3-4eac-bb82-b255f07be9c9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:28.745395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-794d23f3-14e3-4eac-bb82-b255f07be9c9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:28.745918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-794d23f3-14e3-4eac-bb82-b255f07be9c9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:28.746772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-794d23f3-14e3-4eac-bb82-b255f07be9c9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:28.747271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-794d23f3-14e3-4eac-bb82-b255f07be9c9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:29.172962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-794d23f3-14e3-4eac-bb82-b255f07be9c9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:29.185702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d7007edc-333b-4466-b100-57fa3b2514a5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:29.194845 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-794d23f3-14e3-4eac-bb82-b255f07be9c9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1724 microversion: 2.1 time: 0.462633 Aug 02 06:55:29.195808 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d7007edc-333b-4466-b100-57fa3b2514a5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1322 microversion: 2.1 time: 0.529531 Aug 02 06:55:29.206354 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1243/2357] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:28 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1724 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:55:29.208213 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1115/2358] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:28 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:29.219893 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2aab1c92-ee3c-47cd-9407-2b1d047b3486 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:29.220859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2aab1c92-ee3c-47cd-9407-2b1d047b3486 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:29.235962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f8f87352-b1c4-4c9c-b904-1fb8514a0e92 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:29.236933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f8f87352-b1c4-4c9c-b904-1fb8514a0e92 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] [instance: 0a3ace8b-df75-4505-b172-20b320c1156b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:29.244627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2aab1c92-ee3c-47cd-9407-2b1d047b3486 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:29.245092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2aab1c92-ee3c-47cd-9407-2b1d047b3486 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:29.245885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2aab1c92-ee3c-47cd-9407-2b1d047b3486 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:29.246498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2aab1c92-ee3c-47cd-9407-2b1d047b3486 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:29.250551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f8f87352-b1c4-4c9c-b904-1fb8514a0e92 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:29.252165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f8f87352-b1c4-4c9c-b904-1fb8514a0e92 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:29.253511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f8f87352-b1c4-4c9c-b904-1fb8514a0e92 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:29.254495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f8f87352-b1c4-4c9c-b904-1fb8514a0e92 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:29.289357 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-f8f87352-b1c4-4c9c-b904-1fb8514a0e92 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] HTTP exception thrown: Instance 0a3ace8b-df75-4505-b172-20b320c1156b could not be found. Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f8f87352-b1c4-4c9c-b904-1fb8514a0e92 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Request method failure captured: Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b HTTP/1.1 Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MiCJxA4LlQuZQL7JgMZLDOG2dPXSgPZAkK6qvQ1nICKODGdO4NzGNYp8xFL0C65eEb0GyIb1yQ9RWXQd23ePaUBkXIkTyKIfG794qyQCwawN5aWJoarkoBvPOID7qY74-FfY3BhzIhEyr67rO9iQxi2WCzluQrr9mJh_RDCnsh2JQM Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Openstack-Nova-Api-Version: 2.25 Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 28c28ea506a34625bf388395b06b67f5 Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1452829632 Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/28c28ea506a34625bf388395b06b67f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/28c28ea506a34625bf388395b06b67f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_28c28ea506a34625bf388395b06b67f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/28c28ea506a34625bf388395b06b67f5"}]}] Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1452829632 Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 28c28ea506a34625bf388395b06b67f5 Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1452829632 Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-LiveAutoBlockMigrationV225Test-1452829632-project Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: a53fed20dabb4e45895da813d4c6538c Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1452829632-project Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 0a3ace8b-df75-4505-b172-20b320c1156b could not be found. Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '0a3ace8b-df75-4505-b172-20b320c1156b'} Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a3ace8b-df75-4505-b172-20b320c1156b could not be found. Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a3ace8b-df75-4505-b172-20b320c1156b could not be found. Aug 02 06:55:29.291369 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:29.295756 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:29.295756 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:29.295756 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:29.295756 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:29.295756 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:29.295756 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:29.295756 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:29.295756 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a3ace8b-df75-4505-b172-20b320c1156b could not be found. Aug 02 06:55:29.295756 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:29.308177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f8f87352-b1c4-4c9c-b904-1fb8514a0e92 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] Returning 404 to user: Instance 0a3ace8b-df75-4505-b172-20b320c1156b could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:29.308410 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-2aab1c92-ee3c-47cd-9407-2b1d047b3486 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] HTTP exception thrown: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:29.309539 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f8f87352-b1c4-4c9c-b904-1fb8514a0e92 tempest-LiveAutoBlockMigrationV225Test-1452829632 tempest-LiveAutoBlockMigrationV225Test-1452829632-project] 10.222.0.79 "GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b" status: 404 len: 111 microversion: 2.25 time: 0.094876 Aug 02 06:55:29.310365 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1116/2359] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:29 2022] GET /compute/v2.1/servers/0a3ace8b-df75-4505-b172-20b320c1156b => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2aab1c92-ee3c-47cd-9407-2b1d047b3486 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Request method failure captured: Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb HTTP/1.1 Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MnkSplIqiTShUeULuW9ojtK5Rt70xlSaP1csO2PNoBZ69-dXwhPa1ENkGZARrBLww2eUvEj77SS6gecRtwtBF0dajz1kxTfx1z1yVOm_R28SM3i4wnbQCZu55bC5SZzEK5KXjNKokmz7j2KqIQtG4edxg-gJKW5ylj5oL9jTCClCy4 Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 76c70f1ab140418e813917aa08d23033 Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/76c70f1ab140418e813917aa08d23033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76c70f1ab140418e813917aa08d23033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_76c70f1ab140418e813917aa08d23033"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76c70f1ab140418e813917aa08d23033"}]}] Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 76c70f1ab140418e813917aa08d23033 Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestMultiNic-657139817-project Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a4d6484337c84897813ab767ad7d058b Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestMultiNic-657139817-project Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'd8ae4954-4d53-456f-80b1-ecc81adccdbb'} Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:29.310470 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:29.315118 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:29.315118 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:29.315118 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:29.315118 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:29.315118 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:29.315118 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:29.315118 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:29.315118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2aab1c92-ee3c-47cd-9407-2b1d047b3486 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Returning 404 to user: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:29.315118 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2aab1c92-ee3c-47cd-9407-2b1d047b3486 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 404 len: 111 microversion: 2.1 time: 0.114661 Aug 02 06:55:29.321918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d2a92a3e-8bc7-4a77-b4a6-20d66e9130ba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:29.323277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d2a92a3e-8bc7-4a77-b4a6-20d66e9130ba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:29.324589 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1244/2360] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:29 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:55:29.331983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2a92a3e-8bc7-4a77-b4a6-20d66e9130ba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:29.332409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2a92a3e-8bc7-4a77-b4a6-20d66e9130ba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:29.333154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2a92a3e-8bc7-4a77-b4a6-20d66e9130ba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:29.333590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2a92a3e-8bc7-4a77-b4a6-20d66e9130ba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:29.541266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-834026b1-680b-4537-9bd6-a664adb21b5f tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:29.542108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-834026b1-680b-4537-9bd6-a664adb21b5f tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:29.560791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-834026b1-680b-4537-9bd6-a664adb21b5f tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:29.561427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-834026b1-680b-4537-9bd6-a664adb21b5f tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:29.562558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-834026b1-680b-4537-9bd6-a664adb21b5f tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:29.563232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-834026b1-680b-4537-9bd6-a664adb21b5f tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:29.864503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d2a92a3e-8bc7-4a77-b4a6-20d66e9130ba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:29.875026 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d2a92a3e-8bc7-4a77-b4a6-20d66e9130ba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1305 microversion: 2.1 time: 0.556833 Aug 02 06:55:29.876909 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1117/2361] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:29 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1305 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:29.894030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a4a3c29e-ebbc-46bd-9204-aa51c0f46b99 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:29.894694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a4a3c29e-ebbc-46bd-9204-aa51c0f46b99 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:29.903285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4a3c29e-ebbc-46bd-9204-aa51c0f46b99 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:29.903750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4a3c29e-ebbc-46bd-9204-aa51c0f46b99 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:29.904682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4a3c29e-ebbc-46bd-9204-aa51c0f46b99 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:29.905061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4a3c29e-ebbc-46bd-9204-aa51c0f46b99 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:30.317790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-834026b1-680b-4537-9bd6-a664adb21b5f tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a743fbc9ca4dc0b07b41b022f8ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c51bd236584003aa9766619deafa2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:30.333009 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-834026b1-680b-4537-9bd6-a664adb21b5f tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 200 len: 1473 microversion: 2.1 time: 0.796293 Aug 02 06:55:30.354598 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1245/2362] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:29 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 1473 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:30.581818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-2123030374", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": "none"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:30.666628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:55:30.667048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:55:30.667515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:55:30.667919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:55:30.668327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:55:30.696190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:30.696812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:30.697765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:30.698375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:30.700796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a4a3c29e-ebbc-46bd-9204-aa51c0f46b99 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:30.709618 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a4a3c29e-ebbc-46bd-9204-aa51c0f46b99 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1307 microversion: 2.1 time: 0.831624 Aug 02 06:55:30.726046 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1118/2363] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:29 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1307 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:30.734077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cf5b0b50-a390-46a8-a446-9294324f5447 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:30.735185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cf5b0b50-a390-46a8-a446-9294324f5447 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:30.743455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf5b0b50-a390-46a8-a446-9294324f5447 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:30.744157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf5b0b50-a390-46a8-a446-9294324f5447 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:30.745715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf5b0b50-a390-46a8-a446-9294324f5447 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:30.746378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf5b0b50-a390-46a8-a446-9294324f5447 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:30.755303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Getting quotas for project fa57214fe4884c30b76bc22ce457c98d. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:55:30.772210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Getting quotas for user 9150a20234494548aeb0450c3bb36005 and project fa57214fe4884c30b76bc22ce457c98d. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:55:30.807232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:55:30.814020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:55:30.910016 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-393c084a-9455-448d-ad0f-345e4ac3a097 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.553079 Aug 02 06:55:30.917442 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1246/2364] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 06:55:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 06:55:30.922994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-11b63ebe-699b-4040-9ad4-e3cc4eb709e0 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:30.923855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-11b63ebe-699b-4040-9ad4-e3cc4eb709e0 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:30.930675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11b63ebe-699b-4040-9ad4-e3cc4eb709e0 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:30.931388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11b63ebe-699b-4040-9ad4-e3cc4eb709e0 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:30.932347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11b63ebe-699b-4040-9ad4-e3cc4eb709e0 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:30.932978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11b63ebe-699b-4040-9ad4-e3cc4eb709e0 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:31.259131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-11b63ebe-699b-4040-9ad4-e3cc4eb709e0 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:31.270322 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-11b63ebe-699b-4040-9ad4-e3cc4eb709e0 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1517 microversion: 2.1 time: 0.351329 Aug 02 06:55:31.286049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cf5b0b50-a390-46a8-a446-9294324f5447 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:31.288213 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1247/2365] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:30 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1517 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:31.290443 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cf5b0b50-a390-46a8-a446-9294324f5447 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1724 microversion: 2.1 time: 0.559767 Aug 02 06:55:31.293618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02fec56f-2bb2-497c-9f0e-8e6b3bdbf30e tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:31.293775 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1119/2366] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:30 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1724 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:31.294173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-02fec56f-2bb2-497c-9f0e-8e6b3bdbf30e tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:31.300927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02fec56f-2bb2-497c-9f0e-8e6b3bdbf30e tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:31.301375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02fec56f-2bb2-497c-9f0e-8e6b3bdbf30e tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:31.302197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02fec56f-2bb2-497c-9f0e-8e6b3bdbf30e tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:31.302799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02fec56f-2bb2-497c-9f0e-8e6b3bdbf30e tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:31.309372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-64f5788b-66ed-40d9-8b64-3d2525aa393d req-717741eb-b762-4fa9-ade3-11c64d522e41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c00361-60fe-435b-833b-44a0cddbc4db", "tag": "def1d1d8-4436-4f04-bec4-5ad8acc4c80e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:31.326514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-64f5788b-66ed-40d9-8b64-3d2525aa393d req-717741eb-b762-4fa9-ade3-11c64d522e41 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:31.327047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-64f5788b-66ed-40d9-8b64-3d2525aa393d req-717741eb-b762-4fa9-ade3-11c64d522e41 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:31.333626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-02fec56f-2bb2-497c-9f0e-8e6b3bdbf30e tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '78a743fbc9ca4dc0b07b41b022f8ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c51bd236584003aa9766619deafa2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02fec56f-2bb2-497c-9f0e-8e6b3bdbf30e tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Request method failure captured: Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d/diagnostics HTTP/1.1 Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mo9yu_yD_lx1HVrZVTgdpkjxsTcD_QHhbMa_ZB51541N6Ye3CSX8hhHNMHv-PZl9naKbrUG8Kai7fQXQrHoTRtVVyp7FMd2tdJg06I2in430A4dWEtOzchJ831xpkIQRzwzBmmQVgPPwUVjK5_6p1HrswUwP8UZ14qmQh0SRR89QlE Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 52c51bd236584003aa9766619deafa2a Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1510473667 Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/52c51bd236584003aa9766619deafa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/52c51bd236584003aa9766619deafa2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_52c51bd236584003aa9766619deafa2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/52c51bd236584003aa9766619deafa2a"}]}] Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1510473667 Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 52c51bd236584003aa9766619deafa2a Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1510473667 Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerDiagnosticsNegativeTest-1510473667-project Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 78a743fbc9ca4dc0b07b41b022f8ebd2 Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1510473667-project Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'server_id': '69b4e83b-99ba-4a5a-bac1-497b2611608d'} Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise self.value Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:31.344169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:31.348469 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:31.348469 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:31.348469 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 02 06:55:31.348469 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 02 06:55:31.348469 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 02 06:55:31.348469 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:31.349942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02fec56f-2bb2-497c-9f0e-8e6b3bdbf30e tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:31.351697 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-02fec56f-2bb2-497c-9f0e-8e6b3bdbf30e tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.062286 Aug 02 06:55:31.352481 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1248/2367] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:55:31 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d/diagnostics => generated 117 bytes in 64 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:55:31.370370 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1e261400-469e-4976-a945-bae3d7b3284b tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:31.371033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1e261400-469e-4976-a945-bae3d7b3284b tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:31.379042 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-64f5788b-66ed-40d9-8b64-3d2525aa393d req-717741eb-b762-4fa9-ade3-11c64d522e41 service nova] Creating event network-changed:def1d1d8-4436-4f04-bec4-5ad8acc4c80e for instance 98c00361-60fe-435b-833b-44a0cddbc4db on n-h2-851337-3 Aug 02 06:55:31.385348 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-64f5788b-66ed-40d9-8b64-3d2525aa393d req-717741eb-b762-4fa9-ade3-11c64d522e41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090194 Aug 02 06:55:31.386808 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1120/2368] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:31.392847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-06c6e611-b2ec-4611-882c-89ae30349471 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:31.393099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e261400-469e-4976-a945-bae3d7b3284b tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:31.393935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-06c6e611-b2ec-4611-882c-89ae30349471 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:31.396104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e261400-469e-4976-a945-bae3d7b3284b tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:31.399353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e261400-469e-4976-a945-bae3d7b3284b tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:31.403941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e261400-469e-4976-a945-bae3d7b3284b tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:31.490045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-06c6e611-b2ec-4611-882c-89ae30349471 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:31.497629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-06c6e611-b2ec-4611-882c-89ae30349471 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:31.499251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-06c6e611-b2ec-4611-882c-89ae30349471 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:31.514944 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-06c6e611-b2ec-4611-882c-89ae30349471 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1278 microversion: 2.54 time: 0.126512 Aug 02 06:55:31.530291 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1121/2369] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:31 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1278 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:31.536999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f3f4afd6-1d30-4022-8ff8-fb578d9bc6b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:31.540123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f3f4afd6-1d30-4022-8ff8-fb578d9bc6b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:31.551744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3f4afd6-1d30-4022-8ff8-fb578d9bc6b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:31.552183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3f4afd6-1d30-4022-8ff8-fb578d9bc6b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:31.552965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3f4afd6-1d30-4022-8ff8-fb578d9bc6b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:31.553393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3f4afd6-1d30-4022-8ff8-fb578d9bc6b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:31.593631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-f3f4afd6-1d30-4022-8ff8-fb578d9bc6b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lazy-loading 'flavor' on Instance uuid 046c9460-b404-498d-8cae-05a4b2251d32 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:55:31.719751 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f3f4afd6-1d30-4022-8ff8-fb578d9bc6b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "POST /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32/action" status: 200 len: 32 microversion: 2.1 time: 0.187515 Aug 02 06:55:31.721298 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1122/2370] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:55:31 2022] POST /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:55:31.731059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-757c19a7-b6bb-4420-9801-227532b7532a tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:31.732114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-757c19a7-b6bb-4420-9801-227532b7532a tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:31.741339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-757c19a7-b6bb-4420-9801-227532b7532a tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:31.742963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-757c19a7-b6bb-4420-9801-227532b7532a tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:31.744632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-757c19a7-b6bb-4420-9801-227532b7532a tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:31.745468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-757c19a7-b6bb-4420-9801-227532b7532a tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:31.789683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1e261400-469e-4976-a945-bae3d7b3284b tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:31.801252 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1e261400-469e-4976-a945-bae3d7b3284b tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1305 microversion: 2.1 time: 0.447533 Aug 02 06:55:31.806331 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1249/2371] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:31 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1305 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:31.815985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-951579a6-157f-4975-aded-877ede508603 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:31.818117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-951579a6-157f-4975-aded-877ede508603 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:31.826805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-951579a6-157f-4975-aded-877ede508603 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:31.827479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-951579a6-157f-4975-aded-877ede508603 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:31.828529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-951579a6-157f-4975-aded-877ede508603 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:31.829141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-951579a6-157f-4975-aded-877ede508603 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:31.834745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-757c19a7-b6bb-4420-9801-227532b7532a tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:55:31.960096 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-757c19a7-b6bb-4420-9801-227532b7532a tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "DELETE /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 204 len: 0 microversion: 2.1 time: 0.235840 Aug 02 06:55:31.961365 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1123/2372] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:55:31 2022] DELETE /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:55:31.969647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-082ca79b-cb56-4a6a-9c9a-17fea52351bd tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:31.970907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-082ca79b-cb56-4a6a-9c9a-17fea52351bd tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:31.979338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-082ca79b-cb56-4a6a-9c9a-17fea52351bd tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:31.980383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-082ca79b-cb56-4a6a-9c9a-17fea52351bd tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:31.981379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-082ca79b-cb56-4a6a-9c9a-17fea52351bd tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:31.981813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-082ca79b-cb56-4a6a-9c9a-17fea52351bd tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:32.775747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-951579a6-157f-4975-aded-877ede508603 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:32.790286 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-951579a6-157f-4975-aded-877ede508603 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.981843 Aug 02 06:55:32.804679 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1250/2373] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:31 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:32.810445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bf07f950-332a-4fd4-9f30-2da48404eace tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:32.811633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bf07f950-332a-4fd4-9f30-2da48404eace tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:32.818960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf07f950-332a-4fd4-9f30-2da48404eace tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:32.820334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf07f950-332a-4fd4-9f30-2da48404eace tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:32.821402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf07f950-332a-4fd4-9f30-2da48404eace tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:32.822078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf07f950-332a-4fd4-9f30-2da48404eace tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:32.836434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-082ca79b-cb56-4a6a-9c9a-17fea52351bd tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:32.847160 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-082ca79b-cb56-4a6a-9c9a-17fea52351bd tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1307 microversion: 2.1 time: 0.884457 Aug 02 06:55:32.862252 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1124/2374] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:31 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1307 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:32.871318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3ef851f3-d88f-4bba-a33a-c50e66e08074 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:32.871942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3ef851f3-d88f-4bba-a33a-c50e66e08074 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:32.891393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ef851f3-d88f-4bba-a33a-c50e66e08074 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:32.892300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ef851f3-d88f-4bba-a33a-c50e66e08074 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:32.894911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ef851f3-d88f-4bba-a33a-c50e66e08074 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:32.896231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ef851f3-d88f-4bba-a33a-c50e66e08074 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:33.372397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bf07f950-332a-4fd4-9f30-2da48404eace tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a743fbc9ca4dc0b07b41b022f8ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c51bd236584003aa9766619deafa2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:33.383482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3ef851f3-d88f-4bba-a33a-c50e66e08074 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:33.385289 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bf07f950-332a-4fd4-9f30-2da48404eace tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 200 len: 1479 microversion: 2.1 time: 0.578833 Aug 02 06:55:33.393348 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1251/2375] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:32 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 1479 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:33.403720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a9581613-91cb-47bb-8758-f664d851d638 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:33.404674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a9581613-91cb-47bb-8758-f664d851d638 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:33.409861 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3ef851f3-d88f-4bba-a33a-c50e66e08074 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1724 microversion: 2.1 time: 0.544044 Aug 02 06:55:33.410816 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1125/2376] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:32 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1724 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:33.413677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9581613-91cb-47bb-8758-f664d851d638 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:33.414112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9581613-91cb-47bb-8758-f664d851d638 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:33.414918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9581613-91cb-47bb-8758-f664d851d638 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:33.421144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9581613-91cb-47bb-8758-f664d851d638 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:33.432796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4a4eb913-2b1a-480b-ae52-7f815de3b6c2 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:33.433526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4a4eb913-2b1a-480b-ae52-7f815de3b6c2 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:33.443370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a4eb913-2b1a-480b-ae52-7f815de3b6c2 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:33.444639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a4eb913-2b1a-480b-ae52-7f815de3b6c2 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:33.445604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a4eb913-2b1a-480b-ae52-7f815de3b6c2 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:33.446470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a4eb913-2b1a-480b-ae52-7f815de3b6c2 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:33.555619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a9581613-91cb-47bb-8758-f664d851d638 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:33.566553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a9581613-91cb-47bb-8758-f664d851d638 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:33.568132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a9581613-91cb-47bb-8758-f664d851d638 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:33.569311 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a9581613-91cb-47bb-8758-f664d851d638 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1330 microversion: 2.54 time: 0.174676 Aug 02 06:55:33.569873 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1252/2377] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:33 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1330 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:33.580285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-8068c3cb-dde2-4670-8e0f-4238b932c5b8 req-e9cf0672-b52c-4b88-b938-4698f7b84070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c66c14da-356f-4545-830d-93f43f602ca2", "tag": "623de687-c25c-4a70-8b03-fe1359eeddb6"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:33.590365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8068c3cb-dde2-4670-8e0f-4238b932c5b8 req-e9cf0672-b52c-4b88-b938-4698f7b84070 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:33.590810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8068c3cb-dde2-4670-8e0f-4238b932c5b8 req-e9cf0672-b52c-4b88-b938-4698f7b84070 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:33.608364 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-8068c3cb-dde2-4670-8e0f-4238b932c5b8 req-e9cf0672-b52c-4b88-b938-4698f7b84070 service nova] Creating event network-changed:623de687-c25c-4a70-8b03-fe1359eeddb6 for instance c66c14da-356f-4545-830d-93f43f602ca2 on n-h1-851337-3 Aug 02 06:55:33.618521 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-8068c3cb-dde2-4670-8e0f-4238b932c5b8 req-e9cf0672-b52c-4b88-b938-4698f7b84070 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046440 Aug 02 06:55:33.619753 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1253/2378] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:33.638358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4a4eb913-2b1a-480b-ae52-7f815de3b6c2 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:33.646750 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4a4eb913-2b1a-480b-ae52-7f815de3b6c2 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1293 microversion: 2.1 time: 0.233750 Aug 02 06:55:33.647529 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1126/2379] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:33 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1293 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:33.812389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0fae57ab-50e5-441c-954b-d6c6856932f7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:33.813422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0fae57ab-50e5-441c-954b-d6c6856932f7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:33.829124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0fae57ab-50e5-441c-954b-d6c6856932f7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:33.829827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0fae57ab-50e5-441c-954b-d6c6856932f7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:33.830800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0fae57ab-50e5-441c-954b-d6c6856932f7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:33.831390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0fae57ab-50e5-441c-954b-d6c6856932f7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:33.879453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e1f79e45-61f1-45a4-bdfb-1062bb5bf0ee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:33.885459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e1f79e45-61f1-45a4-bdfb-1062bb5bf0ee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:33.913625 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1f79e45-61f1-45a4-bdfb-1062bb5bf0ee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:33.914248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1f79e45-61f1-45a4-bdfb-1062bb5bf0ee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:33.915130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1f79e45-61f1-45a4-bdfb-1062bb5bf0ee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:33.915660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1f79e45-61f1-45a4-bdfb-1062bb5bf0ee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:34.316503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0fae57ab-50e5-441c-954b-d6c6856932f7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:34.321222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e1f79e45-61f1-45a4-bdfb-1062bb5bf0ee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:34.335361 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e1f79e45-61f1-45a4-bdfb-1062bb5bf0ee tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1307 microversion: 2.1 time: 0.470822 Aug 02 06:55:34.336930 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1127/2380] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:33 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1307 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:34.359789 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0fae57ab-50e5-441c-954b-d6c6856932f7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.551788 Aug 02 06:55:34.360443 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1254/2381] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:33 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:34.408036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-642a4d99-b119-4ca8-a36f-b8c29782b707 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:34.408745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-642a4d99-b119-4ca8-a36f-b8c29782b707 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:34.421349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-642a4d99-b119-4ca8-a36f-b8c29782b707 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:34.422261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-642a4d99-b119-4ca8-a36f-b8c29782b707 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:34.423407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-642a4d99-b119-4ca8-a36f-b8c29782b707 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:34.424171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-642a4d99-b119-4ca8-a36f-b8c29782b707 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:34.431927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c68508b2-c21e-4ca8-8cc5-ed9eb8d71380 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:34.432572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c68508b2-c21e-4ca8-8cc5-ed9eb8d71380 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:34.447917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c68508b2-c21e-4ca8-8cc5-ed9eb8d71380 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:34.448371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c68508b2-c21e-4ca8-8cc5-ed9eb8d71380 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:34.449161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c68508b2-c21e-4ca8-8cc5-ed9eb8d71380 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:34.449596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c68508b2-c21e-4ca8-8cc5-ed9eb8d71380 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.016696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c68508b2-c21e-4ca8-8cc5-ed9eb8d71380 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:35.037615 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c68508b2-c21e-4ca8-8cc5-ed9eb8d71380 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1724 microversion: 2.1 time: 0.609427 Aug 02 06:55:35.042758 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1255/2382] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:34 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1724 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:35.059375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a85bb2ad-9c4d-41ad-bda6-de9d58a13aee tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:35.060573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a85bb2ad-9c4d-41ad-bda6-de9d58a13aee tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:35.069976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-642a4d99-b119-4ca8-a36f-b8c29782b707 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a743fbc9ca4dc0b07b41b022f8ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c51bd236584003aa9766619deafa2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:35.083401 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-642a4d99-b119-4ca8-a36f-b8c29782b707 tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 200 len: 1479 microversion: 2.1 time: 0.679778 Aug 02 06:55:35.084910 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1128/2383] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:34 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 1479 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:35.091924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dc284ec7-84ee-4a4e-8bc5-4dddfc00153a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:35.092871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dc284ec7-84ee-4a4e-8bc5-4dddfc00153a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:35.099090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a85bb2ad-9c4d-41ad-bda6-de9d58a13aee tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.099549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a85bb2ad-9c4d-41ad-bda6-de9d58a13aee tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.100340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a85bb2ad-9c4d-41ad-bda6-de9d58a13aee tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.102922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc284ec7-84ee-4a4e-8bc5-4dddfc00153a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.103860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc284ec7-84ee-4a4e-8bc5-4dddfc00153a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.105046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a85bb2ad-9c4d-41ad-bda6-de9d58a13aee tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.105494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc284ec7-84ee-4a4e-8bc5-4dddfc00153a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.106445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc284ec7-84ee-4a4e-8bc5-4dddfc00153a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.135028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:35.295201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a85bb2ad-9c4d-41ad-bda6-de9d58a13aee tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:35.303734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a85bb2ad-9c4d-41ad-bda6-de9d58a13aee tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:35.305247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a85bb2ad-9c4d-41ad-bda6-de9d58a13aee tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:35.306436 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a85bb2ad-9c4d-41ad-bda6-de9d58a13aee tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1336 microversion: 2.54 time: 0.262606 Aug 02 06:55:35.307018 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1256/2384] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:35 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1336 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:35.311483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4c10dcb2-3418-4cbe-9f15-46327544c729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:35.311966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4c10dcb2-3418-4cbe-9f15-46327544c729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:35.315464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:35.319305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c10dcb2-3418-4cbe-9f15-46327544c729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.319772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c10dcb2-3418-4cbe-9f15-46327544c729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.320530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c10dcb2-3418-4cbe-9f15-46327544c729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.321142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c10dcb2-3418-4cbe-9f15-46327544c729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.337199 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-4c10dcb2-3418-4cbe-9f15-46327544c729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] HTTP exception thrown: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4c10dcb2-3418-4cbe-9f15-46327544c729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Request method failure captured: Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb HTTP/1.1 Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MnkSplIqiTShUeULuW9ojtK5Rt70xlSaP1csO2PNoBZ69-dXwhPa1ENkGZARrBLww2eUvEj77SS6gecRtwtBF0dajz1kxTfx1z1yVOm_R28SM3i4wnbQCZu55bC5SZzEK5KXjNKokmz7j2KqIQtG4edxg-gJKW5ylj5oL9jTCClCy4 Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 76c70f1ab140418e813917aa08d23033 Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/76c70f1ab140418e813917aa08d23033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76c70f1ab140418e813917aa08d23033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_76c70f1ab140418e813917aa08d23033"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76c70f1ab140418e813917aa08d23033"}]}] Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 76c70f1ab140418e813917aa08d23033 Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestMultiNic-657139817-project Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a4d6484337c84897813ab767ad7d058b Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestMultiNic-657139817-project Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'd8ae4954-4d53-456f-80b1-ecc81adccdbb'} Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:35.339057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:35.343169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:35.343169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.343169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:35.343169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.343169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:35.343169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:35.343169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:35.343169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:35.343169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:35.343169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:35.343169 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.343169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4c10dcb2-3418-4cbe-9f15-46327544c729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Returning 404 to user: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:35.343169 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4c10dcb2-3418-4cbe-9f15-46327544c729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 404 len: 111 microversion: 2.1 time: 0.032659 Aug 02 06:55:35.343169 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1257/2385] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:55:35 2022] DELETE /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:55:35.347291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-d9eab6da-0443-4333-92fd-6731ca51cb29 req-efd6b30a-9e6a-47ce-98e8-dc31c286289f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b4e83b-99ba-4a5a-bac1-497b2611608d", "name": "network-vif-deleted", "tag": "4676935b-9f6f-4169-b34f-f21a84f3bfad"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:35.361204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d9eab6da-0443-4333-92fd-6731ca51cb29 req-efd6b30a-9e6a-47ce-98e8-dc31c286289f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.361651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d9eab6da-0443-4333-92fd-6731ca51cb29 req-efd6b30a-9e6a-47ce-98e8-dc31c286289f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.374101 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-d9eab6da-0443-4333-92fd-6731ca51cb29 req-efd6b30a-9e6a-47ce-98e8-dc31c286289f service nova] Creating event network-vif-deleted:4676935b-9f6f-4169-b34f-f21a84f3bfad for instance 69b4e83b-99ba-4a5a-bac1-497b2611608d on n-h2-851337-3 Aug 02 06:55:35.379705 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-d9eab6da-0443-4333-92fd-6731ca51cb29 req-efd6b30a-9e6a-47ce-98e8-dc31c286289f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036452 Aug 02 06:55:35.380731 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1258/2386] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:35.387848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-489d9e19-40dc-4bde-b27f-8afa0f47ae72 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:35.388811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-489d9e19-40dc-4bde-b27f-8afa0f47ae72 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: d8ae4954-4d53-456f-80b1-ecc81adccdbb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:35.397071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-489d9e19-40dc-4bde-b27f-8afa0f47ae72 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.397668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-489d9e19-40dc-4bde-b27f-8afa0f47ae72 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.398457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-489d9e19-40dc-4bde-b27f-8afa0f47ae72 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.399183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-489d9e19-40dc-4bde-b27f-8afa0f47ae72 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.418456 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-489d9e19-40dc-4bde-b27f-8afa0f47ae72 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] HTTP exception thrown: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-489d9e19-40dc-4bde-b27f-8afa0f47ae72 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Request method failure captured: Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb HTTP/1.1 Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MnkSplIqiTShUeULuW9ojtK5Rt70xlSaP1csO2PNoBZ69-dXwhPa1ENkGZARrBLww2eUvEj77SS6gecRtwtBF0dajz1kxTfx1z1yVOm_R28SM3i4wnbQCZu55bC5SZzEK5KXjNKokmz7j2KqIQtG4edxg-gJKW5ylj5oL9jTCClCy4 Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 76c70f1ab140418e813917aa08d23033 Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/76c70f1ab140418e813917aa08d23033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76c70f1ab140418e813917aa08d23033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_76c70f1ab140418e813917aa08d23033"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76c70f1ab140418e813917aa08d23033"}]}] Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 76c70f1ab140418e813917aa08d23033 Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestMultiNic-657139817-project Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a4d6484337c84897813ab767ad7d058b Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestMultiNic-657139817-project Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'd8ae4954-4d53-456f-80b1-ecc81adccdbb'} Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:35.420178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.423954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:35.423954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:35.423954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:35.423954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:35.423954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:35.423954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. Aug 02 06:55:35.423954 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.423954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-489d9e19-40dc-4bde-b27f-8afa0f47ae72 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Returning 404 to user: Instance d8ae4954-4d53-456f-80b1-ecc81adccdbb could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:35.423954 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-489d9e19-40dc-4bde-b27f-8afa0f47ae72 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb" status: 404 len: 111 microversion: 2.1 time: 0.039565 Aug 02 06:55:35.423954 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1259/2387] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:35 2022] GET /compute/v2.1/servers/d8ae4954-4d53-456f-80b1-ecc81adccdbb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:55:35.428574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b373358e-bfe9-4861-a318-68eecb52f72a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:35.428662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b373358e-bfe9-4861-a318-68eecb52f72a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:35.435716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b373358e-bfe9-4861-a318-68eecb52f72a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.436222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b373358e-bfe9-4861-a318-68eecb52f72a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.437005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b373358e-bfe9-4861-a318-68eecb52f72a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.437442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b373358e-bfe9-4861-a318-68eecb52f72a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.550272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dc284ec7-84ee-4a4e-8bc5-4dddfc00153a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:35.558949 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dc284ec7-84ee-4a4e-8bc5-4dddfc00153a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1293 microversion: 2.1 time: 0.471787 Aug 02 06:55:35.579651 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1129/2388] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:35 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1293 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:35.587282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-347233a5-76f3-4bdd-b02e-3f1d474c2f41 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:35.588163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-347233a5-76f3-4bdd-b02e-3f1d474c2f41 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:35.597791 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-347233a5-76f3-4bdd-b02e-3f1d474c2f41 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.598424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-347233a5-76f3-4bdd-b02e-3f1d474c2f41 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.599280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-347233a5-76f3-4bdd-b02e-3f1d474c2f41 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.599931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-347233a5-76f3-4bdd-b02e-3f1d474c2f41 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.722905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b373358e-bfe9-4861-a318-68eecb52f72a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:35.741633 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b373358e-bfe9-4861-a318-68eecb52f72a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1307 microversion: 2.1 time: 0.317934 Aug 02 06:55:35.742570 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1260/2389] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:35 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1307 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:35.747623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e68f7383-97b0-480a-82ca-0dd84be77e8f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:35.748341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e68f7383-97b0-480a-82ca-0dd84be77e8f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:35.756995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e68f7383-97b0-480a-82ca-0dd84be77e8f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.757624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e68f7383-97b0-480a-82ca-0dd84be77e8f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.758868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e68f7383-97b0-480a-82ca-0dd84be77e8f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.759520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e68f7383-97b0-480a-82ca-0dd84be77e8f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.781145 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-e68f7383-97b0-480a-82ca-0dd84be77e8f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] HTTP exception thrown: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e68f7383-97b0-480a-82ca-0dd84be77e8f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Request method failure captured: Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf HTTP/1.1 Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MnkSplIqiTShUeULuW9ojtK5Rt70xlSaP1csO2PNoBZ69-dXwhPa1ENkGZARrBLww2eUvEj77SS6gecRtwtBF0dajz1kxTfx1z1yVOm_R28SM3i4wnbQCZu55bC5SZzEK5KXjNKokmz7j2KqIQtG4edxg-gJKW5ylj5oL9jTCClCy4 Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 76c70f1ab140418e813917aa08d23033 Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/76c70f1ab140418e813917aa08d23033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76c70f1ab140418e813917aa08d23033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_76c70f1ab140418e813917aa08d23033"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76c70f1ab140418e813917aa08d23033"}]}] Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 76c70f1ab140418e813917aa08d23033 Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestMultiNic-657139817-project Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a4d6484337c84897813ab767ad7d058b Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestMultiNic-657139817-project Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'ea28a98b-bb58-40e2-8a62-635a752c0ecf'} Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:35.783581 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:35.787658 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:55:35.787658 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.787658 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:35.787658 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.787658 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:35.787658 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:35.787658 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:35.787658 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:35.787658 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:35.787658 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:55:35.787658 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.789495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e68f7383-97b0-480a-82ca-0dd84be77e8f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Returning 404 to user: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:35.791224 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e68f7383-97b0-480a-82ca-0dd84be77e8f tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 404 len: 111 microversion: 2.1 time: 0.046844 Aug 02 06:55:35.792443 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1261/2390] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:55:35 2022] DELETE /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:55:35.801426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a6851f95-853d-4c5d-91de-767a355eb729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:35.802221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a6851f95-853d-4c5d-91de-767a355eb729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] [instance: ea28a98b-bb58-40e2-8a62-635a752c0ecf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:35.817925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6851f95-853d-4c5d-91de-767a355eb729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.819040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6851f95-853d-4c5d-91de-767a355eb729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.820305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6851f95-853d-4c5d-91de-767a355eb729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:35.821192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6851f95-853d-4c5d-91de-767a355eb729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:35.842330 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-a6851f95-853d-4c5d-91de-767a355eb729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] HTTP exception thrown: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a6851f95-853d-4c5d-91de-767a355eb729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Request method failure captured: Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf HTTP/1.1 Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MnkSplIqiTShUeULuW9ojtK5Rt70xlSaP1csO2PNoBZ69-dXwhPa1ENkGZARrBLww2eUvEj77SS6gecRtwtBF0dajz1kxTfx1z1yVOm_R28SM3i4wnbQCZu55bC5SZzEK5KXjNKokmz7j2KqIQtG4edxg-gJKW5ylj5oL9jTCClCy4 Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 76c70f1ab140418e813917aa08d23033 Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/76c70f1ab140418e813917aa08d23033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76c70f1ab140418e813917aa08d23033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_76c70f1ab140418e813917aa08d23033"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76c70f1ab140418e813917aa08d23033"}]}] Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 76c70f1ab140418e813917aa08d23033 Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestMultiNic-657139817 Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestMultiNic-657139817-project Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a4d6484337c84897813ab767ad7d058b Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestMultiNic-657139817-project Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'ea28a98b-bb58-40e2-8a62-635a752c0ecf'} Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:35.844292 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.848052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:35.848052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:35.848052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:35.848052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:35.848052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:35.848052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. Aug 02 06:55:35.848052 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:35.848052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a6851f95-853d-4c5d-91de-767a355eb729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] Returning 404 to user: Instance ea28a98b-bb58-40e2-8a62-635a752c0ecf could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:35.848679 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a6851f95-853d-4c5d-91de-767a355eb729 tempest-ServersTestMultiNic-657139817 tempest-ServersTestMultiNic-657139817-project] 10.222.0.79 "GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf" status: 404 len: 111 microversion: 2.1 time: 0.051433 Aug 02 06:55:35.849405 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1262/2391] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:35 2022] GET /compute/v2.1/servers/ea28a98b-bb58-40e2-8a62-635a752c0ecf => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:55:35.977613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-347233a5-76f3-4bdd-b02e-3f1d474c2f41 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:35.990582 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-347233a5-76f3-4bdd-b02e-3f1d474c2f41 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.407348 Aug 02 06:55:35.995005 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1130/2392] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:35 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:36.085982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-d8a96bf7-7282-4fcb-970e-6dbd99e4b3b4 req-4c62a1c8-bba2-4f42-90be-928edf3ac915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c00361-60fe-435b-833b-44a0cddbc4db", "name": "network-vif-plugged", "status": "completed", "tag": "def1d1d8-4436-4f04-bec4-5ad8acc4c80e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:36.087456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-142684bd-ef81-4a0c-9a4f-b74d556d6beb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:36.089668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-142684bd-ef81-4a0c-9a4f-b74d556d6beb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:36.119914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-142684bd-ef81-4a0c-9a4f-b74d556d6beb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:36.124387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-142684bd-ef81-4a0c-9a4f-b74d556d6beb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:36.126588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-142684bd-ef81-4a0c-9a4f-b74d556d6beb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:36.127169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-142684bd-ef81-4a0c-9a4f-b74d556d6beb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:36.128542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d8a96bf7-7282-4fcb-970e-6dbd99e4b3b4 req-4c62a1c8-bba2-4f42-90be-928edf3ac915 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:36.131746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d8a96bf7-7282-4fcb-970e-6dbd99e4b3b4 req-4c62a1c8-bba2-4f42-90be-928edf3ac915 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:36.177286 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-d8a96bf7-7282-4fcb-970e-6dbd99e4b3b4 req-4c62a1c8-bba2-4f42-90be-928edf3ac915 service nova] Creating event network-vif-plugged:def1d1d8-4436-4f04-bec4-5ad8acc4c80e for instance 98c00361-60fe-435b-833b-44a0cddbc4db on n-h2-851337-3 Aug 02 06:55:36.197260 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-d8a96bf7-7282-4fcb-970e-6dbd99e4b3b4 req-4c62a1c8-bba2-4f42-90be-928edf3ac915 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141015 Aug 02 06:55:36.197929 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1131/2393] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:36.219237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:36.227940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34fd3e9d-8664-4b2f-9922-3de34353be5d tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:36.234149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-34fd3e9d-8664-4b2f-9922-3de34353be5d tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] [instance: 69b4e83b-99ba-4a5a-bac1-497b2611608d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:36.273376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34fd3e9d-8664-4b2f-9922-3de34353be5d tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:36.278174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34fd3e9d-8664-4b2f-9922-3de34353be5d tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:36.279391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34fd3e9d-8664-4b2f-9922-3de34353be5d tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:36.280123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34fd3e9d-8664-4b2f-9922-3de34353be5d tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:36.322574 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-34fd3e9d-8664-4b2f-9922-3de34353be5d tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] HTTP exception thrown: Instance 69b4e83b-99ba-4a5a-bac1-497b2611608d could not be found. Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34fd3e9d-8664-4b2f-9922-3de34353be5d tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Request method failure captured: Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d HTTP/1.1 Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mo9yu_yD_lx1HVrZVTgdpkjxsTcD_QHhbMa_ZB51541N6Ye3CSX8hhHNMHv-PZl9naKbrUG8Kai7fQXQrHoTRtVVyp7FMd2tdJg06I2in430A4dWEtOzchJ831xpkIQRzwzBmmQVgPPwUVjK5_6p1HrswUwP8UZ14qmQh0SRR89QlE Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 52c51bd236584003aa9766619deafa2a Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1510473667 Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/52c51bd236584003aa9766619deafa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/52c51bd236584003aa9766619deafa2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_52c51bd236584003aa9766619deafa2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/52c51bd236584003aa9766619deafa2a"}]}] Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1510473667 Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 52c51bd236584003aa9766619deafa2a Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1510473667 Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerDiagnosticsNegativeTest-1510473667-project Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 78a743fbc9ca4dc0b07b41b022f8ebd2 Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1510473667-project Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 69b4e83b-99ba-4a5a-bac1-497b2611608d could not be found. Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '69b4e83b-99ba-4a5a-bac1-497b2611608d'} Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b4e83b-99ba-4a5a-bac1-497b2611608d could not be found. Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b4e83b-99ba-4a5a-bac1-497b2611608d could not be found. Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:36.324529 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:36.328936 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:36.328936 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:36.328936 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:36.328936 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:36.328936 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:36.328936 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:36.328936 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b4e83b-99ba-4a5a-bac1-497b2611608d could not be found. Aug 02 06:55:36.328936 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:36.328936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34fd3e9d-8664-4b2f-9922-3de34353be5d tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] Returning 404 to user: Instance 69b4e83b-99ba-4a5a-bac1-497b2611608d could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:36.328936 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-34fd3e9d-8664-4b2f-9922-3de34353be5d tempest-ServerDiagnosticsNegativeTest-1510473667 tempest-ServerDiagnosticsNegativeTest-1510473667-project] 10.222.0.79 "GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d" status: 404 len: 111 microversion: 2.1 time: 0.120231 Aug 02 06:55:36.332627 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1132/2394] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:36 2022] GET /compute/v2.1/servers/69b4e83b-99ba-4a5a-bac1-497b2611608d => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:55:36.341022 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ff37b105-d101-4d78-9ae5-cdccc9b42280 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:36.345769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ff37b105-d101-4d78-9ae5-cdccc9b42280 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:36.356880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff37b105-d101-4d78-9ae5-cdccc9b42280 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:36.357876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff37b105-d101-4d78-9ae5-cdccc9b42280 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:36.358899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff37b105-d101-4d78-9ae5-cdccc9b42280 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:36.359416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff37b105-d101-4d78-9ae5-cdccc9b42280 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:36.548368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ff37b105-d101-4d78-9ae5-cdccc9b42280 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:36.562982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ff37b105-d101-4d78-9ae5-cdccc9b42280 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:36.564651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ff37b105-d101-4d78-9ae5-cdccc9b42280 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:36.567485 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ff37b105-d101-4d78-9ae5-cdccc9b42280 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1357 microversion: 2.54 time: 0.236013 Aug 02 06:55:36.568096 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1133/2395] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:36 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:36.595157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d3d03c14-87c2-463a-bd2b-54b6dde260ea tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:36.596029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d3d03c14-87c2-463a-bd2b-54b6dde260ea tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:36.605738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d3d03c14-87c2-463a-bd2b-54b6dde260ea tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:36.606615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d3d03c14-87c2-463a-bd2b-54b6dde260ea tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:36.607694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d3d03c14-87c2-463a-bd2b-54b6dde260ea tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:36.608628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d3d03c14-87c2-463a-bd2b-54b6dde260ea tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:36.724094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-142684bd-ef81-4a0c-9a4f-b74d556d6beb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:36.733274 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-142684bd-ef81-4a0c-9a4f-b74d556d6beb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1724 microversion: 2.1 time: 0.676002 Aug 02 06:55:36.747373 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1263/2396] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:36 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1724 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:36.752740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cf12e0f2-c1a4-4f16-8af6-e141505f5393 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Action: 'create', calling method: .version_select at 0x7f927a810310>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-2094760971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcsdu4jW+otUBaGsoTtHXqTf1yoteTIzym2O2l+sVXXbovii43UPR93KD5IkfaRqiUWuW6afpmTKOm75m1Qy9Vq3AnPf1+836c0Hqr6i7VNUCk38eqPFXbZFTRurwA14Q=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:36.772511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-cf12e0f2-c1a4-4f16-8af6-e141505f5393 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Getting quotas for project fa57214fe4884c30b76bc22ce457c98d. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:55:36.777683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-cf12e0f2-c1a4-4f16-8af6-e141505f5393 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Getting quotas for user 9150a20234494548aeb0450c3bb36005 and project fa57214fe4884c30b76bc22ce457c98d. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:55:36.803416 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cf12e0f2-c1a4-4f16-8af6-e141505f5393 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.054496 Aug 02 06:55:36.803995 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1264/2397] 10.222.0.79 () {62 vars in 1200 bytes} [Tue Aug 2 06:55:36 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 06:55:36.808882 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-58523dbc-a23d-4fe0-92bf-b308c7cca038 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:36.809566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-58523dbc-a23d-4fe0-92bf-b308c7cca038 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:36.828797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58523dbc-a23d-4fe0-92bf-b308c7cca038 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:36.829254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58523dbc-a23d-4fe0-92bf-b308c7cca038 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:36.830095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58523dbc-a23d-4fe0-92bf-b308c7cca038 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:36.830520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58523dbc-a23d-4fe0-92bf-b308c7cca038 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:36.880827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d3d03c14-87c2-463a-bd2b-54b6dde260ea tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:36.892206 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d3d03c14-87c2-463a-bd2b-54b6dde260ea tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1293 microversion: 2.1 time: 0.310237 Aug 02 06:55:36.892789 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1134/2398] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:36 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1293 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:36.902171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-2094760971", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:36.914760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:36.926199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:36.926896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:36.927823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:36.928619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:37.021442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:55:37.021442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:55:37.021442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:55:37.021442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:55:37.021840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:55:37.107044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:37.115177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:37.115855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:37.117703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:37.118370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:37.168299 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-412beef6-9431-453b-8fd2-42e111954107 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "POST /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29/action" status: 202 len: 1140 microversion: 2.54 time: 0.273523 Aug 02 06:55:37.169153 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1135/2399] 10.222.0.79 () {62 vars in 1320 bytes} [Tue Aug 2 06:55:36 2022] POST /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29/action => generated 1140 bytes in 275 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 02 06:55:37.169822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-58523dbc-a23d-4fe0-92bf-b308c7cca038 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:37.174965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6bb77877-d0ac-472e-addb-8073e8040e69 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:37.176067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6bb77877-d0ac-472e-addb-8073e8040e69 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:37.177412 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-58523dbc-a23d-4fe0-92bf-b308c7cca038 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1307 microversion: 2.1 time: 0.372399 Aug 02 06:55:37.181615 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1265/2400] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:36 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1307 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:37.188187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1b137f5d-b73e-46ba-b455-6dbf96b8ac57 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:37.189221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6bb77877-d0ac-472e-addb-8073e8040e69 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:37.190142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6bb77877-d0ac-472e-addb-8073e8040e69 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:37.191180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6bb77877-d0ac-472e-addb-8073e8040e69 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:37.191839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6bb77877-d0ac-472e-addb-8073e8040e69 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:37.193910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1b137f5d-b73e-46ba-b455-6dbf96b8ac57 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:37.200553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b137f5d-b73e-46ba-b455-6dbf96b8ac57 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:37.201005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b137f5d-b73e-46ba-b455-6dbf96b8ac57 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:37.206973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b137f5d-b73e-46ba-b455-6dbf96b8ac57 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:37.207601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b137f5d-b73e-46ba-b455-6dbf96b8ac57 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:37.316909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1b137f5d-b73e-46ba-b455-6dbf96b8ac57 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:37.326236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1b137f5d-b73e-46ba-b455-6dbf96b8ac57 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:37.328740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1b137f5d-b73e-46ba-b455-6dbf96b8ac57 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:37.330291 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1b137f5d-b73e-46ba-b455-6dbf96b8ac57 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.145698 Aug 02 06:55:37.331056 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1266/2401] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:37 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:37.455764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6bb77877-d0ac-472e-addb-8073e8040e69 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:37.473487 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6bb77877-d0ac-472e-addb-8073e8040e69 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.302278 Aug 02 06:55:37.493072 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1136/2402] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:37 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:37.756724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-497f0ce6-879b-4fec-8c08-a3a3a63f9681 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:37.758570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-497f0ce6-879b-4fec-8c08-a3a3a63f9681 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:37.770446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-497f0ce6-879b-4fec-8c08-a3a3a63f9681 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:37.771743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-497f0ce6-879b-4fec-8c08-a3a3a63f9681 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:37.773766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-497f0ce6-879b-4fec-8c08-a3a3a63f9681 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:37.774628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-497f0ce6-879b-4fec-8c08-a3a3a63f9681 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:37.913078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2bcffca5-a007-45cd-91f5-059d78dd02e5 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:37.913701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2bcffca5-a007-45cd-91f5-059d78dd02e5 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:37.929690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2bcffca5-a007-45cd-91f5-059d78dd02e5 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:37.930169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2bcffca5-a007-45cd-91f5-059d78dd02e5 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:37.930974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2bcffca5-a007-45cd-91f5-059d78dd02e5 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:37.931402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2bcffca5-a007-45cd-91f5-059d78dd02e5 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:38.167665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-497f0ce6-879b-4fec-8c08-a3a3a63f9681 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:38.176774 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-497f0ce6-879b-4fec-8c08-a3a3a63f9681 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1724 microversion: 2.1 time: 0.425488 Aug 02 06:55:38.190412 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1267/2403] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:37 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1724 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:38.198412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-023a5011-1fe8-421d-9357-749df79b88d8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:38.199249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-023a5011-1fe8-421d-9357-749df79b88d8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:38.205914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-023a5011-1fe8-421d-9357-749df79b88d8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:38.206556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-023a5011-1fe8-421d-9357-749df79b88d8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:38.207480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-023a5011-1fe8-421d-9357-749df79b88d8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:38.208052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-023a5011-1fe8-421d-9357-749df79b88d8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:38.332428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2bcffca5-a007-45cd-91f5-059d78dd02e5 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:38.353674 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2bcffca5-a007-45cd-91f5-059d78dd02e5 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1293 microversion: 2.1 time: 0.444624 Aug 02 06:55:38.358823 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1137/2404] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:37 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1293 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:38.367646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-217f82c1-5bdb-49ad-9edb-f29853716e95 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:38.370146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-217f82c1-5bdb-49ad-9edb-f29853716e95 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:38.377557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-217f82c1-5bdb-49ad-9edb-f29853716e95 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:38.378670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-217f82c1-5bdb-49ad-9edb-f29853716e95 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:38.379665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-217f82c1-5bdb-49ad-9edb-f29853716e95 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:38.380310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-217f82c1-5bdb-49ad-9edb-f29853716e95 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:38.527411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-217f82c1-5bdb-49ad-9edb-f29853716e95 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:38.537389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-217f82c1-5bdb-49ad-9edb-f29853716e95 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:38.539689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-217f82c1-5bdb-49ad-9edb-f29853716e95 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:38.541379 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-217f82c1-5bdb-49ad-9edb-f29853716e95 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.184984 Aug 02 06:55:38.552097 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1138/2405] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:38 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:38.563961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb3c2aaf-5079-44c9-8902-2e4614a928d1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:38.564955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cb3c2aaf-5079-44c9-8902-2e4614a928d1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:38.571608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-023a5011-1fe8-421d-9357-749df79b88d8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:38.572745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb3c2aaf-5079-44c9-8902-2e4614a928d1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:38.573263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb3c2aaf-5079-44c9-8902-2e4614a928d1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:38.574148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb3c2aaf-5079-44c9-8902-2e4614a928d1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:38.574877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb3c2aaf-5079-44c9-8902-2e4614a928d1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:38.579351 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-023a5011-1fe8-421d-9357-749df79b88d8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1488 microversion: 2.1 time: 0.384793 Aug 02 06:55:38.594356 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1268/2406] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:38 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1488 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:38.600507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6cfd6839-7e5c-4a42-93e7-c7f5e6008b72 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1379916970"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:38.603150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6cfd6839-7e5c-4a42-93e7-c7f5e6008b72 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:38.609519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6cfd6839-7e5c-4a42-93e7-c7f5e6008b72 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:38.610233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6cfd6839-7e5c-4a42-93e7-c7f5e6008b72 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:38.611146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6cfd6839-7e5c-4a42-93e7-c7f5e6008b72 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:38.611721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6cfd6839-7e5c-4a42-93e7-c7f5e6008b72 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:38.864527 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6cfd6839-7e5c-4a42-93e7-c7f5e6008b72 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "POST /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db/action" status: 202 len: 0 microversion: 2.1 time: 0.267685 Aug 02 06:55:38.865532 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1269/2407] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:55:38 2022] POST /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 02 06:55:38.877589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-67af2f22-a70d-449d-95cd-6d04b700d58a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a80ff70>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:39.008054 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-67af2f22-a70d-449d-95cd-6d04b700d58a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/dc6a9e8a-5e42-4a6a-bcf2-3592340c4942" status: 200 len: 1414 microversion: 2.1 time: 0.133670 Aug 02 06:55:39.011151 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1270/2408] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:55:38 2022] GET /compute/v2.1/images/dc6a9e8a-5e42-4a6a-bcf2-3592340c4942 => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:39.028616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cc9b4b08-3d2c-4b2e-9c75-f53a40fac5a7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a810820>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:39.110241 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cc9b4b08-3d2c-4b2e-9c75-f53a40fac5a7 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/dc6a9e8a-5e42-4a6a-bcf2-3592340c4942" status: 200 len: 1414 microversion: 2.1 time: 0.089225 Aug 02 06:55:39.112226 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1271/2409] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:55:39 2022] GET /compute/v2.1/images/dc6a9e8a-5e42-4a6a-bcf2-3592340c4942 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:55:39.126562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5c62b850-ba2b-4155-95de-521fa52a0b35 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a7583a0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:39.144728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cb3c2aaf-5079-44c9-8902-2e4614a928d1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:39.152752 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cb3c2aaf-5079-44c9-8902-2e4614a928d1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.597993 Aug 02 06:55:39.170657 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1139/2410] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:38 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:39.199694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-be7b24d8-fce1-46e0-a1c1-d8827a760360 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:39.200885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-be7b24d8-fce1-46e0-a1c1-d8827a760360 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:39.210620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be7b24d8-fce1-46e0-a1c1-d8827a760360 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:39.214597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be7b24d8-fce1-46e0-a1c1-d8827a760360 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:39.216114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be7b24d8-fce1-46e0-a1c1-d8827a760360 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:39.218910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be7b24d8-fce1-46e0-a1c1-d8827a760360 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:39.413908 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5c62b850-ba2b-4155-95de-521fa52a0b35 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/images/dc6a9e8a-5e42-4a6a-bcf2-3592340c4942" status: 204 len: 0 microversion: 2.1 time: 0.293606 Aug 02 06:55:39.414815 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1272/2411] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:39 2022] DELETE /compute/v2.1/images/dc6a9e8a-5e42-4a6a-bcf2-3592340c4942 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 06:55:39.422133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c9c14606-dbab-43ca-b219-ad2bf2835faf tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:39.423207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c9c14606-dbab-43ca-b219-ad2bf2835faf tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:39.438304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9c14606-dbab-43ca-b219-ad2bf2835faf tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:39.438776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9c14606-dbab-43ca-b219-ad2bf2835faf tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:39.439633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9c14606-dbab-43ca-b219-ad2bf2835faf tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:39.440066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9c14606-dbab-43ca-b219-ad2bf2835faf tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:39.685390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-be7b24d8-fce1-46e0-a1c1-d8827a760360 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:39.697123 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-be7b24d8-fce1-46e0-a1c1-d8827a760360 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1724 microversion: 2.1 time: 0.501214 Aug 02 06:55:39.698061 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1140/2412] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:39 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1724 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:39.702668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-90035976-f762-4903-b3b6-df2489da6a9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927abdce50>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:39.739223 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-90035976-f762-4903-b3b6-df2489da6a9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] HTTP exception thrown: Image not found. Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-90035976-f762-4903-b3b6-df2489da6a9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Request method failure captured: Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/images/dc6a9e8a-5e42-4a6a-bcf2-3592340c4942 HTTP/1.1 Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmFBMbDPWlrXqv5WHrBzHESi-aCp6ZSL-MPW7oksJIFc52eVMg4OFupUZietKB8DWW2-CTOlJ9jvWoU9xEAO_UYFzUQHnk0KXINIlNifawrKVIqlAAIZCLUxLf7DyKhP-XiYe1bGZLmfIH3Qc-TPq-81M5czwG23YFaQx84KcSrz7M Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}] Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 793620d46a6c42fb955f1fe5075b040b Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: exception: Image not found. Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'dc6a9e8a-5e42-4a6a-bcf2-3592340c4942'} Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dc6a9e8a-5e42-4a6a-bcf2-3592340c4942 Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 02 06:55:39.745989 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dc6a9e8a-5e42-4a6a-bcf2-3592340c4942 could not be found. Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:55:39.751336 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:39.761399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-90035976-f762-4903-b3b6-df2489da6a9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Returning 404 to user: Image not found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:39.762376 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-90035976-f762-4903-b3b6-df2489da6a9a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/images/dc6a9e8a-5e42-4a6a-bcf2-3592340c4942" status: 404 len: 62 microversion: 2.1 time: 0.063229 Aug 02 06:55:39.763371 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1141/2413] 10.222.0.79 () {58 vars in 1233 bytes} [Tue Aug 2 06:55:39 2022] GET /compute/v2.1/images/dc6a9e8a-5e42-4a6a-bcf2-3592340c4942 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:55:39.776978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f9e6af08-1d4a-4f93-a59a-fc977110dc59 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:39.777178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c9c14606-dbab-43ca-b219-ad2bf2835faf tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:39.778012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f9e6af08-1d4a-4f93-a59a-fc977110dc59 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:39.786182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9e6af08-1d4a-4f93-a59a-fc977110dc59 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:39.786795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9e6af08-1d4a-4f93-a59a-fc977110dc59 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:39.787740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9e6af08-1d4a-4f93-a59a-fc977110dc59 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:39.788329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9e6af08-1d4a-4f93-a59a-fc977110dc59 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:39.788526 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c9c14606-dbab-43ca-b219-ad2bf2835faf tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1293 microversion: 2.1 time: 0.372568 Aug 02 06:55:39.791083 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1273/2414] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:39 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1293 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:39.796828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-91291adf-227e-4a30-bdb6-028f20b3b892 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:39.798159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-91291adf-227e-4a30-bdb6-028f20b3b892 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:39.821516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91291adf-227e-4a30-bdb6-028f20b3b892 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:39.822012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91291adf-227e-4a30-bdb6-028f20b3b892 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:39.827166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91291adf-227e-4a30-bdb6-028f20b3b892 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:39.827669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91291adf-227e-4a30-bdb6-028f20b3b892 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:39.876015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f9e6af08-1d4a-4f93-a59a-fc977110dc59 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:39.884771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f9e6af08-1d4a-4f93-a59a-fc977110dc59 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:39.886286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f9e6af08-1d4a-4f93-a59a-fc977110dc59 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:39.887476 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f9e6af08-1d4a-4f93-a59a-fc977110dc59 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.123009 Aug 02 06:55:39.888039 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1142/2415] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:39 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:40.183851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85ae6f08-39a7-4fb0-a0d6-ab232aaf8c8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:40.184761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-85ae6f08-39a7-4fb0-a0d6-ab232aaf8c8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:40.194165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85ae6f08-39a7-4fb0-a0d6-ab232aaf8c8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:40.195010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85ae6f08-39a7-4fb0-a0d6-ab232aaf8c8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:40.196945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85ae6f08-39a7-4fb0-a0d6-ab232aaf8c8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:40.197607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85ae6f08-39a7-4fb0-a0d6-ab232aaf8c8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:40.254314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-91291adf-227e-4a30-bdb6-028f20b3b892 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:40.269741 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-91291adf-227e-4a30-bdb6-028f20b3b892 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1500 microversion: 2.1 time: 0.477432 Aug 02 06:55:40.270684 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1274/2416] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:39 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1500 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:40.451246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-85ae6f08-39a7-4fb0-a0d6-ab232aaf8c8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:40.474805 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-85ae6f08-39a7-4fb0-a0d6-ab232aaf8c8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.295579 Aug 02 06:55:40.486358 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1143/2417] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:40 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:55:40.725870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c21f2d47-c55e-451a-a3f5-a8650ef6da55 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:40.731131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c21f2d47-c55e-451a-a3f5-a8650ef6da55 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:40.745481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:40.776421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c21f2d47-c55e-451a-a3f5-a8650ef6da55 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:40.776971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c21f2d47-c55e-451a-a3f5-a8650ef6da55 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:40.783107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c21f2d47-c55e-451a-a3f5-a8650ef6da55 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:40.787769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c21f2d47-c55e-451a-a3f5-a8650ef6da55 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:40.811583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-480b3317-620b-44cf-b25d-68c6fb1a0cba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:40.812479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-480b3317-620b-44cf-b25d-68c6fb1a0cba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:40.824461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-480b3317-620b-44cf-b25d-68c6fb1a0cba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:40.826499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-480b3317-620b-44cf-b25d-68c6fb1a0cba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:40.830462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-480b3317-620b-44cf-b25d-68c6fb1a0cba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:40.831094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-480b3317-620b-44cf-b25d-68c6fb1a0cba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:41.497423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:41.560601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-480b3317-620b-44cf-b25d-68c6fb1a0cba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:41.570531 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-480b3317-620b-44cf-b25d-68c6fb1a0cba tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1293 microversion: 2.1 time: 0.765342 Aug 02 06:55:41.571251 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1144/2418] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:40 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1293 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:41.591211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1d1f98b8-8df2-480e-9c05-cdbf84ecd966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:41.591812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1d1f98b8-8df2-480e-9c05-cdbf84ecd966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:41.599263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d1f98b8-8df2-480e-9c05-cdbf84ecd966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:41.599688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d1f98b8-8df2-480e-9c05-cdbf84ecd966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:41.600476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d1f98b8-8df2-480e-9c05-cdbf84ecd966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:41.600908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d1f98b8-8df2-480e-9c05-cdbf84ecd966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:41.664540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c21f2d47-c55e-451a-a3f5-a8650ef6da55 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:41.675351 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c21f2d47-c55e-451a-a3f5-a8650ef6da55 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1724 microversion: 2.1 time: 0.955563 Aug 02 06:55:41.675855 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1275/2419] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:40 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1724 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:41.682053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bdb31751-fc80-42c9-a275-99a4fb67e90a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:41.682716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bdb31751-fc80-42c9-a275-99a4fb67e90a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:41.689780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdb31751-fc80-42c9-a275-99a4fb67e90a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:41.690247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdb31751-fc80-42c9-a275-99a4fb67e90a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:41.691230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdb31751-fc80-42c9-a275-99a4fb67e90a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:41.691951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdb31751-fc80-42c9-a275-99a4fb67e90a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:41.693861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1d1f98b8-8df2-480e-9c05-cdbf84ecd966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:41.725603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1d1f98b8-8df2-480e-9c05-cdbf84ecd966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:41.727393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1d1f98b8-8df2-480e-9c05-cdbf84ecd966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:41.728617 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1d1f98b8-8df2-480e-9c05-cdbf84ecd966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.141424 Aug 02 06:55:41.729236 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1145/2420] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:41 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:41.753591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-61e9caf9-3dba-46c8-bd30-6e6e793d3533 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:41.754258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-61e9caf9-3dba-46c8-bd30-6e6e793d3533 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:41.767470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61e9caf9-3dba-46c8-bd30-6e6e793d3533 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:41.771557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61e9caf9-3dba-46c8-bd30-6e6e793d3533 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:41.772437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61e9caf9-3dba-46c8-bd30-6e6e793d3533 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:41.773400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61e9caf9-3dba-46c8-bd30-6e6e793d3533 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:41.778656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:42.122720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bdb31751-fc80-42c9-a275-99a4fb67e90a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:42.134375 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bdb31751-fc80-42c9-a275-99a4fb67e90a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1506 microversion: 2.1 time: 0.456350 Aug 02 06:55:42.134965 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1276/2421] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:41 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:42.166009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-61e9caf9-3dba-46c8-bd30-6e6e793d3533 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:42.177073 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-61e9caf9-3dba-46c8-bd30-6e6e793d3533 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.436019 Aug 02 06:55:42.181135 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1146/2422] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:41 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:42.592107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f9c786cb-5832-48a0-8f84-bf863aaae033 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:42.592741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f9c786cb-5832-48a0-8f84-bf863aaae033 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:42.601325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9c786cb-5832-48a0-8f84-bf863aaae033 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:42.602031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9c786cb-5832-48a0-8f84-bf863aaae033 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:42.602591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9c786cb-5832-48a0-8f84-bf863aaae033 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:42.603030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9c786cb-5832-48a0-8f84-bf863aaae033 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:42.697068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79d343e7-d28d-4e80-8a79-47dbc14824ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:42.697756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79d343e7-d28d-4e80-8a79-47dbc14824ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:42.712143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79d343e7-d28d-4e80-8a79-47dbc14824ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:42.712591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79d343e7-d28d-4e80-8a79-47dbc14824ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:42.713411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79d343e7-d28d-4e80-8a79-47dbc14824ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:42.714224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79d343e7-d28d-4e80-8a79-47dbc14824ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:43.007523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f9c786cb-5832-48a0-8f84-bf863aaae033 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:43.016087 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f9c786cb-5832-48a0-8f84-bf863aaae033 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1293 microversion: 2.1 time: 0.428010 Aug 02 06:55:43.023078 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1277/2423] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:42 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1293 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:43.034077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fd3bf3e3-9b74-4e6d-bc9d-c6ac6e00c78c tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:43.034702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fd3bf3e3-9b74-4e6d-bc9d-c6ac6e00c78c tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:43.053604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fd3bf3e3-9b74-4e6d-bc9d-c6ac6e00c78c tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:43.054130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fd3bf3e3-9b74-4e6d-bc9d-c6ac6e00c78c tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:43.055102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fd3bf3e3-9b74-4e6d-bc9d-c6ac6e00c78c tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:43.055869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fd3bf3e3-9b74-4e6d-bc9d-c6ac6e00c78c tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:43.102302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79d343e7-d28d-4e80-8a79-47dbc14824ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:43.114400 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79d343e7-d28d-4e80-8a79-47dbc14824ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1724 microversion: 2.1 time: 0.421181 Aug 02 06:55:43.115018 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1147/2424] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:42 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1724 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:55:43.156359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-00d8ada1-5ed7-45e8-be56-4bfc7ed4ba2e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:43.157554 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-00d8ada1-5ed7-45e8-be56-4bfc7ed4ba2e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:43.172251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00d8ada1-5ed7-45e8-be56-4bfc7ed4ba2e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:43.172834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00d8ada1-5ed7-45e8-be56-4bfc7ed4ba2e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:43.173510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00d8ada1-5ed7-45e8-be56-4bfc7ed4ba2e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:43.173954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00d8ada1-5ed7-45e8-be56-4bfc7ed4ba2e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:43.227810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fd3bf3e3-9b74-4e6d-bc9d-c6ac6e00c78c tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:43.240679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fd3bf3e3-9b74-4e6d-bc9d-c6ac6e00c78c tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:43.246769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fd3bf3e3-9b74-4e6d-bc9d-c6ac6e00c78c tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:43.248627 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fd3bf3e3-9b74-4e6d-bc9d-c6ac6e00c78c tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.223847 Aug 02 06:55:43.253875 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1278/2425] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:43 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:43.288042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e90fd50-57c5-4f85-aac6-3c5abde4de51 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:43.289455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7e90fd50-57c5-4f85-aac6-3c5abde4de51 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:43.318553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e90fd50-57c5-4f85-aac6-3c5abde4de51 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:43.318553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e90fd50-57c5-4f85-aac6-3c5abde4de51 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:43.318553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e90fd50-57c5-4f85-aac6-3c5abde4de51 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:43.319465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e90fd50-57c5-4f85-aac6-3c5abde4de51 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:43.567417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-00d8ada1-5ed7-45e8-be56-4bfc7ed4ba2e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:43.583136 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-00d8ada1-5ed7-45e8-be56-4bfc7ed4ba2e tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1488 microversion: 2.1 time: 0.428665 Aug 02 06:55:43.599461 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1148/2426] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:43 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1488 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:55:43.618593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7b937a0f-f5b9-4f86-b4b5-50e403f5cd6a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:43.620990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7b937a0f-f5b9-4f86-b4b5-50e403f5cd6a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:43.637064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b937a0f-f5b9-4f86-b4b5-50e403f5cd6a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:43.638166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b937a0f-f5b9-4f86-b4b5-50e403f5cd6a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:43.641599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b937a0f-f5b9-4f86-b4b5-50e403f5cd6a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:43.642691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b937a0f-f5b9-4f86-b4b5-50e403f5cd6a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:43.706237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7b937a0f-f5b9-4f86-b4b5-50e403f5cd6a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:55:43.735656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7e90fd50-57c5-4f85-aac6-3c5abde4de51 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:43.747665 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7e90fd50-57c5-4f85-aac6-3c5abde4de51 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.473155 Aug 02 06:55:43.748878 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1279/2427] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:43 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:43.881065 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7b937a0f-f5b9-4f86-b4b5-50e403f5cd6a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 204 len: 0 microversion: 2.1 time: 0.274791 Aug 02 06:55:43.882733 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1149/2428] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:55:43 2022] DELETE /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:55:43.894565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a474c5c-5175-47b6-8c80-e0c6c1961fbc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a810ca0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:43.921372 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-8a474c5c-5175-47b6-8c80-e0c6c1961fbc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] HTTP exception thrown: Image not found. Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a474c5c-5175-47b6-8c80-e0c6c1961fbc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Request method failure captured: Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/images/dc6a9e8a-5e42-4a6a-bcf2-3592340c4942 HTTP/1.1 Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmFBMbDPWlrXqv5WHrBzHESi-aCp6ZSL-MPW7oksJIFc52eVMg4OFupUZietKB8DWW2-CTOlJ9jvWoU9xEAO_UYFzUQHnk0KXINIlNifawrKVIqlAAIZCLUxLf7DyKhP-XiYe1bGZLmfIH3Qc-TPq-81M5czwG23YFaQx84KcSrz7M Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}] Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 793620d46a6c42fb955f1fe5075b040b Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: exception: Image not found. Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'dc6a9e8a-5e42-4a6a-bcf2-3592340c4942'} Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image dc6a9e8a-5e42-4a6a-bcf2-3592340c4942 to delete Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dc6a9e8a-5e42-4a6a-bcf2-3592340c4942 could not be found. Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:43.923630 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:55:43.927221 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:43.933364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a474c5c-5175-47b6-8c80-e0c6c1961fbc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Returning 404 to user: Image not found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:43.934931 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8a474c5c-5175-47b6-8c80-e0c6c1961fbc tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/images/dc6a9e8a-5e42-4a6a-bcf2-3592340c4942" status: 404 len: 62 microversion: 2.1 time: 0.044572 Aug 02 06:55:43.940035 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1280/2429] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:43 2022] DELETE /compute/v2.1/images/dc6a9e8a-5e42-4a6a-bcf2-3592340c4942 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:55:43.944697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9bc64fcd-7c1a-41f9-8eac-e2ed00586ff1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:43.945057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9bc64fcd-7c1a-41f9-8eac-e2ed00586ff1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:43.956781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bc64fcd-7c1a-41f9-8eac-e2ed00586ff1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:43.957230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bc64fcd-7c1a-41f9-8eac-e2ed00586ff1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:43.958227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bc64fcd-7c1a-41f9-8eac-e2ed00586ff1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:43.958843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bc64fcd-7c1a-41f9-8eac-e2ed00586ff1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:44.052204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-420a5437-851e-468f-863e-04e6a58756ef tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:44.053044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9bc64fcd-7c1a-41f9-8eac-e2ed00586ff1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:55:44.054097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-420a5437-851e-468f-863e-04e6a58756ef tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:44.101724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-420a5437-851e-468f-863e-04e6a58756ef tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:44.109368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-420a5437-851e-468f-863e-04e6a58756ef tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:44.113849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-420a5437-851e-468f-863e-04e6a58756ef tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:44.116707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-420a5437-851e-468f-863e-04e6a58756ef tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:44.120954 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.compute.api [None req-9bc64fcd-7c1a-41f9-8eac-e2ed00586ff1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Instance is already in deleting state, ignoring this request Aug 02 06:55:44.122210 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9bc64fcd-7c1a-41f9-8eac-e2ed00586ff1 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 204 len: 0 microversion: 2.1 time: 0.181966 Aug 02 06:55:44.123399 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1150/2430] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:55:43 2022] DELETE /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:55:44.143300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-df722482-95fc-4e32-84b4-af35ced29b15 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:44.145552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-df722482-95fc-4e32-84b4-af35ced29b15 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:44.167570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-df722482-95fc-4e32-84b4-af35ced29b15 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:44.168308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-df722482-95fc-4e32-84b4-af35ced29b15 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:44.169407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-df722482-95fc-4e32-84b4-af35ced29b15 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:44.170102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-df722482-95fc-4e32-84b4-af35ced29b15 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:44.508320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-df722482-95fc-4e32-84b4-af35ced29b15 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:44.518388 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-df722482-95fc-4e32-84b4-af35ced29b15 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1494 microversion: 2.1 time: 0.389965 Aug 02 06:55:44.522179 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1151/2431] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:44 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1494 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:44.528636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e6b9b1a3-853e-446e-af7f-53a68e41773c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:44.529629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e6b9b1a3-853e-446e-af7f-53a68e41773c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:44.556740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6b9b1a3-853e-446e-af7f-53a68e41773c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:44.557198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6b9b1a3-853e-446e-af7f-53a68e41773c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:44.564259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6b9b1a3-853e-446e-af7f-53a68e41773c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:44.564720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6b9b1a3-853e-446e-af7f-53a68e41773c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:44.592035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-420a5437-851e-468f-863e-04e6a58756ef tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:44.602711 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-420a5437-851e-468f-863e-04e6a58756ef tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1293 microversion: 2.1 time: 0.562445 Aug 02 06:55:44.622197 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1281/2432] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:44 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1293 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:44.630228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-74eee77a-e005-45f0-aebc-56429d70d04a req-2c8718ff-4a6c-4cae-b647-98ec4a768980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c00361-60fe-435b-833b-44a0cddbc4db", "name": "network-vif-plugged", "status": "completed", "tag": "def1d1d8-4436-4f04-bec4-5ad8acc4c80e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:44.667510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-74eee77a-e005-45f0-aebc-56429d70d04a req-2c8718ff-4a6c-4cae-b647-98ec4a768980 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:44.668186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-74eee77a-e005-45f0-aebc-56429d70d04a req-2c8718ff-4a6c-4cae-b647-98ec4a768980 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:44.688840 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-74eee77a-e005-45f0-aebc-56429d70d04a req-2c8718ff-4a6c-4cae-b647-98ec4a768980 service nova] Creating event network-vif-plugged:def1d1d8-4436-4f04-bec4-5ad8acc4c80e for instance 98c00361-60fe-435b-833b-44a0cddbc4db on n-h2-851337-3 Aug 02 06:55:44.697038 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-74eee77a-e005-45f0-aebc-56429d70d04a req-2c8718ff-4a6c-4cae-b647-98ec4a768980 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073231 Aug 02 06:55:44.699397 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1282/2433] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:44.710256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7f6f1e36-bc9c-4429-9785-c8d77e490af8 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:44.713247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7f6f1e36-bc9c-4429-9785-c8d77e490af8 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:44.732651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f6f1e36-bc9c-4429-9785-c8d77e490af8 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:44.736299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f6f1e36-bc9c-4429-9785-c8d77e490af8 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:44.737422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f6f1e36-bc9c-4429-9785-c8d77e490af8 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:44.739328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f6f1e36-bc9c-4429-9785-c8d77e490af8 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:44.920236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7f6f1e36-bc9c-4429-9785-c8d77e490af8 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:44.929366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7f6f1e36-bc9c-4429-9785-c8d77e490af8 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:44.930934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7f6f1e36-bc9c-4429-9785-c8d77e490af8 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:44.933203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e6b9b1a3-853e-446e-af7f-53a68e41773c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:44.944572 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e6b9b1a3-853e-446e-af7f-53a68e41773c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1701 microversion: 2.1 time: 0.420564 Aug 02 06:55:44.949288 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7f6f1e36-bc9c-4429-9785-c8d77e490af8 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.242243 Aug 02 06:55:44.953384 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1283/2434] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:44 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:44.959965 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1152/2435] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:44 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1701 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:44.971874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-06692ac1-dc76-4fbe-946a-349fb2fdbedd tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:44.972511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-06692ac1-dc76-4fbe-946a-349fb2fdbedd tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:44.980794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06692ac1-dc76-4fbe-946a-349fb2fdbedd tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:44.984129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06692ac1-dc76-4fbe-946a-349fb2fdbedd tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:44.985270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06692ac1-dc76-4fbe-946a-349fb2fdbedd tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:44.987209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06692ac1-dc76-4fbe-946a-349fb2fdbedd tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:44.990378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b220d48c-2588-4532-ba18-5742b4b44801 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:45.006806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b220d48c-2588-4532-ba18-5742b4b44801 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:45.010032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b220d48c-2588-4532-ba18-5742b4b44801 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:45.033270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:45.163244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b220d48c-2588-4532-ba18-5742b4b44801 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Going to try to start instance {{(pid=126119) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 06:55:45.239689 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b220d48c-2588-4532-ba18-5742b4b44801 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "POST /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/action" status: 202 len: 0 microversion: 2.1 time: 0.264235 Aug 02 06:55:45.243123 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1153/2436] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:55:44 2022] POST /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:55:45.264799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a8b20c4b-abe7-4cf7-beb3-133026e4e684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:45.266540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a8b20c4b-abe7-4cf7-beb3-133026e4e684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:45.274503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8b20c4b-abe7-4cf7-beb3-133026e4e684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:45.275582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8b20c4b-abe7-4cf7-beb3-133026e4e684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:45.277413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8b20c4b-abe7-4cf7-beb3-133026e4e684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:45.278810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8b20c4b-abe7-4cf7-beb3-133026e4e684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:45.418426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-06692ac1-dc76-4fbe-946a-349fb2fdbedd tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:45.427684 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-06692ac1-dc76-4fbe-946a-349fb2fdbedd tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.472193 Aug 02 06:55:45.442043 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1284/2437] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:44 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:45.546099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-23232880-052e-4038-97dd-22fb5edc3f8f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:45.547089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-23232880-052e-4038-97dd-22fb5edc3f8f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:45.559561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23232880-052e-4038-97dd-22fb5edc3f8f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:45.560318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23232880-052e-4038-97dd-22fb5edc3f8f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:45.561403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23232880-052e-4038-97dd-22fb5edc3f8f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:45.562072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23232880-052e-4038-97dd-22fb5edc3f8f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:45.652276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a8b20c4b-abe7-4cf7-beb3-133026e4e684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:45.660962 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a8b20c4b-abe7-4cf7-beb3-133026e4e684 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1710 microversion: 2.1 time: 0.410590 Aug 02 06:55:45.661541 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1154/2438] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:45 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1710 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:45.674146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f09af738-2e70-4a45-8483-53fe1148e84f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:45.674775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f09af738-2e70-4a45-8483-53fe1148e84f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:45.694933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f09af738-2e70-4a45-8483-53fe1148e84f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:45.695392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f09af738-2e70-4a45-8483-53fe1148e84f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:45.696176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f09af738-2e70-4a45-8483-53fe1148e84f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:45.696613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f09af738-2e70-4a45-8483-53fe1148e84f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:46.012176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f09af738-2e70-4a45-8483-53fe1148e84f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:46.030323 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f09af738-2e70-4a45-8483-53fe1148e84f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1293 microversion: 2.1 time: 0.363445 Aug 02 06:55:46.032217 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1155/2439] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:45 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1293 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:46.034462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-23232880-052e-4038-97dd-22fb5edc3f8f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:46.041724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1074e476-4315-47f0-a5b9-265bdd1bc0f2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:46.042980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1074e476-4315-47f0-a5b9-265bdd1bc0f2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:46.051623 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-23232880-052e-4038-97dd-22fb5edc3f8f tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1494 microversion: 2.1 time: 0.509719 Aug 02 06:55:46.052457 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1285/2440] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:45 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1494 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:46.071265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:46.076556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1074e476-4315-47f0-a5b9-265bdd1bc0f2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:46.077802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1074e476-4315-47f0-a5b9-265bdd1bc0f2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:46.082932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1074e476-4315-47f0-a5b9-265bdd1bc0f2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:46.083737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1074e476-4315-47f0-a5b9-265bdd1bc0f2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:46.248949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1074e476-4315-47f0-a5b9-265bdd1bc0f2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:46.263083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1074e476-4315-47f0-a5b9-265bdd1bc0f2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:46.267472 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1074e476-4315-47f0-a5b9-265bdd1bc0f2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:46.269033 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1074e476-4315-47f0-a5b9-265bdd1bc0f2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.235530 Aug 02 06:55:46.286630 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1156/2441] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:46 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:46.449643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5c5f3da1-da00-44ef-8159-9e686d8b5c66 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:46.451040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5c5f3da1-da00-44ef-8159-9e686d8b5c66 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:46.461427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c5f3da1-da00-44ef-8159-9e686d8b5c66 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:46.462171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c5f3da1-da00-44ef-8159-9e686d8b5c66 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:46.463210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c5f3da1-da00-44ef-8159-9e686d8b5c66 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:46.464623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c5f3da1-da00-44ef-8159-9e686d8b5c66 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:46.690480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72dae7d2-0774-4a30-8f5b-0ada2b12f288 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:46.691092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-72dae7d2-0774-4a30-8f5b-0ada2b12f288 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:46.703351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72dae7d2-0774-4a30-8f5b-0ada2b12f288 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:46.703799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72dae7d2-0774-4a30-8f5b-0ada2b12f288 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:46.704576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72dae7d2-0774-4a30-8f5b-0ada2b12f288 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:46.705004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72dae7d2-0774-4a30-8f5b-0ada2b12f288 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:46.747643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5c5f3da1-da00-44ef-8159-9e686d8b5c66 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:46.773256 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5c5f3da1-da00-44ef-8159-9e686d8b5c66 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.327238 Aug 02 06:55:46.785918 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1286/2442] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:46 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:46.785918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-df5defc9-269f-45c8-83bf-4c5afc219b88 req-c096b16d-1d4a-41fc-9a49-6a28f9608cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c00361-60fe-435b-833b-44a0cddbc4db", "name": "network-vif-unplugged", "status": "completed", "tag": "def1d1d8-4436-4f04-bec4-5ad8acc4c80e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:46.802420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=34 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:46.812577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-df5defc9-269f-45c8-83bf-4c5afc219b88 req-c096b16d-1d4a-41fc-9a49-6a28f9608cf6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:46.813448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-df5defc9-269f-45c8-83bf-4c5afc219b88 req-c096b16d-1d4a-41fc-9a49-6a28f9608cf6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:46.838552 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-df5defc9-269f-45c8-83bf-4c5afc219b88 req-c096b16d-1d4a-41fc-9a49-6a28f9608cf6 service nova] Creating event network-vif-unplugged:def1d1d8-4436-4f04-bec4-5ad8acc4c80e for instance 98c00361-60fe-435b-833b-44a0cddbc4db on n-h2-851337-3 Aug 02 06:55:46.846433 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-df5defc9-269f-45c8-83bf-4c5afc219b88 req-c096b16d-1d4a-41fc-9a49-6a28f9608cf6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066126 Aug 02 06:55:46.847614 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1287/2443] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:46.909391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-72dae7d2-0774-4a30-8f5b-0ada2b12f288 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:46.918650 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-72dae7d2-0774-4a30-8f5b-0ada2b12f288 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1710 microversion: 2.1 time: 0.231972 Aug 02 06:55:46.919648 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1157/2444] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:46 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1710 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:47.054431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-22a4658f-b594-4798-88e9-3ce699e6ff3e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:47.055312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-22a4658f-b594-4798-88e9-3ce699e6ff3e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:47.063036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22a4658f-b594-4798-88e9-3ce699e6ff3e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:47.063633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22a4658f-b594-4798-88e9-3ce699e6ff3e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:47.064844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22a4658f-b594-4798-88e9-3ce699e6ff3e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:47.065362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22a4658f-b594-4798-88e9-3ce699e6ff3e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:47.076235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-60deaaba-dcf1-4f1b-b31c-10159a570691 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:47.076865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-60deaaba-dcf1-4f1b-b31c-10159a570691 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:47.097319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60deaaba-dcf1-4f1b-b31c-10159a570691 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:47.097796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60deaaba-dcf1-4f1b-b31c-10159a570691 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:47.098789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60deaaba-dcf1-4f1b-b31c-10159a570691 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:47.099824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60deaaba-dcf1-4f1b-b31c-10159a570691 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:47.193695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-60deaaba-dcf1-4f1b-b31c-10159a570691 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793620d46a6c42fb955f1fe5075b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8dc75e5ba647e3b128c31a49f069ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:47.197259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:47.209728 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-60deaaba-dcf1-4f1b-b31c-10159a570691 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 200 len: 1452 microversion: 2.1 time: 0.140036 Aug 02 06:55:47.211742 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1158/2445] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:47 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:47.296433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c31fa511-4e57-4830-9680-af3254382cf6 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:47.297091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c31fa511-4e57-4830-9680-af3254382cf6 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:47.309137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c31fa511-4e57-4830-9680-af3254382cf6 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:47.312029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c31fa511-4e57-4830-9680-af3254382cf6 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:47.313189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c31fa511-4e57-4830-9680-af3254382cf6 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:47.318068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c31fa511-4e57-4830-9680-af3254382cf6 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:47.372309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-22a4658f-b594-4798-88e9-3ce699e6ff3e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:47.396342 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-22a4658f-b594-4798-88e9-3ce699e6ff3e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1293 microversion: 2.1 time: 0.348384 Aug 02 06:55:47.398211 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1288/2446] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:47 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1293 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:47.433784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7e44b698-1d9a-4344-aa26-f25dd898504f req-480db14e-83ee-41fb-bc59-99dc128bbea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c00361-60fe-435b-833b-44a0cddbc4db", "name": "network-vif-deleted", "tag": "def1d1d8-4436-4f04-bec4-5ad8acc4c80e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:47.486359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7e44b698-1d9a-4344-aa26-f25dd898504f req-480db14e-83ee-41fb-bc59-99dc128bbea4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:47.487060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7e44b698-1d9a-4344-aa26-f25dd898504f req-480db14e-83ee-41fb-bc59-99dc128bbea4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:47.511986 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7e44b698-1d9a-4344-aa26-f25dd898504f req-480db14e-83ee-41fb-bc59-99dc128bbea4 service nova] Creating event network-vif-deleted:def1d1d8-4436-4f04-bec4-5ad8acc4c80e for instance 98c00361-60fe-435b-833b-44a0cddbc4db on n-h2-851337-3 Aug 02 06:55:47.523239 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7e44b698-1d9a-4344-aa26-f25dd898504f req-480db14e-83ee-41fb-bc59-99dc128bbea4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093605 Aug 02 06:55:47.524761 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1289/2447] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:55:47.599063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c31fa511-4e57-4830-9680-af3254382cf6 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:47.607436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c31fa511-4e57-4830-9680-af3254382cf6 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:47.613798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c31fa511-4e57-4830-9680-af3254382cf6 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:47.616961 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c31fa511-4e57-4830-9680-af3254382cf6 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.324640 Aug 02 06:55:47.636545 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1159/2448] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:47 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:47.806762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-05865ddb-66b2-4d3a-904f-1eb998dc8698 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:47.809019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-05865ddb-66b2-4d3a-904f-1eb998dc8698 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:47.818693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05865ddb-66b2-4d3a-904f-1eb998dc8698 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:47.820055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05865ddb-66b2-4d3a-904f-1eb998dc8698 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:47.829821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05865ddb-66b2-4d3a-904f-1eb998dc8698 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:47.830465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05865ddb-66b2-4d3a-904f-1eb998dc8698 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:47.941020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a23d5cda-d6fc-49ff-ba5c-0b64a22103ed tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:47.942279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a23d5cda-d6fc-49ff-ba5c-0b64a22103ed tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:47.952374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a23d5cda-d6fc-49ff-ba5c-0b64a22103ed tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:47.954296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a23d5cda-d6fc-49ff-ba5c-0b64a22103ed tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:47.956807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a23d5cda-d6fc-49ff-ba5c-0b64a22103ed tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:47.957464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a23d5cda-d6fc-49ff-ba5c-0b64a22103ed tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.190763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-05865ddb-66b2-4d3a-904f-1eb998dc8698 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:48.206344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a23d5cda-d6fc-49ff-ba5c-0b64a22103ed tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:48.212775 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-05865ddb-66b2-4d3a-904f-1eb998dc8698 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.415001 Aug 02 06:55:48.226006 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1290/2449] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:47 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:48.231326 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a23d5cda-d6fc-49ff-ba5c-0b64a22103ed tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1714 microversion: 2.1 time: 0.294280 Aug 02 06:55:48.231604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-736fac4f-1522-4d1f-831e-a9e839cb5df6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:48.232234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-736fac4f-1522-4d1f-831e-a9e839cb5df6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 98c00361-60fe-435b-833b-44a0cddbc4db] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:48.238773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-736fac4f-1522-4d1f-831e-a9e839cb5df6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.239480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-736fac4f-1522-4d1f-831e-a9e839cb5df6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.240421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-736fac4f-1522-4d1f-831e-a9e839cb5df6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.241008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-736fac4f-1522-4d1f-831e-a9e839cb5df6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.245794 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1160/2450] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:47 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1714 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:48.256997 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-736fac4f-1522-4d1f-831e-a9e839cb5df6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] HTTP exception thrown: Instance 98c00361-60fe-435b-833b-44a0cddbc4db could not be found. Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-736fac4f-1522-4d1f-831e-a9e839cb5df6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Request method failure captured: Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db HTTP/1.1 Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmFBMbDPWlrXqv5WHrBzHESi-aCp6ZSL-MPW7oksJIFc52eVMg4OFupUZietKB8DWW2-CTOlJ9jvWoU9xEAO_UYFzUQHnk0KXINIlNifawrKVIqlAAIZCLUxLf7DyKhP-XiYe1bGZLmfIH3Qc-TPq-81M5czwG23YFaQx84KcSrz7M Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}] Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 793620d46a6c42fb955f1fe5075b040b Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 98c00361-60fe-435b-833b-44a0cddbc4db could not be found. Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '98c00361-60fe-435b-833b-44a0cddbc4db'} Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98c00361-60fe-435b-833b-44a0cddbc4db could not be found. Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98c00361-60fe-435b-833b-44a0cddbc4db could not be found. Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.258745 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.262999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.262999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.262999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:48.262999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:48.262999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98c00361-60fe-435b-833b-44a0cddbc4db could not be found. Aug 02 06:55:48.262999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.264181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-736fac4f-1522-4d1f-831e-a9e839cb5df6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Returning 404 to user: Instance 98c00361-60fe-435b-833b-44a0cddbc4db could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:48.265054 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-736fac4f-1522-4d1f-831e-a9e839cb5df6 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db" status: 404 len: 111 microversion: 2.1 time: 0.037309 Aug 02 06:55:48.265625 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1291/2451] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:48 2022] GET /compute/v2.1/servers/98c00361-60fe-435b-833b-44a0cddbc4db => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:55:48.275042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9ed55109-9444-4917-b690-c241ad2dd948 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927aadc8b0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:48.300104 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-9ed55109-9444-4917-b690-c241ad2dd948 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] HTTP exception thrown: Image not found. Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9ed55109-9444-4917-b690-c241ad2dd948 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Request method failure captured: Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 HTTP/1.1 Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmFBMbDPWlrXqv5WHrBzHESi-aCp6ZSL-MPW7oksJIFc52eVMg4OFupUZietKB8DWW2-CTOlJ9jvWoU9xEAO_UYFzUQHnk0KXINIlNifawrKVIqlAAIZCLUxLf7DyKhP-XiYe1bGZLmfIH3Qc-TPq-81M5czwG23YFaQx84KcSrz7M Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}] Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 793620d46a6c42fb955f1fe5075b040b Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: exception: Image not found. Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'e6b9e638-831b-4cc4-90ae-1912de0334b7'} Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e6b9e638-831b-4cc4-90ae-1912de0334b7 to delete Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e6b9e638-831b-4cc4-90ae-1912de0334b7 could not be found. Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.302251 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.306632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9ed55109-9444-4917-b690-c241ad2dd948 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Returning 404 to user: Image not found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:48.308770 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9ed55109-9444-4917-b690-c241ad2dd948 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7" status: 404 len: 62 microversion: 2.1 time: 0.038406 Aug 02 06:55:48.309905 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1161/2452] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:48 2022] DELETE /compute/v2.1/images/e6b9e638-831b-4cc4-90ae-1912de0334b7 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:55:48.318687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f7a79371-83b7-4b4c-92dd-0ad796079863 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:48.319367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f7a79371-83b7-4b4c-92dd-0ad796079863 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:48.326976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7a79371-83b7-4b4c-92dd-0ad796079863 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.327694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7a79371-83b7-4b4c-92dd-0ad796079863 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.328656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7a79371-83b7-4b4c-92dd-0ad796079863 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.329242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7a79371-83b7-4b4c-92dd-0ad796079863 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.345011 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-f7a79371-83b7-4b4c-92dd-0ad796079863 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] HTTP exception thrown: Instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 could not be found. Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f7a79371-83b7-4b4c-92dd-0ad796079863 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Request method failure captured: Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 HTTP/1.1 Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmFBMbDPWlrXqv5WHrBzHESi-aCp6ZSL-MPW7oksJIFc52eVMg4OFupUZietKB8DWW2-CTOlJ9jvWoU9xEAO_UYFzUQHnk0KXINIlNifawrKVIqlAAIZCLUxLf7DyKhP-XiYe1bGZLmfIH3Qc-TPq-81M5czwG23YFaQx84KcSrz7M Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}] Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 793620d46a6c42fb955f1fe5075b040b Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 could not be found. Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '27beb807-e873-4cfb-a895-c16a1bd7ad43'} Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 could not be found. Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:48.347214 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 could not be found. Aug 02 06:55:48.351081 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.351081 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.351081 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.351081 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.351081 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.351081 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.351081 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:48.351081 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:48.351081 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 could not be found. Aug 02 06:55:48.351081 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.352846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f7a79371-83b7-4b4c-92dd-0ad796079863 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Returning 404 to user: Instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:48.354135 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f7a79371-83b7-4b4c-92dd-0ad796079863 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 404 len: 111 microversion: 2.1 time: 0.040132 Aug 02 06:55:48.354903 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1292/2453] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:55:48 2022] DELETE /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:55:48.366436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f8cd8d76-5a64-400e-b365-fbaab1125326 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:48.366977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f8cd8d76-5a64-400e-b365-fbaab1125326 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 27beb807-e873-4cfb-a895-c16a1bd7ad43] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:48.380211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f8cd8d76-5a64-400e-b365-fbaab1125326 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.380775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f8cd8d76-5a64-400e-b365-fbaab1125326 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.381932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f8cd8d76-5a64-400e-b365-fbaab1125326 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.383120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f8cd8d76-5a64-400e-b365-fbaab1125326 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.398698 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-f8cd8d76-5a64-400e-b365-fbaab1125326 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] HTTP exception thrown: Instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 could not be found. Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f8cd8d76-5a64-400e-b365-fbaab1125326 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Request method failure captured: Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 HTTP/1.1 Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MmFBMbDPWlrXqv5WHrBzHESi-aCp6ZSL-MPW7oksJIFc52eVMg4OFupUZietKB8DWW2-CTOlJ9jvWoU9xEAO_UYFzUQHnk0KXINIlNifawrKVIqlAAIZCLUxLf7DyKhP-XiYe1bGZLmfIH3Qc-TPq-81M5czwG23YFaQx84KcSrz7M Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}] Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 793620d46a6c42fb955f1fe5075b040b Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 could not be found. Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '27beb807-e873-4cfb-a895-c16a1bd7ad43'} Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 could not be found. Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 could not be found. Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.400331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.403901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.403901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.403901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:48.403901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:48.403901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 could not be found. Aug 02 06:55:48.403901 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.403901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f8cd8d76-5a64-400e-b365-fbaab1125326 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Returning 404 to user: Instance 27beb807-e873-4cfb-a895-c16a1bd7ad43 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:48.403901 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f8cd8d76-5a64-400e-b365-fbaab1125326 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43" status: 404 len: 111 microversion: 2.1 time: 0.041422 Aug 02 06:55:48.405590 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1162/2454] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:48 2022] GET /compute/v2.1/servers/27beb807-e873-4cfb-a895-c16a1bd7ad43 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:55:48.410869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-abf4444d-4f87-4e34-9638-549fae5e920a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a7f4af0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:48.418130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8bb467ba-39a6-49f6-91d0-e25e47766562 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:48.421227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8bb467ba-39a6-49f6-91d0-e25e47766562 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:48.429028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bb467ba-39a6-49f6-91d0-e25e47766562 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.429831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bb467ba-39a6-49f6-91d0-e25e47766562 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.431449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bb467ba-39a6-49f6-91d0-e25e47766562 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.432270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bb467ba-39a6-49f6-91d0-e25e47766562 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.432899 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-abf4444d-4f87-4e34-9638-549fae5e920a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] HTTP exception thrown: Image not found. Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-abf4444d-4f87-4e34-9638-549fae5e920a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Request method failure captured: Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 HTTP/1.1 Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmFBMbDPWlrXqv5WHrBzHESi-aCp6ZSL-MPW7oksJIFc52eVMg4OFupUZietKB8DWW2-CTOlJ9jvWoU9xEAO_UYFzUQHnk0KXINIlNifawrKVIqlAAIZCLUxLf7DyKhP-XiYe1bGZLmfIH3Qc-TPq-81M5czwG23YFaQx84KcSrz7M Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}] Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 793620d46a6c42fb955f1fe5075b040b Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: exception: Image not found. Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '69a574b2-a2aa-408a-ae83-7f6e54c1bb20'} Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 69a574b2-a2aa-408a-ae83-7f6e54c1bb20 to delete Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 69a574b2-a2aa-408a-ae83-7f6e54c1bb20 could not be found. Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.434724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-abf4444d-4f87-4e34-9638-549fae5e920a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Returning 404 to user: Image not found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-abf4444d-4f87-4e34-9638-549fae5e920a tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20" status: 404 len: 62 microversion: 2.1 time: 0.029487 Aug 02 06:55:48.438384 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1293/2455] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:48 2022] DELETE /compute/v2.1/images/69a574b2-a2aa-408a-ae83-7f6e54c1bb20 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:55:48.447937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-56c7f190-7899-4051-be5d-c5c3c4404ac8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:48.447937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-56c7f190-7899-4051-be5d-c5c3c4404ac8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:48.468720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56c7f190-7899-4051-be5d-c5c3c4404ac8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.471463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56c7f190-7899-4051-be5d-c5c3c4404ac8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.473413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56c7f190-7899-4051-be5d-c5c3c4404ac8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.479913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56c7f190-7899-4051-be5d-c5c3c4404ac8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.512125 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-56c7f190-7899-4051-be5d-c5c3c4404ac8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] HTTP exception thrown: Instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 could not be found. Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-56c7f190-7899-4051-be5d-c5c3c4404ac8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Request method failure captured: Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 HTTP/1.1 Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmFBMbDPWlrXqv5WHrBzHESi-aCp6ZSL-MPW7oksJIFc52eVMg4OFupUZietKB8DWW2-CTOlJ9jvWoU9xEAO_UYFzUQHnk0KXINIlNifawrKVIqlAAIZCLUxLf7DyKhP-XiYe1bGZLmfIH3Qc-TPq-81M5czwG23YFaQx84KcSrz7M Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}] Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 793620d46a6c42fb955f1fe5075b040b Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 could not be found. Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'b4790820-2d09-47ab-9c4d-ec909dc7e1c1'} Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 could not be found. Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:48.515911 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 could not be found. Aug 02 06:55:48.519591 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.519591 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.519591 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.519591 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.519591 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.519591 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.519591 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:48.519591 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:48.519591 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 could not be found. Aug 02 06:55:48.519591 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.521952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-56c7f190-7899-4051-be5d-c5c3c4404ac8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Returning 404 to user: Instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:48.523163 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-56c7f190-7899-4051-be5d-c5c3c4404ac8 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 404 len: 111 microversion: 2.1 time: 0.082363 Aug 02 06:55:48.524230 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1294/2456] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:55:48 2022] DELETE /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:55:48.532916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-90f7d2cc-8999-44b9-9e95-c0d65bcf80a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:48.533835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-90f7d2cc-8999-44b9-9e95-c0d65bcf80a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: b4790820-2d09-47ab-9c4d-ec909dc7e1c1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:48.541205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90f7d2cc-8999-44b9-9e95-c0d65bcf80a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.541921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90f7d2cc-8999-44b9-9e95-c0d65bcf80a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.542999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90f7d2cc-8999-44b9-9e95-c0d65bcf80a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.543675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90f7d2cc-8999-44b9-9e95-c0d65bcf80a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.565262 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-90f7d2cc-8999-44b9-9e95-c0d65bcf80a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] HTTP exception thrown: Instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 could not be found. Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-90f7d2cc-8999-44b9-9e95-c0d65bcf80a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Request method failure captured: Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 HTTP/1.1 Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmFBMbDPWlrXqv5WHrBzHESi-aCp6ZSL-MPW7oksJIFc52eVMg4OFupUZietKB8DWW2-CTOlJ9jvWoU9xEAO_UYFzUQHnk0KXINIlNifawrKVIqlAAIZCLUxLf7DyKhP-XiYe1bGZLmfIH3Qc-TPq-81M5czwG23YFaQx84KcSrz7M Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}] Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 793620d46a6c42fb955f1fe5075b040b Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 could not be found. Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'b4790820-2d09-47ab-9c4d-ec909dc7e1c1'} Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 could not be found. Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 could not be found. Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.567831 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.571417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.571417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.571417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:48.571417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:48.571417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 could not be found. Aug 02 06:55:48.571417 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.572652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-90f7d2cc-8999-44b9-9e95-c0d65bcf80a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Returning 404 to user: Instance b4790820-2d09-47ab-9c4d-ec909dc7e1c1 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:48.573678 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-90f7d2cc-8999-44b9-9e95-c0d65bcf80a3 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1" status: 404 len: 111 microversion: 2.1 time: 0.045719 Aug 02 06:55:48.574431 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1295/2457] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:48 2022] GET /compute/v2.1/servers/b4790820-2d09-47ab-9c4d-ec909dc7e1c1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:55:48.584408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a37af668-5ba2-4951-8bb3-d150e0f57481 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '.version_select at 0x7f927a6599d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:48.614132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8bb467ba-39a6-49f6-91d0-e25e47766562 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:48.616508 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-a37af668-5ba2-4951-8bb3-d150e0f57481 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] HTTP exception thrown: Image not found. Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a37af668-5ba2-4951-8bb3-d150e0f57481 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Request method failure captured: Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 HTTP/1.1 Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmFBMbDPWlrXqv5WHrBzHESi-aCp6ZSL-MPW7oksJIFc52eVMg4OFupUZietKB8DWW2-CTOlJ9jvWoU9xEAO_UYFzUQHnk0KXINIlNifawrKVIqlAAIZCLUxLf7DyKhP-XiYe1bGZLmfIH3Qc-TPq-81M5czwG23YFaQx84KcSrz7M Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}] Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 793620d46a6c42fb955f1fe5075b040b Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: exception: Image not found. Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '9b25bd26-da65-4b8a-89c1-9e0a26fc8787'} Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9b25bd26-da65-4b8a-89c1-9e0a26fc8787 to delete Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9b25bd26-da65-4b8a-89c1-9e0a26fc8787 could not be found. Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.619319 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:55:48.623667 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.628584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a37af668-5ba2-4951-8bb3-d150e0f57481 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Returning 404 to user: Image not found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:48.630089 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a37af668-5ba2-4951-8bb3-d150e0f57481 tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787" status: 404 len: 62 microversion: 2.1 time: 0.051309 Aug 02 06:55:48.631874 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8bb467ba-39a6-49f6-91d0-e25e47766562 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1293 microversion: 2.1 time: 0.219065 Aug 02 06:55:48.632080 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1296/2458] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:48 2022] DELETE /compute/v2.1/images/9b25bd26-da65-4b8a-89c1-9e0a26fc8787 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 02 06:55:48.633253 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1163/2459] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:48 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1293 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:55:48.650321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-33d4b61d-2c1a-4106-b41c-34a881cca0ab tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:48.651463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b60a883b-97c1-451b-a5ae-acd34bb2159c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:48.652157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-33d4b61d-2c1a-4106-b41c-34a881cca0ab tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:48.652739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b60a883b-97c1-451b-a5ae-acd34bb2159c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:48.661725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33d4b61d-2c1a-4106-b41c-34a881cca0ab tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.662461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33d4b61d-2c1a-4106-b41c-34a881cca0ab tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.663287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b60a883b-97c1-451b-a5ae-acd34bb2159c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.663986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b60a883b-97c1-451b-a5ae-acd34bb2159c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.664152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33d4b61d-2c1a-4106-b41c-34a881cca0ab tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.664790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33d4b61d-2c1a-4106-b41c-34a881cca0ab tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.665261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b60a883b-97c1-451b-a5ae-acd34bb2159c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.665784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b60a883b-97c1-451b-a5ae-acd34bb2159c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.681306 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-b60a883b-97c1-451b-a5ae-acd34bb2159c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] HTTP exception thrown: Instance 218c6c00-857e-42d7-82d4-eb818faf1f07 could not be found. Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b60a883b-97c1-451b-a5ae-acd34bb2159c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Request method failure captured: Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 HTTP/1.1 Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmFBMbDPWlrXqv5WHrBzHESi-aCp6ZSL-MPW7oksJIFc52eVMg4OFupUZietKB8DWW2-CTOlJ9jvWoU9xEAO_UYFzUQHnk0KXINIlNifawrKVIqlAAIZCLUxLf7DyKhP-XiYe1bGZLmfIH3Qc-TPq-81M5czwG23YFaQx84KcSrz7M Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}] Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 793620d46a6c42fb955f1fe5075b040b Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 218c6c00-857e-42d7-82d4-eb818faf1f07 could not be found. Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '218c6c00-857e-42d7-82d4-eb818faf1f07'} Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 218c6c00-857e-42d7-82d4-eb818faf1f07 could not be found. Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:48.683273 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 218c6c00-857e-42d7-82d4-eb818faf1f07 could not be found. Aug 02 06:55:48.687827 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.687827 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.687827 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.687827 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.687827 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.687827 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.687827 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:48.687827 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:48.687827 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 218c6c00-857e-42d7-82d4-eb818faf1f07 could not be found. Aug 02 06:55:48.687827 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.689372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b60a883b-97c1-451b-a5ae-acd34bb2159c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Returning 404 to user: Instance 218c6c00-857e-42d7-82d4-eb818faf1f07 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:48.690775 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b60a883b-97c1-451b-a5ae-acd34bb2159c tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 404 len: 111 microversion: 2.1 time: 0.054679 Aug 02 06:55:48.692481 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1297/2460] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:55:48 2022] DELETE /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:55:48.702133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5930edaf-9cf5-4e7b-920c-258ee91074cf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:48.703134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5930edaf-9cf5-4e7b-920c-258ee91074cf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] [instance: 218c6c00-857e-42d7-82d4-eb818faf1f07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:48.711971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5930edaf-9cf5-4e7b-920c-258ee91074cf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.714248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5930edaf-9cf5-4e7b-920c-258ee91074cf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.715687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5930edaf-9cf5-4e7b-920c-258ee91074cf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.716131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5930edaf-9cf5-4e7b-920c-258ee91074cf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.737320 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-5930edaf-9cf5-4e7b-920c-258ee91074cf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] HTTP exception thrown: Instance 218c6c00-857e-42d7-82d4-eb818faf1f07 could not be found. Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5930edaf-9cf5-4e7b-920c-258ee91074cf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Request method failure captured: Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 HTTP/1.1 Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MmFBMbDPWlrXqv5WHrBzHESi-aCp6ZSL-MPW7oksJIFc52eVMg4OFupUZietKB8DWW2-CTOlJ9jvWoU9xEAO_UYFzUQHnk0KXINIlNifawrKVIqlAAIZCLUxLf7DyKhP-XiYe1bGZLmfIH3Qc-TPq-81M5czwG23YFaQx84KcSrz7M Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a8dc75e5ba647e3b128c31a49f069ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a8dc75e5ba647e3b128c31a49f069ca"}]}] Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2a8dc75e5ba647e3b128c31a49f069ca Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesTestJSON-1988148519 Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 793620d46a6c42fb955f1fe5075b040b Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesTestJSON-1988148519-project Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 218c6c00-857e-42d7-82d4-eb818faf1f07 could not be found. Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '218c6c00-857e-42d7-82d4-eb818faf1f07'} Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 218c6c00-857e-42d7-82d4-eb818faf1f07 could not be found. Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 218c6c00-857e-42d7-82d4-eb818faf1f07 could not be found. Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.740544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:55:48.745008 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:55:48.745008 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:55:48.745008 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:55:48.745008 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:55:48.745008 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 218c6c00-857e-42d7-82d4-eb818faf1f07 could not be found. Aug 02 06:55:48.745008 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:55:48.747007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5930edaf-9cf5-4e7b-920c-258ee91074cf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] Returning 404 to user: Instance 218c6c00-857e-42d7-82d4-eb818faf1f07 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:55:48.750254 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5930edaf-9cf5-4e7b-920c-258ee91074cf tempest-ImagesTestJSON-1988148519 tempest-ImagesTestJSON-1988148519-project] 10.222.0.79 "GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07" status: 404 len: 111 microversion: 2.1 time: 0.051378 Aug 02 06:55:48.751054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-33d4b61d-2c1a-4106-b41c-34a881cca0ab tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:48.757563 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1298/2461] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:48 2022] GET /compute/v2.1/servers/218c6c00-857e-42d7-82d4-eb818faf1f07 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 06:55:48.761655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-33d4b61d-2c1a-4106-b41c-34a881cca0ab tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:48.763359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-33d4b61d-2c1a-4106-b41c-34a881cca0ab tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:48.765922 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-33d4b61d-2c1a-4106-b41c-34a881cca0ab tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.122581 Aug 02 06:55:48.767574 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1164/2462] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:48 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:55:48.903031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-8fe50bb9-9182-4159-b185-0d757cfd5f66 req-7ad1b6b9-ad09-4122-8f58-37c8894952b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c66c14da-356f-4545-830d-93f43f602ca2", "name": "network-vif-plugged", "status": "completed", "tag": "623de687-c25c-4a70-8b03-fe1359eeddb6"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:48.920653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8fe50bb9-9182-4159-b185-0d757cfd5f66 req-7ad1b6b9-ad09-4122-8f58-37c8894952b0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:48.922912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8fe50bb9-9182-4159-b185-0d757cfd5f66 req-7ad1b6b9-ad09-4122-8f58-37c8894952b0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:48.943865 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-8fe50bb9-9182-4159-b185-0d757cfd5f66 req-7ad1b6b9-ad09-4122-8f58-37c8894952b0 service nova] Creating event network-vif-plugged:623de687-c25c-4a70-8b03-fe1359eeddb6 for instance c66c14da-356f-4545-830d-93f43f602ca2 on n-h1-851337-3 Aug 02 06:55:48.950055 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-8fe50bb9-9182-4159-b185-0d757cfd5f66 req-7ad1b6b9-ad09-4122-8f58-37c8894952b0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051069 Aug 02 06:55:48.950920 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1299/2463] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:49.234396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e7909218-0bc4-48ca-b995-403c2107a006 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:49.235686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e7909218-0bc4-48ca-b995-403c2107a006 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:49.252771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7909218-0bc4-48ca-b995-403c2107a006 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:49.254061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7909218-0bc4-48ca-b995-403c2107a006 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:49.254886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7909218-0bc4-48ca-b995-403c2107a006 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:49.255329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7909218-0bc4-48ca-b995-403c2107a006 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:49.668680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e46b78ae-fec9-4bfa-b719-d7e613974351 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:49.669398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e46b78ae-fec9-4bfa-b719-d7e613974351 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:49.691602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e46b78ae-fec9-4bfa-b719-d7e613974351 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:49.692135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e46b78ae-fec9-4bfa-b719-d7e613974351 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:49.692967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e46b78ae-fec9-4bfa-b719-d7e613974351 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:49.693412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e46b78ae-fec9-4bfa-b719-d7e613974351 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:49.719491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e7909218-0bc4-48ca-b995-403c2107a006 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:49.743347 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e7909218-0bc4-48ca-b995-403c2107a006 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.512813 Aug 02 06:55:49.744700 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1165/2464] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:49 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:49.790723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5c676b63-707f-46d8-aa38-3c881734b302 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:49.791347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5c676b63-707f-46d8-aa38-3c881734b302 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:49.805731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c676b63-707f-46d8-aa38-3c881734b302 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:49.806520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c676b63-707f-46d8-aa38-3c881734b302 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:49.812261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c676b63-707f-46d8-aa38-3c881734b302 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:49.812726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c676b63-707f-46d8-aa38-3c881734b302 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:50.010937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5c676b63-707f-46d8-aa38-3c881734b302 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:50.027576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5c676b63-707f-46d8-aa38-3c881734b302 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:50.035146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5c676b63-707f-46d8-aa38-3c881734b302 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:50.036082 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5c676b63-707f-46d8-aa38-3c881734b302 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.249150 Aug 02 06:55:50.058709 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1166/2465] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:49 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:50.192961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e46b78ae-fec9-4bfa-b719-d7e613974351 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:50.229499 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e46b78ae-fec9-4bfa-b719-d7e613974351 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1293 microversion: 2.1 time: 0.577543 Aug 02 06:55:50.230471 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1300/2466] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:49 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1293 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:50.767487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8ce99b51-e99f-4d2e-847e-be508057e110 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:50.768714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8ce99b51-e99f-4d2e-847e-be508057e110 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:50.779505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ce99b51-e99f-4d2e-847e-be508057e110 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:50.779950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ce99b51-e99f-4d2e-847e-be508057e110 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:50.787867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ce99b51-e99f-4d2e-847e-be508057e110 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:50.788546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ce99b51-e99f-4d2e-847e-be508057e110 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:51.066711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6733077c-c7cb-445a-a3b9-a406f7531966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:51.068028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6733077c-c7cb-445a-a3b9-a406f7531966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:51.087889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6733077c-c7cb-445a-a3b9-a406f7531966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:51.089103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6733077c-c7cb-445a-a3b9-a406f7531966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:51.092945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6733077c-c7cb-445a-a3b9-a406f7531966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:51.093675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6733077c-c7cb-445a-a3b9-a406f7531966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:51.212104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8ce99b51-e99f-4d2e-847e-be508057e110 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:51.227913 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8ce99b51-e99f-4d2e-847e-be508057e110 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.464815 Aug 02 06:55:51.229662 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1167/2467] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:50 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:51.251448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-618ff93e-1843-4a94-b8c2-f81207c4bd6a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:51.268113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-618ff93e-1843-4a94-b8c2-f81207c4bd6a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:51.297861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6733077c-c7cb-445a-a3b9-a406f7531966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:51.307165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6733077c-c7cb-445a-a3b9-a406f7531966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:51.307962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-618ff93e-1843-4a94-b8c2-f81207c4bd6a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:51.308471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-618ff93e-1843-4a94-b8c2-f81207c4bd6a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:51.309344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-618ff93e-1843-4a94-b8c2-f81207c4bd6a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:51.309787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-618ff93e-1843-4a94-b8c2-f81207c4bd6a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:51.315456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6733077c-c7cb-445a-a3b9-a406f7531966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:51.317047 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6733077c-c7cb-445a-a3b9-a406f7531966 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.255881 Aug 02 06:55:51.324649 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1301/2468] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:51 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:51.615338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-453032119", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "708bee9a-a41f-42dc-9f8f-ce6d6f1e8f0f"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:51.743896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] validate_networks() for [('708bee9a-a41f-42dc-9f8f-ce6d6f1e8f0f', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:55:51.820156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-618ff93e-1843-4a94-b8c2-f81207c4bd6a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:51.838198 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-618ff93e-1843-4a94-b8c2-f81207c4bd6a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1484 microversion: 2.1 time: 0.590366 Aug 02 06:55:51.840017 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1168/2469] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:51 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1484 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:51.867508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7a021248-dc8c-42f9-94a4-d78c1c4825de tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:51.869217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7a021248-dc8c-42f9-94a4-d78c1c4825de tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:51.888836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a021248-dc8c-42f9-94a4-d78c1c4825de tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:51.889445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a021248-dc8c-42f9-94a4-d78c1c4825de tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:51.890517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a021248-dc8c-42f9-94a4-d78c1c4825de tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:51.894028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a021248-dc8c-42f9-94a4-d78c1c4825de tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:52.206453 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7a021248-dc8c-42f9-94a4-d78c1c4825de tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.347535 Aug 02 06:55:52.207198 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1169/2470] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 06:55:51 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2/os-interface => generated 285 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:52.252770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f5552432-abaf-4285-9f57-5417f82166b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:52.254096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f5552432-abaf-4285-9f57-5417f82166b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:52.269538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5552432-abaf-4285-9f57-5417f82166b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:52.270261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5552432-abaf-4285-9f57-5417f82166b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:52.271991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5552432-abaf-4285-9f57-5417f82166b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:52.272712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5552432-abaf-4285-9f57-5417f82166b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:52.802933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f5552432-abaf-4285-9f57-5417f82166b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:52.817613 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f5552432-abaf-4285-9f57-5417f82166b6 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.562787 Aug 02 06:55:52.819030 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1170/2471] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:52 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:52.854851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d2f7d5e8-8081-4c4e-a255-8d1806171e27 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:52.855646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d2f7d5e8-8081-4c4e-a255-8d1806171e27 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:52.872192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2f7d5e8-8081-4c4e-a255-8d1806171e27 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:52.877115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2f7d5e8-8081-4c4e-a255-8d1806171e27 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:52.878544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2f7d5e8-8081-4c4e-a255-8d1806171e27 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:52.879008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2f7d5e8-8081-4c4e-a255-8d1806171e27 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:53.122487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d2f7d5e8-8081-4c4e-a255-8d1806171e27 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:53.137191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d2f7d5e8-8081-4c4e-a255-8d1806171e27 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:53.139007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d2f7d5e8-8081-4c4e-a255-8d1806171e27 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:53.140391 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d2f7d5e8-8081-4c4e-a255-8d1806171e27 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.319319 Aug 02 06:55:53.142554 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1171/2472] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:52 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:53.810556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:55:53.811107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:55:53.811980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:55:53.812513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:55:53.813035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:55:53.829916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:53.832410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:53.847464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:53.850107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4d27f75c-9228-4172-908a-3a848caf9990 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:53.851041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4d27f75c-9228-4172-908a-3a848caf9990 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:53.855089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:53.862254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d27f75c-9228-4172-908a-3a848caf9990 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:53.876522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d27f75c-9228-4172-908a-3a848caf9990 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:53.877636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d27f75c-9228-4172-908a-3a848caf9990 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:53.878580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d27f75c-9228-4172-908a-3a848caf9990 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:53.902574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Getting quotas for project 42ec92022d4f4cd1b29391bf914459d6. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:55:53.918841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Getting quotas for user 5c9f038a40df4202b3df8df315c1904b and project 42ec92022d4f4cd1b29391bf914459d6. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:55:53.951707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:55:53.954178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:55:54.041916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:54.077111 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d357a26b-2b19-4fbc-9994-382f3fb5e1aa tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.750779 Aug 02 06:55:54.096568 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1302/2473] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:55:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:55:54.104004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-57babfa9-8ae3-48f3-bda5-88d173078b16 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:54.104004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-57babfa9-8ae3-48f3-bda5-88d173078b16 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:54.311906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-57babfa9-8ae3-48f3-bda5-88d173078b16 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:54.320597 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-57babfa9-8ae3-48f3-bda5-88d173078b16 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1223 microversion: 2.1 time: 0.220620 Aug 02 06:55:54.321305 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1303/2474] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:54 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1223 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:54.334574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ddd78799-addd-49a5-aedf-841f2ef76135 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:54.335477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ddd78799-addd-49a5-aedf-841f2ef76135 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:54.344792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ddd78799-addd-49a5-aedf-841f2ef76135 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:54.345332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ddd78799-addd-49a5-aedf-841f2ef76135 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:54.346069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ddd78799-addd-49a5-aedf-841f2ef76135 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:54.358740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ddd78799-addd-49a5-aedf-841f2ef76135 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:54.533709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4d27f75c-9228-4172-908a-3a848caf9990 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:54.564662 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4d27f75c-9228-4172-908a-3a848caf9990 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.720655 Aug 02 06:55:54.566365 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1172/2475] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:53 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:54.624706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ddd78799-addd-49a5-aedf-841f2ef76135 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:54.638027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ddd78799-addd-49a5-aedf-841f2ef76135 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:54.642438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ddd78799-addd-49a5-aedf-841f2ef76135 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:54.646018 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ddd78799-addd-49a5-aedf-841f2ef76135 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.323398 Aug 02 06:55:54.657318 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1304/2476] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:54 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:55.343279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72ffafac-a1d8-46cc-8f47-9771423ced1d tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:55.343932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-72ffafac-a1d8-46cc-8f47-9771423ced1d tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:55.359987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72ffafac-a1d8-46cc-8f47-9771423ced1d tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:55.360472 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72ffafac-a1d8-46cc-8f47-9771423ced1d tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:55.361292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72ffafac-a1d8-46cc-8f47-9771423ced1d tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:55.366772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72ffafac-a1d8-46cc-8f47-9771423ced1d tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:55.503977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-72ffafac-a1d8-46cc-8f47-9771423ced1d tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:55.513031 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-72ffafac-a1d8-46cc-8f47-9771423ced1d tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1219 microversion: 2.1 time: 0.174774 Aug 02 06:55:55.517184 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1173/2477] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:55 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1219 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:55.593700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-74be57e4-8ea3-4bf9-8fb0-a1f6382ee0a1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:55.595856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-74be57e4-8ea3-4bf9-8fb0-a1f6382ee0a1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:55.614456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74be57e4-8ea3-4bf9-8fb0-a1f6382ee0a1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:55.617669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74be57e4-8ea3-4bf9-8fb0-a1f6382ee0a1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:55.627069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74be57e4-8ea3-4bf9-8fb0-a1f6382ee0a1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:55.627802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74be57e4-8ea3-4bf9-8fb0-a1f6382ee0a1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:55.681236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b5b7e0ce-7b81-4ec7-8c67-13ce953239b5 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:55.682993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b5b7e0ce-7b81-4ec7-8c67-13ce953239b5 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:55.695277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5b7e0ce-7b81-4ec7-8c67-13ce953239b5 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:55.716742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5b7e0ce-7b81-4ec7-8c67-13ce953239b5 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:55.720436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5b7e0ce-7b81-4ec7-8c67-13ce953239b5 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:55.720898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5b7e0ce-7b81-4ec7-8c67-13ce953239b5 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:55.986758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b5b7e0ce-7b81-4ec7-8c67-13ce953239b5 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:56.003071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b5b7e0ce-7b81-4ec7-8c67-13ce953239b5 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:56.005173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b5b7e0ce-7b81-4ec7-8c67-13ce953239b5 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:56.006552 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b5b7e0ce-7b81-4ec7-8c67-13ce953239b5 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.333745 Aug 02 06:55:56.007305 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1174/2478] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:55 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:56.011915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3862aea4-827c-4a24-bd7b-61a9829b705a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:56.026889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3862aea4-827c-4a24-bd7b-61a9829b705a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:56.034157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3862aea4-827c-4a24-bd7b-61a9829b705a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:56.034849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3862aea4-827c-4a24-bd7b-61a9829b705a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:56.035822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3862aea4-827c-4a24-bd7b-61a9829b705a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:56.036414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3862aea4-827c-4a24-bd7b-61a9829b705a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:56.049149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-74be57e4-8ea3-4bf9-8fb0-a1f6382ee0a1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:56.057362 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-74be57e4-8ea3-4bf9-8fb0-a1f6382ee0a1 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.468503 Aug 02 06:55:56.059651 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1305/2479] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:55 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:56.064577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b03796b5-bd9f-44c3-8c38-0661f2a883d2 req-d2d89a06-729e-4968-9ea3-f269db034342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c66c14da-356f-4545-830d-93f43f602ca2", "tag": "623de687-c25c-4a70-8b03-fe1359eeddb6"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:55:56.076067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b03796b5-bd9f-44c3-8c38-0661f2a883d2 req-d2d89a06-729e-4968-9ea3-f269db034342 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:56.077595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b03796b5-bd9f-44c3-8c38-0661f2a883d2 req-d2d89a06-729e-4968-9ea3-f269db034342 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:56.098564 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b03796b5-bd9f-44c3-8c38-0661f2a883d2 req-d2d89a06-729e-4968-9ea3-f269db034342 service nova] Creating event network-changed:623de687-c25c-4a70-8b03-fe1359eeddb6 for instance c66c14da-356f-4545-830d-93f43f602ca2 on n-h1-851337-3 Aug 02 06:55:56.107292 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b03796b5-bd9f-44c3-8c38-0661f2a883d2 req-d2d89a06-729e-4968-9ea3-f269db034342 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045600 Aug 02 06:55:56.109347 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1306/2480] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:55:56.387770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3862aea4-827c-4a24-bd7b-61a9829b705a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:56.396879 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3862aea4-827c-4a24-bd7b-61a9829b705a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1484 microversion: 2.1 time: 0.388367 Aug 02 06:55:56.402206 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1175/2481] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:56 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1484 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:56.547325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0d7d8f86-5539-4f34-8dd8-801fcfb66114 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:56.548041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0d7d8f86-5539-4f34-8dd8-801fcfb66114 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:56.561138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d7d8f86-5539-4f34-8dd8-801fcfb66114 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:56.564095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d7d8f86-5539-4f34-8dd8-801fcfb66114 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:56.575001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d7d8f86-5539-4f34-8dd8-801fcfb66114 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:56.575532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d7d8f86-5539-4f34-8dd8-801fcfb66114 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:56.828410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0d7d8f86-5539-4f34-8dd8-801fcfb66114 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:56.852368 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0d7d8f86-5539-4f34-8dd8-801fcfb66114 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1281 microversion: 2.1 time: 0.309009 Aug 02 06:55:56.866655 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1307/2482] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:56 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1281 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:57.037997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-11e4f21b-bc06-4654-a8c2-cf07cffb5812 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:57.041040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-11e4f21b-bc06-4654-a8c2-cf07cffb5812 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:57.076261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11e4f21b-bc06-4654-a8c2-cf07cffb5812 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:57.085680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-56a6c10e-b0cc-4235-b1cb-dbdfb78cbd2b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:57.086629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-56a6c10e-b0cc-4235-b1cb-dbdfb78cbd2b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:57.096832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11e4f21b-bc06-4654-a8c2-cf07cffb5812 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:57.097956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11e4f21b-bc06-4654-a8c2-cf07cffb5812 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:57.098406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11e4f21b-bc06-4654-a8c2-cf07cffb5812 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:57.109538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56a6c10e-b0cc-4235-b1cb-dbdfb78cbd2b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:57.110170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56a6c10e-b0cc-4235-b1cb-dbdfb78cbd2b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:57.115103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56a6c10e-b0cc-4235-b1cb-dbdfb78cbd2b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:57.122973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56a6c10e-b0cc-4235-b1cb-dbdfb78cbd2b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:57.493049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-11e4f21b-bc06-4654-a8c2-cf07cffb5812 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:57.522928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-11e4f21b-bc06-4654-a8c2-cf07cffb5812 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:57.525886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-11e4f21b-bc06-4654-a8c2-cf07cffb5812 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:57.530690 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-11e4f21b-bc06-4654-a8c2-cf07cffb5812 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.498312 Aug 02 06:55:57.532999 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1176/2483] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:57 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:57.721699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-56a6c10e-b0cc-4235-b1cb-dbdfb78cbd2b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:57.732086 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-56a6c10e-b0cc-4235-b1cb-dbdfb78cbd2b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.650273 Aug 02 06:55:57.738982 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1308/2484] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:57 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:57.876347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-93576e9c-fd00-426a-bfdf-13991380061c tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:57.877250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-93576e9c-fd00-426a-bfdf-13991380061c tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:57.889544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93576e9c-fd00-426a-bfdf-13991380061c tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:57.894226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93576e9c-fd00-426a-bfdf-13991380061c tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:57.895345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93576e9c-fd00-426a-bfdf-13991380061c tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:57.895937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93576e9c-fd00-426a-bfdf-13991380061c tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:57.934260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:55:58.029247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-93576e9c-fd00-426a-bfdf-13991380061c tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:58.048694 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-93576e9c-fd00-426a-bfdf-13991380061c tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1281 microversion: 2.1 time: 0.175878 Aug 02 06:55:58.048926 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1177/2485] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:57 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:58.554511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d7ffd329-4042-493d-ab7f-69fcac8b5217 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:58.555707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d7ffd329-4042-493d-ab7f-69fcac8b5217 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:58.565458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7ffd329-4042-493d-ab7f-69fcac8b5217 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:58.566961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7ffd329-4042-493d-ab7f-69fcac8b5217 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:58.567914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7ffd329-4042-493d-ab7f-69fcac8b5217 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:58.571118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7ffd329-4042-493d-ab7f-69fcac8b5217 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:58.755041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-84c37818-327e-4422-8e87-b144f2220dab tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:58.755624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-84c37818-327e-4422-8e87-b144f2220dab tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:58.774332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84c37818-327e-4422-8e87-b144f2220dab tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:58.775381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84c37818-327e-4422-8e87-b144f2220dab tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:58.778206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84c37818-327e-4422-8e87-b144f2220dab tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:58.778848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84c37818-327e-4422-8e87-b144f2220dab tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:58.784455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d7ffd329-4042-493d-ab7f-69fcac8b5217 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:58.799416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d7ffd329-4042-493d-ab7f-69fcac8b5217 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:58.806721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d7ffd329-4042-493d-ab7f-69fcac8b5217 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:58.808242 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d7ffd329-4042-493d-ab7f-69fcac8b5217 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.258167 Aug 02 06:55:58.808924 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1309/2486] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:58 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:55:59.078512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df9f51fa-d86a-4872-a5e0-b7bf9753f0fe tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:59.079649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df9f51fa-d86a-4872-a5e0-b7bf9753f0fe tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:59.100137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df9f51fa-d86a-4872-a5e0-b7bf9753f0fe tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:59.103744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df9f51fa-d86a-4872-a5e0-b7bf9753f0fe tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:59.104939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df9f51fa-d86a-4872-a5e0-b7bf9753f0fe tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:59.105464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df9f51fa-d86a-4872-a5e0-b7bf9753f0fe tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:59.110319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-84c37818-327e-4422-8e87-b144f2220dab tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:59.120613 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-84c37818-327e-4422-8e87-b144f2220dab tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.370043 Aug 02 06:55:59.140502 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1178/2487] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:58 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:59.298153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-df9f51fa-d86a-4872-a5e0-b7bf9753f0fe tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:55:59.310098 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df9f51fa-d86a-4872-a5e0-b7bf9753f0fe tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1281 microversion: 2.1 time: 0.242056 Aug 02 06:55:59.314106 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1310/2488] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:55:59 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1281 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:55:59.833886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8f2873e4-9a9a-4657-876d-0a1417779aed tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:55:59.834543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8f2873e4-9a9a-4657-876d-0a1417779aed tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:55:59.857984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f2873e4-9a9a-4657-876d-0a1417779aed tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:59.858444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f2873e4-9a9a-4657-876d-0a1417779aed tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:55:59.859372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f2873e4-9a9a-4657-876d-0a1417779aed tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:55:59.859908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f2873e4-9a9a-4657-876d-0a1417779aed tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:00.040620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8f2873e4-9a9a-4657-876d-0a1417779aed tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:00.052061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8f2873e4-9a9a-4657-876d-0a1417779aed tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:00.053799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8f2873e4-9a9a-4657-876d-0a1417779aed tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:00.056983 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8f2873e4-9a9a-4657-876d-0a1417779aed tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.226918 Aug 02 06:56:00.073170 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1179/2489] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:55:59 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:56:00.150246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b89c13a6-39ea-4596-a2c0-81e2f38a9b8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:00.150246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b89c13a6-39ea-4596-a2c0-81e2f38a9b8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:00.169453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b89c13a6-39ea-4596-a2c0-81e2f38a9b8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:00.170359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b89c13a6-39ea-4596-a2c0-81e2f38a9b8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:00.171512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b89c13a6-39ea-4596-a2c0-81e2f38a9b8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:00.172184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b89c13a6-39ea-4596-a2c0-81e2f38a9b8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:00.202443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:00.332817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f7fce406-fd26-4d7e-8e79-74bc57688c2f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:00.333436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f7fce406-fd26-4d7e-8e79-74bc57688c2f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:00.352758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7fce406-fd26-4d7e-8e79-74bc57688c2f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:00.353283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7fce406-fd26-4d7e-8e79-74bc57688c2f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:00.354677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7fce406-fd26-4d7e-8e79-74bc57688c2f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:00.355238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7fce406-fd26-4d7e-8e79-74bc57688c2f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:00.666761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b89c13a6-39ea-4596-a2c0-81e2f38a9b8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:00.676805 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b89c13a6-39ea-4596-a2c0-81e2f38a9b8f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.534451 Aug 02 06:56:00.692370 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1311/2490] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:00 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:01.004720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f7fce406-fd26-4d7e-8e79-74bc57688c2f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:01.021708 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f7fce406-fd26-4d7e-8e79-74bc57688c2f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1323 microversion: 2.1 time: 0.692496 Aug 02 06:56:01.024003 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1180/2491] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:00 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1323 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:01.087772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b9c06b5d-22fe-468a-badc-c446c3aab99d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:01.088587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b9c06b5d-22fe-468a-badc-c446c3aab99d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:01.105169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9c06b5d-22fe-468a-badc-c446c3aab99d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:01.106019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9c06b5d-22fe-468a-badc-c446c3aab99d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:01.107000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9c06b5d-22fe-468a-badc-c446c3aab99d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:01.107537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9c06b5d-22fe-468a-badc-c446c3aab99d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:01.222663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-cf2fc001-464e-42e7-8a5a-9d235c94a4d2 req-0c7c9fb6-8379-4af2-bae8-91c8d65fe319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c40a3375-decc-47ef-aa2e-0bd8f38ef407", "tag": "04fd529e-a733-4059-bf00-9954803f29ea"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:01.238907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cf2fc001-464e-42e7-8a5a-9d235c94a4d2 req-0c7c9fb6-8379-4af2-bae8-91c8d65fe319 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:01.239356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cf2fc001-464e-42e7-8a5a-9d235c94a4d2 req-0c7c9fb6-8379-4af2-bae8-91c8d65fe319 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:01.273382 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-cf2fc001-464e-42e7-8a5a-9d235c94a4d2 req-0c7c9fb6-8379-4af2-bae8-91c8d65fe319 service nova] Creating event network-changed:04fd529e-a733-4059-bf00-9954803f29ea for instance c40a3375-decc-47ef-aa2e-0bd8f38ef407 on n-h2-851337-3 Aug 02 06:56:01.278967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b9c06b5d-22fe-468a-badc-c446c3aab99d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:01.289013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b9c06b5d-22fe-468a-badc-c446c3aab99d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:01.298723 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-cf2fc001-464e-42e7-8a5a-9d235c94a4d2 req-0c7c9fb6-8379-4af2-bae8-91c8d65fe319 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076702 Aug 02 06:56:01.299563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b9c06b5d-22fe-468a-badc-c446c3aab99d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:01.300199 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1181/2492] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:01.303040 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b9c06b5d-22fe-468a-badc-c446c3aab99d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.219057 Aug 02 06:56:01.304177 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1312/2493] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:56:01 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:56:01.704669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d8b9e669-3fac-4b86-9057-f47fa10440f5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:01.705401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d8b9e669-3fac-4b86-9057-f47fa10440f5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:01.719349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8b9e669-3fac-4b86-9057-f47fa10440f5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:01.720014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8b9e669-3fac-4b86-9057-f47fa10440f5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:01.722867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8b9e669-3fac-4b86-9057-f47fa10440f5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:01.723761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8b9e669-3fac-4b86-9057-f47fa10440f5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:02.047092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7818b827-c641-4c32-8c20-1e17a9d079cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:02.047719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7818b827-c641-4c32-8c20-1e17a9d079cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:02.055665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7818b827-c641-4c32-8c20-1e17a9d079cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:02.059781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7818b827-c641-4c32-8c20-1e17a9d079cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:02.061797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7818b827-c641-4c32-8c20-1e17a9d079cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:02.063640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7818b827-c641-4c32-8c20-1e17a9d079cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:02.154422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d8b9e669-3fac-4b86-9057-f47fa10440f5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:02.170782 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d8b9e669-3fac-4b86-9057-f47fa10440f5 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.474180 Aug 02 06:56:02.184952 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1182/2494] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:01 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:02.330366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0946a38a-63a2-4b8a-a16b-5f39503c836f tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:02.330986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0946a38a-63a2-4b8a-a16b-5f39503c836f tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:02.337224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0946a38a-63a2-4b8a-a16b-5f39503c836f tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:02.337911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0946a38a-63a2-4b8a-a16b-5f39503c836f tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:02.338994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0946a38a-63a2-4b8a-a16b-5f39503c836f tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:02.339579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0946a38a-63a2-4b8a-a16b-5f39503c836f tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:02.556061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0946a38a-63a2-4b8a-a16b-5f39503c836f tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:02.565147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7818b827-c641-4c32-8c20-1e17a9d079cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:02.576218 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7818b827-c641-4c32-8c20-1e17a9d079cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1323 microversion: 2.1 time: 0.532835 Aug 02 06:56:02.579447 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1313/2495] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:02 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1323 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:56:02.604950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0946a38a-63a2-4b8a-a16b-5f39503c836f tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:02.615458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0946a38a-63a2-4b8a-a16b-5f39503c836f tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:02.635640 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0946a38a-63a2-4b8a-a16b-5f39503c836f tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.290727 Aug 02 06:56:02.637061 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1183/2496] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:56:02 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:56:02.801853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-888a109f-d5f2-4ce0-9ba1-8861033b0d08 tempest-AbsoluteLimitsTestJSON-29651976 tempest-AbsoluteLimitsTestJSON-29651976-project] Calling method '.version_select at 0x7f927a7f4af0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:02.815741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-888a109f-d5f2-4ce0-9ba1-8861033b0d08 tempest-AbsoluteLimitsTestJSON-29651976 tempest-AbsoluteLimitsTestJSON-29651976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:02.816284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-888a109f-d5f2-4ce0-9ba1-8861033b0d08 tempest-AbsoluteLimitsTestJSON-29651976 tempest-AbsoluteLimitsTestJSON-29651976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:02.817374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-888a109f-d5f2-4ce0-9ba1-8861033b0d08 tempest-AbsoluteLimitsTestJSON-29651976 tempest-AbsoluteLimitsTestJSON-29651976-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:02.817925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-888a109f-d5f2-4ce0-9ba1-8861033b0d08 tempest-AbsoluteLimitsTestJSON-29651976 tempest-AbsoluteLimitsTestJSON-29651976-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:02.856105 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-888a109f-d5f2-4ce0-9ba1-8861033b0d08 tempest-AbsoluteLimitsTestJSON-29651976 tempest-AbsoluteLimitsTestJSON-29651976-project] 10.222.0.79 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.275055 Aug 02 06:56:02.863431 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1314/2497] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 2 06:56:02 2022] GET /compute/v2.1/limits => generated 511 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:03.194567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0ad872a2-1152-4a56-be27-49bf34886859 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:03.195776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0ad872a2-1152-4a56-be27-49bf34886859 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:03.210321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ad872a2-1152-4a56-be27-49bf34886859 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:03.211312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ad872a2-1152-4a56-be27-49bf34886859 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:03.216316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ad872a2-1152-4a56-be27-49bf34886859 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:03.216983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ad872a2-1152-4a56-be27-49bf34886859 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:03.552505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0ad872a2-1152-4a56-be27-49bf34886859 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:03.566715 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0ad872a2-1152-4a56-be27-49bf34886859 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1523 microversion: 2.1 time: 0.375434 Aug 02 06:56:03.568219 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1184/2498] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:03 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1523 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:03.606820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-621e1b00-6357-4803-97b6-76d6b9dcfdfd tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:03.607881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-621e1b00-6357-4803-97b6-76d6b9dcfdfd tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:03.623483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-621e1b00-6357-4803-97b6-76d6b9dcfdfd tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:03.625932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-621e1b00-6357-4803-97b6-76d6b9dcfdfd tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:03.627472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-621e1b00-6357-4803-97b6-76d6b9dcfdfd tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:03.630512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-621e1b00-6357-4803-97b6-76d6b9dcfdfd tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:03.666758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cc7b2a6f-4fda-4e64-939b-93d71a023884 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:03.667381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cc7b2a6f-4fda-4e64-939b-93d71a023884 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:03.680169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc7b2a6f-4fda-4e64-939b-93d71a023884 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:03.680777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc7b2a6f-4fda-4e64-939b-93d71a023884 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:03.681624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc7b2a6f-4fda-4e64-939b-93d71a023884 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:03.686857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc7b2a6f-4fda-4e64-939b-93d71a023884 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:03.827866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cc7b2a6f-4fda-4e64-939b-93d71a023884 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:03.856843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cc7b2a6f-4fda-4e64-939b-93d71a023884 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:03.859946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cc7b2a6f-4fda-4e64-939b-93d71a023884 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:03.862464 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cc7b2a6f-4fda-4e64-939b-93d71a023884 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1409 microversion: 2.54 time: 0.199781 Aug 02 06:56:03.865499 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1185/2499] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:56:03 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1409 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:56:03.977700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-621e1b00-6357-4803-97b6-76d6b9dcfdfd tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:04.017865 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-621e1b00-6357-4803-97b6-76d6b9dcfdfd tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1323 microversion: 2.1 time: 0.404700 Aug 02 06:56:04.021240 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1315/2500] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:03 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1323 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:56:04.591071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8abb2bd9-2b8e-4d21-a906-e999a0b54bee tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:04.591720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8abb2bd9-2b8e-4d21-a906-e999a0b54bee tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:04.603832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8abb2bd9-2b8e-4d21-a906-e999a0b54bee tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:04.604647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8abb2bd9-2b8e-4d21-a906-e999a0b54bee tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:04.605785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8abb2bd9-2b8e-4d21-a906-e999a0b54bee tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:04.606408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8abb2bd9-2b8e-4d21-a906-e999a0b54bee tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:04.891937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f4e821c7-cc3c-4003-ad98-9e99cbef3bb2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:04.892578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f4e821c7-cc3c-4003-ad98-9e99cbef3bb2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:04.916222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4e821c7-cc3c-4003-ad98-9e99cbef3bb2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:04.917915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4e821c7-cc3c-4003-ad98-9e99cbef3bb2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:04.924563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4e821c7-cc3c-4003-ad98-9e99cbef3bb2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:04.925160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4e821c7-cc3c-4003-ad98-9e99cbef3bb2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:04.997493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8abb2bd9-2b8e-4d21-a906-e999a0b54bee tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:05.016630 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8abb2bd9-2b8e-4d21-a906-e999a0b54bee tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1503 microversion: 2.1 time: 0.430835 Aug 02 06:56:05.017946 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1186/2501] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:04 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1503 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:05.042067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-807b5092-1aa2-4491-a85f-2bc7b8a69525 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Action: 'create', calling method: .version_select at 0x7f927ac0fa60>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1280232020", "description": "tempest-description-810101334"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:05.170306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f4e821c7-cc3c-4003-ad98-9e99cbef3bb2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:05.186693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f4e821c7-cc3c-4003-ad98-9e99cbef3bb2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:05.193010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f4e821c7-cc3c-4003-ad98-9e99cbef3bb2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:05.194714 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f4e821c7-cc3c-4003-ad98-9e99cbef3bb2 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1415 microversion: 2.54 time: 0.310355 Aug 02 06:56:05.218105 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1316/2502] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:56:04 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1415 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:56:05.238910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-202f1c4f-b6e0-46b4-87fd-bbb422063677 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:05.239628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-202f1c4f-b6e0-46b4-87fd-bbb422063677 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:05.274715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-202f1c4f-b6e0-46b4-87fd-bbb422063677 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:05.275184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-202f1c4f-b6e0-46b4-87fd-bbb422063677 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:05.276415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-202f1c4f-b6e0-46b4-87fd-bbb422063677 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:05.279073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-202f1c4f-b6e0-46b4-87fd-bbb422063677 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:05.921358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-202f1c4f-b6e0-46b4-87fd-bbb422063677 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:05.932996 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-202f1c4f-b6e0-46b4-87fd-bbb422063677 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1323 microversion: 2.1 time: 0.713327 Aug 02 06:56:05.933598 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1317/2503] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:05 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1323 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:06.128142 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-807b5092-1aa2-4491-a85f-2bc7b8a69525 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.090194 Aug 02 06:56:06.130168 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1187/2504] 10.222.0.79 () {60 vars in 1180 bytes} [Tue Aug 2 06:56:05 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:06.144317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5dbbec1b-e817-4537-ad68-57175ddb56ff tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1280232020"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:06.144639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5dbbec1b-e817-4537-ad68-57175ddb56ff tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:06.156842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dbbec1b-e817-4537-ad68-57175ddb56ff tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:06.161404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dbbec1b-e817-4537-ad68-57175ddb56ff tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:06.164809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dbbec1b-e817-4537-ad68-57175ddb56ff tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:06.165228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dbbec1b-e817-4537-ad68-57175ddb56ff tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:06.226638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-750482b0-1729-4c8e-ac10-df34e352bf67 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:06.227700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-750482b0-1729-4c8e-ac10-df34e352bf67 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:06.239855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-750482b0-1729-4c8e-ac10-df34e352bf67 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:06.241525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-750482b0-1729-4c8e-ac10-df34e352bf67 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:06.242573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-750482b0-1729-4c8e-ac10-df34e352bf67 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:06.247860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-750482b0-1729-4c8e-ac10-df34e352bf67 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:06.386960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-750482b0-1729-4c8e-ac10-df34e352bf67 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:06.402819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-750482b0-1729-4c8e-ac10-df34e352bf67 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:06.407659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-750482b0-1729-4c8e-ac10-df34e352bf67 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:06.408909 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-750482b0-1729-4c8e-ac10-df34e352bf67 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1415 microversion: 2.54 time: 0.188086 Aug 02 06:56:06.421931 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1188/2505] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:56:06 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1415 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:56:06.959169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2821a5f5-10d0-4874-9ccd-7b8dedabba8f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:06.985327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2821a5f5-10d0-4874-9ccd-7b8dedabba8f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:07.013161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2821a5f5-10d0-4874-9ccd-7b8dedabba8f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:07.016824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2821a5f5-10d0-4874-9ccd-7b8dedabba8f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:07.018786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2821a5f5-10d0-4874-9ccd-7b8dedabba8f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:07.019503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2821a5f5-10d0-4874-9ccd-7b8dedabba8f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:07.327983 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.network.security_group_api [None req-5dbbec1b-e817-4537-ad68-57175ddb56ff tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Adding security group bca5cf84-cd4c-484d-8adb-2051a58e4d86 to port 7f8d31f5-4723-4ec2-9785-0a3dac02cdca Aug 02 06:56:07.780192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2821a5f5-10d0-4874-9ccd-7b8dedabba8f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:07.794067 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2821a5f5-10d0-4874-9ccd-7b8dedabba8f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1323 microversion: 2.1 time: 0.838818 Aug 02 06:56:07.814877 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1189/2506] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:06 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1323 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:56:07.821540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-23d15a5e-1dd7-428b-97af-0f1b2e8aa0a0 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:07.822390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-23d15a5e-1dd7-428b-97af-0f1b2e8aa0a0 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:07.838363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23d15a5e-1dd7-428b-97af-0f1b2e8aa0a0 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:07.839820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23d15a5e-1dd7-428b-97af-0f1b2e8aa0a0 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:07.840886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23d15a5e-1dd7-428b-97af-0f1b2e8aa0a0 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:07.841547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23d15a5e-1dd7-428b-97af-0f1b2e8aa0a0 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:08.025560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23d15a5e-1dd7-428b-97af-0f1b2e8aa0a0 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:08.038820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23d15a5e-1dd7-428b-97af-0f1b2e8aa0a0 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:08.041358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23d15a5e-1dd7-428b-97af-0f1b2e8aa0a0 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:08.042928 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-23d15a5e-1dd7-428b-97af-0f1b2e8aa0a0 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1400 microversion: 2.54 time: 0.226562 Aug 02 06:56:08.044083 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1190/2507] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:56:07 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1400 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:56:08.071071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f8b02ce6-f27b-46fc-ae8a-bfb1c7c57b92 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '.version_select at 0x7f927b185160>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:08.124775 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f8b02ce6-f27b-46fc-ae8a-bfb1c7c57b92 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2094760971" status: 204 len: 0 microversion: 2.54 time: 0.058614 Aug 02 06:56:08.125590 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1191/2508] 10.222.0.79 () {60 vars in 1319 bytes} [Tue Aug 2 06:56:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2094760971 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 02 06:56:08.137360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-617b8306-e058-4bd2-9374-133f30143b70 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:08.137870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-617b8306-e058-4bd2-9374-133f30143b70 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:08.154314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-617b8306-e058-4bd2-9374-133f30143b70 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:08.154960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-617b8306-e058-4bd2-9374-133f30143b70 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:08.155770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-617b8306-e058-4bd2-9374-133f30143b70 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:08.156209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-617b8306-e058-4bd2-9374-133f30143b70 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:08.189059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-617b8306-e058-4bd2-9374-133f30143b70 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:56:08.372754 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-617b8306-e058-4bd2-9374-133f30143b70 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 204 len: 0 microversion: 2.54 time: 0.239027 Aug 02 06:56:08.373513 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1192/2509] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:56:08 2022] DELETE /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 06:56:08.383803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c016d4f7-2d6b-429b-b000-74217c8cf712 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:08.385011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c016d4f7-2d6b-429b-b000-74217c8cf712 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:08.400356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c016d4f7-2d6b-429b-b000-74217c8cf712 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:08.401035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c016d4f7-2d6b-429b-b000-74217c8cf712 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:08.402208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c016d4f7-2d6b-429b-b000-74217c8cf712 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:08.405349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c016d4f7-2d6b-429b-b000-74217c8cf712 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:08.653159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c016d4f7-2d6b-429b-b000-74217c8cf712 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:08.668583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c016d4f7-2d6b-429b-b000-74217c8cf712 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:08.670245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c016d4f7-2d6b-429b-b000-74217c8cf712 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:08.673918 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c016d4f7-2d6b-429b-b000-74217c8cf712 tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1406 microversion: 2.54 time: 0.295763 Aug 02 06:56:08.679439 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1193/2510] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:56:08 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:56:08.815316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-eed704d6-e060-4e8c-827a-03ad8a5525af tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:08.815935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-eed704d6-e060-4e8c-827a-03ad8a5525af tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:08.828750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eed704d6-e060-4e8c-827a-03ad8a5525af tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:08.833082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eed704d6-e060-4e8c-827a-03ad8a5525af tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:08.833952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eed704d6-e060-4e8c-827a-03ad8a5525af tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:08.834393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eed704d6-e060-4e8c-827a-03ad8a5525af tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:09.227778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-eed704d6-e060-4e8c-827a-03ad8a5525af tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:09.236182 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-eed704d6-e060-4e8c-827a-03ad8a5525af tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1323 microversion: 2.1 time: 0.424709 Aug 02 06:56:09.249960 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1194/2511] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:08 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1323 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:56:09.456391 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5dbbec1b-e817-4537-ad68-57175ddb56ff tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "POST /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32/action" status: 202 len: 0 microversion: 2.1 time: 3.316978 Aug 02 06:56:09.463797 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1318/2512] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:56:06 2022] POST /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32/action => generated 0 bytes in 3323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:56:09.469154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0be591d3-72cc-47b9-9b5e-72b36f91de3f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1280232020"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:09.469700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0be591d3-72cc-47b9-9b5e-72b36f91de3f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:09.491897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0be591d3-72cc-47b9-9b5e-72b36f91de3f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:09.492349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0be591d3-72cc-47b9-9b5e-72b36f91de3f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:09.493133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0be591d3-72cc-47b9-9b5e-72b36f91de3f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:09.494662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0be591d3-72cc-47b9-9b5e-72b36f91de3f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:09.507389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:09.551373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b69aff9d-fda5-4c09-b0fc-32a0fcc4293f req-fe643225-9635-422d-a33a-596cc6fc7700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046c9460-b404-498d-8cae-05a4b2251d32", "tag": "7f8d31f5-4723-4ec2-9785-0a3dac02cdca"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:09.579012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b69aff9d-fda5-4c09-b0fc-32a0fcc4293f req-fe643225-9635-422d-a33a-596cc6fc7700 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:09.579468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b69aff9d-fda5-4c09-b0fc-32a0fcc4293f req-fe643225-9635-422d-a33a-596cc6fc7700 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:09.618977 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b69aff9d-fda5-4c09-b0fc-32a0fcc4293f req-fe643225-9635-422d-a33a-596cc6fc7700 service nova] Creating event network-changed:7f8d31f5-4723-4ec2-9785-0a3dac02cdca for instance 046c9460-b404-498d-8cae-05a4b2251d32 on n-h1-851337-3 Aug 02 06:56:09.650487 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b69aff9d-fda5-4c09-b0fc-32a0fcc4293f req-fe643225-9635-422d-a33a-596cc6fc7700 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090873 Aug 02 06:56:09.652012 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1319/2513] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:09.698003 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b193ec4-7f73-4774-b8f2-f8e9dae31e8d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:09.699063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b193ec4-7f73-4774-b8f2-f8e9dae31e8d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:09.729717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b193ec4-7f73-4774-b8f2-f8e9dae31e8d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:09.730461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b193ec4-7f73-4774-b8f2-f8e9dae31e8d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:09.731499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b193ec4-7f73-4774-b8f2-f8e9dae31e8d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:09.734582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b193ec4-7f73-4774-b8f2-f8e9dae31e8d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:10.126879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7b193ec4-7f73-4774-b8f2-f8e9dae31e8d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:10.159042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7b193ec4-7f73-4774-b8f2-f8e9dae31e8d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:10.165839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7b193ec4-7f73-4774-b8f2-f8e9dae31e8d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9150a20234494548aeb0450c3bb36005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa57214fe4884c30b76bc22ce457c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:10.168375 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b193ec4-7f73-4774-b8f2-f8e9dae31e8d tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 200 len: 1406 microversion: 2.54 time: 0.475352 Aug 02 06:56:10.196324 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1320/2514] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:56:09 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 1406 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:56:10.258038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b7bd1a6-1a3b-4e2b-9c4a-5f7964f29017 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:10.260401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4b7bd1a6-1a3b-4e2b-9c4a-5f7964f29017 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:10.285782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b7bd1a6-1a3b-4e2b-9c4a-5f7964f29017 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:10.292227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b7bd1a6-1a3b-4e2b-9c4a-5f7964f29017 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:10.293602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b7bd1a6-1a3b-4e2b-9c4a-5f7964f29017 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:10.296773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b7bd1a6-1a3b-4e2b-9c4a-5f7964f29017 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:10.587371 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.network.security_group_api [None req-0be591d3-72cc-47b9-9b5e-72b36f91de3f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Removing security group bca5cf84-cd4c-484d-8adb-2051a58e4d86 from port 7f8d31f5-4723-4ec2-9785-0a3dac02cdca Aug 02 06:56:11.273122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4b7bd1a6-1a3b-4e2b-9c4a-5f7964f29017 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:11.290172 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4b7bd1a6-1a3b-4e2b-9c4a-5f7964f29017 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1323 microversion: 2.1 time: 1.036509 Aug 02 06:56:11.292944 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1321/2515] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:10 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1323 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:11.318737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-06494d04-d86a-4c72-9d94-c639510a23ae tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:11.320748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-06494d04-d86a-4c72-9d94-c639510a23ae tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] [instance: 4d1564f2-b48d-4a47-bf10-aa8d81e8db29] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:11.334456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06494d04-d86a-4c72-9d94-c639510a23ae tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:11.335235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06494d04-d86a-4c72-9d94-c639510a23ae tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:11.336512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06494d04-d86a-4c72-9d94-c639510a23ae tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:11.337264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06494d04-d86a-4c72-9d94-c639510a23ae tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:11.373325 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-06494d04-d86a-4c72-9d94-c639510a23ae tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] HTTP exception thrown: Instance 4d1564f2-b48d-4a47-bf10-aa8d81e8db29 could not be found. Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-06494d04-d86a-4c72-9d94-c639510a23ae tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Request method failure captured: Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 HTTP/1.1 Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mpih9FGUjiVYEPHinaVRphmD_5aQaUgGGxowiCyC5VHfp9kbxUqLWg9RRU0pCRVY5gLYic6qqaze9ceJyQYBVPwn7PRRLR2bKhDEuzNqt2pZjCiZgDObMd0lNtLGYBDLsXdxro00FQyVOl2CtJwYqVPc_09uLkhJbKoovgyjb3O2zw Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.54 Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: fa57214fe4884c30b76bc22ce457c98d Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerShowV254Test-476577568 Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fa57214fe4884c30b76bc22ce457c98d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa57214fe4884c30b76bc22ce457c98d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fa57214fe4884c30b76bc22ce457c98d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa57214fe4884c30b76bc22ce457c98d"}]}] Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerShowV254Test-476577568 Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: fa57214fe4884c30b76bc22ce457c98d Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerShowV254Test-476577568 Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerShowV254Test-476577568-project Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 9150a20234494548aeb0450c3bb36005 Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerShowV254Test-476577568-project Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 4d1564f2-b48d-4a47-bf10-aa8d81e8db29 could not be found. Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '4d1564f2-b48d-4a47-bf10-aa8d81e8db29'} Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d1564f2-b48d-4a47-bf10-aa8d81e8db29 could not be found. Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d1564f2-b48d-4a47-bf10-aa8d81e8db29 could not be found. Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:56:11.375693 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:11.380843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:56:11.380843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:56:11.380843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:56:11.380843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:56:11.380843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:56:11.380843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d1564f2-b48d-4a47-bf10-aa8d81e8db29 could not be found. Aug 02 06:56:11.380843 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:11.382479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-06494d04-d86a-4c72-9d94-c639510a23ae tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] Returning 404 to user: Instance 4d1564f2-b48d-4a47-bf10-aa8d81e8db29 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:56:11.383767 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-06494d04-d86a-4c72-9d94-c639510a23ae tempest-ServerShowV254Test-476577568 tempest-ServerShowV254Test-476577568-project] 10.222.0.79 "GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29" status: 404 len: 111 microversion: 2.54 time: 0.083241 Aug 02 06:56:11.388202 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1322/2516] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:56:11 2022] GET /compute/v2.1/servers/4d1564f2-b48d-4a47-bf10-aa8d81e8db29 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:56:11.812858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-eb19826e-5de2-4566-9ecf-69f8129c3cd6 req-6ab2ca22-1075-4dd1-aef2-f3549b21d7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c40a3375-decc-47ef-aa2e-0bd8f38ef407", "name": "network-vif-plugged", "status": "completed", "tag": "04fd529e-a733-4059-bf00-9954803f29ea"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:11.826151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-eb19826e-5de2-4566-9ecf-69f8129c3cd6 req-6ab2ca22-1075-4dd1-aef2-f3549b21d7e2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:11.826958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-eb19826e-5de2-4566-9ecf-69f8129c3cd6 req-6ab2ca22-1075-4dd1-aef2-f3549b21d7e2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:11.842654 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-eb19826e-5de2-4566-9ecf-69f8129c3cd6 req-6ab2ca22-1075-4dd1-aef2-f3549b21d7e2 service nova] Creating event network-vif-plugged:04fd529e-a733-4059-bf00-9954803f29ea for instance c40a3375-decc-47ef-aa2e-0bd8f38ef407 on n-h2-851337-3 Aug 02 06:56:11.848926 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-eb19826e-5de2-4566-9ecf-69f8129c3cd6 req-6ab2ca22-1075-4dd1-aef2-f3549b21d7e2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041862 Aug 02 06:56:11.850361 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1323/2517] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:56:12.314560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-41b90ecb-b26a-4555-91dd-13e6d0807421 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:12.315305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-41b90ecb-b26a-4555-91dd-13e6d0807421 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:12.322059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41b90ecb-b26a-4555-91dd-13e6d0807421 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:12.322838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41b90ecb-b26a-4555-91dd-13e6d0807421 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:12.323851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41b90ecb-b26a-4555-91dd-13e6d0807421 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:12.324481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41b90ecb-b26a-4555-91dd-13e6d0807421 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:12.401665 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0be591d3-72cc-47b9-9b5e-72b36f91de3f tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "POST /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32/action" status: 202 len: 0 microversion: 2.1 time: 2.936617 Aug 02 06:56:12.404355 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1195/2518] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:56:09 2022] POST /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32/action => generated 0 bytes in 2940 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:56:12.420165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0ac4811d-2f5c-4680-824b-8e1897bad3e8 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Action: 'create', calling method: .version_select at 0x7f927ab35820>, body: {"pool": null} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:12.815075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=10 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:12.834086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:13.123575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-41b90ecb-b26a-4555-91dd-13e6d0807421 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:13.135267 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-41b90ecb-b26a-4555-91dd-13e6d0807421 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1323 microversion: 2.1 time: 0.825950 Aug 02 06:56:13.136850 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1324/2519] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:12 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1323 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:13.155027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-34aea437-c977-437e-a16c-59c1eb79ded7 req-dd243a7d-359c-4e7b-8ad7-f025680e8047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046c9460-b404-498d-8cae-05a4b2251d32", "tag": "7f8d31f5-4723-4ec2-9785-0a3dac02cdca"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:13.172755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-34aea437-c977-437e-a16c-59c1eb79ded7 req-dd243a7d-359c-4e7b-8ad7-f025680e8047 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:13.177260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-34aea437-c977-437e-a16c-59c1eb79ded7 req-dd243a7d-359c-4e7b-8ad7-f025680e8047 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:13.202930 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-34aea437-c977-437e-a16c-59c1eb79ded7 req-dd243a7d-359c-4e7b-8ad7-f025680e8047 service nova] Creating event network-changed:7f8d31f5-4723-4ec2-9785-0a3dac02cdca for instance 046c9460-b404-498d-8cae-05a4b2251d32 on n-h1-851337-3 Aug 02 06:56:13.212229 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-34aea437-c977-437e-a16c-59c1eb79ded7 req-dd243a7d-359c-4e7b-8ad7-f025680e8047 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073154 Aug 02 06:56:13.212840 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1325/2520] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:14.159486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c385e780-1fd0-43c2-953a-478f13a097d4 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:14.160796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c385e780-1fd0-43c2-953a-478f13a097d4 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:14.172427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c385e780-1fd0-43c2-953a-478f13a097d4 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:14.177236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c385e780-1fd0-43c2-953a-478f13a097d4 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:14.178274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c385e780-1fd0-43c2-953a-478f13a097d4 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:14.178861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c385e780-1fd0-43c2-953a-478f13a097d4 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:15.546209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c385e780-1fd0-43c2-953a-478f13a097d4 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:15.556647 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c385e780-1fd0-43c2-953a-478f13a097d4 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1520 microversion: 2.1 time: 1.402791 Aug 02 06:56:15.557244 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1326/2521] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:14 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1520 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:15.728928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-71d258f5-9570-4ce8-b74c-7e7f4773ba14 tempest-ExtensionsTest-961530840 tempest-ExtensionsTest-961530840-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:15.730734 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-71d258f5-9570-4ce8-b74c-7e7f4773ba14 tempest-ExtensionsTest-961530840 tempest-ExtensionsTest-961530840-project] 10.222.0.79 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.164553 Aug 02 06:56:15.731677 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1327/2522] 10.222.0.79 () {58 vars in 1170 bytes} [Tue Aug 2 06:56:15 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:15.743677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f8c1f7b1-f7b4-44ef-8d93-0cc9265944ef tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Action: 'create', calling method: .version_select at 0x7f927aa55670>, body: {"pool": null} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:18.286584 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0ac4811d-2f5c-4680-824b-8e1897bad3e8 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.874887 Aug 02 06:56:18.287554 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1196/2523] 10.222.0.79 () {60 vars in 1170 bytes} [Tue Aug 2 06:56:12 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:18.307150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d952cb3e-8c52-48b5-bea6-10a757b46d53 tempest-ExtensionsTest-961530840 tempest-ExtensionsTest-961530840-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:18.310663 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d952cb3e-8c52-48b5-bea6-10a757b46d53 tempest-ExtensionsTest-961530840 tempest-ExtensionsTest-961530840-project] 10.222.0.79 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.021975 Aug 02 06:56:18.314789 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1197/2524] 10.222.0.79 () {58 vars in 1134 bytes} [Tue Aug 2 06:56:18 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:56:18.491027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1359427596", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "f6b00d5e-7f56-40a5-b0ce-21c89ecfebff"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:18.544450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:18.675847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] validate_networks() for [('f6b00d5e-7f56-40a5-b0ce-21c89ecfebff', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:56:19.618576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:19.788599 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f8c1f7b1-f7b4-44ef-8d93-0cc9265944ef tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.055777 Aug 02 06:56:19.797969 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1328/2525] 10.222.0.79 () {60 vars in 1170 bytes} [Tue Aug 2 06:56:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:19.797969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a5136fe9-d6b2-425d-84fb-42469776ce50 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Action: 'action', calling method: .version_select at 0x7f9289d3bb80>, body: {"addFloatingIp": {"address": "172.25.5.63"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:19.797969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a5136fe9-d6b2-425d-84fb-42469776ce50 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:19.812249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5136fe9-d6b2-425d-84fb-42469776ce50 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:19.812705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5136fe9-d6b2-425d-84fb-42469776ce50 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:19.813485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5136fe9-d6b2-425d-84fb-42469776ce50 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:19.813932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5136fe9-d6b2-425d-84fb-42469776ce50 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:19.872343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:56:19.872763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:56:19.873551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:56:19.874377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:56:19.874973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:56:19.897127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:19.899709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:19.900791 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:19.904869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:19.962159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Getting quotas for project 144a45ff8adc4fc08cdac4d62405c1af. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:56:19.978972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Getting quotas for user 82cffd0e8f5e400996b832cf1368b5d1 and project 144a45ff8adc4fc08cdac4d62405c1af. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:56:19.987990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5136fe9-d6b2-425d-84fb-42469776ce50 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Acquired lock "refresh_cache-046c9460-b404-498d-8cae-05a4b2251d32" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 06:56:20.013565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:56:20.016584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:56:20.094742 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f01d53b8-25ac-4ca8-8e1a-50e1e8544338 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.776519 Aug 02 06:56:20.096038 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1198/2526] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:56:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:56:20.793119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1866181219", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "3904ca9d-0f3a-42df-acde-f1e02b7b9720"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:20.916450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] validate_networks() for [('3904ca9d-0f3a-42df-acde-f1e02b7b9720', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:56:22.093404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:56:22.094684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:56:22.095524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:56:22.096156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:56:22.096796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:56:22.125401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:22.127253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:22.134030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:22.136029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:22.219075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Getting quotas for project a004889882844be18e4c30827645050e. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:56:22.243477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Getting quotas for user 0d6870f29383493c86db7e30259b8a8b and project a004889882844be18e4c30827645050e. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:56:22.299872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:56:22.318255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:56:22.461606 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-150f3fc6-ac92-4e50-99ae-df36129f3726 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.362902 Aug 02 06:56:22.470808 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1199/2527] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:56:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:56:22.477546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-614979433", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "708bee9a-a41f-42dc-9f8f-ce6d6f1e8f0f"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:22.564078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] validate_networks() for [('708bee9a-a41f-42dc-9f8f-ce6d6f1e8f0f', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:56:23.815666 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-a5136fe9-d6b2-425d-84fb-42469776ce50 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Building network info cache for instance {{(pid=126120) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 02 06:56:25.507033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:56:25.508531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:56:25.509219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:56:25.509882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:56:25.510525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:56:25.542273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:25.547883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:25.558147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:25.566110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:25.668000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Getting quotas for project 42ec92022d4f4cd1b29391bf914459d6. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:56:25.692668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Getting quotas for user 5c9f038a40df4202b3df8df315c1904b and project 42ec92022d4f4cd1b29391bf914459d6. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:56:25.742941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:56:25.748724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:56:25.932083 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-748bd387-5d9d-418e-8874-1f64132aa9ca tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.457486 Aug 02 06:56:25.934684 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1200/2528] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:56:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:56:25.953460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79f0e390-85cc-46de-9c59-ca4434a290e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:25.958519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79f0e390-85cc-46de-9c59-ca4434a290e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:25.987869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79f0e390-85cc-46de-9c59-ca4434a290e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:25.990126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79f0e390-85cc-46de-9c59-ca4434a290e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:25.993079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79f0e390-85cc-46de-9c59-ca4434a290e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:25.994173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79f0e390-85cc-46de-9c59-ca4434a290e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:26.504761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79f0e390-85cc-46de-9c59-ca4434a290e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:26.518755 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79f0e390-85cc-46de-9c59-ca4434a290e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1269 microversion: 2.1 time: 0.579496 Aug 02 06:56:26.523667 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1201/2529] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:25 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1269 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:26.535136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-50da4ff9-515a-4452-bd9a-b74941de52d8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:26.538694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-50da4ff9-515a-4452-bd9a-b74941de52d8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:26.555865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50da4ff9-515a-4452-bd9a-b74941de52d8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:26.558943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50da4ff9-515a-4452-bd9a-b74941de52d8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:26.560012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50da4ff9-515a-4452-bd9a-b74941de52d8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:26.561051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50da4ff9-515a-4452-bd9a-b74941de52d8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:26.729301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-50da4ff9-515a-4452-bd9a-b74941de52d8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:26.740874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-a5136fe9-d6b2-425d-84fb-42469776ce50 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Updating instance_info_cache with network_info: [{"id": "7f8d31f5-4723-4ec2-9785-0a3dac02cdca", "address": "fa:16:3e:36:c5:04", "network": {"id": "635d7ef5-6ac0-47e7-ae50-ff36b1a4838c", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1320790465-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91617bcce34a4262a0fb661ddb4593bb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7f8d31f5-47", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126120) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 02 06:56:26.747631 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-50da4ff9-515a-4452-bd9a-b74941de52d8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea" status: 200 len: 1273 microversion: 2.1 time: 0.221333 Aug 02 06:56:26.765761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5136fe9-d6b2-425d-84fb-42469776ce50 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Releasing lock "refresh_cache-046c9460-b404-498d-8cae-05a4b2251d32" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 06:56:26.766885 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a5136fe9-d6b2-425d-84fb-42469776ce50 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "POST /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32/action" status: 202 len: 0 microversion: 2.1 time: 6.976264 Aug 02 06:56:26.768066 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1329/2530] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:56:19 2022] POST /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32/action => generated 0 bytes in 6978 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 02 06:56:26.775625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-8d20bfb7-252f-4426-8d8d-d7a0eb8ea980 req-c387a060-d1ec-4171-83cf-343dbf37676b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046c9460-b404-498d-8cae-05a4b2251d32", "tag": "7f8d31f5-4723-4ec2-9785-0a3dac02cdca"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:26.792116 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1202/2531] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:26 2022] GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:26.799731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=57 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:26.807516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8d20bfb7-252f-4426-8d8d-d7a0eb8ea980 req-c387a060-d1ec-4171-83cf-343dbf37676b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:26.808051 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8d20bfb7-252f-4426-8d8d-d7a0eb8ea980 req-c387a060-d1ec-4171-83cf-343dbf37676b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:26.819982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f7ae0d5c-4fec-429d-967b-ff65a0fcfd72 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:26.820936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f7ae0d5c-4fec-429d-967b-ff65a0fcfd72 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:26.854149 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-8d20bfb7-252f-4426-8d8d-d7a0eb8ea980 req-c387a060-d1ec-4171-83cf-343dbf37676b service nova] Creating event network-changed:7f8d31f5-4723-4ec2-9785-0a3dac02cdca for instance 046c9460-b404-498d-8cae-05a4b2251d32 on n-h1-851337-3 Aug 02 06:56:26.874062 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-8d20bfb7-252f-4426-8d8d-d7a0eb8ea980 req-c387a060-d1ec-4171-83cf-343dbf37676b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104602 Aug 02 06:56:26.881372 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1330/2532] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:26.904267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-10ac1563-bc22-44bb-9254-7ff8578ac056 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Action: 'action', calling method: .version_select at 0x7f9289d3baf0>, body: {"removeFloatingIp": {"address": "172.25.5.63"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:27.285582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f7ae0d5c-4fec-429d-967b-ff65a0fcfd72 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:27.305479 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f7ae0d5c-4fec-429d-967b-ff65a0fcfd72 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb" status: 200 len: 1223 microversion: 2.1 time: 0.504835 Aug 02 06:56:27.314111 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1203/2533] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:26 2022] GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb => generated 1223 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:27.558491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-18a97333-ab8f-4571-9318-2630dfb9d143 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:27.559193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-18a97333-ab8f-4571-9318-2630dfb9d143 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:27.587250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18a97333-ab8f-4571-9318-2630dfb9d143 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:27.596074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18a97333-ab8f-4571-9318-2630dfb9d143 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:27.597012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18a97333-ab8f-4571-9318-2630dfb9d143 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:27.598873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18a97333-ab8f-4571-9318-2630dfb9d143 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:27.745103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-10ac1563-bc22-44bb-9254-7ff8578ac056 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:27.755998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10ac1563-bc22-44bb-9254-7ff8578ac056 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:27.766693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10ac1563-bc22-44bb-9254-7ff8578ac056 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:27.767699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10ac1563-bc22-44bb-9254-7ff8578ac056 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:27.768117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10ac1563-bc22-44bb-9254-7ff8578ac056 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:28.421826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-18a97333-ab8f-4571-9318-2630dfb9d143 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:28.437470 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-18a97333-ab8f-4571-9318-2630dfb9d143 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1311 microversion: 2.1 time: 0.894141 Aug 02 06:56:28.439699 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1204/2534] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:27 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1311 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:28.444454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e24a7672-4f36-4d84-b75b-cba5286438b4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:28.445045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e24a7672-4f36-4d84-b75b-cba5286438b4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:28.461545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e24a7672-4f36-4d84-b75b-cba5286438b4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:28.470237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e24a7672-4f36-4d84-b75b-cba5286438b4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:28.471300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e24a7672-4f36-4d84-b75b-cba5286438b4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:28.472619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e24a7672-4f36-4d84-b75b-cba5286438b4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:28.750822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10ac1563-bc22-44bb-9254-7ff8578ac056 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Acquired lock "refresh_cache-046c9460-b404-498d-8cae-05a4b2251d32" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 06:56:29.102881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e24a7672-4f36-4d84-b75b-cba5286438b4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:29.114907 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e24a7672-4f36-4d84-b75b-cba5286438b4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea" status: 200 len: 1315 microversion: 2.1 time: 0.671853 Aug 02 06:56:29.116054 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1205/2535] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:28 2022] GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:29.122207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-10362ca9-b898-4a09-9647-28966b38b9e9 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:29.123358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-10362ca9-b898-4a09-9647-28966b38b9e9 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:29.140721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10362ca9-b898-4a09-9647-28966b38b9e9 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:29.142173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10362ca9-b898-4a09-9647-28966b38b9e9 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:29.143274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10362ca9-b898-4a09-9647-28966b38b9e9 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:29.143939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10362ca9-b898-4a09-9647-28966b38b9e9 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:29.307767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-10362ca9-b898-4a09-9647-28966b38b9e9 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:29.323900 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-10362ca9-b898-4a09-9647-28966b38b9e9 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb" status: 200 len: 1281 microversion: 2.1 time: 0.205747 Aug 02 06:56:29.324794 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1206/2536] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:29 2022] GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb => generated 1281 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:29.657725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a0a5bce9-80b1-4463-9eae-59b8e3585af7 req-1ab60816-99ee-44f9-b690-0042743669f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aed46f8-2bf8-49ea-88bb-ad81d9f715ea", "tag": "96e0f8fd-9a71-4a1f-b891-956641fd0ad3"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:29.682198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a0a5bce9-80b1-4463-9eae-59b8e3585af7 req-1ab60816-99ee-44f9-b690-0042743669f2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:29.682729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a0a5bce9-80b1-4463-9eae-59b8e3585af7 req-1ab60816-99ee-44f9-b690-0042743669f2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:29.696985 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a0a5bce9-80b1-4463-9eae-59b8e3585af7 req-1ab60816-99ee-44f9-b690-0042743669f2 service nova] Creating event network-changed:96e0f8fd-9a71-4a1f-b891-956641fd0ad3 for instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea on n-h2-851337-3 Aug 02 06:56:29.703761 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a0a5bce9-80b1-4463-9eae-59b8e3585af7 req-1ab60816-99ee-44f9-b690-0042743669f2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.377210 Aug 02 06:56:29.705092 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1207/2537] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:29.713105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-54f3b6f9-f20b-4199-9463-7215a5f87405 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:29.714624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-54f3b6f9-f20b-4199-9463-7215a5f87405 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:29.723712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-54f3b6f9-f20b-4199-9463-7215a5f87405 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:29.724465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-54f3b6f9-f20b-4199-9463-7215a5f87405 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:29.725486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-54f3b6f9-f20b-4199-9463-7215a5f87405 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:29.726141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-54f3b6f9-f20b-4199-9463-7215a5f87405 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:30.521726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-54f3b6f9-f20b-4199-9463-7215a5f87405 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:30.545455 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-54f3b6f9-f20b-4199-9463-7215a5f87405 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1311 microversion: 2.1 time: 0.838466 Aug 02 06:56:30.549608 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1208/2538] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:29 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1311 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:30.566280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3cd390ce-7418-4019-b95c-27116740c55a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:30.567185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3cd390ce-7418-4019-b95c-27116740c55a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:30.580344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cd390ce-7418-4019-b95c-27116740c55a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:30.581449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cd390ce-7418-4019-b95c-27116740c55a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:30.582909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cd390ce-7418-4019-b95c-27116740c55a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:30.583572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cd390ce-7418-4019-b95c-27116740c55a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:30.987209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3cd390ce-7418-4019-b95c-27116740c55a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:30.996139 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3cd390ce-7418-4019-b95c-27116740c55a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea" status: 200 len: 1315 microversion: 2.1 time: 0.444931 Aug 02 06:56:31.004264 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1209/2539] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:30 2022] GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:31.012125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7827de81-bda7-4945-be1c-e62b9a2d8487 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:31.013288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7827de81-bda7-4945-be1c-e62b9a2d8487 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:31.022068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7827de81-bda7-4945-be1c-e62b9a2d8487 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:31.030746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7827de81-bda7-4945-be1c-e62b9a2d8487 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:31.032192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7827de81-bda7-4945-be1c-e62b9a2d8487 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:31.032866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7827de81-bda7-4945-be1c-e62b9a2d8487 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:31.409228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7827de81-bda7-4945-be1c-e62b9a2d8487 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:31.420269 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7827de81-bda7-4945-be1c-e62b9a2d8487 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb" status: 200 len: 1323 microversion: 2.1 time: 0.414677 Aug 02 06:56:31.423437 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1210/2540] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:31 2022] GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb => generated 1323 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:31.634836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-10ac1563-bc22-44bb-9254-7ff8578ac056 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Building network info cache for instance {{(pid=126120) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 02 06:56:31.636988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=85,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:31.757379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c8559de1-046c-4003-9d15-81a8f80794bc req-baaec9e2-706b-414e-891e-13791ef7fb08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f4d549d-c723-4b66-a0f7-4be7f9577859", "tag": "1a10ae0c-eb82-416c-badf-e843929702ff"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:31.790599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c8559de1-046c-4003-9d15-81a8f80794bc req-baaec9e2-706b-414e-891e-13791ef7fb08 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:31.797090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c8559de1-046c-4003-9d15-81a8f80794bc req-baaec9e2-706b-414e-891e-13791ef7fb08 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:31.865798 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c8559de1-046c-4003-9d15-81a8f80794bc req-baaec9e2-706b-414e-891e-13791ef7fb08 service nova] Creating event network-changed:1a10ae0c-eb82-416c-badf-e843929702ff for instance 3f4d549d-c723-4b66-a0f7-4be7f9577859 on n-h1-851337-3 Aug 02 06:56:31.878410 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c8559de1-046c-4003-9d15-81a8f80794bc req-baaec9e2-706b-414e-891e-13791ef7fb08 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.429876 Aug 02 06:56:31.883553 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1211/2541] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:56:31.891726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a04568b7-038a-4bdb-994a-8e2068c20b2d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:31.900520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a04568b7-038a-4bdb-994a-8e2068c20b2d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:31.911260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a04568b7-038a-4bdb-994a-8e2068c20b2d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:31.911958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a04568b7-038a-4bdb-994a-8e2068c20b2d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:31.912995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a04568b7-038a-4bdb-994a-8e2068c20b2d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:31.913587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a04568b7-038a-4bdb-994a-8e2068c20b2d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:32.660645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a04568b7-038a-4bdb-994a-8e2068c20b2d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:32.674936 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a04568b7-038a-4bdb-994a-8e2068c20b2d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1311 microversion: 2.1 time: 0.787149 Aug 02 06:56:32.677537 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1212/2542] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:31 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1311 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:32.705186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-72de9268-1296-4b2f-9e00-e38db9f05583 req-fbaad8a5-2fef-4675-8a71-869eeb1c7c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c161a709-ecf1-430e-b412-72a17a3471bb", "tag": "59c5e71d-6342-4430-844e-96aade791e8c"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:32.729851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-72de9268-1296-4b2f-9e00-e38db9f05583 req-fbaad8a5-2fef-4675-8a71-869eeb1c7c24 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:32.732982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-72de9268-1296-4b2f-9e00-e38db9f05583 req-fbaad8a5-2fef-4675-8a71-869eeb1c7c24 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:32.774334 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-72de9268-1296-4b2f-9e00-e38db9f05583 req-fbaad8a5-2fef-4675-8a71-869eeb1c7c24 service nova] Creating event network-changed:59c5e71d-6342-4430-844e-96aade791e8c for instance c161a709-ecf1-430e-b412-72a17a3471bb on n-h1-851337-3 Aug 02 06:56:32.787857 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-72de9268-1296-4b2f-9e00-e38db9f05583 req-fbaad8a5-2fef-4675-8a71-869eeb1c7c24 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097286 Aug 02 06:56:32.789933 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1213/2543] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:32.813250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ebb8295-d1e7-4483-8243-e96c72444b38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:32.818701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ebb8295-d1e7-4483-8243-e96c72444b38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:32.833977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ebb8295-d1e7-4483-8243-e96c72444b38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:32.834710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ebb8295-d1e7-4483-8243-e96c72444b38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:32.839059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ebb8295-d1e7-4483-8243-e96c72444b38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:32.841030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ebb8295-d1e7-4483-8243-e96c72444b38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:32.941457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-10ac1563-bc22-44bb-9254-7ff8578ac056 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Updating instance_info_cache with network_info: [{"id": "7f8d31f5-4723-4ec2-9785-0a3dac02cdca", "address": "fa:16:3e:36:c5:04", "network": {"id": "635d7ef5-6ac0-47e7-ae50-ff36b1a4838c", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1320790465-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "91617bcce34a4262a0fb661ddb4593bb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7f8d31f5-47", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126120) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 02 06:56:32.961830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10ac1563-bc22-44bb-9254-7ff8578ac056 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Releasing lock "refresh_cache-046c9460-b404-498d-8cae-05a4b2251d32" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 06:56:32.965141 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-10ac1563-bc22-44bb-9254-7ff8578ac056 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "POST /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32/action" status: 202 len: 0 microversion: 2.1 time: 6.079422 Aug 02 06:56:32.971131 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1331/2544] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:56:26 2022] POST /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32/action => generated 0 bytes in 6087 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 02 06:56:32.988484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8606c242-6118-4f85-8ff9-d2467b701257 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:32.990742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8606c242-6118-4f85-8ff9-d2467b701257 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:33.006210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8606c242-6118-4f85-8ff9-d2467b701257 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:33.008780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8606c242-6118-4f85-8ff9-d2467b701257 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:33.011969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8606c242-6118-4f85-8ff9-d2467b701257 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:33.014208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8606c242-6118-4f85-8ff9-d2467b701257 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:33.316338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ebb8295-d1e7-4483-8243-e96c72444b38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:33.324492 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ebb8295-d1e7-4483-8243-e96c72444b38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea" status: 200 len: 1315 microversion: 2.1 time: 0.528879 Aug 02 06:56:33.337522 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1214/2545] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:32 2022] GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:33.344615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-55fdcd2d-169e-46e2-a3a1-43286380e95c tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '.version_select at 0x7f927abd6af0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:33.564248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8606c242-6118-4f85-8ff9-d2467b701257 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:33.578362 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8606c242-6118-4f85-8ff9-d2467b701257 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb" status: 200 len: 1323 microversion: 2.1 time: 0.605297 Aug 02 06:56:33.580657 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1332/2546] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:32 2022] GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb => generated 1323 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:33.699524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2c63761b-33f1-4a70-a513-90d7293533a7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:33.700148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2c63761b-33f1-4a70-a513-90d7293533a7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:33.708481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c63761b-33f1-4a70-a513-90d7293533a7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:33.708934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c63761b-33f1-4a70-a513-90d7293533a7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:33.709722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c63761b-33f1-4a70-a513-90d7293533a7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:33.710186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c63761b-33f1-4a70-a513-90d7293533a7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:33.996793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2c63761b-33f1-4a70-a513-90d7293533a7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:34.007012 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2c63761b-33f1-4a70-a513-90d7293533a7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1311 microversion: 2.1 time: 0.311073 Aug 02 06:56:34.009689 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1333/2547] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:33 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1311 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:56:34.184389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-25997285-c8ad-4e89-a751-f26188f88f80 req-18f381dc-f4b3-4319-b6e5-60511835f2af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046c9460-b404-498d-8cae-05a4b2251d32", "tag": "7f8d31f5-4723-4ec2-9785-0a3dac02cdca"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:34.207037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-25997285-c8ad-4e89-a751-f26188f88f80 req-18f381dc-f4b3-4319-b6e5-60511835f2af service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:34.207491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-25997285-c8ad-4e89-a751-f26188f88f80 req-18f381dc-f4b3-4319-b6e5-60511835f2af service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:34.230992 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-25997285-c8ad-4e89-a751-f26188f88f80 req-18f381dc-f4b3-4319-b6e5-60511835f2af service nova] Creating event network-changed:7f8d31f5-4723-4ec2-9785-0a3dac02cdca for instance 046c9460-b404-498d-8cae-05a4b2251d32 on n-h1-851337-3 Aug 02 06:56:34.259671 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-25997285-c8ad-4e89-a751-f26188f88f80 req-18f381dc-f4b3-4319-b6e5-60511835f2af service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079879 Aug 02 06:56:34.263586 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1334/2548] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:56:34.352613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-29baf272-7e16-4512-a554-c140b96327c8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:34.353788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-29baf272-7e16-4512-a554-c140b96327c8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:34.364217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29baf272-7e16-4512-a554-c140b96327c8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:34.365145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29baf272-7e16-4512-a554-c140b96327c8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:34.366297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29baf272-7e16-4512-a554-c140b96327c8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:34.367132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29baf272-7e16-4512-a554-c140b96327c8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:34.559362 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-55fdcd2d-169e-46e2-a3a1-43286380e95c tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/e40d7a4f-3a47-4011-9b4b-4e55f9cbb913" status: 202 len: 0 microversion: 2.1 time: 1.220459 Aug 02 06:56:34.561439 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1215/2549] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 06:56:33 2022] DELETE /compute/v2.1/os-floating-ips/e40d7a4f-3a47-4011-9b4b-4e55f9cbb913 => generated 0 bytes in 1223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:56:34.571836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-2be2c971-dc6e-499e-94ba-fec08d3690b0 req-aa4afd72-5912-4b1c-b8c5-b0c1a38e31af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aed46f8-2bf8-49ea-88bb-ad81d9f715ea", "name": "network-vif-plugged", "status": "completed", "tag": "96e0f8fd-9a71-4a1f-b891-956641fd0ad3"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:34.603392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2be2c971-dc6e-499e-94ba-fec08d3690b0 req-aa4afd72-5912-4b1c-b8c5-b0c1a38e31af service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:34.604348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2be2c971-dc6e-499e-94ba-fec08d3690b0 req-aa4afd72-5912-4b1c-b8c5-b0c1a38e31af service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:34.635317 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-2be2c971-dc6e-499e-94ba-fec08d3690b0 req-aa4afd72-5912-4b1c-b8c5-b0c1a38e31af service nova] Creating event network-vif-plugged:96e0f8fd-9a71-4a1f-b891-956641fd0ad3 for instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea on n-h2-851337-3 Aug 02 06:56:34.641691 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-2be2c971-dc6e-499e-94ba-fec08d3690b0 req-aa4afd72-5912-4b1c-b8c5-b0c1a38e31af service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078150 Aug 02 06:56:34.646162 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1216/2550] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:34.663547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-29baf272-7e16-4512-a554-c140b96327c8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:34.665644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bbf62057-d9d6-4ded-8f64-bb2cdc0cc974 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '.version_select at 0x7f927abd6af0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:34.678940 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-29baf272-7e16-4512-a554-c140b96327c8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea" status: 200 len: 1315 microversion: 2.1 time: 0.330540 Aug 02 06:56:34.680411 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1335/2551] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:34 2022] GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:34.704662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-caa8c02f-c3cd-44b6-bbf5-e2fa6431a5cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:34.706217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-caa8c02f-c3cd-44b6-bbf5-e2fa6431a5cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:34.742784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa8c02f-c3cd-44b6-bbf5-e2fa6431a5cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:34.744187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa8c02f-c3cd-44b6-bbf5-e2fa6431a5cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:34.749250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa8c02f-c3cd-44b6-bbf5-e2fa6431a5cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:34.750176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa8c02f-c3cd-44b6-bbf5-e2fa6431a5cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:35.008623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-caa8c02f-c3cd-44b6-bbf5-e2fa6431a5cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:35.018279 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-caa8c02f-c3cd-44b6-bbf5-e2fa6431a5cb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb" status: 200 len: 1323 microversion: 2.1 time: 0.335029 Aug 02 06:56:35.021752 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1336/2552] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:34 2022] GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:35.030035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-da5ecbf7-f557-4901-98a8-812ac1a6db77 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:35.031512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-da5ecbf7-f557-4901-98a8-812ac1a6db77 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:35.039362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-da5ecbf7-f557-4901-98a8-812ac1a6db77 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:35.040091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-da5ecbf7-f557-4901-98a8-812ac1a6db77 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:35.041346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-da5ecbf7-f557-4901-98a8-812ac1a6db77 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:35.041861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-da5ecbf7-f557-4901-98a8-812ac1a6db77 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:35.056453 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bbf62057-d9d6-4ded-8f64-bb2cdc0cc974 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/bca5cf84-cd4c-484d-8adb-2051a58e4d86" status: 202 len: 0 microversion: 2.1 time: 0.408485 Aug 02 06:56:35.058796 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1217/2553] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 06:56:34 2022] DELETE /compute/v2.1/os-security-groups/bca5cf84-cd4c-484d-8adb-2051a58e4d86 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:56:35.071430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-512e8732-b026-40b5-b4e3-2d6f193c4f06 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:35.072274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-512e8732-b026-40b5-b4e3-2d6f193c4f06 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:35.101548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-512e8732-b026-40b5-b4e3-2d6f193c4f06 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:35.101976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-512e8732-b026-40b5-b4e3-2d6f193c4f06 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:35.103025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-512e8732-b026-40b5-b4e3-2d6f193c4f06 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:35.104353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-512e8732-b026-40b5-b4e3-2d6f193c4f06 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:35.142155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-512e8732-b026-40b5-b4e3-2d6f193c4f06 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:56:35.252713 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-512e8732-b026-40b5-b4e3-2d6f193c4f06 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "DELETE /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 204 len: 0 microversion: 2.1 time: 0.188293 Aug 02 06:56:35.254810 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1218/2554] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:56:35 2022] DELETE /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:56:35.258500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-da5ecbf7-f557-4901-98a8-812ac1a6db77 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:35.265410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dbb0764e-1f80-4896-9af5-59381dcab965 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:35.266243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dbb0764e-1f80-4896-9af5-59381dcab965 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:35.268356 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-da5ecbf7-f557-4901-98a8-812ac1a6db77 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1311 microversion: 2.1 time: 0.243351 Aug 02 06:56:35.269501 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1337/2555] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:35 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1311 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:56:35.288334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbb0764e-1f80-4896-9af5-59381dcab965 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:35.289058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbb0764e-1f80-4896-9af5-59381dcab965 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:35.290129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbb0764e-1f80-4896-9af5-59381dcab965 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:35.290965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbb0764e-1f80-4896-9af5-59381dcab965 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:35.461186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dbb0764e-1f80-4896-9af5-59381dcab965 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:35.469717 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dbb0764e-1f80-4896-9af5-59381dcab965 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1509 microversion: 2.1 time: 0.209599 Aug 02 06:56:35.470809 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1219/2556] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:35 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:56:35.701873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-448a7086-7a7a-438b-b2bd-8beae1473fbf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:35.702766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-448a7086-7a7a-438b-b2bd-8beae1473fbf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:35.712684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-448a7086-7a7a-438b-b2bd-8beae1473fbf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:35.713152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-448a7086-7a7a-438b-b2bd-8beae1473fbf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:35.714033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-448a7086-7a7a-438b-b2bd-8beae1473fbf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:35.714612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-448a7086-7a7a-438b-b2bd-8beae1473fbf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:35.879443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-448a7086-7a7a-438b-b2bd-8beae1473fbf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:35.889177 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-448a7086-7a7a-438b-b2bd-8beae1473fbf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea" status: 200 len: 1315 microversion: 2.1 time: 0.192138 Aug 02 06:56:35.889979 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1338/2557] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:35 2022] GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:36.049175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-25a2b0e7-073c-4c19-940b-f7c0bfe873a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:36.064802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-25a2b0e7-073c-4c19-940b-f7c0bfe873a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:36.068786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:36.091043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25a2b0e7-073c-4c19-940b-f7c0bfe873a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:36.091520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25a2b0e7-073c-4c19-940b-f7c0bfe873a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:36.092328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25a2b0e7-073c-4c19-940b-f7c0bfe873a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:36.092776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25a2b0e7-073c-4c19-940b-f7c0bfe873a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:36.127729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:36.265816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-25a2b0e7-073c-4c19-940b-f7c0bfe873a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:36.276696 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-25a2b0e7-073c-4c19-940b-f7c0bfe873a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb" status: 200 len: 1323 microversion: 2.1 time: 0.233791 Aug 02 06:56:36.282006 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1220/2558] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:36 2022] GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb => generated 1323 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:36.291746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a92a20a-769f-42b6-978c-22a7a5cf1f1e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:36.292375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8a92a20a-769f-42b6-978c-22a7a5cf1f1e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:36.299319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a92a20a-769f-42b6-978c-22a7a5cf1f1e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:36.300024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a92a20a-769f-42b6-978c-22a7a5cf1f1e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:36.300801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a92a20a-769f-42b6-978c-22a7a5cf1f1e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:36.301235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a92a20a-769f-42b6-978c-22a7a5cf1f1e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:36.448720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8a92a20a-769f-42b6-978c-22a7a5cf1f1e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:36.458033 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8a92a20a-769f-42b6-978c-22a7a5cf1f1e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1311 microversion: 2.1 time: 0.169917 Aug 02 06:56:36.458880 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1339/2559] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:36 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1311 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:56:36.493497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c5186df2-6127-4965-b88c-25f40047122b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:36.494144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c5186df2-6127-4965-b88c-25f40047122b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:36.502118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5186df2-6127-4965-b88c-25f40047122b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:36.502562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5186df2-6127-4965-b88c-25f40047122b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:36.503344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5186df2-6127-4965-b88c-25f40047122b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:36.503783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5186df2-6127-4965-b88c-25f40047122b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:36.648371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c5186df2-6127-4965-b88c-25f40047122b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:36.657062 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c5186df2-6127-4965-b88c-25f40047122b tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1509 microversion: 2.1 time: 0.167288 Aug 02 06:56:36.657835 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1221/2560] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:36 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:36.911124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-50d9bca6-7a7d-4530-8e50-b2f5967f2cc8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:36.911979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-50d9bca6-7a7d-4530-8e50-b2f5967f2cc8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:36.919010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50d9bca6-7a7d-4530-8e50-b2f5967f2cc8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:36.919767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50d9bca6-7a7d-4530-8e50-b2f5967f2cc8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:36.920721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50d9bca6-7a7d-4530-8e50-b2f5967f2cc8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:36.921341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50d9bca6-7a7d-4530-8e50-b2f5967f2cc8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:37.092486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-50d9bca6-7a7d-4530-8e50-b2f5967f2cc8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:37.103658 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-50d9bca6-7a7d-4530-8e50-b2f5967f2cc8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea" status: 200 len: 1502 microversion: 2.1 time: 0.196423 Aug 02 06:56:37.104245 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1340/2561] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:36 2022] GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:56:37.124316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-55ec056f-22af-41b2-a6ad-b426be2c5cc7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:37.124873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-55ec056f-22af-41b2-a6ad-b426be2c5cc7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:37.133222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55ec056f-22af-41b2-a6ad-b426be2c5cc7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:37.135304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55ec056f-22af-41b2-a6ad-b426be2c5cc7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:37.136122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55ec056f-22af-41b2-a6ad-b426be2c5cc7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:37.136762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55ec056f-22af-41b2-a6ad-b426be2c5cc7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:37.166291 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-55ec056f-22af-41b2-a6ad-b426be2c5cc7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:56:37.249124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:37.260519 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-55ec056f-22af-41b2-a6ad-b426be2c5cc7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea" status: 204 len: 0 microversion: 2.1 time: 0.140221 Aug 02 06:56:37.261156 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1222/2562] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:56:37 2022] DELETE /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:56:37.269664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fce28b38-4273-40ed-b537-7c5c473b9d10 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:37.270321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fce28b38-4273-40ed-b537-7c5c473b9d10 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:37.277689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fce28b38-4273-40ed-b537-7c5c473b9d10 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:37.278289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fce28b38-4273-40ed-b537-7c5c473b9d10 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:37.279555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fce28b38-4273-40ed-b537-7c5c473b9d10 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:37.280333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fce28b38-4273-40ed-b537-7c5c473b9d10 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:37.302738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3437ea69-e7b6-4780-a50b-3f1cb3565ca0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:37.304475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3437ea69-e7b6-4780-a50b-3f1cb3565ca0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:37.308451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=20 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:37.345114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3437ea69-e7b6-4780-a50b-3f1cb3565ca0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:37.345661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3437ea69-e7b6-4780-a50b-3f1cb3565ca0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:37.346461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3437ea69-e7b6-4780-a50b-3f1cb3565ca0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:37.346892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3437ea69-e7b6-4780-a50b-3f1cb3565ca0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:37.511853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fce28b38-4273-40ed-b537-7c5c473b9d10 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:37.524572 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fce28b38-4273-40ed-b537-7c5c473b9d10 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea" status: 200 len: 1508 microversion: 2.1 time: 0.258372 Aug 02 06:56:37.528938 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1341/2563] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:37 2022] GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea => generated 1508 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:37.546169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4c2313d9-75d9-45ca-9d84-f586c59e9f90 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:37.546169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4c2313d9-75d9-45ca-9d84-f586c59e9f90 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:37.553147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c2313d9-75d9-45ca-9d84-f586c59e9f90 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:37.554016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c2313d9-75d9-45ca-9d84-f586c59e9f90 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:37.554152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3437ea69-e7b6-4780-a50b-3f1cb3565ca0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:37.555473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c2313d9-75d9-45ca-9d84-f586c59e9f90 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:37.556262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c2313d9-75d9-45ca-9d84-f586c59e9f90 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:37.561767 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3437ea69-e7b6-4780-a50b-3f1cb3565ca0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb" status: 200 len: 1323 microversion: 2.1 time: 0.266816 Aug 02 06:56:37.562685 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1223/2564] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:37 2022] GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:37.680753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-33ab8f53-d126-4e42-9d21-f9e00c235b13 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:37.682234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-33ab8f53-d126-4e42-9d21-f9e00c235b13 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:37.689999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33ab8f53-d126-4e42-9d21-f9e00c235b13 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:37.690688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33ab8f53-d126-4e42-9d21-f9e00c235b13 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:37.692536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33ab8f53-d126-4e42-9d21-f9e00c235b13 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:37.693139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33ab8f53-d126-4e42-9d21-f9e00c235b13 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:37.703669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4c2313d9-75d9-45ca-9d84-f586c59e9f90 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:37.713516 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4c2313d9-75d9-45ca-9d84-f586c59e9f90 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1311 microversion: 2.1 time: 0.183335 Aug 02 06:56:37.723260 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1342/2565] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:37 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1311 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:37.863800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-33ab8f53-d126-4e42-9d21-f9e00c235b13 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:37.871730 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-33ab8f53-d126-4e42-9d21-f9e00c235b13 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1509 microversion: 2.1 time: 0.197080 Aug 02 06:56:37.885738 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1224/2566] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:37 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:38.548817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ec5ff695-eb88-4645-81dd-a229f6d1d26c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:38.550702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ec5ff695-eb88-4645-81dd-a229f6d1d26c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:38.558742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec5ff695-eb88-4645-81dd-a229f6d1d26c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:38.559412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec5ff695-eb88-4645-81dd-a229f6d1d26c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:38.560777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec5ff695-eb88-4645-81dd-a229f6d1d26c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:38.561535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec5ff695-eb88-4645-81dd-a229f6d1d26c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:38.582086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3755fdbf-6498-48bf-9a02-00cd5acef0cc tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:38.592379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3755fdbf-6498-48bf-9a02-00cd5acef0cc tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:38.594573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3755fdbf-6498-48bf-9a02-00cd5acef0cc tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Searching by: {'deleted': False, 'project_id': '629c0175113f4f3d9ae413714345b45f'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:56:38.636043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3755fdbf-6498-48bf-9a02-00cd5acef0cc tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:38.639959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3755fdbf-6498-48bf-9a02-00cd5acef0cc tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:38.641715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3755fdbf-6498-48bf-9a02-00cd5acef0cc tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:38.645643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3755fdbf-6498-48bf-9a02-00cd5acef0cc tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:38.718515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-3755fdbf-6498-48bf-9a02-00cd5acef0cc tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:56:38.772773 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3755fdbf-6498-48bf-9a02-00cd5acef0cc tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.196625 Aug 02 06:56:38.784060 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1225/2567] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Aug 2 06:56:38 2022] GET /compute/v2.1/servers => generated 344 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:38.794030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-12a3a4d1-2111-4a94-874c-0d70fe6c0525 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:38.794030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-12a3a4d1-2111-4a94-874c-0d70fe6c0525 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:38.816953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12a3a4d1-2111-4a94-874c-0d70fe6c0525 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:38.820236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12a3a4d1-2111-4a94-874c-0d70fe6c0525 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:38.821249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12a3a4d1-2111-4a94-874c-0d70fe6c0525 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:38.823386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12a3a4d1-2111-4a94-874c-0d70fe6c0525 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:39.256154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ec5ff695-eb88-4645-81dd-a229f6d1d26c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:39.264193 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ec5ff695-eb88-4645-81dd-a229f6d1d26c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea" status: 200 len: 1508 microversion: 2.1 time: 0.719843 Aug 02 06:56:39.277759 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1343/2568] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:38 2022] GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea => generated 1508 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:39.283193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3fb1c0f2-e823-4436-a09b-bd09a8f593df tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:39.285211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3fb1c0f2-e823-4436-a09b-bd09a8f593df tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:39.301481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3fb1c0f2-e823-4436-a09b-bd09a8f593df tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:39.301832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3fb1c0f2-e823-4436-a09b-bd09a8f593df tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:39.302696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3fb1c0f2-e823-4436-a09b-bd09a8f593df tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:39.303139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3fb1c0f2-e823-4436-a09b-bd09a8f593df tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:39.521718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-12a3a4d1-2111-4a94-874c-0d70fe6c0525 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:39.530277 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-12a3a4d1-2111-4a94-874c-0d70fe6c0525 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb" status: 200 len: 1323 microversion: 2.1 time: 0.744809 Aug 02 06:56:39.530872 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1226/2569] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:38 2022] GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb => generated 1323 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:39.542729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9cb50f91-c919-408c-be96-d18087b5f490 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:39.555991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9cb50f91-c919-408c-be96-d18087b5f490 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:39.557232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9cb50f91-c919-408c-be96-d18087b5f490 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Searching by: {'deleted': False, 'project_id': '629c0175113f4f3d9ae413714345b45f'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:56:39.567902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9cb50f91-c919-408c-be96-d18087b5f490 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:39.568786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9cb50f91-c919-408c-be96-d18087b5f490 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:39.571277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9cb50f91-c919-408c-be96-d18087b5f490 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:39.573300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9cb50f91-c919-408c-be96-d18087b5f490 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:39.579872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3fb1c0f2-e823-4436-a09b-bd09a8f593df tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:39.590306 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3fb1c0f2-e823-4436-a09b-bd09a8f593df tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1311 microversion: 2.1 time: 0.310234 Aug 02 06:56:39.604516 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1344/2570] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:39 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1311 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:39.610426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-81c1f9e5-97b5-4e4b-b687-d5e45930f256 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:39.611201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-81c1f9e5-97b5-4e4b-b687-d5e45930f256 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:39.619985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81c1f9e5-97b5-4e4b-b687-d5e45930f256 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:39.620362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81c1f9e5-97b5-4e4b-b687-d5e45930f256 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:39.621140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81c1f9e5-97b5-4e4b-b687-d5e45930f256 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:39.621570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81c1f9e5-97b5-4e4b-b687-d5e45930f256 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:39.663965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-9cb50f91-c919-408c-be96-d18087b5f490 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:56:39.721374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9cb50f91-c919-408c-be96-d18087b5f490 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:39.728624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9cb50f91-c919-408c-be96-d18087b5f490 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:39.729694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9cb50f91-c919-408c-be96-d18087b5f490 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:39.861383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-81c1f9e5-97b5-4e4b-b687-d5e45930f256 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:39.869280 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-81c1f9e5-97b5-4e4b-b687-d5e45930f256 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1509 microversion: 2.1 time: 0.263392 Aug 02 06:56:39.870113 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1345/2571] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:39 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1509 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:39.888996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-a58dffb8-a273-4e22-924f-00472a82822f req-9bc7b797-b46b-4157-8446-c26f3fb67510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aed46f8-2bf8-49ea-88bb-ad81d9f715ea", "name": "network-vif-deleted", "tag": "96e0f8fd-9a71-4a1f-b891-956641fd0ad3"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:39.914473 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9cb50f91-c919-408c-be96-d18087b5f490 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.382138 Aug 02 06:56:39.915075 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1227/2572] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:56:39 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:39.927994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a58dffb8-a273-4e22-924f-00472a82822f req-9bc7b797-b46b-4157-8446-c26f3fb67510 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:39.928659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a58dffb8-a273-4e22-924f-00472a82822f req-9bc7b797-b46b-4157-8446-c26f3fb67510 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:39.941309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-51d010e5-02f8-4489-9cd9-e8429aeb8cf2 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:39.951535 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-51d010e5-02f8-4489-9cd9-e8429aeb8cf2 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016093 Aug 02 06:56:39.955515 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-a58dffb8-a273-4e22-924f-00472a82822f req-9bc7b797-b46b-4157-8446-c26f3fb67510 service nova] Creating event network-vif-deleted:96e0f8fd-9a71-4a1f-b891-956641fd0ad3 for instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea on n-h2-851337-3 Aug 02 06:56:39.959717 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1228/2573] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 06:56:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:39.963072 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-a58dffb8-a273-4e22-924f-00472a82822f req-9bc7b797-b46b-4157-8446-c26f3fb67510 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091571 Aug 02 06:56:39.964460 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1346/2574] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:40.138364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-28de379e-585f-4114-b5d6-06adf265ecaf req-9320a666-b0ee-4d74-a01a-fe84d97c6d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c161a709-ecf1-430e-b412-72a17a3471bb", "name": "network-vif-plugged", "status": "completed", "tag": "59c5e71d-6342-4430-844e-96aade791e8c"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:40.150726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-28de379e-585f-4114-b5d6-06adf265ecaf req-9320a666-b0ee-4d74-a01a-fe84d97c6d74 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:40.151609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-28de379e-585f-4114-b5d6-06adf265ecaf req-9320a666-b0ee-4d74-a01a-fe84d97c6d74 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:40.175727 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-28de379e-585f-4114-b5d6-06adf265ecaf req-9320a666-b0ee-4d74-a01a-fe84d97c6d74 service nova] Creating event network-vif-plugged:59c5e71d-6342-4430-844e-96aade791e8c for instance c161a709-ecf1-430e-b412-72a17a3471bb on n-h1-851337-3 Aug 02 06:56:40.181967 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-28de379e-585f-4114-b5d6-06adf265ecaf req-9320a666-b0ee-4d74-a01a-fe84d97c6d74 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047742 Aug 02 06:56:40.182568 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1229/2575] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:56:40.292572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1691b257-23e7-4267-b725-3da6f0234a2e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:40.293453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1691b257-23e7-4267-b725-3da6f0234a2e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:40.300474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1691b257-23e7-4267-b725-3da6f0234a2e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:40.301132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1691b257-23e7-4267-b725-3da6f0234a2e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:40.302170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1691b257-23e7-4267-b725-3da6f0234a2e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:40.302734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1691b257-23e7-4267-b725-3da6f0234a2e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:40.311480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-888e55fd-d758-4948-837f-b1712aa33449 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:40.312168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-888e55fd-d758-4948-837f-b1712aa33449 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:40.321550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-888e55fd-d758-4948-837f-b1712aa33449 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:40.324483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-888e55fd-d758-4948-837f-b1712aa33449 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:40.326386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-888e55fd-d758-4948-837f-b1712aa33449 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:40.330176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-888e55fd-d758-4948-837f-b1712aa33449 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:40.338168 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-1691b257-23e7-4267-b725-3da6f0234a2e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1691b257-23e7-4267-b725-3da6f0234a2e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea HTTP/1.1 Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '1aed46f8-2bf8-49ea-88bb-ad81d9f715ea'} Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:56:40.342158 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:40.346066 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:56:40.346066 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:56:40.346066 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:56:40.346066 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:56:40.346066 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:56:40.346066 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 06:56:40.346066 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:40.354005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1691b257-23e7-4267-b725-3da6f0234a2e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:56:40.355115 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1691b257-23e7-4267-b725-3da6f0234a2e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea" status: 404 len: 111 microversion: 2.1 time: 0.066852 Aug 02 06:56:40.355908 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1347/2576] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:40 2022] GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:56:40.377271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-888e55fd-d758-4948-837f-b1712aa33449 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:56:40.495575 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-888e55fd-d758-4948-837f-b1712aa33449 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 204 len: 0 microversion: 2.1 time: 0.188459 Aug 02 06:56:40.497143 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1230/2577] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:56:40 2022] DELETE /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 06:56:40.507669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-87236674-4c6d-4a9e-b334-f8b86d033da3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:40.509334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-87236674-4c6d-4a9e-b334-f8b86d033da3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:40.520102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87236674-4c6d-4a9e-b334-f8b86d033da3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:40.521353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87236674-4c6d-4a9e-b334-f8b86d033da3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:40.522485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87236674-4c6d-4a9e-b334-f8b86d033da3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:40.523073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87236674-4c6d-4a9e-b334-f8b86d033da3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:40.535393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-626217576", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "3904ca9d-0f3a-42df-acde-f1e02b7b9720"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:40.620218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] validate_networks() for [('3904ca9d-0f3a-42df-acde-f1e02b7b9720', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:56:40.939557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-87236674-4c6d-4a9e-b334-f8b86d033da3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:40.952775 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-87236674-4c6d-4a9e-b334-f8b86d033da3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1609 microversion: 2.1 time: 0.450265 Aug 02 06:56:40.953963 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1348/2578] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:40 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1609 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:40.959950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fbfb999a-a322-4bd4-9309-08b969184c8b tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:40.960737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fbfb999a-a322-4bd4-9309-08b969184c8b tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:40.967819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbfb999a-a322-4bd4-9309-08b969184c8b tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:40.968566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbfb999a-a322-4bd4-9309-08b969184c8b tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:40.969527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbfb999a-a322-4bd4-9309-08b969184c8b tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:40.970687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbfb999a-a322-4bd4-9309-08b969184c8b tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:41.003000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:41.216375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fbfb999a-a322-4bd4-9309-08b969184c8b tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:41.228306 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fbfb999a-a322-4bd4-9309-08b969184c8b tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb" status: 200 len: 1323 microversion: 2.1 time: 0.273067 Aug 02 06:56:41.229879 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1349/2579] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:40 2022] GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:41.236731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-24f8d9c4-339c-4ae5-9179-6192756ef5a8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:41.237764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-24f8d9c4-339c-4ae5-9179-6192756ef5a8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:41.245488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24f8d9c4-339c-4ae5-9179-6192756ef5a8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:41.246245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24f8d9c4-339c-4ae5-9179-6192756ef5a8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:41.252471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24f8d9c4-339c-4ae5-9179-6192756ef5a8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:41.257972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24f8d9c4-339c-4ae5-9179-6192756ef5a8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:41.373884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:56:41.375249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:56:41.378168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:56:41.379603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:56:41.380389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:56:41.394680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:41.396115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:41.397486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:41.398375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:41.429322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Getting quotas for project a004889882844be18e4c30827645050e. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:56:41.439758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Getting quotas for user 0d6870f29383493c86db7e30259b8a8b and project a004889882844be18e4c30827645050e. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:56:41.446795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-24f8d9c4-339c-4ae5-9179-6192756ef5a8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:41.454449 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-24f8d9c4-339c-4ae5-9179-6192756ef5a8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1311 microversion: 2.1 time: 0.223303 Aug 02 06:56:41.455246 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1350/2580] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:41 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1311 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:41.471864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:56:41.474328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:56:41.475853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-80285619-e31b-4474-bc35-f4f6373ad55e tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:41.476721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-80285619-e31b-4474-bc35-f4f6373ad55e tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:41.484658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80285619-e31b-4474-bc35-f4f6373ad55e tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:41.485967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80285619-e31b-4474-bc35-f4f6373ad55e tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:41.486988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80285619-e31b-4474-bc35-f4f6373ad55e tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:41.488492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80285619-e31b-4474-bc35-f4f6373ad55e tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:41.523882 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7b98e6e6-4f85-4ee4-b78d-3fabc5bb4a51 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994303 Aug 02 06:56:41.524611 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1231/2581] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:56:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:56:41.540347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d7e26fe1-f0e9-4a10-a175-591c317fa8af tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:41.541143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d7e26fe1-f0e9-4a10-a175-591c317fa8af tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:41.659309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d7e26fe1-f0e9-4a10-a175-591c317fa8af tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:41.668579 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d7e26fe1-f0e9-4a10-a175-591c317fa8af tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1214 microversion: 2.1 time: 0.134542 Aug 02 06:56:41.672357 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1232/2582] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:41 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:41.897497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-80285619-e31b-4474-bc35-f4f6373ad55e tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:41.909243 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-80285619-e31b-4474-bc35-f4f6373ad55e tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1509 microversion: 2.1 time: 0.440129 Aug 02 06:56:41.909837 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1351/2583] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:41 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1509 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:41.975659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1ab18014-e4ab-4fa8-93a6-7b1341530a8a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:41.976278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1ab18014-e4ab-4fa8-93a6-7b1341530a8a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:41.990429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ab18014-e4ab-4fa8-93a6-7b1341530a8a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:41.990948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ab18014-e4ab-4fa8-93a6-7b1341530a8a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:41.992509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ab18014-e4ab-4fa8-93a6-7b1341530a8a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:41.992509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ab18014-e4ab-4fa8-93a6-7b1341530a8a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:42.254483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e015f4f2-c45f-4c49-90fa-de52a837aaab tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:42.255101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e015f4f2-c45f-4c49-90fa-de52a837aaab tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:42.264358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e015f4f2-c45f-4c49-90fa-de52a837aaab tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:42.264802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e015f4f2-c45f-4c49-90fa-de52a837aaab tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:42.265583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e015f4f2-c45f-4c49-90fa-de52a837aaab tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:42.266036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e015f4f2-c45f-4c49-90fa-de52a837aaab tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:42.666958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1ab18014-e4ab-4fa8-93a6-7b1341530a8a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:42.703669 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1ab18014-e4ab-4fa8-93a6-7b1341530a8a tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1609 microversion: 2.1 time: 0.731431 Aug 02 06:56:42.706113 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1233/2584] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:41 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1609 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:42.709179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e015f4f2-c45f-4c49-90fa-de52a837aaab tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:42.711750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a20f761c-cc1a-4ea9-a401-42e335c16423 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:42.714149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a20f761c-cc1a-4ea9-a401-42e335c16423 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:42.718438 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e015f4f2-c45f-4c49-90fa-de52a837aaab tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb" status: 200 len: 1323 microversion: 2.1 time: 0.467390 Aug 02 06:56:42.719791 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1352/2585] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:42 2022] GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb => generated 1323 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:56:42.731551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cf094874-c8fc-46af-8f1a-b7df6fe63abd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:42.732449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cf094874-c8fc-46af-8f1a-b7df6fe63abd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:42.732938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a20f761c-cc1a-4ea9-a401-42e335c16423 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:42.733780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a20f761c-cc1a-4ea9-a401-42e335c16423 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:42.734788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a20f761c-cc1a-4ea9-a401-42e335c16423 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:42.735395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a20f761c-cc1a-4ea9-a401-42e335c16423 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:42.740267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf094874-c8fc-46af-8f1a-b7df6fe63abd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:42.741024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf094874-c8fc-46af-8f1a-b7df6fe63abd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:42.742136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf094874-c8fc-46af-8f1a-b7df6fe63abd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:42.742829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf094874-c8fc-46af-8f1a-b7df6fe63abd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:42.839514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cf094874-c8fc-46af-8f1a-b7df6fe63abd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:42.863018 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cf094874-c8fc-46af-8f1a-b7df6fe63abd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1266 microversion: 2.1 time: 0.135942 Aug 02 06:56:42.864199 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1353/2586] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:42 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:42.934930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8427282b-34b9-4f65-a85f-d462fd4b3ad4 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:42.936142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8427282b-34b9-4f65-a85f-d462fd4b3ad4 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:42.955196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8427282b-34b9-4f65-a85f-d462fd4b3ad4 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:42.956323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8427282b-34b9-4f65-a85f-d462fd4b3ad4 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:42.958284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8427282b-34b9-4f65-a85f-d462fd4b3ad4 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:42.958904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8427282b-34b9-4f65-a85f-d462fd4b3ad4 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:43.480063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a20f761c-cc1a-4ea9-a401-42e335c16423 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:43.519758 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a20f761c-cc1a-4ea9-a401-42e335c16423 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1311 microversion: 2.1 time: 0.811793 Aug 02 06:56:43.522712 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1234/2587] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:42 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1311 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:43.543352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-10250cc6-54de-462e-897b-637c8ab3046b req-012f5b86-e9e1-4204-b192-458ae3a0bab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046c9460-b404-498d-8cae-05a4b2251d32", "name": "network-vif-deleted", "tag": "7f8d31f5-4723-4ec2-9785-0a3dac02cdca"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:43.573842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-10250cc6-54de-462e-897b-637c8ab3046b req-012f5b86-e9e1-4204-b192-458ae3a0bab5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:43.575608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-10250cc6-54de-462e-897b-637c8ab3046b req-012f5b86-e9e1-4204-b192-458ae3a0bab5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:43.622348 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-10250cc6-54de-462e-897b-637c8ab3046b req-012f5b86-e9e1-4204-b192-458ae3a0bab5 service nova] Creating event network-vif-deleted:7f8d31f5-4723-4ec2-9785-0a3dac02cdca for instance 046c9460-b404-498d-8cae-05a4b2251d32 on n-h1-851337-3 Aug 02 06:56:43.637212 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-10250cc6-54de-462e-897b-637c8ab3046b req-012f5b86-e9e1-4204-b192-458ae3a0bab5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111438 Aug 02 06:56:43.640246 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1235/2588] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:43.737441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-37141c20-d432-4257-84b7-42137e3a4cd4 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:43.738922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-37141c20-d432-4257-84b7-42137e3a4cd4 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:43.752285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37141c20-d432-4257-84b7-42137e3a4cd4 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:43.754660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37141c20-d432-4257-84b7-42137e3a4cd4 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:43.757881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37141c20-d432-4257-84b7-42137e3a4cd4 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:43.758602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37141c20-d432-4257-84b7-42137e3a4cd4 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:43.766254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8427282b-34b9-4f65-a85f-d462fd4b3ad4 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daaba266be4e4b6b885eff24a3a56d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91617bcce34a4262a0fb661ddb4593bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:43.796782 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8427282b-34b9-4f65-a85f-d462fd4b3ad4 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 200 len: 1509 microversion: 2.1 time: 0.863778 Aug 02 06:56:43.805205 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1354/2589] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:42 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 1509 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:43.822537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b3816b6-8297-4685-b278-f5eb1031df31 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:43.825050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4b3816b6-8297-4685-b278-f5eb1031df31 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:43.845186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b3816b6-8297-4685-b278-f5eb1031df31 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:43.847167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b3816b6-8297-4685-b278-f5eb1031df31 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:43.848917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b3816b6-8297-4685-b278-f5eb1031df31 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:43.852008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b3816b6-8297-4685-b278-f5eb1031df31 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:44.226044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4b3816b6-8297-4685-b278-f5eb1031df31 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:44.245335 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4b3816b6-8297-4685-b278-f5eb1031df31 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb" status: 200 len: 1519 microversion: 2.1 time: 0.428833 Aug 02 06:56:44.246055 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1355/2590] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:43 2022] GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb => generated 1519 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:44.250889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a8b8313d-88a5-4453-88f2-177ff62d26f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:44.251498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a8b8313d-88a5-4453-88f2-177ff62d26f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:44.267248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8b8313d-88a5-4453-88f2-177ff62d26f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:44.267688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8b8313d-88a5-4453-88f2-177ff62d26f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:44.268648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8b8313d-88a5-4453-88f2-177ff62d26f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:44.269229 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8b8313d-88a5-4453-88f2-177ff62d26f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:44.283296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-37141c20-d432-4257-84b7-42137e3a4cd4 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:44.289505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:44.296390 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-37141c20-d432-4257-84b7-42137e3a4cd4 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1609 microversion: 2.1 time: 0.564373 Aug 02 06:56:44.297251 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1236/2591] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:43 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1609 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:44.305953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-639d1001-4f92-400f-9fd6-90923eafb632 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Action: 'action', calling method: .version_select at 0x7f9289da6d30>, body: {"addFloatingIp": {"address": "172.25.5.119"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:44.309936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-639d1001-4f92-400f-9fd6-90923eafb632 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:44.334115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-639d1001-4f92-400f-9fd6-90923eafb632 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:44.339134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-639d1001-4f92-400f-9fd6-90923eafb632 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:44.340294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-639d1001-4f92-400f-9fd6-90923eafb632 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:44.340962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-639d1001-4f92-400f-9fd6-90923eafb632 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:44.417665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a8b8313d-88a5-4453-88f2-177ff62d26f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:44.429366 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a8b8313d-88a5-4453-88f2-177ff62d26f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1272 microversion: 2.1 time: 0.182019 Aug 02 06:56:44.430108 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1356/2592] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:44 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:44.505214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-639d1001-4f92-400f-9fd6-90923eafb632 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Acquired lock "refresh_cache-c40a3375-decc-47ef-aa2e-0bd8f38ef407" {{(pid=126119) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 06:56:44.659786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-a0aae447-eb87-4b11-b93c-5c6d64e4cf51 req-1c1b9a51-9a66-4ade-a7a4-8fe6c28b2af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f4d549d-c723-4b66-a0f7-4be7f9577859", "name": "network-vif-plugged", "status": "completed", "tag": "1a10ae0c-eb82-416c-badf-e843929702ff"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:44.672885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a0aae447-eb87-4b11-b93c-5c6d64e4cf51 req-1c1b9a51-9a66-4ade-a7a4-8fe6c28b2af8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:44.673571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a0aae447-eb87-4b11-b93c-5c6d64e4cf51 req-1c1b9a51-9a66-4ade-a7a4-8fe6c28b2af8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:44.688831 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-a0aae447-eb87-4b11-b93c-5c6d64e4cf51 req-1c1b9a51-9a66-4ade-a7a4-8fe6c28b2af8 service nova] Creating event network-vif-plugged:1a10ae0c-eb82-416c-badf-e843929702ff for instance 3f4d549d-c723-4b66-a0f7-4be7f9577859 on n-h1-851337-3 Aug 02 06:56:44.695850 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-a0aae447-eb87-4b11-b93c-5c6d64e4cf51 req-1c1b9a51-9a66-4ade-a7a4-8fe6c28b2af8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261855 Aug 02 06:56:44.697047 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1357/2593] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:44.704970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-778d08eb-f2ff-4efe-be4a-325fbc5155b9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:44.706085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-778d08eb-f2ff-4efe-be4a-325fbc5155b9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:44.713693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-778d08eb-f2ff-4efe-be4a-325fbc5155b9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:44.714522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-778d08eb-f2ff-4efe-be4a-325fbc5155b9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:44.716334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-778d08eb-f2ff-4efe-be4a-325fbc5155b9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:44.717087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-778d08eb-f2ff-4efe-be4a-325fbc5155b9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:44.914128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-778d08eb-f2ff-4efe-be4a-325fbc5155b9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lazy-loading 'services' on Instance uuid f8b07c5d-4324-4221-a77d-203f65ad3b04 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:56:45.082916 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-778d08eb-f2ff-4efe-be4a-325fbc5155b9 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/os-volume_attachments/d815438a-890f-4ddf-a735-8d9a04380818" status: 202 len: 0 microversion: 2.1 time: 0.382532 Aug 02 06:56:45.083764 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1358/2594] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 06:56:44 2022] DELETE /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/os-volume_attachments/d815438a-890f-4ddf-a735-8d9a04380818 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:56:45.112800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9a377b95-9dc3-43f6-b833-3628f08f613e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:45.120578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9a377b95-9dc3-43f6-b833-3628f08f613e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:45.141262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a377b95-9dc3-43f6-b833-3628f08f613e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:45.143646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a377b95-9dc3-43f6-b833-3628f08f613e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:45.159352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a377b95-9dc3-43f6-b833-3628f08f613e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:45.160422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a377b95-9dc3-43f6-b833-3628f08f613e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:45.691160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9a377b95-9dc3-43f6-b833-3628f08f613e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:45.699144 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9a377b95-9dc3-43f6-b833-3628f08f613e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1311 microversion: 2.1 time: 0.613689 Aug 02 06:56:45.707058 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1359/2595] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:45 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1311 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:45.722556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-16f2cf1a-9839-4102-9082-c69500f611b7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:45.734372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-16f2cf1a-9839-4102-9082-c69500f611b7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] [instance: 046c9460-b404-498d-8cae-05a4b2251d32] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:45.758834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16f2cf1a-9839-4102-9082-c69500f611b7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:45.759902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16f2cf1a-9839-4102-9082-c69500f611b7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:45.764768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16f2cf1a-9839-4102-9082-c69500f611b7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:45.765995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16f2cf1a-9839-4102-9082-c69500f611b7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:45.807313 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-16f2cf1a-9839-4102-9082-c69500f611b7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] HTTP exception thrown: Instance 046c9460-b404-498d-8cae-05a4b2251d32 could not be found. Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-16f2cf1a-9839-4102-9082-c69500f611b7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Request method failure captured: Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 HTTP/1.1 Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MpFnh8CnV2-qKf_di6Dh_nGvhLS5KBkFepeu1mFxQInsGtBiuwSubDNSfO4fuNlHYOjZxpBeaQLX82GAkAJ95kGiBtuoSP4-qDabqqZtyrYJ8M5Xz6RnuNig_nV6gPfu5Oh6give1gBF7GHaE09cNNjibGu62-uAeDbYD0-ScnKrwI Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 91617bcce34a4262a0fb661ddb4593bb Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1846041547 Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/91617bcce34a4262a0fb661ddb4593bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/91617bcce34a4262a0fb661ddb4593bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_91617bcce34a4262a0fb661ddb4593bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/91617bcce34a4262a0fb661ddb4593bb"}]}] Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1846041547 Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 91617bcce34a4262a0fb661ddb4593bb Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1846041547 Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerRescueTestJSONUnderV235-1846041547-project Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: daaba266be4e4b6b885eff24a3a56d61 Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1846041547-project Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 046c9460-b404-498d-8cae-05a4b2251d32 could not be found. Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '046c9460-b404-498d-8cae-05a4b2251d32'} Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 046c9460-b404-498d-8cae-05a4b2251d32 could not be found. Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 046c9460-b404-498d-8cae-05a4b2251d32 could not be found. Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:45.812090 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:56:45.816302 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:45.816302 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:56:45.816302 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:56:45.816302 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:56:45.816302 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:56:45.816302 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:56:45.816302 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 046c9460-b404-498d-8cae-05a4b2251d32 could not be found. Aug 02 06:56:45.816302 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:45.817744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-16f2cf1a-9839-4102-9082-c69500f611b7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] Returning 404 to user: Instance 046c9460-b404-498d-8cae-05a4b2251d32 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:56:45.818786 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-16f2cf1a-9839-4102-9082-c69500f611b7 tempest-ServerRescueTestJSONUnderV235-1846041547 tempest-ServerRescueTestJSONUnderV235-1846041547-project] 10.222.0.79 "GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32" status: 404 len: 111 microversion: 2.1 time: 0.110529 Aug 02 06:56:45.819514 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1360/2596] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:45 2022] GET /compute/v2.1/servers/046c9460-b404-498d-8cae-05a4b2251d32 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:56:45.824492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0a9b7e04-8063-4aeb-8755-6d95a3535ba0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:45.825447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0a9b7e04-8063-4aeb-8755-6d95a3535ba0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:45.833556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a9b7e04-8063-4aeb-8755-6d95a3535ba0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:45.834658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a9b7e04-8063-4aeb-8755-6d95a3535ba0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:45.835710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a9b7e04-8063-4aeb-8755-6d95a3535ba0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:45.836327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a9b7e04-8063-4aeb-8755-6d95a3535ba0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:46.048262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0a9b7e04-8063-4aeb-8755-6d95a3535ba0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:46.058315 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0a9b7e04-8063-4aeb-8755-6d95a3535ba0 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1252 microversion: 2.1 time: 0.237554 Aug 02 06:56:46.075844 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1361/2597] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:45 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1252 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:46.086356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-331cbe61-2b39-46a4-8955-8e1e1c10cc2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:46.086980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-331cbe61-2b39-46a4-8955-8e1e1c10cc2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:46.105277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-331cbe61-2b39-46a4-8955-8e1e1c10cc2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:46.105950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-331cbe61-2b39-46a4-8955-8e1e1c10cc2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:46.117029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-331cbe61-2b39-46a4-8955-8e1e1c10cc2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:46.117825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-331cbe61-2b39-46a4-8955-8e1e1c10cc2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:46.631561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-331cbe61-2b39-46a4-8955-8e1e1c10cc2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:46.639600 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-331cbe61-2b39-46a4-8955-8e1e1c10cc2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1314 microversion: 2.1 time: 0.562052 Aug 02 06:56:46.640389 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1362/2598] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:46 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:46.645159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-780cea64-d0c3-47e5-b969-0c1044c51d9f req-d6785447-3504-435f-b215-f76ff95dbe00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c66c14da-356f-4545-830d-93f43f602ca2", "name": "network-vif-deleted", "tag": "623de687-c25c-4a70-8b03-fe1359eeddb6"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:46.656527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-780cea64-d0c3-47e5-b969-0c1044c51d9f req-d6785447-3504-435f-b215-f76ff95dbe00 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:46.657200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-780cea64-d0c3-47e5-b969-0c1044c51d9f req-d6785447-3504-435f-b215-f76ff95dbe00 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:46.684369 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-780cea64-d0c3-47e5-b969-0c1044c51d9f req-d6785447-3504-435f-b215-f76ff95dbe00 service nova] Creating event network-vif-deleted:623de687-c25c-4a70-8b03-fe1359eeddb6 for instance c66c14da-356f-4545-830d-93f43f602ca2 on n-h1-851337-3 Aug 02 06:56:46.709451 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-780cea64-d0c3-47e5-b969-0c1044c51d9f req-d6785447-3504-435f-b215-f76ff95dbe00 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067522 Aug 02 06:56:46.710884 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1363/2599] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:46.731043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-abc9df29-d232-46de-84e7-4835c91236ad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:46.732510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-abc9df29-d232-46de-84e7-4835c91236ad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:46.764319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abc9df29-d232-46de-84e7-4835c91236ad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:46.765644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abc9df29-d232-46de-84e7-4835c91236ad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:46.767480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abc9df29-d232-46de-84e7-4835c91236ad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:46.767884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abc9df29-d232-46de-84e7-4835c91236ad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:47.240298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-abc9df29-d232-46de-84e7-4835c91236ad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:47.249931 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-abc9df29-d232-46de-84e7-4835c91236ad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1311 microversion: 2.1 time: 0.526336 Aug 02 06:56:47.253000 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1364/2600] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:46 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1311 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:47.261671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e5eebc60-1a5f-4f24-84ee-5d1cc2d61c76 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:47.266792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e5eebc60-1a5f-4f24-84ee-5d1cc2d61c76 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:47.280023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-639d1001-4f92-400f-9fd6-90923eafb632 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Building network info cache for instance {{(pid=126119) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 02 06:56:47.281730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5eebc60-1a5f-4f24-84ee-5d1cc2d61c76 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:47.285267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5eebc60-1a5f-4f24-84ee-5d1cc2d61c76 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:47.286489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5eebc60-1a5f-4f24-84ee-5d1cc2d61c76 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:47.289028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5eebc60-1a5f-4f24-84ee-5d1cc2d61c76 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:47.774452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e5eebc60-1a5f-4f24-84ee-5d1cc2d61c76 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:47.791009 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e5eebc60-1a5f-4f24-84ee-5d1cc2d61c76 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1252 microversion: 2.1 time: 0.536604 Aug 02 06:56:47.796125 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1365/2601] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:47 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1252 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:47.814058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-f37e731c-c81d-4e17-90ed-d10f31922966 req-31817f8b-c2fd-4ae8-90d9-eed965aef266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c40a3375-decc-47ef-aa2e-0bd8f38ef407", "tag": "04fd529e-a733-4059-bf00-9954803f29ea"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:47.831705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f37e731c-c81d-4e17-90ed-d10f31922966 req-31817f8b-c2fd-4ae8-90d9-eed965aef266 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:47.834387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f37e731c-c81d-4e17-90ed-d10f31922966 req-31817f8b-c2fd-4ae8-90d9-eed965aef266 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:47.875193 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f37e731c-c81d-4e17-90ed-d10f31922966 req-31817f8b-c2fd-4ae8-90d9-eed965aef266 service nova] Creating event network-changed:04fd529e-a733-4059-bf00-9954803f29ea for instance c40a3375-decc-47ef-aa2e-0bd8f38ef407 on n-h2-851337-3 Aug 02 06:56:47.887905 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-f37e731c-c81d-4e17-90ed-d10f31922966 req-31817f8b-c2fd-4ae8-90d9-eed965aef266 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090242 Aug 02 06:56:47.891919 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1366/2602] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:47.908717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d7c61d80-7deb-4327-b60d-9741512a6c98 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:47.910699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d7c61d80-7deb-4327-b60d-9741512a6c98 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:47.928678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7c61d80-7deb-4327-b60d-9741512a6c98 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:47.930156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7c61d80-7deb-4327-b60d-9741512a6c98 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:47.931151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7c61d80-7deb-4327-b60d-9741512a6c98 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:47.932505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7c61d80-7deb-4327-b60d-9741512a6c98 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:48.405462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d7c61d80-7deb-4327-b60d-9741512a6c98 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:48.414625 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d7c61d80-7deb-4327-b60d-9741512a6c98 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1314 microversion: 2.1 time: 0.521037 Aug 02 06:56:48.419822 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1367/2603] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:47 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:48.424988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0251ade3-851e-4d69-a8a5-659284033ce3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:48.429647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0251ade3-851e-4d69-a8a5-659284033ce3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:48.451203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0251ade3-851e-4d69-a8a5-659284033ce3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:48.451924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0251ade3-851e-4d69-a8a5-659284033ce3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:48.452887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0251ade3-851e-4d69-a8a5-659284033ce3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:48.453471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0251ade3-851e-4d69-a8a5-659284033ce3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:48.461674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:48.848128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0251ade3-851e-4d69-a8a5-659284033ce3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:48.859153 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0251ade3-851e-4d69-a8a5-659284033ce3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1494 microversion: 2.1 time: 0.437937 Aug 02 06:56:48.876438 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1368/2604] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:48 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1494 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:48.883452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-82cbe6ff-122f-47c0-908d-1093aa6e4073 req-d963714d-58ae-4438-819c-287f0d759270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b32b61f-03ac-477c-b5d0-1606b9694c26", "tag": "f94f468e-537b-4d22-8dbe-f6783b6b592f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:48.894905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-82cbe6ff-122f-47c0-908d-1093aa6e4073 req-d963714d-58ae-4438-819c-287f0d759270 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:48.895454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-82cbe6ff-122f-47c0-908d-1093aa6e4073 req-d963714d-58ae-4438-819c-287f0d759270 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:48.903053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-639d1001-4f92-400f-9fd6-90923eafb632 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Updating instance_info_cache with network_info: [{"id": "04fd529e-a733-4059-bf00-9954803f29ea", "address": "fa:16:3e:30:03:a9", "network": {"id": "708bee9a-a41f-42dc-9f8f-ce6d6f1e8f0f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1512818216-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "42ec92022d4f4cd1b29391bf914459d6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap04fd529e-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126119) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 02 06:56:48.908357 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-82cbe6ff-122f-47c0-908d-1093aa6e4073 req-d963714d-58ae-4438-819c-287f0d759270 service nova] Creating event network-changed:f94f468e-537b-4d22-8dbe-f6783b6b592f for instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 on n-h2-851337-3 Aug 02 06:56:48.913504 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-82cbe6ff-122f-47c0-908d-1093aa6e4073 req-d963714d-58ae-4438-819c-287f0d759270 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035512 Aug 02 06:56:48.915482 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1369/2605] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:48.922326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ca43e31e-e946-42ad-9a17-200156f4ce3f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:48.923338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ca43e31e-e946-42ad-9a17-200156f4ce3f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:48.932221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca43e31e-e946-42ad-9a17-200156f4ce3f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:48.932377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-639d1001-4f92-400f-9fd6-90923eafb632 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Releasing lock "refresh_cache-c40a3375-decc-47ef-aa2e-0bd8f38ef407" {{(pid=126119) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 06:56:48.933361 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-639d1001-4f92-400f-9fd6-90923eafb632 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "POST /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407/action" status: 202 len: 0 microversion: 2.1 time: 4.634885 Aug 02 06:56:48.933555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca43e31e-e946-42ad-9a17-200156f4ce3f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:48.934375 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1237/2606] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:56:44 2022] POST /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407/action => generated 0 bytes in 4636 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 02 06:56:48.935461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca43e31e-e946-42ad-9a17-200156f4ce3f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:48.936084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca43e31e-e946-42ad-9a17-200156f4ce3f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:49.011041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ca43e31e-e946-42ad-9a17-200156f4ce3f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:49.019758 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ca43e31e-e946-42ad-9a17-200156f4ce3f tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1252 microversion: 2.1 time: 0.102596 Aug 02 06:56:49.020369 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1370/2607] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:48 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1252 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:49.039587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-160718fe-cfe7-44d8-b998-aded5907dca7 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.119"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:49.042369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-160718fe-cfe7-44d8-b998-aded5907dca7 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:49.049495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-160718fe-cfe7-44d8-b998-aded5907dca7 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:49.050039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-160718fe-cfe7-44d8-b998-aded5907dca7 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:49.051007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-160718fe-cfe7-44d8-b998-aded5907dca7 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:49.051528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-160718fe-cfe7-44d8-b998-aded5907dca7 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:49.086107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-160718fe-cfe7-44d8-b998-aded5907dca7 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Acquired lock "refresh_cache-c161a709-ecf1-430e-b412-72a17a3471bb" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 06:56:49.432744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-56ca3962-e98b-4f3a-b364-75966859d826 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:49.433345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-56ca3962-e98b-4f3a-b364-75966859d826 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:49.448933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-56ca3962-e98b-4f3a-b364-75966859d826 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:49.449390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-56ca3962-e98b-4f3a-b364-75966859d826 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:49.450212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-56ca3962-e98b-4f3a-b364-75966859d826 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:49.450651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-56ca3962-e98b-4f3a-b364-75966859d826 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:49.946963 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-56ca3962-e98b-4f3a-b364-75966859d826 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1645 microversion: 2.1 time: 1.007676 Aug 02 06:56:49.948190 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1238/2608] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:48 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1645 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:49.958847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8721d9bf-dda8-4bd9-861b-d3be47bc5bbc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:49.963533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8721d9bf-dda8-4bd9-861b-d3be47bc5bbc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:49.988727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8721d9bf-dda8-4bd9-861b-d3be47bc5bbc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:49.989365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8721d9bf-dda8-4bd9-861b-d3be47bc5bbc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:49.994323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8721d9bf-dda8-4bd9-861b-d3be47bc5bbc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:49.996912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8721d9bf-dda8-4bd9-861b-d3be47bc5bbc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:50.465316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8721d9bf-dda8-4bd9-861b-d3be47bc5bbc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:50.474818 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8721d9bf-dda8-4bd9-861b-d3be47bc5bbc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1314 microversion: 2.1 time: 0.525313 Aug 02 06:56:50.475528 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1239/2609] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:49 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:50.493514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7325f40d-c312-4ec5-b35b-f718b1e41d5b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:50.494704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7325f40d-c312-4ec5-b35b-f718b1e41d5b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:50.503597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7325f40d-c312-4ec5-b35b-f718b1e41d5b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:50.504826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7325f40d-c312-4ec5-b35b-f718b1e41d5b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:50.506515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7325f40d-c312-4ec5-b35b-f718b1e41d5b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:50.507220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7325f40d-c312-4ec5-b35b-f718b1e41d5b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:51.022174 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7325f40d-c312-4ec5-b35b-f718b1e41d5b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1645 microversion: 2.1 time: 0.538145 Aug 02 06:56:51.025965 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1240/2610] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:50 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1645 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:51.034570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1e16b7fb-d3bf-4c8a-8cf2-5d95fd1a0a50 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:51.037571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1e16b7fb-d3bf-4c8a-8cf2-5d95fd1a0a50 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:51.052262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e16b7fb-d3bf-4c8a-8cf2-5d95fd1a0a50 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:51.053293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e16b7fb-d3bf-4c8a-8cf2-5d95fd1a0a50 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:51.056255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e16b7fb-d3bf-4c8a-8cf2-5d95fd1a0a50 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:51.058485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e16b7fb-d3bf-4c8a-8cf2-5d95fd1a0a50 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:51.149573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1e16b7fb-d3bf-4c8a-8cf2-5d95fd1a0a50 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:51.162079 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1e16b7fb-d3bf-4c8a-8cf2-5d95fd1a0a50 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1252 microversion: 2.1 time: 0.134222 Aug 02 06:56:51.162684 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1241/2611] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:51 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1252 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:51.175495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-37ea975c-9c49-4bcb-81d7-c96889fa1df1 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:51.182065 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:56:51.182065 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 06:56:51.183464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37ea975c-9c49-4bcb-81d7-c96889fa1df1 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:51.187673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37ea975c-9c49-4bcb-81d7-c96889fa1df1 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:51.188620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37ea975c-9c49-4bcb-81d7-c96889fa1df1 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:51.191285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37ea975c-9c49-4bcb-81d7-c96889fa1df1 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:51.241488 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-37ea975c-9c49-4bcb-81d7-c96889fa1df1 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.077739 Aug 02 06:56:51.242808 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1242/2612] 10.222.0.79 () {58 vars in 1176 bytes} [Tue Aug 2 06:56:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:51.255772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0ebbb5dc-b6a0-4aa9-a4f5-bd52aad2403c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851337-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:51.263064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0ebbb5dc-b6a0-4aa9-a4f5-bd52aad2403c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:51.278009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ebbb5dc-b6a0-4aa9-a4f5-bd52aad2403c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:51.278460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ebbb5dc-b6a0-4aa9-a4f5-bd52aad2403c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:51.279304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ebbb5dc-b6a0-4aa9-a4f5-bd52aad2403c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:51.281459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ebbb5dc-b6a0-4aa9-a4f5-bd52aad2403c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:51.329660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-0ebbb5dc-b6a0-4aa9-a4f5-bd52aad2403c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lazy-loading 'flavor' on Instance uuid 3f4d549d-c723-4b66-a0f7-4be7f9577859 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:56:51.362180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0ebbb5dc-b6a0-4aa9-a4f5-bd52aad2403c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Going to try to live migrate instance to n-h2-851337-3 {{(pid=126119) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 02 06:56:51.666783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=10 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:53.155110 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.network.neutron [None req-160718fe-cfe7-44d8-b998-aded5907dca7 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] re-assign floating IP 172.25.5.119 from instance c40a3375-decc-47ef-aa2e-0bd8f38ef407 Aug 02 06:56:53.272716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-160718fe-cfe7-44d8-b998-aded5907dca7 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Building network info cache for instance {{(pid=126120) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 02 06:56:54.253400 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0ebbb5dc-b6a0-4aa9-a4f5-bd52aad2403c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859/action" status: 202 len: 0 microversion: 2.1 time: 3.002985 Aug 02 06:56:54.254477 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1243/2613] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:56:51 2022] POST /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859/action => generated 0 bytes in 3005 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 06:56:54.264688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b766b5ad-917b-453d-b937-dc12d09edded tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:54.265328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b766b5ad-917b-453d-b937-dc12d09edded tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:54.293504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b766b5ad-917b-453d-b937-dc12d09edded tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:54.306674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b766b5ad-917b-453d-b937-dc12d09edded tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:54.316274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b766b5ad-917b-453d-b937-dc12d09edded tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:54.316987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b766b5ad-917b-453d-b937-dc12d09edded tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:54.346389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-160718fe-cfe7-44d8-b998-aded5907dca7 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Updating instance_info_cache with network_info: [{"id": "04fd529e-a733-4059-bf00-9954803f29ea", "address": "fa:16:3e:30:03:a9", "network": {"id": "708bee9a-a41f-42dc-9f8f-ce6d6f1e8f0f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1512818216-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "42ec92022d4f4cd1b29391bf914459d6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap04fd529e-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126120) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 02 06:56:54.373308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-160718fe-cfe7-44d8-b998-aded5907dca7 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Building network info cache for instance {{(pid=126120) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 02 06:56:54.686522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b766b5ad-917b-453d-b937-dc12d09edded tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:54.706732 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b766b5ad-917b-453d-b937-dc12d09edded tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1314 microversion: 2.1 time: 0.451057 Aug 02 06:56:54.718433 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1244/2614] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:54 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:54.723405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-971279bb-6837-432b-9cb3-197ed79ecfc7 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:54.731730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-971279bb-6837-432b-9cb3-197ed79ecfc7 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:54.756012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-971279bb-6837-432b-9cb3-197ed79ecfc7 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:54.761382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-971279bb-6837-432b-9cb3-197ed79ecfc7 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:54.765466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-971279bb-6837-432b-9cb3-197ed79ecfc7 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:54.766533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-971279bb-6837-432b-9cb3-197ed79ecfc7 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:54.925334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-971279bb-6837-432b-9cb3-197ed79ecfc7 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:54.939329 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-971279bb-6837-432b-9cb3-197ed79ecfc7 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1252 microversion: 2.1 time: 0.227148 Aug 02 06:56:54.939927 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1245/2615] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:54 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1252 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:54.982971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7b0c5fb8-fb00-4c0f-9f2b-2254d4fad718 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:55.003639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b0c5fb8-fb00-4c0f-9f2b-2254d4fad718 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:55.004550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b0c5fb8-fb00-4c0f-9f2b-2254d4fad718 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:55.065743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7b0c5fb8-fb00-4c0f-9f2b-2254d4fad718 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Going to try to stop instance {{(pid=126119) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 06:56:55.173363 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7b0c5fb8-fb00-4c0f-9f2b-2254d4fad718 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "POST /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/action" status: 202 len: 0 microversion: 2.1 time: 0.215409 Aug 02 06:56:55.175932 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1246/2616] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:56:54 2022] POST /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:56:55.200188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-6d0248bc-b0b2-4409-bf9b-aeb653914cbc req-c9c6c09b-009c-4a66-89ca-d38d98da9aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c40a3375-decc-47ef-aa2e-0bd8f38ef407", "tag": "04fd529e-a733-4059-bf00-9954803f29ea"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:55.226035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6d0248bc-b0b2-4409-bf9b-aeb653914cbc req-c9c6c09b-009c-4a66-89ca-d38d98da9aac service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:55.237575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6d0248bc-b0b2-4409-bf9b-aeb653914cbc req-c9c6c09b-009c-4a66-89ca-d38d98da9aac service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:55.258629 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-6d0248bc-b0b2-4409-bf9b-aeb653914cbc req-c9c6c09b-009c-4a66-89ca-d38d98da9aac service nova] Creating event network-changed:04fd529e-a733-4059-bf00-9954803f29ea for instance c40a3375-decc-47ef-aa2e-0bd8f38ef407 on n-h2-851337-3 Aug 02 06:56:55.274380 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-6d0248bc-b0b2-4409-bf9b-aeb653914cbc req-c9c6c09b-009c-4a66-89ca-d38d98da9aac service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085932 Aug 02 06:56:55.297042 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1247/2617] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:55.319829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8bba6e4b-1ce3-4995-8f15-9134dd828e1f req-a24e4e27-c52d-40a7-a3d2-78b06b26b8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b32b61f-03ac-477c-b5d0-1606b9694c26", "name": "network-vif-plugged", "status": "completed", "tag": "f94f468e-537b-4d22-8dbe-f6783b6b592f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:55.354017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8bba6e4b-1ce3-4995-8f15-9134dd828e1f req-a24e4e27-c52d-40a7-a3d2-78b06b26b8ed service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:55.369458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8bba6e4b-1ce3-4995-8f15-9134dd828e1f req-a24e4e27-c52d-40a7-a3d2-78b06b26b8ed service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:55.405747 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8bba6e4b-1ce3-4995-8f15-9134dd828e1f req-a24e4e27-c52d-40a7-a3d2-78b06b26b8ed service nova] Creating event network-vif-plugged:f94f468e-537b-4d22-8dbe-f6783b6b592f for instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 on n-h2-851337-3 Aug 02 06:56:55.421622 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8bba6e4b-1ce3-4995-8f15-9134dd828e1f req-a24e4e27-c52d-40a7-a3d2-78b06b26b8ed service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122697 Aug 02 06:56:55.423841 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1248/2618] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:55.457477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e9e88c69-bb78-4b97-9ede-0f94dc5344c8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:55.465734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e9e88c69-bb78-4b97-9ede-0f94dc5344c8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:55.486409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9e88c69-bb78-4b97-9ede-0f94dc5344c8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:55.496369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9e88c69-bb78-4b97-9ede-0f94dc5344c8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:55.499457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9e88c69-bb78-4b97-9ede-0f94dc5344c8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:55.500084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9e88c69-bb78-4b97-9ede-0f94dc5344c8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:56.395589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e9e88c69-bb78-4b97-9ede-0f94dc5344c8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:56.404211 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e9e88c69-bb78-4b97-9ede-0f94dc5344c8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1504 microversion: 2.1 time: 0.978591 Aug 02 06:56:56.418033 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1249/2619] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:55 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1504 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:56.436102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-48456911-cb51-4f67-b123-7a7869910e57 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:56.437020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-48456911-cb51-4f67-b123-7a7869910e57 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:56.460459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48456911-cb51-4f67-b123-7a7869910e57 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:56.460910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48456911-cb51-4f67-b123-7a7869910e57 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:56.461698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48456911-cb51-4f67-b123-7a7869910e57 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:56.462164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48456911-cb51-4f67-b123-7a7869910e57 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:56.492931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-160718fe-cfe7-44d8-b998-aded5907dca7 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Updating instance_info_cache with network_info: [{"id": "59c5e71d-6342-4430-844e-96aade791e8c", "address": "fa:16:3e:ba:bd:56", "network": {"id": "708bee9a-a41f-42dc-9f8f-ce6d6f1e8f0f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1512818216-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "42ec92022d4f4cd1b29391bf914459d6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap59c5e71d-63", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126120) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 02 06:56:56.515461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-160718fe-cfe7-44d8-b998-aded5907dca7 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Releasing lock "refresh_cache-c161a709-ecf1-430e-b412-72a17a3471bb" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 06:56:56.516833 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-160718fe-cfe7-44d8-b998-aded5907dca7 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "POST /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb/action" status: 202 len: 0 microversion: 2.1 time: 7.485324 Aug 02 06:56:56.518348 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1371/2620] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:56:49 2022] POST /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb/action => generated 0 bytes in 7497 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 02 06:56:56.529685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2d5472e6-a018-4335-a06d-610f3b82745e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:56.530745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2d5472e6-a018-4335-a06d-610f3b82745e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:56.539118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d5472e6-a018-4335-a06d-610f3b82745e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:56.539914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d5472e6-a018-4335-a06d-610f3b82745e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:56.541687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d5472e6-a018-4335-a06d-610f3b82745e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:56.542439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d5472e6-a018-4335-a06d-610f3b82745e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:57.178062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-48456911-cb51-4f67-b123-7a7869910e57 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:57.217612 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-48456911-cb51-4f67-b123-7a7869910e57 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1678 microversion: 2.1 time: 0.796618 Aug 02 06:56:57.219342 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1250/2621] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:56 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1678 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:57.230348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fdb54c46-c88e-4985-93a2-d139ea0c88b3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:57.231199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fdb54c46-c88e-4985-93a2-d139ea0c88b3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:57.247505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fdb54c46-c88e-4985-93a2-d139ea0c88b3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:57.248259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fdb54c46-c88e-4985-93a2-d139ea0c88b3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:57.250574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fdb54c46-c88e-4985-93a2-d139ea0c88b3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:57.251170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fdb54c46-c88e-4985-93a2-d139ea0c88b3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:57.273747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2d5472e6-a018-4335-a06d-610f3b82745e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:57.315615 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2d5472e6-a018-4335-a06d-610f3b82745e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1314 microversion: 2.1 time: 0.790626 Aug 02 06:56:57.315998 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1372/2622] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:56 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1314 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:57.357218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-f2fb6f71-6d37-45e9-99d5-202fa076b2b0 req-dc4219a4-27f8-4f46-bfc2-84fb562fef3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f4d549d-c723-4b66-a0f7-4be7f9577859", "name": "network-vif-unplugged", "status": "completed", "tag": "1a10ae0c-eb82-416c-badf-e843929702ff"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:57.367861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=86 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:57.371659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f2fb6f71-6d37-45e9-99d5-202fa076b2b0 req-dc4219a4-27f8-4f46-bfc2-84fb562fef3e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:57.372256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f2fb6f71-6d37-45e9-99d5-202fa076b2b0 req-dc4219a4-27f8-4f46-bfc2-84fb562fef3e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:57.390509 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f2fb6f71-6d37-45e9-99d5-202fa076b2b0 req-dc4219a4-27f8-4f46-bfc2-84fb562fef3e service nova] Creating event network-vif-unplugged:1a10ae0c-eb82-416c-badf-e843929702ff for instance 3f4d549d-c723-4b66-a0f7-4be7f9577859 on n-h1-851337-3 Aug 02 06:56:57.396926 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-f2fb6f71-6d37-45e9-99d5-202fa076b2b0 req-dc4219a4-27f8-4f46-bfc2-84fb562fef3e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046518 Aug 02 06:56:57.397936 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1373/2623] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:57.405733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c148f62-a115-455f-97cf-1e4172bc4219 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.119"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:57.547757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fdb54c46-c88e-4985-93a2-d139ea0c88b3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:57.550850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:56:57.562872 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fdb54c46-c88e-4985-93a2-d139ea0c88b3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1252 microversion: 2.1 time: 0.342409 Aug 02 06:56:57.568072 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1251/2624] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:57 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1252 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:57.574635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b7e3bc71-8f3f-4c81-a37a-1b31d06f197d req-e0e00d72-a0dc-410d-a854-ab45f68958b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c161a709-ecf1-430e-b412-72a17a3471bb", "tag": "59c5e71d-6342-4430-844e-96aade791e8c"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:57.602494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b7e3bc71-8f3f-4c81-a37a-1b31d06f197d req-e0e00d72-a0dc-410d-a854-ab45f68958b1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:57.603240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b7e3bc71-8f3f-4c81-a37a-1b31d06f197d req-e0e00d72-a0dc-410d-a854-ab45f68958b1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:57.647900 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b7e3bc71-8f3f-4c81-a37a-1b31d06f197d req-e0e00d72-a0dc-410d-a854-ab45f68958b1 service nova] Creating event network-changed:59c5e71d-6342-4430-844e-96aade791e8c for instance c161a709-ecf1-430e-b412-72a17a3471bb on n-h1-851337-3 Aug 02 06:56:57.663461 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b7e3bc71-8f3f-4c81-a37a-1b31d06f197d req-e0e00d72-a0dc-410d-a854-ab45f68958b1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092254 Aug 02 06:56:57.664098 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1252/2625] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:57.679017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-38d0f9dd-a441-46d9-be15-019a188d5a3e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:57.681238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-38d0f9dd-a441-46d9-be15-019a188d5a3e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:57.695197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38d0f9dd-a441-46d9-be15-019a188d5a3e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:57.699632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38d0f9dd-a441-46d9-be15-019a188d5a3e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:57.700742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38d0f9dd-a441-46d9-be15-019a188d5a3e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:57.703949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38d0f9dd-a441-46d9-be15-019a188d5a3e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:58.075860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9c148f62-a115-455f-97cf-1e4172bc4219 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:58.085815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c148f62-a115-455f-97cf-1e4172bc4219 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:58.086352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c148f62-a115-455f-97cf-1e4172bc4219 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:58.089078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c148f62-a115-455f-97cf-1e4172bc4219 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:58.090069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c148f62-a115-455f-97cf-1e4172bc4219 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:58.245675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-38d0f9dd-a441-46d9-be15-019a188d5a3e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:58.258224 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-38d0f9dd-a441-46d9-be15-019a188d5a3e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1504 microversion: 2.1 time: 0.588531 Aug 02 06:56:58.259109 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1253/2626] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:57 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1504 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:58.264104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-95670f94-af32-4abf-a2c9-767622b4a26e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:58.272136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-95670f94-af32-4abf-a2c9-767622b4a26e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:58.280310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95670f94-af32-4abf-a2c9-767622b4a26e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:58.282222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95670f94-af32-4abf-a2c9-767622b4a26e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:58.283163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95670f94-af32-4abf-a2c9-767622b4a26e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:58.287354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95670f94-af32-4abf-a2c9-767622b4a26e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:58.468513 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-9c148f62-a115-455f-97cf-1e4172bc4219 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] HTTP exception thrown: Floating IP 172.25.5.119 is not associated with instance c40a3375-decc-47ef-aa2e-0bd8f38ef407. Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c148f62-a115-455f-97cf-1e4172bc4219 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Request method failure captured: Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407/action HTTP/1.1 Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 49 Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mp2hyhv3Fv4s36MkcFcau5vsg8pyLPW2AoJoY4nZxLc1KrRX4fnmw19oJ2J2UoFsIG_Z1KDiF1mSz1qZTp5aHNXhQ4TqCNEnbxohRIr_Bo3azCeYhgWtymWj8x61NPqaSCpLl1ZiZIq8hck35HhiHWUgpnTBHdbCsEWnyILdoLhQP4 Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 42ec92022d4f4cd1b29391bf914459d6 Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-557210961 Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/42ec92022d4f4cd1b29391bf914459d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/42ec92022d4f4cd1b29391bf914459d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_42ec92022d4f4cd1b29391bf914459d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/42ec92022d4f4cd1b29391bf914459d6"}]}] Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-557210961 Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 42ec92022d4f4cd1b29391bf914459d6 Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-557210961 Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-FloatingIPsAssociationTestJSON-557210961-project Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5c9f038a40df4202b3df8df315c1904b Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-557210961-project Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: {"removeFloatingIp": {"address": "172.25.5.119"}} Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: exception: Floating IP 172.25.5.119 is not associated with instance c40a3375-decc-47ef-aa2e-0bd8f38ef407. Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'c40a3375-decc-47ef-aa2e-0bd8f38ef407', 'body': {'removeFloatingIp': {'address': '172.25.5.119'}}} Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.5.119 is not associated with instance c40a3375-decc-47ef-aa2e-0bd8f38ef407. Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.5.119 is not associated with instance c40a3375-decc-47ef-aa2e-0bd8f38ef407. Aug 02 06:56:58.470407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:56:58.475561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c148f62-a115-455f-97cf-1e4172bc4219 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Returning 409 to user: Floating IP 172.25.5.119 is not associated with instance c40a3375-decc-47ef-aa2e-0bd8f38ef407. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:56:58.476592 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9c148f62-a115-455f-97cf-1e4172bc4219 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "POST /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407/action" status: 409 len: 146 microversion: 2.1 time: 1.077296 Aug 02 06:56:58.477410 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1374/2627] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:56:57 2022] POST /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407/action => generated 146 bytes in 1079 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:56:58.492600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d3746676-bc77-4198-9911-5c166e2516ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:58.497298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d3746676-bc77-4198-9911-5c166e2516ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:58.522556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3746676-bc77-4198-9911-5c166e2516ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:58.522556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3746676-bc77-4198-9911-5c166e2516ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:58.522556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3746676-bc77-4198-9911-5c166e2516ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:58.522556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3746676-bc77-4198-9911-5c166e2516ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:58.693469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-95670f94-af32-4abf-a2c9-767622b4a26e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:58.706828 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-95670f94-af32-4abf-a2c9-767622b4a26e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1678 microversion: 2.1 time: 0.446352 Aug 02 06:56:58.711645 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1254/2628] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:58 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1678 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:58.726483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-81622cbb-40fa-466c-ae82-b37a9fc6a350 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Action: 'action', calling method: .version_select at 0x7f9289da6430>, body: {"removeFloatingIp": {"address": "172.25.5.119"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:58.814018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d3746676-bc77-4198-9911-5c166e2516ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:58.824733 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d3746676-bc77-4198-9911-5c166e2516ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1501 microversion: 2.1 time: 0.345411 Aug 02 06:56:58.826170 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1375/2629] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:58 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1501 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:58.832327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-81452b35-6620-430e-8b86-d56954ef91f3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:58.833142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-81452b35-6620-430e-8b86-d56954ef91f3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:58.857292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81452b35-6620-430e-8b86-d56954ef91f3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:58.857982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81452b35-6620-430e-8b86-d56954ef91f3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:58.858929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81452b35-6620-430e-8b86-d56954ef91f3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:58.859694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81452b35-6620-430e-8b86-d56954ef91f3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:59.039436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-81452b35-6620-430e-8b86-d56954ef91f3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604e117f97c548b98ace652b760cdf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629c0175113f4f3d9ae413714345b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:59.048296 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-81452b35-6620-430e-8b86-d56954ef91f3 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 200 len: 1252 microversion: 2.1 time: 0.220145 Aug 02 06:56:59.049268 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1376/2630] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:58 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 1252 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:59.123313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-81622cbb-40fa-466c-ae82-b37a9fc6a350 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:59.130853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81622cbb-40fa-466c-ae82-b37a9fc6a350 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:59.132527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81622cbb-40fa-466c-ae82-b37a9fc6a350 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:59.134920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81622cbb-40fa-466c-ae82-b37a9fc6a350 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:59.136768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81622cbb-40fa-466c-ae82-b37a9fc6a350 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:59.285563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-18827174-f3cc-41b1-832e-fb2f7758dd03 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:56:59.287753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-18827174-f3cc-41b1-832e-fb2f7758dd03 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:56:59.309201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18827174-f3cc-41b1-832e-fb2f7758dd03 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:59.314532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18827174-f3cc-41b1-832e-fb2f7758dd03 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:59.315371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18827174-f3cc-41b1-832e-fb2f7758dd03 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:59.317311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18827174-f3cc-41b1-832e-fb2f7758dd03 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:59.812030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81622cbb-40fa-466c-ae82-b37a9fc6a350 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Acquired lock "refresh_cache-c161a709-ecf1-430e-b412-72a17a3471bb" {{(pid=126119) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 06:56:59.816385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-18827174-f3cc-41b1-832e-fb2f7758dd03 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:56:59.827129 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-18827174-f3cc-41b1-832e-fb2f7758dd03 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1504 microversion: 2.1 time: 0.552118 Aug 02 06:56:59.852851 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1377/2631] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:56:59 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1504 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:56:59.859709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-43de1459-b72b-4c81-a7c6-efb8025ce38d req-880fdbd9-a62b-469d-a4a8-52981d8b4e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f4d549d-c723-4b66-a0f7-4be7f9577859", "tag": "1a10ae0c-eb82-416c-badf-e843929702ff"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:56:59.882716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-43de1459-b72b-4c81-a7c6-efb8025ce38d req-880fdbd9-a62b-469d-a4a8-52981d8b4e47 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:56:59.883459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-43de1459-b72b-4c81-a7c6-efb8025ce38d req-880fdbd9-a62b-469d-a4a8-52981d8b4e47 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:56:59.910800 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-43de1459-b72b-4c81-a7c6-efb8025ce38d req-880fdbd9-a62b-469d-a4a8-52981d8b4e47 service nova] Creating event network-changed:1a10ae0c-eb82-416c-badf-e843929702ff for instance 3f4d549d-c723-4b66-a0f7-4be7f9577859 on n-h1-851337-3 Aug 02 06:56:59.923261 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-43de1459-b72b-4c81-a7c6-efb8025ce38d req-880fdbd9-a62b-469d-a4a8-52981d8b4e47 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068776 Aug 02 06:56:59.923964 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1378/2632] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:56:59.929203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-97209442-f7a7-4d5a-9c01-c3e581278a46 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] Calling method '.version_select at 0x7f927aa55c10>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:00.043978 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-97209442-f7a7-4d5a-9c01-c3e581278a46 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/8514cd4a-cf11-42cd-ab98-ce3bd2eea7d1" status: 200 len: 351 microversion: 2.1 time: 0.118583 Aug 02 06:57:00.044642 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1379/2633] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 06:56:59 2022] GET /compute/v2.1/os-volumes/8514cd4a-cf11-42cd-ab98-ce3bd2eea7d1 => generated 351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:00.054461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43a82cfb-f38e-45f9-ba86-5a22a0bb4a3b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:00.056082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-43a82cfb-f38e-45f9-ba86-5a22a0bb4a3b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:00.079545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43a82cfb-f38e-45f9-ba86-5a22a0bb4a3b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:00.080282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43a82cfb-f38e-45f9-ba86-5a22a0bb4a3b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:00.081076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43a82cfb-f38e-45f9-ba86-5a22a0bb4a3b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:00.081685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43a82cfb-f38e-45f9-ba86-5a22a0bb4a3b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:01.204659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=8 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:01.883745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43a82cfb-f38e-45f9-ba86-5a22a0bb4a3b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:01.893599 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43a82cfb-f38e-45f9-ba86-5a22a0bb4a3b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1678 microversion: 2.1 time: 1.847898 Aug 02 06:57:01.902290 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1380/2634] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:00 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1678 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:01.932643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-604e534f-ea77-4daf-8728-9da9669b955e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:01.939475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-604e534f-ea77-4daf-8728-9da9669b955e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] [instance: c66c14da-356f-4545-830d-93f43f602ca2] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:01.972895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-604e534f-ea77-4daf-8728-9da9669b955e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:01.978453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-604e534f-ea77-4daf-8728-9da9669b955e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:01.981665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-604e534f-ea77-4daf-8728-9da9669b955e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:01.983313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-604e534f-ea77-4daf-8728-9da9669b955e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:02.010853 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-604e534f-ea77-4daf-8728-9da9669b955e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] HTTP exception thrown: Instance c66c14da-356f-4545-830d-93f43f602ca2 could not be found. Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-604e534f-ea77-4daf-8728-9da9669b955e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Request method failure captured: Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 HTTP/1.1 Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MoyQaWWKFpcS0nMamDRqkuNfW2CBRQAdOpisXlSJ7nBHNXF8VG3D7PnPCQkAN20lC9pKM3uypWfP0lCQZkEMPDPc8zzC6rfDq0EyY7yNWZQO_osoTC4Ew4c44j2m7hfviazfPSU8TTv80Hi_WS39WVSi_hda_EKfM7t0WDT1QoxmJ0 Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 629c0175113f4f3d9ae413714345b45f Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestBootFromVolume-783068218 Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/629c0175113f4f3d9ae413714345b45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/629c0175113f4f3d9ae413714345b45f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_629c0175113f4f3d9ae413714345b45f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/629c0175113f4f3d9ae413714345b45f"}]}] Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestBootFromVolume-783068218 Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 629c0175113f4f3d9ae413714345b45f Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestBootFromVolume-783068218 Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestBootFromVolume-783068218-project Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 604e117f97c548b98ace652b760cdf0b Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestBootFromVolume-783068218-project Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance c66c14da-356f-4545-830d-93f43f602ca2 could not be found. Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'c66c14da-356f-4545-830d-93f43f602ca2'} Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c66c14da-356f-4545-830d-93f43f602ca2 could not be found. Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c66c14da-356f-4545-830d-93f43f602ca2 could not be found. Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:02.015936 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:02.019705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:02.019705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:02.019705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:02.019705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:57:02.019705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:57:02.019705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c66c14da-356f-4545-830d-93f43f602ca2 could not be found. Aug 02 06:57:02.019705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:02.023467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-604e534f-ea77-4daf-8728-9da9669b955e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Returning 404 to user: Instance c66c14da-356f-4545-830d-93f43f602ca2 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:57:02.024884 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-604e534f-ea77-4daf-8728-9da9669b955e tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2" status: 404 len: 111 microversion: 2.1 time: 0.120006 Aug 02 06:57:02.027352 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1381/2635] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:01 2022] GET /compute/v2.1/servers/c66c14da-356f-4545-830d-93f43f602ca2 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:57:02.034926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-db0b7ab3-ae0d-4b7e-81bc-5d4b76970d30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:02.039028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-db0b7ab3-ae0d-4b7e-81bc-5d4b76970d30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:02.055179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db0b7ab3-ae0d-4b7e-81bc-5d4b76970d30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:02.056674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db0b7ab3-ae0d-4b7e-81bc-5d4b76970d30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:02.059178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db0b7ab3-ae0d-4b7e-81bc-5d4b76970d30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:02.060080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db0b7ab3-ae0d-4b7e-81bc-5d4b76970d30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:02.959448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-db0b7ab3-ae0d-4b7e-81bc-5d4b76970d30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:02.975524 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-db0b7ab3-ae0d-4b7e-81bc-5d4b76970d30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1504 microversion: 2.1 time: 0.944796 Aug 02 06:57:02.976383 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1382/2636] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:02 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1504 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:02.990876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9f5cd97c-b474-44b3-bb51-24f5fd485e38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3101a752-ee7b-485a-ba4f-0da10648e663"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:02.996532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9f5cd97c-b474-44b3-bb51-24f5fd485e38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:03.016287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f5cd97c-b474-44b3-bb51-24f5fd485e38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:03.016968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f5cd97c-b474-44b3-bb51-24f5fd485e38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:03.018830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f5cd97c-b474-44b3-bb51-24f5fd485e38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:03.019427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f5cd97c-b474-44b3-bb51-24f5fd485e38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:03.617062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-81622cbb-40fa-466c-ae82-b37a9fc6a350 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Building network info cache for instance {{(pid=126119) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 02 06:57:03.629708 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9f5cd97c-b474-44b3-bb51-24f5fd485e38 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "POST /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.647709 Aug 02 06:57:03.645766 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1383/2637] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 06:57:02 2022] POST /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26/os-volume_attachments => generated 194 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:03.660705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-abfb5c65-e3e3-49a4-b058-48c485002890 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] Calling method '.version_select at 0x7f927a9e1ee0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:03.713157 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-abfb5c65-e3e3-49a4-b058-48c485002890 tempest-ServersTestBootFromVolume-783068218 tempest-ServersTestBootFromVolume-783068218-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-626367345" status: 202 len: 0 microversion: 2.1 time: 0.064058 Aug 02 06:57:03.715488 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1384/2638] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Aug 2 06:57:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-626367345 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:57:03.722012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a7b749b2-0087-47f1-8c7f-6dbee6b569ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:03.723174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a7b749b2-0087-47f1-8c7f-6dbee6b569ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:03.739332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7b749b2-0087-47f1-8c7f-6dbee6b569ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:03.740341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7b749b2-0087-47f1-8c7f-6dbee6b569ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:03.741403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7b749b2-0087-47f1-8c7f-6dbee6b569ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:03.742435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7b749b2-0087-47f1-8c7f-6dbee6b569ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:04.816346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a7b749b2-0087-47f1-8c7f-6dbee6b569ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:04.832927 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a7b749b2-0087-47f1-8c7f-6dbee6b569ce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1678 microversion: 2.1 time: 1.113409 Aug 02 06:57:04.833935 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1385/2639] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:03 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1678 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:04.854123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fa1dedc8-6967-4ad7-ae5b-d128d674865e tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] Calling method '.version_select at 0x7f928c27a670>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:05.006455 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fa1dedc8-6967-4ad7-ae5b-d128d674865e tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/efdddaa2-3e62-4033-b88d-eac4f2571ec7" status: 200 len: 351 microversion: 2.1 time: 0.170522 Aug 02 06:57:05.014839 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1386/2640] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 06:57:04 2022] GET /compute/v2.1/os-volumes/efdddaa2-3e62-4033-b88d-eac4f2571ec7 => generated 351 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:05.020419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-20824251-582f-4afe-884d-72f4b26c4f5d req-e8f1c520-61ab-4877-8932-672515a80e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c161a709-ecf1-430e-b412-72a17a3471bb", "tag": "59c5e71d-6342-4430-844e-96aade791e8c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:05.067907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-20824251-582f-4afe-884d-72f4b26c4f5d req-e8f1c520-61ab-4877-8932-672515a80e54 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:05.086264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-20824251-582f-4afe-884d-72f4b26c4f5d req-e8f1c520-61ab-4877-8932-672515a80e54 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:05.101174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:05.132524 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-20824251-582f-4afe-884d-72f4b26c4f5d req-e8f1c520-61ab-4877-8932-672515a80e54 service nova] Creating event network-changed:59c5e71d-6342-4430-844e-96aade791e8c for instance c161a709-ecf1-430e-b412-72a17a3471bb on n-h1-851337-3 Aug 02 06:57:05.145751 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-20824251-582f-4afe-884d-72f4b26c4f5d req-e8f1c520-61ab-4877-8932-672515a80e54 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129243 Aug 02 06:57:05.150335 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1387/2641] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:05.166323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a6a74ccf-50d3-4a26-b0ca-f8b6f0d40962 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:05.172599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a6a74ccf-50d3-4a26-b0ca-f8b6f0d40962 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:05.194612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6a74ccf-50d3-4a26-b0ca-f8b6f0d40962 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:05.200012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6a74ccf-50d3-4a26-b0ca-f8b6f0d40962 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:05.202338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6a74ccf-50d3-4a26-b0ca-f8b6f0d40962 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:05.208624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6a74ccf-50d3-4a26-b0ca-f8b6f0d40962 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:06.656002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a6a74ccf-50d3-4a26-b0ca-f8b6f0d40962 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:06.672150 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a6a74ccf-50d3-4a26-b0ca-f8b6f0d40962 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1504 microversion: 2.1 time: 1.520094 Aug 02 06:57:06.672911 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1388/2642] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:05 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1504 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:06.686662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-58c03f8c-c0ab-48dd-9638-7e16188e1124 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:06.690126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-58c03f8c-c0ab-48dd-9638-7e16188e1124 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:06.704321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58c03f8c-c0ab-48dd-9638-7e16188e1124 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:06.714641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58c03f8c-c0ab-48dd-9638-7e16188e1124 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:06.715641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58c03f8c-c0ab-48dd-9638-7e16188e1124 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:06.716244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58c03f8c-c0ab-48dd-9638-7e16188e1124 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:07.819803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-81622cbb-40fa-466c-ae82-b37a9fc6a350 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Updating instance_info_cache with network_info: [{"id": "59c5e71d-6342-4430-844e-96aade791e8c", "address": "fa:16:3e:ba:bd:56", "network": {"id": "708bee9a-a41f-42dc-9f8f-ce6d6f1e8f0f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1512818216-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "42ec92022d4f4cd1b29391bf914459d6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap59c5e71d-63", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126119) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 02 06:57:07.849107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81622cbb-40fa-466c-ae82-b37a9fc6a350 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Releasing lock "refresh_cache-c161a709-ecf1-430e-b412-72a17a3471bb" {{(pid=126119) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 06:57:07.850901 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-81622cbb-40fa-466c-ae82-b37a9fc6a350 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "POST /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb/action" status: 202 len: 0 microversion: 2.1 time: 9.137405 Aug 02 06:57:07.855468 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1255/2643] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:56:58 2022] POST /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb/action => generated 0 bytes in 9143 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 02 06:57:07.861800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1dfbe722-e8d8-42fb-a51b-ff4ab09a88f5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:07.863502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1dfbe722-e8d8-42fb-a51b-ff4ab09a88f5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:07.871759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:07.894697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1dfbe722-e8d8-42fb-a51b-ff4ab09a88f5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:07.898259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1dfbe722-e8d8-42fb-a51b-ff4ab09a88f5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:07.900144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1dfbe722-e8d8-42fb-a51b-ff4ab09a88f5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:07.902625 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1dfbe722-e8d8-42fb-a51b-ff4ab09a88f5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:07.945078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-58c03f8c-c0ab-48dd-9638-7e16188e1124 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:07.958209 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-58c03f8c-c0ab-48dd-9638-7e16188e1124 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1655 microversion: 2.1 time: 1.280051 Aug 02 06:57:07.958822 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1389/2644] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:06 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1655 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:07.981553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c3a8dfc9-ee7a-483a-8628-466a75468305 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:07.985501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c3a8dfc9-ee7a-483a-8628-466a75468305 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:08.006397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c3a8dfc9-ee7a-483a-8628-466a75468305 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:08.006916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c3a8dfc9-ee7a-483a-8628-466a75468305 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:08.009952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c3a8dfc9-ee7a-483a-8628-466a75468305 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:08.010524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c3a8dfc9-ee7a-483a-8628-466a75468305 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:08.064931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c3a8dfc9-ee7a-483a-8628-466a75468305 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:57:08.204474 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c3a8dfc9-ee7a-483a-8628-466a75468305 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb" status: 204 len: 0 microversion: 2.1 time: 0.231813 Aug 02 06:57:08.212189 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1390/2645] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:57:07 2022] DELETE /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:57:08.236959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d5a2f718-56ab-4c0f-86a4-b2025a0fbc4d tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:08.259563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d5a2f718-56ab-4c0f-86a4-b2025a0fbc4d tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:08.260380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d5a2f718-56ab-4c0f-86a4-b2025a0fbc4d tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:08.303889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d5a2f718-56ab-4c0f-86a4-b2025a0fbc4d tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Going to try to start instance {{(pid=126120) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 06:57:08.411940 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d5a2f718-56ab-4c0f-86a4-b2025a0fbc4d tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "POST /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/action" status: 202 len: 0 microversion: 2.1 time: 0.192145 Aug 02 06:57:08.418204 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1391/2646] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:57:08 2022] POST /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:57:08.428128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a470a26a-1700-49ec-be26-1e492860147b tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] Calling method '.version_select at 0x7f927aa55670>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:08.549008 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a470a26a-1700-49ec-be26-1e492860147b tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/87b36779-f2f2-4cbf-a025-1fff90f7355d" status: 200 len: 350 microversion: 2.1 time: 0.128057 Aug 02 06:57:08.549782 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1392/2647] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 06:57:08 2022] GET /compute/v2.1/os-volumes/87b36779-f2f2-4cbf-a025-1fff90f7355d => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:08.561585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c6d505a-972b-402c-b900-e75ba64a3de0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.119"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:08.564353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1c6d505a-972b-402c-b900-e75ba64a3de0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:08.581694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c6d505a-972b-402c-b900-e75ba64a3de0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:08.582580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c6d505a-972b-402c-b900-e75ba64a3de0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:08.588810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c6d505a-972b-402c-b900-e75ba64a3de0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:08.589269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c6d505a-972b-402c-b900-e75ba64a3de0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:08.653307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c6d505a-972b-402c-b900-e75ba64a3de0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Acquired lock "refresh_cache-c40a3375-decc-47ef-aa2e-0bd8f38ef407" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 06:57:08.961299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1dfbe722-e8d8-42fb-a51b-ff4ab09a88f5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:08.970240 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1dfbe722-e8d8-42fb-a51b-ff4ab09a88f5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1504 microversion: 2.1 time: 1.113539 Aug 02 06:57:08.974215 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1256/2648] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:07 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1504 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:08.988122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c83f75c7-1ba6-49f7-b465-f5fbe1bea150 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:08.989102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c83f75c7-1ba6-49f7-b465-f5fbe1bea150 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:08.995600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c83f75c7-1ba6-49f7-b465-f5fbe1bea150 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:08.998538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c83f75c7-1ba6-49f7-b465-f5fbe1bea150 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:08.999667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c83f75c7-1ba6-49f7-b465-f5fbe1bea150 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:09.003269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c83f75c7-1ba6-49f7-b465-f5fbe1bea150 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:09.631003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c83f75c7-1ba6-49f7-b465-f5fbe1bea150 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:09.643247 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c83f75c7-1ba6-49f7-b465-f5fbe1bea150 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1664 microversion: 2.1 time: 0.667551 Aug 02 06:57:09.644232 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1257/2649] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:08 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1664 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:09.654193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2d380c73-1bf2-49c8-a6ea-9428f2583b99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Action: 'create', calling method: .version_select at 0x7f927a96c1f0>, body: {"keypair": {"name": "tempest-keypair-3124824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLLUksaXoCr4n2c6S6zlTTNKnAIJhsrXrhtbS/FUncTiZc1vc86oPNKGfN1sNS1+AgulD0EaOu68d5UZ6+RQaejeDQkhfyQbT/AB439LHvNWHdDiEAYrMXVXfQQ4rn5Pw=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:09.677621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2d380c73-1bf2-49c8-a6ea-9428f2583b99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Getting quotas for project 7abd7d52ec6341babfd4e8bbe151a0c7. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:57:09.685119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2d380c73-1bf2-49c8-a6ea-9428f2583b99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Getting quotas for user 5b650380405b4af8941a934eb447fc40 and project 7abd7d52ec6341babfd4e8bbe151a0c7. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:57:09.721804 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2d380c73-1bf2-49c8-a6ea-9428f2583b99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 398 microversion: 2.32 time: 0.076334 Aug 02 06:57:09.724645 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1258/2650] 10.222.0.79 () {62 vars in 1200 bytes} [Tue Aug 2 06:57:09 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 06:57:09.732649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c6c3941b-4dbc-499c-8927-210ea297e6e8 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] Calling method '.version_select at 0x7f927ac0f160>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:09.907280 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c6c3941b-4dbc-499c-8927-210ea297e6e8 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.180252 Aug 02 06:57:09.911264 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1259/2651] 10.222.0.79 () {58 vars in 1134 bytes} [Tue Aug 2 06:57:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:09.929033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-274985bc-f668-4779-b6be-000b4f6bc5b9 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] Calling method '.version_select at 0x7f927b0ed8b0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:10.100120 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-274985bc-f668-4779-b6be-000b4f6bc5b9 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.178800 Aug 02 06:57:10.101978 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1260/2652] 10.222.0.79 () {58 vars in 1149 bytes} [Tue Aug 2 06:57:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:57:10.107361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ef1ae97d-e786-4b3c-9e00-5cce351381a0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:10.108471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ef1ae97d-e786-4b3c-9e00-5cce351381a0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:10.124643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef1ae97d-e786-4b3c-9e00-5cce351381a0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:10.125633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef1ae97d-e786-4b3c-9e00-5cce351381a0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:10.127437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef1ae97d-e786-4b3c-9e00-5cce351381a0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:10.130076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef1ae97d-e786-4b3c-9e00-5cce351381a0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:10.784082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ef1ae97d-e786-4b3c-9e00-5cce351381a0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:10.799782 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ef1ae97d-e786-4b3c-9e00-5cce351381a0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1494 microversion: 2.1 time: 0.696424 Aug 02 06:57:10.800386 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1261/2653] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:10 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1494 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:10.818048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-da742f7c-2c84-434b-ba4e-60eb1ca4c480 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] Calling method '.version_select at 0x7f927b1abee0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:11.064543 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-da742f7c-2c84-434b-ba4e-60eb1ca4c480 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.261950 Aug 02 06:57:11.065296 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1262/2654] 10.222.0.79 () {58 vars in 1134 bytes} [Tue Aug 2 06:57:10 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:11.080955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3710fe71-b3e5-43e3-8556-ce94cba7d67e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:11.081599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3710fe71-b3e5-43e3-8556-ce94cba7d67e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:11.099118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3710fe71-b3e5-43e3-8556-ce94cba7d67e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:11.100116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3710fe71-b3e5-43e3-8556-ce94cba7d67e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:11.101231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3710fe71-b3e5-43e3-8556-ce94cba7d67e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:11.103155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3710fe71-b3e5-43e3-8556-ce94cba7d67e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:11.626341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3710fe71-b3e5-43e3-8556-ce94cba7d67e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:11.640718 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3710fe71-b3e5-43e3-8556-ce94cba7d67e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1664 microversion: 2.1 time: 0.564661 Aug 02 06:57:11.641833 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1263/2655] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:11 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1664 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:11.660702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-65be5827-9d9d-4f94-a669-daa1a27d7821 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '.version_select at 0x7f927af37af0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:11.666087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65be5827-9d9d-4f94-a669-daa1a27d7821 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:11.666887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65be5827-9d9d-4f94-a669-daa1a27d7821 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:11.677351 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-65be5827-9d9d-4f94-a669-daa1a27d7821 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.034177 Aug 02 06:57:11.678658 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1264/2656] 10.222.0.79 () {58 vars in 1143 bytes} [Tue Aug 2 06:57:11 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:11.683547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5839f885-7010-425b-9eef-4f351fbe3893 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] Calling method '.version_select at 0x7f927b0c0f70>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:11.881983 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5839f885-7010-425b-9eef-4f351fbe3893 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.201361 Aug 02 06:57:11.883061 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1265/2657] 10.222.0.79 () {58 vars in 1167 bytes} [Tue Aug 2 06:57:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:11.888323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6a71e94a-666b-4436-9b02-c9e532da6b9a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:11.889344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6a71e94a-666b-4436-9b02-c9e532da6b9a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:11.907828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a71e94a-666b-4436-9b02-c9e532da6b9a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:11.910888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a71e94a-666b-4436-9b02-c9e532da6b9a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:11.913461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a71e94a-666b-4436-9b02-c9e532da6b9a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:11.917741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a71e94a-666b-4436-9b02-c9e532da6b9a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:12.343242 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6a71e94a-666b-4436-9b02-c9e532da6b9a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1645 microversion: 2.1 time: 0.456707 Aug 02 06:57:12.346014 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1266/2658] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:11 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1645 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:12.354667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-eeee188e-7921-4695-aa53-51792e08d9a6 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] Calling method '.version_select at 0x7f927ae3e280>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:12.544563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-1c6d505a-972b-402c-b900-e75ba64a3de0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Building network info cache for instance {{(pid=126120) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 02 06:57:12.705708 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-eeee188e-7921-4695-aa53-51792e08d9a6 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.357684 Aug 02 06:57:12.716028 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1267/2659] 10.222.0.79 () {58 vars in 1170 bytes} [Tue Aug 2 06:57:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:12.726191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e151af89-f750-4202-ab12-747745b04798 req-8817fa6e-4977-42a4-ab71-e7a0c93dc69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c161a709-ecf1-430e-b412-72a17a3471bb", "name": "network-vif-deleted", "tag": "59c5e71d-6342-4430-844e-96aade791e8c"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:12.760278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e151af89-f750-4202-ab12-747745b04798 req-8817fa6e-4977-42a4-ab71-e7a0c93dc69e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:12.761115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e151af89-f750-4202-ab12-747745b04798 req-8817fa6e-4977-42a4-ab71-e7a0c93dc69e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:12.817696 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e151af89-f750-4202-ab12-747745b04798 req-8817fa6e-4977-42a4-ab71-e7a0c93dc69e service nova] Creating event network-vif-deleted:59c5e71d-6342-4430-844e-96aade791e8c for instance c161a709-ecf1-430e-b412-72a17a3471bb on n-h1-851337-3 Aug 02 06:57:12.825227 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e151af89-f750-4202-ab12-747745b04798 req-8817fa6e-4977-42a4-ab71-e7a0c93dc69e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104973 Aug 02 06:57:12.825883 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1268/2660] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:12.835986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f4717a4c-8ed4-48da-88f8-6a81dd24eee0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:12.836578 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f4717a4c-8ed4-48da-88f8-6a81dd24eee0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:12.862006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4717a4c-8ed4-48da-88f8-6a81dd24eee0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:12.862465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4717a4c-8ed4-48da-88f8-6a81dd24eee0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:12.868924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4717a4c-8ed4-48da-88f8-6a81dd24eee0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:12.870166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4717a4c-8ed4-48da-88f8-6a81dd24eee0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:13.424393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f4717a4c-8ed4-48da-88f8-6a81dd24eee0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:13.432848 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f4717a4c-8ed4-48da-88f8-6a81dd24eee0 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1668 microversion: 2.1 time: 0.603718 Aug 02 06:57:13.433457 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1269/2661] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:12 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1668 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:13.454477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-208928416", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "f6b00d5e-7f56-40a5-b0ce-21c89ecfebff"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:13.530827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] validate_networks() for [('f6b00d5e-7f56-40a5-b0ce-21c89ecfebff', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:57:14.340547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-1c6d505a-972b-402c-b900-e75ba64a3de0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Updating instance_info_cache with network_info: [{"id": "04fd529e-a733-4059-bf00-9954803f29ea", "address": "fa:16:3e:30:03:a9", "network": {"id": "708bee9a-a41f-42dc-9f8f-ce6d6f1e8f0f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1512818216-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "42ec92022d4f4cd1b29391bf914459d6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap04fd529e-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126120) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 02 06:57:14.354317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c6d505a-972b-402c-b900-e75ba64a3de0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Releasing lock "refresh_cache-c40a3375-decc-47ef-aa2e-0bd8f38ef407" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 06:57:14.355863 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1c6d505a-972b-402c-b900-e75ba64a3de0 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "POST /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407/action" status: 202 len: 0 microversion: 2.1 time: 5.804589 Aug 02 06:57:14.356858 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1393/2662] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:57:08 2022] POST /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407/action => generated 0 bytes in 5807 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 02 06:57:14.363495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-37e4591d-173c-4b09-99b1-0ea7fcd247c9 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] Calling method '.version_select at 0x7f927b20bb80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:14.531206 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-37e4591d-173c-4b09-99b1-0ea7fcd247c9 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.172841 Aug 02 06:57:14.531801 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1394/2663] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:57:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:14.548542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1becb027-5b29-4013-8645-27ef3d01b123 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '.version_select at 0x7f927b2619d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:14.720862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:57:14.721382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:57:14.721752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:57:14.722466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:57:14.723239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:57:14.766849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:14.767732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:14.768745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:14.769441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:14.803035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Getting quotas for project 144a45ff8adc4fc08cdac4d62405c1af. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:57:14.809966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Getting quotas for user 82cffd0e8f5e400996b832cf1368b5d1 and project 144a45ff8adc4fc08cdac4d62405c1af. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:57:14.829391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:57:14.833492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:57:14.914601 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f1feae11-76a5-4efb-a71b-4b0b730254e9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.467249 Aug 02 06:57:14.915907 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1270/2664] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:57:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:57:14.925953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-76fb9fd4-84d2-4a7d-b96a-2ba002157493 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] Calling method '.version_select at 0x7f927af0c790>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:14.969603 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1becb027-5b29-4013-8645-27ef3d01b123 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/d578c3ae-4f90-42d4-afe7-1aa89a0823d8" status: 200 len: 185 microversion: 2.1 time: 0.426715 Aug 02 06:57:14.977170 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1395/2665] 10.222.0.79 () {58 vars in 1260 bytes} [Tue Aug 2 06:57:14 2022] GET /compute/v2.1/os-floating-ips/d578c3ae-4f90-42d4-afe7-1aa89a0823d8 => generated 185 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:14.989303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-5b8039b4-9a74-41a7-ab99-58e8699ced6d req-9a1a9b65-ff43-402c-a85d-486ad71cd145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c40a3375-decc-47ef-aa2e-0bd8f38ef407", "tag": "04fd529e-a733-4059-bf00-9954803f29ea"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:15.018641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-5b8039b4-9a74-41a7-ab99-58e8699ced6d req-9a1a9b65-ff43-402c-a85d-486ad71cd145 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:15.019020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-5b8039b4-9a74-41a7-ab99-58e8699ced6d req-9a1a9b65-ff43-402c-a85d-486ad71cd145 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:15.047802 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-5b8039b4-9a74-41a7-ab99-58e8699ced6d req-9a1a9b65-ff43-402c-a85d-486ad71cd145 service nova] Creating event network-changed:04fd529e-a733-4059-bf00-9954803f29ea for instance c40a3375-decc-47ef-aa2e-0bd8f38ef407 on n-h2-851337-3 Aug 02 06:57:15.055091 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-76fb9fd4-84d2-4a7d-b96a-2ba002157493 tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.137682 Aug 02 06:57:15.059453 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-5b8039b4-9a74-41a7-ab99-58e8699ced6d req-9a1a9b65-ff43-402c-a85d-486ad71cd145 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087542 Aug 02 06:57:15.062227 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1271/2666] 10.222.0.79 () {58 vars in 1188 bytes} [Tue Aug 2 06:57:14 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:15.067234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fd95550d-c8ec-45d7-ba8f-376cc41b0ad8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:15.067854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fd95550d-c8ec-45d7-ba8f-376cc41b0ad8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:15.095181 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1396/2667] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:15.114268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bd6d2667-f2e2-411f-9ae4-baa1650c007f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.119"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:15.302269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fd95550d-c8ec-45d7-ba8f-376cc41b0ad8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:15.312277 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fd95550d-c8ec-45d7-ba8f-376cc41b0ad8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1210 microversion: 2.1 time: 0.248697 Aug 02 06:57:15.333073 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1272/2668] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:15 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1210 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:15.338936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d38f0ac6-cce9-43d0-9798-317b765c7ead tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] Calling method '.version_select at 0x7f927b22d700>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:15.447525 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d38f0ac6-cce9-43d0-9798-317b765c7ead tempest-VolumesTestJSON-2128427486 tempest-VolumesTestJSON-2128427486-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.113147 Aug 02 06:57:15.448375 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1273/2669] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 06:57:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:15.453532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-629263250", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "168ea358-34b8-40f5-aac6-d9611ae33d1b"}, {"port": "3700e74e-8d56-4f36-963b-62599cf5f662", "tag": "port-1"}, {"port": "cb505991-c8fe-43b4-b901-90af67c63340", "tag": "port-2"}, {"uuid": "f1677890-d891-4c75-8363-666d1dcc7843", "tag": "net-1"}, {"uuid": "f1677890-d891-4c75-8363-666d1dcc7843"}, {"uuid": "d83fe4e5-8002-4f3c-a076-cfa05266a909", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d83fe4e5-8002-4f3c-a076-cfa05266a909", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b3f2c556-08af-46c0-bb1e-1b9c56471971", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "94b01edf-acb3-473f-9777-e431aed0e145", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "afaef152-f5e7-4ee2-b9f4-46dbf1dbd6d9", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1308264001"}], "key_name": "tempest-keypair-3124824", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:15.712167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bd6d2667-f2e2-411f-9ae4-baa1650c007f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:15.726660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd6d2667-f2e2-411f-9ae4-baa1650c007f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:15.729006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd6d2667-f2e2-411f-9ae4-baa1650c007f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:15.733084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd6d2667-f2e2-411f-9ae4-baa1650c007f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:15.735329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd6d2667-f2e2-411f-9ae4-baa1650c007f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:16.247584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] validate_networks() for [('168ea358-34b8-40f5-aac6-d9611ae33d1b', None, None, None, None, None), (None, None, '3700e74e-8d56-4f36-963b-62599cf5f662', None, None, None), (None, None, 'cb505991-c8fe-43b4-b901-90af67c63340', None, None, None), ('f1677890-d891-4c75-8363-666d1dcc7843', None, None, None, None, None), ('f1677890-d891-4c75-8363-666d1dcc7843', None, None, None, None, None), ('d83fe4e5-8002-4f3c-a076-cfa05266a909', '10.2.2.100', None, None, None, None), ('d83fe4e5-8002-4f3c-a076-cfa05266a909', '10.2.2.200', None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:57:16.617755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd6d2667-f2e2-411f-9ae4-baa1650c007f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Acquired lock "refresh_cache-c40a3375-decc-47ef-aa2e-0bd8f38ef407" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 06:57:18.300787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-bd6d2667-f2e2-411f-9ae4-baa1650c007f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Building network info cache for instance {{(pid=126120) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 02 06:57:20.453939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-bd6d2667-f2e2-411f-9ae4-baa1650c007f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Updating instance_info_cache with network_info: [{"id": "04fd529e-a733-4059-bf00-9954803f29ea", "address": "fa:16:3e:30:03:a9", "network": {"id": "708bee9a-a41f-42dc-9f8f-ce6d6f1e8f0f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1512818216-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "42ec92022d4f4cd1b29391bf914459d6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap04fd529e-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126120) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 02 06:57:20.516593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd6d2667-f2e2-411f-9ae4-baa1650c007f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Releasing lock "refresh_cache-c40a3375-decc-47ef-aa2e-0bd8f38ef407" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 06:57:20.517473 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bd6d2667-f2e2-411f-9ae4-baa1650c007f tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "POST /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407/action" status: 202 len: 0 microversion: 2.1 time: 5.417922 Aug 02 06:57:20.519613 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1397/2670] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:57:15 2022] POST /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407/action => generated 0 bytes in 5424 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 02 06:57:20.547081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a517c553-4f8d-489b-ba4e-46634e9e077d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:20.558394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a517c553-4f8d-489b-ba4e-46634e9e077d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:20.578765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a517c553-4f8d-489b-ba4e-46634e9e077d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:20.581159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a517c553-4f8d-489b-ba4e-46634e9e077d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:20.582681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a517c553-4f8d-489b-ba4e-46634e9e077d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:20.585506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a517c553-4f8d-489b-ba4e-46634e9e077d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:20.898821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a517c553-4f8d-489b-ba4e-46634e9e077d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:20.908174 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a517c553-4f8d-489b-ba4e-46634e9e077d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1310 microversion: 2.1 time: 0.387345 Aug 02 06:57:20.924726 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1398/2671] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:20 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1310 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:20.935857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-63367dc9-f46e-454b-acf5-b9b0766f9603 req-2d1ae5fc-b070-4647-90ea-3644acf496a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c40a3375-decc-47ef-aa2e-0bd8f38ef407", "tag": "04fd529e-a733-4059-bf00-9954803f29ea"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:20.952900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-63367dc9-f46e-454b-acf5-b9b0766f9603 req-2d1ae5fc-b070-4647-90ea-3644acf496a6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:20.960062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-63367dc9-f46e-454b-acf5-b9b0766f9603 req-2d1ae5fc-b070-4647-90ea-3644acf496a6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:20.983016 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-63367dc9-f46e-454b-acf5-b9b0766f9603 req-2d1ae5fc-b070-4647-90ea-3644acf496a6 service nova] Creating event network-changed:04fd529e-a733-4059-bf00-9954803f29ea for instance c40a3375-decc-47ef-aa2e-0bd8f38ef407 on n-h2-851337-3 Aug 02 06:57:20.996528 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-63367dc9-f46e-454b-acf5-b9b0766f9603 req-2d1ae5fc-b070-4647-90ea-3644acf496a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070223 Aug 02 06:57:20.997471 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1399/2672] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:21.017481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-91a5aba5-34f9-4022-bcb6-b7003498ae8b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:21.023989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-91a5aba5-34f9-4022-bcb6-b7003498ae8b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:21.032173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91a5aba5-34f9-4022-bcb6-b7003498ae8b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:21.033003 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91a5aba5-34f9-4022-bcb6-b7003498ae8b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:21.034731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91a5aba5-34f9-4022-bcb6-b7003498ae8b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:21.035355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91a5aba5-34f9-4022-bcb6-b7003498ae8b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:21.075253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-91a5aba5-34f9-4022-bcb6-b7003498ae8b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:57:21.235150 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-91a5aba5-34f9-4022-bcb6-b7003498ae8b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 204 len: 0 microversion: 2.1 time: 0.234676 Aug 02 06:57:21.241306 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1400/2673] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:57:20 2022] DELETE /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:57:21.250043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4ce7e4ae-8bab-4671-8693-2bcc543ffabb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:21.253504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4ce7e4ae-8bab-4671-8693-2bcc543ffabb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:21.262747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ce7e4ae-8bab-4671-8693-2bcc543ffabb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:21.264698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ce7e4ae-8bab-4671-8693-2bcc543ffabb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:21.266121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ce7e4ae-8bab-4671-8693-2bcc543ffabb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:21.266763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ce7e4ae-8bab-4671-8693-2bcc543ffabb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:21.295734 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-4ce7e4ae-8bab-4671-8693-2bcc543ffabb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] HTTP exception thrown: Instance c161a709-ecf1-430e-b412-72a17a3471bb could not be found. Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4ce7e4ae-8bab-4671-8693-2bcc543ffabb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Request method failure captured: Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb HTTP/1.1 Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mp2hyhv3Fv4s36MkcFcau5vsg8pyLPW2AoJoY4nZxLc1KrRX4fnmw19oJ2J2UoFsIG_Z1KDiF1mSz1qZTp5aHNXhQ4TqCNEnbxohRIr_Bo3azCeYhgWtymWj8x61NPqaSCpLl1ZiZIq8hck35HhiHWUgpnTBHdbCsEWnyILdoLhQP4 Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 42ec92022d4f4cd1b29391bf914459d6 Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-557210961 Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/42ec92022d4f4cd1b29391bf914459d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/42ec92022d4f4cd1b29391bf914459d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_42ec92022d4f4cd1b29391bf914459d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/42ec92022d4f4cd1b29391bf914459d6"}]}] Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-557210961 Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 42ec92022d4f4cd1b29391bf914459d6 Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-557210961 Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-FloatingIPsAssociationTestJSON-557210961-project Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5c9f038a40df4202b3df8df315c1904b Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-557210961-project Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance c161a709-ecf1-430e-b412-72a17a3471bb could not be found. Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'c161a709-ecf1-430e-b412-72a17a3471bb'} Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c161a709-ecf1-430e-b412-72a17a3471bb could not be found. Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:57:21.302280 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:57:21.306180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c161a709-ecf1-430e-b412-72a17a3471bb could not be found. Aug 02 06:57:21.306180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:21.306180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:21.306180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:21.306180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:21.306180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:21.306180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:21.306180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:57:21.306180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:57:21.306180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c161a709-ecf1-430e-b412-72a17a3471bb could not be found. Aug 02 06:57:21.306180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:21.306180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4ce7e4ae-8bab-4671-8693-2bcc543ffabb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Returning 404 to user: Instance c161a709-ecf1-430e-b412-72a17a3471bb could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:57:21.306180 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4ce7e4ae-8bab-4671-8693-2bcc543ffabb tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb" status: 404 len: 111 microversion: 2.1 time: 0.060112 Aug 02 06:57:21.316732 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1401/2674] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:57:21 2022] DELETE /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:57:21.322003 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-04bf10cc-e13e-42f8-a039-78bbe2402695 req-bbe0dfec-bfee-4e44-95bf-98fe705d6829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aff6869-710b-4239-bc13-f3a275b7a878", "tag": "606ee08a-250d-404f-8772-4a64ef82b723"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:21.342234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-04bf10cc-e13e-42f8-a039-78bbe2402695 req-bbe0dfec-bfee-4e44-95bf-98fe705d6829 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:21.342890 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-04bf10cc-e13e-42f8-a039-78bbe2402695 req-bbe0dfec-bfee-4e44-95bf-98fe705d6829 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:21.358283 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-04bf10cc-e13e-42f8-a039-78bbe2402695 req-bbe0dfec-bfee-4e44-95bf-98fe705d6829 service nova] Creating event network-changed:606ee08a-250d-404f-8772-4a64ef82b723 for instance 7aff6869-710b-4239-bc13-f3a275b7a878 on n-h1-851337-3 Aug 02 06:57:21.365684 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-04bf10cc-e13e-42f8-a039-78bbe2402695 req-bbe0dfec-bfee-4e44-95bf-98fe705d6829 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047039 Aug 02 06:57:21.365967 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1402/2675] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:21.372589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f0b09780-d7e2-4dc0-9020-9230d0b309e8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:21.373540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f0b09780-d7e2-4dc0-9020-9230d0b309e8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:21.382551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0b09780-d7e2-4dc0-9020-9230d0b309e8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:21.383163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0b09780-d7e2-4dc0-9020-9230d0b309e8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:21.384434 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0b09780-d7e2-4dc0-9020-9230d0b309e8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:21.384934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0b09780-d7e2-4dc0-9020-9230d0b309e8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:21.905349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f0b09780-d7e2-4dc0-9020-9230d0b309e8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:21.921726 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f0b09780-d7e2-4dc0-9020-9230d0b309e8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1553 microversion: 2.1 time: 0.553518 Aug 02 06:57:21.956814 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1403/2676] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:21 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1553 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:21.983149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-94f9835e-164a-46ec-8525-eb9e1161b8a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:21.985389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-94f9835e-164a-46ec-8525-eb9e1161b8a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c161a709-ecf1-430e-b412-72a17a3471bb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:22.006047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-94f9835e-164a-46ec-8525-eb9e1161b8a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:22.011673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-94f9835e-164a-46ec-8525-eb9e1161b8a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:22.013274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-94f9835e-164a-46ec-8525-eb9e1161b8a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:22.014262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-94f9835e-164a-46ec-8525-eb9e1161b8a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:22.034396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:22.050675 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-94f9835e-164a-46ec-8525-eb9e1161b8a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] HTTP exception thrown: Instance c161a709-ecf1-430e-b412-72a17a3471bb could not be found. Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-94f9835e-164a-46ec-8525-eb9e1161b8a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Request method failure captured: Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb HTTP/1.1 Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mp2hyhv3Fv4s36MkcFcau5vsg8pyLPW2AoJoY4nZxLc1KrRX4fnmw19oJ2J2UoFsIG_Z1KDiF1mSz1qZTp5aHNXhQ4TqCNEnbxohRIr_Bo3azCeYhgWtymWj8x61NPqaSCpLl1ZiZIq8hck35HhiHWUgpnTBHdbCsEWnyILdoLhQP4 Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 42ec92022d4f4cd1b29391bf914459d6 Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-557210961 Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/42ec92022d4f4cd1b29391bf914459d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/42ec92022d4f4cd1b29391bf914459d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_42ec92022d4f4cd1b29391bf914459d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/42ec92022d4f4cd1b29391bf914459d6"}]}] Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-557210961 Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 42ec92022d4f4cd1b29391bf914459d6 Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-557210961 Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-FloatingIPsAssociationTestJSON-557210961-project Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5c9f038a40df4202b3df8df315c1904b Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-557210961-project Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance c161a709-ecf1-430e-b412-72a17a3471bb could not be found. Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'c161a709-ecf1-430e-b412-72a17a3471bb'} Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c161a709-ecf1-430e-b412-72a17a3471bb could not be found. Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c161a709-ecf1-430e-b412-72a17a3471bb could not be found. Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:22.052388 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:22.062533 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:22.062533 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:22.062533 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:22.062533 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:22.062533 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:57:22.062533 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:57:22.062533 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c161a709-ecf1-430e-b412-72a17a3471bb could not be found. Aug 02 06:57:22.062533 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:22.062533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-94f9835e-164a-46ec-8525-eb9e1161b8a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Returning 404 to user: Instance c161a709-ecf1-430e-b412-72a17a3471bb could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:57:22.062533 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-94f9835e-164a-46ec-8525-eb9e1161b8a5 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb" status: 404 len: 111 microversion: 2.1 time: 0.095637 Aug 02 06:57:22.062533 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1404/2677] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:21 2022] GET /compute/v2.1/servers/c161a709-ecf1-430e-b412-72a17a3471bb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:57:22.065239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-11bf3295-9049-4805-ad4c-8987af70c79e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:22.065239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-11bf3295-9049-4805-ad4c-8987af70c79e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:22.072479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11bf3295-9049-4805-ad4c-8987af70c79e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:22.072921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11bf3295-9049-4805-ad4c-8987af70c79e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:22.073872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11bf3295-9049-4805-ad4c-8987af70c79e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:22.074485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11bf3295-9049-4805-ad4c-8987af70c79e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:22.332614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-11bf3295-9049-4805-ad4c-8987af70c79e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:22.354782 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-11bf3295-9049-4805-ad4c-8987af70c79e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1310 microversion: 2.1 time: 0.287694 Aug 02 06:57:22.355226 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1405/2678] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:22 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1310 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:22.359948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f7adc1e4-3947-4533-be4c-fe580ed7ce48 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '.version_select at 0x7f927b3e1d30>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:22.956716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:57:22.957698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:57:22.959558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:57:22.960004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:57:22.960416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:57:22.978706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:22.979459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:22.981119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:22.984109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:23.043277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Getting quotas for project 7abd7d52ec6341babfd4e8bbe151a0c7. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:57:23.054023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Getting quotas for user 5b650380405b4af8941a934eb447fc40 and project 7abd7d52ec6341babfd4e8bbe151a0c7. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:57:23.347369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:57:23.350892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b3f2c556-08af-46c0-bb1e-1b9c56471971',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='94b01edf-acb3-473f-9777-e431aed0e145',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='afaef152-f5e7-4ee2-b9f4-46dbf1dbd6d9',volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:57:24.184060 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4fdde415-a46f-4879-85a5-22b2b4a085f4 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.734268 Aug 02 06:57:24.187760 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1274/2679] 10.222.0.79 () {62 vars in 1189 bytes} [Tue Aug 2 06:57:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 8739 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 06:57:24.203533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b5cd677d-3f6f-4bd0-9448-e025002ef2e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:24.204877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b5cd677d-3f6f-4bd0-9448-e025002ef2e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:24.224135 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f7adc1e4-3947-4533-be4c-fe580ed7ce48 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/d578c3ae-4f90-42d4-afe7-1aa89a0823d8" status: 202 len: 0 microversion: 2.1 time: 1.867734 Aug 02 06:57:24.225601 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1406/2680] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 06:57:22 2022] DELETE /compute/v2.1/os-floating-ips/d578c3ae-4f90-42d4-afe7-1aa89a0823d8 => generated 0 bytes in 1870 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:57:24.233825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5892d9f1-5be0-423e-a313-d87b4793854a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:24.234712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5892d9f1-5be0-423e-a313-d87b4793854a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:24.243024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5cd677d-3f6f-4bd0-9448-e025002ef2e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:24.243670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5cd677d-3f6f-4bd0-9448-e025002ef2e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:24.246581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5cd677d-3f6f-4bd0-9448-e025002ef2e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:24.260745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5cd677d-3f6f-4bd0-9448-e025002ef2e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:24.277163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5892d9f1-5be0-423e-a313-d87b4793854a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:24.277629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5892d9f1-5be0-423e-a313-d87b4793854a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:24.278503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5892d9f1-5be0-423e-a313-d87b4793854a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:24.283379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5892d9f1-5be0-423e-a313-d87b4793854a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:24.788892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b5cd677d-3f6f-4bd0-9448-e025002ef2e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:24.803751 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b5cd677d-3f6f-4bd0-9448-e025002ef2e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1511 microversion: 2.1 time: 0.608225 Aug 02 06:57:24.806669 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1275/2681] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:24 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1511 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:24.817944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6d0bca6c-c4e2-4a75-8b6d-1328d64d2f8b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:24.830862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6d0bca6c-c4e2-4a75-8b6d-1328d64d2f8b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:25.030125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5892d9f1-5be0-423e-a313-d87b4793854a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:25.042400 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5892d9f1-5be0-423e-a313-d87b4793854a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1310 microversion: 2.1 time: 0.812353 Aug 02 06:57:25.049462 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1407/2682] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:24 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1310 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:25.063480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6d0bca6c-c4e2-4a75-8b6d-1328d64d2f8b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:25.077222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6d0bca6c-c4e2-4a75-8b6d-1328d64d2f8b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:25.094009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e362c330-fe33-4ce7-93ef-d513fdb11eac tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:25.094009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e362c330-fe33-4ce7-93ef-d513fdb11eac tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:25.094309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6d0bca6c-c4e2-4a75-8b6d-1328d64d2f8b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:25.104766 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6d0bca6c-c4e2-4a75-8b6d-1328d64d2f8b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1282 microversion: 2.32 time: 0.287770 Aug 02 06:57:25.108813 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1276/2683] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:24 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1282 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:25.113840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-1f4497fb-bc50-41db-8c97-ca9abb4c0234 req-a04e47f6-d56c-42dd-b1b7-2e3365b09d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b32b61f-03ac-477c-b5d0-1606b9694c26", "name": "network-vif-deleted", "tag": "f94f468e-537b-4d22-8dbe-f6783b6b592f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:25.123928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e362c330-fe33-4ce7-93ef-d513fdb11eac tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:25.131240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e362c330-fe33-4ce7-93ef-d513fdb11eac tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:25.132167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e362c330-fe33-4ce7-93ef-d513fdb11eac tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:25.139254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e362c330-fe33-4ce7-93ef-d513fdb11eac tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:25.161862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1f4497fb-bc50-41db-8c97-ca9abb4c0234 req-a04e47f6-d56c-42dd-b1b7-2e3365b09d4d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:25.179650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1f4497fb-bc50-41db-8c97-ca9abb4c0234 req-a04e47f6-d56c-42dd-b1b7-2e3365b09d4d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:25.211233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e362c330-fe33-4ce7-93ef-d513fdb11eac tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:57:25.217063 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-1f4497fb-bc50-41db-8c97-ca9abb4c0234 req-a04e47f6-d56c-42dd-b1b7-2e3365b09d4d service nova] Creating event network-vif-deleted:f94f468e-537b-4d22-8dbe-f6783b6b592f for instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 on n-h2-851337-3 Aug 02 06:57:25.242321 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-1f4497fb-bc50-41db-8c97-ca9abb4c0234 req-a04e47f6-d56c-42dd-b1b7-2e3365b09d4d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131897 Aug 02 06:57:25.249386 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1277/2684] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:25.396491 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e362c330-fe33-4ce7-93ef-d513fdb11eac tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 204 len: 0 microversion: 2.1 time: 0.339164 Aug 02 06:57:25.398395 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1408/2685] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:57:25 2022] DELETE /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:57:25.407602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-edec72ec-84be-4d11-8494-d59c2c467128 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:25.408776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-edec72ec-84be-4d11-8494-d59c2c467128 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:25.417110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-edec72ec-84be-4d11-8494-d59c2c467128 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:25.423018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-edec72ec-84be-4d11-8494-d59c2c467128 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:25.427397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-edec72ec-84be-4d11-8494-d59c2c467128 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:25.428127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-edec72ec-84be-4d11-8494-d59c2c467128 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:25.689721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-edec72ec-84be-4d11-8494-d59c2c467128 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:25.698602 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-edec72ec-84be-4d11-8494-d59c2c467128 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1526 microversion: 2.1 time: 0.295285 Aug 02 06:57:25.703035 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1278/2686] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:25 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1526 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:25.834949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44df3408-e300-4010-b8f3-f0a49210269d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:25.835663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-44df3408-e300-4010-b8f3-f0a49210269d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:25.856546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44df3408-e300-4010-b8f3-f0a49210269d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:25.857023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44df3408-e300-4010-b8f3-f0a49210269d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:25.858086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44df3408-e300-4010-b8f3-f0a49210269d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:25.858260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44df3408-e300-4010-b8f3-f0a49210269d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:26.069767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f00f85ec-0cc2-407d-992c-2e56235fdcc3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:26.070416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f00f85ec-0cc2-407d-992c-2e56235fdcc3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:26.079832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f00f85ec-0cc2-407d-992c-2e56235fdcc3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:26.084788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f00f85ec-0cc2-407d-992c-2e56235fdcc3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:26.087900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f00f85ec-0cc2-407d-992c-2e56235fdcc3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:26.088382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f00f85ec-0cc2-407d-992c-2e56235fdcc3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:26.134045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-44df3408-e300-4010-b8f3-f0a49210269d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:26.146312 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-44df3408-e300-4010-b8f3-f0a49210269d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1345 microversion: 2.1 time: 0.315582 Aug 02 06:57:26.146913 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1409/2687] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:25 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1345 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:26.179704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3b1e047d-65a7-4e45-88b0-e87543850c3c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:26.180407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3b1e047d-65a7-4e45-88b0-e87543850c3c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:26.485935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3b1e047d-65a7-4e45-88b0-e87543850c3c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:26.495844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3b1e047d-65a7-4e45-88b0-e87543850c3c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:26.497711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3b1e047d-65a7-4e45-88b0-e87543850c3c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:26.503069 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3b1e047d-65a7-4e45-88b0-e87543850c3c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1282 microversion: 2.32 time: 0.348422 Aug 02 06:57:26.518619 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1410/2688] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:26 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1282 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:26.723707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8496c185-8b9f-4575-b824-edaa5602eabf tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:26.724969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8496c185-8b9f-4575-b824-edaa5602eabf tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:26.736276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8496c185-8b9f-4575-b824-edaa5602eabf tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:26.741030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8496c185-8b9f-4575-b824-edaa5602eabf tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:26.743355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f00f85ec-0cc2-407d-992c-2e56235fdcc3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:26.745178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8496c185-8b9f-4575-b824-edaa5602eabf tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:26.745769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8496c185-8b9f-4575-b824-edaa5602eabf tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:26.753564 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f00f85ec-0cc2-407d-992c-2e56235fdcc3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1310 microversion: 2.1 time: 0.687579 Aug 02 06:57:26.756699 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1279/2689] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:26 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1310 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:27.102804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8496c185-8b9f-4575-b824-edaa5602eabf tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:27.119910 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8496c185-8b9f-4575-b824-edaa5602eabf tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1526 microversion: 2.1 time: 0.400339 Aug 02 06:57:27.120683 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1411/2690] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:26 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1526 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:57:27.172330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3bca7447-0059-46ef-9b64-ddfc5e124a0c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:27.173491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3bca7447-0059-46ef-9b64-ddfc5e124a0c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:27.184626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bca7447-0059-46ef-9b64-ddfc5e124a0c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:27.185518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bca7447-0059-46ef-9b64-ddfc5e124a0c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:27.186556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bca7447-0059-46ef-9b64-ddfc5e124a0c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:27.187509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bca7447-0059-46ef-9b64-ddfc5e124a0c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:27.283391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3bca7447-0059-46ef-9b64-ddfc5e124a0c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:27.298674 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3bca7447-0059-46ef-9b64-ddfc5e124a0c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1345 microversion: 2.1 time: 0.132821 Aug 02 06:57:27.300644 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1280/2691] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:27 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1345 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:27.528797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ea0358e4-6aeb-49ef-9a33-a04c3026ad69 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:27.529564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ea0358e4-6aeb-49ef-9a33-a04c3026ad69 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:27.533374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:27.556807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea0358e4-6aeb-49ef-9a33-a04c3026ad69 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:27.569840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea0358e4-6aeb-49ef-9a33-a04c3026ad69 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:27.571116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea0358e4-6aeb-49ef-9a33-a04c3026ad69 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:27.571768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea0358e4-6aeb-49ef-9a33-a04c3026ad69 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:27.782706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7246dbce-3461-48a9-9ec5-34106c149048 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:27.786401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7246dbce-3461-48a9-9ec5-34106c149048 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:27.802014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7246dbce-3461-48a9-9ec5-34106c149048 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:27.809599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7246dbce-3461-48a9-9ec5-34106c149048 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:27.810804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7246dbce-3461-48a9-9ec5-34106c149048 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:27.814846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7246dbce-3461-48a9-9ec5-34106c149048 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:27.823121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ea0358e4-6aeb-49ef-9a33-a04c3026ad69 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:27.838701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:27.854275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ea0358e4-6aeb-49ef-9a33-a04c3026ad69 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:27.857307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ea0358e4-6aeb-49ef-9a33-a04c3026ad69 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:27.869060 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ea0358e4-6aeb-49ef-9a33-a04c3026ad69 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1580 microversion: 2.32 time: 0.344098 Aug 02 06:57:27.871339 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1412/2692] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:27 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1580 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:28.147794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c1e65f29-2ec7-46e0-9501-0ab86665dd41 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:28.148720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c1e65f29-2ec7-46e0-9501-0ab86665dd41 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:28.167491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1e65f29-2ec7-46e0-9501-0ab86665dd41 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:28.167967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1e65f29-2ec7-46e0-9501-0ab86665dd41 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:28.168788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1e65f29-2ec7-46e0-9501-0ab86665dd41 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:28.169306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1e65f29-2ec7-46e0-9501-0ab86665dd41 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:28.615585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7246dbce-3461-48a9-9ec5-34106c149048 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:28.623962 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7246dbce-3461-48a9-9ec5-34106c149048 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1310 microversion: 2.1 time: 0.847806 Aug 02 06:57:28.630154 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1281/2693] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:27 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1310 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:28.650614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6606b4c7-dd64-4e0a-addc-24cc2764e5f9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:28.651560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6606b4c7-dd64-4e0a-addc-24cc2764e5f9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:28.668714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6606b4c7-dd64-4e0a-addc-24cc2764e5f9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:28.676511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6606b4c7-dd64-4e0a-addc-24cc2764e5f9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:28.682406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6606b4c7-dd64-4e0a-addc-24cc2764e5f9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:28.683036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6606b4c7-dd64-4e0a-addc-24cc2764e5f9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:29.783927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6606b4c7-dd64-4e0a-addc-24cc2764e5f9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:29.812348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c1e65f29-2ec7-46e0-9501-0ab86665dd41 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9f038a40df4202b3df8df315c1904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ec92022d4f4cd1b29391bf914459d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:29.813252 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6606b4c7-dd64-4e0a-addc-24cc2764e5f9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1345 microversion: 2.1 time: 1.181746 Aug 02 06:57:29.813861 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1282/2694] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:28 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1345 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:29.834377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-11a1855e-e7fd-48b4-9853-22737f8f030d req-476b64d3-eeca-4299-8531-d33ac43ec079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c40a3375-decc-47ef-aa2e-0bd8f38ef407", "name": "network-vif-deleted", "tag": "04fd529e-a733-4059-bf00-9954803f29ea"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:29.834602 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c1e65f29-2ec7-46e0-9501-0ab86665dd41 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 200 len: 1526 microversion: 2.1 time: 1.697348 Aug 02 06:57:29.842407 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1413/2695] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:28 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 1526 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:29.848799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-35e63257-09bc-4fef-8ffb-0039e2016eb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:29.851886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-35e63257-09bc-4fef-8ffb-0039e2016eb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:29.861361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35e63257-09bc-4fef-8ffb-0039e2016eb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:29.867588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35e63257-09bc-4fef-8ffb-0039e2016eb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:29.873091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35e63257-09bc-4fef-8ffb-0039e2016eb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:29.873846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35e63257-09bc-4fef-8ffb-0039e2016eb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:29.884263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-11a1855e-e7fd-48b4-9853-22737f8f030d req-476b64d3-eeca-4299-8531-d33ac43ec079 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:29.884701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-11a1855e-e7fd-48b4-9853-22737f8f030d req-476b64d3-eeca-4299-8531-d33ac43ec079 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:29.917986 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-11a1855e-e7fd-48b4-9853-22737f8f030d req-476b64d3-eeca-4299-8531-d33ac43ec079 service nova] Creating event network-vif-deleted:04fd529e-a733-4059-bf00-9954803f29ea for instance c40a3375-decc-47ef-aa2e-0bd8f38ef407 on n-h2-851337-3 Aug 02 06:57:29.927816 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-11a1855e-e7fd-48b4-9853-22737f8f030d req-476b64d3-eeca-4299-8531-d33ac43ec079 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105249 Aug 02 06:57:29.928459 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1283/2696] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:29.933633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-1ad56a11-ade2-4334-879f-561d803d01b7 req-ffc99ddd-bf9c-4718-9261-3bfdfa75db7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aff6869-710b-4239-bc13-f3a275b7a878", "name": "network-vif-plugged", "status": "completed", "tag": "606ee08a-250d-404f-8772-4a64ef82b723"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:29.958845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1ad56a11-ade2-4334-879f-561d803d01b7 req-ffc99ddd-bf9c-4718-9261-3bfdfa75db7b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:29.959989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1ad56a11-ade2-4334-879f-561d803d01b7 req-ffc99ddd-bf9c-4718-9261-3bfdfa75db7b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:29.978015 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-1ad56a11-ade2-4334-879f-561d803d01b7 req-ffc99ddd-bf9c-4718-9261-3bfdfa75db7b service nova] Creating event network-vif-plugged:606ee08a-250d-404f-8772-4a64ef82b723 for instance 7aff6869-710b-4239-bc13-f3a275b7a878 on n-h1-851337-3 Aug 02 06:57:29.996205 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-1ad56a11-ade2-4334-879f-561d803d01b7 req-ffc99ddd-bf9c-4718-9261-3bfdfa75db7b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054439 Aug 02 06:57:30.001403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-35e63257-09bc-4fef-8ffb-0039e2016eb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:30.003463 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1284/2697] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:30.013424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-35e63257-09bc-4fef-8ffb-0039e2016eb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:30.018756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-128d9929-3b8b-4e5f-8d02-e749fe4179e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:30.019792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-128d9929-3b8b-4e5f-8d02-e749fe4179e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:30.029666 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-35e63257-09bc-4fef-8ffb-0039e2016eb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:30.030573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-128d9929-3b8b-4e5f-8d02-e749fe4179e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:30.032025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-128d9929-3b8b-4e5f-8d02-e749fe4179e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:30.033092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-128d9929-3b8b-4e5f-8d02-e749fe4179e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:30.033713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-128d9929-3b8b-4e5f-8d02-e749fe4179e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:30.047114 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-35e63257-09bc-4fef-8ffb-0039e2016eb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1590 microversion: 2.32 time: 0.201570 Aug 02 06:57:30.069517 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1414/2698] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:29 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1590 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:30.293499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-128d9929-3b8b-4e5f-8d02-e749fe4179e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:30.303609 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-128d9929-3b8b-4e5f-8d02-e749fe4179e1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1310 microversion: 2.1 time: 0.298646 Aug 02 06:57:30.304906 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1285/2699] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:30 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1310 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:30.841280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4d3a070d-3f6b-4764-b317-7d9b853c0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:30.841280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4d3a070d-3f6b-4764-b317-7d9b853c0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:30.859770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-01f28465-0cfb-4eef-b4ba-e05b53de6670 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:30.860375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-01f28465-0cfb-4eef-b4ba-e05b53de6670 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] [instance: c40a3375-decc-47ef-aa2e-0bd8f38ef407] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:30.860836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d3a070d-3f6b-4764-b317-7d9b853c0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:30.861304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d3a070d-3f6b-4764-b317-7d9b853c0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:30.863954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d3a070d-3f6b-4764-b317-7d9b853c0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:30.864408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d3a070d-3f6b-4764-b317-7d9b853c0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:30.876371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01f28465-0cfb-4eef-b4ba-e05b53de6670 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:30.877033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01f28465-0cfb-4eef-b4ba-e05b53de6670 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:30.878780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01f28465-0cfb-4eef-b4ba-e05b53de6670 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:30.880548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01f28465-0cfb-4eef-b4ba-e05b53de6670 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:30.928171 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-01f28465-0cfb-4eef-b4ba-e05b53de6670 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] HTTP exception thrown: Instance c40a3375-decc-47ef-aa2e-0bd8f38ef407 could not be found. Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-01f28465-0cfb-4eef-b4ba-e05b53de6670 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Request method failure captured: Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 HTTP/1.1 Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mp2hyhv3Fv4s36MkcFcau5vsg8pyLPW2AoJoY4nZxLc1KrRX4fnmw19oJ2J2UoFsIG_Z1KDiF1mSz1qZTp5aHNXhQ4TqCNEnbxohRIr_Bo3azCeYhgWtymWj8x61NPqaSCpLl1ZiZIq8hck35HhiHWUgpnTBHdbCsEWnyILdoLhQP4 Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 42ec92022d4f4cd1b29391bf914459d6 Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-557210961 Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/42ec92022d4f4cd1b29391bf914459d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/42ec92022d4f4cd1b29391bf914459d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_42ec92022d4f4cd1b29391bf914459d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/42ec92022d4f4cd1b29391bf914459d6"}]}] Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-557210961 Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 42ec92022d4f4cd1b29391bf914459d6 Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-557210961 Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FloatingIPsAssociationTestJSON-557210961-project Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 5c9f038a40df4202b3df8df315c1904b Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-557210961-project Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance c40a3375-decc-47ef-aa2e-0bd8f38ef407 could not be found. Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'c40a3375-decc-47ef-aa2e-0bd8f38ef407'} Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c40a3375-decc-47ef-aa2e-0bd8f38ef407 could not be found. Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c40a3375-decc-47ef-aa2e-0bd8f38ef407 could not be found. Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:30.933114 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:30.938087 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:30.938087 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:30.938087 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:30.938087 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:30.938087 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:57:30.938087 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:57:30.938087 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c40a3375-decc-47ef-aa2e-0bd8f38ef407 could not be found. Aug 02 06:57:30.938087 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:30.944968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-01f28465-0cfb-4eef-b4ba-e05b53de6670 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] Returning 404 to user: Instance c40a3375-decc-47ef-aa2e-0bd8f38ef407 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:57:30.945977 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-01f28465-0cfb-4eef-b4ba-e05b53de6670 tempest-FloatingIPsAssociationTestJSON-557210961 tempest-FloatingIPsAssociationTestJSON-557210961-project] 10.222.0.79 "GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407" status: 404 len: 111 microversion: 2.1 time: 0.090917 Aug 02 06:57:30.946641 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1286/2700] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:30 2022] GET /compute/v2.1/servers/c40a3375-decc-47ef-aa2e-0bd8f38ef407 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:57:31.076819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-171d71d9-cac2-4790-b351-fcf4deafaeaa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:31.077688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-171d71d9-cac2-4790-b351-fcf4deafaeaa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:31.087604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-171d71d9-cac2-4790-b351-fcf4deafaeaa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:31.088303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-171d71d9-cac2-4790-b351-fcf4deafaeaa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:31.098333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-171d71d9-cac2-4790-b351-fcf4deafaeaa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:31.099138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-171d71d9-cac2-4790-b351-fcf4deafaeaa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:31.263891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4d3a070d-3f6b-4764-b317-7d9b853c0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:31.278574 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4d3a070d-3f6b-4764-b317-7d9b853c0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1345 microversion: 2.1 time: 0.438590 Aug 02 06:57:31.279489 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1415/2701] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:30 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1345 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:31.326421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0131c3b5-df1f-4ef0-80dc-b034d1c88021 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:31.327327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0131c3b5-df1f-4ef0-80dc-b034d1c88021 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:31.342954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0131c3b5-df1f-4ef0-80dc-b034d1c88021 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:31.347609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0131c3b5-df1f-4ef0-80dc-b034d1c88021 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:31.352579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0131c3b5-df1f-4ef0-80dc-b034d1c88021 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:31.356432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0131c3b5-df1f-4ef0-80dc-b034d1c88021 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:32.083295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-171d71d9-cac2-4790-b351-fcf4deafaeaa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:32.113343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-171d71d9-cac2-4790-b351-fcf4deafaeaa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:32.116653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-171d71d9-cac2-4790-b351-fcf4deafaeaa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:32.119037 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-171d71d9-cac2-4790-b351-fcf4deafaeaa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1658 microversion: 2.32 time: 1.046178 Aug 02 06:57:32.120023 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1287/2702] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:31 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1658 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:57:32.208538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0131c3b5-df1f-4ef0-80dc-b034d1c88021 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:32.221875 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0131c3b5-df1f-4ef0-80dc-b034d1c88021 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1310 microversion: 2.1 time: 0.900223 Aug 02 06:57:32.225297 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1416/2703] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:31 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1310 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:57:32.300227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bbab6483-45c3-423f-a797-8d2e7865eb37 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:32.301146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bbab6483-45c3-423f-a797-8d2e7865eb37 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:32.308855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbab6483-45c3-423f-a797-8d2e7865eb37 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:32.319549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbab6483-45c3-423f-a797-8d2e7865eb37 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:32.320493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbab6483-45c3-423f-a797-8d2e7865eb37 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:32.321097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbab6483-45c3-423f-a797-8d2e7865eb37 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:32.739477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bbab6483-45c3-423f-a797-8d2e7865eb37 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:32.768792 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bbab6483-45c3-423f-a797-8d2e7865eb37 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1345 microversion: 2.1 time: 0.472477 Aug 02 06:57:32.769402 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1288/2704] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:32 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1345 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:33.145994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b75fd02f-8255-4e5e-974c-b5a1b72a5a2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:33.146701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b75fd02f-8255-4e5e-974c-b5a1b72a5a2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:33.157389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b75fd02f-8255-4e5e-974c-b5a1b72a5a2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:33.157834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b75fd02f-8255-4e5e-974c-b5a1b72a5a2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:33.158629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b75fd02f-8255-4e5e-974c-b5a1b72a5a2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:33.159057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b75fd02f-8255-4e5e-974c-b5a1b72a5a2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:33.255405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ebeef537-97ea-4b36-8f1c-c5e38157b40c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:33.259378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ebeef537-97ea-4b36-8f1c-c5e38157b40c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:33.269400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:33.272411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebeef537-97ea-4b36-8f1c-c5e38157b40c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:33.275245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebeef537-97ea-4b36-8f1c-c5e38157b40c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:33.282226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebeef537-97ea-4b36-8f1c-c5e38157b40c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:33.282801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebeef537-97ea-4b36-8f1c-c5e38157b40c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:34.035733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ebeef537-97ea-4b36-8f1c-c5e38157b40c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:34.048909 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ebeef537-97ea-4b36-8f1c-c5e38157b40c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1492 microversion: 2.1 time: 0.803094 Aug 02 06:57:34.050868 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1289/2705] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:33 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1492 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:57:34.060681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0c4e16ea-fb91-4958-9a7f-769d8848f398 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:34.069815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0c4e16ea-fb91-4958-9a7f-769d8848f398 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:34.101060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c4e16ea-fb91-4958-9a7f-769d8848f398 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:34.103883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c4e16ea-fb91-4958-9a7f-769d8848f398 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:34.104920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c4e16ea-fb91-4958-9a7f-769d8848f398 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:34.105571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c4e16ea-fb91-4958-9a7f-769d8848f398 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:34.138548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b75fd02f-8255-4e5e-974c-b5a1b72a5a2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:34.154469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b75fd02f-8255-4e5e-974c-b5a1b72a5a2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:34.160042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b75fd02f-8255-4e5e-974c-b5a1b72a5a2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:34.163534 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b75fd02f-8255-4e5e-974c-b5a1b72a5a2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1705 microversion: 2.32 time: 1.022813 Aug 02 06:57:34.170358 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1417/2706] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:33 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1705 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:34.183619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ef004131-400e-4a18-b6fa-f35a851d046b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:34.193460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ef004131-400e-4a18-b6fa-f35a851d046b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:34.199901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c4e16ea-fb91-4958-9a7f-769d8848f398 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:34.203010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c4e16ea-fb91-4958-9a7f-769d8848f398 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:34.203777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-0c4e16ea-fb91-4958-9a7f-769d8848f398 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lazy-loading 'fault' on Instance uuid 5b32b61f-03ac-477c-b5d0-1606b9694c26 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:57:34.244362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef004131-400e-4a18-b6fa-f35a851d046b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:34.244828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef004131-400e-4a18-b6fa-f35a851d046b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:34.255530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef004131-400e-4a18-b6fa-f35a851d046b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:34.255530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef004131-400e-4a18-b6fa-f35a851d046b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:34.467397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0c4e16ea-fb91-4958-9a7f-769d8848f398 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:34.485304 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0c4e16ea-fb91-4958-9a7f-769d8848f398 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 200 len: 1350 microversion: 2.1 time: 0.427695 Aug 02 06:57:34.487379 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1290/2707] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:34 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 1350 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:34.702949 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ef004131-400e-4a18-b6fa-f35a851d046b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1643 microversion: 2.1 time: 0.530876 Aug 02 06:57:34.714515 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1418/2708] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:34 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1643 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:34.735626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cbdfca91-46e2-47f4-bc67-de5d9e6c301d tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:34.736786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cbdfca91-46e2-47f4-bc67-de5d9e6c301d tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:34.747174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbdfca91-46e2-47f4-bc67-de5d9e6c301d tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:34.751331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbdfca91-46e2-47f4-bc67-de5d9e6c301d tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:34.752355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbdfca91-46e2-47f4-bc67-de5d9e6c301d tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:34.755128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbdfca91-46e2-47f4-bc67-de5d9e6c301d tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:35.068835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=20 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:35.118675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-69603141", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "7c2a21ed-b799-49f9-b3e2-77f6be4b6e87"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:35.134365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:35.224906 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cbdfca91-46e2-47f4-bc67-de5d9e6c301d tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1643 microversion: 2.1 time: 0.498459 Aug 02 06:57:35.227924 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1419/2709] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:34 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1643 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:35.238100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] validate_networks() for [('7c2a21ed-b799-49f9-b3e2-77f6be4b6e87', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:57:35.252038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3ceb5bf0-bb17-4a29-b702-ab9075dcaf15 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:35.255429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3ceb5bf0-bb17-4a29-b702-ab9075dcaf15 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:35.275653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ceb5bf0-bb17-4a29-b702-ab9075dcaf15 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:35.278221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ceb5bf0-bb17-4a29-b702-ab9075dcaf15 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:35.280689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ceb5bf0-bb17-4a29-b702-ab9075dcaf15 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:35.281146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ceb5bf0-bb17-4a29-b702-ab9075dcaf15 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:36.213433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3ceb5bf0-bb17-4a29-b702-ab9075dcaf15 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:36.226523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3ceb5bf0-bb17-4a29-b702-ab9075dcaf15 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:36.228038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3ceb5bf0-bb17-4a29-b702-ab9075dcaf15 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:36.229201 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3ceb5bf0-bb17-4a29-b702-ab9075dcaf15 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1705 microversion: 2.32 time: 0.999923 Aug 02 06:57:36.238258 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1420/2710] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:35 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1705 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:36.245581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9e6c6de1-d048-408a-8927-eb2bc74ea083 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:36.251268 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 06:57:36.251268 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 06:57:36.252889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e6c6de1-d048-408a-8927-eb2bc74ea083 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:36.253493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e6c6de1-d048-408a-8927-eb2bc74ea083 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:36.254495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e6c6de1-d048-408a-8927-eb2bc74ea083 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:36.255402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e6c6de1-d048-408a-8927-eb2bc74ea083 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:36.287868 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9e6c6de1-d048-408a-8927-eb2bc74ea083 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048267 Aug 02 06:57:36.295680 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1421/2711] 10.222.0.79 () {58 vars in 1176 bytes} [Tue Aug 2 06:57:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:36.300972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ec3b6b76-ccbc-4b24-838f-bea152540286 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:36.302088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ec3b6b76-ccbc-4b24-838f-bea152540286 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:36.308965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec3b6b76-ccbc-4b24-838f-bea152540286 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:36.309718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec3b6b76-ccbc-4b24-838f-bea152540286 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:36.310703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec3b6b76-ccbc-4b24-838f-bea152540286 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:36.311286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec3b6b76-ccbc-4b24-838f-bea152540286 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:36.339895 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-ec3b6b76-ccbc-4b24-838f-bea152540286 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ec3b6b76-ccbc-4b24-838f-bea152540286 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 HTTP/1.1 Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '5b32b61f-03ac-477c-b5d0-1606b9694c26'} Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:36.342013 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:36.346119 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:36.346119 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:36.346119 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:36.346119 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:57:36.346119 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:57:36.346119 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 06:57:36.346119 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:36.354843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ec3b6b76-ccbc-4b24-838f-bea152540286 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:57:36.355956 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ec3b6b76-ccbc-4b24-838f-bea152540286 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 404 len: 111 microversion: 2.1 time: 0.059035 Aug 02 06:57:36.357039 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1422/2712] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:36 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:57:36.374370 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6f22998f-1fb3-4849-903d-12a9391cdc3c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:36.374908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6f22998f-1fb3-4849-903d-12a9391cdc3c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:36.391435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f22998f-1fb3-4849-903d-12a9391cdc3c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:36.391876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f22998f-1fb3-4849-903d-12a9391cdc3c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:36.392660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f22998f-1fb3-4849-903d-12a9391cdc3c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:36.393093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f22998f-1fb3-4849-903d-12a9391cdc3c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:36.408080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:36.494292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:36.503138 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6f22998f-1fb3-4849-903d-12a9391cdc3c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878/action" status: 202 len: 0 microversion: 2.1 time: 0.144574 Aug 02 06:57:36.508972 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1423/2713] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:57:36 2022] POST /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:57:36.537384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a8decd96-68da-49a2-b3b6-c0ed49127a51 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:36.538180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a8decd96-68da-49a2-b3b6-c0ed49127a51 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:36.558586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8decd96-68da-49a2-b3b6-c0ed49127a51 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:36.560151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8decd96-68da-49a2-b3b6-c0ed49127a51 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:36.565153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8decd96-68da-49a2-b3b6-c0ed49127a51 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:36.565867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8decd96-68da-49a2-b3b6-c0ed49127a51 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:37.163681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:57:37.164224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:57:37.164645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:57:37.165059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:57:37.166370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:57:37.167160 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a8decd96-68da-49a2-b3b6-c0ed49127a51 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1648 microversion: 2.1 time: 0.656618 Aug 02 06:57:37.168513 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1424/2714] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:36 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1648 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:37.182869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2d1da34b-31e1-4b40-9387-1f1e158f76ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:37.187763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2d1da34b-31e1-4b40-9387-1f1e158f76ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:37.188904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:37.189370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:37.193030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:37.193530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:37.206096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d1da34b-31e1-4b40-9387-1f1e158f76ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:37.206753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d1da34b-31e1-4b40-9387-1f1e158f76ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:37.209209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d1da34b-31e1-4b40-9387-1f1e158f76ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:37.209771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d1da34b-31e1-4b40-9387-1f1e158f76ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:37.240334 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-2d1da34b-31e1-4b40-9387-1f1e158f76ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2d1da34b-31e1-4b40-9387-1f1e158f76ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26/os-volume_attachments HTTP/1.1 Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'server_id': '5b32b61f-03ac-477c-b5d0-1606b9694c26'} Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:57:37.247499 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:57:37.255473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 06:57:37.255473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:37.255473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:37.255473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:37.255473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:37.255473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:37.255473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:37.255473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:57:37.255473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:57:37.255473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 06:57:37.255473 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:37.255473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2d1da34b-31e1-4b40-9387-1f1e158f76ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:57:37.255473 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2d1da34b-31e1-4b40-9387-1f1e158f76ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.079963 Aug 02 06:57:37.255473 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1425/2715] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 06:57:37 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26/os-volume_attachments => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:57:37.258432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Getting quotas for project ba167934554046859ba8102e8364af7c. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:57:37.266269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-38001587-f9a3-4c14-a6ee-bf1bb4ef2bbc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:37.267145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-38001587-f9a3-4c14-a6ee-bf1bb4ef2bbc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:37.275109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Getting quotas for user ba3a25f8337a4d9dbb49d69959ea64c4 and project ba167934554046859ba8102e8364af7c. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:57:37.284984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38001587-f9a3-4c14-a6ee-bf1bb4ef2bbc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:37.288549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38001587-f9a3-4c14-a6ee-bf1bb4ef2bbc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:37.291233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38001587-f9a3-4c14-a6ee-bf1bb4ef2bbc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:37.293712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38001587-f9a3-4c14-a6ee-bf1bb4ef2bbc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:37.319257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:57:37.329505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:57:37.447875 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a5f46c39-f6c5-4bcf-b332-2326bc55a9a4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.778812 Aug 02 06:57:37.450910 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1291/2716] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 06:57:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2783 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 02 06:57:37.464353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3a8b4766-f392-4381-a848-1995c4106071 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:37.465523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3a8b4766-f392-4381-a848-1995c4106071 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:37.714938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3a8b4766-f392-4381-a848-1995c4106071 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:37.731641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3a8b4766-f392-4381-a848-1995c4106071 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:37.733369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3a8b4766-f392-4381-a848-1995c4106071 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:37.734656 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3a8b4766-f392-4381-a848-1995c4106071 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 200 len: 1257 microversion: 2.21 time: 0.276500 Aug 02 06:57:37.735516 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1292/2717] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:37 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 1257 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:37.745356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1900561741", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "3904ca9d-0f3a-42df-acde-f1e02b7b9720"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:37.896017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] validate_networks() for [('3904ca9d-0f3a-42df-acde-f1e02b7b9720', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:57:38.436474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-38001587-f9a3-4c14-a6ee-bf1bb4ef2bbc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:38.460332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-38001587-f9a3-4c14-a6ee-bf1bb4ef2bbc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:38.467316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-38001587-f9a3-4c14-a6ee-bf1bb4ef2bbc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:38.471155 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-38001587-f9a3-4c14-a6ee-bf1bb4ef2bbc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1752 microversion: 2.32 time: 1.214800 Aug 02 06:57:38.473817 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1426/2718] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:37 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1752 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:38.499240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ebe4700c-abec-4760-b1e0-b13d7337f34f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:38.509833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ebe4700c-abec-4760-b1e0-b13d7337f34f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:38.544774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebe4700c-abec-4760-b1e0-b13d7337f34f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:38.546666 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebe4700c-abec-4760-b1e0-b13d7337f34f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:38.557148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebe4700c-abec-4760-b1e0-b13d7337f34f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:38.557978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebe4700c-abec-4760-b1e0-b13d7337f34f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:39.118889 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ebe4700c-abec-4760-b1e0-b13d7337f34f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1628 microversion: 2.1 time: 0.639347 Aug 02 06:57:39.120285 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1427/2719] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:38 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1628 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:39.137842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cfc1e82f-7af8-4519-afd1-fbc3ca3c5a0f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:39.138823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cfc1e82f-7af8-4519-afd1-fbc3ca3c5a0f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:39.184034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfc1e82f-7af8-4519-afd1-fbc3ca3c5a0f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:39.184628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfc1e82f-7af8-4519-afd1-fbc3ca3c5a0f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:39.189129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfc1e82f-7af8-4519-afd1-fbc3ca3c5a0f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:39.189743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfc1e82f-7af8-4519-afd1-fbc3ca3c5a0f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:39.370933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:57:39.376525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:57:39.377065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:57:39.378474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:57:39.378909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:57:39.426999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:39.427694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:39.434665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:39.447742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:39.514375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Getting quotas for project a004889882844be18e4c30827645050e. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:57:39.536866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Getting quotas for user 0d6870f29383493c86db7e30259b8a8b and project a004889882844be18e4c30827645050e. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:57:39.537244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cfc1e82f-7af8-4519-afd1-fbc3ca3c5a0f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:39.546074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cfc1e82f-7af8-4519-afd1-fbc3ca3c5a0f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:39.547608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cfc1e82f-7af8-4519-afd1-fbc3ca3c5a0f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:39.561813 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cfc1e82f-7af8-4519-afd1-fbc3ca3c5a0f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 200 len: 1309 microversion: 2.21 time: 0.426326 Aug 02 06:57:39.577917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:57:39.578171 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1428/2720] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:39 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 1309 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:39.578269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:57:39.589519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-81ee40f0-863d-4f7a-830d-bb6c069a51be tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851337-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:39.600176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-81ee40f0-863d-4f7a-830d-bb6c069a51be tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:39.626060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81ee40f0-863d-4f7a-830d-bb6c069a51be tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:39.628951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81ee40f0-863d-4f7a-830d-bb6c069a51be tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:39.633498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81ee40f0-863d-4f7a-830d-bb6c069a51be tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:39.636255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81ee40f0-863d-4f7a-830d-bb6c069a51be tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:39.733318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-81ee40f0-863d-4f7a-830d-bb6c069a51be tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lazy-loading 'flavor' on Instance uuid 7aff6869-710b-4239-bc13-f3a275b7a878 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:57:39.767947 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a2d0d1e1-caad-4e4e-8ebc-672d9e84a30a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.029447 Aug 02 06:57:39.774419 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1293/2721] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:57:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:57:39.781261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-81ee40f0-863d-4f7a-830d-bb6c069a51be tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Going to try to live migrate instance to n-h2-851337-3 {{(pid=126120) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 02 06:57:39.806024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5fd00c30-c687-4c1c-ac01-ad7720fe13e8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:39.806814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5fd00c30-c687-4c1c-ac01-ad7720fe13e8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:39.853211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5fd00c30-c687-4c1c-ac01-ad7720fe13e8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:39.858857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5fd00c30-c687-4c1c-ac01-ad7720fe13e8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:39.867374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5fd00c30-c687-4c1c-ac01-ad7720fe13e8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:39.867973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5fd00c30-c687-4c1c-ac01-ad7720fe13e8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:41.199061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5fd00c30-c687-4c1c-ac01-ad7720fe13e8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:41.217551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5fd00c30-c687-4c1c-ac01-ad7720fe13e8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:41.223566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5fd00c30-c687-4c1c-ac01-ad7720fe13e8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:41.227506 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5fd00c30-c687-4c1c-ac01-ad7720fe13e8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1752 microversion: 2.32 time: 1.454215 Aug 02 06:57:41.231942 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1294/2722] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:39 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1752 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:41.252867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7acb115f-ebf3-437f-89c0-f0674b9f99ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:41.254922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7acb115f-ebf3-437f-89c0-f0674b9f99ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:41.271183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7acb115f-ebf3-437f-89c0-f0674b9f99ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:41.272221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7acb115f-ebf3-437f-89c0-f0674b9f99ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:41.276385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7acb115f-ebf3-437f-89c0-f0674b9f99ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:41.277104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7acb115f-ebf3-437f-89c0-f0674b9f99ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:41.670760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7acb115f-ebf3-437f-89c0-f0674b9f99ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:41.688206 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7acb115f-ebf3-437f-89c0-f0674b9f99ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b" status: 200 len: 1219 microversion: 2.1 time: 0.454122 Aug 02 06:57:41.694998 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1295/2723] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:41 2022] GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b => generated 1219 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:41.725507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-41f43f47-92a3-4156-84ff-07a85d025ab1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:41.729330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-41f43f47-92a3-4156-84ff-07a85d025ab1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:41.768783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41f43f47-92a3-4156-84ff-07a85d025ab1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:41.773462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41f43f47-92a3-4156-84ff-07a85d025ab1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:41.782604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41f43f47-92a3-4156-84ff-07a85d025ab1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:41.783772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41f43f47-92a3-4156-84ff-07a85d025ab1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:42.597505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-41f43f47-92a3-4156-84ff-07a85d025ab1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:42.615018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-41f43f47-92a3-4156-84ff-07a85d025ab1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:42.617239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-41f43f47-92a3-4156-84ff-07a85d025ab1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:42.624758 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-41f43f47-92a3-4156-84ff-07a85d025ab1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 200 len: 1315 microversion: 2.21 time: 0.923850 Aug 02 06:57:42.627830 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1296/2724] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:41 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 1315 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:42.635240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0302dfd5-97b1-4471-876b-d7c24ff1c385 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:42.641606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0302dfd5-97b1-4471-876b-d7c24ff1c385 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:42.664146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0302dfd5-97b1-4471-876b-d7c24ff1c385 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:42.670473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0302dfd5-97b1-4471-876b-d7c24ff1c385 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:42.676699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0302dfd5-97b1-4471-876b-d7c24ff1c385 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:42.677747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0302dfd5-97b1-4471-876b-d7c24ff1c385 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:42.767492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0302dfd5-97b1-4471-876b-d7c24ff1c385 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:57:42.981787 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0302dfd5-97b1-4471-876b-d7c24ff1c385 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b" status: 204 len: 0 microversion: 2.1 time: 0.352123 Aug 02 06:57:42.987415 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1297/2725] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:57:42 2022] DELETE /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:57:42.996509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b92867a0-96d7-4975-ba59-6c68329c3c12 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:42.997606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b92867a0-96d7-4975-ba59-6c68329c3c12 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:43.021148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b92867a0-96d7-4975-ba59-6c68329c3c12 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:43.021765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b92867a0-96d7-4975-ba59-6c68329c3c12 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:43.023701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b92867a0-96d7-4975-ba59-6c68329c3c12 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:43.025712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b92867a0-96d7-4975-ba59-6c68329c3c12 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:44.041601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b92867a0-96d7-4975-ba59-6c68329c3c12 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:44.059451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b92867a0-96d7-4975-ba59-6c68329c3c12 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:44.062337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b92867a0-96d7-4975-ba59-6c68329c3c12 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:44.064269 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b92867a0-96d7-4975-ba59-6c68329c3c12 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1846 microversion: 2.32 time: 1.074697 Aug 02 06:57:44.065216 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1298/2726] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:42 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1846 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:44.070644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a7ba8a1f-db4b-4afd-bda8-fe65e49d6302 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:44.071549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a7ba8a1f-db4b-4afd-bda8-fe65e49d6302 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:44.078651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7ba8a1f-db4b-4afd-bda8-fe65e49d6302 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:44.079452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7ba8a1f-db4b-4afd-bda8-fe65e49d6302 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:44.082335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7ba8a1f-db4b-4afd-bda8-fe65e49d6302 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:44.083360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7ba8a1f-db4b-4afd-bda8-fe65e49d6302 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:44.205241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a7ba8a1f-db4b-4afd-bda8-fe65e49d6302 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:44.214164 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a7ba8a1f-db4b-4afd-bda8-fe65e49d6302 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b" status: 200 len: 1273 microversion: 2.1 time: 0.147669 Aug 02 06:57:44.221185 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1299/2727] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:44 2022] GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:44.245580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9f43d423-922d-4f2d-810f-3e871b7d791e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:44.246549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9f43d423-922d-4f2d-810f-3e871b7d791e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:44.259924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f43d423-922d-4f2d-810f-3e871b7d791e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:44.260756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f43d423-922d-4f2d-810f-3e871b7d791e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:44.261793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f43d423-922d-4f2d-810f-3e871b7d791e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:44.268131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f43d423-922d-4f2d-810f-3e871b7d791e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:44.273283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:44.740444 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-81ee40f0-863d-4f7a-830d-bb6c069a51be tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878/action" status: 202 len: 0 microversion: 2.1 time: 5.171413 Aug 02 06:57:44.741038 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1429/2728] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:57:39 2022] POST /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878/action => generated 0 bytes in 5174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:57:44.748548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-954948d3-4439-4c9a-a39d-0402f9efbd8c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:44.749459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-954948d3-4439-4c9a-a39d-0402f9efbd8c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:44.779675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-954948d3-4439-4c9a-a39d-0402f9efbd8c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:44.780421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-954948d3-4439-4c9a-a39d-0402f9efbd8c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:44.781505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-954948d3-4439-4c9a-a39d-0402f9efbd8c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:44.782199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-954948d3-4439-4c9a-a39d-0402f9efbd8c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:44.840114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9f43d423-922d-4f2d-810f-3e871b7d791e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:44.850697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9f43d423-922d-4f2d-810f-3e871b7d791e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:44.856322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9f43d423-922d-4f2d-810f-3e871b7d791e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:44.867650 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9f43d423-922d-4f2d-810f-3e871b7d791e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 200 len: 1357 microversion: 2.21 time: 0.630949 Aug 02 06:57:44.891370 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1300/2729] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:44 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 1357 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:45.093446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb2d8ed0-70eb-40bd-88e9-37de65f505bf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:45.094767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cb2d8ed0-70eb-40bd-88e9-37de65f505bf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:45.117679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb2d8ed0-70eb-40bd-88e9-37de65f505bf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:45.119977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb2d8ed0-70eb-40bd-88e9-37de65f505bf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:45.124609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb2d8ed0-70eb-40bd-88e9-37de65f505bf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:45.127137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb2d8ed0-70eb-40bd-88e9-37de65f505bf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:45.902486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-954948d3-4439-4c9a-a39d-0402f9efbd8c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:45.918544 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-954948d3-4439-4c9a-a39d-0402f9efbd8c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1502 microversion: 2.1 time: 1.174448 Aug 02 06:57:45.923936 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1430/2730] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:44 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1502 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:57:45.930225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-37e7c5b8-93e2-4aba-891a-a265ae943d75 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:45.934673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-37e7c5b8-93e2-4aba-891a-a265ae943d75 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:45.952941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37e7c5b8-93e2-4aba-891a-a265ae943d75 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:45.954953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37e7c5b8-93e2-4aba-891a-a265ae943d75 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:45.969441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37e7c5b8-93e2-4aba-891a-a265ae943d75 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:45.970898 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37e7c5b8-93e2-4aba-891a-a265ae943d75 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:46.265182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:46.386412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cb2d8ed0-70eb-40bd-88e9-37de65f505bf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:46.396371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cb2d8ed0-70eb-40bd-88e9-37de65f505bf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:46.398313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cb2d8ed0-70eb-40bd-88e9-37de65f505bf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:46.399660 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cb2d8ed0-70eb-40bd-88e9-37de65f505bf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1846 microversion: 2.32 time: 1.311121 Aug 02 06:57:46.406533 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1301/2731] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:45 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1846 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:46.414749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f0a58e6b-5e22-4023-b1cd-49300215b193 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:46.415923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f0a58e6b-5e22-4023-b1cd-49300215b193 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:46.425058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0a58e6b-5e22-4023-b1cd-49300215b193 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:46.426925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0a58e6b-5e22-4023-b1cd-49300215b193 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:46.430099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0a58e6b-5e22-4023-b1cd-49300215b193 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:46.431316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0a58e6b-5e22-4023-b1cd-49300215b193 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:46.448413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-37e7c5b8-93e2-4aba-891a-a265ae943d75 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:46.477102 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-37e7c5b8-93e2-4aba-891a-a265ae943d75 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b" status: 200 len: 1315 microversion: 2.1 time: 0.547414 Aug 02 06:57:46.479313 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1431/2732] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:45 2022] GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:46.493447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-3c738d5c-35b6-4d02-9137-650096a4aa61 req-7438378b-34e1-4197-9a98-c5e56d6a1cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab80f74-9eff-44a9-9d24-bce4027dd923", "tag": "70266341-0b8c-4eb5-acf1-21baf8c823ce"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:46.547687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-3c738d5c-35b6-4d02-9137-650096a4aa61 req-7438378b-34e1-4197-9a98-c5e56d6a1cb3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:46.548127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-3c738d5c-35b6-4d02-9137-650096a4aa61 req-7438378b-34e1-4197-9a98-c5e56d6a1cb3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:46.560262 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-3c738d5c-35b6-4d02-9137-650096a4aa61 req-7438378b-34e1-4197-9a98-c5e56d6a1cb3 service nova] Creating event network-changed:70266341-0b8c-4eb5-acf1-21baf8c823ce for instance aab80f74-9eff-44a9-9d24-bce4027dd923 on n-h1-851337-3 Aug 02 06:57:46.565365 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-3c738d5c-35b6-4d02-9137-650096a4aa61 req-7438378b-34e1-4197-9a98-c5e56d6a1cb3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083607 Aug 02 06:57:46.566586 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1432/2733] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:46.952478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a298989e-7d3c-4c38-882f-789aa3d72aad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:46.953246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a298989e-7d3c-4c38-882f-789aa3d72aad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:46.961364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a298989e-7d3c-4c38-882f-789aa3d72aad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:46.962977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a298989e-7d3c-4c38-882f-789aa3d72aad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:46.964152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a298989e-7d3c-4c38-882f-789aa3d72aad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:46.965526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a298989e-7d3c-4c38-882f-789aa3d72aad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:47.604572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f0a58e6b-5e22-4023-b1cd-49300215b193 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:47.616626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f0a58e6b-5e22-4023-b1cd-49300215b193 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:47.621565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f0a58e6b-5e22-4023-b1cd-49300215b193 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:47.624638 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f0a58e6b-5e22-4023-b1cd-49300215b193 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 200 len: 1357 microversion: 2.21 time: 1.215937 Aug 02 06:57:47.626743 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1302/2734] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:46 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 1357 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:47.632906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-25bf3a9c-a357-43eb-91e5-5c54cdb1a3f3 req-1d6f7c5f-71d2-43f3-845e-0585d3f840e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "tag": "25aa727a-724d-4084-bf7a-ee4c3a07cce3"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:47.666162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-25bf3a9c-a357-43eb-91e5-5c54cdb1a3f3 req-1d6f7c5f-71d2-43f3-845e-0585d3f840e0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:47.666657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-25bf3a9c-a357-43eb-91e5-5c54cdb1a3f3 req-1d6f7c5f-71d2-43f3-845e-0585d3f840e0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:47.687809 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-25bf3a9c-a357-43eb-91e5-5c54cdb1a3f3 req-1d6f7c5f-71d2-43f3-845e-0585d3f840e0 service nova] Creating event network-changed:25aa727a-724d-4084-bf7a-ee4c3a07cce3 for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:57:47.695530 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-25bf3a9c-a357-43eb-91e5-5c54cdb1a3f3 req-1d6f7c5f-71d2-43f3-845e-0585d3f840e0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067336 Aug 02 06:57:47.696664 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1303/2735] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:47.708157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d28b23b1-c341-495a-9fcf-aadaa7d4f03b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:47.709074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d28b23b1-c341-495a-9fcf-aadaa7d4f03b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:47.723468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d28b23b1-c341-495a-9fcf-aadaa7d4f03b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:47.723468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d28b23b1-c341-495a-9fcf-aadaa7d4f03b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:47.727461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d28b23b1-c341-495a-9fcf-aadaa7d4f03b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:47.727923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d28b23b1-c341-495a-9fcf-aadaa7d4f03b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:47.826519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a298989e-7d3c-4c38-882f-789aa3d72aad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:47.844590 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a298989e-7d3c-4c38-882f-789aa3d72aad tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1502 microversion: 2.1 time: 0.899264 Aug 02 06:57:47.845807 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1433/2736] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:46 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1502 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:47.859024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-573d263b-3bda-4f61-8b13-b88680957741 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:47.859653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-573d263b-3bda-4f61-8b13-b88680957741 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:47.871340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-573d263b-3bda-4f61-8b13-b88680957741 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:47.871798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-573d263b-3bda-4f61-8b13-b88680957741 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:47.872745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-573d263b-3bda-4f61-8b13-b88680957741 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:47.873108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-573d263b-3bda-4f61-8b13-b88680957741 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:48.882391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d28b23b1-c341-495a-9fcf-aadaa7d4f03b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:48.896206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d28b23b1-c341-495a-9fcf-aadaa7d4f03b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:48.903290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d28b23b1-c341-495a-9fcf-aadaa7d4f03b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:48.904512 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d28b23b1-c341-495a-9fcf-aadaa7d4f03b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1846 microversion: 2.32 time: 1.206752 Aug 02 06:57:48.905097 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1304/2737] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:47 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1846 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:48.909820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ec6c4863-fe56-4ced-bc96-7122fd901c5c req-46980d06-6d72-4847-a851-43867e4d320b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c0413c2-3159-4a74-8005-5b265e6cf69b", "tag": "39c873df-f9ff-43ae-a781-be699246ea63"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:48.939544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ec6c4863-fe56-4ced-bc96-7122fd901c5c req-46980d06-6d72-4847-a851-43867e4d320b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:48.939998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ec6c4863-fe56-4ced-bc96-7122fd901c5c req-46980d06-6d72-4847-a851-43867e4d320b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:48.953290 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ec6c4863-fe56-4ced-bc96-7122fd901c5c req-46980d06-6d72-4847-a851-43867e4d320b service nova] Creating event network-changed:39c873df-f9ff-43ae-a781-be699246ea63 for instance 1c0413c2-3159-4a74-8005-5b265e6cf69b on n-h2-851337-3 Aug 02 06:57:48.974833 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ec6c4863-fe56-4ced-bc96-7122fd901c5c req-46980d06-6d72-4847-a851-43867e4d320b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067795 Aug 02 06:57:48.975836 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1305/2738] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:48.989984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-403a79e9-4eb1-4828-b7f7-2d76547a7a0d tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:48.990934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-403a79e9-4eb1-4828-b7f7-2d76547a7a0d tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:49.021076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-403a79e9-4eb1-4828-b7f7-2d76547a7a0d tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:49.021533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-403a79e9-4eb1-4828-b7f7-2d76547a7a0d tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:49.024041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-403a79e9-4eb1-4828-b7f7-2d76547a7a0d tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:49.025328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-403a79e9-4eb1-4828-b7f7-2d76547a7a0d tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:49.095481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-573d263b-3bda-4f61-8b13-b88680957741 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:49.104750 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-573d263b-3bda-4f61-8b13-b88680957741 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b" status: 200 len: 1315 microversion: 2.1 time: 1.257591 Aug 02 06:57:49.105345 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1434/2739] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:47 2022] GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b => generated 1315 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:49.113544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bd3f366b-a836-442e-9db2-f571929ddb30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:49.114184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bd3f366b-a836-442e-9db2-f571929ddb30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:49.130835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd3f366b-a836-442e-9db2-f571929ddb30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:49.132342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd3f366b-a836-442e-9db2-f571929ddb30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:49.133976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd3f366b-a836-442e-9db2-f571929ddb30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:49.139861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd3f366b-a836-442e-9db2-f571929ddb30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:49.488355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:49.554757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=14 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:49.822362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-403a79e9-4eb1-4828-b7f7-2d76547a7a0d tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:49.835971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bd3f366b-a836-442e-9db2-f571929ddb30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:49.840372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-403a79e9-4eb1-4828-b7f7-2d76547a7a0d tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:49.845581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-403a79e9-4eb1-4828-b7f7-2d76547a7a0d tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:49.853037 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bd3f366b-a836-442e-9db2-f571929ddb30 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1502 microversion: 2.1 time: 0.746561 Aug 02 06:57:49.853645 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1435/2740] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:49 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1502 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:49.856772 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-403a79e9-4eb1-4828-b7f7-2d76547a7a0d tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 200 len: 1357 microversion: 2.21 time: 0.879058 Aug 02 06:57:49.862004 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1306/2741] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:48 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 1357 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:49.928094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dab951a2-4908-4aba-a1e0-b8851170b802 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:49.928958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dab951a2-4908-4aba-a1e0-b8851170b802 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:49.936438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dab951a2-4908-4aba-a1e0-b8851170b802 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:49.937121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dab951a2-4908-4aba-a1e0-b8851170b802 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:49.938280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dab951a2-4908-4aba-a1e0-b8851170b802 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:49.938944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dab951a2-4908-4aba-a1e0-b8851170b802 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:50.127747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-99db1412-aa3a-4c46-a3fa-b501829efcbb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:50.131354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-99db1412-aa3a-4c46-a3fa-b501829efcbb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:50.155850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99db1412-aa3a-4c46-a3fa-b501829efcbb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:50.158451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99db1412-aa3a-4c46-a3fa-b501829efcbb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:50.161438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99db1412-aa3a-4c46-a3fa-b501829efcbb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:50.162585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99db1412-aa3a-4c46-a3fa-b501829efcbb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:51.024047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dab951a2-4908-4aba-a1e0-b8851170b802 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:51.071773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dab951a2-4908-4aba-a1e0-b8851170b802 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:51.078177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dab951a2-4908-4aba-a1e0-b8851170b802 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:51.081340 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dab951a2-4908-4aba-a1e0-b8851170b802 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1867 microversion: 2.32 time: 1.157544 Aug 02 06:57:51.081963 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1436/2742] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:49 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1867 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:57:51.110713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-17e2d52c-f488-4acf-b593-a12fc2fac04b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:51.119495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-17e2d52c-f488-4acf-b593-a12fc2fac04b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:51.148104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17e2d52c-f488-4acf-b593-a12fc2fac04b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:51.152315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17e2d52c-f488-4acf-b593-a12fc2fac04b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:51.154226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17e2d52c-f488-4acf-b593-a12fc2fac04b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:51.158373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17e2d52c-f488-4acf-b593-a12fc2fac04b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:51.175277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-99db1412-aa3a-4c46-a3fa-b501829efcbb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:51.193796 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-99db1412-aa3a-4c46-a3fa-b501829efcbb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b" status: 200 len: 1315 microversion: 2.1 time: 1.072858 Aug 02 06:57:51.198270 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1307/2743] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:50 2022] GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b => generated 1315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:51.205709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aaaa9d26-2373-4df1-bbac-eedcb0f9acd7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:51.206716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aaaa9d26-2373-4df1-bbac-eedcb0f9acd7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:51.234477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aaaa9d26-2373-4df1-bbac-eedcb0f9acd7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:51.236006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aaaa9d26-2373-4df1-bbac-eedcb0f9acd7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:51.240232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aaaa9d26-2373-4df1-bbac-eedcb0f9acd7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:51.240935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aaaa9d26-2373-4df1-bbac-eedcb0f9acd7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:51.704769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-17e2d52c-f488-4acf-b593-a12fc2fac04b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:51.714993 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-17e2d52c-f488-4acf-b593-a12fc2fac04b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1502 microversion: 2.1 time: 0.629948 Aug 02 06:57:51.717882 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1437/2744] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:51 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1502 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:51.725536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-48c82a69-9d14-4bef-9d51-c26286584a4d req-54a00d68-794a-41a4-ac28-9ef68ed54b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aff6869-710b-4239-bc13-f3a275b7a878", "name": "network-vif-unplugged", "status": "completed", "tag": "606ee08a-250d-404f-8772-4a64ef82b723"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:51.749213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-48c82a69-9d14-4bef-9d51-c26286584a4d req-54a00d68-794a-41a4-ac28-9ef68ed54b03 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:51.754608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-48c82a69-9d14-4bef-9d51-c26286584a4d req-54a00d68-794a-41a4-ac28-9ef68ed54b03 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:51.760638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:51.794807 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-48c82a69-9d14-4bef-9d51-c26286584a4d req-54a00d68-794a-41a4-ac28-9ef68ed54b03 service nova] Creating event network-vif-unplugged:606ee08a-250d-404f-8772-4a64ef82b723 for instance 7aff6869-710b-4239-bc13-f3a275b7a878 on n-h1-851337-3 Aug 02 06:57:51.808689 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-48c82a69-9d14-4bef-9d51-c26286584a4d req-54a00d68-794a-41a4-ac28-9ef68ed54b03 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089293 Aug 02 06:57:51.809335 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1438/2745] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:51.908974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aaaa9d26-2373-4df1-bbac-eedcb0f9acd7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:51.921082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aaaa9d26-2373-4df1-bbac-eedcb0f9acd7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:51.934604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aaaa9d26-2373-4df1-bbac-eedcb0f9acd7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:51.936138 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aaaa9d26-2373-4df1-bbac-eedcb0f9acd7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 200 len: 1357 microversion: 2.21 time: 0.736815 Aug 02 06:57:51.937241 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1308/2746] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:51 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 1357 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:51.953800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-76b6111b-83a4-4df2-a72b-643e22aa5b1f req-dd8623c6-f764-48be-b656-6955000bfb0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "tag": "3700e74e-8d56-4f36-963b-62599cf5f662"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:51.974072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-76b6111b-83a4-4df2-a72b-643e22aa5b1f req-dd8623c6-f764-48be-b656-6955000bfb0b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:51.974994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-76b6111b-83a4-4df2-a72b-643e22aa5b1f req-dd8623c6-f764-48be-b656-6955000bfb0b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:51.992154 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-76b6111b-83a4-4df2-a72b-643e22aa5b1f req-dd8623c6-f764-48be-b656-6955000bfb0b service nova] Creating event network-changed:3700e74e-8d56-4f36-963b-62599cf5f662 for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:57:52.002982 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-76b6111b-83a4-4df2-a72b-643e22aa5b1f req-dd8623c6-f764-48be-b656-6955000bfb0b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064270 Aug 02 06:57:52.005095 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1309/2747] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:52.111541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4a4c82a7-2733-490c-8f24-9a438937f1cb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:52.112904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4a4c82a7-2733-490c-8f24-9a438937f1cb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:52.128023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a4c82a7-2733-490c-8f24-9a438937f1cb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:52.132541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a4c82a7-2733-490c-8f24-9a438937f1cb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:52.134968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a4c82a7-2733-490c-8f24-9a438937f1cb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:52.135583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a4c82a7-2733-490c-8f24-9a438937f1cb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:52.512781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b9e621d8-34a0-4ccf-8aa8-5b2703f00208 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Calling method '.version_select at 0x7f927aa97550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:52.538304 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-b9e621d8-34a0-4ccf-8aa8-5b2703f00208 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] HTTP exception thrown: Image not found. Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b9e621d8-34a0-4ccf-8aa8-5b2703f00208 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Request method failure captured: Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/images/48020a8e-aa42-4718-9284-cbd4a2cffd1c/metadata/os_distro HTTP/1.1 Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MrvWhZoGvgUjG0anvs7rQ63pPmpAPWU6I2j4CGt4rzhrn3OevfUlT1HQp6PfKA51HDAOH2c3PEXsgyK76H1Jh--A7-E6yweHtu9NwkKM92_uFd_GD2bsxtYMOAMNqOUuBLtkIom5k1QWHfV_iShoNnyFMfPJt9-z_H5YoVU5U--EPA Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: f7e625953b4c47dc92506b6431d2d61c Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f7e625953b4c47dc92506b6431d2d61c"}]}] Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: f7e625953b4c47dc92506b6431d2d61c Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesMetadataNegativeTestJSON-2083525189-project Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: f270c25fc8a34b99b76c63525047114d Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189-project Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: exception: Image not found. Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'image_id': '48020a8e-aa42-4718-9284-cbd4a2cffd1c', 'id': 'os_distro'} Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 48020a8e-aa42-4718-9284-cbd4a2cffd1c Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 02 06:57:52.551286 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 48020a8e-aa42-4718-9284-cbd4a2cffd1c could not be found. Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b9e621d8-34a0-4ccf-8aa8-5b2703f00208 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Returning 404 to user: Image not found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b9e621d8-34a0-4ccf-8aa8-5b2703f00208 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] 10.222.0.79 "DELETE /compute/v2.1/images/48020a8e-aa42-4718-9284-cbd4a2cffd1c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.742954 Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1439/2748] 10.222.0.79 () {58 vars in 1293 bytes} [Tue Aug 2 06:57:51 2022] DELETE /compute/v2.1/images/48020a8e-aa42-4718-9284-cbd4a2cffd1c/metadata/os_distro => generated 62 bytes in 744 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:57:52.560913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-01812c41-6375-4396-85db-bfb0b1d3f65c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:52.565108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-01812c41-6375-4396-85db-bfb0b1d3f65c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:52.568482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-01812c41-6375-4396-85db-bfb0b1d3f65c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:52.568937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-01812c41-6375-4396-85db-bfb0b1d3f65c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:52.569706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-01812c41-6375-4396-85db-bfb0b1d3f65c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:52.570157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-01812c41-6375-4396-85db-bfb0b1d3f65c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:53.144479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-01812c41-6375-4396-85db-bfb0b1d3f65c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:53.154366 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-01812c41-6375-4396-85db-bfb0b1d3f65c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b" status: 200 len: 1315 microversion: 2.1 time: 0.599140 Aug 02 06:57:53.154950 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1440/2749] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:52 2022] GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:53.165856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3e5eb8da-dac8-4ef1-8c61-60980bd48eb5 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Calling method '.version_select at 0x7f927aa97d30>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:53.182552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4a4c82a7-2733-490c-8f24-9a438937f1cb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:53.196642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4a4c82a7-2733-490c-8f24-9a438937f1cb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:53.199137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4a4c82a7-2733-490c-8f24-9a438937f1cb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:53.200680 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4a4c82a7-2733-490c-8f24-9a438937f1cb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1867 microversion: 2.32 time: 1.094397 Aug 02 06:57:53.201940 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1310/2750] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:52 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1867 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:57:53.208142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e0629ca7-ed20-4895-9ef8-195f6c500366 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:53.209079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e0629ca7-ed20-4895-9ef8-195f6c500366 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:53.211863 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-3e5eb8da-dac8-4ef1-8c61-60980bd48eb5 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] HTTP exception thrown: Image not found. Aug 02 06:57:53.218316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0629ca7-ed20-4895-9ef8-195f6c500366 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:53.219316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0629ca7-ed20-4895-9ef8-195f6c500366 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:53.220297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0629ca7-ed20-4895-9ef8-195f6c500366 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:53.220944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0629ca7-ed20-4895-9ef8-195f6c500366 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3e5eb8da-dac8-4ef1-8c61-60980bd48eb5 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Request method failure captured: Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/images/7114603d-9254-4d89-8b2a-abfc029ceba3/metadata/os_version HTTP/1.1 Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MrvWhZoGvgUjG0anvs7rQ63pPmpAPWU6I2j4CGt4rzhrn3OevfUlT1HQp6PfKA51HDAOH2c3PEXsgyK76H1Jh--A7-E6yweHtu9NwkKM92_uFd_GD2bsxtYMOAMNqOUuBLtkIom5k1QWHfV_iShoNnyFMfPJt9-z_H5YoVU5U--EPA Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: f7e625953b4c47dc92506b6431d2d61c Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f7e625953b4c47dc92506b6431d2d61c"}]}] Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: f7e625953b4c47dc92506b6431d2d61c Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesMetadataNegativeTestJSON-2083525189-project Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: f270c25fc8a34b99b76c63525047114d Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189-project Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: exception: Image not found. Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'image_id': '7114603d-9254-4d89-8b2a-abfc029ceba3', 'id': 'os_version'} Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7114603d-9254-4d89-8b2a-abfc029ceba3 Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 02 06:57:53.221181 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7114603d-9254-4d89-8b2a-abfc029ceba3 could not be found. Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3e5eb8da-dac8-4ef1-8c61-60980bd48eb5 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Returning 404 to user: Image not found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3e5eb8da-dac8-4ef1-8c61-60980bd48eb5 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] 10.222.0.79 "GET /compute/v2.1/images/7114603d-9254-4d89-8b2a-abfc029ceba3/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.066846 Aug 02 06:57:53.225631 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1441/2751] 10.222.0.79 () {58 vars in 1293 bytes} [Tue Aug 2 06:57:53 2022] GET /compute/v2.1/images/7114603d-9254-4d89-8b2a-abfc029ceba3/metadata/os_version => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:57:53.238119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bfed16be-78ba-44c8-99da-cf701359e365 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:53.238746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bfed16be-78ba-44c8-99da-cf701359e365 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:53.259517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfed16be-78ba-44c8-99da-cf701359e365 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:53.259879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfed16be-78ba-44c8-99da-cf701359e365 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:53.260675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfed16be-78ba-44c8-99da-cf701359e365 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:53.265435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfed16be-78ba-44c8-99da-cf701359e365 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:53.607846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e0629ca7-ed20-4895-9ef8-195f6c500366 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:53.623483 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e0629ca7-ed20-4895-9ef8-195f6c500366 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1502 microversion: 2.1 time: 0.418870 Aug 02 06:57:53.624276 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1311/2752] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:53 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1502 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:53.627440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bfed16be-78ba-44c8-99da-cf701359e365 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:53.638929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bfed16be-78ba-44c8-99da-cf701359e365 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:53.642973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bfed16be-78ba-44c8-99da-cf701359e365 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:53.644424 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bfed16be-78ba-44c8-99da-cf701359e365 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 200 len: 1357 microversion: 2.21 time: 0.420243 Aug 02 06:57:53.645517 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1442/2753] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:53 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 1357 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:53.656723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-52b828f2-90ec-4b6d-9aef-1f1d03169776 req-d721f5a8-f9d6-4a7a-9841-8f267ca66c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c0413c2-3159-4a74-8005-5b265e6cf69b", "name": "network-vif-plugged", "status": "completed", "tag": "39c873df-f9ff-43ae-a781-be699246ea63"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:53.673564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d74e8ab9-a184-4c5e-8b59-8435129045a5 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Calling method '.version_select at 0x7f927b0ee4c0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:53.690603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-52b828f2-90ec-4b6d-9aef-1f1d03169776 req-d721f5a8-f9d6-4a7a-9841-8f267ca66c59 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:53.691061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-52b828f2-90ec-4b6d-9aef-1f1d03169776 req-d721f5a8-f9d6-4a7a-9841-8f267ca66c59 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:53.706131 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-d74e8ab9-a184-4c5e-8b59-8435129045a5 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] HTTP exception thrown: Image not found. Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d74e8ab9-a184-4c5e-8b59-8435129045a5 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Request method failure captured: Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/images/c02f2b21-3bb2-403c-96f9-a2a4962f1dc0/metadata HTTP/1.1 Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MrvWhZoGvgUjG0anvs7rQ63pPmpAPWU6I2j4CGt4rzhrn3OevfUlT1HQp6PfKA51HDAOH2c3PEXsgyK76H1Jh--A7-E6yweHtu9NwkKM92_uFd_GD2bsxtYMOAMNqOUuBLtkIom5k1QWHfV_iShoNnyFMfPJt9-z_H5YoVU5U--EPA Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: f7e625953b4c47dc92506b6431d2d61c Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f7e625953b4c47dc92506b6431d2d61c"}]}] Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: f7e625953b4c47dc92506b6431d2d61c Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesMetadataNegativeTestJSON-2083525189-project Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: f270c25fc8a34b99b76c63525047114d Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189-project Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: exception: Image not found. Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'image_id': 'c02f2b21-3bb2-403c-96f9-a2a4962f1dc0'} Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c02f2b21-3bb2-403c-96f9-a2a4962f1dc0 Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 02 06:57:53.708553 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c02f2b21-3bb2-403c-96f9-a2a4962f1dc0 could not be found. Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:57:53.713099 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.716676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d74e8ab9-a184-4c5e-8b59-8435129045a5 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Returning 404 to user: Image not found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:57:53.718998 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d74e8ab9-a184-4c5e-8b59-8435129045a5 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] 10.222.0.79 "GET /compute/v2.1/images/c02f2b21-3bb2-403c-96f9-a2a4962f1dc0/metadata" status: 404 len: 62 microversion: 2.1 time: 0.059735 Aug 02 06:57:53.725013 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1443/2754] 10.222.0.79 () {58 vars in 1260 bytes} [Tue Aug 2 06:57:53 2022] GET /compute/v2.1/images/c02f2b21-3bb2-403c-96f9-a2a4962f1dc0/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:57:53.725807 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-52b828f2-90ec-4b6d-9aef-1f1d03169776 req-d721f5a8-f9d6-4a7a-9841-8f267ca66c59 service nova] Creating event network-vif-plugged:39c873df-f9ff-43ae-a781-be699246ea63 for instance 1c0413c2-3159-4a74-8005-5b265e6cf69b on n-h2-851337-3 Aug 02 06:57:53.729611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2f9ca06c-fc36-4fd0-8873-0e465f87c321 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Action: 'update_all', calling method: .version_select at 0x7f927b251670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:53.738015 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-52b828f2-90ec-4b6d-9aef-1f1d03169776 req-d721f5a8-f9d6-4a7a-9841-8f267ca66c59 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107717 Aug 02 06:57:53.739071 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1312/2755] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:53.781788 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-2f9ca06c-fc36-4fd0-8873-0e465f87c321 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] HTTP exception thrown: Image not found. Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2f9ca06c-fc36-4fd0-8873-0e465f87c321 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Request method failure captured: Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: request: PUT /compute/v2.1/images/e64f3d4b-2fac-4c14-8f5d-70ac37d396cd/metadata HTTP/1.1 Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 57 Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MrvWhZoGvgUjG0anvs7rQ63pPmpAPWU6I2j4CGt4rzhrn3OevfUlT1HQp6PfKA51HDAOH2c3PEXsgyK76H1Jh--A7-E6yweHtu9NwkKM92_uFd_GD2bsxtYMOAMNqOUuBLtkIom5k1QWHfV_iShoNnyFMfPJt9-z_H5YoVU5U--EPA Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: f7e625953b4c47dc92506b6431d2d61c Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f7e625953b4c47dc92506b6431d2d61c"}]}] Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: f7e625953b4c47dc92506b6431d2d61c Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ImagesMetadataNegativeTestJSON-2083525189-project Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: f270c25fc8a34b99b76c63525047114d Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189-project Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: exception: Image not found. Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'image_id': 'e64f3d4b-2fac-4c14-8f5d-70ac37d396cd', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e64f3d4b-2fac-4c14-8f5d-70ac37d396cd Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 02 06:57:53.784645 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e64f3d4b-2fac-4c14-8f5d-70ac37d396cd could not be found. Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2f9ca06c-fc36-4fd0-8873-0e465f87c321 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Returning 404 to user: Image not found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:57:53.789180 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2f9ca06c-fc36-4fd0-8873-0e465f87c321 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] 10.222.0.79 "PUT /compute/v2.1/images/e64f3d4b-2fac-4c14-8f5d-70ac37d396cd/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062384 Aug 02 06:57:53.792233 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1444/2756] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:57:53 2022] PUT /compute/v2.1/images/e64f3d4b-2fac-4c14-8f5d-70ac37d396cd/metadata => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:57:53.800640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c204befe-f984-493b-b392-bf20f0dffa99 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Action: 'update', calling method: .version_select at 0x7f927b1ab040>, body: {"meta": {"os_distro": "alt"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:53.835498 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-c204befe-f984-493b-b392-bf20f0dffa99 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] HTTP exception thrown: Image not found. Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c204befe-f984-493b-b392-bf20f0dffa99 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Request method failure captured: Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: request: PUT /compute/v2.1/images/bd5d26d5-8f7e-4af6-b224-14b5ef0667b5/metadata/os_distro HTTP/1.1 Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 30 Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MrvWhZoGvgUjG0anvs7rQ63pPmpAPWU6I2j4CGt4rzhrn3OevfUlT1HQp6PfKA51HDAOH2c3PEXsgyK76H1Jh--A7-E6yweHtu9NwkKM92_uFd_GD2bsxtYMOAMNqOUuBLtkIom5k1QWHfV_iShoNnyFMfPJt9-z_H5YoVU5U--EPA Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: f7e625953b4c47dc92506b6431d2d61c Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f7e625953b4c47dc92506b6431d2d61c"}]}] Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: f7e625953b4c47dc92506b6431d2d61c Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesMetadataNegativeTestJSON-2083525189-project Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: f270c25fc8a34b99b76c63525047114d Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189-project Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: {"meta": {"os_distro": "alt"}} Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: exception: Image not found. Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'image_id': 'bd5d26d5-8f7e-4af6-b224-14b5ef0667b5', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bd5d26d5-8f7e-4af6-b224-14b5ef0667b5 Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 02 06:57:53.838354 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bd5d26d5-8f7e-4af6-b224-14b5ef0667b5 could not be found. Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:57:53.842166 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.844875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-08230af7-1085-4a79-8ab3-c3f2bf6c9108 req-dbf26c53-964c-4e2c-a47f-6f3a9a1e6f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aff6869-710b-4239-bc13-f3a275b7a878", "tag": "606ee08a-250d-404f-8772-4a64ef82b723"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:53.847058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c204befe-f984-493b-b392-bf20f0dffa99 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Returning 404 to user: Image not found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:57:53.848177 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c204befe-f984-493b-b392-bf20f0dffa99 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] 10.222.0.79 "PUT /compute/v2.1/images/bd5d26d5-8f7e-4af6-b224-14b5ef0667b5/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.052673 Aug 02 06:57:53.848975 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1313/2757] 10.222.0.79 () {60 vars in 1310 bytes} [Tue Aug 2 06:57:53 2022] PUT /compute/v2.1/images/bd5d26d5-8f7e-4af6-b224-14b5ef0667b5/metadata/os_distro => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 06:57:53.856827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-08230af7-1085-4a79-8ab3-c3f2bf6c9108 req-dbf26c53-964c-4e2c-a47f-6f3a9a1e6f36 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:53.858816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-08230af7-1085-4a79-8ab3-c3f2bf6c9108 req-dbf26c53-964c-4e2c-a47f-6f3a9a1e6f36 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:53.860689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-31fe1b71-913b-4249-9ed2-36d3a7b08cf1 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Action: 'create', calling method: .version_select at 0x7f927ab06550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:53.875704 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-08230af7-1085-4a79-8ab3-c3f2bf6c9108 req-dbf26c53-964c-4e2c-a47f-6f3a9a1e6f36 service nova] Creating event network-changed:606ee08a-250d-404f-8772-4a64ef82b723 for instance 7aff6869-710b-4239-bc13-f3a275b7a878 on n-h1-851337-3 Aug 02 06:57:53.884823 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-08230af7-1085-4a79-8ab3-c3f2bf6c9108 req-dbf26c53-964c-4e2c-a47f-6f3a9a1e6f36 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049900 Aug 02 06:57:53.886592 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1445/2758] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:57:53.911062 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-31fe1b71-913b-4249-9ed2-36d3a7b08cf1 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] HTTP exception thrown: Image not found. Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-31fe1b71-913b-4249-9ed2-36d3a7b08cf1 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Request method failure captured: Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/images/d5063bc5-eae8-427c-8d82-4c4f1a8fcd8e/metadata HTTP/1.1 Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 57 Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MrvWhZoGvgUjG0anvs7rQ63pPmpAPWU6I2j4CGt4rzhrn3OevfUlT1HQp6PfKA51HDAOH2c3PEXsgyK76H1Jh--A7-E6yweHtu9NwkKM92_uFd_GD2bsxtYMOAMNqOUuBLtkIom5k1QWHfV_iShoNnyFMfPJt9-z_H5YoVU5U--EPA Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: f7e625953b4c47dc92506b6431d2d61c Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f7e625953b4c47dc92506b6431d2d61c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f7e625953b4c47dc92506b6431d2d61c"}]}] Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: f7e625953b4c47dc92506b6431d2d61c Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189 Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ImagesMetadataNegativeTestJSON-2083525189-project Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: f270c25fc8a34b99b76c63525047114d Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2083525189-project Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: exception: Image not found. Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'image_id': 'd5063bc5-eae8-427c-8d82-4c4f1a8fcd8e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d5063bc5-eae8-427c-8d82-4c4f1a8fcd8e Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 02 06:57:53.913388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d5063bc5-eae8-427c-8d82-4c4f1a8fcd8e could not be found. Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 02 06:57:53.917744 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:57:53.922717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-31fe1b71-913b-4249-9ed2-36d3a7b08cf1 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] Returning 404 to user: Image not found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:57:53.923838 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-31fe1b71-913b-4249-9ed2-36d3a7b08cf1 tempest-ImagesMetadataNegativeTestJSON-2083525189 tempest-ImagesMetadataNegativeTestJSON-2083525189-project] 10.222.0.79 "POST /compute/v2.1/images/d5063bc5-eae8-427c-8d82-4c4f1a8fcd8e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.068509 Aug 02 06:57:53.924658 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1314/2759] 10.222.0.79 () {60 vars in 1281 bytes} [Tue Aug 2 06:57:53 2022] POST /compute/v2.1/images/d5063bc5-eae8-427c-8d82-4c4f1a8fcd8e/metadata => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 02 06:57:54.049630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-2227260e-6d5a-4f52-a0c4-95ea1f7c51fe req-b7a028de-a4c5-4b75-a387-63f6a389f305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "tag": "cb505991-c8fe-43b4-b901-90af67c63340"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:54.088847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2227260e-6d5a-4f52-a0c4-95ea1f7c51fe req-b7a028de-a4c5-4b75-a387-63f6a389f305 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:54.089309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2227260e-6d5a-4f52-a0c4-95ea1f7c51fe req-b7a028de-a4c5-4b75-a387-63f6a389f305 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:54.114717 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-2227260e-6d5a-4f52-a0c4-95ea1f7c51fe req-b7a028de-a4c5-4b75-a387-63f6a389f305 service nova] Creating event network-changed:cb505991-c8fe-43b4-b901-90af67c63340 for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:57:54.127749 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-2227260e-6d5a-4f52-a0c4-95ea1f7c51fe req-b7a028de-a4c5-4b75-a387-63f6a389f305 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083528 Aug 02 06:57:54.128366 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1446/2760] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:54.183664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ee4ade10-2843-41eb-b215-9777494c2737 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:54.184473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ee4ade10-2843-41eb-b215-9777494c2737 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:54.204395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee4ade10-2843-41eb-b215-9777494c2737 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:54.206594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee4ade10-2843-41eb-b215-9777494c2737 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:54.207636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee4ade10-2843-41eb-b215-9777494c2737 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:54.208091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee4ade10-2843-41eb-b215-9777494c2737 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:54.228044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7562b5c-08e0-4eb4-a047-57e23525fa99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:54.228756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e7562b5c-08e0-4eb4-a047-57e23525fa99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:54.251774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7562b5c-08e0-4eb4-a047-57e23525fa99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:54.252517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7562b5c-08e0-4eb4-a047-57e23525fa99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:54.254074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7562b5c-08e0-4eb4-a047-57e23525fa99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:54.254532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7562b5c-08e0-4eb4-a047-57e23525fa99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:55.404642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ee4ade10-2843-41eb-b215-9777494c2737 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:55.416230 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ee4ade10-2843-41eb-b215-9777494c2737 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b" status: 200 len: 1315 microversion: 2.1 time: 1.240008 Aug 02 06:57:55.417065 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1315/2761] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:54 2022] GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b => generated 1315 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:55.431859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f79a2b01-2ef1-417e-91ff-5520e4fe246e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:55.432875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f79a2b01-2ef1-417e-91ff-5520e4fe246e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:55.434630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e7562b5c-08e0-4eb4-a047-57e23525fa99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:55.449821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e7562b5c-08e0-4eb4-a047-57e23525fa99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:55.452302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e7562b5c-08e0-4eb4-a047-57e23525fa99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:55.455277 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7562b5c-08e0-4eb4-a047-57e23525fa99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1888 microversion: 2.32 time: 1.231771 Aug 02 06:57:55.457395 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1447/2762] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:54 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1888 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:57:55.467692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6189826b-2f9b-4dce-b09e-3f2fd280207a tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:55.470212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6189826b-2f9b-4dce-b09e-3f2fd280207a tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:55.472346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f79a2b01-2ef1-417e-91ff-5520e4fe246e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:55.473869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f79a2b01-2ef1-417e-91ff-5520e4fe246e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:55.478520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f79a2b01-2ef1-417e-91ff-5520e4fe246e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:55.479083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f79a2b01-2ef1-417e-91ff-5520e4fe246e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:55.485565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6189826b-2f9b-4dce-b09e-3f2fd280207a tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:55.490655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6189826b-2f9b-4dce-b09e-3f2fd280207a tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:55.491657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6189826b-2f9b-4dce-b09e-3f2fd280207a tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:55.492260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6189826b-2f9b-4dce-b09e-3f2fd280207a tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:55.929477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6189826b-2f9b-4dce-b09e-3f2fd280207a tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:55.938874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6189826b-2f9b-4dce-b09e-3f2fd280207a tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:55.945201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6189826b-2f9b-4dce-b09e-3f2fd280207a tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:55.946416 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6189826b-2f9b-4dce-b09e-3f2fd280207a tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 200 len: 1357 microversion: 2.21 time: 0.485718 Aug 02 06:57:55.946970 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1448/2763] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:55 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 1357 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:55.965617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-747c1d6a-c086-4eb6-b41b-1dae90696319 req-9df23836-914f-4fbd-990a-5f3d150c41c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab80f74-9eff-44a9-9d24-bce4027dd923", "name": "network-vif-plugged", "status": "completed", "tag": "70266341-0b8c-4eb5-acf1-21baf8c823ce"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:55.987399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f79a2b01-2ef1-417e-91ff-5520e4fe246e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:55.999430 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f79a2b01-2ef1-417e-91ff-5520e4fe246e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1502 microversion: 2.1 time: 0.577609 Aug 02 06:57:56.000078 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1316/2764] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:55 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1502 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:56.023555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-747c1d6a-c086-4eb6-b41b-1dae90696319 req-9df23836-914f-4fbd-990a-5f3d150c41c0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:56.026021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-747c1d6a-c086-4eb6-b41b-1dae90696319 req-9df23836-914f-4fbd-990a-5f3d150c41c0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:56.051096 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-747c1d6a-c086-4eb6-b41b-1dae90696319 req-9df23836-914f-4fbd-990a-5f3d150c41c0 service nova] Creating event network-vif-plugged:70266341-0b8c-4eb5-acf1-21baf8c823ce for instance aab80f74-9eff-44a9-9d24-bce4027dd923 on n-h1-851337-3 Aug 02 06:57:56.059337 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-747c1d6a-c086-4eb6-b41b-1dae90696319 req-9df23836-914f-4fbd-990a-5f3d150c41c0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107631 Aug 02 06:57:56.060008 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1449/2765] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:56.410743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-22099c39-5f0a-48b0-8db2-d16be28eff44 req-9c7c5ae9-45b1-41ac-9baa-fefa51d0ff96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "tag": "3955d63c-80ec-4a2b-9a0a-54b7d2089a40"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:56.425346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-22099c39-5f0a-48b0-8db2-d16be28eff44 req-9c7c5ae9-45b1-41ac-9baa-fefa51d0ff96 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:56.426269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-22099c39-5f0a-48b0-8db2-d16be28eff44 req-9c7c5ae9-45b1-41ac-9baa-fefa51d0ff96 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:56.438087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0c53e4d6-4527-46f7-ab20-7af20e6da252 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:56.438707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0c53e4d6-4527-46f7-ab20-7af20e6da252 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:56.441191 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-22099c39-5f0a-48b0-8db2-d16be28eff44 req-9c7c5ae9-45b1-41ac-9baa-fefa51d0ff96 service nova] Creating event network-changed:3955d63c-80ec-4a2b-9a0a-54b7d2089a40 for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:57:56.448854 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-22099c39-5f0a-48b0-8db2-d16be28eff44 req-9c7c5ae9-45b1-41ac-9baa-fefa51d0ff96 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041157 Aug 02 06:57:56.450318 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1317/2766] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:56.454064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c53e4d6-4527-46f7-ab20-7af20e6da252 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:56.454523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c53e4d6-4527-46f7-ab20-7af20e6da252 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:56.455319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c53e4d6-4527-46f7-ab20-7af20e6da252 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:56.455981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c53e4d6-4527-46f7-ab20-7af20e6da252 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:56.485372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7e03aab6-4274-4c0b-b5e3-8c862fdfefa7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:56.486330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7e03aab6-4274-4c0b-b5e3-8c862fdfefa7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:56.498011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e03aab6-4274-4c0b-b5e3-8c862fdfefa7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:56.502359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e03aab6-4274-4c0b-b5e3-8c862fdfefa7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:56.503280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e03aab6-4274-4c0b-b5e3-8c862fdfefa7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:56.503729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e03aab6-4274-4c0b-b5e3-8c862fdfefa7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:57.185198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0c53e4d6-4527-46f7-ab20-7af20e6da252 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:57.193071 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0c53e4d6-4527-46f7-ab20-7af20e6da252 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b" status: 200 len: 1315 microversion: 2.1 time: 0.759965 Aug 02 06:57:57.213950 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1450/2767] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:56 2022] GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:57.219318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-80618754-88c8-4d89-ab14-ec54580e9cc4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:57.226219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-80618754-88c8-4d89-ab14-ec54580e9cc4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:57.239718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80618754-88c8-4d89-ab14-ec54580e9cc4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:57.241303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80618754-88c8-4d89-ab14-ec54580e9cc4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:57.244435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80618754-88c8-4d89-ab14-ec54580e9cc4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:57.245623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80618754-88c8-4d89-ab14-ec54580e9cc4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:57.262675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7e03aab6-4274-4c0b-b5e3-8c862fdfefa7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:57.281636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7e03aab6-4274-4c0b-b5e3-8c862fdfefa7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:57.283651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7e03aab6-4274-4c0b-b5e3-8c862fdfefa7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:57.290948 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7e03aab6-4274-4c0b-b5e3-8c862fdfefa7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1888 microversion: 2.32 time: 0.807276 Aug 02 06:57:57.292625 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1318/2768] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:56 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1888 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:57.301473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c7caa708-75f8-4ece-b3e7-7fea20597f27 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:57.306115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c7caa708-75f8-4ece-b3e7-7fea20597f27 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:57.324557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7caa708-75f8-4ece-b3e7-7fea20597f27 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:57.326322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7caa708-75f8-4ece-b3e7-7fea20597f27 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:57.329280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7caa708-75f8-4ece-b3e7-7fea20597f27 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:57.329829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7caa708-75f8-4ece-b3e7-7fea20597f27 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:57.997162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-80618754-88c8-4d89-ab14-ec54580e9cc4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:58.039279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-80618754-88c8-4d89-ab14-ec54580e9cc4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:58.043069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-80618754-88c8-4d89-ab14-ec54580e9cc4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:58.044277 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-80618754-88c8-4d89-ab14-ec54580e9cc4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 200 len: 1357 microversion: 2.21 time: 0.828993 Aug 02 06:57:58.047585 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1451/2769] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:57 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 1357 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:58.063338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6c79cda7-3d2d-4dc5-b66d-7ecb67948d04 req-c2c048d8-245b-4814-beb7-d4628bf4958e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c0413c2-3159-4a74-8005-5b265e6cf69b", "name": "network-vif-deleted", "tag": "39c873df-f9ff-43ae-a781-be699246ea63"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:58.079869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=76 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:57:58.092082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6c79cda7-3d2d-4dc5-b66d-7ecb67948d04 req-c2c048d8-245b-4814-beb7-d4628bf4958e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:58.093681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6c79cda7-3d2d-4dc5-b66d-7ecb67948d04 req-c2c048d8-245b-4814-beb7-d4628bf4958e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:58.121758 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-6c79cda7-3d2d-4dc5-b66d-7ecb67948d04 req-c2c048d8-245b-4814-beb7-d4628bf4958e service nova] Creating event network-vif-deleted:39c873df-f9ff-43ae-a781-be699246ea63 for instance 1c0413c2-3159-4a74-8005-5b265e6cf69b on n-h2-851337-3 Aug 02 06:57:58.134636 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6c79cda7-3d2d-4dc5-b66d-7ecb67948d04 req-c2c048d8-245b-4814-beb7-d4628bf4958e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080793 Aug 02 06:57:58.139048 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1452/2770] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:58.225039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5b7cd407-d29b-47d9-8cf3-d1d8d59baa59 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:58.225947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5b7cd407-d29b-47d9-8cf3-d1d8d59baa59 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:58.245806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b7cd407-d29b-47d9-8cf3-d1d8d59baa59 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:58.246293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b7cd407-d29b-47d9-8cf3-d1d8d59baa59 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:58.247123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b7cd407-d29b-47d9-8cf3-d1d8d59baa59 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:58.249772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b7cd407-d29b-47d9-8cf3-d1d8d59baa59 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:58.435115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c7caa708-75f8-4ece-b3e7-7fea20597f27 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:58.444759 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c7caa708-75f8-4ece-b3e7-7fea20597f27 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1502 microversion: 2.1 time: 1.150123 Aug 02 06:57:58.445535 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1319/2771] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:57 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1502 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:57:58.462044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5b7cd407-d29b-47d9-8cf3-d1d8d59baa59 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:58.472485 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5b7cd407-d29b-47d9-8cf3-d1d8d59baa59 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b" status: 200 len: 1294 microversion: 2.1 time: 0.252301 Aug 02 06:57:58.474975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a0fcb7b1-87e7-414e-ba67-4e9589c6fcfc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:58.475615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a0fcb7b1-87e7-414e-ba67-4e9589c6fcfc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:58.494374 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1453/2772] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:58 2022] GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b => generated 1294 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:57:58.505766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a0fcb7b1-87e7-414e-ba67-4e9589c6fcfc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:58.506255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a0fcb7b1-87e7-414e-ba67-4e9589c6fcfc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:58.507050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a0fcb7b1-87e7-414e-ba67-4e9589c6fcfc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:58.507497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a0fcb7b1-87e7-414e-ba67-4e9589c6fcfc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:59.067850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c51f638b-bfcb-4803-ab21-8fdbdcb4a6b1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:59.068523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c51f638b-bfcb-4803-ab21-8fdbdcb4a6b1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:59.080946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c51f638b-bfcb-4803-ab21-8fdbdcb4a6b1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:59.081660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c51f638b-bfcb-4803-ab21-8fdbdcb4a6b1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:59.087200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c51f638b-bfcb-4803-ab21-8fdbdcb4a6b1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:59.087837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c51f638b-bfcb-4803-ab21-8fdbdcb4a6b1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:59.089549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a0fcb7b1-87e7-414e-ba67-4e9589c6fcfc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:59.110591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a0fcb7b1-87e7-414e-ba67-4e9589c6fcfc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:59.112511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a0fcb7b1-87e7-414e-ba67-4e9589c6fcfc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:59.119449 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a0fcb7b1-87e7-414e-ba67-4e9589c6fcfc tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1888 microversion: 2.32 time: 0.672812 Aug 02 06:57:59.135467 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1320/2773] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:58 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1888 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:59.346441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c2cb325d-3d56-452c-ac06-50d95fe6c14e req-39114be6-ee48-455d-bb4c-4df0847bf8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "tag": "32cec3a6-9298-4f4e-927b-827dd64b2baf"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:57:59.361603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c2cb325d-3d56-452c-ac06-50d95fe6c14e req-39114be6-ee48-455d-bb4c-4df0847bf8de service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:59.364776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c2cb325d-3d56-452c-ac06-50d95fe6c14e req-39114be6-ee48-455d-bb4c-4df0847bf8de service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:59.399965 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c2cb325d-3d56-452c-ac06-50d95fe6c14e req-39114be6-ee48-455d-bb4c-4df0847bf8de service nova] Creating event network-changed:32cec3a6-9298-4f4e-927b-827dd64b2baf for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:57:59.414856 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c2cb325d-3d56-452c-ac06-50d95fe6c14e req-39114be6-ee48-455d-bb4c-4df0847bf8de service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072999 Aug 02 06:57:59.416090 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1321/2774] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:57:59.443988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c51f638b-bfcb-4803-ab21-8fdbdcb4a6b1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:59.460532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c51f638b-bfcb-4803-ab21-8fdbdcb4a6b1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:59.462268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c51f638b-bfcb-4803-ab21-8fdbdcb4a6b1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:57:59.470417 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c51f638b-bfcb-4803-ab21-8fdbdcb4a6b1 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 200 len: 1550 microversion: 2.21 time: 0.405827 Aug 02 06:57:59.470983 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1454/2775] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:57:59 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 1550 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:57:59.488748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d7b2326c-cb42-41bc-b855-2aab154a1a70 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:59.491134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d7b2326c-cb42-41bc-b855-2aab154a1a70 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:59.493109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab6bad39-e306-495b-bddf-159a9cd62632 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:59.493699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab6bad39-e306-495b-bddf-159a9cd62632 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:59.506663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7b2326c-cb42-41bc-b855-2aab154a1a70 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:59.507431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7b2326c-cb42-41bc-b855-2aab154a1a70 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:59.507975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab6bad39-e306-495b-bddf-159a9cd62632 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:59.508538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab6bad39-e306-495b-bddf-159a9cd62632 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:59.508995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7b2326c-cb42-41bc-b855-2aab154a1a70 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:59.509654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7b2326c-cb42-41bc-b855-2aab154a1a70 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:59.510159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab6bad39-e306-495b-bddf-159a9cd62632 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:59.520337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab6bad39-e306-495b-bddf-159a9cd62632 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:59.568543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab6bad39-e306-495b-bddf-159a9cd62632 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:57:59.724479 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab6bad39-e306-495b-bddf-159a9cd62632 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 204 len: 0 microversion: 2.21 time: 0.235605 Aug 02 06:57:59.725008 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1455/2776] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:57:59 2022] DELETE /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 02 06:57:59.734305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ef2d73e4-d95e-477f-8dae-1bbff1b6f4fa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:57:59.735227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ef2d73e4-d95e-477f-8dae-1bbff1b6f4fa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:57:59.743911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef2d73e4-d95e-477f-8dae-1bbff1b6f4fa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:59.744596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef2d73e4-d95e-477f-8dae-1bbff1b6f4fa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:57:59.745531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef2d73e4-d95e-477f-8dae-1bbff1b6f4fa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:57:59.746175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef2d73e4-d95e-477f-8dae-1bbff1b6f4fa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:00.023233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ef2d73e4-d95e-477f-8dae-1bbff1b6f4fa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:00.035130 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ef2d73e4-d95e-477f-8dae-1bbff1b6f4fa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b" status: 200 len: 1294 microversion: 2.1 time: 0.308873 Aug 02 06:58:00.035716 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1456/2777] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:59 2022] GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b => generated 1294 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:00.041410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6e8bde10-cd4b-44de-adff-ea597a5bc1d7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:00.058405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6e8bde10-cd4b-44de-adff-ea597a5bc1d7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:00.092805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e8bde10-cd4b-44de-adff-ea597a5bc1d7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:00.093528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e8bde10-cd4b-44de-adff-ea597a5bc1d7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:00.094559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e8bde10-cd4b-44de-adff-ea597a5bc1d7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:00.095150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e8bde10-cd4b-44de-adff-ea597a5bc1d7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:01.443762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d7b2326c-cb42-41bc-b855-2aab154a1a70 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:01.446563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:01.506615 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d7b2326c-cb42-41bc-b855-2aab154a1a70 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1502 microversion: 2.1 time: 2.026654 Aug 02 06:58:01.507412 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1322/2778] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:57:59 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1502 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:58:01.517648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b72886da-4aa6-49bf-8262-c0d6c0f9eeb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:01.518284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b72886da-4aa6-49bf-8262-c0d6c0f9eeb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:01.549015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b72886da-4aa6-49bf-8262-c0d6c0f9eeb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:01.552090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b72886da-4aa6-49bf-8262-c0d6c0f9eeb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:01.554595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b72886da-4aa6-49bf-8262-c0d6c0f9eeb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:01.556227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b72886da-4aa6-49bf-8262-c0d6c0f9eeb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:02.064868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6e8bde10-cd4b-44de-adff-ea597a5bc1d7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:02.120020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6e8bde10-cd4b-44de-adff-ea597a5bc1d7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:02.133293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6e8bde10-cd4b-44de-adff-ea597a5bc1d7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:02.140309 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6e8bde10-cd4b-44de-adff-ea597a5bc1d7 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 200 len: 1556 microversion: 2.21 time: 2.101962 Aug 02 06:58:02.143414 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1457/2779] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:00 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 1556 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:02.172289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-63875aec-5eab-4d21-942c-16ad5998ad45 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:02.175526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-63875aec-5eab-4d21-942c-16ad5998ad45 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:02.192968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63875aec-5eab-4d21-942c-16ad5998ad45 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:02.194864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63875aec-5eab-4d21-942c-16ad5998ad45 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:02.196440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63875aec-5eab-4d21-942c-16ad5998ad45 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:02.197615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63875aec-5eab-4d21-942c-16ad5998ad45 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:02.232227 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-63875aec-5eab-4d21-942c-16ad5998ad45 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-63875aec-5eab-4d21-942c-16ad5998ad45 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b HTTP/1.1 Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '1c0413c2-3159-4a74-8005-5b265e6cf69b'} Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:58:02.236851 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:58:02.241460 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:02.241460 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:58:02.241460 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:58:02.241460 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:58:02.241460 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:58:02.241460 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 06:58:02.241460 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:58:02.242908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-63875aec-5eab-4d21-942c-16ad5998ad45 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:58:02.246390 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-63875aec-5eab-4d21-942c-16ad5998ad45 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b" status: 404 len: 111 microversion: 2.1 time: 0.097606 Aug 02 06:58:02.247522 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1458/2780] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:02 2022] GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:58:02.525133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1642160456", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "3904ca9d-0f3a-42df-acde-f1e02b7b9720"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:02.609276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b72886da-4aa6-49bf-8262-c0d6c0f9eeb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:02.617455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] validate_networks() for [('3904ca9d-0f3a-42df-acde-f1e02b7b9720', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:58:02.630493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b72886da-4aa6-49bf-8262-c0d6c0f9eeb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:02.633493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b72886da-4aa6-49bf-8262-c0d6c0f9eeb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:02.635463 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b72886da-4aa6-49bf-8262-c0d6c0f9eeb8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1888 microversion: 2.32 time: 1.126990 Aug 02 06:58:02.636436 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1323/2781] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:01 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1888 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:02.641866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6927aaaf-3c52-45d0-b85b-6787e845e8f1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:02.642845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6927aaaf-3c52-45d0-b85b-6787e845e8f1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:02.651651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6927aaaf-3c52-45d0-b85b-6787e845e8f1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:02.652465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6927aaaf-3c52-45d0-b85b-6787e845e8f1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:02.653843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6927aaaf-3c52-45d0-b85b-6787e845e8f1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:02.654459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6927aaaf-3c52-45d0-b85b-6787e845e8f1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:03.535668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6927aaaf-3c52-45d0-b85b-6787e845e8f1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:03.555377 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6927aaaf-3c52-45d0-b85b-6787e845e8f1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1502 microversion: 2.1 time: 0.917388 Aug 02 06:58:03.557708 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1324/2782] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:02 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1502 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:03.565420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-33c7e9bf-ecb3-4e3e-ab97-7e80a40e6b9f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:03.567115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-33c7e9bf-ecb3-4e3e-ab97-7e80a40e6b9f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:03.577499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:03.580798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33c7e9bf-ecb3-4e3e-ab97-7e80a40e6b9f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:03.581771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33c7e9bf-ecb3-4e3e-ab97-7e80a40e6b9f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:03.583399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33c7e9bf-ecb3-4e3e-ab97-7e80a40e6b9f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:03.586183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33c7e9bf-ecb3-4e3e-ab97-7e80a40e6b9f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:03.653780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33c7e9bf-ecb3-4e3e-ab97-7e80a40e6b9f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:03.655703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33c7e9bf-ecb3-4e3e-ab97-7e80a40e6b9f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:03.656890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-33c7e9bf-ecb3-4e3e-ab97-7e80a40e6b9f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lazy-loading 'fault' on Instance uuid aab80f74-9eff-44a9-9d24-bce4027dd923 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:58:03.855085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-33c7e9bf-ecb3-4e3e-ab97-7e80a40e6b9f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:03.871826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-33c7e9bf-ecb3-4e3e-ab97-7e80a40e6b9f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:03.884604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-33c7e9bf-ecb3-4e3e-ab97-7e80a40e6b9f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba3a25f8337a4d9dbb49d69959ea64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba167934554046859ba8102e8364af7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:03.890812 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-33c7e9bf-ecb3-4e3e-ab97-7e80a40e6b9f tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 200 len: 1347 microversion: 2.21 time: 0.329792 Aug 02 06:58:03.894119 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1325/2783] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:03 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 1347 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:03.902111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-612f7fb1-9431-4f44-9d47-9bb3fcd0b780 req-c9d3e0f5-bcb4-49ea-a5a0-5dec6c39c2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab80f74-9eff-44a9-9d24-bce4027dd923", "name": "network-vif-deleted", "tag": "70266341-0b8c-4eb5-acf1-21baf8c823ce"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:03.927823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-612f7fb1-9431-4f44-9d47-9bb3fcd0b780 req-c9d3e0f5-bcb4-49ea-a5a0-5dec6c39c2d8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:03.929454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-612f7fb1-9431-4f44-9d47-9bb3fcd0b780 req-c9d3e0f5-bcb4-49ea-a5a0-5dec6c39c2d8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:03.946217 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-612f7fb1-9431-4f44-9d47-9bb3fcd0b780 req-c9d3e0f5-bcb4-49ea-a5a0-5dec6c39c2d8 service nova] Creating event network-vif-deleted:70266341-0b8c-4eb5-acf1-21baf8c823ce for instance aab80f74-9eff-44a9-9d24-bce4027dd923 on n-h1-851337-3 Aug 02 06:58:03.952715 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-612f7fb1-9431-4f44-9d47-9bb3fcd0b780 req-c9d3e0f5-bcb4-49ea-a5a0-5dec6c39c2d8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056258 Aug 02 06:58:03.954036 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1326/2784] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:03.959713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-86b7b69c-cbb4-414e-8472-daabb7995c99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:03.960743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-86b7b69c-cbb4-414e-8472-daabb7995c99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:03.978897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86b7b69c-cbb4-414e-8472-daabb7995c99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:03.979661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86b7b69c-cbb4-414e-8472-daabb7995c99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:03.980711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86b7b69c-cbb4-414e-8472-daabb7995c99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:03.981398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86b7b69c-cbb4-414e-8472-daabb7995c99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:04.915392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-86b7b69c-cbb4-414e-8472-daabb7995c99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:04.936913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-86b7b69c-cbb4-414e-8472-daabb7995c99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:04.946004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-86b7b69c-cbb4-414e-8472-daabb7995c99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:04.953995 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-86b7b69c-cbb4-414e-8472-daabb7995c99 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.994487 Aug 02 06:58:04.957923 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1327/2785] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:03 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:04.976582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a65b32fe-5950-4f96-8fb6-51ebe53ae2e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:04.978933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a65b32fe-5950-4f96-8fb6-51ebe53ae2e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:05.002376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a65b32fe-5950-4f96-8fb6-51ebe53ae2e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:05.003360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a65b32fe-5950-4f96-8fb6-51ebe53ae2e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:05.005202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a65b32fe-5950-4f96-8fb6-51ebe53ae2e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:05.008856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a65b32fe-5950-4f96-8fb6-51ebe53ae2e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:05.714147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:58:05.714677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:58:05.716158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:58:05.716690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:58:05.717523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:58:05.737292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:05.738439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:05.741171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:05.743676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:05.775496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a65b32fe-5950-4f96-8fb6-51ebe53ae2e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:05.791292 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a65b32fe-5950-4f96-8fb6-51ebe53ae2e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1477 microversion: 2.1 time: 0.831591 Aug 02 06:58:05.793808 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1328/2786] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:04 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1477 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:05.796736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Getting quotas for project a004889882844be18e4c30827645050e. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:58:05.805787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-108f8227-ec88-421f-9be9-7899afce636c tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:05.810940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-108f8227-ec88-421f-9be9-7899afce636c tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:05.813042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Getting quotas for user 0d6870f29383493c86db7e30259b8a8b and project a004889882844be18e4c30827645050e. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:58:05.827413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-108f8227-ec88-421f-9be9-7899afce636c tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:05.827965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-108f8227-ec88-421f-9be9-7899afce636c tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:05.829201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-108f8227-ec88-421f-9be9-7899afce636c tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:05.829722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-108f8227-ec88-421f-9be9-7899afce636c tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:05.841139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:58:05.843872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:58:05.886738 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-108f8227-ec88-421f-9be9-7899afce636c tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] HTTP exception thrown: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-108f8227-ec88-421f-9be9-7899afce636c tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Request method failure captured: Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 HTTP/1.1 Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mrd3Ph-jwAut21dSXNHZUIv2LYbRUZgg0VqYOBhh92fPjQoM6oYss-tSmMGH6lQ61hW8yVCgCw4kmpxgwRA0oOsL5_pbfjLU2wVj2Mam9fXwlyZWP_mwnHbtncHhkV4IqQn8EcMrOckGdy9QnQYWTduumIL-jLRxOZl7mslnxYVRc8 Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Openstack-Nova-Api-Version: 2.21 Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: ba167934554046859ba8102e8364af7c Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-InstanceActionsV221TestJSON-211567310 Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ba167934554046859ba8102e8364af7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ba167934554046859ba8102e8364af7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ba167934554046859ba8102e8364af7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ba167934554046859ba8102e8364af7c"}]}] Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-InstanceActionsV221TestJSON-211567310 Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: ba167934554046859ba8102e8364af7c Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-211567310 Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-InstanceActionsV221TestJSON-211567310-project Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: ba3a25f8337a4d9dbb49d69959ea64c4 Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-InstanceActionsV221TestJSON-211567310-project Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'aab80f74-9eff-44a9-9d24-bce4027dd923'} Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:05.891088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:58:05.895495 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:05.895495 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:05.895495 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:58:05.895495 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:58:05.895495 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:58:05.895495 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:58:05.895495 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:05.895495 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:05.900446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-108f8227-ec88-421f-9be9-7899afce636c tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Returning 404 to user: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:58:05.902158 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-108f8227-ec88-421f-9be9-7899afce636c tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 404 len: 111 microversion: 2.21 time: 0.106190 Aug 02 06:58:05.906540 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1329/2787] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:05 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:58:05.936066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-730f3375-60e2-4322-b9bd-8366d8238928 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '.version_select at 0x7f927ab064c0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:05.947594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-730f3375-60e2-4322-b9bd-8366d8238928 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:05.956307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-730f3375-60e2-4322-b9bd-8366d8238928 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:05.957067 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0233371f-1ffd-42de-8125-864f37bf6e01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.436392 Aug 02 06:58:05.969066 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1459/2788] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 06:58:05.980205 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-730f3375-60e2-4322-b9bd-8366d8238928 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 783 microversion: 2.1 time: 0.069780 Aug 02 06:58:05.981173 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1330/2789] 10.222.0.79 () {58 vars in 1143 bytes} [Tue Aug 2 06:58:05 2022] GET /compute/v2.1/os-migrations => generated 783 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:05.987445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d2df21d4-46c1-4841-9df2-785936708bd4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '.version_select at 0x7f927b3c0940>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:05.988518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d2df21d4-46c1-4841-9df2-785936708bd4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:05.989715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-9997b36b-4cde-4a4f-b3e1-5570a15da616 req-98538d6f-725b-491d-b4b7-e44c2563e967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "tag": "68c6c37c-41e1-43c2-ab74-6a4e3a848c4a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:06.011793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2df21d4-46c1-4841-9df2-785936708bd4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:06.013097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2df21d4-46c1-4841-9df2-785936708bd4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:06.014803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2df21d4-46c1-4841-9df2-785936708bd4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:06.017032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9997b36b-4cde-4a4f-b3e1-5570a15da616 req-98538d6f-725b-491d-b4b7-e44c2563e967 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:06.018884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2df21d4-46c1-4841-9df2-785936708bd4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:06.026149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9997b36b-4cde-4a4f-b3e1-5570a15da616 req-98538d6f-725b-491d-b4b7-e44c2563e967 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:06.045518 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-9997b36b-4cde-4a4f-b3e1-5570a15da616 req-98538d6f-725b-491d-b4b7-e44c2563e967 service nova] Creating event network-changed:68c6c37c-41e1-43c2-ab74-6a4e3a848c4a for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:58:06.069527 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-9997b36b-4cde-4a4f-b3e1-5570a15da616 req-98538d6f-725b-491d-b4b7-e44c2563e967 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086326 Aug 02 06:58:06.074751 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1331/2790] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:06.111631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-51ca9c07-6490-4c00-9a94-13b22f4e2db1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:06.118519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-51ca9c07-6490-4c00-9a94-13b22f4e2db1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:06.301217 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d2df21d4-46c1-4841-9df2-785936708bd4 tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.328681 Aug 02 06:58:06.313184 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1460/2791] 10.222.0.79 () {60 vars in 1337 bytes} [Tue Aug 2 06:58:05 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923/os-instance-actions => generated 611 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 06:58:06.320821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a560da1a-5b99-4e48-b8ff-e18700aef4c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:06.321819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a560da1a-5b99-4e48-b8ff-e18700aef4c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:06.330524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a560da1a-5b99-4e48-b8ff-e18700aef4c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:06.331203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a560da1a-5b99-4e48-b8ff-e18700aef4c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:06.332322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a560da1a-5b99-4e48-b8ff-e18700aef4c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:06.333082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a560da1a-5b99-4e48-b8ff-e18700aef4c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:06.645915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-51ca9c07-6490-4c00-9a94-13b22f4e2db1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:06.654188 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-51ca9c07-6490-4c00-9a94-13b22f4e2db1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1215 microversion: 2.1 time: 0.577832 Aug 02 06:58:06.655601 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1332/2792] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:06 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1215 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:06.665316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cdb4dae6-eb56-4b00-9afe-5a7e6db1078f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:06.667942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cdb4dae6-eb56-4b00-9afe-5a7e6db1078f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:06.688781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdb4dae6-eb56-4b00-9afe-5a7e6db1078f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:06.689435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdb4dae6-eb56-4b00-9afe-5a7e6db1078f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:06.690497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdb4dae6-eb56-4b00-9afe-5a7e6db1078f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:06.691038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdb4dae6-eb56-4b00-9afe-5a7e6db1078f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:07.646346 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cdb4dae6-eb56-4b00-9afe-5a7e6db1078f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1628 microversion: 2.1 time: 0.988665 Aug 02 06:58:07.649258 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1333/2793] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:06 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1628 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:07.662528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6b3e89f2-258e-44c9-8be8-315ad4dc67ac tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:07.663851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6b3e89f2-258e-44c9-8be8-315ad4dc67ac tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:07.682247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b3e89f2-258e-44c9-8be8-315ad4dc67ac tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:07.683143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b3e89f2-258e-44c9-8be8-315ad4dc67ac tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:07.684286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b3e89f2-258e-44c9-8be8-315ad4dc67ac tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:07.684927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b3e89f2-258e-44c9-8be8-315ad4dc67ac tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:07.704097 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-6b3e89f2-258e-44c9-8be8-315ad4dc67ac tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] HTTP exception thrown: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6b3e89f2-258e-44c9-8be8-315ad4dc67ac tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Request method failure captured: Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 HTTP/1.1 Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mrd3Ph-jwAut21dSXNHZUIv2LYbRUZgg0VqYOBhh92fPjQoM6oYss-tSmMGH6lQ61hW8yVCgCw4kmpxgwRA0oOsL5_pbfjLU2wVj2Mam9fXwlyZWP_mwnHbtncHhkV4IqQn8EcMrOckGdy9QnQYWTduumIL-jLRxOZl7mslnxYVRc8 Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Openstack-Nova-Api-Version: 2.21 Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: ba167934554046859ba8102e8364af7c Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-InstanceActionsV221TestJSON-211567310 Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ba167934554046859ba8102e8364af7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ba167934554046859ba8102e8364af7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ba167934554046859ba8102e8364af7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ba167934554046859ba8102e8364af7c"}]}] Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-InstanceActionsV221TestJSON-211567310 Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: ba167934554046859ba8102e8364af7c Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-211567310 Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-InstanceActionsV221TestJSON-211567310-project Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: ba3a25f8337a4d9dbb49d69959ea64c4 Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-InstanceActionsV221TestJSON-211567310-project Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'aab80f74-9eff-44a9-9d24-bce4027dd923'} Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:58:07.706290 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:58:07.710732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:07.710732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:07.710732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:58:07.710732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:07.710732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:07.710732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:58:07.710732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:58:07.710732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:58:07.710732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:58:07.710732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:07.710732 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:07.712710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6b3e89f2-258e-44c9-8be8-315ad4dc67ac tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Returning 404 to user: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:58:07.713873 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6b3e89f2-258e-44c9-8be8-315ad4dc67ac tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 404 len: 111 microversion: 2.21 time: 0.063237 Aug 02 06:58:07.714997 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1334/2794] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 06:58:07 2022] DELETE /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:58:07.721642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85109781-e6b2-40d3-85b3-8f4436116009 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:07.722524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-85109781-e6b2-40d3-85b3-8f4436116009 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:07.729383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85109781-e6b2-40d3-85b3-8f4436116009 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:07.730156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85109781-e6b2-40d3-85b3-8f4436116009 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:07.731129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85109781-e6b2-40d3-85b3-8f4436116009 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:07.731750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85109781-e6b2-40d3-85b3-8f4436116009 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:07.831050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a560da1a-5b99-4e48-b8ff-e18700aef4c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:07.835455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:07.851663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a560da1a-5b99-4e48-b8ff-e18700aef4c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:07.853779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a560da1a-5b99-4e48-b8ff-e18700aef4c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:07.859849 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a560da1a-5b99-4e48-b8ff-e18700aef4c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 1.545132 Aug 02 06:58:07.861592 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1461/2795] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:06 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:07.892022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7094e359-7e70-4f9b-bae4-291ed605387c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Action: 'create', calling method: .version_select at 0x7f928c2d6f70>, body: {"keypair": {"name": "tempest-keypair-2009159540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSmHHxl++6cWkPzlUZulJCC6G+UhsUhut6fsg+dXp2a+Rq6XDdzEwuq0KvcN/EvO/DwTYtc5799TUY5ntlELpxHGqL7TvLeIz1GQ/66fGbRq5eF4uYMTGu5ykuDXhIC5g=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:07.937767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7094e359-7e70-4f9b-bae4-291ed605387c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Getting quotas for project 144a45ff8adc4fc08cdac4d62405c1af. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:58:07.956520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7094e359-7e70-4f9b-bae4-291ed605387c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Getting quotas for user 82cffd0e8f5e400996b832cf1368b5d1 and project 144a45ff8adc4fc08cdac4d62405c1af. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:58:08.021811 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7094e359-7e70-4f9b-bae4-291ed605387c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158686 Aug 02 06:58:08.031254 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1462/2796] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:58:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:08.051832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8c6e107d-3e35-4c39-9d84-056e9a6dff1e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:08.053183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8c6e107d-3e35-4c39-9d84-056e9a6dff1e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] [instance: aab80f74-9eff-44a9-9d24-bce4027dd923] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:08.066402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c6e107d-3e35-4c39-9d84-056e9a6dff1e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:08.067627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c6e107d-3e35-4c39-9d84-056e9a6dff1e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:08.069970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c6e107d-3e35-4c39-9d84-056e9a6dff1e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:08.072220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c6e107d-3e35-4c39-9d84-056e9a6dff1e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:08.115412 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-8c6e107d-3e35-4c39-9d84-056e9a6dff1e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] HTTP exception thrown: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8c6e107d-3e35-4c39-9d84-056e9a6dff1e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Request method failure captured: Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 HTTP/1.1 Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mrd3Ph-jwAut21dSXNHZUIv2LYbRUZgg0VqYOBhh92fPjQoM6oYss-tSmMGH6lQ61hW8yVCgCw4kmpxgwRA0oOsL5_pbfjLU2wVj2Mam9fXwlyZWP_mwnHbtncHhkV4IqQn8EcMrOckGdy9QnQYWTduumIL-jLRxOZl7mslnxYVRc8 Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.21 Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: ba167934554046859ba8102e8364af7c Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-InstanceActionsV221TestJSON-211567310 Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ba167934554046859ba8102e8364af7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ba167934554046859ba8102e8364af7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ba167934554046859ba8102e8364af7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ba167934554046859ba8102e8364af7c"}]}] Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-InstanceActionsV221TestJSON-211567310 Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: ba167934554046859ba8102e8364af7c Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-211567310 Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-InstanceActionsV221TestJSON-211567310-project Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: ba3a25f8337a4d9dbb49d69959ea64c4 Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-InstanceActionsV221TestJSON-211567310-project Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'aab80f74-9eff-44a9-9d24-bce4027dd923'} Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:58:08.117207 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:58:08.122014 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:58:08.122014 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:08.122014 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:58:08.122014 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:58:08.122014 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:58:08.122014 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:58:08.122014 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. Aug 02 06:58:08.122014 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:58:08.122014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8c6e107d-3e35-4c39-9d84-056e9a6dff1e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] Returning 404 to user: Instance aab80f74-9eff-44a9-9d24-bce4027dd923 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:58:08.122014 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8c6e107d-3e35-4c39-9d84-056e9a6dff1e tempest-InstanceActionsV221TestJSON-211567310 tempest-InstanceActionsV221TestJSON-211567310-project] 10.222.0.79 "GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923" status: 404 len: 111 microversion: 2.21 time: 0.086188 Aug 02 06:58:08.125242 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1463/2797] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:08 2022] GET /compute/v2.1/servers/aab80f74-9eff-44a9-9d24-bce4027dd923 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:58:08.144946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-85109781-e6b2-40d3-85b3-8f4436116009 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:08.154875 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-85109781-e6b2-40d3-85b3-8f4436116009 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1275 microversion: 2.1 time: 0.438404 Aug 02 06:58:08.179091 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1335/2798] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:07 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1275 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:08.649202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-01294278-5c91-4aea-be78-a625ac4c56bc tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Action: 'create', calling method: .version_select at 0x7f927b251ee0>, body: {"keypair": {"name": "tempest-keypair-1554754508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBosdCuR4lQjkZG50+1+VucseflByUMRAq7fiVIdWFtgAWkgCh8DAmpNl7o38qPPkkWk0RMgAvAQ9CsIvGzAv07TnFuA69OO3faopTMnpaLV86OoR0w+/CZJYiuBKzfhA=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:08.697872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-01294278-5c91-4aea-be78-a625ac4c56bc tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Getting quotas for project e81b19403fd5415cae54d275b4777755. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:58:08.714437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-01294278-5c91-4aea-be78-a625ac4c56bc tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Getting quotas for user 3a1d6c7bc62a4ebaaff257c9ba2b220c and project e81b19403fd5415cae54d275b4777755. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:58:08.770216 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-01294278-5c91-4aea-be78-a625ac4c56bc tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.643039 Aug 02 06:58:08.771244 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1464/2799] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:58:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:08.893742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b6759846-a21c-4ed0-bcca-6fa93e8bc596 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:08.895307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b6759846-a21c-4ed0-bcca-6fa93e8bc596 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:08.913110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6759846-a21c-4ed0-bcca-6fa93e8bc596 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:08.913602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6759846-a21c-4ed0-bcca-6fa93e8bc596 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:08.914448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6759846-a21c-4ed0-bcca-6fa93e8bc596 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:08.914941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6759846-a21c-4ed0-bcca-6fa93e8bc596 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:09.076869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a90dfdfd-33e4-4c11-af34-d5d16e0e7905 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:09.078880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a90dfdfd-33e4-4c11-af34-d5d16e0e7905 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:09.090393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a90dfdfd-33e4-4c11-af34-d5d16e0e7905 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:09.092056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a90dfdfd-33e4-4c11-af34-d5d16e0e7905 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:09.095098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a90dfdfd-33e4-4c11-af34-d5d16e0e7905 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:09.096443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a90dfdfd-33e4-4c11-af34-d5d16e0e7905 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:09.176057 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a90dfdfd-33e4-4c11-af34-d5d16e0e7905 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105410 Aug 02 06:58:09.178162 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1465/2800] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 06:58:09 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:58:09.193648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-530f8247-5883-43c1-8196-d112e94b82ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:09.197494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-530f8247-5883-43c1-8196-d112e94b82ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:09.218919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-530f8247-5883-43c1-8196-d112e94b82ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:09.220655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-530f8247-5883-43c1-8196-d112e94b82ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:09.222697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-530f8247-5883-43c1-8196-d112e94b82ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:09.224516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-530f8247-5883-43c1-8196-d112e94b82ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:09.480171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-530f8247-5883-43c1-8196-d112e94b82ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:09.488613 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-530f8247-5883-43c1-8196-d112e94b82ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1273 microversion: 2.1 time: 0.308267 Aug 02 06:58:09.494127 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1466/2801] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:09 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1273 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:09.506720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d2417700-af28-44b4-b647-039000839335 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:09.507234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d2417700-af28-44b4-b647-039000839335 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:09.518531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2417700-af28-44b4-b647-039000839335 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:09.518975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2417700-af28-44b4-b647-039000839335 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:09.519753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2417700-af28-44b4-b647-039000839335 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:09.520189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2417700-af28-44b4-b647-039000839335 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:09.576016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d2417700-af28-44b4-b647-039000839335 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:58:09.744248 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d2417700-af28-44b4-b647-039000839335 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 204 len: 0 microversion: 2.1 time: 0.248527 Aug 02 06:58:09.749571 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1467/2802] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:58:09 2022] DELETE /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:58:09.755275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b6759846-a21c-4ed0-bcca-6fa93e8bc596 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:09.766368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ad229048-2768-4cc9-b564-19de3f55d3db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:09.769048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ad229048-2768-4cc9-b564-19de3f55d3db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:09.773078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b6759846-a21c-4ed0-bcca-6fa93e8bc596 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:09.777339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b6759846-a21c-4ed0-bcca-6fa93e8bc596 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:09.782226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad229048-2768-4cc9-b564-19de3f55d3db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:09.782451 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b6759846-a21c-4ed0-bcca-6fa93e8bc596 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.891880 Aug 02 06:58:09.783165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad229048-2768-4cc9-b564-19de3f55d3db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:09.783354 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1336/2803] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:08 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:09.785243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad229048-2768-4cc9-b564-19de3f55d3db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:09.785876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad229048-2768-4cc9-b564-19de3f55d3db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:10.403312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-109b3bb7-ea39-415e-945a-9d369f39e3a7 req-6a0d8d0c-a4c2-46fb-8bcd-1bc8abba18a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "tag": "8bd7f640-b150-4b49-bbf4-89405b95cc9e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:10.427114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-109b3bb7-ea39-415e-945a-9d369f39e3a7 req-6a0d8d0c-a4c2-46fb-8bcd-1bc8abba18a6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:10.428136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-109b3bb7-ea39-415e-945a-9d369f39e3a7 req-6a0d8d0c-a4c2-46fb-8bcd-1bc8abba18a6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:10.475224 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-109b3bb7-ea39-415e-945a-9d369f39e3a7 req-6a0d8d0c-a4c2-46fb-8bcd-1bc8abba18a6 service nova] Creating event network-changed:8bd7f640-b150-4b49-bbf4-89405b95cc9e for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:58:10.488483 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-109b3bb7-ea39-415e-945a-9d369f39e3a7 req-6a0d8d0c-a4c2-46fb-8bcd-1bc8abba18a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088674 Aug 02 06:58:10.489110 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1337/2804] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:58:10.513218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-691dba62-e395-4977-b51b-394c3af7e3a0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:10.515011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-691dba62-e395-4977-b51b-394c3af7e3a0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:10.539089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-691dba62-e395-4977-b51b-394c3af7e3a0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:10.540731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-691dba62-e395-4977-b51b-394c3af7e3a0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:10.542169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-691dba62-e395-4977-b51b-394c3af7e3a0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:10.542772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-691dba62-e395-4977-b51b-394c3af7e3a0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:10.696526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ad229048-2768-4cc9-b564-19de3f55d3db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:10.709387 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ad229048-2768-4cc9-b564-19de3f55d3db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1674 microversion: 2.1 time: 0.957099 Aug 02 06:58:10.716660 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1468/2805] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:09 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1674 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:10.810174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ceefdb8f-6875-4f11-bb92-59143a01f06e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:10.810894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ceefdb8f-6875-4f11-bb92-59143a01f06e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:10.825987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ceefdb8f-6875-4f11-bb92-59143a01f06e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:10.826430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ceefdb8f-6875-4f11-bb92-59143a01f06e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:10.827338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ceefdb8f-6875-4f11-bb92-59143a01f06e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:10.827658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ceefdb8f-6875-4f11-bb92-59143a01f06e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:11.782113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-691dba62-e395-4977-b51b-394c3af7e3a0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:11.804960 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-691dba62-e395-4977-b51b-394c3af7e3a0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1315 microversion: 2.1 time: 1.298493 Aug 02 06:58:11.806045 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1338/2806] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:10 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1315 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:58:11.823949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9327db9d-1aa4-420c-89d2-9270684b61e3 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:11.825302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9327db9d-1aa4-420c-89d2-9270684b61e3 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:11.839356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9327db9d-1aa4-420c-89d2-9270684b61e3 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:11.843346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9327db9d-1aa4-420c-89d2-9270684b61e3 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:11.854372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9327db9d-1aa4-420c-89d2-9270684b61e3 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:11.855634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9327db9d-1aa4-420c-89d2-9270684b61e3 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:11.882857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ceefdb8f-6875-4f11-bb92-59143a01f06e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:11.907693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ceefdb8f-6875-4f11-bb92-59143a01f06e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:11.913923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ceefdb8f-6875-4f11-bb92-59143a01f06e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:11.916022 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ceefdb8f-6875-4f11-bb92-59143a01f06e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 1.110451 Aug 02 06:58:11.930607 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1469/2807] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:10 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:12.446700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9327db9d-1aa4-420c-89d2-9270684b61e3 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:12.462307 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9327db9d-1aa4-420c-89d2-9270684b61e3 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1674 microversion: 2.1 time: 0.653390 Aug 02 06:58:12.479028 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1339/2808] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:11 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1674 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:12.832288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d4d9181e-0319-4aa2-a0f7-d2fba5a173fb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:12.833262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d4d9181e-0319-4aa2-a0f7-d2fba5a173fb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:12.842929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d4d9181e-0319-4aa2-a0f7-d2fba5a173fb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:12.848440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d4d9181e-0319-4aa2-a0f7-d2fba5a173fb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:12.849603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d4d9181e-0319-4aa2-a0f7-d2fba5a173fb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:12.850153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d4d9181e-0319-4aa2-a0f7-d2fba5a173fb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:12.963186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9b72735e-c8ab-4b34-9370-79fdfebe0546 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:12.974356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9b72735e-c8ab-4b34-9370-79fdfebe0546 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:12.982726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b72735e-c8ab-4b34-9370-79fdfebe0546 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:12.983761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b72735e-c8ab-4b34-9370-79fdfebe0546 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:12.985713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b72735e-c8ab-4b34-9370-79fdfebe0546 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:12.986364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b72735e-c8ab-4b34-9370-79fdfebe0546 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:13.413925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d4d9181e-0319-4aa2-a0f7-d2fba5a173fb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:13.436114 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d4d9181e-0319-4aa2-a0f7-d2fba5a173fb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1315 microversion: 2.1 time: 0.606807 Aug 02 06:58:13.440079 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1470/2809] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:12 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:58:13.495525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-34cdcde6-f261-4353-98ca-488b103d02f1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:13.501107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-34cdcde6-f261-4353-98ca-488b103d02f1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:13.519437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34cdcde6-f261-4353-98ca-488b103d02f1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:13.519916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34cdcde6-f261-4353-98ca-488b103d02f1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:13.526555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34cdcde6-f261-4353-98ca-488b103d02f1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:13.529182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34cdcde6-f261-4353-98ca-488b103d02f1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:13.668604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9b72735e-c8ab-4b34-9370-79fdfebe0546 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:13.716009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9b72735e-c8ab-4b34-9370-79fdfebe0546 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:13.722535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9b72735e-c8ab-4b34-9370-79fdfebe0546 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:13.726259 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9b72735e-c8ab-4b34-9370-79fdfebe0546 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.777080 Aug 02 06:58:13.727861 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1340/2810] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:12 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:58:14.441120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-34cdcde6-f261-4353-98ca-488b103d02f1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:14.451262 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-34cdcde6-f261-4353-98ca-488b103d02f1 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1674 microversion: 2.1 time: 0.961650 Aug 02 06:58:14.453210 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1471/2811] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:13 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1674 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:14.480745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bd9a7953-abd3-46f1-831c-a9172a75cb56 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:14.483147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bd9a7953-abd3-46f1-831c-a9172a75cb56 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:14.494707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd9a7953-abd3-46f1-831c-a9172a75cb56 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:14.495708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd9a7953-abd3-46f1-831c-a9172a75cb56 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:14.496794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd9a7953-abd3-46f1-831c-a9172a75cb56 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:14.497405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd9a7953-abd3-46f1-831c-a9172a75cb56 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:14.755550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9e0b9365-4283-48f1-b7d1-8688e27975da tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:14.756428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9e0b9365-4283-48f1-b7d1-8688e27975da tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:14.773814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e0b9365-4283-48f1-b7d1-8688e27975da tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:14.774615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e0b9365-4283-48f1-b7d1-8688e27975da tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:14.775540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e0b9365-4283-48f1-b7d1-8688e27975da tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:14.776206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e0b9365-4283-48f1-b7d1-8688e27975da tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:15.766454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:15.770420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9e0b9365-4283-48f1-b7d1-8688e27975da tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:15.811757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9e0b9365-4283-48f1-b7d1-8688e27975da tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:15.827467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9e0b9365-4283-48f1-b7d1-8688e27975da tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:15.830247 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9e0b9365-4283-48f1-b7d1-8688e27975da tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 1.080801 Aug 02 06:58:15.831917 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1472/2812] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:14 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:58:15.839682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-c8df4dde-c384-4e6f-ac0f-fb2d40896dd4 req-c8fc9333-de51-476c-881e-bf034ae7b4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef56c36e-6f3f-40c5-b1c4-32d49b7c2975", "tag": "ccb48bda-afe9-45eb-a656-12e649c3ed74"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:15.867404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c8df4dde-c384-4e6f-ac0f-fb2d40896dd4 req-c8fc9333-de51-476c-881e-bf034ae7b4d5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:15.868496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c8df4dde-c384-4e6f-ac0f-fb2d40896dd4 req-c8fc9333-de51-476c-881e-bf034ae7b4d5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:15.892362 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-c8df4dde-c384-4e6f-ac0f-fb2d40896dd4 req-c8fc9333-de51-476c-881e-bf034ae7b4d5 service nova] Creating event network-changed:ccb48bda-afe9-45eb-a656-12e649c3ed74 for instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 on n-h1-851337-3 Aug 02 06:58:15.903279 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-c8df4dde-c384-4e6f-ac0f-fb2d40896dd4 req-c8fc9333-de51-476c-881e-bf034ae7b4d5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068803 Aug 02 06:58:15.905297 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1473/2813] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:15.912318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b0512e48-d9ee-4fe5-af80-b8f9769360db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:15.912508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bd9a7953-abd3-46f1-831c-a9172a75cb56 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:15.913825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b0512e48-d9ee-4fe5-af80-b8f9769360db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:15.931157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0512e48-d9ee-4fe5-af80-b8f9769360db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:15.931891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0512e48-d9ee-4fe5-af80-b8f9769360db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:15.934911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0512e48-d9ee-4fe5-af80-b8f9769360db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:15.935667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0512e48-d9ee-4fe5-af80-b8f9769360db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:15.944266 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bd9a7953-abd3-46f1-831c-a9172a75cb56 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1315 microversion: 2.1 time: 1.466863 Aug 02 06:58:15.948312 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1341/2814] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:14 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1315 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:16.385827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b0512e48-d9ee-4fe5-af80-b8f9769360db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:16.406384 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b0512e48-d9ee-4fe5-af80-b8f9769360db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 200 len: 1607 microversion: 2.1 time: 0.496681 Aug 02 06:58:16.408639 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1474/2815] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:15 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 1607 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:16.614012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ab54dc3b-5639-45a2-81c5-dbea347c554b req-b09aa6c3-42d9-4a1b-8b48-6bb9160e8c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b07c5d-4324-4221-a77d-203f65ad3b04", "name": "network-vif-deleted", "tag": "b40c75bb-1839-4d4f-98e5-444d01355d6a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:16.641031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ab54dc3b-5639-45a2-81c5-dbea347c554b req-b09aa6c3-42d9-4a1b-8b48-6bb9160e8c01 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:16.642636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ab54dc3b-5639-45a2-81c5-dbea347c554b req-b09aa6c3-42d9-4a1b-8b48-6bb9160e8c01 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:16.654596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:16.702814 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ab54dc3b-5639-45a2-81c5-dbea347c554b req-b09aa6c3-42d9-4a1b-8b48-6bb9160e8c01 service nova] Creating event network-vif-deleted:b40c75bb-1839-4d4f-98e5-444d01355d6a for instance f8b07c5d-4324-4221-a77d-203f65ad3b04 on n-h1-851337-3 Aug 02 06:58:16.718218 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ab54dc3b-5639-45a2-81c5-dbea347c554b req-b09aa6c3-42d9-4a1b-8b48-6bb9160e8c01 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106498 Aug 02 06:58:16.721596 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1342/2816] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:16.860291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-29fa0b93-e5bb-4322-8e90-13565279efd5 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:16.862019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-29fa0b93-e5bb-4322-8e90-13565279efd5 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:16.879407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29fa0b93-e5bb-4322-8e90-13565279efd5 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:16.882004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29fa0b93-e5bb-4322-8e90-13565279efd5 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:16.882967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29fa0b93-e5bb-4322-8e90-13565279efd5 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:16.883959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29fa0b93-e5bb-4322-8e90-13565279efd5 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:16.886920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-199599162", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "fb3de272-43ec-4c89-ad6a-2a5b805160e8"}], "security_groups": [{"name": "tempest-securitygroup--425976118"}], "key_name": "tempest-keypair-1554754508", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:17.796477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] validate_networks() for [('fb3de272-43ec-4c89-ad6a-2a5b805160e8', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:58:18.111243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-29fa0b93-e5bb-4322-8e90-13565279efd5 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:18.157750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-29fa0b93-e5bb-4322-8e90-13565279efd5 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:18.162454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-29fa0b93-e5bb-4322-8e90-13565279efd5 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:18.166519 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-29fa0b93-e5bb-4322-8e90-13565279efd5 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 1.311717 Aug 02 06:58:18.186420 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1475/2817] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:16 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:18.201690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df2f3376-2904-4e8f-95f4-36ab5bfae314 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:18.210355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df2f3376-2904-4e8f-95f4-36ab5bfae314 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:18.225391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df2f3376-2904-4e8f-95f4-36ab5bfae314 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:18.226201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df2f3376-2904-4e8f-95f4-36ab5bfae314 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:18.232564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df2f3376-2904-4e8f-95f4-36ab5bfae314 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:18.233258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df2f3376-2904-4e8f-95f4-36ab5bfae314 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:18.736774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=14 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:18.917968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-df2f3376-2904-4e8f-95f4-36ab5bfae314 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:18.929586 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df2f3376-2904-4e8f-95f4-36ab5bfae314 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1315 microversion: 2.1 time: 0.750010 Aug 02 06:58:18.943046 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1476/2818] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:18 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1315 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:18.943046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1497157503", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "f6b00d5e-7f56-40a5-b0ce-21c89ecfebff"}], "security_groups": [{"name": "tempest-securitygroup--414543116"}], "key_name": "tempest-keypair-2009159540", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:19.723691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] validate_networks() for [('f6b00d5e-7f56-40a5-b0ce-21c89ecfebff', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:58:19.791071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Getting quotas for project e81b19403fd5415cae54d275b4777755. Resources: dict_keys(['metadata_items']) {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:58:19.799078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Getting quotas for user 3a1d6c7bc62a4ebaaff257c9ba2b220c and project e81b19403fd5415cae54d275b4777755. Resources: dict_keys(['metadata_items']) {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:58:19.815629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:58:19.830584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:58:19.831181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:58:19.834364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:58:19.834992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:58:19.874984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:19.875446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:19.887150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:19.887605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:19.926609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Getting quotas for project e81b19403fd5415cae54d275b4777755. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:58:19.938979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Getting quotas for user 3a1d6c7bc62a4ebaaff257c9ba2b220c and project e81b19403fd5415cae54d275b4777755. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:58:19.976079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:58:19.980622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:58:20.107263 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7ef6f706-afa8-4fd3-93c1-4dda91db02f2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.229095 Aug 02 06:58:20.108847 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1343/2819] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:58:16 2022] POST /compute/v2.1/servers => generated 408 bytes in 3233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:58:20.139037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-64c672b1-7f0f-4135-911b-be1a9d260084 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:20.139814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-64c672b1-7f0f-4135-911b-be1a9d260084 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:20.154736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-64c672b1-7f0f-4135-911b-be1a9d260084 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:20.155589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-64c672b1-7f0f-4135-911b-be1a9d260084 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:20.156934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-64c672b1-7f0f-4135-911b-be1a9d260084 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:20.158127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-64c672b1-7f0f-4135-911b-be1a9d260084 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:20.180677 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-64c672b1-7f0f-4135-911b-be1a9d260084 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] HTTP exception thrown: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-64c672b1-7f0f-4135-911b-be1a9d260084 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Request method failure captured: Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 HTTP/1.1 Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MnIh0r4AtohMIHRrEySUKFBwUksLvrYD5U5qa12hpVglZXMiGVekhsXvcLy3TbgN66cBUvaprJxUI2LBMOvV3zNfb_RsXkH6cv4hqhNkSOyLVSbFKWy9naxH2MklPvdSqUlgkNKDsb7t5lqcRw9Glt-81uCSsji2_6Z1Z_US2iUgdU Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: c21684e149204ae7afe06a3097411bd0 Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachVolumeTestJSON-898397610 Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c21684e149204ae7afe06a3097411bd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c21684e149204ae7afe06a3097411bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c21684e149204ae7afe06a3097411bd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c21684e149204ae7afe06a3097411bd0"}]}] Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachVolumeTestJSON-898397610 Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: c21684e149204ae7afe06a3097411bd0 Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachVolumeTestJSON-898397610 Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachVolumeTestJSON-898397610-project Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 391135debbcb49de8b47dea807d9a4ea Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachVolumeTestJSON-898397610-project Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'f8b07c5d-4324-4221-a77d-203f65ad3b04'} Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:58:20.182750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:20.186866 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:20.186866 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:58:20.186866 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:58:20.186866 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:58:20.186866 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:58:20.186866 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 06:58:20.186866 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:20.186866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-64c672b1-7f0f-4135-911b-be1a9d260084 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Returning 404 to user: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:58:20.186866 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-64c672b1-7f0f-4135-911b-be1a9d260084 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 404 len: 111 microversion: 2.1 time: 0.064522 Aug 02 06:58:20.186866 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1344/2820] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:20 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:58:20.192715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8661b6b1-e2ae-4fb7-b701-7be9c8afe036 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:20.193426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8661b6b1-e2ae-4fb7-b701-7be9c8afe036 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:20.201051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8661b6b1-e2ae-4fb7-b701-7be9c8afe036 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:20.201614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8661b6b1-e2ae-4fb7-b701-7be9c8afe036 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:20.203815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8661b6b1-e2ae-4fb7-b701-7be9c8afe036 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:20.204957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8661b6b1-e2ae-4fb7-b701-7be9c8afe036 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:20.838934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8661b6b1-e2ae-4fb7-b701-7be9c8afe036 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:20.854008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8661b6b1-e2ae-4fb7-b701-7be9c8afe036 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:20.860408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8661b6b1-e2ae-4fb7-b701-7be9c8afe036 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:20.862044 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8661b6b1-e2ae-4fb7-b701-7be9c8afe036 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.675267 Aug 02 06:58:20.862942 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1345/2821] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:20 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:20.880405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0a3b246-cc4b-4421-b75b-e05a04a36bb3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:20.882992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d0a3b246-cc4b-4421-b75b-e05a04a36bb3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:20.896091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0a3b246-cc4b-4421-b75b-e05a04a36bb3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:20.897682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0a3b246-cc4b-4421-b75b-e05a04a36bb3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:20.901265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0a3b246-cc4b-4421-b75b-e05a04a36bb3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:20.902299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0a3b246-cc4b-4421-b75b-e05a04a36bb3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:20.913448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:21.291202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:58:21.291202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:58:21.292173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:58:21.292173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:58:21.292347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:58:21.297640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:21.313544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:21.314019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:21.314857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:21.315300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:21.341030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Getting quotas for project 144a45ff8adc4fc08cdac4d62405c1af. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:58:21.346927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Getting quotas for user 82cffd0e8f5e400996b832cf1368b5d1 and project 144a45ff8adc4fc08cdac4d62405c1af. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:58:21.368905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:58:21.371620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:58:21.458976 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6bdc835a-0d15-4760-8b83-828f36025b23 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.527288 Aug 02 06:58:21.468154 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1477/2822] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:58:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 2537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:58:21.474980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab2aee0f-51e8-47ab-b81d-1c5f3cd76e55 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:21.475978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab2aee0f-51e8-47ab-b81d-1c5f3cd76e55 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:21.487274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab2aee0f-51e8-47ab-b81d-1c5f3cd76e55 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:21.488462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab2aee0f-51e8-47ab-b81d-1c5f3cd76e55 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:21.489822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab2aee0f-51e8-47ab-b81d-1c5f3cd76e55 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:21.490330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab2aee0f-51e8-47ab-b81d-1c5f3cd76e55 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:21.501659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d0a3b246-cc4b-4421-b75b-e05a04a36bb3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:21.533696 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d0a3b246-cc4b-4421-b75b-e05a04a36bb3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1315 microversion: 2.1 time: 0.658408 Aug 02 06:58:21.541856 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1346/2823] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:20 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:21.550701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c40f98c6-fb08-44e8-8f04-4da61b6d8f32 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '.version_select at 0x7f927a9ab040>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:21.615451 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c40f98c6-fb08-44e8-8f04-4da61b6d8f32 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991769641" status: 202 len: 0 microversion: 2.1 time: 0.071686 Aug 02 06:58:21.623914 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1347/2824] 10.222.0.79 () {58 vars in 1221 bytes} [Tue Aug 2 06:58:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991769641 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:58:21.634073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d3c1e39-b58b-4b11-87c4-5c08025440df tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:21.634857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5d3c1e39-b58b-4b11-87c4-5c08025440df tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:21.786878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab2aee0f-51e8-47ab-b81d-1c5f3cd76e55 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:21.809395 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab2aee0f-51e8-47ab-b81d-1c5f3cd76e55 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1329 microversion: 2.1 time: 0.335965 Aug 02 06:58:21.822968 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1478/2825] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:21 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1329 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:21.890490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3765eb10-5d66-4f21-a5cb-538431a28211 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:21.891024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3765eb10-5d66-4f21-a5cb-538431a28211 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:21.906264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3765eb10-5d66-4f21-a5cb-538431a28211 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:21.906724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3765eb10-5d66-4f21-a5cb-538431a28211 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:21.907547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3765eb10-5d66-4f21-a5cb-538431a28211 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:21.908002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3765eb10-5d66-4f21-a5cb-538431a28211 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:21.959057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5d3c1e39-b58b-4b11-87c4-5c08025440df tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:21.972340 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5d3c1e39-b58b-4b11-87c4-5c08025440df tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1235 microversion: 2.1 time: 0.344902 Aug 02 06:58:21.973204 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1348/2826] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:21 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1235 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:22.558668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3765eb10-5d66-4f21-a5cb-538431a28211 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:22.563938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4c1cb447-bff4-4b22-ac15-da7eff054b3b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:22.566069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4c1cb447-bff4-4b22-ac15-da7eff054b3b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:22.593650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c1cb447-bff4-4b22-ac15-da7eff054b3b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:22.595206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3765eb10-5d66-4f21-a5cb-538431a28211 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:22.597089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c1cb447-bff4-4b22-ac15-da7eff054b3b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:22.599552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c1cb447-bff4-4b22-ac15-da7eff054b3b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:22.600159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c1cb447-bff4-4b22-ac15-da7eff054b3b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:22.601507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3765eb10-5d66-4f21-a5cb-538431a28211 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:22.606600 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3765eb10-5d66-4f21-a5cb-538431a28211 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.718958 Aug 02 06:58:22.613718 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1479/2827] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:21 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:58:22.836679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-825aaf69-7238-4743-9407-aedc0bf43506 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:22.837727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-825aaf69-7238-4743-9407-aedc0bf43506 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:22.849255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-825aaf69-7238-4743-9407-aedc0bf43506 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:22.849983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-825aaf69-7238-4743-9407-aedc0bf43506 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:22.850965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-825aaf69-7238-4743-9407-aedc0bf43506 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:22.851400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-825aaf69-7238-4743-9407-aedc0bf43506 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:23.276042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-825aaf69-7238-4743-9407-aedc0bf43506 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:23.281950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:23.295787 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-825aaf69-7238-4743-9407-aedc0bf43506 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1335 microversion: 2.1 time: 0.463548 Aug 02 06:58:23.297603 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1480/2828] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:22 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1335 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:58:23.306566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f8a5f00d-b925-48c5-8e88-f275585a5509 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:23.307577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f8a5f00d-b925-48c5-8e88-f275585a5509 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:23.318713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f8a5f00d-b925-48c5-8e88-f275585a5509 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:23.319518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f8a5f00d-b925-48c5-8e88-f275585a5509 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:23.320705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f8a5f00d-b925-48c5-8e88-f275585a5509 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:23.321433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f8a5f00d-b925-48c5-8e88-f275585a5509 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:23.359280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4c1cb447-bff4-4b22-ac15-da7eff054b3b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:23.376486 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4c1cb447-bff4-4b22-ac15-da7eff054b3b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1315 microversion: 2.1 time: 0.821846 Aug 02 06:58:23.379434 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1349/2829] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:22 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:23.422211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f8a5f00d-b925-48c5-8e88-f275585a5509 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:23.432241 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f8a5f00d-b925-48c5-8e88-f275585a5509 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1287 microversion: 2.1 time: 0.132880 Aug 02 06:58:23.446539 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1481/2830] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:23 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1287 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:23.641400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5197f3a5-7a27-4a3e-bf18-355cbf2d5b2f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:23.642890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5197f3a5-7a27-4a3e-bf18-355cbf2d5b2f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:23.662345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5197f3a5-7a27-4a3e-bf18-355cbf2d5b2f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:23.664980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5197f3a5-7a27-4a3e-bf18-355cbf2d5b2f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:23.667356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5197f3a5-7a27-4a3e-bf18-355cbf2d5b2f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:23.669869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5197f3a5-7a27-4a3e-bf18-355cbf2d5b2f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:23.917989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2cfbb94f-ccc1-4cec-9287-c11ba2faedce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Action: 'create', calling method: .version_select at 0x7f928c2e1af0>, body: {"keypair": {"name": "tempest-keypair-972196208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHATaucTtmBCG04QLmBGzvuaUe/LBwaSJ4QlDlBq4HJtOsfFJzWva/3F63FwJ8HRbob6MbVqDvmoFXPyK7elwOv5PfShD1IGPJ20I5vGSsPOnQ7jQSIiaiEzUP0qP/O8GA=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:23.966384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2cfbb94f-ccc1-4cec-9287-c11ba2faedce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Getting quotas for project c21684e149204ae7afe06a3097411bd0. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:58:23.975166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2cfbb94f-ccc1-4cec-9287-c11ba2faedce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Getting quotas for user 391135debbcb49de8b47dea807d9a4ea and project c21684e149204ae7afe06a3097411bd0. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:58:24.032178 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2cfbb94f-ccc1-4cec-9287-c11ba2faedce tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.118438 Aug 02 06:58:24.033092 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1482/2831] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 06:58:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:24.324098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b0336d01-a207-4311-b862-5acfd4b84895 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:24.324773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b0336d01-a207-4311-b862-5acfd4b84895 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:24.343894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0336d01-a207-4311-b862-5acfd4b84895 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:24.344731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0336d01-a207-4311-b862-5acfd4b84895 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:24.345845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0336d01-a207-4311-b862-5acfd4b84895 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:24.346487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0336d01-a207-4311-b862-5acfd4b84895 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:24.473254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5197f3a5-7a27-4a3e-bf18-355cbf2d5b2f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:24.490391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5197f3a5-7a27-4a3e-bf18-355cbf2d5b2f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:24.493314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5197f3a5-7a27-4a3e-bf18-355cbf2d5b2f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:24.497081 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5197f3a5-7a27-4a3e-bf18-355cbf2d5b2f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.859955 Aug 02 06:58:24.513462 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1350/2832] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:23 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:24.530874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9b43c644-4cbd-4686-afdf-1188260a7eab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:24.531682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9b43c644-4cbd-4686-afdf-1188260a7eab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:24.553627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b43c644-4cbd-4686-afdf-1188260a7eab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:24.554114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b43c644-4cbd-4686-afdf-1188260a7eab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:24.554903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b43c644-4cbd-4686-afdf-1188260a7eab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:24.555338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b43c644-4cbd-4686-afdf-1188260a7eab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:25.147020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b0336d01-a207-4311-b862-5acfd4b84895 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:25.155880 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b0336d01-a207-4311-b862-5acfd4b84895 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1402 microversion: 2.1 time: 0.836613 Aug 02 06:58:25.156476 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1483/2833] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:24 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1402 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:25.162415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cfa0a1cf-ef4d-413a-b346-c11995ef6814 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:25.163399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cfa0a1cf-ef4d-413a-b346-c11995ef6814 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:25.170779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfa0a1cf-ef4d-413a-b346-c11995ef6814 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:25.171614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfa0a1cf-ef4d-413a-b346-c11995ef6814 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:25.172687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfa0a1cf-ef4d-413a-b346-c11995ef6814 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:25.173419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfa0a1cf-ef4d-413a-b346-c11995ef6814 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:25.237163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9b43c644-4cbd-4686-afdf-1188260a7eab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:25.246872 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9b43c644-4cbd-4686-afdf-1188260a7eab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1315 microversion: 2.1 time: 0.731899 Aug 02 06:58:25.248794 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1351/2834] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:24 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:25.253994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c394bb77-ba0f-4760-b1cc-f486522ec97f req-07875ca6-9ac4-47c6-9143-4ebabd6d76d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef56c36e-6f3f-40c5-b1c4-32d49b7c2975", "name": "network-vif-plugged", "status": "completed", "tag": "ccb48bda-afe9-45eb-a656-12e649c3ed74"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:25.264945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c394bb77-ba0f-4760-b1cc-f486522ec97f req-07875ca6-9ac4-47c6-9143-4ebabd6d76d5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:25.265446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c394bb77-ba0f-4760-b1cc-f486522ec97f req-07875ca6-9ac4-47c6-9143-4ebabd6d76d5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:25.278287 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c394bb77-ba0f-4760-b1cc-f486522ec97f req-07875ca6-9ac4-47c6-9143-4ebabd6d76d5 service nova] Creating event network-vif-plugged:ccb48bda-afe9-45eb-a656-12e649c3ed74 for instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 on n-h1-851337-3 Aug 02 06:58:25.283738 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c394bb77-ba0f-4760-b1cc-f486522ec97f req-07875ca6-9ac4-47c6-9143-4ebabd6d76d5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033390 Aug 02 06:58:25.284888 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1352/2835] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:25.332407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cfa0a1cf-ef4d-413a-b346-c11995ef6814 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:25.341857 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cfa0a1cf-ef4d-413a-b346-c11995ef6814 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1293 microversion: 2.1 time: 0.184102 Aug 02 06:58:25.342857 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1484/2836] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:25 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1293 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:25.538612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-11749bc5-ad33-48a1-94fe-f1955502405d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:25.540678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-11749bc5-ad33-48a1-94fe-f1955502405d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:25.548441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11749bc5-ad33-48a1-94fe-f1955502405d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:25.549212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11749bc5-ad33-48a1-94fe-f1955502405d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:25.550015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11749bc5-ad33-48a1-94fe-f1955502405d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:25.550609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11749bc5-ad33-48a1-94fe-f1955502405d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:25.980908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-11749bc5-ad33-48a1-94fe-f1955502405d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:25.995796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-11749bc5-ad33-48a1-94fe-f1955502405d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:25.998455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-11749bc5-ad33-48a1-94fe-f1955502405d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:26.005592 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-11749bc5-ad33-48a1-94fe-f1955502405d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.470578 Aug 02 06:58:26.006794 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1353/2837] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:25 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:26.190746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4caa3dc1-b45c-4ec8-a176-c487553fa7fd tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:26.191578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4caa3dc1-b45c-4ec8-a176-c487553fa7fd tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:26.208083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4caa3dc1-b45c-4ec8-a176-c487553fa7fd tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:26.209518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4caa3dc1-b45c-4ec8-a176-c487553fa7fd tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:26.210796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4caa3dc1-b45c-4ec8-a176-c487553fa7fd tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:26.211419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4caa3dc1-b45c-4ec8-a176-c487553fa7fd tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:26.268749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-458af05e-bd12-47af-8705-d2cbe17a327f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:26.269271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-458af05e-bd12-47af-8705-d2cbe17a327f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:26.282596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-458af05e-bd12-47af-8705-d2cbe17a327f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:26.283868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-458af05e-bd12-47af-8705-d2cbe17a327f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:26.287126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-458af05e-bd12-47af-8705-d2cbe17a327f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:26.288108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-458af05e-bd12-47af-8705-d2cbe17a327f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:26.715576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4caa3dc1-b45c-4ec8-a176-c487553fa7fd tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:26.731954 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4caa3dc1-b45c-4ec8-a176-c487553fa7fd tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1402 microversion: 2.1 time: 0.554581 Aug 02 06:58:26.755531 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1485/2838] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:26 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1402 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:26.764803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-16970f81-84b0-4b9d-9890-4f400f0f146c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:26.767137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-16970f81-84b0-4b9d-9890-4f400f0f146c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:26.778119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16970f81-84b0-4b9d-9890-4f400f0f146c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:26.779946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16970f81-84b0-4b9d-9890-4f400f0f146c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:26.782601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16970f81-84b0-4b9d-9890-4f400f0f146c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:26.783294 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16970f81-84b0-4b9d-9890-4f400f0f146c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:27.013223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-458af05e-bd12-47af-8705-d2cbe17a327f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:27.026486 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-458af05e-bd12-47af-8705-d2cbe17a327f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1315 microversion: 2.1 time: 0.761479 Aug 02 06:58:27.027174 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1354/2839] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:26 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1315 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:58:27.036998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dd809c33-e562-401b-9881-f1f7f6275183 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:27.037622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dd809c33-e562-401b-9881-f1f7f6275183 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:27.081502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd809c33-e562-401b-9881-f1f7f6275183 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:27.084104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd809c33-e562-401b-9881-f1f7f6275183 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:27.086537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd809c33-e562-401b-9881-f1f7f6275183 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:27.087241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd809c33-e562-401b-9881-f1f7f6275183 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:27.895783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-16970f81-84b0-4b9d-9890-4f400f0f146c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:27.905274 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-16970f81-84b0-4b9d-9890-4f400f0f146c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1360 microversion: 2.1 time: 1.148241 Aug 02 06:58:27.919514 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1486/2840] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:26 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1360 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:27.930227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-4a023beb-e3c7-4079-b78e-b8747cd94de3 req-89e33e40-8512-4004-ab04-065f398b218e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b14c587b-3ed6-447f-8140-e5280370d4bc", "tag": "702fb797-be75-460e-8c23-fdab5d30fe86"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:27.942612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4a023beb-e3c7-4079-b78e-b8747cd94de3 req-89e33e40-8512-4004-ab04-065f398b218e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:27.943591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4a023beb-e3c7-4079-b78e-b8747cd94de3 req-89e33e40-8512-4004-ab04-065f398b218e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:27.967343 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-4a023beb-e3c7-4079-b78e-b8747cd94de3 req-89e33e40-8512-4004-ab04-065f398b218e service nova] Creating event network-changed:702fb797-be75-460e-8c23-fdab5d30fe86 for instance b14c587b-3ed6-447f-8140-e5280370d4bc on n-h1-851337-3 Aug 02 06:58:27.974885 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-4a023beb-e3c7-4079-b78e-b8747cd94de3 req-89e33e40-8512-4004-ab04-065f398b218e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050900 Aug 02 06:58:27.976310 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1487/2841] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:27.979878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dd809c33-e562-401b-9881-f1f7f6275183 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:27.985313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4cf68e16-9037-49cc-8c5b-c0fe87b89488 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:27.987847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4cf68e16-9037-49cc-8c5b-c0fe87b89488 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:27.996100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dd809c33-e562-401b-9881-f1f7f6275183 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:27.997745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dd809c33-e562-401b-9881-f1f7f6275183 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:27.997948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4cf68e16-9037-49cc-8c5b-c0fe87b89488 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:27.998498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4cf68e16-9037-49cc-8c5b-c0fe87b89488 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:27.998968 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dd809c33-e562-401b-9881-f1f7f6275183 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.968901 Aug 02 06:58:28.001145 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1355/2842] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:27 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:28.028976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4cf68e16-9037-49cc-8c5b-c0fe87b89488 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:28.029850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4cf68e16-9037-49cc-8c5b-c0fe87b89488 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:28.049294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-013a7df0-7ea2-48f2-a84b-425d118269f6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:28.050544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-013a7df0-7ea2-48f2-a84b-425d118269f6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:28.060882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-013a7df0-7ea2-48f2-a84b-425d118269f6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:28.064900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-013a7df0-7ea2-48f2-a84b-425d118269f6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:28.065743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-013a7df0-7ea2-48f2-a84b-425d118269f6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:28.066215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-013a7df0-7ea2-48f2-a84b-425d118269f6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:29.131198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4cf68e16-9037-49cc-8c5b-c0fe87b89488 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:29.143586 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4cf68e16-9037-49cc-8c5b-c0fe87b89488 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1402 microversion: 2.1 time: 1.165529 Aug 02 06:58:29.144431 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1488/2843] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:27 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1402 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:29.171977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dec463b0-b140-47e1-a65e-678fde6c6635 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:29.173798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dec463b0-b140-47e1-a65e-678fde6c6635 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:29.183548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dec463b0-b140-47e1-a65e-678fde6c6635 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:29.184202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dec463b0-b140-47e1-a65e-678fde6c6635 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:29.185552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dec463b0-b140-47e1-a65e-678fde6c6635 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:29.186475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dec463b0-b140-47e1-a65e-678fde6c6635 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:29.256623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-013a7df0-7ea2-48f2-a84b-425d118269f6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:29.269393 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-013a7df0-7ea2-48f2-a84b-425d118269f6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1503 microversion: 2.1 time: 1.224036 Aug 02 06:58:29.270817 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1356/2844] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:28 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1503 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:58:29.287362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-08c28a73-5c6f-4abd-b5a8-f014bb002b1d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:29.288529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-08c28a73-5c6f-4abd-b5a8-f014bb002b1d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:29.305442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08c28a73-5c6f-4abd-b5a8-f014bb002b1d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:29.310349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08c28a73-5c6f-4abd-b5a8-f014bb002b1d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:29.320417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08c28a73-5c6f-4abd-b5a8-f014bb002b1d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:29.321107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08c28a73-5c6f-4abd-b5a8-f014bb002b1d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:29.845684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dec463b0-b140-47e1-a65e-678fde6c6635 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:29.869028 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dec463b0-b140-47e1-a65e-678fde6c6635 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1360 microversion: 2.1 time: 0.719936 Aug 02 06:58:29.870882 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1489/2845] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:29 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1360 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:29.888323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2daad3e0-0b37-4b40-b06a-f7ca30d83e0a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:29.888863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2daad3e0-0b37-4b40-b06a-f7ca30d83e0a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:29.897372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:29.902169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2daad3e0-0b37-4b40-b06a-f7ca30d83e0a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:29.902648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2daad3e0-0b37-4b40-b06a-f7ca30d83e0a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:29.903528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2daad3e0-0b37-4b40-b06a-f7ca30d83e0a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:29.903961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2daad3e0-0b37-4b40-b06a-f7ca30d83e0a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:29.968234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-08c28a73-5c6f-4abd-b5a8-f014bb002b1d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:29.992406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-08c28a73-5c6f-4abd-b5a8-f014bb002b1d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:29.994086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-08c28a73-5c6f-4abd-b5a8-f014bb002b1d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:29.995378 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-08c28a73-5c6f-4abd-b5a8-f014bb002b1d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.723514 Aug 02 06:58:30.016802 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1357/2846] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:29 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:30.042481 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2daad3e0-0b37-4b40-b06a-f7ca30d83e0a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "POST /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975/action" status: 202 len: 0 microversion: 2.1 time: 0.169267 Aug 02 06:58:30.045975 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1490/2847] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:58:29 2022] POST /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:58:30.055057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-43c4e643-808b-41e5-842d-329732e37775 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:30.055685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-43c4e643-808b-41e5-842d-329732e37775 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:30.062461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43c4e643-808b-41e5-842d-329732e37775 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:30.063099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43c4e643-808b-41e5-842d-329732e37775 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:30.064031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43c4e643-808b-41e5-842d-329732e37775 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:30.064883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43c4e643-808b-41e5-842d-329732e37775 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:30.179662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e3bea06f-41bf-48b3-a3a7-2aad785f691b tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:30.181046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e3bea06f-41bf-48b3-a3a7-2aad785f691b tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:30.188976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3bea06f-41bf-48b3-a3a7-2aad785f691b tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:30.189707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3bea06f-41bf-48b3-a3a7-2aad785f691b tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:30.190769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3bea06f-41bf-48b3-a3a7-2aad785f691b tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:30.191361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3bea06f-41bf-48b3-a3a7-2aad785f691b tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:30.613760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-43c4e643-808b-41e5-842d-329732e37775 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:30.642698 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-43c4e643-808b-41e5-842d-329732e37775 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1508 microversion: 2.1 time: 0.591516 Aug 02 06:58:30.658013 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1358/2848] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:30 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1508 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:30.713764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e3bea06f-41bf-48b3-a3a7-2aad785f691b tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:30.721972 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e3bea06f-41bf-48b3-a3a7-2aad785f691b tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1402 microversion: 2.1 time: 0.548061 Aug 02 06:58:30.722815 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1491/2849] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:30 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1402 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:30.870531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-dad89d1e-32a4-4d5e-a25b-5f54a4bd0eb3 req-bc845a80-e03f-4a00-8746-5ecc0cedeef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cab5887-4328-4207-9ac6-c884aa9806d1", "tag": "18fcf761-a89b-4d97-9ca7-3c303953a3d1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:30.897077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d0c24d30-597d-4dd9-b6f0-7ce61ff719d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:30.898077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d0c24d30-597d-4dd9-b6f0-7ce61ff719d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:30.898200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-dad89d1e-32a4-4d5e-a25b-5f54a4bd0eb3 req-bc845a80-e03f-4a00-8746-5ecc0cedeef7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:30.898748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-dad89d1e-32a4-4d5e-a25b-5f54a4bd0eb3 req-bc845a80-e03f-4a00-8746-5ecc0cedeef7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:30.919955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0c24d30-597d-4dd9-b6f0-7ce61ff719d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:30.920747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0c24d30-597d-4dd9-b6f0-7ce61ff719d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:30.922093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0c24d30-597d-4dd9-b6f0-7ce61ff719d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:30.931221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0c24d30-597d-4dd9-b6f0-7ce61ff719d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:30.951808 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-dad89d1e-32a4-4d5e-a25b-5f54a4bd0eb3 req-bc845a80-e03f-4a00-8746-5ecc0cedeef7 service nova] Creating event network-changed:18fcf761-a89b-4d97-9ca7-3c303953a3d1 for instance 6cab5887-4328-4207-9ac6-c884aa9806d1 on n-h1-851337-3 Aug 02 06:58:30.978718 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-dad89d1e-32a4-4d5e-a25b-5f54a4bd0eb3 req-bc845a80-e03f-4a00-8746-5ecc0cedeef7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126411 Aug 02 06:58:30.983453 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1359/2850] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:31.026776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-23af412c-aa37-4285-aea8-85be5aac0f77 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:31.028773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-23af412c-aa37-4285-aea8-85be5aac0f77 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:31.046933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:31.052352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23af412c-aa37-4285-aea8-85be5aac0f77 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:31.053245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23af412c-aa37-4285-aea8-85be5aac0f77 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:31.056383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23af412c-aa37-4285-aea8-85be5aac0f77 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:31.058191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23af412c-aa37-4285-aea8-85be5aac0f77 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:31.328018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:31.451131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d0c24d30-597d-4dd9-b6f0-7ce61ff719d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:31.460283 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d0c24d30-597d-4dd9-b6f0-7ce61ff719d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1360 microversion: 2.1 time: 0.569873 Aug 02 06:58:31.463368 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1492/2851] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:30 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1360 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:31.472884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1386277284", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "599126f7-4a02-46ed-bb8a-6a61dd3bec17"}], "security_groups": [{"name": "tempest-securitygroup--1903911730"}], "key_name": "tempest-keypair-972196208", "user_data": "}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:31.967675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=12 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:32.007694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23af412c-aa37-4285-aea8-85be5aac0f77 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:32.020611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23af412c-aa37-4285-aea8-85be5aac0f77 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:32.022493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23af412c-aa37-4285-aea8-85be5aac0f77 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:32.023685 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-23af412c-aa37-4285-aea8-85be5aac0f77 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 1.002920 Aug 02 06:58:32.024429 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1360/2852] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:31 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:32.030000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-42dabb87-8375-4f9a-8b9e-0726b357bd3e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:32.031007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-42dabb87-8375-4f9a-8b9e-0726b357bd3e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:32.042359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42dabb87-8375-4f9a-8b9e-0726b357bd3e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:32.043387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42dabb87-8375-4f9a-8b9e-0726b357bd3e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:32.044353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42dabb87-8375-4f9a-8b9e-0726b357bd3e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:32.044860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42dabb87-8375-4f9a-8b9e-0726b357bd3e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:32.071286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] validate_networks() for [('599126f7-4a02-46ed-bb8a-6a61dd3bec17', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:58:32.488718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-42dabb87-8375-4f9a-8b9e-0726b357bd3e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:32.512960 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-42dabb87-8375-4f9a-8b9e-0726b357bd3e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1488 microversion: 2.1 time: 0.473471 Aug 02 06:58:32.514494 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1361/2853] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:32 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1488 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:32.532467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-25902536-254c-4762-bd3f-66976bfd026f tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:32.534047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-25902536-254c-4762-bd3f-66976bfd026f tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:32.551052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25902536-254c-4762-bd3f-66976bfd026f tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:32.553677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25902536-254c-4762-bd3f-66976bfd026f tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:32.554523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25902536-254c-4762-bd3f-66976bfd026f tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:32.555174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25902536-254c-4762-bd3f-66976bfd026f tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:32.983788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-25902536-254c-4762-bd3f-66976bfd026f tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:33.010711 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-25902536-254c-4762-bd3f-66976bfd026f tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1402 microversion: 2.1 time: 0.492545 Aug 02 06:58:33.012109 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1362/2854] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:32 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1402 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:33.016888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bbf3119e-e917-49b2-8c8b-22f88a6d61bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:33.020407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bbf3119e-e917-49b2-8c8b-22f88a6d61bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:33.044360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbf3119e-e917-49b2-8c8b-22f88a6d61bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:33.046522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbf3119e-e917-49b2-8c8b-22f88a6d61bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:33.047741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbf3119e-e917-49b2-8c8b-22f88a6d61bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:33.050112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbf3119e-e917-49b2-8c8b-22f88a6d61bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:33.489226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bbf3119e-e917-49b2-8c8b-22f88a6d61bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:33.495878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:58:33.496879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:58:33.497392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:58:33.497807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:58:33.498254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:58:33.501767 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bbf3119e-e917-49b2-8c8b-22f88a6d61bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1360 microversion: 2.1 time: 0.488496 Aug 02 06:58:33.511656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:33.512221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:33.513025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:33.513470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:33.518250 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1363/2855] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:33 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1360 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:33.525494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ed0bc448-3dad-4f3c-8e85-20b5f4214a90 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:33.528540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ed0bc448-3dad-4f3c-8e85-20b5f4214a90 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:33.550597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed0bc448-3dad-4f3c-8e85-20b5f4214a90 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:33.551406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed0bc448-3dad-4f3c-8e85-20b5f4214a90 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:33.555613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed0bc448-3dad-4f3c-8e85-20b5f4214a90 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:33.559609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed0bc448-3dad-4f3c-8e85-20b5f4214a90 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:33.580917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Getting quotas for project c21684e149204ae7afe06a3097411bd0. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:58:33.592483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Getting quotas for user 391135debbcb49de8b47dea807d9a4ea and project c21684e149204ae7afe06a3097411bd0. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:58:33.619865 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:58:33.622346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:58:33.645166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ed0bc448-3dad-4f3c-8e85-20b5f4214a90 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:58:33.784018 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-65e9a30f-1a80-433c-a161-f04c675eda40 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.317934 Aug 02 06:58:33.799475 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1493/2856] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:58:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 2334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:58:33.805424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-72359136-8499-473b-ac2f-7e9a17289cc6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:33.821236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-72359136-8499-473b-ac2f-7e9a17289cc6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:33.827435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:33.848551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72359136-8499-473b-ac2f-7e9a17289cc6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:33.849007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72359136-8499-473b-ac2f-7e9a17289cc6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:33.849877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72359136-8499-473b-ac2f-7e9a17289cc6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:33.850260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72359136-8499-473b-ac2f-7e9a17289cc6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:33.908460 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ed0bc448-3dad-4f3c-8e85-20b5f4214a90 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 204 len: 0 microversion: 2.1 time: 0.387293 Aug 02 06:58:33.912705 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1364/2857] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:58:33 2022] DELETE /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:58:33.937790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3e59ede6-2d87-408e-bf0f-8101f73461b8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:33.941212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3e59ede6-2d87-408e-bf0f-8101f73461b8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:34.164490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3e59ede6-2d87-408e-bf0f-8101f73461b8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:34.196187 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3e59ede6-2d87-408e-bf0f-8101f73461b8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1237 microversion: 2.1 time: 0.278389 Aug 02 06:58:34.204527 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1365/2858] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:33 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1237 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:34.230083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e8702a5b-56c2-48b3-ad5d-9e3eae9f2b81 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:34.231231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e8702a5b-56c2-48b3-ad5d-9e3eae9f2b81 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:34.253149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8702a5b-56c2-48b3-ad5d-9e3eae9f2b81 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:34.256595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8702a5b-56c2-48b3-ad5d-9e3eae9f2b81 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:34.263151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8702a5b-56c2-48b3-ad5d-9e3eae9f2b81 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:34.265579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8702a5b-56c2-48b3-ad5d-9e3eae9f2b81 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:34.799753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-72359136-8499-473b-ac2f-7e9a17289cc6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:34.819340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-72359136-8499-473b-ac2f-7e9a17289cc6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:34.821086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-72359136-8499-473b-ac2f-7e9a17289cc6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:34.822105 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-72359136-8499-473b-ac2f-7e9a17289cc6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 1.021382 Aug 02 06:58:34.822673 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1494/2859] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:33 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:34.856767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cd6fd1de-d40a-475e-8c1c-f34eebef8452 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:34.857386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cd6fd1de-d40a-475e-8c1c-f34eebef8452 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:34.865013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e8702a5b-56c2-48b3-ad5d-9e3eae9f2b81 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:34.876506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd6fd1de-d40a-475e-8c1c-f34eebef8452 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:34.880344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd6fd1de-d40a-475e-8c1c-f34eebef8452 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:34.880892 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e8702a5b-56c2-48b3-ad5d-9e3eae9f2b81 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1494 microversion: 2.1 time: 0.673558 Aug 02 06:58:34.881622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd6fd1de-d40a-475e-8c1c-f34eebef8452 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:34.882425 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1366/2860] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:34 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1494 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:34.896016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd6fd1de-d40a-475e-8c1c-f34eebef8452 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:34.901293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-14dda115-e84e-49f5-8b7a-0b3f2755013d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:34.901519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-14dda115-e84e-49f5-8b7a-0b3f2755013d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:34.919642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14dda115-e84e-49f5-8b7a-0b3f2755013d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:34.920124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14dda115-e84e-49f5-8b7a-0b3f2755013d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:34.920957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14dda115-e84e-49f5-8b7a-0b3f2755013d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:34.924735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14dda115-e84e-49f5-8b7a-0b3f2755013d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:35.282914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cd6fd1de-d40a-475e-8c1c-f34eebef8452 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:35.303516 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cd6fd1de-d40a-475e-8c1c-f34eebef8452 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1402 microversion: 2.1 time: 0.450272 Aug 02 06:58:35.305413 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1495/2861] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:34 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1402 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:35.323100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-14dda115-e84e-49f5-8b7a-0b3f2755013d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:35.328459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2de4adf8-7144-4ba5-95bc-b7d48a65dca5 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:35.330275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2de4adf8-7144-4ba5-95bc-b7d48a65dca5 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:35.333328 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-14dda115-e84e-49f5-8b7a-0b3f2755013d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1360 microversion: 2.1 time: 0.449554 Aug 02 06:58:35.354997 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1367/2862] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:34 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1360 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:35.359513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2de4adf8-7144-4ba5-95bc-b7d48a65dca5 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:35.362427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2de4adf8-7144-4ba5-95bc-b7d48a65dca5 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:35.363842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2de4adf8-7144-4ba5-95bc-b7d48a65dca5 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:35.369139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2de4adf8-7144-4ba5-95bc-b7d48a65dca5 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:35.501693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e52dc73c-885d-482e-a495-0783386af54e req-4ec03596-7c31-453a-bc7e-6744ede144ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b14c587b-3ed6-447f-8140-e5280370d4bc", "name": "network-vif-plugged", "status": "completed", "tag": "702fb797-be75-460e-8c23-fdab5d30fe86"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:35.540698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e52dc73c-885d-482e-a495-0783386af54e req-4ec03596-7c31-453a-bc7e-6744ede144ba service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:35.541147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e52dc73c-885d-482e-a495-0783386af54e req-4ec03596-7c31-453a-bc7e-6744ede144ba service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:35.572793 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e52dc73c-885d-482e-a495-0783386af54e req-4ec03596-7c31-453a-bc7e-6744ede144ba service nova] Creating event network-vif-plugged:702fb797-be75-460e-8c23-fdab5d30fe86 for instance b14c587b-3ed6-447f-8140-e5280370d4bc on n-h1-851337-3 Aug 02 06:58:35.604927 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e52dc73c-885d-482e-a495-0783386af54e req-4ec03596-7c31-453a-bc7e-6744ede144ba service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110101 Aug 02 06:58:35.605538 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1368/2863] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:58:35.831224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2de4adf8-7144-4ba5-95bc-b7d48a65dca5 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:35.842069 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2de4adf8-7144-4ba5-95bc-b7d48a65dca5 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1241 microversion: 2.1 time: 0.528978 Aug 02 06:58:35.849386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3b606281-4a11-4215-ba70-eb9bac15ee4a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:35.850469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3b606281-4a11-4215-ba70-eb9bac15ee4a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:35.865150 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1496/2864] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:35 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1241 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:35.876553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b606281-4a11-4215-ba70-eb9bac15ee4a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:35.895735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b606281-4a11-4215-ba70-eb9bac15ee4a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:35.899126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b606281-4a11-4215-ba70-eb9bac15ee4a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:35.900020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b606281-4a11-4215-ba70-eb9bac15ee4a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:35.907735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1fb643f9-f00c-425d-9241-0dded803aba3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:35.925250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1fb643f9-f00c-425d-9241-0dded803aba3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:35.957974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fb643f9-f00c-425d-9241-0dded803aba3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:35.981383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fb643f9-f00c-425d-9241-0dded803aba3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:35.982518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fb643f9-f00c-425d-9241-0dded803aba3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:35.988267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fb643f9-f00c-425d-9241-0dded803aba3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:36.613965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1fb643f9-f00c-425d-9241-0dded803aba3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:36.626663 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1fb643f9-f00c-425d-9241-0dded803aba3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1494 microversion: 2.1 time: 0.726216 Aug 02 06:58:36.642518 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1497/2865] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:35 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1494 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:36.653601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3b606281-4a11-4215-ba70-eb9bac15ee4a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:36.659211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bd8e879c-568d-4d4c-8eee-af588652b963 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:36.660119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bd8e879c-568d-4d4c-8eee-af588652b963 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:36.667626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd8e879c-568d-4d4c-8eee-af588652b963 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:36.668682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd8e879c-568d-4d4c-8eee-af588652b963 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:36.669693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd8e879c-568d-4d4c-8eee-af588652b963 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:36.670402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd8e879c-568d-4d4c-8eee-af588652b963 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:36.670863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3b606281-4a11-4215-ba70-eb9bac15ee4a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:36.672647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3b606281-4a11-4215-ba70-eb9bac15ee4a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:36.673879 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3b606281-4a11-4215-ba70-eb9bac15ee4a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.828833 Aug 02 06:58:36.680903 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1369/2866] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:35 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:36.697149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1da347c3-81fb-4777-a504-54687aa8d0d3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:36.699828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1da347c3-81fb-4777-a504-54687aa8d0d3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:36.725265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1da347c3-81fb-4777-a504-54687aa8d0d3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:36.726894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1da347c3-81fb-4777-a504-54687aa8d0d3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:36.730656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1da347c3-81fb-4777-a504-54687aa8d0d3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:36.731613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1da347c3-81fb-4777-a504-54687aa8d0d3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:37.665414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bd8e879c-568d-4d4c-8eee-af588652b963 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:37.669271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:37.691438 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bd8e879c-568d-4d4c-8eee-af588652b963 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1402 microversion: 2.1 time: 1.041353 Aug 02 06:58:37.693119 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1498/2867] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:36 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1402 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:37.700949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc05d707-7db4-4183-b8cf-f09e1791deda tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:37.711398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bc05d707-7db4-4183-b8cf-f09e1791deda tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:37.743024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc05d707-7db4-4183-b8cf-f09e1791deda tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:37.749760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc05d707-7db4-4183-b8cf-f09e1791deda tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:37.754524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc05d707-7db4-4183-b8cf-f09e1791deda tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:37.758011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc05d707-7db4-4183-b8cf-f09e1791deda tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:37.927098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1da347c3-81fb-4777-a504-54687aa8d0d3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:37.938538 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1da347c3-81fb-4777-a504-54687aa8d0d3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1360 microversion: 2.1 time: 1.256176 Aug 02 06:58:37.944724 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1370/2868] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:36 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1360 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:37.954566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9fe07fa2-112f-4d94-b358-a649a0df812b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:37.974212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9fe07fa2-112f-4d94-b358-a649a0df812b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:38.026951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9fe07fa2-112f-4d94-b358-a649a0df812b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:38.027980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9fe07fa2-112f-4d94-b358-a649a0df812b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:38.029127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9fe07fa2-112f-4d94-b358-a649a0df812b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:38.029796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9fe07fa2-112f-4d94-b358-a649a0df812b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:38.037041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bc05d707-7db4-4183-b8cf-f09e1791deda tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:38.059603 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc05d707-7db4-4183-b8cf-f09e1791deda tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1297 microversion: 2.1 time: 0.355296 Aug 02 06:58:38.061724 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1499/2869] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:37 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1297 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:38.087405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-84c06779-4fad-4381-909f-b8ef00826ced tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:38.091645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-84c06779-4fad-4381-909f-b8ef00826ced tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:38.130879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84c06779-4fad-4381-909f-b8ef00826ced tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:38.134169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84c06779-4fad-4381-909f-b8ef00826ced tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:38.147385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84c06779-4fad-4381-909f-b8ef00826ced tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:38.148076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84c06779-4fad-4381-909f-b8ef00826ced tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:38.428407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9fe07fa2-112f-4d94-b358-a649a0df812b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:38.445065 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9fe07fa2-112f-4d94-b358-a649a0df812b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 200 len: 1452 microversion: 2.1 time: 0.496422 Aug 02 06:58:38.446216 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1371/2870] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:37 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 1452 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:38.500196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-890f378c-fc34-4da1-875a-054ba95c2b32 req-c768e148-88f8-4809-bdc8-69ef1851c7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef56c36e-6f3f-40c5-b1c4-32d49b7c2975", "name": "network-vif-deleted", "tag": "ccb48bda-afe9-45eb-a656-12e649c3ed74"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:38.528077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-890f378c-fc34-4da1-875a-054ba95c2b32 req-c768e148-88f8-4809-bdc8-69ef1851c7c3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:38.528871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-890f378c-fc34-4da1-875a-054ba95c2b32 req-c768e148-88f8-4809-bdc8-69ef1851c7c3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:38.576281 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-890f378c-fc34-4da1-875a-054ba95c2b32 req-c768e148-88f8-4809-bdc8-69ef1851c7c3 service nova] Creating event network-vif-deleted:ccb48bda-afe9-45eb-a656-12e649c3ed74 for instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 on n-h1-851337-3 Aug 02 06:58:38.584331 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-890f378c-fc34-4da1-875a-054ba95c2b32 req-c768e148-88f8-4809-bdc8-69ef1851c7c3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089169 Aug 02 06:58:38.586447 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1372/2871] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:58:38.725681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d37820a5-8811-4bf5-a2b5-f68851f9a0d8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:38.727221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d37820a5-8811-4bf5-a2b5-f68851f9a0d8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:38.743716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d37820a5-8811-4bf5-a2b5-f68851f9a0d8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:38.744162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d37820a5-8811-4bf5-a2b5-f68851f9a0d8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:38.744950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d37820a5-8811-4bf5-a2b5-f68851f9a0d8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:38.745372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d37820a5-8811-4bf5-a2b5-f68851f9a0d8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:39.003844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84c06779-4fad-4381-909f-b8ef00826ced tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:39.026451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84c06779-4fad-4381-909f-b8ef00826ced tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:39.029016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84c06779-4fad-4381-909f-b8ef00826ced tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:39.030980 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-84c06779-4fad-4381-909f-b8ef00826ced tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.966600 Aug 02 06:58:39.039404 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1500/2872] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:38 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:39.048324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-87c95e2f-365d-4359-ad35-55e9fa5c3bbf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:39.055186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-87c95e2f-365d-4359-ad35-55e9fa5c3bbf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:39.068497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87c95e2f-365d-4359-ad35-55e9fa5c3bbf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:39.068955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87c95e2f-365d-4359-ad35-55e9fa5c3bbf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:39.070016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87c95e2f-365d-4359-ad35-55e9fa5c3bbf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:39.070456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87c95e2f-365d-4359-ad35-55e9fa5c3bbf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:39.266356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d37820a5-8811-4bf5-a2b5-f68851f9a0d8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:39.282170 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d37820a5-8811-4bf5-a2b5-f68851f9a0d8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1588 microversion: 2.1 time: 0.560969 Aug 02 06:58:39.283065 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1373/2873] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:38 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1588 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:58:39.302294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0e1e7b30-28e2-4ae3-8031-c442dec566db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:39.303721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0e1e7b30-28e2-4ae3-8031-c442dec566db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:39.313500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e1e7b30-28e2-4ae3-8031-c442dec566db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:39.315033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e1e7b30-28e2-4ae3-8031-c442dec566db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:39.316856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e1e7b30-28e2-4ae3-8031-c442dec566db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:39.317778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e1e7b30-28e2-4ae3-8031-c442dec566db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:39.527354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0e1e7b30-28e2-4ae3-8031-c442dec566db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:39.579391 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0e1e7b30-28e2-4ae3-8031-c442dec566db tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1295 microversion: 2.1 time: 0.294362 Aug 02 06:58:39.582071 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1374/2874] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:39 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1295 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:39.591272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0c2ba379-48b7-4b74-9e2a-fbc46e1fc62c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:39.595397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0c2ba379-48b7-4b74-9e2a-fbc46e1fc62c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:39.602968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c2ba379-48b7-4b74-9e2a-fbc46e1fc62c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:39.603805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c2ba379-48b7-4b74-9e2a-fbc46e1fc62c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:39.606057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c2ba379-48b7-4b74-9e2a-fbc46e1fc62c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:39.607522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c2ba379-48b7-4b74-9e2a-fbc46e1fc62c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:39.735626 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0c2ba379-48b7-4b74-9e2a-fbc46e1fc62c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151357 Aug 02 06:58:39.736960 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1375/2875] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 06:58:39 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:39.744871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-957add28-d4b2-451f-8aad-61e7c6db3e23 req-5cb7a67e-12d6-4032-959d-660a224c092b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cab5887-4328-4207-9ac6-c884aa9806d1", "name": "network-vif-plugged", "status": "completed", "tag": "18fcf761-a89b-4d97-9ca7-3c303953a3d1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:39.765323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-957add28-d4b2-451f-8aad-61e7c6db3e23 req-5cb7a67e-12d6-4032-959d-660a224c092b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:39.765773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-957add28-d4b2-451f-8aad-61e7c6db3e23 req-5cb7a67e-12d6-4032-959d-660a224c092b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:39.787364 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-957add28-d4b2-451f-8aad-61e7c6db3e23 req-5cb7a67e-12d6-4032-959d-660a224c092b service nova] Creating event network-vif-plugged:18fcf761-a89b-4d97-9ca7-3c303953a3d1 for instance 6cab5887-4328-4207-9ac6-c884aa9806d1 on n-h1-851337-3 Aug 02 06:58:39.793737 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-957add28-d4b2-451f-8aad-61e7c6db3e23 req-5cb7a67e-12d6-4032-959d-660a224c092b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055164 Aug 02 06:58:39.794598 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1376/2876] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:39.807690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f2dd2695-b7b0-4535-96b1-d05cd109d5da tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:39.808417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f2dd2695-b7b0-4535-96b1-d05cd109d5da tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:39.828703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2dd2695-b7b0-4535-96b1-d05cd109d5da tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:39.831624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2dd2695-b7b0-4535-96b1-d05cd109d5da tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:39.834285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2dd2695-b7b0-4535-96b1-d05cd109d5da tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:39.848531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2dd2695-b7b0-4535-96b1-d05cd109d5da tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:39.876029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-87c95e2f-365d-4359-ad35-55e9fa5c3bbf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:39.882837 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-f2dd2695-b7b0-4535-96b1-d05cd109d5da tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 06:58:39.884697 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-87c95e2f-365d-4359-ad35-55e9fa5c3bbf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1360 microversion: 2.1 time: 0.843459 Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f2dd2695-b7b0-4535-96b1-d05cd109d5da tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 HTTP/1.1 Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'ef56c36e-6f3f-40c5-b1c4-32d49b7c2975'} Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:58:39.885535 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:39.889685 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:58:39.889685 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:58:39.889685 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:58:39.889685 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:58:39.889685 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:58:39.889685 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 06:58:39.889685 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:58:39.892193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f2dd2695-b7b0-4535-96b1-d05cd109d5da tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:58:39.893451 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f2dd2695-b7b0-4535-96b1-d05cd109d5da tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 404 len: 111 microversion: 2.1 time: 0.097781 Aug 02 06:58:39.894285 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1377/2877] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:39 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:58:39.903144 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1501/2878] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:39 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1360 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:40.056424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4cf5cb74-8686-4427-8d94-2fe781ad5d0f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:40.058291 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4cf5cb74-8686-4427-8d94-2fe781ad5d0f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:40.081647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cf5cb74-8686-4427-8d94-2fe781ad5d0f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:40.085123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cf5cb74-8686-4427-8d94-2fe781ad5d0f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:40.095798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cf5cb74-8686-4427-8d94-2fe781ad5d0f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:40.096987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cf5cb74-8686-4427-8d94-2fe781ad5d0f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:40.115233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-703275478", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "3904ca9d-0f3a-42df-acde-f1e02b7b9720"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:40.206650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] validate_networks() for [('3904ca9d-0f3a-42df-acde-f1e02b7b9720', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:58:41.463529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4cf5cb74-8686-4427-8d94-2fe781ad5d0f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:41.482939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4cf5cb74-8686-4427-8d94-2fe781ad5d0f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:41.484637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4cf5cb74-8686-4427-8d94-2fe781ad5d0f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:41.485936 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4cf5cb74-8686-4427-8d94-2fe781ad5d0f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 1.434919 Aug 02 06:58:41.503121 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1378/2879] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:40 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:41.516223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7e921f1f-136a-4db8-8640-2164b775b855 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:41.516778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7e921f1f-136a-4db8-8640-2164b775b855 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:41.533594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e921f1f-136a-4db8-8640-2164b775b855 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:41.534078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e921f1f-136a-4db8-8640-2164b775b855 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:41.534874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e921f1f-136a-4db8-8640-2164b775b855 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:41.535306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e921f1f-136a-4db8-8640-2164b775b855 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:41.770777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7e921f1f-136a-4db8-8640-2164b775b855 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:41.780394 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7e921f1f-136a-4db8-8640-2164b775b855 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1295 microversion: 2.1 time: 0.285682 Aug 02 06:58:41.780993 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1379/2880] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:41 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1295 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:41.799523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2bf9447e-7cac-406f-9632-40c2ffc42fc2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:41.800544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2bf9447e-7cac-406f-9632-40c2ffc42fc2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:41.807630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2bf9447e-7cac-406f-9632-40c2ffc42fc2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:41.818332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2bf9447e-7cac-406f-9632-40c2ffc42fc2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:41.819638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2bf9447e-7cac-406f-9632-40c2ffc42fc2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:41.820447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2bf9447e-7cac-406f-9632-40c2ffc42fc2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:42.607666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2bf9447e-7cac-406f-9632-40c2ffc42fc2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:42.617302 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2bf9447e-7cac-406f-9632-40c2ffc42fc2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1542 microversion: 2.1 time: 0.833139 Aug 02 06:58:42.626276 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1380/2881] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:41 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1542 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:42.953924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:58:42.958703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:58:42.959118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:58:42.959542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:58:42.960669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:58:42.967446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1071645256", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "09217277-643b-47f9-ae9c-d5bd75d72e3b"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:42.972758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:42.973204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:42.974243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:42.974877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:43.000536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Getting quotas for project a004889882844be18e4c30827645050e. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:58:43.009287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Getting quotas for user 0d6870f29383493c86db7e30259b8a8b and project a004889882844be18e4c30827645050e. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:58:43.032750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:58:43.035654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:58:43.090059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:43.122162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] validate_networks() for [('09217277-643b-47f9-ae9c-d5bd75d72e3b', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:58:43.137104 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b4c8064d-6868-407e-8b7d-bda558be5af3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.021963 Aug 02 06:58:43.147399 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1502/2882] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:58:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:58:43.165247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ae43bb6d-2041-4879-94f7-2b6e1bd80ab7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:43.166726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae43bb6d-2041-4879-94f7-2b6e1bd80ab7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:43.221286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae43bb6d-2041-4879-94f7-2b6e1bd80ab7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:43.223511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae43bb6d-2041-4879-94f7-2b6e1bd80ab7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:43.228558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae43bb6d-2041-4879-94f7-2b6e1bd80ab7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:43.229996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae43bb6d-2041-4879-94f7-2b6e1bd80ab7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:44.171571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:44.264928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ae43bb6d-2041-4879-94f7-2b6e1bd80ab7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:44.289940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ae43bb6d-2041-4879-94f7-2b6e1bd80ab7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:44.293181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ae43bb6d-2041-4879-94f7-2b6e1bd80ab7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:44.294838 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ae43bb6d-2041-4879-94f7-2b6e1bd80ab7 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 1.151219 Aug 02 06:58:44.295759 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1503/2883] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:43 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:44.300948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0e33f2cb-0c95-4635-bba3-09dc5e0eab4f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:44.315100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0e33f2cb-0c95-4635-bba3-09dc5e0eab4f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:44.326403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e33f2cb-0c95-4635-bba3-09dc5e0eab4f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:44.326997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e33f2cb-0c95-4635-bba3-09dc5e0eab4f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:44.327874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e33f2cb-0c95-4635-bba3-09dc5e0eab4f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:44.328560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e33f2cb-0c95-4635-bba3-09dc5e0eab4f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:44.697001 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0e33f2cb-0c95-4635-bba3-09dc5e0eab4f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.398119 Aug 02 06:58:44.698364 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1504/2884] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 06:58:44 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-interface => generated 284 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:44.709714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-af6b5ef8-ba88-4fb5-8256-9cee9770bce8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:44.710706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-af6b5ef8-ba88-4fb5-8256-9cee9770bce8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:44.722688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af6b5ef8-ba88-4fb5-8256-9cee9770bce8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:44.723891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af6b5ef8-ba88-4fb5-8256-9cee9770bce8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:44.725065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af6b5ef8-ba88-4fb5-8256-9cee9770bce8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:44.725769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af6b5ef8-ba88-4fb5-8256-9cee9770bce8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:45.907167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:58:45.907664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:58:45.908050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:58:45.908454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:58:45.908864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:58:45.929104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:45.929945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:45.932295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:45.932947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:45.985608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Getting quotas for project c957737e6d8e4318bcdc29f55fb5ee49. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:58:46.000377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Getting quotas for user a9a3e9cbfff244bc8c89e783c73f8c76 and project c957737e6d8e4318bcdc29f55fb5ee49. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:58:46.013352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-af6b5ef8-ba88-4fb5-8256-9cee9770bce8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:46.036456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Going to run 3 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:58:46.040580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: 1a0a69a6-f09a-4a1a-86ad-90ff72730aab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:58:46.046179 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-af6b5ef8-ba88-4fb5-8256-9cee9770bce8 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1363 microversion: 2.1 time: 1.346470 Aug 02 06:58:46.054007 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1505/2885] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:44 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1363 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:46.058358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f520b14e-1405-4659-ac23-9927aac809ad tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:46.059052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f520b14e-1405-4659-ac23-9927aac809ad tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:46.070515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f520b14e-1405-4659-ac23-9927aac809ad tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:46.070971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f520b14e-1405-4659-ac23-9927aac809ad tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:46.076523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f520b14e-1405-4659-ac23-9927aac809ad tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:46.076980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f520b14e-1405-4659-ac23-9927aac809ad tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:46.150522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: e66ef7ff-64b6-4b92-b1dd-dec10eaddef5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=1a0a69a6-f09a-4a1a-86ad-90ff72730aab,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:58:46.198787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=e66ef7ff-64b6-4b92-b1dd-dec10eaddef5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:58:46.204596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f520b14e-1405-4659-ac23-9927aac809ad tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:46.213002 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f520b14e-1405-4659-ac23-9927aac809ad tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1272 microversion: 2.1 time: 0.164790 Aug 02 06:58:46.231177 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1506/2886] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:46 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:46.237462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-31b5fdc0-923c-4c73-b53c-6655314fe0ad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:46.243186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-31b5fdc0-923c-4c73-b53c-6655314fe0ad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:46.272724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-31b5fdc0-923c-4c73-b53c-6655314fe0ad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:46.273677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-31b5fdc0-923c-4c73-b53c-6655314fe0ad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:46.277284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-31b5fdc0-923c-4c73-b53c-6655314fe0ad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:46.278694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-31b5fdc0-923c-4c73-b53c-6655314fe0ad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:46.335623 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3bd03596-284f-4d4d-97b7-6218b8721e9d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.707557 Aug 02 06:58:46.345059 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1381/2887] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:58:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:58:46.351397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bff387b4-5b02-448e-ab8a-31d68795571d tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:46.352288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bff387b4-5b02-448e-ab8a-31d68795571d tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:46.359466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bff387b4-5b02-448e-ab8a-31d68795571d tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:46.360175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bff387b4-5b02-448e-ab8a-31d68795571d tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:46.361103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bff387b4-5b02-448e-ab8a-31d68795571d tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:46.361688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bff387b4-5b02-448e-ab8a-31d68795571d tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:46.917372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-31b5fdc0-923c-4c73-b53c-6655314fe0ad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:46.933592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-31b5fdc0-923c-4c73-b53c-6655314fe0ad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:46.935341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-31b5fdc0-923c-4c73-b53c-6655314fe0ad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:46.938221 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-31b5fdc0-923c-4c73-b53c-6655314fe0ad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.705509 Aug 02 06:58:46.941480 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1507/2888] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:46 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:46.949564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-efda700e-f5cc-4f6e-b29e-8478f54932ec req-207415c6-2ad2-4ea9-8fcd-032448fb40aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b14c587b-3ed6-447f-8140-e5280370d4bc", "tag": "702fb797-be75-460e-8c23-fdab5d30fe86"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:46.986816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-efda700e-f5cc-4f6e-b29e-8478f54932ec req-207415c6-2ad2-4ea9-8fcd-032448fb40aa service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:46.991063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-efda700e-f5cc-4f6e-b29e-8478f54932ec req-207415c6-2ad2-4ea9-8fcd-032448fb40aa service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:47.010071 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-efda700e-f5cc-4f6e-b29e-8478f54932ec req-207415c6-2ad2-4ea9-8fcd-032448fb40aa service nova] Creating event network-changed:702fb797-be75-460e-8c23-fdab5d30fe86 for instance b14c587b-3ed6-447f-8140-e5280370d4bc on n-h1-851337-3 Aug 02 06:58:47.041815 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-efda700e-f5cc-4f6e-b29e-8478f54932ec req-207415c6-2ad2-4ea9-8fcd-032448fb40aa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097180 Aug 02 06:58:47.043543 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1508/2889] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:47.049093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e419d350-d557-4c11-bd2e-eea4dd696fd2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:47.055381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e419d350-d557-4c11-bd2e-eea4dd696fd2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:47.057075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e419d350-d557-4c11-bd2e-eea4dd696fd2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Searching by: {'deleted': False, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:58:47.092470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e419d350-d557-4c11-bd2e-eea4dd696fd2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:47.093189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e419d350-d557-4c11-bd2e-eea4dd696fd2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:47.094273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e419d350-d557-4c11-bd2e-eea4dd696fd2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:47.095049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e419d350-d557-4c11-bd2e-eea4dd696fd2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:47.133875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bff387b4-5b02-448e-ab8a-31d68795571d tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:47.158461 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bff387b4-5b02-448e-ab8a-31d68795571d tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1588 microversion: 2.1 time: 0.811520 Aug 02 06:58:47.159506 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1382/2890] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:46 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1588 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:47.177061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-94bce201-c719-42b5-9ff0-99d79132bb30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:47.178473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-94bce201-c719-42b5-9ff0-99d79132bb30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:47.204306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-94bce201-c719-42b5-9ff0-99d79132bb30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:47.205042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-94bce201-c719-42b5-9ff0-99d79132bb30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:47.214182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-94bce201-c719-42b5-9ff0-99d79132bb30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:47.214926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-94bce201-c719-42b5-9ff0-99d79132bb30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:47.220546 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e419d350-d557-4c11-bd2e-eea4dd696fd2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.174546 Aug 02 06:58:47.238838 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1509/2891] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Aug 2 06:58:47 2022] GET /compute/v2.1/servers => generated 1018 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:47.254918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-69d2e71b-a4be-41c6-a9eb-8ec63619c3aa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:47.257008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-69d2e71b-a4be-41c6-a9eb-8ec63619c3aa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:47.272900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69d2e71b-a4be-41c6-a9eb-8ec63619c3aa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:47.275059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69d2e71b-a4be-41c6-a9eb-8ec63619c3aa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:47.276691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69d2e71b-a4be-41c6-a9eb-8ec63619c3aa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:47.277841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69d2e71b-a4be-41c6-a9eb-8ec63619c3aa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:47.557828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-69d2e71b-a4be-41c6-a9eb-8ec63619c3aa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:47.577289 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-69d2e71b-a4be-41c6-a9eb-8ec63619c3aa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1272 microversion: 2.1 time: 0.335439 Aug 02 06:58:47.578398 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1510/2892] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:47 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1272 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:47.608168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dabe41e9-6aa4-4b09-9ef2-e4da3bbfa051 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:47.609287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dabe41e9-6aa4-4b09-9ef2-e4da3bbfa051 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:47.902556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dabe41e9-6aa4-4b09-9ef2-e4da3bbfa051 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:47.912110 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dabe41e9-6aa4-4b09-9ef2-e4da3bbfa051 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1223 microversion: 2.1 time: 0.321248 Aug 02 06:58:47.931914 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1511/2893] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:47 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1223 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:47.968221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f3d0744e-07ed-48f2-9a3c-62f5477a7d59 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:47.969279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f3d0744e-07ed-48f2-9a3c-62f5477a7d59 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:47.983724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3d0744e-07ed-48f2-9a3c-62f5477a7d59 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:47.984462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3d0744e-07ed-48f2-9a3c-62f5477a7d59 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:47.987392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3d0744e-07ed-48f2-9a3c-62f5477a7d59 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:47.991782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3d0744e-07ed-48f2-9a3c-62f5477a7d59 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:48.513271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-94bce201-c719-42b5-9ff0-99d79132bb30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:48.523802 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-94bce201-c719-42b5-9ff0-99d79132bb30 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1363 microversion: 2.1 time: 1.362884 Aug 02 06:58:48.535159 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1383/2894] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:47 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1363 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:48.601603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4623edbb-ba8c-4334-a2c1-972fc99ff772 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:48.602835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4623edbb-ba8c-4334-a2c1-972fc99ff772 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:48.614205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4623edbb-ba8c-4334-a2c1-972fc99ff772 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:48.614871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4623edbb-ba8c-4334-a2c1-972fc99ff772 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:48.615844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4623edbb-ba8c-4334-a2c1-972fc99ff772 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:48.616530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4623edbb-ba8c-4334-a2c1-972fc99ff772 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:48.712967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f3d0744e-07ed-48f2-9a3c-62f5477a7d59 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:48.722760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f3d0744e-07ed-48f2-9a3c-62f5477a7d59 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:48.735724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f3d0744e-07ed-48f2-9a3c-62f5477a7d59 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:48.736964 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f3d0744e-07ed-48f2-9a3c-62f5477a7d59 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.772747 Aug 02 06:58:48.737869 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1512/2895] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:47 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:48.937501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1aad32f4-bc45-4d80-bbf7-cd8f1f98642d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:48.939117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1aad32f4-bc45-4d80-bbf7-cd8f1f98642d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:48.952417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1aad32f4-bc45-4d80-bbf7-cd8f1f98642d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:48.953463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1aad32f4-bc45-4d80-bbf7-cd8f1f98642d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:48.962235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1aad32f4-bc45-4d80-bbf7-cd8f1f98642d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:48.962953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1aad32f4-bc45-4d80-bbf7-cd8f1f98642d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:49.168361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4623edbb-ba8c-4334-a2c1-972fc99ff772 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:49.182900 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4623edbb-ba8c-4334-a2c1-972fc99ff772 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1314 microversion: 2.1 time: 0.584143 Aug 02 06:58:49.195558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1aad32f4-bc45-4d80-bbf7-cd8f1f98642d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:49.202152 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1384/2896] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:48 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:58:49.210983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-d1042db4-e9f3-4577-8131-f82d96504871 req-b22ac047-9d7b-4679-9468-84b6ed6cc0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42f890a-37e8-42bd-a345-d4dddadd50a1", "tag": "5ea429d3-3487-4c80-b5fb-b55e82f3edc6"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:49.212355 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1aad32f4-bc45-4d80-bbf7-cd8f1f98642d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1275 microversion: 2.1 time: 0.280273 Aug 02 06:58:49.213837 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1513/2897] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:48 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1275 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:49.233154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d1042db4-e9f3-4577-8131-f82d96504871 req-b22ac047-9d7b-4679-9468-84b6ed6cc0d0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:49.234765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d1042db4-e9f3-4577-8131-f82d96504871 req-b22ac047-9d7b-4679-9468-84b6ed6cc0d0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:49.251352 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-d1042db4-e9f3-4577-8131-f82d96504871 req-b22ac047-9d7b-4679-9468-84b6ed6cc0d0 service nova] Creating event network-changed:5ea429d3-3487-4c80-b5fb-b55e82f3edc6 for instance a42f890a-37e8-42bd-a345-d4dddadd50a1 on n-h1-851337-3 Aug 02 06:58:49.258210 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-d1042db4-e9f3-4577-8131-f82d96504871 req-b22ac047-9d7b-4679-9468-84b6ed6cc0d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052631 Aug 02 06:58:49.271085 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1385/2898] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:49.548033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-647cbbaf-edc8-4157-b98d-594d248cb2cb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:49.548664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-647cbbaf-edc8-4157-b98d-594d248cb2cb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:49.564009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-647cbbaf-edc8-4157-b98d-594d248cb2cb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:49.564378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-647cbbaf-edc8-4157-b98d-594d248cb2cb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:49.565177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-647cbbaf-edc8-4157-b98d-594d248cb2cb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:49.565653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-647cbbaf-edc8-4157-b98d-594d248cb2cb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:49.610497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-31455fcc-95d8-433e-9dbc-c23c9fa9b3da req-1c1e0525-9d3a-44fe-b9b3-1a307c28d834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-plugged", "status": "completed", "tag": "3700e74e-8d56-4f36-963b-62599cf5f662"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:49.625818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-31455fcc-95d8-433e-9dbc-c23c9fa9b3da req-1c1e0525-9d3a-44fe-b9b3-1a307c28d834 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:49.626289 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-31455fcc-95d8-433e-9dbc-c23c9fa9b3da req-1c1e0525-9d3a-44fe-b9b3-1a307c28d834 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:49.642150 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-31455fcc-95d8-433e-9dbc-c23c9fa9b3da req-1c1e0525-9d3a-44fe-b9b3-1a307c28d834 service nova] Creating event network-vif-plugged:3700e74e-8d56-4f36-963b-62599cf5f662 for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:58:49.648238 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-31455fcc-95d8-433e-9dbc-c23c9fa9b3da req-1c1e0525-9d3a-44fe-b9b3-1a307c28d834 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048944 Aug 02 06:58:49.649730 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1386/2899] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:49.764968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f7ad4d91-d570-4385-9639-ceb3e0b6c479 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:49.765927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f7ad4d91-d570-4385-9639-ceb3e0b6c479 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:49.775195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7ad4d91-d570-4385-9639-ceb3e0b6c479 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:49.781568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7ad4d91-d570-4385-9639-ceb3e0b6c479 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:49.782868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7ad4d91-d570-4385-9639-ceb3e0b6c479 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:49.783498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7ad4d91-d570-4385-9639-ceb3e0b6c479 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:49.800204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:50.189631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-647cbbaf-edc8-4157-b98d-594d248cb2cb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:50.203364 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-647cbbaf-edc8-4157-b98d-594d248cb2cb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1363 microversion: 2.1 time: 0.657797 Aug 02 06:58:50.204444 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1514/2900] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:49 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1363 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:50.224569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ecb231b0-f32f-453a-b8ea-c09a33cee20e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:50.228122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ecb231b0-f32f-453a-b8ea-c09a33cee20e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:50.251748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ecb231b0-f32f-453a-b8ea-c09a33cee20e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:50.252365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ecb231b0-f32f-453a-b8ea-c09a33cee20e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:50.255601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ecb231b0-f32f-453a-b8ea-c09a33cee20e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:50.258373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ecb231b0-f32f-453a-b8ea-c09a33cee20e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:50.487448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f7ad4d91-d570-4385-9639-ceb3e0b6c479 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:50.515656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f7ad4d91-d570-4385-9639-ceb3e0b6c479 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:50.520444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f7ad4d91-d570-4385-9639-ceb3e0b6c479 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:50.529350 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f7ad4d91-d570-4385-9639-ceb3e0b6c479 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.767486 Aug 02 06:58:50.530629 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1387/2901] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:49 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:58:50.545178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8c6a3eba-f12a-4fd3-bc80-a30aa12067c4 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:50.548898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8c6a3eba-f12a-4fd3-bc80-a30aa12067c4 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:50.570315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c6a3eba-f12a-4fd3-bc80-a30aa12067c4 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:50.571261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c6a3eba-f12a-4fd3-bc80-a30aa12067c4 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:50.572832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c6a3eba-f12a-4fd3-bc80-a30aa12067c4 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:50.574245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c6a3eba-f12a-4fd3-bc80-a30aa12067c4 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:50.950112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8c6a3eba-f12a-4fd3-bc80-a30aa12067c4 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:50.957854 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8c6a3eba-f12a-4fd3-bc80-a30aa12067c4 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1283 microversion: 2.1 time: 0.425902 Aug 02 06:58:50.958496 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1388/2902] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:50 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1283 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:50.977218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-57040180-0610-4275-ad1c-0baf8fc46ad7 req-3d467def-deb5-4a37-b24f-ab3cb252f342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cab5887-4328-4207-9ac6-c884aa9806d1", "tag": "18fcf761-a89b-4d97-9ca7-3c303953a3d1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:50.987657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-57040180-0610-4275-ad1c-0baf8fc46ad7 req-3d467def-deb5-4a37-b24f-ab3cb252f342 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:50.988550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-57040180-0610-4275-ad1c-0baf8fc46ad7 req-3d467def-deb5-4a37-b24f-ab3cb252f342 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:51.002389 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-57040180-0610-4275-ad1c-0baf8fc46ad7 req-3d467def-deb5-4a37-b24f-ab3cb252f342 service nova] Creating event network-changed:18fcf761-a89b-4d97-9ca7-3c303953a3d1 for instance 6cab5887-4328-4207-9ac6-c884aa9806d1 on n-h1-851337-3 Aug 02 06:58:51.009010 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-57040180-0610-4275-ad1c-0baf8fc46ad7 req-3d467def-deb5-4a37-b24f-ab3cb252f342 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035601 Aug 02 06:58:51.010314 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1389/2903] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:51.030308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ecb231b0-f32f-453a-b8ea-c09a33cee20e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:51.039473 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ecb231b0-f32f-453a-b8ea-c09a33cee20e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1314 microversion: 2.1 time: 0.831888 Aug 02 06:58:51.044609 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1515/2904] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:50 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1314 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:51.228916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dfb21d65-9380-4101-a620-90091779d1fc tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:51.230112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dfb21d65-9380-4101-a620-90091779d1fc tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:51.245885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfb21d65-9380-4101-a620-90091779d1fc tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:51.246868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfb21d65-9380-4101-a620-90091779d1fc tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:51.255995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfb21d65-9380-4101-a620-90091779d1fc tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:51.257204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfb21d65-9380-4101-a620-90091779d1fc tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:51.555943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-892c1aa6-1cc5-45e3-8448-6672e4f1a59e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:51.556943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-892c1aa6-1cc5-45e3-8448-6672e4f1a59e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:51.572965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-892c1aa6-1cc5-45e3-8448-6672e4f1a59e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:51.573518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-892c1aa6-1cc5-45e3-8448-6672e4f1a59e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:51.578754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-892c1aa6-1cc5-45e3-8448-6672e4f1a59e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:51.579301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-892c1aa6-1cc5-45e3-8448-6672e4f1a59e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:52.424867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dfb21d65-9380-4101-a620-90091779d1fc tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:52.438172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-892c1aa6-1cc5-45e3-8448-6672e4f1a59e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:52.447958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-892c1aa6-1cc5-45e3-8448-6672e4f1a59e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:52.449829 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dfb21d65-9380-4101-a620-90091779d1fc tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1363 microversion: 2.1 time: 1.228138 Aug 02 06:58:52.453037 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1390/2905] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:51 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1363 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:52.454074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-892c1aa6-1cc5-45e3-8448-6672e4f1a59e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:52.455301 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-892c1aa6-1cc5-45e3-8448-6672e4f1a59e tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.903661 Aug 02 06:58:52.455876 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1516/2906] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:51 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:52.462972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-6c241e9d-e1c1-4ecf-86cb-05a0d95cfff5 req-65591cab-ec7e-424f-9562-5e757512025d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-plugged", "status": "completed", "tag": "8bd7f640-b150-4b49-bbf4-89405b95cc9e"}, {"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-plugged", "status": "completed", "tag": "3955d63c-80ec-4a2b-9a0a-54b7d2089a40"}, {"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-plugged", "status": "completed", "tag": "25aa727a-724d-4084-bf7a-ee4c3a07cce3"}, {"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-plugged", "status": "completed", "tag": "68c6c37c-41e1-43c2-ab74-6a4e3a848c4a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:52.472377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-599a8f13-fc6e-49b9-b6a0-00aa8867bcd5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:52.473275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-599a8f13-fc6e-49b9-b6a0-00aa8867bcd5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:52.483385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-599a8f13-fc6e-49b9-b6a0-00aa8867bcd5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:52.488002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-599a8f13-fc6e-49b9-b6a0-00aa8867bcd5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:52.489110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-599a8f13-fc6e-49b9-b6a0-00aa8867bcd5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:52.489447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6c241e9d-e1c1-4ecf-86cb-05a0d95cfff5 req-65591cab-ec7e-424f-9562-5e757512025d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:52.490592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6c241e9d-e1c1-4ecf-86cb-05a0d95cfff5 req-65591cab-ec7e-424f-9562-5e757512025d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:52.491512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-599a8f13-fc6e-49b9-b6a0-00aa8867bcd5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:52.512697 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-6c241e9d-e1c1-4ecf-86cb-05a0d95cfff5 req-65591cab-ec7e-424f-9562-5e757512025d service nova] Creating event network-vif-plugged:8bd7f640-b150-4b49-bbf4-89405b95cc9e for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:58:52.513595 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-6c241e9d-e1c1-4ecf-86cb-05a0d95cfff5 req-65591cab-ec7e-424f-9562-5e757512025d service nova] Creating event network-vif-plugged:3955d63c-80ec-4a2b-9a0a-54b7d2089a40 for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:58:52.520252 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-6c241e9d-e1c1-4ecf-86cb-05a0d95cfff5 req-65591cab-ec7e-424f-9562-5e757512025d service nova] Creating event network-vif-plugged:25aa727a-724d-4084-bf7a-ee4c3a07cce3 for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:58:52.523629 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-6c241e9d-e1c1-4ecf-86cb-05a0d95cfff5 req-65591cab-ec7e-424f-9562-5e757512025d service nova] Creating event network-vif-plugged:68c6c37c-41e1-43c2-ab74-6a4e3a848c4a for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:58:52.541357 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-6c241e9d-e1c1-4ecf-86cb-05a0d95cfff5 req-65591cab-ec7e-424f-9562-5e757512025d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.083574 Aug 02 06:58:52.546026 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1391/2907] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:52.552797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-525116d2-d104-41e3-bb0f-322b2ba23807 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:52.555413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-525116d2-d104-41e3-bb0f-322b2ba23807 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:52.569768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-525116d2-d104-41e3-bb0f-322b2ba23807 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:52.570823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-525116d2-d104-41e3-bb0f-322b2ba23807 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:52.572299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-525116d2-d104-41e3-bb0f-322b2ba23807 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:52.572973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-525116d2-d104-41e3-bb0f-322b2ba23807 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:52.767928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-599a8f13-fc6e-49b9-b6a0-00aa8867bcd5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:52.780831 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-599a8f13-fc6e-49b9-b6a0-00aa8867bcd5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1281 microversion: 2.1 time: 0.319530 Aug 02 06:58:52.781946 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1517/2908] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:52 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1281 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:53.052268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-525116d2-d104-41e3-bb0f-322b2ba23807 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:53.066763 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-525116d2-d104-41e3-bb0f-322b2ba23807 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1314 microversion: 2.1 time: 0.518688 Aug 02 06:58:53.069321 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1392/2909] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:52 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:53.472951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d88fda28-7ffc-433b-9186-ef8be1e9417e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:53.479415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8a4ef6a0-9a0a-4a53-9896-22d28d1d5c50 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:53.480327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d88fda28-7ffc-433b-9186-ef8be1e9417e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:53.480588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8a4ef6a0-9a0a-4a53-9896-22d28d1d5c50 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:53.492811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a4ef6a0-9a0a-4a53-9896-22d28d1d5c50 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:53.494783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d88fda28-7ffc-433b-9186-ef8be1e9417e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:53.495323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d88fda28-7ffc-433b-9186-ef8be1e9417e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:53.497108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a4ef6a0-9a0a-4a53-9896-22d28d1d5c50 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:53.498241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a4ef6a0-9a0a-4a53-9896-22d28d1d5c50 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:53.498441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d88fda28-7ffc-433b-9186-ef8be1e9417e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:53.499016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d88fda28-7ffc-433b-9186-ef8be1e9417e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:53.500086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a4ef6a0-9a0a-4a53-9896-22d28d1d5c50 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:54.405752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d88fda28-7ffc-433b-9186-ef8be1e9417e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:54.417609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:54.429340 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d88fda28-7ffc-433b-9186-ef8be1e9417e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1363 microversion: 2.1 time: 0.960320 Aug 02 06:58:54.446527 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1518/2910] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:53 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1363 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:54.453148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ed73bc16-1612-4ebb-ba80-bdfa864a790f req-ecb968fc-3af0-4947-bb52-4a2750b3bf33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b6671f-a2e2-46e6-ae8b-9785cf4d71b6", "tag": "568752e9-0de7-41e2-a754-c10d6f3b26fa"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:54.464719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ed73bc16-1612-4ebb-ba80-bdfa864a790f req-ecb968fc-3af0-4947-bb52-4a2750b3bf33 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:54.465562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ed73bc16-1612-4ebb-ba80-bdfa864a790f req-ecb968fc-3af0-4947-bb52-4a2750b3bf33 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:54.487034 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ed73bc16-1612-4ebb-ba80-bdfa864a790f req-ecb968fc-3af0-4947-bb52-4a2750b3bf33 service nova] Creating event network-changed:568752e9-0de7-41e2-a754-c10d6f3b26fa for instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 on n-h1-851337-3 Aug 02 06:58:54.488049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8a4ef6a0-9a0a-4a53-9896-22d28d1d5c50 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:54.496147 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ed73bc16-1612-4ebb-ba80-bdfa864a790f req-ecb968fc-3af0-4947-bb52-4a2750b3bf33 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047750 Aug 02 06:58:54.496995 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1519/2911] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:54.509073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-336ca821-d405-4142-a232-8a9af8b3f64b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:54.510280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-336ca821-d405-4142-a232-8a9af8b3f64b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:54.512539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8a4ef6a0-9a0a-4a53-9896-22d28d1d5c50 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:54.515850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8a4ef6a0-9a0a-4a53-9896-22d28d1d5c50 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:54.518522 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8a4ef6a0-9a0a-4a53-9896-22d28d1d5c50 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 1.043323 Aug 02 06:58:54.519409 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1393/2912] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:53 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:58:54.524461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-728af5b6-77bc-4b3c-80c6-2c2ed2934620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:54.525069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-728af5b6-77bc-4b3c-80c6-2c2ed2934620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:54.526564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-336ca821-d405-4142-a232-8a9af8b3f64b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:54.527253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-336ca821-d405-4142-a232-8a9af8b3f64b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:54.528596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-336ca821-d405-4142-a232-8a9af8b3f64b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:54.529208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-336ca821-d405-4142-a232-8a9af8b3f64b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:54.532729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-728af5b6-77bc-4b3c-80c6-2c2ed2934620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:54.533361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-728af5b6-77bc-4b3c-80c6-2c2ed2934620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:54.534224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-728af5b6-77bc-4b3c-80c6-2c2ed2934620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:54.534658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-728af5b6-77bc-4b3c-80c6-2c2ed2934620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:54.642607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-336ca821-d405-4142-a232-8a9af8b3f64b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:54.654459 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-336ca821-d405-4142-a232-8a9af8b3f64b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1281 microversion: 2.1 time: 0.155868 Aug 02 06:58:54.655298 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1520/2913] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:54 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1281 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:54.663005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-f4d8feba-6dd2-42de-870f-e4e2b21ac4e8 req-f302b3f8-b78d-4e59-a85e-1ed785480d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-plugged", "status": "completed", "tag": "cb505991-c8fe-43b4-b901-90af67c63340"}, {"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-plugged", "status": "completed", "tag": "32cec3a6-9298-4f4e-927b-827dd64b2baf"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:54.674557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f4d8feba-6dd2-42de-870f-e4e2b21ac4e8 req-f302b3f8-b78d-4e59-a85e-1ed785480d06 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:54.675973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f4d8feba-6dd2-42de-870f-e4e2b21ac4e8 req-f302b3f8-b78d-4e59-a85e-1ed785480d06 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:54.692195 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f4d8feba-6dd2-42de-870f-e4e2b21ac4e8 req-f302b3f8-b78d-4e59-a85e-1ed785480d06 service nova] Creating event network-vif-plugged:cb505991-c8fe-43b4-b901-90af67c63340 for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:58:54.692823 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f4d8feba-6dd2-42de-870f-e4e2b21ac4e8 req-f302b3f8-b78d-4e59-a85e-1ed785480d06 service nova] Creating event network-vif-plugged:32cec3a6-9298-4f4e-927b-827dd64b2baf for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:58:54.701178 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-f4d8feba-6dd2-42de-870f-e4e2b21ac4e8 req-f302b3f8-b78d-4e59-a85e-1ed785480d06 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044002 Aug 02 06:58:54.702417 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1521/2914] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:54.850645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-728af5b6-77bc-4b3c-80c6-2c2ed2934620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:54.866989 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-728af5b6-77bc-4b3c-80c6-2c2ed2934620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1314 microversion: 2.1 time: 0.345391 Aug 02 06:58:54.874934 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1394/2915] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:54 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:55.453032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f84278e4-9ce7-43d2-b695-d2d193a2b4d4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:55.455220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f84278e4-9ce7-43d2-b695-d2d193a2b4d4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:55.463438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f84278e4-9ce7-43d2-b695-d2d193a2b4d4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:55.463719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f84278e4-9ce7-43d2-b695-d2d193a2b4d4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:55.464774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f84278e4-9ce7-43d2-b695-d2d193a2b4d4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:55.465223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f84278e4-9ce7-43d2-b695-d2d193a2b4d4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:55.548780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a8d39682-ed50-4059-b248-9882671474d6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:55.549578 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a8d39682-ed50-4059-b248-9882671474d6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:55.553331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:55.560116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8d39682-ed50-4059-b248-9882671474d6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:55.560709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8d39682-ed50-4059-b248-9882671474d6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:55.561580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8d39682-ed50-4059-b248-9882671474d6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:55.562139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8d39682-ed50-4059-b248-9882671474d6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:55.849965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f84278e4-9ce7-43d2-b695-d2d193a2b4d4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:55.869972 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f84278e4-9ce7-43d2-b695-d2d193a2b4d4 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1363 microversion: 2.1 time: 0.419932 Aug 02 06:58:55.883395 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1522/2916] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:55 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1363 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:55.894071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6eeff2e2-fe05-4c6b-9440-4d9aeed44c75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:55.896447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6eeff2e2-fe05-4c6b-9440-4d9aeed44c75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:55.908076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6eeff2e2-fe05-4c6b-9440-4d9aeed44c75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:55.908960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6eeff2e2-fe05-4c6b-9440-4d9aeed44c75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:55.910321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6eeff2e2-fe05-4c6b-9440-4d9aeed44c75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:55.910768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6eeff2e2-fe05-4c6b-9440-4d9aeed44c75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:55.952949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a8d39682-ed50-4059-b248-9882671474d6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:55.960195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:55.966520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a8d39682-ed50-4059-b248-9882671474d6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:55.969476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a8d39682-ed50-4059-b248-9882671474d6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:55.971001 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a8d39682-ed50-4059-b248-9882671474d6 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1876 microversion: 2.32 time: 0.426243 Aug 02 06:58:55.971825 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1395/2917] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:55 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1876 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:58:55.977398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9bddd16a-19af-4612-ac53-2c3e43efb793 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:55.978322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9bddd16a-19af-4612-ac53-2c3e43efb793 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:55.986217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bddd16a-19af-4612-ac53-2c3e43efb793 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:55.986899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bddd16a-19af-4612-ac53-2c3e43efb793 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:55.987848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bddd16a-19af-4612-ac53-2c3e43efb793 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:55.988444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bddd16a-19af-4612-ac53-2c3e43efb793 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:56.026357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:56.200404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6eeff2e2-fe05-4c6b-9440-4d9aeed44c75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:56.211773 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6eeff2e2-fe05-4c6b-9440-4d9aeed44c75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1323 microversion: 2.1 time: 0.326726 Aug 02 06:58:56.213681 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1523/2918] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:55 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1323 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:56.252516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9bddd16a-19af-4612-ac53-2c3e43efb793 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:56.264720 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9bddd16a-19af-4612-ac53-2c3e43efb793 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1314 microversion: 2.1 time: 0.291094 Aug 02 06:58:56.265724 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1396/2919] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:55 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:56.744956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6bc2595c-cc4f-4e93-80a1-2cb2bc9ac2d5 req-f347c528-f211-40ef-9113-d6d194048cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42f890a-37e8-42bd-a345-d4dddadd50a1", "name": "network-vif-plugged", "status": "completed", "tag": "5ea429d3-3487-4c80-b5fb-b55e82f3edc6"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:56.769135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6bc2595c-cc4f-4e93-80a1-2cb2bc9ac2d5 req-f347c528-f211-40ef-9113-d6d194048cf3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:56.770846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6bc2595c-cc4f-4e93-80a1-2cb2bc9ac2d5 req-f347c528-f211-40ef-9113-d6d194048cf3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:56.803188 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-6bc2595c-cc4f-4e93-80a1-2cb2bc9ac2d5 req-f347c528-f211-40ef-9113-d6d194048cf3 service nova] Creating event network-vif-plugged:5ea429d3-3487-4c80-b5fb-b55e82f3edc6 for instance a42f890a-37e8-42bd-a345-d4dddadd50a1 on n-h1-851337-3 Aug 02 06:58:56.816463 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6bc2595c-cc4f-4e93-80a1-2cb2bc9ac2d5 req-f347c528-f211-40ef-9113-d6d194048cf3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077400 Aug 02 06:58:56.817324 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1524/2920] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:56.900403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-31b12dcd-f7b9-4c5c-bd5a-38f0e07e7ccb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:56.901224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-31b12dcd-f7b9-4c5c-bd5a-38f0e07e7ccb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:56.921305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31b12dcd-f7b9-4c5c-bd5a-38f0e07e7ccb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:56.922031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31b12dcd-f7b9-4c5c-bd5a-38f0e07e7ccb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:56.923651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31b12dcd-f7b9-4c5c-bd5a-38f0e07e7ccb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:56.924160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31b12dcd-f7b9-4c5c-bd5a-38f0e07e7ccb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:57.000095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b5334206-dd07-47f4-9fec-645e08826d2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:57.000915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b5334206-dd07-47f4-9fec-645e08826d2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:57.010275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5334206-dd07-47f4-9fec-645e08826d2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:57.011402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5334206-dd07-47f4-9fec-645e08826d2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:57.013359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5334206-dd07-47f4-9fec-645e08826d2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:57.014345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5334206-dd07-47f4-9fec-645e08826d2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:57.147528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:57.797887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-31b12dcd-f7b9-4c5c-bd5a-38f0e07e7ccb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:57.806625 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-31b12dcd-f7b9-4c5c-bd5a-38f0e07e7ccb tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1363 microversion: 2.1 time: 0.914657 Aug 02 06:58:57.807951 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1397/2921] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:56 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1363 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:57.812879 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e0ba83e6-9535-437b-b160-2fd61922ad60 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:57.813704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e0ba83e6-9535-437b-b160-2fd61922ad60 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:57.821405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0ba83e6-9535-437b-b160-2fd61922ad60 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:57.821949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0ba83e6-9535-437b-b160-2fd61922ad60 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:57.823489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0ba83e6-9535-437b-b160-2fd61922ad60 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:57.823960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0ba83e6-9535-437b-b160-2fd61922ad60 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:57.908341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=24 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:58:57.958594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b5334206-dd07-47f4-9fec-645e08826d2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:57.968380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b5334206-dd07-47f4-9fec-645e08826d2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:57.969978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b5334206-dd07-47f4-9fec-645e08826d2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:57.971335 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b5334206-dd07-47f4-9fec-645e08826d2c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 2827 microversion: 2.32 time: 0.977888 Aug 02 06:58:57.982903 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1525/2922] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:58:56 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 2827 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 06:58:57.992658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-11a7c0ce-7eee-47ff-a66a-9a0685bf56a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:57.993761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-11a7c0ce-7eee-47ff-a66a-9a0685bf56a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:58.009068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11a7c0ce-7eee-47ff-a66a-9a0685bf56a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:58.010243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11a7c0ce-7eee-47ff-a66a-9a0685bf56a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:58.011269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11a7c0ce-7eee-47ff-a66a-9a0685bf56a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:58.015178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11a7c0ce-7eee-47ff-a66a-9a0685bf56a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:58.197559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e0ba83e6-9535-437b-b160-2fd61922ad60 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:58.216865 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e0ba83e6-9535-437b-b160-2fd61922ad60 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1323 microversion: 2.1 time: 0.406353 Aug 02 06:58:58.218731 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1398/2923] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:57 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1323 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:58.242306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e10c7696-646e-4d19-a121-f56d28e5331c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:58.243572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e10c7696-646e-4d19-a121-f56d28e5331c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:58.255855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e10c7696-646e-4d19-a121-f56d28e5331c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:58.257059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e10c7696-646e-4d19-a121-f56d28e5331c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:58.258737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e10c7696-646e-4d19-a121-f56d28e5331c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:58.259885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e10c7696-646e-4d19-a121-f56d28e5331c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:58.532288 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e10c7696-646e-4d19-a121-f56d28e5331c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.309313 Aug 02 06:58:58.533678 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1399/2924] 10.222.0.79 () {60 vars in 1316 bytes} [Tue Aug 2 06:58:58 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595/os-interface => generated 1830 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:58:58.543730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-11a7c0ce-7eee-47ff-a66a-9a0685bf56a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:58.553704 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-11a7c0ce-7eee-47ff-a66a-9a0685bf56a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1314 microversion: 2.1 time: 0.568374 Aug 02 06:58:58.562503 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1526/2925] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:57 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:58.828490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9a350dc6-646e-4a3c-a7f6-5643a28fcb38 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:58.829409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9a350dc6-646e-4a3c-a7f6-5643a28fcb38 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:58.836804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a350dc6-646e-4a3c-a7f6-5643a28fcb38 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:58.837538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a350dc6-646e-4a3c-a7f6-5643a28fcb38 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:58.838517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a350dc6-646e-4a3c-a7f6-5643a28fcb38 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:58.839114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a350dc6-646e-4a3c-a7f6-5643a28fcb38 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:59.209400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9a350dc6-646e-4a3c-a7f6-5643a28fcb38 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:59.224792 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9a350dc6-646e-4a3c-a7f6-5643a28fcb38 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1363 microversion: 2.1 time: 0.400130 Aug 02 06:58:59.226629 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1400/2926] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:58 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:58:59.245642 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ce55d53f-e4a4-4274-9115-ebb7555cbef5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:59.246361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ce55d53f-e4a4-4274-9115-ebb7555cbef5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:59.260861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce55d53f-e4a4-4274-9115-ebb7555cbef5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:59.261319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce55d53f-e4a4-4274-9115-ebb7555cbef5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:59.264912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce55d53f-e4a4-4274-9115-ebb7555cbef5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:59.265363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce55d53f-e4a4-4274-9115-ebb7555cbef5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:59.444905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-bc16cd67-1f81-4b31-9524-9a140e7b5dd4 req-70cbba5c-2666-4dbf-8f5f-f6332025f74b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e2553b-f21b-4a57-999d-2b89e2a73318", "tag": "2a8e8b44-6315-4053-adab-6fdbe02a9b6b"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:58:59.457647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-bc16cd67-1f81-4b31-9524-9a140e7b5dd4 req-70cbba5c-2666-4dbf-8f5f-f6332025f74b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:59.458545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-bc16cd67-1f81-4b31-9524-9a140e7b5dd4 req-70cbba5c-2666-4dbf-8f5f-f6332025f74b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:59.474763 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-bc16cd67-1f81-4b31-9524-9a140e7b5dd4 req-70cbba5c-2666-4dbf-8f5f-f6332025f74b service nova] Creating event network-changed:2a8e8b44-6315-4053-adab-6fdbe02a9b6b for instance f3e2553b-f21b-4a57-999d-2b89e2a73318 on n-h1-851337-3 Aug 02 06:58:59.480061 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-bc16cd67-1f81-4b31-9524-9a140e7b5dd4 req-70cbba5c-2666-4dbf-8f5f-f6332025f74b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038737 Aug 02 06:58:59.481332 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1401/2927] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:58:59.592372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d2585b0b-4109-45e1-a8db-e808390afe9d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:58:59.593256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d2585b0b-4109-45e1-a8db-e808390afe9d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:58:59.600395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2585b0b-4109-45e1-a8db-e808390afe9d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:59.600848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2585b0b-4109-45e1-a8db-e808390afe9d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:59.601624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2585b0b-4109-45e1-a8db-e808390afe9d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:58:59.602105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2585b0b-4109-45e1-a8db-e808390afe9d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:58:59.640913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ce55d53f-e4a4-4274-9115-ebb7555cbef5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:59.668480 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ce55d53f-e4a4-4274-9115-ebb7555cbef5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1323 microversion: 2.1 time: 0.426417 Aug 02 06:58:59.672000 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1527/2928] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:59 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1323 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:58:59.953731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d2585b0b-4109-45e1-a8db-e808390afe9d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:58:59.969025 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d2585b0b-4109-45e1-a8db-e808390afe9d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1314 microversion: 2.1 time: 0.384640 Aug 02 06:58:59.970222 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1402/2929] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:58:59 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:00.250196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b7d82c4b-d9b5-41eb-86dd-46f3b8e6daa6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:00.251688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b7d82c4b-d9b5-41eb-86dd-46f3b8e6daa6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:00.269119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7d82c4b-d9b5-41eb-86dd-46f3b8e6daa6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:00.270458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7d82c4b-d9b5-41eb-86dd-46f3b8e6daa6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:00.271531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7d82c4b-d9b5-41eb-86dd-46f3b8e6daa6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:00.272426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7d82c4b-d9b5-41eb-86dd-46f3b8e6daa6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:00.537545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-36795a1a-c245-4b90-b8f7-044869b2c5b0 req-c0092bb5-2f02-42bc-b3c3-eb406cb2366d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66ef7ff-64b6-4b92-b1dd-dec10eaddef5", "tag": "61529744-fd58-475f-a198-6210dfb8f533"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:00.549740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-36795a1a-c245-4b90-b8f7-044869b2c5b0 req-c0092bb5-2f02-42bc-b3c3-eb406cb2366d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:00.550524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-36795a1a-c245-4b90-b8f7-044869b2c5b0 req-c0092bb5-2f02-42bc-b3c3-eb406cb2366d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:00.565643 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-36795a1a-c245-4b90-b8f7-044869b2c5b0 req-c0092bb5-2f02-42bc-b3c3-eb406cb2366d service nova] Creating event network-changed:61529744-fd58-475f-a198-6210dfb8f533 for instance e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 on n-h1-851337-3 Aug 02 06:59:00.571969 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-36795a1a-c245-4b90-b8f7-044869b2c5b0 req-c0092bb5-2f02-42bc-b3c3-eb406cb2366d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039742 Aug 02 06:59:00.572952 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1403/2930] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:59:00.695503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1120338c-db25-4405-8040-4cb1fd45cee5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:00.696440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1120338c-db25-4405-8040-4cb1fd45cee5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:00.703016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b7d82c4b-d9b5-41eb-86dd-46f3b8e6daa6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:00.704149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1120338c-db25-4405-8040-4cb1fd45cee5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:00.704764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1120338c-db25-4405-8040-4cb1fd45cee5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:00.705707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1120338c-db25-4405-8040-4cb1fd45cee5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:00.706318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1120338c-db25-4405-8040-4cb1fd45cee5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:00.718128 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b7d82c4b-d9b5-41eb-86dd-46f3b8e6daa6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1550 microversion: 2.1 time: 0.471661 Aug 02 06:59:00.733618 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1528/2931] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:00 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1550 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:00.746393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c3ef876e-6eec-471b-b10e-04fe626f09ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:00.749322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c3ef876e-6eec-471b-b10e-04fe626f09ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:00.771838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c3ef876e-6eec-471b-b10e-04fe626f09ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:00.772785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c3ef876e-6eec-471b-b10e-04fe626f09ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:00.777469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c3ef876e-6eec-471b-b10e-04fe626f09ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:00.777792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c3ef876e-6eec-471b-b10e-04fe626f09ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:01.057354 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c3ef876e-6eec-471b-b10e-04fe626f09ca tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.320580 Aug 02 06:59:01.058069 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1529/2932] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 06:59:00 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-interface => generated 285 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:59:01.071935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5e82d197-b40e-452d-9cc1-d200ca5c7945 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:01.072885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5e82d197-b40e-452d-9cc1-d200ca5c7945 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:01.093314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e82d197-b40e-452d-9cc1-d200ca5c7945 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:01.093761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e82d197-b40e-452d-9cc1-d200ca5c7945 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:01.107260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e82d197-b40e-452d-9cc1-d200ca5c7945 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:01.107874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e82d197-b40e-452d-9cc1-d200ca5c7945 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:01.224720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1120338c-db25-4405-8040-4cb1fd45cee5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:01.234468 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1120338c-db25-4405-8040-4cb1fd45cee5 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1323 microversion: 2.1 time: 0.544001 Aug 02 06:59:01.241457 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1404/2933] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:00 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1323 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:59:01.371194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8a639d80-9a7d-4435-9b01-791382735411 req-53954de6-43ac-4442-a135-64f696b02495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b6671f-a2e2-46e6-ae8b-9785cf4d71b6", "name": "network-vif-plugged", "status": "completed", "tag": "568752e9-0de7-41e2-a754-c10d6f3b26fa"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:01.393066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8a639d80-9a7d-4435-9b01-791382735411 req-53954de6-43ac-4442-a135-64f696b02495 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:01.393516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8a639d80-9a7d-4435-9b01-791382735411 req-53954de6-43ac-4442-a135-64f696b02495 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:01.428821 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8a639d80-9a7d-4435-9b01-791382735411 req-53954de6-43ac-4442-a135-64f696b02495 service nova] Creating event network-vif-plugged:568752e9-0de7-41e2-a754-c10d6f3b26fa for instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 on n-h1-851337-3 Aug 02 06:59:01.443465 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8a639d80-9a7d-4435-9b01-791382735411 req-53954de6-43ac-4442-a135-64f696b02495 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077528 Aug 02 06:59:01.444129 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1405/2934] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:59:01.538868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8cf03189-2a9e-4d9b-969f-57f862658823 req-9e3f65e4-46bd-4396-82a9-35fdff9bd398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a0a69a6-f09a-4a1a-86ad-90ff72730aab", "tag": "faa5b763-304c-4f9d-832d-151cc074502b"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:01.557054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8cf03189-2a9e-4d9b-969f-57f862658823 req-9e3f65e4-46bd-4396-82a9-35fdff9bd398 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:01.560870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8cf03189-2a9e-4d9b-969f-57f862658823 req-9e3f65e4-46bd-4396-82a9-35fdff9bd398 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:01.584935 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8cf03189-2a9e-4d9b-969f-57f862658823 req-9e3f65e4-46bd-4396-82a9-35fdff9bd398 service nova] Creating event network-changed:faa5b763-304c-4f9d-832d-151cc074502b for instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab on n-h1-851337-3 Aug 02 06:59:01.614662 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8cf03189-2a9e-4d9b-969f-57f862658823 req-9e3f65e4-46bd-4396-82a9-35fdff9bd398 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078019 Aug 02 06:59:01.619720 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1406/2935] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:59:01.730029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5e82d197-b40e-452d-9cc1-d200ca5c7945 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:01.745089 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5e82d197-b40e-452d-9cc1-d200ca5c7945 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1314 microversion: 2.1 time: 0.685894 Aug 02 06:59:01.746623 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1530/2936] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:01 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1314 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:02.270519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6580d48b-3dbc-4889-a743-1b0934ee6a21 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:02.271696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6580d48b-3dbc-4889-a743-1b0934ee6a21 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:02.290959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6580d48b-3dbc-4889-a743-1b0934ee6a21 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:02.291924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6580d48b-3dbc-4889-a743-1b0934ee6a21 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:02.292976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6580d48b-3dbc-4889-a743-1b0934ee6a21 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:02.293623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6580d48b-3dbc-4889-a743-1b0934ee6a21 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:02.601776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-9adde898-bf09-4542-885c-675849975036 req-4ac50d32-663f-4a66-9fcd-7386cfe25485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "tag": "25aa727a-724d-4084-bf7a-ee4c3a07cce3"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:02.619660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9adde898-bf09-4542-885c-675849975036 req-4ac50d32-663f-4a66-9fcd-7386cfe25485 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:02.633854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9adde898-bf09-4542-885c-675849975036 req-4ac50d32-663f-4a66-9fcd-7386cfe25485 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:02.640593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6580d48b-3dbc-4889-a743-1b0934ee6a21 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:02.650796 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6580d48b-3dbc-4889-a743-1b0934ee6a21 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1323 microversion: 2.1 time: 0.390547 Aug 02 06:59:02.651961 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1407/2937] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:02 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1323 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:02.664383 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-9adde898-bf09-4542-885c-675849975036 req-4ac50d32-663f-4a66-9fcd-7386cfe25485 service nova] Creating event network-changed:25aa727a-724d-4084-bf7a-ee4c3a07cce3 for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 06:59:02.673353 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-9adde898-bf09-4542-885c-675849975036 req-4ac50d32-663f-4a66-9fcd-7386cfe25485 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075260 Aug 02 06:59:02.675127 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1531/2938] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:59:02.768180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d5985ddd-3601-4831-a267-9e836b002ac7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:02.768908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d5985ddd-3601-4831-a267-9e836b002ac7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:02.779307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5985ddd-3601-4831-a267-9e836b002ac7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:02.782003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5985ddd-3601-4831-a267-9e836b002ac7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:02.783199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5985ddd-3601-4831-a267-9e836b002ac7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:02.783718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5985ddd-3601-4831-a267-9e836b002ac7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:02.791104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:03.390585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d5985ddd-3601-4831-a267-9e836b002ac7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:03.401085 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d5985ddd-3601-4831-a267-9e836b002ac7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1314 microversion: 2.1 time: 0.637110 Aug 02 06:59:03.402099 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1408/2939] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:02 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:03.674852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5075e61d-f7d5-42ba-9a81-7970e3e0a113 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:03.676501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5075e61d-f7d5-42ba-9a81-7970e3e0a113 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:03.688342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5075e61d-f7d5-42ba-9a81-7970e3e0a113 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:03.689204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5075e61d-f7d5-42ba-9a81-7970e3e0a113 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:03.690150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5075e61d-f7d5-42ba-9a81-7970e3e0a113 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:03.690655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5075e61d-f7d5-42ba-9a81-7970e3e0a113 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:03.961231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5075e61d-f7d5-42ba-9a81-7970e3e0a113 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:03.972213 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5075e61d-f7d5-42ba-9a81-7970e3e0a113 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1323 microversion: 2.1 time: 0.302433 Aug 02 06:59:03.973140 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1532/2940] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:03 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:04.114457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-1b6b3147-fdda-4ad9-b614-47bfc103c311 req-34564de8-d9ec-43dd-9290-85337cdb83c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42f890a-37e8-42bd-a345-d4dddadd50a1", "tag": "5ea429d3-3487-4c80-b5fb-b55e82f3edc6"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:04.131446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1b6b3147-fdda-4ad9-b614-47bfc103c311 req-34564de8-d9ec-43dd-9290-85337cdb83c6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:04.132211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1b6b3147-fdda-4ad9-b614-47bfc103c311 req-34564de8-d9ec-43dd-9290-85337cdb83c6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:04.154684 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-1b6b3147-fdda-4ad9-b614-47bfc103c311 req-34564de8-d9ec-43dd-9290-85337cdb83c6 service nova] Creating event network-changed:5ea429d3-3487-4c80-b5fb-b55e82f3edc6 for instance a42f890a-37e8-42bd-a345-d4dddadd50a1 on n-h1-851337-3 Aug 02 06:59:04.163487 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-1b6b3147-fdda-4ad9-b614-47bfc103c311 req-34564de8-d9ec-43dd-9290-85337cdb83c6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053960 Aug 02 06:59:04.164792 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1409/2941] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:59:04.423939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-515e4d0c-de83-4374-9a37-dac1a2b2039c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:04.424927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-515e4d0c-de83-4374-9a37-dac1a2b2039c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:04.432919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-515e4d0c-de83-4374-9a37-dac1a2b2039c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:04.433479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-515e4d0c-de83-4374-9a37-dac1a2b2039c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:04.434671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-515e4d0c-de83-4374-9a37-dac1a2b2039c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:04.435232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-515e4d0c-de83-4374-9a37-dac1a2b2039c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:04.589467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-515e4d0c-de83-4374-9a37-dac1a2b2039c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:04.600186 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-515e4d0c-de83-4374-9a37-dac1a2b2039c tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1314 microversion: 2.1 time: 0.181576 Aug 02 06:59:04.605969 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1533/2942] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:04 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:05.002315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7d406911-e596-4fc9-90fb-419f1814d28c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:05.003347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7d406911-e596-4fc9-90fb-419f1814d28c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:05.014494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d406911-e596-4fc9-90fb-419f1814d28c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:05.015273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d406911-e596-4fc9-90fb-419f1814d28c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:05.018011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d406911-e596-4fc9-90fb-419f1814d28c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:05.018847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d406911-e596-4fc9-90fb-419f1814d28c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:05.180473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7d406911-e596-4fc9-90fb-419f1814d28c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:05.189517 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7d406911-e596-4fc9-90fb-419f1814d28c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1323 microversion: 2.1 time: 0.194924 Aug 02 06:59:05.191416 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1410/2943] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:04 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1323 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:05.621558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5d149466-dfb5-46a0-9b1c-e78330e2fb3a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:05.622238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5d149466-dfb5-46a0-9b1c-e78330e2fb3a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:05.630496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d149466-dfb5-46a0-9b1c-e78330e2fb3a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:05.631350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d149466-dfb5-46a0-9b1c-e78330e2fb3a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:05.632900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d149466-dfb5-46a0-9b1c-e78330e2fb3a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:05.633350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d149466-dfb5-46a0-9b1c-e78330e2fb3a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:05.778257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5d149466-dfb5-46a0-9b1c-e78330e2fb3a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:05.786056 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5d149466-dfb5-46a0-9b1c-e78330e2fb3a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1314 microversion: 2.1 time: 0.168576 Aug 02 06:59:05.786794 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1534/2944] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:05 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:06.214997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2225d205-c682-4cd0-a13e-4acc1ba8b4f9 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:06.215602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2225d205-c682-4cd0-a13e-4acc1ba8b4f9 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:06.233976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2225d205-c682-4cd0-a13e-4acc1ba8b4f9 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:06.234379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2225d205-c682-4cd0-a13e-4acc1ba8b4f9 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:06.235266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2225d205-c682-4cd0-a13e-4acc1ba8b4f9 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:06.235744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2225d205-c682-4cd0-a13e-4acc1ba8b4f9 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:06.522467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2225d205-c682-4cd0-a13e-4acc1ba8b4f9 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:06.531238 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2225d205-c682-4cd0-a13e-4acc1ba8b4f9 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1323 microversion: 2.1 time: 0.320155 Aug 02 06:59:06.531926 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1411/2945] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:06 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:06.808917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-de4d90be-4cbd-4dd4-bc17-7b0aec39db4f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:06.809846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-de4d90be-4cbd-4dd4-bc17-7b0aec39db4f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:06.816997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de4d90be-4cbd-4dd4-bc17-7b0aec39db4f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:06.817516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de4d90be-4cbd-4dd4-bc17-7b0aec39db4f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:06.818321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de4d90be-4cbd-4dd4-bc17-7b0aec39db4f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:06.818779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de4d90be-4cbd-4dd4-bc17-7b0aec39db4f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:07.045619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-de4d90be-4cbd-4dd4-bc17-7b0aec39db4f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:07.054432 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-de4d90be-4cbd-4dd4-bc17-7b0aec39db4f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1314 microversion: 2.1 time: 0.249329 Aug 02 06:59:07.065920 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1535/2946] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:06 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:07.316721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-fbd9dfd2-0c1c-40b8-9031-b8a26095703e req-9e4d2f3d-7767-4b70-80ca-826b65c48053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e2553b-f21b-4a57-999d-2b89e2a73318", "name": "network-vif-plugged", "status": "completed", "tag": "2a8e8b44-6315-4053-adab-6fdbe02a9b6b"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:07.328570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fbd9dfd2-0c1c-40b8-9031-b8a26095703e req-9e4d2f3d-7767-4b70-80ca-826b65c48053 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:07.329060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fbd9dfd2-0c1c-40b8-9031-b8a26095703e req-9e4d2f3d-7767-4b70-80ca-826b65c48053 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:07.341298 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-fbd9dfd2-0c1c-40b8-9031-b8a26095703e req-9e4d2f3d-7767-4b70-80ca-826b65c48053 service nova] Creating event network-vif-plugged:2a8e8b44-6315-4053-adab-6fdbe02a9b6b for instance f3e2553b-f21b-4a57-999d-2b89e2a73318 on n-h1-851337-3 Aug 02 06:59:07.347385 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-fbd9dfd2-0c1c-40b8-9031-b8a26095703e req-9e4d2f3d-7767-4b70-80ca-826b65c48053 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034834 Aug 02 06:59:07.348569 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1412/2947] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:59:07.551686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fe5b7e72-d04a-444b-8528-535c9ec46dcb tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:07.552658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fe5b7e72-d04a-444b-8528-535c9ec46dcb tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:07.560340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe5b7e72-d04a-444b-8528-535c9ec46dcb tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:07.561021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe5b7e72-d04a-444b-8528-535c9ec46dcb tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:07.562065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe5b7e72-d04a-444b-8528-535c9ec46dcb tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:07.562512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe5b7e72-d04a-444b-8528-535c9ec46dcb tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:08.077701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-519a6f85-592e-4d5b-8abc-6b004fdf5279 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:08.078455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-519a6f85-592e-4d5b-8abc-6b004fdf5279 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:08.086131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-519a6f85-592e-4d5b-8abc-6b004fdf5279 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:08.086812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-519a6f85-592e-4d5b-8abc-6b004fdf5279 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:08.087854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-519a6f85-592e-4d5b-8abc-6b004fdf5279 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:08.088500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-519a6f85-592e-4d5b-8abc-6b004fdf5279 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:08.098635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fe5b7e72-d04a-444b-8528-535c9ec46dcb tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:08.112807 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fe5b7e72-d04a-444b-8528-535c9ec46dcb tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1323 microversion: 2.1 time: 0.563334 Aug 02 06:59:08.112941 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1536/2948] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:07 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1323 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:08.405885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-519a6f85-592e-4d5b-8abc-6b004fdf5279 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:08.414155 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-519a6f85-592e-4d5b-8abc-6b004fdf5279 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1314 microversion: 2.1 time: 0.340888 Aug 02 06:59:08.415315 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1413/2949] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:08 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:59:09.135766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-32f10a50-3426-4450-8989-b37815884ab1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:09.137530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-32f10a50-3426-4450-8989-b37815884ab1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:09.153817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32f10a50-3426-4450-8989-b37815884ab1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:09.155485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32f10a50-3426-4450-8989-b37815884ab1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:09.156525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32f10a50-3426-4450-8989-b37815884ab1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:09.158318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32f10a50-3426-4450-8989-b37815884ab1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:09.437933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3207e22f-9ba2-48f1-974b-00aab9b65e00 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:09.438571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3207e22f-9ba2-48f1-974b-00aab9b65e00 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:09.449188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3207e22f-9ba2-48f1-974b-00aab9b65e00 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:09.449638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3207e22f-9ba2-48f1-974b-00aab9b65e00 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:09.454849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3207e22f-9ba2-48f1-974b-00aab9b65e00 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:09.458410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3207e22f-9ba2-48f1-974b-00aab9b65e00 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:09.546084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-32f10a50-3426-4450-8989-b37815884ab1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:09.559726 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-32f10a50-3426-4450-8989-b37815884ab1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1323 microversion: 2.1 time: 0.428355 Aug 02 06:59:09.561480 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1537/2950] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:09 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1323 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:09.714641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3207e22f-9ba2-48f1-974b-00aab9b65e00 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:09.723871 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3207e22f-9ba2-48f1-974b-00aab9b65e00 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1314 microversion: 2.1 time: 0.291312 Aug 02 06:59:09.725938 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1414/2951] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:09 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:59:10.581237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-08f84ded-b1f3-449d-a7e5-3ec21731a185 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:10.582574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-08f84ded-b1f3-449d-a7e5-3ec21731a185 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:10.594303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08f84ded-b1f3-449d-a7e5-3ec21731a185 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:10.595071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08f84ded-b1f3-449d-a7e5-3ec21731a185 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:10.596085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08f84ded-b1f3-449d-a7e5-3ec21731a185 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:10.596704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08f84ded-b1f3-449d-a7e5-3ec21731a185 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:10.639575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:10.746556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7af06e30-db3f-405a-ae7e-5ff06edbf620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:10.747430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7af06e30-db3f-405a-ae7e-5ff06edbf620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:10.754522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7af06e30-db3f-405a-ae7e-5ff06edbf620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:10.755171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7af06e30-db3f-405a-ae7e-5ff06edbf620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:10.756512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7af06e30-db3f-405a-ae7e-5ff06edbf620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:10.756948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7af06e30-db3f-405a-ae7e-5ff06edbf620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:10.967778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-08f84ded-b1f3-449d-a7e5-3ec21731a185 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:10.976685 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-08f84ded-b1f3-449d-a7e5-3ec21731a185 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1323 microversion: 2.1 time: 0.399595 Aug 02 06:59:10.977407 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1538/2952] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:10 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1323 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:11.053634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7af06e30-db3f-405a-ae7e-5ff06edbf620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:11.062695 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7af06e30-db3f-405a-ae7e-5ff06edbf620 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1501 microversion: 2.1 time: 0.321803 Aug 02 06:59:11.063297 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1415/2953] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:10 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1501 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:11.083380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-16c18748-4b40-4e4a-8f72-d0d58d425bcc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:11.084242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-16c18748-4b40-4e4a-8f72-d0d58d425bcc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:11.090747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16c18748-4b40-4e4a-8f72-d0d58d425bcc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:11.091206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16c18748-4b40-4e4a-8f72-d0d58d425bcc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:11.091980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16c18748-4b40-4e4a-8f72-d0d58d425bcc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:11.092425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16c18748-4b40-4e4a-8f72-d0d58d425bcc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:11.115608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-16c18748-4b40-4e4a-8f72-d0d58d425bcc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lazy-loading 'flavor' on Instance uuid 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:59:11.356025 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-16c18748-4b40-4e4a-8f72-d0d58d425bcc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "POST /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6/action" status: 202 len: 0 microversion: 2.1 time: 0.276341 Aug 02 06:59:11.367376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2e93ccc0-439c-486d-8090-3e5a04df91ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:11.368250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2e93ccc0-439c-486d-8090-3e5a04df91ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:11.374014 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1539/2954] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 06:59:11 2022] POST /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 06:59:11.375917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e93ccc0-439c-486d-8090-3e5a04df91ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:11.376800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e93ccc0-439c-486d-8090-3e5a04df91ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:11.377927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e93ccc0-439c-486d-8090-3e5a04df91ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:11.378516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e93ccc0-439c-486d-8090-3e5a04df91ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:11.547670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2e93ccc0-439c-486d-8090-3e5a04df91ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:11.557570 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2e93ccc0-439c-486d-8090-3e5a04df91ab tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.194548 Aug 02 06:59:11.558511 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1416/2955] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:11 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:11.737701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-15268d93-42f3-4bb5-90e4-12d557cb9f37 req-d6b04fe1-cebc-4852-aab4-fba830244916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e66ef7ff-64b6-4b92-b1dd-dec10eaddef5", "name": "network-vif-plugged", "status": "completed", "tag": "61529744-fd58-475f-a198-6210dfb8f533"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:11.754500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-15268d93-42f3-4bb5-90e4-12d557cb9f37 req-d6b04fe1-cebc-4852-aab4-fba830244916 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:11.755780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-15268d93-42f3-4bb5-90e4-12d557cb9f37 req-d6b04fe1-cebc-4852-aab4-fba830244916 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:11.767193 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-15268d93-42f3-4bb5-90e4-12d557cb9f37 req-d6b04fe1-cebc-4852-aab4-fba830244916 service nova] Creating event network-vif-plugged:61529744-fd58-475f-a198-6210dfb8f533 for instance e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 on n-h1-851337-3 Aug 02 06:59:11.772280 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-15268d93-42f3-4bb5-90e4-12d557cb9f37 req-d6b04fe1-cebc-4852-aab4-fba830244916 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040435 Aug 02 06:59:11.772986 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1540/2956] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:59:11.998903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-775bfd09-4cd6-4a7b-8252-a7861e07ede3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:11.999475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-775bfd09-4cd6-4a7b-8252-a7861e07ede3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:12.007316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-775bfd09-4cd6-4a7b-8252-a7861e07ede3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:12.007761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-775bfd09-4cd6-4a7b-8252-a7861e07ede3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:12.008566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-775bfd09-4cd6-4a7b-8252-a7861e07ede3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:12.009488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-775bfd09-4cd6-4a7b-8252-a7861e07ede3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:12.216341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-775bfd09-4cd6-4a7b-8252-a7861e07ede3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:12.228924 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-775bfd09-4cd6-4a7b-8252-a7861e07ede3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1323 microversion: 2.1 time: 0.234020 Aug 02 06:59:12.247409 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1417/2957] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:11 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:12.585943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-213c8e23-5bbe-43db-8022-bc52344d27cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:12.588149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-213c8e23-5bbe-43db-8022-bc52344d27cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:12.599353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-213c8e23-5bbe-43db-8022-bc52344d27cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:12.600161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-213c8e23-5bbe-43db-8022-bc52344d27cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:12.601924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-213c8e23-5bbe-43db-8022-bc52344d27cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:12.603106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-213c8e23-5bbe-43db-8022-bc52344d27cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:12.867680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-213c8e23-5bbe-43db-8022-bc52344d27cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:12.882963 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-213c8e23-5bbe-43db-8022-bc52344d27cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.304556 Aug 02 06:59:12.884134 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1541/2958] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:12 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:13.253078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aead9218-ce11-41c6-abbc-65526ad21d6f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:13.253767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aead9218-ce11-41c6-abbc-65526ad21d6f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:13.262982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aead9218-ce11-41c6-abbc-65526ad21d6f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:13.263760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aead9218-ce11-41c6-abbc-65526ad21d6f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:13.264721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aead9218-ce11-41c6-abbc-65526ad21d6f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:13.265304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aead9218-ce11-41c6-abbc-65526ad21d6f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:13.616717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aead9218-ce11-41c6-abbc-65526ad21d6f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:13.638256 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aead9218-ce11-41c6-abbc-65526ad21d6f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 200 len: 1516 microversion: 2.1 time: 0.387858 Aug 02 06:59:13.640979 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1418/2959] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:13 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 1516 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:13.660346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-415c3166-1ed2-42ae-9758-89741baff664 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:13.661169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-415c3166-1ed2-42ae-9758-89741baff664 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: e66ef7ff-64b6-4b92-b1dd-dec10eaddef5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:13.664574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=81 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:13.668250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-415c3166-1ed2-42ae-9758-89741baff664 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:13.668897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-415c3166-1ed2-42ae-9758-89741baff664 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:13.670070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-415c3166-1ed2-42ae-9758-89741baff664 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:13.671861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-415c3166-1ed2-42ae-9758-89741baff664 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:13.824661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a7af94a3-0997-4966-9bc6-0a577d203034 req-7dc0db49-4fcc-4169-94f3-11dac2f04fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0a69a6-f09a-4a1a-86ad-90ff72730aab", "name": "network-vif-plugged", "status": "completed", "tag": "faa5b763-304c-4f9d-832d-151cc074502b"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:13.857538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a7af94a3-0997-4966-9bc6-0a577d203034 req-7dc0db49-4fcc-4169-94f3-11dac2f04fa5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:13.858240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a7af94a3-0997-4966-9bc6-0a577d203034 req-7dc0db49-4fcc-4169-94f3-11dac2f04fa5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:13.872499 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a7af94a3-0997-4966-9bc6-0a577d203034 req-7dc0db49-4fcc-4169-94f3-11dac2f04fa5 service nova] Creating event network-vif-plugged:faa5b763-304c-4f9d-832d-151cc074502b for instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab on n-h1-851337-3 Aug 02 06:59:13.878120 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a7af94a3-0997-4966-9bc6-0a577d203034 req-7dc0db49-4fcc-4169-94f3-11dac2f04fa5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059191 Aug 02 06:59:13.879277 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1419/2960] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:59:13.894992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-415c3166-1ed2-42ae-9758-89741baff664 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:13.909719 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-415c3166-1ed2-42ae-9758-89741baff664 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5" status: 200 len: 1323 microversion: 2.1 time: 0.252943 Aug 02 06:59:13.910310 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1542/2961] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:13 2022] GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:13.919335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e0a341ec-2776-4b3d-bacf-9a9798a59579 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:13.920284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e0a341ec-2776-4b3d-bacf-9a9798a59579 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:13.929387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0a341ec-2776-4b3d-bacf-9a9798a59579 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:13.930267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0a341ec-2776-4b3d-bacf-9a9798a59579 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:13.931408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0a341ec-2776-4b3d-bacf-9a9798a59579 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:13.931847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0a341ec-2776-4b3d-bacf-9a9798a59579 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:14.147906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e0a341ec-2776-4b3d-bacf-9a9798a59579 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:14.160447 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e0a341ec-2776-4b3d-bacf-9a9798a59579 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.245371 Aug 02 06:59:14.161044 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1420/2962] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:13 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:14.932455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-39fd94eb-8c45-497b-8293-de7a359d3c9a tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:14.933755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-39fd94eb-8c45-497b-8293-de7a359d3c9a tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: e66ef7ff-64b6-4b92-b1dd-dec10eaddef5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:14.941812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39fd94eb-8c45-497b-8293-de7a359d3c9a tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:14.942300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39fd94eb-8c45-497b-8293-de7a359d3c9a tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:14.943067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39fd94eb-8c45-497b-8293-de7a359d3c9a tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:14.943568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39fd94eb-8c45-497b-8293-de7a359d3c9a tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:15.085006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-39fd94eb-8c45-497b-8293-de7a359d3c9a tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:15.094357 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-39fd94eb-8c45-497b-8293-de7a359d3c9a tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5" status: 200 len: 1516 microversion: 2.1 time: 0.165896 Aug 02 06:59:15.095016 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1543/2963] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:14 2022] GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:59:15.116901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-783366a0-ba44-4465-b5ba-9ad20876332c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:15.117524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-783366a0-ba44-4465-b5ba-9ad20876332c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: 1a0a69a6-f09a-4a1a-86ad-90ff72730aab] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:15.125747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-783366a0-ba44-4465-b5ba-9ad20876332c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:15.126343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-783366a0-ba44-4465-b5ba-9ad20876332c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:15.127215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-783366a0-ba44-4465-b5ba-9ad20876332c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:15.127724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-783366a0-ba44-4465-b5ba-9ad20876332c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:15.182534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b1e0e2c-591b-46f2-b0d1-1f8cfd51e8cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:15.183200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6b1e0e2c-591b-46f2-b0d1-1f8cfd51e8cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:15.190466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b1e0e2c-591b-46f2-b0d1-1f8cfd51e8cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:15.190900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b1e0e2c-591b-46f2-b0d1-1f8cfd51e8cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:15.191987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b1e0e2c-591b-46f2-b0d1-1f8cfd51e8cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:15.192450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b1e0e2c-591b-46f2-b0d1-1f8cfd51e8cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:15.349254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-783366a0-ba44-4465-b5ba-9ad20876332c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:15.358152 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-783366a0-ba44-4465-b5ba-9ad20876332c tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab" status: 200 len: 1323 microversion: 2.1 time: 0.245154 Aug 02 06:59:15.359424 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1421/2964] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:15 2022] GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab => generated 1323 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:15.395180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6b1e0e2c-591b-46f2-b0d1-1f8cfd51e8cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:15.404009 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6b1e0e2c-591b-46f2-b0d1-1f8cfd51e8cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.225791 Aug 02 06:59:15.404630 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1544/2965] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:15 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:16.379969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-161c544c-349b-423f-9e92-fcd6ea74c1f1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:16.382270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-161c544c-349b-423f-9e92-fcd6ea74c1f1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: 1a0a69a6-f09a-4a1a-86ad-90ff72730aab] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:16.390498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-161c544c-349b-423f-9e92-fcd6ea74c1f1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:16.390972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-161c544c-349b-423f-9e92-fcd6ea74c1f1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:16.391855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-161c544c-349b-423f-9e92-fcd6ea74c1f1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:16.392541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-161c544c-349b-423f-9e92-fcd6ea74c1f1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:16.425449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b3398b17-7148-470d-a705-700eb62d7046 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:16.426205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b3398b17-7148-470d-a705-700eb62d7046 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:16.443273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3398b17-7148-470d-a705-700eb62d7046 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:16.443721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3398b17-7148-470d-a705-700eb62d7046 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:16.444511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3398b17-7148-470d-a705-700eb62d7046 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:16.444945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3398b17-7148-470d-a705-700eb62d7046 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:16.691662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-161c544c-349b-423f-9e92-fcd6ea74c1f1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:16.699944 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-161c544c-349b-423f-9e92-fcd6ea74c1f1 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab" status: 200 len: 1323 microversion: 2.1 time: 0.323818 Aug 02 06:59:16.713845 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1422/2966] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:16 2022] GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab => generated 1323 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:16.726593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b3398b17-7148-470d-a705-700eb62d7046 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:16.736912 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b3398b17-7148-470d-a705-700eb62d7046 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.315847 Aug 02 06:59:16.749918 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1545/2967] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:16 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:17.721673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d891a659-5caa-49be-83ce-7207506f3543 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:17.722506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d891a659-5caa-49be-83ce-7207506f3543 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: 1a0a69a6-f09a-4a1a-86ad-90ff72730aab] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:17.730230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d891a659-5caa-49be-83ce-7207506f3543 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:17.731005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d891a659-5caa-49be-83ce-7207506f3543 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:17.731799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d891a659-5caa-49be-83ce-7207506f3543 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:17.732249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d891a659-5caa-49be-83ce-7207506f3543 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:17.767121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ac407cfb-87f7-4251-b036-3e1f9fa8fb1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:17.768566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ac407cfb-87f7-4251-b036-3e1f9fa8fb1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:17.778984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac407cfb-87f7-4251-b036-3e1f9fa8fb1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:17.783231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac407cfb-87f7-4251-b036-3e1f9fa8fb1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:17.784409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac407cfb-87f7-4251-b036-3e1f9fa8fb1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:17.785014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac407cfb-87f7-4251-b036-3e1f9fa8fb1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:18.137213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ac407cfb-87f7-4251-b036-3e1f9fa8fb1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:18.147306 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ac407cfb-87f7-4251-b036-3e1f9fa8fb1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.388369 Aug 02 06:59:18.148915 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1546/2968] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:17 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:18.175711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d891a659-5caa-49be-83ce-7207506f3543 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:18.189523 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d891a659-5caa-49be-83ce-7207506f3543 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab" status: 200 len: 1516 microversion: 2.1 time: 0.472116 Aug 02 06:59:18.190447 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1423/2969] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:17 2022] GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab => generated 1516 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:18.214256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b2ef041c-40b8-4da8-9c22-a34a9ee7ce40 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:18.214924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b2ef041c-40b8-4da8-9c22-a34a9ee7ce40 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: 1a0a69a6-f09a-4a1a-86ad-90ff72730aab] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:18.222176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2ef041c-40b8-4da8-9c22-a34a9ee7ce40 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:18.222632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2ef041c-40b8-4da8-9c22-a34a9ee7ce40 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:18.223401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2ef041c-40b8-4da8-9c22-a34a9ee7ce40 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:18.223975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2ef041c-40b8-4da8-9c22-a34a9ee7ce40 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:18.256280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b2ef041c-40b8-4da8-9c22-a34a9ee7ce40 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: 1a0a69a6-f09a-4a1a-86ad-90ff72730aab] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:59:18.349301 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b2ef041c-40b8-4da8-9c22-a34a9ee7ce40 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab" status: 204 len: 0 microversion: 2.1 time: 0.138984 Aug 02 06:59:18.350489 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1547/2970] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:59:18 2022] DELETE /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 06:59:18.359942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8be741f0-f30d-4e60-9913-8f25e71ef297 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:18.360693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8be741f0-f30d-4e60-9913-8f25e71ef297 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: 1a0a69a6-f09a-4a1a-86ad-90ff72730aab] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:18.367502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8be741f0-f30d-4e60-9913-8f25e71ef297 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:18.368075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8be741f0-f30d-4e60-9913-8f25e71ef297 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:18.368950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8be741f0-f30d-4e60-9913-8f25e71ef297 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:18.369446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8be741f0-f30d-4e60-9913-8f25e71ef297 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:18.590748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8be741f0-f30d-4e60-9913-8f25e71ef297 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:18.601482 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8be741f0-f30d-4e60-9913-8f25e71ef297 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab" status: 200 len: 1522 microversion: 2.1 time: 0.245271 Aug 02 06:59:18.603592 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1424/2971] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:18 2022] GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:19.177291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-202e6ddf-7d2c-422d-9046-6692350d857e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:19.178028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-202e6ddf-7d2c-422d-9046-6692350d857e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:19.185592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-202e6ddf-7d2c-422d-9046-6692350d857e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:19.186314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-202e6ddf-7d2c-422d-9046-6692350d857e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:19.187230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-202e6ddf-7d2c-422d-9046-6692350d857e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:19.187668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-202e6ddf-7d2c-422d-9046-6692350d857e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:19.417569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-202e6ddf-7d2c-422d-9046-6692350d857e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:19.429732 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-202e6ddf-7d2c-422d-9046-6692350d857e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.258303 Aug 02 06:59:19.442036 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1548/2972] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:19 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:19.625998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7bdfaa41-80bd-466d-8705-ab255e93f892 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:19.626927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7bdfaa41-80bd-466d-8705-ab255e93f892 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: 1a0a69a6-f09a-4a1a-86ad-90ff72730aab] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:19.636888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bdfaa41-80bd-466d-8705-ab255e93f892 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:19.639722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bdfaa41-80bd-466d-8705-ab255e93f892 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:19.641063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bdfaa41-80bd-466d-8705-ab255e93f892 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:19.641675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7bdfaa41-80bd-466d-8705-ab255e93f892 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:19.827416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7bdfaa41-80bd-466d-8705-ab255e93f892 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:19.850647 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7bdfaa41-80bd-466d-8705-ab255e93f892 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab" status: 200 len: 1522 microversion: 2.1 time: 0.230302 Aug 02 06:59:19.851416 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1425/2973] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:19 2022] GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:20.452898 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-feec03b1-285a-4d33-bdfa-127837ab7459 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:20.453714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-feec03b1-285a-4d33-bdfa-127837ab7459 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:20.463594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-feec03b1-285a-4d33-bdfa-127837ab7459 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:20.464508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-feec03b1-285a-4d33-bdfa-127837ab7459 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:20.466326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-feec03b1-285a-4d33-bdfa-127837ab7459 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:20.471277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-feec03b1-285a-4d33-bdfa-127837ab7459 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:20.698331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-feec03b1-285a-4d33-bdfa-127837ab7459 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:20.716573 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-feec03b1-285a-4d33-bdfa-127837ab7459 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.268581 Aug 02 06:59:20.717429 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1549/2974] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:20 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:20.872825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d6a9d3ac-e68e-44a9-9273-93eae6b9f221 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:20.874175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d6a9d3ac-e68e-44a9-9273-93eae6b9f221 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: 1a0a69a6-f09a-4a1a-86ad-90ff72730aab] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:20.890662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6a9d3ac-e68e-44a9-9273-93eae6b9f221 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:20.907304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6a9d3ac-e68e-44a9-9273-93eae6b9f221 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:20.908287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6a9d3ac-e68e-44a9-9273-93eae6b9f221 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:20.908856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6a9d3ac-e68e-44a9-9273-93eae6b9f221 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:20.924843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-0f2a47b7-4b6d-4726-a9bd-6b75d0a64b81 req-9a1709ba-2be5-44ca-a94b-f4a10ed03834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0a69a6-f09a-4a1a-86ad-90ff72730aab", "name": "network-vif-deleted", "tag": "faa5b763-304c-4f9d-832d-151cc074502b"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:20.978525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0f2a47b7-4b6d-4726-a9bd-6b75d0a64b81 req-9a1709ba-2be5-44ca-a94b-f4a10ed03834 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:20.983574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0f2a47b7-4b6d-4726-a9bd-6b75d0a64b81 req-9a1709ba-2be5-44ca-a94b-f4a10ed03834 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:21.025823 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-0f2a47b7-4b6d-4726-a9bd-6b75d0a64b81 req-9a1709ba-2be5-44ca-a94b-f4a10ed03834 service nova] Creating event network-vif-deleted:faa5b763-304c-4f9d-832d-151cc074502b for instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab on n-h1-851337-3 Aug 02 06:59:21.037017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d6a9d3ac-e68e-44a9-9273-93eae6b9f221 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:21.039680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:21.041737 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-0f2a47b7-4b6d-4726-a9bd-6b75d0a64b81 req-9a1709ba-2be5-44ca-a94b-f4a10ed03834 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133489 Aug 02 06:59:21.042841 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1550/2975] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:59:21.050003 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d6a9d3ac-e68e-44a9-9273-93eae6b9f221 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab" status: 200 len: 1480 microversion: 2.1 time: 0.181043 Aug 02 06:59:21.071967 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1426/2976] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:20 2022] GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab => generated 1480 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:21.742611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3af98b12-dea4-4b25-92a7-fdd68d5857cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:21.744095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3af98b12-dea4-4b25-92a7-fdd68d5857cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:21.752096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3af98b12-dea4-4b25-92a7-fdd68d5857cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:21.753012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3af98b12-dea4-4b25-92a7-fdd68d5857cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:21.754160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3af98b12-dea4-4b25-92a7-fdd68d5857cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:21.754765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3af98b12-dea4-4b25-92a7-fdd68d5857cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:21.992938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3af98b12-dea4-4b25-92a7-fdd68d5857cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:22.003532 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3af98b12-dea4-4b25-92a7-fdd68d5857cf tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.266278 Aug 02 06:59:22.004783 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1551/2977] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:21 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:22.080026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-56ea8bc5-6a20-4eb1-9d31-1398a3e0012f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:22.081538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-56ea8bc5-6a20-4eb1-9d31-1398a3e0012f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: 1a0a69a6-f09a-4a1a-86ad-90ff72730aab] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:22.091974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-56ea8bc5-6a20-4eb1-9d31-1398a3e0012f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:22.093552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-56ea8bc5-6a20-4eb1-9d31-1398a3e0012f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:22.094768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-56ea8bc5-6a20-4eb1-9d31-1398a3e0012f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:22.095528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-56ea8bc5-6a20-4eb1-9d31-1398a3e0012f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:22.123810 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-56ea8bc5-6a20-4eb1-9d31-1398a3e0012f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] HTTP exception thrown: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-56ea8bc5-6a20-4eb1-9d31-1398a3e0012f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Request method failure captured: Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab HTTP/1.1 Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Msgdr_3ztUdL69_leIUpiWCqemMYdX62zhm18399SGNaP5PpP0DxWxIfgN1l9HgY8NY5HIwrX9GTmeUO5yqZnVL5Xkei6cnoISwD8bldSOYhjAO4HFf4-XrtCxrr38-L1Tj2k74Eo9yKbSH3X6D0UceTeQIQN6HRbOw8oYysA9SY-c Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}] Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: a9a3e9cbfff244bc8c89e783c73f8c76 Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1a0a69a6-f09a-4a1a-86ad-90ff72730aab'} Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.125481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:22.132754 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.132754 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:22.132754 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:22.132754 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:22.132754 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:59:22.132754 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:59:22.132754 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:22.132754 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.132754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-56ea8bc5-6a20-4eb1-9d31-1398a3e0012f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Returning 404 to user: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:59:22.132754 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-56ea8bc5-6a20-4eb1-9d31-1398a3e0012f tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab" status: 404 len: 111 microversion: 2.1 time: 0.051369 Aug 02 06:59:22.132754 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1427/2978] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:22 2022] GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:59:22.140433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7c3b3357-e462-4d60-a2e6-1dfd7904ee75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:22.160584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7c3b3357-e462-4d60-a2e6-1dfd7904ee75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:22.164206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7c3b3357-e462-4d60-a2e6-1dfd7904ee75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:59:22.170845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c3b3357-e462-4d60-a2e6-1dfd7904ee75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:22.171565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c3b3357-e462-4d60-a2e6-1dfd7904ee75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:22.172609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c3b3357-e462-4d60-a2e6-1dfd7904ee75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:22.173258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c3b3357-e462-4d60-a2e6-1dfd7904ee75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:22.272902 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7c3b3357-e462-4d60-a2e6-1dfd7904ee75 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.136863 Aug 02 06:59:22.275288 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1552/2979] 10.222.0.79 () {58 vars in 1230 bytes} [Tue Aug 2 06:59:22 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:59:22.287714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a6b523e2-5379-4ffd-a668-24ce0f666489 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a6b523e2-5379-4ffd-a668-24ce0f666489 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Request method failure captured: Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Msgdr_3ztUdL69_leIUpiWCqemMYdX62zhm18399SGNaP5PpP0DxWxIfgN1l9HgY8NY5HIwrX9GTmeUO5yqZnVL5Xkei6cnoISwD8bldSOYhjAO4HFf4-XrtCxrr38-L1Tj2k74Eo9yKbSH3X6D0UceTeQIQN6HRbOw8oYysA9SY-c Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}] Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: a9a3e9cbfff244bc8c89e783c73f8c76 Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: action_args: {} Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 02 06:59:22.291870 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a6b523e2-5379-4ffd-a668-24ce0f666489 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a6b523e2-5379-4ffd-a668-24ce0f666489 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.009938 Aug 02 06:59:22.297167 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1428/2980] 10.222.0.79 () {58 vars in 1182 bytes} [Tue Aug 2 06:59:22 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 06:59:22.305580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ddf44210-9d1c-44f3-85b8-b01a679f919b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:22.311533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ddf44210-9d1c-44f3-85b8-b01a679f919b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:22.312206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ddf44210-9d1c-44f3-85b8-b01a679f919b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Searching by: {'deleted': False, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:59:22.319944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ddf44210-9d1c-44f3-85b8-b01a679f919b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:22.320397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ddf44210-9d1c-44f3-85b8-b01a679f919b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:22.322194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ddf44210-9d1c-44f3-85b8-b01a679f919b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:22.323059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ddf44210-9d1c-44f3-85b8-b01a679f919b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:22.367362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-ddf44210-9d1c-44f3-85b8-b01a679f919b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:59:22.373867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:22.454377 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ddf44210-9d1c-44f3-85b8-b01a679f919b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.153956 Aug 02 06:59:22.455891 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1553/2981] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Aug 2 06:59:22 2022] GET /compute/v2.1/servers => generated 683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:59:22.469105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-06568dc6-b6c8-4cf2-85cc-b6543dec6d67 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:22.477737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-06568dc6-b6c8-4cf2-85cc-b6543dec6d67 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:22.478562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.compute.servers [None req-06568dc6-b6c8-4cf2-85cc-b6543dec6d67 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Removing options 'limit' from query {{(pid=126119) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 02 06:59:22.479779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-06568dc6-b6c8-4cf2-85cc-b6543dec6d67 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Searching by: {'deleted': False, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:59:22.491115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06568dc6-b6c8-4cf2-85cc-b6543dec6d67 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:22.491582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06568dc6-b6c8-4cf2-85cc-b6543dec6d67 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:22.492507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06568dc6-b6c8-4cf2-85cc-b6543dec6d67 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:22.493035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06568dc6-b6c8-4cf2-85cc-b6543dec6d67 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:22.535647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-06568dc6-b6c8-4cf2-85cc-b6543dec6d67 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:59:22.618369 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-06568dc6-b6c8-4cf2-85cc-b6543dec6d67 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.151924 Aug 02 06:59:22.619609 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1429/2982] 10.222.0.79 () {58 vars in 1144 bytes} [Tue Aug 2 06:59:22 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:59:22.639289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2351f299-1929-4bb1-a18f-9cc9ebe43e2d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2351f299-1929-4bb1-a18f-9cc9ebe43e2d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Request method failure captured: Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Msgdr_3ztUdL69_leIUpiWCqemMYdX62zhm18399SGNaP5PpP0DxWxIfgN1l9HgY8NY5HIwrX9GTmeUO5yqZnVL5Xkei6cnoISwD8bldSOYhjAO4HFf4-XrtCxrr38-L1Tj2k74Eo9yKbSH3X6D0UceTeQIQN6HRbOw8oYysA9SY-c Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}] Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a9a3e9cbfff244bc8c89e783c73f8c76 Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: action_args: {} Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi '-1' Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 02 06:59:22.644423 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 02 06:59:22.652899 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.656377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2351f299-1929-4bb1-a18f-9cc9ebe43e2d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:59:22.659057 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2351f299-1929-4bb1-a18f-9cc9ebe43e2d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.024341 Aug 02 06:59:22.659901 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1554/2983] 10.222.0.79 () {58 vars in 1142 bytes} [Tue Aug 2 06:59:22 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:59:22.671164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15891751-3a7b-4385-9943-0be5245adeeb tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15891751-3a7b-4385-9943-0be5245adeeb tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Request method failure captured: Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Msgdr_3ztUdL69_leIUpiWCqemMYdX62zhm18399SGNaP5PpP0DxWxIfgN1l9HgY8NY5HIwrX9GTmeUO5yqZnVL5Xkei6cnoISwD8bldSOYhjAO4HFf4-XrtCxrr38-L1Tj2k74Eo9yKbSH3X6D0UceTeQIQN6HRbOw8oYysA9SY-c Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}] Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: a9a3e9cbfff244bc8c89e783c73f8c76 Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: action_args: {} Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'testing' Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 02 06:59:22.680973 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15891751-3a7b-4385-9943-0be5245adeeb tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-15891751-3a7b-4385-9943-0be5245adeeb tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.017150 Aug 02 06:59:22.689034 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1430/2984] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 06:59:22 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 06:59:22.695959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5b8dfab8-9de0-40b2-bfb5-3c12bbb21a50 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:22.701861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5b8dfab8-9de0-40b2-bfb5-3c12bbb21a50 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:22.702584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5b8dfab8-9de0-40b2-bfb5-3c12bbb21a50 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:59:22.725125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.compute.servers [None req-5b8dfab8-9de0-40b2-bfb5-3c12bbb21a50 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Flavor 'non_existing_flavor' could not be found {{(pid=126120) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 02 06:59:22.728846 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5b8dfab8-9de0-40b2-bfb5-3c12bbb21a50 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.037584 Aug 02 06:59:22.739550 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1555/2985] 10.222.0.79 () {58 vars in 1178 bytes} [Tue Aug 2 06:59:22 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:59:22.746225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c81fb009-a9e0-488c-88bd-8b3e849696f3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:22.752225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c81fb009-a9e0-488c-88bd-8b3e849696f3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:22.753194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c81fb009-a9e0-488c-88bd-8b3e849696f3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:59:22.765586 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c81fb009-a9e0-488c-88bd-8b3e849696f3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:22.766211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c81fb009-a9e0-488c-88bd-8b3e849696f3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:22.767244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c81fb009-a9e0-488c-88bd-8b3e849696f3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:22.767825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c81fb009-a9e0-488c-88bd-8b3e849696f3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:22.896841 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c81fb009-a9e0-488c-88bd-8b3e849696f3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.157588 Aug 02 06:59:22.898631 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1431/2986] 10.222.0.79 () {58 vars in 1174 bytes} [Tue Aug 2 06:59:22 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 06:59:22.915146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3a8c4c19-3955-4078-bf65-43b55cc47dc0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:22.922646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3a8c4c19-3955-4078-bf65-43b55cc47dc0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:22.924336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3a8c4c19-3955-4078-bf65-43b55cc47dc0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:59:22.932655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a8c4c19-3955-4078-bf65-43b55cc47dc0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:22.933492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a8c4c19-3955-4078-bf65-43b55cc47dc0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:22.934626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a8c4c19-3955-4078-bf65-43b55cc47dc0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:22.935837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a8c4c19-3955-4078-bf65-43b55cc47dc0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:23.028306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-abb72a2d-2d0f-4d79-822e-5948082b9403 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:23.030231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-abb72a2d-2d0f-4d79-822e-5948082b9403 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:23.042120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abb72a2d-2d0f-4d79-822e-5948082b9403 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:23.045025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abb72a2d-2d0f-4d79-822e-5948082b9403 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:23.046124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abb72a2d-2d0f-4d79-822e-5948082b9403 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:23.051078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abb72a2d-2d0f-4d79-822e-5948082b9403 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:23.084579 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3a8c4c19-3955-4078-bf65-43b55cc47dc0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.175347 Aug 02 06:59:23.085357 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1556/2987] 10.222.0.79 () {58 vars in 1184 bytes} [Tue Aug 2 06:59:22 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:59:23.107375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f12884f-3783-4961-aef7-8ced7b6640da tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:23.119679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f12884f-3783-4961-aef7-8ced7b6640da tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:23.123449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1f12884f-3783-4961-aef7-8ced7b6640da tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Searching by: {'deleted': False, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:59:23.134988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f12884f-3783-4961-aef7-8ced7b6640da tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:23.137688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f12884f-3783-4961-aef7-8ced7b6640da tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:23.138968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f12884f-3783-4961-aef7-8ced7b6640da tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:23.139655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f12884f-3783-4961-aef7-8ced7b6640da tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:23.174807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-1f12884f-3783-4961-aef7-8ced7b6640da tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:59:23.254837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f12884f-3783-4961-aef7-8ced7b6640da tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:23.277038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f12884f-3783-4961-aef7-8ced7b6640da tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:23.277785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f12884f-3783-4961-aef7-8ced7b6640da tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:23.344391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-abb72a2d-2d0f-4d79-822e-5948082b9403 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:23.361364 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-abb72a2d-2d0f-4d79-822e-5948082b9403 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.338646 Aug 02 06:59:23.361989 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1432/2988] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:23 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:23.495417 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f12884f-3783-4961-aef7-8ced7b6640da tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.399484 Aug 02 06:59:23.496497 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1557/2989] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 06:59:23 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:23.522665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-144e3924-6f69-44f1-9795-428fc3b61bbc tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:23.540496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-144e3924-6f69-44f1-9795-428fc3b61bbc tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:23.547170 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-144e3924-6f69-44f1-9795-428fc3b61bbc tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.028776 Aug 02 06:59:23.550021 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1433/2990] 10.222.0.79 () {58 vars in 1178 bytes} [Tue Aug 2 06:59:23 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 06:59:23.568596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4ac64b2a-e5a9-445f-acb5-6a0cb8663dd3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:23.574510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4ac64b2a-e5a9-445f-acb5-6a0cb8663dd3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:23.580589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4ac64b2a-e5a9-445f-acb5-6a0cb8663dd3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Searching by: {'deleted': False, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 06:59:23.587429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ac64b2a-e5a9-445f-acb5-6a0cb8663dd3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:23.587887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ac64b2a-e5a9-445f-acb5-6a0cb8663dd3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:23.588761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ac64b2a-e5a9-445f-acb5-6a0cb8663dd3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:23.589227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ac64b2a-e5a9-445f-acb5-6a0cb8663dd3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:23.627650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-4ac64b2a-e5a9-445f-acb5-6a0cb8663dd3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 06:59:23.663219 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4ac64b2a-e5a9-445f-acb5-6a0cb8663dd3 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.103091 Aug 02 06:59:23.664141 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1558/2991] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Aug 2 06:59:23 2022] GET /compute/v2.1/servers => generated 683 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:59:23.677005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f5f1451e-7bca-41f5-835c-039aa9c0c134 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:23.677437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f5f1451e-7bca-41f5-835c-039aa9c0c134 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: 1a0a69a6-f09a-4a1a-86ad-90ff72730aab] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:23.685855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5f1451e-7bca-41f5-835c-039aa9c0c134 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:23.686666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5f1451e-7bca-41f5-835c-039aa9c0c134 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:23.687686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5f1451e-7bca-41f5-835c-039aa9c0c134 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:23.688241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5f1451e-7bca-41f5-835c-039aa9c0c134 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:23.704148 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-f5f1451e-7bca-41f5-835c-039aa9c0c134 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] HTTP exception thrown: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f5f1451e-7bca-41f5-835c-039aa9c0c134 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Request method failure captured: Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab HTTP/1.1 Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Msgdr_3ztUdL69_leIUpiWCqemMYdX62zhm18399SGNaP5PpP0DxWxIfgN1l9HgY8NY5HIwrX9GTmeUO5yqZnVL5Xkei6cnoISwD8bldSOYhjAO4HFf4-XrtCxrr38-L1Tj2k74Eo9yKbSH3X6D0UceTeQIQN6HRbOw8oYysA9SY-c Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}] Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: a9a3e9cbfff244bc8c89e783c73f8c76 Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1a0a69a6-f09a-4a1a-86ad-90ff72730aab'} Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:59:23.706266 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:59:23.710368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:23.710368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:23.710368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:23.710368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:23.710368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:23.710368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:23.710368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:23.710368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:59:23.710368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:59:23.710368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:23.710368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:23.712237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f5f1451e-7bca-41f5-835c-039aa9c0c134 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Returning 404 to user: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:59:23.713325 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f5f1451e-7bca-41f5-835c-039aa9c0c134 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab" status: 404 len: 111 microversion: 2.1 time: 0.040414 Aug 02 06:59:23.717745 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1434/2992] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:59:23 2022] DELETE /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:59:23.724390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-53f9504c-9540-46dd-8396-51927605eb61 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:23.725444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-53f9504c-9540-46dd-8396-51927605eb61 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: e66ef7ff-64b6-4b92-b1dd-dec10eaddef5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:23.735743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53f9504c-9540-46dd-8396-51927605eb61 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:23.738778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53f9504c-9540-46dd-8396-51927605eb61 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:23.740755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53f9504c-9540-46dd-8396-51927605eb61 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:23.742263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53f9504c-9540-46dd-8396-51927605eb61 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:23.778088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-53f9504c-9540-46dd-8396-51927605eb61 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: e66ef7ff-64b6-4b92-b1dd-dec10eaddef5] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:59:23.881238 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-53f9504c-9540-46dd-8396-51927605eb61 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5" status: 204 len: 0 microversion: 2.1 time: 0.161541 Aug 02 06:59:23.885787 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1559/2993] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:59:23 2022] DELETE /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 06:59:23.894327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8f0b54e5-99ce-4e6b-8d4a-71ad6735ea47 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:23.895135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8f0b54e5-99ce-4e6b-8d4a-71ad6735ea47 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:23.902267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f0b54e5-99ce-4e6b-8d4a-71ad6735ea47 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:23.902732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f0b54e5-99ce-4e6b-8d4a-71ad6735ea47 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:23.903525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f0b54e5-99ce-4e6b-8d4a-71ad6735ea47 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:23.903962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f0b54e5-99ce-4e6b-8d4a-71ad6735ea47 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:23.931732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8f0b54e5-99ce-4e6b-8d4a-71ad6735ea47 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 06:59:24.016336 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8f0b54e5-99ce-4e6b-8d4a-71ad6735ea47 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 204 len: 0 microversion: 2.1 time: 0.128692 Aug 02 06:59:24.016925 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1435/2994] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 06:59:23 2022] DELETE /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 06:59:24.027335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a916e087-90cf-4454-a259-cec3319ccf97 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:24.028581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a916e087-90cf-4454-a259-cec3319ccf97 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: 1a0a69a6-f09a-4a1a-86ad-90ff72730aab] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:24.039056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a916e087-90cf-4454-a259-cec3319ccf97 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:24.039815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a916e087-90cf-4454-a259-cec3319ccf97 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:24.040807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a916e087-90cf-4454-a259-cec3319ccf97 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:24.041513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a916e087-90cf-4454-a259-cec3319ccf97 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:24.079476 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-a916e087-90cf-4454-a259-cec3319ccf97 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] HTTP exception thrown: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a916e087-90cf-4454-a259-cec3319ccf97 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Request method failure captured: Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab HTTP/1.1 Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Msgdr_3ztUdL69_leIUpiWCqemMYdX62zhm18399SGNaP5PpP0DxWxIfgN1l9HgY8NY5HIwrX9GTmeUO5yqZnVL5Xkei6cnoISwD8bldSOYhjAO4HFf4-XrtCxrr38-L1Tj2k74Eo9yKbSH3X6D0UceTeQIQN6HRbOw8oYysA9SY-c Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}] Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a9a3e9cbfff244bc8c89e783c73f8c76 Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '1a0a69a6-f09a-4a1a-86ad-90ff72730aab'} Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:24.081331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:24.085977 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:24.085977 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:24.085977 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:24.085977 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:24.085977 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:59:24.085977 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:59:24.085977 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. Aug 02 06:59:24.085977 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:24.085977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a916e087-90cf-4454-a259-cec3319ccf97 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Returning 404 to user: Instance 1a0a69a6-f09a-4a1a-86ad-90ff72730aab could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:59:24.085977 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a916e087-90cf-4454-a259-cec3319ccf97 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab" status: 404 len: 111 microversion: 2.1 time: 0.061561 Aug 02 06:59:24.087756 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1560/2995] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:24 2022] GET /compute/v2.1/servers/1a0a69a6-f09a-4a1a-86ad-90ff72730aab => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:59:24.094044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-af319732-f960-4eb0-8c8a-e735d5bdca70 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:24.094941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-af319732-f960-4eb0-8c8a-e735d5bdca70 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: e66ef7ff-64b6-4b92-b1dd-dec10eaddef5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:24.105790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af319732-f960-4eb0-8c8a-e735d5bdca70 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:24.106445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af319732-f960-4eb0-8c8a-e735d5bdca70 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:24.109478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af319732-f960-4eb0-8c8a-e735d5bdca70 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:24.110642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af319732-f960-4eb0-8c8a-e735d5bdca70 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:24.349421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-af319732-f960-4eb0-8c8a-e735d5bdca70 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:24.359914 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-af319732-f960-4eb0-8c8a-e735d5bdca70 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5" status: 200 len: 1522 microversion: 2.1 time: 0.271039 Aug 02 06:59:24.361209 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1436/2996] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:24 2022] GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:24.384904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9d5f8985-04f8-4077-bc55-c4a610697269 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:24.385834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9d5f8985-04f8-4077-bc55-c4a610697269 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:24.393529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d5f8985-04f8-4077-bc55-c4a610697269 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:24.394577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d5f8985-04f8-4077-bc55-c4a610697269 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:24.395748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d5f8985-04f8-4077-bc55-c4a610697269 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:24.396868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d5f8985-04f8-4077-bc55-c4a610697269 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:24.628768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9d5f8985-04f8-4077-bc55-c4a610697269 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:24.643517 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9d5f8985-04f8-4077-bc55-c4a610697269 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.264386 Aug 02 06:59:24.644350 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1561/2997] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:24 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:25.384901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1da62311-a314-4955-b192-ce907da6b1e0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:25.385950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1da62311-a314-4955-b192-ce907da6b1e0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: e66ef7ff-64b6-4b92-b1dd-dec10eaddef5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:25.397774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1da62311-a314-4955-b192-ce907da6b1e0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:25.402817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1da62311-a314-4955-b192-ce907da6b1e0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:25.403970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1da62311-a314-4955-b192-ce907da6b1e0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:25.406499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1da62311-a314-4955-b192-ce907da6b1e0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:25.669083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7a99578d-913d-4c55-9942-23a95573b928 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:25.670025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7a99578d-913d-4c55-9942-23a95573b928 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:25.679949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a99578d-913d-4c55-9942-23a95573b928 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:25.680486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a99578d-913d-4c55-9942-23a95573b928 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:25.682399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a99578d-913d-4c55-9942-23a95573b928 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:25.683146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a99578d-913d-4c55-9942-23a95573b928 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:25.688446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1da62311-a314-4955-b192-ce907da6b1e0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:25.701938 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1da62311-a314-4955-b192-ce907da6b1e0 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5" status: 200 len: 1522 microversion: 2.1 time: 0.317982 Aug 02 06:59:25.703574 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1437/2998] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:25 2022] GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:26.001963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7a99578d-913d-4c55-9942-23a95573b928 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:26.010725 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7a99578d-913d-4c55-9942-23a95573b928 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.346953 Aug 02 06:59:26.011983 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1562/2999] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:25 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:26.728955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-40dc7a29-39f7-4e0a-aa7f-e84c6f776f3d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:26.732220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-40dc7a29-39f7-4e0a-aa7f-e84c6f776f3d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: e66ef7ff-64b6-4b92-b1dd-dec10eaddef5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:26.734014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:26.740209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40dc7a29-39f7-4e0a-aa7f-e84c6f776f3d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:26.740656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40dc7a29-39f7-4e0a-aa7f-e84c6f776f3d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:26.741418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40dc7a29-39f7-4e0a-aa7f-e84c6f776f3d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:26.741859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40dc7a29-39f7-4e0a-aa7f-e84c6f776f3d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:26.990528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-40dc7a29-39f7-4e0a-aa7f-e84c6f776f3d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:27.002889 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-40dc7a29-39f7-4e0a-aa7f-e84c6f776f3d tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5" status: 200 len: 1522 microversion: 2.1 time: 0.279427 Aug 02 06:59:27.004664 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1438/3000] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:26 2022] GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:27.043214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9a815655-830f-44be-b008-a5a1ab4734fd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:27.050672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9a815655-830f-44be-b008-a5a1ab4734fd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:27.065500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a815655-830f-44be-b008-a5a1ab4734fd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:27.066066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a815655-830f-44be-b008-a5a1ab4734fd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:27.067686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a815655-830f-44be-b008-a5a1ab4734fd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:27.068502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a815655-830f-44be-b008-a5a1ab4734fd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:27.399609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9a815655-830f-44be-b008-a5a1ab4734fd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:27.412823 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9a815655-830f-44be-b008-a5a1ab4734fd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.382846 Aug 02 06:59:27.415047 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1563/3001] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:27 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:28.031269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-84c13ab9-9371-45ff-83ad-3fb59bc2d88b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:28.032495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-84c13ab9-9371-45ff-83ad-3fb59bc2d88b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: e66ef7ff-64b6-4b92-b1dd-dec10eaddef5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:28.040690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84c13ab9-9371-45ff-83ad-3fb59bc2d88b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:28.041335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84c13ab9-9371-45ff-83ad-3fb59bc2d88b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:28.042371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84c13ab9-9371-45ff-83ad-3fb59bc2d88b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:28.042950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84c13ab9-9371-45ff-83ad-3fb59bc2d88b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:28.306798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-84c13ab9-9371-45ff-83ad-3fb59bc2d88b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:28.321757 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-84c13ab9-9371-45ff-83ad-3fb59bc2d88b tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5" status: 200 len: 1522 microversion: 2.1 time: 0.295069 Aug 02 06:59:28.322672 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1439/3002] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:28 2022] GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:28.438978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bba3c728-6a0f-443d-9a0c-9f5e7fcb6d0f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:28.440342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bba3c728-6a0f-443d-9a0c-9f5e7fcb6d0f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:28.451184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bba3c728-6a0f-443d-9a0c-9f5e7fcb6d0f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:28.452147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bba3c728-6a0f-443d-9a0c-9f5e7fcb6d0f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:28.453759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bba3c728-6a0f-443d-9a0c-9f5e7fcb6d0f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:28.455335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bba3c728-6a0f-443d-9a0c-9f5e7fcb6d0f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:28.600943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-68d60db5-68ad-4e8a-a9b4-6bff9f656487 req-e16f3d4c-7d2f-496c-92ac-3c18a8de8397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e66ef7ff-64b6-4b92-b1dd-dec10eaddef5", "name": "network-vif-deleted", "tag": "61529744-fd58-475f-a198-6210dfb8f533"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:28.622216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-68d60db5-68ad-4e8a-a9b4-6bff9f656487 req-e16f3d4c-7d2f-496c-92ac-3c18a8de8397 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:28.622761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-68d60db5-68ad-4e8a-a9b4-6bff9f656487 req-e16f3d4c-7d2f-496c-92ac-3c18a8de8397 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:28.663603 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-68d60db5-68ad-4e8a-a9b4-6bff9f656487 req-e16f3d4c-7d2f-496c-92ac-3c18a8de8397 service nova] Creating event network-vif-deleted:61529744-fd58-475f-a198-6210dfb8f533 for instance e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 on n-h1-851337-3 Aug 02 06:59:28.680092 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-68d60db5-68ad-4e8a-a9b4-6bff9f656487 req-e16f3d4c-7d2f-496c-92ac-3c18a8de8397 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082701 Aug 02 06:59:28.688563 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1440/3003] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:59:29.265083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bba3c728-6a0f-443d-9a0c-9f5e7fcb6d0f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:29.274914 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bba3c728-6a0f-443d-9a0c-9f5e7fcb6d0f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.842034 Aug 02 06:59:29.289405 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1564/3004] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:28 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:29.352200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3800599d-8559-4bce-a323-19ee4e3b46f2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:29.352868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3800599d-8559-4bce-a323-19ee4e3b46f2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: e66ef7ff-64b6-4b92-b1dd-dec10eaddef5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:29.361077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3800599d-8559-4bce-a323-19ee4e3b46f2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:29.361519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3800599d-8559-4bce-a323-19ee4e3b46f2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:29.362536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3800599d-8559-4bce-a323-19ee4e3b46f2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:29.363166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3800599d-8559-4bce-a323-19ee4e3b46f2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:29.408074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3800599d-8559-4bce-a323-19ee4e3b46f2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:29.408776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3800599d-8559-4bce-a323-19ee4e3b46f2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:29.409404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-3800599d-8559-4bce-a323-19ee4e3b46f2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lazy-loading 'fault' on Instance uuid e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 06:59:29.471020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3800599d-8559-4bce-a323-19ee4e3b46f2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3e9cbfff244bc8c89e783c73f8c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957737e6d8e4318bcdc29f55fb5ee49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:29.479515 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3800599d-8559-4bce-a323-19ee4e3b46f2 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5" status: 200 len: 1313 microversion: 2.1 time: 0.134822 Aug 02 06:59:29.480151 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1441/3005] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:29 2022] GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 => generated 1313 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:30.297824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3b9f50a8-98c6-4ea5-bb2d-5966aa37299e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:30.298625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3b9f50a8-98c6-4ea5-bb2d-5966aa37299e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:30.306558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b9f50a8-98c6-4ea5-bb2d-5966aa37299e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:30.307102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b9f50a8-98c6-4ea5-bb2d-5966aa37299e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:30.308287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b9f50a8-98c6-4ea5-bb2d-5966aa37299e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:30.308921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b9f50a8-98c6-4ea5-bb2d-5966aa37299e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:30.509114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0b6e6c78-c24c-4b17-9384-80c278306289 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:30.510846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3b9f50a8-98c6-4ea5-bb2d-5966aa37299e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:30.516483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0b6e6c78-c24c-4b17-9384-80c278306289 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: e66ef7ff-64b6-4b92-b1dd-dec10eaddef5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:30.535515 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3b9f50a8-98c6-4ea5-bb2d-5966aa37299e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.242937 Aug 02 06:59:30.536087 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1565/3006] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:30 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:30.539006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b6e6c78-c24c-4b17-9384-80c278306289 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:30.539650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b6e6c78-c24c-4b17-9384-80c278306289 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:30.540580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b6e6c78-c24c-4b17-9384-80c278306289 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:30.541156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b6e6c78-c24c-4b17-9384-80c278306289 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:30.559492 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-0b6e6c78-c24c-4b17-9384-80c278306289 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] HTTP exception thrown: Instance e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 could not be found. Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0b6e6c78-c24c-4b17-9384-80c278306289 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Request method failure captured: Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 HTTP/1.1 Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Msgdr_3ztUdL69_leIUpiWCqemMYdX62zhm18399SGNaP5PpP0DxWxIfgN1l9HgY8NY5HIwrX9GTmeUO5yqZnVL5Xkei6cnoISwD8bldSOYhjAO4HFf4-XrtCxrr38-L1Tj2k74Eo9yKbSH3X6D0UceTeQIQN6HRbOw8oYysA9SY-c Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}] Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: a9a3e9cbfff244bc8c89e783c73f8c76 Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 could not be found. Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'e66ef7ff-64b6-4b92-b1dd-dec10eaddef5'} Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 could not be found. Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 could not be found. Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:30.561404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:30.566668 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:30.566668 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:30.566668 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:30.566668 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:30.566668 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:59:30.566668 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:59:30.566668 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 could not be found. Aug 02 06:59:30.566668 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 06:59:30.566668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0b6e6c78-c24c-4b17-9384-80c278306289 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Returning 404 to user: Instance e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:59:30.566668 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0b6e6c78-c24c-4b17-9384-80c278306289 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5" status: 404 len: 111 microversion: 2.1 time: 0.066063 Aug 02 06:59:30.566668 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1442/3007] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:30 2022] GET /compute/v2.1/servers/e66ef7ff-64b6-4b92-b1dd-dec10eaddef5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:59:30.573946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e2f8a2d6-d6a1-421a-ae1d-fd5a1f104e36 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:30.579470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e2f8a2d6-d6a1-421a-ae1d-fd5a1f104e36 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] [instance: f3e2553b-f21b-4a57-999d-2b89e2a73318] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:30.596091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e2f8a2d6-d6a1-421a-ae1d-fd5a1f104e36 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:30.597074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e2f8a2d6-d6a1-421a-ae1d-fd5a1f104e36 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:30.604017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e2f8a2d6-d6a1-421a-ae1d-fd5a1f104e36 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:30.605517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e2f8a2d6-d6a1-421a-ae1d-fd5a1f104e36 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:30.628564 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-e2f8a2d6-d6a1-421a-ae1d-fd5a1f104e36 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] HTTP exception thrown: Instance f3e2553b-f21b-4a57-999d-2b89e2a73318 could not be found. Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e2f8a2d6-d6a1-421a-ae1d-fd5a1f104e36 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Request method failure captured: Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 HTTP/1.1 Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Msgdr_3ztUdL69_leIUpiWCqemMYdX62zhm18399SGNaP5PpP0DxWxIfgN1l9HgY8NY5HIwrX9GTmeUO5yqZnVL5Xkei6cnoISwD8bldSOYhjAO4HFf4-XrtCxrr38-L1Tj2k74Eo9yKbSH3X6D0UceTeQIQN6HRbOw8oYysA9SY-c Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c957737e6d8e4318bcdc29f55fb5ee49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c957737e6d8e4318bcdc29f55fb5ee49"}]}] Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: c957737e6d8e4318bcdc29f55fb5ee49 Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1185741992 Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a9a3e9cbfff244bc8c89e783c73f8c76 Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ListServersNegativeTestJSON-1185741992-project Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance f3e2553b-f21b-4a57-999d-2b89e2a73318 could not be found. Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'f3e2553b-f21b-4a57-999d-2b89e2a73318'} Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e2553b-f21b-4a57-999d-2b89e2a73318 could not be found. Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e2553b-f21b-4a57-999d-2b89e2a73318 could not be found. Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:30.630153 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 06:59:30.640240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:30.640240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 06:59:30.640240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 06:59:30.640240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 06:59:30.640240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 06:59:30.640240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 06:59:30.640240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e2553b-f21b-4a57-999d-2b89e2a73318 could not be found. Aug 02 06:59:30.640240 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 06:59:30.640240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e2f8a2d6-d6a1-421a-ae1d-fd5a1f104e36 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] Returning 404 to user: Instance f3e2553b-f21b-4a57-999d-2b89e2a73318 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 06:59:30.640240 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e2f8a2d6-d6a1-421a-ae1d-fd5a1f104e36 tempest-ListServersNegativeTestJSON-1185741992 tempest-ListServersNegativeTestJSON-1185741992-project] 10.222.0.79 "GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318" status: 404 len: 111 microversion: 2.1 time: 0.062427 Aug 02 06:59:30.640240 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1566/3008] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:30 2022] GET /compute/v2.1/servers/f3e2553b-f21b-4a57-999d-2b89e2a73318 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 06:59:30.726786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-43b3633f-e9eb-4ad5-9a72-b409931c4f04 req-bc505697-7f7f-4c2f-8374-f21ccfed43ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e2553b-f21b-4a57-999d-2b89e2a73318", "name": "network-vif-deleted", "tag": "2a8e8b44-6315-4053-adab-6fdbe02a9b6b"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:30.738670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-43b3633f-e9eb-4ad5-9a72-b409931c4f04 req-bc505697-7f7f-4c2f-8374-f21ccfed43ba service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:30.739412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-43b3633f-e9eb-4ad5-9a72-b409931c4f04 req-bc505697-7f7f-4c2f-8374-f21ccfed43ba service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:30.757829 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-43b3633f-e9eb-4ad5-9a72-b409931c4f04 req-bc505697-7f7f-4c2f-8374-f21ccfed43ba service nova] Creating event network-vif-deleted:2a8e8b44-6315-4053-adab-6fdbe02a9b6b for instance f3e2553b-f21b-4a57-999d-2b89e2a73318 on n-h1-851337-3 Aug 02 06:59:30.764213 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-43b3633f-e9eb-4ad5-9a72-b409931c4f04 req-bc505697-7f7f-4c2f-8374-f21ccfed43ba service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041040 Aug 02 06:59:30.765169 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1443/3009] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:59:31.557574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cfbbbbe4-470f-4e96-b46e-a12ec901c363 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:31.559175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cfbbbbe4-470f-4e96-b46e-a12ec901c363 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:31.572473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfbbbbe4-470f-4e96-b46e-a12ec901c363 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:31.573087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfbbbbe4-470f-4e96-b46e-a12ec901c363 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:31.574050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfbbbbe4-470f-4e96-b46e-a12ec901c363 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:31.574595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfbbbbe4-470f-4e96-b46e-a12ec901c363 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:31.878908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cfbbbbe4-470f-4e96-b46e-a12ec901c363 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:31.899736 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cfbbbbe4-470f-4e96-b46e-a12ec901c363 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.346267 Aug 02 06:59:31.900751 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1567/3010] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:31 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:32.922668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:32.929365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3776654a-a9c1-4383-97b1-d69eee0884e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:32.930177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3776654a-a9c1-4383-97b1-d69eee0884e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:32.953344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3776654a-a9c1-4383-97b1-d69eee0884e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:32.953829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3776654a-a9c1-4383-97b1-d69eee0884e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:32.954860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3776654a-a9c1-4383-97b1-d69eee0884e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:32.955457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3776654a-a9c1-4383-97b1-d69eee0884e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:33.302546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3776654a-a9c1-4383-97b1-d69eee0884e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:33.313704 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3776654a-a9c1-4383-97b1-d69eee0884e9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.393189 Aug 02 06:59:33.315937 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1444/3011] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:32 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:34.341201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:34.343213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=10 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:34.349363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e5f6fec9-7e77-4adf-91db-478407c8c88b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:34.350476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e5f6fec9-7e77-4adf-91db-478407c8c88b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:34.360041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5f6fec9-7e77-4adf-91db-478407c8c88b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:34.360788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5f6fec9-7e77-4adf-91db-478407c8c88b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:34.362020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5f6fec9-7e77-4adf-91db-478407c8c88b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:34.362885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5f6fec9-7e77-4adf-91db-478407c8c88b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:34.866957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e5f6fec9-7e77-4adf-91db-478407c8c88b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:34.884447 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e5f6fec9-7e77-4adf-91db-478407c8c88b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.550838 Aug 02 06:59:34.886532 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1568/3012] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:34 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:35.926482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5301bfe5-d6ce-430c-8b8a-feda47b3dc42 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:35.927662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5301bfe5-d6ce-430c-8b8a-feda47b3dc42 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:35.957083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5301bfe5-d6ce-430c-8b8a-feda47b3dc42 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:35.958971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5301bfe5-d6ce-430c-8b8a-feda47b3dc42 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:35.963897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5301bfe5-d6ce-430c-8b8a-feda47b3dc42 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:35.966057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5301bfe5-d6ce-430c-8b8a-feda47b3dc42 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:36.413411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5301bfe5-d6ce-430c-8b8a-feda47b3dc42 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:36.439693 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5301bfe5-d6ce-430c-8b8a-feda47b3dc42 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.520792 Aug 02 06:59:36.445022 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1445/3013] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:35 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:37.476846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-203fdf62-f88c-4343-b3d0-f5bc4c6d15e2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:37.477604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-203fdf62-f88c-4343-b3d0-f5bc4c6d15e2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:37.491260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-203fdf62-f88c-4343-b3d0-f5bc4c6d15e2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:37.493357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-203fdf62-f88c-4343-b3d0-f5bc4c6d15e2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:37.494442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-203fdf62-f88c-4343-b3d0-f5bc4c6d15e2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:37.495061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-203fdf62-f88c-4343-b3d0-f5bc4c6d15e2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:37.811352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-203fdf62-f88c-4343-b3d0-f5bc4c6d15e2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:37.822659 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-203fdf62-f88c-4343-b3d0-f5bc4c6d15e2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.350296 Aug 02 06:59:37.823262 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1569/3014] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:37 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:59:38.860321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aef54bb4-e8f2-4479-951a-ca208c921de4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:38.861477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aef54bb4-e8f2-4479-951a-ca208c921de4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:38.883066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aef54bb4-e8f2-4479-951a-ca208c921de4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:38.883520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aef54bb4-e8f2-4479-951a-ca208c921de4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:38.884633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aef54bb4-e8f2-4479-951a-ca208c921de4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:38.885123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aef54bb4-e8f2-4479-951a-ca208c921de4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:39.126772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aef54bb4-e8f2-4479-951a-ca208c921de4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:39.141380 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aef54bb4-e8f2-4479-951a-ca208c921de4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.288555 Aug 02 06:59:39.143941 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1446/3015] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:38 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:40.167333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f5342586-3204-4ad1-9a4f-b2f790e62995 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:40.169479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f5342586-3204-4ad1-9a4f-b2f790e62995 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:40.177536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5342586-3204-4ad1-9a4f-b2f790e62995 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:40.179350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5342586-3204-4ad1-9a4f-b2f790e62995 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:40.181473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5342586-3204-4ad1-9a4f-b2f790e62995 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:40.182828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5342586-3204-4ad1-9a4f-b2f790e62995 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:40.548545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f5342586-3204-4ad1-9a4f-b2f790e62995 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:40.557293 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f5342586-3204-4ad1-9a4f-b2f790e62995 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.395989 Aug 02 06:59:40.562933 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1570/3016] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:40 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:41.600522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-43d1b249-16fd-42bb-a4f0-e25166ccd8ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:41.601118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-43d1b249-16fd-42bb-a4f0-e25166ccd8ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:41.620333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43d1b249-16fd-42bb-a4f0-e25166ccd8ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:41.621417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43d1b249-16fd-42bb-a4f0-e25166ccd8ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:41.622490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43d1b249-16fd-42bb-a4f0-e25166ccd8ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:41.623371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43d1b249-16fd-42bb-a4f0-e25166ccd8ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:42.004999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-43d1b249-16fd-42bb-a4f0-e25166ccd8ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:42.025064 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-43d1b249-16fd-42bb-a4f0-e25166ccd8ca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.437885 Aug 02 06:59:42.026455 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1447/3017] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:41 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:43.063966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e032a0f5-3f19-442e-99f7-f4314da90bd7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:43.065349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e032a0f5-3f19-442e-99f7-f4314da90bd7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:43.080115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e032a0f5-3f19-442e-99f7-f4314da90bd7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:43.080573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e032a0f5-3f19-442e-99f7-f4314da90bd7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:43.081522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e032a0f5-3f19-442e-99f7-f4314da90bd7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:43.082233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e032a0f5-3f19-442e-99f7-f4314da90bd7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:43.166424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:43.746065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e032a0f5-3f19-442e-99f7-f4314da90bd7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:43.760401 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e032a0f5-3f19-442e-99f7-f4314da90bd7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1507 microversion: 2.1 time: 0.703352 Aug 02 06:59:43.765919 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1571/3018] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:43 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1507 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:44.812507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f56079b3-0962-4925-a0e2-13e2035b1f29 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:44.819381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f56079b3-0962-4925-a0e2-13e2035b1f29 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:44.874651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f56079b3-0962-4925-a0e2-13e2035b1f29 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:44.876795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f56079b3-0962-4925-a0e2-13e2035b1f29 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:44.882840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f56079b3-0962-4925-a0e2-13e2035b1f29 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:44.885657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f56079b3-0962-4925-a0e2-13e2035b1f29 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:44.893050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:45.167592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f78e6c5-187b-422d-9817-8e1b4d64af56 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:45.168535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5f78e6c5-187b-422d-9817-8e1b4d64af56 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:45.193715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:45.208928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f78e6c5-187b-422d-9817-8e1b4d64af56 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:45.210561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f78e6c5-187b-422d-9817-8e1b4d64af56 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:45.211903 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f78e6c5-187b-422d-9817-8e1b4d64af56 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:45.213563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f78e6c5-187b-422d-9817-8e1b4d64af56 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:45.670273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f56079b3-0962-4925-a0e2-13e2035b1f29 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:45.689014 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f56079b3-0962-4925-a0e2-13e2035b1f29 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1528 microversion: 2.1 time: 0.892834 Aug 02 06:59:45.703407 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1448/3019] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:44 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1528 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:45.887864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5f78e6c5-187b-422d-9817-8e1b4d64af56 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:45.908017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5f78e6c5-187b-422d-9817-8e1b4d64af56 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:45.917429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5f78e6c5-187b-422d-9817-8e1b4d64af56 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:45.919851 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5f78e6c5-187b-422d-9817-8e1b4d64af56 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 2945 microversion: 2.32 time: 0.760554 Aug 02 06:59:45.934686 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1572/3020] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 06:59:45 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 2945 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:59:45.953087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-525ad7a1-66ed-4fd9-93f1-f545f0c2e6bd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:45.953834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-525ad7a1-66ed-4fd9-93f1-f545f0c2e6bd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:45.969692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-525ad7a1-66ed-4fd9-93f1-f545f0c2e6bd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:45.970165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-525ad7a1-66ed-4fd9-93f1-f545f0c2e6bd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:45.972122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-525ad7a1-66ed-4fd9-93f1-f545f0c2e6bd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:45.972565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-525ad7a1-66ed-4fd9-93f1-f545f0c2e6bd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:46.294879 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-525ad7a1-66ed-4fd9-93f1-f545f0c2e6bd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.347802 Aug 02 06:59:46.296325 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1449/3021] 10.222.0.79 () {60 vars in 1316 bytes} [Tue Aug 2 06:59:45 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595/os-interface => generated 1830 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 06:59:46.547391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-9bd8f977-4d09-43d9-8937-b588b385c2a1 req-9366ca6b-23dc-40dd-a111-b1bb048d7f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b6671f-a2e2-46e6-ae8b-9785cf4d71b6", "name": "network-vif-plugged", "status": "completed", "tag": "568752e9-0de7-41e2-a754-c10d6f3b26fa"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:46.568617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9bd8f977-4d09-43d9-8937-b588b385c2a1 req-9366ca6b-23dc-40dd-a111-b1bb048d7f15 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:46.571010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9bd8f977-4d09-43d9-8937-b588b385c2a1 req-9366ca6b-23dc-40dd-a111-b1bb048d7f15 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:46.617433 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-9bd8f977-4d09-43d9-8937-b588b385c2a1 req-9366ca6b-23dc-40dd-a111-b1bb048d7f15 service nova] Creating event network-vif-plugged:568752e9-0de7-41e2-a754-c10d6f3b26fa for instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 on n-h1-851337-3 Aug 02 06:59:46.625023 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-9bd8f977-4d09-43d9-8937-b588b385c2a1 req-9366ca6b-23dc-40dd-a111-b1bb048d7f15 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082740 Aug 02 06:59:46.625680 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1573/3022] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 06:59:46.716664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e38b788a-fd03-4aac-9fe1-ffa648e5015e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:46.717382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e38b788a-fd03-4aac-9fe1-ffa648e5015e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:46.728461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38b788a-fd03-4aac-9fe1-ffa648e5015e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:46.731209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38b788a-fd03-4aac-9fe1-ffa648e5015e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:46.732267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38b788a-fd03-4aac-9fe1-ffa648e5015e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:46.737174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e38b788a-fd03-4aac-9fe1-ffa648e5015e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:47.051386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e38b788a-fd03-4aac-9fe1-ffa648e5015e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:47.061835 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e38b788a-fd03-4aac-9fe1-ffa648e5015e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1528 microversion: 2.1 time: 0.348858 Aug 02 06:59:47.062808 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1450/3023] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:46 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1528 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:47.076710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-629123861", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "eb1546f1-4115-4688-b575-a5c12539c202"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:47.148724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] validate_networks() for [('eb1546f1-4115-4688-b575-a5c12539c202', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 06:59:48.037554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 06:59:48.038150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 06:59:48.038988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 06:59:48.040473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 06:59:48.041105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 06:59:48.056303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:48.056927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:48.058299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:48.059080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:48.087371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bef85564-d517-4d9a-a199-77f654a0b6d3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:48.088141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bef85564-d517-4d9a-a199-77f654a0b6d3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:48.092983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Getting quotas for project 3eda709798e5417f9baf4f1c0e6e92f5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 06:59:48.100034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Getting quotas for user 51e3ce14884b48fcb6dff0ece226e40d and project 3eda709798e5417f9baf4f1c0e6e92f5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 06:59:48.101308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bef85564-d517-4d9a-a199-77f654a0b6d3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:48.102034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bef85564-d517-4d9a-a199-77f654a0b6d3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:48.104970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bef85564-d517-4d9a-a199-77f654a0b6d3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:48.107149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bef85564-d517-4d9a-a199-77f654a0b6d3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:48.115900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 06:59:48.118549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 06:59:48.195331 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f687e860-96f7-4e2a-bd71-e9f39eb0fd2c tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.322785 Aug 02 06:59:48.198327 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1574/3024] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 06:59:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 06:59:48.220105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2f8d4e7e-d02d-4631-819f-5a66ade072e0 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:48.221002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2f8d4e7e-d02d-4631-819f-5a66ade072e0 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:48.431800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2f8d4e7e-d02d-4631-819f-5a66ade072e0 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:48.440713 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2f8d4e7e-d02d-4631-819f-5a66ade072e0 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1216 microversion: 2.1 time: 0.233868 Aug 02 06:59:48.445779 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1575/3025] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:48 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1216 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:48.593518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bef85564-d517-4d9a-a199-77f654a0b6d3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:48.604977 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bef85564-d517-4d9a-a199-77f654a0b6d3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1528 microversion: 2.1 time: 0.522111 Aug 02 06:59:48.606088 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1451/3026] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:48 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1528 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:59:49.475503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8402686e-906d-46a2-8527-c726cda4ee39 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:49.476202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8402686e-906d-46a2-8527-c726cda4ee39 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:49.499365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8402686e-906d-46a2-8527-c726cda4ee39 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:49.499365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8402686e-906d-46a2-8527-c726cda4ee39 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:49.500141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8402686e-906d-46a2-8527-c726cda4ee39 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:49.500750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8402686e-906d-46a2-8527-c726cda4ee39 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:49.628134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8402686e-906d-46a2-8527-c726cda4ee39 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:49.631663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d9a83411-1d18-46c1-9c1f-c4606f09482d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:49.632310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d9a83411-1d18-46c1-9c1f-c4606f09482d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:49.647432 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8402686e-906d-46a2-8527-c726cda4ee39 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1268 microversion: 2.1 time: 0.178993 Aug 02 06:59:49.667240 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1576/3027] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:49 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1268 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:49.684323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9a83411-1d18-46c1-9c1f-c4606f09482d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:49.687132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9a83411-1d18-46c1-9c1f-c4606f09482d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:49.688368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9a83411-1d18-46c1-9c1f-c4606f09482d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:49.691360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9a83411-1d18-46c1-9c1f-c4606f09482d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:50.042755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d9a83411-1d18-46c1-9c1f-c4606f09482d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:50.058510 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d9a83411-1d18-46c1-9c1f-c4606f09482d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1528 microversion: 2.1 time: 0.431124 Aug 02 06:59:50.059135 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1452/3028] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:49 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1528 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:50.680988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3395d089-e186-4b9b-8ac9-c9d60221e5de tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:50.681664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3395d089-e186-4b9b-8ac9-c9d60221e5de tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:50.697461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3395d089-e186-4b9b-8ac9-c9d60221e5de tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:50.700278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3395d089-e186-4b9b-8ac9-c9d60221e5de tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:50.701158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3395d089-e186-4b9b-8ac9-c9d60221e5de tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:50.701589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3395d089-e186-4b9b-8ac9-c9d60221e5de tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:50.940085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3395d089-e186-4b9b-8ac9-c9d60221e5de tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:50.952288 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3395d089-e186-4b9b-8ac9-c9d60221e5de tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1274 microversion: 2.1 time: 0.278459 Aug 02 06:59:50.962061 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1577/3029] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:50 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1274 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:51.089442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c6232c9c-3474-455b-81a3-47057b41e675 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:51.092692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c6232c9c-3474-455b-81a3-47057b41e675 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:51.125804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6232c9c-3474-455b-81a3-47057b41e675 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:51.127926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6232c9c-3474-455b-81a3-47057b41e675 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:51.131279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6232c9c-3474-455b-81a3-47057b41e675 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:51.132532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6232c9c-3474-455b-81a3-47057b41e675 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:51.459417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c6232c9c-3474-455b-81a3-47057b41e675 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:51.485960 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c6232c9c-3474-455b-81a3-47057b41e675 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1523 microversion: 2.1 time: 0.402750 Aug 02 06:59:51.487129 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1453/3030] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:51 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1523 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:51.980795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-751b0dcb-d260-4372-b573-07492385821d tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:51.982495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-751b0dcb-d260-4372-b573-07492385821d tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:51.995895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-751b0dcb-d260-4372-b573-07492385821d tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:51.996715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-751b0dcb-d260-4372-b573-07492385821d tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:51.997695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-751b0dcb-d260-4372-b573-07492385821d tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:51.998367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-751b0dcb-d260-4372-b573-07492385821d tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:52.318724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-751b0dcb-d260-4372-b573-07492385821d tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:52.336123 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-751b0dcb-d260-4372-b573-07492385821d tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1274 microversion: 2.1 time: 0.355086 Aug 02 06:59:52.356319 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1578/3031] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:51 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1274 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:52.518145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-86870a64-55b3-42a0-a289-92e2d917a82f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:52.518841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-86870a64-55b3-42a0-a289-92e2d917a82f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:52.530771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86870a64-55b3-42a0-a289-92e2d917a82f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:52.530771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86870a64-55b3-42a0-a289-92e2d917a82f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:52.537087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86870a64-55b3-42a0-a289-92e2d917a82f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:52.537826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86870a64-55b3-42a0-a289-92e2d917a82f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:52.944140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-86870a64-55b3-42a0-a289-92e2d917a82f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:52.994642 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-86870a64-55b3-42a0-a289-92e2d917a82f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1523 microversion: 2.1 time: 0.486100 Aug 02 06:59:52.995608 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1454/3032] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:52 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1523 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:53.362015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-78253476-04b9-45d7-a4a8-508eb7bb9645 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:53.363349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-78253476-04b9-45d7-a4a8-508eb7bb9645 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:53.378062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78253476-04b9-45d7-a4a8-508eb7bb9645 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:53.379230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78253476-04b9-45d7-a4a8-508eb7bb9645 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:53.382176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78253476-04b9-45d7-a4a8-508eb7bb9645 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:53.384280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78253476-04b9-45d7-a4a8-508eb7bb9645 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:54.020888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6aaf6131-c616-4488-bec3-3a78e4d1df74 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:54.021442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6aaf6131-c616-4488-bec3-3a78e4d1df74 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:54.037023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6aaf6131-c616-4488-bec3-3a78e4d1df74 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:54.039211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6aaf6131-c616-4488-bec3-3a78e4d1df74 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:54.042337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6aaf6131-c616-4488-bec3-3a78e4d1df74 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:54.044407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6aaf6131-c616-4488-bec3-3a78e4d1df74 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:54.302225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-78253476-04b9-45d7-a4a8-508eb7bb9645 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:54.310990 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-78253476-04b9-45d7-a4a8-508eb7bb9645 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1316 microversion: 2.1 time: 0.953900 Aug 02 06:59:54.311603 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1579/3033] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:53 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1316 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:54.770044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6aaf6131-c616-4488-bec3-3a78e4d1df74 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:54.785776 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6aaf6131-c616-4488-bec3-3a78e4d1df74 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1523 microversion: 2.1 time: 0.768892 Aug 02 06:59:54.792518 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1455/3034] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:54 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1523 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 06:59:55.020155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-65fc78e0-dab2-4106-ab87-dc632c293629 req-43ee043e-9afe-4ba5-85dc-94cfede4e868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07d4653-3c3d-46bf-8fea-ccfa3a86fddb", "tag": "c2f7467f-288f-4f23-8841-8d007d5cbfab"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 06:59:55.059963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-65fc78e0-dab2-4106-ab87-dc632c293629 req-43ee043e-9afe-4ba5-85dc-94cfede4e868 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:55.063877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-65fc78e0-dab2-4106-ab87-dc632c293629 req-43ee043e-9afe-4ba5-85dc-94cfede4e868 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:55.108149 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-65fc78e0-dab2-4106-ab87-dc632c293629 req-43ee043e-9afe-4ba5-85dc-94cfede4e868 service nova] Creating event network-changed:c2f7467f-288f-4f23-8841-8d007d5cbfab for instance a07d4653-3c3d-46bf-8fea-ccfa3a86fddb on n-h2-851337-3 Aug 02 06:59:55.117428 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-65fc78e0-dab2-4106-ab87-dc632c293629 req-43ee043e-9afe-4ba5-85dc-94cfede4e868 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105774 Aug 02 06:59:55.122125 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1580/3035] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 06:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 06:59:55.343878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fbf8a92c-a0bd-42ac-9188-9c8e85214bae tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:55.350064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fbf8a92c-a0bd-42ac-9188-9c8e85214bae tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:55.370397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbf8a92c-a0bd-42ac-9188-9c8e85214bae tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:55.371164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbf8a92c-a0bd-42ac-9188-9c8e85214bae tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:55.379210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbf8a92c-a0bd-42ac-9188-9c8e85214bae tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:55.379938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbf8a92c-a0bd-42ac-9188-9c8e85214bae tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:55.810568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c002f1a-fda0-4715-8ab2-8f2b1d2661eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:55.813869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9c002f1a-fda0-4715-8ab2-8f2b1d2661eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:55.825735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c002f1a-fda0-4715-8ab2-8f2b1d2661eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:55.826377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c002f1a-fda0-4715-8ab2-8f2b1d2661eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:55.828066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c002f1a-fda0-4715-8ab2-8f2b1d2661eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:55.828640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c002f1a-fda0-4715-8ab2-8f2b1d2661eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:56.341853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9c002f1a-fda0-4715-8ab2-8f2b1d2661eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:56.344911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fbf8a92c-a0bd-42ac-9188-9c8e85214bae tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:56.353199 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fbf8a92c-a0bd-42ac-9188-9c8e85214bae tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1316 microversion: 2.1 time: 1.016777 Aug 02 06:59:56.353849 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1456/3036] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:55 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1316 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:56.354991 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9c002f1a-fda0-4715-8ab2-8f2b1d2661eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1523 microversion: 2.1 time: 0.548668 Aug 02 06:59:56.361302 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1581/3037] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:55 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1523 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:57.379935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f790bde-94ed-45a3-ab94-58611d2f4e34 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:57.381104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1f790bde-94ed-45a3-ab94-58611d2f4e34 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:57.388042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-17b28556-f2c6-4de8-b711-baa27fbd538f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:57.388883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-17b28556-f2c6-4de8-b711-baa27fbd538f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:57.417507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f790bde-94ed-45a3-ab94-58611d2f4e34 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:57.419777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=40 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:57.423204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17b28556-f2c6-4de8-b711-baa27fbd538f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:57.424247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f790bde-94ed-45a3-ab94-58611d2f4e34 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:57.430396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f790bde-94ed-45a3-ab94-58611d2f4e34 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:57.431188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f790bde-94ed-45a3-ab94-58611d2f4e34 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:57.453361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17b28556-f2c6-4de8-b711-baa27fbd538f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:57.455175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17b28556-f2c6-4de8-b711-baa27fbd538f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:57.466827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17b28556-f2c6-4de8-b711-baa27fbd538f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:58.068272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:58.439232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 06:59:58.634596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-17b28556-f2c6-4de8-b711-baa27fbd538f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:58.672188 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-17b28556-f2c6-4de8-b711-baa27fbd538f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1316 microversion: 2.1 time: 1.295804 Aug 02 06:59:58.677742 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1457/3038] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:57 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1316 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:58.752248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f790bde-94ed-45a3-ab94-58611d2f4e34 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 06:59:58.804386 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f790bde-94ed-45a3-ab94-58611d2f4e34 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1523 microversion: 2.1 time: 1.427690 Aug 02 06:59:58.806867 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1582/3039] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:57 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1523 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 06:59:59.697439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7905daac-0c34-4aae-ac3b-5a94c36e90ac tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:59.698581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7905daac-0c34-4aae-ac3b-5a94c36e90ac tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:59.715831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7905daac-0c34-4aae-ac3b-5a94c36e90ac tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:59.716362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7905daac-0c34-4aae-ac3b-5a94c36e90ac tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:59.717224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7905daac-0c34-4aae-ac3b-5a94c36e90ac tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:59.717727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7905daac-0c34-4aae-ac3b-5a94c36e90ac tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:59.855893 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-acbe3052-ec9d-404c-9518-4fbafa409bfc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 06:59:59.857368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-acbe3052-ec9d-404c-9518-4fbafa409bfc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 06:59:59.865870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-acbe3052-ec9d-404c-9518-4fbafa409bfc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:59.866499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-acbe3052-ec9d-404c-9518-4fbafa409bfc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 06:59:59.867379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-acbe3052-ec9d-404c-9518-4fbafa409bfc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 06:59:59.867939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-acbe3052-ec9d-404c-9518-4fbafa409bfc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:00.223565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7905daac-0c34-4aae-ac3b-5a94c36e90ac tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:00.249873 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7905daac-0c34-4aae-ac3b-5a94c36e90ac tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1316 microversion: 2.1 time: 0.556579 Aug 02 07:00:00.262201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-acbe3052-ec9d-404c-9518-4fbafa409bfc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:00.262201 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-acbe3052-ec9d-404c-9518-4fbafa409bfc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1523 microversion: 2.1 time: 0.424769 Aug 02 07:00:00.267538 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1458/3040] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:59 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1316 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:00.267830 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1583/3041] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 06:59:59 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:01.276143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9380ea8f-dec0-49b5-96bc-600ac025335f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:01.276844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9380ea8f-dec0-49b5-96bc-600ac025335f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:01.295143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9380ea8f-dec0-49b5-96bc-600ac025335f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:01.299483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9380ea8f-dec0-49b5-96bc-600ac025335f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:01.300674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9380ea8f-dec0-49b5-96bc-600ac025335f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:01.301210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9380ea8f-dec0-49b5-96bc-600ac025335f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:01.305191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5b55f33e-8b7f-44be-8f60-6b098b8727e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:01.306255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5b55f33e-8b7f-44be-8f60-6b098b8727e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:01.329749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b55f33e-8b7f-44be-8f60-6b098b8727e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:01.330634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b55f33e-8b7f-44be-8f60-6b098b8727e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:01.332235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b55f33e-8b7f-44be-8f60-6b098b8727e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:01.333969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b55f33e-8b7f-44be-8f60-6b098b8727e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:01.776705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9380ea8f-dec0-49b5-96bc-600ac025335f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:01.797742 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9380ea8f-dec0-49b5-96bc-600ac025335f tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1316 microversion: 2.1 time: 0.526512 Aug 02 07:00:01.834891 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1459/3042] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:01 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:01.939564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5b55f33e-8b7f-44be-8f60-6b098b8727e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:01.948789 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5b55f33e-8b7f-44be-8f60-6b098b8727e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1523 microversion: 2.1 time: 0.651279 Aug 02 07:00:01.955222 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1584/3043] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:01 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1523 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:02.848561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79003a8a-79cd-4fbc-b6dd-fb17bc2479fe tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:02.850117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79003a8a-79cd-4fbc-b6dd-fb17bc2479fe tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:02.872562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79003a8a-79cd-4fbc-b6dd-fb17bc2479fe tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:02.883782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79003a8a-79cd-4fbc-b6dd-fb17bc2479fe tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:02.883782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79003a8a-79cd-4fbc-b6dd-fb17bc2479fe tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:02.883782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79003a8a-79cd-4fbc-b6dd-fb17bc2479fe tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:02.994276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a69d9a5a-21b5-4719-beb5-12750d0f1a97 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:03.003245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a69d9a5a-21b5-4719-beb5-12750d0f1a97 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:03.027350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a69d9a5a-21b5-4719-beb5-12750d0f1a97 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:03.028252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a69d9a5a-21b5-4719-beb5-12750d0f1a97 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:03.029814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a69d9a5a-21b5-4719-beb5-12750d0f1a97 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:03.031109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a69d9a5a-21b5-4719-beb5-12750d0f1a97 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:03.225633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79003a8a-79cd-4fbc-b6dd-fb17bc2479fe tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:03.252498 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79003a8a-79cd-4fbc-b6dd-fb17bc2479fe tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1316 microversion: 2.1 time: 0.402941 Aug 02 07:00:03.259581 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1460/3044] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:02 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:03.413195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a69d9a5a-21b5-4719-beb5-12750d0f1a97 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:03.430515 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a69d9a5a-21b5-4719-beb5-12750d0f1a97 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1523 microversion: 2.1 time: 0.444782 Aug 02 07:00:03.452588 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1585/3045] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:02 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:03.816880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-88b50d61-56c3-47fd-8b39-f52f658dc424 req-a26fc16b-91ed-4eca-aacd-342c4df54547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07d4653-3c3d-46bf-8fea-ccfa3a86fddb", "name": "network-vif-plugged", "status": "completed", "tag": "c2f7467f-288f-4f23-8841-8d007d5cbfab"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:03.829326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-88b50d61-56c3-47fd-8b39-f52f658dc424 req-a26fc16b-91ed-4eca-aacd-342c4df54547 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:03.830109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-88b50d61-56c3-47fd-8b39-f52f658dc424 req-a26fc16b-91ed-4eca-aacd-342c4df54547 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:03.850456 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-88b50d61-56c3-47fd-8b39-f52f658dc424 req-a26fc16b-91ed-4eca-aacd-342c4df54547 service nova] Creating event network-vif-plugged:c2f7467f-288f-4f23-8841-8d007d5cbfab for instance a07d4653-3c3d-46bf-8fea-ccfa3a86fddb on n-h2-851337-3 Aug 02 07:00:03.858914 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-88b50d61-56c3-47fd-8b39-f52f658dc424 req-a26fc16b-91ed-4eca-aacd-342c4df54547 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045234 Aug 02 07:00:03.863275 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1461/3046] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:03.910883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b7542304-9a5f-4cc9-838a-8a04cd3350c8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:03.943112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b7542304-9a5f-4cc9-838a-8a04cd3350c8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:03.945363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b7542304-9a5f-4cc9-838a-8a04cd3350c8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Searching by: {'deleted': False, 'project_id': 'e81b19403fd5415cae54d275b4777755'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:00:03.985583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7542304-9a5f-4cc9-838a-8a04cd3350c8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:03.987391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7542304-9a5f-4cc9-838a-8a04cd3350c8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:03.993021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7542304-9a5f-4cc9-838a-8a04cd3350c8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:03.994014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7542304-9a5f-4cc9-838a-8a04cd3350c8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:04.119286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-b7542304-9a5f-4cc9-838a-8a04cd3350c8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:00:04.191487 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b7542304-9a5f-4cc9-838a-8a04cd3350c8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.295665 Aug 02 07:00:04.192456 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1586/3047] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Aug 2 07:00:03 2022] GET /compute/v2.1/servers => generated 339 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:04.221624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1c377f48-5168-4314-8973-fcfbaabea901 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:04.236449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1c377f48-5168-4314-8973-fcfbaabea901 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:04.237307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1c377f48-5168-4314-8973-fcfbaabea901 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Searching by: {'deleted': False, 'project_id': 'e81b19403fd5415cae54d275b4777755'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:00:04.250842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c377f48-5168-4314-8973-fcfbaabea901 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:04.254086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c377f48-5168-4314-8973-fcfbaabea901 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:04.255780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c377f48-5168-4314-8973-fcfbaabea901 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:04.260911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c377f48-5168-4314-8973-fcfbaabea901 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:04.277014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-764c6090-236e-4b27-acf0-135cb4dafe55 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:04.277737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-764c6090-236e-4b27-acf0-135cb4dafe55 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:04.288481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-764c6090-236e-4b27-acf0-135cb4dafe55 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:04.290214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-764c6090-236e-4b27-acf0-135cb4dafe55 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:04.291299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-764c6090-236e-4b27-acf0-135cb4dafe55 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:04.294931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-764c6090-236e-4b27-acf0-135cb4dafe55 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:04.321008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-1c377f48-5168-4314-8973-fcfbaabea901 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:00:04.399149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1c377f48-5168-4314-8973-fcfbaabea901 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:04.406209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c377f48-5168-4314-8973-fcfbaabea901 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:04.406909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c377f48-5168-4314-8973-fcfbaabea901 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:04.720180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-764c6090-236e-4b27-acf0-135cb4dafe55 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:04.725819 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1c377f48-5168-4314-8973-fcfbaabea901 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.511971 Aug 02 07:00:04.727393 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1462/3048] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 07:00:04 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:04.732526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-37785df4-6c28-49fa-86ca-52c4187e2923 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:04.734390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-37785df4-6c28-49fa-86ca-52c4187e2923 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:04.741377 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-764c6090-236e-4b27-acf0-135cb4dafe55 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1316 microversion: 2.1 time: 0.470176 Aug 02 07:00:04.742395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37785df4-6c28-49fa-86ca-52c4187e2923 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:04.743139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37785df4-6c28-49fa-86ca-52c4187e2923 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:04.744076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37785df4-6c28-49fa-86ca-52c4187e2923 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:04.744655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37785df4-6c28-49fa-86ca-52c4187e2923 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:04.751057 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1587/3049] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:04 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1316 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:04.757479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a44a1c8d-2dd2-49b5-be28-1afc617ba9c7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:04.779097 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a44a1c8d-2dd2-49b5-be28-1afc617ba9c7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026224 Aug 02 07:00:04.790999 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1588/3050] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 07:00:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:05.108771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-37785df4-6c28-49fa-86ca-52c4187e2923 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:05.115185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-93847d07-33ea-4c60-ac05-c3b3e0ef4fc8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:05.115908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-93847d07-33ea-4c60-ac05-c3b3e0ef4fc8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:05.118176 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-37785df4-6c28-49fa-86ca-52c4187e2923 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1523 microversion: 2.1 time: 0.389371 Aug 02 07:00:05.119213 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1463/3051] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:04 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:05.137674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93847d07-33ea-4c60-ac05-c3b3e0ef4fc8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:05.139289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93847d07-33ea-4c60-ac05-c3b3e0ef4fc8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:05.140551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93847d07-33ea-4c60-ac05-c3b3e0ef4fc8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:05.141185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93847d07-33ea-4c60-ac05-c3b3e0ef4fc8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:05.170518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-93847d07-33ea-4c60-ac05-c3b3e0ef4fc8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:00:05.264237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:05.383783 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-93847d07-33ea-4c60-ac05-c3b3e0ef4fc8 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 204 len: 0 microversion: 2.1 time: 0.272799 Aug 02 07:00:05.387754 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1589/3052] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:00:05 2022] DELETE /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:00:05.393083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-32e8d01c-c127-48d1-a03f-3567d59d7dc7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:05.394061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-32e8d01c-c127-48d1-a03f-3567d59d7dc7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:05.404903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32e8d01c-c127-48d1-a03f-3567d59d7dc7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:05.410401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32e8d01c-c127-48d1-a03f-3567d59d7dc7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:05.411450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32e8d01c-c127-48d1-a03f-3567d59d7dc7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:05.412211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32e8d01c-c127-48d1-a03f-3567d59d7dc7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:05.720863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-32e8d01c-c127-48d1-a03f-3567d59d7dc7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:05.738354 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-32e8d01c-c127-48d1-a03f-3567d59d7dc7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1712 microversion: 2.1 time: 0.349099 Aug 02 07:00:05.739108 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1464/3053] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:05 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1712 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:05.767941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-89c8d50e-f5fc-4401-b2b4-a0d1d37c19c8 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:05.768557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-89c8d50e-f5fc-4401-b2b4-a0d1d37c19c8 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:05.781540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89c8d50e-f5fc-4401-b2b4-a0d1d37c19c8 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:05.782036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89c8d50e-f5fc-4401-b2b4-a0d1d37c19c8 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:05.782901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89c8d50e-f5fc-4401-b2b4-a0d1d37c19c8 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:05.783336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89c8d50e-f5fc-4401-b2b4-a0d1d37c19c8 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:05.830485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-865933ac-f576-4a8c-88f3-9eb0a794bd3c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:05.833632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-865933ac-f576-4a8c-88f3-9eb0a794bd3c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:05.847700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-865933ac-f576-4a8c-88f3-9eb0a794bd3c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:05.848589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-865933ac-f576-4a8c-88f3-9eb0a794bd3c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:05.850608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-865933ac-f576-4a8c-88f3-9eb0a794bd3c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:05.851319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-865933ac-f576-4a8c-88f3-9eb0a794bd3c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:05.858135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:06.475505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-89c8d50e-f5fc-4401-b2b4-a0d1d37c19c8 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:06.494925 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-89c8d50e-f5fc-4401-b2b4-a0d1d37c19c8 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1505 microversion: 2.1 time: 0.731198 Aug 02 07:00:06.506948 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1590/3054] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:05 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1505 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:06.530284 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-865933ac-f576-4a8c-88f3-9eb0a794bd3c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1811 microversion: 2.1 time: 0.715144 Aug 02 07:00:06.535411 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1465/3055] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:05 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1811 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:06.542812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aa9a6e30-b91b-4af3-afc6-2da6d7ec5505 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:06.543641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aa9a6e30-b91b-4af3-afc6-2da6d7ec5505 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:06.552539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c127fa30-83cf-4ee6-ac2e-c4bba3dd0705 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:06.553581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c127fa30-83cf-4ee6-ac2e-c4bba3dd0705 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:06.559204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa9a6e30-b91b-4af3-afc6-2da6d7ec5505 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:06.566837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa9a6e30-b91b-4af3-afc6-2da6d7ec5505 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:06.568292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa9a6e30-b91b-4af3-afc6-2da6d7ec5505 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:06.569084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa9a6e30-b91b-4af3-afc6-2da6d7ec5505 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:06.583175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c127fa30-83cf-4ee6-ac2e-c4bba3dd0705 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:06.584323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c127fa30-83cf-4ee6-ac2e-c4bba3dd0705 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:06.587160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c127fa30-83cf-4ee6-ac2e-c4bba3dd0705 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:06.590134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c127fa30-83cf-4ee6-ac2e-c4bba3dd0705 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:06.721583 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c127fa30-83cf-4ee6-ac2e-c4bba3dd0705 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb/ips" status: 200 len: 109 microversion: 2.1 time: 0.184554 Aug 02 07:00:06.729930 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1466/3056] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 07:00:06 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb/ips => generated 109 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:06.735898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a5d83da8-b9d5-43a5-9f7b-90c5acff24f5 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:06.741288 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:00:06.741288 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 07:00:06.743546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5d83da8-b9d5-43a5-9f7b-90c5acff24f5 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:06.744233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5d83da8-b9d5-43a5-9f7b-90c5acff24f5 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:06.746237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5d83da8-b9d5-43a5-9f7b-90c5acff24f5 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:06.747402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5d83da8-b9d5-43a5-9f7b-90c5acff24f5 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:06.831504 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a5d83da8-b9d5-43a5-9f7b-90c5acff24f5 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.106481 Aug 02 07:00:06.834627 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1467/3057] 10.222.0.79 () {58 vars in 1176 bytes} [Tue Aug 2 07:00:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:06.862497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1a3c2247-412d-4978-b147-f24c6ec031ff tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:06.863264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1a3c2247-412d-4978-b147-f24c6ec031ff tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:06.880102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1a3c2247-412d-4978-b147-f24c6ec031ff tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:06.881489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1a3c2247-412d-4978-b147-f24c6ec031ff tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:06.888215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1a3c2247-412d-4978-b147-f24c6ec031ff tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:06.889497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1a3c2247-412d-4978-b147-f24c6ec031ff tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:06.945639 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1a3c2247-412d-4978-b147-f24c6ec031ff tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb/ips" status: 200 len: 109 microversion: 2.1 time: 0.107198 Aug 02 07:00:06.957989 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1468/3058] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 07:00:06 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb/ips => generated 109 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:06.966549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3a55c643-fdf8-4c98-a32f-0c542e70af9c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:06.968623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3a55c643-fdf8-4c98-a32f-0c542e70af9c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:06.980330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a55c643-fdf8-4c98-a32f-0c542e70af9c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:06.981504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a55c643-fdf8-4c98-a32f-0c542e70af9c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:06.982852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a55c643-fdf8-4c98-a32f-0c542e70af9c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:06.983811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a55c643-fdf8-4c98-a32f-0c542e70af9c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:07.377070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3a55c643-fdf8-4c98-a32f-0c542e70af9c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:07.399250 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3a55c643-fdf8-4c98-a32f-0c542e70af9c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1712 microversion: 2.1 time: 0.439694 Aug 02 07:00:07.410320 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1469/3059] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:06 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1712 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:07.432557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-aa9a6e30-b91b-4af3-afc6-2da6d7ec5505 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:07.441231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-910dd564-a73c-43aa-b90f-85e5bd92a1ef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:07.446653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-910dd564-a73c-43aa-b90f-85e5bd92a1ef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:07.465497 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aa9a6e30-b91b-4af3-afc6-2da6d7ec5505 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1523 microversion: 2.1 time: 0.956707 Aug 02 07:00:07.466379 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1591/3060] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:06 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1523 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:07.468762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-910dd564-a73c-43aa-b90f-85e5bd92a1ef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:07.473849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-910dd564-a73c-43aa-b90f-85e5bd92a1ef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:07.482317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-910dd564-a73c-43aa-b90f-85e5bd92a1ef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:07.487020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-910dd564-a73c-43aa-b90f-85e5bd92a1ef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:07.576070 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-910dd564-a73c-43aa-b90f-85e5bd92a1ef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb/ips/tempest-ServerAddressesTestJSON-1172447183-network" status: 200 len: 94 microversion: 2.1 time: 0.164507 Aug 02 07:00:07.577568 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1470/3061] 10.222.0.79 () {58 vars in 1401 bytes} [Tue Aug 2 07:00:07 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb/ips/tempest-ServerAddressesTestJSON-1172447183-network => generated 94 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:00:07.593543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1622f45f-f1c4-4585-8f74-2d23ce57e3da tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:07.594200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1622f45f-f1c4-4585-8f74-2d23ce57e3da tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:07.605621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1622f45f-f1c4-4585-8f74-2d23ce57e3da tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:07.606111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1622f45f-f1c4-4585-8f74-2d23ce57e3da tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:07.610726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1622f45f-f1c4-4585-8f74-2d23ce57e3da tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:07.611176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1622f45f-f1c4-4585-8f74-2d23ce57e3da tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:07.694065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1622f45f-f1c4-4585-8f74-2d23ce57e3da tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:00:07.893032 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1622f45f-f1c4-4585-8f74-2d23ce57e3da tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 204 len: 0 microversion: 2.1 time: 0.302792 Aug 02 07:00:07.894849 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1592/3062] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:00:07 2022] DELETE /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:00:07.915174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-512f63d7-8f39-48f9-9b13-763de58a402b tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:07.920335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-512f63d7-8f39-48f9-9b13-763de58a402b tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:07.971031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-512f63d7-8f39-48f9-9b13-763de58a402b tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:07.972436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-512f63d7-8f39-48f9-9b13-763de58a402b tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:07.975044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-512f63d7-8f39-48f9-9b13-763de58a402b tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:07.975510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-512f63d7-8f39-48f9-9b13-763de58a402b tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:08.306759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-512f63d7-8f39-48f9-9b13-763de58a402b tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:08.319474 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-512f63d7-8f39-48f9-9b13-763de58a402b tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1511 microversion: 2.1 time: 0.419910 Aug 02 07:00:08.335371 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1471/3063] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:07 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1511 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:08.460389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b00c032-f6cf-48e6-a271-c7c00b1a7f25 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:08.461530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4b00c032-f6cf-48e6-a271-c7c00b1a7f25 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:08.488193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b00c032-f6cf-48e6-a271-c7c00b1a7f25 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:08.489200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b00c032-f6cf-48e6-a271-c7c00b1a7f25 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:08.495982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b00c032-f6cf-48e6-a271-c7c00b1a7f25 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:08.496731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b00c032-f6cf-48e6-a271-c7c00b1a7f25 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:08.500461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-63e5e600-6e4a-42d7-b559-e845ba990124 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:08.501099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-63e5e600-6e4a-42d7-b559-e845ba990124 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:08.514056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63e5e600-6e4a-42d7-b559-e845ba990124 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:08.514510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63e5e600-6e4a-42d7-b559-e845ba990124 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:08.515398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63e5e600-6e4a-42d7-b559-e845ba990124 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:08.515835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63e5e600-6e4a-42d7-b559-e845ba990124 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:08.923017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4b00c032-f6cf-48e6-a271-c7c00b1a7f25 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:08.932592 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4b00c032-f6cf-48e6-a271-c7c00b1a7f25 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1712 microversion: 2.1 time: 0.477184 Aug 02 07:00:08.938775 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1593/3064] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:08 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1712 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:09.018974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-63e5e600-6e4a-42d7-b559-e845ba990124 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:09.032231 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-63e5e600-6e4a-42d7-b559-e845ba990124 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1523 microversion: 2.1 time: 0.536390 Aug 02 07:00:09.033669 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1472/3065] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:08 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1523 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:09.343643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-053bec3f-9ab4-4ade-9985-4d5a8376d7bd tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:09.344464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-053bec3f-9ab4-4ade-9985-4d5a8376d7bd tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:09.357152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-053bec3f-9ab4-4ade-9985-4d5a8376d7bd tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:09.357685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-053bec3f-9ab4-4ade-9985-4d5a8376d7bd tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:09.359011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-053bec3f-9ab4-4ade-9985-4d5a8376d7bd tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:09.359011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-053bec3f-9ab4-4ade-9985-4d5a8376d7bd tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:09.877616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d233fa6e-f757-4877-bcc5-8090b8de421c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e83df105-3b87-4e8b-aad1-c461118d94e2", "device": "/dev/xvdb"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:09.882934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d233fa6e-f757-4877-bcc5-8090b8de421c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:09.921190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d233fa6e-f757-4877-bcc5-8090b8de421c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:09.921662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d233fa6e-f757-4877-bcc5-8090b8de421c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:09.922641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d233fa6e-f757-4877-bcc5-8090b8de421c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:09.923082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d233fa6e-f757-4877-bcc5-8090b8de421c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:10.541569 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d233fa6e-f757-4877-bcc5-8090b8de421c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "POST /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.669133 Aug 02 07:00:10.542688 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1473/3066] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:00:09 2022] POST /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments => generated 194 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:00:10.572589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dce992b7-516f-42e9-9e9f-856366011be7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:10.575488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dce992b7-516f-42e9-9e9f-856366011be7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:10.598363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dce992b7-516f-42e9-9e9f-856366011be7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:10.603570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dce992b7-516f-42e9-9e9f-856366011be7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:10.608218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dce992b7-516f-42e9-9e9f-856366011be7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:10.611112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dce992b7-516f-42e9-9e9f-856366011be7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:10.649875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-053bec3f-9ab4-4ade-9985-4d5a8376d7bd tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:10.662688 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-053bec3f-9ab4-4ade-9985-4d5a8376d7bd tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1511 microversion: 2.1 time: 1.325680 Aug 02 07:00:10.666855 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1594/3067] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:09 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1511 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:10.671875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ed5c87a-aa9c-42fb-91d7-36454194eb7f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:10.672497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9ed5c87a-aa9c-42fb-91d7-36454194eb7f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:10.712073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ed5c87a-aa9c-42fb-91d7-36454194eb7f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:10.720799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ed5c87a-aa9c-42fb-91d7-36454194eb7f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:10.723135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ed5c87a-aa9c-42fb-91d7-36454194eb7f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:10.727160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ed5c87a-aa9c-42fb-91d7-36454194eb7f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:10.765486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dce992b7-516f-42e9-9e9f-856366011be7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:10.768858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dce992b7-516f-42e9-9e9f-856366011be7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:10.769498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-dce992b7-516f-42e9-9e9f-856366011be7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lazy-loading 'fault' on Instance uuid b14c587b-3ed6-447f-8140-e5280370d4bc {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:00:11.684431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dce992b7-516f-42e9-9e9f-856366011be7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a1d6c7bc62a4ebaaff257c9ba2b220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81b19403fd5415cae54d275b4777755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:11.694010 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dce992b7-516f-42e9-9e9f-856366011be7 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 200 len: 1367 microversion: 2.1 time: 1.149692 Aug 02 07:00:11.698818 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1474/3068] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:10 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 1367 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:11.713856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-50b43c93-4f2c-4e4d-b757-401304c47926 req-cfb0e275-d5ee-463d-b736-aa55ef46b9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b14c587b-3ed6-447f-8140-e5280370d4bc", "name": "network-vif-deleted", "tag": "702fb797-be75-460e-8c23-fdab5d30fe86"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:11.740027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-50b43c93-4f2c-4e4d-b757-401304c47926 req-cfb0e275-d5ee-463d-b736-aa55ef46b9b8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:11.744349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-50b43c93-4f2c-4e4d-b757-401304c47926 req-cfb0e275-d5ee-463d-b736-aa55ef46b9b8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:11.787331 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-50b43c93-4f2c-4e4d-b757-401304c47926 req-cfb0e275-d5ee-463d-b736-aa55ef46b9b8 service nova] Creating event network-vif-deleted:702fb797-be75-460e-8c23-fdab5d30fe86 for instance b14c587b-3ed6-447f-8140-e5280370d4bc on n-h1-851337-3 Aug 02 07:00:11.806824 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-50b43c93-4f2c-4e4d-b757-401304c47926 req-cfb0e275-d5ee-463d-b736-aa55ef46b9b8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103751 Aug 02 07:00:11.807987 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1475/3069] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:11.819859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5bfecf52-4c58-43c1-be41-012ba2961df5 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:11.824466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5bfecf52-4c58-43c1-be41-012ba2961df5 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:11.855372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5bfecf52-4c58-43c1-be41-012ba2961df5 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:11.856923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5bfecf52-4c58-43c1-be41-012ba2961df5 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:11.862340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5bfecf52-4c58-43c1-be41-012ba2961df5 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:11.863049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5bfecf52-4c58-43c1-be41-012ba2961df5 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:12.428706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9ed5c87a-aa9c-42fb-91d7-36454194eb7f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:12.437973 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9ed5c87a-aa9c-42fb-91d7-36454194eb7f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1523 microversion: 2.1 time: 1.769867 Aug 02 07:00:12.458408 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1595/3070] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:10 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1523 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:12.723583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a9954047-a1ee-4b57-a497-564373782c5c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:12.724552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a9954047-a1ee-4b57-a497-564373782c5c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] [instance: b14c587b-3ed6-447f-8140-e5280370d4bc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:12.741959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9954047-a1ee-4b57-a497-564373782c5c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:12.743174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9954047-a1ee-4b57-a497-564373782c5c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:12.745480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9954047-a1ee-4b57-a497-564373782c5c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:12.747282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9954047-a1ee-4b57-a497-564373782c5c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:12.776615 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-a9954047-a1ee-4b57-a497-564373782c5c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] HTTP exception thrown: Instance b14c587b-3ed6-447f-8140-e5280370d4bc could not be found. Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a9954047-a1ee-4b57-a497-564373782c5c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Request method failure captured: Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc HTTP/1.1 Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mr_B2Fe4XnTwe5udTo16-ox7plkajfyc4tFeLvzZMBUyRjk9C6oB4SMVSRdQPLpBv2ZtWtHu3fA5IF71hH59MyeQ5ObKaHI1nDTD_Nd3jPF146Tbl5-whJGqwuX_1OiiYHN-HjiwIggcQ0eSeM2OVYDLnTuIw-LQQ_FfeuEFZ_5Vxo Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: e81b19403fd5415cae54d275b4777755 Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestManualDisk-1290380173 Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e81b19403fd5415cae54d275b4777755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e81b19403fd5415cae54d275b4777755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e81b19403fd5415cae54d275b4777755"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e81b19403fd5415cae54d275b4777755"}]}] Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestManualDisk-1290380173 Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: e81b19403fd5415cae54d275b4777755 Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestManualDisk-1290380173 Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestManualDisk-1290380173-project Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3a1d6c7bc62a4ebaaff257c9ba2b220c Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestManualDisk-1290380173-project Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance b14c587b-3ed6-447f-8140-e5280370d4bc could not be found. Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'b14c587b-3ed6-447f-8140-e5280370d4bc'} Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b14c587b-3ed6-447f-8140-e5280370d4bc could not be found. Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b14c587b-3ed6-447f-8140-e5280370d4bc could not be found. Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:00:12.792646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:12.798161 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:00:12.798161 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:00:12.798161 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:00:12.798161 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:00:12.798161 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:00:12.798161 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b14c587b-3ed6-447f-8140-e5280370d4bc could not be found. Aug 02 07:00:12.798161 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:12.800293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a9954047-a1ee-4b57-a497-564373782c5c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Returning 404 to user: Instance b14c587b-3ed6-447f-8140-e5280370d4bc could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:00:12.805522 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a9954047-a1ee-4b57-a497-564373782c5c tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc" status: 404 len: 111 microversion: 2.1 time: 0.085143 Aug 02 07:00:12.806697 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1596/3071] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:12 2022] GET /compute/v2.1/servers/b14c587b-3ed6-447f-8140-e5280370d4bc => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:00:12.823726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a6afa694-15bd-4c59-bb13-fdce20e494e2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] Calling method '.version_select at 0x7f928c33ad30>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:12.909045 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a6afa694-15bd-4c59-bb13-fdce20e494e2 tempest-ServersTestManualDisk-1290380173 tempest-ServersTestManualDisk-1290380173-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554754508" status: 202 len: 0 microversion: 2.1 time: 0.097064 Aug 02 07:00:12.918217 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1597/3072] 10.222.0.79 () {58 vars in 1221 bytes} [Tue Aug 2 07:00:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554754508 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:00:12.935802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5bfecf52-4c58-43c1-be41-012ba2961df5 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:12.972880 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5bfecf52-4c58-43c1-be41-012ba2961df5 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1511 microversion: 2.1 time: 1.163570 Aug 02 07:00:12.977108 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1476/3073] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:11 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1511 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:13.341317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-1c6243cd-dc4d-4fdb-b85a-4d9e41190a41 req-1906cfa0-2274-4d40-9dce-39d4235d6a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07d4653-3c3d-46bf-8fea-ccfa3a86fddb", "name": "network-vif-deleted", "tag": "c2f7467f-288f-4f23-8841-8d007d5cbfab"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:13.384201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-1c6243cd-dc4d-4fdb-b85a-4d9e41190a41 req-1906cfa0-2274-4d40-9dce-39d4235d6a00 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:13.385784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-1c6243cd-dc4d-4fdb-b85a-4d9e41190a41 req-1906cfa0-2274-4d40-9dce-39d4235d6a00 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:13.415392 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-1c6243cd-dc4d-4fdb-b85a-4d9e41190a41 req-1906cfa0-2274-4d40-9dce-39d4235d6a00 service nova] Creating event network-vif-deleted:c2f7467f-288f-4f23-8841-8d007d5cbfab for instance a07d4653-3c3d-46bf-8fea-ccfa3a86fddb on n-h2-851337-3 Aug 02 07:00:13.432959 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-1c6243cd-dc4d-4fdb-b85a-4d9e41190a41 req-1906cfa0-2274-4d40-9dce-39d4235d6a00 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099986 Aug 02 07:00:13.438627 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1598/3074] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:13.459609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7b7c653f-7344-4650-9b34-5625428cf419 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:13.460217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7b7c653f-7344-4650-9b34-5625428cf419 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:13.476742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b7c653f-7344-4650-9b34-5625428cf419 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:13.480408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b7c653f-7344-4650-9b34-5625428cf419 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:13.485742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b7c653f-7344-4650-9b34-5625428cf419 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:13.486441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b7c653f-7344-4650-9b34-5625428cf419 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:13.998212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-756aaae8-1bfa-4147-b716-52bec8205cef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:13.998923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-756aaae8-1bfa-4147-b716-52bec8205cef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:14.011554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-756aaae8-1bfa-4147-b716-52bec8205cef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:14.011999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-756aaae8-1bfa-4147-b716-52bec8205cef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:14.012812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-756aaae8-1bfa-4147-b716-52bec8205cef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:14.013247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-756aaae8-1bfa-4147-b716-52bec8205cef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:14.093151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:14.150023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-756aaae8-1bfa-4147-b716-52bec8205cef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:14.150465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-756aaae8-1bfa-4147-b716-52bec8205cef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:14.153435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-756aaae8-1bfa-4147-b716-52bec8205cef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lazy-loading 'fault' on Instance uuid a07d4653-3c3d-46bf-8fea-ccfa3a86fddb {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:00:14.275080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-756aaae8-1bfa-4147-b716-52bec8205cef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e3ce14884b48fcb6dff0ece226e40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eda709798e5417f9baf4f1c0e6e92f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:14.283847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7b7c653f-7344-4650-9b34-5625428cf419 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:14.286972 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-756aaae8-1bfa-4147-b716-52bec8205cef tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 200 len: 1306 microversion: 2.1 time: 0.293991 Aug 02 07:00:14.287661 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1599/3075] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:13 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 1306 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:14.299640 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7b7c653f-7344-4650-9b34-5625428cf419 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1523 microversion: 2.1 time: 0.844213 Aug 02 07:00:14.300387 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1477/3076] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:13 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1523 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:15.309570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b934128-9090-4213-b837-3b5575a47de0 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:15.310389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b934128-9090-4213-b837-3b5575a47de0 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] [instance: a07d4653-3c3d-46bf-8fea-ccfa3a86fddb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:15.321357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c088cbdc-885a-4bde-905a-fe7d60c874eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:15.322851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:15.323284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c088cbdc-885a-4bde-905a-fe7d60c874eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:15.327318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b934128-9090-4213-b837-3b5575a47de0 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:15.328651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b934128-9090-4213-b837-3b5575a47de0 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:15.329658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b934128-9090-4213-b837-3b5575a47de0 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:15.330181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b934128-9090-4213-b837-3b5575a47de0 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:15.333037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:15.351115 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-7b934128-9090-4213-b837-3b5575a47de0 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] HTTP exception thrown: Instance a07d4653-3c3d-46bf-8fea-ccfa3a86fddb could not be found. Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b934128-9090-4213-b837-3b5575a47de0 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Request method failure captured: Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb HTTP/1.1 Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mti08sz1TIxPjorGVwMkjs6h-7vjej3GQ6lMRwrw1ppZyrobjuLWbIPpZbAiJ34x2n9bxg_MEfNmA9-EKcs6sr83Us1h2RblEbwbAJue7XJBbIwudfHCEUuWXpkZqT8qcMn6VUNEdoG0IzBgn6Plxsac4sXev8BvadqJZ9HL_fa674 Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 3eda709798e5417f9baf4f1c0e6e92f5 Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerAddressesTestJSON-769045695 Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3eda709798e5417f9baf4f1c0e6e92f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3eda709798e5417f9baf4f1c0e6e92f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3eda709798e5417f9baf4f1c0e6e92f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3eda709798e5417f9baf4f1c0e6e92f5"}]}] Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerAddressesTestJSON-769045695 Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 3eda709798e5417f9baf4f1c0e6e92f5 Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerAddressesTestJSON-769045695 Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerAddressesTestJSON-769045695-project Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 51e3ce14884b48fcb6dff0ece226e40d Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerAddressesTestJSON-769045695-project Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance a07d4653-3c3d-46bf-8fea-ccfa3a86fddb could not be found. Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'a07d4653-3c3d-46bf-8fea-ccfa3a86fddb'} Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a07d4653-3c3d-46bf-8fea-ccfa3a86fddb could not be found. Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a07d4653-3c3d-46bf-8fea-ccfa3a86fddb could not be found. Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:00:15.352886 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:15.357434 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:00:15.357434 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:00:15.357434 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:00:15.357434 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:00:15.357434 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:00:15.357434 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a07d4653-3c3d-46bf-8fea-ccfa3a86fddb could not be found. Aug 02 07:00:15.357434 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:15.357434 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b934128-9090-4213-b837-3b5575a47de0 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] Returning 404 to user: Instance a07d4653-3c3d-46bf-8fea-ccfa3a86fddb could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:00:15.357434 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b934128-9090-4213-b837-3b5575a47de0 tempest-ServerAddressesTestJSON-769045695 tempest-ServerAddressesTestJSON-769045695-project] 10.222.0.79 "GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb" status: 404 len: 111 microversion: 2.1 time: 0.049944 Aug 02 07:00:15.358803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c088cbdc-885a-4bde-905a-fe7d60c874eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:15.358803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c088cbdc-885a-4bde-905a-fe7d60c874eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:15.359115 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1600/3077] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:15 2022] GET /compute/v2.1/servers/a07d4653-3c3d-46bf-8fea-ccfa3a86fddb => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:00:15.359264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c088cbdc-885a-4bde-905a-fe7d60c874eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:15.359699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c088cbdc-885a-4bde-905a-fe7d60c874eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:15.954748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c088cbdc-885a-4bde-905a-fe7d60c874eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:15.968609 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c088cbdc-885a-4bde-905a-fe7d60c874eb tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1505 microversion: 2.1 time: 0.651035 Aug 02 07:00:15.972482 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1478/3078] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:15 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1505 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:16.427358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-190c7e0e-9f50-459a-aaf8-3ec5e58d03f7 req-80372d64-b89f-4387-ba9e-58f0e73f48a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b6671f-a2e2-46e6-ae8b-9785cf4d71b6", "name": "network-vif-unplugged", "status": "completed", "tag": "568752e9-0de7-41e2-a754-c10d6f3b26fa"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:16.461255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-190c7e0e-9f50-459a-aaf8-3ec5e58d03f7 req-80372d64-b89f-4387-ba9e-58f0e73f48a5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:16.474723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-190c7e0e-9f50-459a-aaf8-3ec5e58d03f7 req-80372d64-b89f-4387-ba9e-58f0e73f48a5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:16.491279 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-190c7e0e-9f50-459a-aaf8-3ec5e58d03f7 req-80372d64-b89f-4387-ba9e-58f0e73f48a5 service nova] Creating event network-vif-unplugged:568752e9-0de7-41e2-a754-c10d6f3b26fa for instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 on n-h1-851337-3 Aug 02 07:00:16.513571 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-190c7e0e-9f50-459a-aaf8-3ec5e58d03f7 req-80372d64-b89f-4387-ba9e-58f0e73f48a5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086941 Aug 02 07:00:16.526285 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1601/3079] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:16.994694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-30aa4a17-b72c-479c-ba72-aa55cbd62fd5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:16.996009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-30aa4a17-b72c-479c-ba72-aa55cbd62fd5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:17.003820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:17.006263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30aa4a17-b72c-479c-ba72-aa55cbd62fd5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:17.015604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30aa4a17-b72c-479c-ba72-aa55cbd62fd5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:17.016807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30aa4a17-b72c-479c-ba72-aa55cbd62fd5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:17.017419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30aa4a17-b72c-479c-ba72-aa55cbd62fd5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:17.373015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-30aa4a17-b72c-479c-ba72-aa55cbd62fd5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:17.388004 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-30aa4a17-b72c-479c-ba72-aa55cbd62fd5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1505 microversion: 2.1 time: 0.397326 Aug 02 07:00:17.388667 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1479/3080] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:16 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:18.416053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-64ff31c3-f076-4a18-9459-d15e9a380d19 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:18.417522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-64ff31c3-f076-4a18-9459-d15e9a380d19 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:18.441246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64ff31c3-f076-4a18-9459-d15e9a380d19 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:18.443897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64ff31c3-f076-4a18-9459-d15e9a380d19 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:18.447431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64ff31c3-f076-4a18-9459-d15e9a380d19 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:18.448617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64ff31c3-f076-4a18-9459-d15e9a380d19 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:19.241194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-64ff31c3-f076-4a18-9459-d15e9a380d19 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:19.249876 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-64ff31c3-f076-4a18-9459-d15e9a380d19 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 200 len: 1508 microversion: 2.1 time: 0.843178 Aug 02 07:00:19.259228 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1602/3081] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:18 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 1508 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:19.273845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:19.274444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:19.283579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:19.284041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:19.286189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:19.286641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:19.322248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:00:19.336069 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.compute.api [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Working on deleting snapshot 82142db8-cd91-4b2f-b781-e2fad95f32a9 from shelved instance... Aug 02 07:00:21.094801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Doing local delete in cell c3b7f982-e927-4a3f-b699-817c726d55c4(cell1) {{(pid=126119) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 02 07:00:21.099048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:21.101072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:21.105810 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.compute.api [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 02 07:00:21.114411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] deallocate_for_instance() {{(pid=126119) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 02 07:00:22.301219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Updating instance_info_cache with network_info: [] {{(pid=126119) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 02 07:00:22.303958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:22.329525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6ef64941-0951-4368-bbf6-f636bee12db8 req-4198d7c3-3898-4d1f-bbd3-1ff61c48b015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b6671f-a2e2-46e6-ae8b-9785cf4d71b6", "name": "network-vif-deleted", "tag": "568752e9-0de7-41e2-a754-c10d6f3b26fa"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:22.371949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6ef64941-0951-4368-bbf6-f636bee12db8 req-4198d7c3-3898-4d1f-bbd3-1ff61c48b015 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:22.372894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6ef64941-0951-4368-bbf6-f636bee12db8 req-4198d7c3-3898-4d1f-bbd3-1ff61c48b015 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:22.411281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.compute.server_external_events [req-6ef64941-0951-4368-bbf6-f636bee12db8 req-4198d7c3-3898-4d1f-bbd3-1ff61c48b015 service nova] Unable to find a host for instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6. Dropping event network-vif-deleted {{(pid=126120) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 02 07:00:22.413225 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6ef64941-0951-4368-bbf6-f636bee12db8 req-4198d7c3-3898-4d1f-bbd3-1ff61c48b015 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.107312 Aug 02 07:00:22.420831 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1603/3082] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 114 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 02 07:00:23.377877 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-65110cd4-5b25-486d-90f2-84ad2c8867a8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "DELETE /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 204 len: 0 microversion: 2.1 time: 4.108434 Aug 02 07:00:23.381990 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1480/3083] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:00:19 2022] DELETE /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 0 bytes in 4110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:00:23.388052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c065d40-7283-4707-864d-1cc675340334 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:23.389416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9c065d40-7283-4707-864d-1cc675340334 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:23.397260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c065d40-7283-4707-864d-1cc675340334 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:23.397932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c065d40-7283-4707-864d-1cc675340334 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:23.398737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c065d40-7283-4707-864d-1cc675340334 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:23.399177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c065d40-7283-4707-864d-1cc675340334 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:23.414157 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-9c065d40-7283-4707-864d-1cc675340334 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c065d40-7283-4707-864d-1cc675340334 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 HTTP/1.1 Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '85b6671f-a2e2-46e6-ae8b-9785cf4d71b6'} Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:00:23.416025 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:23.420767 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:00:23.420767 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:00:23.420767 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:00:23.420767 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:00:23.420767 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:00:23.420767 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:00:23.420767 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:00:23.420767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c065d40-7283-4707-864d-1cc675340334 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:00:23.420767 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9c065d40-7283-4707-864d-1cc675340334 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 404 len: 111 microversion: 2.1 time: 0.034120 Aug 02 07:00:23.421662 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1604/3084] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:23 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:00:23.714357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-464426900", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "3904ca9d-0f3a-42df-acde-f1e02b7b9720"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:23.792000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] validate_networks() for [('3904ca9d-0f3a-42df-acde-f1e02b7b9720', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:00:24.273059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:00:24.273635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:00:24.274763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:00:24.275470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:00:24.276162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:00:24.289382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:24.289833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:24.290889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:24.291584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:24.315140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Getting quotas for project a004889882844be18e4c30827645050e. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:00:24.321192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Getting quotas for user 0d6870f29383493c86db7e30259b8a8b and project a004889882844be18e4c30827645050e. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:00:24.335169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:00:24.337582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:00:24.402881 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2a6f8945-7f9e-44a6-8842-73539636c2cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692963 Aug 02 07:00:24.403891 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1481/3085] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:00:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:00:24.414940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c460d296-a23f-4be8-b879-29b41fae2bf0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:24.415388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c460d296-a23f-4be8-b879-29b41fae2bf0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:24.513350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c460d296-a23f-4be8-b879-29b41fae2bf0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:24.522275 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c460d296-a23f-4be8-b879-29b41fae2bf0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1214 microversion: 2.1 time: 0.111356 Aug 02 07:00:24.534609 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1605/3086] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:24 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:25.546345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5f9b7920-eec4-4b8f-a58b-dd33541e83d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:25.547640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5f9b7920-eec4-4b8f-a58b-dd33541e83d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:25.579784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bcfa62c7-881c-4cdc-a6bc-6d70f4451d22 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:25.580754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bcfa62c7-881c-4cdc-a6bc-6d70f4451d22 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:25.583425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f9b7920-eec4-4b8f-a58b-dd33541e83d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:25.584135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f9b7920-eec4-4b8f-a58b-dd33541e83d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:25.585363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f9b7920-eec4-4b8f-a58b-dd33541e83d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:25.587132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f9b7920-eec4-4b8f-a58b-dd33541e83d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:25.600909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcfa62c7-881c-4cdc-a6bc-6d70f4451d22 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:25.602274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcfa62c7-881c-4cdc-a6bc-6d70f4451d22 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:25.604581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcfa62c7-881c-4cdc-a6bc-6d70f4451d22 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:25.605588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcfa62c7-881c-4cdc-a6bc-6d70f4451d22 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:26.119070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5f9b7920-eec4-4b8f-a58b-dd33541e83d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:26.135228 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5f9b7920-eec4-4b8f-a58b-dd33541e83d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1266 microversion: 2.1 time: 0.594920 Aug 02 07:00:26.136144 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1482/3087] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:25 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1266 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:26.204421 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bcfa62c7-881c-4cdc-a6bc-6d70f4451d22 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1857 microversion: 2.1 time: 0.629077 Aug 02 07:00:26.205349 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1606/3088] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:25 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1857 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:26.232641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-375e0ac8-fbf7-4643-a9f3-c9e8d677592a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851337-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:26.235776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-375e0ac8-fbf7-4643-a9f3-c9e8d677592a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:26.245254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-375e0ac8-fbf7-4643-a9f3-c9e8d677592a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:26.246075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-375e0ac8-fbf7-4643-a9f3-c9e8d677592a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:26.247895 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-375e0ac8-fbf7-4643-a9f3-c9e8d677592a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:26.248603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-375e0ac8-fbf7-4643-a9f3-c9e8d677592a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:26.309372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-375e0ac8-fbf7-4643-a9f3-c9e8d677592a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lazy-loading 'flavor' on Instance uuid 6cab5887-4328-4207-9ac6-c884aa9806d1 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:00:26.325959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-375e0ac8-fbf7-4643-a9f3-c9e8d677592a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Going to try to live migrate instance to n-h2-851337-3 {{(pid=126119) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 02 07:00:27.157553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9661f413-7457-48c1-8560-1c7d6068062b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:27.158286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9661f413-7457-48c1-8560-1c7d6068062b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:27.167595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9661f413-7457-48c1-8560-1c7d6068062b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:27.170215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9661f413-7457-48c1-8560-1c7d6068062b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:27.171220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9661f413-7457-48c1-8560-1c7d6068062b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:27.172216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9661f413-7457-48c1-8560-1c7d6068062b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:27.283300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9661f413-7457-48c1-8560-1c7d6068062b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:27.291763 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9661f413-7457-48c1-8560-1c7d6068062b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1272 microversion: 2.1 time: 0.138375 Aug 02 07:00:27.307240 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1607/3089] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:27 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:28.314767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8d54552a-5fe1-48fb-8ef0-14b09e46e2b2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:28.316232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8d54552a-5fe1-48fb-8ef0-14b09e46e2b2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:28.329836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d54552a-5fe1-48fb-8ef0-14b09e46e2b2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:28.331066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d54552a-5fe1-48fb-8ef0-14b09e46e2b2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:28.332136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d54552a-5fe1-48fb-8ef0-14b09e46e2b2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:28.334722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d54552a-5fe1-48fb-8ef0-14b09e46e2b2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:28.768498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8d54552a-5fe1-48fb-8ef0-14b09e46e2b2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:28.786665 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8d54552a-5fe1-48fb-8ef0-14b09e46e2b2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1314 microversion: 2.1 time: 0.468503 Aug 02 07:00:28.801082 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1608/3090] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:28 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:29.481021 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-375e0ac8-fbf7-4643-a9f3-c9e8d677592a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/action" status: 202 len: 0 microversion: 2.1 time: 3.253437 Aug 02 07:00:29.482291 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1483/3091] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:00:26 2022] POST /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/action => generated 0 bytes in 3255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:00:29.492811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-87a10dba-ce60-45a1-82c9-36aa35330114 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:29.493525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-87a10dba-ce60-45a1-82c9-36aa35330114 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:29.514060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87a10dba-ce60-45a1-82c9-36aa35330114 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:29.515184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87a10dba-ce60-45a1-82c9-36aa35330114 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:29.519273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87a10dba-ce60-45a1-82c9-36aa35330114 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:29.520381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87a10dba-ce60-45a1-82c9-36aa35330114 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:29.820649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4feb7f87-b371-425d-8b4b-9adb58a7422a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:29.827119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4feb7f87-b371-425d-8b4b-9adb58a7422a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:29.842442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:29.898230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4feb7f87-b371-425d-8b4b-9adb58a7422a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:29.899233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4feb7f87-b371-425d-8b4b-9adb58a7422a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:29.900685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4feb7f87-b371-425d-8b4b-9adb58a7422a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:29.901635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4feb7f87-b371-425d-8b4b-9adb58a7422a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:30.374407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-87a10dba-ce60-45a1-82c9-36aa35330114 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:30.385176 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-87a10dba-ce60-45a1-82c9-36aa35330114 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.898298 Aug 02 07:00:30.399700 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1609/3092] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:29 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:30.987501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4feb7f87-b371-425d-8b4b-9adb58a7422a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:31.002738 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4feb7f87-b371-425d-8b4b-9adb58a7422a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1314 microversion: 2.1 time: 1.189519 Aug 02 07:00:31.003606 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1484/3093] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:29 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1314 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:31.410346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-011c22a1-26bf-4db3-94d8-81c1cc14ad56 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:31.411575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-011c22a1-26bf-4db3-94d8-81c1cc14ad56 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:31.427390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-011c22a1-26bf-4db3-94d8-81c1cc14ad56 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:31.431791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-011c22a1-26bf-4db3-94d8-81c1cc14ad56 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:31.434942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-011c22a1-26bf-4db3-94d8-81c1cc14ad56 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:31.435449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-011c22a1-26bf-4db3-94d8-81c1cc14ad56 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:31.479454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:31.725813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-680c8b11-08fc-453b-a70e-fe244046b59c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:31.726354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-680c8b11-08fc-453b-a70e-fe244046b59c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:31.738594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-680c8b11-08fc-453b-a70e-fe244046b59c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:31.739257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-680c8b11-08fc-453b-a70e-fe244046b59c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:31.742541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-680c8b11-08fc-453b-a70e-fe244046b59c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:31.743229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-680c8b11-08fc-453b-a70e-fe244046b59c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:31.801425 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-680c8b11-08fc-453b-a70e-fe244046b59c tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/ips" status: 200 len: 147 microversion: 2.1 time: 0.079607 Aug 02 07:00:31.812969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-011c22a1-26bf-4db3-94d8-81c1cc14ad56 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:31.816293 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1485/3094] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 07:00:31 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/ips => generated 147 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:31.836502 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-011c22a1-26bf-4db3-94d8-81c1cc14ad56 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.430124 Aug 02 07:00:31.877817 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1610/3095] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:31 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:32.028058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a02c3914-3cef-4bec-add3-ae99e9d10bdd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:32.029427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a02c3914-3cef-4bec-add3-ae99e9d10bdd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:32.037481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a02c3914-3cef-4bec-add3-ae99e9d10bdd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:32.046826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a02c3914-3cef-4bec-add3-ae99e9d10bdd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:32.051512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a02c3914-3cef-4bec-add3-ae99e9d10bdd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:32.052372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a02c3914-3cef-4bec-add3-ae99e9d10bdd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:32.867205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-34b36452-bb48-4c63-974d-f10fa0da9b6f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:32.867828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-34b36452-bb48-4c63-974d-f10fa0da9b6f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:32.889098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34b36452-bb48-4c63-974d-f10fa0da9b6f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:32.892709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34b36452-bb48-4c63-974d-f10fa0da9b6f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:32.894064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34b36452-bb48-4c63-974d-f10fa0da9b6f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:32.896942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34b36452-bb48-4c63-974d-f10fa0da9b6f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:34.306727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:34.329497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:34.506627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-34b36452-bb48-4c63-974d-f10fa0da9b6f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:34.511428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a02c3914-3cef-4bec-add3-ae99e9d10bdd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:34.519458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:34.532965 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a02c3914-3cef-4bec-add3-ae99e9d10bdd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1314 microversion: 2.1 time: 2.509062 Aug 02 07:00:34.543092 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1486/3096] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:32 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1314 bytes in 2516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:34.554707 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-34b36452-bb48-4c63-974d-f10fa0da9b6f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 1.692079 Aug 02 07:00:34.557812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-2439f60a-44c8-4e73-9dc9-fff44c246879 req-65faa185-8e93-4a66-a3f6-ab8df155d255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f8b31f7-8832-401c-80ea-c9d595559396", "tag": "14bca030-e56d-4853-a080-fc06d7a4a51f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:34.567702 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1611/3097] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:32 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:34.588273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2439f60a-44c8-4e73-9dc9-fff44c246879 req-65faa185-8e93-4a66-a3f6-ab8df155d255 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:34.589110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2439f60a-44c8-4e73-9dc9-fff44c246879 req-65faa185-8e93-4a66-a3f6-ab8df155d255 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:34.611048 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-2439f60a-44c8-4e73-9dc9-fff44c246879 req-65faa185-8e93-4a66-a3f6-ab8df155d255 service nova] Creating event network-changed:14bca030-e56d-4853-a080-fc06d7a4a51f for instance 3f8b31f7-8832-401c-80ea-c9d595559396 on n-h1-851337-3 Aug 02 07:00:34.619946 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-2439f60a-44c8-4e73-9dc9-fff44c246879 req-65faa185-8e93-4a66-a3f6-ab8df155d255 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070868 Aug 02 07:00:34.621020 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1487/3098] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:35.053099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d33f3acd-3ad2-4281-a875-c59f608db1ec tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df8ca14f-f0ce-4623-b1c6-8d21c93a2941"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:35.057274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d33f3acd-3ad2-4281-a875-c59f608db1ec tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:35.079018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d33f3acd-3ad2-4281-a875-c59f608db1ec tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:35.079892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d33f3acd-3ad2-4281-a875-c59f608db1ec tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:35.081134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d33f3acd-3ad2-4281-a875-c59f608db1ec tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:35.081810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d33f3acd-3ad2-4281-a875-c59f608db1ec tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:35.574342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e1d99dd6-d4cf-4c82-9aee-79ad5f8956d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:35.575603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e1d99dd6-d4cf-4c82-9aee-79ad5f8956d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:35.594309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1d99dd6-d4cf-4c82-9aee-79ad5f8956d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:35.594995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1d99dd6-d4cf-4c82-9aee-79ad5f8956d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:35.595975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1d99dd6-d4cf-4c82-9aee-79ad5f8956d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:35.596567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1d99dd6-d4cf-4c82-9aee-79ad5f8956d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:36.130271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e1d99dd6-d4cf-4c82-9aee-79ad5f8956d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:36.143357 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e1d99dd6-d4cf-4c82-9aee-79ad5f8956d0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1314 microversion: 2.1 time: 0.588411 Aug 02 07:00:36.144377 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1488/3099] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:35 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:36.160904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f586284c-1ec2-4273-a72c-5f7010277ff8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:36.161752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f586284c-1ec2-4273-a72c-5f7010277ff8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:36.171195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f586284c-1ec2-4273-a72c-5f7010277ff8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:36.174720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f586284c-1ec2-4273-a72c-5f7010277ff8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:36.175815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f586284c-1ec2-4273-a72c-5f7010277ff8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:36.176432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f586284c-1ec2-4273-a72c-5f7010277ff8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:36.844594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f586284c-1ec2-4273-a72c-5f7010277ff8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:36.858395 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f586284c-1ec2-4273-a72c-5f7010277ff8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.711694 Aug 02 07:00:36.864454 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1489/3100] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:36 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:37.169376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aba0aca6-52d6-41dd-a5c6-fba28ffc5afa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:37.174835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aba0aca6-52d6-41dd-a5c6-fba28ffc5afa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:37.198782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aba0aca6-52d6-41dd-a5c6-fba28ffc5afa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:37.199576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aba0aca6-52d6-41dd-a5c6-fba28ffc5afa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:37.200546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aba0aca6-52d6-41dd-a5c6-fba28ffc5afa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:37.201097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aba0aca6-52d6-41dd-a5c6-fba28ffc5afa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:37.662805 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d33f3acd-3ad2-4281-a875-c59f608db1ec tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "POST /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.611865 Aug 02 07:00:37.664447 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1612/3101] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:00:35 2022] POST /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments => generated 194 bytes in 2617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:37.737089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aba0aca6-52d6-41dd-a5c6-fba28ffc5afa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:37.750302 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aba0aca6-52d6-41dd-a5c6-fba28ffc5afa tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1314 microversion: 2.1 time: 0.588593 Aug 02 07:00:37.790060 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1490/3102] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:37 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:37.882782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d37ec0e2-273f-4288-a15b-a10a3fa3cb7b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:37.886963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d37ec0e2-273f-4288-a15b-a10a3fa3cb7b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:37.906060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d37ec0e2-273f-4288-a15b-a10a3fa3cb7b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:37.906806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d37ec0e2-273f-4288-a15b-a10a3fa3cb7b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:37.907779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d37ec0e2-273f-4288-a15b-a10a3fa3cb7b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:37.910556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d37ec0e2-273f-4288-a15b-a10a3fa3cb7b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:38.538947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1925279833", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:38.653061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] validate_networks() for [('f289e266-c4ba-4c55-aa32-11b46a69ff42', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:00:38.952793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d37ec0e2-273f-4288-a15b-a10a3fa3cb7b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:38.967752 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d37ec0e2-273f-4288-a15b-a10a3fa3cb7b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 1.085622 Aug 02 07:00:38.968783 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1613/3103] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:37 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:38.980432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-49d7f81e-cd6a-491c-818a-48e45d9ff43f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:38.990430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-49d7f81e-cd6a-491c-818a-48e45d9ff43f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:39.018028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49d7f81e-cd6a-491c-818a-48e45d9ff43f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:39.018484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49d7f81e-cd6a-491c-818a-48e45d9ff43f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:39.019271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49d7f81e-cd6a-491c-818a-48e45d9ff43f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:39.019790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49d7f81e-cd6a-491c-818a-48e45d9ff43f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:39.768845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-49d7f81e-cd6a-491c-818a-48e45d9ff43f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:39.779094 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-49d7f81e-cd6a-491c-818a-48e45d9ff43f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1314 microversion: 2.1 time: 0.802667 Aug 02 07:00:39.787233 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1614/3104] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:38 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1314 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:39.988790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5cbe44b3-d729-4d8b-b7b3-c7a66d146c05 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:39.989549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5cbe44b3-d729-4d8b-b7b3-c7a66d146c05 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:39.997016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5cbe44b3-d729-4d8b-b7b3-c7a66d146c05 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:39.997949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5cbe44b3-d729-4d8b-b7b3-c7a66d146c05 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:39.998978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5cbe44b3-d729-4d8b-b7b3-c7a66d146c05 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:39.999570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5cbe44b3-d729-4d8b-b7b3-c7a66d146c05 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:40.137067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:00:40.137880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:00:40.138707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:00:40.139546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:00:40.140191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:00:40.185197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:40.187401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:40.192775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:40.193521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:40.292430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5cbe44b3-d729-4d8b-b7b3-c7a66d146c05 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:40.322562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Getting quotas for project 7e4fc5f796624bbbb5fab2412ba6d092. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:00:40.329515 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5cbe44b3-d729-4d8b-b7b3-c7a66d146c05 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.344347 Aug 02 07:00:40.336505 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1615/3105] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:39 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:40.345548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Getting quotas for user b9ad5424586247019d4374f52600ea51 and project 7e4fc5f796624bbbb5fab2412ba6d092. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:00:40.404906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:00:40.409609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:00:40.588882 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5238c5e3-19ef-4762-a4c4-4ce9030655a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.305656 Aug 02 07:00:40.602173 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1491/3106] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:00:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 2320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 07:00:40.603155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0969371c-91be-4533-9758-f34288d9a672 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:40.604203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0969371c-91be-4533-9758-f34288d9a672 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:40.713597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0969371c-91be-4533-9758-f34288d9a672 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:40.721657 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0969371c-91be-4533-9758-f34288d9a672 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1222 microversion: 2.1 time: 0.124851 Aug 02 07:00:40.726842 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1616/3107] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:40 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1222 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:40.808441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-16e92eba-b175-4ebf-8c25-97b570e6fed8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:40.809197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-16e92eba-b175-4ebf-8c25-97b570e6fed8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:40.824147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16e92eba-b175-4ebf-8c25-97b570e6fed8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:40.824794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16e92eba-b175-4ebf-8c25-97b570e6fed8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:40.825755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16e92eba-b175-4ebf-8c25-97b570e6fed8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:40.826276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16e92eba-b175-4ebf-8c25-97b570e6fed8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:40.871731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2012646532", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:41.018398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] validate_networks() for [('f289e266-c4ba-4c55-aa32-11b46a69ff42', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:00:41.453881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-16e92eba-b175-4ebf-8c25-97b570e6fed8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:41.463240 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-16e92eba-b175-4ebf-8c25-97b570e6fed8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1314 microversion: 2.1 time: 0.659276 Aug 02 07:00:41.467241 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1492/3108] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:40 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:41.479155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-63aef94c-b364-48f3-9ecc-3cf4bba590ce tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:41.486813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-63aef94c-b364-48f3-9ecc-3cf4bba590ce tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:41.504644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63aef94c-b364-48f3-9ecc-3cf4bba590ce tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:41.507820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63aef94c-b364-48f3-9ecc-3cf4bba590ce tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:41.512081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63aef94c-b364-48f3-9ecc-3cf4bba590ce tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:41.512730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63aef94c-b364-48f3-9ecc-3cf4bba590ce tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:41.521326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=79,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=16,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:42.681177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-63aef94c-b364-48f3-9ecc-3cf4bba590ce tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:42.701458 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-63aef94c-b364-48f3-9ecc-3cf4bba590ce tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 1.218906 Aug 02 07:00:42.702188 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1493/3109] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:41 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:42.728695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a6e92400-5baf-496c-8aeb-18b9441b4ec4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:42.729726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a6e92400-5baf-496c-8aeb-18b9441b4ec4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:42.744185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6e92400-5baf-496c-8aeb-18b9441b4ec4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:42.745084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6e92400-5baf-496c-8aeb-18b9441b4ec4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:42.746145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6e92400-5baf-496c-8aeb-18b9441b4ec4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:42.746795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6e92400-5baf-496c-8aeb-18b9441b4ec4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:43.319603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a6e92400-5baf-496c-8aeb-18b9441b4ec4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:43.345717 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a6e92400-5baf-496c-8aeb-18b9441b4ec4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1314 microversion: 2.1 time: 0.625400 Aug 02 07:00:43.346571 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1494/3110] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:42 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:43.352082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-d4856dcc-8508-4d49-8ea2-a6b3caadd713 req-22bf9a75-459d-4eb0-b4ef-fa48ae99954e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f8b31f7-8832-401c-80ea-c9d595559396", "name": "network-vif-plugged", "status": "completed", "tag": "14bca030-e56d-4853-a080-fc06d7a4a51f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:43.370426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d4856dcc-8508-4d49-8ea2-a6b3caadd713 req-22bf9a75-459d-4eb0-b4ef-fa48ae99954e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:43.371274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d4856dcc-8508-4d49-8ea2-a6b3caadd713 req-22bf9a75-459d-4eb0-b4ef-fa48ae99954e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:43.389969 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-d4856dcc-8508-4d49-8ea2-a6b3caadd713 req-22bf9a75-459d-4eb0-b4ef-fa48ae99954e service nova] Creating event network-vif-plugged:14bca030-e56d-4853-a080-fc06d7a4a51f for instance 3f8b31f7-8832-401c-80ea-c9d595559396 on n-h1-851337-3 Aug 02 07:00:43.403756 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-d4856dcc-8508-4d49-8ea2-a6b3caadd713 req-22bf9a75-459d-4eb0-b4ef-fa48ae99954e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055463 Aug 02 07:00:43.414197 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1495/3111] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:43.524679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:00:43.529246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:00:43.530392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:00:43.531063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:00:43.533129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:00:43.546429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:43.547235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:43.548260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:43.549286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:43.604219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Getting quotas for project 7e4fc5f796624bbbb5fab2412ba6d092. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:00:43.621297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Getting quotas for user b9ad5424586247019d4374f52600ea51 and project 7e4fc5f796624bbbb5fab2412ba6d092. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:00:43.656443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:00:43.659988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:00:43.727847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-effbe485-e817-427d-8a94-c6e4230c064f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:43.728949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-effbe485-e817-427d-8a94-c6e4230c064f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:43.750497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-effbe485-e817-427d-8a94-c6e4230c064f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:43.755916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-effbe485-e817-427d-8a94-c6e4230c064f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:43.759804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-effbe485-e817-427d-8a94-c6e4230c064f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:43.763521 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-48d70701-c713-4f69-9f83-9c8826dfec58 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.901144 Aug 02 07:00:43.763852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-effbe485-e817-427d-8a94-c6e4230c064f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:43.767063 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1617/3112] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:00:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:00:43.792782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f37f53c-a09f-472e-bdfa-9687fb95aebc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:43.793689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1f37f53c-a09f-472e-bdfa-9687fb95aebc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:44.103218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f37f53c-a09f-472e-bdfa-9687fb95aebc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:44.119612 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f37f53c-a09f-472e-bdfa-9687fb95aebc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1222 microversion: 2.1 time: 0.340499 Aug 02 07:00:44.120574 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1618/3113] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:43 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1222 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:44.320694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-effbe485-e817-427d-8a94-c6e4230c064f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:44.337349 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-effbe485-e817-427d-8a94-c6e4230c064f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.613935 Aug 02 07:00:44.341339 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1496/3114] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:43 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:44.368198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9f1cfb2f-5475-416d-a940-88a22be839e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:44.369079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9f1cfb2f-5475-416d-a940-88a22be839e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:44.381411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f1cfb2f-5475-416d-a940-88a22be839e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:44.383961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f1cfb2f-5475-416d-a940-88a22be839e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:44.385597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f1cfb2f-5475-416d-a940-88a22be839e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:44.387464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f1cfb2f-5475-416d-a940-88a22be839e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:44.708431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9f1cfb2f-5475-416d-a940-88a22be839e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:44.739843 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9f1cfb2f-5475-416d-a940-88a22be839e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1314 microversion: 2.1 time: 0.374654 Aug 02 07:00:44.743372 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1619/3115] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:44 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:45.148720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-96d097de-68a9-46e4-8d29-144a932a2372 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:45.149830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-96d097de-68a9-46e4-8d29-144a932a2372 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:45.212003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96d097de-68a9-46e4-8d29-144a932a2372 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:45.216372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96d097de-68a9-46e4-8d29-144a932a2372 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:45.217741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96d097de-68a9-46e4-8d29-144a932a2372 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:45.218506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96d097de-68a9-46e4-8d29-144a932a2372 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:45.369713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-134d78b3-ab40-41f3-8045-0da8e102a4d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:45.375037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-134d78b3-ab40-41f3-8045-0da8e102a4d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:45.403659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-134d78b3-ab40-41f3-8045-0da8e102a4d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:45.404900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-134d78b3-ab40-41f3-8045-0da8e102a4d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:45.406517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-134d78b3-ab40-41f3-8045-0da8e102a4d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:45.417364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-134d78b3-ab40-41f3-8045-0da8e102a4d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:45.536823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-96d097de-68a9-46e4-8d29-144a932a2372 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:45.547203 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-96d097de-68a9-46e4-8d29-144a932a2372 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1218 microversion: 2.1 time: 0.404919 Aug 02 07:00:45.549172 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1497/3116] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:45 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1218 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:45.754696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-134d78b3-ab40-41f3-8045-0da8e102a4d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:45.764722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8d7a5ceb-8d26-40d7-8e5a-0159f96a5946 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:45.766269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8d7a5ceb-8d26-40d7-8e5a-0159f96a5946 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:45.773151 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-134d78b3-ab40-41f3-8045-0da8e102a4d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.412235 Aug 02 07:00:45.773685 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1620/3117] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:45 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:45.780689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d7a5ceb-8d26-40d7-8e5a-0159f96a5946 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:45.783540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d7a5ceb-8d26-40d7-8e5a-0159f96a5946 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:45.792313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d7a5ceb-8d26-40d7-8e5a-0159f96a5946 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:45.794571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d7a5ceb-8d26-40d7-8e5a-0159f96a5946 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:46.209235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8d7a5ceb-8d26-40d7-8e5a-0159f96a5946 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:46.218505 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8d7a5ceb-8d26-40d7-8e5a-0159f96a5946 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1502 microversion: 2.1 time: 0.458957 Aug 02 07:00:46.219051 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1498/3118] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:45 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1502 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:46.244173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a0f5238d-10df-4d54-9622-39f9d5a8f993 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:46.258579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0f5238d-10df-4d54-9622-39f9d5a8f993 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:46.259027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0f5238d-10df-4d54-9622-39f9d5a8f993 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:46.309991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a0f5238d-10df-4d54-9622-39f9d5a8f993 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Going to try to stop instance {{(pid=126120) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 07:00:46.410719 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a0f5238d-10df-4d54-9622-39f9d5a8f993 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "POST /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396/action" status: 202 len: 0 microversion: 2.1 time: 0.169172 Aug 02 07:00:46.422733 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1621/3119] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:00:46 2022] POST /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:00:46.432530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b72d1516-3ef1-48d1-a1c5-ed12ffba0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:46.433446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b72d1516-3ef1-48d1-a1c5-ed12ffba0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:46.451656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b72d1516-3ef1-48d1-a1c5-ed12ffba0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:46.452897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b72d1516-3ef1-48d1-a1c5-ed12ffba0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:46.453860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b72d1516-3ef1-48d1-a1c5-ed12ffba0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:46.454507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b72d1516-3ef1-48d1-a1c5-ed12ffba0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:46.577331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b5683277-67db-47db-ad10-3c6f8cf955e6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:46.578085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b5683277-67db-47db-ad10-3c6f8cf955e6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:46.580275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:46.606916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5683277-67db-47db-ad10-3c6f8cf955e6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:46.607278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5683277-67db-47db-ad10-3c6f8cf955e6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:46.608075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5683277-67db-47db-ad10-3c6f8cf955e6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:46.608508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5683277-67db-47db-ad10-3c6f8cf955e6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:46.714080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b5683277-67db-47db-ad10-3c6f8cf955e6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:46.724105 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b5683277-67db-47db-ad10-3c6f8cf955e6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1280 microversion: 2.1 time: 0.152468 Aug 02 07:00:46.726942 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1622/3120] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:46 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1280 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:46.796838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b8896181-326c-4b28-a17e-d8282cf12d89 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:46.797740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b8896181-326c-4b28-a17e-d8282cf12d89 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:46.817525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8896181-326c-4b28-a17e-d8282cf12d89 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:46.818329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8896181-326c-4b28-a17e-d8282cf12d89 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:46.819628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8896181-326c-4b28-a17e-d8282cf12d89 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:46.820111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8896181-326c-4b28-a17e-d8282cf12d89 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:46.924287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b72d1516-3ef1-48d1-a1c5-ed12ffba0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:46.938865 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b72d1516-3ef1-48d1-a1c5-ed12ffba0c01 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.510615 Aug 02 07:00:46.951650 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1499/3121] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:46 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:47.180367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b8896181-326c-4b28-a17e-d8282cf12d89 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:47.196504 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b8896181-326c-4b28-a17e-d8282cf12d89 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.403971 Aug 02 07:00:47.215737 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1623/3122] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:46 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:47.240611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ba3db541-18fb-4bde-b9f3-9d83a7108b26 req-c5eff087-d62a-479c-a2c5-2aedb811ad53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7e42843-450e-4aab-b2eb-8ec992bfaaf3", "tag": "b6bbcd73-d214-4d50-86ca-a5ec8f43e3a8"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:47.263960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ba3db541-18fb-4bde-b9f3-9d83a7108b26 req-c5eff087-d62a-479c-a2c5-2aedb811ad53 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:47.273527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ba3db541-18fb-4bde-b9f3-9d83a7108b26 req-c5eff087-d62a-479c-a2c5-2aedb811ad53 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:47.310169 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ba3db541-18fb-4bde-b9f3-9d83a7108b26 req-c5eff087-d62a-479c-a2c5-2aedb811ad53 service nova] Creating event network-changed:b6bbcd73-d214-4d50-86ca-a5ec8f43e3a8 for instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 on n-h2-851337-3 Aug 02 07:00:47.322661 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ba3db541-18fb-4bde-b9f3-9d83a7108b26 req-c5eff087-d62a-479c-a2c5-2aedb811ad53 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084778 Aug 02 07:00:47.324302 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1500/3123] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:47.772299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b8103e1f-0c6f-4de0-934a-f13afde5b77f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:47.772932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b8103e1f-0c6f-4de0-934a-f13afde5b77f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:47.810301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8103e1f-0c6f-4de0-934a-f13afde5b77f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:47.811778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8103e1f-0c6f-4de0-934a-f13afde5b77f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:47.812040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8103e1f-0c6f-4de0-934a-f13afde5b77f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:47.812590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8103e1f-0c6f-4de0-934a-f13afde5b77f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:47.964639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-04a6d049-9648-4347-800c-2d1cbb0420af tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:47.965350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-04a6d049-9648-4347-800c-2d1cbb0420af tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:47.987828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04a6d049-9648-4347-800c-2d1cbb0420af tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:47.988293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04a6d049-9648-4347-800c-2d1cbb0420af tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:47.989102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04a6d049-9648-4347-800c-2d1cbb0420af tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:47.989559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04a6d049-9648-4347-800c-2d1cbb0420af tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:48.079069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b8103e1f-0c6f-4de0-934a-f13afde5b77f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:48.100517 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b8103e1f-0c6f-4de0-934a-f13afde5b77f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1280 microversion: 2.1 time: 0.347736 Aug 02 07:00:48.104830 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1624/3124] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:47 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1280 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:48.229717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3c53d973-8fb2-4633-b3ff-d9603b8d568e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:48.230438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3c53d973-8fb2-4633-b3ff-d9603b8d568e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:48.237528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c53d973-8fb2-4633-b3ff-d9603b8d568e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:48.238060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c53d973-8fb2-4633-b3ff-d9603b8d568e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:48.252050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c53d973-8fb2-4633-b3ff-d9603b8d568e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:48.252869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c53d973-8fb2-4633-b3ff-d9603b8d568e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:48.514708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-04a6d049-9648-4347-800c-2d1cbb0420af tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:48.557337 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-04a6d049-9648-4347-800c-2d1cbb0420af tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.595291 Aug 02 07:00:48.560434 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1501/3125] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:47 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:48.614379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3c53d973-8fb2-4633-b3ff-d9603b8d568e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:48.626937 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3c53d973-8fb2-4633-b3ff-d9603b8d568e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.401978 Aug 02 07:00:48.627531 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1625/3126] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:48 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:49.130250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4e5a8b9f-b706-4102-8f17-6131f4e75365 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:49.131599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4e5a8b9f-b706-4102-8f17-6131f4e75365 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:49.143852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e5a8b9f-b706-4102-8f17-6131f4e75365 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:49.144048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e5a8b9f-b706-4102-8f17-6131f4e75365 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:49.157097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e5a8b9f-b706-4102-8f17-6131f4e75365 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:49.157487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e5a8b9f-b706-4102-8f17-6131f4e75365 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:49.497188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4e5a8b9f-b706-4102-8f17-6131f4e75365 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:49.523656 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4e5a8b9f-b706-4102-8f17-6131f4e75365 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1322 microversion: 2.1 time: 0.393248 Aug 02 07:00:49.528593 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1502/3127] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:49 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:49.587891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c9ef9a3e-32f2-49d2-b60d-185560189ca1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:49.588662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c9ef9a3e-32f2-49d2-b60d-185560189ca1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:49.604054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9ef9a3e-32f2-49d2-b60d-185560189ca1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:49.608326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9ef9a3e-32f2-49d2-b60d-185560189ca1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:49.610156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9ef9a3e-32f2-49d2-b60d-185560189ca1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:49.613732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9ef9a3e-32f2-49d2-b60d-185560189ca1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:49.650807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bfabac76-add6-44e1-b180-fee769db5cb4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:49.651941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bfabac76-add6-44e1-b180-fee769db5cb4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:49.670691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfabac76-add6-44e1-b180-fee769db5cb4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:49.672902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfabac76-add6-44e1-b180-fee769db5cb4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:49.675326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfabac76-add6-44e1-b180-fee769db5cb4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:49.680708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfabac76-add6-44e1-b180-fee769db5cb4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:50.228276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:50.380968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:50.392815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bfabac76-add6-44e1-b180-fee769db5cb4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:50.412374 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bfabac76-add6-44e1-b180-fee769db5cb4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.766393 Aug 02 07:00:50.416597 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1503/3128] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:49 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:50.548878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-574296b1-11ae-49f2-822b-5707dd7f720f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:50.550482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-574296b1-11ae-49f2-822b-5707dd7f720f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:50.569658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-574296b1-11ae-49f2-822b-5707dd7f720f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:50.570396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-574296b1-11ae-49f2-822b-5707dd7f720f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:50.573247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-574296b1-11ae-49f2-822b-5707dd7f720f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:50.576500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-574296b1-11ae-49f2-822b-5707dd7f720f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:50.593982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c9ef9a3e-32f2-49d2-b60d-185560189ca1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:50.612305 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c9ef9a3e-32f2-49d2-b60d-185560189ca1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 1.027742 Aug 02 07:00:50.626805 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1626/3129] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:49 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:51.032062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-574296b1-11ae-49f2-822b-5707dd7f720f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:51.045282 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-574296b1-11ae-49f2-822b-5707dd7f720f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1322 microversion: 2.1 time: 0.500374 Aug 02 07:00:51.063944 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1504/3130] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:50 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1322 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:51.437513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a4a00208-1b7e-4ce8-b225-5670138c18d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:51.438487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a4a00208-1b7e-4ce8-b225-5670138c18d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:51.449686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a00208-1b7e-4ce8-b225-5670138c18d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:51.450567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a00208-1b7e-4ce8-b225-5670138c18d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:51.453031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a00208-1b7e-4ce8-b225-5670138c18d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:51.456379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a00208-1b7e-4ce8-b225-5670138c18d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:51.506401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:51.643903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2cf6922f-badb-4107-b917-927ad920aaf7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:51.645145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2cf6922f-badb-4107-b917-927ad920aaf7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:51.661141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2cf6922f-badb-4107-b917-927ad920aaf7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:51.662507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2cf6922f-badb-4107-b917-927ad920aaf7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:51.664898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2cf6922f-badb-4107-b917-927ad920aaf7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:51.666328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2cf6922f-badb-4107-b917-927ad920aaf7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:51.767117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a4a00208-1b7e-4ce8-b225-5670138c18d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:51.782797 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a4a00208-1b7e-4ce8-b225-5670138c18d1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.348636 Aug 02 07:00:51.784149 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1627/3131] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:51 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:51.816850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-f46f670e-65af-4359-b361-d0584241d043 req-d7ce9ee7-30a3-4d15-aa5e-37bd98466ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a", "tag": "8a0df868-ebd1-4372-b04a-0f30ca51787e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:51.842866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f46f670e-65af-4359-b361-d0584241d043 req-d7ce9ee7-30a3-4d15-aa5e-37bd98466ea9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:51.849758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f46f670e-65af-4359-b361-d0584241d043 req-d7ce9ee7-30a3-4d15-aa5e-37bd98466ea9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:51.893194 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f46f670e-65af-4359-b361-d0584241d043 req-d7ce9ee7-30a3-4d15-aa5e-37bd98466ea9 service nova] Creating event network-changed:8a0df868-ebd1-4372-b04a-0f30ca51787e for instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a on n-h1-851337-3 Aug 02 07:00:51.912663 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-f46f670e-65af-4359-b361-d0584241d043 req-d7ce9ee7-30a3-4d15-aa5e-37bd98466ea9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126660 Aug 02 07:00:51.917619 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1628/3132] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:51.988087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2cf6922f-badb-4107-b917-927ad920aaf7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:52.004980 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2cf6922f-badb-4107-b917-927ad920aaf7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.359216 Aug 02 07:00:52.007155 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1505/3133] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:51 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:52.070259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-816c9e9c-87e5-440c-b46d-2812c17090e9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:52.071048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-816c9e9c-87e5-440c-b46d-2812c17090e9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:52.086341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-816c9e9c-87e5-440c-b46d-2812c17090e9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:52.089055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-816c9e9c-87e5-440c-b46d-2812c17090e9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:52.090045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-816c9e9c-87e5-440c-b46d-2812c17090e9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:52.090495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-816c9e9c-87e5-440c-b46d-2812c17090e9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:52.344504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-816c9e9c-87e5-440c-b46d-2812c17090e9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:52.354624 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-816c9e9c-87e5-440c-b46d-2812c17090e9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1322 microversion: 2.1 time: 0.289390 Aug 02 07:00:52.355702 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1629/3134] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:52 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:52.814512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-65f4fef3-2dba-482d-8802-80a64e13794c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:52.815825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-65f4fef3-2dba-482d-8802-80a64e13794c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:52.837096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65f4fef3-2dba-482d-8802-80a64e13794c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:52.838442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65f4fef3-2dba-482d-8802-80a64e13794c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:52.839908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65f4fef3-2dba-482d-8802-80a64e13794c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:52.846733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65f4fef3-2dba-482d-8802-80a64e13794c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:53.028943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8c20b882-0faa-4c53-8a1e-feaaa1afd92a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:53.030246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8c20b882-0faa-4c53-8a1e-feaaa1afd92a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:53.047912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c20b882-0faa-4c53-8a1e-feaaa1afd92a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:53.048753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c20b882-0faa-4c53-8a1e-feaaa1afd92a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:53.049825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c20b882-0faa-4c53-8a1e-feaaa1afd92a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:53.052267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c20b882-0faa-4c53-8a1e-feaaa1afd92a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:53.287740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-65f4fef3-2dba-482d-8802-80a64e13794c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:53.321928 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-65f4fef3-2dba-482d-8802-80a64e13794c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.512340 Aug 02 07:00:53.331174 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1506/3135] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:52 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:53.377430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-143a9a46-a39e-41d6-8852-635449e33a08 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:53.378517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-143a9a46-a39e-41d6-8852-635449e33a08 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:53.401545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-143a9a46-a39e-41d6-8852-635449e33a08 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:53.406037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-143a9a46-a39e-41d6-8852-635449e33a08 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:53.407361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-143a9a46-a39e-41d6-8852-635449e33a08 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:53.407823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-143a9a46-a39e-41d6-8852-635449e33a08 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:53.555440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8c20b882-0faa-4c53-8a1e-feaaa1afd92a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:53.567136 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8c20b882-0faa-4c53-8a1e-feaaa1afd92a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.543143 Aug 02 07:00:53.586348 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1630/3136] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:53 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:53.708240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-143a9a46-a39e-41d6-8852-635449e33a08 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:53.718803 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-143a9a46-a39e-41d6-8852-635449e33a08 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1322 microversion: 2.1 time: 0.346867 Aug 02 07:00:53.720567 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1507/3137] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:53 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:54.355374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bfd404b6-aaca-47f0-bc55-6bfd8733d054 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:54.356159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bfd404b6-aaca-47f0-bc55-6bfd8733d054 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:54.358526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:54.360457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=10 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:54.378144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfd404b6-aaca-47f0-bc55-6bfd8733d054 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:54.378975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfd404b6-aaca-47f0-bc55-6bfd8733d054 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:54.379865 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfd404b6-aaca-47f0-bc55-6bfd8733d054 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:54.380301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfd404b6-aaca-47f0-bc55-6bfd8733d054 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:54.590717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fad53613-74b2-46fc-ad49-511c1d9c4fca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:54.591968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fad53613-74b2-46fc-ad49-511c1d9c4fca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:54.608994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fad53613-74b2-46fc-ad49-511c1d9c4fca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:54.609730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fad53613-74b2-46fc-ad49-511c1d9c4fca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:54.610736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fad53613-74b2-46fc-ad49-511c1d9c4fca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:54.611357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fad53613-74b2-46fc-ad49-511c1d9c4fca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:54.966063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bfd404b6-aaca-47f0-bc55-6bfd8733d054 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:55.003757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fad53613-74b2-46fc-ad49-511c1d9c4fca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:55.009200 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bfd404b6-aaca-47f0-bc55-6bfd8733d054 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.654307 Aug 02 07:00:55.022626 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1631/3138] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:54 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:55.022849 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fad53613-74b2-46fc-ad49-511c1d9c4fca tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.432705 Aug 02 07:00:55.022849 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1508/3139] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:54 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:55.025875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a07ad2d3-bfe7-4088-97bf-63351c00ef33 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:55.026520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a07ad2d3-bfe7-4088-97bf-63351c00ef33 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:55.035723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a07ad2d3-bfe7-4088-97bf-63351c00ef33 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:55.036176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a07ad2d3-bfe7-4088-97bf-63351c00ef33 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:55.037033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a07ad2d3-bfe7-4088-97bf-63351c00ef33 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:55.037528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a07ad2d3-bfe7-4088-97bf-63351c00ef33 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:55.412291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a07ad2d3-bfe7-4088-97bf-63351c00ef33 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:55.413862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-cff7f428-45d8-41cf-9235-ccf76345a294 req-c65a917a-adf3-48b4-abeb-15c0dac9eac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7e42843-450e-4aab-b2eb-8ec992bfaaf3", "name": "network-vif-plugged", "status": "completed", "tag": "b6bbcd73-d214-4d50-86ca-a5ec8f43e3a8"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:00:55.421174 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a07ad2d3-bfe7-4088-97bf-63351c00ef33 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1322 microversion: 2.1 time: 0.403688 Aug 02 07:00:55.421773 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1632/3140] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:55 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:55.433828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cff7f428-45d8-41cf-9235-ccf76345a294 req-c65a917a-adf3-48b4-abeb-15c0dac9eac8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:55.438380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cff7f428-45d8-41cf-9235-ccf76345a294 req-c65a917a-adf3-48b4-abeb-15c0dac9eac8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:55.470862 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-cff7f428-45d8-41cf-9235-ccf76345a294 req-c65a917a-adf3-48b4-abeb-15c0dac9eac8 service nova] Creating event network-vif-plugged:b6bbcd73-d214-4d50-86ca-a5ec8f43e3a8 for instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 on n-h2-851337-3 Aug 02 07:00:55.503891 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-cff7f428-45d8-41cf-9235-ccf76345a294 req-c65a917a-adf3-48b4-abeb-15c0dac9eac8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094715 Aug 02 07:00:55.504974 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1509/3141] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:00:56.033924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a188f42-26e1-404d-b648-136eed0e4c40 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:56.034848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8a188f42-26e1-404d-b648-136eed0e4c40 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:56.045387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-83c5e80c-04e8-471c-a9cd-3448f19625f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:56.046324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-83c5e80c-04e8-471c-a9cd-3448f19625f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:56.048493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a188f42-26e1-404d-b648-136eed0e4c40 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:56.048969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a188f42-26e1-404d-b648-136eed0e4c40 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:56.050740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a188f42-26e1-404d-b648-136eed0e4c40 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:56.051197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a188f42-26e1-404d-b648-136eed0e4c40 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:56.065143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-83c5e80c-04e8-471c-a9cd-3448f19625f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:56.065585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-83c5e80c-04e8-471c-a9cd-3448f19625f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:56.068336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-83c5e80c-04e8-471c-a9cd-3448f19625f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:56.071192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-83c5e80c-04e8-471c-a9cd-3448f19625f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:56.550188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-83c5e80c-04e8-471c-a9cd-3448f19625f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:56.563408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8a188f42-26e1-404d-b648-136eed0e4c40 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:56.565138 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-83c5e80c-04e8-471c-a9cd-3448f19625f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.523354 Aug 02 07:00:56.566144 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1510/3142] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:56 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:56.574470 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8a188f42-26e1-404d-b648-136eed0e4c40 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.545543 Aug 02 07:00:56.581553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c33c70c7-5dad-4409-8e14-13d16e60a3c2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:56.582799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c33c70c7-5dad-4409-8e14-13d16e60a3c2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:56.591020 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1633/3143] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:56 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:56.596837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c33c70c7-5dad-4409-8e14-13d16e60a3c2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:56.598438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c33c70c7-5dad-4409-8e14-13d16e60a3c2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:56.599407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c33c70c7-5dad-4409-8e14-13d16e60a3c2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:56.602616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c33c70c7-5dad-4409-8e14-13d16e60a3c2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:56.892041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c33c70c7-5dad-4409-8e14-13d16e60a3c2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:56.905327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:00:56.914207 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c33c70c7-5dad-4409-8e14-13d16e60a3c2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1322 microversion: 2.1 time: 0.345654 Aug 02 07:00:56.917986 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1511/3144] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:56 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:57.598668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6fbe3a0f-0181-4a62-b54e-a5e609b430e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:57.599401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6fbe3a0f-0181-4a62-b54e-a5e609b430e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:57.601019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f9bd1885-ba43-4e40-9b28-1fbf9e8206de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:57.602380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f9bd1885-ba43-4e40-9b28-1fbf9e8206de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:57.613107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9bd1885-ba43-4e40-9b28-1fbf9e8206de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:57.614092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9bd1885-ba43-4e40-9b28-1fbf9e8206de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:57.615629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9bd1885-ba43-4e40-9b28-1fbf9e8206de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:57.616602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9bd1885-ba43-4e40-9b28-1fbf9e8206de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:57.617760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fbe3a0f-0181-4a62-b54e-a5e609b430e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:57.618303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fbe3a0f-0181-4a62-b54e-a5e609b430e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:57.619485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fbe3a0f-0181-4a62-b54e-a5e609b430e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:57.620225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fbe3a0f-0181-4a62-b54e-a5e609b430e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:57.885178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f9bd1885-ba43-4e40-9b28-1fbf9e8206de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:57.894944 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f9bd1885-ba43-4e40-9b28-1fbf9e8206de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.299281 Aug 02 07:00:57.896581 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1512/3145] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:57 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:57.944238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7b98896a-030d-46ae-8159-d92a998ef91e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:57.945214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6fbe3a0f-0181-4a62-b54e-a5e609b430e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:57.945398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7b98896a-030d-46ae-8159-d92a998ef91e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:57.955966 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6fbe3a0f-0181-4a62-b54e-a5e609b430e6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.366170 Aug 02 07:00:57.956990 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1634/3146] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:57 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:57.958895 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b98896a-030d-46ae-8159-d92a998ef91e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:57.959808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b98896a-030d-46ae-8159-d92a998ef91e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:57.960847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b98896a-030d-46ae-8159-d92a998ef91e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:57.961456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b98896a-030d-46ae-8159-d92a998ef91e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:58.156523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7b98896a-030d-46ae-8159-d92a998ef91e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:58.170768 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7b98896a-030d-46ae-8159-d92a998ef91e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1322 microversion: 2.1 time: 0.231531 Aug 02 07:00:58.171397 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1513/3147] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:57 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:00:58.924951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dc6afec6-bc82-4243-8dc5-973a86bf052c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:58.926115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dc6afec6-bc82-4243-8dc5-973a86bf052c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:58.943086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc6afec6-bc82-4243-8dc5-973a86bf052c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:58.948045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc6afec6-bc82-4243-8dc5-973a86bf052c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:58.950257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc6afec6-bc82-4243-8dc5-973a86bf052c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:58.951631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc6afec6-bc82-4243-8dc5-973a86bf052c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:58.987686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a6075733-0e9e-4418-b81d-71d5089234f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:58.990081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a6075733-0e9e-4418-b81d-71d5089234f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:59.013080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6075733-0e9e-4418-b81d-71d5089234f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:59.014652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6075733-0e9e-4418-b81d-71d5089234f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:59.016349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6075733-0e9e-4418-b81d-71d5089234f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:59.017426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6075733-0e9e-4418-b81d-71d5089234f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:59.304142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dc6afec6-bc82-4243-8dc5-973a86bf052c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:59.330007 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dc6afec6-bc82-4243-8dc5-973a86bf052c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.416342 Aug 02 07:00:59.344243 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1635/3148] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:58 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:00:59.351600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd95d8b3-cbe8-4e3a-bd93-0b4744d50660 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:00:59.352378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dd95d8b3-cbe8-4e3a-bd93-0b4744d50660 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:00:59.373321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd95d8b3-cbe8-4e3a-bd93-0b4744d50660 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:59.376198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd95d8b3-cbe8-4e3a-bd93-0b4744d50660 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:59.378920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd95d8b3-cbe8-4e3a-bd93-0b4744d50660 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:00:59.380152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd95d8b3-cbe8-4e3a-bd93-0b4744d50660 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:00:59.463935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a6075733-0e9e-4418-b81d-71d5089234f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:00:59.479932 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a6075733-0e9e-4418-b81d-71d5089234f8 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.500028 Aug 02 07:00:59.489792 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1514/3149] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:58 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:00.034751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dd95d8b3-cbe8-4e3a-bd93-0b4744d50660 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:00.043823 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dd95d8b3-cbe8-4e3a-bd93-0b4744d50660 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1322 microversion: 2.1 time: 0.700866 Aug 02 07:01:00.049476 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1636/3150] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:00:59 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1322 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:00.373701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-94970d17-b9b0-4ffa-a12c-ad7502fa35e3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:00.375279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-94970d17-b9b0-4ffa-a12c-ad7502fa35e3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:00.407663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:00.424877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-94970d17-b9b0-4ffa-a12c-ad7502fa35e3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:00.426720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-94970d17-b9b0-4ffa-a12c-ad7502fa35e3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:00.430888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-94970d17-b9b0-4ffa-a12c-ad7502fa35e3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:00.431629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-94970d17-b9b0-4ffa-a12c-ad7502fa35e3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:00.522138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4aee0ba3-4223-4990-9056-e67dded030ea tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:00.522950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4aee0ba3-4223-4990-9056-e67dded030ea tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:00.538565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4aee0ba3-4223-4990-9056-e67dded030ea tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:00.539015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4aee0ba3-4223-4990-9056-e67dded030ea tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:00.539903 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4aee0ba3-4223-4990-9056-e67dded030ea tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:00.540263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4aee0ba3-4223-4990-9056-e67dded030ea tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:01.579559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4aee0ba3-4223-4990-9056-e67dded030ea tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:01.585021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-94970d17-b9b0-4ffa-a12c-ad7502fa35e3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:01.598231 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4aee0ba3-4223-4990-9056-e67dded030ea tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 1.081034 Aug 02 07:01:01.600457 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1637/3151] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:00 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:01.610195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-5b70812f-cb20-478a-988f-51d31cc4565d req-9bff922b-1516-4127-8ea7-ae1cf1b145de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cab5887-4328-4207-9ac6-c884aa9806d1", "name": "network-vif-unplugged", "status": "completed", "tag": "18fcf761-a89b-4d97-9ca7-3c303953a3d1"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:01.618342 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-94970d17-b9b0-4ffa-a12c-ad7502fa35e3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 1.257706 Aug 02 07:01:01.619557 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1515/3152] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:00 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:01.636635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-34dfb31b-6cef-4b37-abb5-2824841f72d4 req-9d2511d8-56ac-4bbc-bf03-5aea3bb48fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a", "name": "network-vif-plugged", "status": "completed", "tag": "8a0df868-ebd1-4372-b04a-0f30ca51787e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:01.649958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-5b70812f-cb20-478a-988f-51d31cc4565d req-9bff922b-1516-4127-8ea7-ae1cf1b145de service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:01.660040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-5b70812f-cb20-478a-988f-51d31cc4565d req-9bff922b-1516-4127-8ea7-ae1cf1b145de service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:01.688782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-34dfb31b-6cef-4b37-abb5-2824841f72d4 req-9d2511d8-56ac-4bbc-bf03-5aea3bb48fd8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:01.689585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-34dfb31b-6cef-4b37-abb5-2824841f72d4 req-9d2511d8-56ac-4bbc-bf03-5aea3bb48fd8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:01.701658 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-5b70812f-cb20-478a-988f-51d31cc4565d req-9bff922b-1516-4127-8ea7-ae1cf1b145de service nova] Creating event network-vif-unplugged:18fcf761-a89b-4d97-9ca7-3c303953a3d1 for instance 6cab5887-4328-4207-9ac6-c884aa9806d1 on n-h1-851337-3 Aug 02 07:01:01.731061 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-34dfb31b-6cef-4b37-abb5-2824841f72d4 req-9d2511d8-56ac-4bbc-bf03-5aea3bb48fd8 service nova] Creating event network-vif-plugged:8a0df868-ebd1-4372-b04a-0f30ca51787e for instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a on n-h1-851337-3 Aug 02 07:01:01.731848 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-5b70812f-cb20-478a-988f-51d31cc4565d req-9bff922b-1516-4127-8ea7-ae1cf1b145de service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125348 Aug 02 07:01:01.733663 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1638/3153] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:01.754390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-652cfec6-779a-4cc1-b18f-0604be9c81f8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:01.755574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-652cfec6-779a-4cc1-b18f-0604be9c81f8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:01.763443 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-34dfb31b-6cef-4b37-abb5-2824841f72d4 req-9d2511d8-56ac-4bbc-bf03-5aea3bb48fd8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141423 Aug 02 07:01:01.764959 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1516/3154] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:01.776062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-652cfec6-779a-4cc1-b18f-0604be9c81f8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:01.776917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-652cfec6-779a-4cc1-b18f-0604be9c81f8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:01.779251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-652cfec6-779a-4cc1-b18f-0604be9c81f8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:01.780782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-652cfec6-779a-4cc1-b18f-0604be9c81f8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:02.098167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ba726e0a-72aa-4e94-aa1a-162598bd4535 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:02.120747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ba726e0a-72aa-4e94-aa1a-162598bd4535 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:02.144281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba726e0a-72aa-4e94-aa1a-162598bd4535 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:02.145186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba726e0a-72aa-4e94-aa1a-162598bd4535 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:02.146834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba726e0a-72aa-4e94-aa1a-162598bd4535 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:02.148064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba726e0a-72aa-4e94-aa1a-162598bd4535 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:02.247576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-652cfec6-779a-4cc1-b18f-0604be9c81f8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:02.257556 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-652cfec6-779a-4cc1-b18f-0604be9c81f8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1322 microversion: 2.1 time: 0.522099 Aug 02 07:01:02.258115 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ba726e0a-72aa-4e94-aa1a-162598bd4535 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167779 Aug 02 07:01:02.265928 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1639/3155] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:01 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1322 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:02.266276 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1517/3156] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:01:02 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:02.285729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-246570c2-beff-4ae2-887b-15b3f3b8a55e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:02.290281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-246570c2-beff-4ae2-887b-15b3f3b8a55e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:02.311593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-246570c2-beff-4ae2-887b-15b3f3b8a55e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:02.312034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-246570c2-beff-4ae2-887b-15b3f3b8a55e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:02.313702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-246570c2-beff-4ae2-887b-15b3f3b8a55e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:02.315019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-246570c2-beff-4ae2-887b-15b3f3b8a55e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:02.402378 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-246570c2-beff-4ae2-887b-15b3f3b8a55e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments/df8ca14f-f0ce-4623-b1c6-8d21c93a2941" status: 200 len: 194 microversion: 2.1 time: 0.131547 Aug 02 07:01:02.415082 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1640/3157] 10.222.0.79 () {58 vars in 1413 bytes} [Tue Aug 2 07:01:02 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments/df8ca14f-f0ce-4623-b1c6-8d21c93a2941 => generated 194 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:02.621430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-01aa837d-19e4-4c50-91d7-c33bfe4a8fc3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:02.622836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-01aa837d-19e4-4c50-91d7-c33bfe4a8fc3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:02.642319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01aa837d-19e4-4c50-91d7-c33bfe4a8fc3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:02.645077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01aa837d-19e4-4c50-91d7-c33bfe4a8fc3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:02.647904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01aa837d-19e4-4c50-91d7-c33bfe4a8fc3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:02.648581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01aa837d-19e4-4c50-91d7-c33bfe4a8fc3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:02.659020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9fe83d96-0f3a-4ac8-8f54-3f0ef949279d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:02.659636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9fe83d96-0f3a-4ac8-8f54-3f0ef949279d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:02.671835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9fe83d96-0f3a-4ac8-8f54-3f0ef949279d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:02.672746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9fe83d96-0f3a-4ac8-8f54-3f0ef949279d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:02.673793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9fe83d96-0f3a-4ac8-8f54-3f0ef949279d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:02.675050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9fe83d96-0f3a-4ac8-8f54-3f0ef949279d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:03.173494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9fe83d96-0f3a-4ac8-8f54-3f0ef949279d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:03.178991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-01aa837d-19e4-4c50-91d7-c33bfe4a8fc3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:03.187981 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9fe83d96-0f3a-4ac8-8f54-3f0ef949279d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.532467 Aug 02 07:01:03.192609 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-01aa837d-19e4-4c50-91d7-c33bfe4a8fc3 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.575293 Aug 02 07:01:03.193574 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1518/3158] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:02 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:03.194705 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1641/3159] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:02 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:03.292809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f1a11e89-69ee-44b1-898e-bde53aa1dd3d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:03.294091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f1a11e89-69ee-44b1-898e-bde53aa1dd3d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:03.311854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1a11e89-69ee-44b1-898e-bde53aa1dd3d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:03.312504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1a11e89-69ee-44b1-898e-bde53aa1dd3d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:03.313480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1a11e89-69ee-44b1-898e-bde53aa1dd3d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:03.314131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1a11e89-69ee-44b1-898e-bde53aa1dd3d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:03.608486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f1a11e89-69ee-44b1-898e-bde53aa1dd3d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:03.622046 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f1a11e89-69ee-44b1-898e-bde53aa1dd3d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1322 microversion: 2.1 time: 0.333638 Aug 02 07:01:03.622679 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1519/3160] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:03 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:03.771579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-511f03c2-593d-43cc-871c-72f012c7aee9 req-262700aa-a760-4df6-ab49-4112461ea265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cab5887-4328-4207-9ac6-c884aa9806d1", "tag": "18fcf761-a89b-4d97-9ca7-3c303953a3d1"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:03.821069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-511f03c2-593d-43cc-871c-72f012c7aee9 req-262700aa-a760-4df6-ab49-4112461ea265 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:03.830616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-511f03c2-593d-43cc-871c-72f012c7aee9 req-262700aa-a760-4df6-ab49-4112461ea265 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:03.891119 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-511f03c2-593d-43cc-871c-72f012c7aee9 req-262700aa-a760-4df6-ab49-4112461ea265 service nova] Creating event network-changed:18fcf761-a89b-4d97-9ca7-3c303953a3d1 for instance 6cab5887-4328-4207-9ac6-c884aa9806d1 on n-h1-851337-3 Aug 02 07:01:03.898640 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-511f03c2-593d-43cc-871c-72f012c7aee9 req-262700aa-a760-4df6-ab49-4112461ea265 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145135 Aug 02 07:01:03.900792 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1642/3161] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:01:04.212611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e729aa42-408f-46d1-ae6f-36c67e4b9a0a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:04.213236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e729aa42-408f-46d1-ae6f-36c67e4b9a0a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:04.217704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-97dc2fc3-6955-4ca9-b304-55bb86f380e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:04.218799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-97dc2fc3-6955-4ca9-b304-55bb86f380e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:04.228798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e729aa42-408f-46d1-ae6f-36c67e4b9a0a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:04.230382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e729aa42-408f-46d1-ae6f-36c67e4b9a0a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:04.232116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e729aa42-408f-46d1-ae6f-36c67e4b9a0a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:04.233360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e729aa42-408f-46d1-ae6f-36c67e4b9a0a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:04.236583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97dc2fc3-6955-4ca9-b304-55bb86f380e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:04.237377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97dc2fc3-6955-4ca9-b304-55bb86f380e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:04.238765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97dc2fc3-6955-4ca9-b304-55bb86f380e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:04.239337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97dc2fc3-6955-4ca9-b304-55bb86f380e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:04.827709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-97dc2fc3-6955-4ca9-b304-55bb86f380e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:04.875728 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-97dc2fc3-6955-4ca9-b304-55bb86f380e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.662113 Aug 02 07:01:04.876873 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1643/3162] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:04 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:04.879267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e729aa42-408f-46d1-ae6f-36c67e4b9a0a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:04.893584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b8569c3c-047a-4632-9179-dbb466480616 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:04.900699 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e729aa42-408f-46d1-ae6f-36c67e4b9a0a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.692439 Aug 02 07:01:04.902711 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1520/3163] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:04 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:04.913199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b8569c3c-047a-4632-9179-dbb466480616 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:04.932998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8569c3c-047a-4632-9179-dbb466480616 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:04.933625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8569c3c-047a-4632-9179-dbb466480616 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:04.934757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8569c3c-047a-4632-9179-dbb466480616 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:04.935314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8569c3c-047a-4632-9179-dbb466480616 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:05.183103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b8569c3c-047a-4632-9179-dbb466480616 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:05.194274 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b8569c3c-047a-4632-9179-dbb466480616 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1516 microversion: 2.1 time: 0.315415 Aug 02 07:01:05.196007 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1644/3164] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:04 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1516 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:05.219092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-55ce38d0-216e-434f-add5-70b3c62dbb73 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:05.222371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-55ce38d0-216e-434f-add5-70b3c62dbb73 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:05.231895 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55ce38d0-216e-434f-add5-70b3c62dbb73 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:05.233221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55ce38d0-216e-434f-add5-70b3c62dbb73 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:05.236731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55ce38d0-216e-434f-add5-70b3c62dbb73 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:05.238476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55ce38d0-216e-434f-add5-70b3c62dbb73 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:05.288353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-55ce38d0-216e-434f-add5-70b3c62dbb73 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lazy-loading 'flavor' on Instance uuid 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:01:05.409441 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-55ce38d0-216e-434f-add5-70b3c62dbb73 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a/action" status: 200 len: 32 microversion: 2.1 time: 0.195714 Aug 02 07:01:05.416314 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1521/3165] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:01:05 2022] POST /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:01:05.426364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6fd81a6e-7730-426c-a8ba-6ab7ca965932 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:05.433204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6fd81a6e-7730-426c-a8ba-6ab7ca965932 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:05.465066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aae954e2-1f20-4c4b-ae61-06add6524b92 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34136355-adf2-4793-b3e9-1ac04b8d5d90"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:05.472779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aae954e2-1f20-4c4b-ae61-06add6524b92 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:05.489731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aae954e2-1f20-4c4b-ae61-06add6524b92 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:05.490629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aae954e2-1f20-4c4b-ae61-06add6524b92 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:05.491719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aae954e2-1f20-4c4b-ae61-06add6524b92 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:05.492390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aae954e2-1f20-4c4b-ae61-06add6524b92 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:05.506437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fd81a6e-7730-426c-a8ba-6ab7ca965932 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:05.507376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fd81a6e-7730-426c-a8ba-6ab7ca965932 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:05.508451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fd81a6e-7730-426c-a8ba-6ab7ca965932 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:05.509125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fd81a6e-7730-426c-a8ba-6ab7ca965932 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:05.840057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6fd81a6e-7730-426c-a8ba-6ab7ca965932 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:05.862362 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6fd81a6e-7730-426c-a8ba-6ab7ca965932 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.443333 Aug 02 07:01:05.869646 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1645/3166] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:05 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:05.922154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c4eda238-b32b-44f2-8d17-1ccf9b8b95a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:05.922919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c4eda238-b32b-44f2-8d17-1ccf9b8b95a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:05.938972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4eda238-b32b-44f2-8d17-1ccf9b8b95a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:05.939422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4eda238-b32b-44f2-8d17-1ccf9b8b95a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:05.940449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4eda238-b32b-44f2-8d17-1ccf9b8b95a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:05.940902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4eda238-b32b-44f2-8d17-1ccf9b8b95a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:05.945655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:06.011631 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aae954e2-1f20-4c4b-ae61-06add6524b92 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "POST /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.553239 Aug 02 07:01:06.018543 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1522/3167] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:01:05 2022] POST /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments => generated 194 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:01:06.025437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ff81b252-b1f9-481f-9952-375a9daaece3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:06.026443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ff81b252-b1f9-481f-9952-375a9daaece3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:06.036021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff81b252-b1f9-481f-9952-375a9daaece3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:06.037307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff81b252-b1f9-481f-9952-375a9daaece3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:06.038854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff81b252-b1f9-481f-9952-375a9daaece3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:06.039733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff81b252-b1f9-481f-9952-375a9daaece3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:06.256958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c4eda238-b32b-44f2-8d17-1ccf9b8b95a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:06.276451 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c4eda238-b32b-44f2-8d17-1ccf9b8b95a2 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.361514 Aug 02 07:01:06.290928 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1646/3168] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:05 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:06.387184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ff81b252-b1f9-481f-9952-375a9daaece3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:06.398583 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ff81b252-b1f9-481f-9952-375a9daaece3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.378156 Aug 02 07:01:06.399600 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1523/3169] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:06 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:06.897879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1ded43a4-9b10-4660-b974-671c4c3ceb90 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:06.899010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1ded43a4-9b10-4660-b974-671c4c3ceb90 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:06.933710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ded43a4-9b10-4660-b974-671c4c3ceb90 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:06.934870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ded43a4-9b10-4660-b974-671c4c3ceb90 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:06.937340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ded43a4-9b10-4660-b974-671c4c3ceb90 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:06.938313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ded43a4-9b10-4660-b974-671c4c3ceb90 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:07.178982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1ded43a4-9b10-4660-b974-671c4c3ceb90 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:07.191129 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1ded43a4-9b10-4660-b974-671c4c3ceb90 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.303004 Aug 02 07:01:07.192206 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1647/3170] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:06 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:07.308810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8a5e51a1-1b40-4aa2-b603-82c61d73f47a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:07.309937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8a5e51a1-1b40-4aa2-b603-82c61d73f47a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:07.324326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a5e51a1-1b40-4aa2-b603-82c61d73f47a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:07.325172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a5e51a1-1b40-4aa2-b603-82c61d73f47a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:07.326465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a5e51a1-1b40-4aa2-b603-82c61d73f47a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:07.327133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a5e51a1-1b40-4aa2-b603-82c61d73f47a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:07.421363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-26ec7953-1cac-468d-b01c-e633813b0af2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:07.422304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-26ec7953-1cac-468d-b01c-e633813b0af2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:07.430381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26ec7953-1cac-468d-b01c-e633813b0af2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:07.431235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26ec7953-1cac-468d-b01c-e633813b0af2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:07.433100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26ec7953-1cac-468d-b01c-e633813b0af2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:07.433757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26ec7953-1cac-468d-b01c-e633813b0af2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:07.724896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8a5e51a1-1b40-4aa2-b603-82c61d73f47a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:07.735477 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8a5e51a1-1b40-4aa2-b603-82c61d73f47a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.431833 Aug 02 07:01:07.736004 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1524/3171] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:07 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:07.798612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-26ec7953-1cac-468d-b01c-e633813b0af2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:07.854750 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-26ec7953-1cac-468d-b01c-e633813b0af2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.437591 Aug 02 07:01:07.865256 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1648/3172] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:07 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:08.215892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-952cf305-d581-4d68-bb72-19265a114a6b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:08.216558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-952cf305-d581-4d68-bb72-19265a114a6b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:08.224424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-952cf305-d581-4d68-bb72-19265a114a6b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:08.224969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-952cf305-d581-4d68-bb72-19265a114a6b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:08.225884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-952cf305-d581-4d68-bb72-19265a114a6b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:08.226433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-952cf305-d581-4d68-bb72-19265a114a6b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:08.501981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-952cf305-d581-4d68-bb72-19265a114a6b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:08.506552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:08.518944 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-952cf305-d581-4d68-bb72-19265a114a6b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.307451 Aug 02 07:01:08.520788 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1525/3173] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:08 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:08.768908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-db65a631-cb4d-4733-ab72-0bbbdc2621c6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:08.769686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-db65a631-cb4d-4733-ab72-0bbbdc2621c6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:08.782856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db65a631-cb4d-4733-ab72-0bbbdc2621c6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:08.787338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db65a631-cb4d-4733-ab72-0bbbdc2621c6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:08.788535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db65a631-cb4d-4733-ab72-0bbbdc2621c6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:08.789336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db65a631-cb4d-4733-ab72-0bbbdc2621c6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:08.882892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-29845f32-c004-4773-9cbb-3c6c4a98292b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:08.884371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-29845f32-c004-4773-9cbb-3c6c4a98292b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:08.905287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29845f32-c004-4773-9cbb-3c6c4a98292b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:08.906527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29845f32-c004-4773-9cbb-3c6c4a98292b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:08.907666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29845f32-c004-4773-9cbb-3c6c4a98292b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:08.908370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29845f32-c004-4773-9cbb-3c6c4a98292b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:09.141397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-db65a631-cb4d-4733-ab72-0bbbdc2621c6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:09.165337 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-db65a631-cb4d-4733-ab72-0bbbdc2621c6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.396809 Aug 02 07:01:09.169091 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1649/3174] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:08 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:09.375730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-29845f32-c004-4773-9cbb-3c6c4a98292b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:09.398406 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-29845f32-c004-4773-9cbb-3c6c4a98292b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.522664 Aug 02 07:01:09.409106 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1526/3175] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:08 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:09.552351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d1cca2bf-93ff-4c0d-bed4-9407299da737 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:09.553389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d1cca2bf-93ff-4c0d-bed4-9407299da737 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:09.572349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1cca2bf-93ff-4c0d-bed4-9407299da737 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:09.573364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1cca2bf-93ff-4c0d-bed4-9407299da737 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:09.574481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1cca2bf-93ff-4c0d-bed4-9407299da737 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:09.575128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1cca2bf-93ff-4c0d-bed4-9407299da737 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:10.189964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-52ef0e3f-7975-4e1e-bdaa-b3b34b37f9de tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:10.191334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-52ef0e3f-7975-4e1e-bdaa-b3b34b37f9de tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:10.208124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-52ef0e3f-7975-4e1e-bdaa-b3b34b37f9de tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:10.209351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-52ef0e3f-7975-4e1e-bdaa-b3b34b37f9de tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:10.210439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-52ef0e3f-7975-4e1e-bdaa-b3b34b37f9de tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:10.211076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-52ef0e3f-7975-4e1e-bdaa-b3b34b37f9de tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:10.522752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d1cca2bf-93ff-4c0d-bed4-9407299da737 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:10.540140 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d1cca2bf-93ff-4c0d-bed4-9407299da737 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.991607 Aug 02 07:01:10.543149 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1650/3176] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:09 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:10.556238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6a8fee99-cbc8-4df1-8187-2d6feec22d88 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:10.560035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6a8fee99-cbc8-4df1-8187-2d6feec22d88 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:10.588311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a8fee99-cbc8-4df1-8187-2d6feec22d88 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:10.590985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a8fee99-cbc8-4df1-8187-2d6feec22d88 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:10.598371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a8fee99-cbc8-4df1-8187-2d6feec22d88 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:10.599647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a8fee99-cbc8-4df1-8187-2d6feec22d88 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:11.270520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6a8fee99-cbc8-4df1-8187-2d6feec22d88 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:11.273590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-52ef0e3f-7975-4e1e-bdaa-b3b34b37f9de tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:11.285824 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-52ef0e3f-7975-4e1e-bdaa-b3b34b37f9de tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 1.100069 Aug 02 07:01:11.302100 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1527/3177] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:10 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:11.316274 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6a8fee99-cbc8-4df1-8187-2d6feec22d88 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.768946 Aug 02 07:01:11.318619 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1651/3178] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:10 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:11.570330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b8dd3b47-fe33-45d2-a7e3-baabf357a173 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:11.570858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b8dd3b47-fe33-45d2-a7e3-baabf357a173 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:11.595600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8dd3b47-fe33-45d2-a7e3-baabf357a173 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:11.598147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8dd3b47-fe33-45d2-a7e3-baabf357a173 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:11.603750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8dd3b47-fe33-45d2-a7e3-baabf357a173 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:11.605166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8dd3b47-fe33-45d2-a7e3-baabf357a173 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:11.995567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b8dd3b47-fe33-45d2-a7e3-baabf357a173 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:12.020979 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b8dd3b47-fe33-45d2-a7e3-baabf357a173 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.455099 Aug 02 07:01:12.024574 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1528/3179] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:11 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:12.307433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-98275f7d-b8fb-483b-9c21-5df7d3c5cbf0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:12.308740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-98275f7d-b8fb-483b-9c21-5df7d3c5cbf0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:12.326513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98275f7d-b8fb-483b-9c21-5df7d3c5cbf0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:12.327334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98275f7d-b8fb-483b-9c21-5df7d3c5cbf0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:12.328972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98275f7d-b8fb-483b-9c21-5df7d3c5cbf0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:12.329593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98275f7d-b8fb-483b-9c21-5df7d3c5cbf0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:12.356008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-07693209-1119-4927-b7b2-1268b70d9aef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:12.356636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-07693209-1119-4927-b7b2-1268b70d9aef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:12.374425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07693209-1119-4927-b7b2-1268b70d9aef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:12.374960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07693209-1119-4927-b7b2-1268b70d9aef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:12.375794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07693209-1119-4927-b7b2-1268b70d9aef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:12.377423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07693209-1119-4927-b7b2-1268b70d9aef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:12.812086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-98275f7d-b8fb-483b-9c21-5df7d3c5cbf0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:12.821223 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-98275f7d-b8fb-483b-9c21-5df7d3c5cbf0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.518504 Aug 02 07:01:12.850247 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1652/3180] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:12 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:13.046655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5bd86bc8-088c-4d2e-9dee-ce8181332003 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:13.047661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5bd86bc8-088c-4d2e-9dee-ce8181332003 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:13.063668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bd86bc8-088c-4d2e-9dee-ce8181332003 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:13.064590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bd86bc8-088c-4d2e-9dee-ce8181332003 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:13.066892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bd86bc8-088c-4d2e-9dee-ce8181332003 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:13.067665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bd86bc8-088c-4d2e-9dee-ce8181332003 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:13.610518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-07693209-1119-4927-b7b2-1268b70d9aef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:13.621362 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-07693209-1119-4927-b7b2-1268b70d9aef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 1.270389 Aug 02 07:01:13.621983 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1529/3181] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:12 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:13.652118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5bd86bc8-088c-4d2e-9dee-ce8181332003 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:13.667975 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5bd86bc8-088c-4d2e-9dee-ce8181332003 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.626223 Aug 02 07:01:13.669290 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1653/3182] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:13 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:13.867224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-21b7e6d1-7041-451f-a47b-2b6c501d8808 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:13.869138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-21b7e6d1-7041-451f-a47b-2b6c501d8808 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:13.912662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21b7e6d1-7041-451f-a47b-2b6c501d8808 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:13.918549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21b7e6d1-7041-451f-a47b-2b6c501d8808 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:13.919688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21b7e6d1-7041-451f-a47b-2b6c501d8808 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:13.921263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21b7e6d1-7041-451f-a47b-2b6c501d8808 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:14.215019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-21b7e6d1-7041-451f-a47b-2b6c501d8808 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:14.224025 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-21b7e6d1-7041-451f-a47b-2b6c501d8808 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.371014 Aug 02 07:01:14.224967 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1530/3183] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:13 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:14.648340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f4e04df8-bc73-449e-860c-e2268a9d3c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:14.649703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f4e04df8-bc73-449e-860c-e2268a9d3c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:14.661386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4e04df8-bc73-449e-860c-e2268a9d3c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:14.662605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4e04df8-bc73-449e-860c-e2268a9d3c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:14.663569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4e04df8-bc73-449e-860c-e2268a9d3c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:14.664738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4e04df8-bc73-449e-860c-e2268a9d3c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:14.691460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34659d24-8698-4934-96c8-bf6cfd03d6a3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:14.693178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-34659d24-8698-4934-96c8-bf6cfd03d6a3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:14.712337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34659d24-8698-4934-96c8-bf6cfd03d6a3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:14.713363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34659d24-8698-4934-96c8-bf6cfd03d6a3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:14.714388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34659d24-8698-4934-96c8-bf6cfd03d6a3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:14.714992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34659d24-8698-4934-96c8-bf6cfd03d6a3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:15.228496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-34659d24-8698-4934-96c8-bf6cfd03d6a3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:15.240663 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-34659d24-8698-4934-96c8-bf6cfd03d6a3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.555719 Aug 02 07:01:15.266663 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1531/3184] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:14 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:15.281209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-de5c2dea-7248-44c5-8262-a9a2e058197d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:15.283500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-de5c2dea-7248-44c5-8262-a9a2e058197d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:15.314215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de5c2dea-7248-44c5-8262-a9a2e058197d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:15.316906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de5c2dea-7248-44c5-8262-a9a2e058197d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:15.322043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de5c2dea-7248-44c5-8262-a9a2e058197d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:15.324917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de5c2dea-7248-44c5-8262-a9a2e058197d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:15.492930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f4e04df8-bc73-449e-860c-e2268a9d3c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:15.509926 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f4e04df8-bc73-449e-860c-e2268a9d3c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.864315 Aug 02 07:01:15.511317 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1654/3185] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:14 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:15.801106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-de5c2dea-7248-44c5-8262-a9a2e058197d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:15.817688 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-de5c2dea-7248-44c5-8262-a9a2e058197d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.546928 Aug 02 07:01:15.822512 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1532/3186] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:15 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:16.279131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4af4bfd6-4a37-470e-be03-d2c1acff8d54 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:16.280060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4af4bfd6-4a37-470e-be03-d2c1acff8d54 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:16.291922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4af4bfd6-4a37-470e-be03-d2c1acff8d54 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:16.293015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4af4bfd6-4a37-470e-be03-d2c1acff8d54 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:16.294132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4af4bfd6-4a37-470e-be03-d2c1acff8d54 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:16.295356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4af4bfd6-4a37-470e-be03-d2c1acff8d54 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:16.533748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7687581d-f5be-4858-8b8a-e4f87517fab9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:16.534418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7687581d-f5be-4858-8b8a-e4f87517fab9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:16.545354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7687581d-f5be-4858-8b8a-e4f87517fab9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:16.545805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7687581d-f5be-4858-8b8a-e4f87517fab9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:16.546626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7687581d-f5be-4858-8b8a-e4f87517fab9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:16.547061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7687581d-f5be-4858-8b8a-e4f87517fab9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:16.610178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4af4bfd6-4a37-470e-be03-d2c1acff8d54 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:16.620883 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4af4bfd6-4a37-470e-be03-d2c1acff8d54 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.347091 Aug 02 07:01:16.622447 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1655/3187] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:16 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:16.854759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02b87223-eae0-4c71-9597-c954e6a69835 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:16.855439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-02b87223-eae0-4c71-9597-c954e6a69835 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:16.857384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=68 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:16.865482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02b87223-eae0-4c71-9597-c954e6a69835 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:16.865962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02b87223-eae0-4c71-9597-c954e6a69835 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:16.866767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02b87223-eae0-4c71-9597-c954e6a69835 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:16.867200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02b87223-eae0-4c71-9597-c954e6a69835 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:17.209692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7687581d-f5be-4858-8b8a-e4f87517fab9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:17.225545 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7687581d-f5be-4858-8b8a-e4f87517fab9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.696651 Aug 02 07:01:17.251167 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1533/3188] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:16 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:17.367899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-02b87223-eae0-4c71-9597-c954e6a69835 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:17.388267 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-02b87223-eae0-4c71-9597-c954e6a69835 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1512 microversion: 2.1 time: 0.537409 Aug 02 07:01:17.391816 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1656/3189] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:16 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1512 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:17.645646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7150b58c-d415-4ea8-b288-2e1a50eb4c52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:17.646593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7150b58c-d415-4ea8-b288-2e1a50eb4c52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:17.656308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7150b58c-d415-4ea8-b288-2e1a50eb4c52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:17.656445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7150b58c-d415-4ea8-b288-2e1a50eb4c52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:17.657445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7150b58c-d415-4ea8-b288-2e1a50eb4c52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:17.658095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7150b58c-d415-4ea8-b288-2e1a50eb4c52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:17.918264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7150b58c-d415-4ea8-b288-2e1a50eb4c52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:17.934971 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7150b58c-d415-4ea8-b288-2e1a50eb4c52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.295852 Aug 02 07:01:17.935582 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1534/3190] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:17 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:18.284496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c8330ff7-1536-4e3e-9e72-3097222e1700 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:18.285235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c8330ff7-1536-4e3e-9e72-3097222e1700 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:18.298919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c8330ff7-1536-4e3e-9e72-3097222e1700 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:18.299594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c8330ff7-1536-4e3e-9e72-3097222e1700 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:18.300878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c8330ff7-1536-4e3e-9e72-3097222e1700 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:18.301504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c8330ff7-1536-4e3e-9e72-3097222e1700 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:18.417058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3a1f4de1-f6db-49fe-afe6-6673f3f021d4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:18.417754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3a1f4de1-f6db-49fe-afe6-6673f3f021d4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:18.431695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a1f4de1-f6db-49fe-afe6-6673f3f021d4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:18.432437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a1f4de1-f6db-49fe-afe6-6673f3f021d4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:18.433907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a1f4de1-f6db-49fe-afe6-6673f3f021d4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:18.434558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a1f4de1-f6db-49fe-afe6-6673f3f021d4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:18.819145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3a1f4de1-f6db-49fe-afe6-6673f3f021d4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:18.843808 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3a1f4de1-f6db-49fe-afe6-6673f3f021d4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1489 microversion: 2.1 time: 0.427278 Aug 02 07:01:18.843808 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1535/3191] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:18 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1489 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:18.863959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1e14374b-553e-47fb-ae6b-f4bc53599416 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:18.864628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1e14374b-553e-47fb-ae6b-f4bc53599416 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:18.873232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e14374b-553e-47fb-ae6b-f4bc53599416 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:18.874406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e14374b-553e-47fb-ae6b-f4bc53599416 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:18.875865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e14374b-553e-47fb-ae6b-f4bc53599416 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:18.876702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e14374b-553e-47fb-ae6b-f4bc53599416 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:18.939971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1e14374b-553e-47fb-ae6b-f4bc53599416 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:01:18.948088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c8330ff7-1536-4e3e-9e72-3097222e1700 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:18.977725 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c8330ff7-1536-4e3e-9e72-3097222e1700 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1716 microversion: 2.1 time: 0.706446 Aug 02 07:01:18.995586 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1657/3192] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:18 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1716 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:18.995586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-31f26cf9-b75b-4572-b945-7921c4ed2100 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:18.995586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-31f26cf9-b75b-4572-b945-7921c4ed2100 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:19.007868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-31f26cf9-b75b-4572-b945-7921c4ed2100 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:19.008326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-31f26cf9-b75b-4572-b945-7921c4ed2100 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:19.009146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-31f26cf9-b75b-4572-b945-7921c4ed2100 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:19.009576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-31f26cf9-b75b-4572-b945-7921c4ed2100 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:19.153592 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1e14374b-553e-47fb-ae6b-f4bc53599416 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 204 len: 0 microversion: 2.1 time: 0.293699 Aug 02 07:01:19.154695 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1536/3193] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:01:18 2022] DELETE /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 07:01:19.166878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ba606a1f-47fa-43bd-be01-aa8d6ac1df16 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:19.167597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ba606a1f-47fa-43bd-be01-aa8d6ac1df16 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:19.183018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba606a1f-47fa-43bd-be01-aa8d6ac1df16 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:19.184969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba606a1f-47fa-43bd-be01-aa8d6ac1df16 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:19.188563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba606a1f-47fa-43bd-be01-aa8d6ac1df16 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:19.189860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba606a1f-47fa-43bd-be01-aa8d6ac1df16 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:19.245222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-31f26cf9-b75b-4572-b945-7921c4ed2100 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:19.255163 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-31f26cf9-b75b-4572-b945-7921c4ed2100 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.271541 Aug 02 07:01:19.265968 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1658/3194] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:18 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:19.473092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ba606a1f-47fa-43bd-be01-aa8d6ac1df16 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:19.500194 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ba606a1f-47fa-43bd-be01-aa8d6ac1df16 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1495 microversion: 2.1 time: 0.338225 Aug 02 07:01:19.500194 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1537/3195] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:19 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1495 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:20.024148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2b4c455d-533b-4ae0-9402-3b37c06dd453 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:20.025607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2b4c455d-533b-4ae0-9402-3b37c06dd453 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:20.034137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b4c455d-533b-4ae0-9402-3b37c06dd453 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:20.034758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b4c455d-533b-4ae0-9402-3b37c06dd453 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:20.035707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b4c455d-533b-4ae0-9402-3b37c06dd453 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:20.037226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b4c455d-533b-4ae0-9402-3b37c06dd453 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:20.201529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2b4c455d-533b-4ae0-9402-3b37c06dd453 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:20.211385 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2b4c455d-533b-4ae0-9402-3b37c06dd453 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1706 microversion: 2.1 time: 0.191571 Aug 02 07:01:20.212015 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1659/3196] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:20 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1706 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:20.233639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b5b65829-61f6-4220-8741-bc23a98751dd tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '.version_select at 0x7f927ab065e0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:20.238426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5b65829-61f6-4220-8741-bc23a98751dd tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:20.238818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5b65829-61f6-4220-8741-bc23a98751dd tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:20.249278 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b5b65829-61f6-4220-8741-bc23a98751dd tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.020696 Aug 02 07:01:20.250272 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1538/3197] 10.222.0.79 () {58 vars in 1143 bytes} [Tue Aug 2 07:01:20 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:20.264845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-78e8f217-f78f-4fdf-8a07-bc1f01c3463c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:20.265468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-78e8f217-f78f-4fdf-8a07-bc1f01c3463c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:20.272935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e8f217-f78f-4fdf-8a07-bc1f01c3463c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:20.273808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e8f217-f78f-4fdf-8a07-bc1f01c3463c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:20.274938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e8f217-f78f-4fdf-8a07-bc1f01c3463c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:20.276920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-573d9a5d-7ec7-4eb3-a121-231e3c173a59 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:20.277872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-573d9a5d-7ec7-4eb3-a121-231e3c173a59 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:20.284561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-573d9a5d-7ec7-4eb3-a121-231e3c173a59 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:20.285094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-573d9a5d-7ec7-4eb3-a121-231e3c173a59 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:20.286002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-573d9a5d-7ec7-4eb3-a121-231e3c173a59 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:20.286616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-573d9a5d-7ec7-4eb3-a121-231e3c173a59 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:20.300124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e8f217-f78f-4fdf-8a07-bc1f01c3463c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:20.551248 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-78e8f217-f78f-4fdf-8a07-bc1f01c3463c tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1857 microversion: 2.1 time: 0.289995 Aug 02 07:01:20.551850 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1660/3198] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:20 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1857 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:20.616226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-573d9a5d-7ec7-4eb3-a121-231e3c173a59 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:20.685051 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-573d9a5d-7ec7-4eb3-a121-231e3c173a59 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.398464 Aug 02 07:01:20.685051 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1539/3199] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:20 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:20.695943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ef52ef92-7c7a-4937-ae32-9ef066b3840a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:20.695943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ef52ef92-7c7a-4937-ae32-9ef066b3840a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:20.713328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef52ef92-7c7a-4937-ae32-9ef066b3840a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:20.713580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef52ef92-7c7a-4937-ae32-9ef066b3840a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:20.714550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef52ef92-7c7a-4937-ae32-9ef066b3840a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:20.714997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef52ef92-7c7a-4937-ae32-9ef066b3840a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:20.967662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd319bb9-60f0-4cea-b11d-1730b64d22ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:20.968417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dd319bb9-60f0-4cea-b11d-1730b64d22ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:20.981431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd319bb9-60f0-4cea-b11d-1730b64d22ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:20.983070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd319bb9-60f0-4cea-b11d-1730b64d22ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:20.988818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd319bb9-60f0-4cea-b11d-1730b64d22ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:20.990620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd319bb9-60f0-4cea-b11d-1730b64d22ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:20.991754 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ef52ef92-7c7a-4937-ae32-9ef066b3840a tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1857 microversion: 2.1 time: 0.308130 Aug 02 07:01:20.992558 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1540/3200] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:20 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1857 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:21.159543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f6fc3df4-1647-485a-aff0-f6772aa857dd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:21.160867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f6fc3df4-1647-485a-aff0-f6772aa857dd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:21.213834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6fc3df4-1647-485a-aff0-f6772aa857dd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:21.213834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6fc3df4-1647-485a-aff0-f6772aa857dd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:21.214608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6fc3df4-1647-485a-aff0-f6772aa857dd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:21.216572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6fc3df4-1647-485a-aff0-f6772aa857dd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:21.293091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dd319bb9-60f0-4cea-b11d-1730b64d22ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:21.294051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:21.306633 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dd319bb9-60f0-4cea-b11d-1730b64d22ac tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1495 microversion: 2.1 time: 0.753067 Aug 02 07:01:21.308453 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1661/3201] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:20 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1495 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:21.485394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-f6fc3df4-1647-485a-aff0-f6772aa857dd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lazy-loading 'services' on Instance uuid 6cab5887-4328-4207-9ac6-c884aa9806d1 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:01:21.643274 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f6fc3df4-1647-485a-aff0-f6772aa857dd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments/e83df105-3b87-4e8b-aad1-c461118d94e2" status: 202 len: 0 microversion: 2.1 time: 0.485398 Aug 02 07:01:21.643987 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1541/3202] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:01:21 2022] DELETE /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments/e83df105-3b87-4e8b-aad1-c461118d94e2 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:01:21.654106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-98be68f6-5d50-48ff-95fd-b7ac8a454b13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:21.657619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-98be68f6-5d50-48ff-95fd-b7ac8a454b13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:21.687963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98be68f6-5d50-48ff-95fd-b7ac8a454b13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:21.688566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98be68f6-5d50-48ff-95fd-b7ac8a454b13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:21.689942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98be68f6-5d50-48ff-95fd-b7ac8a454b13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:21.689942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98be68f6-5d50-48ff-95fd-b7ac8a454b13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:21.703825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a86d758b-5272-4c54-b074-170bce9b1436 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:21.704535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a86d758b-5272-4c54-b074-170bce9b1436 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:21.718312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a86d758b-5272-4c54-b074-170bce9b1436 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:21.718767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a86d758b-5272-4c54-b074-170bce9b1436 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:21.719611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a86d758b-5272-4c54-b074-170bce9b1436 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:21.719986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a86d758b-5272-4c54-b074-170bce9b1436 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:21.787325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:21.803353 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-98be68f6-5d50-48ff-95fd-b7ac8a454b13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154784 Aug 02 07:01:21.814288 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1662/3203] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:01:21 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:21.998621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a86d758b-5272-4c54-b074-170bce9b1436 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:22.010330 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a86d758b-5272-4c54-b074-170bce9b1436 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.310603 Aug 02 07:01:22.025338 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1542/3204] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:21 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:22.265347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-edebfa15-0da8-408e-9154-15270425bf85 req-02ee0f0c-b71e-4f11-b2eb-910bb65c1af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f8b31f7-8832-401c-80ea-c9d595559396", "name": "network-vif-deleted", "tag": "14bca030-e56d-4853-a080-fc06d7a4a51f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:22.293050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-edebfa15-0da8-408e-9154-15270425bf85 req-02ee0f0c-b71e-4f11-b2eb-910bb65c1af5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:22.293621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-edebfa15-0da8-408e-9154-15270425bf85 req-02ee0f0c-b71e-4f11-b2eb-910bb65c1af5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:22.313539 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-edebfa15-0da8-408e-9154-15270425bf85 req-02ee0f0c-b71e-4f11-b2eb-910bb65c1af5 service nova] Creating event network-vif-deleted:14bca030-e56d-4853-a080-fc06d7a4a51f for instance 3f8b31f7-8832-401c-80ea-c9d595559396 on n-h1-851337-3 Aug 02 07:01:22.320634 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-edebfa15-0da8-408e-9154-15270425bf85 req-02ee0f0c-b71e-4f11-b2eb-910bb65c1af5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058939 Aug 02 07:01:22.321986 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1663/3205] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:22.334704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dafbbe88-b126-469a-a99b-67c5e8211d1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:22.335448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dafbbe88-b126-469a-a99b-67c5e8211d1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:22.343253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dafbbe88-b126-469a-a99b-67c5e8211d1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:22.344175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dafbbe88-b126-469a-a99b-67c5e8211d1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:22.345227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dafbbe88-b126-469a-a99b-67c5e8211d1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:22.345926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dafbbe88-b126-469a-a99b-67c5e8211d1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:22.553238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dafbbe88-b126-469a-a99b-67c5e8211d1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:22.562044 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dafbbe88-b126-469a-a99b-67c5e8211d1d tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 200 len: 1286 microversion: 2.1 time: 0.232665 Aug 02 07:01:22.567308 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1543/3206] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:22 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 1286 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:22.825431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bb3c906a-46de-48d5-9133-fc3ff43b21da tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:22.833783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bb3c906a-46de-48d5-9133-fc3ff43b21da tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:22.881672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb3c906a-46de-48d5-9133-fc3ff43b21da tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:22.883173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb3c906a-46de-48d5-9133-fc3ff43b21da tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:22.884472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb3c906a-46de-48d5-9133-fc3ff43b21da tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:22.885522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb3c906a-46de-48d5-9133-fc3ff43b21da tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:22.983835 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bb3c906a-46de-48d5-9133-fc3ff43b21da tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166314 Aug 02 07:01:22.990449 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1664/3207] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:01:22 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:23.034597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b4b4e908-e2df-4314-a403-5118829125b1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:23.036108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b4b4e908-e2df-4314-a403-5118829125b1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:23.053737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4b4e908-e2df-4314-a403-5118829125b1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:23.054230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4b4e908-e2df-4314-a403-5118829125b1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:23.055031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4b4e908-e2df-4314-a403-5118829125b1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:23.055470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4b4e908-e2df-4314-a403-5118829125b1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:23.323113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b4b4e908-e2df-4314-a403-5118829125b1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:23.333432 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b4b4e908-e2df-4314-a403-5118829125b1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.304123 Aug 02 07:01:23.334679 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1544/3208] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:23 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:23.611987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-353e9354-218a-4449-8691-d27cfa4c95cc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:23.617700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-353e9354-218a-4449-8691-d27cfa4c95cc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:23.639258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-353e9354-218a-4449-8691-d27cfa4c95cc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:23.639996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-353e9354-218a-4449-8691-d27cfa4c95cc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:23.641056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-353e9354-218a-4449-8691-d27cfa4c95cc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:23.641654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-353e9354-218a-4449-8691-d27cfa4c95cc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:23.662928 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-353e9354-218a-4449-8691-d27cfa4c95cc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-353e9354-218a-4449-8691-d27cfa4c95cc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 HTTP/1.1 Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '3f8b31f7-8832-401c-80ea-c9d595559396'} Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:23.667195 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:23.672270 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:23.672270 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:23.672270 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:23.672270 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:23.672270 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:23.672270 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:23.672270 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:23.675301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-353e9354-218a-4449-8691-d27cfa4c95cc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:23.676888 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-353e9354-218a-4449-8691-d27cfa4c95cc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 404 len: 111 microversion: 2.1 time: 0.080070 Aug 02 07:01:23.677689 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1665/3209] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:23 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:23.749166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-976683076", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "3904ca9d-0f3a-42df-acde-f1e02b7b9720"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:23.822390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] validate_networks() for [('3904ca9d-0f3a-42df-acde-f1e02b7b9720', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:01:23.999532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-96fdeeec-ce6b-4a68-bac6-5c883f9b89a3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:24.001944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-96fdeeec-ce6b-4a68-bac6-5c883f9b89a3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:24.015296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96fdeeec-ce6b-4a68-bac6-5c883f9b89a3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:24.015759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96fdeeec-ce6b-4a68-bac6-5c883f9b89a3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:24.016556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96fdeeec-ce6b-4a68-bac6-5c883f9b89a3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:24.017000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96fdeeec-ce6b-4a68-bac6-5c883f9b89a3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:24.099076 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-96fdeeec-ce6b-4a68-bac6-5c883f9b89a3 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104002 Aug 02 07:01:24.109079 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1666/3210] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:01:23 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:24.307944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ede23c35-60dd-40e0-97fb-81b5e8838463 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:24.310715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ede23c35-60dd-40e0-97fb-81b5e8838463 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:24.318642 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ede23c35-60dd-40e0-97fb-81b5e8838463 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:24.319525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ede23c35-60dd-40e0-97fb-81b5e8838463 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:24.320834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ede23c35-60dd-40e0-97fb-81b5e8838463 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:24.321492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ede23c35-60dd-40e0-97fb-81b5e8838463 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:24.366592 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ede23c35-60dd-40e0-97fb-81b5e8838463 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062623 Aug 02 07:01:24.369507 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1667/3211] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:01:24 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments => generated 371 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:01:24.382129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-856af8ac-f14a-4dfa-9111-76b199bc8f36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:24.384092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-856af8ac-f14a-4dfa-9111-76b199bc8f36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:24.397217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-856af8ac-f14a-4dfa-9111-76b199bc8f36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:24.398019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-856af8ac-f14a-4dfa-9111-76b199bc8f36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:24.399569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-856af8ac-f14a-4dfa-9111-76b199bc8f36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:24.400406 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-856af8ac-f14a-4dfa-9111-76b199bc8f36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:24.545735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:01:24.546913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:01:24.550127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:01:24.550577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:01:24.551402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:01:24.574467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:24.575133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:24.577009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:24.580717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:24.634034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Getting quotas for project a004889882844be18e4c30827645050e. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:01:24.674823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Getting quotas for user 0d6870f29383493c86db7e30259b8a8b and project a004889882844be18e4c30827645050e. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:01:24.708183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:01:24.711040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:01:24.716874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-856af8ac-f14a-4dfa-9111-76b199bc8f36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:24.730416 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-856af8ac-f14a-4dfa-9111-76b199bc8f36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.359236 Aug 02 07:01:24.731341 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1668/3212] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:24 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:24.745001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a91c679b-62d3-40f6-bbd2-40c4fe309d9e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:24.746653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a91c679b-62d3-40f6-bbd2-40c4fe309d9e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:24.761095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a91c679b-62d3-40f6-bbd2-40c4fe309d9e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:24.763713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a91c679b-62d3-40f6-bbd2-40c4fe309d9e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:24.764557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a91c679b-62d3-40f6-bbd2-40c4fe309d9e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:24.765024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a91c679b-62d3-40f6-bbd2-40c4fe309d9e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:24.784482 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a9e55f78-d7bf-44cb-b114-f3b1b28799f1 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.039124 Aug 02 07:01:24.785764 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1545/3213] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:01:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:01:24.797038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-20b57a3b-654a-49d6-8735-19531bdba1b9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:24.797872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-20b57a3b-654a-49d6-8735-19531bdba1b9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:24.917544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-20b57a3b-654a-49d6-8735-19531bdba1b9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:24.925308 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a91c679b-62d3-40f6-bbd2-40c4fe309d9e tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments/df8ca14f-f0ce-4623-b1c6-8d21c93a2941" status: 200 len: 194 microversion: 2.1 time: 0.188813 Aug 02 07:01:24.928593 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1669/3214] 10.222.0.79 () {58 vars in 1413 bytes} [Tue Aug 2 07:01:24 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments/df8ca14f-f0ce-4623-b1c6-8d21c93a2941 => generated 194 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:24.932958 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-20b57a3b-654a-49d6-8735-19531bdba1b9 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1214 microversion: 2.1 time: 0.132539 Aug 02 07:01:24.934234 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1546/3215] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:24 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:24.941773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b7cd109c-6397-47c4-b7cb-493203f3b5ff tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:24.948337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b7cd109c-6397-47c4-b7cb-493203f3b5ff tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:24.963907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7cd109c-6397-47c4-b7cb-493203f3b5ff tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:24.965672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7cd109c-6397-47c4-b7cb-493203f3b5ff tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:24.966713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7cd109c-6397-47c4-b7cb-493203f3b5ff tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:24.969597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7cd109c-6397-47c4-b7cb-493203f3b5ff tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:25.115947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-460e5333-9fd9-4c07-ae95-393ea3712105 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:25.119058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-460e5333-9fd9-4c07-ae95-393ea3712105 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:25.174613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-b7cd109c-6397-47c4-b7cb-493203f3b5ff tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lazy-loading 'services' on Instance uuid a42f890a-37e8-42bd-a345-d4dddadd50a1 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:01:25.177823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-460e5333-9fd9-4c07-ae95-393ea3712105 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:25.178309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-460e5333-9fd9-4c07-ae95-393ea3712105 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:25.179099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-460e5333-9fd9-4c07-ae95-393ea3712105 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:25.179529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-460e5333-9fd9-4c07-ae95-393ea3712105 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:25.309225 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-460e5333-9fd9-4c07-ae95-393ea3712105 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197932 Aug 02 07:01:25.310590 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1547/3216] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:01:25 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:01:25.388121 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b7cd109c-6397-47c4-b7cb-493203f3b5ff tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments/df8ca14f-f0ce-4623-b1c6-8d21c93a2941" status: 202 len: 0 microversion: 2.1 time: 0.454476 Aug 02 07:01:25.389358 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1670/3217] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:01:24 2022] DELETE /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments/df8ca14f-f0ce-4623-b1c6-8d21c93a2941 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:01:25.754989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a1deb4f6-3b80-4ac3-ad11-4d04649babfa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:25.756654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a1deb4f6-3b80-4ac3-ad11-4d04649babfa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:25.764872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1deb4f6-3b80-4ac3-ad11-4d04649babfa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:25.772326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1deb4f6-3b80-4ac3-ad11-4d04649babfa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:25.773439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1deb4f6-3b80-4ac3-ad11-4d04649babfa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:25.774038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1deb4f6-3b80-4ac3-ad11-4d04649babfa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:25.984474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c22d8c0-36da-4507-861d-45d2581d4320 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:25.985438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1c22d8c0-36da-4507-861d-45d2581d4320 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:26.458216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1c22d8c0-36da-4507-861d-45d2581d4320 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:26.471657 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1c22d8c0-36da-4507-861d-45d2581d4320 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1214 microversion: 2.1 time: 0.519292 Aug 02 07:01:26.474516 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1671/3218] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:25 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1214 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:26.479921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b7e0ca60-31d4-4a59-9a42-152e788310bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:26.490844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b7e0ca60-31d4-4a59-9a42-152e788310bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:26.509458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7e0ca60-31d4-4a59-9a42-152e788310bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:26.512613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7e0ca60-31d4-4a59-9a42-152e788310bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:26.513490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7e0ca60-31d4-4a59-9a42-152e788310bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:26.513961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7e0ca60-31d4-4a59-9a42-152e788310bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:26.565593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a1deb4f6-3b80-4ac3-ad11-4d04649babfa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:26.586205 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a1deb4f6-3b80-4ac3-ad11-4d04649babfa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.835554 Aug 02 07:01:26.589579 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1548/3219] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:25 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:26.623269 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b7e0ca60-31d4-4a59-9a42-152e788310bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147017 Aug 02 07:01:26.623886 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1672/3220] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:01:26 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:27.494476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-47cd3591-482b-45be-bb5f-7e974d688fa7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:27.495366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-47cd3591-482b-45be-bb5f-7e974d688fa7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:27.508920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47cd3591-482b-45be-bb5f-7e974d688fa7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:27.518079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47cd3591-482b-45be-bb5f-7e974d688fa7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:27.520553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47cd3591-482b-45be-bb5f-7e974d688fa7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:27.531446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47cd3591-482b-45be-bb5f-7e974d688fa7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:27.616244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5650d20b-6298-4326-8ff2-348824af30be tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:27.617771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5650d20b-6298-4326-8ff2-348824af30be tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:27.635706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5650d20b-6298-4326-8ff2-348824af30be tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:27.639686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5650d20b-6298-4326-8ff2-348824af30be tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:27.641057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5650d20b-6298-4326-8ff2-348824af30be tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:27.641767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5650d20b-6298-4326-8ff2-348824af30be tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:27.690420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-47cd3591-482b-45be-bb5f-7e974d688fa7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:27.704619 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-47cd3591-482b-45be-bb5f-7e974d688fa7 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1272 microversion: 2.1 time: 0.214426 Aug 02 07:01:27.708157 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1549/3221] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:27 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:27.717372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d330123d-496b-47ac-9a00-a798dba96f2f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:27.721574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d330123d-496b-47ac-9a00-a798dba96f2f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:27.745309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d330123d-496b-47ac-9a00-a798dba96f2f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:27.747648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d330123d-496b-47ac-9a00-a798dba96f2f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:27.750281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d330123d-496b-47ac-9a00-a798dba96f2f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:27.752135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d330123d-496b-47ac-9a00-a798dba96f2f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:27.830648 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d330123d-496b-47ac-9a00-a798dba96f2f tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120812 Aug 02 07:01:27.836966 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1550/3222] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:01:27 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:28.063050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5650d20b-6298-4326-8ff2-348824af30be tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:28.090040 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5650d20b-6298-4326-8ff2-348824af30be tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.476946 Aug 02 07:01:28.091419 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1673/3223] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:27 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:28.732568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7899c106-ade5-4d67-9fd8-6bf1f6de328f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:28.733636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7899c106-ade5-4d67-9fd8-6bf1f6de328f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:28.760568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7899c106-ade5-4d67-9fd8-6bf1f6de328f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:28.761333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7899c106-ade5-4d67-9fd8-6bf1f6de328f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:28.762661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7899c106-ade5-4d67-9fd8-6bf1f6de328f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:28.763324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7899c106-ade5-4d67-9fd8-6bf1f6de328f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:28.844678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f24c82f4-cb7e-4e91-8dcf-d5c9c164e9c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:28.846975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f24c82f4-cb7e-4e91-8dcf-d5c9c164e9c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:28.870397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f24c82f4-cb7e-4e91-8dcf-d5c9c164e9c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:28.871138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f24c82f4-cb7e-4e91-8dcf-d5c9c164e9c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:28.872107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f24c82f4-cb7e-4e91-8dcf-d5c9c164e9c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:28.872713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f24c82f4-cb7e-4e91-8dcf-d5c9c164e9c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:28.992910 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f24c82f4-cb7e-4e91-8dcf-d5c9c164e9c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152299 Aug 02 07:01:28.995615 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1674/3224] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:01:28 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:29.119635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-45c5dfef-9319-4714-8e96-3b9edbe6cd66 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:29.124550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-45c5dfef-9319-4714-8e96-3b9edbe6cd66 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:29.151762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7899c106-ade5-4d67-9fd8-6bf1f6de328f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:29.161644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45c5dfef-9319-4714-8e96-3b9edbe6cd66 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:29.169148 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7899c106-ade5-4d67-9fd8-6bf1f6de328f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1314 microversion: 2.1 time: 0.441593 Aug 02 07:01:29.169647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45c5dfef-9319-4714-8e96-3b9edbe6cd66 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:29.170643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45c5dfef-9319-4714-8e96-3b9edbe6cd66 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:29.171095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45c5dfef-9319-4714-8e96-3b9edbe6cd66 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:29.184458 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1551/3225] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:28 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:29.527586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-45c5dfef-9319-4714-8e96-3b9edbe6cd66 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:29.555692 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-45c5dfef-9319-4714-8e96-3b9edbe6cd66 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.444067 Aug 02 07:01:29.568744 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1675/3226] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:29 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:30.010897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-01e23da7-ea17-413a-aeeb-8e544569adf6 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:30.015350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-01e23da7-ea17-413a-aeeb-8e544569adf6 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:30.054139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01e23da7-ea17-413a-aeeb-8e544569adf6 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:30.064641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01e23da7-ea17-413a-aeeb-8e544569adf6 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:30.066202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01e23da7-ea17-413a-aeeb-8e544569adf6 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:30.066849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01e23da7-ea17-413a-aeeb-8e544569adf6 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:30.119074 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-01e23da7-ea17-413a-aeeb-8e544569adf6 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114802 Aug 02 07:01:30.120139 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1552/3227] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:01:30 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:30.211448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8e826685-c609-4aa7-beb2-21949af8442e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:30.212319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8e826685-c609-4aa7-beb2-21949af8442e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:30.226514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e826685-c609-4aa7-beb2-21949af8442e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:30.226962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e826685-c609-4aa7-beb2-21949af8442e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:30.227787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e826685-c609-4aa7-beb2-21949af8442e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:30.228214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e826685-c609-4aa7-beb2-21949af8442e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:30.578785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6ec4f9a5-2e82-4e73-ab60-fc0ffcc9bd10 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:30.579406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6ec4f9a5-2e82-4e73-ab60-fc0ffcc9bd10 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:30.587984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:30.595698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ec4f9a5-2e82-4e73-ab60-fc0ffcc9bd10 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:30.596159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ec4f9a5-2e82-4e73-ab60-fc0ffcc9bd10 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:30.603246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ec4f9a5-2e82-4e73-ab60-fc0ffcc9bd10 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:30.603987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ec4f9a5-2e82-4e73-ab60-fc0ffcc9bd10 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:30.715202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8e826685-c609-4aa7-beb2-21949af8442e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:30.729651 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8e826685-c609-4aa7-beb2-21949af8442e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1314 microversion: 2.1 time: 0.524675 Aug 02 07:01:30.730655 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1676/3228] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:30 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:30.889914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-1b1418f1-a5c1-4881-be5f-da66ead83d82 req-2e6975b2-1e80-4cea-945f-7f80670c55e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef772301-d2f0-4246-bd56-d5e350abce0f", "tag": "321f2442-f0d0-4425-a83c-6966394df6d4"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:30.920592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-1b1418f1-a5c1-4881-be5f-da66ead83d82 req-2e6975b2-1e80-4cea-945f-7f80670c55e0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:30.921372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-1b1418f1-a5c1-4881-be5f-da66ead83d82 req-2e6975b2-1e80-4cea-945f-7f80670c55e0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:30.946822 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-1b1418f1-a5c1-4881-be5f-da66ead83d82 req-2e6975b2-1e80-4cea-945f-7f80670c55e0 service nova] Creating event network-changed:321f2442-f0d0-4425-a83c-6966394df6d4 for instance ef772301-d2f0-4246-bd56-d5e350abce0f on n-h2-851337-3 Aug 02 07:01:30.957482 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-1b1418f1-a5c1-4881-be5f-da66ead83d82 req-2e6975b2-1e80-4cea-945f-7f80670c55e0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074519 Aug 02 07:01:30.963478 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1677/3229] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:01:30.970324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6ec4f9a5-2e82-4e73-ab60-fc0ffcc9bd10 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:30.980386 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6ec4f9a5-2e82-4e73-ab60-fc0ffcc9bd10 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.405693 Aug 02 07:01:30.982274 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1553/3230] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:30 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:31.133944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4da7d95c-e59a-44f7-8c1e-ae1018497170 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:31.136592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4da7d95c-e59a-44f7-8c1e-ae1018497170 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:31.144815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4da7d95c-e59a-44f7-8c1e-ae1018497170 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:31.145380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4da7d95c-e59a-44f7-8c1e-ae1018497170 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:31.146475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4da7d95c-e59a-44f7-8c1e-ae1018497170 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:31.147121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4da7d95c-e59a-44f7-8c1e-ae1018497170 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:31.188396 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4da7d95c-e59a-44f7-8c1e-ae1018497170 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060522 Aug 02 07:01:31.189780 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1678/3231] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:01:31 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 07:01:31.753413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-36bdba1f-8621-4304-b4ce-aae33134ae88 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:31.755412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-36bdba1f-8621-4304-b4ce-aae33134ae88 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:31.766940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36bdba1f-8621-4304-b4ce-aae33134ae88 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:31.767592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36bdba1f-8621-4304-b4ce-aae33134ae88 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:31.768425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36bdba1f-8621-4304-b4ce-aae33134ae88 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:31.769286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36bdba1f-8621-4304-b4ce-aae33134ae88 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:31.969450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-36bdba1f-8621-4304-b4ce-aae33134ae88 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:31.980160 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-36bdba1f-8621-4304-b4ce-aae33134ae88 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1314 microversion: 2.1 time: 0.230210 Aug 02 07:01:31.981157 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1554/3232] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:31 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:32.001970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0d78eb36-ccce-442b-835f-21d9b1a9e66a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:32.002593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0d78eb36-ccce-442b-835f-21d9b1a9e66a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:32.026963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d78eb36-ccce-442b-835f-21d9b1a9e66a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:32.030525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d78eb36-ccce-442b-835f-21d9b1a9e66a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:32.031579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d78eb36-ccce-442b-835f-21d9b1a9e66a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:32.032420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d78eb36-ccce-442b-835f-21d9b1a9e66a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:32.280653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0d78eb36-ccce-442b-835f-21d9b1a9e66a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:32.290843 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0d78eb36-ccce-442b-835f-21d9b1a9e66a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.292763 Aug 02 07:01:32.292146 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1679/3233] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:31 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:33.003816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9e245e16-f208-4a37-910f-ff8a6c5d16a4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:33.004533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9e245e16-f208-4a37-910f-ff8a6c5d16a4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:33.029589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e245e16-f208-4a37-910f-ff8a6c5d16a4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:33.033226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e245e16-f208-4a37-910f-ff8a6c5d16a4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:33.036751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e245e16-f208-4a37-910f-ff8a6c5d16a4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:33.038838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e245e16-f208-4a37-910f-ff8a6c5d16a4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:33.312900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9eccacf3-2fc5-4088-b6e9-7d716b14d15c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:33.313641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9eccacf3-2fc5-4088-b6e9-7d716b14d15c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:33.324818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9eccacf3-2fc5-4088-b6e9-7d716b14d15c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:33.325693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9eccacf3-2fc5-4088-b6e9-7d716b14d15c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:33.327055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9eccacf3-2fc5-4088-b6e9-7d716b14d15c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:33.327796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9eccacf3-2fc5-4088-b6e9-7d716b14d15c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:33.813872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9e245e16-f208-4a37-910f-ff8a6c5d16a4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:33.830237 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9e245e16-f208-4a37-910f-ff8a6c5d16a4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1314 microversion: 2.1 time: 0.829234 Aug 02 07:01:33.830937 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1555/3234] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:32 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1314 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:34.059755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9eccacf3-2fc5-4088-b6e9-7d716b14d15c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:34.077148 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9eccacf3-2fc5-4088-b6e9-7d716b14d15c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.769089 Aug 02 07:01:34.077759 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1680/3235] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:33 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:34.857478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3ea66204-d77d-4318-8916-d7b3a3a830e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:34.859597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3ea66204-d77d-4318-8916-d7b3a3a830e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:34.887988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:34.893692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ea66204-d77d-4318-8916-d7b3a3a830e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:34.895917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ea66204-d77d-4318-8916-d7b3a3a830e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:34.898032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ea66204-d77d-4318-8916-d7b3a3a830e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:34.899519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ea66204-d77d-4318-8916-d7b3a3a830e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:34.950456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=8 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:35.111215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a5b8c48-ade8-4556-9580-f4e1f20eff27 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:35.111855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8a5b8c48-ade8-4556-9580-f4e1f20eff27 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:35.139050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a5b8c48-ade8-4556-9580-f4e1f20eff27 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:35.140523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a5b8c48-ade8-4556-9580-f4e1f20eff27 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:35.143336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a5b8c48-ade8-4556-9580-f4e1f20eff27 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:35.144086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a5b8c48-ade8-4556-9580-f4e1f20eff27 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:35.315737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3ea66204-d77d-4318-8916-d7b3a3a830e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:35.332241 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3ea66204-d77d-4318-8916-d7b3a3a830e0 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1314 microversion: 2.1 time: 0.482131 Aug 02 07:01:35.333969 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1556/3236] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:34 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:35.487143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8a5b8c48-ade8-4556-9580-f4e1f20eff27 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:35.491669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:35.520640 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8a5b8c48-ade8-4556-9580-f4e1f20eff27 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1522 microversion: 2.1 time: 0.410781 Aug 02 07:01:35.522277 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1681/3237] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:35 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:36.359175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-28ad23a5-af67-4d3e-a524-c264759574ec tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:36.360590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-28ad23a5-af67-4d3e-a524-c264759574ec tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:36.387996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28ad23a5-af67-4d3e-a524-c264759574ec tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:36.390568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28ad23a5-af67-4d3e-a524-c264759574ec tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:36.392945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28ad23a5-af67-4d3e-a524-c264759574ec tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:36.410750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28ad23a5-af67-4d3e-a524-c264759574ec tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:36.547344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-03a33ea6-8654-40b2-ba37-af17b63c084b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:36.548216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-03a33ea6-8654-40b2-ba37-af17b63c084b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:36.575496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:36.578570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03a33ea6-8654-40b2-ba37-af17b63c084b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:36.579254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03a33ea6-8654-40b2-ba37-af17b63c084b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:36.582499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03a33ea6-8654-40b2-ba37-af17b63c084b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:36.583578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03a33ea6-8654-40b2-ba37-af17b63c084b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:36.849681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-28ad23a5-af67-4d3e-a524-c264759574ec tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:36.858639 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-28ad23a5-af67-4d3e-a524-c264759574ec tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1314 microversion: 2.1 time: 0.507876 Aug 02 07:01:36.875307 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1557/3238] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:36 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:36.888024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-03a33ea6-8654-40b2-ba37-af17b63c084b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:36.896882 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-03a33ea6-8654-40b2-ba37-af17b63c084b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1502 microversion: 2.1 time: 0.353518 Aug 02 07:01:36.897946 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1682/3239] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:36 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1502 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:36.918847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-acb8e1ed-531b-40a1-b1d7-8399e65ec07e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:36.919502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-acb8e1ed-531b-40a1-b1d7-8399e65ec07e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:36.926581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-acb8e1ed-531b-40a1-b1d7-8399e65ec07e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:36.927058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-acb8e1ed-531b-40a1-b1d7-8399e65ec07e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:36.927806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-acb8e1ed-531b-40a1-b1d7-8399e65ec07e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:36.928237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-acb8e1ed-531b-40a1-b1d7-8399e65ec07e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:37.189439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-acb8e1ed-531b-40a1-b1d7-8399e65ec07e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:37.209564 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-acb8e1ed-531b-40a1-b1d7-8399e65ec07e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1516 microversion: 2.1 time: 0.294758 Aug 02 07:01:37.219562 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1558/3240] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:36 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1516 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:37.247134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-394a7572-b487-4901-be36-115506c5bb42 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:37.249814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-394a7572-b487-4901-be36-115506c5bb42 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 7ef396e9-c8f1-4c1c-bb3a-a3cbac75a71b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:37.269997 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-394a7572-b487-4901-be36-115506c5bb42 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] HTTP exception thrown: Instance 7ef396e9-c8f1-4c1c-bb3a-a3cbac75a71b could not be found. Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-394a7572-b487-4901-be36-115506c5bb42 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Request method failure captured: Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/7ef396e9-c8f1-4c1c-bb3a-a3cbac75a71b/action HTTP/1.1 Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 14 Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MuV9Q5BOG4bZSTn8mNA1jfjLBve4d8RpXHrEXh4dSRfQwoHnO2CX5TWJr_Ybphxlmnei--H-24HQZ2VBGVtXb7ed4xsT9rh6T-B0ctcoWXMM-9zRQgu-z2imnNm8CiRJJUKFATn8QRgKDRSh1174_Xj_fjEsdTPEI1eutLUtYEoOkA Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}] Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b9ad5424586247019d4374f52600ea51 Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: {"rescue": {}} Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 7ef396e9-c8f1-4c1c-bb3a-a3cbac75a71b could not be found. Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '7ef396e9-c8f1-4c1c-bb3a-a3cbac75a71b', 'body': {'rescue': {}}} Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef396e9-c8f1-4c1c-bb3a-a3cbac75a71b could not be found. Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef396e9-c8f1-4c1c-bb3a-a3cbac75a71b could not be found. Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:37.286445 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:37.292358 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:37.292358 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:37.292358 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:37.292358 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:37.292358 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef396e9-c8f1-4c1c-bb3a-a3cbac75a71b could not be found. Aug 02 07:01:37.292358 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:37.295049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-394a7572-b487-4901-be36-115506c5bb42 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Returning 404 to user: Instance 7ef396e9-c8f1-4c1c-bb3a-a3cbac75a71b could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:37.313055 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-394a7572-b487-4901-be36-115506c5bb42 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers/7ef396e9-c8f1-4c1c-bb3a-a3cbac75a71b/action" status: 404 len: 111 microversion: 2.1 time: 0.072990 Aug 02 07:01:37.327773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e07be866-37f1-4bcf-98c1-b52a3ec1187f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:37.328549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e07be866-37f1-4bcf-98c1-b52a3ec1187f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:37.335748 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1683/3241] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:01:37 2022] POST /compute/v2.1/servers/7ef396e9-c8f1-4c1c-bb3a-a3cbac75a71b/action => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:37.345755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e07be866-37f1-4bcf-98c1-b52a3ec1187f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:37.346772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e07be866-37f1-4bcf-98c1-b52a3ec1187f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:37.350474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e07be866-37f1-4bcf-98c1-b52a3ec1187f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:37.350925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e07be866-37f1-4bcf-98c1-b52a3ec1187f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:37.355448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:37.603105 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e07be866-37f1-4bcf-98c1-b52a3ec1187f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3/action" status: 202 len: 0 microversion: 2.1 time: 0.277011 Aug 02 07:01:37.605328 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1559/3242] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:01:37 2022] POST /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:01:37.614040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-89aa577e-1924-4550-8b4f-0c50edf8c5c1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:37.615804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-89aa577e-1924-4550-8b4f-0c50edf8c5c1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:37.631391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89aa577e-1924-4550-8b4f-0c50edf8c5c1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:37.632484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89aa577e-1924-4550-8b4f-0c50edf8c5c1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:37.633353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89aa577e-1924-4550-8b4f-0c50edf8c5c1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:37.636814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89aa577e-1924-4550-8b4f-0c50edf8c5c1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:37.900013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-803f15fa-d969-4d71-ae01-244b0d43f948 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:37.900729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-803f15fa-d969-4d71-ae01-244b0d43f948 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:37.919323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-803f15fa-d969-4d71-ae01-244b0d43f948 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:37.924754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-803f15fa-d969-4d71-ae01-244b0d43f948 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:37.925809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-803f15fa-d969-4d71-ae01-244b0d43f948 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:37.930157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-803f15fa-d969-4d71-ae01-244b0d43f948 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:38.008249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-89aa577e-1924-4550-8b4f-0c50edf8c5c1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:38.024201 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-89aa577e-1924-4550-8b4f-0c50edf8c5c1 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1521 microversion: 2.1 time: 0.414703 Aug 02 07:01:38.043266 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1684/3243] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:37 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:38.050726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-049ebd32-e2ea-49d9-847b-2674ab8913a6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:38.051482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-049ebd32-e2ea-49d9-847b-2674ab8913a6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:38.062449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-049ebd32-e2ea-49d9-847b-2674ab8913a6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:38.063065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-049ebd32-e2ea-49d9-847b-2674ab8913a6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:38.064160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-049ebd32-e2ea-49d9-847b-2674ab8913a6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:38.064943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-049ebd32-e2ea-49d9-847b-2674ab8913a6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:38.119716 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-049ebd32-e2ea-49d9-847b-2674ab8913a6 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments/34136355-adf2-4793-b3e9-1ac04b8d5d90" status: 200 len: 194 microversion: 2.1 time: 0.074450 Aug 02 07:01:38.123978 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1685/3244] 10.222.0.79 () {58 vars in 1413 bytes} [Tue Aug 2 07:01:38 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments/34136355-adf2-4793-b3e9-1ac04b8d5d90 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:38.135444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ef4d6839-b28f-408e-9734-cadddd32d914 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:38.136084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ef4d6839-b28f-408e-9734-cadddd32d914 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:38.143024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef4d6839-b28f-408e-9734-cadddd32d914 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:38.145239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef4d6839-b28f-408e-9734-cadddd32d914 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:38.146627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef4d6839-b28f-408e-9734-cadddd32d914 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:38.147332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef4d6839-b28f-408e-9734-cadddd32d914 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:38.308073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-ef4d6839-b28f-408e-9734-cadddd32d914 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lazy-loading 'services' on Instance uuid a42f890a-37e8-42bd-a345-d4dddadd50a1 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:01:38.454495 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ef4d6839-b28f-408e-9734-cadddd32d914 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments/34136355-adf2-4793-b3e9-1ac04b8d5d90" status: 202 len: 0 microversion: 2.1 time: 0.323417 Aug 02 07:01:38.454866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-803f15fa-d969-4d71-ae01-244b0d43f948 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:38.455554 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1686/3245] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:01:38 2022] DELETE /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments/34136355-adf2-4793-b3e9-1ac04b8d5d90 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:01:38.466714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b6b9b588-7a87-48b5-876f-8b52d632da01 req-f18ec1c3-208a-4366-b04d-72d51202804a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef772301-d2f0-4246-bd56-d5e350abce0f", "name": "network-vif-plugged", "status": "completed", "tag": "321f2442-f0d0-4425-a83c-6966394df6d4"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:38.490486 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-803f15fa-d969-4d71-ae01-244b0d43f948 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1314 microversion: 2.1 time: 0.593026 Aug 02 07:01:38.492246 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1560/3246] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:37 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:38.494729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b6b9b588-7a87-48b5-876f-8b52d632da01 req-f18ec1c3-208a-4366-b04d-72d51202804a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:38.495047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b6b9b588-7a87-48b5-876f-8b52d632da01 req-f18ec1c3-208a-4366-b04d-72d51202804a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:38.528521 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b6b9b588-7a87-48b5-876f-8b52d632da01 req-f18ec1c3-208a-4366-b04d-72d51202804a service nova] Creating event network-vif-plugged:321f2442-f0d0-4425-a83c-6966394df6d4 for instance ef772301-d2f0-4246-bd56-d5e350abce0f on n-h2-851337-3 Aug 02 07:01:38.539198 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b6b9b588-7a87-48b5-876f-8b52d632da01 req-f18ec1c3-208a-4366-b04d-72d51202804a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082081 Aug 02 07:01:38.556678 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1687/3247] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:39.049701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-da4da69f-c8de-4e7f-97a2-e468162584dd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:39.050947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-da4da69f-c8de-4e7f-97a2-e468162584dd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:39.071767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da4da69f-c8de-4e7f-97a2-e468162584dd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:39.077685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da4da69f-c8de-4e7f-97a2-e468162584dd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:39.081167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da4da69f-c8de-4e7f-97a2-e468162584dd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:39.082011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da4da69f-c8de-4e7f-97a2-e468162584dd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:39.513573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-318352c0-993f-46b4-afac-47f6661a4436 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:39.515318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-318352c0-993f-46b4-afac-47f6661a4436 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:39.530119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-318352c0-993f-46b4-afac-47f6661a4436 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:39.533866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-318352c0-993f-46b4-afac-47f6661a4436 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:39.535147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-318352c0-993f-46b4-afac-47f6661a4436 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:39.537236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-318352c0-993f-46b4-afac-47f6661a4436 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:40.022716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-da4da69f-c8de-4e7f-97a2-e468162584dd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:40.039016 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-da4da69f-c8de-4e7f-97a2-e468162584dd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1501 microversion: 2.1 time: 0.995768 Aug 02 07:01:40.046593 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1561/3248] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:39 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1501 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:40.067358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d964cc8e-1e8d-49d4-a9c3-e0bdb939d8f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:40.089705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-318352c0-993f-46b4-afac-47f6661a4436 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:40.105539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d964cc8e-1e8d-49d4-a9c3-e0bdb939d8f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:40.121518 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-318352c0-993f-46b4-afac-47f6661a4436 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1314 microversion: 2.1 time: 0.611910 Aug 02 07:01:40.130343 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1688/3249] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:39 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:40.164092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d964cc8e-1e8d-49d4-a9c3-e0bdb939d8f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:40.164916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d964cc8e-1e8d-49d4-a9c3-e0bdb939d8f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:40.165940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d964cc8e-1e8d-49d4-a9c3-e0bdb939d8f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:40.166592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d964cc8e-1e8d-49d4-a9c3-e0bdb939d8f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:40.269569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-d964cc8e-1e8d-49d4-a9c3-e0bdb939d8f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lazy-loading 'flavor' on Instance uuid b7e42843-450e-4aab-b2eb-8ec992bfaaf3 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:01:40.306589 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-d964cc8e-1e8d-49d4-a9c3-e0bdb939d8f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] HTTP exception thrown: Cannot 'rescue' instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 while it is in vm_state paused Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d964cc8e-1e8d-49d4-a9c3-e0bdb939d8f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Request method failure captured: Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3/action HTTP/1.1 Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 14 Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MuV9Q5BOG4bZSTn8mNA1jfjLBve4d8RpXHrEXh4dSRfQwoHnO2CX5TWJr_Ybphxlmnei--H-24HQZ2VBGVtXb7ed4xsT9rh6T-B0ctcoWXMM-9zRQgu-z2imnNm8CiRJJUKFATn8QRgKDRSh1174_Xj_fjEsdTPEI1eutLUtYEoOkA Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}] Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b9ad5424586247019d4374f52600ea51 Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: {"rescue": {}} Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: exception: Cannot 'rescue' instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 while it is in vm_state paused Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'b7e42843-450e-4aab-b2eb-8ec992bfaaf3', 'body': {'rescue': {}}} Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 in vm_state paused. Cannot rescue while the instance is in this state. Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 while it is in vm_state paused Aug 02 07:01:40.313260 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:40.318284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:40.318284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:40.318284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:40.318284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:40.318284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:40.318284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:40.318284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:40.318284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 while it is in vm_state paused Aug 02 07:01:40.318284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:40.321314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d964cc8e-1e8d-49d4-a9c3-e0bdb939d8f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Returning 409 to user: Cannot 'rescue' instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 while it is in vm_state paused {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:40.324667 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d964cc8e-1e8d-49d4-a9c3-e0bdb939d8f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3/action" status: 409 len: 144 microversion: 2.1 time: 0.262419 Aug 02 07:01:40.328502 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1562/3250] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:01:40 2022] POST /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3/action => generated 144 bytes in 267 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 02 07:01:40.340245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b314a340-a555-4cd1-b243-6e489679c260 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:40.343475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b314a340-a555-4cd1-b243-6e489679c260 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:40.367921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b314a340-a555-4cd1-b243-6e489679c260 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:40.370632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b314a340-a555-4cd1-b243-6e489679c260 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:40.371616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b314a340-a555-4cd1-b243-6e489679c260 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:40.376891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b314a340-a555-4cd1-b243-6e489679c260 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:40.604832 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b314a340-a555-4cd1-b243-6e489679c260 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3/action" status: 202 len: 0 microversion: 2.1 time: 0.249096 Aug 02 07:01:40.608825 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1689/3251] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:01:40 2022] POST /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:01:40.615087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dcdec1ba-5f8c-4536-a298-8beb641346a5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:40.616009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dcdec1ba-5f8c-4536-a298-8beb641346a5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:40.632276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dcdec1ba-5f8c-4536-a298-8beb641346a5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:40.635477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dcdec1ba-5f8c-4536-a298-8beb641346a5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:40.636453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dcdec1ba-5f8c-4536-a298-8beb641346a5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:40.637226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dcdec1ba-5f8c-4536-a298-8beb641346a5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:41.074809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dcdec1ba-5f8c-4536-a298-8beb641346a5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:41.101090 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dcdec1ba-5f8c-4536-a298-8beb641346a5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1508 microversion: 2.1 time: 0.490412 Aug 02 07:01:41.103090 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1563/3252] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:40 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1508 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:41.155037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d985cf28-59da-4706-ba4d-49fdab095666 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:41.168789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d985cf28-59da-4706-ba4d-49fdab095666 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:41.207553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d985cf28-59da-4706-ba4d-49fdab095666 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:41.210051 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d985cf28-59da-4706-ba4d-49fdab095666 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:41.212765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d985cf28-59da-4706-ba4d-49fdab095666 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:41.216054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d985cf28-59da-4706-ba4d-49fdab095666 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:41.500329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d985cf28-59da-4706-ba4d-49fdab095666 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:41.516514 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d985cf28-59da-4706-ba4d-49fdab095666 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1501 microversion: 2.1 time: 0.368028 Aug 02 07:01:41.547643 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1690/3253] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:41 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1501 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:41.582575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-19543dc6-f03d-4ef1-9547-d4a7c18bdba6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:41.583424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-19543dc6-f03d-4ef1-9547-d4a7c18bdba6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:41.590471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19543dc6-f03d-4ef1-9547-d4a7c18bdba6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:41.592932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19543dc6-f03d-4ef1-9547-d4a7c18bdba6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:41.594207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19543dc6-f03d-4ef1-9547-d4a7c18bdba6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:41.594822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19543dc6-f03d-4ef1-9547-d4a7c18bdba6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:41.623490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-19543dc6-f03d-4ef1-9547-d4a7c18bdba6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lazy-loading 'flavor' on Instance uuid ef772301-d2f0-4246-bd56-d5e350abce0f {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:01:41.764878 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-19543dc6-f03d-4ef1-9547-d4a7c18bdba6 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "POST /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f/action" status: 202 len: 0 microversion: 2.1 time: 0.205605 Aug 02 07:01:41.770323 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1564/3254] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:01:41 2022] POST /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:01:41.777176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-34bb5bf9-b54d-4fd9-92da-36e4a1167861 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:41.778066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-34bb5bf9-b54d-4fd9-92da-36e4a1167861 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:41.795436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34bb5bf9-b54d-4fd9-92da-36e4a1167861 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:41.798632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34bb5bf9-b54d-4fd9-92da-36e4a1167861 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:41.799693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34bb5bf9-b54d-4fd9-92da-36e4a1167861 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:41.801779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34bb5bf9-b54d-4fd9-92da-36e4a1167861 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:42.128217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7abc547e-7bc0-4404-9f6a-0560f4f827c8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:42.128926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7abc547e-7bc0-4404-9f6a-0560f4f827c8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:42.152232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7abc547e-7bc0-4404-9f6a-0560f4f827c8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:42.152689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7abc547e-7bc0-4404-9f6a-0560f4f827c8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:42.153481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7abc547e-7bc0-4404-9f6a-0560f4f827c8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:42.153972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7abc547e-7bc0-4404-9f6a-0560f4f827c8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:42.243030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-34bb5bf9-b54d-4fd9-92da-36e4a1167861 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:42.282724 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-34bb5bf9-b54d-4fd9-92da-36e4a1167861 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1509 microversion: 2.1 time: 0.500304 Aug 02 07:01:42.289029 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1691/3255] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:41 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1509 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:42.636021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7abc547e-7bc0-4404-9f6a-0560f4f827c8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:42.655304 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7abc547e-7bc0-4404-9f6a-0560f4f827c8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1516 microversion: 2.1 time: 0.531338 Aug 02 07:01:42.656858 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1565/3256] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:42 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1516 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:43.319809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-be475e72-fcd4-4026-8617-fc4cfbf5514e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:43.320718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-be475e72-fcd4-4026-8617-fc4cfbf5514e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:43.333995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be475e72-fcd4-4026-8617-fc4cfbf5514e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:43.334506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be475e72-fcd4-4026-8617-fc4cfbf5514e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:43.335247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be475e72-fcd4-4026-8617-fc4cfbf5514e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:43.335690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be475e72-fcd4-4026-8617-fc4cfbf5514e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:43.653574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-be475e72-fcd4-4026-8617-fc4cfbf5514e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:43.663621 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-be475e72-fcd4-4026-8617-fc4cfbf5514e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1492 microversion: 2.1 time: 0.350611 Aug 02 07:01:43.664225 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1692/3257] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:43 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1492 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:43.692156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b9d4fb0b-2650-411a-a02c-486b778fc64e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:43.697821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b9d4fb0b-2650-411a-a02c-486b778fc64e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:43.727860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9d4fb0b-2650-411a-a02c-486b778fc64e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:43.732068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9d4fb0b-2650-411a-a02c-486b778fc64e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:43.734291 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9d4fb0b-2650-411a-a02c-486b778fc64e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:43.737256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9d4fb0b-2650-411a-a02c-486b778fc64e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:43.822537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b9d4fb0b-2650-411a-a02c-486b778fc64e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:01:44.219189 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b9d4fb0b-2650-411a-a02c-486b778fc64e tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 204 len: 0 microversion: 2.1 time: 0.534573 Aug 02 07:01:44.223419 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1566/3258] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:01:43 2022] DELETE /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:01:44.233871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7037cd9a-6ee1-4ddc-b2e6-aaa014279999 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:44.234544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7037cd9a-6ee1-4ddc-b2e6-aaa014279999 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:44.248689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7037cd9a-6ee1-4ddc-b2e6-aaa014279999 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:44.250379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7037cd9a-6ee1-4ddc-b2e6-aaa014279999 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:44.252460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7037cd9a-6ee1-4ddc-b2e6-aaa014279999 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:44.253316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7037cd9a-6ee1-4ddc-b2e6-aaa014279999 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:44.750773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7037cd9a-6ee1-4ddc-b2e6-aaa014279999 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:44.765372 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7037cd9a-6ee1-4ddc-b2e6-aaa014279999 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1498 microversion: 2.1 time: 0.537374 Aug 02 07:01:44.778181 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1693/3259] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:44 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1498 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:45.797325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b40846d6-d4ac-4c62-8f32-8254f3d77313 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:45.805493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b40846d6-d4ac-4c62-8f32-8254f3d77313 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:45.806262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aa58328a-3c8a-45f1-9bd1-d844f9b7009d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Action: 'create', calling method: .version_select at 0x7f927a9ab820>, body: {"keypair": {"name": "tempest-keypair-282974978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0rc+pUCcF7yaMkW7yzubcL6MFEWIyhFh/8lz1xg5oc4+S4F+Etb0wlnX12OCmbHd8+tgPl3JKaHYHOotb98Q5WnL7vWOjnb1CB2b4PxSMe47YdRWOcCOnHiOASb9CMbA=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:45.835782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b40846d6-d4ac-4c62-8f32-8254f3d77313 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:45.843970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b40846d6-d4ac-4c62-8f32-8254f3d77313 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:45.845175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b40846d6-d4ac-4c62-8f32-8254f3d77313 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:45.852188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b40846d6-d4ac-4c62-8f32-8254f3d77313 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:45.913165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-aa58328a-3c8a-45f1-9bd1-d844f9b7009d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Getting quotas for project 03f5bbf476c94643bf0cdc53674eac15. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:01:45.934652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-aa58328a-3c8a-45f1-9bd1-d844f9b7009d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Getting quotas for user 2b4020638dc2480a8c451435824cd0f6 and project 03f5bbf476c94643bf0cdc53674eac15. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:01:46.026297 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aa58328a-3c8a-45f1-9bd1-d844f9b7009d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.241829 Aug 02 07:01:46.027526 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1567/3260] 10.222.0.79 () {62 vars in 1200 bytes} [Tue Aug 2 07:01:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 244 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 07:01:46.313954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b40846d6-d4ac-4c62-8f32-8254f3d77313 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:46.327682 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b40846d6-d4ac-4c62-8f32-8254f3d77313 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1498 microversion: 2.1 time: 0.541951 Aug 02 07:01:46.328666 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1694/3261] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:45 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1498 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:46.657003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1ed4b8f3-16de-443e-8337-d5a1a67cef32 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:46.659910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1ed4b8f3-16de-443e-8337-d5a1a67cef32 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:46.685253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ed4b8f3-16de-443e-8337-d5a1a67cef32 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:46.686658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ed4b8f3-16de-443e-8337-d5a1a67cef32 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:46.687940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ed4b8f3-16de-443e-8337-d5a1a67cef32 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:46.702288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ed4b8f3-16de-443e-8337-d5a1a67cef32 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:46.731310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-1ed4b8f3-16de-443e-8337-d5a1a67cef32 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lazy-loading 'flavor' on Instance uuid b7e42843-450e-4aab-b2eb-8ec992bfaaf3 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:01:46.936524 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1ed4b8f3-16de-443e-8337-d5a1a67cef32 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3/action" status: 200 len: 32 microversion: 2.1 time: 0.282016 Aug 02 07:01:46.945332 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1568/3262] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:01:46 2022] POST /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3/action => generated 32 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 07:01:46.950336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ffd10d4c-d280-4c35-862e-38f2ed10c3a6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:46.951066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ffd10d4c-d280-4c35-862e-38f2ed10c3a6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:46.954888 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=80 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:46.966551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ffd10d4c-d280-4c35-862e-38f2ed10c3a6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:46.967002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ffd10d4c-d280-4c35-862e-38f2ed10c3a6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:46.967799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ffd10d4c-d280-4c35-862e-38f2ed10c3a6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:46.969737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ffd10d4c-d280-4c35-862e-38f2ed10c3a6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:47.351743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f56a040a-977d-476c-863e-8fe4d869d20f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:47.352546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f56a040a-977d-476c-863e-8fe4d869d20f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:47.376364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f56a040a-977d-476c-863e-8fe4d869d20f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:47.376615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f56a040a-977d-476c-863e-8fe4d869d20f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:47.377427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f56a040a-977d-476c-863e-8fe4d869d20f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:47.377873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f56a040a-977d-476c-863e-8fe4d869d20f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:48.160914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ffd10d4c-d280-4c35-862e-38f2ed10c3a6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:48.162526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f56a040a-977d-476c-863e-8fe4d869d20f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6870f29383493c86db7e30259b8a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a004889882844be18e4c30827645050e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:48.175507 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f56a040a-977d-476c-863e-8fe4d869d20f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 200 len: 1456 microversion: 2.1 time: 0.828740 Aug 02 07:01:48.176733 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1569/3263] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:47 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 1456 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:48.198783 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ffd10d4c-d280-4c35-862e-38f2ed10c3a6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1522 microversion: 2.1 time: 1.253007 Aug 02 07:01:48.223149 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1695/3264] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:46 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1522 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:49.032896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8b14e15c-2a05-474e-ba0f-fa1f7a3268a9 req-7d3100b5-5406-40bf-84fa-bd3483c862e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef772301-d2f0-4246-bd56-d5e350abce0f", "name": "network-vif-deleted", "tag": "321f2442-f0d0-4425-a83c-6966394df6d4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:49.079022 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8b14e15c-2a05-474e-ba0f-fa1f7a3268a9 req-7d3100b5-5406-40bf-84fa-bd3483c862e7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.079467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8b14e15c-2a05-474e-ba0f-fa1f7a3268a9 req-7d3100b5-5406-40bf-84fa-bd3483c862e7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.148061 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8b14e15c-2a05-474e-ba0f-fa1f7a3268a9 req-7d3100b5-5406-40bf-84fa-bd3483c862e7 service nova] Creating event network-vif-deleted:321f2442-f0d0-4425-a83c-6966394df6d4 for instance ef772301-d2f0-4246-bd56-d5e350abce0f on n-h2-851337-3 Aug 02 07:01:49.171949 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8b14e15c-2a05-474e-ba0f-fa1f7a3268a9 req-7d3100b5-5406-40bf-84fa-bd3483c862e7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.810328 Aug 02 07:01:49.179765 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1570/3265] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:49.197985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-029aa984-55d6-416d-944d-253fc2b95131 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:49.198827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-029aa984-55d6-416d-944d-253fc2b95131 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:49.215479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-029aa984-55d6-416d-944d-253fc2b95131 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.216315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-029aa984-55d6-416d-944d-253fc2b95131 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.217415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-029aa984-55d6-416d-944d-253fc2b95131 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.218824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-029aa984-55d6-416d-944d-253fc2b95131 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.243781 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-029aa984-55d6-416d-944d-253fc2b95131 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.244228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c6156e28-5d9b-4f6a-8226-7fc164d931e5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:49.244957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c6156e28-5d9b-4f6a-8226-7fc164d931e5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-029aa984-55d6-416d-944d-253fc2b95131 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f HTTP/1.1 Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'ef772301-d2f0-4246-bd56-d5e350abce0f'} Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.246628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.251770 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.251770 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.251770 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.251770 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:49.251770 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:49.251770 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.251770 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.253605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-029aa984-55d6-416d-944d-253fc2b95131 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:49.255129 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-029aa984-55d6-416d-944d-253fc2b95131 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 404 len: 111 microversion: 2.1 time: 0.061841 Aug 02 07:01:49.256764 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1696/3266] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:49 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:49.280682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-99762edd-6c30-42ab-bb95-ca77d199785b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:49.281313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6156e28-5d9b-4f6a-8226-7fc164d931e5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.281761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-99762edd-6c30-42ab-bb95-ca77d199785b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:49.281937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6156e28-5d9b-4f6a-8226-7fc164d931e5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.283332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6156e28-5d9b-4f6a-8226-7fc164d931e5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.284872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6156e28-5d9b-4f6a-8226-7fc164d931e5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.296889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99762edd-6c30-42ab-bb95-ca77d199785b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.300036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99762edd-6c30-42ab-bb95-ca77d199785b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.301081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99762edd-6c30-42ab-bb95-ca77d199785b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.301699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99762edd-6c30-42ab-bb95-ca77d199785b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.333001 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-99762edd-6c30-42ab-bb95-ca77d199785b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-99762edd-6c30-42ab-bb95-ca77d199785b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f HTTP/1.1 Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'ef772301-d2f0-4246-bd56-d5e350abce0f'} Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:49.338646 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:49.348108 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.348108 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.348108 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.348108 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.348108 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.348108 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.348108 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.348108 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:49.348108 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:49.348108 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.348108 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.352172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-99762edd-6c30-42ab-bb95-ca77d199785b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:49.354585 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-99762edd-6c30-42ab-bb95-ca77d199785b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 404 len: 111 microversion: 2.1 time: 0.088142 Aug 02 07:01:49.359340 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1697/3267] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:01:49 2022] DELETE /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:49.365838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b6f97cd-7d4f-4ad9-aad2-4b3ae5a6e6e5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:49.366747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4b6f97cd-7d4f-4ad9-aad2-4b3ae5a6e6e5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef772301-d2f0-4246-bd56-d5e350abce0f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:49.370706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:49.376298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b6f97cd-7d4f-4ad9-aad2-4b3ae5a6e6e5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.377334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b6f97cd-7d4f-4ad9-aad2-4b3ae5a6e6e5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.378815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b6f97cd-7d4f-4ad9-aad2-4b3ae5a6e6e5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.379435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b6f97cd-7d4f-4ad9-aad2-4b3ae5a6e6e5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.410118 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-4b6f97cd-7d4f-4ad9-aad2-4b3ae5a6e6e5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b6f97cd-7d4f-4ad9-aad2-4b3ae5a6e6e5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f HTTP/1.1 Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'ef772301-d2f0-4246-bd56-d5e350abce0f'} Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.414494 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.420821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.420821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.420821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.420821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:49.420821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:49.420821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. Aug 02 07:01:49.420821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.424519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b6f97cd-7d4f-4ad9-aad2-4b3ae5a6e6e5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance ef772301-d2f0-4246-bd56-d5e350abce0f could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:49.427144 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4b6f97cd-7d4f-4ad9-aad2-4b3ae5a6e6e5 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f" status: 404 len: 111 microversion: 2.1 time: 0.065800 Aug 02 07:01:49.434842 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1698/3268] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:49 2022] GET /compute/v2.1/servers/ef772301-d2f0-4246-bd56-d5e350abce0f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:49.443729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0adefc6a-828e-4877-9583-1e0276aecffc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:49.452143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0adefc6a-828e-4877-9583-1e0276aecffc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:49.471552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0adefc6a-828e-4877-9583-1e0276aecffc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.472010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0adefc6a-828e-4877-9583-1e0276aecffc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.472958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0adefc6a-828e-4877-9583-1e0276aecffc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.473498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0adefc6a-828e-4877-9583-1e0276aecffc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.508653 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-0adefc6a-828e-4877-9583-1e0276aecffc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0adefc6a-828e-4877-9583-1e0276aecffc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 HTTP/1.1 Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '3f8b31f7-8832-401c-80ea-c9d595559396'} Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:49.510400 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:49.518227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:49.518227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.518227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.518227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.518227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.518227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.518227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.518227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:49.518227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:49.518227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:49.518227 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.518227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0adefc6a-828e-4877-9583-1e0276aecffc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:49.518227 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0adefc6a-828e-4877-9583-1e0276aecffc tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 404 len: 111 microversion: 2.1 time: 0.073053 Aug 02 07:01:49.518227 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1699/3269] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:01:49 2022] DELETE /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:01:49.536390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b818fa9-0462-4164-8056-bd97e6de80f4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:49.537365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b818fa9-0462-4164-8056-bd97e6de80f4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 3f8b31f7-8832-401c-80ea-c9d595559396] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:49.559829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b818fa9-0462-4164-8056-bd97e6de80f4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.560509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b818fa9-0462-4164-8056-bd97e6de80f4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.561452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b818fa9-0462-4164-8056-bd97e6de80f4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.561884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b818fa9-0462-4164-8056-bd97e6de80f4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.610045 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-7b818fa9-0462-4164-8056-bd97e6de80f4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b818fa9-0462-4164-8056-bd97e6de80f4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 HTTP/1.1 Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '3f8b31f7-8832-401c-80ea-c9d595559396'} Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.613530 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.618820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.618820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.618820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.618820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:49.618820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:49.618820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. Aug 02 07:01:49.618820 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.618820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b818fa9-0462-4164-8056-bd97e6de80f4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 3f8b31f7-8832-401c-80ea-c9d595559396 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:49.626656 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b818fa9-0462-4164-8056-bd97e6de80f4 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396" status: 404 len: 111 microversion: 2.1 time: 0.096636 Aug 02 07:01:49.628280 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1700/3270] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:49 2022] GET /compute/v2.1/servers/3f8b31f7-8832-401c-80ea-c9d595559396 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:49.647782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6f44dafd-a349-4b66-a682-a9db0c5e06cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:49.649012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6f44dafd-a349-4b66-a682-a9db0c5e06cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:49.673368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f44dafd-a349-4b66-a682-a9db0c5e06cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.674548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f44dafd-a349-4b66-a682-a9db0c5e06cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.682609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f44dafd-a349-4b66-a682-a9db0c5e06cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.683716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f44dafd-a349-4b66-a682-a9db0c5e06cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.710856 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-6f44dafd-a349-4b66-a682-a9db0c5e06cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6f44dafd-a349-4b66-a682-a9db0c5e06cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 HTTP/1.1 Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '85b6671f-a2e2-46e6-ae8b-9785cf4d71b6'} Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:49.713162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:49.723758 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:01:49.723758 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.723758 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.723758 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.723758 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.723758 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.723758 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.723758 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:49.723758 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:49.723758 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:01:49.723758 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.723758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6f44dafd-a349-4b66-a682-a9db0c5e06cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:49.723758 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6f44dafd-a349-4b66-a682-a9db0c5e06cd tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "DELETE /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 404 len: 111 microversion: 2.1 time: 0.083718 Aug 02 07:01:49.723758 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1701/3271] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:01:49 2022] DELETE /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:49.729656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dacb02ef-ee2a-4c0c-8316-0e559a77cf2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:49.729656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dacb02ef-ee2a-4c0c-8316-0e559a77cf2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:49.751124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dacb02ef-ee2a-4c0c-8316-0e559a77cf2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.751124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dacb02ef-ee2a-4c0c-8316-0e559a77cf2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.751124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dacb02ef-ee2a-4c0c-8316-0e559a77cf2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.751124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dacb02ef-ee2a-4c0c-8316-0e559a77cf2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-dacb02ef-ee2a-4c0c-8316-0e559a77cf2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dacb02ef-ee2a-4c0c-8316-0e559a77cf2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 HTTP/1.1 Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '85b6671f-a2e2-46e6-ae8b-9785cf4d71b6'} Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:49.791418 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dacb02ef-ee2a-4c0c-8316-0e559a77cf2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dacb02ef-ee2a-4c0c-8316-0e559a77cf2a tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6" status: 404 len: 111 microversion: 2.1 time: 0.051881 Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1702/3272] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:49 2022] GET /compute/v2.1/servers/85b6671f-a2e2-46e6-ae8b-9785cf4d71b6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3863ecfb-ebb4-46a6-9854-68a89c1c6631 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3863ecfb-ebb4-46a6-9854-68a89c1c6631 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3863ecfb-ebb4-46a6-9854-68a89c1c6631 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3863ecfb-ebb4-46a6-9854-68a89c1c6631 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3863ecfb-ebb4-46a6-9854-68a89c1c6631 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.818607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3863ecfb-ebb4-46a6-9854-68a89c1c6631 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.884569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:49.886308 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-3863ecfb-ebb4-46a6-9854-68a89c1c6631 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3863ecfb-ebb4-46a6-9854-68a89c1c6631 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 HTTP/1.1 Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'ef56c36e-6f3f-40c5-b1c4-32d49b7c2975'} Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:49.889809 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:49.898044 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 07:01:49.898044 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.898044 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.898044 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.898044 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.898044 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.898044 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.898044 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:49.898044 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:49.898044 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 07:01:49.898044 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.898044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3863ecfb-ebb4-46a6-9854-68a89c1c6631 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:49.900143 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3863ecfb-ebb4-46a6-9854-68a89c1c6631 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 404 len: 111 microversion: 2.1 time: 0.113071 Aug 02 07:01:49.904546 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1703/3273] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:01:49 2022] DELETE /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:49.921332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7ac62532-7079-4158-b1fc-f087ce1a7a12 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:49.922350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7ac62532-7079-4158-b1fc-f087ce1a7a12 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: ef56c36e-6f3f-40c5-b1c4-32d49b7c2975] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:49.935707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ac62532-7079-4158-b1fc-f087ce1a7a12 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.936173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ac62532-7079-4158-b1fc-f087ce1a7a12 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.937573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ac62532-7079-4158-b1fc-f087ce1a7a12 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:49.939664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ac62532-7079-4158-b1fc-f087ce1a7a12 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:49.984674 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-7ac62532-7079-4158-b1fc-f087ce1a7a12 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7ac62532-7079-4158-b1fc-f087ce1a7a12 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 HTTP/1.1 Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'ef56c36e-6f3f-40c5-b1c4-32d49b7c2975'} Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:49.993580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:49.997724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:49.997724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:49.997724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:49.997724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:49.997724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:49.997724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. Aug 02 07:01:49.997724 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:50.000221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7ac62532-7079-4158-b1fc-f087ce1a7a12 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:50.007135 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7ac62532-7079-4158-b1fc-f087ce1a7a12 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975" status: 404 len: 111 microversion: 2.1 time: 0.099487 Aug 02 07:01:50.007983 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1704/3274] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:49 2022] GET /compute/v2.1/servers/ef56c36e-6f3f-40c5-b1c4-32d49b7c2975 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:50.017510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df59347b-febf-49e7-a9ad-58e72de5be17 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:50.018052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df59347b-febf-49e7-a9ad-58e72de5be17 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:50.045079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df59347b-febf-49e7-a9ad-58e72de5be17 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:50.045596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df59347b-febf-49e7-a9ad-58e72de5be17 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:50.047651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df59347b-febf-49e7-a9ad-58e72de5be17 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:50.048130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df59347b-febf-49e7-a9ad-58e72de5be17 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:50.104784 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-df59347b-febf-49e7-a9ad-58e72de5be17 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df59347b-febf-49e7-a9ad-58e72de5be17 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b HTTP/1.1 Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '1c0413c2-3159-4a74-8005-5b265e6cf69b'} Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:50.107653 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:50.111818 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 07:01:50.111818 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:50.111818 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:50.111818 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:50.111818 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:50.111818 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:50.111818 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:50.111818 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:50.111818 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:50.111818 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 07:01:50.111818 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:50.111818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df59347b-febf-49e7-a9ad-58e72de5be17 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:50.128609 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df59347b-febf-49e7-a9ad-58e72de5be17 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b" status: 404 len: 111 microversion: 2.1 time: 0.115310 Aug 02 07:01:50.132489 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1705/3275] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:01:50 2022] DELETE /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:50.150367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ec9781f-e28f-4dc0-8aa9-b19dc382782b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:50.159484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9ec9781f-e28f-4dc0-8aa9-b19dc382782b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1c0413c2-3159-4a74-8005-5b265e6cf69b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:50.203122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c6156e28-5d9b-4f6a-8226-7fc164d931e5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:50.212783 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c6156e28-5d9b-4f6a-8226-7fc164d931e5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1522 microversion: 2.1 time: 0.974775 Aug 02 07:01:50.213967 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1571/3276] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:49 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1522 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:50.219488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ec9781f-e28f-4dc0-8aa9-b19dc382782b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:50.220079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ec9781f-e28f-4dc0-8aa9-b19dc382782b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:50.221019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ec9781f-e28f-4dc0-8aa9-b19dc382782b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:50.222902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ec9781f-e28f-4dc0-8aa9-b19dc382782b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:50.295921 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-9ec9781f-e28f-4dc0-8aa9-b19dc382782b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ec9781f-e28f-4dc0-8aa9-b19dc382782b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b HTTP/1.1 Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '1c0413c2-3159-4a74-8005-5b265e6cf69b'} Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:50.300834 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:50.305972 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:50.305972 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:50.305972 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:50.305972 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:50.305972 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:50.305972 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. Aug 02 07:01:50.305972 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:01:50.309213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ec9781f-e28f-4dc0-8aa9-b19dc382782b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 1c0413c2-3159-4a74-8005-5b265e6cf69b could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:50.311015 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9ec9781f-e28f-4dc0-8aa9-b19dc382782b tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b" status: 404 len: 111 microversion: 2.1 time: 0.176562 Aug 02 07:01:50.316841 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1706/3277] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:50 2022] GET /compute/v2.1/servers/1c0413c2-3159-4a74-8005-5b265e6cf69b => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:51.239374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9f05dd91-b694-42bf-9161-cb580111ecb8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:51.241586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9f05dd91-b694-42bf-9161-cb580111ecb8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:51.274845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f05dd91-b694-42bf-9161-cb580111ecb8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:51.278343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f05dd91-b694-42bf-9161-cb580111ecb8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:51.279933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f05dd91-b694-42bf-9161-cb580111ecb8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:51.280602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f05dd91-b694-42bf-9161-cb580111ecb8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:51.644154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9f05dd91-b694-42bf-9161-cb580111ecb8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:51.656870 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9f05dd91-b694-42bf-9161-cb580111ecb8 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1522 microversion: 2.1 time: 0.424325 Aug 02 07:01:51.658081 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1707/3278] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:51 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:01:51.670820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3733b439-3b3c-4350-a2d5-2957814743b7 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:51.677641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3733b439-3b3c-4350-a2d5-2957814743b7 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:51.694532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3733b439-3b3c-4350-a2d5-2957814743b7 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:51.695522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3733b439-3b3c-4350-a2d5-2957814743b7 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:51.696823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3733b439-3b3c-4350-a2d5-2957814743b7 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:51.698455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3733b439-3b3c-4350-a2d5-2957814743b7 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:51.748380 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3733b439-3b3c-4350-a2d5-2957814743b7 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088804 Aug 02 07:01:51.749980 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1708/3279] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:01:51 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:01:51.825721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-93bb1596-19c9-4549-9db3-ca12f3f2249d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:51.826357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-93bb1596-19c9-4549-9db3-ca12f3f2249d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:51.839018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93bb1596-19c9-4549-9db3-ca12f3f2249d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:51.840099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93bb1596-19c9-4549-9db3-ca12f3f2249d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:51.845251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93bb1596-19c9-4549-9db3-ca12f3f2249d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:51.845723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93bb1596-19c9-4549-9db3-ca12f3f2249d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:51.920678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-93bb1596-19c9-4549-9db3-ca12f3f2249d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:01:51.943937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2051507110", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "20c20d85-841e-464b-882d-cfbfc129b37c"}, {"port": "2136bfef-3765-4057-a98e-e66dd94110e0", "tag": "port-1"}, {"port": "c6a0f893-e351-45b7-8c0a-475bf3575808", "tag": "port-2"}, {"uuid": "25d845e1-059f-477d-becd-4e80b360f698", "tag": "net-1"}, {"uuid": "25d845e1-059f-477d-becd-4e80b360f698"}, {"uuid": "22f8fa77-11b6-475c-bd35-1447d64a3548", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "22f8fa77-11b6-475c-bd35-1447d64a3548", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "00df4d8d-edd9-4f33-a250-31a4fa0da375", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "71bfae3a-8a1c-4999-8fe9-212ba2c2a82f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "750297cc-caab-40e2-baa3-eec3e28316df", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1729995423"}], "key_name": "tempest-keypair-282974978", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:52.191623 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-93bb1596-19c9-4549-9db3-ca12f3f2249d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 204 len: 0 microversion: 2.32 time: 1.237659 Aug 02 07:01:52.192691 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1572/3280] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 07:01:50 2022] DELETE /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 0 bytes in 1240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:01:52.211007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7185cd65-560e-4d89-8de8-bc165098f080 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:52.216893 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7185cd65-560e-4d89-8de8-bc165098f080 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:52.225599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7185cd65-560e-4d89-8de8-bc165098f080 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:52.226444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7185cd65-560e-4d89-8de8-bc165098f080 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:52.227931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7185cd65-560e-4d89-8de8-bc165098f080 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:52.228654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7185cd65-560e-4d89-8de8-bc165098f080 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:52.240121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] validate_networks() for [('20c20d85-841e-464b-882d-cfbfc129b37c', None, None, None, None, None), (None, None, '2136bfef-3765-4057-a98e-e66dd94110e0', None, None, None), (None, None, 'c6a0f893-e351-45b7-8c0a-475bf3575808', None, None, None), ('25d845e1-059f-477d-becd-4e80b360f698', None, None, None, None, None), ('25d845e1-059f-477d-becd-4e80b360f698', None, None, None, None, None), ('22f8fa77-11b6-475c-bd35-1447d64a3548', '10.2.2.100', None, None, None, None), ('22f8fa77-11b6-475c-bd35-1447d64a3548', '10.2.2.200', None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:01:52.267403 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7185cd65-560e-4d89-8de8-bc165098f080 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072753 Aug 02 07:01:52.268293 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1573/3281] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:01:52 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:01:52.282342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-25d00bbf-d0ad-405b-9ada-4cd859169baa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:52.284024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-25d00bbf-d0ad-405b-9ada-4cd859169baa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:52.292093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25d00bbf-d0ad-405b-9ada-4cd859169baa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:52.292857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25d00bbf-d0ad-405b-9ada-4cd859169baa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:52.293934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25d00bbf-d0ad-405b-9ada-4cd859169baa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:52.294570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25d00bbf-d0ad-405b-9ada-4cd859169baa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:52.881485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-25d00bbf-d0ad-405b-9ada-4cd859169baa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:52.895551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-25d00bbf-d0ad-405b-9ada-4cd859169baa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:52.897741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-25d00bbf-d0ad-405b-9ada-4cd859169baa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:52.907192 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-25d00bbf-d0ad-405b-9ada-4cd859169baa tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 2951 microversion: 2.32 time: 0.630775 Aug 02 07:01:52.909416 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1574/3282] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:01:52 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 2951 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:01:52.928069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c4d50cdd-2d39-4a42-a691-6e77dba41400 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:52.931786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c4d50cdd-2d39-4a42-a691-6e77dba41400 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:52.947171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4d50cdd-2d39-4a42-a691-6e77dba41400 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:52.948227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4d50cdd-2d39-4a42-a691-6e77dba41400 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:52.949407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4d50cdd-2d39-4a42-a691-6e77dba41400 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:52.951929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4d50cdd-2d39-4a42-a691-6e77dba41400 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:53.034930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c4d50cdd-2d39-4a42-a691-6e77dba41400 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:01:53.246812 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c4d50cdd-2d39-4a42-a691-6e77dba41400 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 204 len: 0 microversion: 2.1 time: 0.334813 Aug 02 07:01:53.249433 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1575/3283] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:01:52 2022] DELETE /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:01:53.262291 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-49df36b2-a442-4acf-99b7-ec2396e92728 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:53.265398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-49df36b2-a442-4acf-99b7-ec2396e92728 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:53.279349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49df36b2-a442-4acf-99b7-ec2396e92728 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:53.281946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49df36b2-a442-4acf-99b7-ec2396e92728 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:53.283822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49df36b2-a442-4acf-99b7-ec2396e92728 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:53.284452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49df36b2-a442-4acf-99b7-ec2396e92728 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:53.587663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-49df36b2-a442-4acf-99b7-ec2396e92728 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:53.611824 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-49df36b2-a442-4acf-99b7-ec2396e92728 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1522 microversion: 2.1 time: 0.358930 Aug 02 07:01:53.630084 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1576/3284] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:53 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:53.641431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-981233cd-3963-43c1-b85e-8c1c92bf6d2a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:53.642595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-981233cd-3963-43c1-b85e-8c1c92bf6d2a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:53.683412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-981233cd-3963-43c1-b85e-8c1c92bf6d2a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:53.684592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-981233cd-3963-43c1-b85e-8c1c92bf6d2a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:53.686199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-981233cd-3963-43c1-b85e-8c1c92bf6d2a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:53.686857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-981233cd-3963-43c1-b85e-8c1c92bf6d2a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:54.145113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-981233cd-3963-43c1-b85e-8c1c92bf6d2a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:54.165123 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-981233cd-3963-43c1-b85e-8c1c92bf6d2a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1675 microversion: 2.1 time: 0.533102 Aug 02 07:01:54.185922 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1577/3285] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:53 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1675 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:54.185922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4cb82442-4ee3-4f61-9e67-a8925dd20a65 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:54.185922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4cb82442-4ee3-4f61-9e67-a8925dd20a65 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:54.202054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cb82442-4ee3-4f61-9e67-a8925dd20a65 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:54.202513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cb82442-4ee3-4f61-9e67-a8925dd20a65 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:54.203303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cb82442-4ee3-4f61-9e67-a8925dd20a65 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:54.213977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cb82442-4ee3-4f61-9e67-a8925dd20a65 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:54.680957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4cb82442-4ee3-4f61-9e67-a8925dd20a65 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:54.709407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4cb82442-4ee3-4f61-9e67-a8925dd20a65 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:54.722577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4cb82442-4ee3-4f61-9e67-a8925dd20a65 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:54.725463 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4cb82442-4ee3-4f61-9e67-a8925dd20a65 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 2951 microversion: 2.32 time: 0.548933 Aug 02 07:01:54.730293 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1578/3286] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:01:54 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 2951 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:01:54.739278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0dae655a-202d-46e9-911c-fe2a1ccc2b9e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:54.747965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0dae655a-202d-46e9-911c-fe2a1ccc2b9e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:54.771088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0dae655a-202d-46e9-911c-fe2a1ccc2b9e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:54.772147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0dae655a-202d-46e9-911c-fe2a1ccc2b9e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:54.773612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0dae655a-202d-46e9-911c-fe2a1ccc2b9e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:54.776513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0dae655a-202d-46e9-911c-fe2a1ccc2b9e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:55.521292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0dae655a-202d-46e9-911c-fe2a1ccc2b9e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:55.546859 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0dae655a-202d-46e9-911c-fe2a1ccc2b9e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1522 microversion: 2.1 time: 0.813751 Aug 02 07:01:55.547487 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1579/3287] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:54 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1522 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:55.566259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3ded7e6c-0f28-4711-9e62-e9a7c98a454b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:55.567432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3ded7e6c-0f28-4711-9e62-e9a7c98a454b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:55.589467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ded7e6c-0f28-4711-9e62-e9a7c98a454b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:55.590248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ded7e6c-0f28-4711-9e62-e9a7c98a454b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:55.593520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ded7e6c-0f28-4711-9e62-e9a7c98a454b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:55.594230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ded7e6c-0f28-4711-9e62-e9a7c98a454b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:55.951250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:01:56.280347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3ded7e6c-0f28-4711-9e62-e9a7c98a454b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391135debbcb49de8b47dea807d9a4ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21684e149204ae7afe06a3097411bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:56.307974 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3ded7e6c-0f28-4711-9e62-e9a7c98a454b tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 200 len: 1675 microversion: 2.1 time: 0.756274 Aug 02 07:01:56.308918 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1580/3288] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:55 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 1675 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:56.339694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f73d401a-00af-4af9-8d24-12abac3d4d1f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:56.342524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f73d401a-00af-4af9-8d24-12abac3d4d1f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:56.360160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f73d401a-00af-4af9-8d24-12abac3d4d1f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:56.372281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f73d401a-00af-4af9-8d24-12abac3d4d1f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:56.373234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f73d401a-00af-4af9-8d24-12abac3d4d1f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:56.373664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f73d401a-00af-4af9-8d24-12abac3d4d1f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:57.108303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f73d401a-00af-4af9-8d24-12abac3d4d1f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:57.123550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f73d401a-00af-4af9-8d24-12abac3d4d1f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:57.125348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f73d401a-00af-4af9-8d24-12abac3d4d1f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:57.131392 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f73d401a-00af-4af9-8d24-12abac3d4d1f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 2951 microversion: 2.32 time: 0.806518 Aug 02 07:01:57.147354 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1581/3289] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:01:56 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 2951 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:01:57.157594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-073ea6ce-7871-49d6-9572-2572453ffc05 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:57.162256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-073ea6ce-7871-49d6-9572-2572453ffc05 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:57.170010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-073ea6ce-7871-49d6-9572-2572453ffc05 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:57.174960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-073ea6ce-7871-49d6-9572-2572453ffc05 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:57.176383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-073ea6ce-7871-49d6-9572-2572453ffc05 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:57.177193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-073ea6ce-7871-49d6-9572-2572453ffc05 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:57.193700 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-073ea6ce-7871-49d6-9572-2572453ffc05 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-073ea6ce-7871-49d6-9572-2572453ffc05 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 HTTP/1.1 Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '5b32b61f-03ac-477c-b5d0-1606b9694c26'} Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:57.196368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:57.201319 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 07:01:57.201319 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:57.201319 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:57.201319 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:57.201319 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:57.201319 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:57.201319 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:57.201319 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:57.201319 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:57.201319 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 07:01:57.201319 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:57.204057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-073ea6ce-7871-49d6-9572-2572453ffc05 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:57.205256 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-073ea6ce-7871-49d6-9572-2572453ffc05 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 404 len: 111 microversion: 2.1 time: 0.051678 Aug 02 07:01:57.206302 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1582/3290] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:01:57 2022] DELETE /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:57.211959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8d3304b6-0438-44be-aa40-64709a7a7240 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:57.213133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8d3304b6-0438-44be-aa40-64709a7a7240 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:57.220389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d3304b6-0438-44be-aa40-64709a7a7240 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:57.221280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d3304b6-0438-44be-aa40-64709a7a7240 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:57.222389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d3304b6-0438-44be-aa40-64709a7a7240 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:57.227443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d3304b6-0438-44be-aa40-64709a7a7240 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:58.369592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8d3304b6-0438-44be-aa40-64709a7a7240 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:01:58.381938 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8d3304b6-0438-44be-aa40-64709a7a7240 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1522 microversion: 2.1 time: 1.174135 Aug 02 07:01:58.385294 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1583/3291] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:57 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1522 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:01:58.402103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-95b7e4b8-0e09-4046-b51a-3824646c6d5f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:58.402728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-95b7e4b8-0e09-4046-b51a-3824646c6d5f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 5b32b61f-03ac-477c-b5d0-1606b9694c26] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:58.414698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95b7e4b8-0e09-4046-b51a-3824646c6d5f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:58.418552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95b7e4b8-0e09-4046-b51a-3824646c6d5f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:58.419401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95b7e4b8-0e09-4046-b51a-3824646c6d5f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:58.420012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95b7e4b8-0e09-4046-b51a-3824646c6d5f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:58.464479 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-95b7e4b8-0e09-4046-b51a-3824646c6d5f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-95b7e4b8-0e09-4046-b51a-3824646c6d5f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 HTTP/1.1 Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '5b32b61f-03ac-477c-b5d0-1606b9694c26'} Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:58.478276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:58.485780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:58.485780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:58.485780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:58.485780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:58.485780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:58.485780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. Aug 02 07:01:58.485780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:58.485780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-95b7e4b8-0e09-4046-b51a-3824646c6d5f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 5b32b61f-03ac-477c-b5d0-1606b9694c26 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:58.485780 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-95b7e4b8-0e09-4046-b51a-3824646c6d5f tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26" status: 404 len: 111 microversion: 2.1 time: 0.096880 Aug 02 07:01:58.485780 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1584/3292] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:58 2022] GET /compute/v2.1/servers/5b32b61f-03ac-477c-b5d0-1606b9694c26 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:58.503492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-42940228-5c6a-47c2-88be-eb5309323a85 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:58.506435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-42940228-5c6a-47c2-88be-eb5309323a85 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:58.532522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42940228-5c6a-47c2-88be-eb5309323a85 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:58.545401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42940228-5c6a-47c2-88be-eb5309323a85 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:58.548094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42940228-5c6a-47c2-88be-eb5309323a85 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:58.554460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42940228-5c6a-47c2-88be-eb5309323a85 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:58.604747 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-42940228-5c6a-47c2-88be-eb5309323a85 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] HTTP exception thrown: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-42940228-5c6a-47c2-88be-eb5309323a85 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Request method failure captured: Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 HTTP/1.1 Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MnIh0r4AtohMIHRrEySUKFBwUksLvrYD5U5qa12hpVglZXMiGVekhsXvcLy3TbgN66cBUvaprJxUI2LBMOvV3zNfb_RsXkH6cv4hqhNkSOyLVSbFKWy9naxH2MklPvdSqUlgkNKDsb7t5lqcRw9Glt-81uCSsji2_6Z1Z_US2iUgdU Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: c21684e149204ae7afe06a3097411bd0 Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c21684e149204ae7afe06a3097411bd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c21684e149204ae7afe06a3097411bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c21684e149204ae7afe06a3097411bd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c21684e149204ae7afe06a3097411bd0"}]}] Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: c21684e149204ae7afe06a3097411bd0 Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachVolumeTestJSON-898397610-project Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 391135debbcb49de8b47dea807d9a4ea Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachVolumeTestJSON-898397610-project Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'a42f890a-37e8-42bd-a345-d4dddadd50a1'} Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:01:58.614209 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:58.623719 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:01:58.623719 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:01:58.623719 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:01:58.623719 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:01:58.623719 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:01:58.623719 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:01:58.623719 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:01:58.634248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-42940228-5c6a-47c2-88be-eb5309323a85 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Returning 404 to user: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:01:58.636268 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-42940228-5c6a-47c2-88be-eb5309323a85 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 404 len: 111 microversion: 2.1 time: 0.146253 Aug 02 07:01:58.642734 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1585/3293] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:01:58 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:01:59.166751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e61fc483-3826-4c5c-b050-220a41b38cff req-bff35cbd-1477-423d-b63e-70e248433849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42f890a-37e8-42bd-a345-d4dddadd50a1", "name": "network-vif-deleted", "tag": "5ea429d3-3487-4c80-b5fb-b55e82f3edc6"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:01:59.215717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e61fc483-3826-4c5c-b050-220a41b38cff req-bff35cbd-1477-423d-b63e-70e248433849 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:59.216546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e61fc483-3826-4c5c-b050-220a41b38cff req-bff35cbd-1477-423d-b63e-70e248433849 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:59.243464 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e61fc483-3826-4c5c-b050-220a41b38cff req-bff35cbd-1477-423d-b63e-70e248433849 service nova] Creating event network-vif-deleted:5ea429d3-3487-4c80-b5fb-b55e82f3edc6 for instance a42f890a-37e8-42bd-a345-d4dddadd50a1 on n-h1-851337-3 Aug 02 07:01:59.264019 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e61fc483-3826-4c5c-b050-220a41b38cff req-bff35cbd-1477-423d-b63e-70e248433849 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.605210 Aug 02 07:01:59.265366 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1586/3294] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:01:59.276952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4be7398c-5ada-41a8-993c-9594bbc5dbe9 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:01:59.278398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4be7398c-5ada-41a8-993c-9594bbc5dbe9 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:01:59.295804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4be7398c-5ada-41a8-993c-9594bbc5dbe9 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:59.296744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4be7398c-5ada-41a8-993c-9594bbc5dbe9 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:59.298058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4be7398c-5ada-41a8-993c-9594bbc5dbe9 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:01:59.298848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4be7398c-5ada-41a8-993c-9594bbc5dbe9 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:01:59.359732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:00.055538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4be7398c-5ada-41a8-993c-9594bbc5dbe9 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:00.072821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4be7398c-5ada-41a8-993c-9594bbc5dbe9 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:00.078349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4be7398c-5ada-41a8-993c-9594bbc5dbe9 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:00.081534 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4be7398c-5ada-41a8-993c-9594bbc5dbe9 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 2930 microversion: 2.32 time: 0.813094 Aug 02 07:02:00.084873 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1587/3295] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:01:59 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 2930 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:00.108722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0e3df76-25fb-49cb-9883-58ae892b5e32 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:00.113651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d0e3df76-25fb-49cb-9883-58ae892b5e32 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:00.131891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0e3df76-25fb-49cb-9883-58ae892b5e32 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:00.132351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0e3df76-25fb-49cb-9883-58ae892b5e32 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:00.136808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0e3df76-25fb-49cb-9883-58ae892b5e32 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:00.136955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0e3df76-25fb-49cb-9883-58ae892b5e32 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:00.178083 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-d0e3df76-25fb-49cb-9883-58ae892b5e32 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0e3df76-25fb-49cb-9883-58ae892b5e32 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea HTTP/1.1 Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1aed46f8-2bf8-49ea-88bb-ad81d9f715ea'} Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:02:00.184276 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:02:00.189477 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 07:02:00.189477 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:00.189477 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:00.189477 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:00.189477 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:00.189477 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:00.189477 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:00.189477 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:02:00.189477 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:02:00.189477 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 07:02:00.189477 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:00.189477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0e3df76-25fb-49cb-9883-58ae892b5e32 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:02:00.191813 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d0e3df76-25fb-49cb-9883-58ae892b5e32 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea" status: 404 len: 111 microversion: 2.1 time: 0.103823 Aug 02 07:02:00.192728 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1588/3296] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:02:00 2022] DELETE /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:02:00.204562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a5e03e26-e3de-44d9-b696-702c92178e9a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '.version_select at 0x7f927af969d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:00.249245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:00.276892 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a5e03e26-e3de-44d9-b696-702c92178e9a tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-972196208" status: 202 len: 0 microversion: 2.1 time: 0.082007 Aug 02 07:02:00.277801 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1589/3297] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Aug 2 07:02:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-972196208 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:02:00.288764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a44febc2-ec04-4a79-a6d3-95ddcec22bb9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:00.293484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a44febc2-ec04-4a79-a6d3-95ddcec22bb9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:00.316966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a44febc2-ec04-4a79-a6d3-95ddcec22bb9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:00.318388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a44febc2-ec04-4a79-a6d3-95ddcec22bb9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:00.319704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a44febc2-ec04-4a79-a6d3-95ddcec22bb9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:00.320618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a44febc2-ec04-4a79-a6d3-95ddcec22bb9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:00.655039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:02:00.656434 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:02:00.657206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:02:00.657835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:02:00.658602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:02:00.691694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:00.692153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:00.703147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:00.703607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:00.748537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Getting quotas for project 03f5bbf476c94643bf0cdc53674eac15. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:02:00.768480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Getting quotas for user 2b4020638dc2480a8c451435824cd0f6 and project 03f5bbf476c94643bf0cdc53674eac15. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:02:00.912688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a44febc2-ec04-4a79-a6d3-95ddcec22bb9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:00.961985 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a44febc2-ec04-4a79-a6d3-95ddcec22bb9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1522 microversion: 2.1 time: 0.682674 Aug 02 07:02:00.962612 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1590/3298] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:00 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1522 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:01.175077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:02:01.177854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='00df4d8d-edd9-4f33-a250-31a4fa0da375',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='71bfae3a-8a1c-4999-8fe9-212ba2c2a82f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='750297cc-caab-40e2-baa3-eec3e28316df',volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:02:01.505068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c5223964-b74f-45e2-87a5-e89bb59b17df req-1a4514cd-344d-4a33-b592-e13f37383267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-unplugged", "status": "completed", "tag": "68c6c37c-41e1-43c2-ab74-6a4e3a848c4a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:01.525884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c5223964-b74f-45e2-87a5-e89bb59b17df req-1a4514cd-344d-4a33-b592-e13f37383267 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:01.526133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c5223964-b74f-45e2-87a5-e89bb59b17df req-1a4514cd-344d-4a33-b592-e13f37383267 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:01.554774 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c5223964-b74f-45e2-87a5-e89bb59b17df req-1a4514cd-344d-4a33-b592-e13f37383267 service nova] Creating event network-vif-unplugged:68c6c37c-41e1-43c2-ab74-6a4e3a848c4a for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 07:02:01.572463 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c5223964-b74f-45e2-87a5-e89bb59b17df req-1a4514cd-344d-4a33-b592-e13f37383267 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.608555 Aug 02 07:02:01.573685 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1591/3299] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:01.579354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9c479e87-ae9c-4e0a-a7e3-e8f131555f36 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:01.582886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9c479e87-ae9c-4e0a-a7e3-e8f131555f36 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] [instance: 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:01.598680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c479e87-ae9c-4e0a-a7e3-e8f131555f36 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:01.603498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c479e87-ae9c-4e0a-a7e3-e8f131555f36 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:01.605073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c479e87-ae9c-4e0a-a7e3-e8f131555f36 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:01.606479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c479e87-ae9c-4e0a-a7e3-e8f131555f36 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:01.649123 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-9c479e87-ae9c-4e0a-a7e3-e8f131555f36 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] HTTP exception thrown: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9c479e87-ae9c-4e0a-a7e3-e8f131555f36 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Request method failure captured: Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea HTTP/1.1 Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MqSZiO7N2tOVyanI0afzafQRt-khD6xAGO-0zwPbT-8fta0LSm0w6huUCdWIGkVWUJdHnOhPwwyCjxMWiQENKOgURwctDJzeCxd1Ul35lZNSByogmwtDzgbVWjIIjpj3eVYVKSeB9nGLe-mc1I3Ji8dWcmj3iI161LbDFHBSNLmOIk Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a004889882844be18e4c30827645050e Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a004889882844be18e4c30827645050e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a004889882844be18e4c30827645050e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a004889882844be18e4c30827645050e"}]}] Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-DeleteServersTestJSON-774379893 Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a004889882844be18e4c30827645050e Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-DeleteServersTestJSON-774379893 Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0d6870f29383493c86db7e30259b8a8b Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-DeleteServersTestJSON-774379893-project Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1aed46f8-2bf8-49ea-88bb-ad81d9f715ea'} Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:01.653408 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:01.658590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:01.658590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:01.658590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:01.658590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:02:01.658590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:02:01.658590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. Aug 02 07:02:01.658590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:01.660176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9c479e87-ae9c-4e0a-a7e3-e8f131555f36 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] Returning 404 to user: Instance 1aed46f8-2bf8-49ea-88bb-ad81d9f715ea could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:02:01.662592 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9c479e87-ae9c-4e0a-a7e3-e8f131555f36 tempest-DeleteServersTestJSON-774379893 tempest-DeleteServersTestJSON-774379893-project] 10.222.0.79 "GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea" status: 404 len: 111 microversion: 2.1 time: 0.086247 Aug 02 07:02:01.663762 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1592/3300] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:01 2022] GET /compute/v2.1/servers/1aed46f8-2bf8-49ea-88bb-ad81d9f715ea => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:02:01.673587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3fb9ed81-5aaa-4c5b-86d9-1de1b32ef4dd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:01.677949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3fb9ed81-5aaa-4c5b-86d9-1de1b32ef4dd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:01.695036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fb9ed81-5aaa-4c5b-86d9-1de1b32ef4dd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:01.701327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fb9ed81-5aaa-4c5b-86d9-1de1b32ef4dd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:01.706921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fb9ed81-5aaa-4c5b-86d9-1de1b32ef4dd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:01.710245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fb9ed81-5aaa-4c5b-86d9-1de1b32ef4dd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:01.959009 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-510ad7ea-c8cf-401b-99c2-da7fe017da59 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 10.023828 Aug 02 07:02:01.962712 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1709/3301] 10.222.0.79 () {62 vars in 1189 bytes} [Tue Aug 2 07:01:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 10029 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 07:02:01.986192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3e6b1948-13bc-4813-98ba-fdcc7c70b0cf tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:01.991644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3e6b1948-13bc-4813-98ba-fdcc7c70b0cf tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:02.383145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3e6b1948-13bc-4813-98ba-fdcc7c70b0cf tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:02.434754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3e6b1948-13bc-4813-98ba-fdcc7c70b0cf tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:02.445280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3e6b1948-13bc-4813-98ba-fdcc7c70b0cf tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:02.451134 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3e6b1948-13bc-4813-98ba-fdcc7c70b0cf tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1285 microversion: 2.42 time: 0.474749 Aug 02 07:02:02.466582 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1710/3302] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:01 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1285 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:02.476798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-05a2caad-6100-47a8-8aee-08c19d138857 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:02.477425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-05a2caad-6100-47a8-8aee-08c19d138857 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:02.501735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05a2caad-6100-47a8-8aee-08c19d138857 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:02.502227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05a2caad-6100-47a8-8aee-08c19d138857 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:02.503042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05a2caad-6100-47a8-8aee-08c19d138857 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:02.503488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05a2caad-6100-47a8-8aee-08c19d138857 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:02.668083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3fb9ed81-5aaa-4c5b-86d9-1de1b32ef4dd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:02.677756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3fb9ed81-5aaa-4c5b-86d9-1de1b32ef4dd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:02.679335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3fb9ed81-5aaa-4c5b-86d9-1de1b32ef4dd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:02.680650 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3fb9ed81-5aaa-4c5b-86d9-1de1b32ef4dd tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 2909 microversion: 2.32 time: 1.014108 Aug 02 07:02:02.681218 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1593/3303] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:01 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 2909 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:02.703304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-d0b35d07-0aee-464a-bab9-7f1f5443fef8 req-77a3cf44-4dd5-4a60-9eff-535c44cc2ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-deleted", "tag": "8bd7f640-b150-4b49-bbf4-89405b95cc9e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:02.719878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d0b35d07-0aee-464a-bab9-7f1f5443fef8 req-77a3cf44-4dd5-4a60-9eff-535c44cc2ee8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:02.720429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d0b35d07-0aee-464a-bab9-7f1f5443fef8 req-77a3cf44-4dd5-4a60-9eff-535c44cc2ee8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:02.764124 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-d0b35d07-0aee-464a-bab9-7f1f5443fef8 req-77a3cf44-4dd5-4a60-9eff-535c44cc2ee8 service nova] Creating event network-vif-deleted:8bd7f640-b150-4b49-bbf4-89405b95cc9e for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 07:02:02.778721 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-d0b35d07-0aee-464a-bab9-7f1f5443fef8 req-77a3cf44-4dd5-4a60-9eff-535c44cc2ee8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078009 Aug 02 07:02:02.782515 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1594/3304] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:03.178389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-05a2caad-6100-47a8-8aee-08c19d138857 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:03.196045 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-05a2caad-6100-47a8-8aee-08c19d138857 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1522 microversion: 2.1 time: 0.727902 Aug 02 07:02:03.210841 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1711/3305] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:02 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1522 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:03.478376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f3193dc-fa45-43bb-9894-d1c3eb9d3223 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:03.479093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3f3193dc-fa45-43bb-9894-d1c3eb9d3223 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:03.613683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-25e19cf3-8b3c-40e5-bb37-ff0981f2994b req-5b2cadcf-822b-4169-a65c-1ad0fc5cf569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-unplugged", "status": "completed", "tag": "8bd7f640-b150-4b49-bbf4-89405b95cc9e"}, {"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-unplugged", "status": "completed", "tag": "3955d63c-80ec-4a2b-9a0a-54b7d2089a40"}, {"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-unplugged", "status": "completed", "tag": "25aa727a-724d-4084-bf7a-ee4c3a07cce3"}, {"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-unplugged", "status": "completed", "tag": "32cec3a6-9298-4f4e-927b-827dd64b2baf"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:03.665046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-25e19cf3-8b3c-40e5-bb37-ff0981f2994b req-5b2cadcf-822b-4169-a65c-1ad0fc5cf569 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:03.666428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-25e19cf3-8b3c-40e5-bb37-ff0981f2994b req-5b2cadcf-822b-4169-a65c-1ad0fc5cf569 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:03.704362 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-25e19cf3-8b3c-40e5-bb37-ff0981f2994b req-5b2cadcf-822b-4169-a65c-1ad0fc5cf569 service nova] Creating event network-vif-unplugged:8bd7f640-b150-4b49-bbf4-89405b95cc9e for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 07:02:03.710232 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-25e19cf3-8b3c-40e5-bb37-ff0981f2994b req-5b2cadcf-822b-4169-a65c-1ad0fc5cf569 service nova] Creating event network-vif-unplugged:3955d63c-80ec-4a2b-9a0a-54b7d2089a40 for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 07:02:03.711081 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-25e19cf3-8b3c-40e5-bb37-ff0981f2994b req-5b2cadcf-822b-4169-a65c-1ad0fc5cf569 service nova] Creating event network-vif-unplugged:25aa727a-724d-4084-bf7a-ee4c3a07cce3 for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 07:02:03.713042 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-25e19cf3-8b3c-40e5-bb37-ff0981f2994b req-5b2cadcf-822b-4169-a65c-1ad0fc5cf569 service nova] Creating event network-vif-unplugged:32cec3a6-9298-4f4e-927b-827dd64b2baf for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 07:02:03.724057 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-25e19cf3-8b3c-40e5-bb37-ff0981f2994b req-5b2cadcf-822b-4169-a65c-1ad0fc5cf569 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.117499 Aug 02 07:02:03.726059 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1712/3306] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:02:03.734930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7bd0781d-8202-419e-b55b-75e549e3826d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:03.736366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7bd0781d-8202-419e-b55b-75e549e3826d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:03.745375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bd0781d-8202-419e-b55b-75e549e3826d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:03.746348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bd0781d-8202-419e-b55b-75e549e3826d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:03.747331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bd0781d-8202-419e-b55b-75e549e3826d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:03.747991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bd0781d-8202-419e-b55b-75e549e3826d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:03.913601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3f3193dc-fa45-43bb-9894-d1c3eb9d3223 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:03.954091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3f3193dc-fa45-43bb-9894-d1c3eb9d3223 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:03.961404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3f3193dc-fa45-43bb-9894-d1c3eb9d3223 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:03.965447 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3f3193dc-fa45-43bb-9894-d1c3eb9d3223 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1285 microversion: 2.42 time: 0.491374 Aug 02 07:02:03.970232 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1595/3307] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:03 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1285 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:02:04.225565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-da6ef547-baa5-4d9c-8616-c5b00e69e022 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:04.226865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-da6ef547-baa5-4d9c-8616-c5b00e69e022 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:04.237542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da6ef547-baa5-4d9c-8616-c5b00e69e022 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:04.238861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da6ef547-baa5-4d9c-8616-c5b00e69e022 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:04.240618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da6ef547-baa5-4d9c-8616-c5b00e69e022 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:04.242139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da6ef547-baa5-4d9c-8616-c5b00e69e022 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:04.456170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7bd0781d-8202-419e-b55b-75e549e3826d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:04.473704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7bd0781d-8202-419e-b55b-75e549e3826d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:04.487008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7bd0781d-8202-419e-b55b-75e549e3826d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:04.489343 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7bd0781d-8202-419e-b55b-75e549e3826d tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 2748 microversion: 2.32 time: 0.761307 Aug 02 07:02:04.490379 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1713/3308] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:03 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 2748 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:04.757686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-da6ef547-baa5-4d9c-8616-c5b00e69e022 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:04.779640 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-da6ef547-baa5-4d9c-8616-c5b00e69e022 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1522 microversion: 2.1 time: 0.545840 Aug 02 07:02:04.780606 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1596/3309] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:04 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1522 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:04.908769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-523d5567-65a5-4a8d-a011-0379ad3df12a req-8c78a819-bad7-417b-a7ec-397001f7c1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-deleted", "tag": "3955d63c-80ec-4a2b-9a0a-54b7d2089a40"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:04.933626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-523d5567-65a5-4a8d-a011-0379ad3df12a req-8c78a819-bad7-417b-a7ec-397001f7c1a4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:04.937514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-523d5567-65a5-4a8d-a011-0379ad3df12a req-8c78a819-bad7-417b-a7ec-397001f7c1a4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:04.998193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-28ec48ab-f616-43ff-8303-e946a79ae06d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:05.000285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-28ec48ab-f616-43ff-8303-e946a79ae06d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:05.020295 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-523d5567-65a5-4a8d-a011-0379ad3df12a req-8c78a819-bad7-417b-a7ec-397001f7c1a4 service nova] Creating event network-vif-deleted:3955d63c-80ec-4a2b-9a0a-54b7d2089a40 for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 07:02:05.044608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28ec48ab-f616-43ff-8303-e946a79ae06d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:05.045918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28ec48ab-f616-43ff-8303-e946a79ae06d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:05.047492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28ec48ab-f616-43ff-8303-e946a79ae06d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:05.051439 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-523d5567-65a5-4a8d-a011-0379ad3df12a req-8c78a819-bad7-417b-a7ec-397001f7c1a4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146307 Aug 02 07:02:05.052232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28ec48ab-f616-43ff-8303-e946a79ae06d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:05.065934 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1714/3310] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:05.401391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-28ec48ab-f616-43ff-8303-e946a79ae06d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:05.420672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-28ec48ab-f616-43ff-8303-e946a79ae06d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:05.430901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-28ec48ab-f616-43ff-8303-e946a79ae06d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:05.432478 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-28ec48ab-f616-43ff-8303-e946a79ae06d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1583 microversion: 2.42 time: 0.441856 Aug 02 07:02:05.441928 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1597/3311] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:04 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1583 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:02:05.527908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-88e24d11-806d-4712-9620-c1ddaae8d71b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:05.528774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-88e24d11-806d-4712-9620-c1ddaae8d71b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:05.550527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88e24d11-806d-4712-9620-c1ddaae8d71b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:05.562533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88e24d11-806d-4712-9620-c1ddaae8d71b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:05.563825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88e24d11-806d-4712-9620-c1ddaae8d71b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:05.564556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88e24d11-806d-4712-9620-c1ddaae8d71b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:05.813116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e6da148c-e56e-4782-9b25-8fb3b6b06887 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:05.814103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e6da148c-e56e-4782-9b25-8fb3b6b06887 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:05.827738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6da148c-e56e-4782-9b25-8fb3b6b06887 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:05.828646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6da148c-e56e-4782-9b25-8fb3b6b06887 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:05.832091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6da148c-e56e-4782-9b25-8fb3b6b06887 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:05.832849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6da148c-e56e-4782-9b25-8fb3b6b06887 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:06.947318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e6da148c-e56e-4782-9b25-8fb3b6b06887 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:06.963905 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e6da148c-e56e-4782-9b25-8fb3b6b06887 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1522 microversion: 2.1 time: 1.154835 Aug 02 07:02:06.969377 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1598/3312] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:05 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1522 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:06.990243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-36f0285d-f168-40a9-a666-59d2cd2f2246 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:07.004574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-36f0285d-f168-40a9-a666-59d2cd2f2246 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:07.029435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36f0285d-f168-40a9-a666-59d2cd2f2246 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:07.030208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36f0285d-f168-40a9-a666-59d2cd2f2246 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:07.039561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36f0285d-f168-40a9-a666-59d2cd2f2246 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:07.040306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36f0285d-f168-40a9-a666-59d2cd2f2246 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:07.488122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-36f0285d-f168-40a9-a666-59d2cd2f2246 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:07.537502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-36f0285d-f168-40a9-a666-59d2cd2f2246 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:07.540825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-36f0285d-f168-40a9-a666-59d2cd2f2246 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:07.544896 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-36f0285d-f168-40a9-a666-59d2cd2f2246 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1593 microversion: 2.42 time: 0.572374 Aug 02 07:02:07.560461 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1599/3313] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:06 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1593 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:07.600089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8ee88bd2-23f3-4908-95ad-7c1f2c968a27 req-cc7825ff-625d-4915-b0b6-dfa35339bcd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-deleted", "tag": "68c6c37c-41e1-43c2-ab74-6a4e3a848c4a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:07.632295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8ee88bd2-23f3-4908-95ad-7c1f2c968a27 req-cc7825ff-625d-4915-b0b6-dfa35339bcd4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:07.641839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8ee88bd2-23f3-4908-95ad-7c1f2c968a27 req-cc7825ff-625d-4915-b0b6-dfa35339bcd4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:07.651534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-88e24d11-806d-4712-9620-c1ddaae8d71b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:07.678247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-88e24d11-806d-4712-9620-c1ddaae8d71b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:07.680999 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8ee88bd2-23f3-4908-95ad-7c1f2c968a27 req-cc7825ff-625d-4915-b0b6-dfa35339bcd4 service nova] Creating event network-vif-deleted:68c6c37c-41e1-43c2-ab74-6a4e3a848c4a for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 07:02:07.684565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-88e24d11-806d-4712-9620-c1ddaae8d71b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:07.685977 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-88e24d11-806d-4712-9620-c1ddaae8d71b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 2542 microversion: 2.32 time: 2.164194 Aug 02 07:02:07.686587 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1715/3314] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:05 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 2542 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:07.706989 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8ee88bd2-23f3-4908-95ad-7c1f2c968a27 req-cc7825ff-625d-4915-b0b6-dfa35339bcd4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115689 Aug 02 07:02:07.709152 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1600/3315] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:07.994206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f01db0f1-1a39-4f37-a634-0d257c0a3e0e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:07.995114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f01db0f1-1a39-4f37-a634-0d257c0a3e0e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:08.006024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f01db0f1-1a39-4f37-a634-0d257c0a3e0e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:08.007849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f01db0f1-1a39-4f37-a634-0d257c0a3e0e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:08.017523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f01db0f1-1a39-4f37-a634-0d257c0a3e0e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:08.020185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f01db0f1-1a39-4f37-a634-0d257c0a3e0e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:08.573297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2d27fb60-c266-4a7c-b899-06103f13f0ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:08.574038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2d27fb60-c266-4a7c-b899-06103f13f0ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:08.592531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d27fb60-c266-4a7c-b899-06103f13f0ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:08.593047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d27fb60-c266-4a7c-b899-06103f13f0ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:08.593977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d27fb60-c266-4a7c-b899-06103f13f0ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:08.594426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d27fb60-c266-4a7c-b899-06103f13f0ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:09.001651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2d27fb60-c266-4a7c-b899-06103f13f0ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:09.034545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2d27fb60-c266-4a7c-b899-06103f13f0ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:09.041750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2d27fb60-c266-4a7c-b899-06103f13f0ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:09.049731 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2d27fb60-c266-4a7c-b899-06103f13f0ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1593 microversion: 2.42 time: 0.480446 Aug 02 07:02:09.061123 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1601/3316] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:08 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1593 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:02:09.069476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9c6bfc13-ef0c-43d2-8eeb-63d695cf1aeb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:09.071021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9c6bfc13-ef0c-43d2-8eeb-63d695cf1aeb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:09.115061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c6bfc13-ef0c-43d2-8eeb-63d695cf1aeb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:09.116124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c6bfc13-ef0c-43d2-8eeb-63d695cf1aeb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:09.117794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c6bfc13-ef0c-43d2-8eeb-63d695cf1aeb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:09.118704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c6bfc13-ef0c-43d2-8eeb-63d695cf1aeb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:09.305147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f01db0f1-1a39-4f37-a634-0d257c0a3e0e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:09.317088 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f01db0f1-1a39-4f37-a634-0d257c0a3e0e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1522 microversion: 2.1 time: 1.326764 Aug 02 07:02:09.317699 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1716/3317] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:07 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1522 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:02:10.090571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f64b3488-5ea4-4509-9799-73e09fff4fad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:10.091664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f64b3488-5ea4-4509-9799-73e09fff4fad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:10.122461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f64b3488-5ea4-4509-9799-73e09fff4fad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:10.122461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f64b3488-5ea4-4509-9799-73e09fff4fad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:10.132508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f64b3488-5ea4-4509-9799-73e09fff4fad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:10.133061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f64b3488-5ea4-4509-9799-73e09fff4fad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:10.724911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:11.432670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f64b3488-5ea4-4509-9799-73e09fff4fad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:11.448389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f64b3488-5ea4-4509-9799-73e09fff4fad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:11.458535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f64b3488-5ea4-4509-9799-73e09fff4fad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:11.460098 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f64b3488-5ea4-4509-9799-73e09fff4fad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1593 microversion: 2.42 time: 1.374166 Aug 02 07:02:11.463091 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1717/3318] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:10 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1593 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:02:11.473590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-70d72215-b946-48e5-8ce2-8a1b6c9dfbe5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:11.477137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-70d72215-b946-48e5-8ce2-8a1b6c9dfbe5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:11.493770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70d72215-b946-48e5-8ce2-8a1b6c9dfbe5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:11.494398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70d72215-b946-48e5-8ce2-8a1b6c9dfbe5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:11.499093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70d72215-b946-48e5-8ce2-8a1b6c9dfbe5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:11.499622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70d72215-b946-48e5-8ce2-8a1b6c9dfbe5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:11.973870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9c6bfc13-ef0c-43d2-8eeb-63d695cf1aeb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:11.984233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9c6bfc13-ef0c-43d2-8eeb-63d695cf1aeb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:11.985790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9c6bfc13-ef0c-43d2-8eeb-63d695cf1aeb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:11.987249 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9c6bfc13-ef0c-43d2-8eeb-63d695cf1aeb tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 2386 microversion: 2.32 time: 2.924660 Aug 02 07:02:12.010341 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1602/3319] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:09 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 2386 bytes in 2948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:12.426668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:12.486222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3fb1f56b-f431-4edf-ba61-f0c0a629d5a3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:12.487240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3fb1f56b-f431-4edf-ba61-f0c0a629d5a3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:12.503860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fb1f56b-f431-4edf-ba61-f0c0a629d5a3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:12.504580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fb1f56b-f431-4edf-ba61-f0c0a629d5a3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:12.509626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fb1f56b-f431-4edf-ba61-f0c0a629d5a3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:12.511282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fb1f56b-f431-4edf-ba61-f0c0a629d5a3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:12.753863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3fb1f56b-f431-4edf-ba61-f0c0a629d5a3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:12.768514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3fb1f56b-f431-4edf-ba61-f0c0a629d5a3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:12.770109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3fb1f56b-f431-4edf-ba61-f0c0a629d5a3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:12.779593 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3fb1f56b-f431-4edf-ba61-f0c0a629d5a3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1593 microversion: 2.42 time: 0.298610 Aug 02 07:02:12.794175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-70d72215-b946-48e5-8ce2-8a1b6c9dfbe5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:12.794462 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1603/3320] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:12 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1593 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:02:12.801725 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-70d72215-b946-48e5-8ce2-8a1b6c9dfbe5 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1502 microversion: 2.1 time: 1.336699 Aug 02 07:02:12.803016 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1718/3321] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:11 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1502 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:12.830970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f00903d1-e5eb-4ca1-a597-e9948fea3f69 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e564c52c-b85b-4495-8860-8baf5b88d0da"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:12.834179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f00903d1-e5eb-4ca1-a597-e9948fea3f69 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:12.850097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f00903d1-e5eb-4ca1-a597-e9948fea3f69 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:12.856341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f00903d1-e5eb-4ca1-a597-e9948fea3f69 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:12.857912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f00903d1-e5eb-4ca1-a597-e9948fea3f69 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:12.858626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f00903d1-e5eb-4ca1-a597-e9948fea3f69 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:12.956649 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-f00903d1-e5eb-4ca1-a597-e9948fea3f69 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] HTTP exception thrown: Cannot 'attach_volume' instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 while it is in vm_state rescued Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f00903d1-e5eb-4ca1-a597-e9948fea3f69 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Request method failure captured: Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3/os-volume_attachments HTTP/1.1 Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 74 Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MuV9Q5BOG4bZSTn8mNA1jfjLBve4d8RpXHrEXh4dSRfQwoHnO2CX5TWJr_Ybphxlmnei--H-24HQZ2VBGVtXb7ed4xsT9rh6T-B0ctcoWXMM-9zRQgu-z2imnNm8CiRJJUKFATn8QRgKDRSh1174_Xj_fjEsdTPEI1eutLUtYEoOkA Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}] Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b9ad5424586247019d4374f52600ea51 Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: {"volumeAttachment": {"volumeId": "e564c52c-b85b-4495-8860-8baf5b88d0da"}} Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: exception: Cannot 'attach_volume' instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 while it is in vm_state rescued Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'server_id': 'b7e42843-450e-4aab-b2eb-8ec992bfaaf3', 'body': {'volumeAttachment': {'volumeId': 'e564c52c-b85b-4495-8860-8baf5b88d0da'}}} Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 02 07:02:12.964420 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 07:02:12.973779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 07:02:12.973779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 07:02:12.973779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 while it is in vm_state rescued Aug 02 07:02:12.973779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:12.973779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:12.973779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:12.973779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:12.973779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:12.973779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:12.973779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:02:12.973779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:02:12.973779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 while it is in vm_state rescued Aug 02 07:02:12.973779 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:12.973779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f00903d1-e5eb-4ca1-a597-e9948fea3f69 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Returning 409 to user: Cannot 'attach_volume' instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 while it is in vm_state rescued {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:02:12.986983 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f00903d1-e5eb-4ca1-a597-e9948fea3f69 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.156824 Aug 02 07:02:12.988124 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1604/3322] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:02:12 2022] POST /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3/os-volume_attachments => generated 152 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 02 07:02:13.063329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-38c3ad94-fe8b-4abf-8118-930ec71d58a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:13.067475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-38c3ad94-fe8b-4abf-8118-930ec71d58a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:13.099605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38c3ad94-fe8b-4abf-8118-930ec71d58a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:13.100682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38c3ad94-fe8b-4abf-8118-930ec71d58a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:13.102012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38c3ad94-fe8b-4abf-8118-930ec71d58a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:13.102158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7273ea91-372e-4608-95e2-0d31eeb64291 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:13.102764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38c3ad94-fe8b-4abf-8118-930ec71d58a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:13.103705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7273ea91-372e-4608-95e2-0d31eeb64291 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:13.133002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7273ea91-372e-4608-95e2-0d31eeb64291 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:13.140706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7273ea91-372e-4608-95e2-0d31eeb64291 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:13.143397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7273ea91-372e-4608-95e2-0d31eeb64291 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:13.148466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7273ea91-372e-4608-95e2-0d31eeb64291 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:13.310498 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-38c3ad94-fe8b-4abf-8118-930ec71d58a4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3/action" status: 202 len: 0 microversion: 2.1 time: 0.307984 Aug 02 07:02:13.327373 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1719/3323] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:02:12 2022] POST /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:02:13.341733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dde9bed2-075e-441a-9e34-eac159b6c22d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:13.356649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dde9bed2-075e-441a-9e34-eac159b6c22d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:13.377753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dde9bed2-075e-441a-9e34-eac159b6c22d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:13.378613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dde9bed2-075e-441a-9e34-eac159b6c22d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:13.379960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dde9bed2-075e-441a-9e34-eac159b6c22d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:13.381066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dde9bed2-075e-441a-9e34-eac159b6c22d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:13.924713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:14.110524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7273ea91-372e-4608-95e2-0d31eeb64291 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:14.145248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7273ea91-372e-4608-95e2-0d31eeb64291 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:14.155343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7273ea91-372e-4608-95e2-0d31eeb64291 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:14.163031 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7273ea91-372e-4608-95e2-0d31eeb64291 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 2339 microversion: 2.32 time: 1.101098 Aug 02 07:02:14.169318 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1605/3324] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:13 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 2339 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:14.192403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-942189265", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f6b00d5e-7f56-40a5-b0ce-21c89ecfebff"}], "block_device_mapping_v2": [{"uuid": "4f1fce79-3dac-4779-9b03-6467bd157ca4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:14.277404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dde9bed2-075e-441a-9e34-eac159b6c22d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:14.288640 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dde9bed2-075e-441a-9e34-eac159b6c22d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1510 microversion: 2.1 time: 0.954105 Aug 02 07:02:14.308423 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1720/3325] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:13 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1510 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:02:14.318700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-78abdcca-d4ea-4629-a769-03365fb2c9f1 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:14.322511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-78abdcca-d4ea-4629-a769-03365fb2c9f1 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:14.341392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78abdcca-d4ea-4629-a769-03365fb2c9f1 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:14.342357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78abdcca-d4ea-4629-a769-03365fb2c9f1 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:14.345203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78abdcca-d4ea-4629-a769-03365fb2c9f1 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:14.345661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78abdcca-d4ea-4629-a769-03365fb2c9f1 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:14.601672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] validate_networks() for [('f6b00d5e-7f56-40a5-b0ce-21c89ecfebff', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:02:14.947411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-78abdcca-d4ea-4629-a769-03365fb2c9f1 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:14.983096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-78abdcca-d4ea-4629-a769-03365fb2c9f1 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:14.989736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-78abdcca-d4ea-4629-a769-03365fb2c9f1 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:15.000157 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-78abdcca-d4ea-4629-a769-03365fb2c9f1 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1661 microversion: 2.42 time: 0.683336 Aug 02 07:02:15.002770 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1721/3326] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:14 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1661 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:15.194411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d403f216-7ebe-4b71-b891-48fcc6702390 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:15.195947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d403f216-7ebe-4b71-b891-48fcc6702390 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:15.221643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d403f216-7ebe-4b71-b891-48fcc6702390 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:15.222394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d403f216-7ebe-4b71-b891-48fcc6702390 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:15.225817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d403f216-7ebe-4b71-b891-48fcc6702390 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:15.227552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d403f216-7ebe-4b71-b891-48fcc6702390 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:15.465419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d403f216-7ebe-4b71-b891-48fcc6702390 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:15.486989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d403f216-7ebe-4b71-b891-48fcc6702390 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:15.490544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d403f216-7ebe-4b71-b891-48fcc6702390 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:15.496382 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d403f216-7ebe-4b71-b891-48fcc6702390 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 2339 microversion: 2.32 time: 0.307059 Aug 02 07:02:15.497155 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1722/3327] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:15 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 2339 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:02:15.508285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7435cd6b-034b-4fd2-b400-77cf14fc0f40 req-de3cd74a-6ff2-45ca-96a6-ee66a91a5411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-deleted", "tag": "25aa727a-724d-4084-bf7a-ee4c3a07cce3"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:15.532607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7435cd6b-034b-4fd2-b400-77cf14fc0f40 req-de3cd74a-6ff2-45ca-96a6-ee66a91a5411 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:15.532988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7435cd6b-034b-4fd2-b400-77cf14fc0f40 req-de3cd74a-6ff2-45ca-96a6-ee66a91a5411 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:15.563661 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7435cd6b-034b-4fd2-b400-77cf14fc0f40 req-de3cd74a-6ff2-45ca-96a6-ee66a91a5411 service nova] Creating event network-vif-deleted:25aa727a-724d-4084-bf7a-ee4c3a07cce3 for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 07:02:15.578053 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7435cd6b-034b-4fd2-b400-77cf14fc0f40 req-de3cd74a-6ff2-45ca-96a6-ee66a91a5411 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079425 Aug 02 07:02:15.581390 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1723/3328] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:15.605753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d1bce845-e1df-417f-b004-b731adb215f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:15.610978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d1bce845-e1df-417f-b004-b731adb215f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:15.638896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1bce845-e1df-417f-b004-b731adb215f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:15.639746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1bce845-e1df-417f-b004-b731adb215f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:15.643635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1bce845-e1df-417f-b004-b731adb215f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:15.649286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1bce845-e1df-417f-b004-b731adb215f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:16.795871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:02:16.796389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:02:16.796989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:02:16.797523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:02:16.798085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:02:16.817798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:16.818281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:16.819082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:16.819514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:16.842280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d1bce845-e1df-417f-b004-b731adb215f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:16.855907 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d1bce845-e1df-417f-b004-b731adb215f9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1510 microversion: 2.1 time: 1.272850 Aug 02 07:02:16.867907 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1724/3329] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:15 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1510 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:16.869800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Getting quotas for project 144a45ff8adc4fc08cdac4d62405c1af. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:02:16.890370 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8b3befd4-175d-4279-a7a7-25fe005f537a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:16.891661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Getting quotas for user 82cffd0e8f5e400996b832cf1368b5d1 and project 144a45ff8adc4fc08cdac4d62405c1af. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:02:16.892914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8b3befd4-175d-4279-a7a7-25fe005f537a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:16.907701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b3befd4-175d-4279-a7a7-25fe005f537a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:16.910508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b3befd4-175d-4279-a7a7-25fe005f537a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:16.911378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b3befd4-175d-4279-a7a7-25fe005f537a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:16.913678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b3befd4-175d-4279-a7a7-25fe005f537a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:16.924517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:17.141547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:02:17.143793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f1fce79-3dac-4779-9b03-6467bd157ca4',volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:02:17.429867 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ab80f638-6c1e-41b3-9c74-7cc08de17640 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.257171 Aug 02 07:02:17.438596 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1606/3330] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:02:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:02:17.448354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-27f0fa05-14af-4170-8ff8-f49329beb2b0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:17.449423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-27f0fa05-14af-4170-8ff8-f49329beb2b0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:17.457416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-27f0fa05-14af-4170-8ff8-f49329beb2b0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:17.458334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-27f0fa05-14af-4170-8ff8-f49329beb2b0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:17.459373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-27f0fa05-14af-4170-8ff8-f49329beb2b0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:17.460086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-27f0fa05-14af-4170-8ff8-f49329beb2b0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:18.221389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8b3befd4-175d-4279-a7a7-25fe005f537a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:18.248713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8b3befd4-175d-4279-a7a7-25fe005f537a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:18.257422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8b3befd4-175d-4279-a7a7-25fe005f537a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:18.264351 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8b3befd4-175d-4279-a7a7-25fe005f537a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1661 microversion: 2.42 time: 1.396960 Aug 02 07:02:18.265273 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1725/3331] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:16 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1661 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:18.275501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-32090ea0-d9a5-4e58-a2ed-96d2a392f554 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:18.277789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-32090ea0-d9a5-4e58-a2ed-96d2a392f554 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:18.282890 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:18.624017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-32090ea0-d9a5-4e58-a2ed-96d2a392f554 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:18.637996 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-32090ea0-d9a5-4e58-a2ed-96d2a392f554 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1052 microversion: 2.1 time: 0.370650 Aug 02 07:02:18.643088 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1726/3332] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:18 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1052 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:18.670212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-22832979-57d0-436f-9859-c949ec180587 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:18.673467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-22832979-57d0-436f-9859-c949ec180587 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:18.701409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22832979-57d0-436f-9859-c949ec180587 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:18.709404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22832979-57d0-436f-9859-c949ec180587 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:18.716850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22832979-57d0-436f-9859-c949ec180587 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:18.716850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22832979-57d0-436f-9859-c949ec180587 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:18.786666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-27f0fa05-14af-4170-8ff8-f49329beb2b0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:18.800535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-27f0fa05-14af-4170-8ff8-f49329beb2b0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:18.803650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-27f0fa05-14af-4170-8ff8-f49329beb2b0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:18.805834 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-27f0fa05-14af-4170-8ff8-f49329beb2b0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 2052 microversion: 2.32 time: 1.363377 Aug 02 07:02:18.808079 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1607/3333] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:17 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 2052 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:19.244250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-28fb97f8-10fd-4ec7-b764-0602f94f0369 req-c15a1003-0077-4f89-93f9-7219b63635e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd13126-c780-4101-911f-87f9d0d9c595", "name": "network-vif-deleted", "tag": "32cec3a6-9298-4f4e-927b-827dd64b2baf"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:19.271921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-28fb97f8-10fd-4ec7-b764-0602f94f0369 req-c15a1003-0077-4f89-93f9-7219b63635e4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:19.282708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-28fb97f8-10fd-4ec7-b764-0602f94f0369 req-c15a1003-0077-4f89-93f9-7219b63635e4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:19.335161 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-28fb97f8-10fd-4ec7-b764-0602f94f0369 req-c15a1003-0077-4f89-93f9-7219b63635e4 service nova] Creating event network-vif-deleted:32cec3a6-9298-4f4e-927b-827dd64b2baf for instance 0cd13126-c780-4101-911f-87f9d0d9c595 on n-h2-851337-3 Aug 02 07:02:19.362955 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-28fb97f8-10fd-4ec7-b764-0602f94f0369 req-c15a1003-0077-4f89-93f9-7219b63635e4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118824 Aug 02 07:02:19.370074 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1608/3334] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:02:19.386110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7d2caa6d-24a6-45f5-8ea3-c314b0af7b63 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:19.388576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7d2caa6d-24a6-45f5-8ea3-c314b0af7b63 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:19.418369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d2caa6d-24a6-45f5-8ea3-c314b0af7b63 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:19.427634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d2caa6d-24a6-45f5-8ea3-c314b0af7b63 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:19.427634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d2caa6d-24a6-45f5-8ea3-c314b0af7b63 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:19.428230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d2caa6d-24a6-45f5-8ea3-c314b0af7b63 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:19.650359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-22832979-57d0-436f-9859-c949ec180587 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:19.695548 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-22832979-57d0-436f-9859-c949ec180587 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1516 microversion: 2.1 time: 1.049442 Aug 02 07:02:19.709973 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1727/3335] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:18 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1516 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:19.709973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-71f4fe2f-08fb-4a0d-b8a3-d44399e7769b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:19.709973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-71f4fe2f-08fb-4a0d-b8a3-d44399e7769b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:19.719529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71f4fe2f-08fb-4a0d-b8a3-d44399e7769b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:19.719529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71f4fe2f-08fb-4a0d-b8a3-d44399e7769b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:19.719529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71f4fe2f-08fb-4a0d-b8a3-d44399e7769b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:19.719529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-71f4fe2f-08fb-4a0d-b8a3-d44399e7769b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:19.968414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-71f4fe2f-08fb-4a0d-b8a3-d44399e7769b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:19.997228 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-71f4fe2f-08fb-4a0d-b8a3-d44399e7769b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1158 microversion: 2.1 time: 0.295794 Aug 02 07:02:19.998830 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1728/3336] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:19 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1158 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:20.027594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4ac58a4d-827f-4503-8bde-6f564261383f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:20.028221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4ac58a4d-827f-4503-8bde-6f564261383f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:20.053465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ac58a4d-827f-4503-8bde-6f564261383f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:20.053956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ac58a4d-827f-4503-8bde-6f564261383f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:20.054827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ac58a4d-827f-4503-8bde-6f564261383f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:20.055268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ac58a4d-827f-4503-8bde-6f564261383f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:20.194819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7d2caa6d-24a6-45f5-8ea3-c314b0af7b63 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:20.212633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7d2caa6d-24a6-45f5-8ea3-c314b0af7b63 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:20.214300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7d2caa6d-24a6-45f5-8ea3-c314b0af7b63 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:20.215538 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7d2caa6d-24a6-45f5-8ea3-c314b0af7b63 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1708 microversion: 2.42 time: 0.844261 Aug 02 07:02:20.216122 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1609/3337] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:19 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1708 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:20.252700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4ac58a4d-827f-4503-8bde-6f564261383f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:20.286160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4ac58a4d-827f-4503-8bde-6f564261383f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:20.296841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4ac58a4d-827f-4503-8bde-6f564261383f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:20.299450 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4ac58a4d-827f-4503-8bde-6f564261383f tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.296667 Aug 02 07:02:20.306419 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1729/3338] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:20 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:21.021559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b0bb8e5b-e3bf-43ed-a098-299b61a7a966 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:21.022451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b0bb8e5b-e3bf-43ed-a098-299b61a7a966 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:21.035371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0bb8e5b-e3bf-43ed-a098-299b61a7a966 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:21.036065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0bb8e5b-e3bf-43ed-a098-299b61a7a966 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:21.038389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0bb8e5b-e3bf-43ed-a098-299b61a7a966 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:21.039082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0bb8e5b-e3bf-43ed-a098-299b61a7a966 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:21.154964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b0bb8e5b-e3bf-43ed-a098-299b61a7a966 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:21.163324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:21.171318 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b0bb8e5b-e3bf-43ed-a098-299b61a7a966 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1168 microversion: 2.1 time: 0.153800 Aug 02 07:02:21.172551 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1610/3339] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:21 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1168 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:21.254520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4d23311c-4d88-48af-9193-745e324887e0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:21.255559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4d23311c-4d88-48af-9193-745e324887e0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:21.277708 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d23311c-4d88-48af-9193-745e324887e0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:21.282296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d23311c-4d88-48af-9193-745e324887e0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:21.290916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d23311c-4d88-48af-9193-745e324887e0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:21.292132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d23311c-4d88-48af-9193-745e324887e0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:21.327916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d5248c5a-c7ff-423d-9b6d-1c6d4b236a44 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:21.328806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d5248c5a-c7ff-423d-9b6d-1c6d4b236a44 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:21.341329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5248c5a-c7ff-423d-9b6d-1c6d4b236a44 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:21.347965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5248c5a-c7ff-423d-9b6d-1c6d4b236a44 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:21.348980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5248c5a-c7ff-423d-9b6d-1c6d4b236a44 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:21.351492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5248c5a-c7ff-423d-9b6d-1c6d4b236a44 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:21.714790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d5248c5a-c7ff-423d-9b6d-1c6d4b236a44 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:21.724684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d5248c5a-c7ff-423d-9b6d-1c6d4b236a44 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:21.739331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d5248c5a-c7ff-423d-9b6d-1c6d4b236a44 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:21.741023 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d5248c5a-c7ff-423d-9b6d-1c6d4b236a44 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.417544 Aug 02 07:02:21.743072 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1611/3340] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:21 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:02:21.901302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4d23311c-4d88-48af-9193-745e324887e0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:21.914108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4d23311c-4d88-48af-9193-745e324887e0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:21.916193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4d23311c-4d88-48af-9193-745e324887e0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:21.919044 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4d23311c-4d88-48af-9193-745e324887e0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1755 microversion: 2.42 time: 0.671713 Aug 02 07:02:21.932258 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1730/3341] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:21 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1755 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:22.198883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-43fb9693-c492-4aa3-b286-74bf97c8d237 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:22.199602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-43fb9693-c492-4aa3-b286-74bf97c8d237 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:22.208965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43fb9693-c492-4aa3-b286-74bf97c8d237 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:22.213286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43fb9693-c492-4aa3-b286-74bf97c8d237 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:22.214433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43fb9693-c492-4aa3-b286-74bf97c8d237 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:22.218568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43fb9693-c492-4aa3-b286-74bf97c8d237 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:22.783423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1a489ed9-4625-41d3-a0fe-5e0048863ee2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:22.785402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1a489ed9-4625-41d3-a0fe-5e0048863ee2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:22.800963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a489ed9-4625-41d3-a0fe-5e0048863ee2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:22.803758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a489ed9-4625-41d3-a0fe-5e0048863ee2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:22.804973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a489ed9-4625-41d3-a0fe-5e0048863ee2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:22.808167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a489ed9-4625-41d3-a0fe-5e0048863ee2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:22.812009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-43fb9693-c492-4aa3-b286-74bf97c8d237 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:22.825341 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-43fb9693-c492-4aa3-b286-74bf97c8d237 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.630196 Aug 02 07:02:22.826333 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1612/3342] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:22 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:22.945319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-022fad82-a56b-4bd8-bc32-e9767bfb710c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:22.946263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-022fad82-a56b-4bd8-bc32-e9767bfb710c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:22.955083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-022fad82-a56b-4bd8-bc32-e9767bfb710c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:22.958444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-022fad82-a56b-4bd8-bc32-e9767bfb710c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:22.961369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-022fad82-a56b-4bd8-bc32-e9767bfb710c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:22.963181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-022fad82-a56b-4bd8-bc32-e9767bfb710c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:22.964923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1a489ed9-4625-41d3-a0fe-5e0048863ee2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:22.979493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1a489ed9-4625-41d3-a0fe-5e0048863ee2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:22.987330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1a489ed9-4625-41d3-a0fe-5e0048863ee2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:22.989067 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1a489ed9-4625-41d3-a0fe-5e0048863ee2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.210802 Aug 02 07:02:22.996859 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1731/3343] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:22 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:23.648545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-022fad82-a56b-4bd8-bc32-e9767bfb710c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:23.668258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-022fad82-a56b-4bd8-bc32-e9767bfb710c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:23.669909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-022fad82-a56b-4bd8-bc32-e9767bfb710c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:23.671132 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-022fad82-a56b-4bd8-bc32-e9767bfb710c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1802 microversion: 2.42 time: 0.729850 Aug 02 07:02:23.671708 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1613/3344] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:22 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1802 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:02:23.860775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83231d26-f5c7-4f59-a30c-18ea6ac34e76 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:23.861811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-83231d26-f5c7-4f59-a30c-18ea6ac34e76 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:23.875937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83231d26-f5c7-4f59-a30c-18ea6ac34e76 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:23.876476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83231d26-f5c7-4f59-a30c-18ea6ac34e76 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:23.877932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83231d26-f5c7-4f59-a30c-18ea6ac34e76 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:23.878588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83231d26-f5c7-4f59-a30c-18ea6ac34e76 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:24.032327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0893440d-2667-429a-8b01-2f5a2e19c1c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:24.036790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0893440d-2667-429a-8b01-2f5a2e19c1c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:24.056235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0893440d-2667-429a-8b01-2f5a2e19c1c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:24.058126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0893440d-2667-429a-8b01-2f5a2e19c1c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:24.061533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0893440d-2667-429a-8b01-2f5a2e19c1c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:24.063183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0893440d-2667-429a-8b01-2f5a2e19c1c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:24.369633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0893440d-2667-429a-8b01-2f5a2e19c1c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:24.382442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0893440d-2667-429a-8b01-2f5a2e19c1c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:24.391077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0893440d-2667-429a-8b01-2f5a2e19c1c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:24.395498 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0893440d-2667-429a-8b01-2f5a2e19c1c2 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.373657 Aug 02 07:02:24.401517 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1614/3345] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:24 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:24.407597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-83231d26-f5c7-4f59-a30c-18ea6ac34e76 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:24.424653 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-83231d26-f5c7-4f59-a30c-18ea6ac34e76 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.573395 Aug 02 07:02:24.425779 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1732/3346] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:23 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:24.697557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a5c62010-ac00-4e93-813f-ededc3610fbc tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:24.698559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a5c62010-ac00-4e93-813f-ededc3610fbc tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:24.718274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5c62010-ac00-4e93-813f-ededc3610fbc tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:24.718735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5c62010-ac00-4e93-813f-ededc3610fbc tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:24.719555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5c62010-ac00-4e93-813f-ededc3610fbc tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:24.719999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5c62010-ac00-4e93-813f-ededc3610fbc tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:24.989091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-0053598a-f398-4a55-9dd2-5a84b11c2135 req-b095ca16-1bd3-4cf0-a2b6-03a426d5eb7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13dab9a5-60b6-46c3-8f27-6b9ea00e10a4", "tag": "554c704f-d680-42da-86e3-dd789c192bd1"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:25.014277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0053598a-f398-4a55-9dd2-5a84b11c2135 req-b095ca16-1bd3-4cf0-a2b6-03a426d5eb7c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:25.014277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0053598a-f398-4a55-9dd2-5a84b11c2135 req-b095ca16-1bd3-4cf0-a2b6-03a426d5eb7c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:25.031988 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-0053598a-f398-4a55-9dd2-5a84b11c2135 req-b095ca16-1bd3-4cf0-a2b6-03a426d5eb7c service nova] Creating event network-changed:554c704f-d680-42da-86e3-dd789c192bd1 for instance 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 on n-h1-851337-3 Aug 02 07:02:25.037988 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-0053598a-f398-4a55-9dd2-5a84b11c2135 req-b095ca16-1bd3-4cf0-a2b6-03a426d5eb7c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053569 Aug 02 07:02:25.039436 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1733/3347] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:02:25.105040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a5c62010-ac00-4e93-813f-ededc3610fbc tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:25.132452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a5c62010-ac00-4e93-813f-ededc3610fbc tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:25.140648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a5c62010-ac00-4e93-813f-ededc3610fbc tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:25.144997 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a5c62010-ac00-4e93-813f-ededc3610fbc tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1802 microversion: 2.42 time: 0.451838 Aug 02 07:02:25.147859 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1615/3348] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:24 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1802 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:25.425837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-07dd7d69-bdc2-47a1-943a-80a451b52a73 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:25.427060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-07dd7d69-bdc2-47a1-943a-80a451b52a73 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:25.444244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07dd7d69-bdc2-47a1-943a-80a451b52a73 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:25.444708 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07dd7d69-bdc2-47a1-943a-80a451b52a73 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:25.445602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07dd7d69-bdc2-47a1-943a-80a451b52a73 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:25.446078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07dd7d69-bdc2-47a1-943a-80a451b52a73 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:25.452237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-07037dd7-2338-4d6d-ad6d-12985f27d582 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:25.455161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-07037dd7-2338-4d6d-ad6d-12985f27d582 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:25.504148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07037dd7-2338-4d6d-ad6d-12985f27d582 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:25.507811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07037dd7-2338-4d6d-ad6d-12985f27d582 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:25.511449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07037dd7-2338-4d6d-ad6d-12985f27d582 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:25.512080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07037dd7-2338-4d6d-ad6d-12985f27d582 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:25.799142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-07dd7d69-bdc2-47a1-943a-80a451b52a73 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:25.818245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-07dd7d69-bdc2-47a1-943a-80a451b52a73 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:25.822500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-07dd7d69-bdc2-47a1-943a-80a451b52a73 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:25.832690 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-07dd7d69-bdc2-47a1-943a-80a451b52a73 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.411211 Aug 02 07:02:25.833957 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1734/3349] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:25 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:26.085002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-07037dd7-2338-4d6d-ad6d-12985f27d582 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:26.104749 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-07037dd7-2338-4d6d-ad6d-12985f27d582 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.659613 Aug 02 07:02:26.106976 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1616/3350] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:25 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:26.172397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-61bf1d8e-6b3f-40ae-8772-92a4306b0993 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:26.174135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-61bf1d8e-6b3f-40ae-8772-92a4306b0993 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:26.203602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61bf1d8e-6b3f-40ae-8772-92a4306b0993 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:26.204752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61bf1d8e-6b3f-40ae-8772-92a4306b0993 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:26.206506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61bf1d8e-6b3f-40ae-8772-92a4306b0993 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:26.207668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61bf1d8e-6b3f-40ae-8772-92a4306b0993 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:26.549110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-61bf1d8e-6b3f-40ae-8772-92a4306b0993 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:26.559745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-61bf1d8e-6b3f-40ae-8772-92a4306b0993 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:26.561380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-61bf1d8e-6b3f-40ae-8772-92a4306b0993 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:26.562680 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-61bf1d8e-6b3f-40ae-8772-92a4306b0993 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1849 microversion: 2.42 time: 0.395058 Aug 02 07:02:26.563269 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1735/3351] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:26 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1849 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:26.749348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-558e05b4-e4ce-4787-a44e-b715e1c03033 req-4cda8064-2648-4645-a6ac-bddc46d5b1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "tag": "861a1e1b-6d90-469d-92c9-1b3e761b3246"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:26.767850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-558e05b4-e4ce-4787-a44e-b715e1c03033 req-4cda8064-2648-4645-a6ac-bddc46d5b1a6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:26.777366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-558e05b4-e4ce-4787-a44e-b715e1c03033 req-4cda8064-2648-4645-a6ac-bddc46d5b1a6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:26.813103 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-558e05b4-e4ce-4787-a44e-b715e1c03033 req-4cda8064-2648-4645-a6ac-bddc46d5b1a6 service nova] Creating event network-changed:861a1e1b-6d90-469d-92c9-1b3e761b3246 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:02:26.823528 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-558e05b4-e4ce-4787-a44e-b715e1c03033 req-4cda8064-2648-4645-a6ac-bddc46d5b1a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079245 Aug 02 07:02:26.824888 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1617/3352] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:02:26.858314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a2d4bdf-6213-410e-8637-906323f1f3a8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:26.858989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8a2d4bdf-6213-410e-8637-906323f1f3a8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:26.881335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a2d4bdf-6213-410e-8637-906323f1f3a8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:26.881796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a2d4bdf-6213-410e-8637-906323f1f3a8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:26.882741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a2d4bdf-6213-410e-8637-906323f1f3a8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:26.883182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a2d4bdf-6213-410e-8637-906323f1f3a8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:26.982053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:26.982970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:27.174343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-762020132", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "dabdb5fe-e0da-499d-835b-3d19c07e1fca"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:27.261968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] validate_networks() for [('dabdb5fe-e0da-499d-835b-3d19c07e1fca', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:02:27.559622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8a2d4bdf-6213-410e-8637-906323f1f3a8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:27.578793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8a2d4bdf-6213-410e-8637-906323f1f3a8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:27.581234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8a2d4bdf-6213-410e-8637-906323f1f3a8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:27.606722 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8a2d4bdf-6213-410e-8637-906323f1f3a8 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.752413 Aug 02 07:02:27.624450 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1736/3353] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:26 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:27.630307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aee62331-dfef-4f25-b968-015f4a86c8bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:27.631724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aee62331-dfef-4f25-b968-015f4a86c8bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:27.644242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aee62331-dfef-4f25-b968-015f4a86c8bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:27.645105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aee62331-dfef-4f25-b968-015f4a86c8bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:27.646367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aee62331-dfef-4f25-b968-015f4a86c8bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:27.647047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aee62331-dfef-4f25-b968-015f4a86c8bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:28.225769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-aee62331-dfef-4f25-b968-015f4a86c8bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:28.234492 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aee62331-dfef-4f25-b968-015f4a86c8bd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.608255 Aug 02 07:02:28.236315 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1737/3354] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:27 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:28.270366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ef5723b6-4049-430c-bc93-79fd31004443 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:28.272919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ef5723b6-4049-430c-bc93-79fd31004443 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:28.292624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef5723b6-4049-430c-bc93-79fd31004443 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:28.299390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef5723b6-4049-430c-bc93-79fd31004443 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:28.300590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef5723b6-4049-430c-bc93-79fd31004443 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:28.301256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef5723b6-4049-430c-bc93-79fd31004443 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:28.634494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:28.771754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:02:28.772456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:02:28.773231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:02:28.774591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:02:28.775959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:02:28.801003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:28.802244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:28.803413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:28.804464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:28.821155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ef5723b6-4049-430c-bc93-79fd31004443 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:28.843747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ef5723b6-4049-430c-bc93-79fd31004443 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:28.858521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ef5723b6-4049-430c-bc93-79fd31004443 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:28.867325 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ef5723b6-4049-430c-bc93-79fd31004443 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1849 microversion: 2.42 time: 0.625969 Aug 02 07:02:28.871145 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1738/3355] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:28 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1849 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:28.888235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8c80195d-6798-47f6-9da9-7c5479aab6e1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:28.889332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8c80195d-6798-47f6-9da9-7c5479aab6e1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:28.913443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Getting quotas for project 7e897c3108df4457ae001fa38a7362e3. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:02:28.921519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c80195d-6798-47f6-9da9-7c5479aab6e1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:28.921519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c80195d-6798-47f6-9da9-7c5479aab6e1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:28.922292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c80195d-6798-47f6-9da9-7c5479aab6e1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:28.922679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c80195d-6798-47f6-9da9-7c5479aab6e1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:28.925683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Getting quotas for user 2bb7f44ac4f34f588d38409ad71cadc4 and project 7e897c3108df4457ae001fa38a7362e3. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:02:28.953583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:02:28.958765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:02:29.066285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8c80195d-6798-47f6-9da9-7c5479aab6e1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:29.079912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8c80195d-6798-47f6-9da9-7c5479aab6e1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:29.083681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8c80195d-6798-47f6-9da9-7c5479aab6e1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:29.084965 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8c80195d-6798-47f6-9da9-7c5479aab6e1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.212485 Aug 02 07:02:29.097359 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1739/3356] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:28 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:29.141805 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c119200c-1d73-4f07-b20e-2d9abd1cf60a tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.166560 Aug 02 07:02:29.145652 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1618/3357] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 07:02:29.161097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-372fbc58-f94e-4275-9a58-2ed0935b695d req-d64e9561-3628-4bc6-92f7-1debf5ff3144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "tag": "2136bfef-3765-4057-a98e-e66dd94110e0"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:29.164140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3dbc2f6c-d928-4de2-a176-261857996377 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:29.164888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3dbc2f6c-d928-4de2-a176-261857996377 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:29.269040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-372fbc58-f94e-4275-9a58-2ed0935b695d req-d64e9561-3628-4bc6-92f7-1debf5ff3144 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:29.271788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-372fbc58-f94e-4275-9a58-2ed0935b695d req-d64e9561-3628-4bc6-92f7-1debf5ff3144 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:29.314742 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-372fbc58-f94e-4275-9a58-2ed0935b695d req-d64e9561-3628-4bc6-92f7-1debf5ff3144 service nova] Creating event network-changed:2136bfef-3765-4057-a98e-e66dd94110e0 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:02:29.326722 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-372fbc58-f94e-4275-9a58-2ed0935b695d req-d64e9561-3628-4bc6-92f7-1debf5ff3144 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207458 Aug 02 07:02:29.327432 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1740/3358] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:29.350703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e1ff2d9a-e109-41e3-bc27-e7fb634882e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:29.351496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e1ff2d9a-e109-41e3-bc27-e7fb634882e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:29.370814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1ff2d9a-e109-41e3-bc27-e7fb634882e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:29.371959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1ff2d9a-e109-41e3-bc27-e7fb634882e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:29.372974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1ff2d9a-e109-41e3-bc27-e7fb634882e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:29.373127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3dbc2f6c-d928-4de2-a176-261857996377 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb7f44ac4f34f588d38409ad71cadc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e897c3108df4457ae001fa38a7362e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:29.374435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1ff2d9a-e109-41e3-bc27-e7fb634882e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:29.381743 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3dbc2f6c-d928-4de2-a176-261857996377 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 200 len: 1224 microversion: 2.1 time: 0.223678 Aug 02 07:02:29.387157 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1619/3359] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:29 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 1224 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:29.405072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0eeb98c6-2e53-4526-8f39-abed8ede3663 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:29.406615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0eeb98c6-2e53-4526-8f39-abed8ede3663 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:29.425325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0eeb98c6-2e53-4526-8f39-abed8ede3663 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:29.425782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0eeb98c6-2e53-4526-8f39-abed8ede3663 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:29.426599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0eeb98c6-2e53-4526-8f39-abed8ede3663 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:29.434322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0eeb98c6-2e53-4526-8f39-abed8ede3663 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:29.469984 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-0eeb98c6-2e53-4526-8f39-abed8ede3663 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] HTTP exception thrown: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0eeb98c6-2e53-4526-8f39-abed8ede3663 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Request method failure captured: Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 HTTP/1.1 Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MnIh0r4AtohMIHRrEySUKFBwUksLvrYD5U5qa12hpVglZXMiGVekhsXvcLy3TbgN66cBUvaprJxUI2LBMOvV3zNfb_RsXkH6cv4hqhNkSOyLVSbFKWy9naxH2MklPvdSqUlgkNKDsb7t5lqcRw9Glt-81uCSsji2_6Z1Z_US2iUgdU Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: c21684e149204ae7afe06a3097411bd0 Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c21684e149204ae7afe06a3097411bd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c21684e149204ae7afe06a3097411bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c21684e149204ae7afe06a3097411bd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c21684e149204ae7afe06a3097411bd0"}]}] Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: c21684e149204ae7afe06a3097411bd0 Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachVolumeTestJSON-898397610-project Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 391135debbcb49de8b47dea807d9a4ea Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachVolumeTestJSON-898397610-project Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'a42f890a-37e8-42bd-a345-d4dddadd50a1'} Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:02:29.472099 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:02:29.477695 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:02:29.477695 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:29.477695 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:29.477695 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:29.477695 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:29.477695 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:29.477695 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:29.477695 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:02:29.477695 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:02:29.477695 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:02:29.477695 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:29.488005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0eeb98c6-2e53-4526-8f39-abed8ede3663 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Returning 404 to user: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:02:29.491267 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0eeb98c6-2e53-4526-8f39-abed8ede3663 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 404 len: 111 microversion: 2.1 time: 0.103026 Aug 02 07:02:29.494819 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1620/3360] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:02:29 2022] DELETE /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:02:29.516757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-10bf71ab-20cd-4501-9435-72882e426708 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:29.519214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-10bf71ab-20cd-4501-9435-72882e426708 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: a42f890a-37e8-42bd-a345-d4dddadd50a1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:29.537329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10bf71ab-20cd-4501-9435-72882e426708 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:29.538963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10bf71ab-20cd-4501-9435-72882e426708 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:29.540062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10bf71ab-20cd-4501-9435-72882e426708 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:29.548925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10bf71ab-20cd-4501-9435-72882e426708 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:29.587166 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-10bf71ab-20cd-4501-9435-72882e426708 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] HTTP exception thrown: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-10bf71ab-20cd-4501-9435-72882e426708 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Request method failure captured: Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 HTTP/1.1 Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MnIh0r4AtohMIHRrEySUKFBwUksLvrYD5U5qa12hpVglZXMiGVekhsXvcLy3TbgN66cBUvaprJxUI2LBMOvV3zNfb_RsXkH6cv4hqhNkSOyLVSbFKWy9naxH2MklPvdSqUlgkNKDsb7t5lqcRw9Glt-81uCSsji2_6Z1Z_US2iUgdU Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: c21684e149204ae7afe06a3097411bd0 Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c21684e149204ae7afe06a3097411bd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c21684e149204ae7afe06a3097411bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c21684e149204ae7afe06a3097411bd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c21684e149204ae7afe06a3097411bd0"}]}] Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: c21684e149204ae7afe06a3097411bd0 Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachVolumeTestJSON-898397610-project Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 391135debbcb49de8b47dea807d9a4ea Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachVolumeTestJSON-898397610-project Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'a42f890a-37e8-42bd-a345-d4dddadd50a1'} Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:29.591159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:29.606945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:29.606945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:29.606945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:29.606945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:02:29.606945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:02:29.606945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. Aug 02 07:02:29.606945 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:29.606945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-10bf71ab-20cd-4501-9435-72882e426708 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Returning 404 to user: Instance a42f890a-37e8-42bd-a345-d4dddadd50a1 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:02:29.606945 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-10bf71ab-20cd-4501-9435-72882e426708 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1" status: 404 len: 111 microversion: 2.1 time: 0.092633 Aug 02 07:02:29.606945 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1621/3361] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:29 2022] GET /compute/v2.1/servers/a42f890a-37e8-42bd-a345-d4dddadd50a1 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:02:29.899678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c90dafdf-e56a-4202-ac90-21ad1307f6f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:29.904332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c90dafdf-e56a-4202-ac90-21ad1307f6f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:29.913813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:29.948128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c90dafdf-e56a-4202-ac90-21ad1307f6f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:29.954033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c90dafdf-e56a-4202-ac90-21ad1307f6f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:29.955357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c90dafdf-e56a-4202-ac90-21ad1307f6f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:29.955993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c90dafdf-e56a-4202-ac90-21ad1307f6f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:30.130521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e1ff2d9a-e109-41e3-bc27-e7fb634882e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:30.141109 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e1ff2d9a-e109-41e3-bc27-e7fb634882e0 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.812431 Aug 02 07:02:30.142018 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1741/3362] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:29 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:30.147201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f6c183fd-f851-4dda-a884-0af4fd23ba84 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:30.148149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f6c183fd-f851-4dda-a884-0af4fd23ba84 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:30.154836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6c183fd-f851-4dda-a884-0af4fd23ba84 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:30.155566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6c183fd-f851-4dda-a884-0af4fd23ba84 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:30.156950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6c183fd-f851-4dda-a884-0af4fd23ba84 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:30.157563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6c183fd-f851-4dda-a884-0af4fd23ba84 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:30.316849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f6c183fd-f851-4dda-a884-0af4fd23ba84 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:30.337104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f6c183fd-f851-4dda-a884-0af4fd23ba84 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:30.354104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f6c183fd-f851-4dda-a884-0af4fd23ba84 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:30.370604 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f6c183fd-f851-4dda-a884-0af4fd23ba84 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.218316 Aug 02 07:02:30.372005 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1742/3363] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:30 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:30.412586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-28ac7ab5-63f4-41e0-9f4d-bc205f5d5814 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:30.414046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-28ac7ab5-63f4-41e0-9f4d-bc205f5d5814 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:30.440057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28ac7ab5-63f4-41e0-9f4d-bc205f5d5814 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:30.440531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28ac7ab5-63f4-41e0-9f4d-bc205f5d5814 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:30.445689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28ac7ab5-63f4-41e0-9f4d-bc205f5d5814 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:30.447454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28ac7ab5-63f4-41e0-9f4d-bc205f5d5814 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:30.803567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-28ac7ab5-63f4-41e0-9f4d-bc205f5d5814 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb7f44ac4f34f588d38409ad71cadc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e897c3108df4457ae001fa38a7362e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:30.812520 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-28ac7ab5-63f4-41e0-9f4d-bc205f5d5814 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 200 len: 1220 microversion: 2.1 time: 0.404290 Aug 02 07:02:30.817027 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1743/3364] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:30 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 1220 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:30.952220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c90dafdf-e56a-4202-ac90-21ad1307f6f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:30.966876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c90dafdf-e56a-4202-ac90-21ad1307f6f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:30.972958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c90dafdf-e56a-4202-ac90-21ad1307f6f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:30.975562 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c90dafdf-e56a-4202-ac90-21ad1307f6f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1870 microversion: 2.42 time: 1.084335 Aug 02 07:02:30.979439 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1622/3365] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:29 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1870 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:31.175841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9902fc12-0dbd-4c6d-9ffd-e5d244f49719 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:31.179424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9902fc12-0dbd-4c6d-9ffd-e5d244f49719 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:31.193704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9902fc12-0dbd-4c6d-9ffd-e5d244f49719 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:31.198712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9902fc12-0dbd-4c6d-9ffd-e5d244f49719 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:31.201654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9902fc12-0dbd-4c6d-9ffd-e5d244f49719 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:31.202618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9902fc12-0dbd-4c6d-9ffd-e5d244f49719 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:31.219627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:31.415158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-825c9956-e453-432a-ae40-330344484f78 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:31.415782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-825c9956-e453-432a-ae40-330344484f78 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:31.424083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-825c9956-e453-432a-ae40-330344484f78 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:31.424853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-825c9956-e453-432a-ae40-330344484f78 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:31.425880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-825c9956-e453-432a-ae40-330344484f78 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:31.426652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-825c9956-e453-432a-ae40-330344484f78 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:31.942724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-825c9956-e453-432a-ae40-330344484f78 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:31.957827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-825c9956-e453-432a-ae40-330344484f78 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:31.966856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-825c9956-e453-432a-ae40-330344484f78 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:31.972127 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-825c9956-e453-432a-ae40-330344484f78 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.559098 Aug 02 07:02:31.972969 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1623/3366] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:31 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:02:31.996328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8cce0d0b-9359-4f28-b0ed-7b22b46ce1e3 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:32.003296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8cce0d0b-9359-4f28-b0ed-7b22b46ce1e3 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:32.016632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9902fc12-0dbd-4c6d-9ffd-e5d244f49719 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:32.024729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8cce0d0b-9359-4f28-b0ed-7b22b46ce1e3 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:32.033647 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9902fc12-0dbd-4c6d-9ffd-e5d244f49719 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.862303 Aug 02 07:02:32.034574 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1744/3367] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:31 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:32.055232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8cce0d0b-9359-4f28-b0ed-7b22b46ce1e3 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:32.056085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8cce0d0b-9359-4f28-b0ed-7b22b46ce1e3 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:32.056523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8cce0d0b-9359-4f28-b0ed-7b22b46ce1e3 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:32.062933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-68e53a33-09ea-409b-8c35-e9b03ace2db2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:32.063379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-68e53a33-09ea-409b-8c35-e9b03ace2db2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:32.091206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68e53a33-09ea-409b-8c35-e9b03ace2db2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:32.091662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68e53a33-09ea-409b-8c35-e9b03ace2db2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:32.092417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68e53a33-09ea-409b-8c35-e9b03ace2db2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:32.093606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68e53a33-09ea-409b-8c35-e9b03ace2db2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:33.002882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8cce0d0b-9359-4f28-b0ed-7b22b46ce1e3 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb7f44ac4f34f588d38409ad71cadc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e897c3108df4457ae001fa38a7362e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:33.016337 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8cce0d0b-9359-4f28-b0ed-7b22b46ce1e3 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 200 len: 1324 microversion: 2.1 time: 1.026655 Aug 02 07:02:33.021926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-68e53a33-09ea-409b-8c35-e9b03ace2db2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:33.031575 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1624/3368] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:31 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 1324 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:33.034309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-68e53a33-09ea-409b-8c35-e9b03ace2db2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:33.036056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-68e53a33-09ea-409b-8c35-e9b03ace2db2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:33.037474 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-68e53a33-09ea-409b-8c35-e9b03ace2db2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.978813 Aug 02 07:02:33.038282 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1745/3369] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:32 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:33.043900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-18b71982-d6ac-4f18-afdc-dc0c07bb9d89 req-5b2eab49-6e6e-4247-b48a-b5c6e0651c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "tag": "c6a0f893-e351-45b7-8c0a-475bf3575808"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:33.044432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-96a60ed1-8aa9-42ac-b7a5-f87b0cd8152f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'create', calling method: .version_select at 0x7f927b84b790>, body: {"keypair": {"name": "tempest-keypair-1479792239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXuhFMW06giio1kCmWlnsqaF8mHxqo4Mc/MTCDZ6j4tC81pgrsB50LH8O11C2xezcsB+DZEf6ywHKgPKh0SSrFRGM9J0OANH3AiMAeY6PZpqNKz5XRMnPXchENfsTah8Q=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:33.065040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-96a60ed1-8aa9-42ac-b7a5-f87b0cd8152f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Getting quotas for project 7e4fc5f796624bbbb5fab2412ba6d092. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:02:33.071366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-96a60ed1-8aa9-42ac-b7a5-f87b0cd8152f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Getting quotas for user b9ad5424586247019d4374f52600ea51 and project 7e4fc5f796624bbbb5fab2412ba6d092. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:02:33.088078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-18b71982-d6ac-4f18-afdc-dc0c07bb9d89 req-5b2eab49-6e6e-4247-b48a-b5c6e0651c6a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:33.088522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-18b71982-d6ac-4f18-afdc-dc0c07bb9d89 req-5b2eab49-6e6e-4247-b48a-b5c6e0651c6a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:33.104717 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-96a60ed1-8aa9-42ac-b7a5-f87b0cd8152f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064885 Aug 02 07:02:33.105657 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1746/3370] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:02:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:33.113209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f9df120b-6401-466e-b1d5-791dc0b84fd0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:33.120227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f9df120b-6401-466e-b1d5-791dc0b84fd0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:33.126268 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-18b71982-d6ac-4f18-afdc-dc0c07bb9d89 req-5b2eab49-6e6e-4247-b48a-b5c6e0651c6a service nova] Creating event network-changed:c6a0f893-e351-45b7-8c0a-475bf3575808 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:02:33.143419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9df120b-6401-466e-b1d5-791dc0b84fd0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:33.146439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9df120b-6401-466e-b1d5-791dc0b84fd0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:33.150050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9df120b-6401-466e-b1d5-791dc0b84fd0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:33.151264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9df120b-6401-466e-b1d5-791dc0b84fd0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:33.156228 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-18b71982-d6ac-4f18-afdc-dc0c07bb9d89 req-5b2eab49-6e6e-4247-b48a-b5c6e0651c6a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123184 Aug 02 07:02:33.171900 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1625/3371] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:33.190440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2ee7ca16-f8d9-40f0-8748-96699ded20a1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:33.195611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2ee7ca16-f8d9-40f0-8748-96699ded20a1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:33.217221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ee7ca16-f8d9-40f0-8748-96699ded20a1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:33.234440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ee7ca16-f8d9-40f0-8748-96699ded20a1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:33.235483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ee7ca16-f8d9-40f0-8748-96699ded20a1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:33.236013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ee7ca16-f8d9-40f0-8748-96699ded20a1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:33.376625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f9df120b-6401-466e-b1d5-791dc0b84fd0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:33.397351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f9df120b-6401-466e-b1d5-791dc0b84fd0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:33.399312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f9df120b-6401-466e-b1d5-791dc0b84fd0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:33.400792 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f9df120b-6401-466e-b1d5-791dc0b84fd0 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.293547 Aug 02 07:02:33.401547 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1747/3372] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:33 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:33.811254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2ee7ca16-f8d9-40f0-8748-96699ded20a1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:33.822764 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2ee7ca16-f8d9-40f0-8748-96699ded20a1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.647007 Aug 02 07:02:33.823374 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1626/3373] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:33 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:34.051631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ec6d1d48-4f21-4894-99f0-fe71df72a513 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:34.052427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ec6d1d48-4f21-4894-99f0-fe71df72a513 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:34.067397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-955abfa6-ca1c-4050-89b9-589ce0360e75 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:34.068791 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-955abfa6-ca1c-4050-89b9-589ce0360e75 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:34.074349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec6d1d48-4f21-4894-99f0-fe71df72a513 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:34.077031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec6d1d48-4f21-4894-99f0-fe71df72a513 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:34.079185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec6d1d48-4f21-4894-99f0-fe71df72a513 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:34.079644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec6d1d48-4f21-4894-99f0-fe71df72a513 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:34.084784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-955abfa6-ca1c-4050-89b9-589ce0360e75 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:34.086172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-955abfa6-ca1c-4050-89b9-589ce0360e75 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:34.087244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-955abfa6-ca1c-4050-89b9-589ce0360e75 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:34.088399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-955abfa6-ca1c-4050-89b9-589ce0360e75 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:34.587098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ec6d1d48-4f21-4894-99f0-fe71df72a513 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb7f44ac4f34f588d38409ad71cadc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e897c3108df4457ae001fa38a7362e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:34.599763 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ec6d1d48-4f21-4894-99f0-fe71df72a513 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 200 len: 1324 microversion: 2.1 time: 0.551605 Aug 02 07:02:34.600788 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1748/3374] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:34 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 1324 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:34.627276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-955abfa6-ca1c-4050-89b9-589ce0360e75 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:34.627525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-974c4f19-28c1-4480-8cc1-d60c106edbd2 req-584fb2dd-c41d-422c-9f5e-ad6ccab3fe7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6ebdd15-0384-4e16-8d2f-03b10efcce17", "tag": "86cccabb-6d56-4f7e-ba90-5f5d3334bd34"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:34.644461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-955abfa6-ca1c-4050-89b9-589ce0360e75 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:34.649561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-955abfa6-ca1c-4050-89b9-589ce0360e75 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:34.655565 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-955abfa6-ca1c-4050-89b9-589ce0360e75 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.587447 Aug 02 07:02:34.656228 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1627/3375] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:34 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:34.658013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-974c4f19-28c1-4480-8cc1-d60c106edbd2 req-584fb2dd-c41d-422c-9f5e-ad6ccab3fe7e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:34.660138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-974c4f19-28c1-4480-8cc1-d60c106edbd2 req-584fb2dd-c41d-422c-9f5e-ad6ccab3fe7e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:34.661957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dd7e302d-98cc-4401-b235-5b794227caad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:34.666565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dd7e302d-98cc-4401-b235-5b794227caad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:34.678356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd7e302d-98cc-4401-b235-5b794227caad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:34.678813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd7e302d-98cc-4401-b235-5b794227caad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:34.684459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd7e302d-98cc-4401-b235-5b794227caad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:34.684921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd7e302d-98cc-4401-b235-5b794227caad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:34.694552 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-974c4f19-28c1-4480-8cc1-d60c106edbd2 req-584fb2dd-c41d-422c-9f5e-ad6ccab3fe7e service nova] Creating event network-changed:86cccabb-6d56-4f7e-ba90-5f5d3334bd34 for instance d6ebdd15-0384-4e16-8d2f-03b10efcce17 on n-h1-851337-3 Aug 02 07:02:34.708759 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-974c4f19-28c1-4480-8cc1-d60c106edbd2 req-584fb2dd-c41d-422c-9f5e-ad6ccab3fe7e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092491 Aug 02 07:02:34.711271 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1749/3376] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:34.867891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b3cbdbb5-49d3-4d0d-a782-fe3adf52b6de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:34.869097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b3cbdbb5-49d3-4d0d-a782-fe3adf52b6de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:34.890651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3cbdbb5-49d3-4d0d-a782-fe3adf52b6de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:34.891723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3cbdbb5-49d3-4d0d-a782-fe3adf52b6de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:34.892384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3cbdbb5-49d3-4d0d-a782-fe3adf52b6de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:34.892832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3cbdbb5-49d3-4d0d-a782-fe3adf52b6de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:34.929922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dd7e302d-98cc-4401-b235-5b794227caad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:34.960159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dd7e302d-98cc-4401-b235-5b794227caad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:34.961953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dd7e302d-98cc-4401-b235-5b794227caad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:34.963306 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dd7e302d-98cc-4401-b235-5b794227caad tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.306117 Aug 02 07:02:34.964719 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1628/3377] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:34 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:35.244430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b3cbdbb5-49d3-4d0d-a782-fe3adf52b6de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:35.257616 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b3cbdbb5-49d3-4d0d-a782-fe3adf52b6de tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.398576 Aug 02 07:02:35.258418 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1750/3378] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:34 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:35.349081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-58cb64c4-50f3-4fbe-a782-02e3e2e410a2 req-64cbe407-ec1a-4e18-9d38-94c931a2f536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "tag": "1523988e-eb3f-4088-a913-e069e59a9e1b"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:35.370882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-58cb64c4-50f3-4fbe-a782-02e3e2e410a2 req-64cbe407-ec1a-4e18-9d38-94c931a2f536 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:35.375229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-58cb64c4-50f3-4fbe-a782-02e3e2e410a2 req-64cbe407-ec1a-4e18-9d38-94c931a2f536 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:35.418512 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-58cb64c4-50f3-4fbe-a782-02e3e2e410a2 req-64cbe407-ec1a-4e18-9d38-94c931a2f536 service nova] Creating event network-changed:1523988e-eb3f-4088-a913-e069e59a9e1b for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:02:35.428958 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-58cb64c4-50f3-4fbe-a782-02e3e2e410a2 req-64cbe407-ec1a-4e18-9d38-94c931a2f536 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083955 Aug 02 07:02:35.445865 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1629/3379] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:35.629826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9889e349-d078-4ce8-8361-d89727a4796b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:35.631721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9889e349-d078-4ce8-8361-d89727a4796b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:35.645837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9889e349-d078-4ce8-8361-d89727a4796b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:35.646655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9889e349-d078-4ce8-8361-d89727a4796b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:35.647515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9889e349-d078-4ce8-8361-d89727a4796b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:35.648147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9889e349-d078-4ce8-8361-d89727a4796b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:35.704226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-20de8c3b-60b8-441d-a6b6-917ed792b306 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:35.704968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-20de8c3b-60b8-441d-a6b6-917ed792b306 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:35.716764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20de8c3b-60b8-441d-a6b6-917ed792b306 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:35.728538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20de8c3b-60b8-441d-a6b6-917ed792b306 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:35.729830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20de8c3b-60b8-441d-a6b6-917ed792b306 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:35.734431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20de8c3b-60b8-441d-a6b6-917ed792b306 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:36.372232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9889e349-d078-4ce8-8361-d89727a4796b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb7f44ac4f34f588d38409ad71cadc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e897c3108df4457ae001fa38a7362e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:36.386753 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9889e349-d078-4ce8-8361-d89727a4796b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 200 len: 1324 microversion: 2.1 time: 0.761557 Aug 02 07:02:36.387549 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1751/3380] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:35 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 1324 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:36.409924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8092577c-7fc8-43e0-9d46-130c7ff505cf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:36.410660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8092577c-7fc8-43e0-9d46-130c7ff505cf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:36.419496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-20de8c3b-60b8-441d-a6b6-917ed792b306 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:36.430510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8092577c-7fc8-43e0-9d46-130c7ff505cf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:36.430977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8092577c-7fc8-43e0-9d46-130c7ff505cf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:36.431806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8092577c-7fc8-43e0-9d46-130c7ff505cf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:36.432244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8092577c-7fc8-43e0-9d46-130c7ff505cf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:36.435511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-20de8c3b-60b8-441d-a6b6-917ed792b306 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:36.450037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-20de8c3b-60b8-441d-a6b6-917ed792b306 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:36.451747 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-20de8c3b-60b8-441d-a6b6-917ed792b306 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.752090 Aug 02 07:02:36.453136 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1630/3381] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:35 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:02:36.460781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-211936806", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f289e266-c4ba-4c55-aa32-11b46a69ff42"}], "security_groups": [{"name": "tempest-securitygroup--1029465361"}], "key_name": "tempest-keypair-1479792239", "user_data": "}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:36.585520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8092577c-7fc8-43e0-9d46-130c7ff505cf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:36.596900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8092577c-7fc8-43e0-9d46-130c7ff505cf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:36.600498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8092577c-7fc8-43e0-9d46-130c7ff505cf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:36.602259 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8092577c-7fc8-43e0-9d46-130c7ff505cf tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.200759 Aug 02 07:02:36.603047 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1752/3382] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:36 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:36.609772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d3169288-2fcf-4c16-bd7a-ba52022e5cc7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:36.610980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d3169288-2fcf-4c16-bd7a-ba52022e5cc7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:36.627928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3169288-2fcf-4c16-bd7a-ba52022e5cc7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:36.628727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3169288-2fcf-4c16-bd7a-ba52022e5cc7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:36.629703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3169288-2fcf-4c16-bd7a-ba52022e5cc7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:36.630329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3169288-2fcf-4c16-bd7a-ba52022e5cc7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:36.698625 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] validate_networks() for [('f289e266-c4ba-4c55-aa32-11b46a69ff42', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:02:37.027746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d3169288-2fcf-4c16-bd7a-ba52022e5cc7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:37.035577 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d3169288-2fcf-4c16-bd7a-ba52022e5cc7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.430237 Aug 02 07:02:37.036154 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1753/3383] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:36 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:37.419018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-88e8189b-ed3d-4bde-aa44-09b4e26273cf tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:37.420059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-88e8189b-ed3d-4bde-aa44-09b4e26273cf tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:37.427275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88e8189b-ed3d-4bde-aa44-09b4e26273cf tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:37.427774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88e8189b-ed3d-4bde-aa44-09b4e26273cf tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:37.428654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88e8189b-ed3d-4bde-aa44-09b4e26273cf tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:37.429254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88e8189b-ed3d-4bde-aa44-09b4e26273cf tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:37.657928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:02:37.659374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:02:37.660163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:02:37.660842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:02:37.661479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:02:37.675410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:37.676708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:37.677789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:37.678494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:37.706317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Getting quotas for project 7e4fc5f796624bbbb5fab2412ba6d092. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:02:37.714390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Getting quotas for user b9ad5424586247019d4374f52600ea51 and project 7e4fc5f796624bbbb5fab2412ba6d092. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:02:37.732988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:02:37.736987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:02:37.738016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-88e8189b-ed3d-4bde-aa44-09b4e26273cf tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb7f44ac4f34f588d38409ad71cadc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e897c3108df4457ae001fa38a7362e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:37.747265 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-88e8189b-ed3d-4bde-aa44-09b4e26273cf tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 200 len: 1324 microversion: 2.1 time: 0.332231 Aug 02 07:02:37.750177 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1754/3384] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:37 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:02:37.764767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c74193f8-3485-4de1-a245-c14cd1226a18 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:37.765534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c74193f8-3485-4de1-a245-c14cd1226a18 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:37.780822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c74193f8-3485-4de1-a245-c14cd1226a18 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:37.781281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c74193f8-3485-4de1-a245-c14cd1226a18 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:37.782111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c74193f8-3485-4de1-a245-c14cd1226a18 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:37.782543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c74193f8-3485-4de1-a245-c14cd1226a18 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:37.839577 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5de95ed6-81ae-47bd-bc24-fe4dd0b1b591 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.380193 Aug 02 07:02:37.842245 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1631/3385] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:02:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:02:37.860467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-06f8da01-cee0-4b0a-9c38-9b6af67c26ba req-732aa3c5-b60e-4fc0-9d15-122a94d2a67e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "tag": "d122ff1d-37ba-4ca8-88b0-aa8e965f6c3f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:37.899812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-06f8da01-cee0-4b0a-9c38-9b6af67c26ba req-732aa3c5-b60e-4fc0-9d15-122a94d2a67e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:37.901060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-06f8da01-cee0-4b0a-9c38-9b6af67c26ba req-732aa3c5-b60e-4fc0-9d15-122a94d2a67e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:37.928176 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-06f8da01-cee0-4b0a-9c38-9b6af67c26ba req-732aa3c5-b60e-4fc0-9d15-122a94d2a67e service nova] Creating event network-changed:d122ff1d-37ba-4ca8-88b0-aa8e965f6c3f for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:02:37.935668 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-06f8da01-cee0-4b0a-9c38-9b6af67c26ba req-732aa3c5-b60e-4fc0-9d15-122a94d2a67e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091439 Aug 02 07:02:37.936726 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1632/3386] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:37.955750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7752c01a-c875-4c7d-a0e9-eccfe91a9558 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:37.962019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7752c01a-c875-4c7d-a0e9-eccfe91a9558 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:37.975211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7752c01a-c875-4c7d-a0e9-eccfe91a9558 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:37.975659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7752c01a-c875-4c7d-a0e9-eccfe91a9558 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:37.976556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7752c01a-c875-4c7d-a0e9-eccfe91a9558 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:37.976989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7752c01a-c875-4c7d-a0e9-eccfe91a9558 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:38.166925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7752c01a-c875-4c7d-a0e9-eccfe91a9558 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:38.169518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:38.185042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7752c01a-c875-4c7d-a0e9-eccfe91a9558 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:38.190702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7752c01a-c875-4c7d-a0e9-eccfe91a9558 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:38.198019 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7752c01a-c875-4c7d-a0e9-eccfe91a9558 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.256239 Aug 02 07:02:38.200562 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1633/3387] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:37 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:38.214127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c4df393c-fc09-40b4-abd7-fbbd64fa1a48 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:38.215982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c4df393c-fc09-40b4-abd7-fbbd64fa1a48 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:38.369738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c4df393c-fc09-40b4-abd7-fbbd64fa1a48 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:38.379177 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c4df393c-fc09-40b4-abd7-fbbd64fa1a48 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1245 microversion: 2.1 time: 0.176072 Aug 02 07:02:38.379786 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1634/3388] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:38 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1245 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:38.386234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7f02c6d5-e697-47ac-93db-88da1ae90561 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:38.387703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7f02c6d5-e697-47ac-93db-88da1ae90561 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:38.395517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f02c6d5-e697-47ac-93db-88da1ae90561 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:38.396197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f02c6d5-e697-47ac-93db-88da1ae90561 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:38.397455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f02c6d5-e697-47ac-93db-88da1ae90561 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:38.398187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f02c6d5-e697-47ac-93db-88da1ae90561 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:38.905285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c74193f8-3485-4de1-a245-c14cd1226a18 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:38.915966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c74193f8-3485-4de1-a245-c14cd1226a18 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:38.917967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c74193f8-3485-4de1-a245-c14cd1226a18 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:38.919659 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c74193f8-3485-4de1-a245-c14cd1226a18 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 1.168152 Aug 02 07:02:38.920810 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1755/3389] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:37 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:38.937558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e5e88213-5144-427a-8f03-7fadb1229531 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:38.942637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e5e88213-5144-427a-8f03-7fadb1229531 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:38.953370 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5e88213-5144-427a-8f03-7fadb1229531 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:38.960623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5e88213-5144-427a-8f03-7fadb1229531 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:38.961834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5e88213-5144-427a-8f03-7fadb1229531 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:38.962471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5e88213-5144-427a-8f03-7fadb1229531 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:39.122466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7f02c6d5-e697-47ac-93db-88da1ae90561 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:39.140852 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7f02c6d5-e697-47ac-93db-88da1ae90561 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.758551 Aug 02 07:02:39.143146 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1635/3390] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:38 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:39.224025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f7fd9349-1813-4a22-a697-1f31b321c71a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:39.225463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f7fd9349-1813-4a22-a697-1f31b321c71a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:39.233516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7fd9349-1813-4a22-a697-1f31b321c71a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:39.234529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7fd9349-1813-4a22-a697-1f31b321c71a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:39.235824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7fd9349-1813-4a22-a697-1f31b321c71a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:39.235824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7fd9349-1813-4a22-a697-1f31b321c71a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:39.383652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e5e88213-5144-427a-8f03-7fadb1229531 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb7f44ac4f34f588d38409ad71cadc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e897c3108df4457ae001fa38a7362e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:39.388120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f7fd9349-1813-4a22-a697-1f31b321c71a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:39.392977 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e5e88213-5144-427a-8f03-7fadb1229531 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 200 len: 1324 microversion: 2.1 time: 0.470722 Aug 02 07:02:39.418328 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1756/3391] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:38 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 1324 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:39.419158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f7fd9349-1813-4a22-a697-1f31b321c71a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:39.424317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f7fd9349-1813-4a22-a697-1f31b321c71a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:39.425033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aab7261b-a4d3-45f8-a5bb-1ce0932722eb tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:39.425949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aab7261b-a4d3-45f8-a5bb-1ce0932722eb tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:39.427824 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f7fd9349-1813-4a22-a697-1f31b321c71a tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.208656 Aug 02 07:02:39.429669 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1636/3392] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:39 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:39.445975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aab7261b-a4d3-45f8-a5bb-1ce0932722eb tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:39.446751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aab7261b-a4d3-45f8-a5bb-1ce0932722eb tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:39.447755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aab7261b-a4d3-45f8-a5bb-1ce0932722eb tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:39.448366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aab7261b-a4d3-45f8-a5bb-1ce0932722eb tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:39.575599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-aab7261b-a4d3-45f8-a5bb-1ce0932722eb tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:39.587733 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aab7261b-a4d3-45f8-a5bb-1ce0932722eb tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1297 microversion: 2.1 time: 0.164716 Aug 02 07:02:39.588577 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1757/3393] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:39 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1297 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:39.957294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-32c20e89-e84d-4083-8df1-4abe850551c4 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:39.958260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-32c20e89-e84d-4083-8df1-4abe850551c4 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:39.966607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32c20e89-e84d-4083-8df1-4abe850551c4 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:39.967337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32c20e89-e84d-4083-8df1-4abe850551c4 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:39.968272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32c20e89-e84d-4083-8df1-4abe850551c4 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:39.968881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32c20e89-e84d-4083-8df1-4abe850551c4 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:40.125269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6467cbf4-a35f-41fc-9a9b-c0851b206b8b req-867c5a6c-0d81-4be0-8b49-4fc1c0eb281d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "tag": "5b383fff-f64d-4758-98fb-152834840541"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:40.142771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6467cbf4-a35f-41fc-9a9b-c0851b206b8b req-867c5a6c-0d81-4be0-8b49-4fc1c0eb281d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:40.152040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6467cbf4-a35f-41fc-9a9b-c0851b206b8b req-867c5a6c-0d81-4be0-8b49-4fc1c0eb281d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:40.171926 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-6467cbf4-a35f-41fc-9a9b-c0851b206b8b req-867c5a6c-0d81-4be0-8b49-4fc1c0eb281d service nova] Creating event network-changed:5b383fff-f64d-4758-98fb-152834840541 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:02:40.179896 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6467cbf4-a35f-41fc-9a9b-c0851b206b8b req-867c5a6c-0d81-4be0-8b49-4fc1c0eb281d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058597 Aug 02 07:02:40.182291 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1758/3394] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:02:40.188342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f90f095-c93a-40e1-bb23-49058b2d7877 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:40.197044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5f90f095-c93a-40e1-bb23-49058b2d7877 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:40.212430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f90f095-c93a-40e1-bb23-49058b2d7877 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:40.212609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f90f095-c93a-40e1-bb23-49058b2d7877 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:40.217505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f90f095-c93a-40e1-bb23-49058b2d7877 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:40.220281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f90f095-c93a-40e1-bb23-49058b2d7877 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:40.492491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-32c20e89-e84d-4083-8df1-4abe850551c4 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:40.546577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-32c20e89-e84d-4083-8df1-4abe850551c4 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:40.549263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-32c20e89-e84d-4083-8df1-4abe850551c4 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:40.550635 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-32c20e89-e84d-4083-8df1-4abe850551c4 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.603852 Aug 02 07:02:40.551223 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1637/3395] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:39 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:40.584763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ead51761-0fdc-4956-a7a3-6ac120d356f2 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:40.588048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ead51761-0fdc-4956-a7a3-6ac120d356f2 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:40.598379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ead51761-0fdc-4956-a7a3-6ac120d356f2 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:40.600144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ead51761-0fdc-4956-a7a3-6ac120d356f2 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:40.601294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ead51761-0fdc-4956-a7a3-6ac120d356f2 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:40.602948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ead51761-0fdc-4956-a7a3-6ac120d356f2 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:40.951575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5f90f095-c93a-40e1-bb23-49058b2d7877 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:40.961470 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5f90f095-c93a-40e1-bb23-49058b2d7877 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.777781 Aug 02 07:02:40.966959 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1759/3396] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:40 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:40.980113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d713fe3b-f498-48f5-89e6-f2d7b11da574 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:40.981162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d713fe3b-f498-48f5-89e6-f2d7b11da574 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:41.000613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d713fe3b-f498-48f5-89e6-f2d7b11da574 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:41.001828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d713fe3b-f498-48f5-89e6-f2d7b11da574 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:41.004803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d713fe3b-f498-48f5-89e6-f2d7b11da574 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:41.009630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d713fe3b-f498-48f5-89e6-f2d7b11da574 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:41.205251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d713fe3b-f498-48f5-89e6-f2d7b11da574 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:41.243527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ead51761-0fdc-4956-a7a3-6ac120d356f2 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb7f44ac4f34f588d38409ad71cadc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e897c3108df4457ae001fa38a7362e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:41.247910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d713fe3b-f498-48f5-89e6-f2d7b11da574 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:41.250517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d713fe3b-f498-48f5-89e6-f2d7b11da574 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:41.251809 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d713fe3b-f498-48f5-89e6-f2d7b11da574 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.283500 Aug 02 07:02:41.266190 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1760/3397] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:40 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:41.267092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d041d9e9-a471-4bb7-a495-9dda3480c08c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:41.267730 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ead51761-0fdc-4956-a7a3-6ac120d356f2 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 200 len: 1324 microversion: 2.1 time: 0.692112 Aug 02 07:02:41.268572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d041d9e9-a471-4bb7-a495-9dda3480c08c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:41.281294 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1638/3398] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:40 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 1324 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:41.290745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d041d9e9-a471-4bb7-a495-9dda3480c08c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:41.291500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d041d9e9-a471-4bb7-a495-9dda3480c08c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:41.292570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d041d9e9-a471-4bb7-a495-9dda3480c08c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:41.293178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d041d9e9-a471-4bb7-a495-9dda3480c08c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:41.374493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-51484e3f-aef1-4f70-b7f3-a6ae0920b78d req-b6359010-14a4-44f9-8231-2e7671b32236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ebdd15-0384-4e16-8d2f-03b10efcce17", "name": "network-vif-plugged", "status": "completed", "tag": "86cccabb-6d56-4f7e-ba90-5f5d3334bd34"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:41.416000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-51484e3f-aef1-4f70-b7f3-a6ae0920b78d req-b6359010-14a4-44f9-8231-2e7671b32236 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:41.416460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-51484e3f-aef1-4f70-b7f3-a6ae0920b78d req-b6359010-14a4-44f9-8231-2e7671b32236 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:41.471211 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-51484e3f-aef1-4f70-b7f3-a6ae0920b78d req-b6359010-14a4-44f9-8231-2e7671b32236 service nova] Creating event network-vif-plugged:86cccabb-6d56-4f7e-ba90-5f5d3334bd34 for instance d6ebdd15-0384-4e16-8d2f-03b10efcce17 on n-h1-851337-3 Aug 02 07:02:41.487565 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-51484e3f-aef1-4f70-b7f3-a6ae0920b78d req-b6359010-14a4-44f9-8231-2e7671b32236 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118435 Aug 02 07:02:41.494965 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1639/3399] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:41.578372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c09a4b72-5a96-4da8-abc5-0be4b4155f17 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:41.579240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c09a4b72-5a96-4da8-abc5-0be4b4155f17 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:41.592585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d041d9e9-a471-4bb7-a495-9dda3480c08c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:41.595232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c09a4b72-5a96-4da8-abc5-0be4b4155f17 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:41.595849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c09a4b72-5a96-4da8-abc5-0be4b4155f17 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:41.603398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c09a4b72-5a96-4da8-abc5-0be4b4155f17 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:41.604075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c09a4b72-5a96-4da8-abc5-0be4b4155f17 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:41.606559 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d041d9e9-a471-4bb7-a495-9dda3480c08c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1371 microversion: 2.1 time: 0.348733 Aug 02 07:02:41.608487 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1761/3400] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:41 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1371 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:41.992017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7a0db59-cc83-44af-80a3-71675f710deb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:41.992642 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e7a0db59-cc83-44af-80a3-71675f710deb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:42.001454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7a0db59-cc83-44af-80a3-71675f710deb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:42.004892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7a0db59-cc83-44af-80a3-71675f710deb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:42.007322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7a0db59-cc83-44af-80a3-71675f710deb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:42.007981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7a0db59-cc83-44af-80a3-71675f710deb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:42.051875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c09a4b72-5a96-4da8-abc5-0be4b4155f17 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:42.080791 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c09a4b72-5a96-4da8-abc5-0be4b4155f17 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:42.084786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c09a4b72-5a96-4da8-abc5-0be4b4155f17 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:42.089058 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c09a4b72-5a96-4da8-abc5-0be4b4155f17 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.512374 Aug 02 07:02:42.094020 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1640/3401] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:41 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:02:42.235161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ab535afd-c56f-4a21-ac85-6a1bf83b7154 req-77a149f4-8a0f-4fac-86f9-1a019f6e5634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "tag": "20905df0-f84b-4e3e-8164-bd1311888332"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:42.291877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ab535afd-c56f-4a21-ac85-6a1bf83b7154 req-77a149f4-8a0f-4fac-86f9-1a019f6e5634 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:42.292342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ab535afd-c56f-4a21-ac85-6a1bf83b7154 req-77a149f4-8a0f-4fac-86f9-1a019f6e5634 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:42.328723 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ab535afd-c56f-4a21-ac85-6a1bf83b7154 req-77a149f4-8a0f-4fac-86f9-1a019f6e5634 service nova] Creating event network-changed:20905df0-f84b-4e3e-8164-bd1311888332 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:02:42.344125 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ab535afd-c56f-4a21-ac85-6a1bf83b7154 req-77a149f4-8a0f-4fac-86f9-1a019f6e5634 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115636 Aug 02 07:02:42.347629 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1641/3402] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:42.365152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a7d25333-bf45-4963-a338-e63989b20834 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:42.369805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a7d25333-bf45-4963-a338-e63989b20834 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:42.373835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e7a0db59-cc83-44af-80a3-71675f710deb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:42.387244 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7a0db59-cc83-44af-80a3-71675f710deb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.395914 Aug 02 07:02:42.387929 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1762/3403] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:41 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:02:42.388080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7d25333-bf45-4963-a338-e63989b20834 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:42.393174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fafb30d2-c2d5-4b37-a568-5b6d13d6111b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:42.397002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fafb30d2-c2d5-4b37-a568-5b6d13d6111b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:42.404180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7d25333-bf45-4963-a338-e63989b20834 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:42.405511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7d25333-bf45-4963-a338-e63989b20834 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:42.407207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7d25333-bf45-4963-a338-e63989b20834 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:42.418721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fafb30d2-c2d5-4b37-a568-5b6d13d6111b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:42.419414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fafb30d2-c2d5-4b37-a568-5b6d13d6111b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:42.420539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fafb30d2-c2d5-4b37-a568-5b6d13d6111b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:42.420998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fafb30d2-c2d5-4b37-a568-5b6d13d6111b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:42.487432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:42.603321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fafb30d2-c2d5-4b37-a568-5b6d13d6111b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:42.623261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fafb30d2-c2d5-4b37-a568-5b6d13d6111b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:42.625389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fafb30d2-c2d5-4b37-a568-5b6d13d6111b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:42.627261 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fafb30d2-c2d5-4b37-a568-5b6d13d6111b tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.237914 Aug 02 07:02:42.631359 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1763/3404] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:42 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:42.646575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-531f6caa-b1fd-437d-a944-57dcb750de58 req-b2e6e075-70c6-44b7-9fc2-db33f7ce679e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf3144f-9803-4cba-9569-a5113e7e59d7", "tag": "a1b65bba-6618-46d5-aeef-29ac67630aff"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:42.675549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-531f6caa-b1fd-437d-a944-57dcb750de58 req-b2e6e075-70c6-44b7-9fc2-db33f7ce679e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:42.676421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-531f6caa-b1fd-437d-a944-57dcb750de58 req-b2e6e075-70c6-44b7-9fc2-db33f7ce679e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:42.706048 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-531f6caa-b1fd-437d-a944-57dcb750de58 req-b2e6e075-70c6-44b7-9fc2-db33f7ce679e service nova] Creating event network-changed:a1b65bba-6618-46d5-aeef-29ac67630aff for instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 on n-h1-851337-3 Aug 02 07:02:42.726170 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-531f6caa-b1fd-437d-a944-57dcb750de58 req-b2e6e075-70c6-44b7-9fc2-db33f7ce679e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091395 Aug 02 07:02:42.727602 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1764/3405] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:42.734403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a8089c76-4048-4668-9fc1-e50ef4ee8ecc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:42.735550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a8089c76-4048-4668-9fc1-e50ef4ee8ecc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:42.745679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8089c76-4048-4668-9fc1-e50ef4ee8ecc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:42.746484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8089c76-4048-4668-9fc1-e50ef4ee8ecc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:42.747491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8089c76-4048-4668-9fc1-e50ef4ee8ecc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:42.748102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8089c76-4048-4668-9fc1-e50ef4ee8ecc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:42.827865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a7d25333-bf45-4963-a338-e63989b20834 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb7f44ac4f34f588d38409ad71cadc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e897c3108df4457ae001fa38a7362e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:42.836801 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a7d25333-bf45-4963-a338-e63989b20834 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 200 len: 1324 microversion: 2.1 time: 0.484333 Aug 02 07:02:42.854693 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1642/3406] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:42 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 1324 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:43.027113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a8089c76-4048-4668-9fc1-e50ef4ee8ecc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:43.042817 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a8089c76-4048-4668-9fc1-e50ef4ee8ecc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1371 microversion: 2.1 time: 0.313563 Aug 02 07:02:43.044884 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1765/3407] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:42 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:43.131656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-877c2632-8f04-4768-848b-65a5bfefb2fe tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:43.134599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-877c2632-8f04-4768-848b-65a5bfefb2fe tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:43.146504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-877c2632-8f04-4768-848b-65a5bfefb2fe tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:43.147305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-877c2632-8f04-4768-848b-65a5bfefb2fe tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:43.148486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-877c2632-8f04-4768-848b-65a5bfefb2fe tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:43.149123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-877c2632-8f04-4768-848b-65a5bfefb2fe tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:43.415752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fab9cef6-2977-43fd-aa11-36858c3dbba1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:43.418103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fab9cef6-2977-43fd-aa11-36858c3dbba1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:43.428188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:43.432550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fab9cef6-2977-43fd-aa11-36858c3dbba1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:43.433625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fab9cef6-2977-43fd-aa11-36858c3dbba1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:43.435374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fab9cef6-2977-43fd-aa11-36858c3dbba1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:43.436265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fab9cef6-2977-43fd-aa11-36858c3dbba1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:43.534545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-877c2632-8f04-4768-848b-65a5bfefb2fe tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:43.548355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-877c2632-8f04-4768-848b-65a5bfefb2fe tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:43.551201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-877c2632-8f04-4768-848b-65a5bfefb2fe tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:43.552683 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-877c2632-8f04-4768-848b-65a5bfefb2fe tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.426078 Aug 02 07:02:43.567313 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1643/3408] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:43 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:43.658886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bfb5dfd7-d472-487b-9ad5-05dd629591ed tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:43.659819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bfb5dfd7-d472-487b-9ad5-05dd629591ed tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:43.677358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfb5dfd7-d472-487b-9ad5-05dd629591ed tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:43.678310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfb5dfd7-d472-487b-9ad5-05dd629591ed tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:43.679366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfb5dfd7-d472-487b-9ad5-05dd629591ed tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:43.680011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfb5dfd7-d472-487b-9ad5-05dd629591ed tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:43.907300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bfb5dfd7-d472-487b-9ad5-05dd629591ed tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:43.936205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bfb5dfd7-d472-487b-9ad5-05dd629591ed tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:43.939961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bfb5dfd7-d472-487b-9ad5-05dd629591ed tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:43.951744 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bfb5dfd7-d472-487b-9ad5-05dd629591ed tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.297065 Aug 02 07:02:43.961816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fab9cef6-2977-43fd-aa11-36858c3dbba1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:43.966427 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1644/3409] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:43 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:02:43.973464 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fab9cef6-2977-43fd-aa11-36858c3dbba1 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.564271 Aug 02 07:02:43.976715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-035a1b5f-3756-4721-980b-00a7d281992c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:43.977336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-035a1b5f-3756-4721-980b-00a7d281992c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:43.978099 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1766/3410] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:43 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:43.985849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-035a1b5f-3756-4721-980b-00a7d281992c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:43.986373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-035a1b5f-3756-4721-980b-00a7d281992c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:43.987370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-035a1b5f-3756-4721-980b-00a7d281992c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:43.988064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-035a1b5f-3756-4721-980b-00a7d281992c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:44.064947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4934fd86-1aab-4b68-83b9-524e3f54f525 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:44.065947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4934fd86-1aab-4b68-83b9-524e3f54f525 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:44.085179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4934fd86-1aab-4b68-83b9-524e3f54f525 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:44.085995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4934fd86-1aab-4b68-83b9-524e3f54f525 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:44.086991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4934fd86-1aab-4b68-83b9-524e3f54f525 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:44.087625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4934fd86-1aab-4b68-83b9-524e3f54f525 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:44.193241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-035a1b5f-3756-4721-980b-00a7d281992c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb7f44ac4f34f588d38409ad71cadc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e897c3108df4457ae001fa38a7362e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:44.202156 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-035a1b5f-3756-4721-980b-00a7d281992c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 200 len: 1520 microversion: 2.1 time: 0.234320 Aug 02 07:02:44.205460 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1645/3411] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:43 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:44.232209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-10e09754-28a4-4efd-a29d-a05126bf9cb4 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:44.232755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-10e09754-28a4-4efd-a29d-a05126bf9cb4 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:44.251914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10e09754-28a4-4efd-a29d-a05126bf9cb4 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:44.252368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10e09754-28a4-4efd-a29d-a05126bf9cb4 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:44.253162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10e09754-28a4-4efd-a29d-a05126bf9cb4 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:44.253596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10e09754-28a4-4efd-a29d-a05126bf9cb4 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:44.348414 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-10e09754-28a4-4efd-a29d-a05126bf9cb4 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] HTTP exception thrown: Action 999 not found Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-10e09754-28a4-4efd-a29d-a05126bf9cb4 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Request method failure captured: Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17/os-instance-actions/999 HTTP/1.1 Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MwCtrqohhx6TkRa2vGNYQY_1ouaGarDZyOOEf1I-IWlnnDVYMExTddQoGi0-m43cyur5rXM2TEofAX2D22y0w_km-9D815lcWA8_GVP4eUl3IEBPSVDHflrcAPyaOgobFWwWyDlsob9B-v26ZF6VFVg6HcebA9TdQevcqBQOzb1Ut0 Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 7e897c3108df4457ae001fa38a7362e3 Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-189788959 Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7e897c3108df4457ae001fa38a7362e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e897c3108df4457ae001fa38a7362e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7e897c3108df4457ae001fa38a7362e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e897c3108df4457ae001fa38a7362e3"}]}] Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-189788959 Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 7e897c3108df4457ae001fa38a7362e3 Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-189788959 Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-InstanceActionsNegativeTestJSON-189788959-project Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 2bb7f44ac4f34f588d38409ad71cadc4 Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-189788959-project Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: exception: Action 999 not found Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'server_id': 'd6ebdd15-0384-4e16-8d2f-03b10efcce17', 'id': '999'} Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 02 07:02:44.362304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:44.370352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-10e09754-28a4-4efd-a29d-a05126bf9cb4 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Returning 404 to user: Action 999 not found {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:02:44.371451 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-10e09754-28a4-4efd-a29d-a05126bf9cb4 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.144443 Aug 02 07:02:44.372816 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1646/3412] 10.222.0.79 () {58 vars in 1308 bytes} [Tue Aug 2 07:02:44 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17/os-instance-actions/999 => generated 66 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:02:44.387906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e25ba137-746c-4512-916c-376943e8761c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '.version_select at 0x7f927b1b2430>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:44.388795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e25ba137-746c-4512-916c-376943e8761c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: 81d0e83c-7825-4d09-b249-a2d9d5b65a07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:44.400877 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-e25ba137-746c-4512-916c-376943e8761c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] HTTP exception thrown: Instance 81d0e83c-7825-4d09-b249-a2d9d5b65a07 could not be found. Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e25ba137-746c-4512-916c-376943e8761c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Request method failure captured: Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/81d0e83c-7825-4d09-b249-a2d9d5b65a07/os-instance-actions HTTP/1.1 Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MwCtrqohhx6TkRa2vGNYQY_1ouaGarDZyOOEf1I-IWlnnDVYMExTddQoGi0-m43cyur5rXM2TEofAX2D22y0w_km-9D815lcWA8_GVP4eUl3IEBPSVDHflrcAPyaOgobFWwWyDlsob9B-v26ZF6VFVg6HcebA9TdQevcqBQOzb1Ut0 Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 7e897c3108df4457ae001fa38a7362e3 Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-189788959 Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7e897c3108df4457ae001fa38a7362e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e897c3108df4457ae001fa38a7362e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7e897c3108df4457ae001fa38a7362e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e897c3108df4457ae001fa38a7362e3"}]}] Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-189788959 Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 7e897c3108df4457ae001fa38a7362e3 Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-189788959 Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-InstanceActionsNegativeTestJSON-189788959-project Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 2bb7f44ac4f34f588d38409ad71cadc4 Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-189788959-project Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 81d0e83c-7825-4d09-b249-a2d9d5b65a07 could not be found. Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'server_id': '81d0e83c-7825-4d09-b249-a2d9d5b65a07'} Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81d0e83c-7825-4d09-b249-a2d9d5b65a07 could not be found. Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:02:44.402726 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:02:44.410055 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81d0e83c-7825-4d09-b249-a2d9d5b65a07 could not be found. Aug 02 07:02:44.410055 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:44.410055 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:44.410055 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:44.410055 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:44.410055 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:44.410055 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:44.410055 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:02:44.410055 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:02:44.410055 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81d0e83c-7825-4d09-b249-a2d9d5b65a07 could not be found. Aug 02 07:02:44.410055 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:44.410055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e25ba137-746c-4512-916c-376943e8761c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Returning 404 to user: Instance 81d0e83c-7825-4d09-b249-a2d9d5b65a07 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:02:44.410055 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e25ba137-746c-4512-916c-376943e8761c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/81d0e83c-7825-4d09-b249-a2d9d5b65a07/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.025742 Aug 02 07:02:44.410055 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1647/3413] 10.222.0.79 () {58 vars in 1296 bytes} [Tue Aug 2 07:02:44 2022] GET /compute/v2.1/servers/81d0e83c-7825-4d09-b249-a2d9d5b65a07/os-instance-actions => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:02:44.417975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5a1b20ca-4934-4e20-8b8f-69e3e92c5116 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:44.418623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5a1b20ca-4934-4e20-8b8f-69e3e92c5116 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:44.426494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a1b20ca-4934-4e20-8b8f-69e3e92c5116 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:44.426940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a1b20ca-4934-4e20-8b8f-69e3e92c5116 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:44.427733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a1b20ca-4934-4e20-8b8f-69e3e92c5116 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:44.428368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a1b20ca-4934-4e20-8b8f-69e3e92c5116 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:44.464025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4934fd86-1aab-4b68-83b9-524e3f54f525 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:44.474114 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4934fd86-1aab-4b68-83b9-524e3f54f525 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1371 microversion: 2.1 time: 0.413074 Aug 02 07:02:44.474746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5a1b20ca-4934-4e20-8b8f-69e3e92c5116 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:02:44.490095 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1767/3414] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:44 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1371 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:02:44.579083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-472375f5-1315-424e-8472-973eb44a1985 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:44.580844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-472375f5-1315-424e-8472-973eb44a1985 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:44.591507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-472375f5-1315-424e-8472-973eb44a1985 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:44.592281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-472375f5-1315-424e-8472-973eb44a1985 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:44.593333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-472375f5-1315-424e-8472-973eb44a1985 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:44.594450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-472375f5-1315-424e-8472-973eb44a1985 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:44.830359 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5a1b20ca-4934-4e20-8b8f-69e3e92c5116 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 204 len: 0 microversion: 2.1 time: 0.223863 Aug 02 07:02:44.830359 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1648/3415] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:02:44 2022] DELETE /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 07:02:44.830359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ed608b35-1aa3-4e76-85df-8e822c343422 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:44.830359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ed608b35-1aa3-4e76-85df-8e822c343422 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:44.830359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed608b35-1aa3-4e76-85df-8e822c343422 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:44.830359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed608b35-1aa3-4e76-85df-8e822c343422 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:44.830359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed608b35-1aa3-4e76-85df-8e822c343422 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:44.830359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed608b35-1aa3-4e76-85df-8e822c343422 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:45.446607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ed608b35-1aa3-4e76-85df-8e822c343422 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb7f44ac4f34f588d38409ad71cadc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e897c3108df4457ae001fa38a7362e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:45.456125 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ed608b35-1aa3-4e76-85df-8e822c343422 tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 200 len: 1526 microversion: 2.1 time: 0.811455 Aug 02 07:02:45.467202 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1649/3416] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:44 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 1526 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:45.474592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7c511250-8aad-40c2-8036-ab4ac32f8cca tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:45.475228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7c511250-8aad-40c2-8036-ab4ac32f8cca tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:45.491510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c511250-8aad-40c2-8036-ab4ac32f8cca tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:45.491510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c511250-8aad-40c2-8036-ab4ac32f8cca tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:45.491510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c511250-8aad-40c2-8036-ab4ac32f8cca tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:45.491510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c511250-8aad-40c2-8036-ab4ac32f8cca tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:45.626325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7c511250-8aad-40c2-8036-ab4ac32f8cca tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:45.637145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-472375f5-1315-424e-8472-973eb44a1985 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:45.648695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-472375f5-1315-424e-8472-973eb44a1985 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:45.650109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7c511250-8aad-40c2-8036-ab4ac32f8cca tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:45.650338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-472375f5-1315-424e-8472-973eb44a1985 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:45.652351 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-472375f5-1315-424e-8472-973eb44a1985 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 1.077390 Aug 02 07:02:45.656491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7c511250-8aad-40c2-8036-ab4ac32f8cca tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:45.658250 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7c511250-8aad-40c2-8036-ab4ac32f8cca tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.189698 Aug 02 07:02:45.661560 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1650/3417] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:45 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:45.672966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e1715615-a5a5-4744-8783-e0a5c6335044 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:45.673765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e1715615-a5a5-4744-8783-e0a5c6335044 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:45.678223 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1768/3418] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:44 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:45.695343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1715615-a5a5-4744-8783-e0a5c6335044 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:45.697224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1715615-a5a5-4744-8783-e0a5c6335044 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:45.698399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1715615-a5a5-4744-8783-e0a5c6335044 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:45.699004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cdcc0f48-e10b-473d-b64b-c3dbf695697a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:45.699228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1715615-a5a5-4744-8783-e0a5c6335044 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:45.700979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cdcc0f48-e10b-473d-b64b-c3dbf695697a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:45.708580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdcc0f48-e10b-473d-b64b-c3dbf695697a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:45.709133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdcc0f48-e10b-473d-b64b-c3dbf695697a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:45.710096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdcc0f48-e10b-473d-b64b-c3dbf695697a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:45.710615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdcc0f48-e10b-473d-b64b-c3dbf695697a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:46.099278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e1715615-a5a5-4744-8783-e0a5c6335044 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:46.102037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cdcc0f48-e10b-473d-b64b-c3dbf695697a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:46.112910 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e1715615-a5a5-4744-8783-e0a5c6335044 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.449852 Aug 02 07:02:46.114414 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1651/3419] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:45 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:46.118336 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cdcc0f48-e10b-473d-b64b-c3dbf695697a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1371 microversion: 2.1 time: 0.423982 Aug 02 07:02:46.119713 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1769/3420] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:45 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1371 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:46.481369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-da3cebc3-1692-4d01-8b11-1e450873699c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:46.482928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-da3cebc3-1692-4d01-8b11-1e450873699c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:46.493252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da3cebc3-1692-4d01-8b11-1e450873699c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:46.494025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da3cebc3-1692-4d01-8b11-1e450873699c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:46.495112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da3cebc3-1692-4d01-8b11-1e450873699c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:46.495641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da3cebc3-1692-4d01-8b11-1e450873699c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:46.501020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:46.682023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7028048e-2c2a-4680-af6b-2441cb068c5f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:46.698414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7028048e-2c2a-4680-af6b-2441cb068c5f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:46.705375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:46.707672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7028048e-2c2a-4680-af6b-2441cb068c5f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:46.708195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7028048e-2c2a-4680-af6b-2441cb068c5f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:46.709175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7028048e-2c2a-4680-af6b-2441cb068c5f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:46.709750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7028048e-2c2a-4680-af6b-2441cb068c5f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:46.751369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-da3cebc3-1692-4d01-8b11-1e450873699c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb7f44ac4f34f588d38409ad71cadc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e897c3108df4457ae001fa38a7362e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:46.761622 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-da3cebc3-1692-4d01-8b11-1e450873699c tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 200 len: 1526 microversion: 2.1 time: 0.287327 Aug 02 07:02:46.762739 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1652/3421] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:46 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 1526 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:02:46.768422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6d9458af-af47-405d-a365-191a606d1e6c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:46.769312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6d9458af-af47-405d-a365-191a606d1e6c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:46.776328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d9458af-af47-405d-a365-191a606d1e6c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:46.777098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d9458af-af47-405d-a365-191a606d1e6c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:46.777910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d9458af-af47-405d-a365-191a606d1e6c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:46.778343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d9458af-af47-405d-a365-191a606d1e6c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:46.964868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6d9458af-af47-405d-a365-191a606d1e6c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:46.977765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6d9458af-af47-405d-a365-191a606d1e6c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:46.979428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6d9458af-af47-405d-a365-191a606d1e6c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:46.980936 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6d9458af-af47-405d-a365-191a606d1e6c tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.216325 Aug 02 07:02:46.996882 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1653/3422] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:46 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:47.084356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7028048e-2c2a-4680-af6b-2441cb068c5f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:47.096078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7028048e-2c2a-4680-af6b-2441cb068c5f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:47.098306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7028048e-2c2a-4680-af6b-2441cb068c5f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:47.100627 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7028048e-2c2a-4680-af6b-2441cb068c5f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.422656 Aug 02 07:02:47.101648 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1770/3423] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:46 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:02:47.135890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-51a5df78-e19d-4916-9d24-3690218b4273 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:47.137015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-51a5df78-e19d-4916-9d24-3690218b4273 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:47.150508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51a5df78-e19d-4916-9d24-3690218b4273 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:47.151294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51a5df78-e19d-4916-9d24-3690218b4273 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:47.152327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51a5df78-e19d-4916-9d24-3690218b4273 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:47.152951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51a5df78-e19d-4916-9d24-3690218b4273 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:47.170560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c846d85e-2ef2-49a5-b70a-fc4d244ff43a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:47.173679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c846d85e-2ef2-49a5-b70a-fc4d244ff43a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:47.199939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c846d85e-2ef2-49a5-b70a-fc4d244ff43a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:47.201025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c846d85e-2ef2-49a5-b70a-fc4d244ff43a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:47.209031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c846d85e-2ef2-49a5-b70a-fc4d244ff43a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:47.210143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c846d85e-2ef2-49a5-b70a-fc4d244ff43a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:47.540593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-51a5df78-e19d-4916-9d24-3690218b4273 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:47.552546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c846d85e-2ef2-49a5-b70a-fc4d244ff43a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:47.559767 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-51a5df78-e19d-4916-9d24-3690218b4273 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.428713 Aug 02 07:02:47.560292 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1654/3424] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:47 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:47.572305 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c846d85e-2ef2-49a5-b70a-fc4d244ff43a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1371 microversion: 2.1 time: 0.416463 Aug 02 07:02:47.574043 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1771/3425] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:47 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1371 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:47.787424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9102bc87-2b8a-42d9-a19e-0564828f062e tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:47.788316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9102bc87-2b8a-42d9-a19e-0564828f062e tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:47.814286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:47.818059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9102bc87-2b8a-42d9-a19e-0564828f062e tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:47.830556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9102bc87-2b8a-42d9-a19e-0564828f062e tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:47.832192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9102bc87-2b8a-42d9-a19e-0564828f062e tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:47.832969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9102bc87-2b8a-42d9-a19e-0564828f062e tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:48.006648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-62d0df09-f7cc-4dfe-ae58-6ba2f620d077 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:48.008729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-62d0df09-f7cc-4dfe-ae58-6ba2f620d077 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:48.032682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62d0df09-f7cc-4dfe-ae58-6ba2f620d077 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:48.033485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62d0df09-f7cc-4dfe-ae58-6ba2f620d077 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:48.034517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62d0df09-f7cc-4dfe-ae58-6ba2f620d077 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:48.035131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62d0df09-f7cc-4dfe-ae58-6ba2f620d077 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:48.168120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-62d0df09-f7cc-4dfe-ae58-6ba2f620d077 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:48.173327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9102bc87-2b8a-42d9-a19e-0564828f062e tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb7f44ac4f34f588d38409ad71cadc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e897c3108df4457ae001fa38a7362e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:48.184059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-62d0df09-f7cc-4dfe-ae58-6ba2f620d077 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:48.191697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-62d0df09-f7cc-4dfe-ae58-6ba2f620d077 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b650380405b4af8941a934eb447fc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abd7d52ec6341babfd4e8bbe151a0c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:48.192568 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-62d0df09-f7cc-4dfe-ae58-6ba2f620d077 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 200 len: 1601 microversion: 2.32 time: 0.191335 Aug 02 07:02:48.193168 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1772/3426] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:47 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 1601 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:48.210475 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9102bc87-2b8a-42d9-a19e-0564828f062e tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 200 len: 1526 microversion: 2.1 time: 0.429133 Aug 02 07:02:48.213853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e6e79aa5-fe0f-4c0f-92e4-1d5ef367dcfd tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:48.214901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e6e79aa5-fe0f-4c0f-92e4-1d5ef367dcfd tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:48.228849 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1655/3427] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:47 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 1526 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:48.240513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6e79aa5-fe0f-4c0f-92e4-1d5ef367dcfd tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:48.243218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6e79aa5-fe0f-4c0f-92e4-1d5ef367dcfd tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:48.244102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6e79aa5-fe0f-4c0f-92e4-1d5ef367dcfd tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:48.244548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6e79aa5-fe0f-4c0f-92e4-1d5ef367dcfd tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:48.521096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-81e3d090-a78f-4c8d-bc53-3d1655697276 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:48.521833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-81e3d090-a78f-4c8d-bc53-3d1655697276 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:48.541687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=16 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:48.544463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81e3d090-a78f-4c8d-bc53-3d1655697276 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:48.544823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81e3d090-a78f-4c8d-bc53-3d1655697276 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:48.545628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81e3d090-a78f-4c8d-bc53-3d1655697276 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:48.546261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81e3d090-a78f-4c8d-bc53-3d1655697276 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:48.610918 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-81e3d090-a78f-4c8d-bc53-3d1655697276 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] HTTP exception thrown: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-81e3d090-a78f-4c8d-bc53-3d1655697276 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Request method failure captured: Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 HTTP/1.1 Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MnIh0r4AtohMIHRrEySUKFBwUksLvrYD5U5qa12hpVglZXMiGVekhsXvcLy3TbgN66cBUvaprJxUI2LBMOvV3zNfb_RsXkH6cv4hqhNkSOyLVSbFKWy9naxH2MklPvdSqUlgkNKDsb7t5lqcRw9Glt-81uCSsji2_6Z1Z_US2iUgdU Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: c21684e149204ae7afe06a3097411bd0 Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c21684e149204ae7afe06a3097411bd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c21684e149204ae7afe06a3097411bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c21684e149204ae7afe06a3097411bd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c21684e149204ae7afe06a3097411bd0"}]}] Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: c21684e149204ae7afe06a3097411bd0 Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachVolumeTestJSON-898397610-project Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 391135debbcb49de8b47dea807d9a4ea Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachVolumeTestJSON-898397610-project Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'f8b07c5d-4324-4221-a77d-203f65ad3b04'} Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:02:48.617404 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:02:48.623005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 07:02:48.623005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:48.623005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:48.623005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:48.623005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:48.623005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:48.623005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:48.623005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:02:48.623005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:02:48.623005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 07:02:48.623005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:48.626394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-81e3d090-a78f-4c8d-bc53-3d1655697276 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Returning 404 to user: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:02:48.627386 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-81e3d090-a78f-4c8d-bc53-3d1655697276 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 404 len: 111 microversion: 2.1 time: 0.112416 Aug 02 07:02:48.631033 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1656/3428] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:02:48 2022] DELETE /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:02:48.645783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-21b8961f-8dc8-48df-8cdf-f63a067c0eb5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:48.647661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-21b8961f-8dc8-48df-8cdf-f63a067c0eb5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:48.683971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21b8961f-8dc8-48df-8cdf-f63a067c0eb5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:48.685082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21b8961f-8dc8-48df-8cdf-f63a067c0eb5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:48.688116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21b8961f-8dc8-48df-8cdf-f63a067c0eb5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:48.690350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21b8961f-8dc8-48df-8cdf-f63a067c0eb5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:48.960014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e6e79aa5-fe0f-4c0f-92e4-1d5ef367dcfd tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:48.980439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e6e79aa5-fe0f-4c0f-92e4-1d5ef367dcfd tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:48.983717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e6e79aa5-fe0f-4c0f-92e4-1d5ef367dcfd tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:48.989248 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e6e79aa5-fe0f-4c0f-92e4-1d5ef367dcfd tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.793953 Aug 02 07:02:48.992118 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1773/3429] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:48 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:49.001624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-be19d2f7-14b8-450a-9abf-29c8b4c9da8b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:49.010458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-be19d2f7-14b8-450a-9abf-29c8b4c9da8b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:49.041194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be19d2f7-14b8-450a-9abf-29c8b4c9da8b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:49.076989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be19d2f7-14b8-450a-9abf-29c8b4c9da8b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:49.082943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be19d2f7-14b8-450a-9abf-29c8b4c9da8b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:49.090431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be19d2f7-14b8-450a-9abf-29c8b4c9da8b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:49.157595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-21b8961f-8dc8-48df-8cdf-f63a067c0eb5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:49.196207 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-21b8961f-8dc8-48df-8cdf-f63a067c0eb5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.560056 Aug 02 07:02:49.200113 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1657/3430] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:48 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:49.235858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-92e3804e-62e4-4923-9006-ddef16301f42 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:49.241332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-92e3804e-62e4-4923-9006-ddef16301f42 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] [instance: f8b07c5d-4324-4221-a77d-203f65ad3b04] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:49.258862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92e3804e-62e4-4923-9006-ddef16301f42 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:49.259400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92e3804e-62e4-4923-9006-ddef16301f42 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:49.262912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92e3804e-62e4-4923-9006-ddef16301f42 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:49.263769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92e3804e-62e4-4923-9006-ddef16301f42 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:49.325870 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-92e3804e-62e4-4923-9006-ddef16301f42 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] HTTP exception thrown: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-92e3804e-62e4-4923-9006-ddef16301f42 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Request method failure captured: Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 HTTP/1.1 Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MnIh0r4AtohMIHRrEySUKFBwUksLvrYD5U5qa12hpVglZXMiGVekhsXvcLy3TbgN66cBUvaprJxUI2LBMOvV3zNfb_RsXkH6cv4hqhNkSOyLVSbFKWy9naxH2MklPvdSqUlgkNKDsb7t5lqcRw9Glt-81uCSsji2_6Z1Z_US2iUgdU Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: c21684e149204ae7afe06a3097411bd0 Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c21684e149204ae7afe06a3097411bd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c21684e149204ae7afe06a3097411bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c21684e149204ae7afe06a3097411bd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c21684e149204ae7afe06a3097411bd0"}]}] Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: c21684e149204ae7afe06a3097411bd0 Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachVolumeTestJSON-898397610 Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachVolumeTestJSON-898397610-project Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 391135debbcb49de8b47dea807d9a4ea Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachVolumeTestJSON-898397610-project Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'f8b07c5d-4324-4221-a77d-203f65ad3b04'} Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:49.339225 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:49.344255 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:49.344255 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:49.344255 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:49.344255 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:02:49.344255 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:02:49.344255 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. Aug 02 07:02:49.344255 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:49.344255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-92e3804e-62e4-4923-9006-ddef16301f42 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] Returning 404 to user: Instance f8b07c5d-4324-4221-a77d-203f65ad3b04 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:02:49.344255 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-92e3804e-62e4-4923-9006-ddef16301f42 tempest-AttachVolumeTestJSON-898397610 tempest-AttachVolumeTestJSON-898397610-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04" status: 404 len: 111 microversion: 2.1 time: 0.128583 Aug 02 07:02:49.362327 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1658/3431] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:49 2022] GET /compute/v2.1/servers/f8b07c5d-4324-4221-a77d-203f65ad3b04 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:02:49.385797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-101ee37e-5012-49dc-9664-b6b7ac80de58 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:49.414347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-101ee37e-5012-49dc-9664-b6b7ac80de58 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:49.470872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-101ee37e-5012-49dc-9664-b6b7ac80de58 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:49.475948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-101ee37e-5012-49dc-9664-b6b7ac80de58 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:49.479205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-101ee37e-5012-49dc-9664-b6b7ac80de58 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:49.480276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-101ee37e-5012-49dc-9664-b6b7ac80de58 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:49.556563 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-101ee37e-5012-49dc-9664-b6b7ac80de58 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] HTTP exception thrown: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-101ee37e-5012-49dc-9664-b6b7ac80de58 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Request method failure captured: Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 HTTP/1.1 Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mp-nrTgjHdMVQIQ6DGJIo2IWPyplDQMuZO0Bs2IPpND_zE3gAX14cCnhtqh7BvFQnEbPWMga9q1ZZsPsgAPkvewlt-HGGodJ-dBpx7sQ-QNC8rlOSIBXFxvtkQmM5vRJMPf_hRtD6FWFVH50AiRSOZG9D8lvvFF-Mcqsl7srxRrBko Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Openstack-Nova-Api-Version: 2.32 Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 7abd7d52ec6341babfd4e8bbe151a0c7 Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TaggedBootDevicesTest-659615472 Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7abd7d52ec6341babfd4e8bbe151a0c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7abd7d52ec6341babfd4e8bbe151a0c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7abd7d52ec6341babfd4e8bbe151a0c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7abd7d52ec6341babfd4e8bbe151a0c7"}]}] Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TaggedBootDevicesTest-659615472 Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 7abd7d52ec6341babfd4e8bbe151a0c7 Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TaggedBootDevicesTest-659615472 Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TaggedBootDevicesTest-659615472-project Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 5b650380405b4af8941a934eb447fc40 Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TaggedBootDevicesTest-659615472-project Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '0cd13126-c780-4101-911f-87f9d0d9c595'} Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:49.565284 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:49.572513 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:49.572513 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:49.572513 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:49.572513 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:02:49.572513 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:02:49.572513 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:49.572513 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:49.581416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-101ee37e-5012-49dc-9664-b6b7ac80de58 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Returning 404 to user: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:02:49.586667 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-101ee37e-5012-49dc-9664-b6b7ac80de58 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 404 len: 111 microversion: 2.32 time: 0.219412 Aug 02 07:02:49.587579 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1659/3432] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:49 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 111 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:02:49.617690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-983cd81d-0239-485f-8951-47c24a89c54f tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:49.618738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-983cd81d-0239-485f-8951-47c24a89c54f tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:49.628703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:49.675422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-983cd81d-0239-485f-8951-47c24a89c54f tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:49.678323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-983cd81d-0239-485f-8951-47c24a89c54f tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:49.681520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-983cd81d-0239-485f-8951-47c24a89c54f tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:49.682163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-983cd81d-0239-485f-8951-47c24a89c54f tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:49.729984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-983cd81d-0239-485f-8951-47c24a89c54f tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:49.731457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-983cd81d-0239-485f-8951-47c24a89c54f tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:49.731973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-983cd81d-0239-485f-8951-47c24a89c54f tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lazy-loading 'fault' on Instance uuid d6ebdd15-0384-4e16-8d2f-03b10efcce17 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:02:49.898802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-983cd81d-0239-485f-8951-47c24a89c54f tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb7f44ac4f34f588d38409ad71cadc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e897c3108df4457ae001fa38a7362e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:49.924137 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-983cd81d-0239-485f-8951-47c24a89c54f tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 200 len: 1314 microversion: 2.1 time: 0.333701 Aug 02 07:02:49.924734 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1660/3433] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:49 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:49.935686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-be19d2f7-14b8-450a-9abf-29c8b4c9da8b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:49.945470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-9b3aaf1d-7a95-4e51-8a60-eda3bd00196a req-fff6f91b-03ca-482e-a153-250bc05fb668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ebdd15-0384-4e16-8d2f-03b10efcce17", "name": "network-vif-deleted", "tag": "86cccabb-6d56-4f7e-ba90-5f5d3334bd34"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:49.968143 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-be19d2f7-14b8-450a-9abf-29c8b4c9da8b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1371 microversion: 2.1 time: 0.971935 Aug 02 07:02:49.980960 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1774/3434] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:48 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1371 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:49.984353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9b3aaf1d-7a95-4e51-8a60-eda3bd00196a req-fff6f91b-03ca-482e-a153-250bc05fb668 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:49.987648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9b3aaf1d-7a95-4e51-8a60-eda3bd00196a req-fff6f91b-03ca-482e-a153-250bc05fb668 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:49.992279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-38c2d779-607c-4236-aa6f-2d0a93a10dff tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '.version_select at 0x7f927a839b80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:50.024326 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-38c2d779-607c-4236-aa6f-2d0a93a10dff tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-3124824" status: 204 len: 0 microversion: 2.32 time: 0.041213 Aug 02 07:02:50.025358 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1775/3435] 10.222.0.79 () {60 vars in 1253 bytes} [Tue Aug 2 07:02:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-3124824 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:02:50.038748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-75c7caa7-e330-4d5d-a696-f57dd583c3c9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:50.039732 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-9b3aaf1d-7a95-4e51-8a60-eda3bd00196a req-fff6f91b-03ca-482e-a153-250bc05fb668 service nova] Creating event network-vif-deleted:86cccabb-6d56-4f7e-ba90-5f5d3334bd34 for instance d6ebdd15-0384-4e16-8d2f-03b10efcce17 on n-h1-851337-3 Aug 02 07:02:50.042330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-75c7caa7-e330-4d5d-a696-f57dd583c3c9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:50.051159 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-9b3aaf1d-7a95-4e51-8a60-eda3bd00196a req-fff6f91b-03ca-482e-a153-250bc05fb668 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118857 Aug 02 07:02:50.058374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75c7caa7-e330-4d5d-a696-f57dd583c3c9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:50.068557 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1661/3436] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:50.075787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75c7caa7-e330-4d5d-a696-f57dd583c3c9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:50.077361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75c7caa7-e330-4d5d-a696-f57dd583c3c9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:50.078099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75c7caa7-e330-4d5d-a696-f57dd583c3c9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:50.227911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5040a2eb-a537-478e-92c1-c4a09f30e9cd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:50.228759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5040a2eb-a537-478e-92c1-c4a09f30e9cd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:50.241296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5040a2eb-a537-478e-92c1-c4a09f30e9cd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:50.246881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5040a2eb-a537-478e-92c1-c4a09f30e9cd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:50.248105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5040a2eb-a537-478e-92c1-c4a09f30e9cd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:50.248505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5040a2eb-a537-478e-92c1-c4a09f30e9cd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:50.810974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-75c7caa7-e330-4d5d-a696-f57dd583c3c9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:50.827026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-75c7caa7-e330-4d5d-a696-f57dd583c3c9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:50.829060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-75c7caa7-e330-4d5d-a696-f57dd583c3c9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:50.830962 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-75c7caa7-e330-4d5d-a696-f57dd583c3c9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.801255 Aug 02 07:02:50.843995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5040a2eb-a537-478e-92c1-c4a09f30e9cd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:50.847952 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1776/3437] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:50 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:50.854560 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5040a2eb-a537-478e-92c1-c4a09f30e9cd tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.631451 Aug 02 07:02:50.856083 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1662/3438] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:50 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:02:50.957031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bd27b9f9-b87b-4a6b-8e07-40a83d1fbc0b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:50.957695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bd27b9f9-b87b-4a6b-8e07-40a83d1fbc0b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] [instance: d6ebdd15-0384-4e16-8d2f-03b10efcce17] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:50.968654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd27b9f9-b87b-4a6b-8e07-40a83d1fbc0b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:50.969110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd27b9f9-b87b-4a6b-8e07-40a83d1fbc0b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:50.969930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd27b9f9-b87b-4a6b-8e07-40a83d1fbc0b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:50.970380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd27b9f9-b87b-4a6b-8e07-40a83d1fbc0b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:51.017587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-41bbcead-70a5-4095-b26c-c0b7d11389cf tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:51.018716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-41bbcead-70a5-4095-b26c-c0b7d11389cf tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:51.024455 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-bd27b9f9-b87b-4a6b-8e07-40a83d1fbc0b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] HTTP exception thrown: Instance d6ebdd15-0384-4e16-8d2f-03b10efcce17 could not be found. Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bd27b9f9-b87b-4a6b-8e07-40a83d1fbc0b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Request method failure captured: Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 HTTP/1.1 Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MwCtrqohhx6TkRa2vGNYQY_1ouaGarDZyOOEf1I-IWlnnDVYMExTddQoGi0-m43cyur5rXM2TEofAX2D22y0w_km-9D815lcWA8_GVP4eUl3IEBPSVDHflrcAPyaOgobFWwWyDlsob9B-v26ZF6VFVg6HcebA9TdQevcqBQOzb1Ut0 Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 7e897c3108df4457ae001fa38a7362e3 Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-189788959 Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7e897c3108df4457ae001fa38a7362e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e897c3108df4457ae001fa38a7362e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7e897c3108df4457ae001fa38a7362e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e897c3108df4457ae001fa38a7362e3"}]}] Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-189788959 Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 7e897c3108df4457ae001fa38a7362e3 Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-189788959 Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-InstanceActionsNegativeTestJSON-189788959-project Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 2bb7f44ac4f34f588d38409ad71cadc4 Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-189788959-project Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance d6ebdd15-0384-4e16-8d2f-03b10efcce17 could not be found. Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'd6ebdd15-0384-4e16-8d2f-03b10efcce17'} Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6ebdd15-0384-4e16-8d2f-03b10efcce17 could not be found. Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6ebdd15-0384-4e16-8d2f-03b10efcce17 could not be found. Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:02:51.030172 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:51.034962 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:02:51.034962 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:51.034962 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:51.034962 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:51.034962 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:02:51.034962 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:02:51.034962 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6ebdd15-0384-4e16-8d2f-03b10efcce17 could not be found. Aug 02 07:02:51.034962 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:02:51.036035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41bbcead-70a5-4095-b26c-c0b7d11389cf tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:51.036035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41bbcead-70a5-4095-b26c-c0b7d11389cf tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:51.036035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41bbcead-70a5-4095-b26c-c0b7d11389cf tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:51.036035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41bbcead-70a5-4095-b26c-c0b7d11389cf tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:51.039136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bd27b9f9-b87b-4a6b-8e07-40a83d1fbc0b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] Returning 404 to user: Instance d6ebdd15-0384-4e16-8d2f-03b10efcce17 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:02:51.042088 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bd27b9f9-b87b-4a6b-8e07-40a83d1fbc0b tempest-InstanceActionsNegativeTestJSON-189788959 tempest-InstanceActionsNegativeTestJSON-189788959-project] 10.222.0.79 "GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17" status: 404 len: 111 microversion: 2.1 time: 0.089020 Aug 02 07:02:51.042958 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1777/3439] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:50 2022] GET /compute/v2.1/servers/d6ebdd15-0384-4e16-8d2f-03b10efcce17 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:02:51.594124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-41bbcead-70a5-4095-b26c-c0b7d11389cf tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:51.609508 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-41bbcead-70a5-4095-b26c-c0b7d11389cf tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1371 microversion: 2.1 time: 0.616198 Aug 02 07:02:51.612128 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1663/3440] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:50 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1371 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:51.855366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-89de3d3f-dc0e-47cc-896c-fe2363f5bfc2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:51.856183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-89de3d3f-dc0e-47cc-896c-fe2363f5bfc2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:51.873190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89de3d3f-dc0e-47cc-896c-fe2363f5bfc2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:51.874103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89de3d3f-dc0e-47cc-896c-fe2363f5bfc2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:51.874932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89de3d3f-dc0e-47cc-896c-fe2363f5bfc2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:51.875371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89de3d3f-dc0e-47cc-896c-fe2363f5bfc2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:51.886676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c62b200d-cb8c-4f03-8ddb-5677aabb26ed tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:51.889699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c62b200d-cb8c-4f03-8ddb-5677aabb26ed tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:51.908548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c62b200d-cb8c-4f03-8ddb-5677aabb26ed tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:51.909536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c62b200d-cb8c-4f03-8ddb-5677aabb26ed tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:51.913930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c62b200d-cb8c-4f03-8ddb-5677aabb26ed tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:51.914807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c62b200d-cb8c-4f03-8ddb-5677aabb26ed tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:52.893816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-89de3d3f-dc0e-47cc-896c-fe2363f5bfc2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:52.906352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-89de3d3f-dc0e-47cc-896c-fe2363f5bfc2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:52.908932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-89de3d3f-dc0e-47cc-896c-fe2363f5bfc2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:52.910619 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-89de3d3f-dc0e-47cc-896c-fe2363f5bfc2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 1.059850 Aug 02 07:02:52.912524 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1778/3441] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:51 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:52.923926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d8162c8c-5fd9-41ac-921c-cc01c66d0dc3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:52.926243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d8162c8c-5fd9-41ac-921c-cc01c66d0dc3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:52.935445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8162c8c-5fd9-41ac-921c-cc01c66d0dc3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:52.936321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8162c8c-5fd9-41ac-921c-cc01c66d0dc3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:52.937319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8162c8c-5fd9-41ac-921c-cc01c66d0dc3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:52.937954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8162c8c-5fd9-41ac-921c-cc01c66d0dc3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:53.205817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c62b200d-cb8c-4f03-8ddb-5677aabb26ed tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:53.215088 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c62b200d-cb8c-4f03-8ddb-5677aabb26ed tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 1.334113 Aug 02 07:02:53.215687 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1664/3442] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:51 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:53.297030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-72426325-f358-4d3c-b089-a38bdbb8546b req-c147f928-20c1-4733-baa4-8f448d325cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf3144f-9803-4cba-9569-a5113e7e59d7", "name": "network-vif-plugged", "status": "completed", "tag": "a1b65bba-6618-46d5-aeef-29ac67630aff"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:02:53.318456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-72426325-f358-4d3c-b089-a38bdbb8546b req-c147f928-20c1-4733-baa4-8f448d325cdd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:53.319276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-72426325-f358-4d3c-b089-a38bdbb8546b req-c147f928-20c1-4733-baa4-8f448d325cdd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:53.346521 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-72426325-f358-4d3c-b089-a38bdbb8546b req-c147f928-20c1-4733-baa4-8f448d325cdd service nova] Creating event network-vif-plugged:a1b65bba-6618-46d5-aeef-29ac67630aff for instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 on n-h1-851337-3 Aug 02 07:02:53.368302 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-72426325-f358-4d3c-b089-a38bdbb8546b req-c147f928-20c1-4733-baa4-8f448d325cdd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075425 Aug 02 07:02:53.369376 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1665/3443] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:02:53.580643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d8162c8c-5fd9-41ac-921c-cc01c66d0dc3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:53.600723 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d8162c8c-5fd9-41ac-921c-cc01c66d0dc3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1371 microversion: 2.1 time: 0.685070 Aug 02 07:02:53.601651 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1779/3444] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:52 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1371 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:53.956456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cc58fdf3-d66f-44ad-97d1-7e1dfad330a7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:53.957462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cc58fdf3-d66f-44ad-97d1-7e1dfad330a7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:53.970083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc58fdf3-d66f-44ad-97d1-7e1dfad330a7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:53.974400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc58fdf3-d66f-44ad-97d1-7e1dfad330a7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:53.980187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc58fdf3-d66f-44ad-97d1-7e1dfad330a7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:53.981225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc58fdf3-d66f-44ad-97d1-7e1dfad330a7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:54.235682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9f752ac4-fdb3-4044-a432-385b7ce2ef9e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:54.236532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9f752ac4-fdb3-4044-a432-385b7ce2ef9e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:54.250210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f752ac4-fdb3-4044-a432-385b7ce2ef9e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:54.250659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f752ac4-fdb3-4044-a432-385b7ce2ef9e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:54.282439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f752ac4-fdb3-4044-a432-385b7ce2ef9e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:54.283424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f752ac4-fdb3-4044-a432-385b7ce2ef9e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:55.622560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cc58fdf3-d66f-44ad-97d1-7e1dfad330a7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:55.655156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9f752ac4-fdb3-4044-a432-385b7ce2ef9e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:55.668139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cc58fdf3-d66f-44ad-97d1-7e1dfad330a7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:55.680401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cc58fdf3-d66f-44ad-97d1-7e1dfad330a7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:55.692693 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cc58fdf3-d66f-44ad-97d1-7e1dfad330a7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 1.746927 Aug 02 07:02:55.699729 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9f752ac4-fdb3-4044-a432-385b7ce2ef9e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 1.467923 Aug 02 07:02:55.718647 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1666/3445] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:53 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:55.721573 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1780/3446] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:54 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:55.725997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6d939660-b1e5-4824-ada4-2a19cbfdb203 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:55.732077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6d939660-b1e5-4824-ada4-2a19cbfdb203 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:55.771166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d939660-b1e5-4824-ada4-2a19cbfdb203 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:55.774210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d939660-b1e5-4824-ada4-2a19cbfdb203 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:55.775342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d939660-b1e5-4824-ada4-2a19cbfdb203 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:55.777427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d939660-b1e5-4824-ada4-2a19cbfdb203 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:56.512347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6d939660-b1e5-4824-ada4-2a19cbfdb203 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:56.524448 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6d939660-b1e5-4824-ada4-2a19cbfdb203 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1566 microversion: 2.1 time: 0.808945 Aug 02 07:02:56.525196 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1667/3447] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:55 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1566 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:56.554347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f9436b66-c37c-4c55-9cb0-9dce8b6a605b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:56.554860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f9436b66-c37c-4c55-9cb0-9dce8b6a605b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:56.581659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9436b66-c37c-4c55-9cb0-9dce8b6a605b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:56.582518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9436b66-c37c-4c55-9cb0-9dce8b6a605b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:56.592715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9436b66-c37c-4c55-9cb0-9dce8b6a605b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:56.593218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9436b66-c37c-4c55-9cb0-9dce8b6a605b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:56.725195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2184b89c-162b-4d8a-be75-de63bca33e36 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:56.726498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2184b89c-162b-4d8a-be75-de63bca33e36 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:56.764928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2184b89c-162b-4d8a-be75-de63bca33e36 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:56.765524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2184b89c-162b-4d8a-be75-de63bca33e36 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:56.779893 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2184b89c-162b-4d8a-be75-de63bca33e36 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:56.783962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2184b89c-162b-4d8a-be75-de63bca33e36 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:57.059944 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f9436b66-c37c-4c55-9cb0-9dce8b6a605b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.515647 Aug 02 07:02:57.061790 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1781/3448] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 07:02:56 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-interface => generated 285 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:02:57.067538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9036f11a-0572-43f3-942c-671bbdf9e14d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:57.068486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9036f11a-0572-43f3-942c-671bbdf9e14d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:57.086617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9036f11a-0572-43f3-942c-671bbdf9e14d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:57.091197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9036f11a-0572-43f3-942c-671bbdf9e14d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:57.092266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9036f11a-0572-43f3-942c-671bbdf9e14d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:57.092957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9036f11a-0572-43f3-942c-671bbdf9e14d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:57.150918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:02:58.737104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2184b89c-162b-4d8a-be75-de63bca33e36 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:58.765520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2184b89c-162b-4d8a-be75-de63bca33e36 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:58.769361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2184b89c-162b-4d8a-be75-de63bca33e36 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:58.771103 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2184b89c-162b-4d8a-be75-de63bca33e36 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 2.051659 Aug 02 07:02:58.772836 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1668/3449] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:56 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:02:58.777583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9036f11a-0572-43f3-942c-671bbdf9e14d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:02:58.798731 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9036f11a-0572-43f3-942c-671bbdf9e14d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 1.734682 Aug 02 07:02:58.799918 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1782/3450] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:57 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:02:59.687176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-60e3305e-32ef-4aab-87f3-abad4ff8eac1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:59.690013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-60e3305e-32ef-4aab-87f3-abad4ff8eac1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:59.709020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60e3305e-32ef-4aab-87f3-abad4ff8eac1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:59.711680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60e3305e-32ef-4aab-87f3-abad4ff8eac1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:59.712541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60e3305e-32ef-4aab-87f3-abad4ff8eac1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:59.712985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60e3305e-32ef-4aab-87f3-abad4ff8eac1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:59.745084 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-60e3305e-32ef-4aab-87f3-abad4ff8eac1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] HTTP exception thrown: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-60e3305e-32ef-4aab-87f3-abad4ff8eac1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Request method failure captured: Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 HTTP/1.1 Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mp-nrTgjHdMVQIQ6DGJIo2IWPyplDQMuZO0Bs2IPpND_zE3gAX14cCnhtqh7BvFQnEbPWMga9q1ZZsPsgAPkvewlt-HGGodJ-dBpx7sQ-QNC8rlOSIBXFxvtkQmM5vRJMPf_hRtD6FWFVH50AiRSOZG9D8lvvFF-Mcqsl7srxRrBko Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Openstack-Nova-Api-Version: 2.32 Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 7abd7d52ec6341babfd4e8bbe151a0c7 Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TaggedBootDevicesTest-659615472 Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7abd7d52ec6341babfd4e8bbe151a0c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7abd7d52ec6341babfd4e8bbe151a0c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7abd7d52ec6341babfd4e8bbe151a0c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7abd7d52ec6341babfd4e8bbe151a0c7"}]}] Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TaggedBootDevicesTest-659615472 Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 7abd7d52ec6341babfd4e8bbe151a0c7 Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TaggedBootDevicesTest-659615472 Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TaggedBootDevicesTest-659615472-project Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 5b650380405b4af8941a934eb447fc40 Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TaggedBootDevicesTest-659615472-project Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '0cd13126-c780-4101-911f-87f9d0d9c595'} Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:02:59.747588 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:02:59.753344 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:59.753344 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:59.753344 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:59.753344 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:59.753344 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:59.753344 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:59.753344 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:59.753344 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:02:59.753344 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:02:59.753344 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:59.753344 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:02:59.753344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-60e3305e-32ef-4aab-87f3-abad4ff8eac1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Returning 404 to user: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:02:59.767252 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-60e3305e-32ef-4aab-87f3-abad4ff8eac1 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 404 len: 111 microversion: 2.32 time: 0.086149 Aug 02 07:02:59.773066 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1669/3451] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 07:02:59 2022] DELETE /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:02:59.782925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f76712c-f273-435c-b95d-e96a501ab249 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:59.784259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4f76712c-f273-435c-b95d-e96a501ab249 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] [instance: 0cd13126-c780-4101-911f-87f9d0d9c595] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:59.797568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-433d7700-d06a-4499-8ab3-62c67cf15071 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:59.798878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-433d7700-d06a-4499-8ab3-62c67cf15071 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:59.803761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f76712c-f273-435c-b95d-e96a501ab249 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:59.806273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f76712c-f273-435c-b95d-e96a501ab249 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:59.810243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-433d7700-d06a-4499-8ab3-62c67cf15071 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:59.810703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-433d7700-d06a-4499-8ab3-62c67cf15071 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:59.811527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-433d7700-d06a-4499-8ab3-62c67cf15071 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:59.811964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-433d7700-d06a-4499-8ab3-62c67cf15071 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:59.819220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f76712c-f273-435c-b95d-e96a501ab249 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:59.820080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f76712c-f273-435c-b95d-e96a501ab249 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:59.880984 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-4f76712c-f273-435c-b95d-e96a501ab249 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] HTTP exception thrown: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f76712c-f273-435c-b95d-e96a501ab249 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Request method failure captured: Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 HTTP/1.1 Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mp-nrTgjHdMVQIQ6DGJIo2IWPyplDQMuZO0Bs2IPpND_zE3gAX14cCnhtqh7BvFQnEbPWMga9q1ZZsPsgAPkvewlt-HGGodJ-dBpx7sQ-QNC8rlOSIBXFxvtkQmM5vRJMPf_hRtD6FWFVH50AiRSOZG9D8lvvFF-Mcqsl7srxRrBko Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.32 Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 7abd7d52ec6341babfd4e8bbe151a0c7 Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TaggedBootDevicesTest-659615472 Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7abd7d52ec6341babfd4e8bbe151a0c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7abd7d52ec6341babfd4e8bbe151a0c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7abd7d52ec6341babfd4e8bbe151a0c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7abd7d52ec6341babfd4e8bbe151a0c7"}]}] Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TaggedBootDevicesTest-659615472 Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 7abd7d52ec6341babfd4e8bbe151a0c7 Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TaggedBootDevicesTest-659615472 Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TaggedBootDevicesTest-659615472-project Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5b650380405b4af8941a934eb447fc40 Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TaggedBootDevicesTest-659615472-project Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '0cd13126-c780-4101-911f-87f9d0d9c595'} Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:02:59.884199 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:02:59.889673 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:02:59.889673 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:02:59.889673 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:02:59.889673 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:02:59.889673 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:02:59.889673 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. Aug 02 07:02:59.889673 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:02:59.892596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f76712c-f273-435c-b95d-e96a501ab249 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] Returning 404 to user: Instance 0cd13126-c780-4101-911f-87f9d0d9c595 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:02:59.893845 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4f76712c-f273-435c-b95d-e96a501ab249 tempest-TaggedBootDevicesTest-659615472 tempest-TaggedBootDevicesTest-659615472-project] 10.222.0.79 "GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595" status: 404 len: 111 microversion: 2.32 time: 0.121546 Aug 02 07:02:59.895794 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1783/3452] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:59 2022] GET /compute/v2.1/servers/0cd13126-c780-4101-911f-87f9d0d9c595 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:02:59.903736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-578d1cc1-9f0d-4815-8379-de8d23055627 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:02:59.905507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-578d1cc1-9f0d-4815-8379-de8d23055627 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:02:59.914249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-578d1cc1-9f0d-4815-8379-de8d23055627 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:59.914983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-578d1cc1-9f0d-4815-8379-de8d23055627 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:02:59.916088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-578d1cc1-9f0d-4815-8379-de8d23055627 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:02:59.916699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-578d1cc1-9f0d-4815-8379-de8d23055627 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:00.866296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-578d1cc1-9f0d-4815-8379-de8d23055627 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:00.879631 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-578d1cc1-9f0d-4815-8379-de8d23055627 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.982355 Aug 02 07:03:00.894599 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1784/3453] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:02:59 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:00.927904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-433d7700-d06a-4499-8ab3-62c67cf15071 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:00.945414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-433d7700-d06a-4499-8ab3-62c67cf15071 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:00.947156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-433d7700-d06a-4499-8ab3-62c67cf15071 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:00.956631 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-433d7700-d06a-4499-8ab3-62c67cf15071 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 1.163459 Aug 02 07:03:00.957255 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1670/3454] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:02:59 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:03:01.748010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-2caf6ffb-834f-400c-98c8-e2afe53363fe req-e654abc0-497a-494b-9ff0-d465238dd91a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf3144f-9803-4cba-9569-a5113e7e59d7", "tag": "a1b65bba-6618-46d5-aeef-29ac67630aff"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:01.764978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2caf6ffb-834f-400c-98c8-e2afe53363fe req-e654abc0-497a-494b-9ff0-d465238dd91a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:01.767298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2caf6ffb-834f-400c-98c8-e2afe53363fe req-e654abc0-497a-494b-9ff0-d465238dd91a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:01.791327 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-2caf6ffb-834f-400c-98c8-e2afe53363fe req-e654abc0-497a-494b-9ff0-d465238dd91a service nova] Creating event network-changed:a1b65bba-6618-46d5-aeef-29ac67630aff for instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 on n-h1-851337-3 Aug 02 07:03:01.815939 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-2caf6ffb-834f-400c-98c8-e2afe53363fe req-e654abc0-497a-494b-9ff0-d465238dd91a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071611 Aug 02 07:03:01.817154 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1785/3455] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:03:01.901027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-26609f27-f402-4fdd-90b2-e82fc532d51d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:01.901747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-26609f27-f402-4fdd-90b2-e82fc532d51d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:01.921066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26609f27-f402-4fdd-90b2-e82fc532d51d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:01.926869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26609f27-f402-4fdd-90b2-e82fc532d51d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:01.934832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26609f27-f402-4fdd-90b2-e82fc532d51d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:01.936292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26609f27-f402-4fdd-90b2-e82fc532d51d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:01.983726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d75aefb5-2e63-424d-8db0-a0220657c3a6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:01.984482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d75aefb5-2e63-424d-8db0-a0220657c3a6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:01.992222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d75aefb5-2e63-424d-8db0-a0220657c3a6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:02.006979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d75aefb5-2e63-424d-8db0-a0220657c3a6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:02.008182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d75aefb5-2e63-424d-8db0-a0220657c3a6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:02.008847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d75aefb5-2e63-424d-8db0-a0220657c3a6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:02.713560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d75aefb5-2e63-424d-8db0-a0220657c3a6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:02.730800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d75aefb5-2e63-424d-8db0-a0220657c3a6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:02.736667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d75aefb5-2e63-424d-8db0-a0220657c3a6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:02.738108 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d75aefb5-2e63-424d-8db0-a0220657c3a6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.758809 Aug 02 07:03:02.741762 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1786/3456] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:01 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:02.800912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-26609f27-f402-4fdd-90b2-e82fc532d51d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:02.821010 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-26609f27-f402-4fdd-90b2-e82fc532d51d tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1210 microversion: 2.1 time: 0.923295 Aug 02 07:03:02.826595 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1671/3457] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:01 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1210 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:03.770216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-09e8c81b-262f-4e9a-9f0f-0e9bf8c74f32 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:03.771405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-09e8c81b-262f-4e9a-9f0f-0e9bf8c74f32 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:03.787542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09e8c81b-262f-4e9a-9f0f-0e9bf8c74f32 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:03.788379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09e8c81b-262f-4e9a-9f0f-0e9bf8c74f32 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:03.791450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09e8c81b-262f-4e9a-9f0f-0e9bf8c74f32 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:03.792445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09e8c81b-262f-4e9a-9f0f-0e9bf8c74f32 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:03.850463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f22e9023-fcbd-4eff-9d5c-b8f0a0d7a2bb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:03.851075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f22e9023-fcbd-4eff-9d5c-b8f0a0d7a2bb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:03.870900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f22e9023-fcbd-4eff-9d5c-b8f0a0d7a2bb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:03.871506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f22e9023-fcbd-4eff-9d5c-b8f0a0d7a2bb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:03.872577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f22e9023-fcbd-4eff-9d5c-b8f0a0d7a2bb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:03.873185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f22e9023-fcbd-4eff-9d5c-b8f0a0d7a2bb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:03.908946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:03:04.497161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-09e8c81b-262f-4e9a-9f0f-0e9bf8c74f32 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:04.510675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-09e8c81b-262f-4e9a-9f0f-0e9bf8c74f32 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:04.512575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-09e8c81b-262f-4e9a-9f0f-0e9bf8c74f32 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:04.516307 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-09e8c81b-262f-4e9a-9f0f-0e9bf8c74f32 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.750092 Aug 02 07:03:04.518133 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1787/3458] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:03 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:04.544260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f22e9023-fcbd-4eff-9d5c-b8f0a0d7a2bb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:04.556460 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f22e9023-fcbd-4eff-9d5c-b8f0a0d7a2bb tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1198 microversion: 2.1 time: 0.708982 Aug 02 07:03:04.557357 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1672/3459] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:03 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1198 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:05.541251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-81da6d7d-705e-40d5-a6ac-3c32a737d768 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:05.542295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-81da6d7d-705e-40d5-a6ac-3c32a737d768 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:05.559227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81da6d7d-705e-40d5-a6ac-3c32a737d768 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:05.563210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81da6d7d-705e-40d5-a6ac-3c32a737d768 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:05.564306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81da6d7d-705e-40d5-a6ac-3c32a737d768 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:05.564762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81da6d7d-705e-40d5-a6ac-3c32a737d768 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:05.589788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-23c15e59-0c77-4866-bc26-ca64d61ffbcc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:05.592570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-23c15e59-0c77-4866-bc26-ca64d61ffbcc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:05.623683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23c15e59-0c77-4866-bc26-ca64d61ffbcc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:05.628013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23c15e59-0c77-4866-bc26-ca64d61ffbcc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:05.629828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23c15e59-0c77-4866-bc26-ca64d61ffbcc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:05.631546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23c15e59-0c77-4866-bc26-ca64d61ffbcc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:06.144049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-81da6d7d-705e-40d5-a6ac-3c32a737d768 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:06.149814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23c15e59-0c77-4866-bc26-ca64d61ffbcc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:06.158834 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-23c15e59-0c77-4866-bc26-ca64d61ffbcc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1198 microversion: 2.1 time: 0.581729 Aug 02 07:03:06.162799 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1673/3460] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:05 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1198 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:06.173278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-81da6d7d-705e-40d5-a6ac-3c32a737d768 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:06.179378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-81da6d7d-705e-40d5-a6ac-3c32a737d768 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:06.183244 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-81da6d7d-705e-40d5-a6ac-3c32a737d768 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.645483 Aug 02 07:03:06.199093 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1788/3461] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:05 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:07.185394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-db67b57c-b984-4923-a5e7-b925fa558632 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:07.192415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-db67b57c-b984-4923-a5e7-b925fa558632 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:07.216589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-82304a1f-1938-422c-ac12-fabc886ad124 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:07.217844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-82304a1f-1938-422c-ac12-fabc886ad124 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:07.228959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82304a1f-1938-422c-ac12-fabc886ad124 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:07.229917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82304a1f-1938-422c-ac12-fabc886ad124 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:07.232708 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82304a1f-1938-422c-ac12-fabc886ad124 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:07.233775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-82304a1f-1938-422c-ac12-fabc886ad124 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:07.238272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db67b57c-b984-4923-a5e7-b925fa558632 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:07.242669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db67b57c-b984-4923-a5e7-b925fa558632 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:07.243535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db67b57c-b984-4923-a5e7-b925fa558632 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:07.243980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db67b57c-b984-4923-a5e7-b925fa558632 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:08.010002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-82304a1f-1938-422c-ac12-fabc886ad124 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:08.045505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-82304a1f-1938-422c-ac12-fabc886ad124 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:08.049926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-82304a1f-1938-422c-ac12-fabc886ad124 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:08.057109 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-82304a1f-1938-422c-ac12-fabc886ad124 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.850151 Aug 02 07:03:08.059082 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1789/3462] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:07 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:03:08.352197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-db67b57c-b984-4923-a5e7-b925fa558632 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:08.366852 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-db67b57c-b984-4923-a5e7-b925fa558632 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1198 microversion: 2.1 time: 1.187202 Aug 02 07:03:08.369515 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1674/3463] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:07 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1198 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:09.087830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-26544942-7956-4573-8490-d5c360cf00c5 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:09.088620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-26544942-7956-4573-8490-d5c360cf00c5 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:09.105112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26544942-7956-4573-8490-d5c360cf00c5 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:09.105639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26544942-7956-4573-8490-d5c360cf00c5 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:09.106638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26544942-7956-4573-8490-d5c360cf00c5 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:09.107481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26544942-7956-4573-8490-d5c360cf00c5 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:09.389064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-28373bc5-a700-4d55-838c-b77f7ef0932c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:09.392396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-28373bc5-a700-4d55-838c-b77f7ef0932c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:09.417044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28373bc5-a700-4d55-838c-b77f7ef0932c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:09.417577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28373bc5-a700-4d55-838c-b77f7ef0932c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:09.418820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28373bc5-a700-4d55-838c-b77f7ef0932c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:09.419504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28373bc5-a700-4d55-838c-b77f7ef0932c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:10.238075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-26544942-7956-4573-8490-d5c360cf00c5 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:10.257313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-26544942-7956-4573-8490-d5c360cf00c5 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:10.259074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-26544942-7956-4573-8490-d5c360cf00c5 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:10.260447 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-26544942-7956-4573-8490-d5c360cf00c5 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 1.177894 Aug 02 07:03:10.273934 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1790/3464] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:09 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:10.440418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-28373bc5-a700-4d55-838c-b77f7ef0932c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:10.471928 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-28373bc5-a700-4d55-838c-b77f7ef0932c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1198 microversion: 2.1 time: 1.086752 Aug 02 07:03:10.491718 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1675/3465] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:09 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1198 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:11.290433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f486fcf-d7b8-49c5-a48d-6b960dcabc81 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:11.291255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1f486fcf-d7b8-49c5-a48d-6b960dcabc81 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:11.318985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f486fcf-d7b8-49c5-a48d-6b960dcabc81 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:11.319566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f486fcf-d7b8-49c5-a48d-6b960dcabc81 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:11.320554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f486fcf-d7b8-49c5-a48d-6b960dcabc81 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:11.321112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f486fcf-d7b8-49c5-a48d-6b960dcabc81 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:11.504223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f9a99ce8-9cd4-4489-a287-f03d4e1b8c44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:11.507342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f9a99ce8-9cd4-4489-a287-f03d4e1b8c44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:11.528854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9a99ce8-9cd4-4489-a287-f03d4e1b8c44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:11.529606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9a99ce8-9cd4-4489-a287-f03d4e1b8c44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:11.530812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9a99ce8-9cd4-4489-a287-f03d4e1b8c44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:11.537138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9a99ce8-9cd4-4489-a287-f03d4e1b8c44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:12.275957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f486fcf-d7b8-49c5-a48d-6b960dcabc81 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:12.305495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f486fcf-d7b8-49c5-a48d-6b960dcabc81 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:12.328520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f486fcf-d7b8-49c5-a48d-6b960dcabc81 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:12.343702 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f486fcf-d7b8-49c5-a48d-6b960dcabc81 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 1.046962 Aug 02 07:03:12.346234 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1791/3466] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:11 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:03:12.411609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f9a99ce8-9cd4-4489-a287-f03d4e1b8c44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:12.433777 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f9a99ce8-9cd4-4489-a287-f03d4e1b8c44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1198 microversion: 2.1 time: 0.933096 Aug 02 07:03:12.435571 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1676/3467] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:11 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1198 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:13.386161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-63e4e153-d0c4-4a71-8ae9-a3668e639f0e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:13.387565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-63e4e153-d0c4-4a71-8ae9-a3668e639f0e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:13.404540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63e4e153-d0c4-4a71-8ae9-a3668e639f0e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:13.415149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63e4e153-d0c4-4a71-8ae9-a3668e639f0e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:13.417115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63e4e153-d0c4-4a71-8ae9-a3668e639f0e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:13.417878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63e4e153-d0c4-4a71-8ae9-a3668e639f0e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:13.463528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4aea5658-96e9-42c5-ac52-deaf38f38040 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:13.464867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4aea5658-96e9-42c5-ac52-deaf38f38040 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:13.487978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4aea5658-96e9-42c5-ac52-deaf38f38040 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:13.492876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4aea5658-96e9-42c5-ac52-deaf38f38040 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:13.495635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4aea5658-96e9-42c5-ac52-deaf38f38040 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:13.497641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4aea5658-96e9-42c5-ac52-deaf38f38040 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:14.118910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-63e4e153-d0c4-4a71-8ae9-a3668e639f0e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:14.147492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-63e4e153-d0c4-4a71-8ae9-a3668e639f0e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:14.149730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-63e4e153-d0c4-4a71-8ae9-a3668e639f0e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:14.150611 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-63e4e153-d0c4-4a71-8ae9-a3668e639f0e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.768708 Aug 02 07:03:14.151210 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1792/3468] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:13 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:14.209731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4aea5658-96e9-42c5-ac52-deaf38f38040 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:14.223764 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4aea5658-96e9-42c5-ac52-deaf38f38040 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1198 microversion: 2.1 time: 0.764763 Aug 02 07:03:14.235108 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1677/3469] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:13 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1198 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:14.544817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-153059a8-180c-4af9-880a-7bf67f9be953 req-43d2aa6a-8ab4-4804-ad83-ad023e9107ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13dab9a5-60b6-46c3-8f27-6b9ea00e10a4", "name": "network-vif-plugged", "status": "completed", "tag": "554c704f-d680-42da-86e3-dd789c192bd1"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:14.568847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-153059a8-180c-4af9-880a-7bf67f9be953 req-43d2aa6a-8ab4-4804-ad83-ad023e9107ce service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:14.569677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-153059a8-180c-4af9-880a-7bf67f9be953 req-43d2aa6a-8ab4-4804-ad83-ad023e9107ce service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:14.600988 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-153059a8-180c-4af9-880a-7bf67f9be953 req-43d2aa6a-8ab4-4804-ad83-ad023e9107ce service nova] Creating event network-vif-plugged:554c704f-d680-42da-86e3-dd789c192bd1 for instance 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 on n-h1-851337-3 Aug 02 07:03:14.615027 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-153059a8-180c-4af9-880a-7bf67f9be953 req-43d2aa6a-8ab4-4804-ad83-ad023e9107ce service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074026 Aug 02 07:03:14.626412 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1793/3470] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:03:15.181117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2a562b28-c0f9-461c-afc0-61ca3acdfe03 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:15.182029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2a562b28-c0f9-461c-afc0-61ca3acdfe03 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:15.201310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a562b28-c0f9-461c-afc0-61ca3acdfe03 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:15.206026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a562b28-c0f9-461c-afc0-61ca3acdfe03 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:15.207197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a562b28-c0f9-461c-afc0-61ca3acdfe03 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:15.207942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a562b28-c0f9-461c-afc0-61ca3acdfe03 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:15.260753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e00fb331-5329-48d2-b7f7-27e5e5083192 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:15.261854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e00fb331-5329-48d2-b7f7-27e5e5083192 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:15.280587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e00fb331-5329-48d2-b7f7-27e5e5083192 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:15.281507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e00fb331-5329-48d2-b7f7-27e5e5083192 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:15.293425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e00fb331-5329-48d2-b7f7-27e5e5083192 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:15.294632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e00fb331-5329-48d2-b7f7-27e5e5083192 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:15.702537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2a562b28-c0f9-461c-afc0-61ca3acdfe03 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:15.715213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2a562b28-c0f9-461c-afc0-61ca3acdfe03 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:15.723489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2a562b28-c0f9-461c-afc0-61ca3acdfe03 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:15.728370 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2a562b28-c0f9-461c-afc0-61ca3acdfe03 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.551455 Aug 02 07:03:15.731087 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1678/3471] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:15 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:15.860866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e00fb331-5329-48d2-b7f7-27e5e5083192 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:15.881297 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e00fb331-5329-48d2-b7f7-27e5e5083192 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1198 microversion: 2.1 time: 0.625139 Aug 02 07:03:15.886013 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1794/3472] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:15 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1198 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:16.759938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-291741e6-5074-48ec-9baf-0892d7703f7a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:16.761406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-291741e6-5074-48ec-9baf-0892d7703f7a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:16.782654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-291741e6-5074-48ec-9baf-0892d7703f7a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:16.784189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-291741e6-5074-48ec-9baf-0892d7703f7a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:16.785573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-291741e6-5074-48ec-9baf-0892d7703f7a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:16.787339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-291741e6-5074-48ec-9baf-0892d7703f7a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:16.905727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-edbed908-9892-4182-9fb9-543f382f2f2c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:16.906399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-edbed908-9892-4182-9fb9-543f382f2f2c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:16.916140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:03:16.922847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-edbed908-9892-4182-9fb9-543f382f2f2c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:16.934819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-edbed908-9892-4182-9fb9-543f382f2f2c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:16.935952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-edbed908-9892-4182-9fb9-543f382f2f2c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:16.938835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-edbed908-9892-4182-9fb9-543f382f2f2c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:17.585661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-291741e6-5074-48ec-9baf-0892d7703f7a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:17.603081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-291741e6-5074-48ec-9baf-0892d7703f7a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:17.611847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-291741e6-5074-48ec-9baf-0892d7703f7a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:17.617005 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-291741e6-5074-48ec-9baf-0892d7703f7a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 0.863038 Aug 02 07:03:17.628951 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1679/3473] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:16 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:17.656507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-edbed908-9892-4182-9fb9-543f382f2f2c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:17.672436 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-edbed908-9892-4182-9fb9-543f382f2f2c tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1198 microversion: 2.1 time: 0.770605 Aug 02 07:03:17.687628 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1795/3474] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:16 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1198 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:18.348180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-394d0a80-598c-4db1-b65e-f45e6551c141 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Action: 'create', calling method: .version_select at 0x7f927ae3e3a0>, body: {"keypair": {"name": "tempest-keypair-316378317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEN/d90gDpK3qSfyNZmwGne6mdfld5Sk6l5h+f0zOewkal5FlzNaSeW1gCfD5dox+IVRnmoV8kblBToqJMgUSsxPdpfV8OLn9WftgfG5QoB/EVXkJgSIHYC1ExOTbM9Gsg=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:18.425361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-394d0a80-598c-4db1-b65e-f45e6551c141 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for project 6ee1befa077542b9a17865baad3c9999. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:03:18.453049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-394d0a80-598c-4db1-b65e-f45e6551c141 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for user 3a2629fa08b5419a96c2942118d38dad and project 6ee1befa077542b9a17865baad3c9999. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:03:18.554807 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-394d0a80-598c-4db1-b65e-f45e6551c141 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.628275 Aug 02 07:03:18.557999 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1680/3475] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:03:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:03:18.652496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d0a949c4-369e-41ff-bbe0-30530b909b95 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:18.652966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d0a949c4-369e-41ff-bbe0-30530b909b95 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:18.667738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0a949c4-369e-41ff-bbe0-30530b909b95 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:18.668116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0a949c4-369e-41ff-bbe0-30530b909b95 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:18.669060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0a949c4-369e-41ff-bbe0-30530b909b95 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:18.669546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0a949c4-369e-41ff-bbe0-30530b909b95 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:18.696527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-59503ef1-1cda-46f9-be7b-dbaa0eea4fcf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:18.706291 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-59503ef1-1cda-46f9-be7b-dbaa0eea4fcf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:18.726498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59503ef1-1cda-46f9-be7b-dbaa0eea4fcf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:18.729719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59503ef1-1cda-46f9-be7b-dbaa0eea4fcf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:18.730977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59503ef1-1cda-46f9-be7b-dbaa0eea4fcf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:18.731611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59503ef1-1cda-46f9-be7b-dbaa0eea4fcf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:19.813255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-59503ef1-1cda-46f9-be7b-dbaa0eea4fcf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:19.824713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d0a949c4-369e-41ff-bbe0-30530b909b95 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:19.850034 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-59503ef1-1cda-46f9-be7b-dbaa0eea4fcf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1380 microversion: 2.1 time: 1.159199 Aug 02 07:03:19.850668 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1681/3476] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:18 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1380 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:19.858338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d0a949c4-369e-41ff-bbe0-30530b909b95 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:19.871288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d0a949c4-369e-41ff-bbe0-30530b909b95 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:19.872565 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d0a949c4-369e-41ff-bbe0-30530b909b95 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 1.224633 Aug 02 07:03:19.877675 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1796/3477] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:18 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:20.411344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7af6f8da-293d-4716-9952-f4264a2cac55 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:20.413075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7af6f8da-293d-4716-9952-f4264a2cac55 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:20.416105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:03:20.436039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7af6f8da-293d-4716-9952-f4264a2cac55 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:20.440753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7af6f8da-293d-4716-9952-f4264a2cac55 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:20.457845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7af6f8da-293d-4716-9952-f4264a2cac55 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:20.461151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7af6f8da-293d-4716-9952-f4264a2cac55 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:20.916657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-064e5929-9c82-4db5-8021-0d14d7ed092a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:20.917410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-064e5929-9c82-4db5-8021-0d14d7ed092a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:20.939418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-064e5929-9c82-4db5-8021-0d14d7ed092a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:20.940739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-064e5929-9c82-4db5-8021-0d14d7ed092a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:20.943910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-064e5929-9c82-4db5-8021-0d14d7ed092a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:20.944469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-064e5929-9c82-4db5-8021-0d14d7ed092a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:21.299255 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7af6f8da-293d-4716-9952-f4264a2cac55 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1531 microversion: 2.1 time: 1.425156 Aug 02 07:03:21.317931 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1682/3478] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:19 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1531 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:21.331921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4e9bf70e-e851-41b8-ae8a-e02c1a90e5f3 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:21.346449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4e9bf70e-e851-41b8-ae8a-e02c1a90e5f3 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:21.376048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e9bf70e-e851-41b8-ae8a-e02c1a90e5f3 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:21.376441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e9bf70e-e851-41b8-ae8a-e02c1a90e5f3 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:21.377343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e9bf70e-e851-41b8-ae8a-e02c1a90e5f3 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:21.377729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e9bf70e-e851-41b8-ae8a-e02c1a90e5f3 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:22.183980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-064e5929-9c82-4db5-8021-0d14d7ed092a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:22.214868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-064e5929-9c82-4db5-8021-0d14d7ed092a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:22.217523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-064e5929-9c82-4db5-8021-0d14d7ed092a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:22.219662 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-064e5929-9c82-4db5-8021-0d14d7ed092a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 1.308322 Aug 02 07:03:22.223414 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1797/3479] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:20 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:03:22.279882 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4e9bf70e-e851-41b8-ae8a-e02c1a90e5f3 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1531 microversion: 2.1 time: 0.958902 Aug 02 07:03:22.288671 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1683/3480] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:21 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1531 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:22.319658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-56f22161-378b-4400-9c3c-a9a8e189246b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:22.336711 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:03:22.336711 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 07:03:22.343466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56f22161-378b-4400-9c3c-a9a8e189246b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:22.345168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56f22161-378b-4400-9c3c-a9a8e189246b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:22.347491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56f22161-378b-4400-9c3c-a9a8e189246b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:22.351337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-56f22161-378b-4400-9c3c-a9a8e189246b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:22.476113 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-56f22161-378b-4400-9c3c-a9a8e189246b tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.174302 Aug 02 07:03:22.485192 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1798/3481] 10.222.0.79 () {58 vars in 1176 bytes} [Tue Aug 2 07:03:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:03:22.492002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4abfe864-1164-4b17-9266-f541122ff0dc tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851337-3", "block_migration": false, "disk_over_commit": false}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:22.496124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4abfe864-1164-4b17-9266-f541122ff0dc tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:22.521373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4abfe864-1164-4b17-9266-f541122ff0dc tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:22.524604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4abfe864-1164-4b17-9266-f541122ff0dc tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:22.525315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4abfe864-1164-4b17-9266-f541122ff0dc tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:22.525765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4abfe864-1164-4b17-9266-f541122ff0dc tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:22.626489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-4abfe864-1164-4b17-9266-f541122ff0dc tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lazy-loading 'flavor' on Instance uuid 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:03:22.654818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4abfe864-1164-4b17-9266-f541122ff0dc tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Going to try to live migrate instance to n-h2-851337-3 {{(pid=126119) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 02 07:03:23.246687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d496b277-8758-470d-9ccb-15687bb181ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:23.248001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d496b277-8758-470d-9ccb-15687bb181ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:23.280597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d496b277-8758-470d-9ccb-15687bb181ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:23.285201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d496b277-8758-470d-9ccb-15687bb181ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:23.286480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d496b277-8758-470d-9ccb-15687bb181ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:23.288303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d496b277-8758-470d-9ccb-15687bb181ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:24.362556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d496b277-8758-470d-9ccb-15687bb181ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:24.389201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d496b277-8758-470d-9ccb-15687bb181ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:24.394307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d496b277-8758-470d-9ccb-15687bb181ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:24.397431 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d496b277-8758-470d-9ccb-15687bb181ca tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 1.156418 Aug 02 07:03:24.398396 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1799/3482] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:23 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:03:24.694791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c1c78527-ac72-4a49-8b7c-e48a72e16a10 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'create', calling method: .version_select at 0x7f927a79d310>, body: {"keypair": {"name": "tempest-keypair-829538096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoxm716gkxzwjuWsiVjaU8HX6A8ra1cwnpIIpsdP5TKPkpPSLjf74Ez3eJl/Uuw9nvrAYEF9dZIRA44wbsWXB+KPaPwvho4pwGc1XkbqhjnL+XqNub4MsJpJqw4GvwHMA=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:24.728251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-c1c78527-ac72-4a49-8b7c-e48a72e16a10 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Getting quotas for project daaad725b62041d1ac0af9ff8efcdfc5. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:03:24.736599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-c1c78527-ac72-4a49-8b7c-e48a72e16a10 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Getting quotas for user 35f9bc6690f3473a99804c14351b93b6 and project daaad725b62041d1ac0af9ff8efcdfc5. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:03:24.791663 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c1c78527-ac72-4a49-8b7c-e48a72e16a10 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.381922 Aug 02 07:03:24.793658 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1800/3483] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:03:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:03:24.831982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1562590831", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a30dbbf-9ed5-4371-af86-d34ddcdf6f20"}], "security_groups": [{"name": "tempest-securitygroup--2027098805"}], "key_name": "tempest-keypair-316378317", "user_data": "}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:25.239624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] validate_networks() for [('9a30dbbf-9ed5-4371-af86-d34ddcdf6f20', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:03:25.624253 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4abfe864-1164-4b17-9266-f541122ff0dc tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4/action" status: 202 len: 0 microversion: 2.1 time: 3.137307 Aug 02 07:03:25.629294 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1684/3484] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:03:22 2022] POST /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4/action => generated 0 bytes in 3143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:03:25.648633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-276cf374-df36-4bd8-a92a-5a4eecdc0620 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:25.651653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-276cf374-df36-4bd8-a92a-5a4eecdc0620 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:25.701536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-276cf374-df36-4bd8-a92a-5a4eecdc0620 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:25.703464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-276cf374-df36-4bd8-a92a-5a4eecdc0620 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:25.712264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-276cf374-df36-4bd8-a92a-5a4eecdc0620 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:25.713468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-276cf374-df36-4bd8-a92a-5a4eecdc0620 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:26.624860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-276cf374-df36-4bd8-a92a-5a4eecdc0620 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:26.653158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-276cf374-df36-4bd8-a92a-5a4eecdc0620 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:26.661472 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-276cf374-df36-4bd8-a92a-5a4eecdc0620 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:26.664639 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-276cf374-df36-4bd8-a92a-5a4eecdc0620 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1891 microversion: 2.42 time: 1.033909 Aug 02 07:03:26.665427 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1685/3485] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:25 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1891 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:26.680488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-542370b1-8cc9-4cfc-89ce-55b08e2a5b31 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:26.687559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-542370b1-8cc9-4cfc-89ce-55b08e2a5b31 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:26.710680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-542370b1-8cc9-4cfc-89ce-55b08e2a5b31 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:26.711303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-542370b1-8cc9-4cfc-89ce-55b08e2a5b31 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:26.712362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-542370b1-8cc9-4cfc-89ce-55b08e2a5b31 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:26.712919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-542370b1-8cc9-4cfc-89ce-55b08e2a5b31 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:26.750137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:03:26.751396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:03:26.752089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:03:26.752650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:03:26.753252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:03:26.773959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:26.774963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:26.775807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:26.776249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:26.824367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for project 6ee1befa077542b9a17865baad3c9999. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:03:26.835393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for user 3a2629fa08b5419a96c2942118d38dad and project 6ee1befa077542b9a17865baad3c9999. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:03:26.867395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:03:26.872558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:03:26.988796 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b270cb0-7ddc-4c17-9780-4f277a7a3049 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.190796 Aug 02 07:03:26.990049 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1801/3486] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:03:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 2196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:03:27.004935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2c47a44d-3d1d-4953-8c09-99e8cec2d979 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:27.006364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2c47a44d-3d1d-4953-8c09-99e8cec2d979 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:27.408686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2c47a44d-3d1d-4953-8c09-99e8cec2d979 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:27.476666 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2c47a44d-3d1d-4953-8c09-99e8cec2d979 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1241 microversion: 2.1 time: 0.471051 Aug 02 07:03:27.479952 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1802/3487] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:26 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1241 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:27.542300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-542370b1-8cc9-4cfc-89ce-55b08e2a5b31 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:27.573173 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-542370b1-8cc9-4cfc-89ce-55b08e2a5b31 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.900109 Aug 02 07:03:27.577519 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1686/3488] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:26 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:27.689521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f0f8b60-df65-4be7-8f75-74ebe043f598 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:27.690654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5f0f8b60-df65-4be7-8f75-74ebe043f598 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:27.714541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0f8b60-df65-4be7-8f75-74ebe043f598 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:27.715063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0f8b60-df65-4be7-8f75-74ebe043f598 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:27.715935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0f8b60-df65-4be7-8f75-74ebe043f598 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:27.716375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0f8b60-df65-4be7-8f75-74ebe043f598 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:27.751321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=91 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:03:28.519550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d552ca62-5979-497a-b836-5389c7deea87 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:28.524012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d552ca62-5979-497a-b836-5389c7deea87 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:28.550697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:03:28.593795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d552ca62-5979-497a-b836-5389c7deea87 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:28.594236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d552ca62-5979-497a-b836-5389c7deea87 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:28.601655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d552ca62-5979-497a-b836-5389c7deea87 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:28.605456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d552ca62-5979-497a-b836-5389c7deea87 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:28.991456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d552ca62-5979-497a-b836-5389c7deea87 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:29.050434 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d552ca62-5979-497a-b836-5389c7deea87 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1245 microversion: 2.1 time: 0.550961 Aug 02 07:03:29.056341 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1687/3489] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:28 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1245 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:29.090090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8c626847-5519-40ee-87dc-eeffa6305ec8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:29.091455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8c626847-5519-40ee-87dc-eeffa6305ec8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:29.123488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c626847-5519-40ee-87dc-eeffa6305ec8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:29.140268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c626847-5519-40ee-87dc-eeffa6305ec8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:29.141619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c626847-5519-40ee-87dc-eeffa6305ec8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:29.142182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c626847-5519-40ee-87dc-eeffa6305ec8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:29.192492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:03:29.527767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5f0f8b60-df65-4be7-8f75-74ebe043f598 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:29.582571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5f0f8b60-df65-4be7-8f75-74ebe043f598 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:29.596352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5f0f8b60-df65-4be7-8f75-74ebe043f598 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:29.601680 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5f0f8b60-df65-4be7-8f75-74ebe043f598 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 1.915352 Aug 02 07:03:29.604302 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1803/3490] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:27 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:29.851678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1285155245", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a2e64a4-c6ee-43d5-bb6a-002018e2c279"}], "security_groups": [{"name": "tempest-securitygroup--2030591088"}], "key_name": "tempest-keypair-829538096", "user_data": "}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:29.858831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8c626847-5519-40ee-87dc-eeffa6305ec8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:29.870482 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8c626847-5519-40ee-87dc-eeffa6305ec8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.808479 Aug 02 07:03:29.875464 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1688/3491] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:29 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:30.083416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-02b62a33-d8a8-43b2-ad93-6a3cfde49e8c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:30.084287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-02b62a33-d8a8-43b2-ad93-6a3cfde49e8c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:30.102262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02b62a33-d8a8-43b2-ad93-6a3cfde49e8c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:30.110323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02b62a33-d8a8-43b2-ad93-6a3cfde49e8c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:30.111979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02b62a33-d8a8-43b2-ad93-6a3cfde49e8c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:30.112689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02b62a33-d8a8-43b2-ad93-6a3cfde49e8c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:30.401476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-02b62a33-d8a8-43b2-ad93-6a3cfde49e8c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:30.418372 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-02b62a33-d8a8-43b2-ad93-6a3cfde49e8c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1301 microversion: 2.1 time: 0.336874 Aug 02 07:03:30.419677 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1689/3492] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:30 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1301 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:30.425201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] validate_networks() for [('4a2e64a4-c6ee-43d5-bb6a-002018e2c279', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:03:30.640188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2c9fdfcf-1b32-414c-bbfc-824b0d4eb64f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:30.640972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2c9fdfcf-1b32-414c-bbfc-824b0d4eb64f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:30.661124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c9fdfcf-1b32-414c-bbfc-824b0d4eb64f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:30.666002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c9fdfcf-1b32-414c-bbfc-824b0d4eb64f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:30.670049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c9fdfcf-1b32-414c-bbfc-824b0d4eb64f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:30.673269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c9fdfcf-1b32-414c-bbfc-824b0d4eb64f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:32.315156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2c9fdfcf-1b32-414c-bbfc-824b0d4eb64f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:32.325668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2c9fdfcf-1b32-414c-bbfc-824b0d4eb64f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:32.327240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2c9fdfcf-1b32-414c-bbfc-824b0d4eb64f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:32.328454 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2c9fdfcf-1b32-414c-bbfc-824b0d4eb64f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 1.692801 Aug 02 07:03:32.333112 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1690/3493] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:30 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:03:32.360878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9ef2986d-125a-49e8-a3ab-f34c70e5b337 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:32.361548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9ef2986d-125a-49e8-a3ab-f34c70e5b337 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:32.376792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ef2986d-125a-49e8-a3ab-f34c70e5b337 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:32.380041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ef2986d-125a-49e8-a3ab-f34c70e5b337 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:32.381532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ef2986d-125a-49e8-a3ab-f34c70e5b337 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:32.401299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ef2986d-125a-49e8-a3ab-f34c70e5b337 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:32.488682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:03:32.489510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:03:32.489930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:03:32.490351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:03:32.490911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:03:32.537524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:32.538073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:32.538879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:32.539335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:32.594810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Getting quotas for project daaad725b62041d1ac0af9ff8efcdfc5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:03:32.608029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Getting quotas for user 35f9bc6690f3473a99804c14351b93b6 and project daaad725b62041d1ac0af9ff8efcdfc5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:03:32.657612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:03:32.660238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:03:32.807740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9ef2986d-125a-49e8-a3ab-f34c70e5b337 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:32.816126 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9ef2986d-125a-49e8-a3ab-f34c70e5b337 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.463326 Aug 02 07:03:32.816963 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1691/3494] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:32 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:32.821666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6930f214-21f7-40d6-9c69-3c5cd9bc6b0d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:32.831189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6930f214-21f7-40d6-9c69-3c5cd9bc6b0d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:32.836631 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7e1e1412-cacd-4c42-b4a5-546d581540fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.990177 Aug 02 07:03:32.870347 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1804/3495] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:03:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 3024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 07:03:32.902208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-97b05162-a647-42d8-a293-f1f64096a850 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:32.902828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-97b05162-a647-42d8-a293-f1f64096a850 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:32.911749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6930f214-21f7-40d6-9c69-3c5cd9bc6b0d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:32.912283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6930f214-21f7-40d6-9c69-3c5cd9bc6b0d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:32.913512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6930f214-21f7-40d6-9c69-3c5cd9bc6b0d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:32.917373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6930f214-21f7-40d6-9c69-3c5cd9bc6b0d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:33.172510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-97b05162-a647-42d8-a293-f1f64096a850 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:33.180049 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-97b05162-a647-42d8-a293-f1f64096a850 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1238 microversion: 2.1 time: 0.294614 Aug 02 07:03:33.195814 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1805/3496] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:32 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1238 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:33.359155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-65598ea9-01b0-45d2-8641-e205ad0787a2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:33.360018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-65598ea9-01b0-45d2-8641-e205ad0787a2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:33.377769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-65598ea9-01b0-45d2-8641-e205ad0787a2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:33.380247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-65598ea9-01b0-45d2-8641-e205ad0787a2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:33.386597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-65598ea9-01b0-45d2-8641-e205ad0787a2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:33.387424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-65598ea9-01b0-45d2-8641-e205ad0787a2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:33.423325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6930f214-21f7-40d6-9c69-3c5cd9bc6b0d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:33.434968 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6930f214-21f7-40d6-9c69-3c5cd9bc6b0d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1367 microversion: 2.1 time: 0.614230 Aug 02 07:03:33.446966 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1692/3497] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:32 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1367 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:33.846558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-18c70017-70e1-469e-a786-0aa3567ad956 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:33.847644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-18c70017-70e1-469e-a786-0aa3567ad956 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:33.877914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18c70017-70e1-469e-a786-0aa3567ad956 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:33.882327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18c70017-70e1-469e-a786-0aa3567ad956 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:33.883803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-65598ea9-01b0-45d2-8641-e205ad0787a2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:33.889608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18c70017-70e1-469e-a786-0aa3567ad956 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:33.890296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18c70017-70e1-469e-a786-0aa3567ad956 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:33.894884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-65598ea9-01b0-45d2-8641-e205ad0787a2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:33.898375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-65598ea9-01b0-45d2-8641-e205ad0787a2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:33.900642 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-65598ea9-01b0-45d2-8641-e205ad0787a2 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.547649 Aug 02 07:03:33.915055 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1806/3498] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:33 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:34.202941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6d9c85f6-aa94-41b7-81ea-ec662a11d2bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:34.203861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6d9c85f6-aa94-41b7-81ea-ec662a11d2bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:34.222360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d9c85f6-aa94-41b7-81ea-ec662a11d2bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:34.237093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d9c85f6-aa94-41b7-81ea-ec662a11d2bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:34.240242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d9c85f6-aa94-41b7-81ea-ec662a11d2bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:34.244422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d9c85f6-aa94-41b7-81ea-ec662a11d2bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:34.369587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-18c70017-70e1-469e-a786-0aa3567ad956 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:34.390444 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-18c70017-70e1-469e-a786-0aa3567ad956 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.550223 Aug 02 07:03:34.398311 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1693/3499] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:33 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:34.443508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6d9c85f6-aa94-41b7-81ea-ec662a11d2bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:34.458357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a1c99f6d-2b6b-4a48-8d08-d05745cecc20 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:34.459412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a1c99f6d-2b6b-4a48-8d08-d05745cecc20 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:34.460278 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6d9c85f6-aa94-41b7-81ea-ec662a11d2bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1242 microversion: 2.1 time: 0.261215 Aug 02 07:03:34.468029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1c99f6d-2b6b-4a48-8d08-d05745cecc20 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:34.468529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1c99f6d-2b6b-4a48-8d08-d05745cecc20 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:34.469325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1c99f6d-2b6b-4a48-8d08-d05745cecc20 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:34.469762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1c99f6d-2b6b-4a48-8d08-d05745cecc20 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:34.478311 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1807/3500] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:34 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1242 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:34.784984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-2f6f935b-a989-4c41-97d4-572671b279c4 req-a5273f18-e385-4448-b7c5-0a53187fdacc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce30096-300b-4242-b360-ff6617fd5173", "tag": "7760230b-6b27-445e-86d1-9b56e50e0517"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:34.812204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2f6f935b-a989-4c41-97d4-572671b279c4 req-a5273f18-e385-4448-b7c5-0a53187fdacc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:34.812653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2f6f935b-a989-4c41-97d4-572671b279c4 req-a5273f18-e385-4448-b7c5-0a53187fdacc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:34.846019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a1c99f6d-2b6b-4a48-8d08-d05745cecc20 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:34.860727 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a1c99f6d-2b6b-4a48-8d08-d05745cecc20 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1367 microversion: 2.1 time: 0.406187 Aug 02 07:03:34.862198 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1694/3501] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:34 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1367 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:34.874259 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-2f6f935b-a989-4c41-97d4-572671b279c4 req-a5273f18-e385-4448-b7c5-0a53187fdacc service nova] Creating event network-changed:7760230b-6b27-445e-86d1-9b56e50e0517 for instance fce30096-300b-4242-b360-ff6617fd5173 on n-h1-851337-3 Aug 02 07:03:34.885577 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-2f6f935b-a989-4c41-97d4-572671b279c4 req-a5273f18-e385-4448-b7c5-0a53187fdacc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104276 Aug 02 07:03:34.887968 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1808/3502] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:03:34.926261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-572f8ea0-755a-4f1b-9555-00565044f1ad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:34.927118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-572f8ea0-755a-4f1b-9555-00565044f1ad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:34.936332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-572f8ea0-755a-4f1b-9555-00565044f1ad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:34.937060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-572f8ea0-755a-4f1b-9555-00565044f1ad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:34.938200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-572f8ea0-755a-4f1b-9555-00565044f1ad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:34.938828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-572f8ea0-755a-4f1b-9555-00565044f1ad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:35.394898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-572f8ea0-755a-4f1b-9555-00565044f1ad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:35.414649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-572f8ea0-755a-4f1b-9555-00565044f1ad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:35.419604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-572f8ea0-755a-4f1b-9555-00565044f1ad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:35.419950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fdce2fdd-ba84-4bb4-b2c7-22ca12b199d2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:35.420684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fdce2fdd-ba84-4bb4-b2c7-22ca12b199d2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:35.422398 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-572f8ea0-755a-4f1b-9555-00565044f1ad tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.501312 Aug 02 07:03:35.428520 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1695/3503] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:34 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:35.436943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fdce2fdd-ba84-4bb4-b2c7-22ca12b199d2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:35.437671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fdce2fdd-ba84-4bb4-b2c7-22ca12b199d2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:35.444132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fdce2fdd-ba84-4bb4-b2c7-22ca12b199d2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:35.444824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fdce2fdd-ba84-4bb4-b2c7-22ca12b199d2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:35.481235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb4e2484-406b-47bd-a89f-fe0379a0b4c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:35.481848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cb4e2484-406b-47bd-a89f-fe0379a0b4c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:35.494979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb4e2484-406b-47bd-a89f-fe0379a0b4c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:35.495434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb4e2484-406b-47bd-a89f-fe0379a0b4c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:35.496314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb4e2484-406b-47bd-a89f-fe0379a0b4c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:35.496643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb4e2484-406b-47bd-a89f-fe0379a0b4c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:35.642503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cb4e2484-406b-47bd-a89f-fe0379a0b4c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:35.656787 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cb4e2484-406b-47bd-a89f-fe0379a0b4c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1296 microversion: 2.1 time: 0.179364 Aug 02 07:03:35.658754 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1696/3504] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:35 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1296 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:35.895682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-59927a77-7e1f-4c29-95dd-d87ac26c28b2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:35.897694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-59927a77-7e1f-4c29-95dd-d87ac26c28b2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:35.954034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59927a77-7e1f-4c29-95dd-d87ac26c28b2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:35.960136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59927a77-7e1f-4c29-95dd-d87ac26c28b2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:35.962986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fdce2fdd-ba84-4bb4-b2c7-22ca12b199d2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:35.968916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59927a77-7e1f-4c29-95dd-d87ac26c28b2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:35.970594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59927a77-7e1f-4c29-95dd-d87ac26c28b2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:35.990860 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fdce2fdd-ba84-4bb4-b2c7-22ca12b199d2 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.575092 Aug 02 07:03:35.991515 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1809/3505] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:35 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:36.350515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-59927a77-7e1f-4c29-95dd-d87ac26c28b2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:36.360934 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-59927a77-7e1f-4c29-95dd-d87ac26c28b2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1367 microversion: 2.1 time: 0.478214 Aug 02 07:03:36.362174 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1697/3506] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:35 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1367 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:36.451027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e2e0e7f8-d515-413a-9e02-ef779567f7b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:36.451930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e2e0e7f8-d515-413a-9e02-ef779567f7b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:36.466893 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e2e0e7f8-d515-413a-9e02-ef779567f7b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:36.476050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e2e0e7f8-d515-413a-9e02-ef779567f7b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:36.476876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e2e0e7f8-d515-413a-9e02-ef779567f7b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:36.477504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e2e0e7f8-d515-413a-9e02-ef779567f7b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:36.686435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-060995b9-d2d0-4b98-92b5-232c44493fdd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:36.687824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-060995b9-d2d0-4b98-92b5-232c44493fdd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:36.702397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-060995b9-d2d0-4b98-92b5-232c44493fdd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:36.705195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-060995b9-d2d0-4b98-92b5-232c44493fdd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:36.707832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-060995b9-d2d0-4b98-92b5-232c44493fdd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:36.709576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-060995b9-d2d0-4b98-92b5-232c44493fdd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:36.840104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-060995b9-d2d0-4b98-92b5-232c44493fdd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:36.853397 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-060995b9-d2d0-4b98-92b5-232c44493fdd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1296 microversion: 2.1 time: 0.172341 Aug 02 07:03:36.869950 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1698/3507] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:36 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1296 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:36.920209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e2e0e7f8-d515-413a-9e02-ef779567f7b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:36.939770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e2e0e7f8-d515-413a-9e02-ef779567f7b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:36.943113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e2e0e7f8-d515-413a-9e02-ef779567f7b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:36.944484 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e2e0e7f8-d515-413a-9e02-ef779567f7b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.497471 Aug 02 07:03:36.945255 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1810/3508] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:36 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:37.025002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-45ae44db-5fb5-4d30-83be-5a41d8d93e35 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:37.025863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-45ae44db-5fb5-4d30-83be-5a41d8d93e35 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:37.040269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45ae44db-5fb5-4d30-83be-5a41d8d93e35 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:37.044077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45ae44db-5fb5-4d30-83be-5a41d8d93e35 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:37.045322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45ae44db-5fb5-4d30-83be-5a41d8d93e35 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:37.045990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45ae44db-5fb5-4d30-83be-5a41d8d93e35 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:37.291711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-45ae44db-5fb5-4d30-83be-5a41d8d93e35 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:37.305839 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-45ae44db-5fb5-4d30-83be-5a41d8d93e35 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.283001 Aug 02 07:03:37.310264 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1699/3509] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:37 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:37.382845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1b871046-41e4-43c8-b272-3965c987376e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:37.383479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1b871046-41e4-43c8-b272-3965c987376e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:37.398906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b871046-41e4-43c8-b272-3965c987376e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:37.399640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b871046-41e4-43c8-b272-3965c987376e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:37.401176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b871046-41e4-43c8-b272-3965c987376e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:37.401806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b871046-41e4-43c8-b272-3965c987376e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:37.856185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1b871046-41e4-43c8-b272-3965c987376e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:37.881925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0939d7bf-5ee3-4a27-a53f-b382fe9a9fbf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:37.883687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0939d7bf-5ee3-4a27-a53f-b382fe9a9fbf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:37.885111 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1b871046-41e4-43c8-b272-3965c987376e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1367 microversion: 2.1 time: 0.504513 Aug 02 07:03:37.888357 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1811/3510] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:37 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1367 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:37.901530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0939d7bf-5ee3-4a27-a53f-b382fe9a9fbf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:37.902196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0939d7bf-5ee3-4a27-a53f-b382fe9a9fbf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:37.903113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0939d7bf-5ee3-4a27-a53f-b382fe9a9fbf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:37.903666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0939d7bf-5ee3-4a27-a53f-b382fe9a9fbf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:37.971582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2e9416ff-dc4f-4844-808f-af5ff34c4f0f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:37.972713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2e9416ff-dc4f-4844-808f-af5ff34c4f0f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:37.992226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e9416ff-dc4f-4844-808f-af5ff34c4f0f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:37.993042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e9416ff-dc4f-4844-808f-af5ff34c4f0f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:37.994213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e9416ff-dc4f-4844-808f-af5ff34c4f0f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:37.994900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e9416ff-dc4f-4844-808f-af5ff34c4f0f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:38.635710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0939d7bf-5ee3-4a27-a53f-b382fe9a9fbf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:38.660375 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0939d7bf-5ee3-4a27-a53f-b382fe9a9fbf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1364 microversion: 2.1 time: 0.782437 Aug 02 07:03:38.661012 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1700/3511] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:37 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1364 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:38.681979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b0ab4c78-a872-4776-982c-28dc209a5ec7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:38.682598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b0ab4c78-a872-4776-982c-28dc209a5ec7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:38.691842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0ab4c78-a872-4776-982c-28dc209a5ec7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:38.692295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0ab4c78-a872-4776-982c-28dc209a5ec7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:38.693236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0ab4c78-a872-4776-982c-28dc209a5ec7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:38.693697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0ab4c78-a872-4776-982c-28dc209a5ec7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:38.715658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2e9416ff-dc4f-4844-808f-af5ff34c4f0f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:38.727785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2e9416ff-dc4f-4844-808f-af5ff34c4f0f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:38.729768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2e9416ff-dc4f-4844-808f-af5ff34c4f0f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:38.731491 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2e9416ff-dc4f-4844-808f-af5ff34c4f0f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.766436 Aug 02 07:03:38.746816 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1812/3512] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:37 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:38.907004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-07945836-aec4-4478-ba98-6e3478074047 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:38.907752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-07945836-aec4-4478-ba98-6e3478074047 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:38.933247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07945836-aec4-4478-ba98-6e3478074047 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:38.933949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07945836-aec4-4478-ba98-6e3478074047 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:38.937872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07945836-aec4-4478-ba98-6e3478074047 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:38.938648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07945836-aec4-4478-ba98-6e3478074047 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:39.003224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b0ab4c78-a872-4776-982c-28dc209a5ec7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:39.017977 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b0ab4c78-a872-4776-982c-28dc209a5ec7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.340937 Aug 02 07:03:39.040899 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1701/3513] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:38 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:39.267820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-07945836-aec4-4478-ba98-6e3478074047 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:39.282483 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-07945836-aec4-4478-ba98-6e3478074047 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1367 microversion: 2.1 time: 0.378278 Aug 02 07:03:39.293434 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1813/3514] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:38 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:39.683806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0addc4d2-eeed-4bc9-9272-30bbc6104138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:39.684460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0addc4d2-eeed-4bc9-9272-30bbc6104138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:39.694187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0addc4d2-eeed-4bc9-9272-30bbc6104138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:39.694187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0addc4d2-eeed-4bc9-9272-30bbc6104138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:39.694187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0addc4d2-eeed-4bc9-9272-30bbc6104138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:39.694643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0addc4d2-eeed-4bc9-9272-30bbc6104138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:39.757251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ddec770d-1b7b-4493-844d-ac15f891f347 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:39.759180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ddec770d-1b7b-4493-844d-ac15f891f347 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:39.773500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ddec770d-1b7b-4493-844d-ac15f891f347 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:39.786812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ddec770d-1b7b-4493-844d-ac15f891f347 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:39.787977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ddec770d-1b7b-4493-844d-ac15f891f347 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:39.788758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ddec770d-1b7b-4493-844d-ac15f891f347 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:40.056863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0addc4d2-eeed-4bc9-9272-30bbc6104138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:40.073758 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0addc4d2-eeed-4bc9-9272-30bbc6104138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1364 microversion: 2.1 time: 0.393810 Aug 02 07:03:40.092193 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1702/3515] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:39 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1364 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:40.098183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-51dda34a-8dcb-454d-91e5-c23570c8476e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:40.098930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-51dda34a-8dcb-454d-91e5-c23570c8476e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:40.108207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51dda34a-8dcb-454d-91e5-c23570c8476e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:40.109029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51dda34a-8dcb-454d-91e5-c23570c8476e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:40.110952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51dda34a-8dcb-454d-91e5-c23570c8476e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:40.111435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51dda34a-8dcb-454d-91e5-c23570c8476e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:40.140611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ddec770d-1b7b-4493-844d-ac15f891f347 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:40.155320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ddec770d-1b7b-4493-844d-ac15f891f347 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:40.159741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ddec770d-1b7b-4493-844d-ac15f891f347 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:40.166267 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ddec770d-1b7b-4493-844d-ac15f891f347 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.413205 Aug 02 07:03:40.167611 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1814/3516] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:39 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:03:40.308485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f66e7acf-ef54-41b3-b9e6-e2270a2a4ed0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:40.309694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f66e7acf-ef54-41b3-b9e6-e2270a2a4ed0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:40.322938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f66e7acf-ef54-41b3-b9e6-e2270a2a4ed0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:40.323826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f66e7acf-ef54-41b3-b9e6-e2270a2a4ed0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:40.327299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f66e7acf-ef54-41b3-b9e6-e2270a2a4ed0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:40.328162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f66e7acf-ef54-41b3-b9e6-e2270a2a4ed0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:40.329432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-51dda34a-8dcb-454d-91e5-c23570c8476e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:40.343537 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-51dda34a-8dcb-454d-91e5-c23570c8476e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.250025 Aug 02 07:03:40.344808 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1703/3517] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:40 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:40.760040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f66e7acf-ef54-41b3-b9e6-e2270a2a4ed0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:40.802703 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f66e7acf-ef54-41b3-b9e6-e2270a2a4ed0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1367 microversion: 2.1 time: 0.495619 Aug 02 07:03:40.814025 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1815/3518] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:40 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1367 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:41.097853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f263146-68fd-49ee-9560-1ee74d940852 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:41.098511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3f263146-68fd-49ee-9560-1ee74d940852 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:41.109738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f263146-68fd-49ee-9560-1ee74d940852 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:41.110652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f263146-68fd-49ee-9560-1ee74d940852 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:41.111718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f263146-68fd-49ee-9560-1ee74d940852 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:41.112399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f263146-68fd-49ee-9560-1ee74d940852 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:41.190711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2d0f75d8-c716-417c-b1bf-83c7e986b698 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:41.192101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2d0f75d8-c716-417c-b1bf-83c7e986b698 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:41.207919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d0f75d8-c716-417c-b1bf-83c7e986b698 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:41.208878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d0f75d8-c716-417c-b1bf-83c7e986b698 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:41.210129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d0f75d8-c716-417c-b1bf-83c7e986b698 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:41.211014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d0f75d8-c716-417c-b1bf-83c7e986b698 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:41.374775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3f263146-68fd-49ee-9560-1ee74d940852 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:41.383488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:03:41.387827 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3f263146-68fd-49ee-9560-1ee74d940852 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1364 microversion: 2.1 time: 0.294602 Aug 02 07:03:41.393456 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1704/3519] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:41 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1364 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:41.403181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-20b1e441-0826-4aeb-bd61-123be70e10d7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:41.412411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-20b1e441-0826-4aeb-bd61-123be70e10d7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:41.428178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20b1e441-0826-4aeb-bd61-123be70e10d7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:41.429355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20b1e441-0826-4aeb-bd61-123be70e10d7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:41.431099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20b1e441-0826-4aeb-bd61-123be70e10d7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:41.431840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20b1e441-0826-4aeb-bd61-123be70e10d7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:41.839842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-20b1e441-0826-4aeb-bd61-123be70e10d7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:41.859651 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-20b1e441-0826-4aeb-bd61-123be70e10d7 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.462120 Aug 02 07:03:41.866789 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1705/3520] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:41 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:41.882908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2d0f75d8-c716-417c-b1bf-83c7e986b698 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:41.892935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8dac4b9a-5531-40f3-9e17-db7360818b69 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:41.897095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8dac4b9a-5531-40f3-9e17-db7360818b69 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:41.897253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2d0f75d8-c716-417c-b1bf-83c7e986b698 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:41.899004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2d0f75d8-c716-417c-b1bf-83c7e986b698 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:41.900265 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2d0f75d8-c716-417c-b1bf-83c7e986b698 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.713596 Aug 02 07:03:41.901199 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1816/3521] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:41 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:41.906678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8dac4b9a-5531-40f3-9e17-db7360818b69 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:41.907479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8dac4b9a-5531-40f3-9e17-db7360818b69 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:41.908609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8dac4b9a-5531-40f3-9e17-db7360818b69 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:41.909110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8dac4b9a-5531-40f3-9e17-db7360818b69 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:42.062763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-90d3c7bc-b2ea-4ca5-b045-606dbddd654c req-12a98d5a-28a9-48a0-bffe-e627df9ac651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ccfed8-393e-4223-b2a8-7dbf8c77d3fe", "tag": "96c2e36a-4761-4b9b-b02e-96b42f53d06e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:42.083815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-90d3c7bc-b2ea-4ca5-b045-606dbddd654c req-12a98d5a-28a9-48a0-bffe-e627df9ac651 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:42.084263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-90d3c7bc-b2ea-4ca5-b045-606dbddd654c req-12a98d5a-28a9-48a0-bffe-e627df9ac651 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:42.108272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8dac4b9a-5531-40f3-9e17-db7360818b69 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:42.115630 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-90d3c7bc-b2ea-4ca5-b045-606dbddd654c req-12a98d5a-28a9-48a0-bffe-e627df9ac651 service nova] Creating event network-changed:96c2e36a-4761-4b9b-b02e-96b42f53d06e for instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe on n-h1-851337-3 Aug 02 07:03:42.119978 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8dac4b9a-5531-40f3-9e17-db7360818b69 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1367 microversion: 2.1 time: 0.253527 Aug 02 07:03:42.120669 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1706/3522] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:41 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:42.124247 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-90d3c7bc-b2ea-4ca5-b045-606dbddd654c req-12a98d5a-28a9-48a0-bffe-e627df9ac651 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065222 Aug 02 07:03:42.125493 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1817/3523] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:03:42.422168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-629d466e-b1eb-456e-95f5-a355e76eccc8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:42.423859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-629d466e-b1eb-456e-95f5-a355e76eccc8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:42.431836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-629d466e-b1eb-456e-95f5-a355e76eccc8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:42.432548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-629d466e-b1eb-456e-95f5-a355e76eccc8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:42.433955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-629d466e-b1eb-456e-95f5-a355e76eccc8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:42.434637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-629d466e-b1eb-456e-95f5-a355e76eccc8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:42.622319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-629d466e-b1eb-456e-95f5-a355e76eccc8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:42.631296 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-629d466e-b1eb-456e-95f5-a355e76eccc8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1364 microversion: 2.1 time: 0.212675 Aug 02 07:03:42.634383 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1707/3524] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:42 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:42.879692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:03:42.889171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e8687ae7-1f41-4b1b-a1b4-210ede085753 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:42.893339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e8687ae7-1f41-4b1b-a1b4-210ede085753 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:42.921412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e8687ae7-1f41-4b1b-a1b4-210ede085753 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:42.926054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e8687ae7-1f41-4b1b-a1b4-210ede085753 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:42.928654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e8687ae7-1f41-4b1b-a1b4-210ede085753 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:42.929878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e8687ae7-1f41-4b1b-a1b4-210ede085753 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:42.930783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d615a7b3-f4d5-442f-8151-785db7cb07f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:42.931727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d615a7b3-f4d5-442f-8151-785db7cb07f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:42.944459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d615a7b3-f4d5-442f-8151-785db7cb07f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:42.945009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d615a7b3-f4d5-442f-8151-785db7cb07f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:42.951824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d615a7b3-f4d5-442f-8151-785db7cb07f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:42.952989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d615a7b3-f4d5-442f-8151-785db7cb07f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:43.179801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=20 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:03:43.372297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d615a7b3-f4d5-442f-8151-785db7cb07f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:43.389751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d615a7b3-f4d5-442f-8151-785db7cb07f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:43.393557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d615a7b3-f4d5-442f-8151-785db7cb07f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:43.396970 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d615a7b3-f4d5-442f-8151-785db7cb07f9 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.470683 Aug 02 07:03:43.401860 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1708/3525] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:42 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:03:43.411581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0ed44530-6f3b-445d-8373-320786b25b70 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:43.416576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e8687ae7-1f41-4b1b-a1b4-210ede085753 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:43.426286 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e8687ae7-1f41-4b1b-a1b4-210ede085753 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.548063 Aug 02 07:03:43.427996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0ed44530-6f3b-445d-8373-320786b25b70 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:43.433360 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1818/3526] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:42 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:43.437375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ed44530-6f3b-445d-8373-320786b25b70 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:43.438214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ed44530-6f3b-445d-8373-320786b25b70 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:43.439636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ed44530-6f3b-445d-8373-320786b25b70 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:43.440306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ed44530-6f3b-445d-8373-320786b25b70 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:43.658387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b6ab26c0-7ed9-44e0-b751-63d45e140e2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:43.659428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b6ab26c0-7ed9-44e0-b751-63d45e140e2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:43.667709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0ed44530-6f3b-445d-8373-320786b25b70 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:43.675904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6ab26c0-7ed9-44e0-b751-63d45e140e2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:43.676425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6ab26c0-7ed9-44e0-b751-63d45e140e2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:43.680401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6ab26c0-7ed9-44e0-b751-63d45e140e2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:43.680852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6ab26c0-7ed9-44e0-b751-63d45e140e2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:43.683110 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0ed44530-6f3b-445d-8373-320786b25b70 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1367 microversion: 2.1 time: 0.279202 Aug 02 07:03:43.683745 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1709/3527] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:43 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:43.960159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-25fa5424-1e6e-4c0f-b671-9db7d5465665 req-3895c355-9291-4216-80e0-39c2b84951ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce30096-300b-4242-b360-ff6617fd5173", "name": "network-vif-plugged", "status": "completed", "tag": "7760230b-6b27-445e-86d1-9b56e50e0517"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:43.972529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b6ab26c0-7ed9-44e0-b751-63d45e140e2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:43.983401 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b6ab26c0-7ed9-44e0-b751-63d45e140e2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1364 microversion: 2.1 time: 0.329533 Aug 02 07:03:43.984591 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1819/3528] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:43 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1364 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:43.986019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-25fa5424-1e6e-4c0f-b671-9db7d5465665 req-3895c355-9291-4216-80e0-39c2b84951ea service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:43.986664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-25fa5424-1e6e-4c0f-b671-9db7d5465665 req-3895c355-9291-4216-80e0-39c2b84951ea service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:44.004850 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-25fa5424-1e6e-4c0f-b671-9db7d5465665 req-3895c355-9291-4216-80e0-39c2b84951ea service nova] Creating event network-vif-plugged:7760230b-6b27-445e-86d1-9b56e50e0517 for instance fce30096-300b-4242-b360-ff6617fd5173 on n-h1-851337-3 Aug 02 07:03:44.011548 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-25fa5424-1e6e-4c0f-b671-9db7d5465665 req-3895c355-9291-4216-80e0-39c2b84951ea service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055496 Aug 02 07:03:44.012565 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1710/3529] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:03:44.426038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1131080e-126e-4361-8803-0f712d0c0a27 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:44.426810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1131080e-126e-4361-8803-0f712d0c0a27 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:44.435446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1131080e-126e-4361-8803-0f712d0c0a27 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:44.436997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1131080e-126e-4361-8803-0f712d0c0a27 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:44.436997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1131080e-126e-4361-8803-0f712d0c0a27 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:44.437941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1131080e-126e-4361-8803-0f712d0c0a27 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:44.451279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4343545b-d559-4148-8e73-3345115c867e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:44.452903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4343545b-d559-4148-8e73-3345115c867e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:44.461259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4343545b-d559-4148-8e73-3345115c867e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:44.462154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4343545b-d559-4148-8e73-3345115c867e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:44.463125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4343545b-d559-4148-8e73-3345115c867e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:44.463745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4343545b-d559-4148-8e73-3345115c867e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:44.841929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1131080e-126e-4361-8803-0f712d0c0a27 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:44.868384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1131080e-126e-4361-8803-0f712d0c0a27 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:44.873465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1131080e-126e-4361-8803-0f712d0c0a27 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:44.875315 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1131080e-126e-4361-8803-0f712d0c0a27 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.454161 Aug 02 07:03:44.883056 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1820/3530] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:44 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:44.894631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f40b5260-21d3-44ac-8d10-b2633d97ea8f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:44.903856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f40b5260-21d3-44ac-8d10-b2633d97ea8f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:44.906480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:03:44.915619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4343545b-d559-4148-8e73-3345115c867e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:44.926026 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4343545b-d559-4148-8e73-3345115c867e tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.481163 Aug 02 07:03:44.930834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f40b5260-21d3-44ac-8d10-b2633d97ea8f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:44.932058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f40b5260-21d3-44ac-8d10-b2633d97ea8f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:44.933485 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1711/3531] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:44 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:44.938891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f40b5260-21d3-44ac-8d10-b2633d97ea8f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:44.940439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f40b5260-21d3-44ac-8d10-b2633d97ea8f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:45.006966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-44996a71-1b3f-419e-922e-5d440fcf2717 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:45.007521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-44996a71-1b3f-419e-922e-5d440fcf2717 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:45.020062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44996a71-1b3f-419e-922e-5d440fcf2717 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:45.020737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44996a71-1b3f-419e-922e-5d440fcf2717 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:45.022593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44996a71-1b3f-419e-922e-5d440fcf2717 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:45.025323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44996a71-1b3f-419e-922e-5d440fcf2717 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:45.221259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f40b5260-21d3-44ac-8d10-b2633d97ea8f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:45.247488 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f40b5260-21d3-44ac-8d10-b2633d97ea8f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1367 microversion: 2.1 time: 0.361192 Aug 02 07:03:45.249027 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1821/3532] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:44 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:45.378104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44996a71-1b3f-419e-922e-5d440fcf2717 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:45.389809 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-44996a71-1b3f-419e-922e-5d440fcf2717 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1364 microversion: 2.1 time: 0.387665 Aug 02 07:03:45.406857 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1712/3533] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:45 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1364 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:45.905312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-64543c84-581e-4d00-b7e7-e9b4d3b26656 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:45.907377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-64543c84-581e-4d00-b7e7-e9b4d3b26656 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:45.920902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64543c84-581e-4d00-b7e7-e9b4d3b26656 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:45.923553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64543c84-581e-4d00-b7e7-e9b4d3b26656 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:45.926272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64543c84-581e-4d00-b7e7-e9b4d3b26656 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:45.931091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64543c84-581e-4d00-b7e7-e9b4d3b26656 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:45.958203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2a0d7945-5916-48b7-be11-5466ececae4b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:45.960307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2a0d7945-5916-48b7-be11-5466ececae4b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:45.987151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a0d7945-5916-48b7-be11-5466ececae4b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:46.001985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a0d7945-5916-48b7-be11-5466ececae4b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:46.003188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a0d7945-5916-48b7-be11-5466ececae4b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:46.003649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a0d7945-5916-48b7-be11-5466ececae4b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:46.381613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2a0d7945-5916-48b7-be11-5466ececae4b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:46.425558 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2a0d7945-5916-48b7-be11-5466ececae4b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.458133 Aug 02 07:03:46.438954 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1713/3534] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:45 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:46.445477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-64543c84-581e-4d00-b7e7-e9b4d3b26656 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:46.447932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:03:46.453763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c9240133-2a89-4652-a424-404e6285da71 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:46.457380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c9240133-2a89-4652-a424-404e6285da71 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:46.458608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-64543c84-581e-4d00-b7e7-e9b4d3b26656 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:46.461091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-64543c84-581e-4d00-b7e7-e9b4d3b26656 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:46.462601 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-64543c84-581e-4d00-b7e7-e9b4d3b26656 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.561396 Aug 02 07:03:46.471856 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1822/3535] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:45 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:46.475952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9240133-2a89-4652-a424-404e6285da71 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:46.476701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9240133-2a89-4652-a424-404e6285da71 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:46.481343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9240133-2a89-4652-a424-404e6285da71 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:46.482059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9240133-2a89-4652-a424-404e6285da71 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:46.483026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d2d4d0fd-f7aa-4371-8010-f3f3abe5f1e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:46.486868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d2d4d0fd-f7aa-4371-8010-f3f3abe5f1e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:46.500594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2d4d0fd-f7aa-4371-8010-f3f3abe5f1e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:46.502343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2d4d0fd-f7aa-4371-8010-f3f3abe5f1e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:46.503559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2d4d0fd-f7aa-4371-8010-f3f3abe5f1e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:46.504203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2d4d0fd-f7aa-4371-8010-f3f3abe5f1e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:46.983594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c9240133-2a89-4652-a424-404e6285da71 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:47.000467 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c9240133-2a89-4652-a424-404e6285da71 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1367 microversion: 2.1 time: 0.556995 Aug 02 07:03:47.002109 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1714/3536] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:46 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1367 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:47.030477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d2d4d0fd-f7aa-4371-8010-f3f3abe5f1e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:47.044801 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d2d4d0fd-f7aa-4371-8010-f3f3abe5f1e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1364 microversion: 2.1 time: 0.571583 Aug 02 07:03:47.054855 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1823/3537] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:46 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1364 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:47.452033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-75918a12-14c8-48cf-8a5b-73d7e2ee9970 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:47.453179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-75918a12-14c8-48cf-8a5b-73d7e2ee9970 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:47.465470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75918a12-14c8-48cf-8a5b-73d7e2ee9970 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:47.476829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75918a12-14c8-48cf-8a5b-73d7e2ee9970 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:47.477989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75918a12-14c8-48cf-8a5b-73d7e2ee9970 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:47.478689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75918a12-14c8-48cf-8a5b-73d7e2ee9970 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:47.488499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab567502-0b58-4b71-ab7c-7a709602bf1a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:47.490328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab567502-0b58-4b71-ab7c-7a709602bf1a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:47.508376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab567502-0b58-4b71-ab7c-7a709602bf1a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:47.508849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab567502-0b58-4b71-ab7c-7a709602bf1a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:47.509686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab567502-0b58-4b71-ab7c-7a709602bf1a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:47.510267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab567502-0b58-4b71-ab7c-7a709602bf1a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:47.976716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab567502-0b58-4b71-ab7c-7a709602bf1a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:47.989540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab567502-0b58-4b71-ab7c-7a709602bf1a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:48.004245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab567502-0b58-4b71-ab7c-7a709602bf1a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:48.006296 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab567502-0b58-4b71-ab7c-7a709602bf1a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.522242 Aug 02 07:03:48.023537 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1824/3538] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:47 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:48.031550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-34b07707-9bd6-4a78-9860-a7850f04dda4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:48.037729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-34b07707-9bd6-4a78-9860-a7850f04dda4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:48.040130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-75918a12-14c8-48cf-8a5b-73d7e2ee9970 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:48.050277 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-75918a12-14c8-48cf-8a5b-73d7e2ee9970 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.602153 Aug 02 07:03:48.051485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34b07707-9bd6-4a78-9860-a7850f04dda4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:48.054790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34b07707-9bd6-4a78-9860-a7850f04dda4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:48.056064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34b07707-9bd6-4a78-9860-a7850f04dda4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:48.060161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34b07707-9bd6-4a78-9860-a7850f04dda4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:48.062748 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1715/3539] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:47 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:48.079391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-191e62d4-2cb3-4ca5-93eb-a1c8089e1ef4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:48.086402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-191e62d4-2cb3-4ca5-93eb-a1c8089e1ef4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:48.093292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-191e62d4-2cb3-4ca5-93eb-a1c8089e1ef4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:48.094247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-191e62d4-2cb3-4ca5-93eb-a1c8089e1ef4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:48.095208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-191e62d4-2cb3-4ca5-93eb-a1c8089e1ef4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:48.095977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-191e62d4-2cb3-4ca5-93eb-a1c8089e1ef4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:48.408461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-34b07707-9bd6-4a78-9860-a7850f04dda4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:48.416290 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-34b07707-9bd6-4a78-9860-a7850f04dda4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1557 microversion: 2.1 time: 0.391279 Aug 02 07:03:48.421543 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1825/3540] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:48 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1557 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:48.448319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5ecd1b0d-7226-47c5-bffe-f8fcc7e87cb5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:48.449216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5ecd1b0d-7226-47c5-bffe-f8fcc7e87cb5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:48.457368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5ecd1b0d-7226-47c5-bffe-f8fcc7e87cb5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:48.459007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5ecd1b0d-7226-47c5-bffe-f8fcc7e87cb5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:48.460538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5ecd1b0d-7226-47c5-bffe-f8fcc7e87cb5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:48.462387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5ecd1b0d-7226-47c5-bffe-f8fcc7e87cb5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:48.614181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-191e62d4-2cb3-4ca5-93eb-a1c8089e1ef4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:48.627455 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-191e62d4-2cb3-4ca5-93eb-a1c8089e1ef4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1364 microversion: 2.1 time: 0.558967 Aug 02 07:03:48.629206 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1716/3541] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:48 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1364 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:48.651847 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5ecd1b0d-7226-47c5-bffe-f8fcc7e87cb5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207628 Aug 02 07:03:48.653672 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1826/3542] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 07:03:48 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:03:49.041152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1d9a91d7-62f7-4f04-9f91-cb4a6bd32514 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:49.042676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1d9a91d7-62f7-4f04-9f91-cb4a6bd32514 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:49.051354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d9a91d7-62f7-4f04-9f91-cb4a6bd32514 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:49.052416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d9a91d7-62f7-4f04-9f91-cb4a6bd32514 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:49.053616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d9a91d7-62f7-4f04-9f91-cb4a6bd32514 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:49.054317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d9a91d7-62f7-4f04-9f91-cb4a6bd32514 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:49.075898 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-768c8d74-a386-4b6a-bef3-4b9a2d3da3cc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:49.076810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-768c8d74-a386-4b6a-bef3-4b9a2d3da3cc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:49.092205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-768c8d74-a386-4b6a-bef3-4b9a2d3da3cc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:49.094756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-768c8d74-a386-4b6a-bef3-4b9a2d3da3cc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:49.096066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-768c8d74-a386-4b6a-bef3-4b9a2d3da3cc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:49.101277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-768c8d74-a386-4b6a-bef3-4b9a2d3da3cc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:49.512174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-768c8d74-a386-4b6a-bef3-4b9a2d3da3cc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:49.529361 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-768c8d74-a386-4b6a-bef3-4b9a2d3da3cc tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.459440 Aug 02 07:03:49.540306 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1827/3543] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:49 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:49.619372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1d9a91d7-62f7-4f04-9f91-cb4a6bd32514 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:49.632117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1d9a91d7-62f7-4f04-9f91-cb4a6bd32514 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:49.643012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1d9a91d7-62f7-4f04-9f91-cb4a6bd32514 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:49.645296 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1d9a91d7-62f7-4f04-9f91-cb4a6bd32514 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.609597 Aug 02 07:03:49.666526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b711898f-6b82-48da-a7d9-5598eee169c2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:49.666526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b711898f-6b82-48da-a7d9-5598eee169c2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:49.667611 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1717/3544] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:49 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:49.673159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b711898f-6b82-48da-a7d9-5598eee169c2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:49.673645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b711898f-6b82-48da-a7d9-5598eee169c2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:49.676448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b711898f-6b82-48da-a7d9-5598eee169c2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:49.676756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b711898f-6b82-48da-a7d9-5598eee169c2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:50.060623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b711898f-6b82-48da-a7d9-5598eee169c2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:50.080135 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b711898f-6b82-48da-a7d9-5598eee169c2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1364 microversion: 2.1 time: 0.427043 Aug 02 07:03:50.081081 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1828/3545] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:49 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1364 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:50.567504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-25bd2397-a0a5-44bc-8d39-098ed97f46ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:50.568316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-25bd2397-a0a5-44bc-8d39-098ed97f46ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:50.572065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=74 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:03:50.579427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25bd2397-a0a5-44bc-8d39-098ed97f46ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:50.580109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25bd2397-a0a5-44bc-8d39-098ed97f46ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:50.581015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25bd2397-a0a5-44bc-8d39-098ed97f46ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:50.581568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25bd2397-a0a5-44bc-8d39-098ed97f46ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:50.677779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d0245da3-3355-46f7-ba01-74c01935fe1f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:50.679250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d0245da3-3355-46f7-ba01-74c01935fe1f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:50.698220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0245da3-3355-46f7-ba01-74c01935fe1f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:50.699164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0245da3-3355-46f7-ba01-74c01935fe1f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:50.700266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0245da3-3355-46f7-ba01-74c01935fe1f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:50.700895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0245da3-3355-46f7-ba01-74c01935fe1f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:51.573358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-25bd2397-a0a5-44bc-8d39-098ed97f46ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:51.585179 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-25bd2397-a0a5-44bc-8d39-098ed97f46ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 1.023088 Aug 02 07:03:51.599162 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1718/3546] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:50 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:51.605006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4e248427-d516-4b17-939a-af488b25fb04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:51.605841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4e248427-d516-4b17-939a-af488b25fb04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:51.621261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e248427-d516-4b17-939a-af488b25fb04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:51.622041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e248427-d516-4b17-939a-af488b25fb04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:51.623047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e248427-d516-4b17-939a-af488b25fb04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:51.623660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e248427-d516-4b17-939a-af488b25fb04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:52.008211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d0245da3-3355-46f7-ba01-74c01935fe1f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:52.037974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d0245da3-3355-46f7-ba01-74c01935fe1f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:52.040880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d0245da3-3355-46f7-ba01-74c01935fe1f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:52.042976 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d0245da3-3355-46f7-ba01-74c01935fe1f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 1.369727 Aug 02 07:03:52.060541 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1829/3547] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:50 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:52.076324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e9c39468-7b77-4cef-9c89-75a727540128 req-8b15a16f-3c78-4fcc-88dc-b6e75045896f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce30096-300b-4242-b360-ff6617fd5173", "tag": "7760230b-6b27-445e-86d1-9b56e50e0517"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:52.118828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e9c39468-7b77-4cef-9c89-75a727540128 req-8b15a16f-3c78-4fcc-88dc-b6e75045896f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:52.120520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e9c39468-7b77-4cef-9c89-75a727540128 req-8b15a16f-3c78-4fcc-88dc-b6e75045896f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:52.151676 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e9c39468-7b77-4cef-9c89-75a727540128 req-8b15a16f-3c78-4fcc-88dc-b6e75045896f service nova] Creating event network-changed:7760230b-6b27-445e-86d1-9b56e50e0517 for instance fce30096-300b-4242-b360-ff6617fd5173 on n-h1-851337-3 Aug 02 07:03:52.167395 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e9c39468-7b77-4cef-9c89-75a727540128 req-8b15a16f-3c78-4fcc-88dc-b6e75045896f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100860 Aug 02 07:03:52.168245 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1830/3548] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:03:52.462750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4e248427-d516-4b17-939a-af488b25fb04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:52.481144 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4e248427-d516-4b17-939a-af488b25fb04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1364 microversion: 2.1 time: 0.879508 Aug 02 07:03:52.482116 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1719/3549] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:51 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1364 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:52.621797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b3a2d67-86b4-4818-b511-008b5533a7bf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:52.622677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4b3a2d67-86b4-4818-b511-008b5533a7bf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:52.635410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b3a2d67-86b4-4818-b511-008b5533a7bf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:52.636198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b3a2d67-86b4-4818-b511-008b5533a7bf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:52.637328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b3a2d67-86b4-4818-b511-008b5533a7bf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:52.639518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b3a2d67-86b4-4818-b511-008b5533a7bf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:52.928002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4b3a2d67-86b4-4818-b511-008b5533a7bf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:52.937439 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4b3a2d67-86b4-4818-b511-008b5533a7bf tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.320191 Aug 02 07:03:52.938844 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1831/3550] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:52 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:53.067412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8158f312-0ec1-4571-a3b8-7d304c820fd8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:53.068374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8158f312-0ec1-4571-a3b8-7d304c820fd8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:53.081831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8158f312-0ec1-4571-a3b8-7d304c820fd8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:53.084937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8158f312-0ec1-4571-a3b8-7d304c820fd8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:53.086072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8158f312-0ec1-4571-a3b8-7d304c820fd8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:53.086563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8158f312-0ec1-4571-a3b8-7d304c820fd8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:53.525696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0de9297a-1c95-4243-b5d5-ccbdd9fb7a53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:53.527018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0de9297a-1c95-4243-b5d5-ccbdd9fb7a53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:53.537247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0de9297a-1c95-4243-b5d5-ccbdd9fb7a53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:53.538118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0de9297a-1c95-4243-b5d5-ccbdd9fb7a53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:53.539280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0de9297a-1c95-4243-b5d5-ccbdd9fb7a53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:53.540270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0de9297a-1c95-4243-b5d5-ccbdd9fb7a53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:53.592186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8158f312-0ec1-4571-a3b8-7d304c820fd8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:53.615355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8158f312-0ec1-4571-a3b8-7d304c820fd8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:53.627538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8158f312-0ec1-4571-a3b8-7d304c820fd8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:53.628712 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8158f312-0ec1-4571-a3b8-7d304c820fd8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.565656 Aug 02 07:03:53.629291 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1720/3551] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:53 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:53.906290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0de9297a-1c95-4243-b5d5-ccbdd9fb7a53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:53.916868 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0de9297a-1c95-4243-b5d5-ccbdd9fb7a53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1364 microversion: 2.1 time: 0.396943 Aug 02 07:03:53.920857 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1832/3552] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:53 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1364 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:53.964085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3572d077-ca65-4d1d-9049-82ddd7ee9b46 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:53.964985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3572d077-ca65-4d1d-9049-82ddd7ee9b46 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:53.986508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3572d077-ca65-4d1d-9049-82ddd7ee9b46 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:53.987368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3572d077-ca65-4d1d-9049-82ddd7ee9b46 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:53.988391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3572d077-ca65-4d1d-9049-82ddd7ee9b46 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:53.989620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3572d077-ca65-4d1d-9049-82ddd7ee9b46 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:54.226127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3572d077-ca65-4d1d-9049-82ddd7ee9b46 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:54.236017 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3572d077-ca65-4d1d-9049-82ddd7ee9b46 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.275818 Aug 02 07:03:54.237292 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1721/3553] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:53 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:54.319958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-d6ec6612-805e-4626-a4dd-1975db91e587 req-6cc67b9e-508a-4833-8b09-5fb0e9700cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13dab9a5-60b6-46c3-8f27-6b9ea00e10a4", "name": "network-vif-unplugged", "status": "completed", "tag": "554c704f-d680-42da-86e3-dd789c192bd1"}, {"name": "network-changed", "server_uuid": "13dab9a5-60b6-46c3-8f27-6b9ea00e10a4", "tag": "554c704f-d680-42da-86e3-dd789c192bd1"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:54.339421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d6ec6612-805e-4626-a4dd-1975db91e587 req-6cc67b9e-508a-4833-8b09-5fb0e9700cd0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:54.341614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d6ec6612-805e-4626-a4dd-1975db91e587 req-6cc67b9e-508a-4833-8b09-5fb0e9700cd0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:54.355492 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-d6ec6612-805e-4626-a4dd-1975db91e587 req-6cc67b9e-508a-4833-8b09-5fb0e9700cd0 service nova] Creating event network-vif-unplugged:554c704f-d680-42da-86e3-dd789c192bd1 for instance 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 on n-h1-851337-3 Aug 02 07:03:54.356422 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-d6ec6612-805e-4626-a4dd-1975db91e587 req-6cc67b9e-508a-4833-8b09-5fb0e9700cd0 service nova] Creating event network-changed:554c704f-d680-42da-86e3-dd789c192bd1 for instance 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 on n-h1-851337-3 Aug 02 07:03:54.364933 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-d6ec6612-805e-4626-a4dd-1975db91e587 req-6cc67b9e-508a-4833-8b09-5fb0e9700cd0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.050273 Aug 02 07:03:54.370276 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1833/3554] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:03:54.396470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-6a6b8c0a-a6d9-439a-9fa3-90a2eb5c5f09 req-defc2ac7-ce55-4e6f-93f9-7f19c88ad6ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ccfed8-393e-4223-b2a8-7dbf8c77d3fe", "name": "network-vif-plugged", "status": "completed", "tag": "96c2e36a-4761-4b9b-b02e-96b42f53d06e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:54.411263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6a6b8c0a-a6d9-439a-9fa3-90a2eb5c5f09 req-defc2ac7-ce55-4e6f-93f9-7f19c88ad6ce service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:54.411831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6a6b8c0a-a6d9-439a-9fa3-90a2eb5c5f09 req-defc2ac7-ce55-4e6f-93f9-7f19c88ad6ce service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:54.426988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:03:54.429592 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-6a6b8c0a-a6d9-439a-9fa3-90a2eb5c5f09 req-defc2ac7-ce55-4e6f-93f9-7f19c88ad6ce service nova] Creating event network-vif-plugged:96c2e36a-4761-4b9b-b02e-96b42f53d06e for instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe on n-h1-851337-3 Aug 02 07:03:54.435213 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-6a6b8c0a-a6d9-439a-9fa3-90a2eb5c5f09 req-defc2ac7-ce55-4e6f-93f9-7f19c88ad6ce service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047630 Aug 02 07:03:54.436937 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1722/3555] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:03:54.660323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-002b1267-4ee9-4720-b1d5-142a91d2653e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:54.661161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-002b1267-4ee9-4720-b1d5-142a91d2653e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:54.672140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-002b1267-4ee9-4720-b1d5-142a91d2653e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:54.672968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-002b1267-4ee9-4720-b1d5-142a91d2653e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:54.675010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-002b1267-4ee9-4720-b1d5-142a91d2653e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:54.677258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-002b1267-4ee9-4720-b1d5-142a91d2653e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:54.941580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-af72d9a2-ee8e-4527-9995-85ccc6141d34 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:54.945738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-af72d9a2-ee8e-4527-9995-85ccc6141d34 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:54.967388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af72d9a2-ee8e-4527-9995-85ccc6141d34 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:54.972711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af72d9a2-ee8e-4527-9995-85ccc6141d34 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:54.975749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af72d9a2-ee8e-4527-9995-85ccc6141d34 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:54.976818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af72d9a2-ee8e-4527-9995-85ccc6141d34 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:55.023110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-002b1267-4ee9-4720-b1d5-142a91d2653e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:55.039713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-002b1267-4ee9-4720-b1d5-142a91d2653e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:55.041231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-002b1267-4ee9-4720-b1d5-142a91d2653e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:55.043232 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-002b1267-4ee9-4720-b1d5-142a91d2653e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.388712 Aug 02 07:03:55.046657 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1834/3556] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:54 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:55.277977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-91c05f66-1f3f-445b-8e79-4b12ca2f64d4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:55.278969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-91c05f66-1f3f-445b-8e79-4b12ca2f64d4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:55.300103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91c05f66-1f3f-445b-8e79-4b12ca2f64d4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:55.300629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91c05f66-1f3f-445b-8e79-4b12ca2f64d4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:55.301336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91c05f66-1f3f-445b-8e79-4b12ca2f64d4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:55.301774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91c05f66-1f3f-445b-8e79-4b12ca2f64d4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:55.388915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-af72d9a2-ee8e-4527-9995-85ccc6141d34 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:55.397454 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-af72d9a2-ee8e-4527-9995-85ccc6141d34 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1364 microversion: 2.1 time: 0.460231 Aug 02 07:03:55.401117 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1723/3557] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:54 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1364 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:55.770121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-91c05f66-1f3f-445b-8e79-4b12ca2f64d4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:55.781378 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-91c05f66-1f3f-445b-8e79-4b12ca2f64d4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.507427 Aug 02 07:03:55.781989 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1835/3558] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:55 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:56.076820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c41e7f53-7106-482a-a4c5-4f8fd8955d2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:56.077755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c41e7f53-7106-482a-a4c5-4f8fd8955d2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:56.094847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c41e7f53-7106-482a-a4c5-4f8fd8955d2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:56.095812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c41e7f53-7106-482a-a4c5-4f8fd8955d2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:56.097353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c41e7f53-7106-482a-a4c5-4f8fd8955d2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:56.097993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c41e7f53-7106-482a-a4c5-4f8fd8955d2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:56.375265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c41e7f53-7106-482a-a4c5-4f8fd8955d2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:56.399878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c41e7f53-7106-482a-a4c5-4f8fd8955d2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:56.402019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c41e7f53-7106-482a-a4c5-4f8fd8955d2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:56.403836 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c41e7f53-7106-482a-a4c5-4f8fd8955d2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.332432 Aug 02 07:03:56.421421 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1724/3559] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:56 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:56.432021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c892a738-82b0-42dc-927b-7bad53f2e037 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:56.432678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c892a738-82b0-42dc-927b-7bad53f2e037 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:56.440496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c892a738-82b0-42dc-927b-7bad53f2e037 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:56.441065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c892a738-82b0-42dc-927b-7bad53f2e037 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:56.442186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c892a738-82b0-42dc-927b-7bad53f2e037 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:56.442875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c892a738-82b0-42dc-927b-7bad53f2e037 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:56.539225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-726f55d7-11d9-4a7f-90a2-27acfe40fa91 req-014c328b-93d0-4277-892c-7c15b7d8a00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-plugged", "status": "completed", "tag": "d122ff1d-37ba-4ca8-88b0-aa8e965f6c3f"}, {"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-plugged", "status": "completed", "tag": "5b383fff-f64d-4758-98fb-152834840541"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:56.551221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-726f55d7-11d9-4a7f-90a2-27acfe40fa91 req-014c328b-93d0-4277-892c-7c15b7d8a00e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:56.552173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-726f55d7-11d9-4a7f-90a2-27acfe40fa91 req-014c328b-93d0-4277-892c-7c15b7d8a00e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:56.568099 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-726f55d7-11d9-4a7f-90a2-27acfe40fa91 req-014c328b-93d0-4277-892c-7c15b7d8a00e service nova] Creating event network-vif-plugged:d122ff1d-37ba-4ca8-88b0-aa8e965f6c3f for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:03:56.569107 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-726f55d7-11d9-4a7f-90a2-27acfe40fa91 req-014c328b-93d0-4277-892c-7c15b7d8a00e service nova] Creating event network-vif-plugged:5b383fff-f64d-4758-98fb-152834840541 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:03:56.579279 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-726f55d7-11d9-4a7f-90a2-27acfe40fa91 req-014c328b-93d0-4277-892c-7c15b7d8a00e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043063 Aug 02 07:03:56.581732 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1725/3560] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:03:56.657925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c892a738-82b0-42dc-927b-7bad53f2e037 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:56.669393 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c892a738-82b0-42dc-927b-7bad53f2e037 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1364 microversion: 2.1 time: 0.243698 Aug 02 07:03:56.682540 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1836/3561] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:56 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:56.804992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-14c5fe4e-42ee-4ff2-9875-c456d1cb7b57 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:56.805710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-14c5fe4e-42ee-4ff2-9875-c456d1cb7b57 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:56.816293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14c5fe4e-42ee-4ff2-9875-c456d1cb7b57 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:56.816921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14c5fe4e-42ee-4ff2-9875-c456d1cb7b57 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:56.817914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14c5fe4e-42ee-4ff2-9875-c456d1cb7b57 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:56.818359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14c5fe4e-42ee-4ff2-9875-c456d1cb7b57 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:56.995071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-14c5fe4e-42ee-4ff2-9875-c456d1cb7b57 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:57.033024 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-14c5fe4e-42ee-4ff2-9875-c456d1cb7b57 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.233269 Aug 02 07:03:57.036993 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1726/3562] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:56 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:03:57.441692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bdadab2a-801f-4ca9-b8a1-c470e1fc7317 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:57.444018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bdadab2a-801f-4ca9-b8a1-c470e1fc7317 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:57.481770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdadab2a-801f-4ca9-b8a1-c470e1fc7317 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:57.484166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdadab2a-801f-4ca9-b8a1-c470e1fc7317 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:57.487014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdadab2a-801f-4ca9-b8a1-c470e1fc7317 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:57.488933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdadab2a-801f-4ca9-b8a1-c470e1fc7317 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:57.691427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fb29da3c-b730-4460-8400-aae2a847198d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:57.692865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fb29da3c-b730-4460-8400-aae2a847198d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:57.704650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb29da3c-b730-4460-8400-aae2a847198d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:57.711984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb29da3c-b730-4460-8400-aae2a847198d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:57.712991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb29da3c-b730-4460-8400-aae2a847198d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:57.713437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb29da3c-b730-4460-8400-aae2a847198d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:57.920046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bdadab2a-801f-4ca9-b8a1-c470e1fc7317 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:57.933924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bdadab2a-801f-4ca9-b8a1-c470e1fc7317 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:57.940563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bdadab2a-801f-4ca9-b8a1-c470e1fc7317 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:57.944501 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bdadab2a-801f-4ca9-b8a1-c470e1fc7317 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.510679 Aug 02 07:03:57.948429 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1837/3563] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:57 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:03:58.036507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fb29da3c-b730-4460-8400-aae2a847198d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:58.046832 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fb29da3c-b730-4460-8400-aae2a847198d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1551 microversion: 2.1 time: 0.359270 Aug 02 07:03:58.047759 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1727/3564] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:57 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1551 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:58.055449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-731c2f83-a136-4283-8259-120738533165 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:58.056367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-731c2f83-a136-4283-8259-120738533165 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:58.067843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-731c2f83-a136-4283-8259-120738533165 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:58.068735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4cbf9ad5-2dae-4d60-9d30-3e1e883b057f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:58.068920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-731c2f83-a136-4283-8259-120738533165 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:58.069629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4cbf9ad5-2dae-4d60-9d30-3e1e883b057f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:58.069772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-731c2f83-a136-4283-8259-120738533165 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:58.071426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-731c2f83-a136-4283-8259-120738533165 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:58.077006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cbf9ad5-2dae-4d60-9d30-3e1e883b057f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:58.077823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cbf9ad5-2dae-4d60-9d30-3e1e883b057f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:58.079023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cbf9ad5-2dae-4d60-9d30-3e1e883b057f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:58.079690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4cbf9ad5-2dae-4d60-9d30-3e1e883b057f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:58.284979 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4cbf9ad5-2dae-4d60-9d30-3e1e883b057f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.220224 Aug 02 07:03:58.285835 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1728/3565] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 07:03:58 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:03:58.337583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-731c2f83-a136-4283-8259-120738533165 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:58.341241 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-731c2f83-a136-4283-8259-120738533165 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.290106 Aug 02 07:03:58.356889 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1838/3566] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:58 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:03:58.889114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-605362516", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": "none"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:58.988940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd4eb24f-98d5-4de1-bcb4-7516e2c8b395 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:58.991412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dd4eb24f-98d5-4de1-bcb4-7516e2c8b395 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:59.015797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd4eb24f-98d5-4de1-bcb4-7516e2c8b395 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:59.016837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd4eb24f-98d5-4de1-bcb4-7516e2c8b395 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:59.018375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd4eb24f-98d5-4de1-bcb4-7516e2c8b395 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:59.019000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd4eb24f-98d5-4de1-bcb4-7516e2c8b395 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:59.049072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:03:59.050314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:03:59.059023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:03:59.060431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:03:59.061048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:03:59.128776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:59.135590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:59.144421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:59.154534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:59.252618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Getting quotas for project 1d9384342b424d41a9289e91af0cbf6b. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:03:59.282149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Getting quotas for user a2974660fe394b5e851250d9756f4eaf and project 1d9384342b424d41a9289e91af0cbf6b. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:03:59.329205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:03:59.352716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:03:59.451716 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8a70d393-bfc9-495f-a518-1fbfedc26475 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.837817 Aug 02 07:03:59.505160 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1729/3567] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 07:03:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 07:03:59.529704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a79b4305-129a-4494-ae42-e237b79bf3da req-6fe26ed1-1399-4c48-9ea5-87ae452b2672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-plugged", "status": "completed", "tag": "c6a0f893-e351-45b7-8c0a-475bf3575808"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:03:59.569782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a79b4305-129a-4494-ae42-e237b79bf3da req-6fe26ed1-1399-4c48-9ea5-87ae452b2672 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:59.574392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a79b4305-129a-4494-ae42-e237b79bf3da req-6fe26ed1-1399-4c48-9ea5-87ae452b2672 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:59.583172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dd4eb24f-98d5-4de1-bcb4-7516e2c8b395 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:59.599830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dd4eb24f-98d5-4de1-bcb4-7516e2c8b395 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:59.603533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dd4eb24f-98d5-4de1-bcb4-7516e2c8b395 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:03:59.606022 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a79b4305-129a-4494-ae42-e237b79bf3da req-6fe26ed1-1399-4c48-9ea5-87ae452b2672 service nova] Creating event network-vif-plugged:c6a0f893-e351-45b7-8c0a-475bf3575808 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:03:59.608019 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dd4eb24f-98d5-4de1-bcb4-7516e2c8b395 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.632433 Aug 02 07:03:59.610021 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1839/3568] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:58 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:03:59.616753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-764e748c-b0fd-4f71-97f6-f29517b03c13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:59.623111 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a79b4305-129a-4494-ae42-e237b79bf3da req-6fe26ed1-1399-4c48-9ea5-87ae452b2672 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112383 Aug 02 07:03:59.623348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-764e748c-b0fd-4f71-97f6-f29517b03c13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:03:59.626213 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1730/3569] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:03:59.638018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-764e748c-b0fd-4f71-97f6-f29517b03c13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:59.638770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-764e748c-b0fd-4f71-97f6-f29517b03c13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:59.639880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-764e748c-b0fd-4f71-97f6-f29517b03c13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:03:59.640339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-764e748c-b0fd-4f71-97f6-f29517b03c13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:03:59.666688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-da4a65d3-1e96-41b5-b47b-acda79839e83 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:03:59.667852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-da4a65d3-1e96-41b5-b47b-acda79839e83 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:00.082309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-da4a65d3-1e96-41b5-b47b-acda79839e83 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:00.094139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-da4a65d3-1e96-41b5-b47b-acda79839e83 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:00.102225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-da4a65d3-1e96-41b5-b47b-acda79839e83 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:00.103739 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-da4a65d3-1e96-41b5-b47b-acda79839e83 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb" status: 200 len: 1277 microversion: 2.47 time: 0.472460 Aug 02 07:04:00.107048 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1731/3570] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:03:59 2022] GET /compute/v2.1/servers/be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb => generated 1277 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:00.242319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-764e748c-b0fd-4f71-97f6-f29517b03c13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:00.270154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1497393695", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": "none"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:00.281070 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-764e748c-b0fd-4f71-97f6-f29517b03c13 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.665267 Aug 02 07:04:00.292299 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1840/3571] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:03:59 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:00.438025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:04:00.441016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:04:00.442907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:04:00.443269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:04:00.443713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:04:00.502449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:00.504790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:00.510043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:00.511614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:00.573619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Getting quotas for project 1d9384342b424d41a9289e91af0cbf6b. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:04:00.617401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Getting quotas for user a2974660fe394b5e851250d9756f4eaf and project 1d9384342b424d41a9289e91af0cbf6b. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:04:00.639040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-59adfdbd-79b4-4d1f-84a2-b6ccf1fdabff tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:00.644112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-59adfdbd-79b4-4d1f-84a2-b6ccf1fdabff tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:00.668544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:04:00.677736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:04:00.683881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-59adfdbd-79b4-4d1f-84a2-b6ccf1fdabff tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:00.686060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-59adfdbd-79b4-4d1f-84a2-b6ccf1fdabff tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:00.701243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-59adfdbd-79b4-4d1f-84a2-b6ccf1fdabff tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:00.701832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-59adfdbd-79b4-4d1f-84a2-b6ccf1fdabff tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:00.721458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:00.810692 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ae81ae6c-5f5e-4dab-aaef-d4f546498d58 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.545828 Aug 02 07:04:00.812866 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1732/3572] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 07:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 07:04:00.835791 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fe1c6b20-5f4f-4875-8e54-5f86b1764830 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:00.838295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fe1c6b20-5f4f-4875-8e54-5f86b1764830 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:01.023240 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fe1c6b20-5f4f-4875-8e54-5f86b1764830 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "PUT /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 992 microversion: 2.47 time: 0.194597 Aug 02 07:04:01.050003 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1733/3573] 10.222.0.79 () {62 vars in 1297 bytes} [Tue Aug 2 07:04:00 2022] PUT /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 992 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:04:01.074370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3d2bbcd1-31a7-4749-855f-38b7632f69f4 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:01.075042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3d2bbcd1-31a7-4749-855f-38b7632f69f4 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:01.486963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3d2bbcd1-31a7-4749-855f-38b7632f69f4 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:01.500708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3d2bbcd1-31a7-4749-855f-38b7632f69f4 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:01.510704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3d2bbcd1-31a7-4749-855f-38b7632f69f4 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:01.513001 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3d2bbcd1-31a7-4749-855f-38b7632f69f4 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1278 microversion: 2.47 time: 0.461869 Aug 02 07:04:01.513626 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1734/3574] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:01 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1278 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:01.525066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-523391a2-0842-4a04-855f-904d0726d533 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:01.527039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-523391a2-0842-4a04-855f-904d0726d533 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:01.561844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-523391a2-0842-4a04-855f-904d0726d533 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:01.562501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-523391a2-0842-4a04-855f-904d0726d533 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:01.566615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-523391a2-0842-4a04-855f-904d0726d533 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:01.567366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-523391a2-0842-4a04-855f-904d0726d533 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:01.631603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-59adfdbd-79b4-4d1f-84a2-b6ccf1fdabff tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:01.648834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-59adfdbd-79b4-4d1f-84a2-b6ccf1fdabff tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:01.650765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-59adfdbd-79b4-4d1f-84a2-b6ccf1fdabff tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:01.661468 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-59adfdbd-79b4-4d1f-84a2-b6ccf1fdabff tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 1.029120 Aug 02 07:04:01.667932 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1841/3575] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:00 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:01.675904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7443f070-18da-4ab7-b8b1-3894641ae678 req-0346624d-9331-49de-bd18-bfe7b1470b19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ccfed8-393e-4223-b2a8-7dbf8c77d3fe", "tag": "96c2e36a-4761-4b9b-b02e-96b42f53d06e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:01.709765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7443f070-18da-4ab7-b8b1-3894641ae678 req-0346624d-9331-49de-bd18-bfe7b1470b19 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:01.710775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7443f070-18da-4ab7-b8b1-3894641ae678 req-0346624d-9331-49de-bd18-bfe7b1470b19 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:01.726642 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7443f070-18da-4ab7-b8b1-3894641ae678 req-0346624d-9331-49de-bd18-bfe7b1470b19 service nova] Creating event network-changed:96c2e36a-4761-4b9b-b02e-96b42f53d06e for instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe on n-h1-851337-3 Aug 02 07:04:01.734774 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7443f070-18da-4ab7-b8b1-3894641ae678 req-0346624d-9331-49de-bd18-bfe7b1470b19 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064222 Aug 02 07:04:01.735738 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1842/3576] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:04:01.744429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b26b3f8b-5041-4114-9278-80e5352a1c6e req-4b6fb940-12fe-4bfa-a1f6-23e6d0296bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-plugged", "status": "completed", "tag": "2136bfef-3765-4057-a98e-e66dd94110e0"}, {"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-plugged", "status": "completed", "tag": "1523988e-eb3f-4088-a913-e069e59a9e1b"}, {"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-plugged", "status": "completed", "tag": "861a1e1b-6d90-469d-92c9-1b3e761b3246"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:01.759233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b26b3f8b-5041-4114-9278-80e5352a1c6e req-4b6fb940-12fe-4bfa-a1f6-23e6d0296bf5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:01.760039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b26b3f8b-5041-4114-9278-80e5352a1c6e req-4b6fb940-12fe-4bfa-a1f6-23e6d0296bf5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:01.812621 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b26b3f8b-5041-4114-9278-80e5352a1c6e req-4b6fb940-12fe-4bfa-a1f6-23e6d0296bf5 service nova] Creating event network-vif-plugged:2136bfef-3765-4057-a98e-e66dd94110e0 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:04:01.820705 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b26b3f8b-5041-4114-9278-80e5352a1c6e req-4b6fb940-12fe-4bfa-a1f6-23e6d0296bf5 service nova] Creating event network-vif-plugged:1523988e-eb3f-4088-a913-e069e59a9e1b for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:04:01.821662 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b26b3f8b-5041-4114-9278-80e5352a1c6e req-4b6fb940-12fe-4bfa-a1f6-23e6d0296bf5 service nova] Creating event network-vif-plugged:861a1e1b-6d90-469d-92c9-1b3e761b3246 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:04:01.854807 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b26b3f8b-5041-4114-9278-80e5352a1c6e req-4b6fb940-12fe-4bfa-a1f6-23e6d0296bf5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.106808 Aug 02 07:04:01.859560 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1843/3577] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:04:01.971126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-523391a2-0842-4a04-855f-904d0726d533 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:01.995265 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-523391a2-0842-4a04-855f-904d0726d533 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.480431 Aug 02 07:04:01.995873 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1735/3578] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:01 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:02.563977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-113d3b45-72f3-43eb-b8cf-f0c40de19887 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:02.568159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-113d3b45-72f3-43eb-b8cf-f0c40de19887 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:02.581711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-113d3b45-72f3-43eb-b8cf-f0c40de19887 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:02.582350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-113d3b45-72f3-43eb-b8cf-f0c40de19887 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:02.586577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-113d3b45-72f3-43eb-b8cf-f0c40de19887 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:02.590856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-113d3b45-72f3-43eb-b8cf-f0c40de19887 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:02.699859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-564738b2-a3fc-45a2-84fd-9ed7901dc845 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:02.701243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-564738b2-a3fc-45a2-84fd-9ed7901dc845 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:02.709093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-564738b2-a3fc-45a2-84fd-9ed7901dc845 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:02.709656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-564738b2-a3fc-45a2-84fd-9ed7901dc845 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:02.723235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-564738b2-a3fc-45a2-84fd-9ed7901dc845 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:02.732582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-564738b2-a3fc-45a2-84fd-9ed7901dc845 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:02.768625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-113d3b45-72f3-43eb-b8cf-f0c40de19887 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:02.788729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-113d3b45-72f3-43eb-b8cf-f0c40de19887 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:02.796260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-113d3b45-72f3-43eb-b8cf-f0c40de19887 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:02.801690 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-113d3b45-72f3-43eb-b8cf-f0c40de19887 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1330 microversion: 2.47 time: 0.239673 Aug 02 07:04:02.803161 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1844/3579] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:02 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1330 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:04:03.017310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-77bc789b-2d34-4437-8028-d6180c8ba7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:03.022489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-77bc789b-2d34-4437-8028-d6180c8ba7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:03.032356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77bc789b-2d34-4437-8028-d6180c8ba7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:03.033755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77bc789b-2d34-4437-8028-d6180c8ba7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:03.034882 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77bc789b-2d34-4437-8028-d6180c8ba7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:03.035547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77bc789b-2d34-4437-8028-d6180c8ba7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:03.486456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-564738b2-a3fc-45a2-84fd-9ed7901dc845 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:03.502579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-564738b2-a3fc-45a2-84fd-9ed7901dc845 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:03.505117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-564738b2-a3fc-45a2-84fd-9ed7901dc845 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:03.507865 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-564738b2-a3fc-45a2-84fd-9ed7901dc845 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.812726 Aug 02 07:04:03.512017 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1736/3580] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:02 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:04:03.569207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-77bc789b-2d34-4437-8028-d6180c8ba7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:03.586936 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-77bc789b-2d34-4437-8028-d6180c8ba7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.569426 Aug 02 07:04:03.605649 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1845/3581] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:03 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:03.863751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-44bed3bd-dbee-4b64-a212-0ba3490e1442 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:03.864416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-44bed3bd-dbee-4b64-a212-0ba3490e1442 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:03.874675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44bed3bd-dbee-4b64-a212-0ba3490e1442 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:03.874919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44bed3bd-dbee-4b64-a212-0ba3490e1442 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:03.875692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44bed3bd-dbee-4b64-a212-0ba3490e1442 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:03.876121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44bed3bd-dbee-4b64-a212-0ba3490e1442 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:03.980005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-1cf2da11-04db-4878-906d-2a0dbaa4e447 req-73e8c38a-9d2d-4e5c-92dc-74a4abae5c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-plugged", "status": "completed", "tag": "20905df0-f84b-4e3e-8164-bd1311888332"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:03.995423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-1cf2da11-04db-4878-906d-2a0dbaa4e447 req-73e8c38a-9d2d-4e5c-92dc-74a4abae5c99 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:03.996201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-1cf2da11-04db-4878-906d-2a0dbaa4e447 req-73e8c38a-9d2d-4e5c-92dc-74a4abae5c99 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:04.028726 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-1cf2da11-04db-4878-906d-2a0dbaa4e447 req-73e8c38a-9d2d-4e5c-92dc-74a4abae5c99 service nova] Creating event network-vif-plugged:20905df0-f84b-4e3e-8164-bd1311888332 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:04:04.034974 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-1cf2da11-04db-4878-906d-2a0dbaa4e447 req-73e8c38a-9d2d-4e5c-92dc-74a4abae5c99 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061245 Aug 02 07:04:04.036149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44bed3bd-dbee-4b64-a212-0ba3490e1442 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:04.038526 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1846/3582] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:04:04.047487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44bed3bd-dbee-4b64-a212-0ba3490e1442 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:04.049225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44bed3bd-dbee-4b64-a212-0ba3490e1442 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:04.051281 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-44bed3bd-dbee-4b64-a212-0ba3490e1442 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1336 microversion: 2.47 time: 0.203231 Aug 02 07:04:04.052736 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1737/3583] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:03 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1336 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:04.567715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-16399ca7-08dc-45f3-9a6d-a2d5fb886455 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:04.568420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-16399ca7-08dc-45f3-9a6d-a2d5fb886455 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:04.577263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16399ca7-08dc-45f3-9a6d-a2d5fb886455 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:04.577712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16399ca7-08dc-45f3-9a6d-a2d5fb886455 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:04.578522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16399ca7-08dc-45f3-9a6d-a2d5fb886455 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:04.578958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16399ca7-08dc-45f3-9a6d-a2d5fb886455 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:04.613538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-93b05359-8a43-4467-974d-b9a00b56024a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:04.615315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-93b05359-8a43-4467-974d-b9a00b56024a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:04.636826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93b05359-8a43-4467-974d-b9a00b56024a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:04.639920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93b05359-8a43-4467-974d-b9a00b56024a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:04.650497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93b05359-8a43-4467-974d-b9a00b56024a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:04.650497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93b05359-8a43-4467-974d-b9a00b56024a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:05.119251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-16399ca7-08dc-45f3-9a6d-a2d5fb886455 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:05.132347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-16399ca7-08dc-45f3-9a6d-a2d5fb886455 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:05.135230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-16399ca7-08dc-45f3-9a6d-a2d5fb886455 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:05.136720 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-16399ca7-08dc-45f3-9a6d-a2d5fb886455 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.573664 Aug 02 07:04:05.137587 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1847/3584] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:04 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:04:05.151096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-93b05359-8a43-4467-974d-b9a00b56024a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:05.164068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-30726b9f-8131-4f79-bf15-a05df95ab63c tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:05.164718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-30726b9f-8131-4f79-bf15-a05df95ab63c tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:05.169748 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-93b05359-8a43-4467-974d-b9a00b56024a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1390 microversion: 2.1 time: 0.560065 Aug 02 07:04:05.171223 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1738/3585] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:04 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1390 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:04:05.181376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30726b9f-8131-4f79-bf15-a05df95ab63c tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:05.182300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30726b9f-8131-4f79-bf15-a05df95ab63c tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:05.185054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30726b9f-8131-4f79-bf15-a05df95ab63c tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:05.186412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30726b9f-8131-4f79-bf15-a05df95ab63c tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:05.340803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-30726b9f-8131-4f79-bf15-a05df95ab63c tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:05.351898 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-30726b9f-8131-4f79-bf15-a05df95ab63c tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:05.357301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-30726b9f-8131-4f79-bf15-a05df95ab63c tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:05.358715 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-30726b9f-8131-4f79-bf15-a05df95ab63c tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1336 microversion: 2.47 time: 0.219780 Aug 02 07:04:05.359894 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1848/3586] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:05 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1336 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:06.166944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-55663e11-e4f6-4cf9-8628-06b87715967e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:06.167571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-55663e11-e4f6-4cf9-8628-06b87715967e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:06.182720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55663e11-e4f6-4cf9-8628-06b87715967e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:06.183487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55663e11-e4f6-4cf9-8628-06b87715967e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:06.184501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55663e11-e4f6-4cf9-8628-06b87715967e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:06.185515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55663e11-e4f6-4cf9-8628-06b87715967e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:06.192527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c7a386f8-8bfa-4393-945f-be91c864057b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:06.193281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c7a386f8-8bfa-4393-945f-be91c864057b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:06.213319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c7a386f8-8bfa-4393-945f-be91c864057b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:06.213918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c7a386f8-8bfa-4393-945f-be91c864057b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:06.215780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c7a386f8-8bfa-4393-945f-be91c864057b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:06.216201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c7a386f8-8bfa-4393-945f-be91c864057b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:06.626962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-55663e11-e4f6-4cf9-8628-06b87715967e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:06.641239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-55663e11-e4f6-4cf9-8628-06b87715967e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:06.643096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-55663e11-e4f6-4cf9-8628-06b87715967e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:06.644431 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-55663e11-e4f6-4cf9-8628-06b87715967e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1879 microversion: 2.42 time: 0.482126 Aug 02 07:04:06.651137 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1739/3587] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:06 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1879 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:06.656511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-acf2c7d9-e10a-4906-a3f2-fabeb56460d6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:06.658252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-acf2c7d9-e10a-4906-a3f2-fabeb56460d6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:06.665679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-acf2c7d9-e10a-4906-a3f2-fabeb56460d6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:06.666767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-acf2c7d9-e10a-4906-a3f2-fabeb56460d6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:06.667625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c7a386f8-8bfa-4393-945f-be91c864057b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:06.668153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-acf2c7d9-e10a-4906-a3f2-fabeb56460d6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:06.668898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-acf2c7d9-e10a-4906-a3f2-fabeb56460d6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:06.680619 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c7a386f8-8bfa-4393-945f-be91c864057b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1380 microversion: 2.1 time: 0.492277 Aug 02 07:04:06.694784 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1849/3588] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:06 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1380 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:04:06.705348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4707be75-92cf-4c48-8fd5-f7717f0dba1f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '.version_select at 0x7f927a8395e0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:06.710978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4707be75-92cf-4c48-8fd5-f7717f0dba1f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:06.711830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4707be75-92cf-4c48-8fd5-f7717f0dba1f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:06.744226 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4707be75-92cf-4c48-8fd5-f7717f0dba1f tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.044850 Aug 02 07:04:06.746174 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1850/3589] 10.222.0.79 () {58 vars in 1143 bytes} [Tue Aug 2 07:04:06 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:04:06.761966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5b362791-f10d-461d-b697-e0f94005ad05 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:06.762875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5b362791-f10d-461d-b697-e0f94005ad05 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:06.771018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b362791-f10d-461d-b697-e0f94005ad05 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:06.771798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b362791-f10d-461d-b697-e0f94005ad05 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:06.772816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b362791-f10d-461d-b697-e0f94005ad05 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:06.773466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b362791-f10d-461d-b697-e0f94005ad05 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:06.834570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-acf2c7d9-e10a-4906-a3f2-fabeb56460d6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:06.853302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-acf2c7d9-e10a-4906-a3f2-fabeb56460d6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:06.854818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-acf2c7d9-e10a-4906-a3f2-fabeb56460d6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:06.856600 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-acf2c7d9-e10a-4906-a3f2-fabeb56460d6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1336 microversion: 2.47 time: 0.204045 Aug 02 07:04:06.871655 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1740/3590] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:06 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1336 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:07.012817 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5b362791-f10d-461d-b697-e0f94005ad05 tempest-LiveMigrationTest-623543338 tempest-LiveMigrationTest-623543338-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1531 microversion: 2.1 time: 0.254639 Aug 02 07:04:07.013426 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1851/3591] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:06 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1531 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:07.060694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1bbbbcc5-86a6-42fb-9bc2-ba2c1e6a93ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:07.061204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1bbbbcc5-86a6-42fb-9bc2-ba2c1e6a93ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:07.067836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1bbbbcc5-86a6-42fb-9bc2-ba2c1e6a93ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:07.068280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1bbbbcc5-86a6-42fb-9bc2-ba2c1e6a93ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:07.069059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1bbbbcc5-86a6-42fb-9bc2-ba2c1e6a93ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:07.069657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1bbbbcc5-86a6-42fb-9bc2-ba2c1e6a93ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:07.101516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1bbbbcc5-86a6-42fb-9bc2-ba2c1e6a93ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:04:07.188506 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1bbbbcc5-86a6-42fb-9bc2-ba2c1e6a93ef tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "DELETE /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 204 len: 0 microversion: 2.1 time: 0.136200 Aug 02 07:04:07.190503 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1741/3592] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:04:07 2022] DELETE /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:04:07.199422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b91aa716-09f6-4066-b5d6-d0a12cadbbc9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:07.200065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b91aa716-09f6-4066-b5d6-d0a12cadbbc9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:07.207348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b91aa716-09f6-4066-b5d6-d0a12cadbbc9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:07.207797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b91aa716-09f6-4066-b5d6-d0a12cadbbc9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:07.208605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b91aa716-09f6-4066-b5d6-d0a12cadbbc9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:07.209224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b91aa716-09f6-4066-b5d6-d0a12cadbbc9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:07.378678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b91aa716-09f6-4066-b5d6-d0a12cadbbc9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:07.387260 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b91aa716-09f6-4066-b5d6-d0a12cadbbc9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1386 microversion: 2.1 time: 0.192323 Aug 02 07:04:07.387848 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1852/3593] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:07 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1386 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:07.679759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fed803eb-ffeb-4f31-8552-f7dc0baaf7d8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:07.680479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fed803eb-ffeb-4f31-8552-f7dc0baaf7d8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:07.690078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fed803eb-ffeb-4f31-8552-f7dc0baaf7d8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:07.690600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fed803eb-ffeb-4f31-8552-f7dc0baaf7d8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:07.691302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fed803eb-ffeb-4f31-8552-f7dc0baaf7d8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:07.691737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fed803eb-ffeb-4f31-8552-f7dc0baaf7d8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:07.887135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ba38d3a3-6ceb-4961-8719-db6e9b8f229d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:07.889250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ba38d3a3-6ceb-4961-8719-db6e9b8f229d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:07.904691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba38d3a3-6ceb-4961-8719-db6e9b8f229d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:07.905600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba38d3a3-6ceb-4961-8719-db6e9b8f229d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:07.909080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba38d3a3-6ceb-4961-8719-db6e9b8f229d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:07.909854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba38d3a3-6ceb-4961-8719-db6e9b8f229d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:08.021330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ba38d3a3-6ceb-4961-8719-db6e9b8f229d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:08.034266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ba38d3a3-6ceb-4961-8719-db6e9b8f229d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:08.036958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ba38d3a3-6ceb-4961-8719-db6e9b8f229d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:08.039165 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ba38d3a3-6ceb-4961-8719-db6e9b8f229d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1357 microversion: 2.47 time: 0.158726 Aug 02 07:04:08.040577 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1853/3594] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:07 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:04:08.044668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fed803eb-ffeb-4f31-8552-f7dc0baaf7d8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:08.056768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fed803eb-ffeb-4f31-8552-f7dc0baaf7d8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:08.059547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fed803eb-ffeb-4f31-8552-f7dc0baaf7d8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:08.066243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:08.071697 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fed803eb-ffeb-4f31-8552-f7dc0baaf7d8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 2834 microversion: 2.42 time: 0.398824 Aug 02 07:04:08.075042 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1742/3595] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:07 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 2834 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:08.076921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:08.085999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:08.086850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:08.088041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:08.088749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:08.104394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-340d795b-e0c4-4ea7-8d5c-5cc19b3cfc68 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:08.105409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-340d795b-e0c4-4ea7-8d5c-5cc19b3cfc68 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:08.113147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-340d795b-e0c4-4ea7-8d5c-5cc19b3cfc68 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:08.113981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-340d795b-e0c4-4ea7-8d5c-5cc19b3cfc68 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:08.115172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-340d795b-e0c4-4ea7-8d5c-5cc19b3cfc68 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:08.115836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-340d795b-e0c4-4ea7-8d5c-5cc19b3cfc68 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:08.254117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:04:08.255222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:04:08.256252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:04:08.257024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:04:08.268580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:04:08.368914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:08.376073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:08.376815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:08.377787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:08.378683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:08.417118 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-17518d73-9663-4554-a50d-b62a5a7c724f tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "POST /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99/action" status: 202 len: 1079 microversion: 2.47 time: 0.355564 Aug 02 07:04:08.422041 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1854/3596] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Aug 2 07:04:08 2022] POST /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99/action => generated 1079 bytes in 361 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 02 07:04:08.428000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a82207dd-9adf-4873-a703-d3ec952e9e00 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:08.428912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a82207dd-9adf-4873-a703-d3ec952e9e00 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:08.460683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a82207dd-9adf-4873-a703-d3ec952e9e00 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:08.462418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a82207dd-9adf-4873-a703-d3ec952e9e00 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:08.463628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a82207dd-9adf-4873-a703-d3ec952e9e00 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:08.464828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a82207dd-9adf-4873-a703-d3ec952e9e00 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:08.488900 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-340d795b-e0c4-4ea7-8d5c-5cc19b3cfc68 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.388702 Aug 02 07:04:08.490040 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1743/3597] 10.222.0.79 () {60 vars in 1316 bytes} [Tue Aug 2 07:04:08 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8/os-interface => generated 1831 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:08.495406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-639af1f6-3ae0-47f4-93a0-0d0cb7ae3880 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:08.496348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-639af1f6-3ae0-47f4-93a0-0d0cb7ae3880 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:08.527888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-639af1f6-3ae0-47f4-93a0-0d0cb7ae3880 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:08.535223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-639af1f6-3ae0-47f4-93a0-0d0cb7ae3880 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:08.536212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-639af1f6-3ae0-47f4-93a0-0d0cb7ae3880 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:08.536737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-639af1f6-3ae0-47f4-93a0-0d0cb7ae3880 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:08.541679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:08.724217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-639af1f6-3ae0-47f4-93a0-0d0cb7ae3880 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:08.742766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-639af1f6-3ae0-47f4-93a0-0d0cb7ae3880 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:08.749991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-639af1f6-3ae0-47f4-93a0-0d0cb7ae3880 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:08.753382 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-639af1f6-3ae0-47f4-93a0-0d0cb7ae3880 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.262019 Aug 02 07:04:08.759257 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1744/3598] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:08 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:09.145184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a82207dd-9adf-4873-a703-d3ec952e9e00 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:09.155858 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a82207dd-9adf-4873-a703-d3ec952e9e00 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1386 microversion: 2.1 time: 0.732358 Aug 02 07:04:09.157184 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1855/3599] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:08 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1386 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:09.417459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-62ba7c69-63c0-480c-8c67-738d51671f46 req-db371d3e-f431-4c6b-9fb4-62814374c69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13dab9a5-60b6-46c3-8f27-6b9ea00e10a4", "name": "network-vif-deleted", "tag": "554c704f-d680-42da-86e3-dd789c192bd1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:09.431936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-62ba7c69-63c0-480c-8c67-738d51671f46 req-db371d3e-f431-4c6b-9fb4-62814374c69e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:09.432524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-62ba7c69-63c0-480c-8c67-738d51671f46 req-db371d3e-f431-4c6b-9fb4-62814374c69e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:09.451947 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-62ba7c69-63c0-480c-8c67-738d51671f46 req-db371d3e-f431-4c6b-9fb4-62814374c69e service nova] Creating event network-vif-deleted:554c704f-d680-42da-86e3-dd789c192bd1 for instance 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 on n-h2-851337-3 Aug 02 07:04:09.459108 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-62ba7c69-63c0-480c-8c67-738d51671f46 req-db371d3e-f431-4c6b-9fb4-62814374c69e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046480 Aug 02 07:04:09.479731 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1745/3600] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:04:09.793646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bd1c0e0d-ca14-4aee-aa04-aed7dbb4dd9b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:09.794233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bd1c0e0d-ca14-4aee-aa04-aed7dbb4dd9b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:09.827631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd1c0e0d-ca14-4aee-aa04-aed7dbb4dd9b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:09.828091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd1c0e0d-ca14-4aee-aa04-aed7dbb4dd9b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:09.828907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd1c0e0d-ca14-4aee-aa04-aed7dbb4dd9b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:09.833558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd1c0e0d-ca14-4aee-aa04-aed7dbb4dd9b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:09.991622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bd1c0e0d-ca14-4aee-aa04-aed7dbb4dd9b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:10.003431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bd1c0e0d-ca14-4aee-aa04-aed7dbb4dd9b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:10.005820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bd1c0e0d-ca14-4aee-aa04-aed7dbb4dd9b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:10.007375 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bd1c0e0d-ca14-4aee-aa04-aed7dbb4dd9b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.219105 Aug 02 07:04:10.008172 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1856/3601] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:09 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:10.181544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b3a8f531-20be-40f0-af83-9c433698d7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:10.182292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b3a8f531-20be-40f0-af83-9c433698d7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:10.196063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:10.201099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b3a8f531-20be-40f0-af83-9c433698d7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:10.202749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b3a8f531-20be-40f0-af83-9c433698d7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:10.204614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b3a8f531-20be-40f0-af83-9c433698d7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:10.205059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b3a8f531-20be-40f0-af83-9c433698d7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:10.460460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-454826fd-6d56-4bee-8a5b-0d7fe8789a64 req-0f135052-46fb-473d-80ee-32a69934a14d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "tag": "861a1e1b-6d90-469d-92c9-1b3e761b3246"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:10.490077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-454826fd-6d56-4bee-8a5b-0d7fe8789a64 req-0f135052-46fb-473d-80ee-32a69934a14d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:10.494342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-454826fd-6d56-4bee-8a5b-0d7fe8789a64 req-0f135052-46fb-473d-80ee-32a69934a14d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:10.511204 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-454826fd-6d56-4bee-8a5b-0d7fe8789a64 req-0f135052-46fb-473d-80ee-32a69934a14d service nova] Creating event network-changed:861a1e1b-6d90-469d-92c9-1b3e761b3246 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:04:10.524577 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-454826fd-6d56-4bee-8a5b-0d7fe8789a64 req-0f135052-46fb-473d-80ee-32a69934a14d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068843 Aug 02 07:04:10.527565 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1857/3602] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:04:10.553948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:10.572529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b3a8f531-20be-40f0-af83-9c433698d7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:10.599262 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b3a8f531-20be-40f0-af83-9c433698d7c4 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1183 microversion: 2.1 time: 0.423465 Aug 02 07:04:10.609300 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1746/3603] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:10 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1183 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:11.033581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-282a6885-e403-404b-8f5c-a73cdce7500d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:11.034406 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-282a6885-e403-404b-8f5c-a73cdce7500d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:11.054249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-282a6885-e403-404b-8f5c-a73cdce7500d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:11.054702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-282a6885-e403-404b-8f5c-a73cdce7500d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:11.055489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-282a6885-e403-404b-8f5c-a73cdce7500d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:11.055919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-282a6885-e403-404b-8f5c-a73cdce7500d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:11.621129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1694313f-9e74-428e-b25e-f0f8c6572d79 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:11.627727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1694313f-9e74-428e-b25e-f0f8c6572d79 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:11.634896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=16 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:11.664165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1694313f-9e74-428e-b25e-f0f8c6572d79 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:11.665183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1694313f-9e74-428e-b25e-f0f8c6572d79 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:11.666719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1694313f-9e74-428e-b25e-f0f8c6572d79 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:11.667440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1694313f-9e74-428e-b25e-f0f8c6572d79 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:11.852558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1694313f-9e74-428e-b25e-f0f8c6572d79 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:11.859429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-282a6885-e403-404b-8f5c-a73cdce7500d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:11.869753 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1694313f-9e74-428e-b25e-f0f8c6572d79 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1183 microversion: 2.1 time: 0.252817 Aug 02 07:04:11.874663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-282a6885-e403-404b-8f5c-a73cdce7500d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:11.876313 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1747/3604] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:11 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:04:11.878396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-282a6885-e403-404b-8f5c-a73cdce7500d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:11.883213 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-282a6885-e403-404b-8f5c-a73cdce7500d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.854105 Aug 02 07:04:11.885557 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1858/3605] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:11 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:12.903758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-44805652-bb80-4272-8fbe-f1a527961e44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:12.904373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-44805652-bb80-4272-8fbe-f1a527961e44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:12.913784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a1bc0f29-d233-4d08-8521-646533dbc747 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:12.914733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a1bc0f29-d233-4d08-8521-646533dbc747 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:12.929462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44805652-bb80-4272-8fbe-f1a527961e44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:12.930097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44805652-bb80-4272-8fbe-f1a527961e44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:12.932347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1bc0f29-d233-4d08-8521-646533dbc747 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:12.932535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44805652-bb80-4272-8fbe-f1a527961e44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:12.932703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1bc0f29-d233-4d08-8521-646533dbc747 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:12.932861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44805652-bb80-4272-8fbe-f1a527961e44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:12.935266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1bc0f29-d233-4d08-8521-646533dbc747 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:12.938254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1bc0f29-d233-4d08-8521-646533dbc747 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:12.950856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:13.118139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44805652-bb80-4272-8fbe-f1a527961e44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:13.132555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a1bc0f29-d233-4d08-8521-646533dbc747 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:13.136122 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-44805652-bb80-4272-8fbe-f1a527961e44 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1183 microversion: 2.1 time: 0.237075 Aug 02 07:04:13.136748 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1748/3606] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:12 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:13.148426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a1bc0f29-d233-4d08-8521-646533dbc747 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:13.150987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a1bc0f29-d233-4d08-8521-646533dbc747 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:13.152810 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a1bc0f29-d233-4d08-8521-646533dbc747 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.243813 Aug 02 07:04:13.154512 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1859/3607] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:12 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:04:14.100561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f6ced80b-69ff-41f4-96a7-f12a34858016 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a60df81-f1c7-4d0d-8ef2-f6090d459fac"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:14.103893 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f6ced80b-69ff-41f4-96a7-f12a34858016 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:14.112614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6ced80b-69ff-41f4-96a7-f12a34858016 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:14.113427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6ced80b-69ff-41f4-96a7-f12a34858016 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:14.114544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6ced80b-69ff-41f4-96a7-f12a34858016 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:14.115222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6ced80b-69ff-41f4-96a7-f12a34858016 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:14.168305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-04eef971-2297-4809-91fd-479831d44367 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:14.169635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-04eef971-2297-4809-91fd-479831d44367 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:14.182330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04eef971-2297-4809-91fd-479831d44367 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:14.182772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04eef971-2297-4809-91fd-479831d44367 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:14.183562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04eef971-2297-4809-91fd-479831d44367 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:14.183984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04eef971-2297-4809-91fd-479831d44367 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:14.266943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-04eef971-2297-4809-91fd-479831d44367 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:14.294735 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-04eef971-2297-4809-91fd-479831d44367 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1183 microversion: 2.1 time: 0.134989 Aug 02 07:04:14.306062 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1860/3608] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:14 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:14.320245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7dbde633-42a2-4032-ab28-dba2ce5d7966 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:14.321114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7dbde633-42a2-4032-ab28-dba2ce5d7966 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:14.330342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dbde633-42a2-4032-ab28-dba2ce5d7966 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:14.331110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dbde633-42a2-4032-ab28-dba2ce5d7966 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:14.332080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dbde633-42a2-4032-ab28-dba2ce5d7966 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:14.332755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dbde633-42a2-4032-ab28-dba2ce5d7966 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:14.431364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7dbde633-42a2-4032-ab28-dba2ce5d7966 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:14.456111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7dbde633-42a2-4032-ab28-dba2ce5d7966 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:14.460660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7dbde633-42a2-4032-ab28-dba2ce5d7966 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:14.463384 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7dbde633-42a2-4032-ab28-dba2ce5d7966 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.153516 Aug 02 07:04:14.479774 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1861/3609] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:14 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:14.544631 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f6ced80b-69ff-41f4-96a7-f12a34858016 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.447847 Aug 02 07:04:14.547309 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1749/3610] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:04:14 2022] POST /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments => generated 194 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:04:15.322613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3f5bcd99-4d48-40be-b218-932851bf32d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:15.323242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3f5bcd99-4d48-40be-b218-932851bf32d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:15.327357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=84 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:15.344189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f5bcd99-4d48-40be-b218-932851bf32d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:15.348962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f5bcd99-4d48-40be-b218-932851bf32d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:15.350341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f5bcd99-4d48-40be-b218-932851bf32d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:15.353206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f5bcd99-4d48-40be-b218-932851bf32d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:15.494929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-00e8287d-96a7-46a8-8a43-0b5958046d1b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:15.496482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-00e8287d-96a7-46a8-8a43-0b5958046d1b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:15.504849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00e8287d-96a7-46a8-8a43-0b5958046d1b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:15.506232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00e8287d-96a7-46a8-8a43-0b5958046d1b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:15.507279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00e8287d-96a7-46a8-8a43-0b5958046d1b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:15.508002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00e8287d-96a7-46a8-8a43-0b5958046d1b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:15.535066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3f5bcd99-4d48-40be-b218-932851bf32d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:15.547428 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3f5bcd99-4d48-40be-b218-932851bf32d5 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1183 microversion: 2.1 time: 0.228528 Aug 02 07:04:15.548795 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1862/3611] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:15 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:15.622281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-00e8287d-96a7-46a8-8a43-0b5958046d1b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:15.650440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-00e8287d-96a7-46a8-8a43-0b5958046d1b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:15.654272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-00e8287d-96a7-46a8-8a43-0b5958046d1b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:15.656000 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-00e8287d-96a7-46a8-8a43-0b5958046d1b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.165473 Aug 02 07:04:15.657850 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1750/3612] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:15 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:16.571983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cdee1615-60cd-4adf-9d72-33cef823aab8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:16.572778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cdee1615-60cd-4adf-9d72-33cef823aab8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:16.584669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdee1615-60cd-4adf-9d72-33cef823aab8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:16.587923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdee1615-60cd-4adf-9d72-33cef823aab8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:16.590720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdee1615-60cd-4adf-9d72-33cef823aab8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:16.592048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdee1615-60cd-4adf-9d72-33cef823aab8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:16.664619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdee1615-60cd-4adf-9d72-33cef823aab8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:16.670837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdee1615-60cd-4adf-9d72-33cef823aab8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:16.671302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-cdee1615-60cd-4adf-9d72-33cef823aab8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lazy-loading 'fault' on Instance uuid 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:04:16.706891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7ba0b2a5-927b-47a9-96da-d483c6f00080 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:16.707541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7ba0b2a5-927b-47a9-96da-d483c6f00080 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:16.731052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ba0b2a5-927b-47a9-96da-d483c6f00080 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:16.738261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ba0b2a5-927b-47a9-96da-d483c6f00080 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:16.740060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ba0b2a5-927b-47a9-96da-d483c6f00080 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:16.740679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cdee1615-60cd-4adf-9d72-33cef823aab8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:16.741586 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ba0b2a5-927b-47a9-96da-d483c6f00080 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:16.765174 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cdee1615-60cd-4adf-9d72-33cef823aab8 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 200 len: 1188 microversion: 2.1 time: 0.196326 Aug 02 07:04:16.779122 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1863/3613] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:16 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 1188 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:16.915320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7ba0b2a5-927b-47a9-96da-d483c6f00080 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:16.948436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7ba0b2a5-927b-47a9-96da-d483c6f00080 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:16.955631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7ba0b2a5-927b-47a9-96da-d483c6f00080 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:16.957529 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7ba0b2a5-927b-47a9-96da-d483c6f00080 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.267115 Aug 02 07:04:16.959080 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1751/3614] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:16 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:17.792743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-19c63317-0801-4210-843e-2af99a9d6922 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:17.794308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-19c63317-0801-4210-843e-2af99a9d6922 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:17.809391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19c63317-0801-4210-843e-2af99a9d6922 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:17.810238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19c63317-0801-4210-843e-2af99a9d6922 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:17.811692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19c63317-0801-4210-843e-2af99a9d6922 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:17.812870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19c63317-0801-4210-843e-2af99a9d6922 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:17.835140 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-19c63317-0801-4210-843e-2af99a9d6922 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] HTTP exception thrown: Instance 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 could not be found. Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-19c63317-0801-4210-843e-2af99a9d6922 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Request method failure captured: Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 HTTP/1.1 Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqARVGLfLayzui_i_Hgr039lGFD-OuP6VaNwt7g_3b81g3hNI4Cisy4VCTmkcOPZWMKfBcepuj4Bl0Ago9Vuqd12QwnnLVyeWeZCPKaBD1fRNxrFmCSel8SBlqwGvVNa5zIpOM4abUVCs9gc1blbXsR1UmDTcVnBQPKu6U_AnhxQ1Y Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 144a45ff8adc4fc08cdac4d62405c1af Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-LiveMigrationTest-448250625 Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/144a45ff8adc4fc08cdac4d62405c1af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/144a45ff8adc4fc08cdac4d62405c1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_144a45ff8adc4fc08cdac4d62405c1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/144a45ff8adc4fc08cdac4d62405c1af"}]}] Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-LiveMigrationTest-448250625 Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 144a45ff8adc4fc08cdac4d62405c1af Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-LiveMigrationTest-448250625 Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-LiveMigrationTest-448250625-project Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 82cffd0e8f5e400996b832cf1368b5d1 Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-LiveMigrationTest-448250625-project Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 could not be found. Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '13dab9a5-60b6-46c3-8f27-6b9ea00e10a4'} Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 could not be found. Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 could not be found. Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:04:17.837878 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:17.844392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:17.844392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:04:17.844392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:04:17.844392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:04:17.844392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:04:17.844392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 could not be found. Aug 02 07:04:17.844392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:17.847932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-19c63317-0801-4210-843e-2af99a9d6922 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Returning 404 to user: Instance 13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:04:17.854996 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-19c63317-0801-4210-843e-2af99a9d6922 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4" status: 404 len: 111 microversion: 2.1 time: 0.069083 Aug 02 07:04:17.857261 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1864/3615] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:17 2022] GET /compute/v2.1/servers/13dab9a5-60b6-46c3-8f27-6b9ea00e10a4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:04:17.990952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d7f0c24c-bc46-4fb6-8f07-c3352602d660 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:17.993468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d7f0c24c-bc46-4fb6-8f07-c3352602d660 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:18.033741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7f0c24c-bc46-4fb6-8f07-c3352602d660 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:18.034642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7f0c24c-bc46-4fb6-8f07-c3352602d660 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:18.036811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7f0c24c-bc46-4fb6-8f07-c3352602d660 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:18.037685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7f0c24c-bc46-4fb6-8f07-c3352602d660 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:18.204473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d7f0c24c-bc46-4fb6-8f07-c3352602d660 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:18.219753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d7f0c24c-bc46-4fb6-8f07-c3352602d660 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:18.223468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d7f0c24c-bc46-4fb6-8f07-c3352602d660 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:18.225058 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d7f0c24c-bc46-4fb6-8f07-c3352602d660 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.243423 Aug 02 07:04:18.226324 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1752/3616] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:17 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:19.254018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bf233210-ecd4-4d76-ab7e-eee56f4acdef tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:19.256187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bf233210-ecd4-4d76-ab7e-eee56f4acdef tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:19.266585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf233210-ecd4-4d76-ab7e-eee56f4acdef tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:19.267348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf233210-ecd4-4d76-ab7e-eee56f4acdef tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:19.268436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf233210-ecd4-4d76-ab7e-eee56f4acdef tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:19.269195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf233210-ecd4-4d76-ab7e-eee56f4acdef tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:19.394350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bf233210-ecd4-4d76-ab7e-eee56f4acdef tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:19.405219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bf233210-ecd4-4d76-ab7e-eee56f4acdef tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:19.407870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bf233210-ecd4-4d76-ab7e-eee56f4acdef tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:19.409708 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bf233210-ecd4-4d76-ab7e-eee56f4acdef tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.161563 Aug 02 07:04:19.411620 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1865/3617] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:19 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:20.437526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2fcf843f-cafc-4cfe-85a0-c62368f05f2b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:20.438297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2fcf843f-cafc-4cfe-85a0-c62368f05f2b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:20.453002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2fcf843f-cafc-4cfe-85a0-c62368f05f2b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:20.455212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2fcf843f-cafc-4cfe-85a0-c62368f05f2b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:20.456183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2fcf843f-cafc-4cfe-85a0-c62368f05f2b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:20.457599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2fcf843f-cafc-4cfe-85a0-c62368f05f2b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:20.578566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2fcf843f-cafc-4cfe-85a0-c62368f05f2b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:20.594710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2fcf843f-cafc-4cfe-85a0-c62368f05f2b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:20.597006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2fcf843f-cafc-4cfe-85a0-c62368f05f2b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:20.599772 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2fcf843f-cafc-4cfe-85a0-c62368f05f2b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.166516 Aug 02 07:04:20.615974 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1753/3618] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:20 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:04:21.626480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6834dc26-8371-4844-897b-847dee246493 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:21.627101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6834dc26-8371-4844-897b-847dee246493 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:21.645054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6834dc26-8371-4844-897b-847dee246493 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:21.646331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6834dc26-8371-4844-897b-847dee246493 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:21.647623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6834dc26-8371-4844-897b-847dee246493 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:21.648267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6834dc26-8371-4844-897b-847dee246493 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:21.863659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6834dc26-8371-4844-897b-847dee246493 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:21.876407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6834dc26-8371-4844-897b-847dee246493 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:21.880000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6834dc26-8371-4844-897b-847dee246493 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:21.883150 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6834dc26-8371-4844-897b-847dee246493 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.260641 Aug 02 07:04:21.886428 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1866/3619] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:21 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:22.915031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b0934f5f-8406-4d87-90e8-ae66baf99093 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:22.916771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b0934f5f-8406-4d87-90e8-ae66baf99093 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:22.932660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0934f5f-8406-4d87-90e8-ae66baf99093 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:22.933802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0934f5f-8406-4d87-90e8-ae66baf99093 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:22.935760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0934f5f-8406-4d87-90e8-ae66baf99093 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:22.936810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0934f5f-8406-4d87-90e8-ae66baf99093 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:23.107874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b0934f5f-8406-4d87-90e8-ae66baf99093 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:23.151669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b0934f5f-8406-4d87-90e8-ae66baf99093 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:23.162410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b0934f5f-8406-4d87-90e8-ae66baf99093 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:23.164779 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b0934f5f-8406-4d87-90e8-ae66baf99093 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.253764 Aug 02 07:04:23.177960 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1754/3620] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:22 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:24.209651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6255e660-321e-45d4-969c-82951be64169 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:24.210362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6255e660-321e-45d4-969c-82951be64169 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:24.219228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6255e660-321e-45d4-969c-82951be64169 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:24.219925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6255e660-321e-45d4-969c-82951be64169 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:24.220934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6255e660-321e-45d4-969c-82951be64169 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:24.221718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6255e660-321e-45d4-969c-82951be64169 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:24.320641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6255e660-321e-45d4-969c-82951be64169 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:24.329565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6255e660-321e-45d4-969c-82951be64169 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:24.332145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6255e660-321e-45d4-969c-82951be64169 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:24.334794 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6255e660-321e-45d4-969c-82951be64169 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.130049 Aug 02 07:04:24.335924 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1867/3621] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:24 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:25.135051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-87587269-261e-4b8c-a590-86653261e41a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:25.135556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-87587269-261e-4b8c-a590-86653261e41a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:25.150860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87587269-261e-4b8c-a590-86653261e41a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:25.151573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87587269-261e-4b8c-a590-86653261e41a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:25.152551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87587269-261e-4b8c-a590-86653261e41a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:25.153153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87587269-261e-4b8c-a590-86653261e41a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:25.182505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-87587269-261e-4b8c-a590-86653261e41a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:04:25.299274 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-87587269-261e-4b8c-a590-86653261e41a tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 204 len: 0 microversion: 2.1 time: 0.168706 Aug 02 07:04:25.299904 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1755/3622] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:04:25 2022] DELETE /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:04:25.308592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ad06638e-af43-4de5-929f-811800006388 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:25.309217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ad06638e-af43-4de5-929f-811800006388 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:25.326484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad06638e-af43-4de5-929f-811800006388 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:25.326989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad06638e-af43-4de5-929f-811800006388 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:25.328240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad06638e-af43-4de5-929f-811800006388 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:25.328933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad06638e-af43-4de5-929f-811800006388 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:25.375810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3cff2abc-d28c-4d6f-985c-6247ee50ca99 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:25.380202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3cff2abc-d28c-4d6f-985c-6247ee50ca99 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:25.396880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cff2abc-d28c-4d6f-985c-6247ee50ca99 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:25.397328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cff2abc-d28c-4d6f-985c-6247ee50ca99 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:25.398139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cff2abc-d28c-4d6f-985c-6247ee50ca99 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:25.398573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cff2abc-d28c-4d6f-985c-6247ee50ca99 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:25.492687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3cff2abc-d28c-4d6f-985c-6247ee50ca99 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:25.504943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3cff2abc-d28c-4d6f-985c-6247ee50ca99 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:25.509670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3cff2abc-d28c-4d6f-985c-6247ee50ca99 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:25.511196 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3cff2abc-d28c-4d6f-985c-6247ee50ca99 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.145069 Aug 02 07:04:25.522418 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1756/3623] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:25 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:04:25.587346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ad06638e-af43-4de5-929f-811800006388 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:25.597241 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ad06638e-af43-4de5-929f-811800006388 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1666 microversion: 2.1 time: 0.293015 Aug 02 07:04:25.597847 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1868/3624] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:25 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1666 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:26.542251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b14b5d44-7439-47f3-93f5-674697377d76 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:26.542965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b14b5d44-7439-47f3-93f5-674697377d76 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:26.557466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b14b5d44-7439-47f3-93f5-674697377d76 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:26.565658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b14b5d44-7439-47f3-93f5-674697377d76 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:26.567077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b14b5d44-7439-47f3-93f5-674697377d76 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:26.567681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b14b5d44-7439-47f3-93f5-674697377d76 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:26.619747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-62547071-0e8f-43fa-94a6-183c75fbe19b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:26.620366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-62547071-0e8f-43fa-94a6-183c75fbe19b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:26.642547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62547071-0e8f-43fa-94a6-183c75fbe19b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:26.643004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62547071-0e8f-43fa-94a6-183c75fbe19b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:26.648278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62547071-0e8f-43fa-94a6-183c75fbe19b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:26.651288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62547071-0e8f-43fa-94a6-183c75fbe19b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:26.766886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b14b5d44-7439-47f3-93f5-674697377d76 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:26.775508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b14b5d44-7439-47f3-93f5-674697377d76 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:26.777268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b14b5d44-7439-47f3-93f5-674697377d76 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:26.778664 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b14b5d44-7439-47f3-93f5-674697377d76 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.242442 Aug 02 07:04:26.779711 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1757/3625] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:26 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:26.798133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-62547071-0e8f-43fa-94a6-183c75fbe19b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:26.807535 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-62547071-0e8f-43fa-94a6-183c75fbe19b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 200 len: 1599 microversion: 2.1 time: 0.191189 Aug 02 07:04:26.808889 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1869/3626] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:26 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 1599 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:04:27.119898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ef22872b-7030-4246-a198-c75e9fea26ee req-33b0cf33-3f7d-4be2-8611-8fc482da81c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cab5887-4328-4207-9ac6-c884aa9806d1", "name": "network-vif-deleted", "tag": "18fcf761-a89b-4d97-9ca7-3c303953a3d1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:27.148149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ef22872b-7030-4246-a198-c75e9fea26ee req-33b0cf33-3f7d-4be2-8611-8fc482da81c5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:27.148594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ef22872b-7030-4246-a198-c75e9fea26ee req-33b0cf33-3f7d-4be2-8611-8fc482da81c5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:27.179303 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ef22872b-7030-4246-a198-c75e9fea26ee req-33b0cf33-3f7d-4be2-8611-8fc482da81c5 service nova] Creating event network-vif-deleted:18fcf761-a89b-4d97-9ca7-3c303953a3d1 for instance 6cab5887-4328-4207-9ac6-c884aa9806d1 on n-h2-851337-3 Aug 02 07:04:27.206319 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ef22872b-7030-4246-a198-c75e9fea26ee req-33b0cf33-3f7d-4be2-8611-8fc482da81c5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092628 Aug 02 07:04:27.208402 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1758/3627] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:04:27.807551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-793536fb-832c-4c62-a904-6519b1929b2e tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:27.808167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-793536fb-832c-4c62-a904-6519b1929b2e tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:27.816964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-793536fb-832c-4c62-a904-6519b1929b2e tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:27.818847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-793536fb-832c-4c62-a904-6519b1929b2e tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:27.820423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-793536fb-832c-4c62-a904-6519b1929b2e tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:27.821075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-793536fb-832c-4c62-a904-6519b1929b2e tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:27.830033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bad3066c-723c-4561-b651-65630bf9f30b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:27.830740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bad3066c-723c-4561-b651-65630bf9f30b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 6cab5887-4328-4207-9ac6-c884aa9806d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:27.848434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bad3066c-723c-4561-b651-65630bf9f30b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:27.848884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bad3066c-723c-4561-b651-65630bf9f30b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:27.849671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bad3066c-723c-4561-b651-65630bf9f30b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:27.850199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bad3066c-723c-4561-b651-65630bf9f30b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:27.860409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:27.886322 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-bad3066c-723c-4561-b651-65630bf9f30b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] HTTP exception thrown: Instance 6cab5887-4328-4207-9ac6-c884aa9806d1 could not be found. Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bad3066c-723c-4561-b651-65630bf9f30b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Request method failure captured: Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 HTTP/1.1 Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MqARVGLfLayzui_i_Hgr039lGFD-OuP6VaNwt7g_3b81g3hNI4Cisy4VCTmkcOPZWMKfBcepuj4Bl0Ago9Vuqd12QwnnLVyeWeZCPKaBD1fRNxrFmCSel8SBlqwGvVNa5zIpOM4abUVCs9gc1blbXsR1UmDTcVnBQPKu6U_AnhxQ1Y Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 144a45ff8adc4fc08cdac4d62405c1af Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-LiveMigrationTest-448250625 Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/144a45ff8adc4fc08cdac4d62405c1af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/144a45ff8adc4fc08cdac4d62405c1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_144a45ff8adc4fc08cdac4d62405c1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/144a45ff8adc4fc08cdac4d62405c1af"}]}] Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-LiveMigrationTest-448250625 Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 144a45ff8adc4fc08cdac4d62405c1af Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-LiveMigrationTest-448250625 Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-LiveMigrationTest-448250625-project Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 82cffd0e8f5e400996b832cf1368b5d1 Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-LiveMigrationTest-448250625-project Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 6cab5887-4328-4207-9ac6-c884aa9806d1 could not be found. Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '6cab5887-4328-4207-9ac6-c884aa9806d1'} Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cab5887-4328-4207-9ac6-c884aa9806d1 could not be found. Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cab5887-4328-4207-9ac6-c884aa9806d1 could not be found. Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:04:27.888583 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:27.895798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:27.895798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:04:27.895798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:04:27.895798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:04:27.895798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:04:27.895798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cab5887-4328-4207-9ac6-c884aa9806d1 could not be found. Aug 02 07:04:27.895798 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:27.895798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bad3066c-723c-4561-b651-65630bf9f30b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Returning 404 to user: Instance 6cab5887-4328-4207-9ac6-c884aa9806d1 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:04:27.895798 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bad3066c-723c-4561-b651-65630bf9f30b tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1" status: 404 len: 111 microversion: 2.1 time: 0.065173 Aug 02 07:04:27.895798 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1759/3628] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:27 2022] GET /compute/v2.1/servers/6cab5887-4328-4207-9ac6-c884aa9806d1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:04:27.904750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-db224b85-9b46-48f0-8257-ae3ec6fb5a40 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '.version_select at 0x7f927aa31d30>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:27.919456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-793536fb-832c-4c62-a904-6519b1929b2e tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:27.933669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-793536fb-832c-4c62-a904-6519b1929b2e tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:27.935281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-793536fb-832c-4c62-a904-6519b1929b2e tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:27.936549 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-793536fb-832c-4c62-a904-6519b1929b2e tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.133799 Aug 02 07:04:27.937116 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1870/3629] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:27 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:27.946215 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-db224b85-9b46-48f0-8257-ae3ec6fb5a40 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2009159540" status: 202 len: 0 microversion: 2.1 time: 0.050873 Aug 02 07:04:27.946869 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1760/3630] 10.222.0.79 () {58 vars in 1221 bytes} [Tue Aug 2 07:04:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2009159540 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:04:28.966851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-29b4d932-bec3-4ac6-b481-2290e6b242cc tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:28.967993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-29b4d932-bec3-4ac6-b481-2290e6b242cc tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:28.995674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29b4d932-bec3-4ac6-b481-2290e6b242cc tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:28.997496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29b4d932-bec3-4ac6-b481-2290e6b242cc tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:29.000052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29b4d932-bec3-4ac6-b481-2290e6b242cc tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:29.000841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29b4d932-bec3-4ac6-b481-2290e6b242cc tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:29.117661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-29b4d932-bec3-4ac6-b481-2290e6b242cc tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:29.127911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-29b4d932-bec3-4ac6-b481-2290e6b242cc tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:29.130623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-29b4d932-bec3-4ac6-b481-2290e6b242cc tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:29.132328 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-29b4d932-bec3-4ac6-b481-2290e6b242cc tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.176054 Aug 02 07:04:29.133450 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1871/3631] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:28 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:29.400610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6b48a284-2c41-4597-9457-6b0dc2ca5536 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:29.401448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6b48a284-2c41-4597-9457-6b0dc2ca5536 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:29.410301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b48a284-2c41-4597-9457-6b0dc2ca5536 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:29.410709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b48a284-2c41-4597-9457-6b0dc2ca5536 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:29.411497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b48a284-2c41-4597-9457-6b0dc2ca5536 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:29.411939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b48a284-2c41-4597-9457-6b0dc2ca5536 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:29.453903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6b48a284-2c41-4597-9457-6b0dc2ca5536 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:04:29.586661 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6b48a284-2c41-4597-9457-6b0dc2ca5536 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 204 len: 0 microversion: 2.1 time: 0.191004 Aug 02 07:04:29.588491 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1761/3632] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:04:29 2022] DELETE /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:04:29.597351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-77e471eb-5102-4821-a118-c62b5d61de45 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:29.598371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-77e471eb-5102-4821-a118-c62b5d61de45 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:29.618760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77e471eb-5102-4821-a118-c62b5d61de45 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:29.620865 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77e471eb-5102-4821-a118-c62b5d61de45 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:29.622460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77e471eb-5102-4821-a118-c62b5d61de45 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:29.623145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77e471eb-5102-4821-a118-c62b5d61de45 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:29.867877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-77e471eb-5102-4821-a118-c62b5d61de45 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:29.882739 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-77e471eb-5102-4821-a118-c62b5d61de45 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1483 microversion: 2.1 time: 0.289086 Aug 02 07:04:29.883754 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1872/3633] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:29 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1483 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:30.171256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ed75c71-5698-4402-803b-70299c5b87db tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:30.172698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ed75c71-5698-4402-803b-70299c5b87db tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:30.181710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ed75c71-5698-4402-803b-70299c5b87db tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:30.184874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ed75c71-5698-4402-803b-70299c5b87db tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:30.186056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ed75c71-5698-4402-803b-70299c5b87db tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:30.186505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ed75c71-5698-4402-803b-70299c5b87db tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:30.280128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ed75c71-5698-4402-803b-70299c5b87db tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:30.289243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ed75c71-5698-4402-803b-70299c5b87db tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:30.290893 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ed75c71-5698-4402-803b-70299c5b87db tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:30.292458 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ed75c71-5698-4402-803b-70299c5b87db tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.130420 Aug 02 07:04:30.293297 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1762/3634] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:30 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:30.591388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-cdcb7044-fce4-476f-adc6-8e5dfe3e667c req-4925d269-1850-40cd-95cd-ebb67e3c0ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aff6869-710b-4239-bc13-f3a275b7a878", "name": "network-vif-deleted", "tag": "606ee08a-250d-404f-8772-4a64ef82b723"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:30.604092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-cdcb7044-fce4-476f-adc6-8e5dfe3e667c req-4925d269-1850-40cd-95cd-ebb67e3c0ee2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:30.604551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-cdcb7044-fce4-476f-adc6-8e5dfe3e667c req-4925d269-1850-40cd-95cd-ebb67e3c0ee2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:30.618250 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-cdcb7044-fce4-476f-adc6-8e5dfe3e667c req-4925d269-1850-40cd-95cd-ebb67e3c0ee2 service nova] Creating event network-vif-deleted:606ee08a-250d-404f-8772-4a64ef82b723 for instance 7aff6869-710b-4239-bc13-f3a275b7a878 on n-h2-851337-3 Aug 02 07:04:30.625325 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-cdcb7044-fce4-476f-adc6-8e5dfe3e667c req-4925d269-1850-40cd-95cd-ebb67e3c0ee2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037580 Aug 02 07:04:30.629523 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1873/3635] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:04:30.906774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e3d4efc4-b841-4070-a69d-916e4cb397f9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:30.907391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e3d4efc4-b841-4070-a69d-916e4cb397f9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:30.915396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3d4efc4-b841-4070-a69d-916e4cb397f9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:30.915881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3d4efc4-b841-4070-a69d-916e4cb397f9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:30.916715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3d4efc4-b841-4070-a69d-916e4cb397f9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:30.917125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3d4efc4-b841-4070-a69d-916e4cb397f9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:30.952568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3d4efc4-b841-4070-a69d-916e4cb397f9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:30.953213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3d4efc4-b841-4070-a69d-916e4cb397f9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:30.953952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-e3d4efc4-b841-4070-a69d-916e4cb397f9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lazy-loading 'fault' on Instance uuid 7aff6869-710b-4239-bc13-f3a275b7a878 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:04:30.954273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-180303b2-3994-4b27-8a97-a182a1e3fa52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:30.958727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-180303b2-3994-4b27-8a97-a182a1e3fa52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:30.965857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-180303b2-3994-4b27-8a97-a182a1e3fa52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:30.966539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-180303b2-3994-4b27-8a97-a182a1e3fa52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:30.967582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-180303b2-3994-4b27-8a97-a182a1e3fa52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:30.968130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-180303b2-3994-4b27-8a97-a182a1e3fa52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:31.019643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-180303b2-3994-4b27-8a97-a182a1e3fa52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lazy-loading 'flavor' on Instance uuid 4cf3144f-9803-4cba-9569-a5113e7e59d7 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:04:31.061544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e3d4efc4-b841-4070-a69d-916e4cb397f9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:31.076311 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e3d4efc4-b841-4070-a69d-916e4cb397f9 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 200 len: 1300 microversion: 2.1 time: 0.173390 Aug 02 07:04:31.077292 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1763/3636] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:30 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 1300 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:31.292812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:31.318551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bb8eb309-abdb-4fd7-a283-eef6e81b5aed tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:31.319368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bb8eb309-abdb-4fd7-a283-eef6e81b5aed tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:31.327851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb8eb309-abdb-4fd7-a283-eef6e81b5aed tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:31.328523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb8eb309-abdb-4fd7-a283-eef6e81b5aed tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:31.328632 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-180303b2-3994-4b27-8a97-a182a1e3fa52 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/action" status: 200 len: 32 microversion: 2.1 time: 0.376251 Aug 02 07:04:31.329437 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1874/3637] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:04:30 2022] POST /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/action => generated 32 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 07:04:31.329775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb8eb309-abdb-4fd7-a283-eef6e81b5aed tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:31.330456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb8eb309-abdb-4fd7-a283-eef6e81b5aed tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:31.339857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b28251e1-b2a5-414e-bd32-957eee7b16bd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:31.342974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b28251e1-b2a5-414e-bd32-957eee7b16bd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:31.371754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b28251e1-b2a5-414e-bd32-957eee7b16bd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:31.372495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b28251e1-b2a5-414e-bd32-957eee7b16bd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:31.373711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b28251e1-b2a5-414e-bd32-957eee7b16bd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:31.374493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b28251e1-b2a5-414e-bd32-957eee7b16bd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:31.417273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bb8eb309-abdb-4fd7-a283-eef6e81b5aed tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:31.426860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bb8eb309-abdb-4fd7-a283-eef6e81b5aed tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:31.435537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bb8eb309-abdb-4fd7-a283-eef6e81b5aed tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:31.436936 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bb8eb309-abdb-4fd7-a283-eef6e81b5aed tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.124148 Aug 02 07:04:31.437579 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1764/3638] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:31 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:04:31.580047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b28251e1-b2a5-414e-bd32-957eee7b16bd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:31.590945 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b28251e1-b2a5-414e-bd32-957eee7b16bd tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.255035 Aug 02 07:04:31.591903 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1875/3639] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:31 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:04:32.111248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-42018da7-beef-4976-a2a7-e7d6abc825ab tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:32.112591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-42018da7-beef-4976-a2a7-e7d6abc825ab tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 7aff6869-710b-4239-bc13-f3a275b7a878] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:32.132687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42018da7-beef-4976-a2a7-e7d6abc825ab tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:32.133358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42018da7-beef-4976-a2a7-e7d6abc825ab tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:32.134321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42018da7-beef-4976-a2a7-e7d6abc825ab tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:32.134907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42018da7-beef-4976-a2a7-e7d6abc825ab tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:32.150704 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-42018da7-beef-4976-a2a7-e7d6abc825ab tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] HTTP exception thrown: Instance 7aff6869-710b-4239-bc13-f3a275b7a878 could not be found. Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-42018da7-beef-4976-a2a7-e7d6abc825ab tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Request method failure captured: Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 HTTP/1.1 Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MqARVGLfLayzui_i_Hgr039lGFD-OuP6VaNwt7g_3b81g3hNI4Cisy4VCTmkcOPZWMKfBcepuj4Bl0Ago9Vuqd12QwnnLVyeWeZCPKaBD1fRNxrFmCSel8SBlqwGvVNa5zIpOM4abUVCs9gc1blbXsR1UmDTcVnBQPKu6U_AnhxQ1Y Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 144a45ff8adc4fc08cdac4d62405c1af Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-LiveMigrationTest-448250625 Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/144a45ff8adc4fc08cdac4d62405c1af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/144a45ff8adc4fc08cdac4d62405c1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_144a45ff8adc4fc08cdac4d62405c1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/144a45ff8adc4fc08cdac4d62405c1af"}]}] Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-LiveMigrationTest-448250625 Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 144a45ff8adc4fc08cdac4d62405c1af Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-LiveMigrationTest-448250625 Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-LiveMigrationTest-448250625-project Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 82cffd0e8f5e400996b832cf1368b5d1 Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-LiveMigrationTest-448250625-project Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 7aff6869-710b-4239-bc13-f3a275b7a878 could not be found. Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '7aff6869-710b-4239-bc13-f3a275b7a878'} Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aff6869-710b-4239-bc13-f3a275b7a878 could not be found. Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aff6869-710b-4239-bc13-f3a275b7a878 could not be found. Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:04:32.152654 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:32.156304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:32.156304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:04:32.156304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:04:32.156304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:04:32.156304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:04:32.156304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aff6869-710b-4239-bc13-f3a275b7a878 could not be found. Aug 02 07:04:32.156304 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:32.157663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-42018da7-beef-4976-a2a7-e7d6abc825ab tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Returning 404 to user: Instance 7aff6869-710b-4239-bc13-f3a275b7a878 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:04:32.158784 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-42018da7-beef-4976-a2a7-e7d6abc825ab tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878" status: 404 len: 111 microversion: 2.1 time: 0.054635 Aug 02 07:04:32.159529 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1765/3640] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:32 2022] GET /compute/v2.1/servers/7aff6869-710b-4239-bc13-f3a275b7a878 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:04:32.168814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eac04e22-181b-4d44-a998-5f23e6931c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:32.169461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-eac04e22-181b-4d44-a998-5f23e6931c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:32.178435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eac04e22-181b-4d44-a998-5f23e6931c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:32.179037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eac04e22-181b-4d44-a998-5f23e6931c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:32.179895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eac04e22-181b-4d44-a998-5f23e6931c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:32.180529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eac04e22-181b-4d44-a998-5f23e6931c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:32.220643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-eac04e22-181b-4d44-a998-5f23e6931c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:04:32.315651 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-eac04e22-181b-4d44-a998-5f23e6931c37 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 204 len: 0 microversion: 2.1 time: 0.150980 Aug 02 07:04:32.320132 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1876/3641] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:04:32 2022] DELETE /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:04:32.328718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1484df14-1161-49eb-a4e6-3be74b59e280 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:32.329638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1484df14-1161-49eb-a4e6-3be74b59e280 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:32.343534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1484df14-1161-49eb-a4e6-3be74b59e280 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:32.344020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1484df14-1161-49eb-a4e6-3be74b59e280 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:32.345674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1484df14-1161-49eb-a4e6-3be74b59e280 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:32.350679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1484df14-1161-49eb-a4e6-3be74b59e280 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:32.467935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-039884cb-b301-4ef7-a5a8-a3d8ab186ec3 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:32.468776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-039884cb-b301-4ef7-a5a8-a3d8ab186ec3 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:32.479648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-039884cb-b301-4ef7-a5a8-a3d8ab186ec3 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:32.480023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-039884cb-b301-4ef7-a5a8-a3d8ab186ec3 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:32.480859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-039884cb-b301-4ef7-a5a8-a3d8ab186ec3 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:32.481298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-039884cb-b301-4ef7-a5a8-a3d8ab186ec3 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:32.532689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1484df14-1161-49eb-a4e6-3be74b59e280 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:32.543118 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1484df14-1161-49eb-a4e6-3be74b59e280 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1500 microversion: 2.1 time: 0.220618 Aug 02 07:04:32.543958 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1766/3642] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:32 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1500 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:32.564584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-039884cb-b301-4ef7-a5a8-a3d8ab186ec3 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:32.574331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-039884cb-b301-4ef7-a5a8-a3d8ab186ec3 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:32.575872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-039884cb-b301-4ef7-a5a8-a3d8ab186ec3 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:32.577047 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-039884cb-b301-4ef7-a5a8-a3d8ab186ec3 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.114535 Aug 02 07:04:32.577657 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1877/3643] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:32 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:32.615227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f078c671-2d6f-45df-8d37-748b7e5516fa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:32.615644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f078c671-2d6f-45df-8d37-748b7e5516fa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:32.634066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f078c671-2d6f-45df-8d37-748b7e5516fa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:32.635023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f078c671-2d6f-45df-8d37-748b7e5516fa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:32.636352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f078c671-2d6f-45df-8d37-748b7e5516fa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:32.637039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f078c671-2d6f-45df-8d37-748b7e5516fa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:32.846770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f078c671-2d6f-45df-8d37-748b7e5516fa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:32.860219 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f078c671-2d6f-45df-8d37-748b7e5516fa tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.250951 Aug 02 07:04:32.861527 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1767/3644] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:32 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:33.375113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e8f2a1be-f012-4f11-8263-f704ecce9c8a req-766edb7f-303b-41a0-ac61-7bf6d6e19242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f4d549d-c723-4b66-a0f7-4be7f9577859", "name": "network-vif-deleted", "tag": "1a10ae0c-eb82-416c-badf-e843929702ff"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:33.387315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e8f2a1be-f012-4f11-8263-f704ecce9c8a req-766edb7f-303b-41a0-ac61-7bf6d6e19242 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:33.388303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e8f2a1be-f012-4f11-8263-f704ecce9c8a req-766edb7f-303b-41a0-ac61-7bf6d6e19242 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:33.405004 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e8f2a1be-f012-4f11-8263-f704ecce9c8a req-766edb7f-303b-41a0-ac61-7bf6d6e19242 service nova] Creating event network-vif-deleted:1a10ae0c-eb82-416c-badf-e843929702ff for instance 3f4d549d-c723-4b66-a0f7-4be7f9577859 on n-h2-851337-3 Aug 02 07:04:33.412010 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e8f2a1be-f012-4f11-8263-f704ecce9c8a req-766edb7f-303b-41a0-ac61-7bf6d6e19242 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050249 Aug 02 07:04:33.413541 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1878/3645] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:04:33.566863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-97fa5daf-c3d0-4300-81c6-3aa19ca7e191 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:33.567571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-97fa5daf-c3d0-4300-81c6-3aa19ca7e191 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:33.579695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97fa5daf-c3d0-4300-81c6-3aa19ca7e191 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:33.580238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97fa5daf-c3d0-4300-81c6-3aa19ca7e191 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:33.581572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97fa5daf-c3d0-4300-81c6-3aa19ca7e191 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:33.582353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97fa5daf-c3d0-4300-81c6-3aa19ca7e191 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:33.602951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3eb2a194-0b17-40f9-af89-91e60458f149 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:33.603887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3eb2a194-0b17-40f9-af89-91e60458f149 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:33.612440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3eb2a194-0b17-40f9-af89-91e60458f149 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:33.612895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3eb2a194-0b17-40f9-af89-91e60458f149 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:33.613972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3eb2a194-0b17-40f9-af89-91e60458f149 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:33.614658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3eb2a194-0b17-40f9-af89-91e60458f149 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:33.634685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97fa5daf-c3d0-4300-81c6-3aa19ca7e191 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:33.635346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97fa5daf-c3d0-4300-81c6-3aa19ca7e191 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:33.636157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-97fa5daf-c3d0-4300-81c6-3aa19ca7e191 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lazy-loading 'fault' on Instance uuid 3f4d549d-c723-4b66-a0f7-4be7f9577859 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:04:33.705162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-97fa5daf-c3d0-4300-81c6-3aa19ca7e191 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cffd0e8f5e400996b832cf1368b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a45ff8adc4fc08cdac4d62405c1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:33.715598 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-97fa5daf-c3d0-4300-81c6-3aa19ca7e191 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 200 len: 1301 microversion: 2.1 time: 0.154671 Aug 02 07:04:33.716849 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1768/3646] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:33 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 1301 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:33.736109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3eb2a194-0b17-40f9-af89-91e60458f149 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:33.746271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3eb2a194-0b17-40f9-af89-91e60458f149 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:33.747900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3eb2a194-0b17-40f9-af89-91e60458f149 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:33.749116 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3eb2a194-0b17-40f9-af89-91e60458f149 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.151477 Aug 02 07:04:33.750243 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1879/3647] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:33 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:04:33.883352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a16a47b4-37b8-4d6a-a9a0-6d09b03ad8b2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:33.884555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a16a47b4-37b8-4d6a-a9a0-6d09b03ad8b2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:33.899810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a16a47b4-37b8-4d6a-a9a0-6d09b03ad8b2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:33.901029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a16a47b4-37b8-4d6a-a9a0-6d09b03ad8b2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:33.905105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a16a47b4-37b8-4d6a-a9a0-6d09b03ad8b2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:33.905885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a16a47b4-37b8-4d6a-a9a0-6d09b03ad8b2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:34.118369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a16a47b4-37b8-4d6a-a9a0-6d09b03ad8b2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:34.128872 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a16a47b4-37b8-4d6a-a9a0-6d09b03ad8b2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.250565 Aug 02 07:04:34.129567 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1769/3648] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:33 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:34.741962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-94dcbb98-ffca-42b7-9cd3-544bb2141a81 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:34.745208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-94dcbb98-ffca-42b7-9cd3-544bb2141a81 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] [instance: 3f4d549d-c723-4b66-a0f7-4be7f9577859] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:34.758622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-94dcbb98-ffca-42b7-9cd3-544bb2141a81 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:34.759916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-94dcbb98-ffca-42b7-9cd3-544bb2141a81 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:34.761551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-94dcbb98-ffca-42b7-9cd3-544bb2141a81 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:34.762341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-94dcbb98-ffca-42b7-9cd3-544bb2141a81 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:34.784392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fe17b10b-2507-4f84-9399-310a891ed980 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:34.786786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fe17b10b-2507-4f84-9399-310a891ed980 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:34.810194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe17b10b-2507-4f84-9399-310a891ed980 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:34.811160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe17b10b-2507-4f84-9399-310a891ed980 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:34.814591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe17b10b-2507-4f84-9399-310a891ed980 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:34.815803 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-94dcbb98-ffca-42b7-9cd3-544bb2141a81 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] HTTP exception thrown: Instance 3f4d549d-c723-4b66-a0f7-4be7f9577859 could not be found. Aug 02 07:04:34.818447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe17b10b-2507-4f84-9399-310a891ed980 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-94dcbb98-ffca-42b7-9cd3-544bb2141a81 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Request method failure captured: Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 HTTP/1.1 Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MqARVGLfLayzui_i_Hgr039lGFD-OuP6VaNwt7g_3b81g3hNI4Cisy4VCTmkcOPZWMKfBcepuj4Bl0Ago9Vuqd12QwnnLVyeWeZCPKaBD1fRNxrFmCSel8SBlqwGvVNa5zIpOM4abUVCs9gc1blbXsR1UmDTcVnBQPKu6U_AnhxQ1Y Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 144a45ff8adc4fc08cdac4d62405c1af Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-LiveMigrationTest-448250625 Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/144a45ff8adc4fc08cdac4d62405c1af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/144a45ff8adc4fc08cdac4d62405c1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_144a45ff8adc4fc08cdac4d62405c1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/144a45ff8adc4fc08cdac4d62405c1af"}]}] Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-LiveMigrationTest-448250625 Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 144a45ff8adc4fc08cdac4d62405c1af Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-LiveMigrationTest-448250625 Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-LiveMigrationTest-448250625-project Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 82cffd0e8f5e400996b832cf1368b5d1 Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-LiveMigrationTest-448250625-project Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 3f4d549d-c723-4b66-a0f7-4be7f9577859 could not be found. Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '3f4d549d-c723-4b66-a0f7-4be7f9577859'} Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f4d549d-c723-4b66-a0f7-4be7f9577859 could not be found. Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f4d549d-c723-4b66-a0f7-4be7f9577859 could not be found. Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:04:34.820705 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:34.824942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:34.824942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:04:34.824942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:04:34.824942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:04:34.824942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:04:34.824942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f4d549d-c723-4b66-a0f7-4be7f9577859 could not be found. Aug 02 07:04:34.824942 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:34.826514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-94dcbb98-ffca-42b7-9cd3-544bb2141a81 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] Returning 404 to user: Instance 3f4d549d-c723-4b66-a0f7-4be7f9577859 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:04:34.827939 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-94dcbb98-ffca-42b7-9cd3-544bb2141a81 tempest-LiveMigrationTest-448250625 tempest-LiveMigrationTest-448250625-project] 10.222.0.79 "GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859" status: 404 len: 111 microversion: 2.1 time: 0.093080 Aug 02 07:04:34.833683 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1880/3649] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:34 2022] GET /compute/v2.1/servers/3f4d549d-c723-4b66-a0f7-4be7f9577859 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:04:34.968112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fe17b10b-2507-4f84-9399-310a891ed980 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:34.984074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fe17b10b-2507-4f84-9399-310a891ed980 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:34.986949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fe17b10b-2507-4f84-9399-310a891ed980 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:34.989458 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fe17b10b-2507-4f84-9399-310a891ed980 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.214791 Aug 02 07:04:34.991958 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1770/3650] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:34 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:35.154313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4d6c27e6-1e1b-41da-a1b0-e1a1ecdc98bc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:35.155119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4d6c27e6-1e1b-41da-a1b0-e1a1ecdc98bc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:35.172384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d6c27e6-1e1b-41da-a1b0-e1a1ecdc98bc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:35.173540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d6c27e6-1e1b-41da-a1b0-e1a1ecdc98bc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:35.176881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d6c27e6-1e1b-41da-a1b0-e1a1ecdc98bc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:35.177812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d6c27e6-1e1b-41da-a1b0-e1a1ecdc98bc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:35.907897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4d6c27e6-1e1b-41da-a1b0-e1a1ecdc98bc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:35.918861 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4d6c27e6-1e1b-41da-a1b0-e1a1ecdc98bc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.769436 Aug 02 07:04:35.934526 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1881/3651] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:35 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:36.018251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ee23aa8d-8dbb-44cc-8793-001d4cbbd09a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:36.019542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ee23aa8d-8dbb-44cc-8793-001d4cbbd09a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:36.027394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee23aa8d-8dbb-44cc-8793-001d4cbbd09a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:36.028178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee23aa8d-8dbb-44cc-8793-001d4cbbd09a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:36.029455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee23aa8d-8dbb-44cc-8793-001d4cbbd09a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:36.030126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee23aa8d-8dbb-44cc-8793-001d4cbbd09a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:36.163237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ee23aa8d-8dbb-44cc-8793-001d4cbbd09a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:36.186130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ee23aa8d-8dbb-44cc-8793-001d4cbbd09a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:36.189734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ee23aa8d-8dbb-44cc-8793-001d4cbbd09a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:36.192280 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ee23aa8d-8dbb-44cc-8793-001d4cbbd09a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.179352 Aug 02 07:04:36.213775 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1771/3652] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:36 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:36.940899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bb0a6b43-63ea-46db-9488-ae1e6d15888a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:36.942370 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bb0a6b43-63ea-46db-9488-ae1e6d15888a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:36.957600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb0a6b43-63ea-46db-9488-ae1e6d15888a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:36.958091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb0a6b43-63ea-46db-9488-ae1e6d15888a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:36.958878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb0a6b43-63ea-46db-9488-ae1e6d15888a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:36.959315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb0a6b43-63ea-46db-9488-ae1e6d15888a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:37.237059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1bda4520-996c-4be5-9945-38ac051d9085 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:37.237584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1bda4520-996c-4be5-9945-38ac051d9085 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:37.245301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1bda4520-996c-4be5-9945-38ac051d9085 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:37.246108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1bda4520-996c-4be5-9945-38ac051d9085 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:37.247145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1bda4520-996c-4be5-9945-38ac051d9085 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:37.247883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1bda4520-996c-4be5-9945-38ac051d9085 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:37.319141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bb0a6b43-63ea-46db-9488-ae1e6d15888a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:37.332415 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bb0a6b43-63ea-46db-9488-ae1e6d15888a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.395343 Aug 02 07:04:37.335028 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1882/3653] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:36 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:37.338526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1bda4520-996c-4be5-9945-38ac051d9085 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:37.352719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1bda4520-996c-4be5-9945-38ac051d9085 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:37.354717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1bda4520-996c-4be5-9945-38ac051d9085 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:37.356425 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1bda4520-996c-4be5-9945-38ac051d9085 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.124191 Aug 02 07:04:37.357421 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1772/3654] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:37 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:04:38.356089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b24af432-7158-45f4-8583-5572c157e71d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:38.356715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b24af432-7158-45f4-8583-5572c157e71d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:38.365319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b24af432-7158-45f4-8583-5572c157e71d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:38.365776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b24af432-7158-45f4-8583-5572c157e71d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:38.366588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b24af432-7158-45f4-8583-5572c157e71d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:38.367022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b24af432-7158-45f4-8583-5572c157e71d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:38.386483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e92b183f-08eb-4099-b6c1-8fb8b01d62ad tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:38.387195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e92b183f-08eb-4099-b6c1-8fb8b01d62ad tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:38.401936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e92b183f-08eb-4099-b6c1-8fb8b01d62ad tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:38.403656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e92b183f-08eb-4099-b6c1-8fb8b01d62ad tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:38.405611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e92b183f-08eb-4099-b6c1-8fb8b01d62ad tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:38.406099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e92b183f-08eb-4099-b6c1-8fb8b01d62ad tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:38.578018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e92b183f-08eb-4099-b6c1-8fb8b01d62ad tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:38.592455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e92b183f-08eb-4099-b6c1-8fb8b01d62ad tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:38.594150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e92b183f-08eb-4099-b6c1-8fb8b01d62ad tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:38.595426 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e92b183f-08eb-4099-b6c1-8fb8b01d62ad tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.218885 Aug 02 07:04:38.618177 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1773/3655] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:38 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:38.678890 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b24af432-7158-45f4-8583-5572c157e71d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:38.691660 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b24af432-7158-45f4-8583-5572c157e71d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.339080 Aug 02 07:04:38.703324 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1883/3656] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:38 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:39.638311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7f820eb3-6195-4e3c-8267-8f79c4ebec95 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:39.638962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7f820eb3-6195-4e3c-8267-8f79c4ebec95 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:39.662549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f820eb3-6195-4e3c-8267-8f79c4ebec95 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:39.663315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f820eb3-6195-4e3c-8267-8f79c4ebec95 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:39.664111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f820eb3-6195-4e3c-8267-8f79c4ebec95 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:39.664550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f820eb3-6195-4e3c-8267-8f79c4ebec95 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:39.718980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-675b65e8-c73b-44ac-b283-a95ffccf307f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:39.719689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-675b65e8-c73b-44ac-b283-a95ffccf307f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:39.751768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-675b65e8-c73b-44ac-b283-a95ffccf307f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:39.753341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-675b65e8-c73b-44ac-b283-a95ffccf307f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:39.754814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-675b65e8-c73b-44ac-b283-a95ffccf307f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:39.756161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-675b65e8-c73b-44ac-b283-a95ffccf307f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:39.852003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7f820eb3-6195-4e3c-8267-8f79c4ebec95 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:39.862061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7f820eb3-6195-4e3c-8267-8f79c4ebec95 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:39.863746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7f820eb3-6195-4e3c-8267-8f79c4ebec95 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:39.864946 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7f820eb3-6195-4e3c-8267-8f79c4ebec95 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.244800 Aug 02 07:04:39.884992 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1774/3657] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:39 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:40.113148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-675b65e8-c73b-44ac-b283-a95ffccf307f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:40.127829 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-675b65e8-c73b-44ac-b283-a95ffccf307f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.414830 Aug 02 07:04:40.128917 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1884/3658] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:39 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:04:40.891677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-606e800a-4b4e-4e7d-a8c7-ba9afab4b1b9 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:40.893172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-606e800a-4b4e-4e7d-a8c7-ba9afab4b1b9 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:40.897282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:40.905672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-606e800a-4b4e-4e7d-a8c7-ba9afab4b1b9 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:40.906773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-606e800a-4b4e-4e7d-a8c7-ba9afab4b1b9 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:40.907741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-606e800a-4b4e-4e7d-a8c7-ba9afab4b1b9 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:40.908324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-606e800a-4b4e-4e7d-a8c7-ba9afab4b1b9 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:41.016324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-606e800a-4b4e-4e7d-a8c7-ba9afab4b1b9 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:41.020594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:41.026358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-606e800a-4b4e-4e7d-a8c7-ba9afab4b1b9 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:41.030967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-606e800a-4b4e-4e7d-a8c7-ba9afab4b1b9 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:41.040415 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-606e800a-4b4e-4e7d-a8c7-ba9afab4b1b9 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1366 microversion: 2.47 time: 0.153609 Aug 02 07:04:41.042621 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1775/3659] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:40 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:41.162825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8202437b-58b7-4c85-a647-cb7b3693fae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:41.163452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8202437b-58b7-4c85-a647-cb7b3693fae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:41.184931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8202437b-58b7-4c85-a647-cb7b3693fae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:41.186869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8202437b-58b7-4c85-a647-cb7b3693fae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:41.189442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8202437b-58b7-4c85-a647-cb7b3693fae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:41.192413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8202437b-58b7-4c85-a647-cb7b3693fae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:41.524765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8202437b-58b7-4c85-a647-cb7b3693fae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:41.550371 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8202437b-58b7-4c85-a647-cb7b3693fae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.387771 Aug 02 07:04:41.551451 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1885/3660] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:41 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:42.082124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3bf814af-4f5e-460f-882e-9c2da7eae98d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:42.083258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3bf814af-4f5e-460f-882e-9c2da7eae98d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:42.093231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bf814af-4f5e-460f-882e-9c2da7eae98d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:42.093679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bf814af-4f5e-460f-882e-9c2da7eae98d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:42.095513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bf814af-4f5e-460f-882e-9c2da7eae98d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:42.096083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bf814af-4f5e-460f-882e-9c2da7eae98d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:42.254241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3bf814af-4f5e-460f-882e-9c2da7eae98d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:42.272615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3bf814af-4f5e-460f-882e-9c2da7eae98d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:42.292185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3bf814af-4f5e-460f-882e-9c2da7eae98d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:42.298182 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3bf814af-4f5e-460f-882e-9c2da7eae98d tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1372 microversion: 2.47 time: 0.220255 Aug 02 07:04:42.310604 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1776/3661] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:42 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1372 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:42.587020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-152c1a94-a13c-426b-b4fa-893ad349079a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:42.587648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-152c1a94-a13c-426b-b4fa-893ad349079a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:42.595413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-152c1a94-a13c-426b-b4fa-893ad349079a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:42.596953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-152c1a94-a13c-426b-b4fa-893ad349079a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:42.598176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-152c1a94-a13c-426b-b4fa-893ad349079a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:42.598811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-152c1a94-a13c-426b-b4fa-893ad349079a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:42.833495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-152c1a94-a13c-426b-b4fa-893ad349079a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:42.854685 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-152c1a94-a13c-426b-b4fa-893ad349079a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.272137 Aug 02 07:04:42.856603 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1886/3662] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:42 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:43.338496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f39af2f7-04d5-4b2b-822e-fda418fe333a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:43.339709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f39af2f7-04d5-4b2b-822e-fda418fe333a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:43.347121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f39af2f7-04d5-4b2b-822e-fda418fe333a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:43.347502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f39af2f7-04d5-4b2b-822e-fda418fe333a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:43.348403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f39af2f7-04d5-4b2b-822e-fda418fe333a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:43.348895 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f39af2f7-04d5-4b2b-822e-fda418fe333a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:43.482616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f39af2f7-04d5-4b2b-822e-fda418fe333a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:43.503099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f39af2f7-04d5-4b2b-822e-fda418fe333a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:43.508634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f39af2f7-04d5-4b2b-822e-fda418fe333a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:43.510089 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f39af2f7-04d5-4b2b-822e-fda418fe333a tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1372 microversion: 2.47 time: 0.176751 Aug 02 07:04:43.511086 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1777/3663] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:43 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:43.626654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1816519125", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "2cc64aa1-331d-4aea-9ba5-17473820657b"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:43.720112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] validate_networks() for [('2cc64aa1-331d-4aea-9ba5-17473820657b', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:04:43.887411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8c749829-d0d7-4960-80d8-a9f3981a47db tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:43.888318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8c749829-d0d7-4960-80d8-a9f3981a47db tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:43.910965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c749829-d0d7-4960-80d8-a9f3981a47db tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:43.913956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c749829-d0d7-4960-80d8-a9f3981a47db tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:43.914865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c749829-d0d7-4960-80d8-a9f3981a47db tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:43.915317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c749829-d0d7-4960-80d8-a9f3981a47db tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:44.385274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8c749829-d0d7-4960-80d8-a9f3981a47db tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:44.398980 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8c749829-d0d7-4960-80d8-a9f3981a47db tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.522430 Aug 02 07:04:44.406330 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1778/3664] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:43 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:44.552054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:04:44.552991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:04:44.554525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:04:44.555183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:04:44.557135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:04:44.561277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a5993efe-5e88-4c6d-abd5-740ebdc595e0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:44.562191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a5993efe-5e88-4c6d-abd5-740ebdc595e0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:44.569348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5993efe-5e88-4c6d-abd5-740ebdc595e0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:44.570106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5993efe-5e88-4c6d-abd5-740ebdc595e0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:44.571123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5993efe-5e88-4c6d-abd5-740ebdc595e0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:44.571729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5993efe-5e88-4c6d-abd5-740ebdc595e0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:44.572150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:44.572629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:44.573857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:44.574709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:44.614581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Getting quotas for project deda8b9458a946bfb8c990689f130cba. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:04:44.631012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Getting quotas for user 0f943927830b498f82bd9881a240f41a and project deda8b9458a946bfb8c990689f130cba. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:04:44.673527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:04:44.680259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:04:44.682100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a5993efe-5e88-4c6d-abd5-740ebdc595e0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:44.693286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a5993efe-5e88-4c6d-abd5-740ebdc595e0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:44.695982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a5993efe-5e88-4c6d-abd5-740ebdc595e0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:44.697609 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a5993efe-5e88-4c6d-abd5-740ebdc595e0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1372 microversion: 2.47 time: 0.142800 Aug 02 07:04:44.702235 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1779/3665] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:44 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:04:44.757950 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2e115be7-e393-4f99-94e6-6dc500d52059 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.135895 Aug 02 07:04:44.758987 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1887/3666] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:04:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 07:04:44.774698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7e58bb62-15ee-4b21-95ae-e1c306a8c800 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:44.775814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7e58bb62-15ee-4b21-95ae-e1c306a8c800 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:44.867985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7e58bb62-15ee-4b21-95ae-e1c306a8c800 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:44.874771 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7e58bb62-15ee-4b21-95ae-e1c306a8c800 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 200 len: 1214 microversion: 2.1 time: 0.105881 Aug 02 07:04:44.875916 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1780/3667] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:44 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:45.447158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e26474aa-17a1-4734-be4b-bf7b0a46db36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:45.448017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e26474aa-17a1-4734-be4b-bf7b0a46db36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:45.454852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:45.458035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e26474aa-17a1-4734-be4b-bf7b0a46db36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:45.458730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e26474aa-17a1-4734-be4b-bf7b0a46db36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:45.459741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e26474aa-17a1-4734-be4b-bf7b0a46db36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:45.460356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e26474aa-17a1-4734-be4b-bf7b0a46db36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:45.744560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-800d0c44-3f11-4479-9ba3-209ea6741b56 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:45.745621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-800d0c44-3f11-4479-9ba3-209ea6741b56 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:45.767793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-800d0c44-3f11-4479-9ba3-209ea6741b56 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:45.768741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-800d0c44-3f11-4479-9ba3-209ea6741b56 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:45.770028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-800d0c44-3f11-4479-9ba3-209ea6741b56 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:45.770710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-800d0c44-3f11-4479-9ba3-209ea6741b56 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:45.810518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e26474aa-17a1-4734-be4b-bf7b0a46db36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:45.825292 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e26474aa-17a1-4734-be4b-bf7b0a46db36 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.382638 Aug 02 07:04:45.844633 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1888/3668] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:45 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:45.899983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-800d0c44-3f11-4479-9ba3-209ea6741b56 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:45.910245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-800d0c44-3f11-4479-9ba3-209ea6741b56 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:45.911869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-800d0c44-3f11-4479-9ba3-209ea6741b56 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:45.913290 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-800d0c44-3f11-4479-9ba3-209ea6741b56 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1357 microversion: 2.47 time: 0.193325 Aug 02 07:04:45.913853 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1781/3669] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:45 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:04:45.924204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b5235d2-f9f7-4642-aa81-b279d781c125 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:45.928974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4b5235d2-f9f7-4642-aa81-b279d781c125 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:45.936816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b5235d2-f9f7-4642-aa81-b279d781c125 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:45.939247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-29f58350-415d-4cb8-be9c-73d8dc222048 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:45.946027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-29f58350-415d-4cb8-be9c-73d8dc222048 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:45.946240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b5235d2-f9f7-4642-aa81-b279d781c125 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:45.947602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-29f58350-415d-4cb8-be9c-73d8dc222048 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Searching by: {'deleted': False, 'project_id': '1d9384342b424d41a9289e91af0cbf6b'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:04:45.947719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b5235d2-f9f7-4642-aa81-b279d781c125 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:45.948211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b5235d2-f9f7-4642-aa81-b279d781c125 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:45.954824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f58350-415d-4cb8-be9c-73d8dc222048 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:45.955520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f58350-415d-4cb8-be9c-73d8dc222048 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:45.956757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f58350-415d-4cb8-be9c-73d8dc222048 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:45.957475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f58350-415d-4cb8-be9c-73d8dc222048 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:46.030379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4b5235d2-f9f7-4642-aa81-b279d781c125 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:46.038688 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4b5235d2-f9f7-4642-aa81-b279d781c125 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 200 len: 1266 microversion: 2.1 time: 0.134757 Aug 02 07:04:46.052888 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1889/3670] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:45 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:04:46.118340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-29f58350-415d-4cb8-be9c-73d8dc222048 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:04:46.222335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-29f58350-415d-4cb8-be9c-73d8dc222048 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:46.232396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f58350-415d-4cb8-be9c-73d8dc222048 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:46.233581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f58350-415d-4cb8-be9c-73d8dc222048 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:46.249538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-29f58350-415d-4cb8-be9c-73d8dc222048 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:46.251633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-29f58350-415d-4cb8-be9c-73d8dc222048 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:46.635601 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-29f58350-415d-4cb8-be9c-73d8dc222048 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.700981 Aug 02 07:04:46.637725 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1782/3671] 10.222.0.79 () {60 vars in 1187 bytes} [Tue Aug 2 07:04:45 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:46.670830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-06438556-83a7-4d5f-a625-ac5ba61ebcc6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:46.671795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-06438556-83a7-4d5f-a625-ac5ba61ebcc6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:46.681933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06438556-83a7-4d5f-a625-ac5ba61ebcc6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:46.682432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06438556-83a7-4d5f-a625-ac5ba61ebcc6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:46.683427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06438556-83a7-4d5f-a625-ac5ba61ebcc6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:46.684118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06438556-83a7-4d5f-a625-ac5ba61ebcc6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:46.736686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-06438556-83a7-4d5f-a625-ac5ba61ebcc6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:04:46.810904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:46.855574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1040e2e2-71f3-4a47-be51-4efa7e929026 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:46.857699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1040e2e2-71f3-4a47-be51-4efa7e929026 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:46.873189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1040e2e2-71f3-4a47-be51-4efa7e929026 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:46.876231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1040e2e2-71f3-4a47-be51-4efa7e929026 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:46.877108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1040e2e2-71f3-4a47-be51-4efa7e929026 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:46.881053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1040e2e2-71f3-4a47-be51-4efa7e929026 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:46.891157 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-06438556-83a7-4d5f-a625-ac5ba61ebcc6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 204 len: 0 microversion: 2.47 time: 0.224560 Aug 02 07:04:46.892422 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1890/3672] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 07:04:46 2022] DELETE /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:04:46.909842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d91136ff-d7e4-48b2-9ab0-b318e9175448 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:46.910987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d91136ff-d7e4-48b2-9ab0-b318e9175448 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:46.925387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d91136ff-d7e4-48b2-9ab0-b318e9175448 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:46.926166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d91136ff-d7e4-48b2-9ab0-b318e9175448 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:46.927542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d91136ff-d7e4-48b2-9ab0-b318e9175448 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:46.929233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d91136ff-d7e4-48b2-9ab0-b318e9175448 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:47.189945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d91136ff-d7e4-48b2-9ab0-b318e9175448 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:47.211020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d91136ff-d7e4-48b2-9ab0-b318e9175448 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:47.213008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d91136ff-d7e4-48b2-9ab0-b318e9175448 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:47.214697 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d91136ff-d7e4-48b2-9ab0-b318e9175448 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1363 microversion: 2.47 time: 0.315534 Aug 02 07:04:47.215600 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1891/3673] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:46 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:47.220077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02f26598-9e1f-4daf-b8f7-504e9b377887 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:47.220713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-02f26598-9e1f-4daf-b8f7-504e9b377887 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:47.241796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02f26598-9e1f-4daf-b8f7-504e9b377887 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:47.242217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02f26598-9e1f-4daf-b8f7-504e9b377887 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:47.243052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02f26598-9e1f-4daf-b8f7-504e9b377887 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:47.243497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02f26598-9e1f-4daf-b8f7-504e9b377887 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:47.320419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1040e2e2-71f3-4a47-be51-4efa7e929026 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:47.334216 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1040e2e2-71f3-4a47-be51-4efa7e929026 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.483092 Aug 02 07:04:47.335241 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1783/3674] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:46 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:47.391705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-02f26598-9e1f-4daf-b8f7-504e9b377887 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:47.402390 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-02f26598-9e1f-4daf-b8f7-504e9b377887 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 200 len: 1272 microversion: 2.1 time: 0.185502 Aug 02 07:04:47.416306 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1892/3675] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:47 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:48.243584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c0be92de-934e-4095-9d6d-bc5b795685f6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:48.244217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c0be92de-934e-4095-9d6d-bc5b795685f6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:48.256387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0be92de-934e-4095-9d6d-bc5b795685f6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:48.257924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0be92de-934e-4095-9d6d-bc5b795685f6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:48.258777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0be92de-934e-4095-9d6d-bc5b795685f6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:48.259223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0be92de-934e-4095-9d6d-bc5b795685f6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:48.366888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1814132706", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:48.377161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c0be92de-934e-4095-9d6d-bc5b795685f6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:48.387611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c0be92de-934e-4095-9d6d-bc5b795685f6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:48.390052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c0be92de-934e-4095-9d6d-bc5b795685f6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:48.390887 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c0be92de-934e-4095-9d6d-bc5b795685f6 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1363 microversion: 2.47 time: 0.151459 Aug 02 07:04:48.391790 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1893/3676] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:48 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:48.397275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-982a5a34-6737-4bea-8b56-67651579b817 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:48.397917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-982a5a34-6737-4bea-8b56-67651579b817 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:48.404556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-982a5a34-6737-4bea-8b56-67651579b817 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:48.405216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-982a5a34-6737-4bea-8b56-67651579b817 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:48.406310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-982a5a34-6737-4bea-8b56-67651579b817 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:48.407843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-982a5a34-6737-4bea-8b56-67651579b817 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:48.445039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:04:48.896621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-982a5a34-6737-4bea-8b56-67651579b817 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:48.913005 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-982a5a34-6737-4bea-8b56-67651579b817 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.519971 Aug 02 07:04:48.914087 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1894/3677] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:48 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:48.920656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-abbfb1c5-1804-4661-bba2-4a4a52d7a21c tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:48.921546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-abbfb1c5-1804-4661-bba2-4a4a52d7a21c tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:48.937075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abbfb1c5-1804-4661-bba2-4a4a52d7a21c tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:48.938609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abbfb1c5-1804-4661-bba2-4a4a52d7a21c tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:48.940685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abbfb1c5-1804-4661-bba2-4a4a52d7a21c tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:48.941937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abbfb1c5-1804-4661-bba2-4a4a52d7a21c tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:49.132519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:04:49.136098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:04:49.136808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:04:49.137219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:04:49.137633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:04:49.149078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:49.149530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:49.150371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:49.150802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:49.179464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Getting quotas for project 9ef001cfe28743b6812f432721c633ea. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:04:49.218401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Getting quotas for user 135c2de316dd4cf7a7d6dda0a1494763 and project 9ef001cfe28743b6812f432721c633ea. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:04:49.258631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:04:49.262033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:04:49.331163 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7a70925b-cf0f-4571-b810-e5c7469300e1 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.193178 Aug 02 07:04:49.332524 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1784/3678] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:04:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 07:04:49.342361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-24349590-ea29-46cc-85e7-5d0ed710d229 req-750e372b-26ec-4145-8e75-14352389563f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b44a46b3-46af-4cdb-a6b9-932248e50fd6", "tag": "1c3699ff-3e5b-4fba-9851-61a69d43bf35"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:49.351902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-abbfb1c5-1804-4661-bba2-4a4a52d7a21c tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:49.359901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-24349590-ea29-46cc-85e7-5d0ed710d229 req-750e372b-26ec-4145-8e75-14352389563f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:49.360587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-24349590-ea29-46cc-85e7-5d0ed710d229 req-750e372b-26ec-4145-8e75-14352389563f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:49.366191 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-abbfb1c5-1804-4661-bba2-4a4a52d7a21c tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 200 len: 1314 microversion: 2.1 time: 0.450737 Aug 02 07:04:49.367047 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1895/3679] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:48 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:49.373478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f12af973-ff9a-47e2-9c7b-4b9e3612e618 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:49.378010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f12af973-ff9a-47e2-9c7b-4b9e3612e618 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:49.390584 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-24349590-ea29-46cc-85e7-5d0ed710d229 req-750e372b-26ec-4145-8e75-14352389563f service nova] Creating event network-changed:1c3699ff-3e5b-4fba-9851-61a69d43bf35 for instance b44a46b3-46af-4cdb-a6b9-932248e50fd6 on n-h2-851337-3 Aug 02 07:04:49.402311 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-24349590-ea29-46cc-85e7-5d0ed710d229 req-750e372b-26ec-4145-8e75-14352389563f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067367 Aug 02 07:04:49.405871 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1785/3680] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:04:49.416194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a4220694-9a12-4445-a289-1a088cae27c7 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:49.422288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a4220694-9a12-4445-a289-1a088cae27c7 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:49.433236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4220694-9a12-4445-a289-1a088cae27c7 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:49.433998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4220694-9a12-4445-a289-1a088cae27c7 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:49.435109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4220694-9a12-4445-a289-1a088cae27c7 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:49.435692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4220694-9a12-4445-a289-1a088cae27c7 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:49.484150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4220694-9a12-4445-a289-1a088cae27c7 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:49.484553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4220694-9a12-4445-a289-1a088cae27c7 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:49.485018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-a4220694-9a12-4445-a289-1a088cae27c7 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lazy-loading 'fault' on Instance uuid 0d3db743-dd39-45f7-a7c8-5f0474aada99 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:04:49.500089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f12af973-ff9a-47e2-9c7b-4b9e3612e618 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:49.511447 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f12af973-ff9a-47e2-9c7b-4b9e3612e618 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1219 microversion: 2.1 time: 0.143140 Aug 02 07:04:49.512755 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1896/3681] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:49 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1219 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:49.569091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a4220694-9a12-4445-a289-1a088cae27c7 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:49.579303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a4220694-9a12-4445-a289-1a088cae27c7 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:49.581284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a4220694-9a12-4445-a289-1a088cae27c7 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:49.583221 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a4220694-9a12-4445-a289-1a088cae27c7 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1368 microversion: 2.47 time: 0.171535 Aug 02 07:04:49.584286 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1786/3682] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:49 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:04:49.939548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-619b9033-432e-4196-8bd2-595d5461fab3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:49.940101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-619b9033-432e-4196-8bd2-595d5461fab3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:49.947814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-619b9033-432e-4196-8bd2-595d5461fab3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:49.948360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-619b9033-432e-4196-8bd2-595d5461fab3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:49.949083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-619b9033-432e-4196-8bd2-595d5461fab3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:49.949520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-619b9033-432e-4196-8bd2-595d5461fab3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:50.097671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-619b9033-432e-4196-8bd2-595d5461fab3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:50.106889 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-619b9033-432e-4196-8bd2-595d5461fab3 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.171124 Aug 02 07:04:50.114489 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1897/3683] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:49 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:50.391830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7958ec90-fc69-453d-a6a8-6468e110a9c3 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:50.392363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7958ec90-fc69-453d-a6a8-6468e110a9c3 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:50.400171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7958ec90-fc69-453d-a6a8-6468e110a9c3 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:50.400628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7958ec90-fc69-453d-a6a8-6468e110a9c3 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:50.401386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7958ec90-fc69-453d-a6a8-6468e110a9c3 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:50.401837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7958ec90-fc69-453d-a6a8-6468e110a9c3 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:50.537116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9b759dee-c62c-48ea-835e-2eb30a72814a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:50.538494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9b759dee-c62c-48ea-835e-2eb30a72814a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:50.546032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b759dee-c62c-48ea-835e-2eb30a72814a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:50.546586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b759dee-c62c-48ea-835e-2eb30a72814a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:50.547504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b759dee-c62c-48ea-835e-2eb30a72814a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:50.548009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b759dee-c62c-48ea-835e-2eb30a72814a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:50.552655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7958ec90-fc69-453d-a6a8-6468e110a9c3 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:50.561066 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7958ec90-fc69-453d-a6a8-6468e110a9c3 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 200 len: 1314 microversion: 2.1 time: 0.173570 Aug 02 07:04:50.561765 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1787/3684] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:50 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:50.613049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9b759dee-c62c-48ea-835e-2eb30a72814a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:50.615107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-becf9dd0-8439-417d-9a53-795d9e89c062 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:50.616076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-becf9dd0-8439-417d-9a53-795d9e89c062 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:50.622494 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9b759dee-c62c-48ea-835e-2eb30a72814a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1223 microversion: 2.1 time: 0.089646 Aug 02 07:04:50.623005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-becf9dd0-8439-417d-9a53-795d9e89c062 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:50.623197 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1898/3685] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:50 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:04:50.634251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-becf9dd0-8439-417d-9a53-795d9e89c062 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:50.634251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-becf9dd0-8439-417d-9a53-795d9e89c062 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:50.634251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-becf9dd0-8439-417d-9a53-795d9e89c062 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:50.674602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-becf9dd0-8439-417d-9a53-795d9e89c062 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:50.675047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-becf9dd0-8439-417d-9a53-795d9e89c062 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:50.675691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-becf9dd0-8439-417d-9a53-795d9e89c062 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lazy-loading 'fault' on Instance uuid 0d3db743-dd39-45f7-a7c8-5f0474aada99 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:04:50.733742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-becf9dd0-8439-417d-9a53-795d9e89c062 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:50.744883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-becf9dd0-8439-417d-9a53-795d9e89c062 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:50.748086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-becf9dd0-8439-417d-9a53-795d9e89c062 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:50.749656 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-becf9dd0-8439-417d-9a53-795d9e89c062 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 200 len: 1368 microversion: 2.47 time: 0.138595 Aug 02 07:04:50.750729 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1788/3686] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:50 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 1368 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:51.129231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab89e087-b8e9-4059-a401-8fe0d5d9e832 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:51.130938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab89e087-b8e9-4059-a401-8fe0d5d9e832 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:51.142064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab89e087-b8e9-4059-a401-8fe0d5d9e832 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:51.142707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab89e087-b8e9-4059-a401-8fe0d5d9e832 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:51.144062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab89e087-b8e9-4059-a401-8fe0d5d9e832 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:51.144588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab89e087-b8e9-4059-a401-8fe0d5d9e832 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:51.417595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab89e087-b8e9-4059-a401-8fe0d5d9e832 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:51.426308 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab89e087-b8e9-4059-a401-8fe0d5d9e832 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.301165 Aug 02 07:04:51.427212 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1899/3687] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:51 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:51.583281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-426ff93b-0e48-4d2e-8e58-942ebf3788ab tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:51.584068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-426ff93b-0e48-4d2e-8e58-942ebf3788ab tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:51.592084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-426ff93b-0e48-4d2e-8e58-942ebf3788ab tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:51.592836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-426ff93b-0e48-4d2e-8e58-942ebf3788ab tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:51.594013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-426ff93b-0e48-4d2e-8e58-942ebf3788ab tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:51.594546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-426ff93b-0e48-4d2e-8e58-942ebf3788ab tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:51.645880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c9e226dd-6c6a-4528-ad1b-231371097a1e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:51.647998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c9e226dd-6c6a-4528-ad1b-231371097a1e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:51.655741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9e226dd-6c6a-4528-ad1b-231371097a1e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:51.656402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9e226dd-6c6a-4528-ad1b-231371097a1e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:51.657573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9e226dd-6c6a-4528-ad1b-231371097a1e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:51.658186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c9e226dd-6c6a-4528-ad1b-231371097a1e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:51.745184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c9e226dd-6c6a-4528-ad1b-231371097a1e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:51.760752 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c9e226dd-6c6a-4528-ad1b-231371097a1e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1271 microversion: 2.1 time: 0.118717 Aug 02 07:04:51.762161 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1900/3688] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:51 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:04:51.782506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-13cd1f66-f915-4a39-bf61-6d61dd2cbeb0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:51.783255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-13cd1f66-f915-4a39-bf61-6d61dd2cbeb0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: 0d3db743-dd39-45f7-a7c8-5f0474aada99] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:51.789397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-426ff93b-0e48-4d2e-8e58-942ebf3788ab tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:51.791310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13cd1f66-f915-4a39-bf61-6d61dd2cbeb0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:51.791719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13cd1f66-f915-4a39-bf61-6d61dd2cbeb0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:51.792881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13cd1f66-f915-4a39-bf61-6d61dd2cbeb0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:51.793382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13cd1f66-f915-4a39-bf61-6d61dd2cbeb0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:51.816274 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-426ff93b-0e48-4d2e-8e58-942ebf3788ab tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 200 len: 1314 microversion: 2.1 time: 0.237469 Aug 02 07:04:51.832854 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-13cd1f66-f915-4a39-bf61-6d61dd2cbeb0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] HTTP exception thrown: Instance 0d3db743-dd39-45f7-a7c8-5f0474aada99 could not be found. Aug 02 07:04:51.835833 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1789/3689] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:51 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-13cd1f66-f915-4a39-bf61-6d61dd2cbeb0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Request method failure captured: Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 HTTP/1.1 Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mxel94podnTRzgT-T7fdGk3eCpud6WWR-rlFN-ANV9U1g_6L2Gbf8PN7vjrrIF850R2Md3ndcf3LDeQktTGP8YZz6-6yWZP0xapwyYcU-j5YakROoJvTKPxll_GcVEYBGoqThMs-njoLt05Kl_clJkVm6dBVQXvQ3U5lmO5cVPcQ4E Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.47 Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 1d9384342b424d41a9289e91af0cbf6b Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerShowV247Test-1649988715 Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1d9384342b424d41a9289e91af0cbf6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d9384342b424d41a9289e91af0cbf6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1d9384342b424d41a9289e91af0cbf6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d9384342b424d41a9289e91af0cbf6b"}]}] Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerShowV247Test-1649988715 Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 1d9384342b424d41a9289e91af0cbf6b Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerShowV247Test-1649988715 Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerShowV247Test-1649988715-project Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a2974660fe394b5e851250d9756f4eaf Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerShowV247Test-1649988715-project Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 0d3db743-dd39-45f7-a7c8-5f0474aada99 could not be found. Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '0d3db743-dd39-45f7-a7c8-5f0474aada99'} Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d3db743-dd39-45f7-a7c8-5f0474aada99 could not be found. Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d3db743-dd39-45f7-a7c8-5f0474aada99 could not be found. Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:04:51.836261 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:51.840230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:51.840230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:04:51.840230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:04:51.840230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:04:51.840230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:04:51.840230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d3db743-dd39-45f7-a7c8-5f0474aada99 could not be found. Aug 02 07:04:51.840230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:51.844978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-13cd1f66-f915-4a39-bf61-6d61dd2cbeb0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Returning 404 to user: Instance 0d3db743-dd39-45f7-a7c8-5f0474aada99 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:04:51.846646 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-13cd1f66-f915-4a39-bf61-6d61dd2cbeb0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99" status: 404 len: 111 microversion: 2.47 time: 0.073566 Aug 02 07:04:51.847520 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1901/3690] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:51 2022] GET /compute/v2.1/servers/0d3db743-dd39-45f7-a7c8-5f0474aada99 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 02 07:04:51.856960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a87cc2d1-8ebd-426e-b2c6-44b8226e9ac0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:51.857504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a87cc2d1-8ebd-426e-b2c6-44b8226e9ac0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:51.864923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a87cc2d1-8ebd-426e-b2c6-44b8226e9ac0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:51.865405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a87cc2d1-8ebd-426e-b2c6-44b8226e9ac0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:51.866582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a87cc2d1-8ebd-426e-b2c6-44b8226e9ac0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:51.867204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a87cc2d1-8ebd-426e-b2c6-44b8226e9ac0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:51.898790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a87cc2d1-8ebd-426e-b2c6-44b8226e9ac0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:04:51.993547 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a87cc2d1-8ebd-426e-b2c6-44b8226e9ac0 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "DELETE /compute/v2.1/servers/be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb" status: 204 len: 0 microversion: 2.47 time: 0.141134 Aug 02 07:04:51.994204 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1790/3691] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 07:04:51 2022] DELETE /compute/v2.1/servers/be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:04:52.003146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-be1b7735-b8dc-4c49-b4f0-f82bab2cc04b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:52.003805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-be1b7735-b8dc-4c49-b4f0-f82bab2cc04b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:52.018093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be1b7735-b8dc-4c49-b4f0-f82bab2cc04b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:52.018828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be1b7735-b8dc-4c49-b4f0-f82bab2cc04b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:52.020807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be1b7735-b8dc-4c49-b4f0-f82bab2cc04b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:52.021260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be1b7735-b8dc-4c49-b4f0-f82bab2cc04b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:52.125038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-be1b7735-b8dc-4c49-b4f0-f82bab2cc04b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:52.137577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-be1b7735-b8dc-4c49-b4f0-f82bab2cc04b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:52.143480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-be1b7735-b8dc-4c49-b4f0-f82bab2cc04b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:52.144908 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-be1b7735-b8dc-4c49-b4f0-f82bab2cc04b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb" status: 200 len: 1362 microversion: 2.47 time: 0.145932 Aug 02 07:04:52.145608 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1902/3692] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:51 2022] GET /compute/v2.1/servers/be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:52.449985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1ac3feb0-5861-4bb7-a164-6c23eb6bff3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:52.450667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1ac3feb0-5861-4bb7-a164-6c23eb6bff3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:52.456717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ac3feb0-5861-4bb7-a164-6c23eb6bff3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:52.457180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ac3feb0-5861-4bb7-a164-6c23eb6bff3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:52.457929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ac3feb0-5861-4bb7-a164-6c23eb6bff3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:52.458367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ac3feb0-5861-4bb7-a164-6c23eb6bff3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:52.651786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1ac3feb0-5861-4bb7-a164-6c23eb6bff3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:52.654193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:52.661990 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1ac3feb0-5861-4bb7-a164-6c23eb6bff3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1737 microversion: 2.1 time: 0.216250 Aug 02 07:04:52.662621 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1791/3693] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:52 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:52.786435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2234ebef-b05b-4731-b6ae-a2dde6c1d657 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:52.787713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2234ebef-b05b-4731-b6ae-a2dde6c1d657 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:52.796331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2234ebef-b05b-4731-b6ae-a2dde6c1d657 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:52.796761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2234ebef-b05b-4731-b6ae-a2dde6c1d657 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:52.797660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2234ebef-b05b-4731-b6ae-a2dde6c1d657 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:52.798155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2234ebef-b05b-4731-b6ae-a2dde6c1d657 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:52.861693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ca8e7b5a-f470-47a3-a9ce-1a56ef997dae tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:52.862746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ca8e7b5a-f470-47a3-a9ce-1a56ef997dae tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:52.874889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca8e7b5a-f470-47a3-a9ce-1a56ef997dae tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:52.875586 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca8e7b5a-f470-47a3-a9ce-1a56ef997dae tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:52.876572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca8e7b5a-f470-47a3-a9ce-1a56ef997dae tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:52.877243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca8e7b5a-f470-47a3-a9ce-1a56ef997dae tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:52.990305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2234ebef-b05b-4731-b6ae-a2dde6c1d657 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:53.002073 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2234ebef-b05b-4731-b6ae-a2dde6c1d657 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1279 microversion: 2.1 time: 0.219872 Aug 02 07:04:53.007809 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1903/3694] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:52 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1279 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:53.025774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2e603bd-e5d5-4366-8aab-8c44cbaa053a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:53.026739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f2e603bd-e5d5-4366-8aab-8c44cbaa053a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:53.035849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2e603bd-e5d5-4366-8aab-8c44cbaa053a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:53.036564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2e603bd-e5d5-4366-8aab-8c44cbaa053a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:53.037505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2e603bd-e5d5-4366-8aab-8c44cbaa053a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:53.038141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2e603bd-e5d5-4366-8aab-8c44cbaa053a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:53.208562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ca8e7b5a-f470-47a3-a9ce-1a56ef997dae tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:53.218016 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ca8e7b5a-f470-47a3-a9ce-1a56ef997dae tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 200 len: 1314 microversion: 2.1 time: 0.381050 Aug 02 07:04:53.219335 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1792/3695] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:52 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:53.224861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8f667686-01e4-41fe-9e04-02f0089cba21 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:53.226024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8f667686-01e4-41fe-9e04-02f0089cba21 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:53.233215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f667686-01e4-41fe-9e04-02f0089cba21 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:53.234044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f667686-01e4-41fe-9e04-02f0089cba21 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:53.235025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f667686-01e4-41fe-9e04-02f0089cba21 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:53.235812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f667686-01e4-41fe-9e04-02f0089cba21 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:53.336686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8f667686-01e4-41fe-9e04-02f0089cba21 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:53.346932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8f667686-01e4-41fe-9e04-02f0089cba21 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:53.349479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8f667686-01e4-41fe-9e04-02f0089cba21 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:53.351345 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8f667686-01e4-41fe-9e04-02f0089cba21 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb" status: 200 len: 1362 microversion: 2.47 time: 0.130672 Aug 02 07:04:53.352143 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1793/3696] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:53 2022] GET /compute/v2.1/servers/be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb => generated 1362 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:53.374599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f2e603bd-e5d5-4366-8aab-8c44cbaa053a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:53.390009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f2e603bd-e5d5-4366-8aab-8c44cbaa053a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:53.391845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f2e603bd-e5d5-4366-8aab-8c44cbaa053a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:53.393191 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f2e603bd-e5d5-4366-8aab-8c44cbaa053a tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 2953 microversion: 2.42 time: 0.383298 Aug 02 07:04:53.393790 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1904/3697] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:53 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 2953 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:53.422358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f16288bf-c431-433f-9057-fad84e1a8ce8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:53.423142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f16288bf-c431-433f-9057-fad84e1a8ce8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:53.430713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f16288bf-c431-433f-9057-fad84e1a8ce8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:53.431318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f16288bf-c431-433f-9057-fad84e1a8ce8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:53.432240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f16288bf-c431-433f-9057-fad84e1a8ce8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:53.432843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f16288bf-c431-433f-9057-fad84e1a8ce8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:53.664416 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f16288bf-c431-433f-9057-fad84e1a8ce8 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.245666 Aug 02 07:04:53.687032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c5f4d1cd-c77b-4add-9c5e-fe1357affb3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:53.687857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c5f4d1cd-c77b-4add-9c5e-fe1357affb3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:53.689449 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1794/3698] 10.222.0.79 () {60 vars in 1316 bytes} [Tue Aug 2 07:04:53 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8/os-interface => generated 1831 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:53.705736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5f4d1cd-c77b-4add-9c5e-fe1357affb3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:53.710472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5f4d1cd-c77b-4add-9c5e-fe1357affb3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:53.711541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5f4d1cd-c77b-4add-9c5e-fe1357affb3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:53.712150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5f4d1cd-c77b-4add-9c5e-fe1357affb3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:53.969990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c5f4d1cd-c77b-4add-9c5e-fe1357affb3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:54.000772 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c5f4d1cd-c77b-4add-9c5e-fe1357affb3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1717 microversion: 2.1 time: 0.318873 Aug 02 07:04:54.004179 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1905/3699] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:53 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1717 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:04:54.030140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-41f1fe85-9414-4e1d-baa7-8149e7f6da9b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:54.031072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-41f1fe85-9414-4e1d-baa7-8149e7f6da9b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:54.038070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41f1fe85-9414-4e1d-baa7-8149e7f6da9b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:54.038624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41f1fe85-9414-4e1d-baa7-8149e7f6da9b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:54.039694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41f1fe85-9414-4e1d-baa7-8149e7f6da9b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:54.040343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41f1fe85-9414-4e1d-baa7-8149e7f6da9b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:54.148298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-41f1fe85-9414-4e1d-baa7-8149e7f6da9b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:54.161216 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-41f1fe85-9414-4e1d-baa7-8149e7f6da9b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1277 microversion: 2.1 time: 0.135192 Aug 02 07:04:54.174120 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1795/3700] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:54 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:54.240051 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d2e18c90-cd91-4933-9ff9-1ab99037303a tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:54.240663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d2e18c90-cd91-4933-9ff9-1ab99037303a tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:54.250123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2e18c90-cd91-4933-9ff9-1ab99037303a tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:54.250923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2e18c90-cd91-4933-9ff9-1ab99037303a tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:54.251858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2e18c90-cd91-4933-9ff9-1ab99037303a tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:54.252441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2e18c90-cd91-4933-9ff9-1ab99037303a tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:54.275603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9a4dd21f-b7ba-4a0b-8e81-36c26576fa8d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:54.276302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9a4dd21f-b7ba-4a0b-8e81-36c26576fa8d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:54.283903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a4dd21f-b7ba-4a0b-8e81-36c26576fa8d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:54.284361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a4dd21f-b7ba-4a0b-8e81-36c26576fa8d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:54.285165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a4dd21f-b7ba-4a0b-8e81-36c26576fa8d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:54.289756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a4dd21f-b7ba-4a0b-8e81-36c26576fa8d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:54.432879 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-9a4dd21f-b7ba-4a0b-8e81-36c26576fa8d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] HTTP exception thrown: Cannot 'detach_volume' instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 while it is in vm_state rescued Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9a4dd21f-b7ba-4a0b-8e81-36c26576fa8d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Request method failure captured: Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments/1a60df81-f1c7-4d0d-8ef2-f6090d459fac HTTP/1.1 Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MuV9Q5BOG4bZSTn8mNA1jfjLBve4d8RpXHrEXh4dSRfQwoHnO2CX5TWJr_Ybphxlmnei--H-24HQZ2VBGVtXb7ed4xsT9rh6T-B0ctcoWXMM-9zRQgu-z2imnNm8CiRJJUKFATn8QRgKDRSh1174_Xj_fjEsdTPEI1eutLUtYEoOkA Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}] Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b9ad5424586247019d4374f52600ea51 Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: exception: Cannot 'detach_volume' instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 while it is in vm_state rescued Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'server_id': '4cf3144f-9803-4cba-9569-a5113e7e59d7', 'id': '1a60df81-f1c7-4d0d-8ef2-f6090d459fac'} Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 while it is in vm_state rescued Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:54.434821 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:54.438804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:04:54.438804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:04:54.438804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:04:54.438804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:04:54.438804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 while it is in vm_state rescued Aug 02 07:04:54.438804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:04:54.440106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9a4dd21f-b7ba-4a0b-8e81-36c26576fa8d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Returning 409 to user: Cannot 'detach_volume' instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 while it is in vm_state rescued {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:04:54.441222 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9a4dd21f-b7ba-4a0b-8e81-36c26576fa8d tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments/1a60df81-f1c7-4d0d-8ef2-f6090d459fac" status: 409 len: 152 microversion: 2.1 time: 0.170151 Aug 02 07:04:54.442092 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1796/3701] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:04:54 2022] DELETE /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments/1a60df81-f1c7-4d0d-8ef2-f6090d459fac => generated 152 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 02 07:04:54.450452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-44c52f9e-ed96-4429-bad9-232eebc859e1 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:54.452083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-44c52f9e-ed96-4429-bad9-232eebc859e1 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:54.460109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44c52f9e-ed96-4429-bad9-232eebc859e1 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:54.460937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44c52f9e-ed96-4429-bad9-232eebc859e1 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:54.462032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44c52f9e-ed96-4429-bad9-232eebc859e1 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:54.462615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44c52f9e-ed96-4429-bad9-232eebc859e1 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:54.500286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d2e18c90-cd91-4933-9ff9-1ab99037303a tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:54.511199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44c52f9e-ed96-4429-bad9-232eebc859e1 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:54.513206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44c52f9e-ed96-4429-bad9-232eebc859e1 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:54.514001 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d2e18c90-cd91-4933-9ff9-1ab99037303a tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 200 len: 1314 microversion: 2.1 time: 0.277622 Aug 02 07:04:54.514324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-44c52f9e-ed96-4429-bad9-232eebc859e1 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lazy-loading 'fault' on Instance uuid be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:04:54.523876 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1906/3702] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:54 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:54.533581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a5172a8-c953-4ef5-82b5-8486618c0b50 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:54.534176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8a5172a8-c953-4ef5-82b5-8486618c0b50 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:54.558306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a5172a8-c953-4ef5-82b5-8486618c0b50 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:54.559871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a5172a8-c953-4ef5-82b5-8486618c0b50 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:54.562951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a5172a8-c953-4ef5-82b5-8486618c0b50 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:54.564332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a5172a8-c953-4ef5-82b5-8486618c0b50 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:54.575692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44c52f9e-ed96-4429-bad9-232eebc859e1 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:54.586125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44c52f9e-ed96-4429-bad9-232eebc859e1 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:54.588564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44c52f9e-ed96-4429-bad9-232eebc859e1 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2974660fe394b5e851250d9756f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9384342b424d41a9289e91af0cbf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:54.590288 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-44c52f9e-ed96-4429-bad9-232eebc859e1 tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb" status: 200 len: 1367 microversion: 2.47 time: 0.146791 Aug 02 07:04:54.591163 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1797/3703] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:54 2022] GET /compute/v2.1/servers/be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:04:54.607450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:54.684090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:54.743641 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8a5172a8-c953-4ef5-82b5-8486618c0b50 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/action" status: 202 len: 0 microversion: 2.1 time: 0.217403 Aug 02 07:04:54.748364 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1907/3704] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:04:54 2022] POST /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:04:54.754555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-81c590fa-41bb-420e-bfa8-bb73c1fc0969 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:54.755736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-81c590fa-41bb-420e-bfa8-bb73c1fc0969 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:54.775730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81c590fa-41bb-420e-bfa8-bb73c1fc0969 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:54.783702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81c590fa-41bb-420e-bfa8-bb73c1fc0969 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:54.784934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81c590fa-41bb-420e-bfa8-bb73c1fc0969 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:54.786576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-81c590fa-41bb-420e-bfa8-bb73c1fc0969 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:55.006983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-81c590fa-41bb-420e-bfa8-bb73c1fc0969 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:55.025830 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-81c590fa-41bb-420e-bfa8-bb73c1fc0969 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1725 microversion: 2.1 time: 0.276430 Aug 02 07:04:55.026295 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1798/3705] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:54 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:04:55.186171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7fb56d67-a718-4524-a90f-35657a9775af tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:55.187667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7fb56d67-a718-4524-a90f-35657a9775af tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:55.196721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7fb56d67-a718-4524-a90f-35657a9775af tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:55.197529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7fb56d67-a718-4524-a90f-35657a9775af tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:55.198626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7fb56d67-a718-4524-a90f-35657a9775af tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:55.199552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7fb56d67-a718-4524-a90f-35657a9775af tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:55.408658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7fb56d67-a718-4524-a90f-35657a9775af tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:55.423195 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7fb56d67-a718-4524-a90f-35657a9775af tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1319 microversion: 2.1 time: 0.242322 Aug 02 07:04:55.433711 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1908/3706] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:55 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:55.538773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3a35da87-6174-4e34-a263-f9f8bea0b44f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:55.539395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3a35da87-6174-4e34-a263-f9f8bea0b44f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:55.555283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a35da87-6174-4e34-a263-f9f8bea0b44f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:55.555742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a35da87-6174-4e34-a263-f9f8bea0b44f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:55.556604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a35da87-6174-4e34-a263-f9f8bea0b44f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:55.557159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a35da87-6174-4e34-a263-f9f8bea0b44f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:55.621173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83cdcc0f-ef4d-485a-926c-7af66105a56b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:55.622702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-83cdcc0f-ef4d-485a-926c-7af66105a56b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] [instance: be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:55.633573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83cdcc0f-ef4d-485a-926c-7af66105a56b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:55.634059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83cdcc0f-ef4d-485a-926c-7af66105a56b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:55.635028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83cdcc0f-ef4d-485a-926c-7af66105a56b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:55.635616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83cdcc0f-ef4d-485a-926c-7af66105a56b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:55.663863 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-83cdcc0f-ef4d-485a-926c-7af66105a56b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] HTTP exception thrown: Instance be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb could not be found. Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83cdcc0f-ef4d-485a-926c-7af66105a56b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Request method failure captured: Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb HTTP/1.1 Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mxel94podnTRzgT-T7fdGk3eCpud6WWR-rlFN-ANV9U1g_6L2Gbf8PN7vjrrIF850R2Md3ndcf3LDeQktTGP8YZz6-6yWZP0xapwyYcU-j5YakROoJvTKPxll_GcVEYBGoqThMs-njoLt05Kl_clJkVm6dBVQXvQ3U5lmO5cVPcQ4E Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.47 Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 1d9384342b424d41a9289e91af0cbf6b Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerShowV247Test-1649988715 Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1d9384342b424d41a9289e91af0cbf6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d9384342b424d41a9289e91af0cbf6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1d9384342b424d41a9289e91af0cbf6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d9384342b424d41a9289e91af0cbf6b"}]}] Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerShowV247Test-1649988715 Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 1d9384342b424d41a9289e91af0cbf6b Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerShowV247Test-1649988715 Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerShowV247Test-1649988715-project Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a2974660fe394b5e851250d9756f4eaf Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerShowV247Test-1649988715-project Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb could not be found. Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb'} Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb could not be found. Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb could not be found. Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:04:55.666405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:55.670623 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:04:55.670623 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:04:55.670623 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:04:55.670623 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:04:55.670623 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:04:55.670623 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb could not be found. Aug 02 07:04:55.670623 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:04:55.672199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83cdcc0f-ef4d-485a-926c-7af66105a56b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] Returning 404 to user: Instance be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:04:55.673316 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-83cdcc0f-ef4d-485a-926c-7af66105a56b tempest-ServerShowV247Test-1649988715 tempest-ServerShowV247Test-1649988715-project] 10.222.0.79 "GET /compute/v2.1/servers/be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb" status: 404 len: 111 microversion: 2.47 time: 0.056975 Aug 02 07:04:55.674559 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1909/3707] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:04:55 2022] GET /compute/v2.1/servers/be0a95ad-96cc-4a2f-b862-77c5b9fd2ddb => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:04:55.817623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3a35da87-6174-4e34-a263-f9f8bea0b44f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:55.834191 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3a35da87-6174-4e34-a263-f9f8bea0b44f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 200 len: 1314 microversion: 2.1 time: 0.300126 Aug 02 07:04:55.836306 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1799/3708] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:55 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:55.981236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-895e10e2-fb93-4d89-b9ae-612176f8c4c7 req-85bcf883-6a3c-42f4-80b3-b064e6c52919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44a46b3-46af-4cdb-a6b9-932248e50fd6", "name": "network-vif-plugged", "status": "completed", "tag": "1c3699ff-3e5b-4fba-9851-61a69d43bf35"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:55.998225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-fe18ac21-c04c-4166-a3e3-88c54d0e5112 req-935c279c-3165-4750-aa4e-cda6eb736703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd", "tag": "74652927-c9ec-4f70-8098-e3b4e312e343"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:04:55.999153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-895e10e2-fb93-4d89-b9ae-612176f8c4c7 req-85bcf883-6a3c-42f4-80b3-b064e6c52919 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:56.000014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-895e10e2-fb93-4d89-b9ae-612176f8c4c7 req-85bcf883-6a3c-42f4-80b3-b064e6c52919 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:56.019239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fe18ac21-c04c-4166-a3e3-88c54d0e5112 req-935c279c-3165-4750-aa4e-cda6eb736703 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:56.019986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fe18ac21-c04c-4166-a3e3-88c54d0e5112 req-935c279c-3165-4750-aa4e-cda6eb736703 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:56.030384 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-895e10e2-fb93-4d89-b9ae-612176f8c4c7 req-85bcf883-6a3c-42f4-80b3-b064e6c52919 service nova] Creating event network-vif-plugged:1c3699ff-3e5b-4fba-9851-61a69d43bf35 for instance b44a46b3-46af-4cdb-a6b9-932248e50fd6 on n-h2-851337-3 Aug 02 07:04:56.038414 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-895e10e2-fb93-4d89-b9ae-612176f8c4c7 req-85bcf883-6a3c-42f4-80b3-b064e6c52919 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064279 Aug 02 07:04:56.039363 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1910/3709] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:04:56.050149 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-fe18ac21-c04c-4166-a3e3-88c54d0e5112 req-935c279c-3165-4750-aa4e-cda6eb736703 service nova] Creating event network-changed:74652927-c9ec-4f70-8098-e3b4e312e343 for instance 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd on n-h1-851337-3 Aug 02 07:04:56.061043 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-fe18ac21-c04c-4166-a3e3-88c54d0e5112 req-935c279c-3165-4750-aa4e-cda6eb736703 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066674 Aug 02 07:04:56.064167 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1800/3710] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:04:56.064595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0ba99dcc-d245-4273-9dcc-c73baedeb14e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:56.065935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0ba99dcc-d245-4273-9dcc-c73baedeb14e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:56.077427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ba99dcc-d245-4273-9dcc-c73baedeb14e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:56.078158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ba99dcc-d245-4273-9dcc-c73baedeb14e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:56.080019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ba99dcc-d245-4273-9dcc-c73baedeb14e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:56.080578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ba99dcc-d245-4273-9dcc-c73baedeb14e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:56.347684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0ba99dcc-d245-4273-9dcc-c73baedeb14e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:56.358784 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0ba99dcc-d245-4273-9dcc-c73baedeb14e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1725 microversion: 2.1 time: 0.306963 Aug 02 07:04:56.359380 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1911/3711] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:56 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1725 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:56.452561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d07d7565-4897-4ed5-b54f-1056a4539010 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:56.453518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d07d7565-4897-4ed5-b54f-1056a4539010 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:56.460613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d07d7565-4897-4ed5-b54f-1056a4539010 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:56.461053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d07d7565-4897-4ed5-b54f-1056a4539010 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:56.461834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d07d7565-4897-4ed5-b54f-1056a4539010 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:56.462312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d07d7565-4897-4ed5-b54f-1056a4539010 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:56.675659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d07d7565-4897-4ed5-b54f-1056a4539010 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:56.686935 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d07d7565-4897-4ed5-b54f-1056a4539010 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1319 microversion: 2.1 time: 0.239306 Aug 02 07:04:56.688147 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1801/3712] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:56 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:56.863374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cf834365-e54c-4cb7-94cb-26cda0b24f63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:56.864089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cf834365-e54c-4cb7-94cb-26cda0b24f63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:56.871667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf834365-e54c-4cb7-94cb-26cda0b24f63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:56.871667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf834365-e54c-4cb7-94cb-26cda0b24f63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:56.872423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf834365-e54c-4cb7-94cb-26cda0b24f63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:56.872856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf834365-e54c-4cb7-94cb-26cda0b24f63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:57.070367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cf834365-e54c-4cb7-94cb-26cda0b24f63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:57.081799 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cf834365-e54c-4cb7-94cb-26cda0b24f63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 200 len: 1314 microversion: 2.1 time: 0.222603 Aug 02 07:04:57.088084 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1912/3713] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:56 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:57.383600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a86ca524-bb49-456f-8f96-d3ebc35d81ad tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:57.386363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a86ca524-bb49-456f-8f96-d3ebc35d81ad tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:57.394704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a86ca524-bb49-456f-8f96-d3ebc35d81ad tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:57.395580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a86ca524-bb49-456f-8f96-d3ebc35d81ad tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:57.396647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a86ca524-bb49-456f-8f96-d3ebc35d81ad tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:57.397281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a86ca524-bb49-456f-8f96-d3ebc35d81ad tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:57.679137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a86ca524-bb49-456f-8f96-d3ebc35d81ad tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:57.692335 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a86ca524-bb49-456f-8f96-d3ebc35d81ad tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1725 microversion: 2.1 time: 0.314492 Aug 02 07:04:57.694014 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1802/3714] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:57 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1725 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:57.710678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0aa5c02d-491f-4d9d-8f84-2c92db1f303d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:57.712147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0aa5c02d-491f-4d9d-8f84-2c92db1f303d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:57.721608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0aa5c02d-491f-4d9d-8f84-2c92db1f303d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:57.722450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0aa5c02d-491f-4d9d-8f84-2c92db1f303d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:57.723675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0aa5c02d-491f-4d9d-8f84-2c92db1f303d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:57.724336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0aa5c02d-491f-4d9d-8f84-2c92db1f303d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:57.908680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0aa5c02d-491f-4d9d-8f84-2c92db1f303d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:57.917657 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0aa5c02d-491f-4d9d-8f84-2c92db1f303d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1319 microversion: 2.1 time: 0.212372 Aug 02 07:04:57.918307 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1913/3715] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:57 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:58.114346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4c21bdd5-ee58-4dd5-9009-b5faa9557105 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:58.115048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4c21bdd5-ee58-4dd5-9009-b5faa9557105 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:58.122872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c21bdd5-ee58-4dd5-9009-b5faa9557105 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:58.125757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c21bdd5-ee58-4dd5-9009-b5faa9557105 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:58.125757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c21bdd5-ee58-4dd5-9009-b5faa9557105 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:58.125757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c21bdd5-ee58-4dd5-9009-b5faa9557105 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:58.355044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4c21bdd5-ee58-4dd5-9009-b5faa9557105 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:58.365194 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4c21bdd5-ee58-4dd5-9009-b5faa9557105 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 200 len: 1498 microversion: 2.1 time: 0.255587 Aug 02 07:04:58.377484 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1803/3716] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:58 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 1498 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:58.719329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-801d5432-159e-45dc-9362-1171e6b11385 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:58.720119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-801d5432-159e-45dc-9362-1171e6b11385 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:58.728396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-801d5432-159e-45dc-9362-1171e6b11385 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:58.728659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-801d5432-159e-45dc-9362-1171e6b11385 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:58.729804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-801d5432-159e-45dc-9362-1171e6b11385 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:58.730426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-801d5432-159e-45dc-9362-1171e6b11385 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:58.944601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7b74e5b2-7190-40fa-baf8-a6f40be93b94 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:58.945784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7b74e5b2-7190-40fa-baf8-a6f40be93b94 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:58.957018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b74e5b2-7190-40fa-baf8-a6f40be93b94 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:58.957719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b74e5b2-7190-40fa-baf8-a6f40be93b94 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:58.958758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b74e5b2-7190-40fa-baf8-a6f40be93b94 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:58.959345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b74e5b2-7190-40fa-baf8-a6f40be93b94 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:59.012636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-801d5432-159e-45dc-9362-1171e6b11385 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:59.025794 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-801d5432-159e-45dc-9362-1171e6b11385 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1731 microversion: 2.1 time: 0.311681 Aug 02 07:04:59.026922 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1914/3717] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:58 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1731 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:04:59.059897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0969f04f-fe25-411b-9338-c81a0b30422e tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:59.060692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0969f04f-fe25-411b-9338-c81a0b30422e tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:59.068108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0969f04f-fe25-411b-9338-c81a0b30422e tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:59.069198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0969f04f-fe25-411b-9338-c81a0b30422e tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:59.070101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0969f04f-fe25-411b-9338-c81a0b30422e tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:59.070620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0969f04f-fe25-411b-9338-c81a0b30422e tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:59.102960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0969f04f-fe25-411b-9338-c81a0b30422e tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:04:59.164299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:59.215511 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0969f04f-fe25-411b-9338-c81a0b30422e tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 204 len: 0 microversion: 2.1 time: 0.160116 Aug 02 07:04:59.218154 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1915/3718] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:04:59 2022] DELETE /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:04:59.229848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-918fe334-49b4-4f59-b211-6e04c673d718 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:59.230467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-918fe334-49b4-4f59-b211-6e04c673d718 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:59.232825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7b74e5b2-7190-40fa-baf8-a6f40be93b94 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:59.237472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-918fe334-49b4-4f59-b211-6e04c673d718 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:59.237990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-918fe334-49b4-4f59-b211-6e04c673d718 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:59.238778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-918fe334-49b4-4f59-b211-6e04c673d718 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:59.239216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-918fe334-49b4-4f59-b211-6e04c673d718 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:59.245493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=10 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:04:59.254611 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7b74e5b2-7190-40fa-baf8-a6f40be93b94 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1319 microversion: 2.1 time: 0.316009 Aug 02 07:04:59.268731 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1804/3719] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:58 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:04:59.283632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f8427983-41ff-4cf3-bbcf-f7b48aff0878 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:04:59.287233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f8427983-41ff-4cf3-bbcf-f7b48aff0878 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:04:59.300097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f8427983-41ff-4cf3-bbcf-f7b48aff0878 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:59.301224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f8427983-41ff-4cf3-bbcf-f7b48aff0878 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:59.302597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f8427983-41ff-4cf3-bbcf-f7b48aff0878 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:04:59.309632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f8427983-41ff-4cf3-bbcf-f7b48aff0878 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:04:59.386692 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-918fe334-49b4-4f59-b211-6e04c673d718 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161929 Aug 02 07:04:59.388251 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1916/3720] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 07:04:59 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:04:59.571292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f8427983-41ff-4cf3-bbcf-f7b48aff0878 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:04:59.584698 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f8427983-41ff-4cf3-bbcf-f7b48aff0878 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 200 len: 1504 microversion: 2.1 time: 0.313607 Aug 02 07:04:59.598539 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1805/3721] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:04:59 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:00.283138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2608f374-dd24-4f67-9276-22e451dba452 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:00.283942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2608f374-dd24-4f67-9276-22e451dba452 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:00.286762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:00.306045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2608f374-dd24-4f67-9276-22e451dba452 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:00.307861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2608f374-dd24-4f67-9276-22e451dba452 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:00.309425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2608f374-dd24-4f67-9276-22e451dba452 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:00.310352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2608f374-dd24-4f67-9276-22e451dba452 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:00.621086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ddeb2912-5856-4b38-853b-46bac727b401 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:00.622048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ddeb2912-5856-4b38-853b-46bac727b401 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:00.656509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ddeb2912-5856-4b38-853b-46bac727b401 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:00.657295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ddeb2912-5856-4b38-853b-46bac727b401 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:00.659036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ddeb2912-5856-4b38-853b-46bac727b401 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:00.659834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ddeb2912-5856-4b38-853b-46bac727b401 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:01.029424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2608f374-dd24-4f67-9276-22e451dba452 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:01.041716 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2608f374-dd24-4f67-9276-22e451dba452 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1319 microversion: 2.1 time: 0.765274 Aug 02 07:05:01.068710 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1917/3722] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:00 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1319 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:01.369681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ddeb2912-5856-4b38-853b-46bac727b401 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:01.378945 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ddeb2912-5856-4b38-853b-46bac727b401 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 200 len: 1504 microversion: 2.1 time: 0.764550 Aug 02 07:05:01.381087 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1806/3723] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:00 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 1504 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:01.990840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-28c9c701-0656-4b11-a18f-df1800cf2b0b req-dbc5274d-8738-4bff-96aa-f22c2df40ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44a46b3-46af-4cdb-a6b9-932248e50fd6", "name": "network-vif-deleted", "tag": "1c3699ff-3e5b-4fba-9851-61a69d43bf35"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:02.006608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-28c9c701-0656-4b11-a18f-df1800cf2b0b req-dbc5274d-8738-4bff-96aa-f22c2df40ec9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:02.007325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-28c9c701-0656-4b11-a18f-df1800cf2b0b req-dbc5274d-8738-4bff-96aa-f22c2df40ec9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:02.028810 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-28c9c701-0656-4b11-a18f-df1800cf2b0b req-dbc5274d-8738-4bff-96aa-f22c2df40ec9 service nova] Creating event network-vif-deleted:1c3699ff-3e5b-4fba-9851-61a69d43bf35 for instance b44a46b3-46af-4cdb-a6b9-932248e50fd6 on n-h2-851337-3 Aug 02 07:05:02.042551 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-28c9c701-0656-4b11-a18f-df1800cf2b0b req-dbc5274d-8738-4bff-96aa-f22c2df40ec9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055300 Aug 02 07:05:02.044076 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1918/3724] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:02.086076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0c5e67c3-dff0-49b7-a03f-af44bd15d71d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:02.087271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0c5e67c3-dff0-49b7-a03f-af44bd15d71d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:02.107884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c5e67c3-dff0-49b7-a03f-af44bd15d71d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:02.108584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c5e67c3-dff0-49b7-a03f-af44bd15d71d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:02.111451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c5e67c3-dff0-49b7-a03f-af44bd15d71d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:02.112470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0c5e67c3-dff0-49b7-a03f-af44bd15d71d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:02.308764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0c5e67c3-dff0-49b7-a03f-af44bd15d71d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:02.319486 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0c5e67c3-dff0-49b7-a03f-af44bd15d71d tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1319 microversion: 2.1 time: 0.244334 Aug 02 07:05:02.320091 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1807/3725] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:02 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:02.407063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4a29316d-a3cf-42e0-8f56-bbb5d3797e63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:02.407748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4a29316d-a3cf-42e0-8f56-bbb5d3797e63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:02.416423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a29316d-a3cf-42e0-8f56-bbb5d3797e63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:02.416876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a29316d-a3cf-42e0-8f56-bbb5d3797e63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:02.418512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a29316d-a3cf-42e0-8f56-bbb5d3797e63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:02.418944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a29316d-a3cf-42e0-8f56-bbb5d3797e63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:02.500908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a29316d-a3cf-42e0-8f56-bbb5d3797e63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:02.501597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a29316d-a3cf-42e0-8f56-bbb5d3797e63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:02.502112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-4a29316d-a3cf-42e0-8f56-bbb5d3797e63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lazy-loading 'fault' on Instance uuid b44a46b3-46af-4cdb-a6b9-932248e50fd6 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:05:02.577604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4a29316d-a3cf-42e0-8f56-bbb5d3797e63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:02.589428 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4a29316d-a3cf-42e0-8f56-bbb5d3797e63 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 200 len: 1304 microversion: 2.1 time: 0.186966 Aug 02 07:05:02.592200 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1919/3726] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:02 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 1304 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:02.664640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a4a85b90-8a41-417a-b191-b01f50f0a4c2 req-b3b97292-66b6-4477-b6d6-28d756703bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf3144f-9803-4cba-9569-a5113e7e59d7", "tag": "a1b65bba-6618-46d5-aeef-29ac67630aff"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:02.677391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a4a85b90-8a41-417a-b191-b01f50f0a4c2 req-b3b97292-66b6-4477-b6d6-28d756703bc4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:02.678191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a4a85b90-8a41-417a-b191-b01f50f0a4c2 req-b3b97292-66b6-4477-b6d6-28d756703bc4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:02.712829 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a4a85b90-8a41-417a-b191-b01f50f0a4c2 req-b3b97292-66b6-4477-b6d6-28d756703bc4 service nova] Creating event network-changed:a1b65bba-6618-46d5-aeef-29ac67630aff for instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 on n-h1-851337-3 Aug 02 07:05:02.727651 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a4a85b90-8a41-417a-b191-b01f50f0a4c2 req-b3b97292-66b6-4477-b6d6-28d756703bc4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065153 Aug 02 07:05:02.731999 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1808/3727] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:03.343217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-38611706-b6c3-4346-97ad-b64036aa4d1f tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:03.345121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-38611706-b6c3-4346-97ad-b64036aa4d1f tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:03.354102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38611706-b6c3-4346-97ad-b64036aa4d1f tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:03.354947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38611706-b6c3-4346-97ad-b64036aa4d1f tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:03.356478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38611706-b6c3-4346-97ad-b64036aa4d1f tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:03.357570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38611706-b6c3-4346-97ad-b64036aa4d1f tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:03.623394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-71ae204a-8610-4112-af4e-4a8c7742a0ec tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:03.623993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-71ae204a-8610-4112-af4e-4a8c7742a0ec tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: b44a46b3-46af-4cdb-a6b9-932248e50fd6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:03.639048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71ae204a-8610-4112-af4e-4a8c7742a0ec tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:03.640325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71ae204a-8610-4112-af4e-4a8c7742a0ec tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:03.642873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71ae204a-8610-4112-af4e-4a8c7742a0ec tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:03.644295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71ae204a-8610-4112-af4e-4a8c7742a0ec tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:03.686525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-38611706-b6c3-4346-97ad-b64036aa4d1f tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:03.695004 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-38611706-b6c3-4346-97ad-b64036aa4d1f tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1319 microversion: 2.1 time: 0.356944 Aug 02 07:05:03.699039 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1920/3728] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:03 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:03.707820 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-71ae204a-8610-4112-af4e-4a8c7742a0ec tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] HTTP exception thrown: Instance b44a46b3-46af-4cdb-a6b9-932248e50fd6 could not be found. Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-71ae204a-8610-4112-af4e-4a8c7742a0ec tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Request method failure captured: Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 HTTP/1.1 Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MyIollb-NjMd_2WW1rUdLuNm8JfAuIG7lxCdnrN0TwW8Ympj5EvYLzjxijv3jahB5nZTUWl9rEWrLFsQjm3tgXSSIakxELJr-Y9Hefr5bQn69sG1cAyG7jlGpZgoM1nK3CajrXgKIk-WFQVTTD4tgWuPF-W1Dc6cGfqTS6d_KoV7gQ Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: deda8b9458a946bfb8c990689f130cba Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-VolumesActionsTest-1437486429 Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/deda8b9458a946bfb8c990689f130cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/deda8b9458a946bfb8c990689f130cba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_deda8b9458a946bfb8c990689f130cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/deda8b9458a946bfb8c990689f130cba"}]}] Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-VolumesActionsTest-1437486429 Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: deda8b9458a946bfb8c990689f130cba Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-VolumesActionsTest-1437486429 Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-VolumesActionsTest-1437486429-project Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0f943927830b498f82bd9881a240f41a Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-VolumesActionsTest-1437486429-project Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance b44a46b3-46af-4cdb-a6b9-932248e50fd6 could not be found. Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'b44a46b3-46af-4cdb-a6b9-932248e50fd6'} Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b44a46b3-46af-4cdb-a6b9-932248e50fd6 could not be found. Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b44a46b3-46af-4cdb-a6b9-932248e50fd6 could not be found. Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:05:03.713577 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:03.720447 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:03.720447 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:05:03.720447 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:05:03.720447 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:05:03.720447 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:05:03.720447 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b44a46b3-46af-4cdb-a6b9-932248e50fd6 could not be found. Aug 02 07:05:03.720447 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:03.723773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-71ae204a-8610-4112-af4e-4a8c7742a0ec tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Returning 404 to user: Instance b44a46b3-46af-4cdb-a6b9-932248e50fd6 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:05:03.725455 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-71ae204a-8610-4112-af4e-4a8c7742a0ec tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6" status: 404 len: 111 microversion: 2.1 time: 0.107597 Aug 02 07:05:03.727397 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1809/3729] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:03 2022] GET /compute/v2.1/servers/b44a46b3-46af-4cdb-a6b9-932248e50fd6 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:05:03.980918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1273889856", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "2cc64aa1-331d-4aea-9ba5-17473820657b"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:04.096392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] validate_networks() for [('2cc64aa1-331d-4aea-9ba5-17473820657b', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:05:04.723443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e3af081a-d784-4e22-a429-5b967e9fcfad tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:04.724128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e3af081a-d784-4e22-a429-5b967e9fcfad tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:04.742647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:04.745350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3af081a-d784-4e22-a429-5b967e9fcfad tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:04.746041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3af081a-d784-4e22-a429-5b967e9fcfad tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:04.747012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3af081a-d784-4e22-a429-5b967e9fcfad tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:04.747627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3af081a-d784-4e22-a429-5b967e9fcfad tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:04.801100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:04.996435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:05:04.997811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:05:05.001508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:05:05.002198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:05:05.002828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:05:05.051057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:05.052278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:05.058823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:05.061159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:05.114769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Getting quotas for project deda8b9458a946bfb8c990689f130cba. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:05:05.128534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Getting quotas for user 0f943927830b498f82bd9881a240f41a and project deda8b9458a946bfb8c990689f130cba. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:05:05.149216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:05:05.151795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:05:05.171792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e3af081a-d784-4e22-a429-5b967e9fcfad tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:05.186589 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e3af081a-d784-4e22-a429-5b967e9fcfad tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1319 microversion: 2.1 time: 0.468737 Aug 02 07:05:05.189677 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1810/3730] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:04 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:05.195820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-29209e73-a839-45cb-85b0-97a30a704eae req-62313d01-5134-4937-bfc8-5707a9b06947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf3144f-9803-4cba-9569-a5113e7e59d7", "tag": "a1b65bba-6618-46d5-aeef-29ac67630aff"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:05.219242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-29209e73-a839-45cb-85b0-97a30a704eae req-62313d01-5134-4937-bfc8-5707a9b06947 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:05.220117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-29209e73-a839-45cb-85b0-97a30a704eae req-62313d01-5134-4937-bfc8-5707a9b06947 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:05.234374 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-29209e73-a839-45cb-85b0-97a30a704eae req-62313d01-5134-4937-bfc8-5707a9b06947 service nova] Creating event network-changed:a1b65bba-6618-46d5-aeef-29ac67630aff for instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 on n-h1-851337-3 Aug 02 07:05:05.239367 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-233a52e7-63e5-474c-8f97-17398fa88e7f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.261741 Aug 02 07:05:05.240898 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1921/3731] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:05:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:05:05.241402 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-29209e73-a839-45cb-85b0-97a30a704eae req-62313d01-5134-4937-bfc8-5707a9b06947 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050006 Aug 02 07:05:05.242585 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1811/3732] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:05.248775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-454e66c6-e5dc-49cf-8aaa-b6262e916c1c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:05.249819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-454e66c6-e5dc-49cf-8aaa-b6262e916c1c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:05.261549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9af32a94-ad17-473f-a99e-415505890a50 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:05.262811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9af32a94-ad17-473f-a99e-415505890a50 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:05.267788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-454e66c6-e5dc-49cf-8aaa-b6262e916c1c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:05.267888 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-454e66c6-e5dc-49cf-8aaa-b6262e916c1c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:05.268654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-454e66c6-e5dc-49cf-8aaa-b6262e916c1c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:05.271589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-454e66c6-e5dc-49cf-8aaa-b6262e916c1c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:05.371030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9af32a94-ad17-473f-a99e-415505890a50 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:05.378458 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9af32a94-ad17-473f-a99e-415505890a50 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 200 len: 1214 microversion: 2.1 time: 0.128209 Aug 02 07:05:05.380612 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1812/3733] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:05 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:05.385604 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-454e66c6-e5dc-49cf-8aaa-b6262e916c1c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/ips" status: 200 len: 150 microversion: 2.1 time: 0.142809 Aug 02 07:05:05.386452 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1922/3734] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 07:05:05 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/ips => generated 150 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:06.216583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-01e105ef-22ea-46e1-983d-484070856490 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:06.217201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-01e105ef-22ea-46e1-983d-484070856490 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:06.232900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01e105ef-22ea-46e1-983d-484070856490 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:06.233358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01e105ef-22ea-46e1-983d-484070856490 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:06.234199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01e105ef-22ea-46e1-983d-484070856490 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:06.234728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01e105ef-22ea-46e1-983d-484070856490 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:06.405470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c703b10-82d3-47bf-bcc0-6b195b6ab234 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:06.406309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9c703b10-82d3-47bf-bcc0-6b195b6ab234 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:06.409833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:06.441373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c703b10-82d3-47bf-bcc0-6b195b6ab234 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:06.453482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c703b10-82d3-47bf-bcc0-6b195b6ab234 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:06.454891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c703b10-82d3-47bf-bcc0-6b195b6ab234 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:06.455367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c703b10-82d3-47bf-bcc0-6b195b6ab234 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:06.678825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9c703b10-82d3-47bf-bcc0-6b195b6ab234 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:06.694191 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9c703b10-82d3-47bf-bcc0-6b195b6ab234 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 200 len: 1210 microversion: 2.1 time: 0.293072 Aug 02 07:05:06.695300 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1923/3735] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:06 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 1210 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:06.710625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-c610afce-06ce-4814-993e-5dd94334489b req-d29869df-1b9a-4185-a441-846fb48375a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd", "name": "network-vif-plugged", "status": "completed", "tag": "74652927-c9ec-4f70-8098-e3b4e312e343"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:06.728933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-01e105ef-22ea-46e1-983d-484070856490 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:06.737975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c610afce-06ce-4814-993e-5dd94334489b req-d29869df-1b9a-4185-a441-846fb48375a2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:06.739349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c610afce-06ce-4814-993e-5dd94334489b req-d29869df-1b9a-4185-a441-846fb48375a2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:06.746900 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-01e105ef-22ea-46e1-983d-484070856490 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1319 microversion: 2.1 time: 0.535580 Aug 02 07:05:06.755481 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1813/3736] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:06 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:06.787997 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-c610afce-06ce-4814-993e-5dd94334489b req-d29869df-1b9a-4185-a441-846fb48375a2 service nova] Creating event network-vif-plugged:74652927-c9ec-4f70-8098-e3b4e312e343 for instance 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd on n-h1-851337-3 Aug 02 07:05:06.823122 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-c610afce-06ce-4814-993e-5dd94334489b req-d29869df-1b9a-4185-a441-846fb48375a2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126140 Aug 02 07:05:06.824972 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1924/3737] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:07.729315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-db1d9f54-05ec-4633-a773-245fd0937094 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:07.731267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-db1d9f54-05ec-4633-a773-245fd0937094 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:07.754402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db1d9f54-05ec-4633-a773-245fd0937094 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:07.763222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db1d9f54-05ec-4633-a773-245fd0937094 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:07.764428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db1d9f54-05ec-4633-a773-245fd0937094 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:07.766561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db1d9f54-05ec-4633-a773-245fd0937094 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:07.771940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-04c6afe8-ae59-452d-b8b6-0a3a96d4e668 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:07.772650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-04c6afe8-ae59-452d-b8b6-0a3a96d4e668 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:07.798728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04c6afe8-ae59-452d-b8b6-0a3a96d4e668 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:07.801739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04c6afe8-ae59-452d-b8b6-0a3a96d4e668 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:07.810792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04c6afe8-ae59-452d-b8b6-0a3a96d4e668 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:07.813463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04c6afe8-ae59-452d-b8b6-0a3a96d4e668 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:07.954485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-db1d9f54-05ec-4633-a773-245fd0937094 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:07.974499 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-db1d9f54-05ec-4633-a773-245fd0937094 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 200 len: 1272 microversion: 2.1 time: 0.239429 Aug 02 07:05:07.989759 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1814/3738] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:07 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:08.227766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ba92d39e-754c-4c5d-9d8e-074629945c38 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49456d19-5507-4376-870a-d183aa6176b9"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:08.235237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ba92d39e-754c-4c5d-9d8e-074629945c38 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:08.244431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba92d39e-754c-4c5d-9d8e-074629945c38 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:08.245748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba92d39e-754c-4c5d-9d8e-074629945c38 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:08.246599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba92d39e-754c-4c5d-9d8e-074629945c38 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:08.247239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba92d39e-754c-4c5d-9d8e-074629945c38 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:08.292707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-04c6afe8-ae59-452d-b8b6-0a3a96d4e668 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:08.308282 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-04c6afe8-ae59-452d-b8b6-0a3a96d4e668 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1319 microversion: 2.1 time: 0.542666 Aug 02 07:05:08.309299 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1925/3739] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:07 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:08.576706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7ccb12cb-49d2-4f8f-9de6-a526b138c6ba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Action: 'create', calling method: .version_select at 0x7f927a2e4790>, body: {"keypair": {"name": "tempest-keypair-861850151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICgtmc5+6M082qF72K1ukwM3TzIldOCYr33tOf60ADNJPaShr3VFLelA+i73ivWKkpqoPRaEFQNX3EzqW36qGWbbRuFvFq47Mr3j/vwexDxqslmmNYz92zxO5kdG9rfAQ=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:08.594742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7ccb12cb-49d2-4f8f-9de6-a526b138c6ba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Getting quotas for project 15ee4714199b427db6ee9e17d6fd93dc. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:05:08.603085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7ccb12cb-49d2-4f8f-9de6-a526b138c6ba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Getting quotas for user 2b5865db38184a5c85b48def8ef9cf97 and project 15ee4714199b427db6ee9e17d6fd93dc. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:05:08.638929 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7ccb12cb-49d2-4f8f-9de6-a526b138c6ba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.270957 Aug 02 07:05:08.640342 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1926/3740] 10.222.0.79 () {62 vars in 1200 bytes} [Tue Aug 2 07:05:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 273 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 07:05:08.998993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c5c40ddc-1cac-4534-bb85-61bfc9ed3705 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:09.000668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c5c40ddc-1cac-4534-bb85-61bfc9ed3705 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:09.019512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5c40ddc-1cac-4534-bb85-61bfc9ed3705 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:09.019676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5c40ddc-1cac-4534-bb85-61bfc9ed3705 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:09.021847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5c40ddc-1cac-4534-bb85-61bfc9ed3705 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:09.022739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5c40ddc-1cac-4534-bb85-61bfc9ed3705 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:09.030902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:09.224437 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ba92d39e-754c-4c5d-9d8e-074629945c38 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "POST /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.999525 Aug 02 07:05:09.226396 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1815/3741] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:05:08 2022] POST /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments => generated 194 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:09.322791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c5c40ddc-1cac-4534-bb85-61bfc9ed3705 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:09.332444 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c5c40ddc-1cac-4534-bb85-61bfc9ed3705 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 200 len: 1314 microversion: 2.1 time: 0.339334 Aug 02 07:05:09.335142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-65ac1579-3153-4486-8493-fbaff86153e2 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:09.335768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-65ac1579-3153-4486-8493-fbaff86153e2 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:09.335902 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1927/3742] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:08 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:09.355238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65ac1579-3153-4486-8493-fbaff86153e2 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:09.355840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65ac1579-3153-4486-8493-fbaff86153e2 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:09.359274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65ac1579-3153-4486-8493-fbaff86153e2 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:09.366985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65ac1579-3153-4486-8493-fbaff86153e2 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:09.920495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-65ac1579-3153-4486-8493-fbaff86153e2 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:09.939432 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-65ac1579-3153-4486-8493-fbaff86153e2 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1468 microversion: 2.1 time: 0.612334 Aug 02 07:05:09.942553 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1816/3743] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:09 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1468 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:10.224740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-5da2d8fb-9752-410d-87c4-cb52c097858d req-8b00aaad-3bee-48cd-aa02-9f80b90483c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c", "tag": "1de0d1c6-2bcf-4590-b5b2-5e6b2d1e2afd"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:10.229255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6d584cac-67ba-4baf-8b52-bdcae2f3b136 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-668145436", "block_migration": true, "disk_over_commit": false}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:10.239565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6d584cac-67ba-4baf-8b52-bdcae2f3b136 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:10.267327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d584cac-67ba-4baf-8b52-bdcae2f3b136 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:10.268014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5da2d8fb-9752-410d-87c4-cb52c097858d req-8b00aaad-3bee-48cd-aa02-9f80b90483c6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:10.270052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5da2d8fb-9752-410d-87c4-cb52c097858d req-8b00aaad-3bee-48cd-aa02-9f80b90483c6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:10.277404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d584cac-67ba-4baf-8b52-bdcae2f3b136 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:10.278604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d584cac-67ba-4baf-8b52-bdcae2f3b136 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:10.284000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d584cac-67ba-4baf-8b52-bdcae2f3b136 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:10.320414 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-5da2d8fb-9752-410d-87c4-cb52c097858d req-8b00aaad-3bee-48cd-aa02-9f80b90483c6 service nova] Creating event network-changed:1de0d1c6-2bcf-4590-b5b2-5e6b2d1e2afd for instance e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c on n-h2-851337-3 Aug 02 07:05:10.340512 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-5da2d8fb-9752-410d-87c4-cb52c097858d req-8b00aaad-3bee-48cd-aa02-9f80b90483c6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118901 Aug 02 07:05:10.341239 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1817/3744] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:10.373997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0835f952-66bf-4beb-8cb1-996e15cd2e48 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:10.375102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0835f952-66bf-4beb-8cb1-996e15cd2e48 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:10.397703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0835f952-66bf-4beb-8cb1-996e15cd2e48 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:10.399225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0835f952-66bf-4beb-8cb1-996e15cd2e48 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:10.403348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0835f952-66bf-4beb-8cb1-996e15cd2e48 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:10.404178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0835f952-66bf-4beb-8cb1-996e15cd2e48 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:10.504127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-6d584cac-67ba-4baf-8b52-bdcae2f3b136 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lazy-loading 'flavor' on Instance uuid 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:05:10.542103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6d584cac-67ba-4baf-8b52-bdcae2f3b136 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Going to try to live migrate instance to tempest-host-668145436 {{(pid=126120) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 02 07:05:10.564017 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-6d584cac-67ba-4baf-8b52-bdcae2f3b136 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] HTTP exception thrown: Compute host tempest-host-668145436 could not be found. Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6d584cac-67ba-4baf-8b52-bdcae2f3b136 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Request method failure captured: Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd/action HTTP/1.1 Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 106 Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MyPTeMjrXEvVxQ5nEfRJrtdd86OdeAArQgso4Bxd9aFxpINe7VGxkZfp0p2fczZW0hi3--faFuDLKjdvaL3HOKJP5RrkG3gaHTt08sivi0lYKp-TobbzFLR9TUPkndH9ZF3fllZxTLabIeqMSqEdFvoI5p4n6FvZOqaRP1tiWrW-C0 Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5db3091ca56e4162b0d85d4f233ec0a2 Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-LiveMigrationNegativeTest-86015300 Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5db3091ca56e4162b0d85d4f233ec0a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5db3091ca56e4162b0d85d4f233ec0a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5db3091ca56e4162b0d85d4f233ec0a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5db3091ca56e4162b0d85d4f233ec0a2"}]}] Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-LiveMigrationNegativeTest-86015300 Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5db3091ca56e4162b0d85d4f233ec0a2 Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-86015300 Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-LiveMigrationNegativeTest-86015300-project-admin Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: bf2ab1bcc461441dbcb6c0e26d2f583e Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-LiveMigrationNegativeTest-86015300-project-admin Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: {"os-migrateLive": {"host": "tempest-host-668145436", "block_migration": true, "disk_over_commit": false}} Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: exception: Compute host tempest-host-668145436 could not be found. Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd', 'body': {'os-migrateLive': {'host': 'tempest-host-668145436', 'block_migration': True, 'disk_over_commit': False}}} Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5436, in live_migrate Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 02 07:05:10.586910 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-668145436 could not be found. Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-668145436 could not be found. Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-668145436 could not be found. Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6d584cac-67ba-4baf-8b52-bdcae2f3b136 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Returning 400 to user: Compute host tempest-host-668145436 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6d584cac-67ba-4baf-8b52-bdcae2f3b136 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd/action" status: 400 len: 99 microversion: 2.1 time: 0.622445 Aug 02 07:05:10.590348 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1928/3745] 10.222.0.79 () {60 vars in 1279 bytes} [Tue Aug 2 07:05:09 2022] POST /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd/action => generated 99 bytes in 624 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 02 07:05:10.601704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-558cacae-7ce8-49df-b770-211d9a7d1c15 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:10.605454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-558cacae-7ce8-49df-b770-211d9a7d1c15 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:10.624529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-558cacae-7ce8-49df-b770-211d9a7d1c15 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:10.624977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-558cacae-7ce8-49df-b770-211d9a7d1c15 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:10.633276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-558cacae-7ce8-49df-b770-211d9a7d1c15 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:10.633719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-558cacae-7ce8-49df-b770-211d9a7d1c15 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:11.260338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0835f952-66bf-4beb-8cb1-996e15cd2e48 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:11.276891 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0835f952-66bf-4beb-8cb1-996e15cd2e48 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 200 len: 1314 microversion: 2.1 time: 0.908350 Aug 02 07:05:11.277800 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1818/3746] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:10 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:11.625752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-558cacae-7ce8-49df-b770-211d9a7d1c15 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:11.637174 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-558cacae-7ce8-49df-b770-211d9a7d1c15 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1468 microversion: 2.1 time: 1.040582 Aug 02 07:05:11.654464 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1929/3747] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:10 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1468 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:11.803541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1531997165", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:11.954407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:05:12.157435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1696983732", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d5e8407-4786-4142-8296-8f16e1d64f3e"}], "security_groups": [{"name": "tempest-securitygroup--739212315"}], "key_name": "tempest-keypair-861850151", "user_data": "}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:12.474319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] validate_networks() for [('8d5e8407-4786-4142-8296-8f16e1d64f3e', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:05:12.643626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:05:12.649551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:05:12.650503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:05:12.651574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:05:12.653367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:05:12.674291 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:12.677571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:12.679182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:12.679991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:12.709792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Getting quotas for project 9ef001cfe28743b6812f432721c633ea. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:05:12.716756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Getting quotas for user 135c2de316dd4cf7a7d6dda0a1494763 and project 9ef001cfe28743b6812f432721c633ea. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:05:12.735125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:05:12.738066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:05:12.821942 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f63eff3d-01dc-4f6e-87b7-3ddc9ffbfb1a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.022654 Aug 02 07:05:12.823291 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1819/3748] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:05:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:05:12.828193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72351bb5-f325-492e-a167-5618434dd1ce tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:12.829179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-72351bb5-f325-492e-a167-5618434dd1ce tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:12.859299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72351bb5-f325-492e-a167-5618434dd1ce tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:12.859875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72351bb5-f325-492e-a167-5618434dd1ce tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:12.862748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72351bb5-f325-492e-a167-5618434dd1ce tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:12.866418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72351bb5-f325-492e-a167-5618434dd1ce tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:13.272471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-72351bb5-f325-492e-a167-5618434dd1ce tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:13.286443 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-72351bb5-f325-492e-a167-5618434dd1ce tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 200 len: 1314 microversion: 2.1 time: 0.461843 Aug 02 07:05:13.299986 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1820/3749] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:12 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:13.299986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-44d644d2-7ee5-48a8-8ea0-81b06d3bb6b2 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:13.299986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-44d644d2-7ee5-48a8-8ea0-81b06d3bb6b2 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:14.094407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44d644d2-7ee5-48a8-8ea0-81b06d3bb6b2 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:14.106567 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-44d644d2-7ee5-48a8-8ea0-81b06d3bb6b2 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1219 microversion: 2.1 time: 0.813907 Aug 02 07:05:14.126924 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1821/3750] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:13 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1219 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:14.205930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:05:14.206530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:05:14.206897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:05:14.207357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:05:14.208035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:05:14.218613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:14.219091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:14.219952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:14.220322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:14.258381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Getting quotas for project 15ee4714199b427db6ee9e17d6fd93dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:05:14.265515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Getting quotas for user 2b5865db38184a5c85b48def8ef9cf97 and project 15ee4714199b427db6ee9e17d6fd93dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:05:14.285349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:05:14.288915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:05:14.308449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8fc5375d-a8c3-4f6c-976c-27037839ba4b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:14.309584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8fc5375d-a8c3-4f6c-976c-27037839ba4b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:14.326633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fc5375d-a8c3-4f6c-976c-27037839ba4b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:14.328539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fc5375d-a8c3-4f6c-976c-27037839ba4b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:14.329814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fc5375d-a8c3-4f6c-976c-27037839ba4b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:14.330558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fc5375d-a8c3-4f6c-976c-27037839ba4b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:14.358538 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0d96f698-9a3e-4ce9-8c85-2b365d6ef4f0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.205687 Aug 02 07:05:14.376322 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1930/3751] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 07:05:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 2225 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 07:05:14.386297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1eb7559f-0ced-4b4d-8105-32ed251317c7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:14.393804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1eb7559f-0ced-4b4d-8105-32ed251317c7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:14.554481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1eb7559f-0ced-4b4d-8105-32ed251317c7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:14.580463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1eb7559f-0ced-4b4d-8105-32ed251317c7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:14.590629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1eb7559f-0ced-4b4d-8105-32ed251317c7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:14.596550 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1eb7559f-0ced-4b4d-8105-32ed251317c7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1281 microversion: 2.20 time: 0.218384 Aug 02 07:05:14.602893 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1931/3752] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:14 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1281 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:05:14.678755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8fc5375d-a8c3-4f6c-976c-27037839ba4b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:14.688961 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8fc5375d-a8c3-4f6c-976c-27037839ba4b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 200 len: 1314 microversion: 2.1 time: 0.385088 Aug 02 07:05:14.706300 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1822/3753] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:14 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:15.134276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5c1b2bbc-a295-43fa-a979-3b80202e2bbe tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:15.134900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5c1b2bbc-a295-43fa-a979-3b80202e2bbe tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:15.154815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c1b2bbc-a295-43fa-a979-3b80202e2bbe tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:15.155271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c1b2bbc-a295-43fa-a979-3b80202e2bbe tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:15.156982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c1b2bbc-a295-43fa-a979-3b80202e2bbe tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:15.158201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c1b2bbc-a295-43fa-a979-3b80202e2bbe tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:15.292884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5c1b2bbc-a295-43fa-a979-3b80202e2bbe tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:15.318786 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5c1b2bbc-a295-43fa-a979-3b80202e2bbe tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1277 microversion: 2.1 time: 0.188395 Aug 02 07:05:15.319753 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1932/3754] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:15 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:15.628444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c707161d-41a8-4e80-a52d-47fcf3fbe633 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:15.629145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c707161d-41a8-4e80-a52d-47fcf3fbe633 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:15.641737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c707161d-41a8-4e80-a52d-47fcf3fbe633 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:15.648850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c707161d-41a8-4e80-a52d-47fcf3fbe633 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:15.649986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c707161d-41a8-4e80-a52d-47fcf3fbe633 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:15.650585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c707161d-41a8-4e80-a52d-47fcf3fbe633 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:15.713695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3e605409-21bc-43d3-ab3b-52396b79cc23 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:15.714617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3e605409-21bc-43d3-ab3b-52396b79cc23 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:15.748154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e605409-21bc-43d3-ab3b-52396b79cc23 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:15.751339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e605409-21bc-43d3-ab3b-52396b79cc23 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:15.752784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e605409-21bc-43d3-ab3b-52396b79cc23 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:15.754241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e605409-21bc-43d3-ab3b-52396b79cc23 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:15.812879 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c707161d-41a8-4e80-a52d-47fcf3fbe633 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:15.835635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c707161d-41a8-4e80-a52d-47fcf3fbe633 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:15.847200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c707161d-41a8-4e80-a52d-47fcf3fbe633 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:15.849551 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c707161d-41a8-4e80-a52d-47fcf3fbe633 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1333 microversion: 2.20 time: 0.225293 Aug 02 07:05:15.851362 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1823/3755] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:15 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1333 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:05:15.897989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-74f45cf2-8b44-4433-9137-28ea3604f0f9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:15.899041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-74f45cf2-8b44-4433-9137-28ea3604f0f9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:15.913393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74f45cf2-8b44-4433-9137-28ea3604f0f9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:15.914140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74f45cf2-8b44-4433-9137-28ea3604f0f9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:15.921799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74f45cf2-8b44-4433-9137-28ea3604f0f9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:15.926121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74f45cf2-8b44-4433-9137-28ea3604f0f9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:16.098746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3e605409-21bc-43d3-ab3b-52396b79cc23 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:16.111956 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3e605409-21bc-43d3-ab3b-52396b79cc23 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 200 len: 1314 microversion: 2.1 time: 0.401489 Aug 02 07:05:16.125953 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1933/3756] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:15 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:16.242220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-74f45cf2-8b44-4433-9137-28ea3604f0f9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:16.277268 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-74f45cf2-8b44-4433-9137-28ea3604f0f9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.383196 Aug 02 07:05:16.277913 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1824/3757] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:15 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:16.308070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d4b6a45e-8fad-4bf7-a781-965acbaf82b9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:16.311164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d4b6a45e-8fad-4bf7-a781-965acbaf82b9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:16.327939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d4b6a45e-8fad-4bf7-a781-965acbaf82b9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:16.328641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d4b6a45e-8fad-4bf7-a781-965acbaf82b9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:16.331526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d4b6a45e-8fad-4bf7-a781-965acbaf82b9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:16.332183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d4b6a45e-8fad-4bf7-a781-965acbaf82b9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:16.341196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4dfdc6d5-3d44-4112-a1a4-804eccf081c8 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:16.341808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4dfdc6d5-3d44-4112-a1a4-804eccf081c8 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:16.361532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4dfdc6d5-3d44-4112-a1a4-804eccf081c8 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:16.361952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4dfdc6d5-3d44-4112-a1a4-804eccf081c8 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:16.362759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4dfdc6d5-3d44-4112-a1a4-804eccf081c8 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:16.363186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4dfdc6d5-3d44-4112-a1a4-804eccf081c8 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:16.649532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4dfdc6d5-3d44-4112-a1a4-804eccf081c8 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:16.668910 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4dfdc6d5-3d44-4112-a1a4-804eccf081c8 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1319 microversion: 2.1 time: 0.331440 Aug 02 07:05:16.670196 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1825/3758] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:16 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:16.674798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d4b6a45e-8fad-4bf7-a781-965acbaf82b9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:16.691982 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d4b6a45e-8fad-4bf7-a781-965acbaf82b9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.389890 Aug 02 07:05:16.707463 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1934/3759] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:16 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:16.715987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c356c0f8-a11b-44d5-8d8e-f4e77f5b9d39 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:16.717730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c356c0f8-a11b-44d5-8d8e-f4e77f5b9d39 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:16.726342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c356c0f8-a11b-44d5-8d8e-f4e77f5b9d39 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:16.728376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c356c0f8-a11b-44d5-8d8e-f4e77f5b9d39 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:16.729992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c356c0f8-a11b-44d5-8d8e-f4e77f5b9d39 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:16.730924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c356c0f8-a11b-44d5-8d8e-f4e77f5b9d39 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:16.897957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f6766f90-ad3e-4b74-9e5c-77cd7f753afa tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:16.898910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f6766f90-ad3e-4b74-9e5c-77cd7f753afa tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:16.911256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6766f90-ad3e-4b74-9e5c-77cd7f753afa tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:16.912408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6766f90-ad3e-4b74-9e5c-77cd7f753afa tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:16.918435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6766f90-ad3e-4b74-9e5c-77cd7f753afa tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:16.919439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6766f90-ad3e-4b74-9e5c-77cd7f753afa tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:16.988470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c356c0f8-a11b-44d5-8d8e-f4e77f5b9d39 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:16.998455 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c356c0f8-a11b-44d5-8d8e-f4e77f5b9d39 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.287004 Aug 02 07:05:17.003573 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1826/3760] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:16 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:17.030194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-75942dfe-2892-4d85-9f35-62334abc4244 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1161243460"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:17.033841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-75942dfe-2892-4d85-9f35-62334abc4244 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:17.043214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75942dfe-2892-4d85-9f35-62334abc4244 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:17.043922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75942dfe-2892-4d85-9f35-62334abc4244 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:17.045099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75942dfe-2892-4d85-9f35-62334abc4244 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:17.045701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75942dfe-2892-4d85-9f35-62334abc4244 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:17.052581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f6766f90-ad3e-4b74-9e5c-77cd7f753afa tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:17.062260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f6766f90-ad3e-4b74-9e5c-77cd7f753afa tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:17.063933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f6766f90-ad3e-4b74-9e5c-77cd7f753afa tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:17.065202 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f6766f90-ad3e-4b74-9e5c-77cd7f753afa tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1339 microversion: 2.20 time: 0.176488 Aug 02 07:05:17.069947 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1935/3761] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:16 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1339 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:05:17.139028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-883fcf7f-b771-4488-a900-8ff19794e2d9 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:17.139815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-883fcf7f-b771-4488-a900-8ff19794e2d9 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:17.148164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-883fcf7f-b771-4488-a900-8ff19794e2d9 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:17.149594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-883fcf7f-b771-4488-a900-8ff19794e2d9 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:17.152034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-883fcf7f-b771-4488-a900-8ff19794e2d9 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:17.153608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-883fcf7f-b771-4488-a900-8ff19794e2d9 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:17.371001 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-75942dfe-2892-4d85-9f35-62334abc4244 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.348381 Aug 02 07:05:17.374062 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1827/3762] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:05:17 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Aug 02 07:05:17.461646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-883fcf7f-b771-4488-a900-8ff19794e2d9 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:17.472783 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-883fcf7f-b771-4488-a900-8ff19794e2d9 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 200 len: 1314 microversion: 2.1 time: 0.339422 Aug 02 07:05:17.474708 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1936/3763] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:17 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:17.716414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3e3fd401-7503-4997-8bf3-780bc013799e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:17.720685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3e3fd401-7503-4997-8bf3-780bc013799e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:17.741495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e3fd401-7503-4997-8bf3-780bc013799e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:17.744006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e3fd401-7503-4997-8bf3-780bc013799e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:17.748025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e3fd401-7503-4997-8bf3-780bc013799e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:17.749055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e3fd401-7503-4997-8bf3-780bc013799e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:17.782614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:17.994815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3e3fd401-7503-4997-8bf3-780bc013799e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:18.007827 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3e3fd401-7503-4997-8bf3-780bc013799e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1319 microversion: 2.1 time: 0.309413 Aug 02 07:05:18.009091 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1828/3764] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:17 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:18.091357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a70df884-a771-41b3-8832-ece0e263b00f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:18.092726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a70df884-a771-41b3-8832-ece0e263b00f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:18.105461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a70df884-a771-41b3-8832-ece0e263b00f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:18.106217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a70df884-a771-41b3-8832-ece0e263b00f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:18.108143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a70df884-a771-41b3-8832-ece0e263b00f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:18.108834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a70df884-a771-41b3-8832-ece0e263b00f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:18.137549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8fc15f1a-73e0-485c-87b3-97f0399be0d5 req-e54a2c8a-219c-4ab4-95d5-110af8b8b11a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c", "name": "network-vif-plugged", "status": "completed", "tag": "1de0d1c6-2bcf-4590-b5b2-5e6b2d1e2afd"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:18.156803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8fc15f1a-73e0-485c-87b3-97f0399be0d5 req-e54a2c8a-219c-4ab4-95d5-110af8b8b11a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:18.157542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8fc15f1a-73e0-485c-87b3-97f0399be0d5 req-e54a2c8a-219c-4ab4-95d5-110af8b8b11a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:18.175058 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8fc15f1a-73e0-485c-87b3-97f0399be0d5 req-e54a2c8a-219c-4ab4-95d5-110af8b8b11a service nova] Creating event network-vif-plugged:1de0d1c6-2bcf-4590-b5b2-5e6b2d1e2afd for instance e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c on n-h2-851337-3 Aug 02 07:05:18.189517 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8fc15f1a-73e0-485c-87b3-97f0399be0d5 req-e54a2c8a-219c-4ab4-95d5-110af8b8b11a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058106 Aug 02 07:05:18.199839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a70df884-a771-41b3-8832-ece0e263b00f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:18.204402 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1829/3765] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:05:18.211321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a70df884-a771-41b3-8832-ece0e263b00f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:18.213272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a70df884-a771-41b3-8832-ece0e263b00f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:18.215900 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a70df884-a771-41b3-8832-ece0e263b00f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1339 microversion: 2.20 time: 0.129987 Aug 02 07:05:18.217588 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1937/3766] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:18 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1339 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:05:18.501409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-834553d0-0aca-4b01-ac04-13e7da596be4 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:18.502249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-834553d0-0aca-4b01-ac04-13e7da596be4 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:18.509643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-834553d0-0aca-4b01-ac04-13e7da596be4 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:18.510221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-834553d0-0aca-4b01-ac04-13e7da596be4 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:18.511086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-834553d0-0aca-4b01-ac04-13e7da596be4 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:18.511591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-834553d0-0aca-4b01-ac04-13e7da596be4 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:18.678322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-834553d0-0aca-4b01-ac04-13e7da596be4 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:18.690907 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-834553d0-0aca-4b01-ac04-13e7da596be4 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 200 len: 1314 microversion: 2.1 time: 0.193795 Aug 02 07:05:18.692257 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1830/3767] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:18 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:18.704107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-2e2c9bfe-90c7-4988-b3a9-c7349d1052ac req-dd4092af-16af-4360-86fa-eaf9e00f1675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20890d92-8b2b-4bff-93f9-781782bcfca4", "tag": "b90254a9-a8ac-406c-a056-b7e39509570e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:18.721056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2e2c9bfe-90c7-4988-b3a9-c7349d1052ac req-dd4092af-16af-4360-86fa-eaf9e00f1675 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:18.721510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2e2c9bfe-90c7-4988-b3a9-c7349d1052ac req-dd4092af-16af-4360-86fa-eaf9e00f1675 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:18.737038 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-2e2c9bfe-90c7-4988-b3a9-c7349d1052ac req-dd4092af-16af-4360-86fa-eaf9e00f1675 service nova] Creating event network-changed:b90254a9-a8ac-406c-a056-b7e39509570e for instance 20890d92-8b2b-4bff-93f9-781782bcfca4 on n-h2-851337-3 Aug 02 07:05:18.748055 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-2e2c9bfe-90c7-4988-b3a9-c7349d1052ac req-dd4092af-16af-4360-86fa-eaf9e00f1675 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048144 Aug 02 07:05:18.749008 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1938/3768] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:05:19.031753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7cf5def4-d436-4c22-8ef3-8a4ca8947879 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:19.033422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7cf5def4-d436-4c22-8ef3-8a4ca8947879 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:19.042349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cf5def4-d436-4c22-8ef3-8a4ca8947879 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:19.043193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cf5def4-d436-4c22-8ef3-8a4ca8947879 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:19.044270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cf5def4-d436-4c22-8ef3-8a4ca8947879 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:19.045438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cf5def4-d436-4c22-8ef3-8a4ca8947879 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:19.229269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7cf5def4-d436-4c22-8ef3-8a4ca8947879 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:19.238834 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7cf5def4-d436-4c22-8ef3-8a4ca8947879 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1319 microversion: 2.1 time: 0.211725 Aug 02 07:05:19.244953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ca3dacb4-5cfa-4493-939c-f05178973ef7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:19.246946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ca3dacb4-5cfa-4493-939c-f05178973ef7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:19.251861 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1831/3769] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:19 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:19.271280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca3dacb4-5cfa-4493-939c-f05178973ef7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:19.271981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca3dacb4-5cfa-4493-939c-f05178973ef7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:19.273400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca3dacb4-5cfa-4493-939c-f05178973ef7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:19.276603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca3dacb4-5cfa-4493-939c-f05178973ef7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:19.526632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ca3dacb4-5cfa-4493-939c-f05178973ef7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:19.546547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ca3dacb4-5cfa-4493-939c-f05178973ef7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:19.548264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ca3dacb4-5cfa-4493-939c-f05178973ef7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:19.552837 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ca3dacb4-5cfa-4493-939c-f05178973ef7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1406 microversion: 2.20 time: 0.312263 Aug 02 07:05:19.553689 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1939/3770] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:19 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1406 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:05:19.712301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-62a5a61b-b103-4007-822f-371d63d6c646 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:19.715914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-62a5a61b-b103-4007-822f-371d63d6c646 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:19.722577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62a5a61b-b103-4007-822f-371d63d6c646 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:19.723361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62a5a61b-b103-4007-822f-371d63d6c646 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:19.724091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62a5a61b-b103-4007-822f-371d63d6c646 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:19.724675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62a5a61b-b103-4007-822f-371d63d6c646 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:19.880566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-62a5a61b-b103-4007-822f-371d63d6c646 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:19.889284 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-62a5a61b-b103-4007-822f-371d63d6c646 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 200 len: 1497 microversion: 2.1 time: 0.180939 Aug 02 07:05:19.889852 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1832/3771] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:19 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:20.276542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c0adcc17-cb21-4869-b992-6f4d65e08a3e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:20.277167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c0adcc17-cb21-4869-b992-6f4d65e08a3e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:20.285191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0adcc17-cb21-4869-b992-6f4d65e08a3e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:20.285643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0adcc17-cb21-4869-b992-6f4d65e08a3e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:20.286458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0adcc17-cb21-4869-b992-6f4d65e08a3e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:20.287014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0adcc17-cb21-4869-b992-6f4d65e08a3e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:20.417110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7c02d557-d581-4a3d-bebb-1243e255093f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:20.417568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7c02d557-d581-4a3d-bebb-1243e255093f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:20.426068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c02d557-d581-4a3d-bebb-1243e255093f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:20.426604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c02d557-d581-4a3d-bebb-1243e255093f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:20.427384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c02d557-d581-4a3d-bebb-1243e255093f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:20.427814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c02d557-d581-4a3d-bebb-1243e255093f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:20.450847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c0adcc17-cb21-4869-b992-6f4d65e08a3e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:20.459576 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c0adcc17-cb21-4869-b992-6f4d65e08a3e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1319 microversion: 2.1 time: 0.187744 Aug 02 07:05:20.460376 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1940/3772] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:20 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:20.471034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7c02d557-d581-4a3d-bebb-1243e255093f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:05:20.566461 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7c02d557-d581-4a3d-bebb-1243e255093f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 204 len: 0 microversion: 2.1 time: 0.153893 Aug 02 07:05:20.567334 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1833/3773] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:05:20 2022] DELETE /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 07:05:20.575964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9831a963-b53c-470b-985e-75d0884bff2f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:20.576568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9831a963-b53c-470b-985e-75d0884bff2f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:20.581201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-129b0016-e0b0-464f-8f7c-8996d54da552 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:20.582442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-129b0016-e0b0-464f-8f7c-8996d54da552 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:20.584548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9831a963-b53c-470b-985e-75d0884bff2f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:20.585032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9831a963-b53c-470b-985e-75d0884bff2f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:20.586090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9831a963-b53c-470b-985e-75d0884bff2f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:20.586821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9831a963-b53c-470b-985e-75d0884bff2f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:20.595864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-129b0016-e0b0-464f-8f7c-8996d54da552 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:20.596709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-129b0016-e0b0-464f-8f7c-8996d54da552 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:20.602384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-129b0016-e0b0-464f-8f7c-8996d54da552 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:20.604103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-129b0016-e0b0-464f-8f7c-8996d54da552 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:20.831752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9831a963-b53c-470b-985e-75d0884bff2f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:20.835257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-129b0016-e0b0-464f-8f7c-8996d54da552 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:20.846398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-129b0016-e0b0-464f-8f7c-8996d54da552 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:20.848516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-129b0016-e0b0-464f-8f7c-8996d54da552 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:20.849710 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-129b0016-e0b0-464f-8f7c-8996d54da552 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1406 microversion: 2.20 time: 0.273634 Aug 02 07:05:20.850791 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1834/3774] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:20 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:05:20.857487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-5ef8f065-5da8-45d0-9251-f5deadc30e68 req-5af9082e-2bfd-4399-bedb-f20fedf09590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a9ae016-6a95-4257-8d74-99fcd50ae1cb", "tag": "3ee7c406-2514-4927-ba77-18750ac8d2ab"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:20.860656 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9831a963-b53c-470b-985e-75d0884bff2f tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 200 len: 1503 microversion: 2.1 time: 0.288893 Aug 02 07:05:20.861775 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1941/3775] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:20 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 1503 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:20.892186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5ef8f065-5da8-45d0-9251-f5deadc30e68 req-5af9082e-2bfd-4399-bedb-f20fedf09590 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:20.892622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5ef8f065-5da8-45d0-9251-f5deadc30e68 req-5af9082e-2bfd-4399-bedb-f20fedf09590 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:20.910181 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-5ef8f065-5da8-45d0-9251-f5deadc30e68 req-5af9082e-2bfd-4399-bedb-f20fedf09590 service nova] Creating event network-changed:3ee7c406-2514-4927-ba77-18750ac8d2ab for instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb on n-h1-851337-3 Aug 02 07:05:20.920601 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-5ef8f065-5da8-45d0-9251-f5deadc30e68 req-5af9082e-2bfd-4399-bedb-f20fedf09590 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067915 Aug 02 07:05:20.921839 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1835/3776] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:21.480985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-697eeed4-fb92-4ae3-b0ee-d47ccd6d92fb tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:21.481863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-697eeed4-fb92-4ae3-b0ee-d47ccd6d92fb tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:21.489713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-697eeed4-fb92-4ae3-b0ee-d47ccd6d92fb tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:21.489839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-697eeed4-fb92-4ae3-b0ee-d47ccd6d92fb tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:21.490561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-697eeed4-fb92-4ae3-b0ee-d47ccd6d92fb tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:21.490995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-697eeed4-fb92-4ae3-b0ee-d47ccd6d92fb tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:21.635663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-697eeed4-fb92-4ae3-b0ee-d47ccd6d92fb tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:21.643510 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-697eeed4-fb92-4ae3-b0ee-d47ccd6d92fb tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1319 microversion: 2.1 time: 0.166456 Aug 02 07:05:21.644117 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1942/3777] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:21 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:21.875165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-64b5088b-933e-442d-a903-006261d3f28b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:21.875866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-64b5088b-933e-442d-a903-006261d3f28b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:21.885025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-64b5088b-933e-442d-a903-006261d3f28b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:21.885467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-64b5088b-933e-442d-a903-006261d3f28b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:21.886271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-64b5088b-933e-442d-a903-006261d3f28b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:21.887732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-64b5088b-933e-442d-a903-006261d3f28b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:21.891514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9b4e8530-aed9-4a63-a9fe-1f01930210d8 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:21.892471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9b4e8530-aed9-4a63-a9fe-1f01930210d8 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:21.900135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b4e8530-aed9-4a63-a9fe-1f01930210d8 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:21.900933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b4e8530-aed9-4a63-a9fe-1f01930210d8 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:21.901797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b4e8530-aed9-4a63-a9fe-1f01930210d8 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:21.902383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b4e8530-aed9-4a63-a9fe-1f01930210d8 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:22.126575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-64b5088b-933e-442d-a903-006261d3f28b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:22.135401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-64b5088b-933e-442d-a903-006261d3f28b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:22.137179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-64b5088b-933e-442d-a903-006261d3f28b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:22.138720 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-64b5088b-933e-442d-a903-006261d3f28b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1406 microversion: 2.20 time: 0.268123 Aug 02 07:05:22.156048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9b4e8530-aed9-4a63-a9fe-1f01930210d8 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:22.156554 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1836/3778] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:21 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:05:22.163548 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9b4e8530-aed9-4a63-a9fe-1f01930210d8 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 200 len: 1503 microversion: 2.1 time: 0.279661 Aug 02 07:05:22.165012 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1943/3779] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:21 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 1503 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:22.677833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4e05624b-7f4e-4f9f-8885-2fbe955a3a25 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:22.678517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4e05624b-7f4e-4f9f-8885-2fbe955a3a25 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:22.685771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e05624b-7f4e-4f9f-8885-2fbe955a3a25 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:22.686260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e05624b-7f4e-4f9f-8885-2fbe955a3a25 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:22.687332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e05624b-7f4e-4f9f-8885-2fbe955a3a25 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:22.687762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e05624b-7f4e-4f9f-8885-2fbe955a3a25 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:22.691243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ebd08556-f755-45d0-a391-09a84b42360c req-aba0861e-08e4-4011-9271-9b97765300c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c", "name": "network-vif-deleted", "tag": "1de0d1c6-2bcf-4590-b5b2-5e6b2d1e2afd"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:22.693117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:22.714674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ebd08556-f755-45d0-a391-09a84b42360c req-aba0861e-08e4-4011-9271-9b97765300c6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:22.715117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ebd08556-f755-45d0-a391-09a84b42360c req-aba0861e-08e4-4011-9271-9b97765300c6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:22.733182 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ebd08556-f755-45d0-a391-09a84b42360c req-aba0861e-08e4-4011-9271-9b97765300c6 service nova] Creating event network-vif-deleted:1de0d1c6-2bcf-4590-b5b2-5e6b2d1e2afd for instance e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c on n-h2-851337-3 Aug 02 07:05:22.738882 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ebd08556-f755-45d0-a391-09a84b42360c req-aba0861e-08e4-4011-9271-9b97765300c6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052526 Aug 02 07:05:22.740083 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1944/3780] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:05:22.912719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4e05624b-7f4e-4f9f-8885-2fbe955a3a25 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:22.920365 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4e05624b-7f4e-4f9f-8885-2fbe955a3a25 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1319 microversion: 2.1 time: 0.248665 Aug 02 07:05:22.920973 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1837/3781] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:22 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:23.164002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7f60fca1-c3b5-4248-8a42-9c7509a20a91 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:23.164852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7f60fca1-c3b5-4248-8a42-9c7509a20a91 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:23.174027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f60fca1-c3b5-4248-8a42-9c7509a20a91 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:23.174455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f60fca1-c3b5-4248-8a42-9c7509a20a91 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:23.175402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f60fca1-c3b5-4248-8a42-9c7509a20a91 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:23.176001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f60fca1-c3b5-4248-8a42-9c7509a20a91 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:23.188738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dfb6fc04-b89b-42b1-8f45-3bd655e53f24 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:23.189412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dfb6fc04-b89b-42b1-8f45-3bd655e53f24 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:23.202578 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfb6fc04-b89b-42b1-8f45-3bd655e53f24 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:23.203713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfb6fc04-b89b-42b1-8f45-3bd655e53f24 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:23.204903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfb6fc04-b89b-42b1-8f45-3bd655e53f24 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:23.205682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfb6fc04-b89b-42b1-8f45-3bd655e53f24 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:23.261622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfb6fc04-b89b-42b1-8f45-3bd655e53f24 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:23.262347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfb6fc04-b89b-42b1-8f45-3bd655e53f24 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:23.262951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-dfb6fc04-b89b-42b1-8f45-3bd655e53f24 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lazy-loading 'fault' on Instance uuid e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:05:23.319396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dfb6fc04-b89b-42b1-8f45-3bd655e53f24 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f943927830b498f82bd9881a240f41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deda8b9458a946bfb8c990689f130cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:23.327260 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dfb6fc04-b89b-42b1-8f45-3bd655e53f24 tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 200 len: 1304 microversion: 2.1 time: 0.145059 Aug 02 07:05:23.327955 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1838/3782] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:23 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:23.365706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7f60fca1-c3b5-4248-8a42-9c7509a20a91 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:23.375912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7f60fca1-c3b5-4248-8a42-9c7509a20a91 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:23.377771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7f60fca1-c3b5-4248-8a42-9c7509a20a91 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:23.378972 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7f60fca1-c3b5-4248-8a42-9c7509a20a91 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1406 microversion: 2.20 time: 0.221619 Aug 02 07:05:23.379703 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1945/3783] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:23 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:05:23.942626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dba13840-7107-4cf8-8c85-7dab8d4ea0c3 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:23.943551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dba13840-7107-4cf8-8c85-7dab8d4ea0c3 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:23.953611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dba13840-7107-4cf8-8c85-7dab8d4ea0c3 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:23.954418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dba13840-7107-4cf8-8c85-7dab8d4ea0c3 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:23.955429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dba13840-7107-4cf8-8c85-7dab8d4ea0c3 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:23.957088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dba13840-7107-4cf8-8c85-7dab8d4ea0c3 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:24.100742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=10 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:24.123994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dba13840-7107-4cf8-8c85-7dab8d4ea0c3 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:24.133469 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dba13840-7107-4cf8-8c85-7dab8d4ea0c3 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1319 microversion: 2.1 time: 0.195138 Aug 02 07:05:24.134185 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1839/3784] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:23 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:24.230908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e7252d75-db65-4ab3-94a5-065b1147aab4 req-a7d1c831-a191-4f47-b245-c322100e90af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20890d92-8b2b-4bff-93f9-781782bcfca4", "name": "network-vif-plugged", "status": "completed", "tag": "b90254a9-a8ac-406c-a056-b7e39509570e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:24.244349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:24.250830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e7252d75-db65-4ab3-94a5-065b1147aab4 req-a7d1c831-a191-4f47-b245-c322100e90af service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:24.251300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e7252d75-db65-4ab3-94a5-065b1147aab4 req-a7d1c831-a191-4f47-b245-c322100e90af service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:24.264202 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e7252d75-db65-4ab3-94a5-065b1147aab4 req-a7d1c831-a191-4f47-b245-c322100e90af service nova] Creating event network-vif-plugged:b90254a9-a8ac-406c-a056-b7e39509570e for instance 20890d92-8b2b-4bff-93f9-781782bcfca4 on n-h2-851337-3 Aug 02 07:05:24.276766 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e7252d75-db65-4ab3-94a5-065b1147aab4 req-a7d1c831-a191-4f47-b245-c322100e90af service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053086 Aug 02 07:05:24.277540 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1946/3785] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:24.349319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f408b273-0faf-40e1-9d13-aa946ff8a72b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:24.350404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f408b273-0faf-40e1-9d13-aa946ff8a72b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] [instance: e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:24.359742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f408b273-0faf-40e1-9d13-aa946ff8a72b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:24.360610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f408b273-0faf-40e1-9d13-aa946ff8a72b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:24.361484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f408b273-0faf-40e1-9d13-aa946ff8a72b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:24.362029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f408b273-0faf-40e1-9d13-aa946ff8a72b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:24.418423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d2e52977-ead7-4f4d-88d8-1e52141edcba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:24.424088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d2e52977-ead7-4f4d-88d8-1e52141edcba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:24.437885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2e52977-ead7-4f4d-88d8-1e52141edcba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:24.438726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2e52977-ead7-4f4d-88d8-1e52141edcba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:24.439937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2e52977-ead7-4f4d-88d8-1e52141edcba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:24.441130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2e52977-ead7-4f4d-88d8-1e52141edcba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:24.448477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:24.451425 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-f408b273-0faf-40e1-9d13-aa946ff8a72b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] HTTP exception thrown: Instance e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c could not be found. Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f408b273-0faf-40e1-9d13-aa946ff8a72b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Request method failure captured: Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c HTTP/1.1 Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MyIollb-NjMd_2WW1rUdLuNm8JfAuIG7lxCdnrN0TwW8Ympj5EvYLzjxijv3jahB5nZTUWl9rEWrLFsQjm3tgXSSIakxELJr-Y9Hefr5bQn69sG1cAyG7jlGpZgoM1nK3CajrXgKIk-WFQVTTD4tgWuPF-W1Dc6cGfqTS6d_KoV7gQ Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: deda8b9458a946bfb8c990689f130cba Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-VolumesActionsTest-1437486429 Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/deda8b9458a946bfb8c990689f130cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/deda8b9458a946bfb8c990689f130cba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_deda8b9458a946bfb8c990689f130cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/deda8b9458a946bfb8c990689f130cba"}]}] Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-VolumesActionsTest-1437486429 Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: deda8b9458a946bfb8c990689f130cba Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-VolumesActionsTest-1437486429 Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-VolumesActionsTest-1437486429-project Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0f943927830b498f82bd9881a240f41a Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-VolumesActionsTest-1437486429-project Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c could not be found. Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c'} Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c could not be found. Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c could not be found. Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:05:24.464499 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:24.470542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:24.470542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:05:24.470542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:05:24.470542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:05:24.470542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:05:24.470542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c could not be found. Aug 02 07:05:24.470542 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:24.470542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f408b273-0faf-40e1-9d13-aa946ff8a72b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] Returning 404 to user: Instance e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:05:24.470542 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f408b273-0faf-40e1-9d13-aa946ff8a72b tempest-VolumesActionsTest-1437486429 tempest-VolumesActionsTest-1437486429-project] 10.222.0.79 "GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c" status: 404 len: 111 microversion: 2.1 time: 0.121512 Aug 02 07:05:24.480725 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1840/3786] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:24 2022] GET /compute/v2.1/servers/e21ef3fb-ef6f-4e2d-a18f-744fae17fe8c => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:05:24.562877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=18 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:24.732734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d2e52977-ead7-4f4d-88d8-1e52141edcba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:24.743535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d2e52977-ead7-4f4d-88d8-1e52141edcba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:24.746681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d2e52977-ead7-4f4d-88d8-1e52141edcba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:24.747924 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d2e52977-ead7-4f4d-88d8-1e52141edcba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1406 microversion: 2.20 time: 0.342379 Aug 02 07:05:24.748526 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1947/3787] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:24 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1406 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:05:25.147609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e15ed7cd-ce69-44b8-b936-8bed5f8e5695 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Action: 'create', calling method: .version_select at 0x7f927a3330d0>, body: {"keypair": {"name": "tempest-keypair-950874326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLH1Ns0AJsJZoq93pCT29YMWdFVnzjuOKkF3ZqzAB+NJuyAvJLfvoo5l+O0VCCxw/PtQd/IlqaE+0QSrSneBC1M0V355YX255KP1ZEePkbqUDo0aWTkWtaKdrZkENupL3Q=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:25.154579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8dfdf17f-bedf-49d0-a1f8-7d35bb36bc75 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:25.155339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8dfdf17f-bedf-49d0-a1f8-7d35bb36bc75 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:25.162745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8dfdf17f-bedf-49d0-a1f8-7d35bb36bc75 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:25.163413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8dfdf17f-bedf-49d0-a1f8-7d35bb36bc75 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:25.170150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8dfdf17f-bedf-49d0-a1f8-7d35bb36bc75 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:25.170751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8dfdf17f-bedf-49d0-a1f8-7d35bb36bc75 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:25.174433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-e15ed7cd-ce69-44b8-b936-8bed5f8e5695 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for project 6ee1befa077542b9a17865baad3c9999. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:05:25.183573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-e15ed7cd-ce69-44b8-b936-8bed5f8e5695 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for user 3a2629fa08b5419a96c2942118d38dad and project 6ee1befa077542b9a17865baad3c9999. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:05:25.218754 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e15ed7cd-ce69-44b8-b936-8bed5f8e5695 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.076671 Aug 02 07:05:25.221805 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1841/3788] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:05:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:05:25.411452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8dfdf17f-bedf-49d0-a1f8-7d35bb36bc75 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:25.422531 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8dfdf17f-bedf-49d0-a1f8-7d35bb36bc75 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1319 microversion: 2.1 time: 0.271756 Aug 02 07:05:25.436905 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1948/3789] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:25 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:25.775139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a85f596a-1678-4ebd-aa06-177b570c8b12 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:25.775893 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a85f596a-1678-4ebd-aa06-177b570c8b12 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:25.792821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:25.794613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a85f596a-1678-4ebd-aa06-177b570c8b12 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:25.795092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a85f596a-1678-4ebd-aa06-177b570c8b12 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:25.800984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a85f596a-1678-4ebd-aa06-177b570c8b12 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:25.805257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a85f596a-1678-4ebd-aa06-177b570c8b12 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:26.078989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a85f596a-1678-4ebd-aa06-177b570c8b12 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:26.090846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a85f596a-1678-4ebd-aa06-177b570c8b12 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:26.093340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a85f596a-1678-4ebd-aa06-177b570c8b12 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:26.095565 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a85f596a-1678-4ebd-aa06-177b570c8b12 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1406 microversion: 2.20 time: 0.326728 Aug 02 07:05:26.097033 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1842/3790] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:25 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:05:26.446320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6efb888-2d36-40e9-a09f-41fff3a6c1c9 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:26.448215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d6efb888-2d36-40e9-a09f-41fff3a6c1c9 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:26.457785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6efb888-2d36-40e9-a09f-41fff3a6c1c9 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:26.458928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6efb888-2d36-40e9-a09f-41fff3a6c1c9 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:26.460137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6efb888-2d36-40e9-a09f-41fff3a6c1c9 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:26.460951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6efb888-2d36-40e9-a09f-41fff3a6c1c9 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:26.669960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d6efb888-2d36-40e9-a09f-41fff3a6c1c9 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:26.680817 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d6efb888-2d36-40e9-a09f-41fff3a6c1c9 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1468 microversion: 2.1 time: 0.239673 Aug 02 07:05:26.695147 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1949/3791] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:26 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1468 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:26.708564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f4d1eb68-ad25-4037-a014-5601c9170fb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:26.710303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f4d1eb68-ad25-4037-a014-5601c9170fb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:26.721715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4d1eb68-ad25-4037-a014-5601c9170fb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:26.723137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4d1eb68-ad25-4037-a014-5601c9170fb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:26.724705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4d1eb68-ad25-4037-a014-5601c9170fb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:26.726440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4d1eb68-ad25-4037-a014-5601c9170fb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:26.766029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-f4d1eb68-ad25-4037-a014-5601c9170fb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lazy-loading 'flavor' on Instance uuid 20890d92-8b2b-4bff-93f9-781782bcfca4 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:05:26.891209 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f4d1eb68-ad25-4037-a014-5601c9170fb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4/action" status: 202 len: 0 microversion: 2.1 time: 0.188968 Aug 02 07:05:26.892366 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1843/3792] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:05:26 2022] POST /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:05:26.902131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-39f0bd72-68b5-4897-9002-8f3fabf6910e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:26.902800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-39f0bd72-68b5-4897-9002-8f3fabf6910e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:26.909469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39f0bd72-68b5-4897-9002-8f3fabf6910e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:26.910183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39f0bd72-68b5-4897-9002-8f3fabf6910e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:26.911015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39f0bd72-68b5-4897-9002-8f3fabf6910e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:26.911438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39f0bd72-68b5-4897-9002-8f3fabf6910e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:27.125198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-08a81d9e-b39f-4803-aaf9-af93a5242886 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:27.126045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-08a81d9e-b39f-4803-aaf9-af93a5242886 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:27.137266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08a81d9e-b39f-4803-aaf9-af93a5242886 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:27.138062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08a81d9e-b39f-4803-aaf9-af93a5242886 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:27.138915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08a81d9e-b39f-4803-aaf9-af93a5242886 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:27.139359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08a81d9e-b39f-4803-aaf9-af93a5242886 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:27.189579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:27.304138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-39f0bd72-68b5-4897-9002-8f3fabf6910e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:27.326706 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-39f0bd72-68b5-4897-9002-8f3fabf6910e tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1476 microversion: 2.1 time: 0.428932 Aug 02 07:05:27.327993 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1950/3793] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:26 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1476 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:27.432942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1967822980", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a30dbbf-9ed5-4371-af86-d34ddcdf6f20"}], "security_groups": [{"name": "tempest-securitygroup--1680830320"}], "key_name": "tempest-keypair-950874326", "user_data": "}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:27.464468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-08a81d9e-b39f-4803-aaf9-af93a5242886 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:27.480441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-08a81d9e-b39f-4803-aaf9-af93a5242886 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:27.482222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-08a81d9e-b39f-4803-aaf9-af93a5242886 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:27.485131 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-08a81d9e-b39f-4803-aaf9-af93a5242886 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1406 microversion: 2.20 time: 0.364159 Aug 02 07:05:27.487332 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1844/3794] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:27 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:05:27.628050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] validate_networks() for [('9a30dbbf-9ed5-4371-af86-d34ddcdf6f20', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:05:27.919374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-db3b0022-7b3d-495a-a5ad-d40849cdb0c0 req-a495f038-163b-495e-93c1-f2ec8a4c8429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ccfed8-393e-4223-b2a8-7dbf8c77d3fe", "name": "network-vif-plugged", "status": "completed", "tag": "96c2e36a-4761-4b9b-b02e-96b42f53d06e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:27.943157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-db3b0022-7b3d-495a-a5ad-d40849cdb0c0 req-a495f038-163b-495e-93c1-f2ec8a4c8429 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:27.946617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-db3b0022-7b3d-495a-a5ad-d40849cdb0c0 req-a495f038-163b-495e-93c1-f2ec8a4c8429 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:27.987962 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-db3b0022-7b3d-495a-a5ad-d40849cdb0c0 req-a495f038-163b-495e-93c1-f2ec8a4c8429 service nova] Creating event network-vif-plugged:96c2e36a-4761-4b9b-b02e-96b42f53d06e for instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe on n-h1-851337-3 Aug 02 07:05:27.999311 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-db3b0022-7b3d-495a-a5ad-d40849cdb0c0 req-a495f038-163b-495e-93c1-f2ec8a4c8429 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085713 Aug 02 07:05:28.000464 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1845/3795] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:05:28.182074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:05:28.182683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:05:28.183477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:05:28.184582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:05:28.185353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:05:28.215532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:28.216282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:28.217437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:28.218075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:28.242958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for project 6ee1befa077542b9a17865baad3c9999. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:05:28.249744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for user 3a2629fa08b5419a96c2942118d38dad and project 6ee1befa077542b9a17865baad3c9999. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:05:28.280653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:05:28.290299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:05:28.335670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:28.348448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e42bd0d4-a11d-488c-96fb-000182972743 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:28.349151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e42bd0d4-a11d-488c-96fb-000182972743 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:28.369639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e42bd0d4-a11d-488c-96fb-000182972743 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:28.370164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e42bd0d4-a11d-488c-96fb-000182972743 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:28.371003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e42bd0d4-a11d-488c-96fb-000182972743 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:28.371433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e42bd0d4-a11d-488c-96fb-000182972743 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:28.377867 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f446638d-6f3c-422f-8500-325f3e131d60 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.950010 Aug 02 07:05:28.379796 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1951/3796] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:05:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 07:05:28.390013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-67e9bbe1-b96a-4b21-901c-db2ad230cb32 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:28.405793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-67e9bbe1-b96a-4b21-901c-db2ad230cb32 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:28.517528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-67e9bbe1-b96a-4b21-901c-db2ad230cb32 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:28.545731 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-67e9bbe1-b96a-4b21-901c-db2ad230cb32 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1241 microversion: 2.1 time: 0.158889 Aug 02 07:05:28.550680 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1952/3797] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:28 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1241 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:28.558381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-244620cd-3233-46e1-9d6f-2c976068af64 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:28.562500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-244620cd-3233-46e1-9d6f-2c976068af64 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:28.579962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-244620cd-3233-46e1-9d6f-2c976068af64 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:28.581882 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-244620cd-3233-46e1-9d6f-2c976068af64 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:28.588123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-244620cd-3233-46e1-9d6f-2c976068af64 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:28.588123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-244620cd-3233-46e1-9d6f-2c976068af64 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:28.828369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e42bd0d4-a11d-488c-96fb-000182972743 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:28.841789 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e42bd0d4-a11d-488c-96fb-000182972743 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1459 microversion: 2.1 time: 0.497626 Aug 02 07:05:28.842455 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1846/3798] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:28 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1459 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:28.883867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-482c4c72-d6c9-4b98-93e6-bb52f1f1abc8 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:28.886462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-482c4c72-d6c9-4b98-93e6-bb52f1f1abc8 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:28.913350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-482c4c72-d6c9-4b98-93e6-bb52f1f1abc8 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:28.916313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-482c4c72-d6c9-4b98-93e6-bb52f1f1abc8 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:28.918987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-482c4c72-d6c9-4b98-93e6-bb52f1f1abc8 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:28.923105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-482c4c72-d6c9-4b98-93e6-bb52f1f1abc8 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:28.990602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-244620cd-3233-46e1-9d6f-2c976068af64 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:29.006733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-244620cd-3233-46e1-9d6f-2c976068af64 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:29.008470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-244620cd-3233-46e1-9d6f-2c976068af64 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:29.009655 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-244620cd-3233-46e1-9d6f-2c976068af64 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1406 microversion: 2.20 time: 0.457648 Aug 02 07:05:29.010262 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1953/3799] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:28 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1406 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:05:29.520351 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-482c4c72-d6c9-4b98-93e6-bb52f1f1abc8 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1610 microversion: 2.1 time: 0.655449 Aug 02 07:05:29.520917 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1847/3800] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:28 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1610 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:29.545639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d8e7ca51-d2af-4c74-8b9a-2a58b89c5341 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:29.549614 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:05:29.549614 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 07:05:29.551749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8e7ca51-d2af-4c74-8b9a-2a58b89c5341 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:29.554852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8e7ca51-d2af-4c74-8b9a-2a58b89c5341 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:29.556465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8e7ca51-d2af-4c74-8b9a-2a58b89c5341 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:29.561617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8e7ca51-d2af-4c74-8b9a-2a58b89c5341 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:29.582492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e667a535-2718-4ace-a70e-5c03f5cc6bf3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:29.583032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e667a535-2718-4ace-a70e-5c03f5cc6bf3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:29.600666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e667a535-2718-4ace-a70e-5c03f5cc6bf3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:29.601792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e667a535-2718-4ace-a70e-5c03f5cc6bf3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:29.606659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e667a535-2718-4ace-a70e-5c03f5cc6bf3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:29.607251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e667a535-2718-4ace-a70e-5c03f5cc6bf3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:29.677770 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d8e7ca51-d2af-4c74-8b9a-2a58b89c5341 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.135913 Aug 02 07:05:29.685353 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1954/3801] 10.222.0.79 () {58 vars in 1176 bytes} [Tue Aug 2 07:05:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:29.695430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aff8eceb-de81-408d-8bfc-79cf02d14eb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851337-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:29.701326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aff8eceb-de81-408d-8bfc-79cf02d14eb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:29.734511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aff8eceb-de81-408d-8bfc-79cf02d14eb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:29.737776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aff8eceb-de81-408d-8bfc-79cf02d14eb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:29.738978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aff8eceb-de81-408d-8bfc-79cf02d14eb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:29.739606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aff8eceb-de81-408d-8bfc-79cf02d14eb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:29.749983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e667a535-2718-4ace-a70e-5c03f5cc6bf3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:29.770327 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e667a535-2718-4ace-a70e-5c03f5cc6bf3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1237 microversion: 2.1 time: 0.204137 Aug 02 07:05:29.783640 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1848/3802] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:29 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1237 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:29.805343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-aff8eceb-de81-408d-8bfc-79cf02d14eb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Lazy-loading 'flavor' on Instance uuid 20890d92-8b2b-4bff-93f9-781782bcfca4 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:05:29.824052 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-aff8eceb-de81-408d-8bfc-79cf02d14eb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 20890d92-8b2b-4bff-93f9-781782bcfca4 while it is in vm_state suspended Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aff8eceb-de81-408d-8bfc-79cf02d14eb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Request method failure captured: Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4/action HTTP/1.1 Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 97 Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MyPTeMjrXEvVxQ5nEfRJrtdd86OdeAArQgso4Bxd9aFxpINe7VGxkZfp0p2fczZW0hi3--faFuDLKjdvaL3HOKJP5RrkG3gaHTt08sivi0lYKp-TobbzFLR9TUPkndH9ZF3fllZxTLabIeqMSqEdFvoI5p4n6FvZOqaRP1tiWrW-C0 Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5db3091ca56e4162b0d85d4f233ec0a2 Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-LiveMigrationNegativeTest-86015300 Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5db3091ca56e4162b0d85d4f233ec0a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5db3091ca56e4162b0d85d4f233ec0a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5db3091ca56e4162b0d85d4f233ec0a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5db3091ca56e4162b0d85d4f233ec0a2"}]}] Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-LiveMigrationNegativeTest-86015300 Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5db3091ca56e4162b0d85d4f233ec0a2 Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-86015300 Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-LiveMigrationNegativeTest-86015300-project-admin Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: bf2ab1bcc461441dbcb6c0e26d2f583e Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-LiveMigrationNegativeTest-86015300-project-admin Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: {"os-migrateLive": {"host": "n-h1-851337-3", "block_migration": true, "disk_over_commit": false}} Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: exception: Cannot 'os-migrateLive' instance 20890d92-8b2b-4bff-93f9-781782bcfca4 while it is in vm_state suspended Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '20890d92-8b2b-4bff-93f9-781782bcfca4', 'body': {'os-migrateLive': {'host': 'n-h1-851337-3', 'block_migration': True, 'disk_over_commit': False}}} Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 20890d92-8b2b-4bff-93f9-781782bcfca4 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:05:29.827170 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 20890d92-8b2b-4bff-93f9-781782bcfca4 while it is in vm_state suspended Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 20890d92-8b2b-4bff-93f9-781782bcfca4 while it is in vm_state suspended Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aff8eceb-de81-408d-8bfc-79cf02d14eb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 20890d92-8b2b-4bff-93f9-781782bcfca4 while it is in vm_state suspended {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aff8eceb-de81-408d-8bfc-79cf02d14eb4 tempest-LiveMigrationNegativeTest-86015300 tempest-LiveMigrationNegativeTest-86015300-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4/action" status: 409 len: 155 microversion: 2.1 time: 0.139736 Aug 02 07:05:29.833666 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1955/3803] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:05:29 2022] POST /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4/action => generated 155 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:05:29.846974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-71c5af3c-cb59-4639-900e-a3b067e1bf5c tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:29.847543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-71c5af3c-cb59-4639-900e-a3b067e1bf5c tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:29.857384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71c5af3c-cb59-4639-900e-a3b067e1bf5c tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:29.857740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71c5af3c-cb59-4639-900e-a3b067e1bf5c tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:29.858561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71c5af3c-cb59-4639-900e-a3b067e1bf5c tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:29.859073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71c5af3c-cb59-4639-900e-a3b067e1bf5c tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:29.902094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-71c5af3c-cb59-4639-900e-a3b067e1bf5c tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:05:30.036294 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-453d8f3e-67d8-4b35-b2cf-43d93f84392d req-2b1d0a56-4ace-4e60-ae49-c4de4d253e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9ae016-6a95-4257-8d74-99fcd50ae1cb", "name": "network-vif-plugged", "status": "completed", "tag": "3ee7c406-2514-4927-ba77-18750ac8d2ab"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:30.063641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-453d8f3e-67d8-4b35-b2cf-43d93f84392d req-2b1d0a56-4ace-4e60-ae49-c4de4d253e4d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:30.064530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-453d8f3e-67d8-4b35-b2cf-43d93f84392d req-2b1d0a56-4ace-4e60-ae49-c4de4d253e4d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:30.085925 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-71c5af3c-cb59-4639-900e-a3b067e1bf5c tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "DELETE /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 204 len: 0 microversion: 2.1 time: 0.242814 Aug 02 07:05:30.088051 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1849/3804] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:05:29 2022] DELETE /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:05:30.101420 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-453d8f3e-67d8-4b35-b2cf-43d93f84392d req-2b1d0a56-4ace-4e60-ae49-c4de4d253e4d service nova] Creating event network-vif-plugged:3ee7c406-2514-4927-ba77-18750ac8d2ab for instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb on n-h1-851337-3 Aug 02 07:05:30.107601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-635af9a2-0139-4662-b357-d57619000452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:30.113138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-635af9a2-0139-4662-b357-d57619000452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:30.115369 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-453d8f3e-67d8-4b35-b2cf-43d93f84392d req-2b1d0a56-4ace-4e60-ae49-c4de4d253e4d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082776 Aug 02 07:05:30.115991 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1956/3805] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:05:30.126060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-635af9a2-0139-4662-b357-d57619000452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:30.127205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-635af9a2-0139-4662-b357-d57619000452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:30.128501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-635af9a2-0139-4662-b357-d57619000452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:30.129110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-635af9a2-0139-4662-b357-d57619000452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:30.134334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2a3cd42a-e0a5-47a2-a8f0-971628dadc8a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:30.135080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2a3cd42a-e0a5-47a2-a8f0-971628dadc8a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:30.152356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a3cd42a-e0a5-47a2-a8f0-971628dadc8a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:30.152823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a3cd42a-e0a5-47a2-a8f0-971628dadc8a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:30.155175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a3cd42a-e0a5-47a2-a8f0-971628dadc8a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:30.155743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a3cd42a-e0a5-47a2-a8f0-971628dadc8a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:30.460289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2a3cd42a-e0a5-47a2-a8f0-971628dadc8a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:30.477613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-635af9a2-0139-4662-b357-d57619000452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:30.486158 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2a3cd42a-e0a5-47a2-a8f0-971628dadc8a tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1465 microversion: 2.1 time: 0.343875 Aug 02 07:05:30.487282 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1957/3806] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:30 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1465 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:30.501307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-635af9a2-0139-4662-b357-d57619000452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:30.504135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-635af9a2-0139-4662-b357-d57619000452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:30.505955 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-635af9a2-0139-4662-b357-d57619000452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1406 microversion: 2.20 time: 0.415072 Aug 02 07:05:30.507349 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1850/3807] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:30 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1406 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:05:30.796480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e318e75-2388-4234-8efe-90c9cf7ac5ca tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:30.797470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7e318e75-2388-4234-8efe-90c9cf7ac5ca tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:30.813521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e318e75-2388-4234-8efe-90c9cf7ac5ca tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:30.815064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e318e75-2388-4234-8efe-90c9cf7ac5ca tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:30.816309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e318e75-2388-4234-8efe-90c9cf7ac5ca tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:30.816951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e318e75-2388-4234-8efe-90c9cf7ac5ca tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:30.928004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7e318e75-2388-4234-8efe-90c9cf7ac5ca tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:30.936867 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7e318e75-2388-4234-8efe-90c9cf7ac5ca tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1301 microversion: 2.1 time: 0.145237 Aug 02 07:05:30.937549 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1958/3808] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:30 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1301 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:31.514952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-19ef000d-5901-4665-9a83-665b905f7053 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:31.524232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-19ef000d-5901-4665-9a83-665b905f7053 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:31.536544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ca55e6ab-043c-4e3f-84a3-ed979e0abac5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:31.538687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ca55e6ab-043c-4e3f-84a3-ed979e0abac5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:31.553357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19ef000d-5901-4665-9a83-665b905f7053 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:31.555696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19ef000d-5901-4665-9a83-665b905f7053 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:31.559043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19ef000d-5901-4665-9a83-665b905f7053 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:31.564481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19ef000d-5901-4665-9a83-665b905f7053 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:31.567417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca55e6ab-043c-4e3f-84a3-ed979e0abac5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:31.569508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca55e6ab-043c-4e3f-84a3-ed979e0abac5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:31.571500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca55e6ab-043c-4e3f-84a3-ed979e0abac5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:31.571956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca55e6ab-043c-4e3f-84a3-ed979e0abac5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:32.229950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-19ef000d-5901-4665-9a83-665b905f7053 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:32.245253 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-19ef000d-5901-4665-9a83-665b905f7053 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1465 microversion: 2.1 time: 0.740340 Aug 02 07:05:32.247999 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1851/3809] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:31 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1465 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:32.260486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b12d915e-103f-44b3-bc64-5e1837266837 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:32.263249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b12d915e-103f-44b3-bc64-5e1837266837 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:32.285595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b12d915e-103f-44b3-bc64-5e1837266837 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:32.286459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b12d915e-103f-44b3-bc64-5e1837266837 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:32.288607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b12d915e-103f-44b3-bc64-5e1837266837 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:32.290108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b12d915e-103f-44b3-bc64-5e1837266837 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:32.422641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ca55e6ab-043c-4e3f-84a3-ed979e0abac5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:32.444924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ca55e6ab-043c-4e3f-84a3-ed979e0abac5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:32.450762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ca55e6ab-043c-4e3f-84a3-ed979e0abac5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:32.457957 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ca55e6ab-043c-4e3f-84a3-ed979e0abac5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1406 microversion: 2.20 time: 0.929556 Aug 02 07:05:32.469430 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1959/3810] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:31 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1406 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:05:32.609994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b12d915e-103f-44b3-bc64-5e1837266837 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:32.652730 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b12d915e-103f-44b3-bc64-5e1837266837 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1299 microversion: 2.1 time: 0.402818 Aug 02 07:05:32.653683 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1852/3811] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:32 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1299 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:33.270657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f1a16701-d204-4586-8d50-d5bbcc325d40 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:33.271520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f1a16701-d204-4586-8d50-d5bbcc325d40 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:33.323696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1a16701-d204-4586-8d50-d5bbcc325d40 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:33.325879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1a16701-d204-4586-8d50-d5bbcc325d40 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:33.329775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1a16701-d204-4586-8d50-d5bbcc325d40 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:33.330663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1a16701-d204-4586-8d50-d5bbcc325d40 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:33.494634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-015dca44-f984-44c7-bb5a-8527ca1d59a0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:33.495138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-015dca44-f984-44c7-bb5a-8527ca1d59a0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:33.507710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-015dca44-f984-44c7-bb5a-8527ca1d59a0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:33.509409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-015dca44-f984-44c7-bb5a-8527ca1d59a0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:33.521427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-015dca44-f984-44c7-bb5a-8527ca1d59a0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:33.521799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-015dca44-f984-44c7-bb5a-8527ca1d59a0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:33.962835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f1a16701-d204-4586-8d50-d5bbcc325d40 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:33.977451 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f1a16701-d204-4586-8d50-d5bbcc325d40 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 200 len: 1465 microversion: 2.1 time: 0.711939 Aug 02 07:05:33.982965 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1960/3812] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:33 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 1465 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:33.993483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e93a7388-cf1a-4c6f-996a-4a7f2faaa128 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:34.014610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e93a7388-cf1a-4c6f-996a-4a7f2faaa128 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:34.044606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e93a7388-cf1a-4c6f-996a-4a7f2faaa128 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:34.050485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e93a7388-cf1a-4c6f-996a-4a7f2faaa128 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:34.058015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e93a7388-cf1a-4c6f-996a-4a7f2faaa128 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:34.058945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e93a7388-cf1a-4c6f-996a-4a7f2faaa128 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:34.115294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-015dca44-f984-44c7-bb5a-8527ca1d59a0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:34.144106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-015dca44-f984-44c7-bb5a-8527ca1d59a0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:34.146239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-015dca44-f984-44c7-bb5a-8527ca1d59a0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:34.157373 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-015dca44-f984-44c7-bb5a-8527ca1d59a0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1598 microversion: 2.20 time: 0.667321 Aug 02 07:05:34.158290 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1853/3813] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:05:33 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1598 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:05:34.171640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-cc901779-9810-4a26-b149-fe5a1ef6772a req-844565ef-5dd4-40f6-9c71-890aeee2f2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20890d92-8b2b-4bff-93f9-781782bcfca4", "name": "network-vif-deleted", "tag": "b90254a9-a8ac-406c-a056-b7e39509570e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:34.199873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cc901779-9810-4a26-b149-fe5a1ef6772a req-844565ef-5dd4-40f6-9c71-890aeee2f2e7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:34.200649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cc901779-9810-4a26-b149-fe5a1ef6772a req-844565ef-5dd4-40f6-9c71-890aeee2f2e7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:34.231148 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-cc901779-9810-4a26-b149-fe5a1ef6772a req-844565ef-5dd4-40f6-9c71-890aeee2f2e7 service nova] Creating event network-vif-deleted:b90254a9-a8ac-406c-a056-b7e39509570e for instance 20890d92-8b2b-4bff-93f9-781782bcfca4 on n-h2-851337-3 Aug 02 07:05:34.238839 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-cc901779-9810-4a26-b149-fe5a1ef6772a req-844565ef-5dd4-40f6-9c71-890aeee2f2e7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079005 Aug 02 07:05:34.245959 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1854/3814] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:34.252049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-887579dc-2c6e-4a2f-9a96-8d5218c27710 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:34.267034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-887579dc-2c6e-4a2f-9a96-8d5218c27710 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:34.274178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-887579dc-2c6e-4a2f-9a96-8d5218c27710 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:34.274876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-887579dc-2c6e-4a2f-9a96-8d5218c27710 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:34.275831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-887579dc-2c6e-4a2f-9a96-8d5218c27710 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:34.283922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-887579dc-2c6e-4a2f-9a96-8d5218c27710 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:34.515321 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-887579dc-2c6e-4a2f-9a96-8d5218c27710 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.267558 Aug 02 07:05:34.516153 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1855/3815] 10.222.0.79 () {60 vars in 1316 bytes} [Tue Aug 2 07:05:34 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-interface => generated 285 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:05:34.561109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e93a7388-cf1a-4c6f-996a-4a7f2faaa128 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:34.573495 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e93a7388-cf1a-4c6f-996a-4a7f2faaa128 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1299 microversion: 2.1 time: 0.588985 Aug 02 07:05:34.575409 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1961/3816] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:33 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1299 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:35.010654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ceaf4a45-529b-4d08-93d6-fd72b159f072 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:35.011282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ceaf4a45-529b-4d08-93d6-fd72b159f072 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 20890d92-8b2b-4bff-93f9-781782bcfca4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:35.057473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ceaf4a45-529b-4d08-93d6-fd72b159f072 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:35.058310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ceaf4a45-529b-4d08-93d6-fd72b159f072 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:35.065760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ceaf4a45-529b-4d08-93d6-fd72b159f072 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:35.067379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ceaf4a45-529b-4d08-93d6-fd72b159f072 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:35.129063 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-ceaf4a45-529b-4d08-93d6-fd72b159f072 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] HTTP exception thrown: Instance 20890d92-8b2b-4bff-93f9-781782bcfca4 could not be found. Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ceaf4a45-529b-4d08-93d6-fd72b159f072 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Request method failure captured: Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 HTTP/1.1 Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MyOKV_OrXtZkWBBMoCmDSqfayIJ13eH8UW9ONqfmiGa5djPh7oEFFfvf5gyB8WL6IvvV-ShhBz-DMsaP3uuQNXF6D42OcuKz3wgUdHRlWGguGb-OHM90NobGToTzckF9rCu1JCVde16uRmbe0BO28hUr_wZekZzvjktDmDVqJiUQNE Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 9ef001cfe28743b6812f432721c633ea Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-LiveMigrationNegativeTest-511122260 Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9ef001cfe28743b6812f432721c633ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ef001cfe28743b6812f432721c633ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9ef001cfe28743b6812f432721c633ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ef001cfe28743b6812f432721c633ea"}]}] Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-LiveMigrationNegativeTest-511122260 Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 9ef001cfe28743b6812f432721c633ea Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-511122260 Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-LiveMigrationNegativeTest-511122260-project Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 135c2de316dd4cf7a7d6dda0a1494763 Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-LiveMigrationNegativeTest-511122260-project Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 20890d92-8b2b-4bff-93f9-781782bcfca4 could not be found. Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '20890d92-8b2b-4bff-93f9-781782bcfca4'} Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20890d92-8b2b-4bff-93f9-781782bcfca4 could not be found. Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20890d92-8b2b-4bff-93f9-781782bcfca4 could not be found. Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:05:35.131311 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:35.135013 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:35.135013 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:05:35.135013 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:05:35.135013 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:05:35.135013 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:05:35.135013 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20890d92-8b2b-4bff-93f9-781782bcfca4 could not be found. Aug 02 07:05:35.135013 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:05:35.142566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ceaf4a45-529b-4d08-93d6-fd72b159f072 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Returning 404 to user: Instance 20890d92-8b2b-4bff-93f9-781782bcfca4 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:05:35.147669 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ceaf4a45-529b-4d08-93d6-fd72b159f072 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4" status: 404 len: 111 microversion: 2.1 time: 0.144400 Aug 02 07:05:35.148302 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1856/3817] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:34 2022] GET /compute/v2.1/servers/20890d92-8b2b-4bff-93f9-781782bcfca4 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:05:35.160957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-40adf563-8331-4902-87f3-57819c404b71 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:35.163881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-40adf563-8331-4902-87f3-57819c404b71 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:35.195289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40adf563-8331-4902-87f3-57819c404b71 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:35.200582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40adf563-8331-4902-87f3-57819c404b71 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:35.208570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40adf563-8331-4902-87f3-57819c404b71 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:35.216072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40adf563-8331-4902-87f3-57819c404b71 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:35.325594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-40adf563-8331-4902-87f3-57819c404b71 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:05:35.599426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-edbda106-41d7-4b5d-9b5d-45f746567b34 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:35.600134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-edbda106-41d7-4b5d-9b5d-45f746567b34 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:35.605015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:35.623705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-edbda106-41d7-4b5d-9b5d-45f746567b34 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:35.630549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-edbda106-41d7-4b5d-9b5d-45f746567b34 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:35.633853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-edbda106-41d7-4b5d-9b5d-45f746567b34 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:35.635296 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-40adf563-8331-4902-87f3-57819c404b71 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 204 len: 0 microversion: 2.1 time: 0.480407 Aug 02 07:05:35.635820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-edbda106-41d7-4b5d-9b5d-45f746567b34 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:35.637503 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1962/3818] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:05:35 2022] DELETE /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:05:35.657141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-413fbb87-6aff-4fd1-9d3f-7daf6ab54c96 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:35.657848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-413fbb87-6aff-4fd1-9d3f-7daf6ab54c96 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:35.672649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-413fbb87-6aff-4fd1-9d3f-7daf6ab54c96 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:35.673108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-413fbb87-6aff-4fd1-9d3f-7daf6ab54c96 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:35.673916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-413fbb87-6aff-4fd1-9d3f-7daf6ab54c96 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:35.674401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-413fbb87-6aff-4fd1-9d3f-7daf6ab54c96 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:36.911835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-413fbb87-6aff-4fd1-9d3f-7daf6ab54c96 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:36.921109 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-413fbb87-6aff-4fd1-9d3f-7daf6ab54c96 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1474 microversion: 2.1 time: 1.267411 Aug 02 07:05:36.926016 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1963/3819] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:35 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1474 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:36.933465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e6ffa54a-3ecb-421d-9dc0-a22ded341850 req-6aada425-852c-433d-a3df-15683c5b6dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a9ae016-6a95-4257-8d74-99fcd50ae1cb", "tag": "3ee7c406-2514-4927-ba77-18750ac8d2ab"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:36.941605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-edbda106-41d7-4b5d-9b5d-45f746567b34 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:36.955947 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-edbda106-41d7-4b5d-9b5d-45f746567b34 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1367 microversion: 2.1 time: 1.360418 Aug 02 07:05:36.966183 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1857/3820] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:35 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1367 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:36.974089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e6ffa54a-3ecb-421d-9dc0-a22ded341850 req-6aada425-852c-433d-a3df-15683c5b6dec service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:36.974089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e6ffa54a-3ecb-421d-9dc0-a22ded341850 req-6aada425-852c-433d-a3df-15683c5b6dec service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:37.000196 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e6ffa54a-3ecb-421d-9dc0-a22ded341850 req-6aada425-852c-433d-a3df-15683c5b6dec service nova] Creating event network-changed:3ee7c406-2514-4927-ba77-18750ac8d2ab for instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb on n-h1-851337-3 Aug 02 07:05:37.008876 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e6ffa54a-3ecb-421d-9dc0-a22ded341850 req-6aada425-852c-433d-a3df-15683c5b6dec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080403 Aug 02 07:05:37.008876 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1964/3821] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:37.949076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e49e62ad-485a-488c-b732-0734c9dba023 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:37.949768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e49e62ad-485a-488c-b732-0734c9dba023 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:37.972385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e49e62ad-485a-488c-b732-0734c9dba023 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:37.983319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-06893ffa-b6a3-4fcf-87af-be4b9cd87460 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:37.984618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-06893ffa-b6a3-4fcf-87af-be4b9cd87460 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:37.988236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e49e62ad-485a-488c-b732-0734c9dba023 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:37.989603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e49e62ad-485a-488c-b732-0734c9dba023 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:37.990114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e49e62ad-485a-488c-b732-0734c9dba023 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:38.047425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06893ffa-b6a3-4fcf-87af-be4b9cd87460 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:38.055837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06893ffa-b6a3-4fcf-87af-be4b9cd87460 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:38.056840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06893ffa-b6a3-4fcf-87af-be4b9cd87460 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:38.057206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06893ffa-b6a3-4fcf-87af-be4b9cd87460 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:38.528636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:38.585799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-06893ffa-b6a3-4fcf-87af-be4b9cd87460 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:38.588479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:38.595906 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-06893ffa-b6a3-4fcf-87af-be4b9cd87460 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1367 microversion: 2.1 time: 0.617560 Aug 02 07:05:38.604503 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1965/3822] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:37 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1367 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:38.612290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-871ba0b7-ec91-4789-9788-17eaa0a996a9 req-81410ea9-a646-405c-9aeb-1669e1d6684c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee50e87a-eb21-4ce8-82c5-9cf1be097c4f", "tag": "d5b278ab-5524-4da2-ad6d-175f510b6f30"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:38.639941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-871ba0b7-ec91-4789-9788-17eaa0a996a9 req-81410ea9-a646-405c-9aeb-1669e1d6684c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:38.640728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-871ba0b7-ec91-4789-9788-17eaa0a996a9 req-81410ea9-a646-405c-9aeb-1669e1d6684c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:38.672832 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-871ba0b7-ec91-4789-9788-17eaa0a996a9 req-81410ea9-a646-405c-9aeb-1669e1d6684c service nova] Creating event network-changed:d5b278ab-5524-4da2-ad6d-175f510b6f30 for instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f on n-h2-851337-3 Aug 02 07:05:38.680902 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-871ba0b7-ec91-4789-9788-17eaa0a996a9 req-81410ea9-a646-405c-9aeb-1669e1d6684c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074831 Aug 02 07:05:38.683401 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1966/3823] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:38.816215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e49e62ad-485a-488c-b732-0734c9dba023 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:38.826969 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e49e62ad-485a-488c-b732-0734c9dba023 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1474 microversion: 2.1 time: 0.884598 Aug 02 07:05:38.829747 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1858/3824] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:37 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1474 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:39.635068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd33e5de-b41e-4e48-a5a9-50e722284d5e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:39.636299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dd33e5de-b41e-4e48-a5a9-50e722284d5e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:39.687628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:39.725260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd33e5de-b41e-4e48-a5a9-50e722284d5e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:39.730654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd33e5de-b41e-4e48-a5a9-50e722284d5e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:39.733791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd33e5de-b41e-4e48-a5a9-50e722284d5e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:39.753166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd33e5de-b41e-4e48-a5a9-50e722284d5e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:39.935563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2202452d-4fbf-4fc2-b7d6-ed7746319273 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:39.936854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2202452d-4fbf-4fc2-b7d6-ed7746319273 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:40.020570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2202452d-4fbf-4fc2-b7d6-ed7746319273 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:40.022841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2202452d-4fbf-4fc2-b7d6-ed7746319273 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:40.032039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2202452d-4fbf-4fc2-b7d6-ed7746319273 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:40.041003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2202452d-4fbf-4fc2-b7d6-ed7746319273 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:40.301249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2202452d-4fbf-4fc2-b7d6-ed7746319273 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135c2de316dd4cf7a7d6dda0a1494763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef001cfe28743b6812f432721c633ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:40.335237 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2202452d-4fbf-4fc2-b7d6-ed7746319273 tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 200 len: 1432 microversion: 2.1 time: 0.462472 Aug 02 07:05:40.347401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dd33e5de-b41e-4e48-a5a9-50e722284d5e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:40.348976 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1859/3825] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:39 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 1432 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:40.360357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-37ed0a01-6228-4209-9db6-5e9a37781452 req-ece8b80e-f8b6-4544-9d07-0d17ee0f6035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd", "name": "network-vif-deleted", "tag": "74652927-c9ec-4f70-8098-e3b4e312e343"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:40.404518 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dd33e5de-b41e-4e48-a5a9-50e722284d5e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1367 microversion: 2.1 time: 0.773953 Aug 02 07:05:40.407757 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1967/3826] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:39 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1367 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:40.443480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-37ed0a01-6228-4209-9db6-5e9a37781452 req-ece8b80e-f8b6-4544-9d07-0d17ee0f6035 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:40.444194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-37ed0a01-6228-4209-9db6-5e9a37781452 req-ece8b80e-f8b6-4544-9d07-0d17ee0f6035 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:40.481447 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-37ed0a01-6228-4209-9db6-5e9a37781452 req-ece8b80e-f8b6-4544-9d07-0d17ee0f6035 service nova] Creating event network-vif-deleted:74652927-c9ec-4f70-8098-e3b4e312e343 for instance 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd on n-h1-851337-3 Aug 02 07:05:40.498119 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-37ed0a01-6228-4209-9db6-5e9a37781452 req-ece8b80e-f8b6-4544-9d07-0d17ee0f6035 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146209 Aug 02 07:05:40.508308 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1860/3827] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:41.373554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-45b2b4af-df59-4048-9953-28d60422751b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:41.374201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-45b2b4af-df59-4048-9953-28d60422751b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] [instance: 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:41.388629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45b2b4af-df59-4048-9953-28d60422751b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:41.390212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45b2b4af-df59-4048-9953-28d60422751b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:41.394578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45b2b4af-df59-4048-9953-28d60422751b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:41.395685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45b2b4af-df59-4048-9953-28d60422751b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:41.432657 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-45b2b4af-df59-4048-9953-28d60422751b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] HTTP exception thrown: Instance 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd could not be found. Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-45b2b4af-df59-4048-9953-28d60422751b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Request method failure captured: Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd HTTP/1.1 Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MyOKV_OrXtZkWBBMoCmDSqfayIJ13eH8UW9ONqfmiGa5djPh7oEFFfvf5gyB8WL6IvvV-ShhBz-DMsaP3uuQNXF6D42OcuKz3wgUdHRlWGguGb-OHM90NobGToTzckF9rCu1JCVde16uRmbe0BO28hUr_wZekZzvjktDmDVqJiUQNE Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 9ef001cfe28743b6812f432721c633ea Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-LiveMigrationNegativeTest-511122260 Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9ef001cfe28743b6812f432721c633ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ef001cfe28743b6812f432721c633ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9ef001cfe28743b6812f432721c633ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ef001cfe28743b6812f432721c633ea"}]}] Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-LiveMigrationNegativeTest-511122260 Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 9ef001cfe28743b6812f432721c633ea Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-511122260 Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-LiveMigrationNegativeTest-511122260-project Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 135c2de316dd4cf7a7d6dda0a1494763 Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-LiveMigrationNegativeTest-511122260-project Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd could not be found. Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd'} Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd could not be found. Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd could not be found. Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:05:41.440144 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:41.444503 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:05:41.444503 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:05:41.444503 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:05:41.444503 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:05:41.444503 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:05:41.444503 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd could not be found. Aug 02 07:05:41.444503 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:05:41.446237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-45b2b4af-df59-4048-9953-28d60422751b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] Returning 404 to user: Instance 7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:05:41.447309 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-45b2b4af-df59-4048-9953-28d60422751b tempest-LiveMigrationNegativeTest-511122260 tempest-LiveMigrationNegativeTest-511122260-project] 10.222.0.79 "GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd" status: 404 len: 111 microversion: 2.1 time: 0.078899 Aug 02 07:05:41.447972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c1bb3ac4-fb75-407e-a936-9b9a4816abbf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:41.448799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c1bb3ac4-fb75-407e-a936-9b9a4816abbf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:41.449741 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1968/3828] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:41 2022] GET /compute/v2.1/servers/7bb89b45-ce58-4ad4-8222-1bbfe1f9e8cd => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:05:41.471784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1bb3ac4-fb75-407e-a936-9b9a4816abbf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:41.473666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1bb3ac4-fb75-407e-a936-9b9a4816abbf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:41.476565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1bb3ac4-fb75-407e-a936-9b9a4816abbf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:41.477269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1bb3ac4-fb75-407e-a936-9b9a4816abbf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:42.570246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c1bb3ac4-fb75-407e-a936-9b9a4816abbf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:42.581779 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c1bb3ac4-fb75-407e-a936-9b9a4816abbf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1367 microversion: 2.1 time: 1.143559 Aug 02 07:05:42.593917 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1861/3829] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:41 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1367 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:05:43.619000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4d50e3ee-a733-4f98-9334-ae2153421795 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:43.620404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4d50e3ee-a733-4f98-9334-ae2153421795 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:43.637872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d50e3ee-a733-4f98-9334-ae2153421795 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:43.640177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d50e3ee-a733-4f98-9334-ae2153421795 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:43.642986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d50e3ee-a733-4f98-9334-ae2153421795 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:43.645096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d50e3ee-a733-4f98-9334-ae2153421795 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:44.318470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4d50e3ee-a733-4f98-9334-ae2153421795 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:44.330851 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4d50e3ee-a733-4f98-9334-ae2153421795 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1367 microversion: 2.1 time: 0.717193 Aug 02 07:05:44.336494 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1969/3830] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:43 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1367 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:44.546278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-11524656-20af-45ee-b613-55c24a1ab3ff req-69e4cc87-c9ac-497c-8c58-6feb62d7dafb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee50e87a-eb21-4ce8-82c5-9cf1be097c4f", "name": "network-vif-plugged", "status": "completed", "tag": "d5b278ab-5524-4da2-ad6d-175f510b6f30"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:44.621401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-11524656-20af-45ee-b613-55c24a1ab3ff req-69e4cc87-c9ac-497c-8c58-6feb62d7dafb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:44.621945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-11524656-20af-45ee-b613-55c24a1ab3ff req-69e4cc87-c9ac-497c-8c58-6feb62d7dafb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:44.655008 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-11524656-20af-45ee-b613-55c24a1ab3ff req-69e4cc87-c9ac-497c-8c58-6feb62d7dafb service nova] Creating event network-vif-plugged:d5b278ab-5524-4da2-ad6d-175f510b6f30 for instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f on n-h2-851337-3 Aug 02 07:05:44.666309 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-11524656-20af-45ee-b613-55c24a1ab3ff req-69e4cc87-c9ac-497c-8c58-6feb62d7dafb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145960 Aug 02 07:05:44.669257 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1862/3831] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:45.358233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eb188156-f238-4c71-9ed1-ef1678f42969 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:45.359508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-eb188156-f238-4c71-9ed1-ef1678f42969 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:45.384653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eb188156-f238-4c71-9ed1-ef1678f42969 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:45.385348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eb188156-f238-4c71-9ed1-ef1678f42969 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:45.389618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eb188156-f238-4c71-9ed1-ef1678f42969 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:45.393004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eb188156-f238-4c71-9ed1-ef1678f42969 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:45.654341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-eb188156-f238-4c71-9ed1-ef1678f42969 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:45.663030 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-eb188156-f238-4c71-9ed1-ef1678f42969 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1367 microversion: 2.1 time: 0.309964 Aug 02 07:05:45.664055 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1970/3832] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:45 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:46.686344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-772bc2b5-70f3-489a-8dab-bdc76a57adcc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:46.686964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-772bc2b5-70f3-489a-8dab-bdc76a57adcc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:46.705317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-772bc2b5-70f3-489a-8dab-bdc76a57adcc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:46.706121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-772bc2b5-70f3-489a-8dab-bdc76a57adcc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:46.708481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-772bc2b5-70f3-489a-8dab-bdc76a57adcc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:46.709135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-772bc2b5-70f3-489a-8dab-bdc76a57adcc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:46.757401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:47.048796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-772bc2b5-70f3-489a-8dab-bdc76a57adcc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:47.057136 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-772bc2b5-70f3-489a-8dab-bdc76a57adcc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1557 microversion: 2.1 time: 0.375356 Aug 02 07:05:47.057733 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1863/3833] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:46 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1557 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:47.078608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d206dea7-2cd7-4937-8155-efa5b5611a9d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:47.079168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d206dea7-2cd7-4937-8155-efa5b5611a9d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:47.088035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d206dea7-2cd7-4937-8155-efa5b5611a9d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:47.088487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d206dea7-2cd7-4937-8155-efa5b5611a9d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:47.089404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d206dea7-2cd7-4937-8155-efa5b5611a9d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:47.090052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d206dea7-2cd7-4937-8155-efa5b5611a9d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:47.324112 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d206dea7-2cd7-4937-8155-efa5b5611a9d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.249141 Aug 02 07:05:47.325674 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1971/3834] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 07:05:47 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f/os-interface => generated 284 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:05:48.332550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e5acd144-bdcd-46cf-8641-2888ff7c7283 tempest-QuotaClassesAdmin257Test-2101074348 tempest-QuotaClassesAdmin257Test-2101074348-project-admin] Calling method '.version_select at 0x7f927a2c4820>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:48.334301 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:05:48.334301 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 07:05:48.368984 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e5acd144-bdcd-46cf-8641-2888ff7c7283 tempest-QuotaClassesAdmin257Test-2101074348 tempest-QuotaClassesAdmin257Test-2101074348-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.389264 Aug 02 07:05:48.369875 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1864/3835] 10.222.0.79 () {60 vars in 1226 bytes} [Tue Aug 2 07:05:47 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:05:48.382071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3ad821ea-b4c7-4fae-86bb-6326141fe4ad tempest-QuotaClassesAdmin257Test-2101074348 tempest-QuotaClassesAdmin257Test-2101074348-project-admin] Action: 'update', calling method: .version_select at 0x7f927a2efc10>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:48.385832 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:05:48.385832 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 07:05:48.581413 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3ad821ea-b4c7-4fae-86bb-6326141fe4ad tempest-QuotaClassesAdmin257Test-2101074348 tempest-QuotaClassesAdmin257Test-2101074348-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.204323 Aug 02 07:05:48.588436 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1972/3836] 10.222.0.79 () {62 vars in 1247 bytes} [Tue Aug 2 07:05:48 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:05:48.600086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e8a9431b-0bdb-42a6-b8b5-ab3fb83eb81d tempest-QuotaClassesAdmin257Test-2101074348 tempest-QuotaClassesAdmin257Test-2101074348-project-admin] Calling method '.version_select at 0x7f928c2a00d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:48.617643 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e8a9431b-0bdb-42a6-b8b5-ab3fb83eb81d tempest-QuotaClassesAdmin257Test-2101074348 tempest-QuotaClassesAdmin257Test-2101074348-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.022985 Aug 02 07:05:48.620409 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1865/3837] 10.222.0.79 () {60 vars in 1226 bytes} [Tue Aug 2 07:05:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 07:05:48.632400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-26b13d35-b130-48e4-bd81-756637409461 tempest-QuotaClassesAdmin257Test-2101074348 tempest-QuotaClassesAdmin257Test-2101074348-project-admin] Action: 'update', calling method: .version_select at 0x7f927a20c3a0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:48.781738 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-26b13d35-b130-48e4-bd81-756637409461 tempest-QuotaClassesAdmin257Test-2101074348 tempest-QuotaClassesAdmin257Test-2101074348-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.153623 Aug 02 07:05:48.796669 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1973/3838] 10.222.0.79 () {62 vars in 1247 bytes} [Tue Aug 2 07:05:48 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:05:49.711171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ff25ec16-1f8b-4dcb-aa97-2a17ffc181b6 req-c1d3ab3e-0538-4f76-ae4b-0f5ea9ba6601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee50e87a-eb21-4ce8-82c5-9cf1be097c4f", "tag": "d5b278ab-5524-4da2-ad6d-175f510b6f30"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:49.727215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ff25ec16-1f8b-4dcb-aa97-2a17ffc181b6 req-c1d3ab3e-0538-4f76-ae4b-0f5ea9ba6601 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:49.727846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ff25ec16-1f8b-4dcb-aa97-2a17ffc181b6 req-c1d3ab3e-0538-4f76-ae4b-0f5ea9ba6601 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:49.741309 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ff25ec16-1f8b-4dcb-aa97-2a17ffc181b6 req-c1d3ab3e-0538-4f76-ae4b-0f5ea9ba6601 service nova] Creating event network-changed:d5b278ab-5524-4da2-ad6d-175f510b6f30 for instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f on n-h2-851337-3 Aug 02 07:05:49.748183 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ff25ec16-1f8b-4dcb-aa97-2a17ffc181b6 req-c1d3ab3e-0538-4f76-ae4b-0f5ea9ba6601 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041656 Aug 02 07:05:49.753915 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1866/3839] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:05:51.578886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-768780c4-7852-4dc9-ba0a-ea0030ca237c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:51.579710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-768780c4-7852-4dc9-ba0a-ea0030ca237c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:51.590995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-768780c4-7852-4dc9-ba0a-ea0030ca237c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:51.591449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-768780c4-7852-4dc9-ba0a-ea0030ca237c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:51.592250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-768780c4-7852-4dc9-ba0a-ea0030ca237c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:51.592687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-768780c4-7852-4dc9-ba0a-ea0030ca237c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:51.898710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-768780c4-7852-4dc9-ba0a-ea0030ca237c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:51.910711 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-768780c4-7852-4dc9-ba0a-ea0030ca237c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 0.335419 Aug 02 07:05:51.912120 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1974/3840] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:51 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:52.958465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-550b3ac5-a6ba-4764-bf44-4b0ce741bb63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:52.960000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-550b3ac5-a6ba-4764-bf44-4b0ce741bb63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:52.969677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-550b3ac5-a6ba-4764-bf44-4b0ce741bb63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:52.970520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-550b3ac5-a6ba-4764-bf44-4b0ce741bb63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:52.971667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-550b3ac5-a6ba-4764-bf44-4b0ce741bb63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:52.972366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-550b3ac5-a6ba-4764-bf44-4b0ce741bb63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:53.235102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-550b3ac5-a6ba-4764-bf44-4b0ce741bb63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:05:53.255433 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-550b3ac5-a6ba-4764-bf44-4b0ce741bb63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.322242 Aug 02 07:05:53.256062 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1867/3841] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:05:52 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:05:53.283786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f09a6d0c-ee37-4e48-a592-e158c6850b63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1491707785"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:53.295711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f09a6d0c-ee37-4e48-a592-e158c6850b63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:53.314214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f09a6d0c-ee37-4e48-a592-e158c6850b63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:53.315078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f09a6d0c-ee37-4e48-a592-e158c6850b63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:53.318962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f09a6d0c-ee37-4e48-a592-e158c6850b63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:53.321484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f09a6d0c-ee37-4e48-a592-e158c6850b63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:53.604936 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f09a6d0c-ee37-4e48-a592-e158c6850b63 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.331517 Aug 02 07:05:53.606640 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1975/3842] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:05:53 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 02 07:05:55.556744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e3997930-0448-4ef2-bd30-3f5a83fbeb4b tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Action: 'update', calling method: .version_select at 0x7f928c26ad30>, body: {"quota_set": {"ram": "5120"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:55.684853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3997930-0448-4ef2-bd30-3f5a83fbeb4b tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:55.685313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3997930-0448-4ef2-bd30-3f5a83fbeb4b tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:55.687038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3997930-0448-4ef2-bd30-3f5a83fbeb4b tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:55.687827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3997930-0448-4ef2-bd30-3f5a83fbeb4b tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:55.772954 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e3997930-0448-4ef2-bd30-3f5a83fbeb4b tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/057a61fbe1fc4e2bbc8001c3512b6e99" status: 200 len: 240 microversion: 2.36 time: 0.512772 Aug 02 07:05:55.778433 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1868/3843] 10.222.0.79 () {62 vars in 1303 bytes} [Tue Aug 2 07:05:55 2022] PUT /compute/v2.1/os-quota-sets/057a61fbe1fc4e2bbc8001c3512b6e99 => generated 240 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:05:55.787455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-318076a9-26f4-4e5b-ba5e-1a1688adc27b tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Calling method '.version_select at 0x7f928c330f70>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:55.889934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-318076a9-26f4-4e5b-ba5e-1a1688adc27b tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:55.890571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-318076a9-26f4-4e5b-ba5e-1a1688adc27b tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:55.891540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-318076a9-26f4-4e5b-ba5e-1a1688adc27b tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:55.892100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-318076a9-26f4-4e5b-ba5e-1a1688adc27b tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:55.902524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-09e09d6b-07a4-4da1-ae17-91b373f00b9e req-aacdc2d2-8cbf-45ce-b072-1c5875b9df44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ccfed8-393e-4223-b2a8-7dbf8c77d3fe", "name": "network-vif-unplugged", "status": "completed", "tag": "96c2e36a-4761-4b9b-b02e-96b42f53d06e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:55.916810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:55.933048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-09e09d6b-07a4-4da1-ae17-91b373f00b9e req-aacdc2d2-8cbf-45ce-b072-1c5875b9df44 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:55.934043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-09e09d6b-07a4-4da1-ae17-91b373f00b9e req-aacdc2d2-8cbf-45ce-b072-1c5875b9df44 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:55.952726 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-09e09d6b-07a4-4da1-ae17-91b373f00b9e req-aacdc2d2-8cbf-45ce-b072-1c5875b9df44 service nova] Creating event network-vif-unplugged:96c2e36a-4761-4b9b-b02e-96b42f53d06e for instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe on n-h1-851337-3 Aug 02 07:05:55.963474 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-09e09d6b-07a4-4da1-ae17-91b373f00b9e req-aacdc2d2-8cbf-45ce-b072-1c5875b9df44 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067816 Aug 02 07:05:55.966285 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1869/3844] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:05:55.971708 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-318076a9-26f4-4e5b-ba5e-1a1688adc27b tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/057a61fbe1fc4e2bbc8001c3512b6e99/detail" status: 200 len: 672 microversion: 2.36 time: 0.189632 Aug 02 07:05:55.984436 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1976/3845] 10.222.0.79 () {60 vars in 1304 bytes} [Tue Aug 2 07:05:55 2022] GET /compute/v2.1/os-quota-sets/057a61fbe1fc4e2bbc8001c3512b6e99/detail => generated 672 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 07:05:56.224591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-25a8279c-6d74-4fc1-a812-75d87c053b41 tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Action: 'update', calling method: .version_select at 0x7f927af0c550>, body: {"quota_set": {"ram": "2048"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:05:56.334942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25a8279c-6d74-4fc1-a812-75d87c053b41 tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:56.335727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25a8279c-6d74-4fc1-a812-75d87c053b41 tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:56.336740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25a8279c-6d74-4fc1-a812-75d87c053b41 tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:56.337357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25a8279c-6d74-4fc1-a812-75d87c053b41 tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:56.395385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25a8279c-6d74-4fc1-a812-75d87c053b41 tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:56.396698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25a8279c-6d74-4fc1-a812-75d87c053b41 tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:56.397741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25a8279c-6d74-4fc1-a812-75d87c053b41 tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:56.398220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25a8279c-6d74-4fc1-a812-75d87c053b41 tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:56.467786 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-25a8279c-6d74-4fc1-a812-75d87c053b41 tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/057a61fbe1fc4e2bbc8001c3512b6e99?user_id=30c691b789a14eb6a73f9784e7ff2b11" status: 200 len: 240 microversion: 2.36 time: 0.248619 Aug 02 07:05:56.475368 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1870/3846] 10.222.0.79 () {62 vars in 1384 bytes} [Tue Aug 2 07:05:56 2022] PUT /compute/v2.1/os-quota-sets/057a61fbe1fc4e2bbc8001c3512b6e99?user_id=30c691b789a14eb6a73f9784e7ff2b11 => generated 240 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:05:56.481359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c49d7a6f-3f8b-417b-862c-2930e25feca6 tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] Calling method '.version_select at 0x7f927a2c6dc0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:56.589661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=82,nova_api:UPDATE=15 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:05:56.614297 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c49d7a6f-3f8b-417b-862c-2930e25feca6 tempest-QuotasAdminTestV236-1598427067 tempest-QuotasAdminTestV236-1598427067-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/057a61fbe1fc4e2bbc8001c3512b6e99?user_id=30c691b789a14eb6a73f9784e7ff2b11" status: 200 len: 282 microversion: 2.36 time: 0.137626 Aug 02 07:05:56.614878 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1977/3847] 10.222.0.79 () {60 vars in 1364 bytes} [Tue Aug 2 07:05:56 2022] GET /compute/v2.1/os-quota-sets/057a61fbe1fc4e2bbc8001c3512b6e99?user_id=30c691b789a14eb6a73f9784e7ff2b11 => generated 282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:05:59.344848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-af4653ff-6cd7-4467-8050-cff9f9595b80 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:59.346337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-af4653ff-6cd7-4467-8050-cff9f9595b80 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:59.358994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af4653ff-6cd7-4467-8050-cff9f9595b80 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:59.359664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af4653ff-6cd7-4467-8050-cff9f9595b80 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:59.369209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af4653ff-6cd7-4467-8050-cff9f9595b80 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:59.369852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af4653ff-6cd7-4467-8050-cff9f9595b80 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:59.520386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-af4653ff-6cd7-4467-8050-cff9f9595b80 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lazy-loading 'services' on Instance uuid 4cf3144f-9803-4cba-9569-a5113e7e59d7 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:05:59.640846 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-af4653ff-6cd7-4467-8050-cff9f9595b80 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments/1a60df81-f1c7-4d0d-8ef2-f6090d459fac" status: 202 len: 0 microversion: 2.1 time: 0.301651 Aug 02 07:05:59.641739 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1871/3848] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:05:59 2022] DELETE /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments/1a60df81-f1c7-4d0d-8ef2-f6090d459fac => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:05:59.650988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-493ad1f3-dc35-4514-a5f7-dd11a4c9f280 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:05:59.654290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-493ad1f3-dc35-4514-a5f7-dd11a4c9f280 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:05:59.673872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-493ad1f3-dc35-4514-a5f7-dd11a4c9f280 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:59.675516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-493ad1f3-dc35-4514-a5f7-dd11a4c9f280 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:59.679016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-493ad1f3-dc35-4514-a5f7-dd11a4c9f280 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:05:59.679763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-493ad1f3-dc35-4514-a5f7-dd11a4c9f280 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:05:59.738480 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-493ad1f3-dc35-4514-a5f7-dd11a4c9f280 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091791 Aug 02 07:05:59.744640 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1978/3849] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:05:59 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:00.050773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-20844afd-939f-4f6f-ab56-4089f3b627cc req-a6afee6d-baae-4695-81a4-3d09d1f5d8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ccfed8-393e-4223-b2a8-7dbf8c77d3fe", "name": "network-vif-plugged", "status": "completed", "tag": "96c2e36a-4761-4b9b-b02e-96b42f53d06e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:00.071947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-20844afd-939f-4f6f-ab56-4089f3b627cc req-a6afee6d-baae-4695-81a4-3d09d1f5d8af service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:00.074013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-20844afd-939f-4f6f-ab56-4089f3b627cc req-a6afee6d-baae-4695-81a4-3d09d1f5d8af service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:00.095693 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-20844afd-939f-4f6f-ab56-4089f3b627cc req-a6afee6d-baae-4695-81a4-3d09d1f5d8af service nova] Creating event network-vif-plugged:96c2e36a-4761-4b9b-b02e-96b42f53d06e for instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe on n-h1-851337-3 Aug 02 07:06:00.109182 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-20844afd-939f-4f6f-ab56-4089f3b627cc req-a6afee6d-baae-4695-81a4-3d09d1f5d8af service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062982 Aug 02 07:06:00.110119 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1872/3850] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:00.753287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-397472af-afff-4bdd-92b2-b3cc1e41a539 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:00.756753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-397472af-afff-4bdd-92b2-b3cc1e41a539 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:00.771610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-397472af-afff-4bdd-92b2-b3cc1e41a539 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:00.775516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-397472af-afff-4bdd-92b2-b3cc1e41a539 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:00.776534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-397472af-afff-4bdd-92b2-b3cc1e41a539 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:00.777111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-397472af-afff-4bdd-92b2-b3cc1e41a539 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:00.868064 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-397472af-afff-4bdd-92b2-b3cc1e41a539 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119930 Aug 02 07:06:00.885231 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1979/3851] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:00 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:01.247050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1136974893", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:01.324497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:06:01.895749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6dde011d-4377-41ef-9f45-e12b5285cc8f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:01.898381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6dde011d-4377-41ef-9f45-e12b5285cc8f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:01.926199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dde011d-4377-41ef-9f45-e12b5285cc8f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:01.929278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dde011d-4377-41ef-9f45-e12b5285cc8f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:01.931745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dde011d-4377-41ef-9f45-e12b5285cc8f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:01.934096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dde011d-4377-41ef-9f45-e12b5285cc8f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:01.941935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:06:01.942983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:06:01.943657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:06:01.944766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:06:01.945721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:06:01.962149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:01.962974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:01.966134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:01.966930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:01.993380 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6dde011d-4377-41ef-9f45-e12b5285cc8f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104380 Aug 02 07:06:01.994401 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1980/3852] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:01 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:06:02.005486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Getting quotas for project cd45b68f976c48529178d2a460431bd8. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:06:02.014907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Getting quotas for user 86c7e73f30424b5583e42aba5144e5ff and project cd45b68f976c48529178d2a460431bd8. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:06:02.031454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:06:02.035176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:06:02.091605 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d49288e3-7f85-4a22-88f7-b0d90b436152 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.146045 Aug 02 07:06:02.098930 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1873/3853] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:06:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:06:02.106447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3ef397e3-8756-49a5-a098-d1251b772317 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:02.107407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3ef397e3-8756-49a5-a098-d1251b772317 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:02.208400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3ef397e3-8756-49a5-a098-d1251b772317 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:02.216839 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3ef397e3-8756-49a5-a098-d1251b772317 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 200 len: 1222 microversion: 2.1 time: 0.116740 Aug 02 07:06:02.217512 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1981/3854] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:02 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:03.009985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6c71cfdb-bfb9-4c29-a648-f40beaafe5e7 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:03.013004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6c71cfdb-bfb9-4c29-a648-f40beaafe5e7 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:03.033735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c71cfdb-bfb9-4c29-a648-f40beaafe5e7 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:03.034210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c71cfdb-bfb9-4c29-a648-f40beaafe5e7 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:03.034994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c71cfdb-bfb9-4c29-a648-f40beaafe5e7 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:03.035423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c71cfdb-bfb9-4c29-a648-f40beaafe5e7 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:03.154025 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6c71cfdb-bfb9-4c29-a648-f40beaafe5e7 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151185 Aug 02 07:06:03.163463 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1874/3855] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:03 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:03.239494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1a0a3b18-7a4d-4248-b2fa-efc2def661bf tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:03.246519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1a0a3b18-7a4d-4248-b2fa-efc2def661bf tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:03.285943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a0a3b18-7a4d-4248-b2fa-efc2def661bf tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:03.286583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a0a3b18-7a4d-4248-b2fa-efc2def661bf tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:03.292016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a0a3b18-7a4d-4248-b2fa-efc2def661bf tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:03.293566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a0a3b18-7a4d-4248-b2fa-efc2def661bf tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:03.486710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1a0a3b18-7a4d-4248-b2fa-efc2def661bf tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:03.503636 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1a0a3b18-7a4d-4248-b2fa-efc2def661bf tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 200 len: 1218 microversion: 2.1 time: 0.266819 Aug 02 07:06:03.507101 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1982/3856] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:03 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 1218 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:04.170491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8bd9c20f-a42e-4555-a655-2c44745bc74e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:04.172848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8bd9c20f-a42e-4555-a655-2c44745bc74e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:04.193361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bd9c20f-a42e-4555-a655-2c44745bc74e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:04.198594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bd9c20f-a42e-4555-a655-2c44745bc74e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:04.199778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bd9c20f-a42e-4555-a655-2c44745bc74e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:04.201283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bd9c20f-a42e-4555-a655-2c44745bc74e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:04.284141 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8bd9c20f-a42e-4555-a655-2c44745bc74e tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115803 Aug 02 07:06:04.289970 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1875/3857] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:04 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:04.531076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c10870d0-21f7-4555-bf23-2c7a4ae1267f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:04.531704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c10870d0-21f7-4555-bf23-2c7a4ae1267f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:04.539366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c10870d0-21f7-4555-bf23-2c7a4ae1267f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:04.540320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c10870d0-21f7-4555-bf23-2c7a4ae1267f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:04.541247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c10870d0-21f7-4555-bf23-2c7a4ae1267f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:04.542079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c10870d0-21f7-4555-bf23-2c7a4ae1267f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:04.678053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c10870d0-21f7-4555-bf23-2c7a4ae1267f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:04.684943 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c10870d0-21f7-4555-bf23-2c7a4ae1267f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 200 len: 1280 microversion: 2.1 time: 0.160532 Aug 02 07:06:04.700428 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1983/3858] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:04 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 1280 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:05.299589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ef89262e-1b79-4bc5-a564-2e9f5daaa13f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:05.304358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ef89262e-1b79-4bc5-a564-2e9f5daaa13f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:05.324496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef89262e-1b79-4bc5-a564-2e9f5daaa13f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:05.324945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef89262e-1b79-4bc5-a564-2e9f5daaa13f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:05.325761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef89262e-1b79-4bc5-a564-2e9f5daaa13f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:05.326206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef89262e-1b79-4bc5-a564-2e9f5daaa13f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:05.386343 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ef89262e-1b79-4bc5-a564-2e9f5daaa13f tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091136 Aug 02 07:06:05.388581 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1876/3859] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:05 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:05.706865 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f0e51845-5ae4-4045-8178-4528d03b5a80 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:05.707573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f0e51845-5ae4-4045-8178-4528d03b5a80 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:05.720013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0e51845-5ae4-4045-8178-4528d03b5a80 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:05.720509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0e51845-5ae4-4045-8178-4528d03b5a80 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:05.721939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0e51845-5ae4-4045-8178-4528d03b5a80 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:05.727356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0e51845-5ae4-4045-8178-4528d03b5a80 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:05.933876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:06.027982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f0e51845-5ae4-4045-8178-4528d03b5a80 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:06.038585 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f0e51845-5ae4-4045-8178-4528d03b5a80 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 200 len: 1322 microversion: 2.1 time: 0.336015 Aug 02 07:06:06.058061 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1984/3860] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:05 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:06.399179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8cb4dded-255a-4418-9fae-582b9dbc8dd2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:06.404322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8cb4dded-255a-4418-9fae-582b9dbc8dd2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:06.432461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8cb4dded-255a-4418-9fae-582b9dbc8dd2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:06.436683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8cb4dded-255a-4418-9fae-582b9dbc8dd2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:06.439897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8cb4dded-255a-4418-9fae-582b9dbc8dd2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:06.443900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8cb4dded-255a-4418-9fae-582b9dbc8dd2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:06.525036 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8cb4dded-255a-4418-9fae-582b9dbc8dd2 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129583 Aug 02 07:06:06.529480 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1877/3861] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:06 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:06.746335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7b678bd0-5cb5-4f7a-ac76-eea74a4e5a2c req-528805ca-1326-44fe-8d0f-f3ea02f4a0ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f422e3-d249-4632-b7b3-41d1103afdd4", "tag": "d62a0fcc-b8ed-4cb7-a55f-2ec0c08bdca4"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:06.779310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7b678bd0-5cb5-4f7a-ac76-eea74a4e5a2c req-528805ca-1326-44fe-8d0f-f3ea02f4a0ff service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:06.783839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7b678bd0-5cb5-4f7a-ac76-eea74a4e5a2c req-528805ca-1326-44fe-8d0f-f3ea02f4a0ff service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:06.856176 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7b678bd0-5cb5-4f7a-ac76-eea74a4e5a2c req-528805ca-1326-44fe-8d0f-f3ea02f4a0ff service nova] Creating event network-changed:d62a0fcc-b8ed-4cb7-a55f-2ec0c08bdca4 for instance 00f422e3-d249-4632-b7b3-41d1103afdd4 on n-h2-851337-3 Aug 02 07:06:06.885031 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7b678bd0-5cb5-4f7a-ac76-eea74a4e5a2c req-528805ca-1326-44fe-8d0f-f3ea02f4a0ff service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142559 Aug 02 07:06:06.903513 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1985/3862] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:07.064007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-09998a3a-be59-4d5a-bf1b-98017e2c3a19 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:07.065118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-09998a3a-be59-4d5a-bf1b-98017e2c3a19 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:07.079226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9ab31613-c0d0-46b9-81e6-58a16ebcf744 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'create', calling method: .version_select at 0x7f927a334160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-426538094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMZIh96waLqDTWLCR4RzndbhUwEyPD1b42g2zK7Uvty5DI1Kqa+glGqJ47m3kIDj2SGzuA92VArPpn54B4ymMGrNMFEqd+NdEb0dXwNB/VWRFp7a6EX4tFF5hbu9Q0udA=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:07.081922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09998a3a-be59-4d5a-bf1b-98017e2c3a19 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:07.082388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09998a3a-be59-4d5a-bf1b-98017e2c3a19 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:07.083181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09998a3a-be59-4d5a-bf1b-98017e2c3a19 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:07.083624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09998a3a-be59-4d5a-bf1b-98017e2c3a19 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:07.115342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-9ab31613-c0d0-46b9-81e6-58a16ebcf744 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for project bfa05afa69e04974ad3de049c511c674. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:06:07.131594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-9ab31613-c0d0-46b9-81e6-58a16ebcf744 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for user a44367c6be00413eb7b6c79272448cf4 and project bfa05afa69e04974ad3de049c511c674. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:06:07.189932 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9ab31613-c0d0-46b9-81e6-58a16ebcf744 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.422710 Aug 02 07:06:07.191847 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1878/3863] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:06:06 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:07.544896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ceb6a697-30cd-48bf-9314-1a87b6d3f789 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:07.550483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ceb6a697-30cd-48bf-9314-1a87b6d3f789 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:07.569334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ceb6a697-30cd-48bf-9314-1a87b6d3f789 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:07.570228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ceb6a697-30cd-48bf-9314-1a87b6d3f789 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:07.572598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ceb6a697-30cd-48bf-9314-1a87b6d3f789 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:07.573298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ceb6a697-30cd-48bf-9314-1a87b6d3f789 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:07.655225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-09998a3a-be59-4d5a-bf1b-98017e2c3a19 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:07.665841 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-09998a3a-be59-4d5a-bf1b-98017e2c3a19 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 200 len: 1322 microversion: 2.1 time: 0.605969 Aug 02 07:06:07.678929 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1986/3864] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:07 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 1322 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:07.690579 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ceb6a697-30cd-48bf-9314-1a87b6d3f789 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150469 Aug 02 07:06:07.691535 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1879/3865] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:07 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:08.691207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-55be2829-0581-4975-8195-57bc9afcbec5 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:08.691938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-55be2829-0581-4975-8195-57bc9afcbec5 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:08.707122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7691d029-c2a6-4001-a740-71ffb2bf81b0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:08.710304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7691d029-c2a6-4001-a740-71ffb2bf81b0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:08.727825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7691d029-c2a6-4001-a740-71ffb2bf81b0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:08.728385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7691d029-c2a6-4001-a740-71ffb2bf81b0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:08.729582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55be2829-0581-4975-8195-57bc9afcbec5 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:08.730076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55be2829-0581-4975-8195-57bc9afcbec5 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:08.733921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55be2829-0581-4975-8195-57bc9afcbec5 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:08.734756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7691d029-c2a6-4001-a740-71ffb2bf81b0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:08.736723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55be2829-0581-4975-8195-57bc9afcbec5 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:08.738643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7691d029-c2a6-4001-a740-71ffb2bf81b0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:08.812537 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7691d029-c2a6-4001-a740-71ffb2bf81b0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110871 Aug 02 07:06:08.814067 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1880/3866] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:08 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:06:08.975283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0788582-482a-4c5d-90bf-475e0c210ef6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:08.979095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d0788582-482a-4c5d-90bf-475e0c210ef6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:08.994869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0788582-482a-4c5d-90bf-475e0c210ef6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:09.000218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0788582-482a-4c5d-90bf-475e0c210ef6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:09.001630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0788582-482a-4c5d-90bf-475e0c210ef6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:09.005693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0788582-482a-4c5d-90bf-475e0c210ef6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:09.068579 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-d0788582-482a-4c5d-90bf-475e0c210ef6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] HTTP exception thrown: Cannot 'reboot' instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a while it is in vm_state rescued Aug 02 07:06:09.084924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-55be2829-0581-4975-8195-57bc9afcbec5 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0788582-482a-4c5d-90bf-475e0c210ef6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Request method failure captured: Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a/action HTTP/1.1 Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 28 Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MuV9Q5BOG4bZSTn8mNA1jfjLBve4d8RpXHrEXh4dSRfQwoHnO2CX5TWJr_Ybphxlmnei--H-24HQZ2VBGVtXb7ed4xsT9rh6T-B0ctcoWXMM-9zRQgu-z2imnNm8CiRJJUKFATn8QRgKDRSh1174_Xj_fjEsdTPEI1eutLUtYEoOkA Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}] Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b9ad5424586247019d4374f52600ea51 Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: {"reboot": {"type": "HARD"}} Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: exception: Cannot 'reboot' instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a while it is in vm_state rescued Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a', 'body': {'reboot': {'type': 'HARD'}}} Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 07:06:09.094964 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 07:06:09.099522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a while it is in vm_state rescued Aug 02 07:06:09.099522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:09.099522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:09.099522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:09.099522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:09.099522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:09.099522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:09.099522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:06:09.099522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:06:09.099522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a while it is in vm_state rescued Aug 02 07:06:09.099522 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:09.109217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0788582-482a-4c5d-90bf-475e0c210ef6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Returning 409 to user: Cannot 'reboot' instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a while it is in vm_state rescued {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:09.111380 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d0788582-482a-4c5d-90bf-475e0c210ef6 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a/action" status: 409 len: 145 microversion: 2.1 time: 0.149253 Aug 02 07:06:09.114595 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-55be2829-0581-4975-8195-57bc9afcbec5 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 200 len: 1322 microversion: 2.1 time: 0.428232 Aug 02 07:06:09.115369 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1881/3867] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:06:08 2022] POST /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a/action => generated 145 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:06:09.116393 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1987/3868] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:08 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:09.130364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fbd3cc7f-cb68-4a76-b5d5-3b4a23c903cc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:09.133797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fbd3cc7f-cb68-4a76-b5d5-3b4a23c903cc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:09.147225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbd3cc7f-cb68-4a76-b5d5-3b4a23c903cc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:09.152838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbd3cc7f-cb68-4a76-b5d5-3b4a23c903cc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:09.154348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbd3cc7f-cb68-4a76-b5d5-3b4a23c903cc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:09.154961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbd3cc7f-cb68-4a76-b5d5-3b4a23c903cc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:09.226616 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-fbd3cc7f-cb68-4a76-b5d5-3b4a23c903cc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] HTTP exception thrown: Cannot 'rebuild' instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a while it is in vm_state rescued Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fbd3cc7f-cb68-4a76-b5d5-3b4a23c903cc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Request method failure captured: Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a/action HTTP/1.1 Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 65 Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MuV9Q5BOG4bZSTn8mNA1jfjLBve4d8RpXHrEXh4dSRfQwoHnO2CX5TWJr_Ybphxlmnei--H-24HQZ2VBGVtXb7ed4xsT9rh6T-B0ctcoWXMM-9zRQgu-z2imnNm8CiRJJUKFATn8QRgKDRSh1174_Xj_fjEsdTPEI1eutLUtYEoOkA Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}] Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b9ad5424586247019d4374f52600ea51 Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: {"rebuild": {"imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676"}} Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: exception: Cannot 'rebuild' instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a while it is in vm_state rescued Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a', 'body': {'rebuild': {'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676'}}} Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:06:09.228318 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a while it is in vm_state rescued Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a while it is in vm_state rescued Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:09.235747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fbd3cc7f-cb68-4a76-b5d5-3b4a23c903cc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Returning 409 to user: Cannot 'rebuild' instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a while it is in vm_state rescued {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:09.248945 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fbd3cc7f-cb68-4a76-b5d5-3b4a23c903cc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "POST /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a/action" status: 409 len: 146 microversion: 2.1 time: 0.104667 Aug 02 07:06:09.248945 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1882/3869] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:06:09 2022] POST /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a/action => generated 146 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:06:09.254380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fc285e2b-ea9d-4a06-bbe1-bf029f67eab4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:09.255282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fc285e2b-ea9d-4a06-bbe1-bf029f67eab4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:09.268445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc285e2b-ea9d-4a06-bbe1-bf029f67eab4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:09.268779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc285e2b-ea9d-4a06-bbe1-bf029f67eab4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:09.269576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc285e2b-ea9d-4a06-bbe1-bf029f67eab4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:09.282345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc285e2b-ea9d-4a06-bbe1-bf029f67eab4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:09.288199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:09.335210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fc285e2b-ea9d-4a06-bbe1-bf029f67eab4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:06:09.503323 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fc285e2b-ea9d-4a06-bbe1-bf029f67eab4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 204 len: 0 microversion: 2.1 time: 0.253756 Aug 02 07:06:09.507783 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1988/3870] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:06:09 2022] DELETE /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:06:09.522860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f7ca9c4e-7858-4ce8-b638-67783e624e3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:09.523514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f7ca9c4e-7858-4ce8-b638-67783e624e3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:09.544276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7ca9c4e-7858-4ce8-b638-67783e624e3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:09.544844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7ca9c4e-7858-4ce8-b638-67783e624e3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:09.545679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7ca9c4e-7858-4ce8-b638-67783e624e3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:09.546336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f7ca9c4e-7858-4ce8-b638-67783e624e3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:09.956775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f7ca9c4e-7858-4ce8-b638-67783e624e3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:09.980719 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f7ca9c4e-7858-4ce8-b638-67783e624e3c tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1691 microversion: 2.1 time: 0.471258 Aug 02 07:06:09.982771 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1883/3871] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:09 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1691 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:10.137989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7ec5a20b-3c01-4187-8f4b-fa094d93126d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:10.139304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7ec5a20b-3c01-4187-8f4b-fa094d93126d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:10.168245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ec5a20b-3c01-4187-8f4b-fa094d93126d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:10.168584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ec5a20b-3c01-4187-8f4b-fa094d93126d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:10.169385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ec5a20b-3c01-4187-8f4b-fa094d93126d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:10.169823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ec5a20b-3c01-4187-8f4b-fa094d93126d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:10.567271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7ec5a20b-3c01-4187-8f4b-fa094d93126d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:10.592539 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7ec5a20b-3c01-4187-8f4b-fa094d93126d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 200 len: 1322 microversion: 2.1 time: 0.458704 Aug 02 07:06:10.598667 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1989/3872] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:10 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 1322 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:11.005474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-91632015-7490-4847-8eb5-b3fd28fa8a30 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:11.007164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-91632015-7490-4847-8eb5-b3fd28fa8a30 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:11.022424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91632015-7490-4847-8eb5-b3fd28fa8a30 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:11.027736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91632015-7490-4847-8eb5-b3fd28fa8a30 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:11.030898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91632015-7490-4847-8eb5-b3fd28fa8a30 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:11.033978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91632015-7490-4847-8eb5-b3fd28fa8a30 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:11.380350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-91632015-7490-4847-8eb5-b3fd28fa8a30 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:11.391096 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-91632015-7490-4847-8eb5-b3fd28fa8a30 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1691 microversion: 2.1 time: 0.389971 Aug 02 07:06:11.392092 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1884/3873] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:10 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1691 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:11.619859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d081df2b-7edc-4488-84c1-f1f3d2d3aeea tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:11.621753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d081df2b-7edc-4488-84c1-f1f3d2d3aeea tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:11.654846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d081df2b-7edc-4488-84c1-f1f3d2d3aeea tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:11.655459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d081df2b-7edc-4488-84c1-f1f3d2d3aeea tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:11.656360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d081df2b-7edc-4488-84c1-f1f3d2d3aeea tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:11.657034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d081df2b-7edc-4488-84c1-f1f3d2d3aeea tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:11.909324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d081df2b-7edc-4488-84c1-f1f3d2d3aeea tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:11.926807 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d081df2b-7edc-4488-84c1-f1f3d2d3aeea tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 200 len: 1322 microversion: 2.1 time: 0.310449 Aug 02 07:06:11.928049 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1990/3874] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:11 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:12.421325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5faf9fa9-9f9b-4ef7-98a4-3f67100c8458 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:12.424399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5faf9fa9-9f9b-4ef7-98a4-3f67100c8458 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:12.428563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=9 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:12.456659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5faf9fa9-9f9b-4ef7-98a4-3f67100c8458 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:12.462838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5faf9fa9-9f9b-4ef7-98a4-3f67100c8458 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:12.464401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5faf9fa9-9f9b-4ef7-98a4-3f67100c8458 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:12.465324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5faf9fa9-9f9b-4ef7-98a4-3f67100c8458 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:12.791573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7bed1fc5-1654-462d-b286-30b043bdd1d0 req-613d2990-d4d5-453e-93f2-902f2a16ddbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f422e3-d249-4632-b7b3-41d1103afdd4", "name": "network-vif-plugged", "status": "completed", "tag": "d62a0fcc-b8ed-4cb7-a55f-2ec0c08bdca4"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:12.808290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=18,nova_cell0:UPDATE=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:12.824093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7bed1fc5-1654-462d-b286-30b043bdd1d0 req-613d2990-d4d5-453e-93f2-902f2a16ddbe service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:12.825352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7bed1fc5-1654-462d-b286-30b043bdd1d0 req-613d2990-d4d5-453e-93f2-902f2a16ddbe service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:12.859386 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7bed1fc5-1654-462d-b286-30b043bdd1d0 req-613d2990-d4d5-453e-93f2-902f2a16ddbe service nova] Creating event network-vif-plugged:d62a0fcc-b8ed-4cb7-a55f-2ec0c08bdca4 for instance 00f422e3-d249-4632-b7b3-41d1103afdd4 on n-h2-851337-3 Aug 02 07:06:12.869252 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7bed1fc5-1654-462d-b286-30b043bdd1d0 req-613d2990-d4d5-453e-93f2-902f2a16ddbe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084731 Aug 02 07:06:12.870514 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1991/3875] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:06:12.950055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9cb65452-8c48-4058-a00a-4094ffc1435f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:12.951242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9cb65452-8c48-4058-a00a-4094ffc1435f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:12.965518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cb65452-8c48-4058-a00a-4094ffc1435f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:12.967108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cb65452-8c48-4058-a00a-4094ffc1435f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:12.970649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cb65452-8c48-4058-a00a-4094ffc1435f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:12.971936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cb65452-8c48-4058-a00a-4094ffc1435f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:13.251910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5faf9fa9-9f9b-4ef7-98a4-3f67100c8458 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:13.274528 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5faf9fa9-9f9b-4ef7-98a4-3f67100c8458 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1691 microversion: 2.1 time: 0.851506 Aug 02 07:06:13.275561 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1885/3876] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:12 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1691 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:13.434095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9cb65452-8c48-4058-a00a-4094ffc1435f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:13.460218 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9cb65452-8c48-4058-a00a-4094ffc1435f tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 200 len: 1322 microversion: 2.1 time: 0.514837 Aug 02 07:06:13.475452 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1992/3877] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:12 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 1322 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:14.299164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f646520f-5fa3-44ec-bc73-4ee2a92177c4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:14.299793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f646520f-5fa3-44ec-bc73-4ee2a92177c4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:14.310464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f646520f-5fa3-44ec-bc73-4ee2a92177c4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:14.310914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f646520f-5fa3-44ec-bc73-4ee2a92177c4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:14.311712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f646520f-5fa3-44ec-bc73-4ee2a92177c4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:14.312149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f646520f-5fa3-44ec-bc73-4ee2a92177c4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:14.337664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:14.482841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e29dd4d1-2a00-4ef6-9d81-b35b52ebd012 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:14.484108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e29dd4d1-2a00-4ef6-9d81-b35b52ebd012 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:14.500761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e29dd4d1-2a00-4ef6-9d81-b35b52ebd012 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:14.502196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e29dd4d1-2a00-4ef6-9d81-b35b52ebd012 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:14.503502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e29dd4d1-2a00-4ef6-9d81-b35b52ebd012 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:14.504121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e29dd4d1-2a00-4ef6-9d81-b35b52ebd012 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:14.712804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f646520f-5fa3-44ec-bc73-4ee2a92177c4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:14.724130 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f646520f-5fa3-44ec-bc73-4ee2a92177c4 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 200 len: 1623 microversion: 2.1 time: 0.428958 Aug 02 07:06:14.734777 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1886/3878] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:14 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 1623 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:14.962272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-13645799-f799-4a0c-8225-011fdade4962 req-098568ab-9283-4d66-87b3-4ba2b16f3e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf3144f-9803-4cba-9569-a5113e7e59d7", "name": "network-vif-deleted", "tag": "a1b65bba-6618-46d5-aeef-29ac67630aff"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:15.026427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-13645799-f799-4a0c-8225-011fdade4962 req-098568ab-9283-4d66-87b3-4ba2b16f3e78 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:15.028610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-13645799-f799-4a0c-8225-011fdade4962 req-098568ab-9283-4d66-87b3-4ba2b16f3e78 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:15.082334 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-13645799-f799-4a0c-8225-011fdade4962 req-098568ab-9283-4d66-87b3-4ba2b16f3e78 service nova] Creating event network-vif-deleted:a1b65bba-6618-46d5-aeef-29ac67630aff for instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 on n-h1-851337-3 Aug 02 07:06:15.104789 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-13645799-f799-4a0c-8225-011fdade4962 req-098568ab-9283-4d66-87b3-4ba2b16f3e78 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148920 Aug 02 07:06:15.112565 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1887/3879] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:15.206805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e29dd4d1-2a00-4ef6-9d81-b35b52ebd012 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:15.222734 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e29dd4d1-2a00-4ef6-9d81-b35b52ebd012 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 200 len: 1322 microversion: 2.1 time: 0.744412 Aug 02 07:06:15.224867 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1993/3880] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:14 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 1322 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:15.767153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5e0483f8-9e93-4635-aab6-4f037fd3718b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:15.770331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5e0483f8-9e93-4635-aab6-4f037fd3718b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 4cf3144f-9803-4cba-9569-a5113e7e59d7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:15.789946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e0483f8-9e93-4635-aab6-4f037fd3718b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:15.792119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e0483f8-9e93-4635-aab6-4f037fd3718b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:15.795960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e0483f8-9e93-4635-aab6-4f037fd3718b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:15.797414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e0483f8-9e93-4635-aab6-4f037fd3718b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:16.202214 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-5e0483f8-9e93-4635-aab6-4f037fd3718b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] HTTP exception thrown: Instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 could not be found. Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5e0483f8-9e93-4635-aab6-4f037fd3718b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Request method failure captured: Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 HTTP/1.1 Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MuV9Q5BOG4bZSTn8mNA1jfjLBve4d8RpXHrEXh4dSRfQwoHnO2CX5TWJr_Ybphxlmnei--H-24HQZ2VBGVtXb7ed4xsT9rh6T-B0ctcoWXMM-9zRQgu-z2imnNm8CiRJJUKFATn8QRgKDRSh1174_Xj_fjEsdTPEI1eutLUtYEoOkA Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}] Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b9ad5424586247019d4374f52600ea51 Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 could not be found. Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '4cf3144f-9803-4cba-9569-a5113e7e59d7'} Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 could not be found. Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 could not be found. Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:16.204345 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:16.208151 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:16.208151 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:16.208151 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:16.208151 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:16.208151 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:06:16.208151 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:06:16.208151 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 could not be found. Aug 02 07:06:16.208151 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:16.208151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5e0483f8-9e93-4635-aab6-4f037fd3718b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Returning 404 to user: Instance 4cf3144f-9803-4cba-9569-a5113e7e59d7 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:16.208666 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5e0483f8-9e93-4635-aab6-4f037fd3718b tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7" status: 404 len: 111 microversion: 2.1 time: 0.451020 Aug 02 07:06:16.213097 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1888/3881] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:15 2022] GET /compute/v2.1/servers/4cf3144f-9803-4cba-9569-a5113e7e59d7 => generated 111 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:06:16.218303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9bab1ef6-dbea-467d-bec1-be860f736c10 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '.version_select at 0x7f927a268310>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:16.249465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a23920c0-9431-4000-bde4-f899366f9da7 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:16.250132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a23920c0-9431-4000-bde4-f899366f9da7 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:16.258940 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9bab1ef6-dbea-467d-bec1-be860f736c10 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479792239" status: 202 len: 0 microversion: 2.1 time: 0.044499 Aug 02 07:06:16.259918 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1994/3882] 10.222.0.79 () {58 vars in 1221 bytes} [Tue Aug 2 07:06:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479792239 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:06:16.287456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a23920c0-9431-4000-bde4-f899366f9da7 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:16.294370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a23920c0-9431-4000-bde4-f899366f9da7 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:16.295380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a23920c0-9431-4000-bde4-f899366f9da7 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:16.295840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a23920c0-9431-4000-bde4-f899366f9da7 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:17.027183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a23920c0-9431-4000-bde4-f899366f9da7 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:17.044386 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a23920c0-9431-4000-bde4-f899366f9da7 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 200 len: 1472 microversion: 2.1 time: 0.799009 Aug 02 07:06:17.047489 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1889/3883] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:16 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 1472 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:17.519753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0fbe8e86-a7e6-4d4f-af21-b3d22bea1ff5 tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:17.521262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0fbe8e86-a7e6-4d4f-af21-b3d22bea1ff5 tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] [instance: efc18db1-11c7-4720-9734-e67e1448a31d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:17.527673 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-0fbe8e86-a7e6-4d4f-af21-b3d22bea1ff5 tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] HTTP exception thrown: Instance efc18db1-11c7-4720-9734-e67e1448a31d could not be found. Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0fbe8e86-a7e6-4d4f-af21-b3d22bea1ff5 tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Request method failure captured: Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/efc18db1-11c7-4720-9734-e67e1448a31d/action HTTP/1.1 Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 15 Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MzY5SOwcTXvPTjOuoRGNaXYpwBoljQCL2OLQjtjICR98yIhC4EnWHospbSJz-EEYKZt3r03LjCFBjKUda7s-OhafN_-I-lvA7W3pNP99bhqd8AZmtuB5R3ZV9bmUa72WF0lzouUzvIeyBGAhaLPZ0wfLjsQBHvYcP3TevcmFjWrZG0 Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 1ce12eec4fe846a0bbc2c759a8a89e40 Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ce12eec4fe846a0bbc2c759a8a89e40"}]}] Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 1ce12eec4fe846a0bbc2c759a8a89e40 Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersAdminNegativeTestJSON-2109781573-project-admin Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: c929532f5c60416387159335c7a67d7e Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2109781573-project-admin Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: {"migrate": {}} Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance efc18db1-11c7-4720-9734-e67e1448a31d could not be found. Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'efc18db1-11c7-4720-9734-e67e1448a31d', 'body': {'migrate': {}}} Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efc18db1-11c7-4720-9734-e67e1448a31d could not be found. Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efc18db1-11c7-4720-9734-e67e1448a31d could not be found. Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:17.531029 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:17.535879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:17.535879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:17.535879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:06:17.535879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:06:17.535879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efc18db1-11c7-4720-9734-e67e1448a31d could not be found. Aug 02 07:06:17.535879 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:17.539817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0fbe8e86-a7e6-4d4f-af21-b3d22bea1ff5 tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Returning 404 to user: Instance efc18db1-11c7-4720-9734-e67e1448a31d could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:17.542842 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0fbe8e86-a7e6-4d4f-af21-b3d22bea1ff5 tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/efc18db1-11c7-4720-9734-e67e1448a31d/action" status: 404 len: 111 microversion: 2.1 time: 0.477030 Aug 02 07:06:17.544901 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1995/3884] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:06:17 2022] POST /compute/v2.1/servers/efc18db1-11c7-4720-9734-e67e1448a31d/action => generated 111 bytes in 480 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:06:17.923651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-171972909", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:17.947435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=34 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:18.081083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:06:19.610462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:06:19.611044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:06:19.611398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:06:19.611871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:06:19.612209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:06:19.638374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:19.638760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:19.639555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:19.639994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:19.716731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Getting quotas for project cd45b68f976c48529178d2a460431bd8. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:06:19.743785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Getting quotas for user 86c7e73f30424b5583e42aba5144e5ff and project cd45b68f976c48529178d2a460431bd8. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:06:19.798235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:06:19.825860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:06:19.965872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:20.019198 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dd24ea9c-8df1-4efc-a796-06fbf1950850 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.099484 Aug 02 07:06:20.032619 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1890/3885] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:06:20.036112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7fe00436-1dcf-4635-8770-f041347fe1a0 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:20.036727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7fe00436-1dcf-4635-8770-f041347fe1a0 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:20.225090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7fe00436-1dcf-4635-8770-f041347fe1a0 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:20.260955 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7fe00436-1dcf-4635-8770-f041347fe1a0 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1221 microversion: 2.1 time: 0.222848 Aug 02 07:06:20.261646 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1996/3886] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:20 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1221 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:21.287420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-05ced1bf-c6b9-47ca-bd4a-cedbc3f24779 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:21.289683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-05ced1bf-c6b9-47ca-bd4a-cedbc3f24779 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:21.309041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-05ced1bf-c6b9-47ca-bd4a-cedbc3f24779 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:21.309950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-05ced1bf-c6b9-47ca-bd4a-cedbc3f24779 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:21.311679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-05ced1bf-c6b9-47ca-bd4a-cedbc3f24779 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:21.312394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-05ced1bf-c6b9-47ca-bd4a-cedbc3f24779 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:21.432998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-05ced1bf-c6b9-47ca-bd4a-cedbc3f24779 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:21.447039 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-05ced1bf-c6b9-47ca-bd4a-cedbc3f24779 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1217 microversion: 2.1 time: 0.165786 Aug 02 07:06:21.450360 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1891/3887] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:21 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:22.331385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1869147217", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "a37565d6-a552-4f96-b699-c4d518fe09d7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-426538094", "security_groups": [{"name": "tempest-secgroup-smoke-1050889674"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:22.475454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9e41b714-9bc9-43ad-86ad-b585686601d2 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:22.476231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9e41b714-9bc9-43ad-86ad-b585686601d2 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:22.487607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e41b714-9bc9-43ad-86ad-b585686601d2 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:22.488052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e41b714-9bc9-43ad-86ad-b585686601d2 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:22.488833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e41b714-9bc9-43ad-86ad-b585686601d2 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:22.489268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e41b714-9bc9-43ad-86ad-b585686601d2 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:22.636203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9e41b714-9bc9-43ad-86ad-b585686601d2 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:22.658902 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9e41b714-9bc9-43ad-86ad-b585686601d2 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1279 microversion: 2.1 time: 0.183926 Aug 02 07:06:22.661201 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1892/3888] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:22 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:22.668483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] validate_networks() for [('a37565d6-a552-4f96-b699-c4d518fe09d7', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:06:23.613799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:06:23.614933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:06:23.615588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:06:23.616456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:06:23.617021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:06:23.637792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:23.639962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:23.646638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:23.647332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:23.690135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3dad11b1-cf83-40fd-bdab-70c5142c2fd1 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:23.691995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3dad11b1-cf83-40fd-bdab-70c5142c2fd1 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:23.713071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for project bfa05afa69e04974ad3de049c511c674. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:06:23.716210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3dad11b1-cf83-40fd-bdab-70c5142c2fd1 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:23.718129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3dad11b1-cf83-40fd-bdab-70c5142c2fd1 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:23.725919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3dad11b1-cf83-40fd-bdab-70c5142c2fd1 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:23.726620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3dad11b1-cf83-40fd-bdab-70c5142c2fd1 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:23.739474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for user a44367c6be00413eb7b6c79272448cf4 and project bfa05afa69e04974ad3de049c511c674. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:06:23.789608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:06:23.792261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:06:23.927566 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-15002d8d-79e3-4899-84fe-18199e0fb4f1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.601241 Aug 02 07:06:23.934301 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1997/3889] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:06:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:06:23.939418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1e27f5a1-5264-4afe-a01c-c9176e105976 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:23.939922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1e27f5a1-5264-4afe-a01c-c9176e105976 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:23.989362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e27f5a1-5264-4afe-a01c-c9176e105976 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:23.989848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e27f5a1-5264-4afe-a01c-c9176e105976 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:23.990772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e27f5a1-5264-4afe-a01c-c9176e105976 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:23.991208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e27f5a1-5264-4afe-a01c-c9176e105976 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:24.109789 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1e27f5a1-5264-4afe-a01c-c9176e105976 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f/ips" status: 200 len: 150 microversion: 2.1 time: 0.174265 Aug 02 07:06:24.132076 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1998/3890] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 07:06:23 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f/ips => generated 150 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:24.152074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-70b4d1a8-8a5b-45cd-8529-05c128ab12cb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:24.164394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-70b4d1a8-8a5b-45cd-8529-05c128ab12cb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:24.408362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3dad11b1-cf83-40fd-bdab-70c5142c2fd1 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:24.436088 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3dad11b1-cf83-40fd-bdab-70c5142c2fd1 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1321 microversion: 2.1 time: 0.751166 Aug 02 07:06:24.437142 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1893/3891] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:23 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1321 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:24.454221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-486f2cf2-d58f-468f-ac44-a7e94ee869f3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49456d19-5507-4376-870a-d183aa6176b9"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:24.458022 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-486f2cf2-d58f-468f-ac44-a7e94ee869f3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:24.471957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-486f2cf2-d58f-468f-ac44-a7e94ee869f3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:24.476471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-486f2cf2-d58f-468f-ac44-a7e94ee869f3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:24.478904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-486f2cf2-d58f-468f-ac44-a7e94ee869f3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:24.484711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-70b4d1a8-8a5b-45cd-8529-05c128ab12cb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:24.494768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-486f2cf2-d58f-468f-ac44-a7e94ee869f3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:24.499530 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-70b4d1a8-8a5b-45cd-8529-05c128ab12cb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1266 microversion: 2.1 time: 0.366077 Aug 02 07:06:24.501516 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 1999/3892] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:24 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-486f2cf2-d58f-468f-ac44-a7e94ee869f3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] HTTP exception thrown: Invalid volume: volume 49456d19-5507-4376-870a-d183aa6176b9 is already attached to instances: fce30096-300b-4242-b360-ff6617fd5173 Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-486f2cf2-d58f-468f-ac44-a7e94ee869f3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Request method failure captured: Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f/os-volume_attachments HTTP/1.1 Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 74 Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mw13SPusoL2oig6z8JKTC1nUbf8Rw_5jT5YPT1CWrOABe8wYL59aYsXiUDtU2vA3es6LryNsakcXkaddV2SmWSmf9b0Kir8iKyeHQ1V913RDI7OxthQkB34rsjOk5zDf7k87yoaJrxDD4eFsnTmbVoTrOLyxwi8jQau6VljX5rXYUE Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ee1befa077542b9a17865baad3c9999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}] Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 3a2629fa08b5419a96c2942118d38dad Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: {"volumeAttachment": {"volumeId": "49456d19-5507-4376-870a-d183aa6176b9"}} Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid volume: volume 49456d19-5507-4376-870a-d183aa6176b9 is already attached to instances: fce30096-300b-4242-b360-ff6617fd5173 Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'server_id': 'ee50e87a-eb21-4ce8-82c5-9cf1be097c4f', 'body': {'volumeAttachment': {'volumeId': '49456d19-5507-4376-870a-d183aa6176b9'}}} Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 49456d19-5507-4376-870a-d183aa6176b9 is already attached to instances: fce30096-300b-4242-b360-ff6617fd5173 Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:24.816385 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 49456d19-5507-4376-870a-d183aa6176b9 is already attached to instances: fce30096-300b-4242-b360-ff6617fd5173 Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 49456d19-5507-4376-870a-d183aa6176b9 is already attached to instances: fce30096-300b-4242-b360-ff6617fd5173 Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-486f2cf2-d58f-468f-ac44-a7e94ee869f3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Returning 400 to user: Invalid volume: volume 49456d19-5507-4376-870a-d183aa6176b9 is already attached to instances: fce30096-300b-4242-b360-ff6617fd5173 {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:24.832122 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-486f2cf2-d58f-468f-ac44-a7e94ee869f3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "POST /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.376273 Aug 02 07:06:24.852821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fbfbd9bb-34bc-43a0-a4a7-0e214212c0ed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:24.852821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fbfbd9bb-34bc-43a0-a4a7-0e214212c0ed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:24.854569 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1894/3893] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:06:24 2022] POST /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f/os-volume_attachments => generated 174 bytes in 406 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:06:24.855112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbfbd9bb-34bc-43a0-a4a7-0e214212c0ed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:24.855112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbfbd9bb-34bc-43a0-a4a7-0e214212c0ed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:24.855975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbfbd9bb-34bc-43a0-a4a7-0e214212c0ed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:24.856235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbfbd9bb-34bc-43a0-a4a7-0e214212c0ed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:24.949427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fbfbd9bb-34bc-43a0-a4a7-0e214212c0ed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:06:25.194199 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fbfbd9bb-34bc-43a0-a4a7-0e214212c0ed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 204 len: 0 microversion: 2.1 time: 0.373851 Aug 02 07:06:25.196180 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2000/3894] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:06:24 2022] DELETE /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 07:06:25.208355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c7ecf3b7-5faa-445f-a6ca-34766c7485fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:25.210603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c7ecf3b7-5faa-445f-a6ca-34766c7485fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:25.222642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7ecf3b7-5faa-445f-a6ca-34766c7485fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:25.223385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7ecf3b7-5faa-445f-a6ca-34766c7485fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:25.224994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7ecf3b7-5faa-445f-a6ca-34766c7485fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:25.225633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7ecf3b7-5faa-445f-a6ca-34766c7485fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:25.457620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c2e2eb9a-07e9-4ddd-aa8a-de5d524abc4d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:25.465356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c2e2eb9a-07e9-4ddd-aa8a-de5d524abc4d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:25.489676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2e2eb9a-07e9-4ddd-aa8a-de5d524abc4d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:25.490262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2e2eb9a-07e9-4ddd-aa8a-de5d524abc4d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:25.496952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2e2eb9a-07e9-4ddd-aa8a-de5d524abc4d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:25.498309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2e2eb9a-07e9-4ddd-aa8a-de5d524abc4d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:25.626573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c7ecf3b7-5faa-445f-a6ca-34766c7485fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:25.649997 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c7ecf3b7-5faa-445f-a6ca-34766c7485fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1682 microversion: 2.1 time: 0.448540 Aug 02 07:06:25.661829 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1895/3895] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:25 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1682 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:25.689597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-422bc1f7-464d-4de9-9ffd-bb6b54244ac6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:25.691228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-422bc1f7-464d-4de9-9ffd-bb6b54244ac6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:25.723727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-422bc1f7-464d-4de9-9ffd-bb6b54244ac6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:25.724157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-422bc1f7-464d-4de9-9ffd-bb6b54244ac6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:25.735925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-422bc1f7-464d-4de9-9ffd-bb6b54244ac6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:25.739515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-422bc1f7-464d-4de9-9ffd-bb6b54244ac6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:25.923235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-422bc1f7-464d-4de9-9ffd-bb6b54244ac6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:25.933212 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-422bc1f7-464d-4de9-9ffd-bb6b54244ac6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1270 microversion: 2.1 time: 0.269973 Aug 02 07:06:25.934162 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1896/3896] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:25 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1270 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:25.964137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c2e2eb9a-07e9-4ddd-aa8a-de5d524abc4d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:25.983299 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c2e2eb9a-07e9-4ddd-aa8a-de5d524abc4d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1321 microversion: 2.1 time: 0.529763 Aug 02 07:06:25.987359 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2001/3897] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:25 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1321 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:26.637739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-891aa49e-9662-4a67-b369-3e7b377832c7 req-33172212-ca49-4463-8f5e-c4442af3c25c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8176ddfd-5305-40e8-b380-813f108ea2c8", "tag": "2077edfc-89e5-4646-9a96-104ff255378f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:26.677120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-891aa49e-9662-4a67-b369-3e7b377832c7 req-33172212-ca49-4463-8f5e-c4442af3c25c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:26.681079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-47f75519-e63c-439d-b6d7-69d23152c27b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:26.681716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-47f75519-e63c-439d-b6d7-69d23152c27b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:26.683968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-891aa49e-9662-4a67-b369-3e7b377832c7 req-33172212-ca49-4463-8f5e-c4442af3c25c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:26.699181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:26.700910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47f75519-e63c-439d-b6d7-69d23152c27b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:26.701372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47f75519-e63c-439d-b6d7-69d23152c27b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:26.702246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47f75519-e63c-439d-b6d7-69d23152c27b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:26.702776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47f75519-e63c-439d-b6d7-69d23152c27b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:26.723167 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-891aa49e-9662-4a67-b369-3e7b377832c7 req-33172212-ca49-4463-8f5e-c4442af3c25c service nova] Creating event network-changed:2077edfc-89e5-4646-9a96-104ff255378f for instance 8176ddfd-5305-40e8-b380-813f108ea2c8 on n-h2-851337-3 Aug 02 07:06:26.740051 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-891aa49e-9662-4a67-b369-3e7b377832c7 req-33172212-ca49-4463-8f5e-c4442af3c25c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105906 Aug 02 07:06:26.743316 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1897/3898] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:26.957190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2abd17e4-558f-437d-9dbe-d7bf72d5e466 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:26.958091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2abd17e4-558f-437d-9dbe-d7bf72d5e466 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:27.032497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2abd17e4-558f-437d-9dbe-d7bf72d5e466 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:27.037205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2abd17e4-558f-437d-9dbe-d7bf72d5e466 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:27.044792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2abd17e4-558f-437d-9dbe-d7bf72d5e466 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:27.046483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2abd17e4-558f-437d-9dbe-d7bf72d5e466 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:27.408885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2abd17e4-558f-437d-9dbe-d7bf72d5e466 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:27.409322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-47f75519-e63c-439d-b6d7-69d23152c27b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:27.419258 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-47f75519-e63c-439d-b6d7-69d23152c27b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1682 microversion: 2.1 time: 0.741723 Aug 02 07:06:27.421695 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2002/3899] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:26 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1682 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:27.425353 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2abd17e4-558f-437d-9dbe-d7bf72d5e466 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1336 microversion: 2.1 time: 0.470003 Aug 02 07:06:27.426211 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1898/3900] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:26 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1336 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:27.429570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-495b9347-abb7-4630-bd92-f3c3affcbf30 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:27.434239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-495b9347-abb7-4630-bd92-f3c3affcbf30 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:27.462986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-495b9347-abb7-4630-bd92-f3c3affcbf30 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:27.463845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-495b9347-abb7-4630-bd92-f3c3affcbf30 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:27.465273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-495b9347-abb7-4630-bd92-f3c3affcbf30 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:27.465920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-495b9347-abb7-4630-bd92-f3c3affcbf30 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:28.134237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-495b9347-abb7-4630-bd92-f3c3affcbf30 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:28.147841 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-495b9347-abb7-4630-bd92-f3c3affcbf30 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1321 microversion: 2.1 time: 0.724544 Aug 02 07:06:28.148181 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2003/3901] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:27 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1321 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:28.442629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-618b471d-7d80-492d-a5fb-cdd668ac7103 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:28.443717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-618b471d-7d80-492d-a5fb-cdd668ac7103 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:28.451386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7445253f-0af7-434b-b685-20288ad659fa tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:28.452581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7445253f-0af7-434b-b685-20288ad659fa tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:28.456831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-618b471d-7d80-492d-a5fb-cdd668ac7103 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:28.474344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-618b471d-7d80-492d-a5fb-cdd668ac7103 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:28.476719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-618b471d-7d80-492d-a5fb-cdd668ac7103 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:28.477601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7445253f-0af7-434b-b685-20288ad659fa tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:28.478593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7445253f-0af7-434b-b685-20288ad659fa tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:28.479974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7445253f-0af7-434b-b685-20288ad659fa tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:28.480680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-618b471d-7d80-492d-a5fb-cdd668ac7103 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:28.480831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7445253f-0af7-434b-b685-20288ad659fa tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:28.892172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7445253f-0af7-434b-b685-20288ad659fa tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:28.907245 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7445253f-0af7-434b-b685-20288ad659fa tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1324 microversion: 2.1 time: 0.459857 Aug 02 07:06:28.907831 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2004/3902] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:28 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1324 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:29.175508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dad87e1d-38f5-4bc8-8bae-62cd2fc08bb0 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:29.179714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dad87e1d-38f5-4bc8-8bae-62cd2fc08bb0 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:29.198682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dad87e1d-38f5-4bc8-8bae-62cd2fc08bb0 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:29.199600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dad87e1d-38f5-4bc8-8bae-62cd2fc08bb0 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:29.200580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dad87e1d-38f5-4bc8-8bae-62cd2fc08bb0 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:29.204938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dad87e1d-38f5-4bc8-8bae-62cd2fc08bb0 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:29.210807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-618b471d-7d80-492d-a5fb-cdd668ac7103 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:29.220289 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-618b471d-7d80-492d-a5fb-cdd668ac7103 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1682 microversion: 2.1 time: 0.781627 Aug 02 07:06:29.227905 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1899/3903] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:28 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1682 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:29.493389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dad87e1d-38f5-4bc8-8bae-62cd2fc08bb0 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:29.505711 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dad87e1d-38f5-4bc8-8bae-62cd2fc08bb0 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1321 microversion: 2.1 time: 0.340960 Aug 02 07:06:29.521608 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2005/3904] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:29 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:29.932497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c5b1ec42-11bb-4cd4-9a56-b0aff69f5889 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:29.933455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c5b1ec42-11bb-4cd4-9a56-b0aff69f5889 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:29.944600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:29.948450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:29.951114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5b1ec42-11bb-4cd4-9a56-b0aff69f5889 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:29.957384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5b1ec42-11bb-4cd4-9a56-b0aff69f5889 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:29.960552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5b1ec42-11bb-4cd4-9a56-b0aff69f5889 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:29.977428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5b1ec42-11bb-4cd4-9a56-b0aff69f5889 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:30.249501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4057b97d-7fcc-4d63-b43c-ce2ba68174b4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:30.250465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4057b97d-7fcc-4d63-b43c-ce2ba68174b4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:30.272902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4057b97d-7fcc-4d63-b43c-ce2ba68174b4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:30.276552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4057b97d-7fcc-4d63-b43c-ce2ba68174b4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:30.277556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4057b97d-7fcc-4d63-b43c-ce2ba68174b4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:30.278042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4057b97d-7fcc-4d63-b43c-ce2ba68174b4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:30.468831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4057b97d-7fcc-4d63-b43c-ce2ba68174b4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:30.483767 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4057b97d-7fcc-4d63-b43c-ce2ba68174b4 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 200 len: 1614 microversion: 2.1 time: 0.238835 Aug 02 07:06:30.500222 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2006/3905] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:30 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 1614 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:30.538844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e8e9ee57-e79b-4b86-be55-bf04b43f5da6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:30.541192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e8e9ee57-e79b-4b86-be55-bf04b43f5da6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:30.551749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e8e9ee57-e79b-4b86-be55-bf04b43f5da6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:30.552745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e8e9ee57-e79b-4b86-be55-bf04b43f5da6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:30.553968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e8e9ee57-e79b-4b86-be55-bf04b43f5da6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:30.554967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e8e9ee57-e79b-4b86-be55-bf04b43f5da6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:30.560819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:30.683580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c5b1ec42-11bb-4cd4-9a56-b0aff69f5889 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:30.707021 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c5b1ec42-11bb-4cd4-9a56-b0aff69f5889 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1392 microversion: 2.1 time: 0.768383 Aug 02 07:06:30.712006 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1900/3906] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:29 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1392 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:30.747653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-62134732-d882-4e38-85c7-3001cc2ad369 req-0222c709-c26e-4ee5-ad9c-488f953e3d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee50e87a-eb21-4ce8-82c5-9cf1be097c4f", "name": "network-vif-deleted", "tag": "d5b278ab-5524-4da2-ad6d-175f510b6f30"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:30.790807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-62134732-d882-4e38-85c7-3001cc2ad369 req-0222c709-c26e-4ee5-ad9c-488f953e3d1f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:30.791357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-62134732-d882-4e38-85c7-3001cc2ad369 req-0222c709-c26e-4ee5-ad9c-488f953e3d1f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:30.867366 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-62134732-d882-4e38-85c7-3001cc2ad369 req-0222c709-c26e-4ee5-ad9c-488f953e3d1f service nova] Creating event network-vif-deleted:d5b278ab-5524-4da2-ad6d-175f510b6f30 for instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f on n-h2-851337-3 Aug 02 07:06:30.894353 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-62134732-d882-4e38-85c7-3001cc2ad369 req-0222c709-c26e-4ee5-ad9c-488f953e3d1f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175489 Aug 02 07:06:30.898423 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1901/3907] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:31.079107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e8e9ee57-e79b-4b86-be55-bf04b43f5da6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:31.152109 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e8e9ee57-e79b-4b86-be55-bf04b43f5da6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1321 microversion: 2.1 time: 0.625796 Aug 02 07:06:31.167640 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2007/3908] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:30 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1321 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:31.508719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7fc57c44-162a-4b1f-a9de-77bd5b77db9c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:31.510135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7fc57c44-162a-4b1f-a9de-77bd5b77db9c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:31.526990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7fc57c44-162a-4b1f-a9de-77bd5b77db9c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:31.541072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7fc57c44-162a-4b1f-a9de-77bd5b77db9c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:31.543297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7fc57c44-162a-4b1f-a9de-77bd5b77db9c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:31.544083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7fc57c44-162a-4b1f-a9de-77bd5b77db9c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:31.562335 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-7fc57c44-162a-4b1f-a9de-77bd5b77db9c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] HTTP exception thrown: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7fc57c44-162a-4b1f-a9de-77bd5b77db9c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Request method failure captured: Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f HTTP/1.1 Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mw13SPusoL2oig6z8JKTC1nUbf8Rw_5jT5YPT1CWrOABe8wYL59aYsXiUDtU2vA3es6LryNsakcXkaddV2SmWSmf9b0Kir8iKyeHQ1V913RDI7OxthQkB34rsjOk5zDf7k87yoaJrxDD4eFsnTmbVoTrOLyxwi8jQau6VljX5rXYUE Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ee1befa077542b9a17865baad3c9999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}] Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 3a2629fa08b5419a96c2942118d38dad Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'ee50e87a-eb21-4ce8-82c5-9cf1be097c4f'} Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:31.564928 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:31.569638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:31.569638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:31.569638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:31.569638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:06:31.569638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:06:31.569638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:06:31.569638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:31.571355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7fc57c44-162a-4b1f-a9de-77bd5b77db9c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Returning 404 to user: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:31.572461 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7fc57c44-162a-4b1f-a9de-77bd5b77db9c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 404 len: 111 microversion: 2.1 time: 0.071282 Aug 02 07:06:31.575230 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1902/3909] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:31 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:06:31.592361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fbaf4be9-3bf9-428c-9b08-ec53444645f6 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '.version_select at 0x7f927a2c6820>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:31.690528 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fbaf4be9-3bf9-428c-9b08-ec53444645f6 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-950874326" status: 202 len: 0 microversion: 2.1 time: 0.110026 Aug 02 07:06:31.694329 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2008/3910] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Aug 2 07:06:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-950874326 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:06:31.728241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a6cf08f5-ae29-4628-88ec-240cdfb669d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:31.729100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a6cf08f5-ae29-4628-88ec-240cdfb669d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:31.742293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6cf08f5-ae29-4628-88ec-240cdfb669d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:31.742748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6cf08f5-ae29-4628-88ec-240cdfb669d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:31.743740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6cf08f5-ae29-4628-88ec-240cdfb669d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:31.748023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6cf08f5-ae29-4628-88ec-240cdfb669d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:32.082710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c0c99bfd-84bc-45a2-abe8-0299e551ea84 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:32.083441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c0c99bfd-84bc-45a2-abe8-0299e551ea84 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:32.094377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0c99bfd-84bc-45a2-abe8-0299e551ea84 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:32.099769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0c99bfd-84bc-45a2-abe8-0299e551ea84 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:32.101373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0c99bfd-84bc-45a2-abe8-0299e551ea84 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:32.109934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0c99bfd-84bc-45a2-abe8-0299e551ea84 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:32.169620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c0c99bfd-84bc-45a2-abe8-0299e551ea84 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:06:32.209812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a6cf08f5-ae29-4628-88ec-240cdfb669d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:32.225270 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a6cf08f5-ae29-4628-88ec-240cdfb669d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1392 microversion: 2.1 time: 0.498966 Aug 02 07:06:32.228739 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1903/3911] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:31 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1392 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:32.237031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d58de1b5-7ef3-428b-b78d-03b9ea2d9b2d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:32.246611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d58de1b5-7ef3-428b-b78d-03b9ea2d9b2d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:32.261478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d58de1b5-7ef3-428b-b78d-03b9ea2d9b2d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:32.265070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d58de1b5-7ef3-428b-b78d-03b9ea2d9b2d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:32.266822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d58de1b5-7ef3-428b-b78d-03b9ea2d9b2d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:32.269976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d58de1b5-7ef3-428b-b78d-03b9ea2d9b2d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:32.406244 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c0c99bfd-84bc-45a2-abe8-0299e551ea84 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 204 len: 0 microversion: 2.1 time: 0.327144 Aug 02 07:06:32.414332 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2009/3912] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:06:32 2022] DELETE /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:06:32.425210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a46b601c-a537-43d9-aaa6-365f0ad34e3a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:32.425938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a46b601c-a537-43d9-aaa6-365f0ad34e3a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:32.451903 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a46b601c-a537-43d9-aaa6-365f0ad34e3a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:32.452358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a46b601c-a537-43d9-aaa6-365f0ad34e3a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:32.458027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a46b601c-a537-43d9-aaa6-365f0ad34e3a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:32.459875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a46b601c-a537-43d9-aaa6-365f0ad34e3a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:32.604077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d58de1b5-7ef3-428b-b78d-03b9ea2d9b2d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:32.617811 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d58de1b5-7ef3-428b-b78d-03b9ea2d9b2d tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1321 microversion: 2.1 time: 0.385795 Aug 02 07:06:32.620169 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1904/3913] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:32 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1321 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:32.765441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a46b601c-a537-43d9-aaa6-365f0ad34e3a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:32.776958 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a46b601c-a537-43d9-aaa6-365f0ad34e3a tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1508 microversion: 2.1 time: 0.356898 Aug 02 07:06:32.778077 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2010/3914] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:32 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1508 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:32.807392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2063c8b6-8c38-40f5-b82c-e441e7ba2b56 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:32.808010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2063c8b6-8c38-40f5-b82c-e441e7ba2b56 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:32.816781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2063c8b6-8c38-40f5-b82c-e441e7ba2b56 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:32.817645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2063c8b6-8c38-40f5-b82c-e441e7ba2b56 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:32.818635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2063c8b6-8c38-40f5-b82c-e441e7ba2b56 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:32.819231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2063c8b6-8c38-40f5-b82c-e441e7ba2b56 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:33.023270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2063c8b6-8c38-40f5-b82c-e441e7ba2b56 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:33.032107 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2063c8b6-8c38-40f5-b82c-e441e7ba2b56 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 0.228451 Aug 02 07:06:33.032677 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1905/3915] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:32 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:33.092403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-c8662a24-a7c7-4135-8c43-ddc79731729d req-eed30bc0-35f9-4f88-a837-b82666a9c18c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d93db40-84f5-4c63-825f-6ee647fa2331", "tag": "38895fc4-ade3-4226-bdfd-d68b06745975"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:33.111778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c8662a24-a7c7-4135-8c43-ddc79731729d req-eed30bc0-35f9-4f88-a837-b82666a9c18c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:33.114862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c8662a24-a7c7-4135-8c43-ddc79731729d req-eed30bc0-35f9-4f88-a837-b82666a9c18c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:33.144808 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-c8662a24-a7c7-4135-8c43-ddc79731729d req-eed30bc0-35f9-4f88-a837-b82666a9c18c service nova] Creating event network-changed:38895fc4-ade3-4226-bdfd-d68b06745975 for instance 4d93db40-84f5-4c63-825f-6ee647fa2331 on n-h1-851337-3 Aug 02 07:06:33.162115 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-c8662a24-a7c7-4135-8c43-ddc79731729d req-eed30bc0-35f9-4f88-a837-b82666a9c18c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073351 Aug 02 07:06:33.176107 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2011/3916] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:33.254933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-12a8d720-8477-4270-bfa8-4e60c2b4be79 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:33.255899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-12a8d720-8477-4270-bfa8-4e60c2b4be79 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:33.269003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12a8d720-8477-4270-bfa8-4e60c2b4be79 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:33.272328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12a8d720-8477-4270-bfa8-4e60c2b4be79 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:33.273336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12a8d720-8477-4270-bfa8-4e60c2b4be79 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:33.275694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12a8d720-8477-4270-bfa8-4e60c2b4be79 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:33.555767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-12a8d720-8477-4270-bfa8-4e60c2b4be79 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:33.561226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:33.581405 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-12a8d720-8477-4270-bfa8-4e60c2b4be79 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1392 microversion: 2.1 time: 0.328844 Aug 02 07:06:33.582590 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1906/3917] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:33 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1392 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:33.621427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d5179378-e1a3-4634-aa18-596d12d3fa06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:33.622133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d5179378-e1a3-4634-aa18-596d12d3fa06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:33.632722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d5179378-e1a3-4634-aa18-596d12d3fa06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:33.633249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d5179378-e1a3-4634-aa18-596d12d3fa06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:33.634146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d5179378-e1a3-4634-aa18-596d12d3fa06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:33.634705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d5179378-e1a3-4634-aa18-596d12d3fa06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:33.644773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fea64d5f-9580-4c0f-92ba-6e51f4ec977c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:33.646268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fea64d5f-9580-4c0f-92ba-6e51f4ec977c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:33.653926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea64d5f-9580-4c0f-92ba-6e51f4ec977c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:33.654711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea64d5f-9580-4c0f-92ba-6e51f4ec977c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:33.655862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea64d5f-9580-4c0f-92ba-6e51f4ec977c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:33.656483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea64d5f-9580-4c0f-92ba-6e51f4ec977c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:33.665504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:33.754350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-d5179378-e1a3-4634-aa18-596d12d3fa06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lazy-loading 'services' on Instance uuid fce30096-300b-4242-b360-ff6617fd5173 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:06:33.857421 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d5179378-e1a3-4634-aa18-596d12d3fa06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments/49456d19-5507-4376-870a-d183aa6176b9" status: 202 len: 0 microversion: 2.1 time: 0.240031 Aug 02 07:06:33.859061 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2012/3918] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:06:33 2022] DELETE /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments/49456d19-5507-4376-870a-d183aa6176b9 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:06:33.865425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9d030e8a-b54d-48a0-9445-2b939b4527e0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:33.866148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9d030e8a-b54d-48a0-9445-2b939b4527e0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:33.875738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d030e8a-b54d-48a0-9445-2b939b4527e0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:33.876363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d030e8a-b54d-48a0-9445-2b939b4527e0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:33.877345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d030e8a-b54d-48a0-9445-2b939b4527e0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:33.877921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d030e8a-b54d-48a0-9445-2b939b4527e0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:33.951037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fea64d5f-9580-4c0f-92ba-6e51f4ec977c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:33.960235 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fea64d5f-9580-4c0f-92ba-6e51f4ec977c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1321 microversion: 2.1 time: 0.319422 Aug 02 07:06:33.961801 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1907/3919] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:33 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:33.967343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-31069836-96b1-4201-8df0-419067bfe57d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:33.970221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-31069836-96b1-4201-8df0-419067bfe57d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:33.978097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31069836-96b1-4201-8df0-419067bfe57d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:33.987375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31069836-96b1-4201-8df0-419067bfe57d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:33.988760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31069836-96b1-4201-8df0-419067bfe57d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:33.989325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31069836-96b1-4201-8df0-419067bfe57d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:34.028662 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-31069836-96b1-4201-8df0-419067bfe57d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064909 Aug 02 07:06:34.029738 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1908/3920] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:33 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:34.056089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-77a31cd8-6608-4b43-a037-dc840216aad8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:34.065836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-77a31cd8-6608-4b43-a037-dc840216aad8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:34.084684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9d030e8a-b54d-48a0-9445-2b939b4527e0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:34.089396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77a31cd8-6608-4b43-a037-dc840216aad8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:34.091630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77a31cd8-6608-4b43-a037-dc840216aad8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:34.093606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77a31cd8-6608-4b43-a037-dc840216aad8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:34.097447 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9d030e8a-b54d-48a0-9445-2b939b4527e0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1508 microversion: 2.1 time: 0.236997 Aug 02 07:06:34.098032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77a31cd8-6608-4b43-a037-dc840216aad8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:34.098459 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2013/3921] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:33 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:34.329135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-77a31cd8-6608-4b43-a037-dc840216aad8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:34.338841 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-77a31cd8-6608-4b43-a037-dc840216aad8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 0.287644 Aug 02 07:06:34.350862 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1909/3922] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:34 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:34.541422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-37591946-2447-40f3-8072-b7d40cb46609 req-cc67b69e-39ae-496f-aa86-403efe90942a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8176ddfd-5305-40e8-b380-813f108ea2c8", "name": "network-vif-plugged", "status": "completed", "tag": "2077edfc-89e5-4646-9a96-104ff255378f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:34.547520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=10 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:34.555659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-37591946-2447-40f3-8072-b7d40cb46609 req-cc67b69e-39ae-496f-aa86-403efe90942a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:34.556035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-37591946-2447-40f3-8072-b7d40cb46609 req-cc67b69e-39ae-496f-aa86-403efe90942a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:34.569559 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-37591946-2447-40f3-8072-b7d40cb46609 req-cc67b69e-39ae-496f-aa86-403efe90942a service nova] Creating event network-vif-plugged:2077edfc-89e5-4646-9a96-104ff255378f for instance 8176ddfd-5305-40e8-b380-813f108ea2c8 on n-h2-851337-3 Aug 02 07:06:34.575357 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-37591946-2447-40f3-8072-b7d40cb46609 req-cc67b69e-39ae-496f-aa86-403efe90942a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037814 Aug 02 07:06:34.576190 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2014/3923] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:34.604237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9ff9cee6-5c53-4d24-bb59-6cf43c7daacb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:34.604893 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9ff9cee6-5c53-4d24-bb59-6cf43c7daacb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:34.626493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ff9cee6-5c53-4d24-bb59-6cf43c7daacb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:34.627168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ff9cee6-5c53-4d24-bb59-6cf43c7daacb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:34.627985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ff9cee6-5c53-4d24-bb59-6cf43c7daacb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:34.628443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ff9cee6-5c53-4d24-bb59-6cf43c7daacb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:34.928916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9ff9cee6-5c53-4d24-bb59-6cf43c7daacb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:34.956298 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9ff9cee6-5c53-4d24-bb59-6cf43c7daacb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1392 microversion: 2.1 time: 0.356298 Aug 02 07:06:34.961675 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1910/3924] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:34 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1392 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:34.988887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-38be2462-a628-47e5-88a0-25ad02577299 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:34.989488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-38be2462-a628-47e5-88a0-25ad02577299 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:35.005834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38be2462-a628-47e5-88a0-25ad02577299 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.006137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38be2462-a628-47e5-88a0-25ad02577299 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.006927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38be2462-a628-47e5-88a0-25ad02577299 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.013310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38be2462-a628-47e5-88a0-25ad02577299 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.042301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3b4ab7c8-27fc-427d-9dc9-f9f022844eab tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:35.045187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3b4ab7c8-27fc-427d-9dc9-f9f022844eab tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:35.066012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b4ab7c8-27fc-427d-9dc9-f9f022844eab tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.071765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b4ab7c8-27fc-427d-9dc9-f9f022844eab tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.076592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b4ab7c8-27fc-427d-9dc9-f9f022844eab tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.077317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b4ab7c8-27fc-427d-9dc9-f9f022844eab tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.143064 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3b4ab7c8-27fc-427d-9dc9-f9f022844eab tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105159 Aug 02 07:06:35.143666 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1911/3925] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:35 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:06:35.151281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-333f8878-5695-4c0e-ae95-5de8262aaa24 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:35.151902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-333f8878-5695-4c0e-ae95-5de8262aaa24 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:35.171244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-333f8878-5695-4c0e-ae95-5de8262aaa24 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.171708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-333f8878-5695-4c0e-ae95-5de8262aaa24 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.172555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-333f8878-5695-4c0e-ae95-5de8262aaa24 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.173001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-333f8878-5695-4c0e-ae95-5de8262aaa24 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.243863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-333f8878-5695-4c0e-ae95-5de8262aaa24 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.244767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-333f8878-5695-4c0e-ae95-5de8262aaa24 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.245257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-333f8878-5695-4c0e-ae95-5de8262aaa24 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lazy-loading 'fault' on Instance uuid 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:06:35.291096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-38be2462-a628-47e5-88a0-25ad02577299 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:35.322250 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-38be2462-a628-47e5-88a0-25ad02577299 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1321 microversion: 2.1 time: 0.342851 Aug 02 07:06:35.326708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-333f8878-5695-4c0e-ae95-5de8262aaa24 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:35.330173 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2015/3926] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:34 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:35.341347 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-333f8878-5695-4c0e-ae95-5de8262aaa24 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 200 len: 1312 microversion: 2.1 time: 0.196277 Aug 02 07:06:35.343427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-326fb951-36b4-4235-9872-c4d48dfe95a3 req-b88db716-7176-483f-808a-7f2a21d493eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a", "name": "network-vif-deleted", "tag": "8a0df868-ebd1-4372-b04a-0f30ca51787e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:35.356859 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1912/3927] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:35 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 1312 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:35.370791 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-28c7d1b9-42fb-478b-a03c-67c4d4db2b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:35.371659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-28c7d1b9-42fb-478b-a03c-67c4d4db2b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:35.378556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28c7d1b9-42fb-478b-a03c-67c4d4db2b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.379374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28c7d1b9-42fb-478b-a03c-67c4d4db2b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.380840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28c7d1b9-42fb-478b-a03c-67c4d4db2b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.381463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28c7d1b9-42fb-478b-a03c-67c4d4db2b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.395835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-326fb951-36b4-4235-9872-c4d48dfe95a3 req-b88db716-7176-483f-808a-7f2a21d493eb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.397219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-326fb951-36b4-4235-9872-c4d48dfe95a3 req-b88db716-7176-483f-808a-7f2a21d493eb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.418704 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-326fb951-36b4-4235-9872-c4d48dfe95a3 req-b88db716-7176-483f-808a-7f2a21d493eb service nova] Creating event network-vif-deleted:8a0df868-ebd1-4372-b04a-0f30ca51787e for instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a on n-h1-851337-3 Aug 02 07:06:35.424218 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-326fb951-36b4-4235-9872-c4d48dfe95a3 req-b88db716-7176-483f-808a-7f2a21d493eb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092844 Aug 02 07:06:35.437920 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2016/3928] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:35.591823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-28c7d1b9-42fb-478b-a03c-67c4d4db2b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:35.602391 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-28c7d1b9-42fb-478b-a03c-67c4d4db2b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.244196 Aug 02 07:06:35.603260 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1913/3929] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:35 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:35.625696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-51ad9998-67b0-4ec1-bdba-412aebaeb1ee tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-59570888"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:35.628555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-51ad9998-67b0-4ec1-bdba-412aebaeb1ee tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:35.637083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51ad9998-67b0-4ec1-bdba-412aebaeb1ee tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.637816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51ad9998-67b0-4ec1-bdba-412aebaeb1ee tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.639053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51ad9998-67b0-4ec1-bdba-412aebaeb1ee tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.639768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51ad9998-67b0-4ec1-bdba-412aebaeb1ee tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.878282 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-51ad9998-67b0-4ec1-bdba-412aebaeb1ee tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.255990 Aug 02 07:06:35.880048 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2017/3930] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:06:35 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 02 07:06:35.891036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-756e7ec1-8738-4699-a624-6ce18c5b5571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:35.891787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-756e7ec1-8738-4699-a624-6ce18c5b5571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:35.899389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-756e7ec1-8738-4699-a624-6ce18c5b5571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.899930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-756e7ec1-8738-4699-a624-6ce18c5b5571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.900633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-756e7ec1-8738-4699-a624-6ce18c5b5571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.901369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-756e7ec1-8738-4699-a624-6ce18c5b5571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.983743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ff5e3245-0d0e-46df-9140-71e699399c0f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:35.984459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ff5e3245-0d0e-46df-9140-71e699399c0f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:35.993329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff5e3245-0d0e-46df-9140-71e699399c0f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.993329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff5e3245-0d0e-46df-9140-71e699399c0f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:35.994301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff5e3245-0d0e-46df-9140-71e699399c0f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:35.994301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff5e3245-0d0e-46df-9140-71e699399c0f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.167605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-756e7ec1-8738-4699-a624-6ce18c5b5571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:36.178214 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-756e7ec1-8738-4699-a624-6ce18c5b5571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.293839 Aug 02 07:06:36.179366 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1914/3931] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:35 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:36.185488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-749d6083-edba-45dd-8d41-43aa5b9d7c5a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:36.188158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-749d6083-edba-45dd-8d41-43aa5b9d7c5a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:36.194769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-749d6083-edba-45dd-8d41-43aa5b9d7c5a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:36.195872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-749d6083-edba-45dd-8d41-43aa5b9d7c5a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.196874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-749d6083-edba-45dd-8d41-43aa5b9d7c5a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:36.197729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-749d6083-edba-45dd-8d41-43aa5b9d7c5a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.240970 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-749d6083-edba-45dd-8d41-43aa5b9d7c5a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060182 Aug 02 07:06:36.242420 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1915/3932] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:36 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:36.249396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ff5e3245-0d0e-46df-9140-71e699399c0f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:36.258381 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ff5e3245-0d0e-46df-9140-71e699399c0f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1392 microversion: 2.1 time: 0.279045 Aug 02 07:06:36.258976 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2018/3933] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:35 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1392 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:36.350382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-244fc869-3854-4eca-813c-49a63f3ba5ba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:36.351014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-244fc869-3854-4eca-813c-49a63f3ba5ba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:36.359475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-244fc869-3854-4eca-813c-49a63f3ba5ba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:36.359931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-244fc869-3854-4eca-813c-49a63f3ba5ba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.360823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-244fc869-3854-4eca-813c-49a63f3ba5ba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:36.361245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-244fc869-3854-4eca-813c-49a63f3ba5ba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.377728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-db6df613-b1c6-4166-99a9-bc8cbdcb0a35 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:36.380027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-db6df613-b1c6-4166-99a9-bc8cbdcb0a35 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:36.388905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db6df613-b1c6-4166-99a9-bc8cbdcb0a35 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:36.389592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db6df613-b1c6-4166-99a9-bc8cbdcb0a35 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.391045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db6df613-b1c6-4166-99a9-bc8cbdcb0a35 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:36.391759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db6df613-b1c6-4166-99a9-bc8cbdcb0a35 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.409667 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-db6df613-b1c6-4166-99a9-bc8cbdcb0a35 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] HTTP exception thrown: Instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a could not be found. Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-db6df613-b1c6-4166-99a9-bc8cbdcb0a35 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Request method failure captured: Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a HTTP/1.1 Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MuV9Q5BOG4bZSTn8mNA1jfjLBve4d8RpXHrEXh4dSRfQwoHnO2CX5TWJr_Ybphxlmnei--H-24HQZ2VBGVtXb7ed4xsT9rh6T-B0ctcoWXMM-9zRQgu-z2imnNm8CiRJJUKFATn8QRgKDRSh1174_Xj_fjEsdTPEI1eutLUtYEoOkA Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}] Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b9ad5424586247019d4374f52600ea51 Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a could not be found. Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a'} Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a could not be found. Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a could not be found. Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:36.411853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:36.415344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:36.415344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:36.415344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:36.415344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:36.415344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:06:36.415344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:06:36.415344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a could not be found. Aug 02 07:06:36.415344 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:36.417045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-db6df613-b1c6-4166-99a9-bc8cbdcb0a35 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Returning 404 to user: Instance 0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:36.418387 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-db6df613-b1c6-4166-99a9-bc8cbdcb0a35 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a" status: 404 len: 111 microversion: 2.1 time: 0.045423 Aug 02 07:06:36.422789 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2019/3934] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:36 2022] GET /compute/v2.1/servers/0699f6ac-a1b8-4d28-a3bf-2bd95c45a41a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:06:36.428641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-35bb32ca-2482-469c-8885-e542d1640acc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:36.429365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-35bb32ca-2482-469c-8885-e542d1640acc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:36.437025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35bb32ca-2482-469c-8885-e542d1640acc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:36.438428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35bb32ca-2482-469c-8885-e542d1640acc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.439988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35bb32ca-2482-469c-8885-e542d1640acc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:36.440590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-35bb32ca-2482-469c-8885-e542d1640acc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.490384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-35bb32ca-2482-469c-8885-e542d1640acc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:06:36.531235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-244fc869-3854-4eca-813c-49a63f3ba5ba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:36.542026 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-244fc869-3854-4eca-813c-49a63f3ba5ba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1471 microversion: 2.1 time: 0.195522 Aug 02 07:06:36.542746 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1916/3935] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:36 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:36.567404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ecf42997-e1e4-41ed-831d-897498b4ea8b tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:36.569158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ecf42997-e1e4-41ed-831d-897498b4ea8b tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:36.578931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ecf42997-e1e4-41ed-831d-897498b4ea8b tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:36.579808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ecf42997-e1e4-41ed-831d-897498b4ea8b tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.582114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ecf42997-e1e4-41ed-831d-897498b4ea8b tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:36.582956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ecf42997-e1e4-41ed-831d-897498b4ea8b tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.616658 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-35bb32ca-2482-469c-8885-e542d1640acc tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 204 len: 0 microversion: 2.1 time: 0.192221 Aug 02 07:06:36.617583 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2020/3936] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:06:36 2022] DELETE /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:06:36.626598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-22e2b3dd-3a1b-4671-bb98-86bed61809f0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:36.627459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-22e2b3dd-3a1b-4671-bb98-86bed61809f0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:36.636890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-ecf42997-e1e4-41ed-831d-897498b4ea8b tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lazy-loading 'flavor' on Instance uuid 8176ddfd-5305-40e8-b380-813f108ea2c8 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:06:36.640706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22e2b3dd-3a1b-4671-bb98-86bed61809f0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:36.641188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22e2b3dd-3a1b-4671-bb98-86bed61809f0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.642182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22e2b3dd-3a1b-4671-bb98-86bed61809f0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:36.642623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22e2b3dd-3a1b-4671-bb98-86bed61809f0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.761198 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ecf42997-e1e4-41ed-831d-897498b4ea8b tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8/action" status: 202 len: 0 microversion: 2.1 time: 0.200913 Aug 02 07:06:36.763056 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1917/3937] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:06:36 2022] POST /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:06:36.773380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ebe4a7d-7b19-4cc2-8e92-3514a1aeb1fb tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:36.790643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ebe4a7d-7b19-4cc2-8e92-3514a1aeb1fb tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:36.808270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ebe4a7d-7b19-4cc2-8e92-3514a1aeb1fb tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:36.808976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ebe4a7d-7b19-4cc2-8e92-3514a1aeb1fb tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.810163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ebe4a7d-7b19-4cc2-8e92-3514a1aeb1fb tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:36.810753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ebe4a7d-7b19-4cc2-8e92-3514a1aeb1fb tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:36.811545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-22e2b3dd-3a1b-4671-bb98-86bed61809f0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:36.820408 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-22e2b3dd-3a1b-4671-bb98-86bed61809f0 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1522 microversion: 2.1 time: 0.198219 Aug 02 07:06:36.821231 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2021/3938] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:36 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:37.104363 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ebe4a7d-7b19-4cc2-8e92-3514a1aeb1fb tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1630 microversion: 2.1 time: 0.336438 Aug 02 07:06:37.110102 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1918/3939] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:36 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1630 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:37.206282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4c5184e2-f7c1-49b4-bf3f-47429238882a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:37.207888 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4c5184e2-f7c1-49b4-bf3f-47429238882a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:37.229062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c5184e2-f7c1-49b4-bf3f-47429238882a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:37.230550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c5184e2-f7c1-49b4-bf3f-47429238882a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:37.231371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c5184e2-f7c1-49b4-bf3f-47429238882a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:37.231813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c5184e2-f7c1-49b4-bf3f-47429238882a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:37.255085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:37.258151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7f006cf5-2373-411c-a577-a3e2c4937e06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:37.260677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7f006cf5-2373-411c-a577-a3e2c4937e06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:37.271415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f006cf5-2373-411c-a577-a3e2c4937e06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:37.279663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f006cf5-2373-411c-a577-a3e2c4937e06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:37.280537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f006cf5-2373-411c-a577-a3e2c4937e06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:37.281041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f006cf5-2373-411c-a577-a3e2c4937e06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:37.336478 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7f006cf5-2373-411c-a577-a3e2c4937e06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083313 Aug 02 07:06:37.337578 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1919/3940] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:37 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:37.346600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d61d86f7-0438-423b-b8fb-a6b5432acba3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:37.347962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d61d86f7-0438-423b-b8fb-a6b5432acba3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:37.355799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d61d86f7-0438-423b-b8fb-a6b5432acba3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:37.356779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d61d86f7-0438-423b-b8fb-a6b5432acba3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:37.358788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d61d86f7-0438-423b-b8fb-a6b5432acba3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:37.359272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d61d86f7-0438-423b-b8fb-a6b5432acba3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:37.446482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4c5184e2-f7c1-49b4-bf3f-47429238882a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:37.463310 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4c5184e2-f7c1-49b4-bf3f-47429238882a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.260315 Aug 02 07:06:37.464452 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2022/3941] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:37 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:37.524896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d61d86f7-0438-423b-b8fb-a6b5432acba3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:37.533132 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d61d86f7-0438-423b-b8fb-a6b5432acba3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1392 microversion: 2.1 time: 0.193877 Aug 02 07:06:37.533864 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1920/3942] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:37 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:37.846491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-06779d47-6634-42b4-af53-ac40c21f4ae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:37.847222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-06779d47-6634-42b4-af53-ac40c21f4ae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:37.857147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06779d47-6634-42b4-af53-ac40c21f4ae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:37.857693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06779d47-6634-42b4-af53-ac40c21f4ae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:37.858586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06779d47-6634-42b4-af53-ac40c21f4ae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:37.859098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06779d47-6634-42b4-af53-ac40c21f4ae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:38.032399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-06779d47-6634-42b4-af53-ac40c21f4ae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:38.042778 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-06779d47-6634-42b4-af53-ac40c21f4ae9 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1522 microversion: 2.1 time: 0.201079 Aug 02 07:06:38.044868 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2023/3943] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:37 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:38.132381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-37a3d892-a73d-441c-8bbe-e7462f862c3c req-6d917a71-5671-4cb0-8607-34f8fe0d672a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ccfed8-393e-4223-b2a8-7dbf8c77d3fe", "name": "network-vif-unplugged", "status": "completed", "tag": "96c2e36a-4761-4b9b-b02e-96b42f53d06e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:38.139405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-55ea7082-4f89-4ec1-8153-15a5581fac8c tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:38.140707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-55ea7082-4f89-4ec1-8153-15a5581fac8c tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:38.152397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55ea7082-4f89-4ec1-8153-15a5581fac8c tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:38.153491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55ea7082-4f89-4ec1-8153-15a5581fac8c tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:38.154599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55ea7082-4f89-4ec1-8153-15a5581fac8c tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:38.155232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55ea7082-4f89-4ec1-8153-15a5581fac8c tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:38.156212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-37a3d892-a73d-441c-8bbe-e7462f862c3c req-6d917a71-5671-4cb0-8607-34f8fe0d672a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:38.156936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-37a3d892-a73d-441c-8bbe-e7462f862c3c req-6d917a71-5671-4cb0-8607-34f8fe0d672a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:38.184540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:38.211003 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-37a3d892-a73d-441c-8bbe-e7462f862c3c req-6d917a71-5671-4cb0-8607-34f8fe0d672a service nova] Creating event network-vif-unplugged:96c2e36a-4761-4b9b-b02e-96b42f53d06e for instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe on n-h1-851337-3 Aug 02 07:06:38.231935 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-37a3d892-a73d-441c-8bbe-e7462f862c3c req-6d917a71-5671-4cb0-8607-34f8fe0d672a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103532 Aug 02 07:06:38.232837 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2024/3944] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:38.349836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a48856de-2b4a-478f-8c81-4d78a716a3b0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:38.353701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a48856de-2b4a-478f-8c81-4d78a716a3b0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:38.362456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a48856de-2b4a-478f-8c81-4d78a716a3b0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:38.363952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a48856de-2b4a-478f-8c81-4d78a716a3b0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:38.367127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a48856de-2b4a-478f-8c81-4d78a716a3b0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:38.367650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a48856de-2b4a-478f-8c81-4d78a716a3b0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:38.386855 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-55ea7082-4f89-4ec1-8153-15a5581fac8c tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1630 microversion: 2.1 time: 0.253287 Aug 02 07:06:38.390991 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1921/3945] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:38 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1630 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:38.422841 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a48856de-2b4a-478f-8c81-4d78a716a3b0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077454 Aug 02 07:06:38.423428 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2025/3946] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:38 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:38.485754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1848e1d9-bd0b-4a7b-b0d6-4d2b742cf5ef tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:38.486672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1848e1d9-bd0b-4a7b-b0d6-4d2b742cf5ef tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:38.494118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1848e1d9-bd0b-4a7b-b0d6-4d2b742cf5ef tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:38.494562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1848e1d9-bd0b-4a7b-b0d6-4d2b742cf5ef tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:38.495514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1848e1d9-bd0b-4a7b-b0d6-4d2b742cf5ef tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:38.495956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1848e1d9-bd0b-4a7b-b0d6-4d2b742cf5ef tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:38.555435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b96659e3-1295-4c2d-83ec-ccba9aa36c4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:38.556347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b96659e3-1295-4c2d-83ec-ccba9aa36c4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:38.572007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b96659e3-1295-4c2d-83ec-ccba9aa36c4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:38.572907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b96659e3-1295-4c2d-83ec-ccba9aa36c4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:38.574142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b96659e3-1295-4c2d-83ec-ccba9aa36c4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:38.574737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b96659e3-1295-4c2d-83ec-ccba9aa36c4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:38.730360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1848e1d9-bd0b-4a7b-b0d6-4d2b742cf5ef tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:38.739030 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1848e1d9-bd0b-4a7b-b0d6-4d2b742cf5ef tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.257392 Aug 02 07:06:38.739619 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1922/3947] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:38 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:38.774021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b96659e3-1295-4c2d-83ec-ccba9aa36c4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:38.784810 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b96659e3-1295-4c2d-83ec-ccba9aa36c4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1392 microversion: 2.1 time: 0.233630 Aug 02 07:06:38.786314 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2026/3948] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:38 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1392 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:39.064795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-33d0339f-9be3-41b4-9460-6d12d03442ef tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:39.065428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-33d0339f-9be3-41b4-9460-6d12d03442ef tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:39.072522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33d0339f-9be3-41b4-9460-6d12d03442ef tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:39.072979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33d0339f-9be3-41b4-9460-6d12d03442ef tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:39.073771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33d0339f-9be3-41b4-9460-6d12d03442ef tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:39.074239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33d0339f-9be3-41b4-9460-6d12d03442ef tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:39.365436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-33d0339f-9be3-41b4-9460-6d12d03442ef tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:39.376166 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-33d0339f-9be3-41b4-9460-6d12d03442ef tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1522 microversion: 2.1 time: 0.315329 Aug 02 07:06:39.377101 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1923/3949] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:39 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:39.412670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7d512f91-5a1d-42a0-967c-0bebb299d7d4 tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:39.414440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7d512f91-5a1d-42a0-967c-0bebb299d7d4 tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:39.423422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d512f91-5a1d-42a0-967c-0bebb299d7d4 tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:39.424617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d512f91-5a1d-42a0-967c-0bebb299d7d4 tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:39.437439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8df02b96-a198-40fc-920c-e894ba7d95c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:39.440445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8df02b96-a198-40fc-920c-e894ba7d95c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:39.443728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d512f91-5a1d-42a0-967c-0bebb299d7d4 tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:39.444471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d512f91-5a1d-42a0-967c-0bebb299d7d4 tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:39.456983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8df02b96-a198-40fc-920c-e894ba7d95c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:39.459715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8df02b96-a198-40fc-920c-e894ba7d95c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:39.460769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8df02b96-a198-40fc-920c-e894ba7d95c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:39.462357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8df02b96-a198-40fc-920c-e894ba7d95c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:39.524645 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8df02b96-a198-40fc-920c-e894ba7d95c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091675 Aug 02 07:06:39.529842 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1924/3950] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:39 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:39.762250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6a146d28-9fc0-4df3-831f-c7e80c0cfaf9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:39.763170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6a146d28-9fc0-4df3-831f-c7e80c0cfaf9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:39.770435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a146d28-9fc0-4df3-831f-c7e80c0cfaf9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:39.771213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a146d28-9fc0-4df3-831f-c7e80c0cfaf9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:39.772247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a146d28-9fc0-4df3-831f-c7e80c0cfaf9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:39.772872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a146d28-9fc0-4df3-831f-c7e80c0cfaf9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.196793 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7d512f91-5a1d-42a0-967c-0bebb299d7d4 tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1613 microversion: 2.1 time: 0.789280 Aug 02 07:06:40.197717 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2027/3951] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:39 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1613 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:40.202665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eb7ec1dd-ca37-4852-8e9f-73b6fff9e10a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:40.203293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-eb7ec1dd-ca37-4852-8e9f-73b6fff9e10a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:40.228830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eb7ec1dd-ca37-4852-8e9f-73b6fff9e10a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:40.229297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eb7ec1dd-ca37-4852-8e9f-73b6fff9e10a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.230651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eb7ec1dd-ca37-4852-8e9f-73b6fff9e10a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:40.231100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eb7ec1dd-ca37-4852-8e9f-73b6fff9e10a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.534528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6a146d28-9fc0-4df3-831f-c7e80c0cfaf9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:40.544991 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6a146d28-9fc0-4df3-831f-c7e80c0cfaf9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.787546 Aug 02 07:06:40.546232 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1925/3952] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:39 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:40.552929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3db05824-9901-48b0-ba34-8d6ba884650d tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:40.554250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3db05824-9901-48b0-ba34-8d6ba884650d tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:40.556465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-eb7ec1dd-ca37-4852-8e9f-73b6fff9e10a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:40.566612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3db05824-9901-48b0-ba34-8d6ba884650d tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:40.567310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3db05824-9901-48b0-ba34-8d6ba884650d tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.568450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3db05824-9901-48b0-ba34-8d6ba884650d tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:40.568895 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3db05824-9901-48b0-ba34-8d6ba884650d tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.570537 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-eb7ec1dd-ca37-4852-8e9f-73b6fff9e10a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1392 microversion: 2.1 time: 0.371634 Aug 02 07:06:40.571417 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2028/3953] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:40 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1392 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:40.584393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4970e78b-1af8-493e-9315-8845c4f41315 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:40.585124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4970e78b-1af8-493e-9315-8845c4f41315 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:40.591993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4970e78b-1af8-493e-9315-8845c4f41315 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:40.592677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4970e78b-1af8-493e-9315-8845c4f41315 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.593730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4970e78b-1af8-493e-9315-8845c4f41315 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:40.594301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4970e78b-1af8-493e-9315-8845c4f41315 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.617642 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-3db05824-9901-48b0-ba34-8d6ba884650d tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] HTTP exception thrown: Cannot 'migrate' instance 8176ddfd-5305-40e8-b380-813f108ea2c8 while it is in vm_state suspended Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3db05824-9901-48b0-ba34-8d6ba884650d tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Request method failure captured: Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8/action HTTP/1.1 Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 15 Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MzY5SOwcTXvPTjOuoRGNaXYpwBoljQCL2OLQjtjICR98yIhC4EnWHospbSJz-EEYKZt3r03LjCFBjKUda7s-OhafN_-I-lvA7W3pNP99bhqd8AZmtuB5R3ZV9bmUa72WF0lzouUzvIeyBGAhaLPZ0wfLjsQBHvYcP3TevcmFjWrZG0 Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 1ce12eec4fe846a0bbc2c759a8a89e40 Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ce12eec4fe846a0bbc2c759a8a89e40"}]}] Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 1ce12eec4fe846a0bbc2c759a8a89e40 Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersAdminNegativeTestJSON-2109781573-project-admin Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: c929532f5c60416387159335c7a67d7e Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2109781573-project-admin Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: {"migrate": {}} Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: exception: Cannot 'migrate' instance 8176ddfd-5305-40e8-b380-813f108ea2c8 while it is in vm_state suspended Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '8176ddfd-5305-40e8-b380-813f108ea2c8', 'body': {'migrate': {}}} Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8176ddfd-5305-40e8-b380-813f108ea2c8 in vm_state suspended. Cannot resize while the instance is in this state. Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:40.620543 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 8176ddfd-5305-40e8-b380-813f108ea2c8 while it is in vm_state suspended Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 8176ddfd-5305-40e8-b380-813f108ea2c8 while it is in vm_state suspended Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3db05824-9901-48b0-ba34-8d6ba884650d tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Returning 409 to user: Cannot 'migrate' instance 8176ddfd-5305-40e8-b380-813f108ea2c8 while it is in vm_state suspended {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:40.624898 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3db05824-9901-48b0-ba34-8d6ba884650d tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8/action" status: 409 len: 148 microversion: 2.1 time: 0.074749 Aug 02 07:06:40.627948 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1926/3954] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:06:40 2022] POST /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8/action => generated 148 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:06:40.633909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-cc6913d1-6ced-4eee-adb0-07684f0397aa req-746c6bfe-bc62-4801-ac0c-bb1950870f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7e42843-450e-4aab-b2eb-8ec992bfaaf3", "name": "network-vif-deleted", "tag": "b6bbcd73-d214-4d50-86ca-a5ec8f43e3a8"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:40.640337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4970e78b-1af8-493e-9315-8845c4f41315 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:40.641181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4970e78b-1af8-493e-9315-8845c4f41315 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.645453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cc6913d1-6ced-4eee-adb0-07684f0397aa req-746c6bfe-bc62-4801-ac0c-bb1950870f62 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:40.645660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-4970e78b-1af8-493e-9315-8845c4f41315 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lazy-loading 'fault' on Instance uuid b7e42843-450e-4aab-b2eb-8ec992bfaaf3 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:06:40.645990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cc6913d1-6ced-4eee-adb0-07684f0397aa req-746c6bfe-bc62-4801-ac0c-bb1950870f62 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.657954 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-cc6913d1-6ced-4eee-adb0-07684f0397aa req-746c6bfe-bc62-4801-ac0c-bb1950870f62 service nova] Creating event network-vif-deleted:b6bbcd73-d214-4d50-86ca-a5ec8f43e3a8 for instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 on n-h2-851337-3 Aug 02 07:06:40.663213 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-cc6913d1-6ced-4eee-adb0-07684f0397aa req-746c6bfe-bc62-4801-ac0c-bb1950870f62 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033969 Aug 02 07:06:40.664475 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1927/3955] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:40.674991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0acbe443-a830-487b-bd16-637b4d7fd1ec tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:40.679229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0acbe443-a830-487b-bd16-637b4d7fd1ec tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:40.686985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0acbe443-a830-487b-bd16-637b4d7fd1ec tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:40.687242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0acbe443-a830-487b-bd16-637b4d7fd1ec tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.688295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0acbe443-a830-487b-bd16-637b4d7fd1ec tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:40.688915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0acbe443-a830-487b-bd16-637b4d7fd1ec tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.701731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4970e78b-1af8-493e-9315-8845c4f41315 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ad5424586247019d4374f52600ea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4fc5f796624bbbb5fab2412ba6d092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:40.718826 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4970e78b-1af8-493e-9315-8845c4f41315 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 200 len: 1312 microversion: 2.1 time: 0.144700 Aug 02 07:06:40.720738 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2029/3956] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:40 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 1312 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:40.727650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4788d3fb-57aa-4b66-94b2-2302ce0f910f tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:40.727878 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0acbe443-a830-487b-bd16-637b4d7fd1ec tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061817 Aug 02 07:06:40.728489 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1928/3957] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:06:40 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4788d3fb-57aa-4b66-94b2-2302ce0f910f tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Request method failure captured: Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4/action HTTP/1.1 Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 39 Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MzY5SOwcTXvPTjOuoRGNaXYpwBoljQCL2OLQjtjICR98yIhC4EnWHospbSJz-EEYKZt3r03LjCFBjKUda7s-OhafN_-I-lvA7W3pNP99bhqd8AZmtuB5R3ZV9bmUa72WF0lzouUzvIeyBGAhaLPZ0wfLjsQBHvYcP3TevcmFjWrZG0 Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 1ce12eec4fe846a0bbc2c759a8a89e40 Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ce12eec4fe846a0bbc2c759a8a89e40"}]}] Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 1ce12eec4fe846a0bbc2c759a8a89e40 Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersAdminNegativeTestJSON-2109781573-project-admin Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: c929532f5c60416387159335c7a67d7e Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2109781573-project-admin Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: {"os-resetState": {"state": "invalid"}} Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '00f422e3-d249-4632-b7b3-41d1103afdd4', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'invalid' Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:06:40.732211 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:06:40.736953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 02 07:06:40.736953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.736953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:40.736953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.736953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:40.736953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:40.736953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:40.736953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:06:40.736953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:06:40.736953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 02 07:06:40.736953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.740721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4788d3fb-57aa-4b66-94b2-2302ce0f910f tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:40.741628 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4788d3fb-57aa-4b66-94b2-2302ce0f910f tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4/action" status: 400 len: 144 microversion: 2.1 time: 0.018995 Aug 02 07:06:40.746590 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2030/3958] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:06:40 2022] POST /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4/action => generated 144 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:06:40.754355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85ca11bc-7db1-4f6d-bed0-c9bd5a9607dc tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85ca11bc-7db1-4f6d-bed0-c9bd5a9607dc tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Request method failure captured: Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4/action HTTP/1.1 Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 31 Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MzY5SOwcTXvPTjOuoRGNaXYpwBoljQCL2OLQjtjICR98yIhC4EnWHospbSJz-EEYKZt3r03LjCFBjKUda7s-OhafN_-I-lvA7W3pNP99bhqd8AZmtuB5R3ZV9bmUa72WF0lzouUzvIeyBGAhaLPZ0wfLjsQBHvYcP3TevcmFjWrZG0 Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 1ce12eec4fe846a0bbc2c759a8a89e40 Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ce12eec4fe846a0bbc2c759a8a89e40"}]}] Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 1ce12eec4fe846a0bbc2c759a8a89e40 Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersAdminNegativeTestJSON-2109781573-project-admin Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: c929532f5c60416387159335c7a67d7e Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2109781573-project-admin Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: {"os-resetState": {"state": 1}} Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '00f422e3-d249-4632-b7b3-41d1103afdd4', 'body': {'os-resetState': {'state': 1}}} Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 1 Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 02 07:06:40.759783 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.764331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:40.764331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.764331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:40.764331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:40.764331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:40.764331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:06:40.764331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:06:40.764331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 02 07:06:40.764331 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.764331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85ca11bc-7db1-4f6d-bed0-c9bd5a9607dc tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:40.765361 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-85ca11bc-7db1-4f6d-bed0-c9bd5a9607dc tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4/action" status: 400 len: 120 microversion: 2.1 time: 0.016163 Aug 02 07:06:40.766006 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1929/3959] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:06:40 2022] POST /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4/action => generated 120 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:06:40.779977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-54f54adc-365a-4d8d-85d4-7cc0397217fb tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:40.783236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-54f54adc-365a-4d8d-85d4-7cc0397217fb tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Failed to fetch instance by id 999 {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 02 07:06:40.784480 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-54f54adc-365a-4d8d-85d4-7cc0397217fb tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-54f54adc-365a-4d8d-85d4-7cc0397217fb tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Request method failure captured: Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 37 Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MzY5SOwcTXvPTjOuoRGNaXYpwBoljQCL2OLQjtjICR98yIhC4EnWHospbSJz-EEYKZt3r03LjCFBjKUda7s-OhafN_-I-lvA7W3pNP99bhqd8AZmtuB5R3ZV9bmUa72WF0lzouUzvIeyBGAhaLPZ0wfLjsQBHvYcP3TevcmFjWrZG0 Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 1ce12eec4fe846a0bbc2c759a8a89e40 Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ce12eec4fe846a0bbc2c759a8a89e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ce12eec4fe846a0bbc2c759a8a89e40"}]}] Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 1ce12eec4fe846a0bbc2c759a8a89e40 Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2109781573 Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersAdminNegativeTestJSON-2109781573-project-admin Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: c929532f5c60416387159335c7a67d7e Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2109781573-project-admin Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: {"os-resetState": {"state": "error"}} Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 999 could not be found. Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:40.802145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:06:40.806525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:06:40.806525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 02 07:06:40.806525 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:40.806525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-54f54adc-365a-4d8d-85d4-7cc0397217fb tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:40.806525 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-54f54adc-365a-4d8d-85d4-7cc0397217fb tempest-ServersAdminNegativeTestJSON-2109781573 tempest-ServersAdminNegativeTestJSON-2109781573-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.031631 Aug 02 07:06:40.806525 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2031/3960] 10.222.0.79 () {60 vars in 1179 bytes} [Tue Aug 2 07:06:40 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:06:40.812713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b0adaaac-20bc-4ed1-a171-191006cb3b83 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:40.813271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b0adaaac-20bc-4ed1-a171-191006cb3b83 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:40.815979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bf26ea9a-ba56-42d7-974b-539ecda15e14 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:40.816491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bf26ea9a-ba56-42d7-974b-539ecda15e14 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:40.821016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0adaaac-20bc-4ed1-a171-191006cb3b83 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:40.821467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0adaaac-20bc-4ed1-a171-191006cb3b83 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.822449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0adaaac-20bc-4ed1-a171-191006cb3b83 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:40.823037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0adaaac-20bc-4ed1-a171-191006cb3b83 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.823336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf26ea9a-ba56-42d7-974b-539ecda15e14 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:40.823846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf26ea9a-ba56-42d7-974b-539ecda15e14 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.824788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf26ea9a-ba56-42d7-974b-539ecda15e14 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:40.825296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf26ea9a-ba56-42d7-974b-539ecda15e14 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:40.860904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b0adaaac-20bc-4ed1-a171-191006cb3b83 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:06:40.884363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bf26ea9a-ba56-42d7-974b-539ecda15e14 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:06:41.043900 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b0adaaac-20bc-4ed1-a171-191006cb3b83 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 204 len: 0 microversion: 2.1 time: 0.238740 Aug 02 07:06:41.047576 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1930/3961] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:06:40 2022] DELETE /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 07:06:41.063235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-90b59237-503b-4bae-a184-14cbb746b48e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:41.065226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-90b59237-503b-4bae-a184-14cbb746b48e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:41.078403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90b59237-503b-4bae-a184-14cbb746b48e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:41.079280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90b59237-503b-4bae-a184-14cbb746b48e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:41.080431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90b59237-503b-4bae-a184-14cbb746b48e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:41.081132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90b59237-503b-4bae-a184-14cbb746b48e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:41.092507 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bf26ea9a-ba56-42d7-974b-539ecda15e14 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 204 len: 0 microversion: 2.1 time: 0.280010 Aug 02 07:06:41.096765 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2032/3962] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:06:40 2022] DELETE /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:06:41.103516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9637b48a-294e-47b9-881b-80f05b28435c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:41.107884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9637b48a-294e-47b9-881b-80f05b28435c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:41.137809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9637b48a-294e-47b9-881b-80f05b28435c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:41.138483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9637b48a-294e-47b9-881b-80f05b28435c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:41.139310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9637b48a-294e-47b9-881b-80f05b28435c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:41.139751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9637b48a-294e-47b9-881b-80f05b28435c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:41.316163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-90b59237-503b-4bae-a184-14cbb746b48e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:41.324457 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-90b59237-503b-4bae-a184-14cbb746b48e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1682 microversion: 2.1 time: 0.271725 Aug 02 07:06:41.325293 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1931/3963] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:41 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1682 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:41.343864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9637b48a-294e-47b9-881b-80f05b28435c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:41.351444 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9637b48a-294e-47b9-881b-80f05b28435c tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1468 microversion: 2.1 time: 0.252522 Aug 02 07:06:41.352232 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2033/3964] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:41 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1468 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:41.567780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-02d176f1-b245-49b7-80e5-d18ec91b3f18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:41.568446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-02d176f1-b245-49b7-80e5-d18ec91b3f18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:41.575240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02d176f1-b245-49b7-80e5-d18ec91b3f18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:41.575699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02d176f1-b245-49b7-80e5-d18ec91b3f18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:41.576484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02d176f1-b245-49b7-80e5-d18ec91b3f18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:41.576932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02d176f1-b245-49b7-80e5-d18ec91b3f18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:41.592699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2a6bb725-248e-4f85-acf9-85e77d299e09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:41.594122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2a6bb725-248e-4f85-acf9-85e77d299e09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:41.601519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a6bb725-248e-4f85-acf9-85e77d299e09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:41.602072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a6bb725-248e-4f85-acf9-85e77d299e09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:41.602911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a6bb725-248e-4f85-acf9-85e77d299e09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:41.603758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a6bb725-248e-4f85-acf9-85e77d299e09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:41.799794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-02d176f1-b245-49b7-80e5-d18ec91b3f18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:41.808623 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-02d176f1-b245-49b7-80e5-d18ec91b3f18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.244796 Aug 02 07:06:41.809225 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1932/3965] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:41 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:41.814704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-46bd9ae1-cc0c-4cd8-8432-bc4b5d848241 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:41.814857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2a6bb725-248e-4f85-acf9-85e77d299e09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:41.815636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-46bd9ae1-cc0c-4cd8-8432-bc4b5d848241 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] [instance: b7e42843-450e-4aab-b2eb-8ec992bfaaf3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:41.822726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46bd9ae1-cc0c-4cd8-8432-bc4b5d848241 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:41.823116 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2a6bb725-248e-4f85-acf9-85e77d299e09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1392 microversion: 2.1 time: 0.234480 Aug 02 07:06:41.823270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46bd9ae1-cc0c-4cd8-8432-bc4b5d848241 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:41.823704 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2034/3966] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:41 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1392 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:41.823943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46bd9ae1-cc0c-4cd8-8432-bc4b5d848241 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:41.824581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46bd9ae1-cc0c-4cd8-8432-bc4b5d848241 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:41.841985 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-46bd9ae1-cc0c-4cd8-8432-bc4b5d848241 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] HTTP exception thrown: Instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 could not be found. Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-46bd9ae1-cc0c-4cd8-8432-bc4b5d848241 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Request method failure captured: Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 HTTP/1.1 Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MuV9Q5BOG4bZSTn8mNA1jfjLBve4d8RpXHrEXh4dSRfQwoHnO2CX5TWJr_Ybphxlmnei--H-24HQZ2VBGVtXb7ed4xsT9rh6T-B0ctcoWXMM-9zRQgu-z2imnNm8CiRJJUKFATn8QRgKDRSh1174_Xj_fjEsdTPEI1eutLUtYEoOkA Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7e4fc5f796624bbbb5fab2412ba6d092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7e4fc5f796624bbbb5fab2412ba6d092"}]}] Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 7e4fc5f796624bbbb5fab2412ba6d092 Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2129679551 Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b9ad5424586247019d4374f52600ea51 Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2129679551-project Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 could not be found. Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'b7e42843-450e-4aab-b2eb-8ec992bfaaf3'} Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 could not be found. Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 could not be found. Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:41.843952 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:41.847737 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:41.847737 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:41.847737 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:41.847737 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:41.847737 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:06:41.847737 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:06:41.847737 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 could not be found. Aug 02 07:06:41.847737 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:41.847737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-46bd9ae1-cc0c-4cd8-8432-bc4b5d848241 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] Returning 404 to user: Instance b7e42843-450e-4aab-b2eb-8ec992bfaaf3 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:41.847737 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-46bd9ae1-cc0c-4cd8-8432-bc4b5d848241 tempest-ServerRescueNegativeTestJSON-2129679551 tempest-ServerRescueNegativeTestJSON-2129679551-project] 10.222.0.79 "GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3" status: 404 len: 111 microversion: 2.1 time: 0.035183 Aug 02 07:06:41.847737 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1933/3967] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:41 2022] GET /compute/v2.1/servers/b7e42843-450e-4aab-b2eb-8ec992bfaaf3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:06:42.350851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-beca0662-1fa0-47f7-a0d7-90410f683d40 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:42.352368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-beca0662-1fa0-47f7-a0d7-90410f683d40 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:42.368986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-beca0662-1fa0-47f7-a0d7-90410f683d40 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:42.369778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-beca0662-1fa0-47f7-a0d7-90410f683d40 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:42.372371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-beca0662-1fa0-47f7-a0d7-90410f683d40 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:42.373088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-76dd80dc-6eb3-4ffe-a609-e3ab11818717 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:42.373698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-76dd80dc-6eb3-4ffe-a609-e3ab11818717 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:42.374653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-beca0662-1fa0-47f7-a0d7-90410f683d40 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:42.387093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76dd80dc-6eb3-4ffe-a609-e3ab11818717 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:42.388008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76dd80dc-6eb3-4ffe-a609-e3ab11818717 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:42.389086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76dd80dc-6eb3-4ffe-a609-e3ab11818717 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:42.402705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76dd80dc-6eb3-4ffe-a609-e3ab11818717 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:42.709438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-76dd80dc-6eb3-4ffe-a609-e3ab11818717 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:42.717842 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-76dd80dc-6eb3-4ffe-a609-e3ab11818717 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1468 microversion: 2.1 time: 0.348643 Aug 02 07:06:42.731859 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1934/3968] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:42 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1468 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:42.737194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b1a776b8-bae0-4044-abf7-41f5365271d9 req-1b54427a-502c-494b-a380-0a8463d39bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d93db40-84f5-4c63-825f-6ee647fa2331", "name": "network-vif-plugged", "status": "completed", "tag": "38895fc4-ade3-4226-bdfd-d68b06745975"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:42.748979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b1a776b8-bae0-4044-abf7-41f5365271d9 req-1b54427a-502c-494b-a380-0a8463d39bed service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:42.749667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b1a776b8-bae0-4044-abf7-41f5365271d9 req-1b54427a-502c-494b-a380-0a8463d39bed service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:42.766097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-beca0662-1fa0-47f7-a0d7-90410f683d40 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:42.777297 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b1a776b8-bae0-4044-abf7-41f5365271d9 req-1b54427a-502c-494b-a380-0a8463d39bed service nova] Creating event network-vif-plugged:38895fc4-ade3-4226-bdfd-d68b06745975 for instance 4d93db40-84f5-4c63-825f-6ee647fa2331 on n-h1-851337-3 Aug 02 07:06:42.779126 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-beca0662-1fa0-47f7-a0d7-90410f683d40 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1682 microversion: 2.1 time: 0.436546 Aug 02 07:06:42.794327 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2035/3969] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:42 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1682 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:42.798829 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b1a776b8-bae0-4044-abf7-41f5365271d9 req-1b54427a-502c-494b-a380-0a8463d39bed service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065327 Aug 02 07:06:42.799728 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1935/3970] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:42.832008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3d6d0d5a-04de-405a-a7eb-8aadcf712605 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:42.832545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3d6d0d5a-04de-405a-a7eb-8aadcf712605 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:42.845097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d6d0d5a-04de-405a-a7eb-8aadcf712605 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:42.849469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d6d0d5a-04de-405a-a7eb-8aadcf712605 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:42.851857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d6d0d5a-04de-405a-a7eb-8aadcf712605 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:42.854915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d6d0d5a-04de-405a-a7eb-8aadcf712605 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:42.860718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0b8a51e3-a2ec-4e87-aa0c-781505d36823 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:42.861459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0b8a51e3-a2ec-4e87-aa0c-781505d36823 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:42.869520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:42.885511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b8a51e3-a2ec-4e87-aa0c-781505d36823 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:42.887520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b8a51e3-a2ec-4e87-aa0c-781505d36823 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:42.889825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b8a51e3-a2ec-4e87-aa0c-781505d36823 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:42.890530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0b8a51e3-a2ec-4e87-aa0c-781505d36823 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:43.300632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3d6d0d5a-04de-405a-a7eb-8aadcf712605 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:43.308604 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3d6d0d5a-04de-405a-a7eb-8aadcf712605 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1687 microversion: 2.1 time: 0.480975 Aug 02 07:06:43.323122 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2036/3971] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:42 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1687 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:43.353249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0b8a51e3-a2ec-4e87-aa0c-781505d36823 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:43.367346 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0b8a51e3-a2ec-4e87-aa0c-781505d36823 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1392 microversion: 2.1 time: 0.514383 Aug 02 07:06:43.368988 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1936/3972] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:42 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1392 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:43.622473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ac05c654-f809-445e-898d-ed6ffeff8cdf req-1b954d78-e687-4509-b0b3-6682a2f7f5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8176ddfd-5305-40e8-b380-813f108ea2c8", "name": "network-vif-deleted", "tag": "2077edfc-89e5-4646-9a96-104ff255378f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:43.682527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ac05c654-f809-445e-898d-ed6ffeff8cdf req-1b954d78-e687-4509-b0b3-6682a2f7f5ff service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:43.683357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ac05c654-f809-445e-898d-ed6ffeff8cdf req-1b954d78-e687-4509-b0b3-6682a2f7f5ff service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:43.712199 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ac05c654-f809-445e-898d-ed6ffeff8cdf req-1b954d78-e687-4509-b0b3-6682a2f7f5ff service nova] Creating event network-vif-deleted:2077edfc-89e5-4646-9a96-104ff255378f for instance 8176ddfd-5305-40e8-b380-813f108ea2c8 on n-h2-851337-3 Aug 02 07:06:43.724213 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ac05c654-f809-445e-898d-ed6ffeff8cdf req-1b954d78-e687-4509-b0b3-6682a2f7f5ff service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105701 Aug 02 07:06:43.728937 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2037/3973] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:06:43.743857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-97f4953f-3ac5-445b-9da8-661ebc99ad91 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:43.744821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-97f4953f-3ac5-445b-9da8-661ebc99ad91 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:43.756235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97f4953f-3ac5-445b-9da8-661ebc99ad91 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:43.756696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97f4953f-3ac5-445b-9da8-661ebc99ad91 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:43.768686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97f4953f-3ac5-445b-9da8-661ebc99ad91 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:43.769597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97f4953f-3ac5-445b-9da8-661ebc99ad91 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:43.805578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d17495d6-6c20-4164-8137-ff9e909a5c59 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:43.807090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d17495d6-6c20-4164-8137-ff9e909a5c59 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:43.832603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97f4953f-3ac5-445b-9da8-661ebc99ad91 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:43.833267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97f4953f-3ac5-445b-9da8-661ebc99ad91 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:43.833921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-97f4953f-3ac5-445b-9da8-661ebc99ad91 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lazy-loading 'fault' on Instance uuid 8176ddfd-5305-40e8-b380-813f108ea2c8 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:06:43.858529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d17495d6-6c20-4164-8137-ff9e909a5c59 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:43.859116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d17495d6-6c20-4164-8137-ff9e909a5c59 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:43.860273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d17495d6-6c20-4164-8137-ff9e909a5c59 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:43.861187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d17495d6-6c20-4164-8137-ff9e909a5c59 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:43.908532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-97f4953f-3ac5-445b-9da8-661ebc99ad91 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:43.925977 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-97f4953f-3ac5-445b-9da8-661ebc99ad91 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 200 len: 1311 microversion: 2.1 time: 0.189744 Aug 02 07:06:43.927158 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1937/3974] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:43 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:44.086263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d17495d6-6c20-4164-8137-ff9e909a5c59 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:44.103324 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d17495d6-6c20-4164-8137-ff9e909a5c59 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1682 microversion: 2.1 time: 0.302794 Aug 02 07:06:44.104337 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2038/3975] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:43 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1682 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:44.335921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7ea8963c-8a71-4763-9b4b-8a7d1f002f4a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:44.336886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7ea8963c-8a71-4763-9b4b-8a7d1f002f4a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:44.345296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ea8963c-8a71-4763-9b4b-8a7d1f002f4a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:44.346074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ea8963c-8a71-4763-9b4b-8a7d1f002f4a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:44.347687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ea8963c-8a71-4763-9b4b-8a7d1f002f4a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:44.348294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ea8963c-8a71-4763-9b4b-8a7d1f002f4a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:44.390553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2701138a-c552-4eb7-ab79-26cb24313784 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:44.391548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2701138a-c552-4eb7-ab79-26cb24313784 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:44.398802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2701138a-c552-4eb7-ab79-26cb24313784 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:44.399498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2701138a-c552-4eb7-ab79-26cb24313784 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:44.400458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2701138a-c552-4eb7-ab79-26cb24313784 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:44.401038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2701138a-c552-4eb7-ab79-26cb24313784 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:44.731795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2701138a-c552-4eb7-ab79-26cb24313784 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:44.739851 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2701138a-c552-4eb7-ab79-26cb24313784 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1392 microversion: 2.1 time: 0.353658 Aug 02 07:06:44.744457 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2039/3976] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:44 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1392 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:44.749010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7ea8963c-8a71-4763-9b4b-8a7d1f002f4a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:44.759086 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7ea8963c-8a71-4763-9b4b-8a7d1f002f4a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1687 microversion: 2.1 time: 0.430265 Aug 02 07:06:44.764887 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1938/3977] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:44 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1687 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:44.952951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6c96e58-b4db-4357-bbbe-e65b41d59f5e tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:44.953629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d6c96e58-b4db-4357-bbbe-e65b41d59f5e tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 8176ddfd-5305-40e8-b380-813f108ea2c8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:44.960256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6c96e58-b4db-4357-bbbe-e65b41d59f5e tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:44.960687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6c96e58-b4db-4357-bbbe-e65b41d59f5e tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:44.967523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6c96e58-b4db-4357-bbbe-e65b41d59f5e tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:44.968382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6c96e58-b4db-4357-bbbe-e65b41d59f5e tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:44.975265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:44.991572 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-d6c96e58-b4db-4357-bbbe-e65b41d59f5e tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] HTTP exception thrown: Instance 8176ddfd-5305-40e8-b380-813f108ea2c8 could not be found. Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6c96e58-b4db-4357-bbbe-e65b41d59f5e tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Request method failure captured: Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 HTTP/1.1 Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MzXK5CLKtMCcKmiikzrANGYjikixm0boImJoMrRcznvM8s4Of9XIvYUwGMUlhyc8drXM7e_qDH4Bdd2IZhRpbKKWzwVoJ38d1cCLrfD0y30vQYzODIMxUg9B0uDGQuRuW7qF7EYABg4J6f6KLQ25DnVcRLINuGaHY5QiWY9ZVNgmpc Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: cd45b68f976c48529178d2a460431bd8 Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1739099294 Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cd45b68f976c48529178d2a460431bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd45b68f976c48529178d2a460431bd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cd45b68f976c48529178d2a460431bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd45b68f976c48529178d2a460431bd8"}]}] Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1739099294 Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: cd45b68f976c48529178d2a460431bd8 Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1739099294 Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersAdminNegativeTestJSON-1739099294-project Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 86c7e73f30424b5583e42aba5144e5ff Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1739099294-project Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 8176ddfd-5305-40e8-b380-813f108ea2c8 could not be found. Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '8176ddfd-5305-40e8-b380-813f108ea2c8'} Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8176ddfd-5305-40e8-b380-813f108ea2c8 could not be found. Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8176ddfd-5305-40e8-b380-813f108ea2c8 could not be found. Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:44.995009 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:44.999478 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:44.999478 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:44.999478 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:44.999478 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:44.999478 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:06:44.999478 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:06:44.999478 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8176ddfd-5305-40e8-b380-813f108ea2c8 could not be found. Aug 02 07:06:44.999478 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:45.002910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6c96e58-b4db-4357-bbbe-e65b41d59f5e tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Returning 404 to user: Instance 8176ddfd-5305-40e8-b380-813f108ea2c8 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:45.004219 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d6c96e58-b4db-4357-bbbe-e65b41d59f5e tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8" status: 404 len: 111 microversion: 2.1 time: 0.056257 Aug 02 07:06:45.008772 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2040/3978] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:44 2022] GET /compute/v2.1/servers/8176ddfd-5305-40e8-b380-813f108ea2c8 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:06:45.014129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-af607d11-657a-430e-b5ab-09179354e073 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:45.014641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-af607d11-657a-430e-b5ab-09179354e073 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:45.028959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af607d11-657a-430e-b5ab-09179354e073 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:45.030499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af607d11-657a-430e-b5ab-09179354e073 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:45.033649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af607d11-657a-430e-b5ab-09179354e073 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:45.035533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af607d11-657a-430e-b5ab-09179354e073 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:45.074418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:45.084776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-af607d11-657a-430e-b5ab-09179354e073 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:06:45.127912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c5012671-93c5-485a-a1ed-1a6f9abc7b77 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:45.128653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c5012671-93c5-485a-a1ed-1a6f9abc7b77 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:45.142266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5012671-93c5-485a-a1ed-1a6f9abc7b77 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:45.144811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5012671-93c5-485a-a1ed-1a6f9abc7b77 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:45.149163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5012671-93c5-485a-a1ed-1a6f9abc7b77 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:45.149910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5012671-93c5-485a-a1ed-1a6f9abc7b77 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:45.247967 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-af607d11-657a-430e-b5ab-09179354e073 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "DELETE /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 204 len: 0 microversion: 2.1 time: 0.237468 Aug 02 07:06:45.252875 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1939/3979] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:06:45 2022] DELETE /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:06:45.264803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b4e9c187-a6f3-41a5-a848-ff152c686451 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:45.265588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b4e9c187-a6f3-41a5-a848-ff152c686451 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:45.283130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4e9c187-a6f3-41a5-a848-ff152c686451 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:45.285735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4e9c187-a6f3-41a5-a848-ff152c686451 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:45.285735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4e9c187-a6f3-41a5-a848-ff152c686451 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:45.285735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b4e9c187-a6f3-41a5-a848-ff152c686451 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:45.646110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c5012671-93c5-485a-a1ed-1a6f9abc7b77 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:45.657402 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c5012671-93c5-485a-a1ed-1a6f9abc7b77 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 200 len: 1682 microversion: 2.1 time: 0.535841 Aug 02 07:06:45.658843 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2041/3980] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:45 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 1682 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:45.688026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b4e9c187-a6f3-41a5-a848-ff152c686451 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:45.698367 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b4e9c187-a6f3-41a5-a848-ff152c686451 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 200 len: 1478 microversion: 2.1 time: 0.440282 Aug 02 07:06:45.699172 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1940/3981] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:45 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 1478 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:45.765317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-987663e1-f31c-434e-b97a-e4d6b083e37e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:45.767350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-987663e1-f31c-434e-b97a-e4d6b083e37e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:45.776246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-987663e1-f31c-434e-b97a-e4d6b083e37e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:45.776695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-987663e1-f31c-434e-b97a-e4d6b083e37e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:45.778108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-987663e1-f31c-434e-b97a-e4d6b083e37e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:45.778776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-987663e1-f31c-434e-b97a-e4d6b083e37e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:45.786347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cbc646ce-a17f-4940-978d-c472d0eb9f85 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:45.787536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cbc646ce-a17f-4940-978d-c472d0eb9f85 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:45.796917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbc646ce-a17f-4940-978d-c472d0eb9f85 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:45.800965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbc646ce-a17f-4940-978d-c472d0eb9f85 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:45.803745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbc646ce-a17f-4940-978d-c472d0eb9f85 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:45.804672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbc646ce-a17f-4940-978d-c472d0eb9f85 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:46.296382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cbc646ce-a17f-4940-978d-c472d0eb9f85 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:46.305738 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cbc646ce-a17f-4940-978d-c472d0eb9f85 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1687 microversion: 2.1 time: 0.524834 Aug 02 07:06:46.322206 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1941/3982] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:45 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1687 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:46.333613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-5fcaca98-1e67-4369-bd15-5b4e4c14f013 req-f5d2c38c-1fc8-4e31-a188-6bb908138e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce30096-300b-4242-b360-ff6617fd5173", "name": "network-vif-deleted", "tag": "7760230b-6b27-445e-86d1-9b56e50e0517"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:46.355115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5fcaca98-1e67-4369-bd15-5b4e4c14f013 req-f5d2c38c-1fc8-4e31-a188-6bb908138e34 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:46.358014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5fcaca98-1e67-4369-bd15-5b4e4c14f013 req-f5d2c38c-1fc8-4e31-a188-6bb908138e34 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:46.398786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-987663e1-f31c-434e-b97a-e4d6b083e37e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:46.443756 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-5fcaca98-1e67-4369-bd15-5b4e4c14f013 req-f5d2c38c-1fc8-4e31-a188-6bb908138e34 service nova] Creating event network-vif-deleted:7760230b-6b27-445e-86d1-9b56e50e0517 for instance fce30096-300b-4242-b360-ff6617fd5173 on n-h1-851337-3 Aug 02 07:06:46.450763 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-987663e1-f31c-434e-b97a-e4d6b083e37e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1564 microversion: 2.1 time: 0.660975 Aug 02 07:06:46.451532 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2042/3983] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:45 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1564 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:46.473869 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-5fcaca98-1e67-4369-bd15-5b4e4c14f013 req-f5d2c38c-1fc8-4e31-a188-6bb908138e34 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149441 Aug 02 07:06:46.478129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8bc79bd8-59db-498f-95ee-a31f1cf50a3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:46.478764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8bc79bd8-59db-498f-95ee-a31f1cf50a3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:46.480902 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1942/3984] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:46.488528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:06:46.490852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bc79bd8-59db-498f-95ee-a31f1cf50a3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:46.491352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bc79bd8-59db-498f-95ee-a31f1cf50a3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:46.492205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bc79bd8-59db-498f-95ee-a31f1cf50a3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:46.492738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bc79bd8-59db-498f-95ee-a31f1cf50a3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:46.688712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-88b165c7-f74b-48b0-92e2-a0437683c29c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:46.689973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-88b165c7-f74b-48b0-92e2-a0437683c29c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:46.696998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88b165c7-f74b-48b0-92e2-a0437683c29c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:46.697683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88b165c7-f74b-48b0-92e2-a0437683c29c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:46.698934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88b165c7-f74b-48b0-92e2-a0437683c29c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:46.700113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88b165c7-f74b-48b0-92e2-a0437683c29c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:46.741822 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-88b165c7-f74b-48b0-92e2-a0437683c29c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] HTTP exception thrown: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-88b165c7-f74b-48b0-92e2-a0437683c29c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Request method failure captured: Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 HTTP/1.1 Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mw13SPusoL2oig6z8JKTC1nUbf8Rw_5jT5YPT1CWrOABe8wYL59aYsXiUDtU2vA3es6LryNsakcXkaddV2SmWSmf9b0Kir8iKyeHQ1V913RDI7OxthQkB34rsjOk5zDf7k87yoaJrxDD4eFsnTmbVoTrOLyxwi8jQau6VljX5rXYUE Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ee1befa077542b9a17865baad3c9999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}] Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 3a2629fa08b5419a96c2942118d38dad Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'fce30096-300b-4242-b360-ff6617fd5173'} Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:46.743864 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:46.748183 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:46.748183 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:46.748183 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:46.748183 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:06:46.748183 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:06:46.748183 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:06:46.748183 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:06:46.749658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-88b165c7-f74b-48b0-92e2-a0437683c29c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Returning 404 to user: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:46.750772 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-88b165c7-f74b-48b0-92e2-a0437683c29c tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 404 len: 111 microversion: 2.1 time: 0.071083 Aug 02 07:06:46.756004 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1943/3985] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:46 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:06:46.762481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7ee4de5b-4a78-4ff5-a8fa-02768d68e8f6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:46.763507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7ee4de5b-4a78-4ff5-a8fa-02768d68e8f6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:46.770516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ee4de5b-4a78-4ff5-a8fa-02768d68e8f6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:46.771269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ee4de5b-4a78-4ff5-a8fa-02768d68e8f6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:46.772547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ee4de5b-4a78-4ff5-a8fa-02768d68e8f6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:46.773215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ee4de5b-4a78-4ff5-a8fa-02768d68e8f6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:47.018048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8bc79bd8-59db-498f-95ee-a31f1cf50a3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:47.028604 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8bc79bd8-59db-498f-95ee-a31f1cf50a3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1564 microversion: 2.1 time: 0.559112 Aug 02 07:06:47.031394 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2043/3986] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:46 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1564 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:47.041512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-239dedf8-093d-4f86-ba2d-894096c45550 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '.version_select at 0x7f927a1e75e0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:47.084716 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-239dedf8-093d-4f86-ba2d-894096c45550 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-316378317" status: 202 len: 0 microversion: 2.1 time: 0.045486 Aug 02 07:06:47.087015 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2044/3987] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Aug 2 07:06:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-316378317 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:06:47.174479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-cb6ca09f-ee71-4c31-9de0-d885ce589a46 req-426a94b2-ba7d-4b1b-9770-0857a6dc41d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ccfed8-393e-4223-b2a8-7dbf8c77d3fe", "name": "network-vif-plugged", "status": "completed", "tag": "96c2e36a-4761-4b9b-b02e-96b42f53d06e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:47.190455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-cb6ca09f-ee71-4c31-9de0-d885ce589a46 req-426a94b2-ba7d-4b1b-9770-0857a6dc41d4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:47.191110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-cb6ca09f-ee71-4c31-9de0-d885ce589a46 req-426a94b2-ba7d-4b1b-9770-0857a6dc41d4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:47.205105 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-cb6ca09f-ee71-4c31-9de0-d885ce589a46 req-426a94b2-ba7d-4b1b-9770-0857a6dc41d4 service nova] Creating event network-vif-plugged:96c2e36a-4761-4b9b-b02e-96b42f53d06e for instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe on n-h1-851337-3 Aug 02 07:06:47.210940 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-cb6ca09f-ee71-4c31-9de0-d885ce589a46 req-426a94b2-ba7d-4b1b-9770-0857a6dc41d4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041741 Aug 02 07:06:47.212396 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2045/3988] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:47.273093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7ee4de5b-4a78-4ff5-a8fa-02768d68e8f6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:47.285139 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7ee4de5b-4a78-4ff5-a8fa-02768d68e8f6 tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 200 len: 1478 microversion: 2.1 time: 0.527629 Aug 02 07:06:47.285740 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1944/3989] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:46 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 1478 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:47.343275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1475fe32-b059-4f36-b107-ea5580664d0c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:47.344255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1475fe32-b059-4f36-b107-ea5580664d0c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:47.374319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1475fe32-b059-4f36-b107-ea5580664d0c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:47.375453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1475fe32-b059-4f36-b107-ea5580664d0c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:47.376561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1475fe32-b059-4f36-b107-ea5580664d0c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:47.377148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1475fe32-b059-4f36-b107-ea5580664d0c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:47.642386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-11c0921d-ec7e-4de3-9de4-d14227d2a640 req-d1560a11-66e3-41c5-9b3b-20d84446b144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f422e3-d249-4632-b7b3-41d1103afdd4", "name": "network-vif-deleted", "tag": "d62a0fcc-b8ed-4cb7-a55f-2ec0c08bdca4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:47.669969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-11c0921d-ec7e-4de3-9de4-d14227d2a640 req-d1560a11-66e3-41c5-9b3b-20d84446b144 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:47.671270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-11c0921d-ec7e-4de3-9de4-d14227d2a640 req-d1560a11-66e3-41c5-9b3b-20d84446b144 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:47.699843 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-11c0921d-ec7e-4de3-9de4-d14227d2a640 req-d1560a11-66e3-41c5-9b3b-20d84446b144 service nova] Creating event network-vif-deleted:d62a0fcc-b8ed-4cb7-a55f-2ec0c08bdca4 for instance 00f422e3-d249-4632-b7b3-41d1103afdd4 on n-h2-851337-3 Aug 02 07:06:47.720988 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-11c0921d-ec7e-4de3-9de4-d14227d2a640 req-d1560a11-66e3-41c5-9b3b-20d84446b144 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082424 Aug 02 07:06:47.726987 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1945/3990] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:47.764639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1475fe32-b059-4f36-b107-ea5580664d0c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:47.776130 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1475fe32-b059-4f36-b107-ea5580664d0c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1687 microversion: 2.1 time: 0.439271 Aug 02 07:06:47.777764 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2046/3991] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:47 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1687 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:48.312869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1188da89-f37c-4b0a-acd8-85d30b58ee8a tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:48.315456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1188da89-f37c-4b0a-acd8-85d30b58ee8a tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:48.329808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1188da89-f37c-4b0a-acd8-85d30b58ee8a tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:48.330297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1188da89-f37c-4b0a-acd8-85d30b58ee8a tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:48.333488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1188da89-f37c-4b0a-acd8-85d30b58ee8a tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:48.335459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1188da89-f37c-4b0a-acd8-85d30b58ee8a tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:48.397997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1188da89-f37c-4b0a-acd8-85d30b58ee8a tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:48.398392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1188da89-f37c-4b0a-acd8-85d30b58ee8a tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:48.399404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-1188da89-f37c-4b0a-acd8-85d30b58ee8a tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lazy-loading 'fault' on Instance uuid 00f422e3-d249-4632-b7b3-41d1103afdd4 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:06:48.472445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1188da89-f37c-4b0a-acd8-85d30b58ee8a tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c7e73f30424b5583e42aba5144e5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd45b68f976c48529178d2a460431bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:48.480172 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1188da89-f37c-4b0a-acd8-85d30b58ee8a tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 200 len: 1312 microversion: 2.1 time: 0.173070 Aug 02 07:06:48.480791 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1946/3992] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:48 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 1312 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:48.608921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4d1c3190-2035-422d-a815-8bcc499b3bda tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Action: 'create', calling method: .version_select at 0x7f927a27b5e0>, body: {"keypair": {"name": "tempest-keypair-1476571847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOkN5x1vi9Soi5rXUKVfu/5UgyOscc4mZJ9q8I+YdnkaiglJmVLmbJinAycXPLAzxu71lTZYjk/bauOp3dvQzhBRBBck43urH3jgtpIPY7rqyuv7iq2rOEGaHwe5fRD0A=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:48.649613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-4d1c3190-2035-422d-a815-8bcc499b3bda tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for project 6ee1befa077542b9a17865baad3c9999. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:06:48.660779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-4d1c3190-2035-422d-a815-8bcc499b3bda tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for user 3a2629fa08b5419a96c2942118d38dad and project 6ee1befa077542b9a17865baad3c9999. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:06:48.700024 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4d1c3190-2035-422d-a815-8bcc499b3bda tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096305 Aug 02 07:06:48.702591 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2047/3993] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:06:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:06:48.799964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3c643e2a-9dd5-4237-996c-df3f24e5d038 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:48.800689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3c643e2a-9dd5-4237-996c-df3f24e5d038 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:48.826137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3c643e2a-9dd5-4237-996c-df3f24e5d038 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:48.828117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3c643e2a-9dd5-4237-996c-df3f24e5d038 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:48.829206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3c643e2a-9dd5-4237-996c-df3f24e5d038 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:48.829758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3c643e2a-9dd5-4237-996c-df3f24e5d038 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:49.057250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3c643e2a-9dd5-4237-996c-df3f24e5d038 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:49.066579 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3c643e2a-9dd5-4237-996c-df3f24e5d038 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1687 microversion: 2.1 time: 0.270730 Aug 02 07:06:49.086291 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1947/3994] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:48 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1687 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:49.509361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2324fe4d-99f6-4a2d-9ad6-dfaaf8583aba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:49.510503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2324fe4d-99f6-4a2d-9ad6-dfaaf8583aba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] [instance: 00f422e3-d249-4632-b7b3-41d1103afdd4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:49.519407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2324fe4d-99f6-4a2d-9ad6-dfaaf8583aba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:49.520126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2324fe4d-99f6-4a2d-9ad6-dfaaf8583aba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:49.521110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2324fe4d-99f6-4a2d-9ad6-dfaaf8583aba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:49.521780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2324fe4d-99f6-4a2d-9ad6-dfaaf8583aba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:49.548717 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-2324fe4d-99f6-4a2d-9ad6-dfaaf8583aba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] HTTP exception thrown: Instance 00f422e3-d249-4632-b7b3-41d1103afdd4 could not be found. Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2324fe4d-99f6-4a2d-9ad6-dfaaf8583aba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Request method failure captured: Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 HTTP/1.1 Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MzXK5CLKtMCcKmiikzrANGYjikixm0boImJoMrRcznvM8s4Of9XIvYUwGMUlhyc8drXM7e_qDH4Bdd2IZhRpbKKWzwVoJ38d1cCLrfD0y30vQYzODIMxUg9B0uDGQuRuW7qF7EYABg4J6f6KLQ25DnVcRLINuGaHY5QiWY9ZVNgmpc Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: cd45b68f976c48529178d2a460431bd8 Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1739099294 Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cd45b68f976c48529178d2a460431bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd45b68f976c48529178d2a460431bd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cd45b68f976c48529178d2a460431bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd45b68f976c48529178d2a460431bd8"}]}] Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1739099294 Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: cd45b68f976c48529178d2a460431bd8 Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1739099294 Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersAdminNegativeTestJSON-1739099294-project Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 86c7e73f30424b5583e42aba5144e5ff Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1739099294-project Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 00f422e3-d249-4632-b7b3-41d1103afdd4 could not be found. Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '00f422e3-d249-4632-b7b3-41d1103afdd4'} Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f422e3-d249-4632-b7b3-41d1103afdd4 could not be found. Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f422e3-d249-4632-b7b3-41d1103afdd4 could not be found. Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:49.551088 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:06:49.554779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:49.554779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:06:49.554779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:06:49.554779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:06:49.554779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:06:49.554779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:06:49.554779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f422e3-d249-4632-b7b3-41d1103afdd4 could not be found. Aug 02 07:06:49.554779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:06:49.557487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2324fe4d-99f6-4a2d-9ad6-dfaaf8583aba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] Returning 404 to user: Instance 00f422e3-d249-4632-b7b3-41d1103afdd4 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:06:49.558754 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2324fe4d-99f6-4a2d-9ad6-dfaaf8583aba tempest-ServersAdminNegativeTestJSON-1739099294 tempest-ServersAdminNegativeTestJSON-1739099294-project] 10.222.0.79 "GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4" status: 404 len: 111 microversion: 2.1 time: 0.060166 Aug 02 07:06:49.559862 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2048/3995] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:49 2022] GET /compute/v2.1/servers/00f422e3-d249-4632-b7b3-41d1103afdd4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:06:50.094410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-893c98d2-b201-45aa-ae85-f1bf78beaf05 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:50.095537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-893c98d2-b201-45aa-ae85-f1bf78beaf05 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:50.112258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-893c98d2-b201-45aa-ae85-f1bf78beaf05 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:50.113004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-893c98d2-b201-45aa-ae85-f1bf78beaf05 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:50.114195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-893c98d2-b201-45aa-ae85-f1bf78beaf05 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:50.114860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-893c98d2-b201-45aa-ae85-f1bf78beaf05 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:50.912759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-893c98d2-b201-45aa-ae85-f1bf78beaf05 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:50.926877 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-893c98d2-b201-45aa-ae85-f1bf78beaf05 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 0.837858 Aug 02 07:06:50.927495 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1948/3996] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:50 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:51.628274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0e1ef1b9-2488-4254-b709-3bccfdbc1253 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:51.628909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0e1ef1b9-2488-4254-b709-3bccfdbc1253 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:51.649765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e1ef1b9-2488-4254-b709-3bccfdbc1253 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:51.651720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e1ef1b9-2488-4254-b709-3bccfdbc1253 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:51.654052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e1ef1b9-2488-4254-b709-3bccfdbc1253 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:51.657054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e1ef1b9-2488-4254-b709-3bccfdbc1253 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:51.658066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-4cd5f104-f342-48c0-882d-1465a9eb8e8a req-b2c8a468-7d19-479f-943a-41f25ddd5361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d93db40-84f5-4c63-825f-6ee647fa2331", "tag": "38895fc4-ade3-4226-bdfd-d68b06745975"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:51.685419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-4cd5f104-f342-48c0-882d-1465a9eb8e8a req-b2c8a468-7d19-479f-943a-41f25ddd5361 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:51.685976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-4cd5f104-f342-48c0-882d-1465a9eb8e8a req-b2c8a468-7d19-479f-943a-41f25ddd5361 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:51.722606 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-4cd5f104-f342-48c0-882d-1465a9eb8e8a req-b2c8a468-7d19-479f-943a-41f25ddd5361 service nova] Creating event network-changed:38895fc4-ade3-4226-bdfd-d68b06745975 for instance 4d93db40-84f5-4c63-825f-6ee647fa2331 on n-h1-851337-3 Aug 02 07:06:51.733177 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-4cd5f104-f342-48c0-882d-1465a9eb8e8a req-b2c8a468-7d19-479f-943a-41f25ddd5361 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084433 Aug 02 07:06:51.734198 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1949/3997] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:06:51.951017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e33e0fdc-5785-49b5-ad48-ea750b5bdd20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:51.952353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e33e0fdc-5785-49b5-ad48-ea750b5bdd20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:51.987653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e33e0fdc-5785-49b5-ad48-ea750b5bdd20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:51.988133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e33e0fdc-5785-49b5-ad48-ea750b5bdd20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:51.988992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e33e0fdc-5785-49b5-ad48-ea750b5bdd20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:51.989439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e33e0fdc-5785-49b5-ad48-ea750b5bdd20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:52.656633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0e1ef1b9-2488-4254-b709-3bccfdbc1253 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:52.680265 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0e1ef1b9-2488-4254-b709-3bccfdbc1253 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1564 microversion: 2.1 time: 1.052590 Aug 02 07:06:52.693924 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2049/3998] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:51 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1564 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:52.775096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e33e0fdc-5785-49b5-ad48-ea750b5bdd20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:52.788018 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e33e0fdc-5785-49b5-ad48-ea750b5bdd20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 0.842496 Aug 02 07:06:52.790196 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1950/3999] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:51 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:52.897604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1649937097", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a30dbbf-9ed5-4371-af86-d34ddcdf6f20"}], "security_groups": [{"name": "tempest-securitygroup--2005872281"}], "key_name": "tempest-keypair-1476571847", "user_data": "}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:53.627209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] validate_networks() for [('9a30dbbf-9ed5-4371-af86-d34ddcdf6f20', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:06:53.817439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9820198c-1ea9-40e4-a874-0200fd136b3b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:53.818946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9820198c-1ea9-40e4-a874-0200fd136b3b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:53.846013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9820198c-1ea9-40e4-a874-0200fd136b3b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:53.870755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9820198c-1ea9-40e4-a874-0200fd136b3b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:53.871582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9820198c-1ea9-40e4-a874-0200fd136b3b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:53.872024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9820198c-1ea9-40e4-a874-0200fd136b3b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:54.401502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9820198c-1ea9-40e4-a874-0200fd136b3b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:54.411511 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9820198c-1ea9-40e4-a874-0200fd136b3b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 0.600464 Aug 02 07:06:54.412013 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1951/4000] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:53 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:54.891386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:06:54.891952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:06:54.892446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:06:54.892854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:06:54.893302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:06:54.939156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:54.944255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:54.945411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:54.946037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:55.021253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for project 6ee1befa077542b9a17865baad3c9999. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:06:55.034374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for user 3a2629fa08b5419a96c2942118d38dad and project 6ee1befa077542b9a17865baad3c9999. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:06:55.075739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:06:55.078255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:06:55.193649 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43d016bf-0272-409e-9b63-c77b192ce855 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.300996 Aug 02 07:06:55.204922 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2050/4001] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:06:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 2308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:06:55.223471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-51859350-38a5-40c5-8cd2-8e6d6db7d781 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:55.227244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-51859350-38a5-40c5-8cd2-8e6d6db7d781 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:55.394219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-51859350-38a5-40c5-8cd2-8e6d6db7d781 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:55.401325 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-51859350-38a5-40c5-8cd2-8e6d6db7d781 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 200 len: 1242 microversion: 2.1 time: 0.194586 Aug 02 07:06:55.403207 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1952/4002] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:55 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 1242 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:55.433746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c08707da-9104-45ef-b545-53d692d84f51 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:55.434622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c08707da-9104-45ef-b545-53d692d84f51 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:55.443178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c08707da-9104-45ef-b545-53d692d84f51 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:55.444040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c08707da-9104-45ef-b545-53d692d84f51 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:55.445219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c08707da-9104-45ef-b545-53d692d84f51 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:55.445876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c08707da-9104-45ef-b545-53d692d84f51 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:56.204388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c08707da-9104-45ef-b545-53d692d84f51 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:56.226107 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c08707da-9104-45ef-b545-53d692d84f51 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 0.797216 Aug 02 07:06:56.229972 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2051/4003] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:55 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:56.429828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-eed5460d-38f1-4783-8aab-19c10d1faa4e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:56.432822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-eed5460d-38f1-4783-8aab-19c10d1faa4e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:56.467659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eed5460d-38f1-4783-8aab-19c10d1faa4e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:56.468771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eed5460d-38f1-4783-8aab-19c10d1faa4e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:56.472984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eed5460d-38f1-4783-8aab-19c10d1faa4e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:56.475950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eed5460d-38f1-4783-8aab-19c10d1faa4e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:56.731101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-eed5460d-38f1-4783-8aab-19c10d1faa4e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:56.743877 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-eed5460d-38f1-4783-8aab-19c10d1faa4e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 200 len: 1238 microversion: 2.1 time: 0.322605 Aug 02 07:06:56.746682 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1953/4004] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:56 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 1238 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:56.818843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1654449700", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:06:56.960315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:06:57.252063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-32394249-69f7-480b-a0a1-bc2920eb8b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:57.252920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-32394249-69f7-480b-a0a1-bc2920eb8b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:57.272902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32394249-69f7-480b-a0a1-bc2920eb8b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:57.280758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32394249-69f7-480b-a0a1-bc2920eb8b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:57.282880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32394249-69f7-480b-a0a1-bc2920eb8b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:57.287568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32394249-69f7-480b-a0a1-bc2920eb8b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:57.506653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:06:57.507496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:06:57.507496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:06:57.507935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:06:57.508349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:06:57.538944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:57.539379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:57.540397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:57.540996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:57.597319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Getting quotas for project baa0fa34fbba445586cc0ed08368210f. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:06:57.613730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Getting quotas for user d7d4163f7039422da3362e0fb7780696 and project baa0fa34fbba445586cc0ed08368210f. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:06:57.632802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:06:57.639809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:06:57.716441 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-915e41ac-94c9-4dec-8e0b-84b02dca74ea tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.224460 Aug 02 07:06:57.719562 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2052/4005] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:06:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:06:57.747934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-77ce4ebd-dd06-4033-b0fb-d5fc573851b2 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:57.749708 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-77ce4ebd-dd06-4033-b0fb-d5fc573851b2 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:58.021835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-32394249-69f7-480b-a0a1-bc2920eb8b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:58.035484 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-32394249-69f7-480b-a0a1-bc2920eb8b38 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 0.787502 Aug 02 07:06:58.050576 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1954/4006] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:57 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:06:58.056619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-77ce4ebd-dd06-4033-b0fb-d5fc573851b2 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4163f7039422da3362e0fb7780696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa0fa34fbba445586cc0ed08368210f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:58.056842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3058660e-3b90-491a-ba59-33926c0b3815 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:58.061539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3058660e-3b90-491a-ba59-33926c0b3815 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:58.069985 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-77ce4ebd-dd06-4033-b0fb-d5fc573851b2 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 200 len: 1214 microversion: 2.1 time: 0.332903 Aug 02 07:06:58.075077 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2053/4007] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:57 2022] GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 1214 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:58.088363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3058660e-3b90-491a-ba59-33926c0b3815 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:58.088830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3058660e-3b90-491a-ba59-33926c0b3815 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:58.089631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3058660e-3b90-491a-ba59-33926c0b3815 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:58.096196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3058660e-3b90-491a-ba59-33926c0b3815 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:58.502024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3058660e-3b90-491a-ba59-33926c0b3815 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:58.517000 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3058660e-3b90-491a-ba59-33926c0b3815 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 200 len: 1300 microversion: 2.1 time: 0.464973 Aug 02 07:06:58.526829 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1955/4008] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:58 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 1300 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:59.057367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-69d6b0b4-bd51-40d5-8cd2-848f1aa05da4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:59.058027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-69d6b0b4-bd51-40d5-8cd2-848f1aa05da4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:59.074103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69d6b0b4-bd51-40d5-8cd2-848f1aa05da4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:59.074662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69d6b0b4-bd51-40d5-8cd2-848f1aa05da4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:59.075576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69d6b0b4-bd51-40d5-8cd2-848f1aa05da4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:59.076095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69d6b0b4-bd51-40d5-8cd2-848f1aa05da4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:59.101552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8ee6260e-1617-4677-bb58-d250eab34985 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:59.102813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8ee6260e-1617-4677-bb58-d250eab34985 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:59.117309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ee6260e-1617-4677-bb58-d250eab34985 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:59.118121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ee6260e-1617-4677-bb58-d250eab34985 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:59.119125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ee6260e-1617-4677-bb58-d250eab34985 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:59.119826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ee6260e-1617-4677-bb58-d250eab34985 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:59.307248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8ee6260e-1617-4677-bb58-d250eab34985 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4163f7039422da3362e0fb7780696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa0fa34fbba445586cc0ed08368210f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:59.328907 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8ee6260e-1617-4677-bb58-d250eab34985 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 200 len: 1210 microversion: 2.1 time: 0.231197 Aug 02 07:06:59.329830 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1956/4009] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:59 2022] GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 1210 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:06:59.548557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c77ad7ca-b21b-4d0b-89f0-6d0877a55a8e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:06:59.549641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c77ad7ca-b21b-4d0b-89f0-6d0877a55a8e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:06:59.566816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c77ad7ca-b21b-4d0b-89f0-6d0877a55a8e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:59.567562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c77ad7ca-b21b-4d0b-89f0-6d0877a55a8e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:59.568541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c77ad7ca-b21b-4d0b-89f0-6d0877a55a8e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:06:59.569132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c77ad7ca-b21b-4d0b-89f0-6d0877a55a8e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:06:59.950736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-69d6b0b4-bd51-40d5-8cd2-848f1aa05da4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:06:59.959478 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-69d6b0b4-bd51-40d5-8cd2-848f1aa05da4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 0.906221 Aug 02 07:06:59.994287 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2054/4010] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:59 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:00.006297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c77ad7ca-b21b-4d0b-89f0-6d0877a55a8e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:00.031521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:00.036789 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c77ad7ca-b21b-4d0b-89f0-6d0877a55a8e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 200 len: 1300 microversion: 2.1 time: 0.492366 Aug 02 07:07:00.041443 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1957/4011] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:06:59 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 1300 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:07:00.360981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e82e0f09-8068-4b6e-9883-7ebe4892633d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:00.362228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e82e0f09-8068-4b6e-9883-7ebe4892633d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:00.389002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e82e0f09-8068-4b6e-9883-7ebe4892633d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:00.410996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e82e0f09-8068-4b6e-9883-7ebe4892633d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:00.416175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e82e0f09-8068-4b6e-9883-7ebe4892633d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:00.416987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e82e0f09-8068-4b6e-9883-7ebe4892633d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:00.605655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-722cdb7f-cc31-4736-a990-4b268e0fa65f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:00.606467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-722cdb7f-cc31-4736-a990-4b268e0fa65f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:00.619596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-722cdb7f-cc31-4736-a990-4b268e0fa65f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:00.622612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-722cdb7f-cc31-4736-a990-4b268e0fa65f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:00.626511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-722cdb7f-cc31-4736-a990-4b268e0fa65f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:00.628959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-722cdb7f-cc31-4736-a990-4b268e0fa65f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:00.716596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-722cdb7f-cc31-4736-a990-4b268e0fa65f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:07:00.742973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e82e0f09-8068-4b6e-9883-7ebe4892633d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4163f7039422da3362e0fb7780696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa0fa34fbba445586cc0ed08368210f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:00.759084 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e82e0f09-8068-4b6e-9883-7ebe4892633d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 200 len: 1272 microversion: 2.1 time: 0.396574 Aug 02 07:07:00.761417 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1958/4012] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:00 2022] GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 1272 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:07:00.958762 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-722cdb7f-cc31-4736-a990-4b268e0fa65f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 204 len: 0 microversion: 2.42 time: 0.725197 Aug 02 07:07:00.968995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1c2501c3-6927-4f59-bc1e-b80eb3542859 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:00.970345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1c2501c3-6927-4f59-bc1e-b80eb3542859 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:00.973551 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2055/4013] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 07:07:00 2022] DELETE /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:07:00.988089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c2501c3-6927-4f59-bc1e-b80eb3542859 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:00.988839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c2501c3-6927-4f59-bc1e-b80eb3542859 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:00.992684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c2501c3-6927-4f59-bc1e-b80eb3542859 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:00.994568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cb50b758-019b-4b44-a287-c364aa8d6c5c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:00.995492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cb50b758-019b-4b44-a287-c364aa8d6c5c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:01.002676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c2501c3-6927-4f59-bc1e-b80eb3542859 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:01.009779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb50b758-019b-4b44-a287-c364aa8d6c5c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:01.014965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb50b758-019b-4b44-a287-c364aa8d6c5c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:01.016236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb50b758-019b-4b44-a287-c364aa8d6c5c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:01.016844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb50b758-019b-4b44-a287-c364aa8d6c5c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:01.904869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cb50b758-019b-4b44-a287-c364aa8d6c5c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:01.931874 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cb50b758-019b-4b44-a287-c364aa8d6c5c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 0.941765 Aug 02 07:07:01.932546 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2056/4014] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:00 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:07:01.941628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b662380-63fc-4f9b-aca2-6b3ceade822e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:01.945491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6b662380-63fc-4f9b-aca2-6b3ceade822e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:01.960247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b662380-63fc-4f9b-aca2-6b3ceade822e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:01.961093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b662380-63fc-4f9b-aca2-6b3ceade822e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:01.963252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b662380-63fc-4f9b-aca2-6b3ceade822e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:01.965223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b662380-63fc-4f9b-aca2-6b3ceade822e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:02.289592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1c2501c3-6927-4f59-bc1e-b80eb3542859 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:02.316221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1c2501c3-6927-4f59-bc1e-b80eb3542859 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:02.324051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1c2501c3-6927-4f59-bc1e-b80eb3542859 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:02.325861 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1c2501c3-6927-4f59-bc1e-b80eb3542859 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 2959 microversion: 2.42 time: 1.361241 Aug 02 07:07:02.339548 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1959/4015] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:00 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 2959 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:02.349521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-06a3b080-c454-451d-b923-4e9f1c5b335a tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:02.362383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-06a3b080-c454-451d-b923-4e9f1c5b335a tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:02.372363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06a3b080-c454-451d-b923-4e9f1c5b335a tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:02.393869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06a3b080-c454-451d-b923-4e9f1c5b335a tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:02.402883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06a3b080-c454-451d-b923-4e9f1c5b335a tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:02.410220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06a3b080-c454-451d-b923-4e9f1c5b335a tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:02.658631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6b662380-63fc-4f9b-aca2-6b3ceade822e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:02.667223 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6b662380-63fc-4f9b-aca2-6b3ceade822e tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 200 len: 1368 microversion: 2.1 time: 0.731272 Aug 02 07:07:02.681573 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2057/4016] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:01 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 1368 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:02.998083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d49ecf21-2e76-4a48-8ead-433e15e7cd4c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:02.999910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d49ecf21-2e76-4a48-8ead-433e15e7cd4c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:03.007788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d49ecf21-2e76-4a48-8ead-433e15e7cd4c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:03.008647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d49ecf21-2e76-4a48-8ead-433e15e7cd4c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:03.009911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d49ecf21-2e76-4a48-8ead-433e15e7cd4c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:03.011323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d49ecf21-2e76-4a48-8ead-433e15e7cd4c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:03.978605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-06a3b080-c454-451d-b923-4e9f1c5b335a tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4163f7039422da3362e0fb7780696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa0fa34fbba445586cc0ed08368210f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:03.990317 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-06a3b080-c454-451d-b923-4e9f1c5b335a tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 200 len: 1314 microversion: 2.1 time: 1.649456 Aug 02 07:07:03.990936 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1960/4017] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:02 2022] GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 1314 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:04.018392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8ffdf8f4-ff55-45cf-a71b-5523ceddbd78 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:04.019408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8ffdf8f4-ff55-45cf-a71b-5523ceddbd78 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:04.027608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ffdf8f4-ff55-45cf-a71b-5523ceddbd78 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:04.028397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ffdf8f4-ff55-45cf-a71b-5523ceddbd78 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:04.029385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ffdf8f4-ff55-45cf-a71b-5523ceddbd78 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:04.029999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ffdf8f4-ff55-45cf-a71b-5523ceddbd78 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:04.723174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d49ecf21-2e76-4a48-8ead-433e15e7cd4c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:04.733028 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d49ecf21-2e76-4a48-8ead-433e15e7cd4c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 1.778825 Aug 02 07:07:04.752751 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2058/4018] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:02 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:04.767889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4d55f8f5-0d14-440f-8051-41c71e21e577 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:04.769826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4d55f8f5-0d14-440f-8051-41c71e21e577 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:04.790135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d55f8f5-0d14-440f-8051-41c71e21e577 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:04.792405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d55f8f5-0d14-440f-8051-41c71e21e577 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:04.793766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d55f8f5-0d14-440f-8051-41c71e21e577 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:04.796085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d55f8f5-0d14-440f-8051-41c71e21e577 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:04.908501 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4d55f8f5-0d14-440f-8051-41c71e21e577 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/ips" status: 200 len: 151 microversion: 2.20 time: 0.151915 Aug 02 07:07:04.910474 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2059/4019] 10.222.0.79 () {60 vars in 1289 bytes} [Tue Aug 2 07:07:04 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/ips => generated 151 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:07:04.937074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d945c09c-226c-4ff7-a153-afa75cce4e51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:04.938038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d945c09c-226c-4ff7-a153-afa75cce4e51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:04.955223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d945c09c-226c-4ff7-a153-afa75cce4e51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:04.955957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d945c09c-226c-4ff7-a153-afa75cce4e51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:04.956971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d945c09c-226c-4ff7-a153-afa75cce4e51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:04.957725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d945c09c-226c-4ff7-a153-afa75cce4e51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:05.400664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:05.842149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8ffdf8f4-ff55-45cf-a71b-5523ceddbd78 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:05.861174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8ffdf8f4-ff55-45cf-a71b-5523ceddbd78 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:05.872537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8ffdf8f4-ff55-45cf-a71b-5523ceddbd78 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:05.883675 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8ffdf8f4-ff55-45cf-a71b-5523ceddbd78 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 2959 microversion: 2.42 time: 1.879646 Aug 02 07:07:05.886027 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1961/4020] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:03 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 2959 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:06.048546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ce3c9324-0241-445a-b790-f1554e602005 req-9021e7dc-89a2-44b4-ab8e-b1e99dad1a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d", "tag": "dcae9a67-4109-47b1-a166-84e52bb96d5f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:06.064899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ce3c9324-0241-445a-b790-f1554e602005 req-9021e7dc-89a2-44b4-ab8e-b1e99dad1a87 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:06.066024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ce3c9324-0241-445a-b790-f1554e602005 req-9021e7dc-89a2-44b4-ab8e-b1e99dad1a87 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:06.083066 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ce3c9324-0241-445a-b790-f1554e602005 req-9021e7dc-89a2-44b4-ab8e-b1e99dad1a87 service nova] Creating event network-changed:dcae9a67-4109-47b1-a166-84e52bb96d5f for instance 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d on n-h2-851337-3 Aug 02 07:07:06.089280 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ce3c9324-0241-445a-b790-f1554e602005 req-9021e7dc-89a2-44b4-ab8e-b1e99dad1a87 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199968 Aug 02 07:07:06.090636 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1962/4021] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:06.125444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d945c09c-226c-4ff7-a153-afa75cce4e51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:06.138722 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d945c09c-226c-4ff7-a153-afa75cce4e51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 200 len: 1368 microversion: 2.1 time: 1.225520 Aug 02 07:07:06.139887 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2060/4022] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:04 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 1368 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:06.146165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-39b0f78b-7502-4e71-a49f-479bb00299ad tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:06.149240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-39b0f78b-7502-4e71-a49f-479bb00299ad tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:06.154671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39b0f78b-7502-4e71-a49f-479bb00299ad tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:06.155508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39b0f78b-7502-4e71-a49f-479bb00299ad tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:06.156535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39b0f78b-7502-4e71-a49f-479bb00299ad tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:06.157173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39b0f78b-7502-4e71-a49f-479bb00299ad tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:06.247058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-3a3537f3-3617-4f3a-b7ee-8b959235f9cb req-136bb833-6daa-41dd-ac3a-230c12d6e09b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416496be-7b54-49d4-9d90-3d0be9463e67", "tag": "3ebf0c02-a621-4c47-94f1-5e112337634c"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:06.280703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3a3537f3-3617-4f3a-b7ee-8b959235f9cb req-136bb833-6daa-41dd-ac3a-230c12d6e09b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:06.281505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3a3537f3-3617-4f3a-b7ee-8b959235f9cb req-136bb833-6daa-41dd-ac3a-230c12d6e09b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:06.298099 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-3a3537f3-3617-4f3a-b7ee-8b959235f9cb req-136bb833-6daa-41dd-ac3a-230c12d6e09b service nova] Creating event network-changed:3ebf0c02-a621-4c47-94f1-5e112337634c for instance 416496be-7b54-49d4-9d90-3d0be9463e67 on n-h2-851337-3 Aug 02 07:07:06.304007 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-3a3537f3-3617-4f3a-b7ee-8b959235f9cb req-136bb833-6daa-41dd-ac3a-230c12d6e09b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211423 Aug 02 07:07:06.305118 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1963/4023] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:06.317611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-90df01ab-4915-4d6f-b856-d8ec727a7f37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:06.318650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-90df01ab-4915-4d6f-b856-d8ec727a7f37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:06.328304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90df01ab-4915-4d6f-b856-d8ec727a7f37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:06.329134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90df01ab-4915-4d6f-b856-d8ec727a7f37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:06.330592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90df01ab-4915-4d6f-b856-d8ec727a7f37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:06.331208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90df01ab-4915-4d6f-b856-d8ec727a7f37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:07.461375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-39b0f78b-7502-4e71-a49f-479bb00299ad tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4163f7039422da3362e0fb7780696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa0fa34fbba445586cc0ed08368210f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:07.463919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:07.469129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-90df01ab-4915-4d6f-b856-d8ec727a7f37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:07.478707 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-39b0f78b-7502-4e71-a49f-479bb00299ad tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 200 len: 1314 microversion: 2.1 time: 1.333256 Aug 02 07:07:07.478707 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2061/4024] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:06 2022] GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 1314 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:07.499102 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-90df01ab-4915-4d6f-b856-d8ec727a7f37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 1.191771 Aug 02 07:07:07.502913 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1964/4025] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:06 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:07.520574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8dca779c-14ff-432a-b04d-8ba575aa3f55 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:07.530373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8dca779c-14ff-432a-b04d-8ba575aa3f55 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:07.554254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8dca779c-14ff-432a-b04d-8ba575aa3f55 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:07.555075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8dca779c-14ff-432a-b04d-8ba575aa3f55 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:07.555890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8dca779c-14ff-432a-b04d-8ba575aa3f55 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:07.564710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:07.568369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8dca779c-14ff-432a-b04d-8ba575aa3f55 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:07.646451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-dd2cd8a2-f506-454a-9f92-b4d087a2aa5f req-ab0f2804-76bb-4bdc-beb5-0cdb40d9c3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-unplugged", "status": "completed", "tag": "c6a0f893-e351-45b7-8c0a-475bf3575808"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:07.669641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-dd2cd8a2-f506-454a-9f92-b4d087a2aa5f req-ab0f2804-76bb-4bdc-beb5-0cdb40d9c3e9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:07.675444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-dd2cd8a2-f506-454a-9f92-b4d087a2aa5f req-ab0f2804-76bb-4bdc-beb5-0cdb40d9c3e9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:07.715225 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-dd2cd8a2-f506-454a-9f92-b4d087a2aa5f req-ab0f2804-76bb-4bdc-beb5-0cdb40d9c3e9 service nova] Creating event network-vif-unplugged:c6a0f893-e351-45b7-8c0a-475bf3575808 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:07:07.725447 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-dd2cd8a2-f506-454a-9f92-b4d087a2aa5f req-ab0f2804-76bb-4bdc-beb5-0cdb40d9c3e9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.247391 Aug 02 07:07:07.727620 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2062/4026] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:07.738404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-639f6467-cb90-4099-a791-a4539170f02f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:07.740028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-639f6467-cb90-4099-a791-a4539170f02f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:07.752063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-639f6467-cb90-4099-a791-a4539170f02f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:07.752792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-639f6467-cb90-4099-a791-a4539170f02f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:07.753803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-639f6467-cb90-4099-a791-a4539170f02f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:07.754813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-639f6467-cb90-4099-a791-a4539170f02f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:08.067567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=18 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:08.293618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8dca779c-14ff-432a-b04d-8ba575aa3f55 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:08.307857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8dca779c-14ff-432a-b04d-8ba575aa3f55 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:08.309448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8dca779c-14ff-432a-b04d-8ba575aa3f55 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:08.315640 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8dca779c-14ff-432a-b04d-8ba575aa3f55 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 2959 microversion: 2.42 time: 0.806297 Aug 02 07:07:08.316255 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1965/4027] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:07 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 2959 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:08.326381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-639f6467-cb90-4099-a791-a4539170f02f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:08.348506 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-639f6467-cb90-4099-a791-a4539170f02f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 200 len: 1368 microversion: 2.1 time: 0.618311 Aug 02 07:07:08.349107 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2063/4028] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:07 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 1368 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:08.432576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4f56ec79-655a-432c-9b78-3c266c300000 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:08.433128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4f56ec79-655a-432c-9b78-3c266c300000 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:08.445774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f56ec79-655a-432c-9b78-3c266c300000 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:08.446236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f56ec79-655a-432c-9b78-3c266c300000 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:08.447014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f56ec79-655a-432c-9b78-3c266c300000 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:08.447451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f56ec79-655a-432c-9b78-3c266c300000 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:08.495732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9240a8b7-5583-4c41-8b31-a2e4916d4a1b tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:08.496995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9240a8b7-5583-4c41-8b31-a2e4916d4a1b tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:08.505697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9240a8b7-5583-4c41-8b31-a2e4916d4a1b tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:08.511397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-4f56ec79-655a-432c-9b78-3c266c300000 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lazy-loading 'flavor' on Instance uuid 9a9ae016-6a95-4257-8d74-99fcd50ae1cb {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:07:08.516553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9240a8b7-5583-4c41-8b31-a2e4916d4a1b tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:08.526123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9240a8b7-5583-4c41-8b31-a2e4916d4a1b tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:08.527409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9240a8b7-5583-4c41-8b31-a2e4916d4a1b tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:08.869215 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4f56ec79-655a-432c-9b78-3c266c300000 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "POST /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/action" status: 202 len: 0 microversion: 2.20 time: 0.438919 Aug 02 07:07:08.869988 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1966/4029] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Aug 2 07:07:08 2022] POST /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:07:08.886376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cccdb797-f7a3-4c7d-87b0-3d32b0bfceff tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:08.887091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cccdb797-f7a3-4c7d-87b0-3d32b0bfceff tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:08.926529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cccdb797-f7a3-4c7d-87b0-3d32b0bfceff tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:08.927077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cccdb797-f7a3-4c7d-87b0-3d32b0bfceff tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:08.930804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cccdb797-f7a3-4c7d-87b0-3d32b0bfceff tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:08.931300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cccdb797-f7a3-4c7d-87b0-3d32b0bfceff tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:09.576125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9240a8b7-5583-4c41-8b31-a2e4916d4a1b tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4163f7039422da3362e0fb7780696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa0fa34fbba445586cc0ed08368210f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:09.586119 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9240a8b7-5583-4c41-8b31-a2e4916d4a1b tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 200 len: 1314 microversion: 2.1 time: 1.094083 Aug 02 07:07:09.586657 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2064/4030] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:08 2022] GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 1314 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:07:09.602980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-80a379a5-9a1f-4a68-9e6f-703abc719c88 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:09.603887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-80a379a5-9a1f-4a68-9e6f-703abc719c88 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:09.625115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80a379a5-9a1f-4a68-9e6f-703abc719c88 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:09.625962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80a379a5-9a1f-4a68-9e6f-703abc719c88 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:09.627017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80a379a5-9a1f-4a68-9e6f-703abc719c88 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:09.629129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80a379a5-9a1f-4a68-9e6f-703abc719c88 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:09.770857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cccdb797-f7a3-4c7d-87b0-3d32b0bfceff tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:09.803990 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cccdb797-f7a3-4c7d-87b0-3d32b0bfceff tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 0.932437 Aug 02 07:07:09.805249 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1967/4031] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:08 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:09.977368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-308345885", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:10.125555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] validate_networks() for [('ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:07:11.508837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-80a379a5-9a1f-4a68-9e6f-703abc719c88 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:11.539961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-80a379a5-9a1f-4a68-9e6f-703abc719c88 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:11.553107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-80a379a5-9a1f-4a68-9e6f-703abc719c88 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:11.554709 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-80a379a5-9a1f-4a68-9e6f-703abc719c88 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1722 microversion: 2.20 time: 1.963268 Aug 02 07:07:11.555457 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2065/4032] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:09 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1722 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:11.567308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3c6558b2-6ac4-4659-8655-7adde0a1351f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:11.581814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3c6558b2-6ac4-4659-8655-7adde0a1351f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:11.595870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c6558b2-6ac4-4659-8655-7adde0a1351f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:11.596324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c6558b2-6ac4-4659-8655-7adde0a1351f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:11.597114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c6558b2-6ac4-4659-8655-7adde0a1351f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:11.605161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c6558b2-6ac4-4659-8655-7adde0a1351f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:12.241404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3c6558b2-6ac4-4659-8655-7adde0a1351f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:12.254989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3c6558b2-6ac4-4659-8655-7adde0a1351f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:12.256946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3c6558b2-6ac4-4659-8655-7adde0a1351f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:12.258697 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3c6558b2-6ac4-4659-8655-7adde0a1351f tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 2938 microversion: 2.42 time: 0.695444 Aug 02 07:07:12.259817 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2066/4033] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:11 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 2938 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:12.266007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c4003953-404c-4d4f-9a8c-8025fe601690 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:12.266915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c4003953-404c-4d4f-9a8c-8025fe601690 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:12.296522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4003953-404c-4d4f-9a8c-8025fe601690 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:12.308113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4003953-404c-4d4f-9a8c-8025fe601690 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:12.309582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4003953-404c-4d4f-9a8c-8025fe601690 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:12.310250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4003953-404c-4d4f-9a8c-8025fe601690 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:12.562920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:07:12.563620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:07:12.563859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:07:12.564272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:07:12.564688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:07:12.587453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:12.587915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:12.588753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:12.589196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:12.666451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:07:12.676782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for user 0971d7961d5a4e8996ea2c0f958382ad and project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:07:12.699868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:07:12.705811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:07:12.856315 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3d372c80-a811-452b-97b8-dd5d7105d75c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.041355 Aug 02 07:07:12.864284 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1968/4034] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:07:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:07:12.869719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-20df5efe-3786-47c3-b859-57593cfa4c97 req-b7d28952-dea4-4677-bc03-32d0d1f8365a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-unplugged", "status": "completed", "tag": "5b383fff-f64d-4758-98fb-152834840541"}, {"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-unplugged", "status": "completed", "tag": "2136bfef-3765-4057-a98e-e66dd94110e0"}, {"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-unplugged", "status": "completed", "tag": "1523988e-eb3f-4088-a913-e069e59a9e1b"}, {"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-unplugged", "status": "completed", "tag": "861a1e1b-6d90-469d-92c9-1b3e761b3246"}, {"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-unplugged", "status": "completed", "tag": "d122ff1d-37ba-4ca8-88b0-aa8e965f6c3f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:12.908180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-20df5efe-3786-47c3-b859-57593cfa4c97 req-b7d28952-dea4-4677-bc03-32d0d1f8365a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:12.919894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-20df5efe-3786-47c3-b859-57593cfa4c97 req-b7d28952-dea4-4677-bc03-32d0d1f8365a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:12.966559 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-20df5efe-3786-47c3-b859-57593cfa4c97 req-b7d28952-dea4-4677-bc03-32d0d1f8365a service nova] Creating event network-vif-unplugged:5b383fff-f64d-4758-98fb-152834840541 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:07:12.975447 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-20df5efe-3786-47c3-b859-57593cfa4c97 req-b7d28952-dea4-4677-bc03-32d0d1f8365a service nova] Creating event network-vif-unplugged:2136bfef-3765-4057-a98e-e66dd94110e0 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:07:12.979643 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-20df5efe-3786-47c3-b859-57593cfa4c97 req-b7d28952-dea4-4677-bc03-32d0d1f8365a service nova] Creating event network-vif-unplugged:1523988e-eb3f-4088-a913-e069e59a9e1b for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:07:12.984014 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-20df5efe-3786-47c3-b859-57593cfa4c97 req-b7d28952-dea4-4677-bc03-32d0d1f8365a service nova] Creating event network-vif-unplugged:861a1e1b-6d90-469d-92c9-1b3e761b3246 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:07:12.991095 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-20df5efe-3786-47c3-b859-57593cfa4c97 req-b7d28952-dea4-4677-bc03-32d0d1f8365a service nova] Creating event network-vif-unplugged:d122ff1d-37ba-4ca8-88b0-aa8e965f6c3f for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:07:13.024259 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-20df5efe-3786-47c3-b859-57593cfa4c97 req-b7d28952-dea4-4677-bc03-32d0d1f8365a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.158260 Aug 02 07:07:13.028670 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1969/4035] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:13.040519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-40c6559e-8f79-4949-bdc4-2a7299e0c97d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:13.060744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-40c6559e-8f79-4949-bdc4-2a7299e0c97d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:13.076753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:13.105732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40c6559e-8f79-4949-bdc4-2a7299e0c97d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:13.110131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40c6559e-8f79-4949-bdc4-2a7299e0c97d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:13.116421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40c6559e-8f79-4949-bdc4-2a7299e0c97d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:13.117272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40c6559e-8f79-4949-bdc4-2a7299e0c97d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:13.653377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-40c6559e-8f79-4949-bdc4-2a7299e0c97d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4163f7039422da3362e0fb7780696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa0fa34fbba445586cc0ed08368210f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:13.667490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c4003953-404c-4d4f-9a8c-8025fe601690 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:13.672198 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-40c6559e-8f79-4949-bdc4-2a7299e0c97d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 200 len: 1314 microversion: 2.1 time: 0.636153 Aug 02 07:07:13.681773 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c4003953-404c-4d4f-9a8c-8025fe601690 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 200 len: 1368 microversion: 2.1 time: 1.420466 Aug 02 07:07:13.683355 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2067/4036] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:12 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 1368 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:13.698422 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1970/4037] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:13 2022] GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:13.700845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2f6609d8-6aef-4ff7-a387-d6ef47648c43 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:13.701725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2f6609d8-6aef-4ff7-a387-d6ef47648c43 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:13.703833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aabbab9a-b35e-4e02-8de4-2da02e27a2de tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:13.704456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aabbab9a-b35e-4e02-8de4-2da02e27a2de tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:13.713617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:13.719682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f6609d8-6aef-4ff7-a387-d6ef47648c43 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:13.720419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f6609d8-6aef-4ff7-a387-d6ef47648c43 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:13.725305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f6609d8-6aef-4ff7-a387-d6ef47648c43 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:13.725775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f6609d8-6aef-4ff7-a387-d6ef47648c43 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:13.737144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aabbab9a-b35e-4e02-8de4-2da02e27a2de tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:13.737657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aabbab9a-b35e-4e02-8de4-2da02e27a2de tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:13.738551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aabbab9a-b35e-4e02-8de4-2da02e27a2de tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:13.738986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aabbab9a-b35e-4e02-8de4-2da02e27a2de tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:14.312447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aabbab9a-b35e-4e02-8de4-2da02e27a2de tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:14.338931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aabbab9a-b35e-4e02-8de4-2da02e27a2de tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:14.352208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aabbab9a-b35e-4e02-8de4-2da02e27a2de tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:14.362067 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aabbab9a-b35e-4e02-8de4-2da02e27a2de tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1722 microversion: 2.20 time: 0.657188 Aug 02 07:07:14.362740 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1971/4038] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:13 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1722 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:14.384643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3fcee8fb-998e-4c44-b577-9ccf1b801f31 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:14.387006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3fcee8fb-998e-4c44-b577-9ccf1b801f31 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:14.396702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fcee8fb-998e-4c44-b577-9ccf1b801f31 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:14.397504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fcee8fb-998e-4c44-b577-9ccf1b801f31 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:14.398891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fcee8fb-998e-4c44-b577-9ccf1b801f31 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:14.399567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fcee8fb-998e-4c44-b577-9ccf1b801f31 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:14.406037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2f6609d8-6aef-4ff7-a387-d6ef47648c43 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:14.414458 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2f6609d8-6aef-4ff7-a387-d6ef47648c43 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 0.724155 Aug 02 07:07:14.415045 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2068/4039] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:13 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:14.452123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3a894877-767f-4b84-82f9-25d3c7669bc7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:14.452821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3a894877-767f-4b84-82f9-25d3c7669bc7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:14.492226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a894877-767f-4b84-82f9-25d3c7669bc7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:14.492702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a894877-767f-4b84-82f9-25d3c7669bc7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:14.493526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a894877-767f-4b84-82f9-25d3c7669bc7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:14.493988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3a894877-767f-4b84-82f9-25d3c7669bc7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:14.557585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3fcee8fb-998e-4c44-b577-9ccf1b801f31 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:14.573244 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3fcee8fb-998e-4c44-b577-9ccf1b801f31 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3" status: 200 len: 1188 microversion: 2.1 time: 0.196671 Aug 02 07:07:14.574554 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1972/4040] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:14 2022] GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 => generated 1188 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:14.693174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-23b526d8-33fe-459d-bd3c-eeec6c510809 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:14.694554 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-23b526d8-33fe-459d-bd3c-eeec6c510809 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:14.706907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23b526d8-33fe-459d-bd3c-eeec6c510809 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:14.707639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23b526d8-33fe-459d-bd3c-eeec6c510809 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:14.708618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23b526d8-33fe-459d-bd3c-eeec6c510809 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:14.712363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23b526d8-33fe-459d-bd3c-eeec6c510809 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:14.988633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3a894877-767f-4b84-82f9-25d3c7669bc7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:15.011319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3a894877-767f-4b84-82f9-25d3c7669bc7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:15.013046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3a894877-767f-4b84-82f9-25d3c7669bc7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:15.014641 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3a894877-767f-4b84-82f9-25d3c7669bc7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 2917 microversion: 2.42 time: 0.569907 Aug 02 07:07:15.018707 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2069/4041] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:14 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 2917 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:15.030370 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-480a6388-452b-47eb-96d8-e9f39ec54268 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:15.031212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-480a6388-452b-47eb-96d8-e9f39ec54268 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:15.048572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-480a6388-452b-47eb-96d8-e9f39ec54268 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:15.049026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-480a6388-452b-47eb-96d8-e9f39ec54268 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:15.054431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-480a6388-452b-47eb-96d8-e9f39ec54268 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:15.055257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-480a6388-452b-47eb-96d8-e9f39ec54268 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:15.407181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23b526d8-33fe-459d-bd3c-eeec6c510809 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4163f7039422da3362e0fb7780696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa0fa34fbba445586cc0ed08368210f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:15.425011 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-23b526d8-33fe-459d-bd3c-eeec6c510809 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 200 len: 1314 microversion: 2.1 time: 0.736005 Aug 02 07:07:15.425950 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1973/4042] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:14 2022] GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:07:15.443262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c726dcb2-3b6c-4cf1-a68a-722922f56a27 req-7e998511-1f60-4e43-8330-cb0c31639bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-deleted", "tag": "20905df0-f84b-4e3e-8164-bd1311888332"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:15.472258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c726dcb2-3b6c-4cf1-a68a-722922f56a27 req-7e998511-1f60-4e43-8330-cb0c31639bd1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:15.472707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c726dcb2-3b6c-4cf1-a68a-722922f56a27 req-7e998511-1f60-4e43-8330-cb0c31639bd1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:15.491988 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c726dcb2-3b6c-4cf1-a68a-722922f56a27 req-7e998511-1f60-4e43-8330-cb0c31639bd1 service nova] Creating event network-vif-deleted:20905df0-f84b-4e3e-8164-bd1311888332 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:07:15.498948 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c726dcb2-3b6c-4cf1-a68a-722922f56a27 req-7e998511-1f60-4e43-8330-cb0c31639bd1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071552 Aug 02 07:07:15.500233 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1974/4043] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:15.508325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-765529ea-25ee-4466-b236-c3a8b22ffbd0 req-dc542bf6-e678-4be8-ac7e-bb2176cc3091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-unplugged", "status": "completed", "tag": "20905df0-f84b-4e3e-8164-bd1311888332"}, {"server_uuid": "416496be-7b54-49d4-9d90-3d0be9463e67", "name": "network-vif-plugged", "status": "completed", "tag": "3ebf0c02-a621-4c47-94f1-5e112337634c"}, {"server_uuid": "3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d", "name": "network-vif-plugged", "status": "completed", "tag": "dcae9a67-4109-47b1-a166-84e52bb96d5f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:15.522089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-765529ea-25ee-4466-b236-c3a8b22ffbd0 req-dc542bf6-e678-4be8-ac7e-bb2176cc3091 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:15.523609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-765529ea-25ee-4466-b236-c3a8b22ffbd0 req-dc542bf6-e678-4be8-ac7e-bb2176cc3091 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:15.543003 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-765529ea-25ee-4466-b236-c3a8b22ffbd0 req-dc542bf6-e678-4be8-ac7e-bb2176cc3091 service nova] Creating event network-vif-unplugged:20905df0-f84b-4e3e-8164-bd1311888332 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:07:15.544072 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-765529ea-25ee-4466-b236-c3a8b22ffbd0 req-dc542bf6-e678-4be8-ac7e-bb2176cc3091 service nova] Creating event network-vif-plugged:3ebf0c02-a621-4c47-94f1-5e112337634c for instance 416496be-7b54-49d4-9d90-3d0be9463e67 on n-h2-851337-3 Aug 02 07:07:15.544804 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-765529ea-25ee-4466-b236-c3a8b22ffbd0 req-dc542bf6-e678-4be8-ac7e-bb2176cc3091 service nova] Creating event network-vif-plugged:dcae9a67-4109-47b1-a166-84e52bb96d5f for instance 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d on n-h2-851337-3 Aug 02 07:07:15.553771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-480a6388-452b-47eb-96d8-e9f39ec54268 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:15.554621 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-765529ea-25ee-4466-b236-c3a8b22ffbd0 req-dc542bf6-e678-4be8-ac7e-bb2176cc3091 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.051187 Aug 02 07:07:15.555798 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1975/4044] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:15.562314 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-480a6388-452b-47eb-96d8-e9f39ec54268 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 200 len: 1368 microversion: 2.1 time: 0.542074 Aug 02 07:07:15.562891 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2070/4045] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:15 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 1368 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:15.563736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-87826a23-1eb6-420d-aba5-c6eb04e1b41b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:15.564617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-87826a23-1eb6-420d-aba5-c6eb04e1b41b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:15.571754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87826a23-1eb6-420d-aba5-c6eb04e1b41b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:15.573147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87826a23-1eb6-420d-aba5-c6eb04e1b41b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:15.574502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87826a23-1eb6-420d-aba5-c6eb04e1b41b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:15.575448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87826a23-1eb6-420d-aba5-c6eb04e1b41b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:15.578037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f9a07ed9-47f2-4c04-af64-e1765b187003 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:15.578664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f9a07ed9-47f2-4c04-af64-e1765b187003 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:15.605665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:15.621814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9a07ed9-47f2-4c04-af64-e1765b187003 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:15.622549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9a07ed9-47f2-4c04-af64-e1765b187003 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:15.623557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9a07ed9-47f2-4c04-af64-e1765b187003 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:15.624389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9a07ed9-47f2-4c04-af64-e1765b187003 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:16.011456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-87826a23-1eb6-420d-aba5-c6eb04e1b41b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:16.027577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-87826a23-1eb6-420d-aba5-c6eb04e1b41b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:16.029458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-87826a23-1eb6-420d-aba5-c6eb04e1b41b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:16.031018 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-87826a23-1eb6-420d-aba5-c6eb04e1b41b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1722 microversion: 2.20 time: 0.473836 Aug 02 07:07:16.032286 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1976/4046] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:15 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1722 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:16.038062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7869fb67-780f-445f-84d4-23b10eb7549a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:16.038698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7869fb67-780f-445f-84d4-23b10eb7549a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:16.047606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7869fb67-780f-445f-84d4-23b10eb7549a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:16.048056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7869fb67-780f-445f-84d4-23b10eb7549a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:16.049081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7869fb67-780f-445f-84d4-23b10eb7549a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:16.049677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7869fb67-780f-445f-84d4-23b10eb7549a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:16.134436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f9a07ed9-47f2-4c04-af64-e1765b187003 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:16.147694 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f9a07ed9-47f2-4c04-af64-e1765b187003 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1682 microversion: 2.1 time: 0.580834 Aug 02 07:07:16.148595 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2071/4047] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:15 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1682 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:16.169814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7869fb67-780f-445f-84d4-23b10eb7549a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:16.185083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bcb8dfaa-ca08-4b88-bf94-17477304021b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:16.186059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bcb8dfaa-ca08-4b88-bf94-17477304021b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:16.191292 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7869fb67-780f-445f-84d4-23b10eb7549a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3" status: 200 len: 1250 microversion: 2.1 time: 0.157419 Aug 02 07:07:16.192574 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1977/4048] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:16 2022] GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 => generated 1250 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:16.196745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcb8dfaa-ca08-4b88-bf94-17477304021b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:16.197558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcb8dfaa-ca08-4b88-bf94-17477304021b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:16.198553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcb8dfaa-ca08-4b88-bf94-17477304021b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:16.199139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcb8dfaa-ca08-4b88-bf94-17477304021b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:16.450661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a2f9f325-fce5-433f-aea6-d8a8b1b5a710 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:16.451302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a2f9f325-fce5-433f-aea6-d8a8b1b5a710 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:16.462118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2f9f325-fce5-433f-aea6-d8a8b1b5a710 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:16.462583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2f9f325-fce5-433f-aea6-d8a8b1b5a710 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:16.470829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2f9f325-fce5-433f-aea6-d8a8b1b5a710 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:16.471332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2f9f325-fce5-433f-aea6-d8a8b1b5a710 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:16.619959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bcb8dfaa-ca08-4b88-bf94-17477304021b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:16.648060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bcb8dfaa-ca08-4b88-bf94-17477304021b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:16.649591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bcb8dfaa-ca08-4b88-bf94-17477304021b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:16.650970 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bcb8dfaa-ca08-4b88-bf94-17477304021b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 2709 microversion: 2.42 time: 0.501222 Aug 02 07:07:16.654640 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2072/4049] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:16 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 2709 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:16.660248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1423a355-b95e-4706-a70e-bfa7853b4557 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:16.661079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1423a355-b95e-4706-a70e-bfa7853b4557 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:16.674178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1423a355-b95e-4706-a70e-bfa7853b4557 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:16.674655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1423a355-b95e-4706-a70e-bfa7853b4557 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:16.675476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1423a355-b95e-4706-a70e-bfa7853b4557 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:16.675939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1423a355-b95e-4706-a70e-bfa7853b4557 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:16.798159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a2f9f325-fce5-433f-aea6-d8a8b1b5a710 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4163f7039422da3362e0fb7780696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa0fa34fbba445586cc0ed08368210f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:16.814692 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a2f9f325-fce5-433f-aea6-d8a8b1b5a710 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 200 len: 1314 microversion: 2.1 time: 0.368271 Aug 02 07:07:16.828165 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1978/4050] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:16 2022] GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:17.015964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1423a355-b95e-4706-a70e-bfa7853b4557 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:17.028579 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1423a355-b95e-4706-a70e-bfa7853b4557 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 200 len: 1368 microversion: 2.1 time: 0.372410 Aug 02 07:07:17.029178 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2073/4051] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:16 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 1368 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:17.063894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-902d429f-b14a-46bc-a14c-40f49a334ed7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:17.067037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-902d429f-b14a-46bc-a14c-40f49a334ed7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:17.094484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-902d429f-b14a-46bc-a14c-40f49a334ed7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:17.095207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-902d429f-b14a-46bc-a14c-40f49a334ed7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:17.096922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-902d429f-b14a-46bc-a14c-40f49a334ed7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:17.097597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-902d429f-b14a-46bc-a14c-40f49a334ed7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:17.176251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9da65b9e-5d5f-4105-b3cf-c44b185f84f7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:17.177809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9da65b9e-5d5f-4105-b3cf-c44b185f84f7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:17.186911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9da65b9e-5d5f-4105-b3cf-c44b185f84f7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:17.187936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9da65b9e-5d5f-4105-b3cf-c44b185f84f7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:17.189043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9da65b9e-5d5f-4105-b3cf-c44b185f84f7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:17.189682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9da65b9e-5d5f-4105-b3cf-c44b185f84f7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:17.508878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-902d429f-b14a-46bc-a14c-40f49a334ed7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:17.521530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-902d429f-b14a-46bc-a14c-40f49a334ed7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:17.523627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-902d429f-b14a-46bc-a14c-40f49a334ed7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:17.525339 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-902d429f-b14a-46bc-a14c-40f49a334ed7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1722 microversion: 2.20 time: 0.468101 Aug 02 07:07:17.538883 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1979/4052] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:17 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1722 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:17.542660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-24024cb8-9cfd-404e-a3e6-daecd8846997 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:17.545424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-24024cb8-9cfd-404e-a3e6-daecd8846997 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:17.554092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24024cb8-9cfd-404e-a3e6-daecd8846997 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:17.554704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24024cb8-9cfd-404e-a3e6-daecd8846997 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:17.555614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24024cb8-9cfd-404e-a3e6-daecd8846997 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:17.568316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24024cb8-9cfd-404e-a3e6-daecd8846997 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:17.667488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9da65b9e-5d5f-4105-b3cf-c44b185f84f7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:17.682108 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9da65b9e-5d5f-4105-b3cf-c44b185f84f7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.512177 Aug 02 07:07:17.684048 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2074/4053] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:17 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:07:17.691097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-11a88611-a8c0-45b9-824f-e2b59dbf5d12 req-9e184e60-ee3d-4d4d-a599-5d5ca839e15c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6df8190-3206-4d0e-97d9-7e80986012a3", "tag": "9f4e2fd7-50f2-4305-acd9-a197edde8479"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:17.706191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-11a88611-a8c0-45b9-824f-e2b59dbf5d12 req-9e184e60-ee3d-4d4d-a599-5d5ca839e15c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:17.706846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-11a88611-a8c0-45b9-824f-e2b59dbf5d12 req-9e184e60-ee3d-4d4d-a599-5d5ca839e15c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:17.744577 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-11a88611-a8c0-45b9-824f-e2b59dbf5d12 req-9e184e60-ee3d-4d4d-a599-5d5ca839e15c service nova] Creating event network-changed:9f4e2fd7-50f2-4305-acd9-a197edde8479 for instance f6df8190-3206-4d0e-97d9-7e80986012a3 on n-h1-851337-3 Aug 02 07:07:17.752884 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-11a88611-a8c0-45b9-824f-e2b59dbf5d12 req-9e184e60-ee3d-4d4d-a599-5d5ca839e15c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066235 Aug 02 07:07:17.755377 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2075/4054] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:17.764645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-d26f5328-a04d-4759-8b32-77b6abed2eb7 req-6644cd85-4384-43bd-87cd-904e0ff6b66c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-deleted", "tag": "1523988e-eb3f-4088-a913-e069e59a9e1b"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:17.783140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d26f5328-a04d-4759-8b32-77b6abed2eb7 req-6644cd85-4384-43bd-87cd-904e0ff6b66c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:17.783869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d26f5328-a04d-4759-8b32-77b6abed2eb7 req-6644cd85-4384-43bd-87cd-904e0ff6b66c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:17.798464 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-d26f5328-a04d-4759-8b32-77b6abed2eb7 req-6644cd85-4384-43bd-87cd-904e0ff6b66c service nova] Creating event network-vif-deleted:1523988e-eb3f-4088-a913-e069e59a9e1b for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:07:17.806295 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-d26f5328-a04d-4759-8b32-77b6abed2eb7 req-6644cd85-4384-43bd-87cd-904e0ff6b66c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046850 Aug 02 07:07:17.807159 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2076/4055] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:17.826395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d82488d1-4f41-4c01-a849-40a82cdf46b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:17.826395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d82488d1-4f41-4c01-a849-40a82cdf46b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:17.850163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d82488d1-4f41-4c01-a849-40a82cdf46b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:17.850731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d82488d1-4f41-4c01-a849-40a82cdf46b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:17.851906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d82488d1-4f41-4c01-a849-40a82cdf46b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:17.853037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d82488d1-4f41-4c01-a849-40a82cdf46b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:17.874306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-24024cb8-9cfd-404e-a3e6-daecd8846997 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:17.887937 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-24024cb8-9cfd-404e-a3e6-daecd8846997 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3" status: 200 len: 1292 microversion: 2.1 time: 0.353848 Aug 02 07:07:17.889480 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1980/4056] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:17 2022] GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 => generated 1292 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:17.894091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6a5dc1f8-cba1-49a4-960e-07c38cb88a04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:17.894748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6a5dc1f8-cba1-49a4-960e-07c38cb88a04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:17.901883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a5dc1f8-cba1-49a4-960e-07c38cb88a04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:17.902653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a5dc1f8-cba1-49a4-960e-07c38cb88a04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:17.903527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a5dc1f8-cba1-49a4-960e-07c38cb88a04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:17.904362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a5dc1f8-cba1-49a4-960e-07c38cb88a04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:18.257577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d82488d1-4f41-4c01-a849-40a82cdf46b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:18.269697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d82488d1-4f41-4c01-a849-40a82cdf46b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:18.271466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d82488d1-4f41-4c01-a849-40a82cdf46b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:18.275617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6a5dc1f8-cba1-49a4-960e-07c38cb88a04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:18.280334 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d82488d1-4f41-4c01-a849-40a82cdf46b0 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 2549 microversion: 2.42 time: 0.471089 Aug 02 07:07:18.285628 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6a5dc1f8-cba1-49a4-960e-07c38cb88a04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.395379 Aug 02 07:07:18.286306 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2077/4057] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:17 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 2549 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:18.297919 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1981/4058] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:17 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:18.297919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5473ec22-325f-43b5-af60-4376c33d918a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:18.297919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5473ec22-325f-43b5-af60-4376c33d918a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:18.305226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bd14ad53-3087-46f1-912c-7e4df9f23a65 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:18.306605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bd14ad53-3087-46f1-912c-7e4df9f23a65 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:18.313948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5473ec22-325f-43b5-af60-4376c33d918a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:18.314539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5473ec22-325f-43b5-af60-4376c33d918a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:18.316130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd14ad53-3087-46f1-912c-7e4df9f23a65 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:18.316769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5473ec22-325f-43b5-af60-4376c33d918a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:18.317058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd14ad53-3087-46f1-912c-7e4df9f23a65 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:18.318234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd14ad53-3087-46f1-912c-7e4df9f23a65 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:18.318370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5473ec22-325f-43b5-af60-4376c33d918a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:18.319084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bd14ad53-3087-46f1-912c-7e4df9f23a65 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:18.741343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5473ec22-325f-43b5-af60-4376c33d918a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:18.754028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bd14ad53-3087-46f1-912c-7e4df9f23a65 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4163f7039422da3362e0fb7780696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa0fa34fbba445586cc0ed08368210f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:18.758394 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5473ec22-325f-43b5-af60-4376c33d918a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 200 len: 1559 microversion: 2.1 time: 0.469790 Aug 02 07:07:18.759775 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1982/4059] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:18 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 1559 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:18.772392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ed82e6b5-14d6-4359-94a1-b9a19b792795 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:18.773019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ed82e6b5-14d6-4359-94a1-b9a19b792795 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:18.779290 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bd14ad53-3087-46f1-912c-7e4df9f23a65 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 200 len: 1464 microversion: 2.1 time: 0.489496 Aug 02 07:07:18.780954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed82e6b5-14d6-4359-94a1-b9a19b792795 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:18.781170 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2078/4060] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:18 2022] GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 1464 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:18.781433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed82e6b5-14d6-4359-94a1-b9a19b792795 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:18.782553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed82e6b5-14d6-4359-94a1-b9a19b792795 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:18.783221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed82e6b5-14d6-4359-94a1-b9a19b792795 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:18.793780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-8ae14de5-7fd3-4d08-b111-4d772914092e req-0cdb49bb-39b8-49ad-83ac-b6578abe92f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ccfed8-393e-4223-b2a8-7dbf8c77d3fe", "name": "network-vif-unplugged", "status": "completed", "tag": "96c2e36a-4761-4b9b-b02e-96b42f53d06e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:18.804881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8ae14de5-7fd3-4d08-b111-4d772914092e req-0cdb49bb-39b8-49ad-83ac-b6578abe92f7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:18.805547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8ae14de5-7fd3-4d08-b111-4d772914092e req-0cdb49bb-39b8-49ad-83ac-b6578abe92f7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:18.820382 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-8ae14de5-7fd3-4d08-b111-4d772914092e req-0cdb49bb-39b8-49ad-83ac-b6578abe92f7 service nova] Creating event network-vif-unplugged:96c2e36a-4761-4b9b-b02e-96b42f53d06e for instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe on n-h1-851337-3 Aug 02 07:07:18.825844 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-8ae14de5-7fd3-4d08-b111-4d772914092e req-0cdb49bb-39b8-49ad-83ac-b6578abe92f7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042923 Aug 02 07:07:18.829499 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2079/4061] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:18.832046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c4f521f0-f0e9-4b48-a323-af9c82059a96 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:18.832630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c4f521f0-f0e9-4b48-a323-af9c82059a96 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:18.839233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4f521f0-f0e9-4b48-a323-af9c82059a96 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:18.839680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4f521f0-f0e9-4b48-a323-af9c82059a96 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:18.840455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4f521f0-f0e9-4b48-a323-af9c82059a96 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:18.840892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4f521f0-f0e9-4b48-a323-af9c82059a96 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:19.019829 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c4f521f0-f0e9-4b48-a323-af9c82059a96 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.192078 Aug 02 07:07:19.021033 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2080/4062] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 07:07:18 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:19.072922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ed82e6b5-14d6-4359-94a1-b9a19b792795 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:19.088023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ed82e6b5-14d6-4359-94a1-b9a19b792795 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:19.089924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ed82e6b5-14d6-4359-94a1-b9a19b792795 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:19.091417 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ed82e6b5-14d6-4359-94a1-b9a19b792795 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1722 microversion: 2.20 time: 0.330287 Aug 02 07:07:19.091996 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1983/4063] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:18 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:19.107118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-eebadd04-b18e-4972-9ded-5abfa901347a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:19.107981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-eebadd04-b18e-4972-9ded-5abfa901347a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:19.115246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eebadd04-b18e-4972-9ded-5abfa901347a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:19.115695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eebadd04-b18e-4972-9ded-5abfa901347a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:19.116479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eebadd04-b18e-4972-9ded-5abfa901347a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:19.116911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eebadd04-b18e-4972-9ded-5abfa901347a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:19.126854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5b27732c-d97f-4171-b624-21209bcb708e tempest-TenantUsagesTestJSON-449561425 tempest-TenantUsagesTestJSON-449561425-project-admin] Calling method '.version_select at 0x7f927a2e44c0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:19.163375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b27732c-d97f-4171-b624-21209bcb708e tempest-TenantUsagesTestJSON-449561425 tempest-TenantUsagesTestJSON-449561425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:19.163819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b27732c-d97f-4171-b624-21209bcb708e tempest-TenantUsagesTestJSON-449561425 tempest-TenantUsagesTestJSON-449561425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:19.209236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b27732c-d97f-4171-b624-21209bcb708e tempest-TenantUsagesTestJSON-449561425 tempest-TenantUsagesTestJSON-449561425-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:19.213250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b27732c-d97f-4171-b624-21209bcb708e tempest-TenantUsagesTestJSON-449561425 tempest-TenantUsagesTestJSON-449561425-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:19.265366 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5b27732c-d97f-4171-b624-21209bcb708e tempest-TenantUsagesTestJSON-449561425 tempest-TenantUsagesTestJSON-449561425-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/baa0fa34fbba445586cc0ed08368210f?start=2022-08-01T07%3A07%3A18.794463&end=2022-08-03T07%3A07%3A18.794463" status: 200 len: 695 microversion: 2.1 time: 0.242844 Aug 02 07:07:19.270129 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2081/4064] 10.222.0.79 () {58 vars in 1412 bytes} [Tue Aug 2 07:07:19 2022] GET /compute/v2.1/os-simple-tenant-usage/baa0fa34fbba445586cc0ed08368210f?start=2022-08-01T07%3A07%3A18.794463&end=2022-08-03T07%3A07%3A18.794463 => generated 695 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:19.287550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-89649f51-00f9-4c4a-8b60-fada80316ba6 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '.version_select at 0x7f927a2c6b80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:19.299251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89649f51-00f9-4c4a-8b60-fada80316ba6 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:19.300002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89649f51-00f9-4c4a-8b60-fada80316ba6 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:19.316742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89649f51-00f9-4c4a-8b60-fada80316ba6 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:19.317345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89649f51-00f9-4c4a-8b60-fada80316ba6 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:19.333668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:19.343149 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-89649f51-00f9-4c4a-8b60-fada80316ba6 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/baa0fa34fbba445586cc0ed08368210f?start=2022-08-01T07%3A07%3A18.794463&end=2022-08-03T07%3A07%3A18.794463" status: 200 len: 694 microversion: 2.1 time: 0.061042 Aug 02 07:07:19.344331 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2082/4065] 10.222.0.79 () {58 vars in 1412 bytes} [Tue Aug 2 07:07:19 2022] GET /compute/v2.1/os-simple-tenant-usage/baa0fa34fbba445586cc0ed08368210f?start=2022-08-01T07%3A07%3A18.794463&end=2022-08-03T07%3A07%3A18.794463 => generated 694 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:19.352955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cc52275a-ff47-49ae-b3e2-8a700ce2d012 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:19.353760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cc52275a-ff47-49ae-b3e2-8a700ce2d012 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:19.365317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc52275a-ff47-49ae-b3e2-8a700ce2d012 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:19.366771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc52275a-ff47-49ae-b3e2-8a700ce2d012 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:19.368665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc52275a-ff47-49ae-b3e2-8a700ce2d012 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:19.371232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc52275a-ff47-49ae-b3e2-8a700ce2d012 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:19.550820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-eebadd04-b18e-4972-9ded-5abfa901347a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:19.573190 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-eebadd04-b18e-4972-9ded-5abfa901347a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3" status: 200 len: 1292 microversion: 2.1 time: 0.469911 Aug 02 07:07:19.577831 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1984/4066] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:19 2022] GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 => generated 1292 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:19.593104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8b4e6c03-248c-4228-a6b8-e536bb17072d tempest-TenantUsagesTestJSON-449561425 tempest-TenantUsagesTestJSON-449561425-project-admin] Calling method '.version_select at 0x7f927b590b80>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:19.602131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8b4e6c03-248c-4228-a6b8-e536bb17072d tempest-TenantUsagesTestJSON-449561425 tempest-TenantUsagesTestJSON-449561425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:19.602589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8b4e6c03-248c-4228-a6b8-e536bb17072d tempest-TenantUsagesTestJSON-449561425 tempest-TenantUsagesTestJSON-449561425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:19.627307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8b4e6c03-248c-4228-a6b8-e536bb17072d tempest-TenantUsagesTestJSON-449561425 tempest-TenantUsagesTestJSON-449561425-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:19.627754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8b4e6c03-248c-4228-a6b8-e536bb17072d tempest-TenantUsagesTestJSON-449561425 tempest-TenantUsagesTestJSON-449561425-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:19.837203 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8b4e6c03-248c-4228-a6b8-e536bb17072d tempest-TenantUsagesTestJSON-449561425 tempest-TenantUsagesTestJSON-449561425-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-01T07%3A07%3A18.794463&end=2022-08-03T07%3A07%3A18.794463&detailed=1" status: 200 len: 50992 microversion: 2.1 time: 0.255451 Aug 02 07:07:19.850124 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1985/4067] 10.222.0.79 () {58 vars in 1335 bytes} [Tue Aug 2 07:07:19 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-01T07%3A07%3A18.794463&end=2022-08-03T07%3A07%3A18.794463&detailed=1 => generated 50992 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:07:19.866674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d032ab66-d694-4ebf-870e-ecca74089274 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:19.868579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d032ab66-d694-4ebf-870e-ecca74089274 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:19.893398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d032ab66-d694-4ebf-870e-ecca74089274 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:19.893849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d032ab66-d694-4ebf-870e-ecca74089274 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:19.895368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d032ab66-d694-4ebf-870e-ecca74089274 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:19.896066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d032ab66-d694-4ebf-870e-ecca74089274 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:20.302344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cc52275a-ff47-49ae-b3e2-8a700ce2d012 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:20.314280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cc52275a-ff47-49ae-b3e2-8a700ce2d012 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:20.316514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cc52275a-ff47-49ae-b3e2-8a700ce2d012 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:20.319408 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cc52275a-ff47-49ae-b3e2-8a700ce2d012 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 2502 microversion: 2.42 time: 0.973613 Aug 02 07:07:20.323041 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2083/4068] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:19 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 2502 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:20.326693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b9152b36-ea0e-4865-aa55-ce39e0a1542c tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:20.327524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b9152b36-ea0e-4865-aa55-ce39e0a1542c tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:20.335784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9152b36-ea0e-4865-aa55-ce39e0a1542c tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:20.336490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9152b36-ea0e-4865-aa55-ce39e0a1542c tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:20.337456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9152b36-ea0e-4865-aa55-ce39e0a1542c tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:20.338120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9152b36-ea0e-4865-aa55-ce39e0a1542c tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:20.339848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d032ab66-d694-4ebf-870e-ecca74089274 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:20.349388 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d032ab66-d694-4ebf-870e-ecca74089274 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.497507 Aug 02 07:07:20.359388 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1986/4069] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:19 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:20.366597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9488e3df-8584-43d9-8374-823cebf4f8cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:20.366916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b9152b36-ea0e-4865-aa55-ce39e0a1542c tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:07:20.367697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9488e3df-8584-43d9-8374-823cebf4f8cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:20.376452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9488e3df-8584-43d9-8374-823cebf4f8cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:20.377199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9488e3df-8584-43d9-8374-823cebf4f8cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:20.378344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9488e3df-8584-43d9-8374-823cebf4f8cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:20.378970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9488e3df-8584-43d9-8374-823cebf4f8cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:20.491751 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b9152b36-ea0e-4865-aa55-ce39e0a1542c tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 204 len: 0 microversion: 2.1 time: 0.166106 Aug 02 07:07:20.492914 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2084/4070] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:07:20 2022] DELETE /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:07:20.508157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-414a6c04-365a-475e-9ff5-f3c21bac96c6 req-b496e770-776f-448d-83f0-b64cac5c12d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-deleted", "tag": "5b383fff-f64d-4758-98fb-152834840541"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:20.531881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-414a6c04-365a-475e-9ff5-f3c21bac96c6 req-b496e770-776f-448d-83f0-b64cac5c12d9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:20.532483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-414a6c04-365a-475e-9ff5-f3c21bac96c6 req-b496e770-776f-448d-83f0-b64cac5c12d9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:20.576049 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-414a6c04-365a-475e-9ff5-f3c21bac96c6 req-b496e770-776f-448d-83f0-b64cac5c12d9 service nova] Creating event network-vif-deleted:5b383fff-f64d-4758-98fb-152834840541 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:07:20.591594 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-414a6c04-365a-475e-9ff5-f3c21bac96c6 req-b496e770-776f-448d-83f0-b64cac5c12d9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094207 Aug 02 07:07:20.592288 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2085/4071] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:20.601689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-180143c8-bcf7-41bb-b15a-0c806285f05b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:20.602469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-180143c8-bcf7-41bb-b15a-0c806285f05b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:20.623160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-180143c8-bcf7-41bb-b15a-0c806285f05b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:20.624309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-180143c8-bcf7-41bb-b15a-0c806285f05b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:20.625423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-180143c8-bcf7-41bb-b15a-0c806285f05b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:20.626614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-180143c8-bcf7-41bb-b15a-0c806285f05b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:20.897152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9488e3df-8584-43d9-8374-823cebf4f8cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:20.913049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9488e3df-8584-43d9-8374-823cebf4f8cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:20.918059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9488e3df-8584-43d9-8374-823cebf4f8cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:20.922191 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9488e3df-8584-43d9-8374-823cebf4f8cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1722 microversion: 2.20 time: 0.561148 Aug 02 07:07:20.922833 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1987/4072] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:20 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1722 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:20.946311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-78e55c8e-afc3-4826-a0de-915e30ededd7 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:20.947395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-78e55c8e-afc3-4826-a0de-915e30ededd7 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:20.962062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78e55c8e-afc3-4826-a0de-915e30ededd7 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:20.962350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78e55c8e-afc3-4826-a0de-915e30ededd7 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:20.963243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78e55c8e-afc3-4826-a0de-915e30ededd7 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:20.970188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78e55c8e-afc3-4826-a0de-915e30ededd7 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:20.990719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-180143c8-bcf7-41bb-b15a-0c806285f05b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:21.005097 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-180143c8-bcf7-41bb-b15a-0c806285f05b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.410736 Aug 02 07:07:21.018503 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2086/4073] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:20 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:21.032080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-96a89c73-8e35-44b1-9b6e-e9c81e03b6a2 req-4ea42906-89df-4d02-be62-e3ae4b868ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416496be-7b54-49d4-9d90-3d0be9463e67", "tag": "3ebf0c02-a621-4c47-94f1-5e112337634c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:21.043141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-96a89c73-8e35-44b1-9b6e-e9c81e03b6a2 req-4ea42906-89df-4d02-be62-e3ae4b868ca7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:21.043665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-96a89c73-8e35-44b1-9b6e-e9c81e03b6a2 req-4ea42906-89df-4d02-be62-e3ae4b868ca7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:21.090414 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-96a89c73-8e35-44b1-9b6e-e9c81e03b6a2 req-4ea42906-89df-4d02-be62-e3ae4b868ca7 service nova] Creating event network-changed:3ebf0c02-a621-4c47-94f1-5e112337634c for instance 416496be-7b54-49d4-9d90-3d0be9463e67 on n-h2-851337-3 Aug 02 07:07:21.109516 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-96a89c73-8e35-44b1-9b6e-e9c81e03b6a2 req-4ea42906-89df-4d02-be62-e3ae4b868ca7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089582 Aug 02 07:07:21.110477 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2087/4074] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:21.122272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2011890d-dce9-424e-ae0e-0b153594672b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:21.123306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2011890d-dce9-424e-ae0e-0b153594672b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:21.145502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2011890d-dce9-424e-ae0e-0b153594672b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:21.145976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2011890d-dce9-424e-ae0e-0b153594672b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:21.146775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2011890d-dce9-424e-ae0e-0b153594672b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:21.147216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2011890d-dce9-424e-ae0e-0b153594672b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:21.286872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-78e55c8e-afc3-4826-a0de-915e30ededd7 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4163f7039422da3362e0fb7780696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa0fa34fbba445586cc0ed08368210f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:21.304936 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-78e55c8e-afc3-4826-a0de-915e30ededd7 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 200 len: 1470 microversion: 2.1 time: 0.379776 Aug 02 07:07:21.305754 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1988/4075] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:20 2022] GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 1470 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:21.328647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-63f35301-80b6-4a46-8f0c-124b607ab891 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:21.329282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-63f35301-80b6-4a46-8f0c-124b607ab891 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:21.349962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f35301-80b6-4a46-8f0c-124b607ab891 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:21.350426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f35301-80b6-4a46-8f0c-124b607ab891 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:21.351192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f35301-80b6-4a46-8f0c-124b607ab891 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:21.351843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f35301-80b6-4a46-8f0c-124b607ab891 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:21.675422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2011890d-dce9-424e-ae0e-0b153594672b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:21.684935 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2011890d-dce9-424e-ae0e-0b153594672b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3" status: 200 len: 1292 microversion: 2.1 time: 0.573158 Aug 02 07:07:21.693140 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2088/4076] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:21 2022] GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 => generated 1292 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:21.707137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fc64ba69-5f16-4051-a157-86c5c4754f33 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:21.707764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fc64ba69-5f16-4051-a157-86c5c4754f33 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:21.724729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc64ba69-5f16-4051-a157-86c5c4754f33 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:21.727708 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc64ba69-5f16-4051-a157-86c5c4754f33 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:21.731413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc64ba69-5f16-4051-a157-86c5c4754f33 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:21.732065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc64ba69-5f16-4051-a157-86c5c4754f33 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:22.141285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-63f35301-80b6-4a46-8f0c-124b607ab891 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:22.162164 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-63f35301-80b6-4a46-8f0c-124b607ab891 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.841921 Aug 02 07:07:22.165103 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1989/4077] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:21 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:22.183444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0e6b52fa-49b1-46b4-b22e-be40f3b312fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:22.187797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0e6b52fa-49b1-46b4-b22e-be40f3b312fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:22.196761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e6b52fa-49b1-46b4-b22e-be40f3b312fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:22.196761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e6b52fa-49b1-46b4-b22e-be40f3b312fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:22.198965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e6b52fa-49b1-46b4-b22e-be40f3b312fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:22.199511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e6b52fa-49b1-46b4-b22e-be40f3b312fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:22.223718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fc64ba69-5f16-4051-a157-86c5c4754f33 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:22.245858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fc64ba69-5f16-4051-a157-86c5c4754f33 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:22.252130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fc64ba69-5f16-4051-a157-86c5c4754f33 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:22.253476 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fc64ba69-5f16-4051-a157-86c5c4754f33 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 2346 microversion: 2.42 time: 0.558632 Aug 02 07:07:22.262698 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2089/4078] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:21 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 2346 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:22.284417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5487008a-a770-4ddf-bc14-344e12c83a2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:22.287215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5487008a-a770-4ddf-bc14-344e12c83a2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:22.315545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5487008a-a770-4ddf-bc14-344e12c83a2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:22.316364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5487008a-a770-4ddf-bc14-344e12c83a2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:22.317227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5487008a-a770-4ddf-bc14-344e12c83a2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:22.317676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5487008a-a770-4ddf-bc14-344e12c83a2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:22.511618 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5487008a-a770-4ddf-bc14-344e12c83a2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.246201 Aug 02 07:07:22.515461 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2090/4079] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:07:22 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:07:22.560543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2673bf6-87cc-4f0d-bedd-f6dd8c3af94d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:22.561276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f2673bf6-87cc-4f0d-bedd-f6dd8c3af94d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:22.584908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2673bf6-87cc-4f0d-bedd-f6dd8c3af94d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:22.585843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2673bf6-87cc-4f0d-bedd-f6dd8c3af94d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:22.586931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2673bf6-87cc-4f0d-bedd-f6dd8c3af94d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:22.587554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2673bf6-87cc-4f0d-bedd-f6dd8c3af94d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:22.691562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:23.017535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0e6b52fa-49b1-46b4-b22e-be40f3b312fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:23.030718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0e6b52fa-49b1-46b4-b22e-be40f3b312fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:23.033868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0e6b52fa-49b1-46b4-b22e-be40f3b312fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:23.035819 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0e6b52fa-49b1-46b4-b22e-be40f3b312fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1722 microversion: 2.20 time: 0.867542 Aug 02 07:07:23.037050 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1990/4080] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:22 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1722 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:23.042789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dc762d3a-2b0f-427a-8d02-00ecfbfa1a62 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:23.044024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dc762d3a-2b0f-427a-8d02-00ecfbfa1a62 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:23.058882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc762d3a-2b0f-427a-8d02-00ecfbfa1a62 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:23.064428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc762d3a-2b0f-427a-8d02-00ecfbfa1a62 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:23.065873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc762d3a-2b0f-427a-8d02-00ecfbfa1a62 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:23.067065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc762d3a-2b0f-427a-8d02-00ecfbfa1a62 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:23.145969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f2673bf6-87cc-4f0d-bedd-f6dd8c3af94d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4163f7039422da3362e0fb7780696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa0fa34fbba445586cc0ed08368210f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:23.167916 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f2673bf6-87cc-4f0d-bedd-f6dd8c3af94d tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 200 len: 1470 microversion: 2.1 time: 0.638698 Aug 02 07:07:23.171933 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2091/4081] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:22 2022] GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 1470 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:23.178670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-0d4b938d-afb5-4763-b0d4-66b5a95f691d req-8ac3f4f1-911e-48c7-abbf-653a67edccf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-deleted", "tag": "861a1e1b-6d90-469d-92c9-1b3e761b3246"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:23.236522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0d4b938d-afb5-4763-b0d4-66b5a95f691d req-8ac3f4f1-911e-48c7-abbf-653a67edccf5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:23.237441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0d4b938d-afb5-4763-b0d4-66b5a95f691d req-8ac3f4f1-911e-48c7-abbf-653a67edccf5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:23.264628 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-0d4b938d-afb5-4763-b0d4-66b5a95f691d req-8ac3f4f1-911e-48c7-abbf-653a67edccf5 service nova] Creating event network-vif-deleted:861a1e1b-6d90-469d-92c9-1b3e761b3246 for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:07:23.271326 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-0d4b938d-afb5-4763-b0d4-66b5a95f691d req-8ac3f4f1-911e-48c7-abbf-653a67edccf5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097316 Aug 02 07:07:23.272538 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2092/4082] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:23.279887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-914d3c57-5341-4913-aaf3-c6e490d5dac2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:23.307181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-914d3c57-5341-4913-aaf3-c6e490d5dac2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:23.325707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-914d3c57-5341-4913-aaf3-c6e490d5dac2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:23.327674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-914d3c57-5341-4913-aaf3-c6e490d5dac2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:23.329081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-914d3c57-5341-4913-aaf3-c6e490d5dac2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:23.329802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-914d3c57-5341-4913-aaf3-c6e490d5dac2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:23.762631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dc762d3a-2b0f-427a-8d02-00ecfbfa1a62 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:23.776470 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dc762d3a-2b0f-427a-8d02-00ecfbfa1a62 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1671 microversion: 2.1 time: 0.737964 Aug 02 07:07:23.777077 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1991/4083] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:23 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1671 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:23.805421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e5b29538-56ee-470b-8550-6b28b323d9d6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:23.806131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e5b29538-56ee-470b-8550-6b28b323d9d6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:23.839475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5b29538-56ee-470b-8550-6b28b323d9d6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:23.843507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5b29538-56ee-470b-8550-6b28b323d9d6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:23.849159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5b29538-56ee-470b-8550-6b28b323d9d6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:23.850636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5b29538-56ee-470b-8550-6b28b323d9d6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:23.961219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-914d3c57-5341-4913-aaf3-c6e490d5dac2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:23.971464 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-914d3c57-5341-4913-aaf3-c6e490d5dac2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3" status: 200 len: 1292 microversion: 2.1 time: 0.697421 Aug 02 07:07:23.982075 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2093/4084] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:23 2022] GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 => generated 1292 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:24.006080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-9a0d5bc1-912d-4bc1-a16e-7c7151187f29 req-67a06c70-fcef-4999-bafe-db3dd41680c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d", "name": "network-vif-deleted", "tag": "dcae9a67-4109-47b1-a166-84e52bb96d5f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:24.039356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9a0d5bc1-912d-4bc1-a16e-7c7151187f29 req-67a06c70-fcef-4999-bafe-db3dd41680c3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:24.040107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9a0d5bc1-912d-4bc1-a16e-7c7151187f29 req-67a06c70-fcef-4999-bafe-db3dd41680c3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:24.074759 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-9a0d5bc1-912d-4bc1-a16e-7c7151187f29 req-67a06c70-fcef-4999-bafe-db3dd41680c3 service nova] Creating event network-vif-deleted:dcae9a67-4109-47b1-a166-84e52bb96d5f for instance 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d on n-h2-851337-3 Aug 02 07:07:24.087122 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-9a0d5bc1-912d-4bc1-a16e-7c7151187f29 req-67a06c70-fcef-4999-bafe-db3dd41680c3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103636 Aug 02 07:07:24.093118 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2094/4085] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:24.108694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ee9e9e35-1140-437c-baea-e4c15c050d1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:24.110398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ee9e9e35-1140-437c-baea-e4c15c050d1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:24.117416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e5b29538-56ee-470b-8550-6b28b323d9d6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:24.141833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e5b29538-56ee-470b-8550-6b28b323d9d6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:24.142232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee9e9e35-1140-437c-baea-e4c15c050d1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:24.143441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee9e9e35-1140-437c-baea-e4c15c050d1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:24.147608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee9e9e35-1140-437c-baea-e4c15c050d1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:24.148245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e5b29538-56ee-470b-8550-6b28b323d9d6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:24.148512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee9e9e35-1140-437c-baea-e4c15c050d1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:24.153330 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e5b29538-56ee-470b-8550-6b28b323d9d6 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.361987 Aug 02 07:07:24.154334 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1992/4086] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:23 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:24.186721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3951e218-ab45-4a15-acbe-e0032baba403 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:24.199471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3951e218-ab45-4a15-acbe-e0032baba403 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:24.214199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3951e218-ab45-4a15-acbe-e0032baba403 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:24.214704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3951e218-ab45-4a15-acbe-e0032baba403 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:24.215705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3951e218-ab45-4a15-acbe-e0032baba403 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:24.216274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3951e218-ab45-4a15-acbe-e0032baba403 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:24.317490 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3951e218-ab45-4a15-acbe-e0032baba403 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331/action" status: 200 len: 24569 microversion: 2.1 time: 0.139509 Aug 02 07:07:24.318512 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1993/4087] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:07:24 2022] POST /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331/action => generated 24569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:07:24.328050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bca28131-879e-4e66-9f19-635a522a7459 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:24.331696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bca28131-879e-4e66-9f19-635a522a7459 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:24.342916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bca28131-879e-4e66-9f19-635a522a7459 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:24.343389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bca28131-879e-4e66-9f19-635a522a7459 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:24.344175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bca28131-879e-4e66-9f19-635a522a7459 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:24.344615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bca28131-879e-4e66-9f19-635a522a7459 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:24.349821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:24.385548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bca28131-879e-4e66-9f19-635a522a7459 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:24.386211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bca28131-879e-4e66-9f19-635a522a7459 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:24.386672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-bca28131-879e-4e66-9f19-635a522a7459 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lazy-loading 'fault' on Instance uuid 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:07:24.472145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bca28131-879e-4e66-9f19-635a522a7459 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4163f7039422da3362e0fb7780696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa0fa34fbba445586cc0ed08368210f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:24.497608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ee9e9e35-1140-437c-baea-e4c15c050d1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:24.512226 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bca28131-879e-4e66-9f19-635a522a7459 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 200 len: 1304 microversion: 2.1 time: 0.189340 Aug 02 07:07:24.518554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ee9e9e35-1140-437c-baea-e4c15c050d1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:24.520101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ee9e9e35-1140-437c-baea-e4c15c050d1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:24.521670 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ee9e9e35-1140-437c-baea-e4c15c050d1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1722 microversion: 2.20 time: 0.427046 Aug 02 07:07:24.526749 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1994/4088] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:24 2022] GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 1304 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:24.532584 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2095/4089] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:24 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1722 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:24.810459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-55c6876e-f1a6-4225-88f7-cf216d3afc2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:24.812454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-55c6876e-f1a6-4225-88f7-cf216d3afc2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:24.826092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55c6876e-f1a6-4225-88f7-cf216d3afc2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:24.826987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55c6876e-f1a6-4225-88f7-cf216d3afc2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:24.829130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55c6876e-f1a6-4225-88f7-cf216d3afc2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:24.831327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55c6876e-f1a6-4225-88f7-cf216d3afc2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:24.835875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-c7339321-6c06-4be0-b0ad-2e5bbed0518c req-c3659cc9-4b04-487e-a204-47e7592fa819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6df8190-3206-4d0e-97d9-7e80986012a3", "name": "network-vif-plugged", "status": "completed", "tag": "9f4e2fd7-50f2-4305-acd9-a197edde8479"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:24.856328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c7339321-6c06-4be0-b0ad-2e5bbed0518c req-c3659cc9-4b04-487e-a204-47e7592fa819 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:24.857071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c7339321-6c06-4be0-b0ad-2e5bbed0518c req-c3659cc9-4b04-487e-a204-47e7592fa819 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:24.918011 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-c7339321-6c06-4be0-b0ad-2e5bbed0518c req-c3659cc9-4b04-487e-a204-47e7592fa819 service nova] Creating event network-vif-plugged:9f4e2fd7-50f2-4305-acd9-a197edde8479 for instance f6df8190-3206-4d0e-97d9-7e80986012a3 on n-h1-851337-3 Aug 02 07:07:24.918011 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-c7339321-6c06-4be0-b0ad-2e5bbed0518c req-c3659cc9-4b04-487e-a204-47e7592fa819 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075080 Aug 02 07:07:24.918011 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2096/4090] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:07:25.003843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b2328fe3-9b71-4df5-ae09-4b39bd70e535 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:25.005203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b2328fe3-9b71-4df5-ae09-4b39bd70e535 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:25.014286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2328fe3-9b71-4df5-ae09-4b39bd70e535 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:25.014988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2328fe3-9b71-4df5-ae09-4b39bd70e535 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:25.016046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2328fe3-9b71-4df5-ae09-4b39bd70e535 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:25.016614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2328fe3-9b71-4df5-ae09-4b39bd70e535 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:25.222658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-55c6876e-f1a6-4225-88f7-cf216d3afc2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:25.231539 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-55c6876e-f1a6-4225-88f7-cf216d3afc2c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1671 microversion: 2.1 time: 0.431888 Aug 02 07:07:25.232477 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1995/4091] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:24 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1671 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:25.237868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9aaba9cc-572f-47a1-a5a9-e0ecfd249e24 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:25.238801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9aaba9cc-572f-47a1-a5a9-e0ecfd249e24 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:25.245718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9aaba9cc-572f-47a1-a5a9-e0ecfd249e24 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:25.246557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9aaba9cc-572f-47a1-a5a9-e0ecfd249e24 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:25.247557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9aaba9cc-572f-47a1-a5a9-e0ecfd249e24 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:25.248228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9aaba9cc-572f-47a1-a5a9-e0ecfd249e24 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:25.298114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b2328fe3-9b71-4df5-ae09-4b39bd70e535 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:25.308579 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b2328fe3-9b71-4df5-ae09-4b39bd70e535 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3" status: 200 len: 1292 microversion: 2.1 time: 0.319000 Aug 02 07:07:25.317904 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2097/4092] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:24 2022] GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 => generated 1292 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:07:25.344434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9aaba9cc-572f-47a1-a5a9-e0ecfd249e24 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:25.355524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-5e59e7ba-284c-4490-a8ba-6409d38d8d99 req-b24325a4-5706-483b-a051-0dc62fec20d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6fbed1-be54-48af-9d5f-8fe30fa88cf8", "name": "network-vif-deleted", "tag": "d122ff1d-37ba-4ca8-88b0-aa8e965f6c3f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:25.355939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9aaba9cc-572f-47a1-a5a9-e0ecfd249e24 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:25.357702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9aaba9cc-572f-47a1-a5a9-e0ecfd249e24 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:25.359047 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9aaba9cc-572f-47a1-a5a9-e0ecfd249e24 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.125460 Aug 02 07:07:25.372137 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1996/4093] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:25 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:25.380792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-5e59e7ba-284c-4490-a8ba-6409d38d8d99 req-b24325a4-5706-483b-a051-0dc62fec20d0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:25.381252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-5e59e7ba-284c-4490-a8ba-6409d38d8d99 req-b24325a4-5706-483b-a051-0dc62fec20d0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:25.395464 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-5e59e7ba-284c-4490-a8ba-6409d38d8d99 req-b24325a4-5706-483b-a051-0dc62fec20d0 service nova] Creating event network-vif-deleted:d122ff1d-37ba-4ca8-88b0-aa8e965f6c3f for instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 on n-h2-851337-3 Aug 02 07:07:25.400513 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-5e59e7ba-284c-4490-a8ba-6409d38d8d99 req-b24325a4-5706-483b-a051-0dc62fec20d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049000 Aug 02 07:07:25.401189 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2098/4094] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:25.549341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c2a22d5b-d099-4a25-ba63-f574832490c0 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:25.550554 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c2a22d5b-d099-4a25-ba63-f574832490c0 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] [instance: 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:25.556402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43949eef-96e4-476a-9769-4b5e2ba8be2c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:25.557255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-43949eef-96e4-476a-9769-4b5e2ba8be2c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:25.558729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2a22d5b-d099-4a25-ba63-f574832490c0 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:25.559363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2a22d5b-d099-4a25-ba63-f574832490c0 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:25.560951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2a22d5b-d099-4a25-ba63-f574832490c0 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:25.561654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2a22d5b-d099-4a25-ba63-f574832490c0 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:25.564245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43949eef-96e4-476a-9769-4b5e2ba8be2c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:25.564707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43949eef-96e4-476a-9769-4b5e2ba8be2c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:25.565561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43949eef-96e4-476a-9769-4b5e2ba8be2c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:25.566035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43949eef-96e4-476a-9769-4b5e2ba8be2c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:25.587111 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-c2a22d5b-d099-4a25-ba63-f574832490c0 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] HTTP exception thrown: Instance 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d could not be found. Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c2a22d5b-d099-4a25-ba63-f574832490c0 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Request method failure captured: Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d HTTP/1.1 Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M0OaBebssrufI6Cv7gA84E67avPVxSCidDXXtt5vrQwy2vFVWwvAi6WztVKdx6Vun-QvRjPkZT16lF8y1d5uTxaQc_kOUGZmMwQUU757MU0rIXcEDzeNtEZC_KmNfEbxZbXG53fuyU3wT5zGRBMl6AUncq0-d9Q8u5hZdwtHny1ZRg Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: baa0fa34fbba445586cc0ed08368210f Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TenantUsagesTestJSON-1612530944 Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/baa0fa34fbba445586cc0ed08368210f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/baa0fa34fbba445586cc0ed08368210f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_baa0fa34fbba445586cc0ed08368210f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/baa0fa34fbba445586cc0ed08368210f"}]}] Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TenantUsagesTestJSON-1612530944 Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: baa0fa34fbba445586cc0ed08368210f Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1612530944 Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TenantUsagesTestJSON-1612530944-project Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: d7d4163f7039422da3362e0fb7780696 Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TenantUsagesTestJSON-1612530944-project Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d could not be found. Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d'} Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d could not be found. Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d could not be found. Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:07:25.588984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:25.596865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:25.596865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:07:25.596865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:07:25.596865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:07:25.596865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:07:25.596865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d could not be found. Aug 02 07:07:25.596865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:25.596865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c2a22d5b-d099-4a25-ba63-f574832490c0 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] Returning 404 to user: Instance 3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:07:25.596865 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c2a22d5b-d099-4a25-ba63-f574832490c0 tempest-TenantUsagesTestJSON-1612530944 tempest-TenantUsagesTestJSON-1612530944-project] 10.222.0.79 "GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d" status: 404 len: 111 microversion: 2.1 time: 0.046727 Aug 02 07:07:25.596865 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1997/4095] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:25 2022] GET /compute/v2.1/servers/3fd9c0fe-ab1d-4ef8-8f07-279de1e86e0d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:07:25.789085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43949eef-96e4-476a-9769-4b5e2ba8be2c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:25.801469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43949eef-96e4-476a-9769-4b5e2ba8be2c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:25.803193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43949eef-96e4-476a-9769-4b5e2ba8be2c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:25.805869 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43949eef-96e4-476a-9769-4b5e2ba8be2c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1722 microversion: 2.20 time: 0.254102 Aug 02 07:07:25.806674 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2099/4096] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:25 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:26.252984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ff51f6ce-49d2-4396-83b2-f5dbe6a10bf2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:26.254711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ff51f6ce-49d2-4396-83b2-f5dbe6a10bf2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:26.264223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff51f6ce-49d2-4396-83b2-f5dbe6a10bf2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:26.265065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff51f6ce-49d2-4396-83b2-f5dbe6a10bf2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:26.265863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff51f6ce-49d2-4396-83b2-f5dbe6a10bf2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:26.266378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff51f6ce-49d2-4396-83b2-f5dbe6a10bf2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:26.333797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ec87d077-f3d2-4067-a929-93352708a14f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:26.335029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ec87d077-f3d2-4067-a929-93352708a14f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:26.355517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec87d077-f3d2-4067-a929-93352708a14f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:26.355716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec87d077-f3d2-4067-a929-93352708a14f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:26.356559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec87d077-f3d2-4067-a929-93352708a14f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:26.356949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec87d077-f3d2-4067-a929-93352708a14f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:26.520033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ff51f6ce-49d2-4396-83b2-f5dbe6a10bf2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:26.529411 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ff51f6ce-49d2-4396-83b2-f5dbe6a10bf2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1676 microversion: 2.1 time: 0.280383 Aug 02 07:07:26.530794 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1998/4097] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:26 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1676 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:26.541245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-55219961-432c-437a-a484-8bfafbc4c213 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:26.542308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-55219961-432c-437a-a484-8bfafbc4c213 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:26.551439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55219961-432c-437a-a484-8bfafbc4c213 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:26.552210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55219961-432c-437a-a484-8bfafbc4c213 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:26.553068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55219961-432c-437a-a484-8bfafbc4c213 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:26.553577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55219961-432c-437a-a484-8bfafbc4c213 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:26.613696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ec87d077-f3d2-4067-a929-93352708a14f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:26.616259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:26.625616 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ec87d077-f3d2-4067-a929-93352708a14f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3" status: 200 len: 1292 microversion: 2.1 time: 0.295807 Aug 02 07:07:26.634093 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2100/4098] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:26 2022] GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 => generated 1292 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:07:26.650727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-55219961-432c-437a-a484-8bfafbc4c213 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:26.666890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-55219961-432c-437a-a484-8bfafbc4c213 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:26.668765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-55219961-432c-437a-a484-8bfafbc4c213 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:26.670202 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-55219961-432c-437a-a484-8bfafbc4c213 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.138097 Aug 02 07:07:26.671164 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 1999/4099] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:26 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:26.832131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bce47417-03ad-4dc8-bf3c-05faa05925ee tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:26.833177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bce47417-03ad-4dc8-bf3c-05faa05925ee tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:26.841589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bce47417-03ad-4dc8-bf3c-05faa05925ee tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:26.842485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bce47417-03ad-4dc8-bf3c-05faa05925ee tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:26.843914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bce47417-03ad-4dc8-bf3c-05faa05925ee tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:26.844737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bce47417-03ad-4dc8-bf3c-05faa05925ee tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:27.042497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bce47417-03ad-4dc8-bf3c-05faa05925ee tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:27.053600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bce47417-03ad-4dc8-bf3c-05faa05925ee tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:27.056076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bce47417-03ad-4dc8-bf3c-05faa05925ee tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:27.057781 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bce47417-03ad-4dc8-bf3c-05faa05925ee tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1722 microversion: 2.20 time: 0.230070 Aug 02 07:07:27.063134 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2101/4100] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:26 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:27.556071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9ef02ae7-8e10-4041-836a-07717c6a8872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:27.556820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9ef02ae7-8e10-4041-836a-07717c6a8872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:27.565733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ef02ae7-8e10-4041-836a-07717c6a8872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:27.566352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ef02ae7-8e10-4041-836a-07717c6a8872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:27.567164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ef02ae7-8e10-4041-836a-07717c6a8872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:27.567596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ef02ae7-8e10-4041-836a-07717c6a8872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:27.661808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e444c216-f198-41ec-adf7-fca67ce3bdae tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:27.663003 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e444c216-f198-41ec-adf7-fca67ce3bdae tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:27.672067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e444c216-f198-41ec-adf7-fca67ce3bdae tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:27.672712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e444c216-f198-41ec-adf7-fca67ce3bdae tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:27.673786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e444c216-f198-41ec-adf7-fca67ce3bdae tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:27.675112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e444c216-f198-41ec-adf7-fca67ce3bdae tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:27.780133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9ef02ae7-8e10-4041-836a-07717c6a8872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:27.789999 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9ef02ae7-8e10-4041-836a-07717c6a8872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.238551 Aug 02 07:07:27.790910 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2000/4101] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:27 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:27.821625 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4e997e28-1151-4638-80f0-eae48c13d508 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:27.822688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4e997e28-1151-4638-80f0-eae48c13d508 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:27.829925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e997e28-1151-4638-80f0-eae48c13d508 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:27.830906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e997e28-1151-4638-80f0-eae48c13d508 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:27.832058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e997e28-1151-4638-80f0-eae48c13d508 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:27.832800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e997e28-1151-4638-80f0-eae48c13d508 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:27.875697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e444c216-f198-41ec-adf7-fca67ce3bdae tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:27.887184 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e444c216-f198-41ec-adf7-fca67ce3bdae tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3" status: 200 len: 1472 microversion: 2.1 time: 0.228984 Aug 02 07:07:27.889015 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2102/4102] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:27 2022] GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 => generated 1472 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:07:27.900855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4e10899b-0943-4bad-a84e-a1b84c12dc98 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:27.904687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4e10899b-0943-4bad-a84e-a1b84c12dc98 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:27.913573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e10899b-0943-4bad-a84e-a1b84c12dc98 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:27.915119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e10899b-0943-4bad-a84e-a1b84c12dc98 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:27.916469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e10899b-0943-4bad-a84e-a1b84c12dc98 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:27.917918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e10899b-0943-4bad-a84e-a1b84c12dc98 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:27.947334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4e997e28-1151-4638-80f0-eae48c13d508 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:27.959114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4e997e28-1151-4638-80f0-eae48c13d508 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:27.966564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4e997e28-1151-4638-80f0-eae48c13d508 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:27.967886 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4e997e28-1151-4638-80f0-eae48c13d508 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.175635 Aug 02 07:07:27.968563 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2001/4103] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:27 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:27.989595 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4e10899b-0943-4bad-a84e-a1b84c12dc98 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 200 len: 324 microversion: 2.1 time: 0.098941 Aug 02 07:07:27.990292 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2103/4104] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:07:27 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 324 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:28.000774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8a8c6502-da13-48f0-899d-a27fd26a828e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:28.001387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8a8c6502-da13-48f0-899d-a27fd26a828e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:28.010032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a8c6502-da13-48f0-899d-a27fd26a828e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:28.010032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a8c6502-da13-48f0-899d-a27fd26a828e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:28.010304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a8c6502-da13-48f0-899d-a27fd26a828e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:28.010646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a8c6502-da13-48f0-899d-a27fd26a828e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:28.061099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1665560654", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:28.124488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] validate_networks() for [('ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:07:28.237546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8a8c6502-da13-48f0-899d-a27fd26a828e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:28.248598 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8a8c6502-da13-48f0-899d-a27fd26a828e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.252208 Aug 02 07:07:28.249282 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2002/4105] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:27 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:07:28.255913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1e558c9a-0de5-4f5e-a396-24f68c5f5917 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:28.256870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1e558c9a-0de5-4f5e-a396-24f68c5f5917 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:28.264520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e558c9a-0de5-4f5e-a396-24f68c5f5917 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:28.265427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e558c9a-0de5-4f5e-a396-24f68c5f5917 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:28.266644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e558c9a-0de5-4f5e-a396-24f68c5f5917 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:28.267256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e558c9a-0de5-4f5e-a396-24f68c5f5917 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:28.507107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1e558c9a-0de5-4f5e-a396-24f68c5f5917 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:28.516396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1e558c9a-0de5-4f5e-a396-24f68c5f5917 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:28.518170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1e558c9a-0de5-4f5e-a396-24f68c5f5917 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:28.519439 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1e558c9a-0de5-4f5e-a396-24f68c5f5917 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1743 microversion: 2.20 time: 0.269182 Aug 02 07:07:28.520145 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2003/4106] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:28 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1743 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:28.681615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:07:28.682226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:07:28.683053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:07:28.683473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:07:28.683895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:07:28.697507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:28.698404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:28.699514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:28.700132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:28.725751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:07:28.733678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for user 0971d7961d5a4e8996ea2c0f958382ad and project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:07:28.744927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-76f06f08-bc92-4e09-a0c5-0855794908f6 tempest-FlavorsV2NegativeTest-1994565706 tempest-FlavorsV2NegativeTest-1994565706-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:28.750560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:07:28.753243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 6d0f8e23-78a8-4d3c-91d8-45662b249654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:07:28.759381 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-76f06f08-bc92-4e09-a0c5-0855794908f6 tempest-FlavorsV2NegativeTest-1994565706 tempest-FlavorsV2NegativeTest-1994565706-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.237946 Aug 02 07:07:28.786284 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2004/4107] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 07:07:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:28.791822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4a563dc0-0067-4163-a857-ca0d48653824 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:28.792909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4a563dc0-0067-4163-a857-ca0d48653824 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:28.805939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a563dc0-0067-4163-a857-ca0d48653824 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:28.806767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a563dc0-0067-4163-a857-ca0d48653824 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:28.808429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a563dc0-0067-4163-a857-ca0d48653824 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:28.809084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a563dc0-0067-4163-a857-ca0d48653824 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:28.829281 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2f3bcc86-bad2-42bf-9a48-8e7d24f1eb5d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772815 Aug 02 07:07:28.830741 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2104/4108] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:07:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 07:07:28.850342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a8c255c0-5207-42bf-bcef-422e29321c17 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:28.852531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a8c255c0-5207-42bf-bcef-422e29321c17 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 6d0f8e23-78a8-4d3c-91d8-45662b249654] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:28.884813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a8c255c0-5207-42bf-bcef-422e29321c17 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 6d0f8e23-78a8-4d3c-91d8-45662b249654] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:07:28.900574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:29.138941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4a563dc0-0067-4163-a857-ca0d48653824 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:29.151848 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4a563dc0-0067-4163-a857-ca0d48653824 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.363935 Aug 02 07:07:29.168859 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2005/4109] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:28 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:29.177484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ae9be2a2-e29c-4e5d-99f3-cd5145c70592 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:29.178973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ae9be2a2-e29c-4e5d-99f3-cd5145c70592 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:29.191183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae9be2a2-e29c-4e5d-99f3-cd5145c70592 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:29.192589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae9be2a2-e29c-4e5d-99f3-cd5145c70592 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:29.193850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae9be2a2-e29c-4e5d-99f3-cd5145c70592 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:29.194809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae9be2a2-e29c-4e5d-99f3-cd5145c70592 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:29.310841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ae9be2a2-e29c-4e5d-99f3-cd5145c70592 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:29.323531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ae9be2a2-e29c-4e5d-99f3-cd5145c70592 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:29.325606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ae9be2a2-e29c-4e5d-99f3-cd5145c70592 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:29.327232 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ae9be2a2-e29c-4e5d-99f3-cd5145c70592 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.157050 Aug 02 07:07:29.338306 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2006/4110] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:29 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:29.352873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ae2eec4-44c4-46c4-b9b1-b5a0e0566273 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:29.359912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ae2eec4-44c4-46c4-b9b1-b5a0e0566273 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:29.381512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ae2eec4-44c4-46c4-b9b1-b5a0e0566273 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:29.381865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ae2eec4-44c4-46c4-b9b1-b5a0e0566273 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:29.390365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ae2eec4-44c4-46c4-b9b1-b5a0e0566273 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:29.391076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ae2eec4-44c4-46c4-b9b1-b5a0e0566273 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:29.626572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:29.663425 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.scheduler.client.report [None req-a8c255c0-5207-42bf-bcef-422e29321c17 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Deleted allocations for instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 Aug 02 07:07:29.671016 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.compute.api [None req-a8c255c0-5207-42bf-bcef-422e29321c17 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 6d0f8e23-78a8-4d3c-91d8-45662b249654] Instance Mapping does not exist while attempting local delete cleanup. Aug 02 07:07:29.672737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ae2eec4-44c4-46c4-b9b1-b5a0e0566273 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:29.674702 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a8c255c0-5207-42bf-bcef-422e29321c17 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6d0f8e23-78a8-4d3c-91d8-45662b249654" status: 204 len: 0 microversion: 2.1 time: 0.836242 Aug 02 07:07:29.677395 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2105/4111] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:07:28 2022] DELETE /compute/v2.1/servers/6d0f8e23-78a8-4d3c-91d8-45662b249654 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:07:29.681190 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ae2eec4-44c4-46c4-b9b1-b5a0e0566273 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.340518 Aug 02 07:07:29.681783 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2007/4112] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:29 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:29.688279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a068733d-630e-4317-b181-dfd7b217ed6a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:29.689285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a068733d-630e-4317-b181-dfd7b217ed6a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 6d0f8e23-78a8-4d3c-91d8-45662b249654] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:29.702513 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-a068733d-630e-4317-b181-dfd7b217ed6a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a068733d-630e-4317-b181-dfd7b217ed6a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/6d0f8e23-78a8-4d3c-91d8-45662b249654 HTTP/1.1 Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '6d0f8e23-78a8-4d3c-91d8-45662b249654'} Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:29.706939 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:07:29.711581 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:07:29.711581 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:07:29.711581 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:07:29.711581 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:07:29.711581 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:29.711581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a068733d-630e-4317-b181-dfd7b217ed6a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:07:29.711581 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a068733d-630e-4317-b181-dfd7b217ed6a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/6d0f8e23-78a8-4d3c-91d8-45662b249654" status: 404 len: 111 microversion: 2.1 time: 0.022240 Aug 02 07:07:29.711581 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2008/4113] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:29 2022] GET /compute/v2.1/servers/6d0f8e23-78a8-4d3c-91d8-45662b249654 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:07:29.725982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d1935b3d-43ba-4c90-9c01-b6da62340206 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:29.727533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ad4f0904-e7ce-4f5c-b066-c4baa53acda2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:29.728063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d1935b3d-43ba-4c90-9c01-b6da62340206 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:29.728890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ad4f0904-e7ce-4f5c-b066-c4baa53acda2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:29.736002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1935b3d-43ba-4c90-9c01-b6da62340206 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:29.736606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1935b3d-43ba-4c90-9c01-b6da62340206 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:29.737513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1935b3d-43ba-4c90-9c01-b6da62340206 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:29.738520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1935b3d-43ba-4c90-9c01-b6da62340206 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:29.739692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ad4f0904-e7ce-4f5c-b066-c4baa53acda2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:29.740549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ad4f0904-e7ce-4f5c-b066-c4baa53acda2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:29.741849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ad4f0904-e7ce-4f5c-b066-c4baa53acda2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:29.742669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ad4f0904-e7ce-4f5c-b066-c4baa53acda2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:29.983687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d1935b3d-43ba-4c90-9c01-b6da62340206 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:29.992918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d1935b3d-43ba-4c90-9c01-b6da62340206 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:29.993387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ad4f0904-e7ce-4f5c-b066-c4baa53acda2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:29.994871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d1935b3d-43ba-4c90-9c01-b6da62340206 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:29.996958 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d1935b3d-43ba-4c90-9c01-b6da62340206 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1743 microversion: 2.20 time: 0.317693 Aug 02 07:07:29.998306 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2106/4114] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:29 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1743 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:30.003561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7973edb0-8eda-4e67-abac-b247875a367f tempest-FlavorsV2NegativeTest-1994565706 tempest-FlavorsV2NegativeTest-1994565706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1058615317", "imageRef": "2f936e50-361c-42f9-9cf5-8701b09ccb14", "flavorRef": "452"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:30.028798 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ad4f0904-e7ce-4f5c-b066-c4baa53acda2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.313249 Aug 02 07:07:30.029556 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2009/4115] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:29 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:30.043294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-424439457", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:30.061804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-7973edb0-8eda-4e67-abac-b247875a367f tempest-FlavorsV2NegativeTest-1994565706 tempest-FlavorsV2NegativeTest-1994565706-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:07:30.116987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] validate_networks() for [('ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:07:30.442452 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-7973edb0-8eda-4e67-abac-b247875a367f tempest-FlavorsV2NegativeTest-1994565706 tempest-FlavorsV2NegativeTest-1994565706-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7973edb0-8eda-4e67-abac-b247875a367f tempest-FlavorsV2NegativeTest-1994565706 tempest-FlavorsV2NegativeTest-1994565706-project] Request method failure captured: Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 143 Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M0wxoI-Krm2kD9X7jqLVlIBEh3tc23OYKYajijfROHkEh5U3MMbhT3Oplh-JNBu5FfacWV1lQeuMPKCBLyHiS2kFjeDQYaZPDh4cqpGDnXtA_Td9pzWzbKr-uOHKjkDTys6RE1gDp3VFE2CFwK0wDNMa0RGU1elTQWZd2PEt1tA0gA Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2b7da71a8d964de7bfdfd0839bafc1f0 Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-FlavorsV2NegativeTest-1994565706 Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2b7da71a8d964de7bfdfd0839bafc1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2b7da71a8d964de7bfdfd0839bafc1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2b7da71a8d964de7bfdfd0839bafc1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2b7da71a8d964de7bfdfd0839bafc1f0"}]}] Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-FlavorsV2NegativeTest-1994565706 Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2b7da71a8d964de7bfdfd0839bafc1f0 Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1994565706 Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-FlavorsV2NegativeTest-1994565706-project Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 14b3e9b800dc4b29a5ee852f47341d30 Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-FlavorsV2NegativeTest-1994565706-project Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1058615317", "imageRef": "2f936e50-361c-42f9-9cf5-8701b09ccb14", "flavorRef": "452"}} Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: exception: Flavor's memory is too small for requested image. Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1058615317', 'imageRef': '2f936e50-361c-42f9-9cf5-8701b09ccb14', 'flavorRef': '452'}}} Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:07:30.445274 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 02 07:07:30.451085 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:07:30.456709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7973edb0-8eda-4e67-abac-b247875a367f tempest-FlavorsV2NegativeTest-1994565706 tempest-FlavorsV2NegativeTest-1994565706-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:07:30.458860 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7973edb0-8eda-4e67-abac-b247875a367f tempest-FlavorsV2NegativeTest-1994565706 tempest-FlavorsV2NegativeTest-1994565706-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.458790 Aug 02 07:07:30.461552 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2107/4116] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:07:29 2022] POST /compute/v2.1/servers => generated 93 bytes in 462 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 02 07:07:30.471851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1844409466", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "4a2e64a4-c6ee-43d5-bb6a-002018e2c279"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:30.561557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] validate_networks() for [('4a2e64a4-c6ee-43d5-bb6a-002018e2c279', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:07:31.210397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:07:31.211352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:07:31.212019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:07:31.212594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:07:31.213169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:07:31.232431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:31.235276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:31.236319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:31.239674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:31.284202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:07:31.303750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for user 0971d7961d5a4e8996ea2c0f958382ad and project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:07:31.319516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:07:31.322332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:07:31.374094 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2f9b80a3-707e-4e0d-8694-900f9d7a26c8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.342770 Aug 02 07:07:31.374688 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2010/4117] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:07:31.382693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8813a2ba-2437-413e-ade5-b594f2c6553c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:31.383640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8813a2ba-2437-413e-ade5-b594f2c6553c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:31.391820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8813a2ba-2437-413e-ade5-b594f2c6553c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:31.392589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8813a2ba-2437-413e-ade5-b594f2c6553c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:31.393594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8813a2ba-2437-413e-ade5-b594f2c6553c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:31.394225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8813a2ba-2437-413e-ade5-b594f2c6553c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:31.898106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:07:31.899350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:07:31.899998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:07:31.900577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:07:31.901157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:07:31.916627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:31.917080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:31.917910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:31.918356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:31.968194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8813a2ba-2437-413e-ade5-b594f2c6553c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:31.976719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Getting quotas for project daaad725b62041d1ac0af9ff8efcdfc5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:07:31.983006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8813a2ba-2437-413e-ade5-b594f2c6553c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:31.984522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8813a2ba-2437-413e-ade5-b594f2c6553c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:31.985777 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8813a2ba-2437-413e-ade5-b594f2c6553c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.610120 Aug 02 07:07:31.990612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Getting quotas for user 35f9bc6690f3473a99804c14351b93b6 and project daaad725b62041d1ac0af9ff8efcdfc5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:07:32.006398 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2011/4118] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:31 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:32.017569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-598d1e28-2c25-4d37-898b-c3ae04ba7612 req-ba0c423c-44f6-4d85-8d51-803fa1f1aab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9ae016-6a95-4257-8d74-99fcd50ae1cb", "name": "network-vif-plugged", "status": "completed", "tag": "3ee7c406-2514-4927-ba77-18750ac8d2ab"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:32.040326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:32.045128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:07:32.046733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-598d1e28-2c25-4d37-898b-c3ae04ba7612 req-ba0c423c-44f6-4d85-8d51-803fa1f1aab7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:32.047179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-598d1e28-2c25-4d37-898b-c3ae04ba7612 req-ba0c423c-44f6-4d85-8d51-803fa1f1aab7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:32.053938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:07:32.074349 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-598d1e28-2c25-4d37-898b-c3ae04ba7612 req-ba0c423c-44f6-4d85-8d51-803fa1f1aab7 service nova] Creating event network-vif-plugged:3ee7c406-2514-4927-ba77-18750ac8d2ab for instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb on n-h1-851337-3 Aug 02 07:07:32.090699 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-598d1e28-2c25-4d37-898b-c3ae04ba7612 req-ba0c423c-44f6-4d85-8d51-803fa1f1aab7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082694 Aug 02 07:07:32.091512 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2012/4119] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:32.097881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34895f0c-44cd-46f2-ade0-dc0f16b66001 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:32.102134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-34895f0c-44cd-46f2-ade0-dc0f16b66001 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:32.116068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34895f0c-44cd-46f2-ade0-dc0f16b66001 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:32.116773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34895f0c-44cd-46f2-ade0-dc0f16b66001 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:32.117809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34895f0c-44cd-46f2-ade0-dc0f16b66001 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:32.118469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34895f0c-44cd-46f2-ade0-dc0f16b66001 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:32.152165 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fc94d7fd-a423-40b0-99b5-f9ad689f64a0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.687013 Aug 02 07:07:32.153425 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2108/4120] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:07:32.164579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6472fb2d-7087-4d51-bd85-5c47f9adfad3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:32.165504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6472fb2d-7087-4d51-bd85-5c47f9adfad3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:32.423831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6472fb2d-7087-4d51-bd85-5c47f9adfad3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:32.432731 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6472fb2d-7087-4d51-bd85-5c47f9adfad3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1220 microversion: 2.1 time: 0.277967 Aug 02 07:07:32.448919 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2109/4121] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:32 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1220 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:32.455179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2fc60a4c-2480-48e5-990b-60a83b583190 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:32.456166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2fc60a4c-2480-48e5-990b-60a83b583190 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:32.613234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2fc60a4c-2480-48e5-990b-60a83b583190 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:32.624890 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2fc60a4c-2480-48e5-990b-60a83b583190 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1215 microversion: 2.1 time: 0.174104 Aug 02 07:07:32.628162 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2110/4122] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:32 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:32.683283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-34895f0c-44cd-46f2-ade0-dc0f16b66001 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:32.702177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-34895f0c-44cd-46f2-ade0-dc0f16b66001 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:32.703911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-34895f0c-44cd-46f2-ade0-dc0f16b66001 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:32.708844 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-34895f0c-44cd-46f2-ade0-dc0f16b66001 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1743 microversion: 2.20 time: 0.615876 Aug 02 07:07:32.709531 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2013/4123] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:32 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1743 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:33.026376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-db06b22e-fce0-483a-952e-33b51f8dd6b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:33.028094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-db06b22e-fce0-483a-952e-33b51f8dd6b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:33.078036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db06b22e-fce0-483a-952e-33b51f8dd6b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:33.079188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db06b22e-fce0-483a-952e-33b51f8dd6b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:33.081184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db06b22e-fce0-483a-952e-33b51f8dd6b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:33.081994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db06b22e-fce0-483a-952e-33b51f8dd6b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:33.194391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-db06b22e-fce0-483a-952e-33b51f8dd6b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:33.221223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-db06b22e-fce0-483a-952e-33b51f8dd6b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:33.234746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-db06b22e-fce0-483a-952e-33b51f8dd6b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:33.238599 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-db06b22e-fce0-483a-952e-33b51f8dd6b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.219826 Aug 02 07:07:33.241925 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2111/4124] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:33 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:33.457230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fb8a943d-12a8-4b72-9c42-770e41dfe5b1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:33.458127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fb8a943d-12a8-4b72-9c42-770e41dfe5b1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:33.474870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb8a943d-12a8-4b72-9c42-770e41dfe5b1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:33.476488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb8a943d-12a8-4b72-9c42-770e41dfe5b1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:33.477504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb8a943d-12a8-4b72-9c42-770e41dfe5b1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:33.479155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb8a943d-12a8-4b72-9c42-770e41dfe5b1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:33.545136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:33.649188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b98b9f4-fa22-42f3-9a08-cd001a00f977 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:33.650699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b98b9f4-fa22-42f3-9a08-cd001a00f977 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:33.672476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fb8a943d-12a8-4b72-9c42-770e41dfe5b1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:33.682613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b98b9f4-fa22-42f3-9a08-cd001a00f977 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:33.687553 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fb8a943d-12a8-4b72-9c42-770e41dfe5b1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1280 microversion: 2.1 time: 0.236672 Aug 02 07:07:33.689714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b98b9f4-fa22-42f3-9a08-cd001a00f977 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:33.692375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b98b9f4-fa22-42f3-9a08-cd001a00f977 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:33.692830 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2014/4125] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:33 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1280 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:33.697883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b98b9f4-fa22-42f3-9a08-cd001a00f977 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:33.737035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a4854510-5143-4752-acfc-ac7bfed4b931 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:33.738076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a4854510-5143-4752-acfc-ac7bfed4b931 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:33.751593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4854510-5143-4752-acfc-ac7bfed4b931 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:33.753039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4854510-5143-4752-acfc-ac7bfed4b931 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:33.754577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4854510-5143-4752-acfc-ac7bfed4b931 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:33.755246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4854510-5143-4752-acfc-ac7bfed4b931 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:33.936743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7b98b9f4-fa22-42f3-9a08-cd001a00f977 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:33.945987 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b98b9f4-fa22-42f3-9a08-cd001a00f977 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1267 microversion: 2.1 time: 0.300876 Aug 02 07:07:33.953798 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2112/4126] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:33 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1267 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:34.099351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a4854510-5143-4752-acfc-ac7bfed4b931 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:34.114367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a4854510-5143-4752-acfc-ac7bfed4b931 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:34.116321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a4854510-5143-4752-acfc-ac7bfed4b931 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:34.117805 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a4854510-5143-4752-acfc-ac7bfed4b931 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 0.385506 Aug 02 07:07:34.120694 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2015/4127] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:33 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:34.267185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-852447de-505e-4c47-9c6e-8db870aed83d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:34.268397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-852447de-505e-4c47-9c6e-8db870aed83d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:34.291563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-852447de-505e-4c47-9c6e-8db870aed83d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:34.293932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-852447de-505e-4c47-9c6e-8db870aed83d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:34.297544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-852447de-505e-4c47-9c6e-8db870aed83d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:34.304592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-852447de-505e-4c47-9c6e-8db870aed83d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:34.717029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-afbc77e1-1ffd-46d7-a2d9-fd95a9b7bbf1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:34.721841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-afbc77e1-1ffd-46d7-a2d9-fd95a9b7bbf1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:34.746108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-afbc77e1-1ffd-46d7-a2d9-fd95a9b7bbf1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:34.750450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-afbc77e1-1ffd-46d7-a2d9-fd95a9b7bbf1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:34.752684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-afbc77e1-1ffd-46d7-a2d9-fd95a9b7bbf1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:34.755964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-afbc77e1-1ffd-46d7-a2d9-fd95a9b7bbf1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:34.809556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-852447de-505e-4c47-9c6e-8db870aed83d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:34.821201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-852447de-505e-4c47-9c6e-8db870aed83d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:34.830201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-852447de-505e-4c47-9c6e-8db870aed83d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:34.835627 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-852447de-505e-4c47-9c6e-8db870aed83d tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.573087 Aug 02 07:07:34.850407 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2113/4128] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:34 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:34.977638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0dbbe171-3350-405b-b9a2-69b44a90c076 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:34.978496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0dbbe171-3350-405b-b9a2-69b44a90c076 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:34.991947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0dbbe171-3350-405b-b9a2-69b44a90c076 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:34.992657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0dbbe171-3350-405b-b9a2-69b44a90c076 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:34.993633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0dbbe171-3350-405b-b9a2-69b44a90c076 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:34.994251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0dbbe171-3350-405b-b9a2-69b44a90c076 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:35.434476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0dbbe171-3350-405b-b9a2-69b44a90c076 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:35.448966 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0dbbe171-3350-405b-b9a2-69b44a90c076 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1273 microversion: 2.1 time: 0.473760 Aug 02 07:07:35.466686 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2114/4129] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:34 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1273 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:35.477155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6d73cbe4-2841-4483-bfb6-79e9715b28c0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:35.480648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6d73cbe4-2841-4483-bfb6-79e9715b28c0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:35.496832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d73cbe4-2841-4483-bfb6-79e9715b28c0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:35.498521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d73cbe4-2841-4483-bfb6-79e9715b28c0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:35.500911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d73cbe4-2841-4483-bfb6-79e9715b28c0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:35.502480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6d73cbe4-2841-4483-bfb6-79e9715b28c0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:36.269181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-afbc77e1-1ffd-46d7-a2d9-fd95a9b7bbf1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:36.280989 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-afbc77e1-1ffd-46d7-a2d9-fd95a9b7bbf1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1320 microversion: 2.1 time: 1.571832 Aug 02 07:07:36.283357 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2016/4130] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:34 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1320 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:36.294628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1e08a358-8c73-4a4d-bf18-abb960c60e2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:36.306383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1e08a358-8c73-4a4d-bf18-abb960c60e2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:36.313503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e08a358-8c73-4a4d-bf18-abb960c60e2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:36.314337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e08a358-8c73-4a4d-bf18-abb960c60e2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:36.315386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e08a358-8c73-4a4d-bf18-abb960c60e2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:36.317249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e08a358-8c73-4a4d-bf18-abb960c60e2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:36.535813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1e08a358-8c73-4a4d-bf18-abb960c60e2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:36.561668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1e08a358-8c73-4a4d-bf18-abb960c60e2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:36.568554 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1e08a358-8c73-4a4d-bf18-abb960c60e2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:36.579367 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1e08a358-8c73-4a4d-bf18-abb960c60e2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.294636 Aug 02 07:07:36.580603 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2017/4131] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:36 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:36.590944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5a0369b9-ea1f-4497-881b-c6fc21c7e9c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:36.599449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5a0369b9-ea1f-4497-881b-c6fc21c7e9c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:36.610746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a0369b9-ea1f-4497-881b-c6fc21c7e9c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:36.619694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a0369b9-ea1f-4497-881b-c6fc21c7e9c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:36.621078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a0369b9-ea1f-4497-881b-c6fc21c7e9c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:36.622734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a0369b9-ea1f-4497-881b-c6fc21c7e9c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:36.639035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6d73cbe4-2841-4483-bfb6-79e9715b28c0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:36.650822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6d73cbe4-2841-4483-bfb6-79e9715b28c0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:36.678290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6d73cbe4-2841-4483-bfb6-79e9715b28c0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:36.683855 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6d73cbe4-2841-4483-bfb6-79e9715b28c0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 1.215512 Aug 02 07:07:36.684901 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2115/4132] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:35 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:37.176310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5a0369b9-ea1f-4497-881b-c6fc21c7e9c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:37.190074 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5a0369b9-ea1f-4497-881b-c6fc21c7e9c6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1315 microversion: 2.1 time: 0.607777 Aug 02 07:07:37.192812 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2018/4133] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:36 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1315 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:37.317659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-73371a15-f4ff-48d6-8708-b2e9d1648b3a req-08829e7a-1138-4e69-8d27-365cf33ca684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93257197-87b4-4106-a2e4-10447658866a", "tag": "c46402ea-8187-46a1-a94e-d2e1a80152be"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:37.318426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-401b5c7e-f958-476d-9256-bd478bdb0533 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:37.319251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-401b5c7e-f958-476d-9256-bd478bdb0533 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:37.339297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-401b5c7e-f958-476d-9256-bd478bdb0533 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:37.342383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-401b5c7e-f958-476d-9256-bd478bdb0533 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:37.343886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-73371a15-f4ff-48d6-8708-b2e9d1648b3a req-08829e7a-1138-4e69-8d27-365cf33ca684 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:37.345045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-401b5c7e-f958-476d-9256-bd478bdb0533 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:37.345960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-401b5c7e-f958-476d-9256-bd478bdb0533 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:37.346451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-73371a15-f4ff-48d6-8708-b2e9d1648b3a req-08829e7a-1138-4e69-8d27-365cf33ca684 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:37.379036 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-73371a15-f4ff-48d6-8708-b2e9d1648b3a req-08829e7a-1138-4e69-8d27-365cf33ca684 service nova] Creating event network-changed:c46402ea-8187-46a1-a94e-d2e1a80152be for instance 93257197-87b4-4106-a2e4-10447658866a on n-h2-851337-3 Aug 02 07:07:37.393658 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-73371a15-f4ff-48d6-8708-b2e9d1648b3a req-08829e7a-1138-4e69-8d27-365cf33ca684 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083989 Aug 02 07:07:37.406353 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2019/4134] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:37.606003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a318512e-4586-4330-b72b-a60ae57f5786 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:37.607352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a318512e-4586-4330-b72b-a60ae57f5786 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:37.618978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a318512e-4586-4330-b72b-a60ae57f5786 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:37.622141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a318512e-4586-4330-b72b-a60ae57f5786 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:37.624643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a318512e-4586-4330-b72b-a60ae57f5786 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:37.627580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a318512e-4586-4330-b72b-a60ae57f5786 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:37.807622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a318512e-4586-4330-b72b-a60ae57f5786 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:37.818391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a318512e-4586-4330-b72b-a60ae57f5786 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:37.828743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a318512e-4586-4330-b72b-a60ae57f5786 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:37.830682 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a318512e-4586-4330-b72b-a60ae57f5786 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.229539 Aug 02 07:07:37.833647 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2020/4135] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:37 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:37.844566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f21a6ccd-5361-4b5a-9069-787e9b5b24ba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:37.848589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f21a6ccd-5361-4b5a-9069-787e9b5b24ba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:37.882856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f21a6ccd-5361-4b5a-9069-787e9b5b24ba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:37.884393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f21a6ccd-5361-4b5a-9069-787e9b5b24ba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:37.885672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f21a6ccd-5361-4b5a-9069-787e9b5b24ba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:37.887144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f21a6ccd-5361-4b5a-9069-787e9b5b24ba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:37.949120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-401b5c7e-f958-476d-9256-bd478bdb0533 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:37.965522 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-401b5c7e-f958-476d-9256-bd478bdb0533 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1320 microversion: 2.1 time: 0.658769 Aug 02 07:07:37.966882 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2116/4136] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:37 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1320 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:38.236027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b0ce18d3-5369-4084-a166-48c3b01cc373 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:38.236892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b0ce18d3-5369-4084-a166-48c3b01cc373 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:38.272976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0ce18d3-5369-4084-a166-48c3b01cc373 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:38.274106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0ce18d3-5369-4084-a166-48c3b01cc373 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:38.274984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0ce18d3-5369-4084-a166-48c3b01cc373 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:38.281883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0ce18d3-5369-4084-a166-48c3b01cc373 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:38.336466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f21a6ccd-5361-4b5a-9069-787e9b5b24ba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:38.349517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f21a6ccd-5361-4b5a-9069-787e9b5b24ba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:38.354129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f21a6ccd-5361-4b5a-9069-787e9b5b24ba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:38.355907 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f21a6ccd-5361-4b5a-9069-787e9b5b24ba tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 0.520930 Aug 02 07:07:38.380496 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2021/4137] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:37 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:38.768428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b0ce18d3-5369-4084-a166-48c3b01cc373 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:38.782530 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b0ce18d3-5369-4084-a166-48c3b01cc373 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1315 microversion: 2.1 time: 0.570759 Aug 02 07:07:38.798058 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2117/4138] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:38 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:38.865829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f10d3a90-2b3c-439b-b44e-ae3999fbf43b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:38.866724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f10d3a90-2b3c-439b-b44e-ae3999fbf43b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:38.882415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f10d3a90-2b3c-439b-b44e-ae3999fbf43b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:38.883090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f10d3a90-2b3c-439b-b44e-ae3999fbf43b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:38.883949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f10d3a90-2b3c-439b-b44e-ae3999fbf43b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:38.884821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f10d3a90-2b3c-439b-b44e-ae3999fbf43b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:38.958442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f10d3a90-2b3c-439b-b44e-ae3999fbf43b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:38.971701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f10d3a90-2b3c-439b-b44e-ae3999fbf43b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:38.974824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f10d3a90-2b3c-439b-b44e-ae3999fbf43b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:38.977312 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f10d3a90-2b3c-439b-b44e-ae3999fbf43b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.118342 Aug 02 07:07:38.990427 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2022/4139] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:38 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:38.992324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-941036c2-f293-4641-9ebb-b4db007604ab tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:38.993650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-941036c2-f293-4641-9ebb-b4db007604ab tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:39.008672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-941036c2-f293-4641-9ebb-b4db007604ab tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:39.009317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-941036c2-f293-4641-9ebb-b4db007604ab tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:39.018498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-941036c2-f293-4641-9ebb-b4db007604ab tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:39.019710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-941036c2-f293-4641-9ebb-b4db007604ab tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:39.303835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-941036c2-f293-4641-9ebb-b4db007604ab tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:39.314619 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-941036c2-f293-4641-9ebb-b4db007604ab tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1320 microversion: 2.1 time: 0.328972 Aug 02 07:07:39.334325 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2118/4140] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:38 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:39.388805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ba33e30e-d5ed-4689-a979-ffbdf9d1ba87 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:39.390242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ba33e30e-d5ed-4689-a979-ffbdf9d1ba87 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:39.404434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba33e30e-d5ed-4689-a979-ffbdf9d1ba87 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:39.407258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba33e30e-d5ed-4689-a979-ffbdf9d1ba87 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:39.408482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba33e30e-d5ed-4689-a979-ffbdf9d1ba87 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:39.414168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba33e30e-d5ed-4689-a979-ffbdf9d1ba87 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:39.652314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ba33e30e-d5ed-4689-a979-ffbdf9d1ba87 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:39.662763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ba33e30e-d5ed-4689-a979-ffbdf9d1ba87 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:39.667572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ba33e30e-d5ed-4689-a979-ffbdf9d1ba87 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:39.669656 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ba33e30e-d5ed-4689-a979-ffbdf9d1ba87 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 0.286522 Aug 02 07:07:39.711775 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2023/4141] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:39 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:39.808241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f724b13d-4c0a-4678-8776-227b466dcece tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:39.809686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f724b13d-4c0a-4678-8776-227b466dcece tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:39.830267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f724b13d-4c0a-4678-8776-227b466dcece tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:39.832160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f724b13d-4c0a-4678-8776-227b466dcece tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:39.833387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f724b13d-4c0a-4678-8776-227b466dcece tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:39.839538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f724b13d-4c0a-4678-8776-227b466dcece tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:40.003716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-96f24bd6-34f8-4541-9497-110bedf7c336 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:40.005387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-96f24bd6-34f8-4541-9497-110bedf7c336 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:40.018841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96f24bd6-34f8-4541-9497-110bedf7c336 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:40.024268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96f24bd6-34f8-4541-9497-110bedf7c336 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:40.025592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96f24bd6-34f8-4541-9497-110bedf7c336 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:40.026356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96f24bd6-34f8-4541-9497-110bedf7c336 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:40.276800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-96f24bd6-34f8-4541-9497-110bedf7c336 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:40.294109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-96f24bd6-34f8-4541-9497-110bedf7c336 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:40.297986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-96f24bd6-34f8-4541-9497-110bedf7c336 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:40.301144 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-96f24bd6-34f8-4541-9497-110bedf7c336 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.303090 Aug 02 07:07:40.303827 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2024/4142] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:39 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:40.337382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7da2b24b-9197-48d0-b762-1fc69566943f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:40.338202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7da2b24b-9197-48d0-b762-1fc69566943f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:40.349732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7da2b24b-9197-48d0-b762-1fc69566943f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:40.350392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7da2b24b-9197-48d0-b762-1fc69566943f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:40.355952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7da2b24b-9197-48d0-b762-1fc69566943f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:40.356608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7da2b24b-9197-48d0-b762-1fc69566943f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:40.721306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f724b13d-4c0a-4678-8776-227b466dcece tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:40.742010 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f724b13d-4c0a-4678-8776-227b466dcece tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1315 microversion: 2.1 time: 0.935986 Aug 02 07:07:40.743563 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2119/4143] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:39 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:40.755339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8f7d09c5-778e-457e-9e44-8bda9f784b01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:40.757064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8f7d09c5-778e-457e-9e44-8bda9f784b01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:40.769537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7d09c5-778e-457e-9e44-8bda9f784b01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:40.777534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7d09c5-778e-457e-9e44-8bda9f784b01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:40.779092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7d09c5-778e-457e-9e44-8bda9f784b01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:40.779745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7d09c5-778e-457e-9e44-8bda9f784b01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:41.226964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7da2b24b-9197-48d0-b762-1fc69566943f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:41.236188 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7da2b24b-9197-48d0-b762-1fc69566943f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1320 microversion: 2.1 time: 0.903234 Aug 02 07:07:41.241633 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2025/4144] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:40 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1320 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:41.251600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:41.264647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c09b2a14-e608-40a4-809a-8f64eea74451 req-d8095928-ee49-4ab1-a7ed-71cc684726ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d415b6-b9f4-4c0c-bd81-67d9b571ea81", "tag": "21354a97-6003-4b29-b2d1-6d99fd2581b8"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:41.285843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c09b2a14-e608-40a4-809a-8f64eea74451 req-d8095928-ee49-4ab1-a7ed-71cc684726ca service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:41.286836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c09b2a14-e608-40a4-809a-8f64eea74451 req-d8095928-ee49-4ab1-a7ed-71cc684726ca service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:41.305111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8f7d09c5-778e-457e-9e44-8bda9f784b01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:41.313942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8f7d09c5-778e-457e-9e44-8bda9f784b01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:41.315283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:41.315485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8f7d09c5-778e-457e-9e44-8bda9f784b01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:41.316668 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8f7d09c5-778e-457e-9e44-8bda9f784b01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 0.571711 Aug 02 07:07:41.325245 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2120/4145] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:40 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:41.332914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8c2397fc-6194-486f-ba2f-034d5cac5159 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:41.337225 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c09b2a14-e608-40a4-809a-8f64eea74451 req-d8095928-ee49-4ab1-a7ed-71cc684726ca service nova] Creating event network-changed:21354a97-6003-4b29-b2d1-6d99fd2581b8 for instance 03d415b6-b9f4-4c0c-bd81-67d9b571ea81 on n-h2-851337-3 Aug 02 07:07:41.340548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8c2397fc-6194-486f-ba2f-034d5cac5159 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:41.354871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c2397fc-6194-486f-ba2f-034d5cac5159 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:41.357862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c2397fc-6194-486f-ba2f-034d5cac5159 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:41.359089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c2397fc-6194-486f-ba2f-034d5cac5159 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:41.359734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c2397fc-6194-486f-ba2f-034d5cac5159 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:41.397305 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c09b2a14-e608-40a4-809a-8f64eea74451 req-d8095928-ee49-4ab1-a7ed-71cc684726ca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153809 Aug 02 07:07:41.422095 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2026/4146] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:41.533274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8c2397fc-6194-486f-ba2f-034d5cac5159 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:41.545204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8c2397fc-6194-486f-ba2f-034d5cac5159 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:41.548446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8c2397fc-6194-486f-ba2f-034d5cac5159 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:41.550187 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8c2397fc-6194-486f-ba2f-034d5cac5159 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.223469 Aug 02 07:07:41.551318 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2121/4147] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:41 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:41.766822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-87b97df1-0fc6-44b9-8755-e51741ac3ad3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:41.767545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-87b97df1-0fc6-44b9-8755-e51741ac3ad3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:41.787673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87b97df1-0fc6-44b9-8755-e51741ac3ad3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:41.788138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87b97df1-0fc6-44b9-8755-e51741ac3ad3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:41.788944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87b97df1-0fc6-44b9-8755-e51741ac3ad3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:41.789383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87b97df1-0fc6-44b9-8755-e51741ac3ad3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:42.070036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-87b97df1-0fc6-44b9-8755-e51741ac3ad3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:42.085332 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-87b97df1-0fc6-44b9-8755-e51741ac3ad3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1315 microversion: 2.1 time: 0.323744 Aug 02 07:07:42.086735 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2027/4148] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:41 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:42.269126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44993585-aafe-4e09-ab0b-0b829f880c83 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:42.269781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-44993585-aafe-4e09-ab0b-0b829f880c83 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:42.279692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:42.289037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44993585-aafe-4e09-ab0b-0b829f880c83 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:42.290611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44993585-aafe-4e09-ab0b-0b829f880c83 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:42.292178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44993585-aafe-4e09-ab0b-0b829f880c83 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:42.295361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44993585-aafe-4e09-ab0b-0b829f880c83 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:42.357686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ef9abd3e-5d1c-4501-98ed-e869a1246651 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:42.358558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ef9abd3e-5d1c-4501-98ed-e869a1246651 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:42.373176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef9abd3e-5d1c-4501-98ed-e869a1246651 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:42.376276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef9abd3e-5d1c-4501-98ed-e869a1246651 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:42.377710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef9abd3e-5d1c-4501-98ed-e869a1246651 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:42.380870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef9abd3e-5d1c-4501-98ed-e869a1246651 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:42.601988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-44993585-aafe-4e09-ab0b-0b829f880c83 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:42.611294 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-44993585-aafe-4e09-ab0b-0b829f880c83 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1320 microversion: 2.1 time: 0.346640 Aug 02 07:07:42.630311 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2122/4149] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:42 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1320 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:42.642406 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0993ea4a-2694-483e-82ec-42e68f3000b7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:42.643342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0993ea4a-2694-483e-82ec-42e68f3000b7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:42.649074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=18 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:42.651604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0993ea4a-2694-483e-82ec-42e68f3000b7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:42.652311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0993ea4a-2694-483e-82ec-42e68f3000b7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:42.653518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0993ea4a-2694-483e-82ec-42e68f3000b7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:42.654182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0993ea4a-2694-483e-82ec-42e68f3000b7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:42.680895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:42.851012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0993ea4a-2694-483e-82ec-42e68f3000b7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:42.885669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0993ea4a-2694-483e-82ec-42e68f3000b7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:42.892280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0993ea4a-2694-483e-82ec-42e68f3000b7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:42.898443 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0993ea4a-2694-483e-82ec-42e68f3000b7 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.264812 Aug 02 07:07:42.899790 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2123/4150] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:42 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:42.955575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ef9abd3e-5d1c-4501-98ed-e869a1246651 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:42.967481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ef9abd3e-5d1c-4501-98ed-e869a1246651 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:42.969559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ef9abd3e-5d1c-4501-98ed-e869a1246651 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:42.971201 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ef9abd3e-5d1c-4501-98ed-e869a1246651 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 0.619098 Aug 02 07:07:42.971977 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2028/4151] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:42 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:43.110210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-914edaac-5624-45e6-a56c-0a86222a9a97 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:43.110841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-914edaac-5624-45e6-a56c-0a86222a9a97 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:43.121546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-914edaac-5624-45e6-a56c-0a86222a9a97 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:43.124189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-914edaac-5624-45e6-a56c-0a86222a9a97 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:43.125044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-914edaac-5624-45e6-a56c-0a86222a9a97 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:43.125320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-914edaac-5624-45e6-a56c-0a86222a9a97 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:43.433210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-914edaac-5624-45e6-a56c-0a86222a9a97 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:43.444017 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-914edaac-5624-45e6-a56c-0a86222a9a97 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1315 microversion: 2.1 time: 0.338137 Aug 02 07:07:43.451321 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2124/4152] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:43 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:43.652105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-12520541-5b3b-4948-bf5b-20bd42674393 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:43.653731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-12520541-5b3b-4948-bf5b-20bd42674393 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:43.664026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12520541-5b3b-4948-bf5b-20bd42674393 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:43.664162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12520541-5b3b-4948-bf5b-20bd42674393 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:43.664948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12520541-5b3b-4948-bf5b-20bd42674393 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:43.665389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12520541-5b3b-4948-bf5b-20bd42674393 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:43.929718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ff94a30-8b34-41eb-80ce-bc09ad1e5dfa tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:43.930852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2ff94a30-8b34-41eb-80ce-bc09ad1e5dfa tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:43.953750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ff94a30-8b34-41eb-80ce-bc09ad1e5dfa tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:43.954778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ff94a30-8b34-41eb-80ce-bc09ad1e5dfa tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:43.955832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ff94a30-8b34-41eb-80ce-bc09ad1e5dfa tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:43.956513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ff94a30-8b34-41eb-80ce-bc09ad1e5dfa tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:44.158184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2ff94a30-8b34-41eb-80ce-bc09ad1e5dfa tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:44.175050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2ff94a30-8b34-41eb-80ce-bc09ad1e5dfa tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:44.176921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2ff94a30-8b34-41eb-80ce-bc09ad1e5dfa tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:44.178553 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2ff94a30-8b34-41eb-80ce-bc09ad1e5dfa tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.257156 Aug 02 07:07:44.180310 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2125/4153] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:43 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:44.180652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-12520541-5b3b-4948-bf5b-20bd42674393 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:44.191904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f6f3008c-3e62-4ede-9a67-35460398d21d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:44.195971 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-12520541-5b3b-4948-bf5b-20bd42674393 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1320 microversion: 2.1 time: 0.555546 Aug 02 07:07:44.197397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f6f3008c-3e62-4ede-9a67-35460398d21d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:44.208818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6f3008c-3e62-4ede-9a67-35460398d21d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:44.211995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6f3008c-3e62-4ede-9a67-35460398d21d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:44.213994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6f3008c-3e62-4ede-9a67-35460398d21d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:44.214289 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2029/4154] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:43 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1320 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:44.216934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6f3008c-3e62-4ede-9a67-35460398d21d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:44.474391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-121555e9-c951-4516-a64e-24c9c768ae92 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:44.475295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-121555e9-c951-4516-a64e-24c9c768ae92 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:44.493700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-121555e9-c951-4516-a64e-24c9c768ae92 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:44.497129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-121555e9-c951-4516-a64e-24c9c768ae92 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:44.498925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-121555e9-c951-4516-a64e-24c9c768ae92 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:44.500021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-121555e9-c951-4516-a64e-24c9c768ae92 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:44.524212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f6f3008c-3e62-4ede-9a67-35460398d21d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:44.535651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f6f3008c-3e62-4ede-9a67-35460398d21d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:44.543850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f6f3008c-3e62-4ede-9a67-35460398d21d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:44.551442 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f6f3008c-3e62-4ede-9a67-35460398d21d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 0.369607 Aug 02 07:07:44.552458 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2126/4155] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:44 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:44.843409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-121555e9-c951-4516-a64e-24c9c768ae92 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:44.853284 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-121555e9-c951-4516-a64e-24c9c768ae92 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1315 microversion: 2.1 time: 0.385749 Aug 02 07:07:44.882975 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2030/4156] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:44 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:07:45.215956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e6242796-d7b0-4feb-abd1-55c5d1067a9b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:45.216772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e6242796-d7b0-4feb-abd1-55c5d1067a9b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:45.217434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5ffb243f-e793-48b3-bac8-e131b717cfd3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:45.218427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5ffb243f-e793-48b3-bac8-e131b717cfd3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:45.227350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ffb243f-e793-48b3-bac8-e131b717cfd3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:45.227798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ffb243f-e793-48b3-bac8-e131b717cfd3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:45.228610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ffb243f-e793-48b3-bac8-e131b717cfd3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:45.229043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ffb243f-e793-48b3-bac8-e131b717cfd3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:45.243923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6242796-d7b0-4feb-abd1-55c5d1067a9b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:45.244382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6242796-d7b0-4feb-abd1-55c5d1067a9b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:45.249787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6242796-d7b0-4feb-abd1-55c5d1067a9b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:45.253083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6242796-d7b0-4feb-abd1-55c5d1067a9b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:45.538974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e6242796-d7b0-4feb-abd1-55c5d1067a9b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:45.558355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e6242796-d7b0-4feb-abd1-55c5d1067a9b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:45.559994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e6242796-d7b0-4feb-abd1-55c5d1067a9b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:45.565850 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e6242796-d7b0-4feb-abd1-55c5d1067a9b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.356854 Aug 02 07:07:45.569940 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2127/4157] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:45 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:45.579928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-76c7b31b-6741-49df-831e-3d017abb0b2f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:45.580549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-76c7b31b-6741-49df-831e-3d017abb0b2f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:45.615533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76c7b31b-6741-49df-831e-3d017abb0b2f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:45.615984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76c7b31b-6741-49df-831e-3d017abb0b2f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:45.616771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76c7b31b-6741-49df-831e-3d017abb0b2f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:45.617199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76c7b31b-6741-49df-831e-3d017abb0b2f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:45.824732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5ffb243f-e793-48b3-bac8-e131b717cfd3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:45.834257 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5ffb243f-e793-48b3-bac8-e131b717cfd3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1320 microversion: 2.1 time: 0.620704 Aug 02 07:07:45.854328 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2031/4158] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:45 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1320 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:45.875804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f0d36915-6a00-4654-a4ee-4cb89daa9d8c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:45.876432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f0d36915-6a00-4654-a4ee-4cb89daa9d8c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:45.889047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0d36915-6a00-4654-a4ee-4cb89daa9d8c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:45.889851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0d36915-6a00-4654-a4ee-4cb89daa9d8c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:45.890846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0d36915-6a00-4654-a4ee-4cb89daa9d8c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:45.893185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0d36915-6a00-4654-a4ee-4cb89daa9d8c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:45.943390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:45.985716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-76c7b31b-6741-49df-831e-3d017abb0b2f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:46.007568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-76c7b31b-6741-49df-831e-3d017abb0b2f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:46.009674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-76c7b31b-6741-49df-831e-3d017abb0b2f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:46.011308 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-76c7b31b-6741-49df-831e-3d017abb0b2f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 0.438377 Aug 02 07:07:46.013414 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2128/4159] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:45 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:46.189749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f0d36915-6a00-4654-a4ee-4cb89daa9d8c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:46.202183 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f0d36915-6a00-4654-a4ee-4cb89daa9d8c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1315 microversion: 2.1 time: 0.331082 Aug 02 07:07:46.203412 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2032/4160] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:45 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:07:46.599540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b77dc75f-0da0-4a9a-aa3d-f5a5f662b84c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:46.600178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b77dc75f-0da0-4a9a-aa3d-f5a5f662b84c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:46.648015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b77dc75f-0da0-4a9a-aa3d-f5a5f662b84c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:46.649223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b77dc75f-0da0-4a9a-aa3d-f5a5f662b84c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:46.650020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b77dc75f-0da0-4a9a-aa3d-f5a5f662b84c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:46.650476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b77dc75f-0da0-4a9a-aa3d-f5a5f662b84c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:46.849590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b77dc75f-0da0-4a9a-aa3d-f5a5f662b84c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:46.866622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-689eafd8-0799-4855-b988-2f828f78b026 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:46.867242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-689eafd8-0799-4855-b988-2f828f78b026 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:46.880545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b77dc75f-0da0-4a9a-aa3d-f5a5f662b84c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:46.887881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-689eafd8-0799-4855-b988-2f828f78b026 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:46.889166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-689eafd8-0799-4855-b988-2f828f78b026 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:46.890520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b77dc75f-0da0-4a9a-aa3d-f5a5f662b84c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:46.894637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-689eafd8-0799-4855-b988-2f828f78b026 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:46.897128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-689eafd8-0799-4855-b988-2f828f78b026 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:46.898253 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b77dc75f-0da0-4a9a-aa3d-f5a5f662b84c tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.302751 Aug 02 07:07:46.926033 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2129/4161] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:46 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:47.039054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-03faa427-9929-49ce-a2c0-4757adc29f35 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:47.039578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-03faa427-9929-49ce-a2c0-4757adc29f35 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:47.062484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03faa427-9929-49ce-a2c0-4757adc29f35 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:47.063097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03faa427-9929-49ce-a2c0-4757adc29f35 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:47.063952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03faa427-9929-49ce-a2c0-4757adc29f35 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:47.064391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03faa427-9929-49ce-a2c0-4757adc29f35 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:47.565607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-689eafd8-0799-4855-b988-2f828f78b026 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:47.578612 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-689eafd8-0799-4855-b988-2f828f78b026 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1320 microversion: 2.1 time: 0.712833 Aug 02 07:07:47.581518 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2033/4162] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:46 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1320 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:47.600853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-be087f0a-7c5a-40d0-873a-2b9a03e82c82 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:47.602023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-be087f0a-7c5a-40d0-873a-2b9a03e82c82 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:47.616295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be087f0a-7c5a-40d0-873a-2b9a03e82c82 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:47.620672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be087f0a-7c5a-40d0-873a-2b9a03e82c82 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:47.622474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be087f0a-7c5a-40d0-873a-2b9a03e82c82 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:47.624232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be087f0a-7c5a-40d0-873a-2b9a03e82c82 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:47.646756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-03faa427-9929-49ce-a2c0-4757adc29f35 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:47.660589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-03faa427-9929-49ce-a2c0-4757adc29f35 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:47.662942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-03faa427-9929-49ce-a2c0-4757adc29f35 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:47.664393 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-03faa427-9929-49ce-a2c0-4757adc29f35 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 0.629436 Aug 02 07:07:47.665726 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2130/4163] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:47 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:07:47.673687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-01e1e79a-d4b3-485c-a2bf-48fe76f271e8 req-0ddee6dd-256b-4ccd-9c6e-7bf8fef12d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93257197-87b4-4106-a2e4-10447658866a", "name": "network-vif-plugged", "status": "completed", "tag": "c46402ea-8187-46a1-a94e-d2e1a80152be"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:47.706499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-01e1e79a-d4b3-485c-a2bf-48fe76f271e8 req-0ddee6dd-256b-4ccd-9c6e-7bf8fef12d7b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:47.707155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-01e1e79a-d4b3-485c-a2bf-48fe76f271e8 req-0ddee6dd-256b-4ccd-9c6e-7bf8fef12d7b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:47.740636 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-01e1e79a-d4b3-485c-a2bf-48fe76f271e8 req-0ddee6dd-256b-4ccd-9c6e-7bf8fef12d7b service nova] Creating event network-vif-plugged:c46402ea-8187-46a1-a94e-d2e1a80152be for instance 93257197-87b4-4106-a2e4-10447658866a on n-h2-851337-3 Aug 02 07:07:47.746798 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-01e1e79a-d4b3-485c-a2bf-48fe76f271e8 req-0ddee6dd-256b-4ccd-9c6e-7bf8fef12d7b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079458 Aug 02 07:07:47.748876 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2131/4164] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:47.925426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc9bbe3b-83f4-4b73-a0f5-9a6228c053b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:47.926525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bc9bbe3b-83f4-4b73-a0f5-9a6228c053b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:47.944721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc9bbe3b-83f4-4b73-a0f5-9a6228c053b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:47.950831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc9bbe3b-83f4-4b73-a0f5-9a6228c053b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:47.961649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc9bbe3b-83f4-4b73-a0f5-9a6228c053b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:47.965872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc9bbe3b-83f4-4b73-a0f5-9a6228c053b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:48.244160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-be087f0a-7c5a-40d0-873a-2b9a03e82c82 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:48.288447 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-be087f0a-7c5a-40d0-873a-2b9a03e82c82 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1315 microversion: 2.1 time: 0.701048 Aug 02 07:07:48.289283 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2034/4165] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:47 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:48.333412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bc9bbe3b-83f4-4b73-a0f5-9a6228c053b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:48.343800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bc9bbe3b-83f4-4b73-a0f5-9a6228c053b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:48.356675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bc9bbe3b-83f4-4b73-a0f5-9a6228c053b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:48.362135 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc9bbe3b-83f4-4b73-a0f5-9a6228c053b3 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1604 microversion: 2.42 time: 0.441288 Aug 02 07:07:48.370319 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2132/4166] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:47 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1604 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:07:48.605369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a402328c-d5dd-4821-97fe-203464a21ab0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:48.606035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a402328c-d5dd-4821-97fe-203464a21ab0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:48.621105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a402328c-d5dd-4821-97fe-203464a21ab0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:48.621665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a402328c-d5dd-4821-97fe-203464a21ab0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:48.622958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a402328c-d5dd-4821-97fe-203464a21ab0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:48.623746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a402328c-d5dd-4821-97fe-203464a21ab0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:48.698248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-41104b1a-c9d4-4adc-8e46-1e58aa0251ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:48.719771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-41104b1a-c9d4-4adc-8e46-1e58aa0251ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:48.755124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41104b1a-c9d4-4adc-8e46-1e58aa0251ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:48.767480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41104b1a-c9d4-4adc-8e46-1e58aa0251ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:48.773449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41104b1a-c9d4-4adc-8e46-1e58aa0251ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:48.773746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41104b1a-c9d4-4adc-8e46-1e58aa0251ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:49.044468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a402328c-d5dd-4821-97fe-203464a21ab0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:49.060912 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a402328c-d5dd-4821-97fe-203464a21ab0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1320 microversion: 2.1 time: 0.461118 Aug 02 07:07:49.061527 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2035/4167] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:48 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1320 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:49.136652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-41104b1a-c9d4-4adc-8e46-1e58aa0251ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:49.150890 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-41104b1a-c9d4-4adc-8e46-1e58aa0251ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:49.152351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-41104b1a-c9d4-4adc-8e46-1e58aa0251ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:49.158160 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-41104b1a-c9d4-4adc-8e46-1e58aa0251ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 0.466363 Aug 02 07:07:49.187979 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2133/4168] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:48 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:49.310511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fbe5673f-1f66-49d2-8e6e-6913e1aeace3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:49.311773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fbe5673f-1f66-49d2-8e6e-6913e1aeace3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:49.331117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbe5673f-1f66-49d2-8e6e-6913e1aeace3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:49.331963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbe5673f-1f66-49d2-8e6e-6913e1aeace3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:49.335065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbe5673f-1f66-49d2-8e6e-6913e1aeace3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:49.335663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbe5673f-1f66-49d2-8e6e-6913e1aeace3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:49.345705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-178791792", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "981e12d8-74e3-4609-bc8b-167b178d98ea"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:49.448035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] validate_networks() for [('981e12d8-74e3-4609-bc8b-167b178d98ea', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:07:49.770077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fbe5673f-1f66-49d2-8e6e-6913e1aeace3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:49.783282 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fbe5673f-1f66-49d2-8e6e-6913e1aeace3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1315 microversion: 2.1 time: 0.477469 Aug 02 07:07:49.802360 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2134/4169] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:49 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:07:49.812211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-745c82d2-c311-4a3c-b443-959056a4c370 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:49.813491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-745c82d2-c311-4a3c-b443-959056a4c370 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:49.835897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-745c82d2-c311-4a3c-b443-959056a4c370 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:49.836871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-745c82d2-c311-4a3c-b443-959056a4c370 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:49.838016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-745c82d2-c311-4a3c-b443-959056a4c370 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:49.838749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-745c82d2-c311-4a3c-b443-959056a4c370 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:49.878314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-745c82d2-c311-4a3c-b443-959056a4c370 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:49.879677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-745c82d2-c311-4a3c-b443-959056a4c370 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:49.880193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-745c82d2-c311-4a3c-b443-959056a4c370 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lazy-loading 'fault' on Instance uuid 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:07:50.644655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-745c82d2-c311-4a3c-b443-959056a4c370 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:50.653116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-745c82d2-c311-4a3c-b443-959056a4c370 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:50.663480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-745c82d2-c311-4a3c-b443-959056a4c370 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4020638dc2480a8c451435824cd0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f5bbf476c94643bf0cdc53674eac15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:50.665017 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-745c82d2-c311-4a3c-b443-959056a4c370 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 200 len: 1371 microversion: 2.42 time: 0.861124 Aug 02 07:07:50.666365 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2135/4170] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:49 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 1371 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:50.673431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9b55b519-2f26-4002-a130-743dbc4ecd7f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:50.677772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9b55b519-2f26-4002-a130-743dbc4ecd7f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:50.696383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b55b519-2f26-4002-a130-743dbc4ecd7f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:50.697168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b55b519-2f26-4002-a130-743dbc4ecd7f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:50.698215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b55b519-2f26-4002-a130-743dbc4ecd7f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:50.699991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b55b519-2f26-4002-a130-743dbc4ecd7f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:50.791862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:07:50.792962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:07:50.793622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:07:50.794236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:07:50.794806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:07:50.809520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:50.810342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:50.811481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:50.812088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:50.878195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Getting quotas for project fc1dad66fd4340908cce462baeb8e4c7. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:07:50.894061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Getting quotas for user ce8039cf34f34f0fa6fed42879e9b79b and project fc1dad66fd4340908cce462baeb8e4c7. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:07:50.936070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:07:50.944355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:07:51.075976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9b55b519-2f26-4002-a130-743dbc4ecd7f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:51.085411 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e08e7872-a3f0-4e59-966a-f56b9ed35301 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.022297 Aug 02 07:07:51.086863 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2036/4171] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:07:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:07:51.094687 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9b55b519-2f26-4002-a130-743dbc4ecd7f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1501 microversion: 2.1 time: 0.426602 Aug 02 07:07:51.096207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1ece37ae-747c-4f75-b394-c28dec0c79a9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:51.098627 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2136/4172] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:50 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1501 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:51.098821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1ece37ae-747c-4f75-b394-c28dec0c79a9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:51.105826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-307e1f98-1876-4cd1-a068-83f6d7c5fd7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:51.107486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-307e1f98-1876-4cd1-a068-83f6d7c5fd7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:51.115338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-307e1f98-1876-4cd1-a068-83f6d7c5fd7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:51.115603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ece37ae-747c-4f75-b394-c28dec0c79a9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:51.116228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-307e1f98-1876-4cd1-a068-83f6d7c5fd7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:51.116499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ece37ae-747c-4f75-b394-c28dec0c79a9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:51.117479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ece37ae-747c-4f75-b394-c28dec0c79a9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:51.117747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-307e1f98-1876-4cd1-a068-83f6d7c5fd7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:51.118277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-307e1f98-1876-4cd1-a068-83f6d7c5fd7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:51.120046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ece37ae-747c-4f75-b394-c28dec0c79a9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:51.414853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1ece37ae-747c-4f75-b394-c28dec0c79a9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:51.428772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1ece37ae-747c-4f75-b394-c28dec0c79a9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:51.431543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1ece37ae-747c-4f75-b394-c28dec0c79a9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:51.433617 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1ece37ae-747c-4f75-b394-c28dec0c79a9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 0.345305 Aug 02 07:07:51.434443 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2037/4173] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:51 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:51.455527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-93354f01-edc2-4517-957b-97f4da5d7f2f tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:51.456485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-93354f01-edc2-4517-957b-97f4da5d7f2f tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:51.544434 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-307e1f98-1876-4cd1-a068-83f6d7c5fd7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:51.556670 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-307e1f98-1876-4cd1-a068-83f6d7c5fd7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1315 microversion: 2.1 time: 0.456511 Aug 02 07:07:51.569943 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2137/4174] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:51 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:51.569943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0e4aa666-6d1c-4269-81c0-9ee294b1542e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:51.569943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0e4aa666-6d1c-4269-81c0-9ee294b1542e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:51.588652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e4aa666-6d1c-4269-81c0-9ee294b1542e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:51.589128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e4aa666-6d1c-4269-81c0-9ee294b1542e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:51.592284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e4aa666-6d1c-4269-81c0-9ee294b1542e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:51.592759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e4aa666-6d1c-4269-81c0-9ee294b1542e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:51.624124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-93354f01-edc2-4517-957b-97f4da5d7f2f tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:51.642459 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-93354f01-edc2-4517-957b-97f4da5d7f2f tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1231 microversion: 2.1 time: 0.206526 Aug 02 07:07:51.647286 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2038/4175] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:51 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1231 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:51.659564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-893c4dae-f44a-4f25-8b3b-e2f8ae21b3cc req-aa8a40d3-c56c-48c6-be4d-4656e392e71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d415b6-b9f4-4c0c-bd81-67d9b571ea81", "name": "network-vif-plugged", "status": "completed", "tag": "21354a97-6003-4b29-b2d1-6d99fd2581b8"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:51.685228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-893c4dae-f44a-4f25-8b3b-e2f8ae21b3cc req-aa8a40d3-c56c-48c6-be4d-4656e392e71e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:51.686148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-893c4dae-f44a-4f25-8b3b-e2f8ae21b3cc req-aa8a40d3-c56c-48c6-be4d-4656e392e71e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:51.717934 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-893c4dae-f44a-4f25-8b3b-e2f8ae21b3cc req-aa8a40d3-c56c-48c6-be4d-4656e392e71e service nova] Creating event network-vif-plugged:21354a97-6003-4b29-b2d1-6d99fd2581b8 for instance 03d415b6-b9f4-4c0c-bd81-67d9b571ea81 on n-h2-851337-3 Aug 02 07:07:51.727127 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-893c4dae-f44a-4f25-8b3b-e2f8ae21b3cc req-aa8a40d3-c56c-48c6-be4d-4656e392e71e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071701 Aug 02 07:07:51.732390 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2039/4176] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:51.741608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1b3fb11-5a43-4d1c-ba8e-958a0c7246af tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:51.746864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b1b3fb11-5a43-4d1c-ba8e-958a0c7246af tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:51.777713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1b3fb11-5a43-4d1c-ba8e-958a0c7246af tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:51.779104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1b3fb11-5a43-4d1c-ba8e-958a0c7246af tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:51.780566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1b3fb11-5a43-4d1c-ba8e-958a0c7246af tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:51.783165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1b3fb11-5a43-4d1c-ba8e-958a0c7246af tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:51.818953 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-b1b3fb11-5a43-4d1c-ba8e-958a0c7246af tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] HTTP exception thrown: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1b3fb11-5a43-4d1c-ba8e-958a0c7246af tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Request method failure captured: Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 HTTP/1.1 Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MuZ6EVddVLU62kX7Hr3pBMdx0ZNiTLq6bYmbQX7ito5QmTJS_QmQIIwqDHMiSZU-UCzTLo0IgHedtlTSTYoJEkzyIm3joZ_xJa7SaKZPu7frrrpXyZKrw1WUKUso_dxsKSnWX0DpNEbZ98roNHMdKAGk6pMhLNz80epDepFD87yr0U Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Openstack-Nova-Api-Version: 2.42 Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 03f5bbf476c94643bf0cdc53674eac15 Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1181860373 Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/03f5bbf476c94643bf0cdc53674eac15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03f5bbf476c94643bf0cdc53674eac15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_03f5bbf476c94643bf0cdc53674eac15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03f5bbf476c94643bf0cdc53674eac15"}]}] Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1181860373 Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 03f5bbf476c94643bf0cdc53674eac15 Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1181860373 Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TaggedBootDevicesTest_v242-1181860373-project Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 2b4020638dc2480a8c451435824cd0f6 Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1181860373-project Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '2a6fbed1-be54-48af-9d5f-8fe30fa88cf8'} Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:51.823002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:07:51.828456 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:51.828456 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:51.828456 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:07:51.828456 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:07:51.828456 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:07:51.828456 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:07:51.828456 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:07:51.828456 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:07:51.830233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1b3fb11-5a43-4d1c-ba8e-958a0c7246af tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Returning 404 to user: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:07:51.832203 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b1b3fb11-5a43-4d1c-ba8e-958a0c7246af tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 404 len: 111 microversion: 2.42 time: 0.098050 Aug 02 07:07:51.837772 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2040/4177] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:51 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:07:51.844087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6d90fa3d-0781-419d-8138-3178fcc4c224 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '.version_select at 0x7f927aab74c0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:51.893478 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6d90fa3d-0781-419d-8138-3178fcc4c224 tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-282974978" status: 204 len: 0 microversion: 2.42 time: 0.053974 Aug 02 07:07:51.903289 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2041/4178] 10.222.0.79 () {60 vars in 1259 bytes} [Tue Aug 2 07:07:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-282974978 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:07:52.050018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0e4aa666-6d1c-4269-81c0-9ee294b1542e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:52.068425 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0e4aa666-6d1c-4269-81c0-9ee294b1542e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1501 microversion: 2.1 time: 0.507261 Aug 02 07:07:52.069751 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2138/4179] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:51 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1501 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:52.094363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0f62adf1-b405-4b0b-b480-8982902b7d42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:52.095316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0f62adf1-b405-4b0b-b480-8982902b7d42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:52.114117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f62adf1-b405-4b0b-b480-8982902b7d42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:52.115637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f62adf1-b405-4b0b-b480-8982902b7d42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:52.119215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f62adf1-b405-4b0b-b480-8982902b7d42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:52.119856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f62adf1-b405-4b0b-b480-8982902b7d42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:52.181255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0f62adf1-b405-4b0b-b480-8982902b7d42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:07:52.391845 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0f62adf1-b405-4b0b-b480-8982902b7d42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 204 len: 0 microversion: 2.1 time: 0.301544 Aug 02 07:07:52.392507 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2042/4180] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:07:52 2022] DELETE /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:07:52.401285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ad184e9-6648-42c5-a11f-0092f6555f98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:52.402659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9ad184e9-6648-42c5-a11f-0092f6555f98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:52.410724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ad184e9-6648-42c5-a11f-0092f6555f98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:52.411603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ad184e9-6648-42c5-a11f-0092f6555f98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:52.412784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ad184e9-6648-42c5-a11f-0092f6555f98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:52.413404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ad184e9-6648-42c5-a11f-0092f6555f98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:52.473774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-043278e7-23f0-4cac-8bd7-be16062e6b1e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:52.479499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-043278e7-23f0-4cac-8bd7-be16062e6b1e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:52.505529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-043278e7-23f0-4cac-8bd7-be16062e6b1e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:52.506494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-043278e7-23f0-4cac-8bd7-be16062e6b1e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:52.508603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-043278e7-23f0-4cac-8bd7-be16062e6b1e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:52.512875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-043278e7-23f0-4cac-8bd7-be16062e6b1e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:52.895896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9ad184e9-6648-42c5-a11f-0092f6555f98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:52.906292 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9ad184e9-6648-42c5-a11f-0092f6555f98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1507 microversion: 2.1 time: 0.509167 Aug 02 07:07:52.907493 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2139/4181] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:52 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1507 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:52.913041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-439e48e7-cea6-44a6-84b1-6e87ad0f1113 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:52.913914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-439e48e7-cea6-44a6-84b1-6e87ad0f1113 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:52.923599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-439e48e7-cea6-44a6-84b1-6e87ad0f1113 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:52.924306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-439e48e7-cea6-44a6-84b1-6e87ad0f1113 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:52.925275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-439e48e7-cea6-44a6-84b1-6e87ad0f1113 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:52.926016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-439e48e7-cea6-44a6-84b1-6e87ad0f1113 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:52.931336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:52.953690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-043278e7-23f0-4cac-8bd7-be16062e6b1e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:52.969322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-043278e7-23f0-4cac-8bd7-be16062e6b1e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:52.970892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-043278e7-23f0-4cac-8bd7-be16062e6b1e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:52.972954 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-043278e7-23f0-4cac-8bd7-be16062e6b1e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 0.513405 Aug 02 07:07:52.986899 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2043/4182] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:52 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:53.004983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-17b93bb6-5b33-47c2-958e-498a5a5e4a80 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:53.005907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-17b93bb6-5b33-47c2-958e-498a5a5e4a80 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:53.014537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17b93bb6-5b33-47c2-958e-498a5a5e4a80 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:53.015374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17b93bb6-5b33-47c2-958e-498a5a5e4a80 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:53.016553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17b93bb6-5b33-47c2-958e-498a5a5e4a80 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:53.017305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17b93bb6-5b33-47c2-958e-498a5a5e4a80 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:53.255589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-17b93bb6-5b33-47c2-958e-498a5a5e4a80 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:53.267715 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-17b93bb6-5b33-47c2-958e-498a5a5e4a80 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1283 microversion: 2.1 time: 0.278623 Aug 02 07:07:53.283578 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2044/4183] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:52 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1283 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:53.355363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-439e48e7-cea6-44a6-84b1-6e87ad0f1113 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:53.375602 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-439e48e7-cea6-44a6-84b1-6e87ad0f1113 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1315 microversion: 2.1 time: 0.466794 Aug 02 07:07:53.376201 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2140/4184] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:52 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:53.929991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-16774f7d-8e14-4a2c-a950-9f3b8aa87c87 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:53.930665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-16774f7d-8e14-4a2c-a950-9f3b8aa87c87 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:53.944632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16774f7d-8e14-4a2c-a950-9f3b8aa87c87 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:53.957845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16774f7d-8e14-4a2c-a950-9f3b8aa87c87 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:53.961358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16774f7d-8e14-4a2c-a950-9f3b8aa87c87 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:53.977455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16774f7d-8e14-4a2c-a950-9f3b8aa87c87 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:53.999519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-15045e88-3edd-4505-9b6c-d76c84dbabf0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:54.000748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-15045e88-3edd-4505-9b6c-d76c84dbabf0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:54.021020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15045e88-3edd-4505-9b6c-d76c84dbabf0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:54.021726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15045e88-3edd-4505-9b6c-d76c84dbabf0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:54.024383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15045e88-3edd-4505-9b6c-d76c84dbabf0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:54.026197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15045e88-3edd-4505-9b6c-d76c84dbabf0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:54.955120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-16774f7d-8e14-4a2c-a950-9f3b8aa87c87 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:54.972905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-15045e88-3edd-4505-9b6c-d76c84dbabf0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:54.973115 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-16774f7d-8e14-4a2c-a950-9f3b8aa87c87 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1507 microversion: 2.1 time: 1.045254 Aug 02 07:07:54.978831 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2045/4185] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:53 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1507 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:54.984794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b78ff6ee-9a35-47d2-9af9-dab56ba37342 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:54.991103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b78ff6ee-9a35-47d2-9af9-dab56ba37342 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:55.001720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-15045e88-3edd-4505-9b6c-d76c84dbabf0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:55.007076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-15045e88-3edd-4505-9b6c-d76c84dbabf0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:55.008550 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-15045e88-3edd-4505-9b6c-d76c84dbabf0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 1.013223 Aug 02 07:07:55.008773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b78ff6ee-9a35-47d2-9af9-dab56ba37342 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:55.009724 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2141/4186] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:53 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:07:55.010238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b78ff6ee-9a35-47d2-9af9-dab56ba37342 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:55.011385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b78ff6ee-9a35-47d2-9af9-dab56ba37342 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:55.018413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b78ff6ee-9a35-47d2-9af9-dab56ba37342 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:55.040975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4a2ff01e-a6d7-4c0b-8bdc-2567ebc0ee3a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:55.042185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4a2ff01e-a6d7-4c0b-8bdc-2567ebc0ee3a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:55.069474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a2ff01e-a6d7-4c0b-8bdc-2567ebc0ee3a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:55.070295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a2ff01e-a6d7-4c0b-8bdc-2567ebc0ee3a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:55.073880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a2ff01e-a6d7-4c0b-8bdc-2567ebc0ee3a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:55.076935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a2ff01e-a6d7-4c0b-8bdc-2567ebc0ee3a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:55.149506 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4a2ff01e-a6d7-4c0b-8bdc-2567ebc0ee3a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/ips" status: 200 len: 150 microversion: 2.1 time: 0.135108 Aug 02 07:07:55.154032 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2142/4187] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 07:07:55 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/ips => generated 150 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:55.179203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-08fe2fb6-85d6-4036-b377-3439025930a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:55.180459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-08fe2fb6-85d6-4036-b377-3439025930a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:55.190564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:55.204346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08fe2fb6-85d6-4036-b377-3439025930a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:55.210222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08fe2fb6-85d6-4036-b377-3439025930a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:55.211612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08fe2fb6-85d6-4036-b377-3439025930a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:55.214448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08fe2fb6-85d6-4036-b377-3439025930a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:55.599460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b78ff6ee-9a35-47d2-9af9-dab56ba37342 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:55.640285 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b78ff6ee-9a35-47d2-9af9-dab56ba37342 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1331 microversion: 2.1 time: 0.658999 Aug 02 07:07:55.641225 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2046/4188] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:54 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1331 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:55.939026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b4dcfeb5-5d28-4682-8cf1-1890015d999a req-91d966cb-9962-42d4-971f-7718e96b61bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93257197-87b4-4106-a2e4-10447658866a", "name": "network-vif-deleted", "tag": "c46402ea-8187-46a1-a94e-d2e1a80152be"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:55.961445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b4dcfeb5-5d28-4682-8cf1-1890015d999a req-91d966cb-9962-42d4-971f-7718e96b61bd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:55.966707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b4dcfeb5-5d28-4682-8cf1-1890015d999a req-91d966cb-9962-42d4-971f-7718e96b61bd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:55.994246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-08fe2fb6-85d6-4036-b377-3439025930a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:56.018719 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b4dcfeb5-5d28-4682-8cf1-1890015d999a req-91d966cb-9962-42d4-971f-7718e96b61bd service nova] Creating event network-vif-deleted:c46402ea-8187-46a1-a94e-d2e1a80152be for instance 93257197-87b4-4106-a2e4-10447658866a on n-h2-851337-3 Aug 02 07:07:56.041351 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b4dcfeb5-5d28-4682-8cf1-1890015d999a req-91d966cb-9962-42d4-971f-7718e96b61bd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094944 Aug 02 07:07:56.049271 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-08fe2fb6-85d6-4036-b377-3439025930a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1502 microversion: 2.1 time: 0.888737 Aug 02 07:07:56.051964 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2047/4189] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:56.053940 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2143/4190] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:55 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1502 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:56.073775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-efc14cd3-864a-4840-a7f3-9ea457b5f1f8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:56.074774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-efc14cd3-864a-4840-a7f3-9ea457b5f1f8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:56.077058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c47be22f-8ff2-4165-97e2-764070b9453d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:56.082262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c47be22f-8ff2-4165-97e2-764070b9453d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:56.083125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-efc14cd3-864a-4840-a7f3-9ea457b5f1f8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:56.083769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-efc14cd3-864a-4840-a7f3-9ea457b5f1f8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:56.084745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-efc14cd3-864a-4840-a7f3-9ea457b5f1f8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:56.085348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-efc14cd3-864a-4840-a7f3-9ea457b5f1f8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:56.142513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c47be22f-8ff2-4165-97e2-764070b9453d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:56.147616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c47be22f-8ff2-4165-97e2-764070b9453d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:56.152466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c47be22f-8ff2-4165-97e2-764070b9453d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:56.153173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c47be22f-8ff2-4165-97e2-764070b9453d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:56.345567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-efc14cd3-864a-4840-a7f3-9ea457b5f1f8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:56.354958 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-efc14cd3-864a-4840-a7f3-9ea457b5f1f8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 200 len: 1305 microversion: 2.1 time: 0.301397 Aug 02 07:07:56.358999 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2048/4191] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:56 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 1305 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:56.369101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ac4aa4c-80b9-47af-96f9-8cd3988d7a00 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:56.381704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ac4aa4c-80b9-47af-96f9-8cd3988d7a00 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:56.390422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ac4aa4c-80b9-47af-96f9-8cd3988d7a00 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:56.436200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ac4aa4c-80b9-47af-96f9-8cd3988d7a00 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Going to try to stop instance {{(pid=126119) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 07:07:56.540660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c47be22f-8ff2-4165-97e2-764070b9453d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:56.561031 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ac4aa4c-80b9-47af-96f9-8cd3988d7a00 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81/action" status: 202 len: 0 microversion: 2.1 time: 0.196757 Aug 02 07:07:56.564689 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2049/4192] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:07:56 2022] POST /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:07:56.567454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c47be22f-8ff2-4165-97e2-764070b9453d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:56.575575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c47be22f-8ff2-4165-97e2-764070b9453d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:56.583679 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c47be22f-8ff2-4165-97e2-764070b9453d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 0.526367 Aug 02 07:07:56.584939 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2144/4193] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:56 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:56.589450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9801c179-5652-4ce2-9452-46e10fa77a45 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:56.591993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9801c179-5652-4ce2-9452-46e10fa77a45 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:56.607328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:56.613760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9801c179-5652-4ce2-9452-46e10fa77a45 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:56.616581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9801c179-5652-4ce2-9452-46e10fa77a45 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:56.617946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9801c179-5652-4ce2-9452-46e10fa77a45 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:56.619855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9801c179-5652-4ce2-9452-46e10fa77a45 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:56.667441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-839df6c6-b80f-4ff0-b4f6-fd2ea2113af4 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:56.668892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-839df6c6-b80f-4ff0-b4f6-fd2ea2113af4 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:56.693095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-839df6c6-b80f-4ff0-b4f6-fd2ea2113af4 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:56.693731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-839df6c6-b80f-4ff0-b4f6-fd2ea2113af4 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:56.695089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-839df6c6-b80f-4ff0-b4f6-fd2ea2113af4 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:56.711217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-839df6c6-b80f-4ff0-b4f6-fd2ea2113af4 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:57.197117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-839df6c6-b80f-4ff0-b4f6-fd2ea2113af4 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:57.210176 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-839df6c6-b80f-4ff0-b4f6-fd2ea2113af4 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1331 microversion: 2.1 time: 0.548426 Aug 02 07:07:57.225920 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2145/4194] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:56 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1331 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:57.384847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7d13bf2-6d3a-483d-903c-eb1289312bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:57.385702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e7d13bf2-6d3a-483d-903c-eb1289312bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:57.409554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7d13bf2-6d3a-483d-903c-eb1289312bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:57.411601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7d13bf2-6d3a-483d-903c-eb1289312bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:57.412703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7d13bf2-6d3a-483d-903c-eb1289312bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:57.415112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9801c179-5652-4ce2-9452-46e10fa77a45 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:57.416195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7d13bf2-6d3a-483d-903c-eb1289312bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:57.429302 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9801c179-5652-4ce2-9452-46e10fa77a45 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.860094 Aug 02 07:07:57.430533 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2050/4195] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:56 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:57.452256 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-e7d13bf2-6d3a-483d-903c-eb1289312bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7d13bf2-6d3a-483d-903c-eb1289312bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a HTTP/1.1 Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '93257197-87b4-4106-a2e4-10447658866a'} Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:07:57.454163 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:07:57.458366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:07:57.458366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:07:57.458366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:07:57.458366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:07:57.458366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:07:57.458366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:07:57.458366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:07:57.460545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7d13bf2-6d3a-483d-903c-eb1289312bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:07:57.463098 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7d13bf2-6d3a-483d-903c-eb1289312bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 404 len: 111 microversion: 2.1 time: 0.084002 Aug 02 07:07:57.474393 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2146/4196] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:57 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:07:57.479362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3c5d3d82-2958-40eb-95cd-0c3cf58e216c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Action: 'create', calling method: .version_select at 0x7f927be28f70>, body: {"keypair": {"name": "tempest-key-2125202781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAZ6qvmd/fD4fRsjfM70YrR5GAxF2hEc55Uk9oly19yxmvYWU5s2viDoIj1Ffvh55BKluN/J2HpBnAM28QfOgtydQrZFcL75oJNSXvaeuFmlY/cO6tLfL3vB6Hmd8ylQA=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:57.521583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3c5d3d82-2958-40eb-95cd-0c3cf58e216c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for project da31144cd8b94b76821c8a01029ffb37. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:07:57.534128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-3c5d3d82-2958-40eb-95cd-0c3cf58e216c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for user 0971d7961d5a4e8996ea2c0f958382ad and project da31144cd8b94b76821c8a01029ffb37. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:07:57.596057 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3c5d3d82-2958-40eb-95cd-0c3cf58e216c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.121351 Aug 02 07:07:57.597496 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2051/4197] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:07:57 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:07:57.617948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9d2daa38-4035-46e0-a8c5-bb1f5580ff0a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '.version_select at 0x7f927a755940>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:57.621269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d4e3404-6da8-4c77-859a-49bffd28ea8c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:57.621954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5d4e3404-6da8-4c77-859a-49bffd28ea8c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:57.642127 n-d-851337-3 devstack@n-api.service[126120]: WARNING oslo_db.sqlalchemy.utils [None req-9d2daa38-4035-46e0-a8c5-bb1f5580ff0a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 02 07:07:57.663516 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9d2daa38-4035-46e0-a8c5-bb1f5580ff0a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.059756 Aug 02 07:07:57.664119 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2147/4198] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 07:07:57 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:57.678034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d4e3404-6da8-4c77-859a-49bffd28ea8c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:57.678767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d4e3404-6da8-4c77-859a-49bffd28ea8c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:57.680541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d4e3404-6da8-4c77-859a-49bffd28ea8c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:57.682914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d4e3404-6da8-4c77-859a-49bffd28ea8c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:57.809843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:07:57.983553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-694744318", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "key_name": "tempest-key-2125202781", "networks": [{"uuid": "ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:58.117080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] validate_networks() for [('ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:07:58.282303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5d4e3404-6da8-4c77-859a-49bffd28ea8c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:58.294823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5d4e3404-6da8-4c77-859a-49bffd28ea8c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:58.297937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5d4e3404-6da8-4c77-859a-49bffd28ea8c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:58.304011 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5d4e3404-6da8-4c77-859a-49bffd28ea8c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 0.691691 Aug 02 07:07:58.315005 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2052/4199] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:57 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:07:58.329735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f02e2ea-6644-4b82-b620-729db3498c27 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0e8d650-e5e7-43f9-ae3e-e4a78421b481"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:58.336890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3f02e2ea-6644-4b82-b620-729db3498c27 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:58.357342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f02e2ea-6644-4b82-b620-729db3498c27 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:58.358236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f02e2ea-6644-4b82-b620-729db3498c27 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:58.359275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f02e2ea-6644-4b82-b620-729db3498c27 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:58.359923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f02e2ea-6644-4b82-b620-729db3498c27 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:59.117012 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3f02e2ea-6644-4b82-b620-729db3498c27 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "POST /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.771985 Aug 02 07:07:59.130574 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2053/4200] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:07:58 2022] POST /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments => generated 194 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:59.143419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a1630ea2-0f65-436e-91cd-4aee25294268 req-7962968b-4c7a-449f-82e9-27a2baca4edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d05fd34-5166-4491-9425-fc2da25e106f", "tag": "9bfac521-3575-41c1-ac0e-8d05e3335152"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:07:59.173843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a1630ea2-0f65-436e-91cd-4aee25294268 req-7962968b-4c7a-449f-82e9-27a2baca4edc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:59.178077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a1630ea2-0f65-436e-91cd-4aee25294268 req-7962968b-4c7a-449f-82e9-27a2baca4edc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:59.216358 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a1630ea2-0f65-436e-91cd-4aee25294268 req-7962968b-4c7a-449f-82e9-27a2baca4edc service nova] Creating event network-changed:9bfac521-3575-41c1-ac0e-8d05e3335152 for instance 2d05fd34-5166-4491-9425-fc2da25e106f on n-h1-851337-3 Aug 02 07:07:59.235118 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a1630ea2-0f65-436e-91cd-4aee25294268 req-7962968b-4c7a-449f-82e9-27a2baca4edc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101086 Aug 02 07:07:59.236361 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2054/4201] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:07:59.244245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b6c97c03-20db-4a72-86a3-c911513661e9 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:59.245396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b6c97c03-20db-4a72-86a3-c911513661e9 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:59.249712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:07:59.250888 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:07:59.252299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:07:59.253025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:07:59.254682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:07:59.282601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:59.283354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:59.283996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6c97c03-20db-4a72-86a3-c911513661e9 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:59.285076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:59.285923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6c97c03-20db-4a72-86a3-c911513661e9 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:59.287460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:59.289414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6c97c03-20db-4a72-86a3-c911513661e9 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:59.290083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6c97c03-20db-4a72-86a3-c911513661e9 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:59.364279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:07:59.383251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for user 0971d7961d5a4e8996ea2c0f958382ad and project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:07:59.425227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:07:59.427651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:07:59.530551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b6c97c03-20db-4a72-86a3-c911513661e9 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:07:59.541452 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b6c97c03-20db-4a72-86a3-c911513661e9 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1331 microversion: 2.1 time: 0.302651 Aug 02 07:07:59.546085 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a672701b-a91f-44cf-99a8-ec20d6076bbd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566271 Aug 02 07:07:59.550827 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2148/4202] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:07:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:07:59.559862 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2055/4203] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:59 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1331 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:07:59.566829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02e40ec8-0153-4439-80e3-9932e415b1a6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:59.568261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6a265cd1-0a06-473e-b951-9468447d4aa2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:07:59.569659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6a265cd1-0a06-473e-b951-9468447d4aa2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:59.573055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-02e40ec8-0153-4439-80e3-9932e415b1a6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:07:59.576610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a265cd1-0a06-473e-b951-9468447d4aa2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:59.577157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a265cd1-0a06-473e-b951-9468447d4aa2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:59.578052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a265cd1-0a06-473e-b951-9468447d4aa2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:59.579055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a265cd1-0a06-473e-b951-9468447d4aa2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:59.596834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02e40ec8-0153-4439-80e3-9932e415b1a6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:59.602434 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02e40ec8-0153-4439-80e3-9932e415b1a6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:07:59.607734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02e40ec8-0153-4439-80e3-9932e415b1a6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:07:59.608523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02e40ec8-0153-4439-80e3-9932e415b1a6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:00.101995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6a265cd1-0a06-473e-b951-9468447d4aa2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:00.119187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6a265cd1-0a06-473e-b951-9468447d4aa2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:00.124405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6a265cd1-0a06-473e-b951-9468447d4aa2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:00.130265 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6a265cd1-0a06-473e-b951-9468447d4aa2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1738 microversion: 2.20 time: 0.568897 Aug 02 07:08:00.131404 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2056/4204] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:07:59 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1738 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:00.147835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e282e298-88f0-4fa1-b924-44a3197b5430 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:00.148505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e282e298-88f0-4fa1-b924-44a3197b5430 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:00.285479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e282e298-88f0-4fa1-b924-44a3197b5430 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:00.294158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-02e40ec8-0153-4439-80e3-9932e415b1a6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:00.298615 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e282e298-88f0-4fa1-b924-44a3197b5430 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 200 len: 1228 microversion: 2.1 time: 0.166106 Aug 02 07:08:00.299327 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2057/4205] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:00 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 1228 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:00.340617 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-02e40ec8-0153-4439-80e3-9932e415b1a6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.785126 Aug 02 07:08:00.357990 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2149/4206] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:07:59 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:00.571794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4bfb0ec9-37f7-4d1f-b3ca-88b18a69f069 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:00.572425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4bfb0ec9-37f7-4d1f-b3ca-88b18a69f069 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:00.583876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4bfb0ec9-37f7-4d1f-b3ca-88b18a69f069 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:00.584339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4bfb0ec9-37f7-4d1f-b3ca-88b18a69f069 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:00.585180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4bfb0ec9-37f7-4d1f-b3ca-88b18a69f069 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:00.585588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4bfb0ec9-37f7-4d1f-b3ca-88b18a69f069 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:00.844815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:00.855439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4bfb0ec9-37f7-4d1f-b3ca-88b18a69f069 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:00.865249 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4bfb0ec9-37f7-4d1f-b3ca-88b18a69f069 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1331 microversion: 2.1 time: 0.297834 Aug 02 07:08:00.866460 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2058/4207] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:00 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1331 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:01.155490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a0484e6e-08ef-4772-a0a7-79e07366feb5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:01.156422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a0484e6e-08ef-4772-a0a7-79e07366feb5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:01.167974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0484e6e-08ef-4772-a0a7-79e07366feb5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:01.168431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0484e6e-08ef-4772-a0a7-79e07366feb5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:01.169228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0484e6e-08ef-4772-a0a7-79e07366feb5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:01.174659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0484e6e-08ef-4772-a0a7-79e07366feb5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:01.276864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-37c20fec-5014-4096-adab-b9d404f0d55e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:01.278081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-37c20fec-5014-4096-adab-b9d404f0d55e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:01.285452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37c20fec-5014-4096-adab-b9d404f0d55e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:01.290706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37c20fec-5014-4096-adab-b9d404f0d55e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:01.291744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37c20fec-5014-4096-adab-b9d404f0d55e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:01.292338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37c20fec-5014-4096-adab-b9d404f0d55e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:01.319829 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-37c20fec-5014-4096-adab-b9d404f0d55e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] HTTP exception thrown: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-37c20fec-5014-4096-adab-b9d404f0d55e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Request method failure captured: Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 HTTP/1.1 Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MuZ6EVddVLU62kX7Hr3pBMdx0ZNiTLq6bYmbQX7ito5QmTJS_QmQIIwqDHMiSZU-UCzTLo0IgHedtlTSTYoJEkzyIm3joZ_xJa7SaKZPu7frrrpXyZKrw1WUKUso_dxsKSnWX0DpNEbZ98roNHMdKAGk6pMhLNz80epDepFD87yr0U Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Openstack-Nova-Api-Version: 2.42 Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 03f5bbf476c94643bf0cdc53674eac15 Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1181860373 Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/03f5bbf476c94643bf0cdc53674eac15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03f5bbf476c94643bf0cdc53674eac15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_03f5bbf476c94643bf0cdc53674eac15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03f5bbf476c94643bf0cdc53674eac15"}]}] Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1181860373 Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 03f5bbf476c94643bf0cdc53674eac15 Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1181860373 Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TaggedBootDevicesTest_v242-1181860373-project Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 2b4020638dc2480a8c451435824cd0f6 Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1181860373-project Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '2a6fbed1-be54-48af-9d5f-8fe30fa88cf8'} Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:08:01.321956 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:08:01.326387 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:08:01.326387 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:01.326387 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:01.326387 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:01.326387 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:01.326387 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:01.326387 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:01.326387 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:08:01.326387 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:08:01.326387 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:08:01.326387 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:01.328359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-37c20fec-5014-4096-adab-b9d404f0d55e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Returning 404 to user: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:08:01.329397 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-37c20fec-5014-4096-adab-b9d404f0d55e tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 404 len: 111 microversion: 2.42 time: 0.057395 Aug 02 07:08:01.333235 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2059/4208] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 07:08:01 2022] DELETE /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 02 07:08:01.338504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-18d4cbbc-60bb-4ad3-8457-ccb4834e065a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:01.339060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-18d4cbbc-60bb-4ad3-8457-ccb4834e065a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:01.345793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18d4cbbc-60bb-4ad3-8457-ccb4834e065a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:01.346255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18d4cbbc-60bb-4ad3-8457-ccb4834e065a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:01.347237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18d4cbbc-60bb-4ad3-8457-ccb4834e065a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:01.347827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18d4cbbc-60bb-4ad3-8457-ccb4834e065a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:01.417049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a0484e6e-08ef-4772-a0a7-79e07366feb5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:01.455081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a0484e6e-08ef-4772-a0a7-79e07366feb5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:01.463235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a0484e6e-08ef-4772-a0a7-79e07366feb5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:01.469083 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a0484e6e-08ef-4772-a0a7-79e07366feb5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1720 microversion: 2.20 time: 0.313560 Aug 02 07:08:01.481524 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2150/4209] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:01 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1720 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:01.498174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0009ac16-cd10-41b9-b8f5-1b35fb55cd2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:01.498818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0009ac16-cd10-41b9-b8f5-1b35fb55cd2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] [instance: 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:01.512432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0009ac16-cd10-41b9-b8f5-1b35fb55cd2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:01.513032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0009ac16-cd10-41b9-b8f5-1b35fb55cd2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:01.513908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0009ac16-cd10-41b9-b8f5-1b35fb55cd2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:01.514366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0009ac16-cd10-41b9-b8f5-1b35fb55cd2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:01.514481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-18d4cbbc-60bb-4ad3-8457-ccb4834e065a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:01.530042 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-18d4cbbc-60bb-4ad3-8457-ccb4834e065a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 200 len: 1224 microversion: 2.1 time: 0.195375 Aug 02 07:08:01.530404 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-0009ac16-cd10-41b9-b8f5-1b35fb55cd2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] HTTP exception thrown: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0009ac16-cd10-41b9-b8f5-1b35fb55cd2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Request method failure captured: Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 HTTP/1.1 Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MuZ6EVddVLU62kX7Hr3pBMdx0ZNiTLq6bYmbQX7ito5QmTJS_QmQIIwqDHMiSZU-UCzTLo0IgHedtlTSTYoJEkzyIm3joZ_xJa7SaKZPu7frrrpXyZKrw1WUKUso_dxsKSnWX0DpNEbZ98roNHMdKAGk6pMhLNz80epDepFD87yr0U Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.42 Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 03f5bbf476c94643bf0cdc53674eac15 Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1181860373 Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/03f5bbf476c94643bf0cdc53674eac15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03f5bbf476c94643bf0cdc53674eac15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_03f5bbf476c94643bf0cdc53674eac15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03f5bbf476c94643bf0cdc53674eac15"}]}] Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1181860373 Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 03f5bbf476c94643bf0cdc53674eac15 Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1181860373 Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TaggedBootDevicesTest_v242-1181860373-project Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 2b4020638dc2480a8c451435824cd0f6 Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1181860373-project Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '2a6fbed1-be54-48af-9d5f-8fe30fa88cf8'} Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:01.532447 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:01.538536 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:01.538536 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:01.538536 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:01.538536 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:01.538536 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:08:01.538536 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:08:01.538536 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. Aug 02 07:08:01.538536 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:01.539614 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2060/4210] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:01 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 1224 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:01.541083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d9e3c96-c22a-4605-9dc7-f07992de5331 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:01.541714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0009ac16-cd10-41b9-b8f5-1b35fb55cd2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] Returning 404 to user: Instance 2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:08:01.543054 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0009ac16-cd10-41b9-b8f5-1b35fb55cd2b tempest-TaggedBootDevicesTest_v242-1181860373 tempest-TaggedBootDevicesTest_v242-1181860373-project] 10.222.0.79 "GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8" status: 404 len: 111 microversion: 2.42 time: 0.051825 Aug 02 07:08:01.545598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5d9e3c96-c22a-4605-9dc7-f07992de5331 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:01.547723 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2151/4211] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:01 2022] GET /compute/v2.1/servers/2a6fbed1-be54-48af-9d5f-8fe30fa88cf8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:08:01.567019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d9e3c96-c22a-4605-9dc7-f07992de5331 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:01.567736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d9e3c96-c22a-4605-9dc7-f07992de5331 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:01.568686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d9e3c96-c22a-4605-9dc7-f07992de5331 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:01.569285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d9e3c96-c22a-4605-9dc7-f07992de5331 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:01.836677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5d9e3c96-c22a-4605-9dc7-f07992de5331 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:01.867370 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5d9e3c96-c22a-4605-9dc7-f07992de5331 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.332738 Aug 02 07:08:01.868144 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2061/4212] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:01 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:01.886320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1be27632-fdcd-4bd0-8de9-520cea3d320c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:01.887325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1be27632-fdcd-4bd0-8de9-520cea3d320c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:01.900167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1be27632-fdcd-4bd0-8de9-520cea3d320c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:01.900999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1be27632-fdcd-4bd0-8de9-520cea3d320c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:01.902359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1be27632-fdcd-4bd0-8de9-520cea3d320c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:01.903057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1be27632-fdcd-4bd0-8de9-520cea3d320c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:02.105632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1be27632-fdcd-4bd0-8de9-520cea3d320c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:02.126690 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1be27632-fdcd-4bd0-8de9-520cea3d320c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1331 microversion: 2.1 time: 0.244011 Aug 02 07:08:02.143516 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2152/4213] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:01 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1331 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:02.505105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7c62ff62-8824-475b-b532-49c84be98c06 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:02.505936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7c62ff62-8824-475b-b532-49c84be98c06 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:02.524497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c62ff62-8824-475b-b532-49c84be98c06 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:02.525253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c62ff62-8824-475b-b532-49c84be98c06 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:02.526294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c62ff62-8824-475b-b532-49c84be98c06 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:02.526742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c62ff62-8824-475b-b532-49c84be98c06 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:02.557543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ce7f462d-b83d-4ed7-8a0e-6b64487ae8e1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:02.558748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ce7f462d-b83d-4ed7-8a0e-6b64487ae8e1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:02.571255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce7f462d-b83d-4ed7-8a0e-6b64487ae8e1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:02.572103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce7f462d-b83d-4ed7-8a0e-6b64487ae8e1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:02.573116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce7f462d-b83d-4ed7-8a0e-6b64487ae8e1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:02.573780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce7f462d-b83d-4ed7-8a0e-6b64487ae8e1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:02.699470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ce7f462d-b83d-4ed7-8a0e-6b64487ae8e1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:02.707689 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ce7f462d-b83d-4ed7-8a0e-6b64487ae8e1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 200 len: 1286 microversion: 2.1 time: 0.154055 Aug 02 07:08:02.717026 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2153/4214] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:02 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 1286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:02.823308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7c62ff62-8824-475b-b532-49c84be98c06 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:02.834636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7c62ff62-8824-475b-b532-49c84be98c06 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:02.836824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7c62ff62-8824-475b-b532-49c84be98c06 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:02.856168 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7c62ff62-8824-475b-b532-49c84be98c06 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1720 microversion: 2.20 time: 0.355387 Aug 02 07:08:02.892825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c6bc4375-aa86-462b-9e64-840fa89d3c8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:02.893633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c6bc4375-aa86-462b-9e64-840fa89d3c8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:02.896823 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2062/4215] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:02 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1720 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:02.911056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6bc4375-aa86-462b-9e64-840fa89d3c8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:02.911972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6bc4375-aa86-462b-9e64-840fa89d3c8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:02.913115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6bc4375-aa86-462b-9e64-840fa89d3c8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:02.916052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6bc4375-aa86-462b-9e64-840fa89d3c8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:03.091351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c5a1c1e7-ab44-4843-8ecd-7f60982c9d0c tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:03.092031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c5a1c1e7-ab44-4843-8ecd-7f60982c9d0c tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:03.101920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5a1c1e7-ab44-4843-8ecd-7f60982c9d0c tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:03.109342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5a1c1e7-ab44-4843-8ecd-7f60982c9d0c tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:03.116076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5a1c1e7-ab44-4843-8ecd-7f60982c9d0c tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:03.116705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5a1c1e7-ab44-4843-8ecd-7f60982c9d0c tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:03.238843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c6bc4375-aa86-462b-9e64-840fa89d3c8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:03.278345 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c6bc4375-aa86-462b-9e64-840fa89d3c8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.387174 Aug 02 07:08:03.282198 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2154/4216] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:02 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:08:03.296939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b3686f2d-5b08-4c52-83b9-7560971a4ae5 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:03.300158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b3686f2d-5b08-4c52-83b9-7560971a4ae5 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:03.324803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3686f2d-5b08-4c52-83b9-7560971a4ae5 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:03.325820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3686f2d-5b08-4c52-83b9-7560971a4ae5 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:03.327500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3686f2d-5b08-4c52-83b9-7560971a4ae5 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:03.328107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3686f2d-5b08-4c52-83b9-7560971a4ae5 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:03.787763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b3686f2d-5b08-4c52-83b9-7560971a4ae5 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:03.814093 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b3686f2d-5b08-4c52-83b9-7560971a4ae5 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1331 microversion: 2.1 time: 0.526955 Aug 02 07:08:03.818366 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2155/4217] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:03 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1331 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:03.849271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ee68d9e4-bdef-4d92-ae38-2f53a0d6cb91 req-4ab525bb-a4b9-49e7-af8a-a701800b8beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9ae016-6a95-4257-8d74-99fcd50ae1cb", "name": "network-vif-unplugged", "status": "completed", "tag": "3ee7c406-2514-4927-ba77-18750ac8d2ab"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:03.916470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ee68d9e4-bdef-4d92-ae38-2f53a0d6cb91 req-4ab525bb-a4b9-49e7-af8a-a701800b8beb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:03.916952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ee68d9e4-bdef-4d92-ae38-2f53a0d6cb91 req-4ab525bb-a4b9-49e7-af8a-a701800b8beb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:03.960820 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ee68d9e4-bdef-4d92-ae38-2f53a0d6cb91 req-4ab525bb-a4b9-49e7-af8a-a701800b8beb service nova] Creating event network-vif-unplugged:3ee7c406-2514-4927-ba77-18750ac8d2ab for instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb on n-h1-851337-3 Aug 02 07:08:03.998090 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ee68d9e4-bdef-4d92-ae38-2f53a0d6cb91 req-4ab525bb-a4b9-49e7-af8a-a701800b8beb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161405 Aug 02 07:08:03.999132 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2156/4218] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:04.017841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-81292e05-5417-486e-afcc-c41d6a34dcd9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:04.019228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-81292e05-5417-486e-afcc-c41d6a34dcd9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:04.046731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81292e05-5417-486e-afcc-c41d6a34dcd9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:04.047192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81292e05-5417-486e-afcc-c41d6a34dcd9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:04.047985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81292e05-5417-486e-afcc-c41d6a34dcd9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:04.048683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81292e05-5417-486e-afcc-c41d6a34dcd9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:04.300739 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c5a1c1e7-ab44-4843-8ecd-7f60982c9d0c tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1834 microversion: 2.1 time: 1.215112 Aug 02 07:08:04.310332 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2063/4219] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:03 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1834 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:04.340813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7f5be89e-5852-41e5-a647-dd8d142c8ca2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:04.342921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7f5be89e-5852-41e5-a647-dd8d142c8ca2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:04.369787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f5be89e-5852-41e5-a647-dd8d142c8ca2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:04.370611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f5be89e-5852-41e5-a647-dd8d142c8ca2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:04.380888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f5be89e-5852-41e5-a647-dd8d142c8ca2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:04.381719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f5be89e-5852-41e5-a647-dd8d142c8ca2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:04.444989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-81292e05-5417-486e-afcc-c41d6a34dcd9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:04.453079 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-81292e05-5417-486e-afcc-c41d6a34dcd9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 200 len: 1328 microversion: 2.1 time: 0.447491 Aug 02 07:08:04.457874 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2157/4220] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:03 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 1328 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:04.476817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a0d136a0-33f0-4ff7-82b7-77aee8cad155 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:04.477743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a0d136a0-33f0-4ff7-82b7-77aee8cad155 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:04.484546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0d136a0-33f0-4ff7-82b7-77aee8cad155 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:04.485827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0d136a0-33f0-4ff7-82b7-77aee8cad155 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:04.486821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0d136a0-33f0-4ff7-82b7-77aee8cad155 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:04.487437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0d136a0-33f0-4ff7-82b7-77aee8cad155 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:04.798212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7f5be89e-5852-41e5-a647-dd8d142c8ca2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:04.814036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7f5be89e-5852-41e5-a647-dd8d142c8ca2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:04.817648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7f5be89e-5852-41e5-a647-dd8d142c8ca2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:04.822284 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7f5be89e-5852-41e5-a647-dd8d142c8ca2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1720 microversion: 2.20 time: 0.505728 Aug 02 07:08:04.869008 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2064/4221] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:04 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1720 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:04.879841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-559894e3-e4a7-4426-ba02-3a03674c3e1f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:04.884966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-559894e3-e4a7-4426-ba02-3a03674c3e1f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:04.896658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-559894e3-e4a7-4426-ba02-3a03674c3e1f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:04.897446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-559894e3-e4a7-4426-ba02-3a03674c3e1f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:04.899736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-559894e3-e4a7-4426-ba02-3a03674c3e1f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:04.900649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-559894e3-e4a7-4426-ba02-3a03674c3e1f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:04.961774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a0d136a0-33f0-4ff7-82b7-77aee8cad155 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:04.970170 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a0d136a0-33f0-4ff7-82b7-77aee8cad155 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.510906 Aug 02 07:08:04.970679 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2158/4222] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:04 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:04.976591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-07c34520-9554-4208-a973-06bbcf295511 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:04.978805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-07c34520-9554-4208-a973-06bbcf295511 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:04.997263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07c34520-9554-4208-a973-06bbcf295511 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:04.997716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07c34520-9554-4208-a973-06bbcf295511 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:04.998611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07c34520-9554-4208-a973-06bbcf295511 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:04.999068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07c34520-9554-4208-a973-06bbcf295511 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:05.185738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-559894e3-e4a7-4426-ba02-3a03674c3e1f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:05.201487 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-559894e3-e4a7-4426-ba02-3a03674c3e1f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1683 microversion: 2.1 time: 0.329008 Aug 02 07:08:05.202194 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2065/4223] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:04 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1683 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:05.210920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-07c34520-9554-4208-a973-06bbcf295511 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:05.222635 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-07c34520-9554-4208-a973-06bbcf295511 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1331 microversion: 2.1 time: 0.250678 Aug 02 07:08:05.223272 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2159/4224] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:04 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1331 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:05.349147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-30bbcc9f-6067-4290-b908-ec7b76bfc943 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:05.352469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-30bbcc9f-6067-4290-b908-ec7b76bfc943 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:05.359489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30bbcc9f-6067-4290-b908-ec7b76bfc943 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:05.360051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30bbcc9f-6067-4290-b908-ec7b76bfc943 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:05.360939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30bbcc9f-6067-4290-b908-ec7b76bfc943 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:05.361703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30bbcc9f-6067-4290-b908-ec7b76bfc943 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:05.413506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-759480af-5882-4caf-b158-a85444c284e3 req-d3474515-546f-419a-b311-463114db6334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbbef094-4c9f-4465-8f94-3f251fb13b64", "tag": "762cb23f-cfd7-489f-a797-6621b64df34d"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:05.423939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-759480af-5882-4caf-b158-a85444c284e3 req-d3474515-546f-419a-b311-463114db6334 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:05.424674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-759480af-5882-4caf-b158-a85444c284e3 req-d3474515-546f-419a-b311-463114db6334 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:05.439690 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-759480af-5882-4caf-b158-a85444c284e3 req-d3474515-546f-419a-b311-463114db6334 service nova] Creating event network-changed:762cb23f-cfd7-489f-a797-6621b64df34d for instance dbbef094-4c9f-4465-8f94-3f251fb13b64 on n-h2-851337-3 Aug 02 07:08:05.445006 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-759480af-5882-4caf-b158-a85444c284e3 req-d3474515-546f-419a-b311-463114db6334 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035919 Aug 02 07:08:05.446847 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2160/4225] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:05.483566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-acbf64d8-5701-49d8-9a53-a4201a3d97a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:05.484945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-acbf64d8-5701-49d8-9a53-a4201a3d97a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:05.493581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-acbf64d8-5701-49d8-9a53-a4201a3d97a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:05.494453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-acbf64d8-5701-49d8-9a53-a4201a3d97a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:05.496061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-acbf64d8-5701-49d8-9a53-a4201a3d97a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:05.496722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-acbf64d8-5701-49d8-9a53-a4201a3d97a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:05.517749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:05.656355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-acbf64d8-5701-49d8-9a53-a4201a3d97a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:05.667531 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-acbf64d8-5701-49d8-9a53-a4201a3d97a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 200 len: 1328 microversion: 2.1 time: 0.188888 Aug 02 07:08:05.669461 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2161/4226] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:05 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 1328 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:05.855509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df52f06c-36bc-4839-a615-4b1ad4b1ada2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:05.856277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df52f06c-36bc-4839-a615-4b1ad4b1ada2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:05.862764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df52f06c-36bc-4839-a615-4b1ad4b1ada2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:05.863219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df52f06c-36bc-4839-a615-4b1ad4b1ada2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:05.864000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df52f06c-36bc-4839-a615-4b1ad4b1ada2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:05.864439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df52f06c-36bc-4839-a615-4b1ad4b1ada2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:06.076878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-df52f06c-36bc-4839-a615-4b1ad4b1ada2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:06.085315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-df52f06c-36bc-4839-a615-4b1ad4b1ada2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:06.086939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-df52f06c-36bc-4839-a615-4b1ad4b1ada2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:06.088131 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df52f06c-36bc-4839-a615-4b1ad4b1ada2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1720 microversion: 2.20 time: 0.241925 Aug 02 07:08:06.102198 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2162/4227] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:05 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1720 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:08:06.102198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-74482f81-8300-4756-9dff-a012eb7689f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:06.102198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-74482f81-8300-4756-9dff-a012eb7689f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:06.102198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74482f81-8300-4756-9dff-a012eb7689f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:06.102198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74482f81-8300-4756-9dff-a012eb7689f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:06.102709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74482f81-8300-4756-9dff-a012eb7689f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:06.103073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74482f81-8300-4756-9dff-a012eb7689f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:06.134420 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-30bbcc9f-6067-4290-b908-ec7b76bfc943 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331/action" status: 200 len: 32638 microversion: 2.1 time: 0.788893 Aug 02 07:08:06.135514 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2066/4228] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:08:05 2022] POST /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331/action => generated 32638 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:08:06.244977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d42d9999-caeb-4f92-a4f3-5d4c1cd0f6db tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:06.246004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d42d9999-caeb-4f92-a4f3-5d4c1cd0f6db tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:06.253176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d42d9999-caeb-4f92-a4f3-5d4c1cd0f6db tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:06.254229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d42d9999-caeb-4f92-a4f3-5d4c1cd0f6db tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:06.255241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d42d9999-caeb-4f92-a4f3-5d4c1cd0f6db tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:06.255834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d42d9999-caeb-4f92-a4f3-5d4c1cd0f6db tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:06.273637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-74482f81-8300-4756-9dff-a012eb7689f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:06.281731 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-74482f81-8300-4756-9dff-a012eb7689f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.191608 Aug 02 07:08:06.290794 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2163/4229] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:06 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:06.296294 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-269a79c6-642e-4abb-968c-1bca37e42ac0 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:06.300387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-269a79c6-642e-4abb-968c-1bca37e42ac0 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:06.318098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-269a79c6-642e-4abb-968c-1bca37e42ac0 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:06.321706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-269a79c6-642e-4abb-968c-1bca37e42ac0 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:06.323493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-269a79c6-642e-4abb-968c-1bca37e42ac0 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:06.327593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-269a79c6-642e-4abb-968c-1bca37e42ac0 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:06.391314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-269a79c6-642e-4abb-968c-1bca37e42ac0 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7a0cc023da4147a2960d160dd0183018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c62bc9c5a48a6aa19a8f07984981d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:06.391828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-269a79c6-642e-4abb-968c-1bca37e42ac0 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] flavor_id is None. Assuming migration. {{(pid=126120) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 02 07:08:06.392278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-269a79c6-642e-4abb-968c-1bca37e42ac0 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126120) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 07:08:06.514483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d42d9999-caeb-4f92-a4f3-5d4c1cd0f6db tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:06.522340 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d42d9999-caeb-4f92-a4f3-5d4c1cd0f6db tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1331 microversion: 2.1 time: 0.281531 Aug 02 07:08:06.522926 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2067/4230] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:06 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1331 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:08:06.689561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9d423cb2-0e4e-4113-bc21-bd72617fea79 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:06.690197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9d423cb2-0e4e-4113-bc21-bd72617fea79 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:06.698528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d423cb2-0e4e-4113-bc21-bd72617fea79 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:06.698980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d423cb2-0e4e-4113-bc21-bd72617fea79 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:06.699508 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-269a79c6-642e-4abb-968c-1bca37e42ac0 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331/action" status: 202 len: 0 microversion: 2.1 time: 0.407209 Aug 02 07:08:06.699748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d423cb2-0e4e-4113-bc21-bd72617fea79 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:06.700179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d423cb2-0e4e-4113-bc21-bd72617fea79 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:06.700463 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2164/4231] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:08:06 2022] POST /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:08:06.709036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-991f7c5e-d503-4f7e-bc8c-e04056080f89 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:06.709653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-991f7c5e-d503-4f7e-bc8c-e04056080f89 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:06.720005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-991f7c5e-d503-4f7e-bc8c-e04056080f89 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:06.720443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-991f7c5e-d503-4f7e-bc8c-e04056080f89 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:06.721824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-991f7c5e-d503-4f7e-bc8c-e04056080f89 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:06.722165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-991f7c5e-d503-4f7e-bc8c-e04056080f89 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:06.987312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-991f7c5e-d503-4f7e-bc8c-e04056080f89 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:06.999626 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-991f7c5e-d503-4f7e-bc8c-e04056080f89 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1692 microversion: 2.1 time: 0.294945 Aug 02 07:08:07.003547 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2165/4232] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:06 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1692 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:08:07.034042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9d423cb2-0e4e-4113-bc21-bd72617fea79 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:07.042881 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9d423cb2-0e4e-4113-bc21-bd72617fea79 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 200 len: 1328 microversion: 2.1 time: 0.357857 Aug 02 07:08:07.045369 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2068/4233] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:06 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 1328 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:07.114647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9466baca-53c4-439e-9c7b-450aff187035 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:07.115252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9466baca-53c4-439e-9c7b-450aff187035 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:07.129473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9466baca-53c4-439e-9c7b-450aff187035 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:07.129957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9466baca-53c4-439e-9c7b-450aff187035 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:07.130722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9466baca-53c4-439e-9c7b-450aff187035 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:07.136413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9466baca-53c4-439e-9c7b-450aff187035 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:07.313776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-95d60097-4511-4450-9a8c-e2925840a48a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:07.314596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-95d60097-4511-4450-9a8c-e2925840a48a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:07.326296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95d60097-4511-4450-9a8c-e2925840a48a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:07.327087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95d60097-4511-4450-9a8c-e2925840a48a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:07.330146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95d60097-4511-4450-9a8c-e2925840a48a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:07.330811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95d60097-4511-4450-9a8c-e2925840a48a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:07.508195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9466baca-53c4-439e-9c7b-450aff187035 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:07.519757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9466baca-53c4-439e-9c7b-450aff187035 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:07.522960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9466baca-53c4-439e-9c7b-450aff187035 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:07.527251 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9466baca-53c4-439e-9c7b-450aff187035 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1663 microversion: 2.20 time: 0.415777 Aug 02 07:08:07.546680 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2166/4234] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:07 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1663 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:07.553460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-20ce2e60-fd43-4087-835c-21dd132a868d req-a6596c24-ac37-4006-b4f6-79061e0b4a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d05fd34-5166-4491-9425-fc2da25e106f", "name": "network-vif-plugged", "status": "completed", "tag": "9bfac521-3575-41c1-ac0e-8d05e3335152"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:07.576177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-20ce2e60-fd43-4087-835c-21dd132a868d req-a6596c24-ac37-4006-b4f6-79061e0b4a06 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:07.578005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-20ce2e60-fd43-4087-835c-21dd132a868d req-a6596c24-ac37-4006-b4f6-79061e0b4a06 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:07.601727 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-20ce2e60-fd43-4087-835c-21dd132a868d req-a6596c24-ac37-4006-b4f6-79061e0b4a06 service nova] Creating event network-vif-plugged:9bfac521-3575-41c1-ac0e-8d05e3335152 for instance 2d05fd34-5166-4491-9425-fc2da25e106f on n-h1-851337-3 Aug 02 07:08:07.615473 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-20ce2e60-fd43-4087-835c-21dd132a868d req-a6596c24-ac37-4006-b4f6-79061e0b4a06 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084623 Aug 02 07:08:07.622081 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2167/4235] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:07.627204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d04961fb-bc39-48ab-8c64-8ba7a2045823 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:07.627905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d04961fb-bc39-48ab-8c64-8ba7a2045823 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:07.646138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d04961fb-bc39-48ab-8c64-8ba7a2045823 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:07.646591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d04961fb-bc39-48ab-8c64-8ba7a2045823 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:07.647383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d04961fb-bc39-48ab-8c64-8ba7a2045823 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:07.647805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d04961fb-bc39-48ab-8c64-8ba7a2045823 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:07.666684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-95d60097-4511-4450-9a8c-e2925840a48a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:07.688295 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-95d60097-4511-4450-9a8c-e2925840a48a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.378653 Aug 02 07:08:07.688890 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2069/4236] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:07 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:08:07.715952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0beac9bc-700c-4b4f-ba69-0e1f6d285039 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1d7e351-139d-4c5a-9f7b-9ceed5c6077e"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:07.718987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0beac9bc-700c-4b4f-ba69-0e1f6d285039 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:07.735256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0beac9bc-700c-4b4f-ba69-0e1f6d285039 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:07.735961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0beac9bc-700c-4b4f-ba69-0e1f6d285039 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:07.736967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0beac9bc-700c-4b4f-ba69-0e1f6d285039 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:07.737618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0beac9bc-700c-4b4f-ba69-0e1f6d285039 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:07.743804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:07.971120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d04961fb-bc39-48ab-8c64-8ba7a2045823 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:07.992186 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d04961fb-bc39-48ab-8c64-8ba7a2045823 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1331 microversion: 2.1 time: 0.369120 Aug 02 07:08:07.993146 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2168/4237] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:07 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1331 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:08.026585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cc56a258-4cbb-419d-b2cb-1e3fc2f5978f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:08.027135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cc56a258-4cbb-419d-b2cb-1e3fc2f5978f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:08.039803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc56a258-4cbb-419d-b2cb-1e3fc2f5978f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:08.040262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc56a258-4cbb-419d-b2cb-1e3fc2f5978f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:08.041113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc56a258-4cbb-419d-b2cb-1e3fc2f5978f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:08.041473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc56a258-4cbb-419d-b2cb-1e3fc2f5978f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:08.249939 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0beac9bc-700c-4b4f-ba69-0e1f6d285039 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "POST /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.549936 Aug 02 07:08:08.251181 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2070/4238] 10.222.0.79 () {62 vars in 1364 bytes} [Tue Aug 2 07:08:07 2022] POST /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments => generated 188 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:08:08.285525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b177d5f0-f121-41ca-bb92-872d534addfa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:08.286476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b177d5f0-f121-41ca-bb92-872d534addfa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:08.288461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cc56a258-4cbb-419d-b2cb-1e3fc2f5978f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:08.294672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b177d5f0-f121-41ca-bb92-872d534addfa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:08.295589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b177d5f0-f121-41ca-bb92-872d534addfa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:08.296651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b177d5f0-f121-41ca-bb92-872d534addfa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:08.297262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b177d5f0-f121-41ca-bb92-872d534addfa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:08.309872 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cc56a258-4cbb-419d-b2cb-1e3fc2f5978f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1692 microversion: 2.1 time: 0.288659 Aug 02 07:08:08.316716 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2169/4239] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:08 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1692 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:08.574254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b177d5f0-f121-41ca-bb92-872d534addfa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:08.587147 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b177d5f0-f121-41ca-bb92-872d534addfa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 200 len: 1328 microversion: 2.1 time: 0.334079 Aug 02 07:08:08.587948 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2071/4240] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:08 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 1328 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:08.614196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f441d36d-341f-4b43-82d0-379cb705c151 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:08.614815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f441d36d-341f-4b43-82d0-379cb705c151 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:08.625817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f441d36d-341f-4b43-82d0-379cb705c151 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:08.626377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f441d36d-341f-4b43-82d0-379cb705c151 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:08.627945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f441d36d-341f-4b43-82d0-379cb705c151 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:08.627945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f441d36d-341f-4b43-82d0-379cb705c151 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:08.717408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1ba2dea4-39ac-4126-ad46-13b618926ec9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:08.719911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1ba2dea4-39ac-4126-ad46-13b618926ec9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:08.720565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f441d36d-341f-4b43-82d0-379cb705c151 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126120) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 07:08:08.745579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ba2dea4-39ac-4126-ad46-13b618926ec9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:08.747318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ba2dea4-39ac-4126-ad46-13b618926ec9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:08.753355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ba2dea4-39ac-4126-ad46-13b618926ec9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:08.757406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ba2dea4-39ac-4126-ad46-13b618926ec9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:08.849496 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f441d36d-341f-4b43-82d0-379cb705c151 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "POST /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/action" status: 202 len: 0 microversion: 2.20 time: 0.241237 Aug 02 07:08:08.850166 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2170/4241] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Aug 2 07:08:08 2022] POST /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:08:08.863402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3b81c432-fa06-4dcb-b62e-0d487f5b935e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:08.864019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3b81c432-fa06-4dcb-b62e-0d487f5b935e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:08.882510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b81c432-fa06-4dcb-b62e-0d487f5b935e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:08.884398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b81c432-fa06-4dcb-b62e-0d487f5b935e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:08.886942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b81c432-fa06-4dcb-b62e-0d487f5b935e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:08.889267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b81c432-fa06-4dcb-b62e-0d487f5b935e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:09.196742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1ba2dea4-39ac-4126-ad46-13b618926ec9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:09.205715 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1ba2dea4-39ac-4126-ad46-13b618926ec9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.498636 Aug 02 07:08:09.223960 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2072/4242] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:08 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:09.229292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8ae7af8a-e1c3-4327-a08f-215fdf4485af tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:09.234608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8ae7af8a-e1c3-4327-a08f-215fdf4485af tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:09.250770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ae7af8a-e1c3-4327-a08f-215fdf4485af tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:09.251457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ae7af8a-e1c3-4327-a08f-215fdf4485af tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:09.252403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ae7af8a-e1c3-4327-a08f-215fdf4485af tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:09.253048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ae7af8a-e1c3-4327-a08f-215fdf4485af tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:09.334209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:09.403049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:09.412597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3b81c432-fa06-4dcb-b62e-0d487f5b935e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:09.430055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3b81c432-fa06-4dcb-b62e-0d487f5b935e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:09.436892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3b81c432-fa06-4dcb-b62e-0d487f5b935e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:09.451844 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3b81c432-fa06-4dcb-b62e-0d487f5b935e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1749 microversion: 2.20 time: 0.589661 Aug 02 07:08:09.455100 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2171/4243] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:08 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1749 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:09.473975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c133aa14-6828-41b4-baa9-607bb8bd59d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:09.476286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c133aa14-6828-41b4-baa9-607bb8bd59d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:09.503603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c133aa14-6828-41b4-baa9-607bb8bd59d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:09.504933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c133aa14-6828-41b4-baa9-607bb8bd59d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:09.506846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c133aa14-6828-41b4-baa9-607bb8bd59d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:09.510415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c133aa14-6828-41b4-baa9-607bb8bd59d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:09.766626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8ae7af8a-e1c3-4327-a08f-215fdf4485af tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:09.791994 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8ae7af8a-e1c3-4327-a08f-215fdf4485af tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1331 microversion: 2.1 time: 0.562299 Aug 02 07:08:09.807321 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2073/4244] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:09 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1331 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:09.813101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-45fd2b1b-508a-4eb4-be87-04abebeaa9ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:09.814075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-45fd2b1b-508a-4eb4-be87-04abebeaa9ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:09.822535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45fd2b1b-508a-4eb4-be87-04abebeaa9ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:09.823242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45fd2b1b-508a-4eb4-be87-04abebeaa9ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:09.824208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45fd2b1b-508a-4eb4-be87-04abebeaa9ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:09.824791 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45fd2b1b-508a-4eb4-be87-04abebeaa9ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:09.838905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c133aa14-6828-41b4-baa9-607bb8bd59d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:09.848866 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c133aa14-6828-41b4-baa9-607bb8bd59d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1692 microversion: 2.1 time: 0.392390 Aug 02 07:08:09.854964 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2172/4245] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:09 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1692 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:10.071953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-45fd2b1b-508a-4eb4-be87-04abebeaa9ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:10.081075 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-45fd2b1b-508a-4eb4-be87-04abebeaa9ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 200 len: 1328 microversion: 2.1 time: 0.272162 Aug 02 07:08:10.084404 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2074/4246] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:09 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 1328 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:10.240311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ea9c7e98-ade6-4bb9-8528-69427cd8a9f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:10.242916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ea9c7e98-ade6-4bb9-8528-69427cd8a9f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:10.259933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea9c7e98-ade6-4bb9-8528-69427cd8a9f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:10.263511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea9c7e98-ade6-4bb9-8528-69427cd8a9f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:10.264663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea9c7e98-ade6-4bb9-8528-69427cd8a9f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:10.266199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea9c7e98-ade6-4bb9-8528-69427cd8a9f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:10.494372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7cc8ab43-5062-4f0d-9dda-fb25a4b39520 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:10.495309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7cc8ab43-5062-4f0d-9dda-fb25a4b39520 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:10.518596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=14 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:10.522182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ea9c7e98-ade6-4bb9-8528-69427cd8a9f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:10.528154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cc8ab43-5062-4f0d-9dda-fb25a4b39520 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:10.528758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cc8ab43-5062-4f0d-9dda-fb25a4b39520 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:10.532958 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ea9c7e98-ade6-4bb9-8528-69427cd8a9f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.305789 Aug 02 07:08:10.534269 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2173/4247] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:10 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:10.535954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cc8ab43-5062-4f0d-9dda-fb25a4b39520 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:10.546494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cc8ab43-5062-4f0d-9dda-fb25a4b39520 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:10.814701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8177bd27-0f86-4586-9a9c-2cb55054b71c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:10.815475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8177bd27-0f86-4586-9a9c-2cb55054b71c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:10.839144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8177bd27-0f86-4586-9a9c-2cb55054b71c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:10.841707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8177bd27-0f86-4586-9a9c-2cb55054b71c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:10.847846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8177bd27-0f86-4586-9a9c-2cb55054b71c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:10.848793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8177bd27-0f86-4586-9a9c-2cb55054b71c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:10.872100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7cc8ab43-5062-4f0d-9dda-fb25a4b39520 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:10.885309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7cc8ab43-5062-4f0d-9dda-fb25a4b39520 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:10.887581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7cc8ab43-5062-4f0d-9dda-fb25a4b39520 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:10.889728 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7cc8ab43-5062-4f0d-9dda-fb25a4b39520 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1749 microversion: 2.20 time: 0.400376 Aug 02 07:08:10.891791 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2075/4248] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:10 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1749 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:08:10.898449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5b21e02f-0e24-46ab-a38b-f8e1dfd987ca tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:10.899338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5b21e02f-0e24-46ab-a38b-f8e1dfd987ca tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:10.908136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b21e02f-0e24-46ab-a38b-f8e1dfd987ca tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:10.908970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b21e02f-0e24-46ab-a38b-f8e1dfd987ca tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:10.910029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b21e02f-0e24-46ab-a38b-f8e1dfd987ca tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:10.910633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b21e02f-0e24-46ab-a38b-f8e1dfd987ca tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:11.241537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5b21e02f-0e24-46ab-a38b-f8e1dfd987ca tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:11.253582 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5b21e02f-0e24-46ab-a38b-f8e1dfd987ca tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1692 microversion: 2.1 time: 0.358528 Aug 02 07:08:11.254896 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2076/4249] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:10 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1692 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:11.274380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-55b3377d-7f27-45e5-b018-96e1119d70ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:11.275695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-55b3377d-7f27-45e5-b018-96e1119d70ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:11.290972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55b3377d-7f27-45e5-b018-96e1119d70ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:11.298979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55b3377d-7f27-45e5-b018-96e1119d70ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:11.298979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55b3377d-7f27-45e5-b018-96e1119d70ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:11.298979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-55b3377d-7f27-45e5-b018-96e1119d70ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:11.326918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8177bd27-0f86-4586-9a9c-2cb55054b71c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:11.337697 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8177bd27-0f86-4586-9a9c-2cb55054b71c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1535 microversion: 2.1 time: 0.528406 Aug 02 07:08:11.339451 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2174/4250] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:10 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1535 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:11.347559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-46849390-9cbd-4e91-a953-eb9a6c1b84e9 req-2fdfdd34-f9fd-45b0-90e5-8342d94c9f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbbef094-4c9f-4465-8f94-3f251fb13b64", "name": "network-vif-plugged", "status": "completed", "tag": "762cb23f-cfd7-489f-a797-6621b64df34d"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:11.363471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-46849390-9cbd-4e91-a953-eb9a6c1b84e9 req-2fdfdd34-f9fd-45b0-90e5-8342d94c9f07 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:11.364236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-46849390-9cbd-4e91-a953-eb9a6c1b84e9 req-2fdfdd34-f9fd-45b0-90e5-8342d94c9f07 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:11.378736 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-46849390-9cbd-4e91-a953-eb9a6c1b84e9 req-2fdfdd34-f9fd-45b0-90e5-8342d94c9f07 service nova] Creating event network-vif-plugged:762cb23f-cfd7-489f-a797-6621b64df34d for instance dbbef094-4c9f-4465-8f94-3f251fb13b64 on n-h2-851337-3 Aug 02 07:08:11.385371 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-46849390-9cbd-4e91-a953-eb9a6c1b84e9 req-2fdfdd34-f9fd-45b0-90e5-8342d94c9f07 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044132 Aug 02 07:08:11.386993 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2175/4251] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:11.394020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-798f0609-d4f0-447a-b8ff-747446880756 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Action: 'create', calling method: .version_select at 0x7f927a82fee0>, body: {"pool": "a216acbd-5c92-441a-b243-674c18d16f72"} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:11.776623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-55b3377d-7f27-45e5-b018-96e1119d70ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:11.789433 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-55b3377d-7f27-45e5-b018-96e1119d70ac tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 200 len: 1328 microversion: 2.1 time: 0.529894 Aug 02 07:08:11.790285 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2077/4252] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:11 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 1328 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:11.823160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-86e34e92-6ad4-41ff-be66-7bc17809977c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:11.824389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-86e34e92-6ad4-41ff-be66-7bc17809977c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:11.836036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86e34e92-6ad4-41ff-be66-7bc17809977c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:11.836594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86e34e92-6ad4-41ff-be66-7bc17809977c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:11.839852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86e34e92-6ad4-41ff-be66-7bc17809977c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:11.843560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86e34e92-6ad4-41ff-be66-7bc17809977c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:12.427009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-86e34e92-6ad4-41ff-be66-7bc17809977c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:12.435956 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-86e34e92-6ad4-41ff-be66-7bc17809977c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.631621 Aug 02 07:08:12.436681 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2078/4253] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:11 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:12.441612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-49ec6217-88ad-4ce7-a0ea-bb0e6349e555 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:12.442859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-49ec6217-88ad-4ce7-a0ea-bb0e6349e555 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:12.449845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49ec6217-88ad-4ce7-a0ea-bb0e6349e555 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:12.451662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49ec6217-88ad-4ce7-a0ea-bb0e6349e555 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:12.452858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49ec6217-88ad-4ce7-a0ea-bb0e6349e555 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:12.453524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49ec6217-88ad-4ce7-a0ea-bb0e6349e555 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:12.695689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-49ec6217-88ad-4ce7-a0ea-bb0e6349e555 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:12.706091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-49ec6217-88ad-4ce7-a0ea-bb0e6349e555 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:12.708687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-49ec6217-88ad-4ce7-a0ea-bb0e6349e555 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:12.710074 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-49ec6217-88ad-4ce7-a0ea-bb0e6349e555 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1751 microversion: 2.20 time: 0.272186 Aug 02 07:08:12.711059 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2079/4254] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:12 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1751 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:12.717056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8b2e60df-eb97-41b2-aa33-d6186532cdea tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:12.717552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8b2e60df-eb97-41b2-aa33-d6186532cdea tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:12.724371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8b2e60df-eb97-41b2-aa33-d6186532cdea tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:12.725009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8b2e60df-eb97-41b2-aa33-d6186532cdea tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:12.726068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8b2e60df-eb97-41b2-aa33-d6186532cdea tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:12.726727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8b2e60df-eb97-41b2-aa33-d6186532cdea tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:12.984080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8b2e60df-eb97-41b2-aa33-d6186532cdea tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:12.998450 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8b2e60df-eb97-41b2-aa33-d6186532cdea tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1697 microversion: 2.1 time: 0.286142 Aug 02 07:08:12.999737 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2080/4255] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:12 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1697 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:13.006660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-57c6df80-9cfa-4b9c-ab5d-76248bb5107d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:13.007869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-57c6df80-9cfa-4b9c-ab5d-76248bb5107d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:13.017119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-57c6df80-9cfa-4b9c-ab5d-76248bb5107d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:13.017566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-57c6df80-9cfa-4b9c-ab5d-76248bb5107d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:13.018511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-57c6df80-9cfa-4b9c-ab5d-76248bb5107d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:13.018938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-57c6df80-9cfa-4b9c-ab5d-76248bb5107d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:13.281589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-57c6df80-9cfa-4b9c-ab5d-76248bb5107d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:13.290819 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-57c6df80-9cfa-4b9c-ab5d-76248bb5107d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 200 len: 1328 microversion: 2.1 time: 0.289494 Aug 02 07:08:13.294642 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2081/4256] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:12 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 1328 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:13.461418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-28fc966c-0852-446a-afa6-43c84b0de872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:13.462079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-28fc966c-0852-446a-afa6-43c84b0de872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:13.469431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28fc966c-0852-446a-afa6-43c84b0de872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:13.470172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28fc966c-0852-446a-afa6-43c84b0de872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:13.471035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28fc966c-0852-446a-afa6-43c84b0de872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:13.471520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28fc966c-0852-446a-afa6-43c84b0de872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:13.743368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-28fc966c-0852-446a-afa6-43c84b0de872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:13.754383 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-28fc966c-0852-446a-afa6-43c84b0de872 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.296440 Aug 02 07:08:13.755106 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2082/4257] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:13 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:13.770638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a925eb62-6869-4612-8cb5-d17cca717ce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:13.773373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a925eb62-6869-4612-8cb5-d17cca717ce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:13.791034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a925eb62-6869-4612-8cb5-d17cca717ce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:13.791034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a925eb62-6869-4612-8cb5-d17cca717ce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:13.791731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a925eb62-6869-4612-8cb5-d17cca717ce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:13.792170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a925eb62-6869-4612-8cb5-d17cca717ce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:13.792998 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-798f0609-d4f0-447a-b8ff-747446880756 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.398372 Aug 02 07:08:13.793676 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2176/4258] 10.222.0.79 () {60 vars in 1170 bytes} [Tue Aug 2 07:08:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:13.806497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0613eac7-5d00-41e8-bd5f-dc2ec4bb70de tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.185"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:13.809204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0613eac7-5d00-41e8-bd5f-dc2ec4bb70de tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:13.820141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0613eac7-5d00-41e8-bd5f-dc2ec4bb70de tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:13.820598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0613eac7-5d00-41e8-bd5f-dc2ec4bb70de tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:13.821386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0613eac7-5d00-41e8-bd5f-dc2ec4bb70de tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:13.821821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0613eac7-5d00-41e8-bd5f-dc2ec4bb70de tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:13.870633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0613eac7-5d00-41e8-bd5f-dc2ec4bb70de tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Acquired lock "refresh_cache-2d05fd34-5166-4491-9425-fc2da25e106f" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 07:08:14.072044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a925eb62-6869-4612-8cb5-d17cca717ce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:14.084626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a925eb62-6869-4612-8cb5-d17cca717ce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:14.086961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a925eb62-6869-4612-8cb5-d17cca717ce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:14.088454 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a925eb62-6869-4612-8cb5-d17cca717ce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1751 microversion: 2.20 time: 0.332278 Aug 02 07:08:14.089230 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2083/4259] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:13 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1751 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:14.095481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e7863089-8a86-497e-811f-462c584aed23 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:14.096693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e7863089-8a86-497e-811f-462c584aed23 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:14.107115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7863089-8a86-497e-811f-462c584aed23 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:14.107920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7863089-8a86-497e-811f-462c584aed23 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:14.116095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7863089-8a86-497e-811f-462c584aed23 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:14.117408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7863089-8a86-497e-811f-462c584aed23 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:14.146970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:14.471337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e7863089-8a86-497e-811f-462c584aed23 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:14.484537 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e7863089-8a86-497e-811f-462c584aed23 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1697 microversion: 2.1 time: 0.393713 Aug 02 07:08:14.500694 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2084/4260] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:14 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1697 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:14.508853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fcc63906-d066-4028-a247-5f166c70f45a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:14.511097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fcc63906-d066-4028-a247-5f166c70f45a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:14.518881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fcc63906-d066-4028-a247-5f166c70f45a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:14.521971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fcc63906-d066-4028-a247-5f166c70f45a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:14.523182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fcc63906-d066-4028-a247-5f166c70f45a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:14.524525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fcc63906-d066-4028-a247-5f166c70f45a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:14.791457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fcc63906-d066-4028-a247-5f166c70f45a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:14.809594 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fcc63906-d066-4028-a247-5f166c70f45a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 200 len: 1509 microversion: 2.1 time: 0.304110 Aug 02 07:08:14.811118 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2085/4261] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:14 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 1509 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:14.817093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-40f2bcb9-8bc1-42c0-a01f-8e12d9e78283 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:14.818110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-40f2bcb9-8bc1-42c0-a01f-8e12d9e78283 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:14.832948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40f2bcb9-8bc1-42c0-a01f-8e12d9e78283 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:14.833399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40f2bcb9-8bc1-42c0-a01f-8e12d9e78283 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:14.838157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40f2bcb9-8bc1-42c0-a01f-8e12d9e78283 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:14.838609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40f2bcb9-8bc1-42c0-a01f-8e12d9e78283 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:15.115741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-40f2bcb9-8bc1-42c0-a01f-8e12d9e78283 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:15.124312 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-40f2bcb9-8bc1-42c0-a01f-8e12d9e78283 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.311817 Aug 02 07:08:15.124944 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2086/4262] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:14 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:15.133488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3a2a9c3b-8b70-4825-90f8-6b3253aeab06 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:15.134094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3a2a9c3b-8b70-4825-90f8-6b3253aeab06 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:15.154611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a2a9c3b-8b70-4825-90f8-6b3253aeab06 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:15.155053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a2a9c3b-8b70-4825-90f8-6b3253aeab06 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:15.156202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a2a9c3b-8b70-4825-90f8-6b3253aeab06 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:15.156630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a2a9c3b-8b70-4825-90f8-6b3253aeab06 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:15.595516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3a2a9c3b-8b70-4825-90f8-6b3253aeab06 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:15.609088 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3a2a9c3b-8b70-4825-90f8-6b3253aeab06 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 200 len: 1509 microversion: 2.1 time: 0.483002 Aug 02 07:08:15.625359 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2087/4263] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:15 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 1509 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:15.625359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b6931b81-16a9-4153-8667-22447b953457 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:15.625359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b6931b81-16a9-4153-8667-22447b953457 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:15.630602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6931b81-16a9-4153-8667-22447b953457 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:15.638032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6931b81-16a9-4153-8667-22447b953457 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:15.642156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6931b81-16a9-4153-8667-22447b953457 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:15.642846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6931b81-16a9-4153-8667-22447b953457 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:15.886308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b6931b81-16a9-4153-8667-22447b953457 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:15.897025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b6931b81-16a9-4153-8667-22447b953457 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:15.911897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b6931b81-16a9-4153-8667-22447b953457 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:15.913286 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b6931b81-16a9-4153-8667-22447b953457 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1751 microversion: 2.20 time: 0.302222 Aug 02 07:08:15.914299 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2088/4264] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:15 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1751 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:15.919545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0824a130-dd65-4fbc-bab7-a3f7c178125a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0e8d650-e5e7-43f9-ae3e-e4a78421b481"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:15.922487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0824a130-dd65-4fbc-bab7-a3f7c178125a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:15.944575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0824a130-dd65-4fbc-bab7-a3f7c178125a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:15.946309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0824a130-dd65-4fbc-bab7-a3f7c178125a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:15.948775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0824a130-dd65-4fbc-bab7-a3f7c178125a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:15.949881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0824a130-dd65-4fbc-bab7-a3f7c178125a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:15.963025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-0613eac7-5d00-41e8-bd5f-dc2ec4bb70de tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Building network info cache for instance {{(pid=126120) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 02 07:08:15.978207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:16.109952 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-0824a130-dd65-4fbc-bab7-a3f7c178125a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] HTTP exception thrown: Invalid volume: volume b0e8d650-e5e7-43f9-ae3e-e4a78421b481 is already attached to instances: 416496be-7b54-49d4-9d90-3d0be9463e67 Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0824a130-dd65-4fbc-bab7-a3f7c178125a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Request method failure captured: Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments HTTP/1.1 Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 74 Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mw13SPusoL2oig6z8JKTC1nUbf8Rw_5jT5YPT1CWrOABe8wYL59aYsXiUDtU2vA3es6LryNsakcXkaddV2SmWSmf9b0Kir8iKyeHQ1V913RDI7OxthQkB34rsjOk5zDf7k87yoaJrxDD4eFsnTmbVoTrOLyxwi8jQau6VljX5rXYUE Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ee1befa077542b9a17865baad3c9999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}] Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 3a2629fa08b5419a96c2942118d38dad Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: {"volumeAttachment": {"volumeId": "b0e8d650-e5e7-43f9-ae3e-e4a78421b481"}} Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid volume: volume b0e8d650-e5e7-43f9-ae3e-e4a78421b481 is already attached to instances: 416496be-7b54-49d4-9d90-3d0be9463e67 Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'server_id': '416496be-7b54-49d4-9d90-3d0be9463e67', 'body': {'volumeAttachment': {'volumeId': 'b0e8d650-e5e7-43f9-ae3e-e4a78421b481'}}} Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b0e8d650-e5e7-43f9-ae3e-e4a78421b481 is already attached to instances: 416496be-7b54-49d4-9d90-3d0be9463e67 Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:08:16.112830 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b0e8d650-e5e7-43f9-ae3e-e4a78421b481 is already attached to instances: 416496be-7b54-49d4-9d90-3d0be9463e67 Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b0e8d650-e5e7-43f9-ae3e-e4a78421b481 is already attached to instances: 416496be-7b54-49d4-9d90-3d0be9463e67 Aug 02 07:08:16.126205 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:16.133225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0824a130-dd65-4fbc-bab7-a3f7c178125a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Returning 400 to user: Invalid volume: volume b0e8d650-e5e7-43f9-ae3e-e4a78421b481 is already attached to instances: 416496be-7b54-49d4-9d90-3d0be9463e67 {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:08:16.134060 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0824a130-dd65-4fbc-bab7-a3f7c178125a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "POST /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.218663 Aug 02 07:08:16.135545 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2089/4265] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:08:15 2022] POST /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments => generated 174 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:08:16.148151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b75cda2c-0718-44f8-a000-69d463cf1464 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:16.149444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b75cda2c-0718-44f8-a000-69d463cf1464 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:16.160686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b75cda2c-0718-44f8-a000-69d463cf1464 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:16.162750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b75cda2c-0718-44f8-a000-69d463cf1464 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:16.164469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b75cda2c-0718-44f8-a000-69d463cf1464 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:16.165199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b75cda2c-0718-44f8-a000-69d463cf1464 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:16.435084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b75cda2c-0718-44f8-a000-69d463cf1464 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:16.450474 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b75cda2c-0718-44f8-a000-69d463cf1464 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1697 microversion: 2.1 time: 0.312516 Aug 02 07:08:16.459767 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2090/4266] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:16 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1697 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:16.459767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1e7db25f-9525-4617-a7a1-50cc6814fc78 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:16.459767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1e7db25f-9525-4617-a7a1-50cc6814fc78 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:16.486733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e7db25f-9525-4617-a7a1-50cc6814fc78 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:16.487481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e7db25f-9525-4617-a7a1-50cc6814fc78 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:16.488538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e7db25f-9525-4617-a7a1-50cc6814fc78 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:16.489134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e7db25f-9525-4617-a7a1-50cc6814fc78 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:16.525831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1e7db25f-9525-4617-a7a1-50cc6814fc78 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:08:16.724238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:16.738245 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1e7db25f-9525-4617-a7a1-50cc6814fc78 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 204 len: 0 microversion: 2.1 time: 0.285187 Aug 02 07:08:16.740644 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2091/4267] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:08:16 2022] DELETE /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:08:16.750191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-0abcfc44-7d43-4d76-a9e8-d070a5bfeeb5 req-9f7aad3b-e3c6-490b-9de7-7a8bd05c9668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d05fd34-5166-4491-9425-fc2da25e106f", "tag": "9bfac521-3575-41c1-ac0e-8d05e3335152"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:16.775529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0abcfc44-7d43-4d76-a9e8-d070a5bfeeb5 req-9f7aad3b-e3c6-490b-9de7-7a8bd05c9668 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:16.776479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0abcfc44-7d43-4d76-a9e8-d070a5bfeeb5 req-9f7aad3b-e3c6-490b-9de7-7a8bd05c9668 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:16.810244 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-0abcfc44-7d43-4d76-a9e8-d070a5bfeeb5 req-9f7aad3b-e3c6-490b-9de7-7a8bd05c9668 service nova] Creating event network-changed:9bfac521-3575-41c1-ac0e-8d05e3335152 for instance 2d05fd34-5166-4491-9425-fc2da25e106f on n-h1-851337-3 Aug 02 07:08:16.815647 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-0abcfc44-7d43-4d76-a9e8-d070a5bfeeb5 req-9f7aad3b-e3c6-490b-9de7-7a8bd05c9668 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072630 Aug 02 07:08:16.816895 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2092/4268] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:16.833598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c56c45f1-8243-41a7-9b05-2f6433815763 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:16.834234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c56c45f1-8243-41a7-9b05-2f6433815763 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:16.841498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c56c45f1-8243-41a7-9b05-2f6433815763 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:16.842025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c56c45f1-8243-41a7-9b05-2f6433815763 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:16.842824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c56c45f1-8243-41a7-9b05-2f6433815763 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:16.843257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c56c45f1-8243-41a7-9b05-2f6433815763 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:17.184287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-0613eac7-5d00-41e8-bd5f-dc2ec4bb70de tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Updating instance_info_cache with network_info: [{"id": "9bfac521-3575-41c1-ac0e-8d05e3335152", "address": "fa:16:3e:92:21:2a", "network": {"id": "981e12d8-74e3-4609-bc8b-167b178d98ea", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-223143322-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fc1dad66fd4340908cce462baeb8e4c7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9bfac521-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126120) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 02 07:08:17.203608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0613eac7-5d00-41e8-bd5f-dc2ec4bb70de tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Releasing lock "refresh_cache-2d05fd34-5166-4491-9425-fc2da25e106f" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 07:08:17.204537 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0613eac7-5d00-41e8-bd5f-dc2ec4bb70de tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action" status: 202 len: 0 microversion: 2.1 time: 3.402445 Aug 02 07:08:17.208759 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2177/4269] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:08:13 2022] POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action => generated 0 bytes in 3407 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Aug 02 07:08:17.237485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-853deb34-867b-436f-9530-4be7ed042fac tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:17.241040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-853deb34-867b-436f-9530-4be7ed042fac tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:17.261097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-853deb34-867b-436f-9530-4be7ed042fac tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:17.261621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-853deb34-867b-436f-9530-4be7ed042fac tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:17.262527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-853deb34-867b-436f-9530-4be7ed042fac tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:17.263028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-853deb34-867b-436f-9530-4be7ed042fac tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:17.323115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c56c45f1-8243-41a7-9b05-2f6433815763 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:17.332353 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c56c45f1-8243-41a7-9b05-2f6433815763 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.513624 Aug 02 07:08:17.333159 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2093/4270] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:16 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:17.338660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-89ebed88-6c3b-46a3-b647-d1a518bebe36 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:17.339523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-89ebed88-6c3b-46a3-b647-d1a518bebe36 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:17.346929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89ebed88-6c3b-46a3-b647-d1a518bebe36 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:17.347589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89ebed88-6c3b-46a3-b647-d1a518bebe36 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:17.348631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89ebed88-6c3b-46a3-b647-d1a518bebe36 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:17.349224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89ebed88-6c3b-46a3-b647-d1a518bebe36 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:17.437811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-853deb34-867b-436f-9530-4be7ed042fac tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lazy-loading 'services' on Instance uuid 416496be-7b54-49d4-9d90-3d0be9463e67 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:08:17.587630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-89ebed88-6c3b-46a3-b647-d1a518bebe36 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:17.600917 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-89ebed88-6c3b-46a3-b647-d1a518bebe36 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 200 len: 1515 microversion: 2.1 time: 0.266132 Aug 02 07:08:17.601244 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-853deb34-867b-436f-9530-4be7ed042fac tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments/b0e8d650-e5e7-43f9-ae3e-e4a78421b481" status: 202 len: 0 microversion: 2.1 time: 0.390559 Aug 02 07:08:17.602080 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2178/4271] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:08:17 2022] DELETE /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments/b0e8d650-e5e7-43f9-ae3e-e4a78421b481 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:08:17.602404 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2094/4272] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:17 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 1515 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:17.608102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c3621d67-c26a-44ff-8c06-1520fe82355c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Action: 'create', calling method: .version_select at 0x7f927ad84160>, body: {"pool": "a216acbd-5c92-441a-b243-674c18d16f72"} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:17.610071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-876c0f03-7586-4437-9c38-4cff522134ff tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:17.611247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-876c0f03-7586-4437-9c38-4cff522134ff tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:17.647038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-876c0f03-7586-4437-9c38-4cff522134ff tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:17.651351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-876c0f03-7586-4437-9c38-4cff522134ff tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:17.653757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-876c0f03-7586-4437-9c38-4cff522134ff tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:17.654709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-876c0f03-7586-4437-9c38-4cff522134ff tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:18.212007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-876c0f03-7586-4437-9c38-4cff522134ff tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:18.228785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-876c0f03-7586-4437-9c38-4cff522134ff tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:18.230928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-876c0f03-7586-4437-9c38-4cff522134ff tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:18.232569 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-876c0f03-7586-4437-9c38-4cff522134ff tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1751 microversion: 2.20 time: 0.629113 Aug 02 07:08:18.233789 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2179/4273] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:17 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1751 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:18.240733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4dcb8639-3207-454e-a3f8-aa9b51c40d39 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:18.242254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4dcb8639-3207-454e-a3f8-aa9b51c40d39 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:18.252758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4dcb8639-3207-454e-a3f8-aa9b51c40d39 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:18.253550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4dcb8639-3207-454e-a3f8-aa9b51c40d39 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:18.255013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4dcb8639-3207-454e-a3f8-aa9b51c40d39 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:18.255861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4dcb8639-3207-454e-a3f8-aa9b51c40d39 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:18.480932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4dcb8639-3207-454e-a3f8-aa9b51c40d39 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:18.493352 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4dcb8639-3207-454e-a3f8-aa9b51c40d39 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1697 microversion: 2.1 time: 0.254254 Aug 02 07:08:18.496310 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2180/4274] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:18 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1697 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:18.682528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6721f8f7-a1dd-4f78-ad61-d44c6a5a8461 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:18.685361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6721f8f7-a1dd-4f78-ad61-d44c6a5a8461 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:18.710712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6721f8f7-a1dd-4f78-ad61-d44c6a5a8461 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:18.711172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6721f8f7-a1dd-4f78-ad61-d44c6a5a8461 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:18.711972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6721f8f7-a1dd-4f78-ad61-d44c6a5a8461 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:18.712411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6721f8f7-a1dd-4f78-ad61-d44c6a5a8461 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:18.791505 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6721f8f7-a1dd-4f78-ad61-d44c6a5a8461 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.292432 Aug 02 07:08:18.792768 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2181/4275] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:08:18 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments => generated 197 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:18.811266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3b7d4c09-b4a1-4e6c-bb9c-2b76a48e3ebe tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:18.811897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3b7d4c09-b4a1-4e6c-bb9c-2b76a48e3ebe tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:18.819956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:18.821562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b7d4c09-b4a1-4e6c-bb9c-2b76a48e3ebe tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:18.822107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b7d4c09-b4a1-4e6c-bb9c-2b76a48e3ebe tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:18.822992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b7d4c09-b4a1-4e6c-bb9c-2b76a48e3ebe tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:18.823391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b7d4c09-b4a1-4e6c-bb9c-2b76a48e3ebe tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:19.557883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3b7d4c09-b4a1-4e6c-bb9c-2b76a48e3ebe tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:19.568921 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3b7d4c09-b4a1-4e6c-bb9c-2b76a48e3ebe tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.766813 Aug 02 07:08:19.582966 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2182/4276] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:18 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:19.589820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02f94b31-a043-4730-b7ab-5557c738c99b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:19.590537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-02f94b31-a043-4730-b7ab-5557c738c99b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:19.598317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02f94b31-a043-4730-b7ab-5557c738c99b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:19.598765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02f94b31-a043-4730-b7ab-5557c738c99b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:19.599566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02f94b31-a043-4730-b7ab-5557c738c99b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:19.599975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02f94b31-a043-4730-b7ab-5557c738c99b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:19.619470 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-02f94b31-a043-4730-b7ab-5557c738c99b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02f94b31-a043-4730-b7ab-5557c738c99b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 HTTP/1.1 Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'dbbef094-4c9f-4465-8f94-3f251fb13b64'} Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:19.621951 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:19.625968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:19.625968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:19.625968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:19.625968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:08:19.625968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:08:19.625968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:08:19.625968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:19.625968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02f94b31-a043-4730-b7ab-5557c738c99b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:08:19.625968 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-02f94b31-a043-4730-b7ab-5557c738c99b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 404 len: 111 microversion: 2.1 time: 0.039682 Aug 02 07:08:19.625968 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2183/4277] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:19 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:08:19.630960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-cf526ab9-0167-4374-b8fe-a56c8cdfc6cb req-716559ca-dd41-4540-8148-f80dcd4c9dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbbef094-4c9f-4465-8f94-3f251fb13b64", "name": "network-vif-deleted", "tag": "762cb23f-cfd7-489f-a797-6621b64df34d"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:19.647397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-cf526ab9-0167-4374-b8fe-a56c8cdfc6cb req-716559ca-dd41-4540-8148-f80dcd4c9dc4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:19.648100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-cf526ab9-0167-4374-b8fe-a56c8cdfc6cb req-716559ca-dd41-4540-8148-f80dcd4c9dc4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:19.675855 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-cf526ab9-0167-4374-b8fe-a56c8cdfc6cb req-716559ca-dd41-4540-8148-f80dcd4c9dc4 service nova] Creating event network-vif-deleted:762cb23f-cfd7-489f-a797-6621b64df34d for instance dbbef094-4c9f-4465-8f94-3f251fb13b64 on n-h2-851337-3 Aug 02 07:08:19.683828 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-cf526ab9-0167-4374-b8fe-a56c8cdfc6cb req-716559ca-dd41-4540-8148-f80dcd4c9dc4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057081 Aug 02 07:08:19.684759 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2184/4278] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:19.692522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83d43d25-6c06-44ac-ae93-6e80f71e2455 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:19.697530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-83d43d25-6c06-44ac-ae93-6e80f71e2455 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:19.706430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83d43d25-6c06-44ac-ae93-6e80f71e2455 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:19.707135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83d43d25-6c06-44ac-ae93-6e80f71e2455 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:19.708165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83d43d25-6c06-44ac-ae93-6e80f71e2455 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:19.710013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83d43d25-6c06-44ac-ae93-6e80f71e2455 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:19.968549 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c3621d67-c26a-44ff-8c06-1520fe82355c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.364728 Aug 02 07:08:19.969344 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2095/4279] 10.222.0.79 () {60 vars in 1170 bytes} [Tue Aug 2 07:08:17 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:19.974048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a5b2ee9d-c467-47a9-b73c-c31506e9f7fd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:19.974871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a5b2ee9d-c467-47a9-b73c-c31506e9f7fd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:19.983515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5b2ee9d-c467-47a9-b73c-c31506e9f7fd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:19.984352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5b2ee9d-c467-47a9-b73c-c31506e9f7fd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:19.985415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5b2ee9d-c467-47a9-b73c-c31506e9f7fd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:19.986120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5b2ee9d-c467-47a9-b73c-c31506e9f7fd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:19.994091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-83d43d25-6c06-44ac-ae93-6e80f71e2455 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:20.004570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-83d43d25-6c06-44ac-ae93-6e80f71e2455 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:20.006547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-83d43d25-6c06-44ac-ae93-6e80f71e2455 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:20.008425 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-83d43d25-6c06-44ac-ae93-6e80f71e2455 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1751 microversion: 2.20 time: 0.321965 Aug 02 07:08:20.009574 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2185/4280] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:19 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1751 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:20.015872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-41d55ed8-9c55-4934-b9aa-309d9b613fe6 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '.version_select at 0x7f927a7d0b80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:20.041700 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-41d55ed8-9c55-4934-b9aa-309d9b613fe6 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-key-2125202781" status: 202 len: 0 microversion: 2.1 time: 0.030356 Aug 02 07:08:20.042524 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2186/4281] 10.222.0.79 () {58 vars in 1209 bytes} [Tue Aug 2 07:08:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2125202781 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:08:20.048528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cbcfd10b-3be0-49ec-9abe-6345814f0661 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:20.050536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cbcfd10b-3be0-49ec-9abe-6345814f0661 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:20.058829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbcfd10b-3be0-49ec-9abe-6345814f0661 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:20.059467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbcfd10b-3be0-49ec-9abe-6345814f0661 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:20.060319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbcfd10b-3be0-49ec-9abe-6345814f0661 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:20.060781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbcfd10b-3be0-49ec-9abe-6345814f0661 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:20.104099 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cbcfd10b-3be0-49ec-9abe-6345814f0661 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060560 Aug 02 07:08:20.104942 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2187/4282] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:08:20 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:20.114350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-60a4920f-8156-40ed-8345-bc1031ebe7a1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.30"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:20.116814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-60a4920f-8156-40ed-8345-bc1031ebe7a1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:20.123817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-60a4920f-8156-40ed-8345-bc1031ebe7a1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:20.124381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-60a4920f-8156-40ed-8345-bc1031ebe7a1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:20.125236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-60a4920f-8156-40ed-8345-bc1031ebe7a1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:20.125673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-60a4920f-8156-40ed-8345-bc1031ebe7a1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:20.145253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a5b2ee9d-c467-47a9-b73c-c31506e9f7fd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:20.153759 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a5b2ee9d-c467-47a9-b73c-c31506e9f7fd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1697 microversion: 2.1 time: 0.183256 Aug 02 07:08:20.154701 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2096/4283] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:19 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:20.166081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-60a4920f-8156-40ed-8345-bc1031ebe7a1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Acquired lock "refresh_cache-2d05fd34-5166-4491-9425-fc2da25e106f" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 07:08:20.171516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2072807205", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:20.236891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] validate_networks() for [('ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:08:20.762564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG neutronclient.v2_0.client [None req-60a4920f-8156-40ed-8345-bc1031ebe7a1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.5.30 (97045889-2fc2-4da3-911c-2ae756782842) with port 9bfac521-3575-41c1-ac0e-8d05e3335152 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network a216acbd-5c92-441a-b243-674c18d16f72.", "detail": ""}} {{(pid=126120) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 07:08:20.763305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-60a4920f-8156-40ed-8345-bc1031ebe7a1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Releasing lock "refresh_cache-2d05fd34-5166-4491-9425-fc2da25e106f" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 07:08:20.763953 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-60a4920f-8156-40ed-8345-bc1031ebe7a1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] HTTP exception thrown: Cannot associate floating IP 172.25.5.30 (97045889-2fc2-4da3-911c-2ae756782842) with port 9bfac521-3575-41c1-ac0e-8d05e3335152 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network a216acbd-5c92-441a-b243-674c18d16f72. Aug 02 07:08:20.763953 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-b188d578-afe0-403a-8622-722897ab1ed3'] Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-60a4920f-8156-40ed-8345-bc1031ebe7a1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Request method failure captured: Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action HTTP/1.1 Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 45 Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M1ExICjYDs7CXVoJmLwYBJ0QJT7fyd4dtr2wK5d2qdRrJ9AgCvVKJ0sdfhQ2e5E8C-RjQ43p44_bXqwyfwnAEww6nUFCAmGUlNc2FLGZh_C21m8DzF3tFfX6t2APAHC87syL6CENDyfhmNyEmHRadzCTlX2PQgZe0k6rRyMbi7qDz0 Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: fc1dad66fd4340908cce462baeb8e4c7 Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fc1dad66fd4340908cce462baeb8e4c7"}]}] Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: fc1dad66fd4340908cce462baeb8e4c7 Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: ce8039cf34f34f0fa6fed42879e9b79b Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: {"addFloatingIp": {"address": "172.25.5.30"}} Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: exception: Cannot associate floating IP 172.25.5.30 (97045889-2fc2-4da3-911c-2ae756782842) with port 9bfac521-3575-41c1-ac0e-8d05e3335152 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network a216acbd-5c92-441a-b243-674c18d16f72. Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-b188d578-afe0-403a-8622-722897ab1ed3'] Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '2d05fd34-5166-4491-9425-fc2da25e106f', 'body': {'addFloatingIp': {'address': '172.25.5.30'}}} Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 07:08:20.766264 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.5.30 (97045889-2fc2-4da3-911c-2ae756782842) with port 9bfac521-3575-41c1-ac0e-8d05e3335152 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network a216acbd-5c92-441a-b243-674c18d16f72. Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b188d578-afe0-403a-8622-722897ab1ed3'] Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.5.30 (97045889-2fc2-4da3-911c-2ae756782842) with port 9bfac521-3575-41c1-ac0e-8d05e3335152 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network a216acbd-5c92-441a-b243-674c18d16f72. Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b188d578-afe0-403a-8622-722897ab1ed3'] Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.5.30 (97045889-2fc2-4da3-911c-2ae756782842) with port 9bfac521-3575-41c1-ac0e-8d05e3335152 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network a216acbd-5c92-441a-b243-674c18d16f72. Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b188d578-afe0-403a-8622-722897ab1ed3'] Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.5.30 (97045889-2fc2-4da3-911c-2ae756782842) with port 9bfac521-3575-41c1-ac0e-8d05e3335152 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network a216acbd-5c92-441a-b243-674c18d16f72. Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b188d578-afe0-403a-8622-722897ab1ed3'] Aug 02 07:08:20.772847 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:20.778538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-60a4920f-8156-40ed-8345-bc1031ebe7a1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Returning 400 to user: Cannot associate floating IP 172.25.5.30 (97045889-2fc2-4da3-911c-2ae756782842) with port 9bfac521-3575-41c1-ac0e-8d05e3335152 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network a216acbd-5c92-441a-b243-674c18d16f72. Aug 02 07:08:20.778538 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-b188d578-afe0-403a-8622-722897ab1ed3'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:08:20.778538 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-60a4920f-8156-40ed-8345-bc1031ebe7a1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action" status: 400 len: 381 microversion: 2.1 time: 0.657702 Aug 02 07:08:20.778538 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2188/4284] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:08:20 2022] POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action => generated 381 bytes in 663 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:08:20.783789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-328f39a7-3a80-4467-b4d8-1932dc540042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:20.784636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-328f39a7-3a80-4467-b4d8-1932dc540042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:20.802635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-328f39a7-3a80-4467-b4d8-1932dc540042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:20.803231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-328f39a7-3a80-4467-b4d8-1932dc540042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:20.804085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-328f39a7-3a80-4467-b4d8-1932dc540042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:20.804531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-328f39a7-3a80-4467-b4d8-1932dc540042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:20.972166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:08:20.973203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:08:20.973913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:08:20.974572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:08:20.975195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:08:20.985385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:20.986259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:20.987398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:20.988067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:21.007228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:08:21.015686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for user 0971d7961d5a4e8996ea2c0f958382ad and project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:08:21.031746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-328f39a7-3a80-4467-b4d8-1932dc540042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:21.033681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:08:21.038077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:08:21.043615 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-328f39a7-3a80-4467-b4d8-1932dc540042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.272896 Aug 02 07:08:21.044781 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2189/4285] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:20 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:21.050471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1b855f01-2ef9-4ea5-8f86-4ccbaf1a4c86 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '.version_select at 0x7f927a8105e0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:21.120295 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-42f52874-355a-46a6-98e7-ba24e78f6f2d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.952630 Aug 02 07:08:21.121756 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2097/4286] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:08:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:08:21.129958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a33267e8-acfe-4129-b71d-784f7d61324d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:21.130993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a33267e8-acfe-4129-b71d-784f7d61324d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:21.142452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a33267e8-acfe-4129-b71d-784f7d61324d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:21.143337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a33267e8-acfe-4129-b71d-784f7d61324d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:21.144349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a33267e8-acfe-4129-b71d-784f7d61324d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:21.144990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a33267e8-acfe-4129-b71d-784f7d61324d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:21.705545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a33267e8-acfe-4129-b71d-784f7d61324d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:21.734258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a33267e8-acfe-4129-b71d-784f7d61324d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:21.736356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a33267e8-acfe-4129-b71d-784f7d61324d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:21.737822 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a33267e8-acfe-4129-b71d-784f7d61324d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1751 microversion: 2.20 time: 0.614665 Aug 02 07:08:21.739109 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2098/4287] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:21 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1751 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:21.755122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f25ad55c-d5ff-4d69-8f3b-4f6c5995fa7d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:21.760500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f25ad55c-d5ff-4d69-8f3b-4f6c5995fa7d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:21.775032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f25ad55c-d5ff-4d69-8f3b-4f6c5995fa7d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:21.778750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f25ad55c-d5ff-4d69-8f3b-4f6c5995fa7d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:21.779912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f25ad55c-d5ff-4d69-8f3b-4f6c5995fa7d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:21.780393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f25ad55c-d5ff-4d69-8f3b-4f6c5995fa7d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:21.861106 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f25ad55c-d5ff-4d69-8f3b-4f6c5995fa7d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120472 Aug 02 07:08:21.866012 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2099/4288] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:08:21 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:21.867145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-52557887-b9fb-4a8e-9559-cccaddae3042 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:21.867818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-52557887-b9fb-4a8e-9559-cccaddae3042 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:21.875690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-52557887-b9fb-4a8e-9559-cccaddae3042 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:21.876142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-52557887-b9fb-4a8e-9559-cccaddae3042 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:21.877035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-52557887-b9fb-4a8e-9559-cccaddae3042 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:21.877477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-52557887-b9fb-4a8e-9559-cccaddae3042 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:21.994053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-52557887-b9fb-4a8e-9559-cccaddae3042 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:22.003095 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-52557887-b9fb-4a8e-9559-cccaddae3042 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 200 len: 1213 microversion: 2.1 time: 0.139801 Aug 02 07:08:22.011750 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2100/4289] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:21 2022] GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:22.026771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7f16cd36-7763-4aee-9e85-3d416cace10f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:22.029204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7f16cd36-7763-4aee-9e85-3d416cace10f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:22.044907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f16cd36-7763-4aee-9e85-3d416cace10f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:22.045938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f16cd36-7763-4aee-9e85-3d416cace10f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:22.055838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f16cd36-7763-4aee-9e85-3d416cace10f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:22.058077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f16cd36-7763-4aee-9e85-3d416cace10f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:22.087985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:22.338958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7f16cd36-7763-4aee-9e85-3d416cace10f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:22.347690 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7f16cd36-7763-4aee-9e85-3d416cace10f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1697 microversion: 2.1 time: 0.333182 Aug 02 07:08:22.349679 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2101/4290] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:22 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1697 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:22.355428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b76d5a11-f8e7-45f8-b9ee-4889a7ff7c13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:22.356447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b76d5a11-f8e7-45f8-b9ee-4889a7ff7c13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:22.370671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b76d5a11-f8e7-45f8-b9ee-4889a7ff7c13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:22.373930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b76d5a11-f8e7-45f8-b9ee-4889a7ff7c13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:22.375175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b76d5a11-f8e7-45f8-b9ee-4889a7ff7c13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:22.377159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b76d5a11-f8e7-45f8-b9ee-4889a7ff7c13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:22.689148 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1b855f01-2ef9-4ea5-8f86-4ccbaf1a4c86 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/97045889-2fc2-4da3-911c-2ae756782842" status: 202 len: 0 microversion: 2.1 time: 1.643208 Aug 02 07:08:22.695878 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2190/4291] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 07:08:21 2022] DELETE /compute/v2.1/os-floating-ips/97045889-2fc2-4da3-911c-2ae756782842 => generated 0 bytes in 1650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:08:22.708145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aef4d104-4254-4730-b75a-1c31bd189ae0 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.185"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:22.711379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b76d5a11-f8e7-45f8-b9ee-4889a7ff7c13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:22.720191 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b76d5a11-f8e7-45f8-b9ee-4889a7ff7c13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.368619 Aug 02 07:08:22.722667 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2102/4292] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:22 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:22.766610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6655b315-b4ba-473c-bbb4-c164e54931d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:22.767506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6655b315-b4ba-473c-bbb4-c164e54931d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:22.785047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6655b315-b4ba-473c-bbb4-c164e54931d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:22.786645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6655b315-b4ba-473c-bbb4-c164e54931d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:22.787758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6655b315-b4ba-473c-bbb4-c164e54931d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:22.788370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6655b315-b4ba-473c-bbb4-c164e54931d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:22.899732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aef4d104-4254-4730-b75a-1c31bd189ae0 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:22.907710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aef4d104-4254-4730-b75a-1c31bd189ae0 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:22.908560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aef4d104-4254-4730-b75a-1c31bd189ae0 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:22.909943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aef4d104-4254-4730-b75a-1c31bd189ae0 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:22.910609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aef4d104-4254-4730-b75a-1c31bd189ae0 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:23.071633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6655b315-b4ba-473c-bbb4-c164e54931d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:23.082766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6655b315-b4ba-473c-bbb4-c164e54931d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:23.084604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6655b315-b4ba-473c-bbb4-c164e54931d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:23.086100 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6655b315-b4ba-473c-bbb4-c164e54931d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.324999 Aug 02 07:08:23.087145 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2103/4293] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:22 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:23.094284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-093685e8-3f41-426e-aa5d-f2f16ab054fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:23.097838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-093685e8-3f41-426e-aa5d-f2f16ab054fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:23.127853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-093685e8-3f41-426e-aa5d-f2f16ab054fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:23.128322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-093685e8-3f41-426e-aa5d-f2f16ab054fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:23.129492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-093685e8-3f41-426e-aa5d-f2f16ab054fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:23.129960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-093685e8-3f41-426e-aa5d-f2f16ab054fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:23.164042 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-093685e8-3f41-426e-aa5d-f2f16ab054fa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075444 Aug 02 07:08:23.165263 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2104/4294] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:08:23 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:23.170192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6122ed63-f56a-4d61-8370-6fcbcddc9589 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:23.171065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6122ed63-f56a-4d61-8370-6fcbcddc9589 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:23.178338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6122ed63-f56a-4d61-8370-6fcbcddc9589 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:23.179054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6122ed63-f56a-4d61-8370-6fcbcddc9589 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:23.180007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6122ed63-f56a-4d61-8370-6fcbcddc9589 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:23.180607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6122ed63-f56a-4d61-8370-6fcbcddc9589 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:23.292828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aef4d104-4254-4730-b75a-1c31bd189ae0 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Acquired lock "refresh_cache-2d05fd34-5166-4491-9425-fc2da25e106f" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 07:08:23.322872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6122ed63-f56a-4d61-8370-6fcbcddc9589 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:23.335210 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6122ed63-f56a-4d61-8370-6fcbcddc9589 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 200 len: 1267 microversion: 2.1 time: 0.167789 Aug 02 07:08:23.350371 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2105/4295] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:23 2022] GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:23.370549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2093b5f2-a439-4206-9cb7-9e6eb276df6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:23.371387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2093b5f2-a439-4206-9cb7-9e6eb276df6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:23.384524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2093b5f2-a439-4206-9cb7-9e6eb276df6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:23.386308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2093b5f2-a439-4206-9cb7-9e6eb276df6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:23.390359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2093b5f2-a439-4206-9cb7-9e6eb276df6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:23.392344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2093b5f2-a439-4206-9cb7-9e6eb276df6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:23.680030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2093b5f2-a439-4206-9cb7-9e6eb276df6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:23.688984 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2093b5f2-a439-4206-9cb7-9e6eb276df6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1697 microversion: 2.1 time: 0.322657 Aug 02 07:08:23.689633 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2106/4296] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:23 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1697 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:08:23.745334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1be59845-e5d8-4005-a0fc-502e07f1de00 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:23.745981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1be59845-e5d8-4005-a0fc-502e07f1de00 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:23.770403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1be59845-e5d8-4005-a0fc-502e07f1de00 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:23.771129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1be59845-e5d8-4005-a0fc-502e07f1de00 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:23.772402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1be59845-e5d8-4005-a0fc-502e07f1de00 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:23.775989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1be59845-e5d8-4005-a0fc-502e07f1de00 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:24.216081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1be59845-e5d8-4005-a0fc-502e07f1de00 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:24.249616 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1be59845-e5d8-4005-a0fc-502e07f1de00 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.508641 Aug 02 07:08:24.263843 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2107/4297] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:23 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:24.263843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-98587a53-1f9d-4ff4-8deb-cd42ef42d31b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:24.277711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-98587a53-1f9d-4ff4-8deb-cd42ef42d31b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:24.296474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98587a53-1f9d-4ff4-8deb-cd42ef42d31b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:24.298300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98587a53-1f9d-4ff4-8deb-cd42ef42d31b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:24.299859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98587a53-1f9d-4ff4-8deb-cd42ef42d31b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:24.301511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98587a53-1f9d-4ff4-8deb-cd42ef42d31b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:24.572226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-98587a53-1f9d-4ff4-8deb-cd42ef42d31b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:24.587247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-98587a53-1f9d-4ff4-8deb-cd42ef42d31b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:24.588787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-98587a53-1f9d-4ff4-8deb-cd42ef42d31b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:24.602391 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-98587a53-1f9d-4ff4-8deb-cd42ef42d31b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.321868 Aug 02 07:08:24.604220 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2108/4298] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:24 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:24.609489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6898084f-790e-405c-ae5e-c5d7e8d13146 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:24.611870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6898084f-790e-405c-ae5e-c5d7e8d13146 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:24.635718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6898084f-790e-405c-ae5e-c5d7e8d13146 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:24.636415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6898084f-790e-405c-ae5e-c5d7e8d13146 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:24.637406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6898084f-790e-405c-ae5e-c5d7e8d13146 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:24.638078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6898084f-790e-405c-ae5e-c5d7e8d13146 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:24.690363 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6898084f-790e-405c-ae5e-c5d7e8d13146 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084843 Aug 02 07:08:24.694387 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2109/4299] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:08:24 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:24.699457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f3672d6e-c6d8-4b7c-845a-17a63c996e0d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:24.700080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f3672d6e-c6d8-4b7c-845a-17a63c996e0d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:24.706837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3672d6e-c6d8-4b7c-845a-17a63c996e0d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:24.708919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3672d6e-c6d8-4b7c-845a-17a63c996e0d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:24.709764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3672d6e-c6d8-4b7c-845a-17a63c996e0d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:24.710301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3672d6e-c6d8-4b7c-845a-17a63c996e0d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:25.530168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-aef4d104-4254-4730-b75a-1c31bd189ae0 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Building network info cache for instance {{(pid=126120) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 02 07:08:25.884804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f3672d6e-c6d8-4b7c-845a-17a63c996e0d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:25.895128 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f3672d6e-c6d8-4b7c-845a-17a63c996e0d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 200 len: 1309 microversion: 2.1 time: 1.199552 Aug 02 07:08:25.908211 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2110/4300] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:24 2022] GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 1309 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:25.926640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9019e369-c992-4468-b093-9aaf9f9cd5eb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:25.930034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9019e369-c992-4468-b093-9aaf9f9cd5eb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:25.947715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9019e369-c992-4468-b093-9aaf9f9cd5eb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:25.948657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9019e369-c992-4468-b093-9aaf9f9cd5eb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:25.949677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9019e369-c992-4468-b093-9aaf9f9cd5eb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:25.950727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9019e369-c992-4468-b093-9aaf9f9cd5eb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:26.773515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9019e369-c992-4468-b093-9aaf9f9cd5eb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:26.785948 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9019e369-c992-4468-b093-9aaf9f9cd5eb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1696 microversion: 2.1 time: 0.871904 Aug 02 07:08:26.794087 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2111/4301] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:25 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1696 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:27.058503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0a4936a-facc-4115-849d-442e4029baf8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:27.059576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d0a4936a-facc-4115-849d-442e4029baf8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:27.079729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0a4936a-facc-4115-849d-442e4029baf8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:27.081076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0a4936a-facc-4115-849d-442e4029baf8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:27.082964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0a4936a-facc-4115-849d-442e4029baf8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:27.086237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0a4936a-facc-4115-849d-442e4029baf8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:27.457650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d0a4936a-facc-4115-849d-442e4029baf8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:27.470871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-aef4d104-4254-4730-b75a-1c31bd189ae0 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Updating instance_info_cache with network_info: [{"id": "9bfac521-3575-41c1-ac0e-8d05e3335152", "address": "fa:16:3e:92:21:2a", "network": {"id": "981e12d8-74e3-4609-bc8b-167b178d98ea", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-223143322-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fc1dad66fd4340908cce462baeb8e4c7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9bfac521-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126120) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 02 07:08:27.483025 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d0a4936a-facc-4115-849d-442e4029baf8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1512 microversion: 2.1 time: 0.687116 Aug 02 07:08:27.483785 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2112/4302] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:26 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1512 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:27.489119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-95093281-8509-42a7-a435-5fa1d78fc97e req-bcc11611-dec6-47a9-ba1f-87cbcac53e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d05fd34-5166-4491-9425-fc2da25e106f", "tag": "9bfac521-3575-41c1-ac0e-8d05e3335152"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:27.501359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aef4d104-4254-4730-b75a-1c31bd189ae0 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Releasing lock "refresh_cache-2d05fd34-5166-4491-9425-fc2da25e106f" {{(pid=126120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 07:08:27.502678 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aef4d104-4254-4730-b75a-1c31bd189ae0 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action" status: 202 len: 0 microversion: 2.1 time: 4.805380 Aug 02 07:08:27.506998 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2191/4303] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:08:22 2022] POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action => generated 0 bytes in 4810 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 02 07:08:27.515426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-95093281-8509-42a7-a435-5fa1d78fc97e req-bcc11611-dec6-47a9-ba1f-87cbcac53e88 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:27.515877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-95093281-8509-42a7-a435-5fa1d78fc97e req-bcc11611-dec6-47a9-ba1f-87cbcac53e88 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:27.525054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-682ac4be-494e-46ba-a22c-a521a63fa7ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:27.529294 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-682ac4be-494e-46ba-a22c-a521a63fa7ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:27.530808 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-95093281-8509-42a7-a435-5fa1d78fc97e req-bcc11611-dec6-47a9-ba1f-87cbcac53e88 service nova] Creating event network-changed:9bfac521-3575-41c1-ac0e-8d05e3335152 for instance 2d05fd34-5166-4491-9425-fc2da25e106f on n-h1-851337-3 Aug 02 07:08:27.536250 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-95093281-8509-42a7-a435-5fa1d78fc97e req-bcc11611-dec6-47a9-ba1f-87cbcac53e88 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050904 Aug 02 07:08:27.537429 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2113/4304] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:27.543732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-682ac4be-494e-46ba-a22c-a521a63fa7ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:27.544227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-682ac4be-494e-46ba-a22c-a521a63fa7ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:27.553354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-682ac4be-494e-46ba-a22c-a521a63fa7ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:27.553940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-682ac4be-494e-46ba-a22c-a521a63fa7ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:27.555186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f647ef5a-df99-4b83-aef0-0a9391539740 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:27.558091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f647ef5a-df99-4b83-aef0-0a9391539740 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:27.565322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f647ef5a-df99-4b83-aef0-0a9391539740 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:27.566051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f647ef5a-df99-4b83-aef0-0a9391539740 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:27.567129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f647ef5a-df99-4b83-aef0-0a9391539740 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:27.567749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f647ef5a-df99-4b83-aef0-0a9391539740 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:27.636545 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f647ef5a-df99-4b83-aef0-0a9391539740 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097483 Aug 02 07:08:27.637705 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2114/4305] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:08:27 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:27.642753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b2f7b968-8a14-4ad5-84a2-d74791d8a890 req-f63d425a-e321-49f8-adfb-65d14e22f2fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27439ee3-686a-4cd3-8430-f409fdaf175b", "tag": "fd44c955-a54c-45f3-b36f-556eb41f9bb6"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:27.673123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b2f7b968-8a14-4ad5-84a2-d74791d8a890 req-f63d425a-e321-49f8-adfb-65d14e22f2fc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:27.674170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b2f7b968-8a14-4ad5-84a2-d74791d8a890 req-f63d425a-e321-49f8-adfb-65d14e22f2fc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:27.700520 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b2f7b968-8a14-4ad5-84a2-d74791d8a890 req-f63d425a-e321-49f8-adfb-65d14e22f2fc service nova] Creating event network-changed:fd44c955-a54c-45f3-b36f-556eb41f9bb6 for instance 27439ee3-686a-4cd3-8430-f409fdaf175b on n-h2-851337-3 Aug 02 07:08:27.715536 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b2f7b968-8a14-4ad5-84a2-d74791d8a890 req-f63d425a-e321-49f8-adfb-65d14e22f2fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076135 Aug 02 07:08:27.721756 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2115/4306] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:27.727249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-02176327-b08b-4173-9a47-7a9ca972b033 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:27.727942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-02176327-b08b-4173-9a47-7a9ca972b033 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:27.751571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02176327-b08b-4173-9a47-7a9ca972b033 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:27.752016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02176327-b08b-4173-9a47-7a9ca972b033 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:27.752794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02176327-b08b-4173-9a47-7a9ca972b033 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:27.753228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02176327-b08b-4173-9a47-7a9ca972b033 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:28.529353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-682ac4be-494e-46ba-a22c-a521a63fa7ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:28.548958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-682ac4be-494e-46ba-a22c-a521a63fa7ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:28.556173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-682ac4be-494e-46ba-a22c-a521a63fa7ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:28.560449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-02176327-b08b-4173-9a47-7a9ca972b033 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:28.569657 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-682ac4be-494e-46ba-a22c-a521a63fa7ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 1.060723 Aug 02 07:08:28.572510 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-02176327-b08b-4173-9a47-7a9ca972b033 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 200 len: 1309 microversion: 2.1 time: 0.849355 Aug 02 07:08:28.583234 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2192/4307] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:27 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:28.588665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c9207903-4969-4f9a-a90c-fbab0fc2c38c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '.version_select at 0x7f927a9e0b80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:28.590088 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2116/4308] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:27 2022] GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 1309 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:28.595198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dafe391a-6572-4bec-8765-146701804e4e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:28.602326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dafe391a-6572-4bec-8765-146701804e4e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:28.617715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dafe391a-6572-4bec-8765-146701804e4e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:28.618574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dafe391a-6572-4bec-8765-146701804e4e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:28.619839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dafe391a-6572-4bec-8765-146701804e4e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:28.620572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dafe391a-6572-4bec-8765-146701804e4e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:28.989498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dafe391a-6572-4bec-8765-146701804e4e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:29.040085 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dafe391a-6572-4bec-8765-146701804e4e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1696 microversion: 2.1 time: 0.445032 Aug 02 07:08:29.040854 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2117/4309] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:28 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1696 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:29.063004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b5a729d6-cfd4-455c-bf01-12d9476dc559 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:29.063765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b5a729d6-cfd4-455c-bf01-12d9476dc559 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:29.085961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5a729d6-cfd4-455c-bf01-12d9476dc559 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:29.086522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5a729d6-cfd4-455c-bf01-12d9476dc559 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:29.098861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5a729d6-cfd4-455c-bf01-12d9476dc559 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:29.099417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5a729d6-cfd4-455c-bf01-12d9476dc559 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:29.988222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b5a729d6-cfd4-455c-bf01-12d9476dc559 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:29.999632 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b5a729d6-cfd4-455c-bf01-12d9476dc559 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1489 microversion: 2.1 time: 0.957532 Aug 02 07:08:30.023531 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2118/4310] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:29 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1489 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:30.032763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1f977df6-c729-4cd9-9d3f-94921f71c7cf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:30.043044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1f977df6-c729-4cd9-9d3f-94921f71c7cf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:30.070920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f977df6-c729-4cd9-9d3f-94921f71c7cf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:30.072080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f977df6-c729-4cd9-9d3f-94921f71c7cf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:30.079216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f977df6-c729-4cd9-9d3f-94921f71c7cf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:30.080158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f977df6-c729-4cd9-9d3f-94921f71c7cf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:30.114466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:30.132556 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1f977df6-c729-4cd9-9d3f-94921f71c7cf tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106675 Aug 02 07:08:30.141783 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2119/4311] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:08:30 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:08:30.149266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-78b009ef-4b78-46a8-a22b-805f8e853695 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:30.150124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-78b009ef-4b78-46a8-a22b-805f8e853695 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:30.159832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78b009ef-4b78-46a8-a22b-805f8e853695 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:30.160287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78b009ef-4b78-46a8-a22b-805f8e853695 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:30.161322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78b009ef-4b78-46a8-a22b-805f8e853695 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:30.162197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78b009ef-4b78-46a8-a22b-805f8e853695 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:30.774567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-78b009ef-4b78-46a8-a22b-805f8e853695 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:30.790632 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-78b009ef-4b78-46a8-a22b-805f8e853695 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 200 len: 1309 microversion: 2.1 time: 0.646549 Aug 02 07:08:30.805318 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2120/4312] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:30 2022] GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 1309 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:30.811535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-39b5ab55-a70f-44e6-9c4a-97e8bd7e33a3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:30.822918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-39b5ab55-a70f-44e6-9c4a-97e8bd7e33a3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:30.850284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39b5ab55-a70f-44e6-9c4a-97e8bd7e33a3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:30.851343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39b5ab55-a70f-44e6-9c4a-97e8bd7e33a3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:30.852785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39b5ab55-a70f-44e6-9c4a-97e8bd7e33a3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:30.853452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39b5ab55-a70f-44e6-9c4a-97e8bd7e33a3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:30.996635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:31.024948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:31.676010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-39b5ab55-a70f-44e6-9c4a-97e8bd7e33a3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:31.690984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-39b5ab55-a70f-44e6-9c4a-97e8bd7e33a3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:31.695617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-39b5ab55-a70f-44e6-9c4a-97e8bd7e33a3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:31.699057 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-39b5ab55-a70f-44e6-9c4a-97e8bd7e33a3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.892152 Aug 02 07:08:31.700946 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2121/4313] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:30 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:31.711292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-2072cf22-8f4a-4aeb-9b3f-cacea7f737b0 req-5718e35b-36c5-45c2-b367-37bb0b23e205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d93db40-84f5-4c63-825f-6ee647fa2331", "name": "network-vif-unplugged", "status": "completed", "tag": "38895fc4-ade3-4226-bdfd-d68b06745975"}, {"name": "network-changed", "server_uuid": "4d93db40-84f5-4c63-825f-6ee647fa2331", "tag": "38895fc4-ade3-4226-bdfd-d68b06745975"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:31.739933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2072cf22-8f4a-4aeb-9b3f-cacea7f737b0 req-5718e35b-36c5-45c2-b367-37bb0b23e205 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:31.740826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2072cf22-8f4a-4aeb-9b3f-cacea7f737b0 req-5718e35b-36c5-45c2-b367-37bb0b23e205 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:31.759912 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-2072cf22-8f4a-4aeb-9b3f-cacea7f737b0 req-5718e35b-36c5-45c2-b367-37bb0b23e205 service nova] Creating event network-vif-unplugged:38895fc4-ade3-4226-bdfd-d68b06745975 for instance 4d93db40-84f5-4c63-825f-6ee647fa2331 on n-h2-851337-3 Aug 02 07:08:31.760932 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-2072cf22-8f4a-4aeb-9b3f-cacea7f737b0 req-5718e35b-36c5-45c2-b367-37bb0b23e205 service nova] Creating event network-changed:38895fc4-ade3-4226-bdfd-d68b06745975 for instance 4d93db40-84f5-4c63-825f-6ee647fa2331 on n-h2-851337-3 Aug 02 07:08:31.781191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-2072cf22-8f4a-4aeb-9b3f-cacea7f737b0 req-5718e35b-36c5-45c2-b367-37bb0b23e205 service nova] Instance 4d93db40-84f5-4c63-825f-6ee647fa2331 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:08:31.808111 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-2072cf22-8f4a-4aeb-9b3f-cacea7f737b0 req-5718e35b-36c5-45c2-b367-37bb0b23e205 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.105328 Aug 02 07:08:31.812538 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2122/4314] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:31.825757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3ab8f3a5-04ed-4e1a-b2bf-6cf42762c92f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:31.829949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3ab8f3a5-04ed-4e1a-b2bf-6cf42762c92f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:31.849610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ab8f3a5-04ed-4e1a-b2bf-6cf42762c92f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:31.851118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ab8f3a5-04ed-4e1a-b2bf-6cf42762c92f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:31.857388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ab8f3a5-04ed-4e1a-b2bf-6cf42762c92f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:31.860760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ab8f3a5-04ed-4e1a-b2bf-6cf42762c92f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:32.033524 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3ab8f3a5-04ed-4e1a-b2bf-6cf42762c92f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 200 len: 129 microversion: 2.1 time: 0.220941 Aug 02 07:08:32.034793 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2123/4315] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:08:31 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 129 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:32.050342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1884666-236b-4c70-af74-3a93a081be15 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:32.051169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b1884666-236b-4c70-af74-3a93a081be15 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:32.067581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1884666-236b-4c70-af74-3a93a081be15 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:32.068030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1884666-236b-4c70-af74-3a93a081be15 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:32.068824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1884666-236b-4c70-af74-3a93a081be15 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:32.069256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1884666-236b-4c70-af74-3a93a081be15 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:32.453630 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c9207903-4969-4f9a-a90c-fbab0fc2c38c tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/77a4405b-855e-4d78-a8aa-017a5eec0922" status: 202 len: 0 microversion: 2.1 time: 3.868711 Aug 02 07:08:32.454641 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2193/4316] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 07:08:28 2022] DELETE /compute/v2.1/os-floating-ips/77a4405b-855e-4d78-a8aa-017a5eec0922 => generated 0 bytes in 3870 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:08:32.460590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3fab6872-2e7f-436a-96cb-293774647baa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:32.460818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3fab6872-2e7f-436a-96cb-293774647baa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:32.474131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3fab6872-2e7f-436a-96cb-293774647baa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:32.474650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3fab6872-2e7f-436a-96cb-293774647baa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:32.475532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3fab6872-2e7f-436a-96cb-293774647baa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:32.475977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3fab6872-2e7f-436a-96cb-293774647baa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:32.521495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3fab6872-2e7f-436a-96cb-293774647baa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:08:32.537774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b1884666-236b-4c70-af74-3a93a081be15 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:32.549774 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b1884666-236b-4c70-af74-3a93a081be15 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1694 microversion: 2.1 time: 0.511496 Aug 02 07:08:32.551585 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2124/4317] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:32 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1694 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:32.563159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8fc10e82-596c-4060-8d21-170edf9de30c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:32.563807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8fc10e82-596c-4060-8d21-170edf9de30c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:32.577267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fc10e82-596c-4060-8d21-170edf9de30c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:32.577739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fc10e82-596c-4060-8d21-170edf9de30c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:32.580446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fc10e82-596c-4060-8d21-170edf9de30c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:32.580891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fc10e82-596c-4060-8d21-170edf9de30c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:32.745685 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3fab6872-2e7f-436a-96cb-293774647baa tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 204 len: 0 microversion: 2.1 time: 0.289726 Aug 02 07:08:32.747249 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2194/4318] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:08:32 2022] DELETE /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:08:32.755967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-22174935-d82f-46e0-b8ce-f18ff5c7fdd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:32.757075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-22174935-d82f-46e0-b8ce-f18ff5c7fdd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:32.770079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22174935-d82f-46e0-b8ce-f18ff5c7fdd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:32.773633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22174935-d82f-46e0-b8ce-f18ff5c7fdd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:32.774721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22174935-d82f-46e0-b8ce-f18ff5c7fdd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:32.775340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22174935-d82f-46e0-b8ce-f18ff5c7fdd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:32.783352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:32.923990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8fc10e82-596c-4060-8d21-170edf9de30c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:32.935176 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8fc10e82-596c-4060-8d21-170edf9de30c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 200 len: 1309 microversion: 2.1 time: 0.380992 Aug 02 07:08:32.938407 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2125/4319] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:32 2022] GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 1309 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:32.943409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-af793795-395a-4ce7-87c8-1256e0089955 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-af793795-395a-4ce7-87c8-1256e0089955 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Request method failure captured: Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action HTTP/1.1 Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 34 Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M1ExICjYDs7CXVoJmLwYBJ0QJT7fyd4dtr2wK5d2qdRrJ9AgCvVKJ0sdfhQ2e5E8C-RjQ43p44_bXqwyfwnAEww6nUFCAmGUlNc2FLGZh_C21m8DzF3tFfX6t2APAHC87syL6CENDyfhmNyEmHRadzCTlX2PQgZe0k6rRyMbi7qDz0 Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: fc1dad66fd4340908cce462baeb8e4c7 Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fc1dad66fd4340908cce462baeb8e4c7"}]}] Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: fc1dad66fd4340908cce462baeb8e4c7 Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: ce8039cf34f34f0fa6fed42879e9b79b Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: {"addFloatingIp": {"address": ""}} Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '2d05fd34-5166-4491-9425-fc2da25e106f', 'body': {'addFloatingIp': {'address': ''}}} Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi '' Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:08:32.954958 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:08:32.959060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:08:32.959060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 02 07:08:32.959060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:32.959060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:32.959060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:32.959060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:32.959060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:32.959060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:32.959060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:08:32.959060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:08:32.959060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 02 07:08:32.959060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:32.972973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-af793795-395a-4ce7-87c8-1256e0089955 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:08:32.976311 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-af793795-395a-4ce7-87c8-1256e0089955 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action" status: 400 len: 142 microversion: 2.1 time: 0.036706 Aug 02 07:08:32.979108 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2126/4320] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:08:32 2022] POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action => generated 142 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:08:32.990908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-daae6a64-cd13-4f67-a329-660b910f20a2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:32.996259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-daae6a64-cd13-4f67-a329-660b910f20a2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:33.028927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daae6a64-cd13-4f67-a329-660b910f20a2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:33.029739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daae6a64-cd13-4f67-a329-660b910f20a2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:33.033140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daae6a64-cd13-4f67-a329-660b910f20a2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:33.033941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daae6a64-cd13-4f67-a329-660b910f20a2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:33.308939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-22174935-d82f-46e0-b8ce-f18ff5c7fdd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:33.331028 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-22174935-d82f-46e0-b8ce-f18ff5c7fdd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.569715 Aug 02 07:08:33.331882 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2195/4321] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:32 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:33.341677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-18ba6ded-ddea-4c11-9ae2-021455c6667a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:33.342337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-18ba6ded-ddea-4c11-9ae2-021455c6667a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:33.380319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18ba6ded-ddea-4c11-9ae2-021455c6667a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:33.386233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18ba6ded-ddea-4c11-9ae2-021455c6667a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:33.390329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18ba6ded-ddea-4c11-9ae2-021455c6667a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:33.394336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18ba6ded-ddea-4c11-9ae2-021455c6667a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:33.589351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-daae6a64-cd13-4f67-a329-660b910f20a2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:33.602953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-daae6a64-cd13-4f67-a329-660b910f20a2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:33.607871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-daae6a64-cd13-4f67-a329-660b910f20a2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:33.608942 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-daae6a64-cd13-4f67-a329-660b910f20a2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.628590 Aug 02 07:08:33.609563 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2127/4322] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:32 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:33.619469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-26043b42-9238-4ac3-bb27-acb0fd0f3aeb tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:33.622665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-26043b42-9238-4ac3-bb27-acb0fd0f3aeb tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:33.648867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26043b42-9238-4ac3-bb27-acb0fd0f3aeb tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:33.651455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26043b42-9238-4ac3-bb27-acb0fd0f3aeb tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:33.657151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26043b42-9238-4ac3-bb27-acb0fd0f3aeb tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:33.660117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26043b42-9238-4ac3-bb27-acb0fd0f3aeb tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:33.766724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26043b42-9238-4ac3-bb27-acb0fd0f3aeb tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Acquired lock "refresh_cache-2d05fd34-5166-4491-9425-fc2da25e106f" {{(pid=126119) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 07:08:33.834805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-18ba6ded-ddea-4c11-9ae2-021455c6667a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:33.861200 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-18ba6ded-ddea-4c11-9ae2-021455c6667a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 200 len: 1683 microversion: 2.1 time: 0.528339 Aug 02 07:08:33.870769 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2196/4323] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:33 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 1683 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:33.876722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-33c95eb6-bf6f-426f-a0ff-31454cca18b0 req-4b8e17c6-f1b4-4ea4-92e4-4ffe7412fef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27439ee3-686a-4cd3-8430-f409fdaf175b", "name": "network-vif-plugged", "status": "completed", "tag": "fd44c955-a54c-45f3-b36f-556eb41f9bb6"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:33.911294 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-33c95eb6-bf6f-426f-a0ff-31454cca18b0 req-4b8e17c6-f1b4-4ea4-92e4-4ffe7412fef5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:33.912017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-33c95eb6-bf6f-426f-a0ff-31454cca18b0 req-4b8e17c6-f1b4-4ea4-92e4-4ffe7412fef5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:33.925873 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-33c95eb6-bf6f-426f-a0ff-31454cca18b0 req-4b8e17c6-f1b4-4ea4-92e4-4ffe7412fef5 service nova] Creating event network-vif-plugged:fd44c955-a54c-45f3-b36f-556eb41f9bb6 for instance 27439ee3-686a-4cd3-8430-f409fdaf175b on n-h2-851337-3 Aug 02 07:08:33.931586 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-33c95eb6-bf6f-426f-a0ff-31454cca18b0 req-4b8e17c6-f1b4-4ea4-92e4-4ffe7412fef5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059091 Aug 02 07:08:33.938614 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2197/4324] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:33.958796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2c372ed9-ed1b-4915-a70c-7b272f9a1264 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:33.959801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2c372ed9-ed1b-4915-a70c-7b272f9a1264 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:33.969760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c372ed9-ed1b-4915-a70c-7b272f9a1264 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:33.970471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c372ed9-ed1b-4915-a70c-7b272f9a1264 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:33.971421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c372ed9-ed1b-4915-a70c-7b272f9a1264 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:33.973309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c372ed9-ed1b-4915-a70c-7b272f9a1264 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:34.155023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26043b42-9238-4ac3-bb27-acb0fd0f3aeb tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Releasing lock "refresh_cache-2d05fd34-5166-4491-9425-fc2da25e106f" {{(pid=126119) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 07:08:34.155676 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-26043b42-9238-4ac3-bb27-acb0fd0f3aeb tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] HTTP exception thrown: floating IP not found Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-26043b42-9238-4ac3-bb27-acb0fd0f3aeb tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Request method failure captured: Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action HTTP/1.1 Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 41 Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M1ExICjYDs7CXVoJmLwYBJ0QJT7fyd4dtr2wK5d2qdRrJ9AgCvVKJ0sdfhQ2e5E8C-RjQ43p44_bXqwyfwnAEww6nUFCAmGUlNc2FLGZh_C21m8DzF3tFfX6t2APAHC87syL6CENDyfhmNyEmHRadzCTlX2PQgZe0k6rRyMbi7qDz0 Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: fc1dad66fd4340908cce462baeb8e4c7 Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fc1dad66fd4340908cce462baeb8e4c7"}]}] Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: fc1dad66fd4340908cce462baeb8e4c7 Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: ce8039cf34f34f0fa6fed42879e9b79b Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: exception: floating IP not found Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '2d05fd34-5166-4491-9425-fc2da25e106f', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 02 07:08:34.157715 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:34.162131 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:34.162131 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:34.162131 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:34.162131 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:34.162131 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:34.162131 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:08:34.162131 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:08:34.162131 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 02 07:08:34.162131 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:34.162131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-26043b42-9238-4ac3-bb27-acb0fd0f3aeb tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Returning 404 to user: floating IP not found {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:08:34.162131 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-26043b42-9238-4ac3-bb27-acb0fd0f3aeb tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action" status: 404 len: 67 microversion: 2.1 time: 0.545202 Aug 02 07:08:34.168449 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2128/4325] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:08:33 2022] POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action => generated 67 bytes in 558 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:08:34.176714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2f1ef263-5d50-4208-b26a-acdd2ab047dc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:34.177340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2f1ef263-5d50-4208-b26a-acdd2ab047dc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:34.208695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f1ef263-5d50-4208-b26a-acdd2ab047dc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:34.211754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f1ef263-5d50-4208-b26a-acdd2ab047dc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:34.217736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f1ef263-5d50-4208-b26a-acdd2ab047dc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:34.231027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f1ef263-5d50-4208-b26a-acdd2ab047dc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:34.394052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2c372ed9-ed1b-4915-a70c-7b272f9a1264 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:34.405519 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2c372ed9-ed1b-4915-a70c-7b272f9a1264 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.465188 Aug 02 07:08:34.406143 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2198/4326] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:33 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:34.426945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-276e0a7e-cd38-4c08-a34d-fb780d09df46 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:34.430651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-276e0a7e-cd38-4c08-a34d-fb780d09df46 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:34.443284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-276e0a7e-cd38-4c08-a34d-fb780d09df46 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:34.444107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-276e0a7e-cd38-4c08-a34d-fb780d09df46 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:34.447515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-276e0a7e-cd38-4c08-a34d-fb780d09df46 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:34.448148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-276e0a7e-cd38-4c08-a34d-fb780d09df46 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:35.111985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2f1ef263-5d50-4208-b26a-acdd2ab047dc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:35.131511 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2f1ef263-5d50-4208-b26a-acdd2ab047dc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1694 microversion: 2.1 time: 0.960219 Aug 02 07:08:35.134924 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2129/4327] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:34 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1694 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:35.147947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-99815b63-de39-48c9-b3c0-c5f6d289b1e1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:35.390601 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-99815b63-de39-48c9-b3c0-c5f6d289b1e1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-99815b63-de39-48c9-b3c0-c5f6d289b1e1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Request method failure captured: Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action HTTP/1.1 Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 44 Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M1ExICjYDs7CXVoJmLwYBJ0QJT7fyd4dtr2wK5d2qdRrJ9AgCvVKJ0sdfhQ2e5E8C-RjQ43p44_bXqwyfwnAEww6nUFCAmGUlNc2FLGZh_C21m8DzF3tFfX6t2APAHC87syL6CENDyfhmNyEmHRadzCTlX2PQgZe0k6rRyMbi7qDz0 Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: fc1dad66fd4340908cce462baeb8e4c7 Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fc1dad66fd4340908cce462baeb8e4c7"}]}] Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: fc1dad66fd4340908cce462baeb8e4c7 Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: ce8039cf34f34f0fa6fed42879e9b79b Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: exception: Floating IP not found for address 0.0.0.0. Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '2d05fd34-5166-4491-9425-fc2da25e106f', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 02 07:08:35.392931 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 02 07:08:35.397778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 02 07:08:35.397778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:35.397778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:35.397778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:35.397778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:35.397778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:35.397778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:35.397778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:08:35.397778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:08:35.397778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 02 07:08:35.397778 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:35.400168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-99815b63-de39-48c9-b3c0-c5f6d289b1e1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:08:35.401226 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-99815b63-de39-48c9-b3c0-c5f6d289b1e1 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action" status: 404 len: 88 microversion: 2.1 time: 0.263800 Aug 02 07:08:35.402101 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2130/4328] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:08:35 2022] POST /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f/action => generated 88 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:08:35.417401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab27f6aa-26da-42e8-aa7b-175a013451d2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:35.418597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ab27f6aa-26da-42e8-aa7b-175a013451d2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:35.439288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab27f6aa-26da-42e8-aa7b-175a013451d2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:35.444699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab27f6aa-26da-42e8-aa7b-175a013451d2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:35.448323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab27f6aa-26da-42e8-aa7b-175a013451d2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:35.449002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab27f6aa-26da-42e8-aa7b-175a013451d2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:35.809596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-276e0a7e-cd38-4c08-a34d-fb780d09df46 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:35.860263 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-276e0a7e-cd38-4c08-a34d-fb780d09df46 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 200 len: 1309 microversion: 2.1 time: 1.446389 Aug 02 07:08:35.868531 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2199/4329] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:34 2022] GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 1309 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:35.884491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3fdcafa3-9bd0-49c0-bc8a-8e458fe49346 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:35.885137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3fdcafa3-9bd0-49c0-bc8a-8e458fe49346 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:35.898560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3fdcafa3-9bd0-49c0-bc8a-8e458fe49346 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:35.899020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3fdcafa3-9bd0-49c0-bc8a-8e458fe49346 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:35.909277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3fdcafa3-9bd0-49c0-bc8a-8e458fe49346 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:35.911222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3fdcafa3-9bd0-49c0-bc8a-8e458fe49346 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:36.302938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ab27f6aa-26da-42e8-aa7b-175a013451d2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:36.324473 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ab27f6aa-26da-42e8-aa7b-175a013451d2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.917500 Aug 02 07:08:36.333233 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2131/4330] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:35 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:36.349814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-98718e5b-8dc3-48dc-8491-bd428130e485 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:36.350620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-98718e5b-8dc3-48dc-8491-bd428130e485 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:36.368281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98718e5b-8dc3-48dc-8491-bd428130e485 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:36.369173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98718e5b-8dc3-48dc-8491-bd428130e485 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:36.373142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98718e5b-8dc3-48dc-8491-bd428130e485 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:36.374052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-98718e5b-8dc3-48dc-8491-bd428130e485 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:36.588495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3fdcafa3-9bd0-49c0-bc8a-8e458fe49346 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:36.605377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3fdcafa3-9bd0-49c0-bc8a-8e458fe49346 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:36.607599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3fdcafa3-9bd0-49c0-bc8a-8e458fe49346 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:36.614217 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3fdcafa3-9bd0-49c0-bc8a-8e458fe49346 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.744081 Aug 02 07:08:36.621533 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2200/4331] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:35 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:36.637201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c917bb7a-8963-4290-982e-9fb6d91802bf tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:36.639895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c917bb7a-8963-4290-982e-9fb6d91802bf tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:36.663567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c917bb7a-8963-4290-982e-9fb6d91802bf tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:36.674921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c917bb7a-8963-4290-982e-9fb6d91802bf tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:36.676560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c917bb7a-8963-4290-982e-9fb6d91802bf tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:36.677253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c917bb7a-8963-4290-982e-9fb6d91802bf tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:36.697091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-98718e5b-8dc3-48dc-8491-bd428130e485 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:36.715491 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-98718e5b-8dc3-48dc-8491-bd428130e485 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 200 len: 1615 microversion: 2.1 time: 0.375907 Aug 02 07:08:36.719978 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2132/4332] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:36 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 1615 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:36.740921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-517c0ea5-76c1-465f-ad56-1fcb5a5a5c09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:36.752213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-517c0ea5-76c1-465f-ad56-1fcb5a5a5c09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:36.790123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c917bb7a-8963-4290-982e-9fb6d91802bf tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:08:36.818440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-517c0ea5-76c1-465f-ad56-1fcb5a5a5c09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:36.819951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-517c0ea5-76c1-465f-ad56-1fcb5a5a5c09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:36.826842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-517c0ea5-76c1-465f-ad56-1fcb5a5a5c09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:36.830372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-517c0ea5-76c1-465f-ad56-1fcb5a5a5c09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:37.063157 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c917bb7a-8963-4290-982e-9fb6d91802bf tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 204 len: 0 microversion: 2.1 time: 0.439335 Aug 02 07:08:37.066896 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2201/4333] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:08:36 2022] DELETE /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:08:37.076055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1d1dec9b-9c08-4b2c-b521-ac0b60a75e88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:37.079232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1d1dec9b-9c08-4b2c-b521-ac0b60a75e88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:37.104144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d1dec9b-9c08-4b2c-b521-ac0b60a75e88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:37.105619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d1dec9b-9c08-4b2c-b521-ac0b60a75e88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:37.108062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d1dec9b-9c08-4b2c-b521-ac0b60a75e88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:37.111242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d1dec9b-9c08-4b2c-b521-ac0b60a75e88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:37.505375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-517c0ea5-76c1-465f-ad56-1fcb5a5a5c09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:37.517454 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-517c0ea5-76c1-465f-ad56-1fcb5a5a5c09 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1691 microversion: 2.1 time: 0.795931 Aug 02 07:08:37.518456 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2133/4334] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:36 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1691 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:37.523856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-40cdd52f-9947-4b04-bb4b-e1cd356fd9aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:37.525248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-40cdd52f-9947-4b04-bb4b-e1cd356fd9aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:37.533757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40cdd52f-9947-4b04-bb4b-e1cd356fd9aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:37.534677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40cdd52f-9947-4b04-bb4b-e1cd356fd9aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:37.535700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40cdd52f-9947-4b04-bb4b-e1cd356fd9aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:37.536390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-40cdd52f-9947-4b04-bb4b-e1cd356fd9aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:37.769219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1d1dec9b-9c08-4b2c-b521-ac0b60a75e88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:37.783447 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1d1dec9b-9c08-4b2c-b521-ac0b60a75e88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.717042 Aug 02 07:08:37.784992 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2202/4335] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:37 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:37.793134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-3f64beb7-ce2b-4130-8c2e-6f5d2640e18d req-f0189bd7-1b0f-43ab-9e2b-32cbade25e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416496be-7b54-49d4-9d90-3d0be9463e67", "name": "network-vif-deleted", "tag": "3ebf0c02-a621-4c47-94f1-5e112337634c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:37.825704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-3f64beb7-ce2b-4130-8c2e-6f5d2640e18d req-f0189bd7-1b0f-43ab-9e2b-32cbade25e41 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:37.829229 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-3f64beb7-ce2b-4130-8c2e-6f5d2640e18d req-f0189bd7-1b0f-43ab-9e2b-32cbade25e41 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:37.861771 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-3f64beb7-ce2b-4130-8c2e-6f5d2640e18d req-f0189bd7-1b0f-43ab-9e2b-32cbade25e41 service nova] Creating event network-vif-deleted:3ebf0c02-a621-4c47-94f1-5e112337634c for instance 416496be-7b54-49d4-9d90-3d0be9463e67 on n-h2-851337-3 Aug 02 07:08:37.879107 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-3f64beb7-ce2b-4130-8c2e-6f5d2640e18d req-f0189bd7-1b0f-43ab-9e2b-32cbade25e41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091714 Aug 02 07:08:37.880606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-40cdd52f-9947-4b04-bb4b-e1cd356fd9aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:37.881184 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2203/4336] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:37.889046 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-40cdd52f-9947-4b04-bb4b-e1cd356fd9aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 200 len: 1489 microversion: 2.1 time: 0.369249 Aug 02 07:08:37.890264 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2134/4337] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:37 2022] GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 1489 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:37.895761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1e01d803-fd52-47fa-bbd5-bda629422ceb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:37.896753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1e01d803-fd52-47fa-bbd5-bda629422ceb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:37.899714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ca62b88b-6d4f-4e83-ad67-5b45d589836e tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:37.901141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ca62b88b-6d4f-4e83-ad67-5b45d589836e tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:37.906703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e01d803-fd52-47fa-bbd5-bda629422ceb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:37.907519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e01d803-fd52-47fa-bbd5-bda629422ceb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:37.908549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e01d803-fd52-47fa-bbd5-bda629422ceb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:37.909242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e01d803-fd52-47fa-bbd5-bda629422ceb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:37.957367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca62b88b-6d4f-4e83-ad67-5b45d589836e tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:37.959519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca62b88b-6d4f-4e83-ad67-5b45d589836e tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:37.961197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca62b88b-6d4f-4e83-ad67-5b45d589836e tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:37.962289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca62b88b-6d4f-4e83-ad67-5b45d589836e tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:38.051144 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1e01d803-fd52-47fa-bbd5-bda629422ceb tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331/action" status: 204 len: 0 microversion: 2.1 time: 0.154350 Aug 02 07:08:38.054336 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2135/4338] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:08:37 2022] POST /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331/action => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:08:38.070142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-612f92e0-8fde-4d86-a23d-9b1fc5f51ec8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:38.071676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-612f92e0-8fde-4d86-a23d-9b1fc5f51ec8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:38.080440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-612f92e0-8fde-4d86-a23d-9b1fc5f51ec8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:38.081319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-612f92e0-8fde-4d86-a23d-9b1fc5f51ec8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:38.082147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-612f92e0-8fde-4d86-a23d-9b1fc5f51ec8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:38.082733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-612f92e0-8fde-4d86-a23d-9b1fc5f51ec8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:38.375487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ca62b88b-6d4f-4e83-ad67-5b45d589836e tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:38.389597 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ca62b88b-6d4f-4e83-ad67-5b45d589836e tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1541 microversion: 2.1 time: 0.505470 Aug 02 07:08:38.394194 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2204/4339] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:37 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1541 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:38.407951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-a10a79cd-a311-4856-b0f2-892666b26d59 req-c8de805d-66b9-45ff-85b4-443afe470a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d93db40-84f5-4c63-825f-6ee647fa2331", "name": "network-vif-plugged", "status": "completed", "tag": "38895fc4-ade3-4226-bdfd-d68b06745975"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:38.434006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a10a79cd-a311-4856-b0f2-892666b26d59 req-c8de805d-66b9-45ff-85b4-443afe470a13 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:38.442897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-612f92e0-8fde-4d86-a23d-9b1fc5f51ec8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:38.447762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a10a79cd-a311-4856-b0f2-892666b26d59 req-c8de805d-66b9-45ff-85b4-443afe470a13 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:38.455129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-612f92e0-8fde-4d86-a23d-9b1fc5f51ec8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:38.465391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-612f92e0-8fde-4d86-a23d-9b1fc5f51ec8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:38.471509 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-612f92e0-8fde-4d86-a23d-9b1fc5f51ec8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.415842 Aug 02 07:08:38.472896 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2136/4340] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:38 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:38.478437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2df91414-8d15-4b3a-bd69-3bb1f4f17f8a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:38.486248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2df91414-8d15-4b3a-bd69-3bb1f4f17f8a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:38.486999 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-a10a79cd-a311-4856-b0f2-892666b26d59 req-c8de805d-66b9-45ff-85b4-443afe470a13 service nova] Creating event network-vif-plugged:38895fc4-ade3-4226-bdfd-d68b06745975 for instance 4d93db40-84f5-4c63-825f-6ee647fa2331 on n-h2-851337-3 Aug 02 07:08:38.499909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:38.509752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-a10a79cd-a311-4856-b0f2-892666b26d59 req-c8de805d-66b9-45ff-85b4-443afe470a13 service nova] Instance 4d93db40-84f5-4c63-825f-6ee647fa2331 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:08:38.518912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2df91414-8d15-4b3a-bd69-3bb1f4f17f8a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:38.519444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2df91414-8d15-4b3a-bd69-3bb1f4f17f8a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:38.520294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2df91414-8d15-4b3a-bd69-3bb1f4f17f8a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:38.520728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2df91414-8d15-4b3a-bd69-3bb1f4f17f8a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:38.535280 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-a10a79cd-a311-4856-b0f2-892666b26d59 req-c8de805d-66b9-45ff-85b4-443afe470a13 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136435 Aug 02 07:08:38.540437 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2205/4341] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:38.555954 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-2df91414-8d15-4b3a-bd69-3bb1f4f17f8a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] HTTP exception thrown: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2df91414-8d15-4b3a-bd69-3bb1f4f17f8a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Request method failure captured: Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 HTTP/1.1 Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mw13SPusoL2oig6z8JKTC1nUbf8Rw_5jT5YPT1CWrOABe8wYL59aYsXiUDtU2vA3es6LryNsakcXkaddV2SmWSmf9b0Kir8iKyeHQ1V913RDI7OxthQkB34rsjOk5zDf7k87yoaJrxDD4eFsnTmbVoTrOLyxwi8jQau6VljX5rXYUE Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ee1befa077542b9a17865baad3c9999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}] Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 3a2629fa08b5419a96c2942118d38dad Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '416496be-7b54-49d4-9d90-3d0be9463e67'} Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:38.565671 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:38.570481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:38.570481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:38.570481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:38.570481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:08:38.570481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:08:38.570481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:08:38.570481 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:08:38.572221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2045006563", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "4a2e64a4-c6ee-43d5-bb6a-002018e2c279"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:38.573407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2df91414-8d15-4b3a-bd69-3bb1f4f17f8a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Returning 404 to user: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:08:38.574333 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2df91414-8d15-4b3a-bd69-3bb1f4f17f8a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 404 len: 111 microversion: 2.1 time: 0.100115 Aug 02 07:08:38.574945 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2137/4342] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:38 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:08:38.582185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2072807205", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:38.701175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] validate_networks() for [('4a2e64a4-c6ee-43d5-bb6a-002018e2c279', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:08:38.731528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] validate_networks() for [('ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:08:40.198416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:08:40.203461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:08:40.218231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:08:40.218838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:08:40.219134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:08:40.240095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:40.240881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:40.241874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:40.242331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:40.261749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Getting quotas for project daaad725b62041d1ac0af9ff8efcdfc5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:08:40.267087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Getting quotas for user 35f9bc6690f3473a99804c14351b93b6 and project daaad725b62041d1ac0af9ff8efcdfc5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:08:40.278939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:08:40.279462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:08:40.279812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:08:40.280211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:08:40.284206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:08:40.284727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:08:40.291024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:08:40.294685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:40.295298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:40.296313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:40.296942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:40.315813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:08:40.321801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for user 0971d7961d5a4e8996ea2c0f958382ad and project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:08:40.335346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:08:40.338013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:08:40.354906 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6ccc38d6-7f5b-430f-b927-f7a707c40ce8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.812473 Aug 02 07:08:40.365108 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2206/4343] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:08:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:08:40.376000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6e79ad9a-df5e-4a97-88ce-c74643732e6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:40.377426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6e79ad9a-df5e-4a97-88ce-c74643732e6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:40.396736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e79ad9a-df5e-4a97-88ce-c74643732e6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:40.397490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e79ad9a-df5e-4a97-88ce-c74643732e6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:40.398700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e79ad9a-df5e-4a97-88ce-c74643732e6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:40.399409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e79ad9a-df5e-4a97-88ce-c74643732e6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:40.444422 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a66291d1-0912-444a-a2da-66f04f52ac1e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.866481 Aug 02 07:08:40.450722 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2138/4344] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:08:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:08:40.476861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3cc9afa3-73d7-45a6-9b31-df419473d72d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '.version_select at 0x7f928c24d040>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:40.554245 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3cc9afa3-73d7-45a6-9b31-df419473d72d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476571847" status: 202 len: 0 microversion: 2.1 time: 0.101015 Aug 02 07:08:40.558196 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2139/4345] 10.222.0.79 () {58 vars in 1221 bytes} [Tue Aug 2 07:08:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476571847 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:08:40.565987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79a948e3-9559-4e56-8709-9cbb78216707 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:40.567215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79a948e3-9559-4e56-8709-9cbb78216707 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:40.577351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79a948e3-9559-4e56-8709-9cbb78216707 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:40.578133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79a948e3-9559-4e56-8709-9cbb78216707 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:40.579084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79a948e3-9559-4e56-8709-9cbb78216707 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:40.579813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79a948e3-9559-4e56-8709-9cbb78216707 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:40.604373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:40.715681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6e79ad9a-df5e-4a97-88ce-c74643732e6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:40.724356 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6e79ad9a-df5e-4a97-88ce-c74643732e6f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1691 microversion: 2.1 time: 0.357802 Aug 02 07:08:40.743279 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2207/4346] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:40 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1691 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:40.751146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3f556b03-57ff-408e-98b9-778dff38a8f6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:40.752938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3f556b03-57ff-408e-98b9-778dff38a8f6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:40.761673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f556b03-57ff-408e-98b9-778dff38a8f6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:40.763191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f556b03-57ff-408e-98b9-778dff38a8f6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:40.764451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f556b03-57ff-408e-98b9-778dff38a8f6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:40.765102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f556b03-57ff-408e-98b9-778dff38a8f6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:41.164008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3f556b03-57ff-408e-98b9-778dff38a8f6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:41.175929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3f556b03-57ff-408e-98b9-778dff38a8f6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:41.177513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3f556b03-57ff-408e-98b9-778dff38a8f6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:41.187477 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3f556b03-57ff-408e-98b9-778dff38a8f6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.442344 Aug 02 07:08:41.188821 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2208/4347] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:40 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:41.193201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab440303-1c58-4bad-906a-1c9bb50c971d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:41.193841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab440303-1c58-4bad-906a-1c9bb50c971d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:41.209471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79a948e3-9559-4e56-8709-9cbb78216707 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:41.220075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab440303-1c58-4bad-906a-1c9bb50c971d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:41.224140 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79a948e3-9559-4e56-8709-9cbb78216707 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1541 microversion: 2.1 time: 0.666935 Aug 02 07:08:41.224921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab440303-1c58-4bad-906a-1c9bb50c971d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:41.226829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab440303-1c58-4bad-906a-1c9bb50c971d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:41.227276 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2140/4348] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:40 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1541 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:41.229154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab440303-1c58-4bad-906a-1c9bb50c971d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:41.237589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-66148a76-abb3-4daa-8b9a-c088ffb024f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:41.244956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-66148a76-abb3-4daa-8b9a-c088ffb024f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:41.259918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66148a76-abb3-4daa-8b9a-c088ffb024f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:41.272408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66148a76-abb3-4daa-8b9a-c088ffb024f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:41.275484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66148a76-abb3-4daa-8b9a-c088ffb024f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:41.276130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66148a76-abb3-4daa-8b9a-c088ffb024f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:41.545653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-66148a76-abb3-4daa-8b9a-c088ffb024f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:41.563680 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-66148a76-abb3-4daa-8b9a-c088ffb024f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1213 microversion: 2.1 time: 0.335113 Aug 02 07:08:41.567056 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2141/4349] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:41 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1213 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:41.584090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab440303-1c58-4bad-906a-1c9bb50c971d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:41.597645 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab440303-1c58-4bad-906a-1c9bb50c971d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 200 len: 1219 microversion: 2.1 time: 0.407959 Aug 02 07:08:41.602400 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2209/4350] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:41 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 1219 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:41.757057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-de45b53d-8386-44cf-97f7-163b8c53e5f2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:41.758203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-de45b53d-8386-44cf-97f7-163b8c53e5f2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:41.768665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de45b53d-8386-44cf-97f7-163b8c53e5f2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:41.769496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de45b53d-8386-44cf-97f7-163b8c53e5f2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:41.770321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de45b53d-8386-44cf-97f7-163b8c53e5f2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:41.770938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de45b53d-8386-44cf-97f7-163b8c53e5f2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:41.899120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-85c0b817-4f04-4cca-9b04-b98e8c739967 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Action: 'create', calling method: .version_select at 0x7f927a839280>, body: {"keypair": {"name": "tempest-keypair-1599287358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+Oh4ajTFs3KpXeq/S/0B8PRl2oOAQvKX+tiT5vkCd1dE+metcsBQQGqHKCCnFXUKWkF6fPchC5vDEGv3uV15qfQKbZ1ciV7YYftwdi0do1nDvpmHAf5YTPLrfVR1RQ3w=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:41.919486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-85c0b817-4f04-4cca-9b04-b98e8c739967 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for project 6ee1befa077542b9a17865baad3c9999. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:08:41.926352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-85c0b817-4f04-4cca-9b04-b98e8c739967 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for user 3a2629fa08b5419a96c2942118d38dad and project 6ee1befa077542b9a17865baad3c9999. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:08:41.967386 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-85c0b817-4f04-4cca-9b04-b98e8c739967 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072942 Aug 02 07:08:41.975356 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2210/4351] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:08:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:42.214232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e829f5bc-86e7-4e70-8f17-fe0eb5f96914 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:42.214871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e829f5bc-86e7-4e70-8f17-fe0eb5f96914 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:42.227974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e829f5bc-86e7-4e70-8f17-fe0eb5f96914 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:42.230020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e829f5bc-86e7-4e70-8f17-fe0eb5f96914 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:42.230969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e829f5bc-86e7-4e70-8f17-fe0eb5f96914 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:42.231441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e829f5bc-86e7-4e70-8f17-fe0eb5f96914 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:42.692538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-de45b53d-8386-44cf-97f7-163b8c53e5f2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:42.707043 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-de45b53d-8386-44cf-97f7-163b8c53e5f2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1691 microversion: 2.1 time: 0.955518 Aug 02 07:08:42.707649 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2142/4352] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:41 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1691 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:42.718338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e609b53f-3ec1-4acc-9268-7d5ecfa365ff tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:42.719482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e609b53f-3ec1-4acc-9268-7d5ecfa365ff tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:42.726979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e609b53f-3ec1-4acc-9268-7d5ecfa365ff tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:42.727723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e609b53f-3ec1-4acc-9268-7d5ecfa365ff tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:42.729375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e609b53f-3ec1-4acc-9268-7d5ecfa365ff tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:42.730078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e609b53f-3ec1-4acc-9268-7d5ecfa365ff tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:42.856369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e829f5bc-86e7-4e70-8f17-fe0eb5f96914 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:42.875071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e829f5bc-86e7-4e70-8f17-fe0eb5f96914 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:42.880335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e829f5bc-86e7-4e70-8f17-fe0eb5f96914 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:42.882072 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e829f5bc-86e7-4e70-8f17-fe0eb5f96914 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.673768 Aug 02 07:08:42.883653 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2211/4353] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:42 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:08:42.889555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2e12d0d4-d89d-43b0-b8d8-dc4b68bd5ed7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:42.890612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2e12d0d4-d89d-43b0-b8d8-dc4b68bd5ed7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:42.901646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e12d0d4-d89d-43b0-b8d8-dc4b68bd5ed7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:42.905497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e12d0d4-d89d-43b0-b8d8-dc4b68bd5ed7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:42.906682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e12d0d4-d89d-43b0-b8d8-dc4b68bd5ed7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:42.907829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2e12d0d4-d89d-43b0-b8d8-dc4b68bd5ed7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:43.144013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2e12d0d4-d89d-43b0-b8d8-dc4b68bd5ed7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:43.154678 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2e12d0d4-d89d-43b0-b8d8-dc4b68bd5ed7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1267 microversion: 2.1 time: 0.269292 Aug 02 07:08:43.165740 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2212/4354] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:42 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1267 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:43.165740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c1d5a59a-603c-438d-a498-f93a301b48d0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:43.165740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c1d5a59a-603c-438d-a498-f93a301b48d0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:43.173006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1d5a59a-603c-438d-a498-f93a301b48d0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:43.173673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1d5a59a-603c-438d-a498-f93a301b48d0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:43.174683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1d5a59a-603c-438d-a498-f93a301b48d0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:43.175388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1d5a59a-603c-438d-a498-f93a301b48d0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:43.212565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:43.328316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c1d5a59a-603c-438d-a498-f93a301b48d0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:43.337923 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c1d5a59a-603c-438d-a498-f93a301b48d0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 200 len: 1273 microversion: 2.1 time: 0.181502 Aug 02 07:08:43.341089 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2213/4355] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:43 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:43.373646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e609b53f-3ec1-4acc-9268-7d5ecfa365ff tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8039cf34f34f0fa6fed42879e9b79b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1dad66fd4340908cce462baeb8e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:43.391587 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e609b53f-3ec1-4acc-9268-7d5ecfa365ff tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 200 len: 1541 microversion: 2.1 time: 0.677220 Aug 02 07:08:43.408141 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2143/4356] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:42 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 1541 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:43.728952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8f85c734-b214-472c-862d-3af6b2905a5d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:43.729341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8f85c734-b214-472c-862d-3af6b2905a5d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:43.736533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f85c734-b214-472c-862d-3af6b2905a5d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:43.737204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f85c734-b214-472c-862d-3af6b2905a5d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:43.738142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f85c734-b214-472c-862d-3af6b2905a5d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:43.738684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f85c734-b214-472c-862d-3af6b2905a5d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:43.783000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-91c5eb7f-e2b8-45d8-8d6f-51c43d620d90 req-f1b8de13-8c06-4d2c-b9a3-0d934ceb0cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d05fd34-5166-4491-9425-fc2da25e106f", "name": "network-vif-deleted", "tag": "9bfac521-3575-41c1-ac0e-8d05e3335152"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:43.802915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-91c5eb7f-e2b8-45d8-8d6f-51c43d620d90 req-f1b8de13-8c06-4d2c-b9a3-0d934ceb0cc3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:43.805336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-91c5eb7f-e2b8-45d8-8d6f-51c43d620d90 req-f1b8de13-8c06-4d2c-b9a3-0d934ceb0cc3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:43.819943 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-91c5eb7f-e2b8-45d8-8d6f-51c43d620d90 req-f1b8de13-8c06-4d2c-b9a3-0d934ceb0cc3 service nova] Creating event network-vif-deleted:9bfac521-3575-41c1-ac0e-8d05e3335152 for instance 2d05fd34-5166-4491-9425-fc2da25e106f on n-h1-851337-3 Aug 02 07:08:43.826238 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-91c5eb7f-e2b8-45d8-8d6f-51c43d620d90 req-f1b8de13-8c06-4d2c-b9a3-0d934ceb0cc3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047438 Aug 02 07:08:43.827473 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2144/4357] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:43.909568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8cd6e4e9-cbc6-460a-a231-84e504026955 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:43.910627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8cd6e4e9-cbc6-460a-a231-84e504026955 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:43.919456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8cd6e4e9-cbc6-460a-a231-84e504026955 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:43.920758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8cd6e4e9-cbc6-460a-a231-84e504026955 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:43.922041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8cd6e4e9-cbc6-460a-a231-84e504026955 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:43.923463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8cd6e4e9-cbc6-460a-a231-84e504026955 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:44.805676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8f85c734-b214-472c-862d-3af6b2905a5d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:44.814261 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8f85c734-b214-472c-862d-3af6b2905a5d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1691 microversion: 2.1 time: 1.089831 Aug 02 07:08:44.816021 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2214/4358] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:43 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1691 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:44.821160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fb0e0d81-6a46-4459-bfc2-c447e9b4a34d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:44.822030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fb0e0d81-6a46-4459-bfc2-c447e9b4a34d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:44.825308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:44.860041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb0e0d81-6a46-4459-bfc2-c447e9b4a34d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:44.860646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb0e0d81-6a46-4459-bfc2-c447e9b4a34d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:44.861810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb0e0d81-6a46-4459-bfc2-c447e9b4a34d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:44.862594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb0e0d81-6a46-4459-bfc2-c447e9b4a34d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:45.272366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fb0e0d81-6a46-4459-bfc2-c447e9b4a34d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:45.286954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8cd6e4e9-cbc6-460a-a231-84e504026955 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:45.287976 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fb0e0d81-6a46-4459-bfc2-c447e9b4a34d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1267 microversion: 2.1 time: 0.467579 Aug 02 07:08:45.303943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8cd6e4e9-cbc6-460a-a231-84e504026955 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:45.303943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8cd6e4e9-cbc6-460a-a231-84e504026955 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:45.305346 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8cd6e4e9-cbc6-460a-a231-84e504026955 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 1.401897 Aug 02 07:08:45.305346 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2145/4359] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:43 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:45.305990 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2215/4360] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:44 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1267 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:45.317101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-95a8e3a0-794c-4fb6-9100-cc922e87e317 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:45.317728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-95a8e3a0-794c-4fb6-9100-cc922e87e317 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:45.318623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6e5bc8b-85a9-482b-9c6e-102fa695a1b7 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:45.321256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d6e5bc8b-85a9-482b-9c6e-102fa695a1b7 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] [instance: 2d05fd34-5166-4491-9425-fc2da25e106f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:45.333118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95a8e3a0-794c-4fb6-9100-cc922e87e317 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:45.333466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95a8e3a0-794c-4fb6-9100-cc922e87e317 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:45.337823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6e5bc8b-85a9-482b-9c6e-102fa695a1b7 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:45.338561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6e5bc8b-85a9-482b-9c6e-102fa695a1b7 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:45.340117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95a8e3a0-794c-4fb6-9100-cc922e87e317 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:45.340633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95a8e3a0-794c-4fb6-9100-cc922e87e317 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:45.341647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6e5bc8b-85a9-482b-9c6e-102fa695a1b7 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:45.342308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6e5bc8b-85a9-482b-9c6e-102fa695a1b7 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:45.381696 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-d6e5bc8b-85a9-482b-9c6e-102fa695a1b7 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] HTTP exception thrown: Instance 2d05fd34-5166-4491-9425-fc2da25e106f could not be found. Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6e5bc8b-85a9-482b-9c6e-102fa695a1b7 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Request method failure captured: Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f HTTP/1.1 Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M1ExICjYDs7CXVoJmLwYBJ0QJT7fyd4dtr2wK5d2qdRrJ9AgCvVKJ0sdfhQ2e5E8C-RjQ43p44_bXqwyfwnAEww6nUFCAmGUlNc2FLGZh_C21m8DzF3tFfX6t2APAHC87syL6CENDyfhmNyEmHRadzCTlX2PQgZe0k6rRyMbi7qDz0 Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: fc1dad66fd4340908cce462baeb8e4c7 Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fc1dad66fd4340908cce462baeb8e4c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fc1dad66fd4340908cce462baeb8e4c7"}]}] Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: fc1dad66fd4340908cce462baeb8e4c7 Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: ce8039cf34f34f0fa6fed42879e9b79b Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 2d05fd34-5166-4491-9425-fc2da25e106f could not be found. Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '2d05fd34-5166-4491-9425-fc2da25e106f'} Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d05fd34-5166-4491-9425-fc2da25e106f could not be found. Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d05fd34-5166-4491-9425-fc2da25e106f could not be found. Aug 02 07:08:45.384509 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:45.389272 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:08:45.389272 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:45.389272 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:08:45.389272 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:08:45.389272 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:08:45.389272 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:08:45.389272 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:08:45.389272 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d05fd34-5166-4491-9425-fc2da25e106f could not be found. Aug 02 07:08:45.389272 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:08:45.393161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6e5bc8b-85a9-482b-9c6e-102fa695a1b7 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] Returning 404 to user: Instance 2d05fd34-5166-4491-9425-fc2da25e106f could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:08:45.394343 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d6e5bc8b-85a9-482b-9c6e-102fa695a1b7 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329 tempest-FloatingIPsAssociationNegativeTestJSON-1462633329-project] 10.222.0.79 "GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f" status: 404 len: 111 microversion: 2.1 time: 0.085487 Aug 02 07:08:45.399267 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2216/4361] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:45 2022] GET /compute/v2.1/servers/2d05fd34-5166-4491-9425-fc2da25e106f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:08:45.841175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-521ae900-2a0c-4151-8fc2-965f8239d22f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:45.841800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-521ae900-2a0c-4151-8fc2-965f8239d22f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:45.853513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-521ae900-2a0c-4151-8fc2-965f8239d22f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:45.856403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-521ae900-2a0c-4151-8fc2-965f8239d22f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:45.857429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-521ae900-2a0c-4151-8fc2-965f8239d22f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:45.858071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-521ae900-2a0c-4151-8fc2-965f8239d22f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:46.174460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-95a8e3a0-794c-4fb6-9100-cc922e87e317 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:46.186121 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-95a8e3a0-794c-4fb6-9100-cc922e87e317 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 200 len: 1315 microversion: 2.1 time: 0.879699 Aug 02 07:08:46.188944 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2146/4362] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:45 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 1315 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:46.200403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e79c1862-0e7c-4b5d-8b42-4313c166fe81 req-334d9cc2-eecd-4a57-a5c6-e06a5dc78273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c3bfd41-7a86-4a91-a51d-e6f38888fd9b", "tag": "3b96a15e-6e4a-44c3-84a8-40430d1e2f35"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:46.225008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e79c1862-0e7c-4b5d-8b42-4313c166fe81 req-334d9cc2-eecd-4a57-a5c6-e06a5dc78273 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:46.227789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e79c1862-0e7c-4b5d-8b42-4313c166fe81 req-334d9cc2-eecd-4a57-a5c6-e06a5dc78273 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:46.259828 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e79c1862-0e7c-4b5d-8b42-4313c166fe81 req-334d9cc2-eecd-4a57-a5c6-e06a5dc78273 service nova] Creating event network-changed:3b96a15e-6e4a-44c3-84a8-40430d1e2f35 for instance 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b on n-h2-851337-3 Aug 02 07:08:46.282654 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e79c1862-0e7c-4b5d-8b42-4313c166fe81 req-334d9cc2-eecd-4a57-a5c6-e06a5dc78273 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082420 Aug 02 07:08:46.284016 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2147/4363] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:46.316699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5700ea9a-efe7-4d86-b6de-f05583931244 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:46.317413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5700ea9a-efe7-4d86-b6de-f05583931244 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:46.334538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5700ea9a-efe7-4d86-b6de-f05583931244 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:46.334995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5700ea9a-efe7-4d86-b6de-f05583931244 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:46.335792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5700ea9a-efe7-4d86-b6de-f05583931244 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:46.336350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5700ea9a-efe7-4d86-b6de-f05583931244 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:46.698604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-521ae900-2a0c-4151-8fc2-965f8239d22f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:46.707667 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-521ae900-2a0c-4151-8fc2-965f8239d22f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1691 microversion: 2.1 time: 0.870237 Aug 02 07:08:46.708912 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2217/4364] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:45 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1691 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:08:46.727406 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-98d0f908-2d1d-47ce-9fc7-22f76d498985 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:46.728310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-98d0f908-2d1d-47ce-9fc7-22f76d498985 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:46.735534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98d0f908-2d1d-47ce-9fc7-22f76d498985 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:46.736147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98d0f908-2d1d-47ce-9fc7-22f76d498985 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:46.736947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98d0f908-2d1d-47ce-9fc7-22f76d498985 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:46.738017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98d0f908-2d1d-47ce-9fc7-22f76d498985 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:46.971948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5700ea9a-efe7-4d86-b6de-f05583931244 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:46.984945 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5700ea9a-efe7-4d86-b6de-f05583931244 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1309 microversion: 2.1 time: 0.672743 Aug 02 07:08:46.987189 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2148/4365] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:46 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1309 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:08:47.209798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9ef70588-c4e5-47f7-8e2c-b818c87d2538 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:47.210900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9ef70588-c4e5-47f7-8e2c-b818c87d2538 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:47.220210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ef70588-c4e5-47f7-8e2c-b818c87d2538 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:47.220934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ef70588-c4e5-47f7-8e2c-b818c87d2538 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:47.221954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ef70588-c4e5-47f7-8e2c-b818c87d2538 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:47.222669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9ef70588-c4e5-47f7-8e2c-b818c87d2538 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:47.404472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-98d0f908-2d1d-47ce-9fc7-22f76d498985 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:47.417368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-98d0f908-2d1d-47ce-9fc7-22f76d498985 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:47.420382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-98d0f908-2d1d-47ce-9fc7-22f76d498985 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:47.421942 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-98d0f908-2d1d-47ce-9fc7-22f76d498985 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.711666 Aug 02 07:08:47.423052 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2218/4366] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:46 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:47.697751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9ef70588-c4e5-47f7-8e2c-b818c87d2538 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:47.707982 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9ef70588-c4e5-47f7-8e2c-b818c87d2538 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 200 len: 1315 microversion: 2.1 time: 0.502927 Aug 02 07:08:47.709393 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2149/4367] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:47 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:47.734353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-19000813-7f2c-4c88-9975-99758a4ebb3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:47.735470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-19000813-7f2c-4c88-9975-99758a4ebb3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:47.742762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19000813-7f2c-4c88-9975-99758a4ebb3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:47.743544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19000813-7f2c-4c88-9975-99758a4ebb3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:47.744637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19000813-7f2c-4c88-9975-99758a4ebb3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:47.745284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19000813-7f2c-4c88-9975-99758a4ebb3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:48.008361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c4f425a7-9688-47c2-a35b-297ad43c423c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:48.009264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c4f425a7-9688-47c2-a35b-297ad43c423c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:48.016126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4f425a7-9688-47c2-a35b-297ad43c423c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:48.016807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4f425a7-9688-47c2-a35b-297ad43c423c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:48.017732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4f425a7-9688-47c2-a35b-297ad43c423c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:48.018345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4f425a7-9688-47c2-a35b-297ad43c423c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:48.569695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-19000813-7f2c-4c88-9975-99758a4ebb3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:48.580392 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-19000813-7f2c-4c88-9975-99758a4ebb3a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1683 microversion: 2.1 time: 0.851988 Aug 02 07:08:48.587045 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2219/4368] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:47 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1683 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:08:48.595328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-24d3bbe4-619a-47a6-b287-d8a4a3732ba1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:48.596428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-24d3bbe4-619a-47a6-b287-d8a4a3732ba1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:48.619005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24d3bbe4-619a-47a6-b287-d8a4a3732ba1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:48.619737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24d3bbe4-619a-47a6-b287-d8a4a3732ba1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:48.620520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24d3bbe4-619a-47a6-b287-d8a4a3732ba1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:48.620956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24d3bbe4-619a-47a6-b287-d8a4a3732ba1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:48.949505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c4f425a7-9688-47c2-a35b-297ad43c423c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:48.958375 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c4f425a7-9688-47c2-a35b-297ad43c423c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1309 microversion: 2.1 time: 0.954518 Aug 02 07:08:48.961336 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2150/4369] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:48 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1309 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:48.969182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b8f46f3b-f1a9-46eb-9704-7eea1a5624fd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:48.969805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b8f46f3b-f1a9-46eb-9704-7eea1a5624fd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:48.988520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8f46f3b-f1a9-46eb-9704-7eea1a5624fd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:48.988879 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8f46f3b-f1a9-46eb-9704-7eea1a5624fd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:48.989664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8f46f3b-f1a9-46eb-9704-7eea1a5624fd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:49.002715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8f46f3b-f1a9-46eb-9704-7eea1a5624fd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:49.051807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-24d3bbe4-619a-47a6-b287-d8a4a3732ba1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:49.066999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-24d3bbe4-619a-47a6-b287-d8a4a3732ba1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:49.068949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-24d3bbe4-619a-47a6-b287-d8a4a3732ba1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:49.070583 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-24d3bbe4-619a-47a6-b287-d8a4a3732ba1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.481782 Aug 02 07:08:49.071817 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2220/4370] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:48 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:49.078171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-618350848", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a30dbbf-9ed5-4371-af86-d34ddcdf6f20"}], "security_groups": [{"name": "tempest-securitygroup--2017795463"}], "key_name": "tempest-keypair-1599287358", "user_data": "}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:49.417517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] validate_networks() for [('9a30dbbf-9ed5-4371-af86-d34ddcdf6f20', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:08:49.463030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b8f46f3b-f1a9-46eb-9704-7eea1a5624fd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:49.478978 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b8f46f3b-f1a9-46eb-9704-7eea1a5624fd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 200 len: 1315 microversion: 2.1 time: 0.515688 Aug 02 07:08:49.480089 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2151/4371] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:48 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:49.487162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c43b2380-35e7-4b19-85db-a246b7c1fc6b req-79b09b47-efdc-40bc-b5c4-6869052ded87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b615a925-443e-4046-83d5-fceafea57257", "tag": "d0bef38a-2d40-4520-a39c-0f9bfb2f9b50"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:49.499818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c43b2380-35e7-4b19-85db-a246b7c1fc6b req-79b09b47-efdc-40bc-b5c4-6869052ded87 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:49.501450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c43b2380-35e7-4b19-85db-a246b7c1fc6b req-79b09b47-efdc-40bc-b5c4-6869052ded87 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:49.526476 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c43b2380-35e7-4b19-85db-a246b7c1fc6b req-79b09b47-efdc-40bc-b5c4-6869052ded87 service nova] Creating event network-changed:d0bef38a-2d40-4520-a39c-0f9bfb2f9b50 for instance b615a925-443e-4046-83d5-fceafea57257 on n-h2-851337-3 Aug 02 07:08:49.534871 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c43b2380-35e7-4b19-85db-a246b7c1fc6b req-79b09b47-efdc-40bc-b5c4-6869052ded87 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053209 Aug 02 07:08:49.536456 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2152/4372] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:49.980717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a9d52333-ed05-4122-9d6b-a269d3e0badb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:49.982497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a9d52333-ed05-4122-9d6b-a269d3e0badb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:49.995369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9d52333-ed05-4122-9d6b-a269d3e0badb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:49.996136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9d52333-ed05-4122-9d6b-a269d3e0badb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:49.997382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9d52333-ed05-4122-9d6b-a269d3e0badb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:49.999915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9d52333-ed05-4122-9d6b-a269d3e0badb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:50.252060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:50.305605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:50.331374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:50.759102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a9d52333-ed05-4122-9d6b-a269d3e0badb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:50.773968 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a9d52333-ed05-4122-9d6b-a269d3e0badb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1309 microversion: 2.1 time: 0.796983 Aug 02 07:08:50.786119 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2153/4373] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:49 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1309 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:08:50.799472 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-78232a19-24d8-4fa7-b08b-bf83aef25f9b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:50.800514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-78232a19-24d8-4fa7-b08b-bf83aef25f9b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:50.807836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78232a19-24d8-4fa7-b08b-bf83aef25f9b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:50.809922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78232a19-24d8-4fa7-b08b-bf83aef25f9b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:50.810798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78232a19-24d8-4fa7-b08b-bf83aef25f9b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:50.811242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78232a19-24d8-4fa7-b08b-bf83aef25f9b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:50.814085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:08:50.814869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:08:50.815482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:08:50.816057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:08:50.816622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:08:50.838925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:50.842650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:50.843990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:50.849248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:50.890735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for project 6ee1befa077542b9a17865baad3c9999. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:08:50.898001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Getting quotas for user 3a2629fa08b5419a96c2942118d38dad and project 6ee1befa077542b9a17865baad3c9999. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:08:50.926621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:08:50.948161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:08:51.080420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-78232a19-24d8-4fa7-b08b-bf83aef25f9b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:51.095308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-78232a19-24d8-4fa7-b08b-bf83aef25f9b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:51.098336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-78232a19-24d8-4fa7-b08b-bf83aef25f9b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:51.099866 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-78232a19-24d8-4fa7-b08b-bf83aef25f9b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.311663 Aug 02 07:08:51.116340 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2357f9e2-0691-4e29-9f54-ea307910acd2 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.039199 Aug 02 07:08:51.116340 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2221/4374] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:08:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 2041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:08:51.118103 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2154/4375] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:50 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:51.121225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-de584bd3-f6c9-4420-9dbc-0f7110ae4610 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:51.121876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-de584bd3-f6c9-4420-9dbc-0f7110ae4610 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:51.131415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-78652f00-8829-4cba-bc33-7d88c84f5399 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:51.132184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-78652f00-8829-4cba-bc33-7d88c84f5399 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:51.145841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de584bd3-f6c9-4420-9dbc-0f7110ae4610 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:51.154601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de584bd3-f6c9-4420-9dbc-0f7110ae4610 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:51.156137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de584bd3-f6c9-4420-9dbc-0f7110ae4610 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:51.156756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de584bd3-f6c9-4420-9dbc-0f7110ae4610 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:51.346464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-78652f00-8829-4cba-bc33-7d88c84f5399 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:51.353735 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-78652f00-8829-4cba-bc33-7d88c84f5399 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1241 microversion: 2.1 time: 0.226509 Aug 02 07:08:51.355339 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2155/4376] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:51 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1241 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:08:51.549679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-de584bd3-f6c9-4420-9dbc-0f7110ae4610 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:51.567624 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-de584bd3-f6c9-4420-9dbc-0f7110ae4610 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 200 len: 1315 microversion: 2.1 time: 0.452754 Aug 02 07:08:51.568956 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2222/4377] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:51 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:51.811628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-36a45ce5-3f1d-4f9d-8aff-8369172e9ba9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:51.812875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-36a45ce5-3f1d-4f9d-8aff-8369172e9ba9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:51.833181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36a45ce5-3f1d-4f9d-8aff-8369172e9ba9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:51.834407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36a45ce5-3f1d-4f9d-8aff-8369172e9ba9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:51.837916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36a45ce5-3f1d-4f9d-8aff-8369172e9ba9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:51.839326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36a45ce5-3f1d-4f9d-8aff-8369172e9ba9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:52.125038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b0e1f283-b105-4747-876b-2e54c5c58bf7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:52.126070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b0e1f283-b105-4747-876b-2e54c5c58bf7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:52.151758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0e1f283-b105-4747-876b-2e54c5c58bf7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:52.155885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0e1f283-b105-4747-876b-2e54c5c58bf7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:52.156970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0e1f283-b105-4747-876b-2e54c5c58bf7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:52.157674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0e1f283-b105-4747-876b-2e54c5c58bf7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:52.443648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-36a45ce5-3f1d-4f9d-8aff-8369172e9ba9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:52.471930 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-36a45ce5-3f1d-4f9d-8aff-8369172e9ba9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1309 microversion: 2.1 time: 0.670897 Aug 02 07:08:52.495444 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2156/4378] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:51 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1309 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:52.502662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5b65c126-3c0b-46f9-a18c-27c9b07c6002 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:52.503984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5b65c126-3c0b-46f9-a18c-27c9b07c6002 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:52.518479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b65c126-3c0b-46f9-a18c-27c9b07c6002 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:52.529358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b65c126-3c0b-46f9-a18c-27c9b07c6002 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:52.531043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b65c126-3c0b-46f9-a18c-27c9b07c6002 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:52.531692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b65c126-3c0b-46f9-a18c-27c9b07c6002 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:52.650879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b0e1f283-b105-4747-876b-2e54c5c58bf7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:52.671116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b0e1f283-b105-4747-876b-2e54c5c58bf7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:52.676439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b0e1f283-b105-4747-876b-2e54c5c58bf7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:52.679003 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b0e1f283-b105-4747-876b-2e54c5c58bf7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.559403 Aug 02 07:08:52.682325 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2223/4379] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:52 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:08:52.697949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b86159ff-b330-4665-9a94-8823aed8fc80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:52.700625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b86159ff-b330-4665-9a94-8823aed8fc80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:52.723331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b86159ff-b330-4665-9a94-8823aed8fc80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:52.724046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b86159ff-b330-4665-9a94-8823aed8fc80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:52.725046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b86159ff-b330-4665-9a94-8823aed8fc80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:52.725793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b86159ff-b330-4665-9a94-8823aed8fc80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:52.810026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5b65c126-3c0b-46f9-a18c-27c9b07c6002 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:52.821692 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5b65c126-3c0b-46f9-a18c-27c9b07c6002 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1293 microversion: 2.1 time: 0.324692 Aug 02 07:08:52.822968 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2157/4380] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:52 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1293 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:53.002892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b86159ff-b330-4665-9a94-8823aed8fc80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:53.015378 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b86159ff-b330-4665-9a94-8823aed8fc80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 200 len: 1315 microversion: 2.1 time: 0.327052 Aug 02 07:08:53.016003 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2224/4381] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:52 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:53.507142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-319fc393-58b3-4912-90d8-05059c38debd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:53.508725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-319fc393-58b3-4912-90d8-05059c38debd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:53.519224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-319fc393-58b3-4912-90d8-05059c38debd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:53.519699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-319fc393-58b3-4912-90d8-05059c38debd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:53.520675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-319fc393-58b3-4912-90d8-05059c38debd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:53.521945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-319fc393-58b3-4912-90d8-05059c38debd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:53.705939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5dfcaabf-347f-4800-9e3b-ac78b1300149 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:53.707434 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5dfcaabf-347f-4800-9e3b-ac78b1300149 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:53.716186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dfcaabf-347f-4800-9e3b-ac78b1300149 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:53.716638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dfcaabf-347f-4800-9e3b-ac78b1300149 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:53.717534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dfcaabf-347f-4800-9e3b-ac78b1300149 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:53.717993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dfcaabf-347f-4800-9e3b-ac78b1300149 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:53.856289 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-319fc393-58b3-4912-90d8-05059c38debd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:53.872247 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-319fc393-58b3-4912-90d8-05059c38debd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1309 microversion: 2.1 time: 0.370465 Aug 02 07:08:53.872883 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2158/4382] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:53 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1309 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:53.887879 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b25f289f-2076-4b5c-9603-2721b00a58af tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:53.888500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b25f289f-2076-4b5c-9603-2721b00a58af tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:53.896260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b25f289f-2076-4b5c-9603-2721b00a58af tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:53.896959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b25f289f-2076-4b5c-9603-2721b00a58af tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:53.898134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b25f289f-2076-4b5c-9603-2721b00a58af tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:53.898984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b25f289f-2076-4b5c-9603-2721b00a58af tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:53.979580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5dfcaabf-347f-4800-9e3b-ac78b1300149 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:53.996627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b25f289f-2076-4b5c-9603-2721b00a58af tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:53.998331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5dfcaabf-347f-4800-9e3b-ac78b1300149 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:54.007560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5dfcaabf-347f-4800-9e3b-ac78b1300149 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:54.008806 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5dfcaabf-347f-4800-9e3b-ac78b1300149 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.307046 Aug 02 07:08:54.009093 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b25f289f-2076-4b5c-9603-2721b00a58af tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1299 microversion: 2.1 time: 0.131702 Aug 02 07:08:54.009382 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2225/4383] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:53 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:54.023825 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2159/4384] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:53 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1299 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:54.038830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6837f6d9-37a2-4b53-bd6b-accd99428129 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:54.041002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6837f6d9-37a2-4b53-bd6b-accd99428129 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:54.061305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6837f6d9-37a2-4b53-bd6b-accd99428129 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:54.061777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6837f6d9-37a2-4b53-bd6b-accd99428129 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:54.062628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6837f6d9-37a2-4b53-bd6b-accd99428129 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:54.063054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6837f6d9-37a2-4b53-bd6b-accd99428129 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:54.266417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6837f6d9-37a2-4b53-bd6b-accd99428129 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:54.285450 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6837f6d9-37a2-4b53-bd6b-accd99428129 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 200 len: 1315 microversion: 2.1 time: 0.252640 Aug 02 07:08:54.288553 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2226/4385] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:54 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:54.892993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-899a2382-3702-4588-8b01-3c905d66dd14 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:54.894272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-899a2382-3702-4588-8b01-3c905d66dd14 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:54.902757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-899a2382-3702-4588-8b01-3c905d66dd14 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:54.903336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-899a2382-3702-4588-8b01-3c905d66dd14 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:54.904235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-899a2382-3702-4588-8b01-3c905d66dd14 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:54.904670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-899a2382-3702-4588-8b01-3c905d66dd14 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:54.909712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:55.044976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-49b2bcb2-6462-4b66-90b4-d7e93e737c92 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:55.046218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-49b2bcb2-6462-4b66-90b4-d7e93e737c92 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:55.061361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49b2bcb2-6462-4b66-90b4-d7e93e737c92 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:55.063341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49b2bcb2-6462-4b66-90b4-d7e93e737c92 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:55.064496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49b2bcb2-6462-4b66-90b4-d7e93e737c92 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:55.065155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49b2bcb2-6462-4b66-90b4-d7e93e737c92 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:55.183191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-899a2382-3702-4588-8b01-3c905d66dd14 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:55.204469 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-899a2382-3702-4588-8b01-3c905d66dd14 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1309 microversion: 2.1 time: 0.313141 Aug 02 07:08:55.205146 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2160/4386] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:54 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1309 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:55.228887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b336b991-25a2-4670-8901-cacd33165cef tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:55.231361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b336b991-25a2-4670-8901-cacd33165cef tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:55.272951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b336b991-25a2-4670-8901-cacd33165cef tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:55.273430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b336b991-25a2-4670-8901-cacd33165cef tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:55.274282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b336b991-25a2-4670-8901-cacd33165cef tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:55.274723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b336b991-25a2-4670-8901-cacd33165cef tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:55.529763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-49b2bcb2-6462-4b66-90b4-d7e93e737c92 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:55.541755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-49b2bcb2-6462-4b66-90b4-d7e93e737c92 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:55.544383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-49b2bcb2-6462-4b66-90b4-d7e93e737c92 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:55.550221 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-49b2bcb2-6462-4b66-90b4-d7e93e737c92 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.518539 Aug 02 07:08:55.550951 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2227/4387] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:55 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:55.556595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aab1c89c-1e98-438e-9d5c-b93b4cbf5af2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:55.566649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aab1c89c-1e98-438e-9d5c-b93b4cbf5af2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:55.581256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aab1c89c-1e98-438e-9d5c-b93b4cbf5af2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:55.581708 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aab1c89c-1e98-438e-9d5c-b93b4cbf5af2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:55.582536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aab1c89c-1e98-438e-9d5c-b93b4cbf5af2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:55.585488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aab1c89c-1e98-438e-9d5c-b93b4cbf5af2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:55.677968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b336b991-25a2-4670-8901-cacd33165cef tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:55.695272 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b336b991-25a2-4670-8901-cacd33165cef tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1367 microversion: 2.1 time: 0.486373 Aug 02 07:08:55.709039 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2161/4388] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:55 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1367 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:55.834140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-aab1c89c-1e98-438e-9d5c-b93b4cbf5af2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:55.846602 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aab1c89c-1e98-438e-9d5c-b93b4cbf5af2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 200 len: 1315 microversion: 2.1 time: 0.294286 Aug 02 07:08:55.849638 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2228/4389] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:55 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:56.031799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e5705a11-1167-4c79-ba9f-90da8b743a05 req-b175f861-e1f0-4d48-9601-853417f59420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3bfd41-7a86-4a91-a51d-e6f38888fd9b", "name": "network-vif-plugged", "status": "completed", "tag": "3b96a15e-6e4a-44c3-84a8-40430d1e2f35"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:56.050907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e5705a11-1167-4c79-ba9f-90da8b743a05 req-b175f861-e1f0-4d48-9601-853417f59420 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:56.051354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e5705a11-1167-4c79-ba9f-90da8b743a05 req-b175f861-e1f0-4d48-9601-853417f59420 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:56.080372 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e5705a11-1167-4c79-ba9f-90da8b743a05 req-b175f861-e1f0-4d48-9601-853417f59420 service nova] Creating event network-vif-plugged:3b96a15e-6e4a-44c3-84a8-40430d1e2f35 for instance 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b on n-h2-851337-3 Aug 02 07:08:56.095904 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e5705a11-1167-4c79-ba9f-90da8b743a05 req-b175f861-e1f0-4d48-9601-853417f59420 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067908 Aug 02 07:08:56.096858 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2162/4390] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:56.227937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9f70f191-b6b8-47cb-922a-32c05d595a72 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:56.228911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9f70f191-b6b8-47cb-922a-32c05d595a72 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:56.237264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f70f191-b6b8-47cb-922a-32c05d595a72 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:56.238073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f70f191-b6b8-47cb-922a-32c05d595a72 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:56.239096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f70f191-b6b8-47cb-922a-32c05d595a72 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:56.239722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f70f191-b6b8-47cb-922a-32c05d595a72 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:56.401054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-eab5d447-26b0-4ea0-a92c-191aeb87847b req-c94050b1-5553-43d8-8535-b9f821b7ce02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f2010c-11ee-485b-b841-11e8b795aeb8", "tag": "d729d2b4-ee94-4a77-b294-583f29177fe3"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:56.441525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-eab5d447-26b0-4ea0-a92c-191aeb87847b req-c94050b1-5553-43d8-8535-b9f821b7ce02 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:56.442312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-eab5d447-26b0-4ea0-a92c-191aeb87847b req-c94050b1-5553-43d8-8535-b9f821b7ce02 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:56.476050 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-eab5d447-26b0-4ea0-a92c-191aeb87847b req-c94050b1-5553-43d8-8535-b9f821b7ce02 service nova] Creating event network-changed:d729d2b4-ee94-4a77-b294-583f29177fe3 for instance 65f2010c-11ee-485b-b841-11e8b795aeb8 on n-h1-851337-3 Aug 02 07:08:56.493920 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-eab5d447-26b0-4ea0-a92c-191aeb87847b req-c94050b1-5553-43d8-8535-b9f821b7ce02 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092932 Aug 02 07:08:56.494932 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2163/4391] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:08:56.577130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3701ae28-cd77-4817-a516-9d6cbb11a053 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:56.578569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3701ae28-cd77-4817-a516-9d6cbb11a053 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:56.598750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3701ae28-cd77-4817-a516-9d6cbb11a053 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:56.599675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3701ae28-cd77-4817-a516-9d6cbb11a053 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:56.600716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3701ae28-cd77-4817-a516-9d6cbb11a053 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:56.601316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3701ae28-cd77-4817-a516-9d6cbb11a053 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:56.626791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9f70f191-b6b8-47cb-922a-32c05d595a72 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:56.636384 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9f70f191-b6b8-47cb-922a-32c05d595a72 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1309 microversion: 2.1 time: 0.413723 Aug 02 07:08:56.637839 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2229/4392] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:56 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1309 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:56.715846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b156e2cd-7dc3-49f5-8575-2aa66e9dec51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:56.716460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b156e2cd-7dc3-49f5-8575-2aa66e9dec51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:56.728876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b156e2cd-7dc3-49f5-8575-2aa66e9dec51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:56.729332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b156e2cd-7dc3-49f5-8575-2aa66e9dec51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:56.730150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b156e2cd-7dc3-49f5-8575-2aa66e9dec51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:56.730968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b156e2cd-7dc3-49f5-8575-2aa66e9dec51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:57.049035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3701ae28-cd77-4817-a516-9d6cbb11a053 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:57.070638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3701ae28-cd77-4817-a516-9d6cbb11a053 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:57.075098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3701ae28-cd77-4817-a516-9d6cbb11a053 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:57.079911 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3701ae28-cd77-4817-a516-9d6cbb11a053 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.507094 Aug 02 07:08:57.081407 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2164/4393] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:56 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:57.098776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1bdbbf33-237e-4ffd-b85f-7534aed8e552 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:57.099392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1bdbbf33-237e-4ffd-b85f-7534aed8e552 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:57.107087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1bdbbf33-237e-4ffd-b85f-7534aed8e552 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:57.107553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1bdbbf33-237e-4ffd-b85f-7534aed8e552 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:57.108377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1bdbbf33-237e-4ffd-b85f-7534aed8e552 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:57.116048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1bdbbf33-237e-4ffd-b85f-7534aed8e552 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:57.170409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b156e2cd-7dc3-49f5-8575-2aa66e9dec51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:57.181931 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b156e2cd-7dc3-49f5-8575-2aa66e9dec51 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1367 microversion: 2.1 time: 0.469542 Aug 02 07:08:57.183195 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2230/4394] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:56 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:08:57.448252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1bdbbf33-237e-4ffd-b85f-7534aed8e552 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:57.465667 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1bdbbf33-237e-4ffd-b85f-7534aed8e552 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 200 len: 1315 microversion: 2.1 time: 0.370132 Aug 02 07:08:57.483233 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2165/4395] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:57 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:57.666010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6ad309ae-212b-4b17-b914-9cf7340d78c4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:57.669995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6ad309ae-212b-4b17-b914-9cf7340d78c4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:57.734341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ad309ae-212b-4b17-b914-9cf7340d78c4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:57.735142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ad309ae-212b-4b17-b914-9cf7340d78c4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:57.736027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ad309ae-212b-4b17-b914-9cf7340d78c4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:57.736495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ad309ae-212b-4b17-b914-9cf7340d78c4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:57.798621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:08:58.038927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6ad309ae-212b-4b17-b914-9cf7340d78c4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:58.049168 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6ad309ae-212b-4b17-b914-9cf7340d78c4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1309 microversion: 2.1 time: 0.391013 Aug 02 07:08:58.051848 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2231/4396] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:57 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1309 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:58.109489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-909b1807-308a-480c-98f2-de11246c12ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:58.110332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-909b1807-308a-480c-98f2-de11246c12ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:58.122729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-909b1807-308a-480c-98f2-de11246c12ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:58.123513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-909b1807-308a-480c-98f2-de11246c12ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:58.124759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-909b1807-308a-480c-98f2-de11246c12ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:58.125564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-909b1807-308a-480c-98f2-de11246c12ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:58.201868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-71098c80-3a4f-4ec0-aecd-189173b30907 req-96a6e612-0c01-4dc0-bfd4-13d08723f23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9ae016-6a95-4257-8d74-99fcd50ae1cb", "name": "network-vif-plugged", "status": "completed", "tag": "3ee7c406-2514-4927-ba77-18750ac8d2ab"}, {"server_uuid": "b615a925-443e-4046-83d5-fceafea57257", "name": "network-vif-plugged", "status": "completed", "tag": "d0bef38a-2d40-4520-a39c-0f9bfb2f9b50"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:58.227647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-71098c80-3a4f-4ec0-aecd-189173b30907 req-96a6e612-0c01-4dc0-bfd4-13d08723f23b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:58.230797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-71098c80-3a4f-4ec0-aecd-189173b30907 req-96a6e612-0c01-4dc0-bfd4-13d08723f23b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:58.261234 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-71098c80-3a4f-4ec0-aecd-189173b30907 req-96a6e612-0c01-4dc0-bfd4-13d08723f23b service nova] Creating event network-vif-plugged:3ee7c406-2514-4927-ba77-18750ac8d2ab for instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb on n-h1-851337-3 Aug 02 07:08:58.266852 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-71098c80-3a4f-4ec0-aecd-189173b30907 req-96a6e612-0c01-4dc0-bfd4-13d08723f23b service nova] Creating event network-vif-plugged:d0bef38a-2d40-4520-a39c-0f9bfb2f9b50 for instance b615a925-443e-4046-83d5-fceafea57257 on n-h2-851337-3 Aug 02 07:08:58.279633 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-71098c80-3a4f-4ec0-aecd-189173b30907 req-96a6e612-0c01-4dc0-bfd4-13d08723f23b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081358 Aug 02 07:08:58.280976 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2232/4397] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:08:58.288867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-774bb353-00c2-46fe-8405-3ef045e46fed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:58.290096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-774bb353-00c2-46fe-8405-3ef045e46fed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:58.298153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-774bb353-00c2-46fe-8405-3ef045e46fed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:58.299493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-774bb353-00c2-46fe-8405-3ef045e46fed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:58.300893 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-774bb353-00c2-46fe-8405-3ef045e46fed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:58.302079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-774bb353-00c2-46fe-8405-3ef045e46fed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:58.622719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-909b1807-308a-480c-98f2-de11246c12ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:58.633956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-909b1807-308a-480c-98f2-de11246c12ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:58.636258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-909b1807-308a-480c-98f2-de11246c12ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:58.640563 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-909b1807-308a-480c-98f2-de11246c12ea tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.534316 Aug 02 07:08:58.641925 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2166/4398] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:58 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:08:58.647653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-999c7be2-d01f-497b-9eeb-02395b3903c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:58.648544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-999c7be2-d01f-497b-9eeb-02395b3903c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:58.655504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-999c7be2-d01f-497b-9eeb-02395b3903c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:58.656267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-999c7be2-d01f-497b-9eeb-02395b3903c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:58.657219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-999c7be2-d01f-497b-9eeb-02395b3903c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:58.658212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-999c7be2-d01f-497b-9eeb-02395b3903c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:58.789368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-774bb353-00c2-46fe-8405-3ef045e46fed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:58.829659 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-774bb353-00c2-46fe-8405-3ef045e46fed tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1367 microversion: 2.1 time: 0.546823 Aug 02 07:08:58.840334 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2233/4399] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:58 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1367 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:58.918696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-999c7be2-d01f-497b-9eeb-02395b3903c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:58.929302 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-999c7be2-d01f-497b-9eeb-02395b3903c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 200 len: 1502 microversion: 2.1 time: 0.286135 Aug 02 07:08:58.937694 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2167/4400] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:58 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 1502 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:58.962391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-685476c5-aec3-4a9c-9726-47f396ee014a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:08:58.965624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-685476c5-aec3-4a9c-9726-47f396ee014a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:58.981019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-685476c5-aec3-4a9c-9726-47f396ee014a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:58.981465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-685476c5-aec3-4a9c-9726-47f396ee014a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:58.985750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-685476c5-aec3-4a9c-9726-47f396ee014a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:58.987433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-685476c5-aec3-4a9c-9726-47f396ee014a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:59.061446 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-685476c5-aec3-4a9c-9726-47f396ee014a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action" status: 200 len: 14 microversion: 2.1 time: 0.102968 Aug 02 07:08:59.062536 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2234/4401] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:08:58 2022] POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:08:59.074967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8d1e0a1a-5e7d-418e-a263-ddac41d81df1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:59.076075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8d1e0a1a-5e7d-418e-a263-ddac41d81df1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:59.088754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d1e0a1a-5e7d-418e-a263-ddac41d81df1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:59.089523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d1e0a1a-5e7d-418e-a263-ddac41d81df1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:59.092865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d1e0a1a-5e7d-418e-a263-ddac41d81df1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:59.093700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d1e0a1a-5e7d-418e-a263-ddac41d81df1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:59.417305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8d1e0a1a-5e7d-418e-a263-ddac41d81df1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:08:59.431565 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8d1e0a1a-5e7d-418e-a263-ddac41d81df1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1309 microversion: 2.1 time: 0.362576 Aug 02 07:08:59.432213 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2168/4402] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:59 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1309 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:08:59.673797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5467a2cb-2c9a-4be4-8df0-ab0ec03cf8e9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:59.674858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5467a2cb-2c9a-4be4-8df0-ab0ec03cf8e9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:59.698805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5467a2cb-2c9a-4be4-8df0-ab0ec03cf8e9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:59.699290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5467a2cb-2c9a-4be4-8df0-ab0ec03cf8e9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:59.700088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5467a2cb-2c9a-4be4-8df0-ab0ec03cf8e9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:59.700544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5467a2cb-2c9a-4be4-8df0-ab0ec03cf8e9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:59.860064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-89d501a8-8385-4899-9cb5-2aab274ddef1 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:08:59.860927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-89d501a8-8385-4899-9cb5-2aab274ddef1 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:08:59.868893 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89d501a8-8385-4899-9cb5-2aab274ddef1 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:59.869628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89d501a8-8385-4899-9cb5-2aab274ddef1 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:08:59.870624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89d501a8-8385-4899-9cb5-2aab274ddef1 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:08:59.871336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89d501a8-8385-4899-9cb5-2aab274ddef1 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:00.129990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5467a2cb-2c9a-4be4-8df0-ab0ec03cf8e9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:00.141306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5467a2cb-2c9a-4be4-8df0-ab0ec03cf8e9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:00.156338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5467a2cb-2c9a-4be4-8df0-ab0ec03cf8e9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:00.157735 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5467a2cb-2c9a-4be4-8df0-ab0ec03cf8e9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.490926 Aug 02 07:09:00.158459 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2235/4403] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:08:59 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:09:00.163585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-969ec30d-23c7-4efc-a5bf-43dc815b3bfc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:00.166498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-969ec30d-23c7-4efc-a5bf-43dc815b3bfc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:00.173484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-969ec30d-23c7-4efc-a5bf-43dc815b3bfc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:00.174420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-969ec30d-23c7-4efc-a5bf-43dc815b3bfc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:00.175440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-969ec30d-23c7-4efc-a5bf-43dc815b3bfc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:00.176077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-969ec30d-23c7-4efc-a5bf-43dc815b3bfc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:00.227190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-89d501a8-8385-4899-9cb5-2aab274ddef1 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:00.228173 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-969ec30d-23c7-4efc-a5bf-43dc815b3bfc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action" status: 200 len: 14 microversion: 2.1 time: 0.066948 Aug 02 07:09:00.229282 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2236/4404] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:00 2022] POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:09:00.238799 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-89d501a8-8385-4899-9cb5-2aab274ddef1 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1367 microversion: 2.1 time: 0.382593 Aug 02 07:09:00.240536 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2169/4405] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:08:59 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:00.456195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0ec8e571-ad28-414d-bc75-42bbedaa8a6d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:00.456906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0ec8e571-ad28-414d-bc75-42bbedaa8a6d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:00.479654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ec8e571-ad28-414d-bc75-42bbedaa8a6d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:00.481422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ec8e571-ad28-414d-bc75-42bbedaa8a6d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:00.496385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ec8e571-ad28-414d-bc75-42bbedaa8a6d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:00.501436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ec8e571-ad28-414d-bc75-42bbedaa8a6d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:00.821018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fc9e1ead-2a75-4920-b0da-4fa8ac729217 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:00.823426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fc9e1ead-2a75-4920-b0da-4fa8ac729217 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:00.850999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc9e1ead-2a75-4920-b0da-4fa8ac729217 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:00.851922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc9e1ead-2a75-4920-b0da-4fa8ac729217 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:00.853249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc9e1ead-2a75-4920-b0da-4fa8ac729217 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:00.853930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc9e1ead-2a75-4920-b0da-4fa8ac729217 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:00.877695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:00.911192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=16 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:00.924276 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fc9e1ead-2a75-4920-b0da-4fa8ac729217 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331/action" status: 200 len: 24577 microversion: 2.1 time: 0.107389 Aug 02 07:09:00.925077 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2170/4406] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:00 2022] POST /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331/action => generated 24577 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:09:00.968750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0ec8e571-ad28-414d-bc75-42bbedaa8a6d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:00.980724 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0ec8e571-ad28-414d-bc75-42bbedaa8a6d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1490 microversion: 2.1 time: 0.528704 Aug 02 07:09:01.002643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-912c07d5-53f9-483b-9d61-2d20d19ea05b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:01.003717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-912c07d5-53f9-483b-9d61-2d20d19ea05b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:01.011554 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2237/4407] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:00 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1490 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:01.016095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-912c07d5-53f9-483b-9d61-2d20d19ea05b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:01.016548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-912c07d5-53f9-483b-9d61-2d20d19ea05b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:01.017525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-912c07d5-53f9-483b-9d61-2d20d19ea05b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:01.017750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-912c07d5-53f9-483b-9d61-2d20d19ea05b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:01.184080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3cebfe01-613f-45c8-adf1-66b3a1f8a78e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:01.184687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3cebfe01-613f-45c8-adf1-66b3a1f8a78e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:01.194245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cebfe01-613f-45c8-adf1-66b3a1f8a78e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:01.194701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cebfe01-613f-45c8-adf1-66b3a1f8a78e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:01.195498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cebfe01-613f-45c8-adf1-66b3a1f8a78e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:01.195934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cebfe01-613f-45c8-adf1-66b3a1f8a78e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:01.304235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-912c07d5-53f9-483b-9d61-2d20d19ea05b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:01.315579 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-912c07d5-53f9-483b-9d61-2d20d19ea05b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 200 len: 1489 microversion: 2.1 time: 0.317193 Aug 02 07:09:01.317352 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2171/4408] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:00 2022] GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 1489 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:01.324558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-989ee02d-d86d-4de9-8b26-83f5669264cf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:01.328396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-989ee02d-d86d-4de9-8b26-83f5669264cf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:01.357777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-989ee02d-d86d-4de9-8b26-83f5669264cf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:01.358330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-989ee02d-d86d-4de9-8b26-83f5669264cf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:01.359178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-989ee02d-d86d-4de9-8b26-83f5669264cf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:01.359622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-989ee02d-d86d-4de9-8b26-83f5669264cf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:01.360243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:01.442123 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-989ee02d-d86d-4de9-8b26-83f5669264cf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action" status: 200 len: 14 microversion: 2.1 time: 0.123002 Aug 02 07:09:01.443017 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2172/4409] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:01 2022] POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:09:01.449868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d2526f34-1e9c-48dc-95b2-4b621526ee32 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:01.450607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d2526f34-1e9c-48dc-95b2-4b621526ee32 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:01.467228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2526f34-1e9c-48dc-95b2-4b621526ee32 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:01.467685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2526f34-1e9c-48dc-95b2-4b621526ee32 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:01.473288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2526f34-1e9c-48dc-95b2-4b621526ee32 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:01.473999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2526f34-1e9c-48dc-95b2-4b621526ee32 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:01.487439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3cebfe01-613f-45c8-adf1-66b3a1f8a78e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:01.499797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3cebfe01-613f-45c8-adf1-66b3a1f8a78e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:01.504567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3cebfe01-613f-45c8-adf1-66b3a1f8a78e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:01.510737 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3cebfe01-613f-45c8-adf1-66b3a1f8a78e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.332388 Aug 02 07:09:01.515461 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2238/4410] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:09:01 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:09:01.522182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a836d170-27dd-41cb-b16c-0b184f4109b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:01.539138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a836d170-27dd-41cb-b16c-0b184f4109b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:01.553546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a836d170-27dd-41cb-b16c-0b184f4109b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:01.559970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a836d170-27dd-41cb-b16c-0b184f4109b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:01.561733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a836d170-27dd-41cb-b16c-0b184f4109b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:01.562411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a836d170-27dd-41cb-b16c-0b184f4109b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:01.829596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d2526f34-1e9c-48dc-95b2-4b621526ee32 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:01.854453 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d2526f34-1e9c-48dc-95b2-4b621526ee32 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1367 microversion: 2.1 time: 0.410008 Aug 02 07:09:01.869920 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2173/4411] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:01 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:02.075316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a836d170-27dd-41cb-b16c-0b184f4109b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:02.084134 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a836d170-27dd-41cb-b16c-0b184f4109b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1490 microversion: 2.1 time: 0.567294 Aug 02 07:09:02.091446 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2239/4412] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:01 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1490 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:02.118502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-472b465b-6ecf-4336-a208-674380946df5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:02.119016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-472b465b-6ecf-4336-a208-674380946df5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:02.145280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-472b465b-6ecf-4336-a208-674380946df5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:02.146999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-472b465b-6ecf-4336-a208-674380946df5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:02.147834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-472b465b-6ecf-4336-a208-674380946df5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:02.148275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-472b465b-6ecf-4336-a208-674380946df5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:02.221303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-472b465b-6ecf-4336-a208-674380946df5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:09:02.453390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-369c293d-1eec-47ae-9879-926aa1e30eab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:02.457356 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-472b465b-6ecf-4336-a208-674380946df5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 204 len: 0 microversion: 2.1 time: 0.351270 Aug 02 07:09:02.458256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-369c293d-1eec-47ae-9879-926aa1e30eab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:02.467369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-369c293d-1eec-47ae-9879-926aa1e30eab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:02.468298 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2174/4413] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:09:02 2022] DELETE /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:09:02.487146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-369c293d-1eec-47ae-9879-926aa1e30eab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:02.489024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-369c293d-1eec-47ae-9879-926aa1e30eab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:02.489501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-369c293d-1eec-47ae-9879-926aa1e30eab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:02.495442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1c822ccd-e4ba-44f5-b52c-20388b5ad57d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:02.496567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1c822ccd-e4ba-44f5-b52c-20388b5ad57d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:02.507420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:02.509269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c822ccd-e4ba-44f5-b52c-20388b5ad57d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:02.510256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c822ccd-e4ba-44f5-b52c-20388b5ad57d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:02.511222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c822ccd-e4ba-44f5-b52c-20388b5ad57d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:02.512005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c822ccd-e4ba-44f5-b52c-20388b5ad57d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:02.818036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1c822ccd-e4ba-44f5-b52c-20388b5ad57d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:02.827918 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1c822ccd-e4ba-44f5-b52c-20388b5ad57d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1496 microversion: 2.1 time: 0.350041 Aug 02 07:09:02.830234 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2175/4414] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:02 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1496 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:02.835816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ffd46e2d-c143-449b-8bea-5ef424182393 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:02.839274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ffd46e2d-c143-449b-8bea-5ef424182393 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:02.858737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ffd46e2d-c143-449b-8bea-5ef424182393 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:02.859366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ffd46e2d-c143-449b-8bea-5ef424182393 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:02.860302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ffd46e2d-c143-449b-8bea-5ef424182393 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:02.866954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ffd46e2d-c143-449b-8bea-5ef424182393 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:03.566577 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-369c293d-1eec-47ae-9879-926aa1e30eab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action" status: 200 len: 14 microversion: 2.1 time: 1.116776 Aug 02 07:09:03.570881 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2240/4415] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:02 2022] POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action => generated 14 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 07:09:03.577601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc265544-be35-4585-98f4-22002ce31b7f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:03.580232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bc265544-be35-4585-98f4-22002ce31b7f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:03.610943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc265544-be35-4585-98f4-22002ce31b7f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:03.611410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc265544-be35-4585-98f4-22002ce31b7f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:03.612300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc265544-be35-4585-98f4-22002ce31b7f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:03.621661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ffd46e2d-c143-449b-8bea-5ef424182393 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:03.630576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc265544-be35-4585-98f4-22002ce31b7f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:03.638597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ffd46e2d-c143-449b-8bea-5ef424182393 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:03.663556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ffd46e2d-c143-449b-8bea-5ef424182393 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:03.664894 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ffd46e2d-c143-449b-8bea-5ef424182393 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1807 microversion: 2.20 time: 0.832843 Aug 02 07:09:03.665386 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2176/4416] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:09:02 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1807 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:09:03.851721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9f205268-d15e-419a-815b-e5dda409b1aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:03.861961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9f205268-d15e-419a-815b-e5dda409b1aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:03.877381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f205268-d15e-419a-815b-e5dda409b1aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:03.877837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f205268-d15e-419a-815b-e5dda409b1aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:03.879038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f205268-d15e-419a-815b-e5dda409b1aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:03.879477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f205268-d15e-419a-815b-e5dda409b1aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:03.886957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:04.601228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9f205268-d15e-419a-815b-e5dda409b1aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:04.620066 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9f205268-d15e-419a-815b-e5dda409b1aa tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1496 microversion: 2.1 time: 0.768647 Aug 02 07:09:04.625238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bc265544-be35-4585-98f4-22002ce31b7f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:04.639787 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc265544-be35-4585-98f4-22002ce31b7f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1367 microversion: 2.1 time: 1.067444 Aug 02 07:09:04.640001 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2177/4417] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:03 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1496 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:04.640464 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2241/4418] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:03 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1367 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:04.652892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-adb445c6-8783-4314-9b85-a104fcb2a9a1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:04.666328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-adb445c6-8783-4314-9b85-a104fcb2a9a1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:04.682336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-adb445c6-8783-4314-9b85-a104fcb2a9a1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:04.685964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-adb445c6-8783-4314-9b85-a104fcb2a9a1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:04.688815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8eac1266-c62f-48b5-801c-ff03abe52088 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:04.689248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8eac1266-c62f-48b5-801c-ff03abe52088 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:04.692200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-adb445c6-8783-4314-9b85-a104fcb2a9a1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:04.693143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-adb445c6-8783-4314-9b85-a104fcb2a9a1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:04.699085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8eac1266-c62f-48b5-801c-ff03abe52088 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:04.702578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8eac1266-c62f-48b5-801c-ff03abe52088 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:04.703795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8eac1266-c62f-48b5-801c-ff03abe52088 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:04.707885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8eac1266-c62f-48b5-801c-ff03abe52088 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:04.817704 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-adb445c6-8783-4314-9b85-a104fcb2a9a1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action" status: 200 len: 14 microversion: 2.1 time: 0.176430 Aug 02 07:09:04.818423 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2178/4419] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:04 2022] POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:09:05.532280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8eac1266-c62f-48b5-801c-ff03abe52088 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:05.561501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8eac1266-c62f-48b5-801c-ff03abe52088 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:05.568938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8eac1266-c62f-48b5-801c-ff03abe52088 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:05.591570 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8eac1266-c62f-48b5-801c-ff03abe52088 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1794 microversion: 2.20 time: 0.895443 Aug 02 07:09:05.594769 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2242/4420] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:09:04 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1794 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:09:05.646977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-755dfa53-3a69-41b0-b034-3531c84e5fa5 req-b6676391-bedb-4e45-b413-1bc05528f221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b615a925-443e-4046-83d5-fceafea57257", "name": "network-vif-deleted", "tag": "d0bef38a-2d40-4520-a39c-0f9bfb2f9b50"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:05.647759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7ce7a549-a762-4ebe-a47a-98335d794156 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:05.648142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7ce7a549-a762-4ebe-a47a-98335d794156 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:05.659722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ce7a549-a762-4ebe-a47a-98335d794156 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:05.659722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ce7a549-a762-4ebe-a47a-98335d794156 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:05.660399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ce7a549-a762-4ebe-a47a-98335d794156 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:05.660833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ce7a549-a762-4ebe-a47a-98335d794156 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:05.674476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-755dfa53-3a69-41b0-b034-3531c84e5fa5 req-b6676391-bedb-4e45-b413-1bc05528f221 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:05.677417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-755dfa53-3a69-41b0-b034-3531c84e5fa5 req-b6676391-bedb-4e45-b413-1bc05528f221 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:05.738401 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-755dfa53-3a69-41b0-b034-3531c84e5fa5 req-b6676391-bedb-4e45-b413-1bc05528f221 service nova] Creating event network-vif-deleted:d0bef38a-2d40-4520-a39c-0f9bfb2f9b50 for instance b615a925-443e-4046-83d5-fceafea57257 on n-h2-851337-3 Aug 02 07:09:05.764750 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-755dfa53-3a69-41b0-b034-3531c84e5fa5 req-b6676391-bedb-4e45-b413-1bc05528f221 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121618 Aug 02 07:09:05.768147 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2243/4421] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:05.799899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-64d946af-0dbd-4fbb-961c-71b36a6cd3be tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:05.804138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-64d946af-0dbd-4fbb-961c-71b36a6cd3be tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:05.822725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64d946af-0dbd-4fbb-961c-71b36a6cd3be tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:05.823587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64d946af-0dbd-4fbb-961c-71b36a6cd3be tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:05.826655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64d946af-0dbd-4fbb-961c-71b36a6cd3be tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:05.827372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64d946af-0dbd-4fbb-961c-71b36a6cd3be tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:05.965998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7ce7a549-a762-4ebe-a47a-98335d794156 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:05.982987 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7ce7a549-a762-4ebe-a47a-98335d794156 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 200 len: 1454 microversion: 2.1 time: 0.338751 Aug 02 07:09:05.997981 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2179/4422] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:05 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 1454 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:06.008897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-da10adcd-61fd-4190-9484-ca45bf32399b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:06.015466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-da10adcd-61fd-4190-9484-ca45bf32399b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:06.051170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da10adcd-61fd-4190-9484-ca45bf32399b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:06.053755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da10adcd-61fd-4190-9484-ca45bf32399b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:06.054639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da10adcd-61fd-4190-9484-ca45bf32399b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:06.055091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da10adcd-61fd-4190-9484-ca45bf32399b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:06.288994 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-da10adcd-61fd-4190-9484-ca45bf32399b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action" status: 200 len: 14 microversion: 2.1 time: 0.297583 Aug 02 07:09:06.290212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-64d946af-0dbd-4fbb-961c-71b36a6cd3be tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:06.293269 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2180/4423] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:05 2022] POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action => generated 14 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:09:06.330477 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-64d946af-0dbd-4fbb-961c-71b36a6cd3be tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1367 microversion: 2.1 time: 0.560576 Aug 02 07:09:06.346361 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2244/4424] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:05 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1367 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:07.021372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7796eb77-a017-4090-93f2-852f6d8f5a08 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:07.022690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7796eb77-a017-4090-93f2-852f6d8f5a08 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:07.039806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7796eb77-a017-4090-93f2-852f6d8f5a08 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:07.044401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7796eb77-a017-4090-93f2-852f6d8f5a08 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:07.045635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7796eb77-a017-4090-93f2-852f6d8f5a08 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:07.050147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7796eb77-a017-4090-93f2-852f6d8f5a08 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:07.090535 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-7796eb77-a017-4090-93f2-852f6d8f5a08 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7796eb77-a017-4090-93f2-852f6d8f5a08 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 HTTP/1.1 Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'b615a925-443e-4046-83d5-fceafea57257'} Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:09:07.097305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:07.109547 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:07.109547 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:09:07.109547 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:09:07.109547 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:09:07.109547 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:09:07.109547 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:09:07.109547 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:07.109547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7796eb77-a017-4090-93f2-852f6d8f5a08 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:09:07.109547 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7796eb77-a017-4090-93f2-852f6d8f5a08 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 404 len: 111 microversion: 2.1 time: 0.085689 Aug 02 07:09:07.111593 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2181/4425] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:07 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:09:07.112906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-793f56af-2e11-43c4-ac16-5c7b0fb12658 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:07.114578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-793f56af-2e11-43c4-ac16-5c7b0fb12658 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:07.181664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-793f56af-2e11-43c4-ac16-5c7b0fb12658 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:07.189471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-793f56af-2e11-43c4-ac16-5c7b0fb12658 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:07.194696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-793f56af-2e11-43c4-ac16-5c7b0fb12658 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:07.195597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-793f56af-2e11-43c4-ac16-5c7b0fb12658 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:07.274456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-856c5ace-4e8a-424c-90de-4c7975c66eba tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:07.275368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-856c5ace-4e8a-424c-90de-4c7975c66eba tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:07.286904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-856c5ace-4e8a-424c-90de-4c7975c66eba tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:07.287755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-856c5ace-4e8a-424c-90de-4c7975c66eba tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:07.295679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-856c5ace-4e8a-424c-90de-4c7975c66eba tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:07.296387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-856c5ace-4e8a-424c-90de-4c7975c66eba tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:07.297592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-793f56af-2e11-43c4-ac16-5c7b0fb12658 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:09:07.525325 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-793f56af-2e11-43c4-ac16-5c7b0fb12658 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 204 len: 0 microversion: 2.1 time: 0.420732 Aug 02 07:09:07.529142 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2245/4426] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:09:07 2022] DELETE /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:09:07.537330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-24a45bc5-2b9b-45b5-a824-60740081b996 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:07.566372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-24a45bc5-2b9b-45b5-a824-60740081b996 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:07.573031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24a45bc5-2b9b-45b5-a824-60740081b996 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:07.573486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24a45bc5-2b9b-45b5-a824-60740081b996 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:07.574468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24a45bc5-2b9b-45b5-a824-60740081b996 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:07.574902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24a45bc5-2b9b-45b5-a824-60740081b996 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:07.817595 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-856c5ace-4e8a-424c-90de-4c7975c66eba tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1834 microversion: 2.1 time: 0.546942 Aug 02 07:09:07.820437 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2182/4427] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:07 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1834 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:07.830747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-88c0a187-8cdb-48bf-a161-e1f522e3212a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:07.836237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-88c0a187-8cdb-48bf-a161-e1f522e3212a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:07.857762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88c0a187-8cdb-48bf-a161-e1f522e3212a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:07.862925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88c0a187-8cdb-48bf-a161-e1f522e3212a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:07.863871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88c0a187-8cdb-48bf-a161-e1f522e3212a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:07.864335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88c0a187-8cdb-48bf-a161-e1f522e3212a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:08.293235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-88c0a187-8cdb-48bf-a161-e1f522e3212a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:08.309180 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-88c0a187-8cdb-48bf-a161-e1f522e3212a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1367 microversion: 2.1 time: 0.483007 Aug 02 07:09:08.314247 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2183/4428] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:07 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1367 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:08.323180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-944c362e-857e-4da2-bf14-283e453f6884 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:08.323805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-944c362e-857e-4da2-bf14-283e453f6884 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:08.354577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-944c362e-857e-4da2-bf14-283e453f6884 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:08.355078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-944c362e-857e-4da2-bf14-283e453f6884 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:08.356018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-944c362e-857e-4da2-bf14-283e453f6884 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:08.356448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-944c362e-857e-4da2-bf14-283e453f6884 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:08.690032 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-24a45bc5-2b9b-45b5-a824-60740081b996 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action" status: 200 len: 14 microversion: 2.1 time: 1.161052 Aug 02 07:09:08.693644 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2246/4429] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:07 2022] POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action => generated 14 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:09:08.829699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-944c362e-857e-4da2-bf14-283e453f6884 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:08.839688 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-944c362e-857e-4da2-bf14-283e453f6884 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 200 len: 1495 microversion: 2.1 time: 0.524014 Aug 02 07:09:08.841791 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2184/4430] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:08 2022] GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 1495 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:08.963505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-720a3225-a723-47dd-ab7d-f3280f0149e6 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] Action: 'create', calling method: .version_select at 0x7f927a8368b0>, body: {"pool": null} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:09.022596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-414236014", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "0c6b1f64-899d-4e1f-bc89-61a10c8bc1e2"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:09.150405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] validate_networks() for [('0c6b1f64-899d-4e1f-bc89-61a10c8bc1e2', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:09:11.518477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:09:11.518477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:09:11.518477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:09:11.519288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:09:11.519288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:09:11.532115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:11.532787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:11.533760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:11.534394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:11.563429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Getting quotas for project 4a324b72e01a4bbfb25e822709ba2ddc. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:09:11.574844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Getting quotas for user af2e27618e26434e9f320ba83533cfa2 and project 4a324b72e01a4bbfb25e822709ba2ddc. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:09:11.594431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:09:11.601164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:09:11.664625 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-16e3b974-04ea-4c60-9a72-929c84bc929f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.795463 Aug 02 07:09:11.665346 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2185/4431] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:09:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:09:11.694482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-0d8d8bca-5ef8-4406-9151-197c81841f70 req-fe343cf7-8131-4821-bdb9-06c2f9cfa47d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65f2010c-11ee-485b-b841-11e8b795aeb8", "name": "network-vif-plugged", "status": "completed", "tag": "d729d2b4-ee94-4a77-b294-583f29177fe3"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:11.728320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0d8d8bca-5ef8-4406-9151-197c81841f70 req-fe343cf7-8131-4821-bdb9-06c2f9cfa47d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:11.728765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0d8d8bca-5ef8-4406-9151-197c81841f70 req-fe343cf7-8131-4821-bdb9-06c2f9cfa47d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:11.757140 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-0d8d8bca-5ef8-4406-9151-197c81841f70 req-fe343cf7-8131-4821-bdb9-06c2f9cfa47d service nova] Creating event network-vif-plugged:d729d2b4-ee94-4a77-b294-583f29177fe3 for instance 65f2010c-11ee-485b-b841-11e8b795aeb8 on n-h1-851337-3 Aug 02 07:09:11.763744 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-0d8d8bca-5ef8-4406-9151-197c81841f70 req-fe343cf7-8131-4821-bdb9-06c2f9cfa47d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097130 Aug 02 07:09:11.764357 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2186/4432] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:11.769748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-26d07afe-8f89-4d21-8b09-eb9563c25269 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:11.770461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-26d07afe-8f89-4d21-8b09-eb9563c25269 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:11.780502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26d07afe-8f89-4d21-8b09-eb9563c25269 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:11.781517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26d07afe-8f89-4d21-8b09-eb9563c25269 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:11.782563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26d07afe-8f89-4d21-8b09-eb9563c25269 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:11.783473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26d07afe-8f89-4d21-8b09-eb9563c25269 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:12.324097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-26d07afe-8f89-4d21-8b09-eb9563c25269 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:12.352849 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-26d07afe-8f89-4d21-8b09-eb9563c25269 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1367 microversion: 2.1 time: 0.582291 Aug 02 07:09:12.353983 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2187/4433] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:11 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1367 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:12.371500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-219b99bb-31e3-4183-9ef5-5acd3adbd9e0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:12.398607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-219b99bb-31e3-4183-9ef5-5acd3adbd9e0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:12.425429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-219b99bb-31e3-4183-9ef5-5acd3adbd9e0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:12.426105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-219b99bb-31e3-4183-9ef5-5acd3adbd9e0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:12.427019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-219b99bb-31e3-4183-9ef5-5acd3adbd9e0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:12.431338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-219b99bb-31e3-4183-9ef5-5acd3adbd9e0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:12.610764 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-219b99bb-31e3-4183-9ef5-5acd3adbd9e0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action" status: 200 len: 16400 microversion: 2.1 time: 0.254030 Aug 02 07:09:12.612478 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2188/4434] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:12 2022] POST /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b/action => generated 16400 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:09:12.625026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e27632be-7ac6-4c78-8779-a8f21a9ef4dd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:12.628221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e27632be-7ac6-4c78-8779-a8f21a9ef4dd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:12.651596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e27632be-7ac6-4c78-8779-a8f21a9ef4dd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:12.652051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e27632be-7ac6-4c78-8779-a8f21a9ef4dd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:12.653532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e27632be-7ac6-4c78-8779-a8f21a9ef4dd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:12.654037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e27632be-7ac6-4c78-8779-a8f21a9ef4dd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:12.803923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e27632be-7ac6-4c78-8779-a8f21a9ef4dd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:12.805384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e27632be-7ac6-4c78-8779-a8f21a9ef4dd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:12.806341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-e27632be-7ac6-4c78-8779-a8f21a9ef4dd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lazy-loading 'fault' on Instance uuid 27439ee3-686a-4cd3-8430-f409fdaf175b {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:09:13.040572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e27632be-7ac6-4c78-8779-a8f21a9ef4dd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:13.052116 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e27632be-7ac6-4c78-8779-a8f21a9ef4dd tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 200 len: 1299 microversion: 2.1 time: 0.437555 Aug 02 07:09:13.054347 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2189/4435] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:12 2022] GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 1299 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:13.073729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7b8726eb-b7e7-4ec6-b8c3-9aeea1580666 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:13.074652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7b8726eb-b7e7-4ec6-b8c3-9aeea1580666 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:13.087930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b8726eb-b7e7-4ec6-b8c3-9aeea1580666 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:13.088643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b8726eb-b7e7-4ec6-b8c3-9aeea1580666 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:13.091160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b8726eb-b7e7-4ec6-b8c3-9aeea1580666 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:13.092597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b8726eb-b7e7-4ec6-b8c3-9aeea1580666 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:13.287820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7b8726eb-b7e7-4ec6-b8c3-9aeea1580666 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:13.297639 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7b8726eb-b7e7-4ec6-b8c3-9aeea1580666 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1221 microversion: 2.1 time: 0.241311 Aug 02 07:09:13.313931 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2190/4436] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:13 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1221 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:13.315061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-cc8bfa2a-b9aa-4cb7-8bb1-3d1636e7c3ea req-fc4360fd-86cc-4139-a3f9-f82854ab5bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27439ee3-686a-4cd3-8430-f409fdaf175b", "name": "network-vif-deleted", "tag": "fd44c955-a54c-45f3-b36f-556eb41f9bb6"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:13.339145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cc8bfa2a-b9aa-4cb7-8bb1-3d1636e7c3ea req-fc4360fd-86cc-4139-a3f9-f82854ab5bc1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:13.339715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cc8bfa2a-b9aa-4cb7-8bb1-3d1636e7c3ea req-fc4360fd-86cc-4139-a3f9-f82854ab5bc1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:13.371932 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-cc8bfa2a-b9aa-4cb7-8bb1-3d1636e7c3ea req-fc4360fd-86cc-4139-a3f9-f82854ab5bc1 service nova] Creating event network-vif-deleted:fd44c955-a54c-45f3-b36f-556eb41f9bb6 for instance 27439ee3-686a-4cd3-8430-f409fdaf175b on n-h2-851337-3 Aug 02 07:09:13.381032 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-cc8bfa2a-b9aa-4cb7-8bb1-3d1636e7c3ea req-fc4360fd-86cc-4139-a3f9-f82854ab5bc1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075625 Aug 02 07:09:13.384216 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2191/4437] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:13.397512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-58310e9c-2e99-4744-a803-0aa64d72d2ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:13.398352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-58310e9c-2e99-4744-a803-0aa64d72d2ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:13.417677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-58310e9c-2e99-4744-a803-0aa64d72d2ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:13.419724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-58310e9c-2e99-4744-a803-0aa64d72d2ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:13.420600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-58310e9c-2e99-4744-a803-0aa64d72d2ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:13.421048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-58310e9c-2e99-4744-a803-0aa64d72d2ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:13.521339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-58310e9c-2e99-4744-a803-0aa64d72d2ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:09:13.690411 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-58310e9c-2e99-4744-a803-0aa64d72d2ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 204 len: 0 microversion: 2.1 time: 0.304244 Aug 02 07:09:13.691175 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2192/4438] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:09:13 2022] DELETE /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:09:13.706207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4450db75-ed5b-472d-9e85-57ea1e38620f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:13.708141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4450db75-ed5b-472d-9e85-57ea1e38620f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:13.718521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4450db75-ed5b-472d-9e85-57ea1e38620f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:13.720388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4450db75-ed5b-472d-9e85-57ea1e38620f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:13.721529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4450db75-ed5b-472d-9e85-57ea1e38620f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:13.722309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4450db75-ed5b-472d-9e85-57ea1e38620f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:13.876934 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-720a3225-a723-47dd-ab7d-f3280f0149e6 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.184196 Aug 02 07:09:13.877934 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2247/4439] 10.222.0.79 () {60 vars in 1170 bytes} [Tue Aug 2 07:09:08 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:13.883827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-96d7746d-44cd-43a5-b47a-93130cc4b72d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:13.885012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-96d7746d-44cd-43a5-b47a-93130cc4b72d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:13.916648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96d7746d-44cd-43a5-b47a-93130cc4b72d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:13.917395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96d7746d-44cd-43a5-b47a-93130cc4b72d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:13.919770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96d7746d-44cd-43a5-b47a-93130cc4b72d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:13.920391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96d7746d-44cd-43a5-b47a-93130cc4b72d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:14.018884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4450db75-ed5b-472d-9e85-57ea1e38620f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:14.046946 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4450db75-ed5b-472d-9e85-57ea1e38620f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.353349 Aug 02 07:09:14.048240 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2193/4440] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:13 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:14.071154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1086bef7-3189-438b-b7a1-70933876ed7b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:14.071848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1086bef7-3189-438b-b7a1-70933876ed7b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:14.080783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1086bef7-3189-438b-b7a1-70933876ed7b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:14.081589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1086bef7-3189-438b-b7a1-70933876ed7b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:14.082687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1086bef7-3189-438b-b7a1-70933876ed7b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:14.083234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1086bef7-3189-438b-b7a1-70933876ed7b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:14.198497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-96d7746d-44cd-43a5-b47a-93130cc4b72d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:14.214076 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-96d7746d-44cd-43a5-b47a-93130cc4b72d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1558 microversion: 2.1 time: 0.334295 Aug 02 07:09:14.215365 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2248/4441] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:13 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1558 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:14.225958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3b4b2c88-2f15-4bcb-b90e-ec5a572a9ac5 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] Action: 'create', calling method: .version_select at 0x7f927a8105e0>, body: {"pool": null} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:14.421193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1086bef7-3189-438b-b7a1-70933876ed7b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:14.435468 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1086bef7-3189-438b-b7a1-70933876ed7b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 200 len: 1689 microversion: 2.1 time: 0.384922 Aug 02 07:09:14.445480 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2194/4442] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:14 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 1689 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:14.450973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7cbf48ec-539a-4c6c-a988-32825f7cdd68 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:14.456475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7cbf48ec-539a-4c6c-a988-32825f7cdd68 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:14.471688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cbf48ec-539a-4c6c-a988-32825f7cdd68 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:14.473200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cbf48ec-539a-4c6c-a988-32825f7cdd68 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:14.476711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cbf48ec-539a-4c6c-a988-32825f7cdd68 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:14.479531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cbf48ec-539a-4c6c-a988-32825f7cdd68 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:14.522789 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-7cbf48ec-539a-4c6c-a988-32825f7cdd68 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7cbf48ec-539a-4c6c-a988-32825f7cdd68 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b HTTP/1.1 Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '27439ee3-686a-4cd3-8430-f409fdaf175b'} Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:09:14.530712 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:14.535692 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:14.535692 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:09:14.535692 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:09:14.535692 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:09:14.535692 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:09:14.535692 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:09:14.535692 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:14.537997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7cbf48ec-539a-4c6c-a988-32825f7cdd68 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:09:14.541081 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7cbf48ec-539a-4c6c-a988-32825f7cdd68 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 404 len: 111 microversion: 2.1 time: 0.099975 Aug 02 07:09:14.544472 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2195/4443] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:14 2022] GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:09:14.575592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c28b6bb4-d478-4fdb-8f4a-d3827e5fdf13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:14.584422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c28b6bb4-d478-4fdb-8f4a-d3827e5fdf13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:14.602600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c28b6bb4-d478-4fdb-8f4a-d3827e5fdf13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:14.603069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c28b6bb4-d478-4fdb-8f4a-d3827e5fdf13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:14.603951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c28b6bb4-d478-4fdb-8f4a-d3827e5fdf13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:14.604421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c28b6bb4-d478-4fdb-8f4a-d3827e5fdf13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:14.614017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:15.526656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c28b6bb4-d478-4fdb-8f4a-d3827e5fdf13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:15.546099 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c28b6bb4-d478-4fdb-8f4a-d3827e5fdf13 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.979400 Aug 02 07:09:15.551575 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2196/4444] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:14 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:15.564281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3072d100-59ec-4287-a114-08967a66f7d0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:15.578593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3072d100-59ec-4287-a114-08967a66f7d0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:15.593935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3072d100-59ec-4287-a114-08967a66f7d0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:15.602189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3072d100-59ec-4287-a114-08967a66f7d0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:15.604004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3072d100-59ec-4287-a114-08967a66f7d0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:15.604459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3072d100-59ec-4287-a114-08967a66f7d0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:15.796906 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3072d100-59ec-4287-a114-08967a66f7d0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.243556 Aug 02 07:09:15.797746 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2197/4445] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 07:09:15 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-interface => generated 285 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:15.811899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7e960107-6402-4b5c-a369-dca28a1d67bd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:15.813101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7e960107-6402-4b5c-a369-dca28a1d67bd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:15.829379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e960107-6402-4b5c-a369-dca28a1d67bd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:15.833402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e960107-6402-4b5c-a369-dca28a1d67bd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:15.834366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e960107-6402-4b5c-a369-dca28a1d67bd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:15.834890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e960107-6402-4b5c-a369-dca28a1d67bd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:16.417179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7e960107-6402-4b5c-a369-dca28a1d67bd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:16.430129 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7e960107-6402-4b5c-a369-dca28a1d67bd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1317 microversion: 2.1 time: 0.618753 Aug 02 07:09:16.431023 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2198/4446] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:15 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1317 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:16.435802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1561022564", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:16.530254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] validate_networks() for [('ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:09:18.795262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:09:18.795807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:09:18.796330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:09:18.796792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:09:18.797196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:09:18.824733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:18.826241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:18.829240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:18.831461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:18.904750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:09:18.936368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for user 0971d7961d5a4e8996ea2c0f958382ad and project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:09:18.953063 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3b4b2c88-2f15-4bcb-b90e-ec5a572a9ac5 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.736318 Aug 02 07:09:18.955223 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2249/4447] 10.222.0.79 () {60 vars in 1170 bytes} [Tue Aug 2 07:09:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:18.959535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:09:18.964781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:09:18.968396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-09baf421-27c8-44d5-bbd0-1acc0e798953 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:18.969133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-09baf421-27c8-44d5-bbd0-1acc0e798953 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 4d93db40-84f5-4c63-825f-6ee647fa2331] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:18.989246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:18.994997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09baf421-27c8-44d5-bbd0-1acc0e798953 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:18.996529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09baf421-27c8-44d5-bbd0-1acc0e798953 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:19.001422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09baf421-27c8-44d5-bbd0-1acc0e798953 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:19.002324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09baf421-27c8-44d5-bbd0-1acc0e798953 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:19.032650 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-09baf421-27c8-44d5-bbd0-1acc0e798953 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] HTTP exception thrown: Instance 4d93db40-84f5-4c63-825f-6ee647fa2331 could not be found. Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-09baf421-27c8-44d5-bbd0-1acc0e798953 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Request method failure captured: Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 HTTP/1.1 Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mzd332IyHs8WEC33t3YUNz7sq1ptUIAHfE__Qv8aBPsjD5fgOPUMjL9QNhBtDeuMmcahY94wYnuhI_ZDX9lnldCseQtzbltYf6Z0vf9AbPytvHxBPNUlbLU5KkXMkrC0xu54w449QvxMiAm33sZhpVGvyWLihgN3WhItHGPM7rvGsc Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: bfa05afa69e04974ad3de049c511c674 Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1158041327 Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bfa05afa69e04974ad3de049c511c674"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bfa05afa69e04974ad3de049c511c674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bfa05afa69e04974ad3de049c511c674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bfa05afa69e04974ad3de049c511c674"}]}] Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1158041327 Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: bfa05afa69e04974ad3de049c511c674 Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1158041327 Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestNetworkAdvancedServerOps-1158041327-project Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a44367c6be00413eb7b6c79272448cf4 Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1158041327-project Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 4d93db40-84f5-4c63-825f-6ee647fa2331 could not be found. Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '4d93db40-84f5-4c63-825f-6ee647fa2331'} Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d93db40-84f5-4c63-825f-6ee647fa2331 could not be found. Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d93db40-84f5-4c63-825f-6ee647fa2331 could not be found. Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:09:19.034568 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:09:19.041235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:09:19.041235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:19.041235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:09:19.041235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:09:19.041235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:09:19.041235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:09:19.041235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d93db40-84f5-4c63-825f-6ee647fa2331 could not be found. Aug 02 07:09:19.041235 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:09:19.044438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-09baf421-27c8-44d5-bbd0-1acc0e798953 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Returning 404 to user: Instance 4d93db40-84f5-4c63-825f-6ee647fa2331 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:09:19.048907 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f1fa0777-3be9-42c2-b49d-45ed772c71d0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.616754 Aug 02 07:09:19.056445 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2199/4448] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:09:19.056445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-6bd345aa-0298-47fe-9ccc-4ec6b72af1e2 req-6b0bbc8b-3e24-44e0-96cb-806743343aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d93db40-84f5-4c63-825f-6ee647fa2331", "tag": "38895fc4-ade3-4226-bdfd-d68b06745975"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:19.068798 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-09baf421-27c8-44d5-bbd0-1acc0e798953 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331" status: 404 len: 111 microversion: 2.1 time: 0.088848 Aug 02 07:09:19.072741 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2250/4449] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:18 2022] GET /compute/v2.1/servers/4d93db40-84f5-4c63-825f-6ee647fa2331 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:09:19.089470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6bd345aa-0298-47fe-9ccc-4ec6b72af1e2 req-6b0bbc8b-3e24-44e0-96cb-806743343aa2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:19.090075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6bd345aa-0298-47fe-9ccc-4ec6b72af1e2 req-6b0bbc8b-3e24-44e0-96cb-806743343aa2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:19.140716 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-6bd345aa-0298-47fe-9ccc-4ec6b72af1e2 req-6b0bbc8b-3e24-44e0-96cb-806743343aa2 service nova] Creating event network-changed:38895fc4-ade3-4226-bdfd-d68b06745975 for instance 4d93db40-84f5-4c63-825f-6ee647fa2331 on n-h2-851337-3 Aug 02 07:09:19.146697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8f7e3add-aadc-4c1a-b41c-728c274d4932 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:19.153432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8f7e3add-aadc-4c1a-b41c-728c274d4932 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:19.171635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7e3add-aadc-4c1a-b41c-728c274d4932 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:19.172356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7e3add-aadc-4c1a-b41c-728c274d4932 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:19.173351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7e3add-aadc-4c1a-b41c-728c274d4932 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:19.175502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7e3add-aadc-4c1a-b41c-728c274d4932 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:19.176142 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-6bd345aa-0298-47fe-9ccc-4ec6b72af1e2 req-6b0bbc8b-3e24-44e0-96cb-806743343aa2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116959 Aug 02 07:09:19.179184 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2200/4450] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:19.189393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8b8e3114-1581-4cff-8f4a-a4636c81e667 req-a78e39dc-8e37-4218-90c9-98ad00c4a0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba90067e-50cc-4009-886b-124ae5608b6f", "tag": "359f0467-c390-4642-9439-c61430073554"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:19.218366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8b8e3114-1581-4cff-8f4a-a4636c81e667 req-a78e39dc-8e37-4218-90c9-98ad00c4a0c5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:19.218890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8b8e3114-1581-4cff-8f4a-a4636c81e667 req-a78e39dc-8e37-4218-90c9-98ad00c4a0c5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:19.260612 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8b8e3114-1581-4cff-8f4a-a4636c81e667 req-a78e39dc-8e37-4218-90c9-98ad00c4a0c5 service nova] Creating event network-changed:359f0467-c390-4642-9439-c61430073554 for instance ba90067e-50cc-4009-886b-124ae5608b6f on n-h1-851337-3 Aug 02 07:09:19.271737 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8b8e3114-1581-4cff-8f4a-a4636c81e667 req-a78e39dc-8e37-4218-90c9-98ad00c4a0c5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090923 Aug 02 07:09:19.273552 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2201/4451] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:19.288460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-42711756-7dfe-4400-b22c-9926a45e1481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:19.290971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-42711756-7dfe-4400-b22c-9926a45e1481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:19.302637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42711756-7dfe-4400-b22c-9926a45e1481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:19.303985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42711756-7dfe-4400-b22c-9926a45e1481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:19.306585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42711756-7dfe-4400-b22c-9926a45e1481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:19.308394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42711756-7dfe-4400-b22c-9926a45e1481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:20.001356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-42711756-7dfe-4400-b22c-9926a45e1481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:20.011549 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-42711756-7dfe-4400-b22c-9926a45e1481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1317 microversion: 2.1 time: 0.732875 Aug 02 07:09:20.012142 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2202/4452] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:19 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1317 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:20.022335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b95cea00-8414-4d9e-ac32-e9a9dce68c58 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] Action: 'create', calling method: .version_select at 0x7f927b830d30>, body: {"pool": null} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:20.840578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8f7e3add-aadc-4c1a-b41c-728c274d4932 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:20.849395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:20.861567 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8f7e3add-aadc-4c1a-b41c-728c274d4932 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 1.762068 Aug 02 07:09:20.865739 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2251/4453] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:19 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:20.879859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c4f8401a-9906-407a-a0d4-9cd5ca264e24 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:20.880718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c4f8401a-9906-407a-a0d4-9cd5ca264e24 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:20.904466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4f8401a-9906-407a-a0d4-9cd5ca264e24 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:20.906116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4f8401a-9906-407a-a0d4-9cd5ca264e24 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:20.909296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4f8401a-9906-407a-a0d4-9cd5ca264e24 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:20.910656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4f8401a-9906-407a-a0d4-9cd5ca264e24 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:21.162850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c4f8401a-9906-407a-a0d4-9cd5ca264e24 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:21.182891 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c4f8401a-9906-407a-a0d4-9cd5ca264e24 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 200 len: 1269 microversion: 2.1 time: 0.315741 Aug 02 07:09:21.184559 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2252/4454] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:20 2022] GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 1269 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:21.189984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d2d1f4b6-c67d-462a-a1bc-b9abb30daff6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:21.190591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d2d1f4b6-c67d-462a-a1bc-b9abb30daff6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:21.206408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2d1f4b6-c67d-462a-a1bc-b9abb30daff6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:21.207021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2d1f4b6-c67d-462a-a1bc-b9abb30daff6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:21.207840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2d1f4b6-c67d-462a-a1bc-b9abb30daff6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:21.208274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2d1f4b6-c67d-462a-a1bc-b9abb30daff6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:21.573751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d2d1f4b6-c67d-462a-a1bc-b9abb30daff6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:21.584289 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d2d1f4b6-c67d-462a-a1bc-b9abb30daff6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.398000 Aug 02 07:09:21.585465 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2253/4455] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:21 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:21.593025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b8db8dd-4279-42c8-abe6-3e0f7d5b0083 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:21.596116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6b8db8dd-4279-42c8-abe6-3e0f7d5b0083 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:21.615131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b8db8dd-4279-42c8-abe6-3e0f7d5b0083 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:21.615693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b8db8dd-4279-42c8-abe6-3e0f7d5b0083 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:21.622580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b8db8dd-4279-42c8-abe6-3e0f7d5b0083 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:21.623120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b8db8dd-4279-42c8-abe6-3e0f7d5b0083 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:21.960797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6b8db8dd-4279-42c8-abe6-3e0f7d5b0083 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:21.975583 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6b8db8dd-4279-42c8-abe6-3e0f7d5b0083 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1317 microversion: 2.1 time: 0.388258 Aug 02 07:09:21.976614 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2254/4456] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:21 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:21.987873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-5722b864-38b2-4e46-8b07-ebd2696f1647 req-f86fb186-3904-4d78-a139-286e3578900f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d93db40-84f5-4c63-825f-6ee647fa2331", "name": "network-vif-deleted", "tag": "38895fc4-ade3-4226-bdfd-d68b06745975"}, {"name": "network-changed", "server_uuid": "65f2010c-11ee-485b-b841-11e8b795aeb8", "tag": "d729d2b4-ee94-4a77-b294-583f29177fe3"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:22.024912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-5722b864-38b2-4e46-8b07-ebd2696f1647 req-f86fb186-3904-4d78-a139-286e3578900f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:22.025687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-5722b864-38b2-4e46-8b07-ebd2696f1647 req-f86fb186-3904-4d78-a139-286e3578900f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:22.048444 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-5722b864-38b2-4e46-8b07-ebd2696f1647 req-f86fb186-3904-4d78-a139-286e3578900f service nova] Creating event network-vif-deleted:38895fc4-ade3-4226-bdfd-d68b06745975 for instance 4d93db40-84f5-4c63-825f-6ee647fa2331 on n-h2-851337-3 Aug 02 07:09:22.050305 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-5722b864-38b2-4e46-8b07-ebd2696f1647 req-f86fb186-3904-4d78-a139-286e3578900f service nova] Creating event network-changed:d729d2b4-ee94-4a77-b294-583f29177fe3 for instance 65f2010c-11ee-485b-b841-11e8b795aeb8 on n-h1-851337-3 Aug 02 07:09:22.067274 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-5722b864-38b2-4e46-8b07-ebd2696f1647 req-f86fb186-3904-4d78-a139-286e3578900f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.088751 Aug 02 07:09:22.069500 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2255/4457] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:22.077616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7dcf63b3-5ddf-4876-b93e-fdab9b8f730e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:22.078462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7dcf63b3-5ddf-4876-b93e-fdab9b8f730e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:22.092580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dcf63b3-5ddf-4876-b93e-fdab9b8f730e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:22.093882 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dcf63b3-5ddf-4876-b93e-fdab9b8f730e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:22.094902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dcf63b3-5ddf-4876-b93e-fdab9b8f730e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:22.095572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dcf63b3-5ddf-4876-b93e-fdab9b8f730e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:22.183373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7dcf63b3-5ddf-4876-b93e-fdab9b8f730e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Locking {{(pid=126120) lock /opt/stack/nova/nova/compute/api.py:4781}} Aug 02 07:09:22.269802 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7dcf63b3-5ddf-4876-b93e-fdab9b8f730e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.198524 Aug 02 07:09:22.274617 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2256/4458] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:22 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:09:22.281266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7bf851cb-f93f-422a-8507-38fb8d554bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:22.282241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7bf851cb-f93f-422a-8507-38fb8d554bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:22.299285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bf851cb-f93f-422a-8507-38fb8d554bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:22.300920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bf851cb-f93f-422a-8507-38fb8d554bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:22.302017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bf851cb-f93f-422a-8507-38fb8d554bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:22.302617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7bf851cb-f93f-422a-8507-38fb8d554bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:22.397749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7bf851cb-f93f-422a-8507-38fb8d554bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:22.407507 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7bf851cb-f93f-422a-8507-38fb8d554bd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 200 len: 1267 microversion: 2.1 time: 0.131019 Aug 02 07:09:22.408805 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2257/4459] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:22 2022] GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 1267 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:22.414218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-61752536-af99-4074-a3c8-78b9f6627b53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:22.415178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-61752536-af99-4074-a3c8-78b9f6627b53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:22.423533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61752536-af99-4074-a3c8-78b9f6627b53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:22.424414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61752536-af99-4074-a3c8-78b9f6627b53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:22.425445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61752536-af99-4074-a3c8-78b9f6627b53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:22.426321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-61752536-af99-4074-a3c8-78b9f6627b53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:22.666308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-61752536-af99-4074-a3c8-78b9f6627b53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:22.678651 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-61752536-af99-4074-a3c8-78b9f6627b53 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.268586 Aug 02 07:09:22.679566 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2258/4460] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:22 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:22.706201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b349544c-fbfa-4d46-925c-b3bdc40c0ae1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:22.715410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b349544c-fbfa-4d46-925c-b3bdc40c0ae1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:22.715931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b349544c-fbfa-4d46-925c-b3bdc40c0ae1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:22.748488 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-b349544c-fbfa-4d46-925c-b3bdc40c0ae1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] HTTP exception thrown: Instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe is locked Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b349544c-fbfa-4d46-925c-b3bdc40c0ae1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Request method failure captured: Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action HTTP/1.1 Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 15 Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mw7zphSbQMyV1VXzUHwZd5rIpAe-J0qyHXkZOXqSTF1d6X6i4GdQd6SAUR575sU6Hm3N4AxhP_yLKO8F3_7Y95D5F9Xzk9hsnx3CQybTj1H2lx-bESaz2CLvMeK80wW4lAMQ_yzam-Q_YptKuaWSXkoL0Pz6P3TXT8PIXRbAKIUaKg Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: daaad725b62041d1ac0af9ff8efcdfc5 Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/daaad725b62041d1ac0af9ff8efcdfc5"}]}] Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: daaad725b62041d1ac0af9ff8efcdfc5 Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerActionsTestJSON-1022755064-project Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 35f9bc6690f3473a99804c14351b93b6 Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerActionsTestJSON-1022755064-project Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: {"os-stop": {}} Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe is locked Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '84ccfed8-393e-4223-b2a8-7dbf8c77d3fe', 'body': {'os-stop': {}}} Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe is locked Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe is locked Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe is locked Aug 02 07:09:22.750220 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:09:22.757514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b349544c-fbfa-4d46-925c-b3bdc40c0ae1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Returning 409 to user: Instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe is locked {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:09:22.758671 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b349544c-fbfa-4d46-925c-b3bdc40c0ae1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 409 len: 107 microversion: 2.1 time: 0.057242 Aug 02 07:09:22.762802 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2259/4461] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:22 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 107 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:09:22.770499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-defbc393-7f20-4449-8439-7a34dc599bb6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:22.771545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-defbc393-7f20-4449-8439-7a34dc599bb6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:22.790201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-defbc393-7f20-4449-8439-7a34dc599bb6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:22.791498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-defbc393-7f20-4449-8439-7a34dc599bb6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:22.792532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-defbc393-7f20-4449-8439-7a34dc599bb6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:22.793130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-defbc393-7f20-4449-8439-7a34dc599bb6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:22.881169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-defbc393-7f20-4449-8439-7a34dc599bb6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Unlocking {{(pid=126120) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 02 07:09:22.981034 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-defbc393-7f20-4449-8439-7a34dc599bb6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.216587 Aug 02 07:09:22.981944 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2260/4462] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:22 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:09:22.992098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e2e5ca2a-40e1-4a65-b05a-12f25f2325b1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:22.999659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e2e5ca2a-40e1-4a65-b05a-12f25f2325b1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:23.000207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e2e5ca2a-40e1-4a65-b05a-12f25f2325b1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:23.067954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e2e5ca2a-40e1-4a65-b05a-12f25f2325b1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Going to try to stop instance {{(pid=126120) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 07:09:23.134451 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e2e5ca2a-40e1-4a65-b05a-12f25f2325b1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.147389 Aug 02 07:09:23.135407 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2261/4463] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:22 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:09:23.147072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0da2c3a4-99fa-4eae-9079-247dcc791e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:23.152286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0da2c3a4-99fa-4eae-9079-247dcc791e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:23.170059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0da2c3a4-99fa-4eae-9079-247dcc791e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:23.172130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0da2c3a4-99fa-4eae-9079-247dcc791e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:23.174353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0da2c3a4-99fa-4eae-9079-247dcc791e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:23.175871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0da2c3a4-99fa-4eae-9079-247dcc791e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:23.259897 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b95cea00-8414-4d9e-ac32-e9a9dce68c58 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.243564 Aug 02 07:09:23.262933 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2203/4464] 10.222.0.79 () {60 vars in 1170 bytes} [Tue Aug 2 07:09:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:23.270216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f6aaf3fb-96ee-43d9-bdc9-5820e7e101d3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:23.271083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f6aaf3fb-96ee-43d9-bdc9-5820e7e101d3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:23.284595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6aaf3fb-96ee-43d9-bdc9-5820e7e101d3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:23.285429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6aaf3fb-96ee-43d9-bdc9-5820e7e101d3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:23.286722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6aaf3fb-96ee-43d9-bdc9-5820e7e101d3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:23.287326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6aaf3fb-96ee-43d9-bdc9-5820e7e101d3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:23.382466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0da2c3a4-99fa-4eae-9079-247dcc791e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:23.392877 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0da2c3a4-99fa-4eae-9079-247dcc791e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1317 microversion: 2.1 time: 0.254498 Aug 02 07:09:23.393727 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2262/4465] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:23 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:23.398757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1468847874", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "43221104-4b88-4bfc-b42e-9ed37fe0b67d"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:23.467196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f6aaf3fb-96ee-43d9-bdc9-5820e7e101d3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:23.475620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] validate_networks() for [('43221104-4b88-4bfc-b42e-9ed37fe0b67d', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:09:23.475878 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f6aaf3fb-96ee-43d9-bdc9-5820e7e101d3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.211475 Aug 02 07:09:23.481655 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2204/4466] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:23 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:23.498353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f546d53-e1fa-47e2-b77f-6fc5635d83e0 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] Action: 'create', calling method: .version_select at 0x7f928c2ea790>, body: {"pool": null} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:24.259786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:09:24.262923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:09:24.263489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:09:24.263964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:09:24.264734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:09:24.287086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:24.289632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:24.294378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:24.296161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:24.338081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Getting quotas for project 5220c59e230140e382ba24d3ae86fcd1. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:09:24.350645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Getting quotas for user 54d1bc2a5837436dae121d0c5574d1b9 and project 5220c59e230140e382ba24d3ae86fcd1. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:09:24.385782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:09:24.392754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:09:24.501224 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cc944ed6-13c1-4b3c-a62c-75e4b872e4e8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106107 Aug 02 07:09:24.517913 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2263/4467] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:09:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:09:24.534295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f4db231a-93ac-4cf2-892a-586454d8b0f9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:24.537538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f4db231a-93ac-4cf2-892a-586454d8b0f9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:24.578401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4db231a-93ac-4cf2-892a-586454d8b0f9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:24.580375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4db231a-93ac-4cf2-892a-586454d8b0f9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:24.585467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4db231a-93ac-4cf2-892a-586454d8b0f9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:24.586205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4db231a-93ac-4cf2-892a-586454d8b0f9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:24.602529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:25.765940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f4db231a-93ac-4cf2-892a-586454d8b0f9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:25.776667 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f4db231a-93ac-4cf2-892a-586454d8b0f9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 200 len: 1309 microversion: 2.1 time: 1.257638 Aug 02 07:09:25.777317 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2264/4468] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:24 2022] GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 1309 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:25.784890 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2043e845-ac79-4bb2-95d7-b7ef56cfa190 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:25.785799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2043e845-ac79-4bb2-95d7-b7ef56cfa190 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:25.817108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2043e845-ac79-4bb2-95d7-b7ef56cfa190 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:25.817559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2043e845-ac79-4bb2-95d7-b7ef56cfa190 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:25.822997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2043e845-ac79-4bb2-95d7-b7ef56cfa190 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:25.824136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2043e845-ac79-4bb2-95d7-b7ef56cfa190 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:26.170964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2043e845-ac79-4bb2-95d7-b7ef56cfa190 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:26.181164 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2043e845-ac79-4bb2-95d7-b7ef56cfa190 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1317 microversion: 2.1 time: 0.402257 Aug 02 07:09:26.184281 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2265/4469] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:25 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:26.203319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a4a61c0f-b563-4f79-ac82-edae47c5d002 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:26.204371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a4a61c0f-b563-4f79-ac82-edae47c5d002 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:26.219183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a61c0f-b563-4f79-ac82-edae47c5d002 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:26.219621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a61c0f-b563-4f79-ac82-edae47c5d002 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:26.220781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a61c0f-b563-4f79-ac82-edae47c5d002 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:26.221237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a61c0f-b563-4f79-ac82-edae47c5d002 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:26.690113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a4a61c0f-b563-4f79-ac82-edae47c5d002 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:26.698835 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a4a61c0f-b563-4f79-ac82-edae47c5d002 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.513483 Aug 02 07:09:26.699741 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2266/4470] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:26 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:26.704528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c100f6b-9546-43bd-a192-5ed5e7913161 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:26.705396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1c100f6b-9546-43bd-a192-5ed5e7913161 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:26.712266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c100f6b-9546-43bd-a192-5ed5e7913161 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:26.712727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c100f6b-9546-43bd-a192-5ed5e7913161 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:26.713499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c100f6b-9546-43bd-a192-5ed5e7913161 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:26.713936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c100f6b-9546-43bd-a192-5ed5e7913161 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:26.840611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1c100f6b-9546-43bd-a192-5ed5e7913161 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:26.852196 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1c100f6b-9546-43bd-a192-5ed5e7913161 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0" status: 200 len: 1277 microversion: 2.1 time: 0.150179 Aug 02 07:09:26.853085 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2267/4471] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:26 2022] GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0 => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:26.859830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-372f906d-b708-478d-b628-93c428dc1e5c req-d11a3260-9a47-461e-a473-3e5c95ce6f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba90067e-50cc-4009-886b-124ae5608b6f", "name": "network-vif-plugged", "status": "completed", "tag": "359f0467-c390-4642-9439-c61430073554"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:26.870981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-372f906d-b708-478d-b628-93c428dc1e5c req-d11a3260-9a47-461e-a473-3e5c95ce6f53 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:26.871421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-372f906d-b708-478d-b628-93c428dc1e5c req-d11a3260-9a47-461e-a473-3e5c95ce6f53 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:26.884261 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-372f906d-b708-478d-b628-93c428dc1e5c req-d11a3260-9a47-461e-a473-3e5c95ce6f53 service nova] Creating event network-vif-plugged:359f0467-c390-4642-9439-c61430073554 for instance ba90067e-50cc-4009-886b-124ae5608b6f on n-h1-851337-3 Aug 02 07:09:26.890260 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-372f906d-b708-478d-b628-93c428dc1e5c req-d11a3260-9a47-461e-a473-3e5c95ce6f53 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035511 Aug 02 07:09:26.894134 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2268/4472] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:26.900297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-9c790a2a-832a-43e5-abb0-c5174e94d865 req-2ff6b779-48ff-40b2-b15f-baaa1add40d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420aa836-056a-4683-88ee-378b568df42e", "tag": "58dd43a8-fc53-44c7-bec0-dfa0ac209fa1"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:26.910647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9c790a2a-832a-43e5-abb0-c5174e94d865 req-2ff6b779-48ff-40b2-b15f-baaa1add40d6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:26.911115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9c790a2a-832a-43e5-abb0-c5174e94d865 req-2ff6b779-48ff-40b2-b15f-baaa1add40d6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:26.922755 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-9c790a2a-832a-43e5-abb0-c5174e94d865 req-2ff6b779-48ff-40b2-b15f-baaa1add40d6 service nova] Creating event network-changed:58dd43a8-fc53-44c7-bec0-dfa0ac209fa1 for instance 420aa836-056a-4683-88ee-378b568df42e on n-h2-851337-3 Aug 02 07:09:26.928055 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-9c790a2a-832a-43e5-abb0-c5174e94d865 req-2ff6b779-48ff-40b2-b15f-baaa1add40d6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032494 Aug 02 07:09:26.928670 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2269/4473] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:26.933876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-21190439-ed75-4e05-95ec-dca7ba1933f4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:26.934581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-21190439-ed75-4e05-95ec-dca7ba1933f4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:26.941322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21190439-ed75-4e05-95ec-dca7ba1933f4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:26.941694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21190439-ed75-4e05-95ec-dca7ba1933f4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:26.942501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21190439-ed75-4e05-95ec-dca7ba1933f4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:26.942938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21190439-ed75-4e05-95ec-dca7ba1933f4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:26.976849 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3f546d53-e1fa-47e2-b77f-6fc5635d83e0 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.493674 Aug 02 07:09:26.984082 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2205/4474] 10.222.0.79 () {60 vars in 1170 bytes} [Tue Aug 2 07:09:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:26.990910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d3545bde-a636-4ba6-adec-b5dc9feca9a0 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] Calling method '.version_select at 0x7f928c318160>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:27.264872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-21190439-ed75-4e05-95ec-dca7ba1933f4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:27.273471 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-21190439-ed75-4e05-95ec-dca7ba1933f4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 200 len: 1309 microversion: 2.1 time: 0.343581 Aug 02 07:09:27.274148 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2270/4475] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:26 2022] GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 1309 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:27.279828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e1c28c27-a156-47b9-9ce1-8d0d455dbbf4 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:27.280498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e1c28c27-a156-47b9-9ce1-8d0d455dbbf4 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:27.288193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1c28c27-a156-47b9-9ce1-8d0d455dbbf4 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:27.288743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1c28c27-a156-47b9-9ce1-8d0d455dbbf4 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:27.289565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1c28c27-a156-47b9-9ce1-8d0d455dbbf4 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:27.290086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1c28c27-a156-47b9-9ce1-8d0d455dbbf4 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:27.424436 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d3545bde-a636-4ba6-adec-b5dc9feca9a0 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/aa2a5380-3627-4943-92bb-0ed9210a37ed" status: 200 len: 142 microversion: 2.1 time: 0.438937 Aug 02 07:09:27.424988 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2206/4476] 10.222.0.79 () {58 vars in 1260 bytes} [Tue Aug 2 07:09:26 2022] GET /compute/v2.1/os-floating-ips/aa2a5380-3627-4943-92bb-0ed9210a37ed => generated 142 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:09:27.438011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3c5c2ad2-bea8-4e77-a20e-b32f156e6ad5 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] Calling method '.version_select at 0x7f928c3188b0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:27.870016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e1c28c27-a156-47b9-9ce1-8d0d455dbbf4 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:27.884732 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e1c28c27-a156-47b9-9ce1-8d0d455dbbf4 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1317 microversion: 2.1 time: 0.609005 Aug 02 07:09:27.885656 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2271/4477] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:27 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1317 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:27.891903 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3cfaf54e-9ee8-473e-adfe-40f14d5b3352 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:27.893054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3cfaf54e-9ee8-473e-adfe-40f14d5b3352 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:27.902061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cfaf54e-9ee8-473e-adfe-40f14d5b3352 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:27.903078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cfaf54e-9ee8-473e-adfe-40f14d5b3352 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:27.904199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cfaf54e-9ee8-473e-adfe-40f14d5b3352 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:27.904649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cfaf54e-9ee8-473e-adfe-40f14d5b3352 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:28.680262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3cfaf54e-9ee8-473e-adfe-40f14d5b3352 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:28.688239 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3cfaf54e-9ee8-473e-adfe-40f14d5b3352 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.801200 Aug 02 07:09:28.689949 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2272/4478] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:27 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:28.698200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bf08c13b-db2b-4893-8976-885afa890d89 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:28.698200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bf08c13b-db2b-4893-8976-885afa890d89 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:28.704063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf08c13b-db2b-4893-8976-885afa890d89 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:28.704568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf08c13b-db2b-4893-8976-885afa890d89 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:28.705342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf08c13b-db2b-4893-8976-885afa890d89 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:28.705780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf08c13b-db2b-4893-8976-885afa890d89 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:28.854062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:28.875160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bf08c13b-db2b-4893-8976-885afa890d89 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:28.884633 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bf08c13b-db2b-4893-8976-885afa890d89 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0" status: 200 len: 1277 microversion: 2.1 time: 0.193392 Aug 02 07:09:28.885227 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2273/4479] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:28 2022] GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:28.890927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f7b807c4-ad3a-4756-942d-cfb846cc6911 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:28.891590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f7b807c4-ad3a-4756-942d-cfb846cc6911 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:28.898584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7b807c4-ad3a-4756-942d-cfb846cc6911 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:28.899256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7b807c4-ad3a-4756-942d-cfb846cc6911 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:28.900244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7b807c4-ad3a-4756-942d-cfb846cc6911 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:28.900878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7b807c4-ad3a-4756-942d-cfb846cc6911 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:28.946944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=12 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:29.291965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f7b807c4-ad3a-4756-942d-cfb846cc6911 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:29.300971 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f7b807c4-ad3a-4756-942d-cfb846cc6911 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 200 len: 1309 microversion: 2.1 time: 0.414266 Aug 02 07:09:29.301979 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2274/4480] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:28 2022] GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 1309 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:29.307318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aa4ff194-42c2-40d0-a2f6-32a1ea39dd80 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:29.308339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aa4ff194-42c2-40d0-a2f6-32a1ea39dd80 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:29.325328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa4ff194-42c2-40d0-a2f6-32a1ea39dd80 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:29.325964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa4ff194-42c2-40d0-a2f6-32a1ea39dd80 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:29.326784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa4ff194-42c2-40d0-a2f6-32a1ea39dd80 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:29.327283 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa4ff194-42c2-40d0-a2f6-32a1ea39dd80 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:29.681346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-aa4ff194-42c2-40d0-a2f6-32a1ea39dd80 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:29.689423 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aa4ff194-42c2-40d0-a2f6-32a1ea39dd80 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1507 microversion: 2.1 time: 0.386089 Aug 02 07:09:29.690043 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2275/4481] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:29 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1507 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:29.694712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d31d3b44-aa11-4e34-b815-5611aa8971e1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '.version_select at 0x7f928c27a550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:29.722032 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d31d3b44-aa11-4e34-b815-5611aa8971e1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-426538094" status: 202 len: 0 microversion: 2.1 time: 0.030629 Aug 02 07:09:29.723290 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2276/4482] 10.222.0.79 () {58 vars in 1281 bytes} [Tue Aug 2 07:09:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-426538094 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:09:29.728869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-73b4cf1f-2fd0-4a92-ba8e-66bd07a15ebf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:29.729877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-73b4cf1f-2fd0-4a92-ba8e-66bd07a15ebf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:29.737599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73b4cf1f-2fd0-4a92-ba8e-66bd07a15ebf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:29.738350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73b4cf1f-2fd0-4a92-ba8e-66bd07a15ebf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:29.739849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73b4cf1f-2fd0-4a92-ba8e-66bd07a15ebf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:29.740667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73b4cf1f-2fd0-4a92-ba8e-66bd07a15ebf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:29.751085 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3c5c2ad2-bea8-4e77-a20e-b32f156e6ad5 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/aa2a5380-3627-4943-92bb-0ed9210a37ed" status: 202 len: 0 microversion: 2.1 time: 2.316790 Aug 02 07:09:29.758714 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2207/4483] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 07:09:27 2022] DELETE /compute/v2.1/os-floating-ips/aa2a5380-3627-4943-92bb-0ed9210a37ed => generated 0 bytes in 2325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:09:29.763783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f10f3ac7-4cc6-4243-a894-78d38f1f7544 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:29.764397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f10f3ac7-4cc6-4243-a894-78d38f1f7544 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:29.779837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f10f3ac7-4cc6-4243-a894-78d38f1f7544 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:29.780281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f10f3ac7-4cc6-4243-a894-78d38f1f7544 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:29.781060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f10f3ac7-4cc6-4243-a894-78d38f1f7544 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:29.781493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f10f3ac7-4cc6-4243-a894-78d38f1f7544 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:30.097162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-73b4cf1f-2fd0-4a92-ba8e-66bd07a15ebf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:30.104788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f10f3ac7-4cc6-4243-a894-78d38f1f7544 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:30.106412 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-73b4cf1f-2fd0-4a92-ba8e-66bd07a15ebf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1507 microversion: 2.1 time: 0.381742 Aug 02 07:09:30.118111 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2277/4484] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:29 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1507 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:30.118111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2b7fd639-b66d-4c88-815c-28364a21edd7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'create', calling method: .version_select at 0x7f927b261820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1804463986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU83Vznr51UpsNqRVsOSqm8NXyfDZm0taryBS6zbtv7g2axnJ2k/KpK/1NpjhYxcNu1XV9UxGiAT+nYIuxqDCEhqI1CfBVJvCtveIXpfehLOxZamm0jYgAukc1X0Rph/A=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:30.118413 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f10f3ac7-4cc6-4243-a894-78d38f1f7544 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.355500 Aug 02 07:09:30.121822 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2208/4485] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:29 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:30.129133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d9af64d6-4cab-49f4-9ec4-2fa38a146624 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] Calling method '.version_select at 0x7f927abc5f70>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:30.139809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2b7fd639-b66d-4c88-815c-28364a21edd7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for project bfa05afa69e04974ad3de049c511c674. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:09:30.145557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2b7fd639-b66d-4c88-815c-28364a21edd7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for user a44367c6be00413eb7b6c79272448cf4 and project bfa05afa69e04974ad3de049c511c674. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:09:30.169519 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2b7fd639-b66d-4c88-815c-28364a21edd7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.061045 Aug 02 07:09:30.170530 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2278/4486] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:09:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:30.175078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ae3ca95e-4824-4357-a4b4-2ad39084f85b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:30.175798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae3ca95e-4824-4357-a4b4-2ad39084f85b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:30.182310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae3ca95e-4824-4357-a4b4-2ad39084f85b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:30.182947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae3ca95e-4824-4357-a4b4-2ad39084f85b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:30.183901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae3ca95e-4824-4357-a4b4-2ad39084f85b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:30.184430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae3ca95e-4824-4357-a4b4-2ad39084f85b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:30.479943 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d9af64d6-4cab-49f4-9ec4-2fa38a146624 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.354979 Aug 02 07:09:30.488051 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2209/4487] 10.222.0.79 () {58 vars in 1164 bytes} [Tue Aug 2 07:09:30 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:09:30.488051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-efd654a7-ef42-4060-b9b9-b81f7a514fca req-7981c9b8-7a9a-4e81-9b5d-7d3df8711448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420aa836-056a-4683-88ee-378b568df42e", "name": "network-vif-plugged", "status": "completed", "tag": "58dd43a8-fc53-44c7-bec0-dfa0ac209fa1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:30.511543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-efd654a7-ef42-4060-b9b9-b81f7a514fca req-7981c9b8-7a9a-4e81-9b5d-7d3df8711448 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:30.512073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-efd654a7-ef42-4060-b9b9-b81f7a514fca req-7981c9b8-7a9a-4e81-9b5d-7d3df8711448 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:30.526356 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-efd654a7-ef42-4060-b9b9-b81f7a514fca req-7981c9b8-7a9a-4e81-9b5d-7d3df8711448 service nova] Creating event network-vif-plugged:58dd43a8-fc53-44c7-bec0-dfa0ac209fa1 for instance 420aa836-056a-4683-88ee-378b568df42e on n-h2-851337-3 Aug 02 07:09:30.531997 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-efd654a7-ef42-4060-b9b9-b81f7a514fca req-7981c9b8-7a9a-4e81-9b5d-7d3df8711448 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049120 Aug 02 07:09:30.532941 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2210/4488] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:30.542266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:30.545529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:30.552178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ae3ca95e-4824-4357-a4b4-2ad39084f85b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:30.553064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:30.553730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:30.554998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:30.555683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:30.568893 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ae3ca95e-4824-4357-a4b4-2ad39084f85b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0" status: 200 len: 1319 microversion: 2.1 time: 0.397362 Aug 02 07:09:30.569836 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2279/4489] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:30 2022] GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0 => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:30.574834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a4a351b4-8781-46fb-b4fd-0322d6676654 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:30.575461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a4a351b4-8781-46fb-b4fd-0322d6676654 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:30.587959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a351b4-8781-46fb-b4fd-0322d6676654 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:30.588538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a351b4-8781-46fb-b4fd-0322d6676654 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:30.602954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a351b4-8781-46fb-b4fd-0322d6676654 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:30.603590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a351b4-8781-46fb-b4fd-0322d6676654 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:30.681259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:30.687546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:09:30.688275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:09:30.688723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:09:30.689284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:09:30.689846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:09:30.774332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:30.791416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:30.791416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:30.791416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:30.791416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:30.822151 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8fe5d850-ae83-45a6-bc03-344ed6ddde41 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "POST /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f/action" status: 202 len: 1109 microversion: 2.1 time: 0.284367 Aug 02 07:09:30.823288 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2211/4490] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:30 2022] POST /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f/action => generated 1109 bytes in 286 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 07:09:30.827891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4b9332d1-c29c-40a7-9bbe-5f9b387647af tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] Calling method '.version_select at 0x7f927ab9e5e0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:30.964103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a4a351b4-8781-46fb-b4fd-0322d6676654 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:30.974150 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a4a351b4-8781-46fb-b4fd-0322d6676654 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 200 len: 1309 microversion: 2.1 time: 0.403252 Aug 02 07:09:30.975073 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2280/4491] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:30 2022] GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 1309 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:30.980871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-717e328a-42ed-4ec0-b569-566d4184746d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:30.981574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-717e328a-42ed-4ec0-b569-566d4184746d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:30.991285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-717e328a-42ed-4ec0-b569-566d4184746d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:30.991783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-717e328a-42ed-4ec0-b569-566d4184746d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:30.992678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-717e328a-42ed-4ec0-b569-566d4184746d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:30.993245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-717e328a-42ed-4ec0-b569-566d4184746d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:31.208980 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4b9332d1-c29c-40a7-9bbe-5f9b387647af tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.384594 Aug 02 07:09:31.209580 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2212/4492] 10.222.0.79 () {58 vars in 1149 bytes} [Tue Aug 2 07:09:30 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:31.224229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-04ba2c19-cefd-4e0e-b9bd-a9abf700033e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:31.224852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-04ba2c19-cefd-4e0e-b9bd-a9abf700033e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:31.234190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04ba2c19-cefd-4e0e-b9bd-a9abf700033e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:31.235080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04ba2c19-cefd-4e0e-b9bd-a9abf700033e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:31.236175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04ba2c19-cefd-4e0e-b9bd-a9abf700033e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:31.236852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04ba2c19-cefd-4e0e-b9bd-a9abf700033e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:31.650467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-717e328a-42ed-4ec0-b569-566d4184746d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:31.661015 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-717e328a-42ed-4ec0-b569-566d4184746d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.684371 Aug 02 07:09:31.662401 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2281/4493] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:30 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:31.667607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7a16422f-f0e9-48ea-8259-077227929616 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] Calling method '.version_select at 0x7f927b0cf160>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:31.885103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-04ba2c19-cefd-4e0e-b9bd-a9abf700033e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:31.896622 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-04ba2c19-cefd-4e0e-b9bd-a9abf700033e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.676567 Aug 02 07:09:31.899595 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2213/4494] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:31 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:31.929963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-20748961-36dd-4176-911b-6d35a21b6b7c req-47558357-ca50-4992-a1e2-7e5216efd72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df9cce51-3636-4177-ae1a-6439b8273ff0", "tag": "869bd5e2-d110-49ca-ac08-aed58db97575"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:31.943999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-20748961-36dd-4176-911b-6d35a21b6b7c req-47558357-ca50-4992-a1e2-7e5216efd72d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:31.944418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-20748961-36dd-4176-911b-6d35a21b6b7c req-47558357-ca50-4992-a1e2-7e5216efd72d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:31.961071 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-20748961-36dd-4176-911b-6d35a21b6b7c req-47558357-ca50-4992-a1e2-7e5216efd72d service nova] Creating event network-changed:869bd5e2-d110-49ca-ac08-aed58db97575 for instance df9cce51-3636-4177-ae1a-6439b8273ff0 on n-h2-851337-3 Aug 02 07:09:31.967583 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-20748961-36dd-4176-911b-6d35a21b6b7c req-47558357-ca50-4992-a1e2-7e5216efd72d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045670 Aug 02 07:09:31.968592 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2214/4495] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:31.975920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5452ff13-67ff-4bc5-ac32-a64c0f342469 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:31.976652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5452ff13-67ff-4bc5-ac32-a64c0f342469 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:31.986258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5452ff13-67ff-4bc5-ac32-a64c0f342469 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:31.986834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5452ff13-67ff-4bc5-ac32-a64c0f342469 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:31.987672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5452ff13-67ff-4bc5-ac32-a64c0f342469 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:31.988169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5452ff13-67ff-4bc5-ac32-a64c0f342469 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:32.383912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5452ff13-67ff-4bc5-ac32-a64c0f342469 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:32.395971 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5452ff13-67ff-4bc5-ac32-a64c0f342469 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0" status: 200 len: 1319 microversion: 2.1 time: 0.425336 Aug 02 07:09:32.409001 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2215/4496] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:31 2022] GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0 => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:32.419185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-38c1aa2a-858b-43d8-ad85-35f8cdde7c4a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:32.419903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-38c1aa2a-858b-43d8-ad85-35f8cdde7c4a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:32.428097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38c1aa2a-858b-43d8-ad85-35f8cdde7c4a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:32.428541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38c1aa2a-858b-43d8-ad85-35f8cdde7c4a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:32.429335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38c1aa2a-858b-43d8-ad85-35f8cdde7c4a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:32.430016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38c1aa2a-858b-43d8-ad85-35f8cdde7c4a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:32.717218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-38c1aa2a-858b-43d8-ad85-35f8cdde7c4a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:32.726835 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-38c1aa2a-858b-43d8-ad85-35f8cdde7c4a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 200 len: 1489 microversion: 2.1 time: 0.316628 Aug 02 07:09:32.742270 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2216/4497] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:32 2022] GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 1489 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:32.742270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9d4bc59f-c540-44e3-bac1-48da04d0edf8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:32.742270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9d4bc59f-c540-44e3-bac1-48da04d0edf8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:32.742994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d4bc59f-c540-44e3-bac1-48da04d0edf8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:32.743830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d4bc59f-c540-44e3-bac1-48da04d0edf8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:32.744821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d4bc59f-c540-44e3-bac1-48da04d0edf8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:32.745777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d4bc59f-c540-44e3-bac1-48da04d0edf8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:32.987551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9d4bc59f-c540-44e3-bac1-48da04d0edf8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:32.999315 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9d4bc59f-c540-44e3-bac1-48da04d0edf8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.269756 Aug 02 07:09:33.000303 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2217/4498] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:32 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:33.006473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-532c753c-dabd-4281-9f9d-56c2c6992d62 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:33.009840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-532c753c-dabd-4281-9f9d-56c2c6992d62 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:33.012598 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7a16422f-f0e9-48ea-8259-077227929616 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/9f2a3a99-cf57-4a9a-9caa-5d3b445a2b17" status: 202 len: 0 microversion: 2.1 time: 1.348919 Aug 02 07:09:33.013365 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2282/4499] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 07:09:31 2022] DELETE /compute/v2.1/os-floating-ips/9f2a3a99-cf57-4a9a-9caa-5d3b445a2b17 => generated 0 bytes in 1350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:09:33.018341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-375cdd31-3306-4c65-8954-ff1b6f410b5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:33.019019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-375cdd31-3306-4c65-8954-ff1b6f410b5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:33.019339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-532c753c-dabd-4281-9f9d-56c2c6992d62 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:33.020061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-532c753c-dabd-4281-9f9d-56c2c6992d62 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:33.021213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-532c753c-dabd-4281-9f9d-56c2c6992d62 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:33.021997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-532c753c-dabd-4281-9f9d-56c2c6992d62 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:33.027613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-375cdd31-3306-4c65-8954-ff1b6f410b5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:33.028063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-375cdd31-3306-4c65-8954-ff1b6f410b5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:33.028939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-375cdd31-3306-4c65-8954-ff1b6f410b5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:33.029443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-375cdd31-3306-4c65-8954-ff1b6f410b5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:33.110359 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-532c753c-dabd-4281-9f9d-56c2c6992d62 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "PUT /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 200 len: 1084 microversion: 2.1 time: 0.108570 Aug 02 07:09:33.111116 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2218/4500] 10.222.0.79 () {60 vars in 1256 bytes} [Tue Aug 2 07:09:33 2022] PUT /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 1084 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:33.116893 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5caacd16-471a-41fe-8843-155fc91bdd36 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] Calling method '.version_select at 0x7f928c3c5dc0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:33.280416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-375cdd31-3306-4c65-8954-ff1b6f410b5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:33.288730 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-375cdd31-3306-4c65-8954-ff1b6f410b5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.274036 Aug 02 07:09:33.289323 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2283/4501] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:33 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:33.294359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5126819f-3402-4a6d-85fd-514a6c041f99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:33.294951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5126819f-3402-4a6d-85fd-514a6c041f99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:33.304265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5126819f-3402-4a6d-85fd-514a6c041f99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:33.304725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5126819f-3402-4a6d-85fd-514a6c041f99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:33.305551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5126819f-3402-4a6d-85fd-514a6c041f99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:33.306038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5126819f-3402-4a6d-85fd-514a6c041f99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:33.573123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5126819f-3402-4a6d-85fd-514a6c041f99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:33.589615 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5126819f-3402-4a6d-85fd-514a6c041f99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 200 len: 1510 microversion: 2.1 time: 0.298983 Aug 02 07:09:33.590257 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2284/4502] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:33 2022] GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:33.611721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-70a545b1-4163-42ba-93ba-73cf64e0c23b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:33.612306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-70a545b1-4163-42ba-93ba-73cf64e0c23b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:33.618773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70a545b1-4163-42ba-93ba-73cf64e0c23b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:33.619459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70a545b1-4163-42ba-93ba-73cf64e0c23b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:33.620314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70a545b1-4163-42ba-93ba-73cf64e0c23b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:33.620867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70a545b1-4163-42ba-93ba-73cf64e0c23b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:33.627158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:34.029117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-70a545b1-4163-42ba-93ba-73cf64e0c23b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:34.045084 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-70a545b1-4163-42ba-93ba-73cf64e0c23b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0" status: 200 len: 1319 microversion: 2.1 time: 0.440394 Aug 02 07:09:34.058019 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2285/4503] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:33 2022] GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0 => generated 1319 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:34.062396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab5d2faf-259c-4cb0-938e-01f8a68656cb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:34.063173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab5d2faf-259c-4cb0-938e-01f8a68656cb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:34.077805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab5d2faf-259c-4cb0-938e-01f8a68656cb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:34.078994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab5d2faf-259c-4cb0-938e-01f8a68656cb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:34.080386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab5d2faf-259c-4cb0-938e-01f8a68656cb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:34.081052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab5d2faf-259c-4cb0-938e-01f8a68656cb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:34.312453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:34.395689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab5d2faf-259c-4cb0-938e-01f8a68656cb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:34.411426 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab5d2faf-259c-4cb0-938e-01f8a68656cb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 200 len: 1510 microversion: 2.1 time: 0.353353 Aug 02 07:09:34.412084 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2286/4504] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:34 2022] GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 1510 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:34.427320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9018a8a8-1fdc-43fe-948b-0b6db8eb2773 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:34.427320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9018a8a8-1fdc-43fe-948b-0b6db8eb2773 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:34.444047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9018a8a8-1fdc-43fe-948b-0b6db8eb2773 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:34.444745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9018a8a8-1fdc-43fe-948b-0b6db8eb2773 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:34.445751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9018a8a8-1fdc-43fe-948b-0b6db8eb2773 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:34.446484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9018a8a8-1fdc-43fe-948b-0b6db8eb2773 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:34.654813 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5caacd16-471a-41fe-8843-155fc91bdd36 tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/71be184e-9d36-4129-973e-50180642500c" status: 202 len: 0 microversion: 2.1 time: 1.539731 Aug 02 07:09:34.659212 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2219/4505] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 07:09:33 2022] DELETE /compute/v2.1/os-floating-ips/71be184e-9d36-4129-973e-50180642500c => generated 0 bytes in 1547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:09:34.673306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0ab37d4d-20e8-4b78-b87d-7584a77b8e02 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:34.674276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0ab37d4d-20e8-4b78-b87d-7584a77b8e02 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:34.687978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ab37d4d-20e8-4b78-b87d-7584a77b8e02 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:34.691486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ab37d4d-20e8-4b78-b87d-7584a77b8e02 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:34.692607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ab37d4d-20e8-4b78-b87d-7584a77b8e02 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:34.696340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ab37d4d-20e8-4b78-b87d-7584a77b8e02 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:34.728981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9018a8a8-1fdc-43fe-948b-0b6db8eb2773 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:34.740525 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9018a8a8-1fdc-43fe-948b-0b6db8eb2773 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.327364 Aug 02 07:09:34.755394 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2287/4506] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:34 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:34.760685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9dcff55d-c602-4e5d-b500-7553cb29b39a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:34.761449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9dcff55d-c602-4e5d-b500-7553cb29b39a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:34.767248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:34.768985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9dcff55d-c602-4e5d-b500-7553cb29b39a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:34.769670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9dcff55d-c602-4e5d-b500-7553cb29b39a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:34.770782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9dcff55d-c602-4e5d-b500-7553cb29b39a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:34.771387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9dcff55d-c602-4e5d-b500-7553cb29b39a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:34.802246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9dcff55d-c602-4e5d-b500-7553cb29b39a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:09:34.921310 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9dcff55d-c602-4e5d-b500-7553cb29b39a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 204 len: 0 microversion: 2.1 time: 0.164123 Aug 02 07:09:34.922301 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2288/4507] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:09:34 2022] DELETE /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:09:34.923128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0ab37d4d-20e8-4b78-b87d-7584a77b8e02 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:34.925961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:34.928893 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c30c8f82-d636-4768-a590-da53cc8c6e3e tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] Calling method '.version_select at 0x7f927a8105e0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:34.935402 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0ab37d4d-20e8-4b78-b87d-7584a77b8e02 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1656 microversion: 2.1 time: 0.270810 Aug 02 07:09:34.936663 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2220/4508] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:34 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1656 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:34.948016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-04d7a1ed-6be1-413e-99fa-539eddccc9e0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:34.950009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-04d7a1ed-6be1-413e-99fa-539eddccc9e0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:34.962283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04d7a1ed-6be1-413e-99fa-539eddccc9e0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:34.963031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04d7a1ed-6be1-413e-99fa-539eddccc9e0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:34.964278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04d7a1ed-6be1-413e-99fa-539eddccc9e0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:34.964876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04d7a1ed-6be1-413e-99fa-539eddccc9e0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:35.562645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-04d7a1ed-6be1-413e-99fa-539eddccc9e0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:35.574538 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-04d7a1ed-6be1-413e-99fa-539eddccc9e0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 200 len: 1516 microversion: 2.1 time: 0.636534 Aug 02 07:09:35.575706 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2221/4509] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:34 2022] GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 1516 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:35.580838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7e1ac4b7-3276-4b55-ad08-fc16cd8dd695 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:35.587695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e1ac4b7-3276-4b55-ad08-fc16cd8dd695 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:35.588131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e1ac4b7-3276-4b55-ad08-fc16cd8dd695 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:35.612439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7e1ac4b7-3276-4b55-ad08-fc16cd8dd695 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Going to try to start instance {{(pid=126119) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 07:09:35.669997 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7e1ac4b7-3276-4b55-ad08-fc16cd8dd695 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.092287 Aug 02 07:09:35.673001 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2222/4510] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:35 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:09:35.680243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-99373c90-6aa8-4daf-98be-9f8444ef333d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:35.681412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-99373c90-6aa8-4daf-98be-9f8444ef333d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:35.689885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99373c90-6aa8-4daf-98be-9f8444ef333d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:35.690671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99373c90-6aa8-4daf-98be-9f8444ef333d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:35.691825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99373c90-6aa8-4daf-98be-9f8444ef333d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:35.692865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99373c90-6aa8-4daf-98be-9f8444ef333d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:35.992054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-99373c90-6aa8-4daf-98be-9f8444ef333d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:36.005834 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-99373c90-6aa8-4daf-98be-9f8444ef333d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0" status: 200 len: 1319 microversion: 2.1 time: 0.331079 Aug 02 07:09:36.014657 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2223/4511] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:35 2022] GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:36.020409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c8704f86-0376-4b04-b866-7f1bac229fc0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:36.022395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c8704f86-0376-4b04-b866-7f1bac229fc0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:36.032559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8704f86-0376-4b04-b866-7f1bac229fc0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:36.033368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8704f86-0376-4b04-b866-7f1bac229fc0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:36.034447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8704f86-0376-4b04-b866-7f1bac229fc0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:36.035080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8704f86-0376-4b04-b866-7f1bac229fc0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:36.279300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c8704f86-0376-4b04-b866-7f1bac229fc0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:36.307204 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c8704f86-0376-4b04-b866-7f1bac229fc0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1665 microversion: 2.1 time: 0.290686 Aug 02 07:09:36.312867 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2224/4512] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:36 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1665 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:36.336437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bbda9647-bfed-4b5b-a981-059304ebbbef tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:36.347141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bbda9647-bfed-4b5b-a981-059304ebbbef tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:36.360317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbda9647-bfed-4b5b-a981-059304ebbbef tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:36.362944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbda9647-bfed-4b5b-a981-059304ebbbef tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:36.364057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbda9647-bfed-4b5b-a981-059304ebbbef tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:36.367500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbda9647-bfed-4b5b-a981-059304ebbbef tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:36.825805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bbda9647-bfed-4b5b-a981-059304ebbbef tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:36.837439 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bbda9647-bfed-4b5b-a981-059304ebbbef tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.522609 Aug 02 07:09:36.842940 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2225/4513] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:36 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:36.853772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-37d59b9c-78da-46d3-86af-9db851ffb04d req-b2cce2d7-5b96-46ca-88b6-990fb91adda5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9cce51-3636-4177-ae1a-6439b8273ff0", "name": "network-vif-plugged", "status": "completed", "tag": "869bd5e2-d110-49ca-ac08-aed58db97575"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:36.874471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-37d59b9c-78da-46d3-86af-9db851ffb04d req-b2cce2d7-5b96-46ca-88b6-990fb91adda5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:36.874856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-37d59b9c-78da-46d3-86af-9db851ffb04d req-b2cce2d7-5b96-46ca-88b6-990fb91adda5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:36.896010 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-37d59b9c-78da-46d3-86af-9db851ffb04d req-b2cce2d7-5b96-46ca-88b6-990fb91adda5 service nova] Creating event network-vif-plugged:869bd5e2-d110-49ca-ac08-aed58db97575 for instance df9cce51-3636-4177-ae1a-6439b8273ff0 on n-h2-851337-3 Aug 02 07:09:36.902067 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-37d59b9c-78da-46d3-86af-9db851ffb04d req-b2cce2d7-5b96-46ca-88b6-990fb91adda5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057665 Aug 02 07:09:36.907126 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2226/4514] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:36.913449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1de31570-90cf-43c4-9227-79439be8b990 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:36.914173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1de31570-90cf-43c4-9227-79439be8b990 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:36.921612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1de31570-90cf-43c4-9227-79439be8b990 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:36.922281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1de31570-90cf-43c4-9227-79439be8b990 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:36.923251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1de31570-90cf-43c4-9227-79439be8b990 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:36.924366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1de31570-90cf-43c4-9227-79439be8b990 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:36.975027 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c30c8f82-d636-4768-a590-da53cc8c6e3e tempest-FloatingIPDetailsTestJSON-1279087269 tempest-FloatingIPDetailsTestJSON-1279087269-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/0c12c5f3-4be7-4810-a0ee-4bdb46863fc5" status: 202 len: 0 microversion: 2.1 time: 2.051548 Aug 02 07:09:36.979066 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2289/4515] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 07:09:34 2022] DELETE /compute/v2.1/os-floating-ips/0c12c5f3-4be7-4810-a0ee-4bdb46863fc5 => generated 0 bytes in 2056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:09:37.030688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4ac031d0-8f49-4d20-86bb-de8edecd49ef tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:37.031748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4ac031d0-8f49-4d20-86bb-de8edecd49ef tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:37.052644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ac031d0-8f49-4d20-86bb-de8edecd49ef tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:37.054567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ac031d0-8f49-4d20-86bb-de8edecd49ef tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:37.055401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ac031d0-8f49-4d20-86bb-de8edecd49ef tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:37.056052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ac031d0-8f49-4d20-86bb-de8edecd49ef tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:37.386371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1de31570-90cf-43c4-9227-79439be8b990 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:37.398506 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1de31570-90cf-43c4-9227-79439be8b990 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 200 len: 1516 microversion: 2.1 time: 0.489979 Aug 02 07:09:37.412786 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2227/4516] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:36 2022] GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 1516 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:37.424441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-410b3e21-6f48-461f-bb1c-395216027590 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:37.429742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-410b3e21-6f48-461f-bb1c-395216027590 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:37.442677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-410b3e21-6f48-461f-bb1c-395216027590 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:37.443960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-410b3e21-6f48-461f-bb1c-395216027590 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:37.445577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-410b3e21-6f48-461f-bb1c-395216027590 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:37.446327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-410b3e21-6f48-461f-bb1c-395216027590 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:37.503659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4ac031d0-8f49-4d20-86bb-de8edecd49ef tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:37.512663 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4ac031d0-8f49-4d20-86bb-de8edecd49ef tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0" status: 200 len: 1319 microversion: 2.1 time: 0.487223 Aug 02 07:09:37.513251 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2290/4517] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:37 2022] GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0 => generated 1319 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:37.868197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e3ab3bda-f8d6-4a81-af1f-64664c2a6c4b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:37.868837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e3ab3bda-f8d6-4a81-af1f-64664c2a6c4b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:37.876627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3ab3bda-f8d6-4a81-af1f-64664c2a6c4b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:37.877078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3ab3bda-f8d6-4a81-af1f-64664c2a6c4b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:37.877879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3ab3bda-f8d6-4a81-af1f-64664c2a6c4b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:37.878688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e3ab3bda-f8d6-4a81-af1f-64664c2a6c4b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:37.895955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-410b3e21-6f48-461f-bb1c-395216027590 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:37.920900 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-410b3e21-6f48-461f-bb1c-395216027590 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1665 microversion: 2.1 time: 0.501105 Aug 02 07:09:37.922927 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2228/4518] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:37 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1665 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:37.945530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-d2aec498-a81d-4f24-97c3-c478393a94e6 req-0d7ec24b-b648-4496-9600-f0744360196d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420aa836-056a-4683-88ee-378b568df42e", "name": "network-vif-deleted", "tag": "58dd43a8-fc53-44c7-bec0-dfa0ac209fa1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:37.956673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d2aec498-a81d-4f24-97c3-c478393a94e6 req-0d7ec24b-b648-4496-9600-f0744360196d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:37.957317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d2aec498-a81d-4f24-97c3-c478393a94e6 req-0d7ec24b-b648-4496-9600-f0744360196d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:37.973853 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-d2aec498-a81d-4f24-97c3-c478393a94e6 req-0d7ec24b-b648-4496-9600-f0744360196d service nova] Creating event network-vif-deleted:58dd43a8-fc53-44c7-bec0-dfa0ac209fa1 for instance 420aa836-056a-4683-88ee-378b568df42e on n-h2-851337-3 Aug 02 07:09:37.980845 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-d2aec498-a81d-4f24-97c3-c478393a94e6 req-0d7ec24b-b648-4496-9600-f0744360196d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039221 Aug 02 07:09:37.981756 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2229/4519] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:09:38.122308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1370855310", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "0f932d94-41ef-4c60-8453-56767fa92bd8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1804463986", "security_groups": [{"name": "tempest-secgroup-smoke-2084750099"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:38.268583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e3ab3bda-f8d6-4a81-af1f-64664c2a6c4b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:38.276635 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e3ab3bda-f8d6-4a81-af1f-64664c2a6c4b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.417012 Aug 02 07:09:38.277220 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2291/4520] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:37 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:38.357800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] validate_networks() for [('0f932d94-41ef-4c60-8453-56767fa92bd8', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:09:38.426757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-42799212-bab7-4925-ac23-76f5ec019c30 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:38.427599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-42799212-bab7-4925-ac23-76f5ec019c30 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:38.441500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42799212-bab7-4925-ac23-76f5ec019c30 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:38.441973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42799212-bab7-4925-ac23-76f5ec019c30 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:38.442691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42799212-bab7-4925-ac23-76f5ec019c30 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:38.446680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42799212-bab7-4925-ac23-76f5ec019c30 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:38.526169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42799212-bab7-4925-ac23-76f5ec019c30 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:38.527250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42799212-bab7-4925-ac23-76f5ec019c30 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:38.527904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-42799212-bab7-4925-ac23-76f5ec019c30 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lazy-loading 'fault' on Instance uuid 420aa836-056a-4683-88ee-378b568df42e {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:09:38.662365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-42799212-bab7-4925-ac23-76f5ec019c30 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:38.699056 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-42799212-bab7-4925-ac23-76f5ec019c30 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 200 len: 1320 microversion: 2.1 time: 0.276820 Aug 02 07:09:38.704091 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2292/4521] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:38 2022] GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 1320 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:38.709583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5eb0fc40-2d14-4bf2-9ccf-bf00e04d778e tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:38.710626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5eb0fc40-2d14-4bf2-9ccf-bf00e04d778e tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:38.718864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5eb0fc40-2d14-4bf2-9ccf-bf00e04d778e tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:38.719714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5eb0fc40-2d14-4bf2-9ccf-bf00e04d778e tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:38.722906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5eb0fc40-2d14-4bf2-9ccf-bf00e04d778e tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:38.724334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5eb0fc40-2d14-4bf2-9ccf-bf00e04d778e tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:39.220793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5eb0fc40-2d14-4bf2-9ccf-bf00e04d778e tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:39.229737 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5eb0fc40-2d14-4bf2-9ccf-bf00e04d778e tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0" status: 200 len: 1507 microversion: 2.1 time: 0.524075 Aug 02 07:09:39.236688 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2293/4522] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:38 2022] GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0 => generated 1507 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:39.242040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6f7d20c4-8250-4ce1-8b39-83a1b508d2e4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:39.244996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6f7d20c4-8250-4ce1-8b39-83a1b508d2e4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:39.260893 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f7d20c4-8250-4ce1-8b39-83a1b508d2e4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:39.262406 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f7d20c4-8250-4ce1-8b39-83a1b508d2e4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:39.263215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f7d20c4-8250-4ce1-8b39-83a1b508d2e4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:39.263650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f7d20c4-8250-4ce1-8b39-83a1b508d2e4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:40.005178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6f7d20c4-8250-4ce1-8b39-83a1b508d2e4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:40.016572 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6f7d20c4-8250-4ce1-8b39-83a1b508d2e4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.777092 Aug 02 07:09:40.017959 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2294/4523] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:39 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:40.023043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7a111e56-1019-4535-be64-5abaf4c415a3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:40.024155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7a111e56-1019-4535-be64-5abaf4c415a3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:40.029039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:09:40.029611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:09:40.029913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:09:40.030505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:09:40.031106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:09:40.032187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a111e56-1019-4535-be64-5abaf4c415a3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:40.033716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a111e56-1019-4535-be64-5abaf4c415a3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:40.037132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a111e56-1019-4535-be64-5abaf4c415a3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:40.038371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a111e56-1019-4535-be64-5abaf4c415a3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:40.047606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:40.049703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:40.052305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:40.053338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:40.099468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for project bfa05afa69e04974ad3de049c511c674. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:09:40.108412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for user a44367c6be00413eb7b6c79272448cf4 and project bfa05afa69e04974ad3de049c511c674. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:09:40.128467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:09:40.131046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:09:40.153152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=10 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:40.249464 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a6fd6c1b-fe93-48d9-a303-22864047f566 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.131509 Aug 02 07:09:40.263304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7a111e56-1019-4535-be64-5abaf4c415a3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:40.274869 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2230/4524] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:09:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:09:40.282460 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7a111e56-1019-4535-be64-5abaf4c415a3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.259278 Aug 02 07:09:40.330267 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2295/4525] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:40 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:40.335359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5385d1cb-7d81-4c55-9983-572afb06c97f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:40.336115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5385d1cb-7d81-4c55-9983-572afb06c97f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:40.344214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2969b4d4-75b3-43e1-91e4-11e2b3055ea8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:40.348318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2969b4d4-75b3-43e1-91e4-11e2b3055ea8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:40.362120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2969b4d4-75b3-43e1-91e4-11e2b3055ea8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:40.362637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2969b4d4-75b3-43e1-91e4-11e2b3055ea8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:40.363525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2969b4d4-75b3-43e1-91e4-11e2b3055ea8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:40.364191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2969b4d4-75b3-43e1-91e4-11e2b3055ea8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:40.381442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5385d1cb-7d81-4c55-9983-572afb06c97f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:40.381959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5385d1cb-7d81-4c55-9983-572afb06c97f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:40.382718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5385d1cb-7d81-4c55-9983-572afb06c97f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:40.388740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5385d1cb-7d81-4c55-9983-572afb06c97f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:40.429265 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-2969b4d4-75b3-43e1-91e4-11e2b3055ea8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2969b4d4-75b3-43e1-91e4-11e2b3055ea8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e HTTP/1.1 Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '420aa836-056a-4683-88ee-378b568df42e'} Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:09:40.431780 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:40.436608 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:40.436608 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:09:40.436608 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:09:40.436608 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:09:40.436608 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:09:40.436608 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:09:40.436608 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:40.439191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2969b4d4-75b3-43e1-91e4-11e2b3055ea8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:09:40.441181 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2969b4d4-75b3-43e1-91e4-11e2b3055ea8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 404 len: 111 microversion: 2.1 time: 0.165320 Aug 02 07:09:40.456315 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2231/4526] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:40 2022] GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:09:40.456315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b5b68a20-3738-4cd6-b0ac-15296e64ca28 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:40.456315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b5b68a20-3738-4cd6-b0ac-15296e64ca28 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:40.763125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b5b68a20-3738-4cd6-b0ac-15296e64ca28 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:40.776359 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b5b68a20-3738-4cd6-b0ac-15296e64ca28 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1267 microversion: 2.1 time: 0.328507 Aug 02 07:09:40.777062 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2232/4527] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:40 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1267 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:40.784518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-712140337", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:40.873481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5385d1cb-7d81-4c55-9983-572afb06c97f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:40.892904 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5385d1cb-7d81-4c55-9983-572afb06c97f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.561155 Aug 02 07:09:40.898162 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2296/4528] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:40 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:40.919913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] validate_networks() for [('ebbaf7b3-a3cf-4cd7-9dfe-08fcc8416243', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:09:40.921096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4e1ae84e-b1b8-4e78-b8fe-f36da395c718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:40.921650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4e1ae84e-b1b8-4e78-b8fe-f36da395c718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:40.932054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e1ae84e-b1b8-4e78-b8fe-f36da395c718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:40.932577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e1ae84e-b1b8-4e78-b8fe-f36da395c718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:40.933372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e1ae84e-b1b8-4e78-b8fe-f36da395c718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:40.933814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e1ae84e-b1b8-4e78-b8fe-f36da395c718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:41.022254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4e1ae84e-b1b8-4e78-b8fe-f36da395c718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Unlocking {{(pid=126120) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 02 07:09:41.121993 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4e1ae84e-b1b8-4e78-b8fe-f36da395c718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.205937 Aug 02 07:09:41.129787 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2297/4529] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:40 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:09:41.136245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6ed5322-8a84-4525-8537-b54bc09fd1c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:41.137305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d6ed5322-8a84-4525-8537-b54bc09fd1c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:41.144471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6ed5322-8a84-4525-8537-b54bc09fd1c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:41.144917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6ed5322-8a84-4525-8537-b54bc09fd1c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:41.145935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6ed5322-8a84-4525-8537-b54bc09fd1c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:41.146466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6ed5322-8a84-4525-8537-b54bc09fd1c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:41.174361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:41.560923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d6ed5322-8a84-4525-8537-b54bc09fd1c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:41.573059 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d6ed5322-8a84-4525-8537-b54bc09fd1c4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.441290 Aug 02 07:09:41.574200 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2298/4530] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:41 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:41.580593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d5d936c3-3a81-4848-b28b-1eb7c2570776 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:41.581425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d5d936c3-3a81-4848-b28b-1eb7c2570776 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:41.595416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d5d936c3-3a81-4848-b28b-1eb7c2570776 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:41.595929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d5d936c3-3a81-4848-b28b-1eb7c2570776 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:41.599916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d5d936c3-3a81-4848-b28b-1eb7c2570776 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:41.600368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d5d936c3-3a81-4848-b28b-1eb7c2570776 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:42.036103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d5d936c3-3a81-4848-b28b-1eb7c2570776 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:42.047799 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d5d936c3-3a81-4848-b28b-1eb7c2570776 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.472333 Aug 02 07:09:42.063990 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2299/4531] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:41 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:42.074727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c545546e-f207-4fde-9960-3ed57411fcc5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:42.079112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c545546e-f207-4fde-9960-3ed57411fcc5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:42.111482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c545546e-f207-4fde-9960-3ed57411fcc5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:42.112159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c545546e-f207-4fde-9960-3ed57411fcc5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:42.116379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c545546e-f207-4fde-9960-3ed57411fcc5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:42.116840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c545546e-f207-4fde-9960-3ed57411fcc5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:42.382907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:09:42.384529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:09:42.385225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:09:42.386116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:09:42.386789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:09:42.399450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:42.400431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:42.402183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:42.402855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:42.429665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:09:42.438495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Getting quotas for user 0971d7961d5a4e8996ea2c0f958382ad and project da31144cd8b94b76821c8a01029ffb37. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:09:42.465004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:09:42.467456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:09:42.572130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c545546e-f207-4fde-9960-3ed57411fcc5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:42.589047 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c545546e-f207-4fde-9960-3ed57411fcc5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.523472 Aug 02 07:09:42.605870 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f945339a-24c6-4314-a579-160f92da5330 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.819576 Aug 02 07:09:42.608934 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2300/4532] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:42 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:42.609645 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2233/4533] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:09:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:09:42.623461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f3d2786-ac07-4502-a587-2d3ccbf3661a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:42.625958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4f3d2786-ac07-4502-a587-2d3ccbf3661a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:42.630032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c2517bee-468f-4038-b158-72781d224836 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:42.631037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c2517bee-468f-4038-b158-72781d224836 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:42.643974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2517bee-468f-4038-b158-72781d224836 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:42.646607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2517bee-468f-4038-b158-72781d224836 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:42.648789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2517bee-468f-4038-b158-72781d224836 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:42.649582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2517bee-468f-4038-b158-72781d224836 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:42.658008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f3d2786-ac07-4502-a587-2d3ccbf3661a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:42.658487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f3d2786-ac07-4502-a587-2d3ccbf3661a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:42.659316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f3d2786-ac07-4502-a587-2d3ccbf3661a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:42.659759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f3d2786-ac07-4502-a587-2d3ccbf3661a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:42.843032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4f3d2786-ac07-4502-a587-2d3ccbf3661a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:42.858059 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4f3d2786-ac07-4502-a587-2d3ccbf3661a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1325 microversion: 2.1 time: 0.247799 Aug 02 07:09:42.859190 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2301/4534] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:42 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1325 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:42.871426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f5a3556e-abd1-4301-8853-de772025d9a9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:42.872061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f5a3556e-abd1-4301-8853-de772025d9a9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:43.101377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f5a3556e-abd1-4301-8853-de772025d9a9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:43.110912 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f5a3556e-abd1-4301-8853-de772025d9a9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1208 microversion: 2.1 time: 0.249968 Aug 02 07:09:43.115968 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2302/4535] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:42 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1208 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:43.126619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c2d3c34e-23de-4b19-827f-efb735a47707 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:43.130777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c2d3c34e-23de-4b19-827f-efb735a47707 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:43.143078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2d3c34e-23de-4b19-827f-efb735a47707 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:43.143782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c2517bee-468f-4038-b158-72781d224836 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:43.144262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2d3c34e-23de-4b19-827f-efb735a47707 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:43.145332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2d3c34e-23de-4b19-827f-efb735a47707 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:43.145958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2d3c34e-23de-4b19-827f-efb735a47707 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:43.158575 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c2517bee-468f-4038-b158-72781d224836 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.547741 Aug 02 07:09:43.159186 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2234/4536] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:42 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:43.186041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-878969e0-bae4-452b-a03a-de93e6baf9e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:43.186971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-878969e0-bae4-452b-a03a-de93e6baf9e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:43.200631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-878969e0-bae4-452b-a03a-de93e6baf9e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:43.208121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-878969e0-bae4-452b-a03a-de93e6baf9e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:43.210692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-878969e0-bae4-452b-a03a-de93e6baf9e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:43.213068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-878969e0-bae4-452b-a03a-de93e6baf9e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:43.407595 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-878969e0-bae4-452b-a03a-de93e6baf9e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.232137 Aug 02 07:09:43.408540 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2235/4537] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:43 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:09:43.418329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2335e455-f6d6-495f-8031-eb9417262c90 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:43.419559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2335e455-f6d6-495f-8031-eb9417262c90 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:43.427754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2335e455-f6d6-495f-8031-eb9417262c90 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:43.429148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2335e455-f6d6-495f-8031-eb9417262c90 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:43.432986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c2d3c34e-23de-4b19-827f-efb735a47707 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:43.434298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2335e455-f6d6-495f-8031-eb9417262c90 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:43.435442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2335e455-f6d6-495f-8031-eb9417262c90 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:43.450324 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c2d3c34e-23de-4b19-827f-efb735a47707 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.330923 Aug 02 07:09:43.462087 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2303/4538] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:43 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:43.879994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-91829480-b332-45e5-92f5-a86f040ae6f4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:43.880614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-91829480-b332-45e5-92f5-a86f040ae6f4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:43.892612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91829480-b332-45e5-92f5-a86f040ae6f4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:43.892984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91829480-b332-45e5-92f5-a86f040ae6f4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:43.900414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91829480-b332-45e5-92f5-a86f040ae6f4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:43.901479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91829480-b332-45e5-92f5-a86f040ae6f4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:43.928411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2335e455-f6d6-495f-8031-eb9417262c90 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:43.942390 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2335e455-f6d6-495f-8031-eb9417262c90 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1674 microversion: 2.1 time: 0.526105 Aug 02 07:09:43.943042 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2236/4539] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:43 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1674 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:44.013863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-91829480-b332-45e5-92f5-a86f040ae6f4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:44.032491 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-91829480-b332-45e5-92f5-a86f040ae6f4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1325 microversion: 2.1 time: 0.156566 Aug 02 07:09:44.043863 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2304/4540] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:43 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1325 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:44.137053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79180edd-28fe-4654-8ccb-ad45072e1936 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:44.138627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79180edd-28fe-4654-8ccb-ad45072e1936 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:44.147328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79180edd-28fe-4654-8ccb-ad45072e1936 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:44.148237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79180edd-28fe-4654-8ccb-ad45072e1936 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:44.149349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79180edd-28fe-4654-8ccb-ad45072e1936 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:44.150147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79180edd-28fe-4654-8ccb-ad45072e1936 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:44.268763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79180edd-28fe-4654-8ccb-ad45072e1936 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:44.280497 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79180edd-28fe-4654-8ccb-ad45072e1936 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1260 microversion: 2.1 time: 0.147322 Aug 02 07:09:44.293968 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2237/4541] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:44 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:44.473571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b252b04e-7a7f-4919-8a62-fb444f1a8a81 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:44.474237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b252b04e-7a7f-4919-8a62-fb444f1a8a81 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:44.486826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b252b04e-7a7f-4919-8a62-fb444f1a8a81 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:44.487304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b252b04e-7a7f-4919-8a62-fb444f1a8a81 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:44.488120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b252b04e-7a7f-4919-8a62-fb444f1a8a81 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:44.490530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b252b04e-7a7f-4919-8a62-fb444f1a8a81 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:44.983810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d793ec9e-9f7f-4253-a6c4-67e9f39d38ae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:44.985234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d793ec9e-9f7f-4253-a6c4-67e9f39d38ae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:44.998054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d793ec9e-9f7f-4253-a6c4-67e9f39d38ae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:44.998955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d793ec9e-9f7f-4253-a6c4-67e9f39d38ae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:45.000243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d793ec9e-9f7f-4253-a6c4-67e9f39d38ae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:45.004553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d793ec9e-9f7f-4253-a6c4-67e9f39d38ae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:45.010108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b252b04e-7a7f-4919-8a62-fb444f1a8a81 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:45.030259 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b252b04e-7a7f-4919-8a62-fb444f1a8a81 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.552605 Aug 02 07:09:45.031426 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2305/4542] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:44 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:45.056687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cea9f395-624e-464c-ac0b-d8fa4ca7fbe0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:45.057767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cea9f395-624e-464c-ac0b-d8fa4ca7fbe0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:45.065188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cea9f395-624e-464c-ac0b-d8fa4ca7fbe0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:45.076071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cea9f395-624e-464c-ac0b-d8fa4ca7fbe0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:45.077557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cea9f395-624e-464c-ac0b-d8fa4ca7fbe0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:45.078438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cea9f395-624e-464c-ac0b-d8fa4ca7fbe0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:45.559946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cea9f395-624e-464c-ac0b-d8fa4ca7fbe0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:45.567951 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cea9f395-624e-464c-ac0b-d8fa4ca7fbe0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1393 microversion: 2.1 time: 0.515132 Aug 02 07:09:45.569081 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2306/4543] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:45 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1393 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:45.573834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-26490b44-ae6e-42eb-be9b-b38c495096e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:45.574700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-26490b44-ae6e-42eb-be9b-b38c495096e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:45.576342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d793ec9e-9f7f-4253-a6c4-67e9f39d38ae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:45.581049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26490b44-ae6e-42eb-be9b-b38c495096e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:45.582190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26490b44-ae6e-42eb-be9b-b38c495096e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:45.582580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26490b44-ae6e-42eb-be9b-b38c495096e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:45.583011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26490b44-ae6e-42eb-be9b-b38c495096e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:45.589379 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d793ec9e-9f7f-4253-a6c4-67e9f39d38ae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1654 microversion: 2.1 time: 0.609583 Aug 02 07:09:45.601930 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2238/4544] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:44 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1654 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:45.621260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3bf528d4-02ca-4296-bed3-b38ad42e126c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:45.623041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3bf528d4-02ca-4296-bed3-b38ad42e126c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:45.640731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bf528d4-02ca-4296-bed3-b38ad42e126c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:45.642370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bf528d4-02ca-4296-bed3-b38ad42e126c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:45.644697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bf528d4-02ca-4296-bed3-b38ad42e126c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:45.645266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bf528d4-02ca-4296-bed3-b38ad42e126c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:45.682024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:45.721996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-26490b44-ae6e-42eb-be9b-b38c495096e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:45.734441 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-26490b44-ae6e-42eb-be9b-b38c495096e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1266 microversion: 2.1 time: 0.163917 Aug 02 07:09:45.735171 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2307/4545] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:45 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:45.743414 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3bf528d4-02ca-4296-bed3-b38ad42e126c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.125742 Aug 02 07:09:45.744525 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2239/4546] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:09:45 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:09:45.753429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5266fe98-b2b6-4295-a6fc-953076b4c3cb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:45.754119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5266fe98-b2b6-4295-a6fc-953076b4c3cb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:45.767826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5266fe98-b2b6-4295-a6fc-953076b4c3cb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:45.768281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5266fe98-b2b6-4295-a6fc-953076b4c3cb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:45.769116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5266fe98-b2b6-4295-a6fc-953076b4c3cb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:45.772776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5266fe98-b2b6-4295-a6fc-953076b4c3cb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:46.055621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-279daafa-aa42-45d6-b93e-5e17ec629336 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:46.057861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-279daafa-aa42-45d6-b93e-5e17ec629336 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:46.080637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-279daafa-aa42-45d6-b93e-5e17ec629336 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:46.081709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-279daafa-aa42-45d6-b93e-5e17ec629336 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:46.082830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-279daafa-aa42-45d6-b93e-5e17ec629336 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:46.083516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-279daafa-aa42-45d6-b93e-5e17ec629336 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:46.534985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5266fe98-b2b6-4295-a6fc-953076b4c3cb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:46.560190 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5266fe98-b2b6-4295-a6fc-953076b4c3cb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1661 microversion: 2.1 time: 0.808998 Aug 02 07:09:46.560862 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2308/4547] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:45 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1661 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:46.588990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-801d95b8-9ab6-4e4c-9341-4472a61df5c5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:46.589612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-801d95b8-9ab6-4e4c-9341-4472a61df5c5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:46.597154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-801d95b8-9ab6-4e4c-9341-4472a61df5c5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:46.597918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-801d95b8-9ab6-4e4c-9341-4472a61df5c5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:46.598895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-801d95b8-9ab6-4e4c-9341-4472a61df5c5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:46.599493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-801d95b8-9ab6-4e4c-9341-4472a61df5c5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:46.662091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-279daafa-aa42-45d6-b93e-5e17ec629336 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:46.681337 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-279daafa-aa42-45d6-b93e-5e17ec629336 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.629990 Aug 02 07:09:46.689111 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2240/4548] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:46 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:46.698767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-dc715271-45f5-47d4-b473-4f97d8e0a360 req-d437f9ef-e0d0-4b95-a5c3-26ea8440cea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a5964c-4da3-4792-9d53-9c7a77632724", "tag": "a4d951c8-7fd6-4964-b8d1-fffe96300cc7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:46.739218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-dc715271-45f5-47d4-b473-4f97d8e0a360 req-d437f9ef-e0d0-4b95-a5c3-26ea8440cea9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:46.739694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-dc715271-45f5-47d4-b473-4f97d8e0a360 req-d437f9ef-e0d0-4b95-a5c3-26ea8440cea9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:46.759499 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-dc715271-45f5-47d4-b473-4f97d8e0a360 req-d437f9ef-e0d0-4b95-a5c3-26ea8440cea9 service nova] Creating event network-changed:a4d951c8-7fd6-4964-b8d1-fffe96300cc7 for instance e9a5964c-4da3-4792-9d53-9c7a77632724 on n-h2-851337-3 Aug 02 07:09:46.772837 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-dc715271-45f5-47d4-b473-4f97d8e0a360 req-d437f9ef-e0d0-4b95-a5c3-26ea8440cea9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079166 Aug 02 07:09:46.782820 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2241/4549] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:46.805051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-958a1f98-15a8-4d17-8dbd-455de917ecb1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:46.806473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-958a1f98-15a8-4d17-8dbd-455de917ecb1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:46.820933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-958a1f98-15a8-4d17-8dbd-455de917ecb1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:46.821512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-958a1f98-15a8-4d17-8dbd-455de917ecb1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:46.833354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-958a1f98-15a8-4d17-8dbd-455de917ecb1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:46.834140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-958a1f98-15a8-4d17-8dbd-455de917ecb1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:47.215188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-801d95b8-9ab6-4e4c-9341-4472a61df5c5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:47.228186 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-801d95b8-9ab6-4e4c-9341-4472a61df5c5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1393 microversion: 2.1 time: 0.643138 Aug 02 07:09:47.241264 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2309/4550] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:46 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1393 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:47.326813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-958a1f98-15a8-4d17-8dbd-455de917ecb1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:47.341276 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-958a1f98-15a8-4d17-8dbd-455de917ecb1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1308 microversion: 2.1 time: 0.554157 Aug 02 07:09:47.354774 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2242/4551] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:46 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1308 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:47.407940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ea43edf8-e05b-4042-9dd5-fcc43ea45584 req-b728f750-8de4-4cfe-8724-44ab8fc9c559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45bacc58-d131-4b47-8082-8d441784de01", "tag": "d83c518f-7e01-4928-a463-48a408186564"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:47.430437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ea43edf8-e05b-4042-9dd5-fcc43ea45584 req-b728f750-8de4-4cfe-8724-44ab8fc9c559 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:47.430867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ea43edf8-e05b-4042-9dd5-fcc43ea45584 req-b728f750-8de4-4cfe-8724-44ab8fc9c559 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:47.461126 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ea43edf8-e05b-4042-9dd5-fcc43ea45584 req-b728f750-8de4-4cfe-8724-44ab8fc9c559 service nova] Creating event network-changed:d83c518f-7e01-4928-a463-48a408186564 for instance 45bacc58-d131-4b47-8082-8d441784de01 on n-h1-851337-3 Aug 02 07:09:47.473368 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ea43edf8-e05b-4042-9dd5-fcc43ea45584 req-b728f750-8de4-4cfe-8724-44ab8fc9c559 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071436 Aug 02 07:09:47.475079 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2310/4552] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:09:47.581709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b5b1418d-2d10-4ee9-91e1-6cc9e612a67c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:47.582341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b5b1418d-2d10-4ee9-91e1-6cc9e612a67c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:47.590116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5b1418d-2d10-4ee9-91e1-6cc9e612a67c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:47.590561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5b1418d-2d10-4ee9-91e1-6cc9e612a67c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:47.595746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5b1418d-2d10-4ee9-91e1-6cc9e612a67c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:47.597735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5b1418d-2d10-4ee9-91e1-6cc9e612a67c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:47.714796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d989a3b4-4b2b-46c7-849a-3824ed1ef148 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:47.715644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d989a3b4-4b2b-46c7-849a-3824ed1ef148 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:47.725691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d989a3b4-4b2b-46c7-849a-3824ed1ef148 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:47.727299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d989a3b4-4b2b-46c7-849a-3824ed1ef148 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:47.728105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d989a3b4-4b2b-46c7-849a-3824ed1ef148 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:47.728548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d989a3b4-4b2b-46c7-849a-3824ed1ef148 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:47.879641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b5b1418d-2d10-4ee9-91e1-6cc9e612a67c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:47.892679 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b5b1418d-2d10-4ee9-91e1-6cc9e612a67c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.314371 Aug 02 07:09:47.893877 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2243/4553] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:47 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:47.921430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-63001485-654b-4da6-8aea-9db1ff261246 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:47.924285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-63001485-654b-4da6-8aea-9db1ff261246 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:47.936937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63001485-654b-4da6-8aea-9db1ff261246 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:47.937552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63001485-654b-4da6-8aea-9db1ff261246 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:47.939611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63001485-654b-4da6-8aea-9db1ff261246 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:47.940432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63001485-654b-4da6-8aea-9db1ff261246 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:47.965412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d989a3b4-4b2b-46c7-849a-3824ed1ef148 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:47.983999 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d989a3b4-4b2b-46c7-849a-3824ed1ef148 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.277404 Aug 02 07:09:47.988218 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2311/4554] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:47 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:48.147526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-63001485-654b-4da6-8aea-9db1ff261246 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:48.158643 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-63001485-654b-4da6-8aea-9db1ff261246 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.248568 Aug 02 07:09:48.159594 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2244/4555] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:47 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:48.185227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ad3c5cca-adc9-4290-93c9-ef2eb90ab726 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:48.186175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ad3c5cca-adc9-4290-93c9-ef2eb90ab726 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:48.192848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ad3c5cca-adc9-4290-93c9-ef2eb90ab726 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:48.193529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ad3c5cca-adc9-4290-93c9-ef2eb90ab726 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:48.194571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ad3c5cca-adc9-4290-93c9-ef2eb90ab726 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:48.196013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ad3c5cca-adc9-4290-93c9-ef2eb90ab726 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:48.216844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab16c863-1841-4ce6-9438-c1897fd7fa57 tempest-AbsoluteLimitsNegativeTestJSON-1109185593 tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project] Calling method '.version_select at 0x7f9289a6b8b0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:48.230955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab16c863-1841-4ce6-9438-c1897fd7fa57 tempest-AbsoluteLimitsNegativeTestJSON-1109185593 tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:48.231709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab16c863-1841-4ce6-9438-c1897fd7fa57 tempest-AbsoluteLimitsNegativeTestJSON-1109185593 tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:48.232700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab16c863-1841-4ce6-9438-c1897fd7fa57 tempest-AbsoluteLimitsNegativeTestJSON-1109185593 tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:48.233132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab16c863-1841-4ce6-9438-c1897fd7fa57 tempest-AbsoluteLimitsNegativeTestJSON-1109185593 tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:48.256214 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab16c863-1841-4ce6-9438-c1897fd7fa57 tempest-AbsoluteLimitsNegativeTestJSON-1109185593 tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project] 10.222.0.79 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.220023 Aug 02 07:09:48.257467 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2312/4556] 10.222.0.79 () {58 vars in 1122 bytes} [Tue Aug 2 07:09:48 2022] GET /compute/v2.1/limits => generated 511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:09:48.274049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-80e2d9e2-4f7e-4eb8-ae06-adcf9292638f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:48.275563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-80e2d9e2-4f7e-4eb8-ae06-adcf9292638f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:48.287033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80e2d9e2-4f7e-4eb8-ae06-adcf9292638f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:48.288155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80e2d9e2-4f7e-4eb8-ae06-adcf9292638f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:48.289434 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80e2d9e2-4f7e-4eb8-ae06-adcf9292638f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:48.290402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80e2d9e2-4f7e-4eb8-ae06-adcf9292638f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:48.382697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ad3c5cca-adc9-4290-93c9-ef2eb90ab726 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:48.391736 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ad3c5cca-adc9-4290-93c9-ef2eb90ab726 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.211606 Aug 02 07:09:48.393076 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2245/4557] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:48 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:48.401467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ce62020b-3e99-4a80-9b82-b4b7b57799f1 tempest-AbsoluteLimitsNegativeTestJSON-1109185593 tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1834653759", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:48.421856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:48.484710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-ce62020b-3e99-4a80-9b82-b4b7b57799f1 tempest-AbsoluteLimitsNegativeTestJSON-1109185593 tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:09:48.494081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-80e2d9e2-4f7e-4eb8-ae06-adcf9292638f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:48.502425 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-80e2d9e2-4f7e-4eb8-ae06-adcf9292638f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1393 microversion: 2.1 time: 0.243695 Aug 02 07:09:48.503619 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2313/4558] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:48 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1393 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:48.512794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5b09cd51-2737-419e-8622-c71efd02a11b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:48.514826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5b09cd51-2737-419e-8622-c71efd02a11b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:48.522651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b09cd51-2737-419e-8622-c71efd02a11b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:48.523363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b09cd51-2737-419e-8622-c71efd02a11b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:48.524433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b09cd51-2737-419e-8622-c71efd02a11b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:48.524874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b09cd51-2737-419e-8622-c71efd02a11b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:48.930780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5b09cd51-2737-419e-8622-c71efd02a11b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:48.943264 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5b09cd51-2737-419e-8622-c71efd02a11b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1308 microversion: 2.1 time: 0.438238 Aug 02 07:09:48.945928 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2314/4559] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:48 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1308 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:48.951271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-27c0ac4b-c55b-42c5-b78f-7765b9d8286c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:48.953403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-27c0ac4b-c55b-42c5-b78f-7765b9d8286c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:48.963272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27c0ac4b-c55b-42c5-b78f-7765b9d8286c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:48.963759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27c0ac4b-c55b-42c5-b78f-7765b9d8286c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:48.964547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27c0ac4b-c55b-42c5-b78f-7765b9d8286c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:48.964985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27c0ac4b-c55b-42c5-b78f-7765b9d8286c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:49.051456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-ce62020b-3e99-4a80-9b82-b4b7b57799f1 tempest-AbsoluteLimitsNegativeTestJSON-1109185593 tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project] Getting quotas for project e07746d31f8044afab1df1f7b80beed3. Resources: dict_keys(['metadata_items']) {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:09:49.065387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-ce62020b-3e99-4a80-9b82-b4b7b57799f1 tempest-AbsoluteLimitsNegativeTestJSON-1109185593 tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project] Getting quotas for user 4d1979b9d2bb4d5386fc27d99221e393 and project e07746d31f8044afab1df1f7b80beed3. Resources: dict_keys(['metadata_items']) {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:09:49.088359 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-ce62020b-3e99-4a80-9b82-b4b7b57799f1 tempest-AbsoluteLimitsNegativeTestJSON-1109185593 tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ce62020b-3e99-4a80-9b82-b4b7b57799f1 tempest-AbsoluteLimitsNegativeTestJSON-1109185593 tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project] Request method failure captured: Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 1752 Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M27fWFjIaFtb71KLYqLaZeAhVmiFtdP97un_rTYhbe_BPhUUmTc_Y0FlHVlz2uw5IgTl6CIIZDNt_LsAazIsaOoQEhWWRKymGy0acr8PrrhvvOlixF6--h_X7VsFpgmjN0BaAlEJw9KnHhrIk0qdCne2j96ixNfxmSHiuwa-V5lVtk Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: e07746d31f8044afab1df1f7b80beed3 Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1109185593 Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e07746d31f8044afab1df1f7b80beed3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e07746d31f8044afab1df1f7b80beed3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e07746d31f8044afab1df1f7b80beed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e07746d31f8044afab1df1f7b80beed3"}]}] Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1109185593 Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: e07746d31f8044afab1df1f7b80beed3 Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1109185593 Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4d1979b9d2bb4d5386fc27d99221e393 Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1834653759", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:09:49.091717 n-d-851337-3 devstack@n-api.service[126119]: exception: Maximum number of metadata items exceeds 128 Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1834653759', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:09:49.096288 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ce62020b-3e99-4a80-9b82-b4b7b57799f1 tempest-AbsoluteLimitsNegativeTestJSON-1109185593 tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ce62020b-3e99-4a80-9b82-b4b7b57799f1 tempest-AbsoluteLimitsNegativeTestJSON-1109185593 tempest-AbsoluteLimitsNegativeTestJSON-1109185593-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.699678 Aug 02 07:09:49.104426 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2246/4560] 10.222.0.79 () {60 vars in 1148 bytes} [Tue Aug 2 07:09:48 2022] POST /compute/v2.1/servers => generated 87 bytes in 702 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:09:49.107646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-91c61f67-4588-4877-9b1f-189e5f11a115 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:49.107646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-91c61f67-4588-4877-9b1f-189e5f11a115 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:49.115651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91c61f67-4588-4877-9b1f-189e5f11a115 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:49.116261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91c61f67-4588-4877-9b1f-189e5f11a115 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:49.117257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91c61f67-4588-4877-9b1f-189e5f11a115 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:49.117979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91c61f67-4588-4877-9b1f-189e5f11a115 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:49.297468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-27c0ac4b-c55b-42c5-b78f-7765b9d8286c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:49.321080 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-27c0ac4b-c55b-42c5-b78f-7765b9d8286c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.373464 Aug 02 07:09:49.323115 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2315/4561] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:48 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:49.345071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-04dfb2e6-2a2e-4b2a-8b14-e81bdb57b232 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:49.346079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-04dfb2e6-2a2e-4b2a-8b14-e81bdb57b232 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:49.355397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04dfb2e6-2a2e-4b2a-8b14-e81bdb57b232 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:49.355947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04dfb2e6-2a2e-4b2a-8b14-e81bdb57b232 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:49.357497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04dfb2e6-2a2e-4b2a-8b14-e81bdb57b232 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:49.358028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04dfb2e6-2a2e-4b2a-8b14-e81bdb57b232 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:49.456959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-91c61f67-4588-4877-9b1f-189e5f11a115 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:49.470197 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-91c61f67-4588-4877-9b1f-189e5f11a115 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.373587 Aug 02 07:09:49.481949 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2247/4562] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:49 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:49.527195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e68cd972-5865-4b23-906f-ee1f9cefa8ee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:49.527811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e68cd972-5865-4b23-906f-ee1f9cefa8ee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:49.534614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e68cd972-5865-4b23-906f-ee1f9cefa8ee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:49.535063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e68cd972-5865-4b23-906f-ee1f9cefa8ee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:49.535874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e68cd972-5865-4b23-906f-ee1f9cefa8ee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:49.536305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e68cd972-5865-4b23-906f-ee1f9cefa8ee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:49.649257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-04dfb2e6-2a2e-4b2a-8b14-e81bdb57b232 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:49.677254 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-04dfb2e6-2a2e-4b2a-8b14-e81bdb57b232 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.338117 Aug 02 07:09:49.694250 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2316/4563] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:49 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:49.700044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b356924d-fc42-447f-9931-33f180db2b12 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:49.700939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b356924d-fc42-447f-9931-33f180db2b12 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:49.709987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b356924d-fc42-447f-9931-33f180db2b12 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:49.710778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b356924d-fc42-447f-9931-33f180db2b12 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:49.711760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b356924d-fc42-447f-9931-33f180db2b12 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:49.712182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b356924d-fc42-447f-9931-33f180db2b12 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:49.717685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:49.745847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e68cd972-5865-4b23-906f-ee1f9cefa8ee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:49.765542 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e68cd972-5865-4b23-906f-ee1f9cefa8ee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1393 microversion: 2.1 time: 0.241780 Aug 02 07:09:49.768866 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2248/4564] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:49 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1393 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:49.917118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b356924d-fc42-447f-9931-33f180db2b12 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:49.925142 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b356924d-fc42-447f-9931-33f180db2b12 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.229702 Aug 02 07:09:49.938560 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2317/4565] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:49 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:49.979758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1e6a74b3-f064-4134-bbcd-a8da6aff82d4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:49.981283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1e6a74b3-f064-4134-bbcd-a8da6aff82d4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:49.995740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e6a74b3-f064-4134-bbcd-a8da6aff82d4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:49.996338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e6a74b3-f064-4134-bbcd-a8da6aff82d4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:49.998273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e6a74b3-f064-4134-bbcd-a8da6aff82d4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:49.998905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e6a74b3-f064-4134-bbcd-a8da6aff82d4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:50.166310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1e6a74b3-f064-4134-bbcd-a8da6aff82d4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:50.175814 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1e6a74b3-f064-4134-bbcd-a8da6aff82d4 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1308 microversion: 2.1 time: 0.201079 Aug 02 07:09:50.176423 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2249/4566] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:49 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1308 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:50.507635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4bbc1e33-9735-474f-82b9-821ce36abb57 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:50.508830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4bbc1e33-9735-474f-82b9-821ce36abb57 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:50.516490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bbc1e33-9735-474f-82b9-821ce36abb57 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:50.516937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bbc1e33-9735-474f-82b9-821ce36abb57 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:50.517933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bbc1e33-9735-474f-82b9-821ce36abb57 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:50.518602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bbc1e33-9735-474f-82b9-821ce36abb57 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:50.765093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4bbc1e33-9735-474f-82b9-821ce36abb57 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:50.789689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e9729f5b-2916-4fb5-8e3c-7be49dacbf70 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:50.791956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e9729f5b-2916-4fb5-8e3c-7be49dacbf70 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:50.802033 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4bbc1e33-9735-474f-82b9-821ce36abb57 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.299043 Aug 02 07:09:50.805374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9729f5b-2916-4fb5-8e3c-7be49dacbf70 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:50.822284 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2318/4567] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:50 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:50.823341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9729f5b-2916-4fb5-8e3c-7be49dacbf70 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:50.824638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9729f5b-2916-4fb5-8e3c-7be49dacbf70 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:50.825246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9729f5b-2916-4fb5-8e3c-7be49dacbf70 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:51.031499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e9729f5b-2916-4fb5-8e3c-7be49dacbf70 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:51.040849 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e9729f5b-2916-4fb5-8e3c-7be49dacbf70 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1393 microversion: 2.1 time: 0.255196 Aug 02 07:09:51.049949 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2250/4568] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:50 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1393 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:51.198248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a27abe4-6998-441b-b37b-df685909fc98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:51.199812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8a27abe4-6998-441b-b37b-df685909fc98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:51.207848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a27abe4-6998-441b-b37b-df685909fc98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:51.208154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a27abe4-6998-441b-b37b-df685909fc98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:51.209138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a27abe4-6998-441b-b37b-df685909fc98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:51.210388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a27abe4-6998-441b-b37b-df685909fc98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:51.410697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8a27abe4-6998-441b-b37b-df685909fc98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:51.425831 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8a27abe4-6998-441b-b37b-df685909fc98 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1308 microversion: 2.1 time: 0.231558 Aug 02 07:09:51.427631 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2319/4569] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:51 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1308 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:51.827325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f4968811-39a2-459e-bf5b-d274749d8f3a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:51.828064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f4968811-39a2-459e-bf5b-d274749d8f3a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:51.835665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4968811-39a2-459e-bf5b-d274749d8f3a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:51.836529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4968811-39a2-459e-bf5b-d274749d8f3a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:51.837407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4968811-39a2-459e-bf5b-d274749d8f3a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:51.838115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4968811-39a2-459e-bf5b-d274749d8f3a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:52.063389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fbc55bb5-f269-4d17-a6ff-b204a2b7345b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:52.064662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fbc55bb5-f269-4d17-a6ff-b204a2b7345b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:52.078018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f4968811-39a2-459e-bf5b-d274749d8f3a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:52.081855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbc55bb5-f269-4d17-a6ff-b204a2b7345b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:52.082687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbc55bb5-f269-4d17-a6ff-b204a2b7345b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:52.084245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbc55bb5-f269-4d17-a6ff-b204a2b7345b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:52.087811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbc55bb5-f269-4d17-a6ff-b204a2b7345b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:52.092011 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f4968811-39a2-459e-bf5b-d274749d8f3a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.268689 Aug 02 07:09:52.105515 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2251/4570] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:51 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:52.257979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e7eb3df6-6fa3-484f-a392-4a07037d92f2 req-8341d736-4c18-4f9c-9850-599250e908d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a5964c-4da3-4792-9d53-9c7a77632724", "name": "network-vif-plugged", "status": "completed", "tag": "a4d951c8-7fd6-4964-b8d1-fffe96300cc7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:52.288927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e7eb3df6-6fa3-484f-a392-4a07037d92f2 req-8341d736-4c18-4f9c-9850-599250e908d5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:52.291792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e7eb3df6-6fa3-484f-a392-4a07037d92f2 req-8341d736-4c18-4f9c-9850-599250e908d5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:52.312480 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e7eb3df6-6fa3-484f-a392-4a07037d92f2 req-8341d736-4c18-4f9c-9850-599250e908d5 service nova] Creating event network-vif-plugged:a4d951c8-7fd6-4964-b8d1-fffe96300cc7 for instance e9a5964c-4da3-4792-9d53-9c7a77632724 on n-h2-851337-3 Aug 02 07:09:52.325839 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e7eb3df6-6fa3-484f-a392-4a07037d92f2 req-8341d736-4c18-4f9c-9850-599250e908d5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073906 Aug 02 07:09:52.327476 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2252/4571] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:52.392857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fbc55bb5-f269-4d17-a6ff-b204a2b7345b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:52.402626 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fbc55bb5-f269-4d17-a6ff-b204a2b7345b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1393 microversion: 2.1 time: 0.343279 Aug 02 07:09:52.415828 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2320/4572] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:52 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1393 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:52.445941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:52.452111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-82336927-8e86-4f49-a315-d53d84973cb9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:52.452838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-82336927-8e86-4f49-a315-d53d84973cb9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:52.471094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82336927-8e86-4f49-a315-d53d84973cb9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:52.472120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82336927-8e86-4f49-a315-d53d84973cb9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:52.473109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82336927-8e86-4f49-a315-d53d84973cb9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:52.473709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82336927-8e86-4f49-a315-d53d84973cb9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:52.767895 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-82336927-8e86-4f49-a315-d53d84973cb9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:52.783174 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-82336927-8e86-4f49-a315-d53d84973cb9 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1308 microversion: 2.1 time: 0.337104 Aug 02 07:09:52.794731 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2253/4573] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:52 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1308 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:53.113294 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dea2e7dd-d227-4789-b6a3-836e4c555de3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:53.114506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dea2e7dd-d227-4789-b6a3-836e4c555de3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:53.124877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dea2e7dd-d227-4789-b6a3-836e4c555de3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:53.125920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dea2e7dd-d227-4789-b6a3-836e4c555de3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:53.127633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dea2e7dd-d227-4789-b6a3-836e4c555de3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:53.129649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dea2e7dd-d227-4789-b6a3-836e4c555de3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:53.430227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fea304a9-2db2-451d-ac27-f6ec96368520 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:53.431967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fea304a9-2db2-451d-ac27-f6ec96368520 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:53.453509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea304a9-2db2-451d-ac27-f6ec96368520 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:53.454017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea304a9-2db2-451d-ac27-f6ec96368520 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:53.455161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea304a9-2db2-451d-ac27-f6ec96368520 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:53.455610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea304a9-2db2-451d-ac27-f6ec96368520 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:54.135037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fea304a9-2db2-451d-ac27-f6ec96368520 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:54.143776 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fea304a9-2db2-451d-ac27-f6ec96368520 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1393 microversion: 2.1 time: 0.719440 Aug 02 07:09:54.152434 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dea2e7dd-d227-4789-b6a3-836e4c555de3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:54.157142 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2254/4574] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:53 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1393 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:54.162656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c878d74d-1759-45b7-b30d-a581eaaea0c3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:54.163288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c878d74d-1759-45b7-b30d-a581eaaea0c3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:54.168005 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dea2e7dd-d227-4789-b6a3-836e4c555de3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 1.057520 Aug 02 07:09:54.170678 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2321/4575] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:53 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:54.183908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c878d74d-1759-45b7-b30d-a581eaaea0c3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:54.184368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c878d74d-1759-45b7-b30d-a581eaaea0c3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:54.185175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c878d74d-1759-45b7-b30d-a581eaaea0c3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:54.185612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c878d74d-1759-45b7-b30d-a581eaaea0c3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:54.498352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c878d74d-1759-45b7-b30d-a581eaaea0c3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:54.509491 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c878d74d-1759-45b7-b30d-a581eaaea0c3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1308 microversion: 2.1 time: 0.351118 Aug 02 07:09:54.510344 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2255/4576] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:54 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1308 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:55.168612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-913e53cc-01a8-4d0c-89e0-6c43cf924b25 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:55.170032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-913e53cc-01a8-4d0c-89e0-6c43cf924b25 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:55.182259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-913e53cc-01a8-4d0c-89e0-6c43cf924b25 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:55.182992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-913e53cc-01a8-4d0c-89e0-6c43cf924b25 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:55.184641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-913e53cc-01a8-4d0c-89e0-6c43cf924b25 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:55.186150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-913e53cc-01a8-4d0c-89e0-6c43cf924b25 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:55.194638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fd5a8b25-e7c2-479b-b4a3-c02034ecdabe tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:55.196025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fd5a8b25-e7c2-479b-b4a3-c02034ecdabe tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:55.215350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd5a8b25-e7c2-479b-b4a3-c02034ecdabe tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:55.216160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd5a8b25-e7c2-479b-b4a3-c02034ecdabe tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:55.217439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd5a8b25-e7c2-479b-b4a3-c02034ecdabe tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:55.218171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd5a8b25-e7c2-479b-b4a3-c02034ecdabe tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:55.651275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fd5a8b25-e7c2-479b-b4a3-c02034ecdabe tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:55.667612 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fd5a8b25-e7c2-479b-b4a3-c02034ecdabe tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.478346 Aug 02 07:09:55.670016 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2256/4577] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:55 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:55.687522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2b64f74c-a664-44e3-a379-3fd679e4cfe3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:55.688228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-913e53cc-01a8-4d0c-89e0-6c43cf924b25 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:55.689255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2b64f74c-a664-44e3-a379-3fd679e4cfe3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:55.697319 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-913e53cc-01a8-4d0c-89e0-6c43cf924b25 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1565 microversion: 2.1 time: 0.535693 Aug 02 07:09:55.715593 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2322/4578] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:55 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1565 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:55.716601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b64f74c-a664-44e3-a379-3fd679e4cfe3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:55.717577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b64f74c-a664-44e3-a379-3fd679e4cfe3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:55.719040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b64f74c-a664-44e3-a379-3fd679e4cfe3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:55.719798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b64f74c-a664-44e3-a379-3fd679e4cfe3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:55.724006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43ba06b7-16ac-44be-b815-71f1ee4699bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:55.724937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-43ba06b7-16ac-44be-b815-71f1ee4699bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:55.735939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43ba06b7-16ac-44be-b815-71f1ee4699bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:55.736500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43ba06b7-16ac-44be-b815-71f1ee4699bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:55.737297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43ba06b7-16ac-44be-b815-71f1ee4699bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:55.737723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43ba06b7-16ac-44be-b815-71f1ee4699bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:56.082988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2b64f74c-a664-44e3-a379-3fd679e4cfe3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:56.085265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:56.094079 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2b64f74c-a664-44e3-a379-3fd679e4cfe3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1308 microversion: 2.1 time: 0.422019 Aug 02 07:09:56.094984 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2257/4579] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:55 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:56.100217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-4b6bed90-bc7b-497a-b578-8a311625d47d req-e883efed-3ee4-4d6e-9652-abbd36e0549c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45bacc58-d131-4b47-8082-8d441784de01", "name": "network-vif-plugged", "status": "completed", "tag": "d83c518f-7e01-4928-a463-48a408186564"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:56.103130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43ba06b7-16ac-44be-b815-71f1ee4699bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:56.112429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-4b6bed90-bc7b-497a-b578-8a311625d47d req-e883efed-3ee4-4d6e-9652-abbd36e0549c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:56.113066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-4b6bed90-bc7b-497a-b578-8a311625d47d req-e883efed-3ee4-4d6e-9652-abbd36e0549c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:56.120157 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43ba06b7-16ac-44be-b815-71f1ee4699bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1565 microversion: 2.1 time: 0.399972 Aug 02 07:09:56.133926 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2323/4580] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:55 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1565 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:09:56.148447 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-4b6bed90-bc7b-497a-b578-8a311625d47d req-e883efed-3ee4-4d6e-9652-abbd36e0549c service nova] Creating event network-vif-plugged:d83c518f-7e01-4928-a463-48a408186564 for instance 45bacc58-d131-4b47-8082-8d441784de01 on n-h1-851337-3 Aug 02 07:09:56.155485 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-4b6bed90-bc7b-497a-b578-8a311625d47d req-e883efed-3ee4-4d6e-9652-abbd36e0549c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058761 Aug 02 07:09:56.156409 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2258/4581] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:09:56.696718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-caa65b6d-f60e-454f-92c5-6686f988e50b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:56.697886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-caa65b6d-f60e-454f-92c5-6686f988e50b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:56.740953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa65b6d-f60e-454f-92c5-6686f988e50b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:56.742118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa65b6d-f60e-454f-92c5-6686f988e50b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:56.743763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa65b6d-f60e-454f-92c5-6686f988e50b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:56.744850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa65b6d-f60e-454f-92c5-6686f988e50b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:57.134427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0a2e856d-fbd3-4fc2-af58-f855e08e61fb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:57.135249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0a2e856d-fbd3-4fc2-af58-f855e08e61fb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:57.152248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a2e856d-fbd3-4fc2-af58-f855e08e61fb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:57.153066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a2e856d-fbd3-4fc2-af58-f855e08e61fb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:57.154240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a2e856d-fbd3-4fc2-af58-f855e08e61fb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:57.154853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a2e856d-fbd3-4fc2-af58-f855e08e61fb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:57.226343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-caa65b6d-f60e-454f-92c5-6686f988e50b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:57.238657 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-caa65b6d-f60e-454f-92c5-6686f988e50b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.550126 Aug 02 07:09:57.239619 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2324/4582] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:56 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:57.608466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0a2e856d-fbd3-4fc2-af58-f855e08e61fb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:57.631573 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0a2e856d-fbd3-4fc2-af58-f855e08e61fb tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1308 microversion: 2.1 time: 0.502523 Aug 02 07:09:57.632006 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2259/4583] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:57 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1308 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:58.276764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5b0dc60c-ed44-4f39-90f1-f27c3282645e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:58.277946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5b0dc60c-ed44-4f39-90f1-f27c3282645e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:58.283718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:58.289111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:58.316520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b0dc60c-ed44-4f39-90f1-f27c3282645e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:58.317554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b0dc60c-ed44-4f39-90f1-f27c3282645e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:58.319291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b0dc60c-ed44-4f39-90f1-f27c3282645e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:58.321702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b0dc60c-ed44-4f39-90f1-f27c3282645e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:58.666107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-77f44ea4-7d2f-4dba-9a44-ca3bedaf20da tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:58.667103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-77f44ea4-7d2f-4dba-9a44-ca3bedaf20da tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:58.684420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77f44ea4-7d2f-4dba-9a44-ca3bedaf20da tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:58.684860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77f44ea4-7d2f-4dba-9a44-ca3bedaf20da tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:58.685833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77f44ea4-7d2f-4dba-9a44-ca3bedaf20da tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:58.686953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77f44ea4-7d2f-4dba-9a44-ca3bedaf20da tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:58.793059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5b0dc60c-ed44-4f39-90f1-f27c3282645e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:58.813647 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5b0dc60c-ed44-4f39-90f1-f27c3282645e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.541351 Aug 02 07:09:58.837758 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2325/4584] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:58 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:59.055424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-77f44ea4-7d2f-4dba-9a44-ca3bedaf20da tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:09:59.074418 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-77f44ea4-7d2f-4dba-9a44-ca3bedaf20da tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1488 microversion: 2.1 time: 0.415665 Aug 02 07:09:59.075448 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2260/4585] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:58 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1488 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:59.112139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d3c16f85-c5f2-4197-a4f7-187fe071e291 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1963188492"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:09:59.116118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d3c16f85-c5f2-4197-a4f7-187fe071e291 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:59.129519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3c16f85-c5f2-4197-a4f7-187fe071e291 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:59.130285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3c16f85-c5f2-4197-a4f7-187fe071e291 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:59.131509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3c16f85-c5f2-4197-a4f7-187fe071e291 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:59.132175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3c16f85-c5f2-4197-a4f7-187fe071e291 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:59.289064 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d3c16f85-c5f2-4197-a4f7-187fe071e291 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "PUT /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1074 microversion: 2.1 time: 0.183737 Aug 02 07:09:59.310746 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2326/4586] 10.222.0.79 () {60 vars in 1256 bytes} [Tue Aug 2 07:09:59 2022] PUT /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1074 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:09:59.319467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f65cf928-a5bd-45b3-b7d7-c58802139188 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:09:59.320923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f65cf928-a5bd-45b3-b7d7-c58802139188 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:09:59.330066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=18 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:09:59.333697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f65cf928-a5bd-45b3-b7d7-c58802139188 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:59.334892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f65cf928-a5bd-45b3-b7d7-c58802139188 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:59.336450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f65cf928-a5bd-45b3-b7d7-c58802139188 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:09:59.337662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f65cf928-a5bd-45b3-b7d7-c58802139188 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:09:59.938387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bdd496c0-a63e-4c89-8923-8cc0738044f5 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Calling method '.version_select at 0x7f927b11d700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:00.010681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG neutronclient.v2_0.client [None req-bdd496c0-a63e-4c89-8923-8cc0738044f5 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7dff32f4-82a5-4bc2-b325-d70be349360a does not exist", "detail": ""}} {{(pid=126120) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 07:10:00.011306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.security_group_api [None req-bdd496c0-a63e-4c89-8923-8cc0738044f5 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Neutron security group 7dff32f4-82a5-4bc2-b325-d70be349360a not found {{(pid=126120) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 07:10:00.011841 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-bdd496c0-a63e-4c89-8923-8cc0738044f5 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] HTTP exception thrown: Security group 7dff32f4-82a5-4bc2-b325-d70be349360a does not exist Aug 02 07:10:00.011841 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-eb5170fe-0364-40a6-9f78-cb040ed270b1'] Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bdd496c0-a63e-4c89-8923-8cc0738044f5 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Request method failure captured: Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-security-groups/7dff32f4-82a5-4bc2-b325-d70be349360a HTTP/1.1 Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M3Hz_QQhG_cbJPtjY5Rs0nuUvWpy4W6OXlxxdgLdPXur_RlhYKgJbwNLmKHrYL6Y6jYkEVJ6wpbKd9c3TlyEAYjAldlppHRx1YFwSoS5MLFzW_UAPeVaKMp82ISI9NSsi3iVnQxSov8ldTSSkgj49PwMh88KAQZNLjTl9JLCdFWKEw Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a75294ad0630475d989825e0a154d385 Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1424138869 Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a75294ad0630475d989825e0a154d385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a75294ad0630475d989825e0a154d385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a75294ad0630475d989825e0a154d385"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a75294ad0630475d989825e0a154d385"}]}] Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1424138869 Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a75294ad0630475d989825e0a154d385 Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1424138869 Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupsNegativeTestJSON-1424138869-project Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5a179650b21e49f2afe43b53a056d6df Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1424138869-project Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: exception: Security group 7dff32f4-82a5-4bc2-b325-d70be349360a does not exist Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-eb5170fe-0364-40a6-9f78-cb040ed270b1'] Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '7dff32f4-82a5-4bc2-b325-d70be349360a'} Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 07:10:00.013830 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7dff32f4-82a5-4bc2-b325-d70be349360a does not exist Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb5170fe-0364-40a6-9f78-cb040ed270b1'] Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7dff32f4-82a5-4bc2-b325-d70be349360a does not exist Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb5170fe-0364-40a6-9f78-cb040ed270b1'] Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7dff32f4-82a5-4bc2-b325-d70be349360a does not exist Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb5170fe-0364-40a6-9f78-cb040ed270b1'] Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7dff32f4-82a5-4bc2-b325-d70be349360a does not exist Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb5170fe-0364-40a6-9f78-cb040ed270b1'] Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bdd496c0-a63e-4c89-8923-8cc0738044f5 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Returning 404 to user: Security group 7dff32f4-82a5-4bc2-b325-d70be349360a does not exist Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-eb5170fe-0364-40a6-9f78-cb040ed270b1'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bdd496c0-a63e-4c89-8923-8cc0738044f5 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/7dff32f4-82a5-4bc2-b325-d70be349360a" status: 404 len: 194 microversion: 2.1 time: 0.275414 Aug 02 07:10:00.020399 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2327/4587] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 07:09:59 2022] DELETE /compute/v2.1/os-security-groups/7dff32f4-82a5-4bc2-b325-d70be349360a => generated 194 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:10:00.023634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-86874812-c4ad-4946-86f0-f7a758ecf3cf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:00.023634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-86874812-c4ad-4946-86f0-f7a758ecf3cf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:00.047807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-86874812-c4ad-4946-86f0-f7a758ecf3cf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:00.048265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-86874812-c4ad-4946-86f0-f7a758ecf3cf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:00.049377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-86874812-c4ad-4946-86f0-f7a758ecf3cf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:00.049812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-86874812-c4ad-4946-86f0-f7a758ecf3cf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:00.181554 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f65cf928-a5bd-45b3-b7d7-c58802139188 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:00.192671 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f65cf928-a5bd-45b3-b7d7-c58802139188 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1500 microversion: 2.1 time: 0.879724 Aug 02 07:10:00.206561 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2261/4588] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:09:59 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1500 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:00.215788 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bdbd7c87-827c-4b27-a3b1-22cca668457c tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.006641 Aug 02 07:10:00.216510 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2262/4589] 10.222.0.79 () {58 vars in 1164 bytes} [Tue Aug 2 07:10:00 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 07:10:00.222200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3e6ad81b-c240-413c-af01-7bfc1bd89063 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:00.222908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3e6ad81b-c240-413c-af01-7bfc1bd89063 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:00.229634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e6ad81b-c240-413c-af01-7bfc1bd89063 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:00.230382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e6ad81b-c240-413c-af01-7bfc1bd89063 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:00.231282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e6ad81b-c240-413c-af01-7bfc1bd89063 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:00.231790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e6ad81b-c240-413c-af01-7bfc1bd89063 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:00.348411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-86874812-c4ad-4946-86f0-f7a758ecf3cf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:00.356972 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-86874812-c4ad-4946-86f0-f7a758ecf3cf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.339709 Aug 02 07:10:00.357720 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2328/4590] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:00 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:00.362559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5347c1e4-7b8a-4f48-8918-a0ae87101abc tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Calling method '.version_select at 0x7f927a80e670>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:00.691511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3e6ad81b-c240-413c-af01-7bfc1bd89063 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:00.711503 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3e6ad81b-c240-413c-af01-7bfc1bd89063 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1500 microversion: 2.1 time: 0.493274 Aug 02 07:10:00.713157 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2263/4591] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:00 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1500 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:00.747891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2305e07f-2c43-4797-bc58-ff20ae48e32d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:00.758029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2305e07f-2c43-4797-bc58-ff20ae48e32d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:00.762382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2305e07f-2c43-4797-bc58-ff20ae48e32d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:00.820069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2305e07f-2c43-4797-bc58-ff20ae48e32d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Going to try to stop instance {{(pid=126119) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 07:10:00.888467 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5347c1e4-7b8a-4f48-8918-a0ae87101abc tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.529444 Aug 02 07:10:00.889672 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2329/4592] 10.222.0.79 () {58 vars in 1158 bytes} [Tue Aug 2 07:10:00 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:00.894741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d19b6546-521b-44e8-b3b3-b3ef25d50fae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:00.895548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d19b6546-521b-44e8-b3b3-b3ef25d50fae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:00.904949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d19b6546-521b-44e8-b3b3-b3ef25d50fae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:00.905664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d19b6546-521b-44e8-b3b3-b3ef25d50fae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:00.906643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d19b6546-521b-44e8-b3b3-b3ef25d50fae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:00.907249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d19b6546-521b-44e8-b3b3-b3ef25d50fae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:00.925658 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2305e07f-2c43-4797-bc58-ff20ae48e32d tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "POST /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01/action" status: 202 len: 0 microversion: 2.1 time: 0.179657 Aug 02 07:10:00.927228 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2264/4593] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:10:00 2022] POST /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:10:00.934516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-48220ffe-aa4a-4d11-b5d8-8bb1a8baae75 req-a5a5326a-adad-45b9-ab03-2caf172948be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a5964c-4da3-4792-9d53-9c7a77632724", "tag": "a4d951c8-7fd6-4964-b8d1-fffe96300cc7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:00.949386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-48220ffe-aa4a-4d11-b5d8-8bb1a8baae75 req-a5a5326a-adad-45b9-ab03-2caf172948be service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:00.951716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-48220ffe-aa4a-4d11-b5d8-8bb1a8baae75 req-a5a5326a-adad-45b9-ab03-2caf172948be service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:00.970461 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-48220ffe-aa4a-4d11-b5d8-8bb1a8baae75 req-a5a5326a-adad-45b9-ab03-2caf172948be service nova] Creating event network-changed:a4d951c8-7fd6-4964-b8d1-fffe96300cc7 for instance e9a5964c-4da3-4792-9d53-9c7a77632724 on n-h2-851337-3 Aug 02 07:10:00.976547 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-48220ffe-aa4a-4d11-b5d8-8bb1a8baae75 req-a5a5326a-adad-45b9-ab03-2caf172948be service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047707 Aug 02 07:10:00.977665 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2265/4594] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:00.986684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0cc16202-7f0f-4bea-a11f-c8fc75ff4d10 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Calling method '.version_select at 0x7f927a3333a0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:01.298256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d19b6546-521b-44e8-b3b3-b3ef25d50fae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:01.307312 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d19b6546-521b-44e8-b3b3-b3ef25d50fae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1565 microversion: 2.1 time: 0.416211 Aug 02 07:10:01.322170 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2330/4595] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:00 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1565 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:01.327469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b852cc7c-811c-4671-8154-dcbde98fdac1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:01.328813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b852cc7c-811c-4671-8154-dcbde98fdac1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:01.335921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b852cc7c-811c-4671-8154-dcbde98fdac1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:01.336383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b852cc7c-811c-4671-8154-dcbde98fdac1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:01.337190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b852cc7c-811c-4671-8154-dcbde98fdac1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:01.337629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b852cc7c-811c-4671-8154-dcbde98fdac1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:01.471597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG neutronclient.v2_0.client [None req-0cc16202-7f0f-4bea-a11f-c8fc75ff4d10 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=126119) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 07:10:01.473120 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-0cc16202-7f0f-4bea-a11f-c8fc75ff4d10 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 02 07:10:01.473120 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-8ba9a247-6106-4969-bfce-d5d720baebfd'] Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0cc16202-7f0f-4bea-a11f-c8fc75ff4d10 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Request method failure captured: Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/os-security-groups/d04e1313-ad39-4aa5-9735-d3e8273ccf1c HTTP/1.1 Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M3Hz_QQhG_cbJPtjY5Rs0nuUvWpy4W6OXlxxdgLdPXur_RlhYKgJbwNLmKHrYL6Y6jYkEVJ6wpbKd9c3TlyEAYjAldlppHRx1YFwSoS5MLFzW_UAPeVaKMp82ISI9NSsi3iVnQxSov8ldTSSkgj49PwMh88KAQZNLjTl9JLCdFWKEw Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: a75294ad0630475d989825e0a154d385 Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1424138869 Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a75294ad0630475d989825e0a154d385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a75294ad0630475d989825e0a154d385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a75294ad0630475d989825e0a154d385"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a75294ad0630475d989825e0a154d385"}]}] Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1424138869 Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: a75294ad0630475d989825e0a154d385 Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1424138869 Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-SecurityGroupsNegativeTestJSON-1424138869-project Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 5a179650b21e49f2afe43b53a056d6df Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1424138869-project Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: exception: Insufficient rights for removing default security group. Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-8ba9a247-6106-4969-bfce-d5d720baebfd'] Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'd04e1313-ad39-4aa5-9735-d3e8273ccf1c'} Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 07:10:01.475159 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ba9a247-6106-4969-bfce-d5d720baebfd'] Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ba9a247-6106-4969-bfce-d5d720baebfd'] Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ba9a247-6106-4969-bfce-d5d720baebfd'] Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ba9a247-6106-4969-bfce-d5d720baebfd'] Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0cc16202-7f0f-4bea-a11f-c8fc75ff4d10 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: Neutron server returns request_ids: ['req-8ba9a247-6106-4969-bfce-d5d720baebfd'] {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0cc16202-7f0f-4bea-a11f-c8fc75ff4d10 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/d04e1313-ad39-4aa5-9735-d3e8273ccf1c" status: 400 len: 182 microversion: 2.1 time: 0.497515 Aug 02 07:10:01.486060 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2266/4596] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 07:10:00 2022] DELETE /compute/v2.1/os-security-groups/d04e1313-ad39-4aa5-9735-d3e8273ccf1c => generated 182 bytes in 499 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:10:01.491628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4b113f30-4b57-401b-a5d5-714255368676 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:01.492390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4b113f30-4b57-401b-a5d5-714255368676 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:01.508220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b113f30-4b57-401b-a5d5-714255368676 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:01.508672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b113f30-4b57-401b-a5d5-714255368676 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:01.509649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b113f30-4b57-401b-a5d5-714255368676 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:01.510389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b113f30-4b57-401b-a5d5-714255368676 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:01.754094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b852cc7c-811c-4671-8154-dcbde98fdac1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:01.765606 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b852cc7c-811c-4671-8154-dcbde98fdac1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.441972 Aug 02 07:10:01.768703 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2331/4597] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:01 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:01.788813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b0ea0f5-bac1-4a08-8d52-ccec06a9c755 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Calling method '.version_select at 0x7f928c2e10d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:01.847952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG neutronclient.v2_0.client [None req-6b0ea0f5-bac1-4a08-8d52-ccec06a9c755 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fb1350b4-beb5-4c4a-a96b-339708d08edf does not exist", "detail": ""}} {{(pid=126120) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 07:10:01.848940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.security_group_api [None req-6b0ea0f5-bac1-4a08-8d52-ccec06a9c755 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Neutron security group fb1350b4-beb5-4c4a-a96b-339708d08edf not found {{(pid=126120) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 07:10:01.849717 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-6b0ea0f5-bac1-4a08-8d52-ccec06a9c755 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] HTTP exception thrown: Security group fb1350b4-beb5-4c4a-a96b-339708d08edf does not exist Aug 02 07:10:01.849717 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-0e2a041d-f498-42d8-a59d-b772c1e5b351'] Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b0ea0f5-bac1-4a08-8d52-ccec06a9c755 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Request method failure captured: Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-security-groups/fb1350b4-beb5-4c4a-a96b-339708d08edf HTTP/1.1 Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M3Hz_QQhG_cbJPtjY5Rs0nuUvWpy4W6OXlxxdgLdPXur_RlhYKgJbwNLmKHrYL6Y6jYkEVJ6wpbKd9c3TlyEAYjAldlppHRx1YFwSoS5MLFzW_UAPeVaKMp82ISI9NSsi3iVnQxSov8ldTSSkgj49PwMh88KAQZNLjTl9JLCdFWKEw Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a75294ad0630475d989825e0a154d385 Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1424138869 Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a75294ad0630475d989825e0a154d385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a75294ad0630475d989825e0a154d385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a75294ad0630475d989825e0a154d385"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a75294ad0630475d989825e0a154d385"}]}] Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1424138869 Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a75294ad0630475d989825e0a154d385 Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1424138869 Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupsNegativeTestJSON-1424138869-project Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5a179650b21e49f2afe43b53a056d6df Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1424138869-project Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: exception: Security group fb1350b4-beb5-4c4a-a96b-339708d08edf does not exist Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-0e2a041d-f498-42d8-a59d-b772c1e5b351'] Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'fb1350b4-beb5-4c4a-a96b-339708d08edf'} Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 07:10:01.853967 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fb1350b4-beb5-4c4a-a96b-339708d08edf does not exist Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e2a041d-f498-42d8-a59d-b772c1e5b351'] Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fb1350b4-beb5-4c4a-a96b-339708d08edf does not exist Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e2a041d-f498-42d8-a59d-b772c1e5b351'] Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fb1350b4-beb5-4c4a-a96b-339708d08edf does not exist Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e2a041d-f498-42d8-a59d-b772c1e5b351'] Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fb1350b4-beb5-4c4a-a96b-339708d08edf does not exist Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e2a041d-f498-42d8-a59d-b772c1e5b351'] Aug 02 07:10:01.858659 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.862958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b0ea0f5-bac1-4a08-8d52-ccec06a9c755 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Returning 404 to user: Security group fb1350b4-beb5-4c4a-a96b-339708d08edf does not exist Aug 02 07:10:01.862958 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-0e2a041d-f498-42d8-a59d-b772c1e5b351'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:01.864521 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6b0ea0f5-bac1-4a08-8d52-ccec06a9c755 tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/fb1350b4-beb5-4c4a-a96b-339708d08edf" status: 404 len: 194 microversion: 2.1 time: 0.080924 Aug 02 07:10:01.866267 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2332/4598] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 07:10:01 2022] GET /compute/v2.1/os-security-groups/fb1350b4-beb5-4c4a-a96b-339708d08edf => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:01.876309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-af91eb00-bbb9-42c6-952d-8b82352d292f tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Action: 'update', calling method: .version_select at 0x7f927b149ee0>, body: {"security_group": {"name": "tempest-sg-348225666", "description": "tempest-description-277241512"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:01.913307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4b113f30-4b57-401b-a5d5-714255368676 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:01.925852 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4b113f30-4b57-401b-a5d5-714255368676 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1514 microversion: 2.1 time: 0.446503 Aug 02 07:10:01.926480 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2267/4599] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:01 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1514 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:01.959323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG neutronclient.v2_0.client [None req-af91eb00-bbb9-42c6-952d-8b82352d292f tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cf912c16-fb57-4e25-91f0-0b09841f4529 does not exist", "detail": ""}} {{(pid=126120) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 02 07:10:01.959940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.security_group_api [None req-af91eb00-bbb9-42c6-952d-8b82352d292f tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Neutron security group cf912c16-fb57-4e25-91f0-0b09841f4529 not found {{(pid=126120) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 02 07:10:01.960471 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-af91eb00-bbb9-42c6-952d-8b82352d292f tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] HTTP exception thrown: Security group cf912c16-fb57-4e25-91f0-0b09841f4529 does not exist Aug 02 07:10:01.960471 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-183cd174-8789-4602-90be-2f84ae6ea1a8'] Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-af91eb00-bbb9-42c6-952d-8b82352d292f tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Request method failure captured: Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: request: PUT /compute/v2.1/os-security-groups/cf912c16-fb57-4e25-91f0-0b09841f4529 HTTP/1.1 Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 100 Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M3Hz_QQhG_cbJPtjY5Rs0nuUvWpy4W6OXlxxdgLdPXur_RlhYKgJbwNLmKHrYL6Y6jYkEVJ6wpbKd9c3TlyEAYjAldlppHRx1YFwSoS5MLFzW_UAPeVaKMp82ISI9NSsi3iVnQxSov8ldTSSkgj49PwMh88KAQZNLjTl9JLCdFWKEw Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a75294ad0630475d989825e0a154d385 Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1424138869 Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a75294ad0630475d989825e0a154d385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a75294ad0630475d989825e0a154d385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a75294ad0630475d989825e0a154d385"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a75294ad0630475d989825e0a154d385"}]}] Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1424138869 Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a75294ad0630475d989825e0a154d385 Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1424138869 Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-SecurityGroupsNegativeTestJSON-1424138869-project Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5a179650b21e49f2afe43b53a056d6df Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1424138869-project Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: {"security_group": {"name": "tempest-sg-348225666", "description": "tempest-description-277241512"}} Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: exception: Security group cf912c16-fb57-4e25-91f0-0b09841f4529 does not exist Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-183cd174-8789-4602-90be-2f84ae6ea1a8'] Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'cf912c16-fb57-4e25-91f0-0b09841f4529', 'body': {'security_group': {'name': 'tempest-sg-348225666', 'description': 'tempest-description-277241512'}}} Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 02 07:10:01.962544 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cf912c16-fb57-4e25-91f0-0b09841f4529 does not exist Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-183cd174-8789-4602-90be-2f84ae6ea1a8'] Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cf912c16-fb57-4e25-91f0-0b09841f4529 does not exist Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-183cd174-8789-4602-90be-2f84ae6ea1a8'] Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cf912c16-fb57-4e25-91f0-0b09841f4529 does not exist Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-183cd174-8789-4602-90be-2f84ae6ea1a8'] Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cf912c16-fb57-4e25-91f0-0b09841f4529 does not exist Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-183cd174-8789-4602-90be-2f84ae6ea1a8'] Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-af91eb00-bbb9-42c6-952d-8b82352d292f tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] Returning 404 to user: Security group cf912c16-fb57-4e25-91f0-0b09841f4529 does not exist Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: Neutron server returns request_ids: ['req-183cd174-8789-4602-90be-2f84ae6ea1a8'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:01.968100 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-af91eb00-bbb9-42c6-952d-8b82352d292f tempest-SecurityGroupsNegativeTestJSON-1424138869 tempest-SecurityGroupsNegativeTestJSON-1424138869-project] 10.222.0.79 "PUT /compute/v2.1/os-security-groups/cf912c16-fb57-4e25-91f0-0b09841f4529" status: 404 len: 194 microversion: 2.1 time: 0.092650 Aug 02 07:10:01.972244 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2333/4600] 10.222.0.79 () {60 vars in 1290 bytes} [Tue Aug 2 07:10:01 2022] PUT /compute/v2.1/os-security-groups/cf912c16-fb57-4e25-91f0-0b09841f4529 => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:02.792504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4be72dcb-fbae-46f2-b01d-a43a3bac2e42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:02.793324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4be72dcb-fbae-46f2-b01d-a43a3bac2e42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:02.809025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4be72dcb-fbae-46f2-b01d-a43a3bac2e42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:02.809644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4be72dcb-fbae-46f2-b01d-a43a3bac2e42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:02.810777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4be72dcb-fbae-46f2-b01d-a43a3bac2e42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:02.814018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4be72dcb-fbae-46f2-b01d-a43a3bac2e42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:02.949509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f071410-b2f8-43ce-907d-c38d5e2161c6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:02.950928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1f071410-b2f8-43ce-907d-c38d5e2161c6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:02.968670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f071410-b2f8-43ce-907d-c38d5e2161c6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:02.970207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f071410-b2f8-43ce-907d-c38d5e2161c6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:02.971156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f071410-b2f8-43ce-907d-c38d5e2161c6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:02.971609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f071410-b2f8-43ce-907d-c38d5e2161c6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:03.124214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4be72dcb-fbae-46f2-b01d-a43a3bac2e42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:03.169554 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4be72dcb-fbae-46f2-b01d-a43a3bac2e42 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.363769 Aug 02 07:10:03.183109 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2268/4601] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:02 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:03.257856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f071410-b2f8-43ce-907d-c38d5e2161c6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:03.271419 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f071410-b2f8-43ce-907d-c38d5e2161c6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1532 microversion: 2.1 time: 0.326860 Aug 02 07:10:03.272062 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2334/4602] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:02 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1532 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:04.196848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dc7b0d57-3e6f-4646-9e2a-65b91e6dd4e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:04.198362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dc7b0d57-3e6f-4646-9e2a-65b91e6dd4e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:04.207001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc7b0d57-3e6f-4646-9e2a-65b91e6dd4e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:04.207712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc7b0d57-3e6f-4646-9e2a-65b91e6dd4e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:04.208725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc7b0d57-3e6f-4646-9e2a-65b91e6dd4e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:04.209510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc7b0d57-3e6f-4646-9e2a-65b91e6dd4e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:04.297639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c679501-d701-4f72-b241-2ff3e9d19716 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:04.298591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9c679501-d701-4f72-b241-2ff3e9d19716 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:04.318863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c679501-d701-4f72-b241-2ff3e9d19716 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:04.319616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c679501-d701-4f72-b241-2ff3e9d19716 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:04.320573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c679501-d701-4f72-b241-2ff3e9d19716 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:04.321169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c679501-d701-4f72-b241-2ff3e9d19716 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:04.588745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dc7b0d57-3e6f-4646-9e2a-65b91e6dd4e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:04.598070 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dc7b0d57-3e6f-4646-9e2a-65b91e6dd4e2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.405621 Aug 02 07:10:04.600196 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2269/4603] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:04 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:04.670766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9c679501-d701-4f72-b241-2ff3e9d19716 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:04.679845 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9c679501-d701-4f72-b241-2ff3e9d19716 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1520 microversion: 2.1 time: 0.386531 Aug 02 07:10:04.680442 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2335/4604] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:04 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:05.451353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-04e05159-056a-49a6-adce-a9ddf92b4522 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d0f1e0b-d2bd-4fba-9b9e-a80e95d7c515", "device": "/dev/sdb"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:05.453876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-04e05159-056a-49a6-adce-a9ddf92b4522 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:05.461283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04e05159-056a-49a6-adce-a9ddf92b4522 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:05.461730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04e05159-056a-49a6-adce-a9ddf92b4522 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:05.462525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04e05159-056a-49a6-adce-a9ddf92b4522 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:05.463043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-04e05159-056a-49a6-adce-a9ddf92b4522 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:05.638807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1516abf0-38fa-4491-8e21-9475ebbb0b93 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:05.640022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1516abf0-38fa-4491-8e21-9475ebbb0b93 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:05.658860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:05.666681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1516abf0-38fa-4491-8e21-9475ebbb0b93 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:05.667462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1516abf0-38fa-4491-8e21-9475ebbb0b93 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:05.669165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1516abf0-38fa-4491-8e21-9475ebbb0b93 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:05.670420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1516abf0-38fa-4491-8e21-9475ebbb0b93 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:05.866921 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-04e05159-056a-49a6-adce-a9ddf92b4522 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "POST /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417686 Aug 02 07:10:05.868938 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2270/4605] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:10:05 2022] POST /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:05.879381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-87d1af3c-e538-4d68-8944-f420166cdade tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:05.884765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-87d1af3c-e538-4d68-8944-f420166cdade tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:05.899362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87d1af3c-e538-4d68-8944-f420166cdade tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:05.900495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87d1af3c-e538-4d68-8944-f420166cdade tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:05.903202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87d1af3c-e538-4d68-8944-f420166cdade tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:05.904059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87d1af3c-e538-4d68-8944-f420166cdade tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:06.109087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1516abf0-38fa-4491-8e21-9475ebbb0b93 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:06.118774 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1516abf0-38fa-4491-8e21-9475ebbb0b93 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.488150 Aug 02 07:10:06.134542 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2336/4606] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:05 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:06.139861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-be7d187c-4c84-44ce-b77c-3ed47c782ef2 req-cfb4a276-9767-4963-928a-ceeaf6bcf02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba90067e-50cc-4009-886b-124ae5608b6f", "name": "network-vif-unplugged", "status": "completed", "tag": "359f0467-c390-4642-9439-c61430073554"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:06.154716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-be7d187c-4c84-44ce-b77c-3ed47c782ef2 req-cfb4a276-9767-4963-928a-ceeaf6bcf02e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:06.155589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-be7d187c-4c84-44ce-b77c-3ed47c782ef2 req-cfb4a276-9767-4963-928a-ceeaf6bcf02e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:06.163477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:06.181290 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-be7d187c-4c84-44ce-b77c-3ed47c782ef2 req-cfb4a276-9767-4963-928a-ceeaf6bcf02e service nova] Creating event network-vif-unplugged:359f0467-c390-4642-9439-c61430073554 for instance ba90067e-50cc-4009-886b-124ae5608b6f on n-h1-851337-3 Aug 02 07:10:06.192659 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-be7d187c-4c84-44ce-b77c-3ed47c782ef2 req-cfb4a276-9767-4963-928a-ceeaf6bcf02e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055990 Aug 02 07:10:06.194567 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2337/4607] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:06.203496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-87d1af3c-e538-4d68-8944-f420166cdade tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:06.212343 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-87d1af3c-e538-4d68-8944-f420166cdade tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1520 microversion: 2.1 time: 0.341351 Aug 02 07:10:06.213220 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2271/4608] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:05 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:07.150800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1b6d7ac6-868f-482e-b18c-4e00a90eee99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:07.152898 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1b6d7ac6-868f-482e-b18c-4e00a90eee99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:07.160140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b6d7ac6-868f-482e-b18c-4e00a90eee99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:07.160589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b6d7ac6-868f-482e-b18c-4e00a90eee99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:07.161660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b6d7ac6-868f-482e-b18c-4e00a90eee99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:07.162527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b6d7ac6-868f-482e-b18c-4e00a90eee99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:07.233958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-42a1e378-d32f-41ee-b853-0637377a764d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:07.235403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-42a1e378-d32f-41ee-b853-0637377a764d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:07.243185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42a1e378-d32f-41ee-b853-0637377a764d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:07.245125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42a1e378-d32f-41ee-b853-0637377a764d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:07.246225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42a1e378-d32f-41ee-b853-0637377a764d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:07.247539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42a1e378-d32f-41ee-b853-0637377a764d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:07.418518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1b6d7ac6-868f-482e-b18c-4e00a90eee99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:07.426685 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1b6d7ac6-868f-482e-b18c-4e00a90eee99 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.281652 Aug 02 07:10:07.427454 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2338/4609] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:07 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:07.520326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-42a1e378-d32f-41ee-b853-0637377a764d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:07.528575 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-42a1e378-d32f-41ee-b853-0637377a764d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1520 microversion: 2.1 time: 0.298771 Aug 02 07:10:07.529178 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2272/4610] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:07 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:08.451817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a15a5eb5-e2a2-4e2b-af1d-fd430d8ad0fe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:08.454386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a15a5eb5-e2a2-4e2b-af1d-fd430d8ad0fe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:08.466151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a15a5eb5-e2a2-4e2b-af1d-fd430d8ad0fe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:08.467179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a15a5eb5-e2a2-4e2b-af1d-fd430d8ad0fe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:08.468568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a15a5eb5-e2a2-4e2b-af1d-fd430d8ad0fe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:08.469426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a15a5eb5-e2a2-4e2b-af1d-fd430d8ad0fe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:08.558794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-14087347-2614-4039-922c-793a86c4992e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:08.561391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-14087347-2614-4039-922c-793a86c4992e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:08.587991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14087347-2614-4039-922c-793a86c4992e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:08.588818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14087347-2614-4039-922c-793a86c4992e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:08.589829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14087347-2614-4039-922c-793a86c4992e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:08.591155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14087347-2614-4039-922c-793a86c4992e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:08.751394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a15a5eb5-e2a2-4e2b-af1d-fd430d8ad0fe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:08.770112 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a15a5eb5-e2a2-4e2b-af1d-fd430d8ad0fe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.324867 Aug 02 07:10:08.771887 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2339/4611] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:08 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:08.800651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-14087347-2614-4039-922c-793a86c4992e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:08.815036 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-14087347-2614-4039-922c-793a86c4992e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1520 microversion: 2.1 time: 0.267493 Aug 02 07:10:08.816293 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2273/4612] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:08 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:09.794369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab6c545b-f177-4bbd-afd0-d4db72a73f19 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:09.795050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ab6c545b-f177-4bbd-afd0-d4db72a73f19 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:09.805647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab6c545b-f177-4bbd-afd0-d4db72a73f19 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:09.806182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab6c545b-f177-4bbd-afd0-d4db72a73f19 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:09.809443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab6c545b-f177-4bbd-afd0-d4db72a73f19 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:09.811455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab6c545b-f177-4bbd-afd0-d4db72a73f19 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:09.937914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1247937769", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "e9cfc0cd-4899-490f-8df4-df7276c26882"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:10.018704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] validate_networks() for [('e9cfc0cd-4899-490f-8df4-df7276c26882', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:10:10.139370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ab6c545b-f177-4bbd-afd0-d4db72a73f19 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:10.151652 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ab6c545b-f177-4bbd-afd0-d4db72a73f19 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.361510 Aug 02 07:10:10.154713 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2274/4613] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:09 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:10.161536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6a5e701e-9e15-40ce-8abb-10ef8b8356dc tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:10.163308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6a5e701e-9e15-40ce-8abb-10ef8b8356dc tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:10.171922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a5e701e-9e15-40ce-8abb-10ef8b8356dc tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:10.173482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a5e701e-9e15-40ce-8abb-10ef8b8356dc tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:10.174617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a5e701e-9e15-40ce-8abb-10ef8b8356dc tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:10.175388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a5e701e-9e15-40ce-8abb-10ef8b8356dc tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:10.226262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:10.418611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6a5e701e-9e15-40ce-8abb-10ef8b8356dc tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:10.428065 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6a5e701e-9e15-40ce-8abb-10ef8b8356dc tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1520 microversion: 2.1 time: 0.270862 Aug 02 07:10:10.429177 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2275/4614] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:10 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:10.434172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-554bd3ca-2459-4e52-97aa-d55408d7e0e8 req-d855138b-de59-4c18-b7f2-c8420be149b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba90067e-50cc-4009-886b-124ae5608b6f", "name": "network-vif-plugged", "status": "completed", "tag": "359f0467-c390-4642-9439-c61430073554"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:10.445579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-554bd3ca-2459-4e52-97aa-d55408d7e0e8 req-d855138b-de59-4c18-b7f2-c8420be149b2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:10.446294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-554bd3ca-2459-4e52-97aa-d55408d7e0e8 req-d855138b-de59-4c18-b7f2-c8420be149b2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:10.471725 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-554bd3ca-2459-4e52-97aa-d55408d7e0e8 req-d855138b-de59-4c18-b7f2-c8420be149b2 service nova] Creating event network-vif-plugged:359f0467-c390-4642-9439-c61430073554 for instance ba90067e-50cc-4009-886b-124ae5608b6f on n-h1-851337-3 Aug 02 07:10:10.480431 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-554bd3ca-2459-4e52-97aa-d55408d7e0e8 req-d855138b-de59-4c18-b7f2-c8420be149b2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049448 Aug 02 07:10:10.482574 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2276/4615] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:10.770581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:10:10.786566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:10:10.787981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:10:10.789669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:10:10.790520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:10:10.805921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:10.806445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:10.807261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:10.807703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:10.852925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Getting quotas for project 6adeb58dc1964c3b93a757b1440b5624. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:10:10.862195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Getting quotas for user 67a8eca82e1747eba4bd9a283720df28 and project 6adeb58dc1964c3b93a757b1440b5624. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:10:10.877067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:10:10.879783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:10:10.931905 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ef2cb013-b622-4498-a0c9-50abba4720c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183964 Aug 02 07:10:10.943801 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2340/4616] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:10:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:10:10.988313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-488496331", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "e9cfc0cd-4899-490f-8df4-df7276c26882"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:11.058185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] validate_networks() for [('e9cfc0cd-4899-490f-8df4-df7276c26882', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:10:11.182281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-06fef47a-6064-4fe0-97a5-83078c83cfd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:11.183396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-06fef47a-6064-4fe0-97a5-83078c83cfd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:11.193429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06fef47a-6064-4fe0-97a5-83078c83cfd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:11.193879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06fef47a-6064-4fe0-97a5-83078c83cfd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:11.194684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06fef47a-6064-4fe0-97a5-83078c83cfd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:11.195113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06fef47a-6064-4fe0-97a5-83078c83cfd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:11.473426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-06fef47a-6064-4fe0-97a5-83078c83cfd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:11.489596 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-06fef47a-6064-4fe0-97a5-83078c83cfd0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.313565 Aug 02 07:10:11.505418 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2341/4617] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:11 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:11.514469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7faa731a-bd92-46d5-ad8a-269296e38293 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:11.515876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7faa731a-bd92-46d5-ad8a-269296e38293 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:11.542181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7faa731a-bd92-46d5-ad8a-269296e38293 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:11.543076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7faa731a-bd92-46d5-ad8a-269296e38293 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:11.544220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7faa731a-bd92-46d5-ad8a-269296e38293 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:11.544944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7faa731a-bd92-46d5-ad8a-269296e38293 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:11.830426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:10:11.830561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:10:11.831651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:10:11.832844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:10:11.833624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:10:11.856502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:11.857447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:11.860641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:11.861743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:11.877067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7faa731a-bd92-46d5-ad8a-269296e38293 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:11.893126 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7faa731a-bd92-46d5-ad8a-269296e38293 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1520 microversion: 2.1 time: 0.384073 Aug 02 07:10:11.894750 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2342/4618] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:11 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:11.927564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Getting quotas for project 6adeb58dc1964c3b93a757b1440b5624. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:10:11.935499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Getting quotas for user 67a8eca82e1747eba4bd9a283720df28 and project 6adeb58dc1964c3b93a757b1440b5624. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:10:11.955405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:10:11.959250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: fd8b1e0a-9584-420c-82e0-5c60e8d17a35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:10:12.023378 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7422fe03-6d4d-4d92-a7be-ea6619fd7500 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040059 Aug 02 07:10:12.025051 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2277/4619] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:10:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:10:12.107390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1123115918", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "451", "networks": [{"uuid": "e9cfc0cd-4899-490f-8df4-df7276c26882"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:12.259702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] validate_networks() for [('e9cfc0cd-4899-490f-8df4-df7276c26882', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:10:12.547928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-af53f01a-bf6c-42e1-8d4e-255e1cc4ed1b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:12.552734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-af53f01a-bf6c-42e1-8d4e-255e1cc4ed1b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:12.565211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af53f01a-bf6c-42e1-8d4e-255e1cc4ed1b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:12.565869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af53f01a-bf6c-42e1-8d4e-255e1cc4ed1b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:12.567213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af53f01a-bf6c-42e1-8d4e-255e1cc4ed1b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:12.567806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af53f01a-bf6c-42e1-8d4e-255e1cc4ed1b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:12.962786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-af53f01a-bf6c-42e1-8d4e-255e1cc4ed1b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:12.971750 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-af53f01a-bf6c-42e1-8d4e-255e1cc4ed1b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.434094 Aug 02 07:10:12.972337 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2278/4620] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:12 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:13.135458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-59c42260-27aa-4361-89f2-c85b09dbb02b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:13.137523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-59c42260-27aa-4361-89f2-c85b09dbb02b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:13.149515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59c42260-27aa-4361-89f2-c85b09dbb02b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:13.150702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59c42260-27aa-4361-89f2-c85b09dbb02b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:13.151996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59c42260-27aa-4361-89f2-c85b09dbb02b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:13.152708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59c42260-27aa-4361-89f2-c85b09dbb02b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:13.195774 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-59c42260-27aa-4361-89f2-c85b09dbb02b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments/b1d7e351-139d-4c5a-9f7b-9ceed5c6077e" status: 200 len: 194 microversion: 2.20 time: 0.213096 Aug 02 07:10:13.197917 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2279/4621] 10.222.0.79 () {60 vars in 1454 bytes} [Tue Aug 2 07:10:12 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments/b1d7e351-139d-4c5a-9f7b-9ceed5c6077e => generated 194 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:10:13.205651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-daa2086d-3935-466c-a3cf-3646a7f4f01a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:13.207777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-daa2086d-3935-466c-a3cf-3646a7f4f01a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:13.219447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daa2086d-3935-466c-a3cf-3646a7f4f01a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:13.220195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daa2086d-3935-466c-a3cf-3646a7f4f01a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:13.221690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daa2086d-3935-466c-a3cf-3646a7f4f01a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:13.222365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daa2086d-3935-466c-a3cf-3646a7f4f01a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:13.609300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:10:13.609815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:10:13.610292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:10:13.610712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:10:13.611138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:10:13.622151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:13.622619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:13.623451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:13.623905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:13.627159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-daa2086d-3935-466c-a3cf-3646a7f4f01a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:13.636245 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-daa2086d-3935-466c-a3cf-3646a7f4f01a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1505 microversion: 2.1 time: 0.436195 Aug 02 07:10:13.637164 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2280/4622] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:13 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:13.642746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Getting quotas for project 6adeb58dc1964c3b93a757b1440b5624. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:10:13.643641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6159c789-0fdf-411b-aa5f-4569bbfd9458 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:13.644339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6159c789-0fdf-411b-aa5f-4569bbfd9458 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:13.648514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Getting quotas for user 67a8eca82e1747eba4bd9a283720df28 and project 6adeb58dc1964c3b93a757b1440b5624. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:10:13.651765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6159c789-0fdf-411b-aa5f-4569bbfd9458 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:13.652594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6159c789-0fdf-411b-aa5f-4569bbfd9458 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:13.653600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6159c789-0fdf-411b-aa5f-4569bbfd9458 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:13.654340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6159c789-0fdf-411b-aa5f-4569bbfd9458 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:13.662251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:10:13.664536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:10:13.761466 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c53d5db2-9695-41ea-a51d-130384a936d3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.660533 Aug 02 07:10:13.766677 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2343/4623] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:10:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:10:13.803747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0c3e018e-27df-4ec4-9834-d30fb08e0ad6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:13.807258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0c3e018e-27df-4ec4-9834-d30fb08e0ad6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:13.836586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c3e018e-27df-4ec4-9834-d30fb08e0ad6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:13.843476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c3e018e-27df-4ec4-9834-d30fb08e0ad6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:13.845275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c3e018e-27df-4ec4-9834-d30fb08e0ad6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:13.846559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c3e018e-27df-4ec4-9834-d30fb08e0ad6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:13.848134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-6159c789-0fdf-411b-aa5f-4569bbfd9458 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lazy-loading 'services' on Instance uuid 9a9ae016-6a95-4257-8d74-99fcd50ae1cb {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:10:14.042016 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6159c789-0fdf-411b-aa5f-4569bbfd9458 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments/b1d7e351-139d-4c5a-9f7b-9ceed5c6077e" status: 202 len: 0 microversion: 2.20 time: 0.403363 Aug 02 07:10:14.043417 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2281/4624] 10.222.0.79 () {60 vars in 1457 bytes} [Tue Aug 2 07:10:13 2022] DELETE /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments/b1d7e351-139d-4c5a-9f7b-9ceed5c6077e => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:10:14.049862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b67dd911-7a5d-47c3-b196-2a526f6acd6e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:14.050860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b67dd911-7a5d-47c3-b196-2a526f6acd6e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:14.190356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b67dd911-7a5d-47c3-b196-2a526f6acd6e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:14.205726 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b67dd911-7a5d-47c3-b196-2a526f6acd6e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1221 microversion: 2.1 time: 0.160782 Aug 02 07:10:14.212020 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2282/4625] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:14 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1221 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:14.225175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-702d2681-d7f2-4d7a-bba5-b620d8767ddf tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:14.225826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-702d2681-d7f2-4d7a-bba5-b620d8767ddf tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:14.239696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-702d2681-d7f2-4d7a-bba5-b620d8767ddf tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:14.243462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-702d2681-d7f2-4d7a-bba5-b620d8767ddf tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:14.244612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-702d2681-d7f2-4d7a-bba5-b620d8767ddf tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:14.247152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-702d2681-d7f2-4d7a-bba5-b620d8767ddf tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:14.380156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0c3e018e-27df-4ec4-9834-d30fb08e0ad6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:14.388432 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0c3e018e-27df-4ec4-9834-d30fb08e0ad6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 200 len: 1505 microversion: 2.1 time: 0.620003 Aug 02 07:10:14.389251 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2344/4626] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:13 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 1505 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:14.396126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9e9d20bc-67cd-4480-98cd-613ae74d9e99 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:14.398733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9e9d20bc-67cd-4480-98cd-613ae74d9e99 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:14.408006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e9d20bc-67cd-4480-98cd-613ae74d9e99 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:14.409039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e9d20bc-67cd-4480-98cd-613ae74d9e99 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:14.414181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e9d20bc-67cd-4480-98cd-613ae74d9e99 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:14.415124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e9d20bc-67cd-4480-98cd-613ae74d9e99 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:14.470252 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9e9d20bc-67cd-4480-98cd-613ae74d9e99 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079568 Aug 02 07:10:14.471195 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2345/4627] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 07:10:14 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:10:14.476332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e480cbe5-424c-4779-ae46-999e692ed0da tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:14.477169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e480cbe5-424c-4779-ae46-999e692ed0da tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:14.483784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e480cbe5-424c-4779-ae46-999e692ed0da tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:14.484489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e480cbe5-424c-4779-ae46-999e692ed0da tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:14.485446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e480cbe5-424c-4779-ae46-999e692ed0da tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:14.486207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e480cbe5-424c-4779-ae46-999e692ed0da tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:14.516382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e480cbe5-424c-4779-ae46-999e692ed0da tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:10:14.571254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-702d2681-d7f2-4d7a-bba5-b620d8767ddf tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:14.588396 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-702d2681-d7f2-4d7a-bba5-b620d8767ddf tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.374837 Aug 02 07:10:14.589279 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2283/4628] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:14 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:14.670469 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e480cbe5-424c-4779-ae46-999e692ed0da tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 204 len: 0 microversion: 2.1 time: 0.197304 Aug 02 07:10:14.671263 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2346/4629] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:10:14 2022] DELETE /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:10:14.910395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1287212747", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "0c6b1f64-899d-4e1f-bc89-61a10c8bc1e2"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:14.991596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] validate_networks() for [('0c6b1f64-899d-4e1f-bc89-61a10c8bc1e2', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:10:15.236502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a41a28e-2813-4a69-bd7a-ff32af7ebcf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:15.237092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8a41a28e-2813-4a69-bd7a-ff32af7ebcf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:15.247558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a41a28e-2813-4a69-bd7a-ff32af7ebcf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:15.248105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a41a28e-2813-4a69-bd7a-ff32af7ebcf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:15.249013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a41a28e-2813-4a69-bd7a-ff32af7ebcf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:15.249471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a41a28e-2813-4a69-bd7a-ff32af7ebcf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:15.373452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8a41a28e-2813-4a69-bd7a-ff32af7ebcf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:15.386544 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8a41a28e-2813-4a69-bd7a-ff32af7ebcf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1217 microversion: 2.1 time: 0.155336 Aug 02 07:10:15.398899 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2347/4630] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:15 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:15.498841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-171f286a-4742-4b9b-b12a-de580047cb89 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:15.504904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-171f286a-4742-4b9b-b12a-de580047cb89 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:15.524177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-171f286a-4742-4b9b-b12a-de580047cb89 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:15.526620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-171f286a-4742-4b9b-b12a-de580047cb89 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:15.529041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-171f286a-4742-4b9b-b12a-de580047cb89 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:15.530267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-171f286a-4742-4b9b-b12a-de580047cb89 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:15.607188 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-171f286a-4742-4b9b-b12a-de580047cb89 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.123003 Aug 02 07:10:15.608627 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2348/4631] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 07:10:15 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:10:15.623595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-62e450fc-861a-4e46-8cc1-5cccca5b6009 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:15.625328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-62e450fc-861a-4e46-8cc1-5cccca5b6009 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:15.639180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62e450fc-861a-4e46-8cc1-5cccca5b6009 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:15.639929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62e450fc-861a-4e46-8cc1-5cccca5b6009 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:15.642272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62e450fc-861a-4e46-8cc1-5cccca5b6009 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:15.643044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-62e450fc-861a-4e46-8cc1-5cccca5b6009 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:15.754218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:10:15.755221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:10:15.756249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:10:15.757023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:10:15.757857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:10:15.775760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:15.780178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:15.782371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:15.786202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:15.811549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:15.827332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Getting quotas for project 4a324b72e01a4bbfb25e822709ba2ddc. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:10:15.835763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Getting quotas for user af2e27618e26434e9f320ba83533cfa2 and project 4a324b72e01a4bbfb25e822709ba2ddc. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:10:15.867954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:10:15.873964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:10:15.968423 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-655f2ffb-98b7-47d6-866f-f5d9b0ac3284 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063552 Aug 02 07:10:15.969392 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2284/4632] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:10:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:10:15.981242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ad35f55b-fb73-4f95-bed1-98a5f5b1d5cf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:15.981862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ad35f55b-fb73-4f95-bed1-98a5f5b1d5cf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:15.998799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-62e450fc-861a-4e46-8cc1-5cccca5b6009 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:16.014646 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-62e450fc-861a-4e46-8cc1-5cccca5b6009 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.397387 Aug 02 07:10:16.017110 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2349/4633] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:15 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:16.055886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b1e52712-34a4-467d-818f-91f19667cbd6 req-e4f7dfc5-8f9c-4637-8f9b-725a9dc54b9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd8b1e0a-9584-420c-82e0-5c60e8d17a35", "tag": "2561b1e6-dd74-4efb-9bae-86ac94e53546"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:16.120065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b1e52712-34a4-467d-818f-91f19667cbd6 req-e4f7dfc5-8f9c-4637-8f9b-725a9dc54b9b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:16.130860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b1e52712-34a4-467d-818f-91f19667cbd6 req-e4f7dfc5-8f9c-4637-8f9b-725a9dc54b9b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:16.180402 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b1e52712-34a4-467d-818f-91f19667cbd6 req-e4f7dfc5-8f9c-4637-8f9b-725a9dc54b9b service nova] Creating event network-changed:2561b1e6-dd74-4efb-9bae-86ac94e53546 for instance fd8b1e0a-9584-420c-82e0-5c60e8d17a35 on n-h2-851337-3 Aug 02 07:10:16.199401 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b1e52712-34a4-467d-818f-91f19667cbd6 req-e4f7dfc5-8f9c-4637-8f9b-725a9dc54b9b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160621 Aug 02 07:10:16.201143 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2350/4634] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:16.236286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ad35f55b-fb73-4f95-bed1-98a5f5b1d5cf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:16.245466 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ad35f55b-fb73-4f95-bed1-98a5f5b1d5cf tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1218 microversion: 2.1 time: 0.267550 Aug 02 07:10:16.247780 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2285/4635] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:15 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1218 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:16.441944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e875061d-b67a-4e41-bc60-225877eb9218 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:16.444992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e875061d-b67a-4e41-bc60-225877eb9218 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:16.469278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e875061d-b67a-4e41-bc60-225877eb9218 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:16.476424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e875061d-b67a-4e41-bc60-225877eb9218 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:16.477624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e875061d-b67a-4e41-bc60-225877eb9218 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:16.478298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e875061d-b67a-4e41-bc60-225877eb9218 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:16.599892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-19a582bc-6c60-4acc-b123-c8d369320574 req-10a4d5f8-334e-44bf-8c14-9f1f7a4b946f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d100437-b34c-4421-8793-64b8a4480a56", "tag": "b6435b4c-d475-4e8b-8eae-b2a4f33ad4f1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:16.668373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-19a582bc-6c60-4acc-b123-c8d369320574 req-10a4d5f8-334e-44bf-8c14-9f1f7a4b946f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:16.670041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-19a582bc-6c60-4acc-b123-c8d369320574 req-10a4d5f8-334e-44bf-8c14-9f1f7a4b946f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:16.689609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e875061d-b67a-4e41-bc60-225877eb9218 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:16.692484 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-19a582bc-6c60-4acc-b123-c8d369320574 req-10a4d5f8-334e-44bf-8c14-9f1f7a4b946f service nova] Creating event network-changed:b6435b4c-d475-4e8b-8eae-b2a4f33ad4f1 for instance 9d100437-b34c-4421-8793-64b8a4480a56 on n-h2-851337-3 Aug 02 07:10:16.703067 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e875061d-b67a-4e41-bc60-225877eb9218 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1273 microversion: 2.1 time: 0.293527 Aug 02 07:10:16.708705 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-19a582bc-6c60-4acc-b123-c8d369320574 req-10a4d5f8-334e-44bf-8c14-9f1f7a4b946f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117720 Aug 02 07:10:16.709265 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2351/4636] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:16 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1273 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:16.709565 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2286/4637] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:16.717741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8fe9046a-9ff1-4842-91e5-93f74440662a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:16.720634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8fe9046a-9ff1-4842-91e5-93f74440662a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:16.728703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fe9046a-9ff1-4842-91e5-93f74440662a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:16.730006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fe9046a-9ff1-4842-91e5-93f74440662a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:16.732036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fe9046a-9ff1-4842-91e5-93f74440662a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:16.732741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fe9046a-9ff1-4842-91e5-93f74440662a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:16.773201 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8fe9046a-9ff1-4842-91e5-93f74440662a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062181 Aug 02 07:10:16.776333 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2352/4638] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 07:10:16 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:10:17.051078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-60b0f546-5afd-4c56-a83c-e0bb3e9c98a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:17.052510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-60b0f546-5afd-4c56-a83c-e0bb3e9c98a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:17.059832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60b0f546-5afd-4c56-a83c-e0bb3e9c98a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:17.060599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60b0f546-5afd-4c56-a83c-e0bb3e9c98a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:17.061436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60b0f546-5afd-4c56-a83c-e0bb3e9c98a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:17.062115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60b0f546-5afd-4c56-a83c-e0bb3e9c98a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:17.275670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-60b0f546-5afd-4c56-a83c-e0bb3e9c98a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:17.278670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-de810d52-50ee-4b35-b856-501a40cbfb37 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:17.281384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-de810d52-50ee-4b35-b856-501a40cbfb37 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:17.294481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de810d52-50ee-4b35-b856-501a40cbfb37 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:17.295756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de810d52-50ee-4b35-b856-501a40cbfb37 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:17.298918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de810d52-50ee-4b35-b856-501a40cbfb37 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:17.300266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de810d52-50ee-4b35-b856-501a40cbfb37 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:17.301540 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-60b0f546-5afd-4c56-a83c-e0bb3e9c98a0 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.255950 Aug 02 07:10:17.302989 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2287/4639] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:17 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:17.427073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-de810d52-50ee-4b35-b856-501a40cbfb37 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:17.442213 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-de810d52-50ee-4b35-b856-501a40cbfb37 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1222 microversion: 2.1 time: 0.173547 Aug 02 07:10:17.454531 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2353/4640] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:17 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1222 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:17.726570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8e30f87a-9398-4fb3-a6af-7e9cda78e82a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:17.727652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8e30f87a-9398-4fb3-a6af-7e9cda78e82a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:17.735004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e30f87a-9398-4fb3-a6af-7e9cda78e82a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:17.735714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e30f87a-9398-4fb3-a6af-7e9cda78e82a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:17.736960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e30f87a-9398-4fb3-a6af-7e9cda78e82a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:17.737617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e30f87a-9398-4fb3-a6af-7e9cda78e82a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:17.788408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-012ba76f-67e3-497e-9449-a1b7f3c382d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:17.791351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-012ba76f-67e3-497e-9449-a1b7f3c382d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:17.799468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-012ba76f-67e3-497e-9449-a1b7f3c382d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:17.800384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-012ba76f-67e3-497e-9449-a1b7f3c382d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:17.801655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-012ba76f-67e3-497e-9449-a1b7f3c382d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:17.802379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-012ba76f-67e3-497e-9449-a1b7f3c382d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:17.843728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8e30f87a-9398-4fb3-a6af-7e9cda78e82a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:17.851559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:17.860052 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8e30f87a-9398-4fb3-a6af-7e9cda78e82a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1279 microversion: 2.1 time: 0.138648 Aug 02 07:10:17.862121 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2288/4641] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:17 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1279 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:17.867974 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-012ba76f-67e3-497e-9449-a1b7f3c382d3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084552 Aug 02 07:10:17.869142 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2354/4642] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 07:10:17 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:10:18.240359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-5b0c1c16-6107-4472-88d6-169635aea383 req-d7b75a34-b8ba-4322-8b92-21cbeebe923f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba90067e-50cc-4009-886b-124ae5608b6f", "name": "network-vif-deleted", "tag": "359f0467-c390-4642-9439-c61430073554"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:18.272940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5b0c1c16-6107-4472-88d6-169635aea383 req-d7b75a34-b8ba-4322-8b92-21cbeebe923f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:18.273754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5b0c1c16-6107-4472-88d6-169635aea383 req-d7b75a34-b8ba-4322-8b92-21cbeebe923f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:18.287751 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-5b0c1c16-6107-4472-88d6-169635aea383 req-d7b75a34-b8ba-4322-8b92-21cbeebe923f service nova] Creating event network-vif-deleted:359f0467-c390-4642-9439-c61430073554 for instance ba90067e-50cc-4009-886b-124ae5608b6f on n-h1-851337-3 Aug 02 07:10:18.293832 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-5b0c1c16-6107-4472-88d6-169635aea383 req-d7b75a34-b8ba-4322-8b92-21cbeebe923f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061369 Aug 02 07:10:18.295037 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2289/4643] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:18.345209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a7ef0a5b-5e62-4d0b-ab86-6869907716f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:18.350613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a7ef0a5b-5e62-4d0b-ab86-6869907716f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:18.376773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7ef0a5b-5e62-4d0b-ab86-6869907716f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:18.380106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7ef0a5b-5e62-4d0b-ab86-6869907716f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:18.381758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7ef0a5b-5e62-4d0b-ab86-6869907716f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:18.385816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7ef0a5b-5e62-4d0b-ab86-6869907716f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:18.481788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-daed085f-c30c-4548-9bac-0199b543ca24 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:18.487835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-daed085f-c30c-4548-9bac-0199b543ca24 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:18.521932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daed085f-c30c-4548-9bac-0199b543ca24 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:18.523852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daed085f-c30c-4548-9bac-0199b543ca24 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:18.526240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daed085f-c30c-4548-9bac-0199b543ca24 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:18.527007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daed085f-c30c-4548-9bac-0199b543ca24 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:18.858580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-daed085f-c30c-4548-9bac-0199b543ca24 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:18.869225 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-daed085f-c30c-4548-9bac-0199b543ca24 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1222 microversion: 2.1 time: 0.399477 Aug 02 07:10:18.873950 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2290/4644] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:18 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1222 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:18.899124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7b18d0a2-4a57-4119-8815-a1a343292bd2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:18.908837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7b18d0a2-4a57-4119-8815-a1a343292bd2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:18.930861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b18d0a2-4a57-4119-8815-a1a343292bd2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:18.932163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b18d0a2-4a57-4119-8815-a1a343292bd2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:18.933693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b18d0a2-4a57-4119-8815-a1a343292bd2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:18.936604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7b18d0a2-4a57-4119-8815-a1a343292bd2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:19.035971 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7b18d0a2-4a57-4119-8815-a1a343292bd2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.157739 Aug 02 07:10:19.038143 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2291/4645] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 07:10:18 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:10:19.057119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a18b399c-fc6f-4d50-ada8-c4d153f2bdce tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:19.062800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a18b399c-fc6f-4d50-ada8-c4d153f2bdce tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:19.099109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a18b399c-fc6f-4d50-ada8-c4d153f2bdce tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:19.099966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a18b399c-fc6f-4d50-ada8-c4d153f2bdce tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:19.101000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a18b399c-fc6f-4d50-ada8-c4d153f2bdce tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:19.101802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a18b399c-fc6f-4d50-ada8-c4d153f2bdce tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:19.245054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a7ef0a5b-5e62-4d0b-ab86-6869907716f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:19.267534 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a7ef0a5b-5e62-4d0b-ab86-6869907716f3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.936185 Aug 02 07:10:19.268500 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2355/4646] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:18 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:19.356571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a18b399c-fc6f-4d50-ada8-c4d153f2bdce tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:19.371866 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a18b399c-fc6f-4d50-ada8-c4d153f2bdce tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1321 microversion: 2.1 time: 0.331331 Aug 02 07:10:19.372699 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2292/4647] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:19 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:19.865070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c91824d-9891-428a-bce9-02e318be77a5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:19.868987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9c91824d-9891-428a-bce9-02e318be77a5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:19.879606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c91824d-9891-428a-bce9-02e318be77a5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:19.882610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c91824d-9891-428a-bce9-02e318be77a5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:19.883448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c91824d-9891-428a-bce9-02e318be77a5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:19.884453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c91824d-9891-428a-bce9-02e318be77a5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:19.916441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b42e0652-99ae-4263-a809-48e66d6f3719 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:19.917612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b42e0652-99ae-4263-a809-48e66d6f3719 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:19.936367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b42e0652-99ae-4263-a809-48e66d6f3719 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:19.937162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b42e0652-99ae-4263-a809-48e66d6f3719 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:19.944410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b42e0652-99ae-4263-a809-48e66d6f3719 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:19.945284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b42e0652-99ae-4263-a809-48e66d6f3719 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:20.064041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b42e0652-99ae-4263-a809-48e66d6f3719 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:20.082054 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b42e0652-99ae-4263-a809-48e66d6f3719 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1270 microversion: 2.1 time: 0.173369 Aug 02 07:10:20.084070 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2293/4648] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:19 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:20.114882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2790151b-9b15-4925-a947-d740556af45b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:20.125520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2790151b-9b15-4925-a947-d740556af45b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:20.129833 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9c91824d-9891-428a-bce9-02e318be77a5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724/action" status: 200 len: 24560 microversion: 2.1 time: 0.270958 Aug 02 07:10:20.131140 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2356/4649] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:10:19 2022] POST /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724/action => generated 24560 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:10:20.148850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2790151b-9b15-4925-a947-d740556af45b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:20.152817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2790151b-9b15-4925-a947-d740556af45b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:20.159426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2790151b-9b15-4925-a947-d740556af45b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:20.160120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2790151b-9b15-4925-a947-d740556af45b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:20.293251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f3f33ca9-444b-481e-bc89-ea74ba0c0a2c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:20.294493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f3f33ca9-444b-481e-bc89-ea74ba0c0a2c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:20.314398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3f33ca9-444b-481e-bc89-ea74ba0c0a2c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:20.315465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3f33ca9-444b-481e-bc89-ea74ba0c0a2c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:20.316704 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2790151b-9b15-4925-a947-d740556af45b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.228417 Aug 02 07:10:20.320091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3f33ca9-444b-481e-bc89-ea74ba0c0a2c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:20.320522 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2294/4650] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 07:10:20 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments => generated 197 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:10:20.331061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3f33ca9-444b-481e-bc89-ea74ba0c0a2c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:20.349615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-7279337d-304b-4457-99a2-26fdc80b3b4c req-f6a15972-900b-41b0-b048-5e16102db138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698accff-ea86-4c25-9757-cf21b7e06d5e", "tag": "57c8008d-c1fe-4d6d-9a07-a8cdc41b7f50"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:20.390951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7279337d-304b-4457-99a2-26fdc80b3b4c req-f6a15972-900b-41b0-b048-5e16102db138 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:20.391717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7279337d-304b-4457-99a2-26fdc80b3b4c req-f6a15972-900b-41b0-b048-5e16102db138 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:20.446486 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-7279337d-304b-4457-99a2-26fdc80b3b4c req-f6a15972-900b-41b0-b048-5e16102db138 service nova] Creating event network-changed:57c8008d-c1fe-4d6d-9a07-a8cdc41b7f50 for instance 698accff-ea86-4c25-9757-cf21b7e06d5e on n-h1-851337-3 Aug 02 07:10:20.465563 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-7279337d-304b-4457-99a2-26fdc80b3b4c req-f6a15972-900b-41b0-b048-5e16102db138 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124074 Aug 02 07:10:20.478692 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2295/4651] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:10:20.493231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cfa7f0cb-8d45-4f7d-bd48-ceb9808b92b0 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:20.494536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cfa7f0cb-8d45-4f7d-bd48-ceb9808b92b0 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:20.525700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cfa7f0cb-8d45-4f7d-bd48-ceb9808b92b0 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:20.526701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cfa7f0cb-8d45-4f7d-bd48-ceb9808b92b0 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:20.528139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cfa7f0cb-8d45-4f7d-bd48-ceb9808b92b0 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:20.530062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cfa7f0cb-8d45-4f7d-bd48-ceb9808b92b0 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:21.493541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f3f33ca9-444b-481e-bc89-ea74ba0c0a2c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:21.507927 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f3f33ca9-444b-481e-bc89-ea74ba0c0a2c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 1.220082 Aug 02 07:10:21.508521 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2357/4652] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:20 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:21.513065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-57a39b3c-e104-42fe-a8be-902def5d9fc6 req-22ef0533-548e-4354-8a86-0fb4b987f898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8b1e0a-9584-420c-82e0-5c60e8d17a35", "name": "network-vif-plugged", "status": "completed", "tag": "2561b1e6-dd74-4efb-9bae-86ac94e53546"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:21.534857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cfa7f0cb-8d45-4f7d-bd48-ceb9808b92b0 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:21.536297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-57a39b3c-e104-42fe-a8be-902def5d9fc6 req-22ef0533-548e-4354-8a86-0fb4b987f898 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:21.538052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-57a39b3c-e104-42fe-a8be-902def5d9fc6 req-22ef0533-548e-4354-8a86-0fb4b987f898 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:21.548303 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cfa7f0cb-8d45-4f7d-bd48-ceb9808b92b0 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1321 microversion: 2.1 time: 1.063233 Aug 02 07:10:21.554608 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2296/4653] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:20 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1321 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:21.570757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-871caa8d-455b-4170-9c02-f714486fb55f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:21.571877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-871caa8d-455b-4170-9c02-f714486fb55f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:21.577609 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-57a39b3c-e104-42fe-a8be-902def5d9fc6 req-22ef0533-548e-4354-8a86-0fb4b987f898 service nova] Creating event network-vif-plugged:2561b1e6-dd74-4efb-9bae-86ac94e53546 for instance fd8b1e0a-9584-420c-82e0-5c60e8d17a35 on n-h2-851337-3 Aug 02 07:10:21.588890 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-57a39b3c-e104-42fe-a8be-902def5d9fc6 req-22ef0533-548e-4354-8a86-0fb4b987f898 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079019 Aug 02 07:10:21.607638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-871caa8d-455b-4170-9c02-f714486fb55f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:21.608609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-871caa8d-455b-4170-9c02-f714486fb55f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:21.609107 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2358/4654] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:21.611789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-871caa8d-455b-4170-9c02-f714486fb55f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:21.612557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-871caa8d-455b-4170-9c02-f714486fb55f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:21.628379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43a9846b-aeb4-40c6-9d0f-6e1dda8d89b2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:21.631266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-43a9846b-aeb4-40c6-9d0f-6e1dda8d89b2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:21.645621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43a9846b-aeb4-40c6-9d0f-6e1dda8d89b2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:21.648461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43a9846b-aeb4-40c6-9d0f-6e1dda8d89b2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:21.651168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43a9846b-aeb4-40c6-9d0f-6e1dda8d89b2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:21.654895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43a9846b-aeb4-40c6-9d0f-6e1dda8d89b2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:21.679301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:21.739931 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43a9846b-aeb4-40c6-9d0f-6e1dda8d89b2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129189 Aug 02 07:10:21.744795 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2359/4655] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 07:10:21 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:10:21.793535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-871caa8d-455b-4170-9c02-f714486fb55f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:21.809941 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-871caa8d-455b-4170-9c02-f714486fb55f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1276 microversion: 2.1 time: 0.253404 Aug 02 07:10:21.810693 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2297/4656] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:21 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1276 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:22.546625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8668ce2b-a319-4f44-96ad-ac808276256c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:22.547855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8668ce2b-a319-4f44-96ad-ac808276256c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:22.559010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8668ce2b-a319-4f44-96ad-ac808276256c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:22.563716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8668ce2b-a319-4f44-96ad-ac808276256c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:22.564798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8668ce2b-a319-4f44-96ad-ac808276256c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:22.565442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8668ce2b-a319-4f44-96ad-ac808276256c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:22.591863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f462356e-7379-4b23-b7f8-1390dd0d8230 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:22.592479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f462356e-7379-4b23-b7f8-1390dd0d8230 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:22.606395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f462356e-7379-4b23-b7f8-1390dd0d8230 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:22.607937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f462356e-7379-4b23-b7f8-1390dd0d8230 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:22.607937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f462356e-7379-4b23-b7f8-1390dd0d8230 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:22.608559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f462356e-7379-4b23-b7f8-1390dd0d8230 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:22.896235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8668ce2b-a319-4f44-96ad-ac808276256c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:22.913089 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8668ce2b-a319-4f44-96ad-ac808276256c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.369916 Aug 02 07:10:22.917057 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2360/4657] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:22 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:22.925165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f462356e-7379-4b23-b7f8-1390dd0d8230 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:22.935314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ae53fb5c-fcb2-4fd5-ab73-34a5a4e8aee8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:22.940468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae53fb5c-fcb2-4fd5-ab73-34a5a4e8aee8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:22.952332 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f462356e-7379-4b23-b7f8-1390dd0d8230 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1321 microversion: 2.1 time: 0.364208 Aug 02 07:10:22.957923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae53fb5c-fcb2-4fd5-ab73-34a5a4e8aee8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:22.959120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae53fb5c-fcb2-4fd5-ab73-34a5a4e8aee8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:22.960723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae53fb5c-fcb2-4fd5-ab73-34a5a4e8aee8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:22.961686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae53fb5c-fcb2-4fd5-ab73-34a5a4e8aee8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:22.966198 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2298/4658] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:22 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:22.971587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6ba00265-ea9a-4fa8-b6b0-e790f9a4c8a8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:22.972196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6ba00265-ea9a-4fa8-b6b0-e790f9a4c8a8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:22.988740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ba00265-ea9a-4fa8-b6b0-e790f9a4c8a8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:22.989468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ba00265-ea9a-4fa8-b6b0-e790f9a4c8a8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:22.990485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ba00265-ea9a-4fa8-b6b0-e790f9a4c8a8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:22.991085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ba00265-ea9a-4fa8-b6b0-e790f9a4c8a8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:23.114229 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ae53fb5c-fcb2-4fd5-ab73-34a5a4e8aee8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.189466 Aug 02 07:10:23.116006 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2361/4659] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 07:10:22 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:10:23.345062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6ba00265-ea9a-4fa8-b6b0-e790f9a4c8a8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:23.369768 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6ba00265-ea9a-4fa8-b6b0-e790f9a4c8a8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1318 microversion: 2.1 time: 0.393419 Aug 02 07:10:23.371111 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2299/4660] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:22 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:23.630201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6f465194-d533-4df2-9abc-2e688008f56b req-eb3dddce-a3a1-4680-bea1-9b89bc29b7ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d100437-b34c-4421-8793-64b8a4480a56", "name": "network-vif-plugged", "status": "completed", "tag": "b6435b4c-d475-4e8b-8eae-b2a4f33ad4f1"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:23.641679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:23.650757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6f465194-d533-4df2-9abc-2e688008f56b req-eb3dddce-a3a1-4680-bea1-9b89bc29b7ac service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:23.651295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6f465194-d533-4df2-9abc-2e688008f56b req-eb3dddce-a3a1-4680-bea1-9b89bc29b7ac service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:23.656795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=12 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:23.666413 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-6f465194-d533-4df2-9abc-2e688008f56b req-eb3dddce-a3a1-4680-bea1-9b89bc29b7ac service nova] Creating event network-vif-plugged:b6435b4c-d475-4e8b-8eae-b2a4f33ad4f1 for instance 9d100437-b34c-4421-8793-64b8a4480a56 on n-h2-851337-3 Aug 02 07:10:23.671983 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6f465194-d533-4df2-9abc-2e688008f56b req-eb3dddce-a3a1-4680-bea1-9b89bc29b7ac service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049555 Aug 02 07:10:23.676192 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2362/4661] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:23.978133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-38dd1635-f5cd-49e5-a6d5-9fb109472ff8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:23.983396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-38dd1635-f5cd-49e5-a6d5-9fb109472ff8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:23.991344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3e18666e-053e-423e-9dc3-6ac8ccf1563b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:23.996978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3e18666e-053e-423e-9dc3-6ac8ccf1563b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:23.997874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38dd1635-f5cd-49e5-a6d5-9fb109472ff8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:23.998350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38dd1635-f5cd-49e5-a6d5-9fb109472ff8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:23.999125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38dd1635-f5cd-49e5-a6d5-9fb109472ff8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:23.999548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38dd1635-f5cd-49e5-a6d5-9fb109472ff8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:24.021351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e18666e-053e-423e-9dc3-6ac8ccf1563b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:24.023241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e18666e-053e-423e-9dc3-6ac8ccf1563b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:24.025565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e18666e-053e-423e-9dc3-6ac8ccf1563b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:24.027457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e18666e-053e-423e-9dc3-6ac8ccf1563b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:24.348481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3e18666e-053e-423e-9dc3-6ac8ccf1563b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:24.358687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-38dd1635-f5cd-49e5-a6d5-9fb109472ff8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:24.386726 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-38dd1635-f5cd-49e5-a6d5-9fb109472ff8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.430211 Aug 02 07:10:24.389584 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3e18666e-053e-423e-9dc3-6ac8ccf1563b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1321 microversion: 2.1 time: 0.417772 Aug 02 07:10:24.414134 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2363/4662] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:23 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:24.433403 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2300/4663] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:23 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:24.454246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c487ade6-538a-4e55-9234-c2922f3f0664 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:24.459659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-46f12c4c-26bb-4f48-be39-736d1eacd684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:24.463632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-46f12c4c-26bb-4f48-be39-736d1eacd684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:24.466182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c487ade6-538a-4e55-9234-c2922f3f0664 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:24.485947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46f12c4c-26bb-4f48-be39-736d1eacd684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:24.491158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c487ade6-538a-4e55-9234-c2922f3f0664 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:24.491811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c487ade6-538a-4e55-9234-c2922f3f0664 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:24.493829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46f12c4c-26bb-4f48-be39-736d1eacd684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:24.495106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46f12c4c-26bb-4f48-be39-736d1eacd684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:24.495875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46f12c4c-26bb-4f48-be39-736d1eacd684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:24.505595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c487ade6-538a-4e55-9234-c2922f3f0664 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:24.506433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c487ade6-538a-4e55-9234-c2922f3f0664 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:24.561636 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c487ade6-538a-4e55-9234-c2922f3f0664 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.128879 Aug 02 07:10:24.563190 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2364/4664] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 07:10:24 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:24.583356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-8691da69-0597-4a17-b363-b7d0d97a3a2e req-ca3a47e0-5447-49b8-980d-101fa679bbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32378f59-645b-4f54-8d09-d30c783496d1", "tag": "5f4865d9-a451-4b8f-929a-4afc9ed99e04"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:24.618461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8691da69-0597-4a17-b363-b7d0d97a3a2e req-ca3a47e0-5447-49b8-980d-101fa679bbe5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:24.624287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8691da69-0597-4a17-b363-b7d0d97a3a2e req-ca3a47e0-5447-49b8-980d-101fa679bbe5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:24.673681 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-8691da69-0597-4a17-b363-b7d0d97a3a2e req-ca3a47e0-5447-49b8-980d-101fa679bbe5 service nova] Creating event network-changed:5f4865d9-a451-4b8f-929a-4afc9ed99e04 for instance 32378f59-645b-4f54-8d09-d30c783496d1 on n-h2-851337-3 Aug 02 07:10:24.703416 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-8691da69-0597-4a17-b363-b7d0d97a3a2e req-ca3a47e0-5447-49b8-980d-101fa679bbe5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133404 Aug 02 07:10:24.705340 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2365/4665] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:24.725091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-46f12c4c-26bb-4f48-be39-736d1eacd684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:24.732684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df2e4d6f-f91b-4792-a262-42cb0a2ccdbf tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:24.733681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df2e4d6f-f91b-4792-a262-42cb0a2ccdbf tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:24.740829 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-46f12c4c-26bb-4f48-be39-736d1eacd684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1318 microversion: 2.1 time: 0.305826 Aug 02 07:10:24.742060 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2301/4666] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:24 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:24.754054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df2e4d6f-f91b-4792-a262-42cb0a2ccdbf tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:24.754054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df2e4d6f-f91b-4792-a262-42cb0a2ccdbf tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:24.754054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df2e4d6f-f91b-4792-a262-42cb0a2ccdbf tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:24.754054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df2e4d6f-f91b-4792-a262-42cb0a2ccdbf tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:24.802744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df2e4d6f-f91b-4792-a262-42cb0a2ccdbf tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:10:24.961177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:24.968079 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df2e4d6f-f91b-4792-a262-42cb0a2ccdbf tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 204 len: 0 microversion: 2.20 time: 0.242555 Aug 02 07:10:24.969185 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2366/4667] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 07:10:24 2022] DELETE /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 02 07:10:24.980046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0770aa36-00e3-4cc8-b012-240236c5757e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:24.980906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0770aa36-00e3-4cc8-b012-240236c5757e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:24.987928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0770aa36-00e3-4cc8-b012-240236c5757e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:24.988371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0770aa36-00e3-4cc8-b012-240236c5757e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:24.989376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0770aa36-00e3-4cc8-b012-240236c5757e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:24.989802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0770aa36-00e3-4cc8-b012-240236c5757e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:25.287576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0770aa36-00e3-4cc8-b012-240236c5757e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:25.300445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0770aa36-00e3-4cc8-b012-240236c5757e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:25.302267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0770aa36-00e3-4cc8-b012-240236c5757e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:25.303730 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0770aa36-00e3-4cc8-b012-240236c5757e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1722 microversion: 2.20 time: 0.327988 Aug 02 07:10:25.304389 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2302/4668] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:24 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:10:25.426769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b6e6011-47e0-49c1-a285-52a25403a847 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:25.428188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6b6e6011-47e0-49c1-a285-52a25403a847 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:25.441374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b6e6011-47e0-49c1-a285-52a25403a847 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:25.442477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b6e6011-47e0-49c1-a285-52a25403a847 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:25.443997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b6e6011-47e0-49c1-a285-52a25403a847 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:25.444760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b6e6011-47e0-49c1-a285-52a25403a847 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:25.461666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85343184-fdde-4140-add2-526f44a1d0e3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:25.463187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-85343184-fdde-4140-add2-526f44a1d0e3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:25.474949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85343184-fdde-4140-add2-526f44a1d0e3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:25.475757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85343184-fdde-4140-add2-526f44a1d0e3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:25.477181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85343184-fdde-4140-add2-526f44a1d0e3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:25.478043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85343184-fdde-4140-add2-526f44a1d0e3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:25.774492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6b6e6011-47e0-49c1-a285-52a25403a847 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:25.801805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:25.813868 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6b6e6011-47e0-49c1-a285-52a25403a847 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1321 microversion: 2.1 time: 0.392228 Aug 02 07:10:25.837218 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2367/4669] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:25 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1321 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:25.845508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1a72c800-5a2a-4076-b711-e146aa3e83ea tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:25.846165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1a72c800-5a2a-4076-b711-e146aa3e83ea tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:25.851708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-85343184-fdde-4140-add2-526f44a1d0e3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:25.859522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a72c800-5a2a-4076-b711-e146aa3e83ea tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:25.859969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a72c800-5a2a-4076-b711-e146aa3e83ea tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:25.860751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a72c800-5a2a-4076-b711-e146aa3e83ea tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:25.861186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a72c800-5a2a-4076-b711-e146aa3e83ea tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:25.889786 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-85343184-fdde-4140-add2-526f44a1d0e3 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.436299 Aug 02 07:10:25.904067 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2303/4670] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:25 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:26.128048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1a72c800-5a2a-4076-b711-e146aa3e83ea tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:26.138590 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1a72c800-5a2a-4076-b711-e146aa3e83ea tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1318 microversion: 2.1 time: 0.306873 Aug 02 07:10:26.139570 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2368/4671] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:25 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:26.336168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a730d7a7-fd69-40b6-95b1-07cb1307f949 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:26.337002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a730d7a7-fd69-40b6-95b1-07cb1307f949 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:26.339936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=16 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:26.346783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a730d7a7-fd69-40b6-95b1-07cb1307f949 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:26.347232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a730d7a7-fd69-40b6-95b1-07cb1307f949 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:26.348993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a730d7a7-fd69-40b6-95b1-07cb1307f949 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:26.349440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a730d7a7-fd69-40b6-95b1-07cb1307f949 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:26.553875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a730d7a7-fd69-40b6-95b1-07cb1307f949 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:26.569064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a730d7a7-fd69-40b6-95b1-07cb1307f949 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:26.571877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a730d7a7-fd69-40b6-95b1-07cb1307f949 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:26.573412 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a730d7a7-fd69-40b6-95b1-07cb1307f949 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1722 microversion: 2.20 time: 0.241545 Aug 02 07:10:26.588964 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2304/4672] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:26 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:10:26.855287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e79077ae-e49b-434a-a699-2f492849726e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:26.856767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e79077ae-e49b-434a-a699-2f492849726e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:26.867086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e79077ae-e49b-434a-a699-2f492849726e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:26.867776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e79077ae-e49b-434a-a699-2f492849726e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:26.868867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e79077ae-e49b-434a-a699-2f492849726e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:26.869335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e79077ae-e49b-434a-a699-2f492849726e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:26.918337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c8254b9e-d89f-4763-b403-e9459bd94b69 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:26.919645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c8254b9e-d89f-4763-b403-e9459bd94b69 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:26.937500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8254b9e-d89f-4763-b403-e9459bd94b69 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:26.938690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8254b9e-d89f-4763-b403-e9459bd94b69 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:26.940086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8254b9e-d89f-4763-b403-e9459bd94b69 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:26.940837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8254b9e-d89f-4763-b403-e9459bd94b69 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:27.152195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e79077ae-e49b-434a-a699-2f492849726e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:27.167007 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e79077ae-e49b-434a-a699-2f492849726e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1321 microversion: 2.1 time: 0.317208 Aug 02 07:10:27.168220 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2369/4673] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:26 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:27.176935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a5ae82bb-9d4c-431c-89ba-0b4084f7f8cb tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:27.178023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a5ae82bb-9d4c-431c-89ba-0b4084f7f8cb tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:27.191037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5ae82bb-9d4c-431c-89ba-0b4084f7f8cb tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:27.191902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5ae82bb-9d4c-431c-89ba-0b4084f7f8cb tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:27.192906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5ae82bb-9d4c-431c-89ba-0b4084f7f8cb tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:27.193564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5ae82bb-9d4c-431c-89ba-0b4084f7f8cb tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:27.225489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c8254b9e-d89f-4763-b403-e9459bd94b69 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:27.234754 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c8254b9e-d89f-4763-b403-e9459bd94b69 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.325682 Aug 02 07:10:27.246169 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2305/4674] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:26 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:27.459576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a5ae82bb-9d4c-431c-89ba-0b4084f7f8cb tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:27.474455 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a5ae82bb-9d4c-431c-89ba-0b4084f7f8cb tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1318 microversion: 2.1 time: 0.304841 Aug 02 07:10:27.487233 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2370/4675] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:27 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:27.601832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-916d09bd-bdc0-464f-832e-45557aea8e43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:27.603985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-916d09bd-bdc0-464f-832e-45557aea8e43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:27.615078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-916d09bd-bdc0-464f-832e-45557aea8e43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:27.615523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-916d09bd-bdc0-464f-832e-45557aea8e43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:27.616315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-916d09bd-bdc0-464f-832e-45557aea8e43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:27.617298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-916d09bd-bdc0-464f-832e-45557aea8e43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:27.788203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-916d09bd-bdc0-464f-832e-45557aea8e43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:27.797342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-916d09bd-bdc0-464f-832e-45557aea8e43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:27.798877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-916d09bd-bdc0-464f-832e-45557aea8e43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:27.800070 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-916d09bd-bdc0-464f-832e-45557aea8e43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1722 microversion: 2.20 time: 0.205082 Aug 02 07:10:27.801026 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2306/4676] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:27 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:10:27.913226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6ce32966-ce2d-4cc3-84c9-b9639556f730 req-246510d6-d697-4a27-a7a4-db39bea54b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698accff-ea86-4c25-9757-cf21b7e06d5e", "name": "network-vif-plugged", "status": "completed", "tag": "57c8008d-c1fe-4d6d-9a07-a8cdc41b7f50"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:27.930311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6ce32966-ce2d-4cc3-84c9-b9639556f730 req-246510d6-d697-4a27-a7a4-db39bea54b83 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:27.930885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6ce32966-ce2d-4cc3-84c9-b9639556f730 req-246510d6-d697-4a27-a7a4-db39bea54b83 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:27.949008 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-6ce32966-ce2d-4cc3-84c9-b9639556f730 req-246510d6-d697-4a27-a7a4-db39bea54b83 service nova] Creating event network-vif-plugged:57c8008d-c1fe-4d6d-9a07-a8cdc41b7f50 for instance 698accff-ea86-4c25-9757-cf21b7e06d5e on n-h1-851337-3 Aug 02 07:10:27.957447 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6ce32966-ce2d-4cc3-84c9-b9639556f730 req-246510d6-d697-4a27-a7a4-db39bea54b83 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049823 Aug 02 07:10:27.958906 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2371/4677] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:28.215970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c46597f4-76e8-4762-a0a8-50daa4b6cbf6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:28.216998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c46597f4-76e8-4762-a0a8-50daa4b6cbf6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:28.231733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c46597f4-76e8-4762-a0a8-50daa4b6cbf6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:28.232975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c46597f4-76e8-4762-a0a8-50daa4b6cbf6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:28.234842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c46597f4-76e8-4762-a0a8-50daa4b6cbf6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:28.236028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c46597f4-76e8-4762-a0a8-50daa4b6cbf6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:28.260426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5e9d77d0-f6ff-4d22-b5a9-4c22a49979d2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:28.261233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5e9d77d0-f6ff-4d22-b5a9-4c22a49979d2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:28.274012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e9d77d0-f6ff-4d22-b5a9-4c22a49979d2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:28.274573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e9d77d0-f6ff-4d22-b5a9-4c22a49979d2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:28.278190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e9d77d0-f6ff-4d22-b5a9-4c22a49979d2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:28.279367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e9d77d0-f6ff-4d22-b5a9-4c22a49979d2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:28.578589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c46597f4-76e8-4762-a0a8-50daa4b6cbf6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:28.601507 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c46597f4-76e8-4762-a0a8-50daa4b6cbf6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1321 microversion: 2.1 time: 0.396997 Aug 02 07:10:28.605358 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2307/4678] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:28 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:28.622389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c37e4ea6-bce0-4c8a-b1a9-df193684079c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:28.624239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c37e4ea6-bce0-4c8a-b1a9-df193684079c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:28.634978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c37e4ea6-bce0-4c8a-b1a9-df193684079c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:28.635426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c37e4ea6-bce0-4c8a-b1a9-df193684079c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:28.636203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c37e4ea6-bce0-4c8a-b1a9-df193684079c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:28.636632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c37e4ea6-bce0-4c8a-b1a9-df193684079c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:28.642980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5e9d77d0-f6ff-4d22-b5a9-4c22a49979d2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:28.654564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:28.665593 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5e9d77d0-f6ff-4d22-b5a9-4c22a49979d2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1510 microversion: 2.1 time: 0.409542 Aug 02 07:10:28.666780 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2372/4679] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:28 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1510 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:28.824661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5c073c91-6f45-4f95-8232-0f4535c8061b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:28.825272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5c073c91-6f45-4f95-8232-0f4535c8061b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:28.844420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c073c91-6f45-4f95-8232-0f4535c8061b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:28.846217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c073c91-6f45-4f95-8232-0f4535c8061b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:28.855728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c073c91-6f45-4f95-8232-0f4535c8061b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:28.857054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c073c91-6f45-4f95-8232-0f4535c8061b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:28.889650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c37e4ea6-bce0-4c8a-b1a9-df193684079c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:28.905316 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c37e4ea6-bce0-4c8a-b1a9-df193684079c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1318 microversion: 2.1 time: 0.296611 Aug 02 07:10:28.918629 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2308/4680] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:28 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:28.990743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5c073c91-6f45-4f95-8232-0f4535c8061b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:29.013249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5c073c91-6f45-4f95-8232-0f4535c8061b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:29.015023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5c073c91-6f45-4f95-8232-0f4535c8061b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:29.016489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-87dda99b-d91d-477e-b7f1-4c34ce05926f req-a838c979-9364-464f-81cf-edb85bcb0d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9ae016-6a95-4257-8d74-99fcd50ae1cb", "name": "network-vif-deleted", "tag": "3ee7c406-2514-4927-ba77-18750ac8d2ab"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:29.016836 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5c073c91-6f45-4f95-8232-0f4535c8061b tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1655 microversion: 2.20 time: 0.196021 Aug 02 07:10:29.018160 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2373/4681] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:28 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1655 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:10:29.030443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-87dda99b-d91d-477e-b7f1-4c34ce05926f req-a838c979-9364-464f-81cf-edb85bcb0d66 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:29.030790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-87dda99b-d91d-477e-b7f1-4c34ce05926f req-a838c979-9364-464f-81cf-edb85bcb0d66 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:29.046281 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-87dda99b-d91d-477e-b7f1-4c34ce05926f req-a838c979-9364-464f-81cf-edb85bcb0d66 service nova] Creating event network-vif-deleted:3ee7c406-2514-4927-ba77-18750ac8d2ab for instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb on n-h1-851337-3 Aug 02 07:10:29.052201 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-87dda99b-d91d-477e-b7f1-4c34ce05926f req-a838c979-9364-464f-81cf-edb85bcb0d66 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039616 Aug 02 07:10:29.053109 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2309/4682] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:10:29.632022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8b5fce0b-3761-4963-ae12-f7c5738cd85f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:29.632634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8b5fce0b-3761-4963-ae12-f7c5738cd85f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:29.644606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b5fce0b-3761-4963-ae12-f7c5738cd85f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:29.646313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b5fce0b-3761-4963-ae12-f7c5738cd85f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:29.651698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b5fce0b-3761-4963-ae12-f7c5738cd85f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:29.652200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b5fce0b-3761-4963-ae12-f7c5738cd85f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:29.693398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-663a3853-1760-4edf-b07d-f51db937d224 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:29.694890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-663a3853-1760-4edf-b07d-f51db937d224 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:29.703302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-663a3853-1760-4edf-b07d-f51db937d224 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:29.704035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-663a3853-1760-4edf-b07d-f51db937d224 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:29.704999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-663a3853-1760-4edf-b07d-f51db937d224 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:29.705609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-663a3853-1760-4edf-b07d-f51db937d224 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:29.954149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8b5fce0b-3761-4963-ae12-f7c5738cd85f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:29.963563 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8b5fce0b-3761-4963-ae12-f7c5738cd85f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1321 microversion: 2.1 time: 0.336116 Aug 02 07:10:29.966432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-663a3853-1760-4edf-b07d-f51db937d224 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:29.968060 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2374/4683] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:29 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:29.973209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-96d7eb55-af78-4edb-aaa3-114c9274165c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:29.974179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-96d7eb55-af78-4edb-aaa3-114c9274165c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:29.974680 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-663a3853-1760-4edf-b07d-f51db937d224 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1487 microversion: 2.1 time: 0.285517 Aug 02 07:10:29.975299 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2310/4684] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:29 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1487 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:29.997346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96d7eb55-af78-4edb-aaa3-114c9274165c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:29.998515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9dfdf6ca-3f5d-40e6-8c06-7d7d3f848d04 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-980439576"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:29.998875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96d7eb55-af78-4edb-aaa3-114c9274165c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:29.999921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96d7eb55-af78-4edb-aaa3-114c9274165c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.000589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96d7eb55-af78-4edb-aaa3-114c9274165c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.001142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9dfdf6ca-3f5d-40e6-8c06-7d7d3f848d04 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:30.008136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9dfdf6ca-3f5d-40e6-8c06-7d7d3f848d04 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.008577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9dfdf6ca-3f5d-40e6-8c06-7d7d3f848d04 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.009670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9dfdf6ca-3f5d-40e6-8c06-7d7d3f848d04 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.010319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9dfdf6ca-3f5d-40e6-8c06-7d7d3f848d04 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.100070 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9dfdf6ca-3f5d-40e6-8c06-7d7d3f848d04 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "PUT /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1059 microversion: 2.1 time: 0.105263 Aug 02 07:10:30.101575 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2311/4685] 10.222.0.79 () {60 vars in 1256 bytes} [Tue Aug 2 07:10:29 2022] PUT /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1059 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:30.107506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-288ef2c9-20cc-4e3a-9273-4cb56a5d9b7a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:30.108214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-288ef2c9-20cc-4e3a-9273-4cb56a5d9b7a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:30.114897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-288ef2c9-20cc-4e3a-9273-4cb56a5d9b7a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.116168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-288ef2c9-20cc-4e3a-9273-4cb56a5d9b7a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.117198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-288ef2c9-20cc-4e3a-9273-4cb56a5d9b7a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.118783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-288ef2c9-20cc-4e3a-9273-4cb56a5d9b7a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.155774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-288ef2c9-20cc-4e3a-9273-4cb56a5d9b7a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.156315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-288ef2c9-20cc-4e3a-9273-4cb56a5d9b7a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.156999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-288ef2c9-20cc-4e3a-9273-4cb56a5d9b7a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lazy-loading 'fault' on Instance uuid 9a9ae016-6a95-4257-8d74-99fcd50ae1cb {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:10:30.176478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-96d7eb55-af78-4edb-aaa3-114c9274165c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:30.189094 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-96d7eb55-af78-4edb-aaa3-114c9274165c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1318 microversion: 2.1 time: 0.217831 Aug 02 07:10:30.196760 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2375/4686] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:29 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:30.218267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-288ef2c9-20cc-4e3a-9273-4cb56a5d9b7a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:30.225362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f37af1b2-816d-4b29-9745-88b8b2362791 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:30.226042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f37af1b2-816d-4b29-9745-88b8b2362791 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:30.228891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-288ef2c9-20cc-4e3a-9273-4cb56a5d9b7a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:30.230644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-288ef2c9-20cc-4e3a-9273-4cb56a5d9b7a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:30.232845 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-288ef2c9-20cc-4e3a-9273-4cb56a5d9b7a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 200 len: 1371 microversion: 2.20 time: 0.129929 Aug 02 07:10:30.233632 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2312/4687] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:30 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 1371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:10:30.260127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f37af1b2-816d-4b29-9745-88b8b2362791 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.260910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f37af1b2-816d-4b29-9745-88b8b2362791 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.262683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f37af1b2-816d-4b29-9745-88b8b2362791 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.263606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f37af1b2-816d-4b29-9745-88b8b2362791 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.430730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f37af1b2-816d-4b29-9745-88b8b2362791 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:30.442760 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f37af1b2-816d-4b29-9745-88b8b2362791 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1486 microversion: 2.1 time: 0.244654 Aug 02 07:10:30.452973 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2376/4688] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:30 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1486 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:30.473807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8827449b-fa56-4978-b58e-b7f526b4021e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:30.484592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8827449b-fa56-4978-b58e-b7f526b4021e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:30.494099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8827449b-fa56-4978-b58e-b7f526b4021e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.494603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8827449b-fa56-4978-b58e-b7f526b4021e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.495350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8827449b-fa56-4978-b58e-b7f526b4021e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.495962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8827449b-fa56-4978-b58e-b7f526b4021e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.661559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-be56d803-5c23-49e0-8edb-ad027fde0938 req-e8157ad5-233c-493b-a0c0-ee16a64f5689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32378f59-645b-4f54-8d09-d30c783496d1", "name": "network-vif-plugged", "status": "completed", "tag": "5f4865d9-a451-4b8f-929a-4afc9ed99e04"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:30.682761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-be56d803-5c23-49e0-8edb-ad027fde0938 req-e8157ad5-233c-493b-a0c0-ee16a64f5689 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.683209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-be56d803-5c23-49e0-8edb-ad027fde0938 req-e8157ad5-233c-493b-a0c0-ee16a64f5689 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.698014 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-be56d803-5c23-49e0-8edb-ad027fde0938 req-e8157ad5-233c-493b-a0c0-ee16a64f5689 service nova] Creating event network-vif-plugged:5f4865d9-a451-4b8f-929a-4afc9ed99e04 for instance 32378f59-645b-4f54-8d09-d30c783496d1 on n-h2-851337-3 Aug 02 07:10:30.703520 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-be56d803-5c23-49e0-8edb-ad027fde0938 req-e8157ad5-233c-493b-a0c0-ee16a64f5689 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045879 Aug 02 07:10:30.704410 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2377/4689] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:30.759350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8827449b-fa56-4978-b58e-b7f526b4021e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:30.767353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:30.772223 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8827449b-fa56-4978-b58e-b7f526b4021e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1486 microversion: 2.1 time: 0.303005 Aug 02 07:10:30.773441 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2313/4690] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:30 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1486 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:30.793871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9541b7f2-47aa-4918-a7db-6c773236db4e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:30.794407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9541b7f2-47aa-4918-a7db-6c773236db4e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:30.802235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9541b7f2-47aa-4918-a7db-6c773236db4e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.802669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9541b7f2-47aa-4918-a7db-6c773236db4e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.804079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9541b7f2-47aa-4918-a7db-6c773236db4e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.804522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9541b7f2-47aa-4918-a7db-6c773236db4e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.832414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9541b7f2-47aa-4918-a7db-6c773236db4e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:10:30.916690 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9541b7f2-47aa-4918-a7db-6c773236db4e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 204 len: 0 microversion: 2.1 time: 0.126782 Aug 02 07:10:30.917493 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2378/4691] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:10:30 2022] DELETE /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:10:30.926725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e5e39854-67f1-4a18-9748-2c166fa99ec8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:30.927369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e5e39854-67f1-4a18-9748-2c166fa99ec8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:30.935030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5e39854-67f1-4a18-9748-2c166fa99ec8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.935481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5e39854-67f1-4a18-9748-2c166fa99ec8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.936263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5e39854-67f1-4a18-9748-2c166fa99ec8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:30.936699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5e39854-67f1-4a18-9748-2c166fa99ec8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:30.991326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-98dde0b5-4c3d-4ccc-a81f-2c5e77ede10a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:30.992429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-98dde0b5-4c3d-4ccc-a81f-2c5e77ede10a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:31.000012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98dde0b5-4c3d-4ccc-a81f-2c5e77ede10a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.001364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98dde0b5-4c3d-4ccc-a81f-2c5e77ede10a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.002889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98dde0b5-4c3d-4ccc-a81f-2c5e77ede10a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.003333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98dde0b5-4c3d-4ccc-a81f-2c5e77ede10a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.129860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e5e39854-67f1-4a18-9748-2c166fa99ec8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:31.138677 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e5e39854-67f1-4a18-9748-2c166fa99ec8 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1492 microversion: 2.1 time: 0.215950 Aug 02 07:10:31.139231 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2314/4692] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:30 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1492 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:31.144356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b71dd6c9-664b-4966-947c-30b1b2fc62ba tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:31.144959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b71dd6c9-664b-4966-947c-30b1b2fc62ba tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:31.152061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b71dd6c9-664b-4966-947c-30b1b2fc62ba tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.152740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b71dd6c9-664b-4966-947c-30b1b2fc62ba tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.153707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b71dd6c9-664b-4966-947c-30b1b2fc62ba tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.154347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b71dd6c9-664b-4966-947c-30b1b2fc62ba tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.187032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-98dde0b5-4c3d-4ccc-a81f-2c5e77ede10a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:31.196029 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-98dde0b5-4c3d-4ccc-a81f-2c5e77ede10a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1510 microversion: 2.1 time: 0.210070 Aug 02 07:10:31.196778 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2379/4693] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:30 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:31.215775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7544206f-45bb-4bd6-8656-178021d683b8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:31.216677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7544206f-45bb-4bd6-8656-178021d683b8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:31.224410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7544206f-45bb-4bd6-8656-178021d683b8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.225101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7544206f-45bb-4bd6-8656-178021d683b8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.226049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7544206f-45bb-4bd6-8656-178021d683b8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.226609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7544206f-45bb-4bd6-8656-178021d683b8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.357376 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b71dd6c9-664b-4966-947c-30b1b2fc62ba tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1834 microversion: 2.1 time: 0.216729 Aug 02 07:10:31.357979 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2315/4694] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:31 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1834 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:31.372557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-913ceb4f-2c13-4ed5-b532-0abfbd2e22d8 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:31.374215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-913ceb4f-2c13-4ed5-b532-0abfbd2e22d8 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:31.381285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-913ceb4f-2c13-4ed5-b532-0abfbd2e22d8 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.381739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-913ceb4f-2c13-4ed5-b532-0abfbd2e22d8 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.382555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-913ceb4f-2c13-4ed5-b532-0abfbd2e22d8 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.383020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-913ceb4f-2c13-4ed5-b532-0abfbd2e22d8 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.395191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7544206f-45bb-4bd6-8656-178021d683b8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:31.405114 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7544206f-45bb-4bd6-8656-178021d683b8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1318 microversion: 2.1 time: 0.194110 Aug 02 07:10:31.405708 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2380/4695] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:31 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:31.422257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-12020e49-d6fc-41dc-a9e2-907683d213cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:31.422867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-12020e49-d6fc-41dc-a9e2-907683d213cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:31.429547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12020e49-d6fc-41dc-a9e2-907683d213cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.430023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12020e49-d6fc-41dc-a9e2-907683d213cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.430906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12020e49-d6fc-41dc-a9e2-907683d213cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.431343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12020e49-d6fc-41dc-a9e2-907683d213cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.446100 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-12020e49-d6fc-41dc-a9e2-907683d213cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] HTTP exception thrown: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-12020e49-d6fc-41dc-a9e2-907683d213cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Request method failure captured: Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb HTTP/1.1 Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MykMNz6zTP3YmWmN8RFvg4OuoQ7ofP79l7lC8TxwC-OXzZDZidEgPJRv9-ffdPPw8o2qbzgmjbG2TUCMcLDsOKrX4Dsu-x-EDiGY1JC0T6Cs5bYOW4hgrN8stmhVKgexGtvYBtG5q_VMETNRzsABzIfAOFDItvpYy5GcNmYHJa-PzE Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 15ee4714199b427db6ee9e17d6fd93dc Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/15ee4714199b427db6ee9e17d6fd93dc"}]}] Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 15ee4714199b427db6ee9e17d6fd93dc Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AttachVolumeShelveTestJSON-1804433436-project Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 2b5865db38184a5c85b48def8ef9cf97 Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1804433436-project Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '9a9ae016-6a95-4257-8d74-99fcd50ae1cb'} Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:31.447963 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:31.452786 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:31.452786 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:31.452786 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:31.452786 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:31.452786 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:31.452786 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:31.452786 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:10:31.452786 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:31.452786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-12020e49-d6fc-41dc-a9e2-907683d213cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Returning 404 to user: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:31.452786 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-12020e49-d6fc-41dc-a9e2-907683d213cc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 404 len: 111 microversion: 2.20 time: 0.031250 Aug 02 07:10:31.452786 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2381/4696] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:31 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:10:31.458559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83aeb821-a2d5-437c-8a9d-761c3be2c842 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:31.459205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-83aeb821-a2d5-437c-8a9d-761c3be2c842 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:31.465576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83aeb821-a2d5-437c-8a9d-761c3be2c842 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.466121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83aeb821-a2d5-437c-8a9d-761c3be2c842 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.467426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83aeb821-a2d5-437c-8a9d-761c3be2c842 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.467426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83aeb821-a2d5-437c-8a9d-761c3be2c842 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.568488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-913ceb4f-2c13-4ed5-b532-0abfbd2e22d8 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:31.577761 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-913ceb4f-2c13-4ed5-b532-0abfbd2e22d8 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1511 microversion: 2.1 time: 0.218556 Aug 02 07:10:31.578523 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2316/4697] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:31 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:31.583755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d3cb4ab6-b629-4c66-bb9e-4902d044dd0a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '.version_select at 0x7f927abc5e50>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:31.610052 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d3cb4ab6-b629-4c66-bb9e-4902d044dd0a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-861850151" status: 204 len: 0 microversion: 2.20 time: 0.029830 Aug 02 07:10:31.611015 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2317/4698] 10.222.0.79 () {60 vars in 1259 bytes} [Tue Aug 2 07:10:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-861850151 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:10:31.615874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-19d2a422-81f8-4ce2-b29e-10e46e44f21d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:31.616565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-19d2a422-81f8-4ce2-b29e-10e46e44f21d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: fd8b1e0a-9584-420c-82e0-5c60e8d17a35] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:31.629085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19d2a422-81f8-4ce2-b29e-10e46e44f21d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.629865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19d2a422-81f8-4ce2-b29e-10e46e44f21d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.633610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19d2a422-81f8-4ce2-b29e-10e46e44f21d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.634365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19d2a422-81f8-4ce2-b29e-10e46e44f21d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.659175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-83aeb821-a2d5-437c-8a9d-761c3be2c842 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:31.669468 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-83aeb821-a2d5-437c-8a9d-761c3be2c842 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1683 microversion: 2.1 time: 0.214701 Aug 02 07:10:31.670445 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2382/4699] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:31 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1683 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:31.858187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-423d60e1-7cda-49d8-ae6c-2474e4a98b7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:31.862468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-423d60e1-7cda-49d8-ae6c-2474e4a98b7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:31.905855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-423d60e1-7cda-49d8-ae6c-2474e4a98b7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.909639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-423d60e1-7cda-49d8-ae6c-2474e4a98b7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.912793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-423d60e1-7cda-49d8-ae6c-2474e4a98b7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:31.916129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-423d60e1-7cda-49d8-ae6c-2474e4a98b7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:31.964991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-19d2a422-81f8-4ce2-b29e-10e46e44f21d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:31.986115 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-19d2a422-81f8-4ce2-b29e-10e46e44f21d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35" status: 200 len: 1510 microversion: 2.1 time: 0.373492 Aug 02 07:10:31.987262 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2318/4700] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:31 2022] GET /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35 => generated 1510 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:32.024126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9b812863-f33c-4725-b578-d660ea2f2693 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:32.033105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9b812863-f33c-4725-b578-d660ea2f2693 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:32.035468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9b812863-f33c-4725-b578-d660ea2f2693 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:10:32.059241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b812863-f33c-4725-b578-d660ea2f2693 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:32.059961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b812863-f33c-4725-b578-d660ea2f2693 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:32.061127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b812863-f33c-4725-b578-d660ea2f2693 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:32.061701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b812863-f33c-4725-b578-d660ea2f2693 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:32.171539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-9b812863-f33c-4725-b578-d660ea2f2693 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:10:32.175433 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-423d60e1-7cda-49d8-ae6c-2474e4a98b7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724/action" status: 200 len: 32631 microversion: 2.1 time: 0.327145 Aug 02 07:10:32.178268 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2383/4701] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:10:31 2022] POST /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724/action => generated 32631 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 07:10:32.185064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cb0fefbf-2daa-4896-bc81-5e20cc523d9f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:32.186133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cb0fefbf-2daa-4896-bc81-5e20cc523d9f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:32.197656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb0fefbf-2daa-4896-bc81-5e20cc523d9f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:32.198451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb0fefbf-2daa-4896-bc81-5e20cc523d9f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:32.199615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb0fefbf-2daa-4896-bc81-5e20cc523d9f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:32.200803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb0fefbf-2daa-4896-bc81-5e20cc523d9f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:32.250677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9b812863-f33c-4725-b578-d660ea2f2693 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:32.260722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b812863-f33c-4725-b578-d660ea2f2693 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:32.261173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b812863-f33c-4725-b578-d660ea2f2693 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:32.414790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cb0fefbf-2daa-4896-bc81-5e20cc523d9f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:32.437642 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9b812863-f33c-4725-b578-d660ea2f2693 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.420289 Aug 02 07:10:32.438302 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2319/4702] 10.222.0.79 () {58 vars in 1167 bytes} [Tue Aug 2 07:10:32 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:32.443001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2d37fbcd-4cef-4c1c-8e0b-61c6bee1d313 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:32.443579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2d37fbcd-4cef-4c1c-8e0b-61c6bee1d313 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:32.446121 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cb0fefbf-2daa-4896-bc81-5e20cc523d9f tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1492 microversion: 2.1 time: 0.266130 Aug 02 07:10:32.448543 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2384/4703] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:32 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1492 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:32.456654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f29c631-0f38-44ee-9566-b11a6bc9f633 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:32.457388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d37fbcd-4cef-4c1c-8e0b-61c6bee1d313 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:32.458899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1f29c631-0f38-44ee-9566-b11a6bc9f633 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:32.466684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d37fbcd-4cef-4c1c-8e0b-61c6bee1d313 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:32.467870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d37fbcd-4cef-4c1c-8e0b-61c6bee1d313 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:32.468643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d37fbcd-4cef-4c1c-8e0b-61c6bee1d313 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:32.474395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f29c631-0f38-44ee-9566-b11a6bc9f633 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:32.475853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f29c631-0f38-44ee-9566-b11a6bc9f633 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:32.476880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f29c631-0f38-44ee-9566-b11a6bc9f633 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:32.477735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f29c631-0f38-44ee-9566-b11a6bc9f633 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:32.556704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2d37fbcd-4cef-4c1c-8e0b-61c6bee1d313 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7a0cc023da4147a2960d160dd0183018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c62bc9c5a48a6aa19a8f07984981d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:32.559347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2d37fbcd-4cef-4c1c-8e0b-61c6bee1d313 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] flavor_id is None. Assuming migration. {{(pid=126119) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 02 07:10:32.560021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2d37fbcd-4cef-4c1c-8e0b-61c6bee1d313 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126119) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 07:10:32.681420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f29c631-0f38-44ee-9566-b11a6bc9f633 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:32.697744 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f29c631-0f38-44ee-9566-b11a6bc9f633 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1509 microversion: 2.1 time: 0.247452 Aug 02 07:10:32.698918 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2385/4704] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:32 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:32.705101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b6c02e11-6762-42c1-b963-2350a73e7429 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:32.711752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b6c02e11-6762-42c1-b963-2350a73e7429 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:32.713364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b6c02e11-6762-42c1-b963-2350a73e7429 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1247937769', 'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:10:32.721485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6c02e11-6762-42c1-b963-2350a73e7429 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:32.722320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6c02e11-6762-42c1-b963-2350a73e7429 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:32.723354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6c02e11-6762-42c1-b963-2350a73e7429 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:32.724053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6c02e11-6762-42c1-b963-2350a73e7429 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:32.789884 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2d37fbcd-4cef-4c1c-8e0b-61c6bee1d313 tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724/action" status: 202 len: 0 microversion: 2.1 time: 0.350389 Aug 02 07:10:32.791309 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2320/4705] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:10:32 2022] POST /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:10:32.796416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b01f4568-3786-4f5e-a348-b88efb2fa850 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Action: 'create', calling method: .version_select at 0x7f927a354dc0>, body: {"keypair": {"name": "tempest-keypair-994474532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNIO0sYQtdyh642i7CsBSgaG93ZaH3nI3A1P9sYmtBaCzORRBSb7qGHNeaeLdhmGemKL1Y3TKKOmBWNqo5n4MW3csUMikdip2KjSTrVh/7oy+SJA+hT7Nnf54+u2oFXsg=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:32.816734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-b01f4568-3786-4f5e-a348-b88efb2fa850 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Getting quotas for project 15ee4714199b427db6ee9e17d6fd93dc. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:10:32.823407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:32.826473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-b01f4568-3786-4f5e-a348-b88efb2fa850 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Getting quotas for user 2b5865db38184a5c85b48def8ef9cf97 and project 15ee4714199b427db6ee9e17d6fd93dc. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:10:32.862861 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b01f4568-3786-4f5e-a348-b88efb2fa850 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.070165 Aug 02 07:10:32.863939 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2321/4706] 10.222.0.79 () {62 vars in 1200 bytes} [Tue Aug 2 07:10:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 07:10:32.870586 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aa113428-a00e-47a2-bb3c-a369cb9641ac tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:32.871203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aa113428-a00e-47a2-bb3c-a369cb9641ac tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:32.878056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa113428-a00e-47a2-bb3c-a369cb9641ac tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:32.878421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-b6c02e11-6762-42c1-b963-2350a73e7429 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:10:32.878561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa113428-a00e-47a2-bb3c-a369cb9641ac tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:32.879469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa113428-a00e-47a2-bb3c-a369cb9641ac tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:32.879960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa113428-a00e-47a2-bb3c-a369cb9641ac tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:32.963380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b6c02e11-6762-42c1-b963-2350a73e7429 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:32.971128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6c02e11-6762-42c1-b963-2350a73e7429 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:32.971936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6c02e11-6762-42c1-b963-2350a73e7429 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:33.156610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aa113428-a00e-47a2-bb3c-a369cb9641ac tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:33.177518 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aa113428-a00e-47a2-bb3c-a369cb9641ac tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1509 microversion: 2.1 time: 0.312009 Aug 02 07:10:33.179642 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2322/4707] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:32 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1509 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:33.189649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2ea279da-c568-4e2e-a1c3-a1ac6e43c2ec tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:33.191680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2ea279da-c568-4e2e-a1c3-a1ac6e43c2ec tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:33.213770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ea279da-c568-4e2e-a1c3-a1ac6e43c2ec tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:33.216391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ea279da-c568-4e2e-a1c3-a1ac6e43c2ec tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:33.217283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ea279da-c568-4e2e-a1c3-a1ac6e43c2ec tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:33.217726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ea279da-c568-4e2e-a1c3-a1ac6e43c2ec tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:33.257613 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b6c02e11-6762-42c1-b963-2350a73e7429 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1247937769" status: 200 len: 1514 microversion: 2.1 time: 0.556834 Aug 02 07:10:33.259007 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2386/4708] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 07:10:32 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1247937769 => generated 1514 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:33.265765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab45d6a6-9fcb-4651-9608-d2c9ea15eac0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:33.286017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab45d6a6-9fcb-4651-9608-d2c9ea15eac0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:33.320267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab45d6a6-9fcb-4651-9608-d2c9ea15eac0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:33.320715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab45d6a6-9fcb-4651-9608-d2c9ea15eac0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:33.329803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab45d6a6-9fcb-4651-9608-d2c9ea15eac0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:33.330422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab45d6a6-9fcb-4651-9608-d2c9ea15eac0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:33.518374 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab45d6a6-9fcb-4651-9608-d2c9ea15eac0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "PUT /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1081 microversion: 2.1 time: 0.257725 Aug 02 07:10:33.535707 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2387/4709] 10.222.0.79 () {60 vars in 1256 bytes} [Tue Aug 2 07:10:33 2022] PUT /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1081 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:33.562814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f37abeeb-9fd0-45a8-bb1c-d052b5220eed tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:33.584939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f37abeeb-9fd0-45a8-bb1c-d052b5220eed tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:33.587185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f37abeeb-9fd0-45a8-bb1c-d052b5220eed tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:10:33.594056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f37abeeb-9fd0-45a8-bb1c-d052b5220eed tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:33.594968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f37abeeb-9fd0-45a8-bb1c-d052b5220eed tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:33.595994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f37abeeb-9fd0-45a8-bb1c-d052b5220eed tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:33.596894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f37abeeb-9fd0-45a8-bb1c-d052b5220eed tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:33.656836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2ea279da-c568-4e2e-a1c3-a1ac6e43c2ec tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:33.668249 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2ea279da-c568-4e2e-a1c3-a1ac6e43c2ec tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1692 microversion: 2.1 time: 0.484650 Aug 02 07:10:33.668932 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2323/4710] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:33 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1692 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:33.686269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-242866da-e63e-4b9b-9949-cd61d58874c5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:33.687215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-242866da-e63e-4b9b-9949-cd61d58874c5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:33.695087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-242866da-e63e-4b9b-9949-cd61d58874c5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:33.695859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-242866da-e63e-4b9b-9949-cd61d58874c5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:33.697560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-242866da-e63e-4b9b-9949-cd61d58874c5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:33.701564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:33.702503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-242866da-e63e-4b9b-9949-cd61d58874c5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:33.732418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-f37abeeb-9fd0-45a8-bb1c-d052b5220eed tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:10:33.766662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-242866da-e63e-4b9b-9949-cd61d58874c5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:33.767370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-242866da-e63e-4b9b-9949-cd61d58874c5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:33.767985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-242866da-e63e-4b9b-9949-cd61d58874c5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lazy-loading 'fault' on Instance uuid 45bacc58-d131-4b47-8082-8d441784de01 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:10:33.824852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f37abeeb-9fd0-45a8-bb1c-d052b5220eed tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:33.835348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f37abeeb-9fd0-45a8-bb1c-d052b5220eed tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:33.835889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f37abeeb-9fd0-45a8-bb1c-d052b5220eed tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:33.946187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-242866da-e63e-4b9b-9949-cd61d58874c5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:33.956142 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-242866da-e63e-4b9b-9949-cd61d58874c5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 200 len: 1309 microversion: 2.1 time: 0.285628 Aug 02 07:10:33.957558 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2324/4711] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:33 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 1309 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:33.963190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8dcbe7d1-d448-4b4c-9d2a-2a739eec37b8 req-31a3bada-e41c-4b00-9634-5afacfd8aadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45bacc58-d131-4b47-8082-8d441784de01", "name": "network-vif-deleted", "tag": "d83c518f-7e01-4928-a463-48a408186564"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:33.974654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8dcbe7d1-d448-4b4c-9d2a-2a739eec37b8 req-31a3bada-e41c-4b00-9634-5afacfd8aadd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:33.975383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8dcbe7d1-d448-4b4c-9d2a-2a739eec37b8 req-31a3bada-e41c-4b00-9634-5afacfd8aadd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:33.991456 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8dcbe7d1-d448-4b4c-9d2a-2a739eec37b8 req-31a3bada-e41c-4b00-9634-5afacfd8aadd service nova] Creating event network-vif-deleted:d83c518f-7e01-4928-a463-48a408186564 for instance 45bacc58-d131-4b47-8082-8d441784de01 on n-h1-851337-3 Aug 02 07:10:34.006343 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8dcbe7d1-d448-4b4c-9d2a-2a739eec37b8 req-31a3bada-e41c-4b00-9634-5afacfd8aadd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045779 Aug 02 07:10:34.020945 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2325/4712] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:34.029861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6a892e8f-4342-437a-92ef-99d01248678d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:34.031627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6a892e8f-4342-437a-92ef-99d01248678d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:34.040768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a892e8f-4342-437a-92ef-99d01248678d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:34.041755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a892e8f-4342-437a-92ef-99d01248678d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:34.043273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a892e8f-4342-437a-92ef-99d01248678d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:34.043979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a892e8f-4342-437a-92ef-99d01248678d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:34.175706 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f37abeeb-9fd0-45a8-bb1c-d052b5220eed tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 0.629328 Aug 02 07:10:34.200092 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2388/4713] 10.222.0.79 () {58 vars in 1173 bytes} [Tue Aug 2 07:10:33 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:34.207528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-016f1a69-eb25-4c8b-bef5-34102f50a7c7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:34.214774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-016f1a69-eb25-4c8b-bef5-34102f50a7c7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:34.216287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.compute.servers [None req-016f1a69-eb25-4c8b-bef5-34102f50a7c7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Removing options 'limit' from query {{(pid=126120) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 02 07:10:34.217119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-016f1a69-eb25-4c8b-bef5-34102f50a7c7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:10:34.223115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-016f1a69-eb25-4c8b-bef5-34102f50a7c7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:34.223825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-016f1a69-eb25-4c8b-bef5-34102f50a7c7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:34.225212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-016f1a69-eb25-4c8b-bef5-34102f50a7c7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:34.225652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-016f1a69-eb25-4c8b-bef5-34102f50a7c7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:34.307887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-016f1a69-eb25-4c8b-bef5-34102f50a7c7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:34.316601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-016f1a69-eb25-4c8b-bef5-34102f50a7c7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:34.317416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-016f1a69-eb25-4c8b-bef5-34102f50a7c7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:34.344046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6a892e8f-4342-437a-92ef-99d01248678d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:34.352613 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6a892e8f-4342-437a-92ef-99d01248678d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1507 microversion: 2.1 time: 0.328525 Aug 02 07:10:34.356255 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2326/4714] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:34 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:34.388691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-199cd4be-fcd1-4400-b7f2-fa89e32eb5c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:34.389392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-199cd4be-fcd1-4400-b7f2-fa89e32eb5c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:34.395903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-199cd4be-fcd1-4400-b7f2-fa89e32eb5c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:34.396422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-199cd4be-fcd1-4400-b7f2-fa89e32eb5c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:34.397587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-199cd4be-fcd1-4400-b7f2-fa89e32eb5c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:34.398250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-199cd4be-fcd1-4400-b7f2-fa89e32eb5c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:34.868395 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-016f1a69-eb25-4c8b-bef5-34102f50a7c7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.666714 Aug 02 07:10:34.869212 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2389/4715] 10.222.0.79 () {58 vars in 1161 bytes} [Tue Aug 2 07:10:34 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:34.889110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f613bf5-d6d6-4025-b042-cabb7ddafbae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:34.890985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4f613bf5-d6d6-4025-b042-cabb7ddafbae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:34.902275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f613bf5-d6d6-4025-b042-cabb7ddafbae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:34.903138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f613bf5-d6d6-4025-b042-cabb7ddafbae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:34.905045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f613bf5-d6d6-4025-b042-cabb7ddafbae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:34.905598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f613bf5-d6d6-4025-b042-cabb7ddafbae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:34.926178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-199cd4be-fcd1-4400-b7f2-fa89e32eb5c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:34.935334 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-199cd4be-fcd1-4400-b7f2-fa89e32eb5c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1507 microversion: 2.1 time: 0.554888 Aug 02 07:10:34.950451 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2327/4716] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:34 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1507 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:34.955851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f026ea6c-d429-4ba3-9e3a-a5b0e7cf3509 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:34.960954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f026ea6c-d429-4ba3-9e3a-a5b0e7cf3509 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:34.961764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f026ea6c-d429-4ba3-9e3a-a5b0e7cf3509 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:10:34.968224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f026ea6c-d429-4ba3-9e3a-a5b0e7cf3509 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:34.968660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f026ea6c-d429-4ba3-9e3a-a5b0e7cf3509 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:34.969632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f026ea6c-d429-4ba3-9e3a-a5b0e7cf3509 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:34.970098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f026ea6c-d429-4ba3-9e3a-a5b0e7cf3509 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.006279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-f026ea6c-d429-4ba3-9e3a-a5b0e7cf3509 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:10:35.041139 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f026ea6c-d429-4ba3-9e3a-a5b0e7cf3509 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.089334 Aug 02 07:10:35.042357 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2328/4717] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 07:10:34 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:35.049337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:35.052731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:35.060401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.062027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.063355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.064525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.075394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4f613bf5-d6d6-4025-b042-cabb7ddafbae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:35.092451 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4f613bf5-d6d6-4025-b042-cabb7ddafbae tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1692 microversion: 2.1 time: 0.221535 Aug 02 07:10:35.107912 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2390/4718] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:34 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1692 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:35.110390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eee8c893-59bc-4899-9f6c-25ec007c3051 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:35.111821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-eee8c893-59bc-4899-9f6c-25ec007c3051 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:35.118274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eee8c893-59bc-4899-9f6c-25ec007c3051 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.118765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eee8c893-59bc-4899-9f6c-25ec007c3051 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.119521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eee8c893-59bc-4899-9f6c-25ec007c3051 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.119949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eee8c893-59bc-4899-9f6c-25ec007c3051 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.135795 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-eee8c893-59bc-4899-9f6c-25ec007c3051 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eee8c893-59bc-4899-9f6c-25ec007c3051 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 HTTP/1.1 Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '45bacc58-d131-4b47-8082-8d441784de01'} Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:35.137458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.142260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.142260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:35.142260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:35.142260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:35.142260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:35.142260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.142260 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.142260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eee8c893-59bc-4899-9f6c-25ec007c3051 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:35.142260 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-eee8c893-59bc-4899-9f6c-25ec007c3051 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 404 len: 111 microversion: 2.1 time: 0.037441 Aug 02 07:10:35.142260 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2391/4719] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:35 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:35.144092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df5f6a86-1784-44e1-ab6c-6fa5904623f9 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:35.149172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-df5f6a86-1784-44e1-ab6c-6fa5904623f9 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:35.149702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.compute.servers [None req-df5f6a86-1784-44e1-ab6c-6fa5904623f9 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Removing options 'limit' from query {{(pid=126120) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 02 07:10:35.150453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df5f6a86-1784-44e1-ab6c-6fa5904623f9 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:10:35.157271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df5f6a86-1784-44e1-ab6c-6fa5904623f9 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.157723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df5f6a86-1784-44e1-ab6c-6fa5904623f9 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.158755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df5f6a86-1784-44e1-ab6c-6fa5904623f9 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.159530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df5f6a86-1784-44e1-ab6c-6fa5904623f9 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.163546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:10:35.163963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:10:35.164625 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:10:35.165233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:10:35.165647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:10:35.177831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:35.190124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-df5f6a86-1784-44e1-ab6c-6fa5904623f9 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:10:35.231848 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df5f6a86-1784-44e1-ab6c-6fa5904623f9 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.091117 Aug 02 07:10:35.232724 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2392/4720] 10.222.0.79 () {58 vars in 1150 bytes} [Tue Aug 2 07:10:35 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:35.237939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-caa22094-81a0-458b-9a55-046ffe0b3866 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:35.238648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-caa22094-81a0-458b-9a55-046ffe0b3866 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:35.246628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa22094-81a0-458b-9a55-046ffe0b3866 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.247324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa22094-81a0-458b-9a55-046ffe0b3866 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.248359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa22094-81a0-458b-9a55-046ffe0b3866 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.249266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caa22094-81a0-458b-9a55-046ffe0b3866 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.253382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:35.262917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.263678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.264614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.265165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.267582 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-caa22094-81a0-458b-9a55-046ffe0b3866 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-caa22094-81a0-458b-9a55-046ffe0b3866 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 HTTP/1.1 Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '45bacc58-d131-4b47-8082-8d441784de01'} Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:35.269490 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.274968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.274968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:35.274968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.274968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.274968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:35.274968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:35.274968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:35.274968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:35.274968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.274968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.277982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-caa22094-81a0-458b-9a55-046ffe0b3866 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:35.279065 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-caa22094-81a0-458b-9a55-046ffe0b3866 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 404 len: 111 microversion: 2.1 time: 0.045149 Aug 02 07:10:35.280087 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2393/4721] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:10:35 2022] DELETE /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:35.290342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2742fd7-9188-410b-9576-f2efdd750811 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:35.295960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f2742fd7-9188-410b-9576-f2efdd750811 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:35.297092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f2742fd7-9188-410b-9576-f2efdd750811 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:10:35.304431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2742fd7-9188-410b-9576-f2efdd750811 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.305753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2742fd7-9188-410b-9576-f2efdd750811 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.307185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2742fd7-9188-410b-9576-f2efdd750811 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.308527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2742fd7-9188-410b-9576-f2efdd750811 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.316881 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-47760ee3-d6a7-4dd0-9f22-b4061398eff2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "POST /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1/action" status: 202 len: 1113 microversion: 2.1 time: 0.272327 Aug 02 07:10:35.317788 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2329/4722] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:10:35 2022] POST /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1/action => generated 1113 bytes in 275 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 07:10:35.323009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8683feda-9f83-4e9e-855a-258c1b235a0c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:35.323904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8683feda-9f83-4e9e-855a-258c1b235a0c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 45bacc58-d131-4b47-8082-8d441784de01] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:35.332392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8683feda-9f83-4e9e-855a-258c1b235a0c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.333298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8683feda-9f83-4e9e-855a-258c1b235a0c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.334209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8683feda-9f83-4e9e-855a-258c1b235a0c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.335095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8683feda-9f83-4e9e-855a-258c1b235a0c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.355808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-f2742fd7-9188-410b-9576-f2efdd750811 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:10:35.356275 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-8683feda-9f83-4e9e-855a-258c1b235a0c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8683feda-9f83-4e9e-855a-258c1b235a0c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 HTTP/1.1 Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '45bacc58-d131-4b47-8082-8d441784de01'} Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:35.357984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.362204 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.362204 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:35.362204 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:35.362204 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:35.362204 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:35.362204 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. Aug 02 07:10:35.362204 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.364319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8683feda-9f83-4e9e-855a-258c1b235a0c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 45bacc58-d131-4b47-8082-8d441784de01 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:35.365638 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8683feda-9f83-4e9e-855a-258c1b235a0c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01" status: 404 len: 111 microversion: 2.1 time: 0.046440 Aug 02 07:10:35.366483 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2330/4723] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:35 2022] GET /compute/v2.1/servers/45bacc58-d131-4b47-8082-8d441784de01 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:35.376681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-240d5757-219a-4f0b-ac04-207d97d5ae7e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:35.378132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-240d5757-219a-4f0b-ac04-207d97d5ae7e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:35.385252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-240d5757-219a-4f0b-ac04-207d97d5ae7e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.386312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-240d5757-219a-4f0b-ac04-207d97d5ae7e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.387419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-240d5757-219a-4f0b-ac04-207d97d5ae7e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.387984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-240d5757-219a-4f0b-ac04-207d97d5ae7e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.438164 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f2742fd7-9188-410b-9576-f2efdd750811 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.156887 Aug 02 07:10:35.438747 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2394/4724] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Aug 2 07:10:35 2022] GET /compute/v2.1/servers => generated 1011 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:35.454574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ec3742f-c162-46cb-81c5-a3232a38ec13 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:35.455186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9ec3742f-c162-46cb-81c5-a3232a38ec13 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:35.462457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ec3742f-c162-46cb-81c5-a3232a38ec13 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.462920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ec3742f-c162-46cb-81c5-a3232a38ec13 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.463861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ec3742f-c162-46cb-81c5-a3232a38ec13 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.464308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ec3742f-c162-46cb-81c5-a3232a38ec13 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.482334 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-9ec3742f-c162-46cb-81c5-a3232a38ec13 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ec3742f-c162-46cb-81c5-a3232a38ec13 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e HTTP/1.1 Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '420aa836-056a-4683-88ee-378b568df42e'} Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:35.484257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:10:35.488514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.488514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:35.488514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.488514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.488514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:35.488514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:35.488514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:35.488514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:35.488514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:10:35.488514 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.490930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ec3742f-c162-46cb-81c5-a3232a38ec13 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:35.491776 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9ec3742f-c162-46cb-81c5-a3232a38ec13 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 404 len: 111 microversion: 2.1 time: 0.051790 Aug 02 07:10:35.492330 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2395/4725] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:10:35 2022] DELETE /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:35.498755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-194649dd-c4c1-4e39-965a-94dcd0962017 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:35.505017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-194649dd-c4c1-4e39-965a-94dcd0962017 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:35.506237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-194649dd-c4c1-4e39-965a-94dcd0962017 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:10:35.518734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-194649dd-c4c1-4e39-965a-94dcd0962017 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.519327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-194649dd-c4c1-4e39-965a-94dcd0962017 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.520115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-194649dd-c4c1-4e39-965a-94dcd0962017 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.520543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-194649dd-c4c1-4e39-965a-94dcd0962017 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.610692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-194649dd-c4c1-4e39-965a-94dcd0962017 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:10:35.630743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-240d5757-219a-4f0b-ac04-207d97d5ae7e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:35.641722 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-240d5757-219a-4f0b-ac04-207d97d5ae7e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.270832 Aug 02 07:10:35.642774 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2331/4726] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:35 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:35.648478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4fbcff0c-93eb-44d1-a06c-d0d541f8489c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:35.649467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4fbcff0c-93eb-44d1-a06c-d0d541f8489c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 420aa836-056a-4683-88ee-378b568df42e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:35.657490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4fbcff0c-93eb-44d1-a06c-d0d541f8489c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.657964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4fbcff0c-93eb-44d1-a06c-d0d541f8489c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.658743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4fbcff0c-93eb-44d1-a06c-d0d541f8489c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.659170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4fbcff0c-93eb-44d1-a06c-d0d541f8489c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.678853 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-4fbcff0c-93eb-44d1-a06c-d0d541f8489c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4fbcff0c-93eb-44d1-a06c-d0d541f8489c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e HTTP/1.1 Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '420aa836-056a-4683-88ee-378b568df42e'} Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:35.681388 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.685589 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.685589 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:35.685589 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:35.685589 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:35.685589 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:35.685589 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. Aug 02 07:10:35.685589 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.685589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4fbcff0c-93eb-44d1-a06c-d0d541f8489c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 420aa836-056a-4683-88ee-378b568df42e could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:35.685589 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4fbcff0c-93eb-44d1-a06c-d0d541f8489c tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e" status: 404 len: 111 microversion: 2.1 time: 0.039044 Aug 02 07:10:35.685589 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2332/4727] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:35 2022] GET /compute/v2.1/servers/420aa836-056a-4683-88ee-378b568df42e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:35.692640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-66905644", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d5e8407-4786-4142-8296-8f16e1d64f3e"}], "security_groups": [{"name": "tempest-securitygroup--1202786570"}], "key_name": "tempest-keypair-994474532", "user_data": "}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:35.703883 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-194649dd-c4c1-4e39-965a-94dcd0962017 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.210224 Aug 02 07:10:35.704474 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2396/4728] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 07:10:35 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:35.709370 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b5780369-693e-49a0-9bcc-1a40388478c6 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:35.709853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b5780369-693e-49a0-9bcc-1a40388478c6 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:35.716667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5780369-693e-49a0-9bcc-1a40388478c6 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.717640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5780369-693e-49a0-9bcc-1a40388478c6 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.718696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5780369-693e-49a0-9bcc-1a40388478c6 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.719123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5780369-693e-49a0-9bcc-1a40388478c6 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.805655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-b5780369-693e-49a0-9bcc-1a40388478c6 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lazy-loading 'services' on Instance uuid df9cce51-3636-4177-ae1a-6439b8273ff0 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:10:35.864147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] validate_networks() for [('8d5e8407-4786-4142-8296-8f16e1d64f3e', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:10:35.885548 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b5780369-693e-49a0-9bcc-1a40388478c6 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "DELETE /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0/os-volume_attachments/8d0f1e0b-d2bd-4fba-9b9e-a80e95d7c515" status: 202 len: 0 microversion: 2.1 time: 0.179856 Aug 02 07:10:35.886190 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2397/4729] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:10:35 2022] DELETE /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0/os-volume_attachments/8d0f1e0b-d2bd-4fba-9b9e-a80e95d7c515 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:10:35.891662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-47923708-353c-4404-a2c8-1449132b8a82 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:35.892246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-47923708-353c-4404-a2c8-1449132b8a82 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:35.899911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47923708-353c-4404-a2c8-1449132b8a82 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.900382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47923708-353c-4404-a2c8-1449132b8a82 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.901488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47923708-353c-4404-a2c8-1449132b8a82 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.901975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47923708-353c-4404-a2c8-1449132b8a82 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.916998 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-47923708-353c-4404-a2c8-1449132b8a82 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-47923708-353c-4404-a2c8-1449132b8a82 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 HTTP/1.1 Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'b615a925-443e-4046-83d5-fceafea57257'} Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:35.918811 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:10:35.923650 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.923650 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:35.923650 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.923650 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:35.923650 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:35.923650 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:35.923650 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:35.923650 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:35.923650 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:10:35.923650 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:35.923650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-47923708-353c-4404-a2c8-1449132b8a82 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:35.923650 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-47923708-353c-4404-a2c8-1449132b8a82 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 404 len: 111 microversion: 2.1 time: 0.032849 Aug 02 07:10:35.923650 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2398/4730] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:10:35 2022] DELETE /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:35.928438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-20851698-d605-498c-a674-3f6d175102d2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:35.934166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-20851698-d605-498c-a674-3f6d175102d2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:35.934166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.compute.servers [None req-20851698-d605-498c-a674-3f6d175102d2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Removing options 'limit' from query {{(pid=126120) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 02 07:10:35.934890 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-20851698-d605-498c-a674-3f6d175102d2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:10:35.941556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-20851698-d605-498c-a674-3f6d175102d2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.942375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-20851698-d605-498c-a674-3f6d175102d2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.943783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-20851698-d605-498c-a674-3f6d175102d2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:35.944352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-20851698-d605-498c-a674-3f6d175102d2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:35.986880 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-20851698-d605-498c-a674-3f6d175102d2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.062240 Aug 02 07:10:35.988334 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2399/4731] 10.222.0.79 () {58 vars in 1140 bytes} [Tue Aug 2 07:10:35 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:35.993373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-725efa47-37d1-4f74-927a-dfa46e2e6b9a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:35.995984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-725efa47-37d1-4f74-927a-dfa46e2e6b9a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: b615a925-443e-4046-83d5-fceafea57257] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:36.013995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-725efa47-37d1-4f74-927a-dfa46e2e6b9a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.014366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-725efa47-37d1-4f74-927a-dfa46e2e6b9a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.016563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-725efa47-37d1-4f74-927a-dfa46e2e6b9a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.017072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-725efa47-37d1-4f74-927a-dfa46e2e6b9a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.034576 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-725efa47-37d1-4f74-927a-dfa46e2e6b9a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-725efa47-37d1-4f74-927a-dfa46e2e6b9a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 HTTP/1.1 Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'b615a925-443e-4046-83d5-fceafea57257'} Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:36.036187 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.044505 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.044505 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:36.044505 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:36.044505 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:36.044505 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:36.044505 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. Aug 02 07:10:36.044505 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.044505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-725efa47-37d1-4f74-927a-dfa46e2e6b9a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance b615a925-443e-4046-83d5-fceafea57257 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:36.044505 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-725efa47-37d1-4f74-927a-dfa46e2e6b9a tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257" status: 404 len: 111 microversion: 2.1 time: 0.048284 Aug 02 07:10:36.044505 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2400/4732] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:35 2022] GET /compute/v2.1/servers/b615a925-443e-4046-83d5-fceafea57257 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:36.046442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0bf2caa0-7517-48f4-8c59-74a67e98e1a7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:36.051143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0bf2caa0-7517-48f4-8c59-74a67e98e1a7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:36.051815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0bf2caa0-7517-48f4-8c59-74a67e98e1a7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1247937769', 'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:10:36.059689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bf2caa0-7517-48f4-8c59-74a67e98e1a7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.060191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bf2caa0-7517-48f4-8c59-74a67e98e1a7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.061160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bf2caa0-7517-48f4-8c59-74a67e98e1a7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.061622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bf2caa0-7517-48f4-8c59-74a67e98e1a7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.148516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-0bf2caa0-7517-48f4-8c59-74a67e98e1a7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:10:36.208394 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0bf2caa0-7517-48f4-8c59-74a67e98e1a7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1247937769" status: 200 len: 346 microversion: 2.1 time: 0.168520 Aug 02 07:10:36.209032 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2401/4733] 10.222.0.79 () {58 vars in 1242 bytes} [Tue Aug 2 07:10:36 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1247937769 => generated 346 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:36.214415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dacbb33b-eb7a-4a73-b474-8064f8ec0b0b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:36.215230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dacbb33b-eb7a-4a73-b474-8064f8ec0b0b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:36.222737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dacbb33b-eb7a-4a73-b474-8064f8ec0b0b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.223182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dacbb33b-eb7a-4a73-b474-8064f8ec0b0b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.224058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dacbb33b-eb7a-4a73-b474-8064f8ec0b0b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.224509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dacbb33b-eb7a-4a73-b474-8064f8ec0b0b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.238409 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-dacbb33b-eb7a-4a73-b474-8064f8ec0b0b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dacbb33b-eb7a-4a73-b474-8064f8ec0b0b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b HTTP/1.1 Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '27439ee3-686a-4cd3-8430-f409fdaf175b'} Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:36.239979 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:10:36.244224 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.244224 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:36.244224 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.244224 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.244224 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:36.244224 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:36.244224 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:36.244224 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:36.244224 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:10:36.244224 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.244224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dacbb33b-eb7a-4a73-b474-8064f8ec0b0b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:36.244224 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dacbb33b-eb7a-4a73-b474-8064f8ec0b0b tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 404 len: 111 microversion: 2.1 time: 0.031426 Aug 02 07:10:36.244224 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2402/4734] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:10:36 2022] DELETE /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:36.246622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dc773fc2-2f54-462e-8917-d29a176d980b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:36.247226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dc773fc2-2f54-462e-8917-d29a176d980b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:36.253577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc773fc2-2f54-462e-8917-d29a176d980b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.254045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc773fc2-2f54-462e-8917-d29a176d980b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.254804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc773fc2-2f54-462e-8917-d29a176d980b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.255237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc773fc2-2f54-462e-8917-d29a176d980b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.341048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:10:36.341530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:10:36.342100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:10:36.342568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:10:36.343068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:10:36.352664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.353129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.353925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.354367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.371236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Getting quotas for project 15ee4714199b427db6ee9e17d6fd93dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:10:36.376480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Getting quotas for user 2b5865db38184a5c85b48def8ef9cf97 and project 15ee4714199b427db6ee9e17d6fd93dc. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:10:36.389509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:10:36.391813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:10:36.406517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dc773fc2-2f54-462e-8917-d29a176d980b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:36.414391 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dc773fc2-2f54-462e-8917-d29a176d980b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1697 microversion: 2.1 time: 0.171429 Aug 02 07:10:36.414974 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2403/4735] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:36 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:36.419703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c6a0fd65-a8ac-4a76-9a15-a0774c4cf3cb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:36.420196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c6a0fd65-a8ac-4a76-9a15-a0774c4cf3cb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:36.427138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6a0fd65-a8ac-4a76-9a15-a0774c4cf3cb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.427615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6a0fd65-a8ac-4a76-9a15-a0774c4cf3cb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.428449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6a0fd65-a8ac-4a76-9a15-a0774c4cf3cb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.428910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6a0fd65-a8ac-4a76-9a15-a0774c4cf3cb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.447866 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9cd32555-71e0-40c0-b896-5b689114b511 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.763129 Aug 02 07:10:36.448447 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2333/4736] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 07:10:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 07:10:36.453333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f76b21f-ea72-4013-89bf-5520bc95bd3a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:36.462946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f76b21f-ea72-4013-89bf-5520bc95bd3a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.463409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f76b21f-ea72-4013-89bf-5520bc95bd3a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.475813 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c6a0fd65-a8ac-4a76-9a15-a0774c4cf3cb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/ips" status: 200 len: 151 microversion: 2.1 time: 0.059711 Aug 02 07:10:36.476332 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2404/4737] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 07:10:36 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/ips => generated 151 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:36.481316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f30f9a06-3b13-4908-907a-233b23e7b363 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:36.481991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f30f9a06-3b13-4908-907a-233b23e7b363 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 27439ee3-686a-4cd3-8430-f409fdaf175b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:36.495006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3f76b21f-ea72-4013-89bf-5520bc95bd3a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Going to try to stop instance {{(pid=126119) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 07:10:36.500836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f30f9a06-3b13-4908-907a-233b23e7b363 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.501360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f30f9a06-3b13-4908-907a-233b23e7b363 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.502118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f30f9a06-3b13-4908-907a-233b23e7b363 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.502904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f30f9a06-3b13-4908-907a-233b23e7b363 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.526649 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-f30f9a06-3b13-4908-907a-233b23e7b363 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f30f9a06-3b13-4908-907a-233b23e7b363 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b HTTP/1.1 Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '27439ee3-686a-4cd3-8430-f409fdaf175b'} Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:36.528282 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.536157 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.536157 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:36.536157 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:36.536157 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:36.536157 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:36.536157 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. Aug 02 07:10:36.536157 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.536157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f30f9a06-3b13-4908-907a-233b23e7b363 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 27439ee3-686a-4cd3-8430-f409fdaf175b could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:36.536157 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f30f9a06-3b13-4908-907a-233b23e7b363 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b" status: 404 len: 111 microversion: 2.1 time: 0.052498 Aug 02 07:10:36.536157 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2405/4738] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:36 2022] GET /compute/v2.1/servers/27439ee3-686a-4cd3-8430-f409fdaf175b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:36.536157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-37d336bb-1215-447b-bbfa-456ce3db94e2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:36.536157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-37d336bb-1215-447b-bbfa-456ce3db94e2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:36.554056 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3f76b21f-ea72-4013-89bf-5520bc95bd3a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "POST /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56/action" status: 202 len: 0 microversion: 2.1 time: 0.104132 Aug 02 07:10:36.559598 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2334/4739] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:10:36 2022] POST /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:10:36.567536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fb2fc09c-50db-4e69-99d0-3d1d4054f7b2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:36.568332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fb2fc09c-50db-4e69-99d0-3d1d4054f7b2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:36.591428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb2fc09c-50db-4e69-99d0-3d1d4054f7b2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.591797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb2fc09c-50db-4e69-99d0-3d1d4054f7b2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.593150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb2fc09c-50db-4e69-99d0-3d1d4054f7b2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.593587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb2fc09c-50db-4e69-99d0-3d1d4054f7b2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.617928 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-fb2fc09c-50db-4e69-99d0-3d1d4054f7b2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fb2fc09c-50db-4e69-99d0-3d1d4054f7b2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 HTTP/1.1 Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'dbbef094-4c9f-4465-8f94-3f251fb13b64'} Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:36.619943 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:10:36.624624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.624624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:36.624624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.624624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.624624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:36.624624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:36.624624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:36.624624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:36.624624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:10:36.624624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.626316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fb2fc09c-50db-4e69-99d0-3d1d4054f7b2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:36.627336 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fb2fc09c-50db-4e69-99d0-3d1d4054f7b2 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 404 len: 111 microversion: 2.1 time: 0.066747 Aug 02 07:10:36.628727 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2335/4740] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:10:36 2022] DELETE /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:36.634208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-37d336bb-1215-447b-bbfa-456ce3db94e2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:36.634488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-84a3778e-0a99-4cef-a7ad-21a98d452a5e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:36.634488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-84a3778e-0a99-4cef-a7ad-21a98d452a5e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:36.640598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84a3778e-0a99-4cef-a7ad-21a98d452a5e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.641239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84a3778e-0a99-4cef-a7ad-21a98d452a5e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.642203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84a3778e-0a99-4cef-a7ad-21a98d452a5e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.642795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84a3778e-0a99-4cef-a7ad-21a98d452a5e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.644262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-37d336bb-1215-447b-bbfa-456ce3db94e2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:36.652757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-37d336bb-1215-447b-bbfa-456ce3db94e2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:36.654463 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-37d336bb-1215-447b-bbfa-456ce3db94e2 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1279 microversion: 2.20 time: 0.123175 Aug 02 07:10:36.670398 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2406/4741] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:36 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1279 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:10:36.670398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a4c765ae-d720-468a-84c0-e48cf031edb7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:36.670398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a4c765ae-d720-468a-84c0-e48cf031edb7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: dbbef094-4c9f-4465-8f94-3f251fb13b64] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:36.677688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4c765ae-d720-468a-84c0-e48cf031edb7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.678631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4c765ae-d720-468a-84c0-e48cf031edb7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.679832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4c765ae-d720-468a-84c0-e48cf031edb7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.680465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4c765ae-d720-468a-84c0-e48cf031edb7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.705253 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-a4c765ae-d720-468a-84c0-e48cf031edb7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a4c765ae-d720-468a-84c0-e48cf031edb7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 HTTP/1.1 Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'dbbef094-4c9f-4465-8f94-3f251fb13b64'} Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:36.707392 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.713641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:36.713641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:36.713641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:36.713641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:36.713641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:36.713641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. Aug 02 07:10:36.713641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:36.713641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a4c765ae-d720-468a-84c0-e48cf031edb7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance dbbef094-4c9f-4465-8f94-3f251fb13b64 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:36.713641 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a4c765ae-d720-468a-84c0-e48cf031edb7 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64" status: 404 len: 111 microversion: 2.1 time: 0.050942 Aug 02 07:10:36.713641 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2407/4742] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:36 2022] GET /compute/v2.1/servers/dbbef094-4c9f-4465-8f94-3f251fb13b64 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:36.718098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-10f7682b-6d74-4d6f-96db-c0ec22328c34 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:36.718706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-10f7682b-6d74-4d6f-96db-c0ec22328c34 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:36.721784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:36.732218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10f7682b-6d74-4d6f-96db-c0ec22328c34 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.732660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10f7682b-6d74-4d6f-96db-c0ec22328c34 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:36.733435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10f7682b-6d74-4d6f-96db-c0ec22328c34 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:36.733861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10f7682b-6d74-4d6f-96db-c0ec22328c34 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:37.008059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-84a3778e-0a99-4cef-a7ad-21a98d452a5e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:37.022082 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-84a3778e-0a99-4cef-a7ad-21a98d452a5e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 0.387674 Aug 02 07:10:37.023028 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2336/4743] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:36 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:37.041834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-48adf94a-7715-4f8d-818c-aee9890b3014 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:37.042642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-48adf94a-7715-4f8d-818c-aee9890b3014 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:37.052565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48adf94a-7715-4f8d-818c-aee9890b3014 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:37.054243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48adf94a-7715-4f8d-818c-aee9890b3014 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:37.055093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48adf94a-7715-4f8d-818c-aee9890b3014 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:37.055495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48adf94a-7715-4f8d-818c-aee9890b3014 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:37.085230 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-48adf94a-7715-4f8d-818c-aee9890b3014 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:10:37.086543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-10f7682b-6d74-4d6f-96db-c0ec22328c34 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-48adf94a-7715-4f8d-818c-aee9890b3014 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a HTTP/1.1 Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '93257197-87b4-4106-a2e4-10447658866a'} Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:37.086935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:10:37.091020 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.091020 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:37.091020 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.091020 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:37.091020 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:37.091020 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:37.091020 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:37.091020 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:37.091020 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:10:37.091020 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.093447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-48adf94a-7715-4f8d-818c-aee9890b3014 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:37.094549 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-48adf94a-7715-4f8d-818c-aee9890b3014 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 404 len: 111 microversion: 2.1 time: 0.068756 Aug 02 07:10:37.095292 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2337/4744] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:10:37 2022] DELETE /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:37.102201 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-10f7682b-6d74-4d6f-96db-c0ec22328c34 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.385929 Aug 02 07:10:37.103166 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2408/4745] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:36 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:37.113555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-07f2bdf0-dabc-4bb6-8205-2c20abe3f414 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:37.114190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-07f2bdf0-dabc-4bb6-8205-2c20abe3f414 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 93257197-87b4-4106-a2e4-10447658866a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:37.127996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07f2bdf0-dabc-4bb6-8205-2c20abe3f414 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:37.128534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07f2bdf0-dabc-4bb6-8205-2c20abe3f414 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:37.129420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07f2bdf0-dabc-4bb6-8205-2c20abe3f414 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:37.129940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07f2bdf0-dabc-4bb6-8205-2c20abe3f414 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:37.150212 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-07f2bdf0-dabc-4bb6-8205-2c20abe3f414 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-07f2bdf0-dabc-4bb6-8205-2c20abe3f414 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a HTTP/1.1 Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '93257197-87b4-4106-a2e4-10447658866a'} Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:37.153059 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.158459 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:37.158459 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:37.158459 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:37.158459 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:37.158459 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:37.158459 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. Aug 02 07:10:37.158459 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.160180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-07f2bdf0-dabc-4bb6-8205-2c20abe3f414 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 93257197-87b4-4106-a2e4-10447658866a could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:37.162335 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-07f2bdf0-dabc-4bb6-8205-2c20abe3f414 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a" status: 404 len: 111 microversion: 2.1 time: 0.057687 Aug 02 07:10:37.166317 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2338/4746] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:37 2022] GET /compute/v2.1/servers/93257197-87b4-4106-a2e4-10447658866a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:37.172409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-05c3bad3-52ea-4f39-945e-537a58e4c12e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:37.172951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-05c3bad3-52ea-4f39-945e-537a58e4c12e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 6d0f8e23-78a8-4d3c-91d8-45662b249654] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:37.180185 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-05c3bad3-52ea-4f39-945e-537a58e4c12e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-05c3bad3-52ea-4f39-945e-537a58e4c12e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/6d0f8e23-78a8-4d3c-91d8-45662b249654 HTTP/1.1 Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '6d0f8e23-78a8-4d3c-91d8-45662b249654'} Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:37.182058 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.189488 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:37.189488 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:37.189488 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:37.189488 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:37.189488 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:37.189488 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:10:37.189488 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.189488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-05c3bad3-52ea-4f39-945e-537a58e4c12e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:37.189488 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-05c3bad3-52ea-4f39-945e-537a58e4c12e tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6d0f8e23-78a8-4d3c-91d8-45662b249654" status: 404 len: 111 microversion: 2.1 time: 0.015850 Aug 02 07:10:37.189488 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2409/4747] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:10:37 2022] DELETE /compute/v2.1/servers/6d0f8e23-78a8-4d3c-91d8-45662b249654 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:37.192387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3c963ac5-876f-47f9-a0fd-6779e8ee43e1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:37.193007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3c963ac5-876f-47f9-a0fd-6779e8ee43e1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: 6d0f8e23-78a8-4d3c-91d8-45662b249654] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:37.199325 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-3c963ac5-876f-47f9-a0fd-6779e8ee43e1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3c963ac5-876f-47f9-a0fd-6779e8ee43e1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/6d0f8e23-78a8-4d3c-91d8-45662b249654 HTTP/1.1 Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '6d0f8e23-78a8-4d3c-91d8-45662b249654'} Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:37.201002 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:37.208812 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:37.208812 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:37.208812 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:37.208812 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. Aug 02 07:10:37.208812 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:37.208812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3c963ac5-876f-47f9-a0fd-6779e8ee43e1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance 6d0f8e23-78a8-4d3c-91d8-45662b249654 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:37.208812 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3c963ac5-876f-47f9-a0fd-6779e8ee43e1 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/6d0f8e23-78a8-4d3c-91d8-45662b249654" status: 404 len: 111 microversion: 2.1 time: 0.014265 Aug 02 07:10:37.208812 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2339/4748] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:37 2022] GET /compute/v2.1/servers/6d0f8e23-78a8-4d3c-91d8-45662b249654 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:37.212003 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-662559c4-8705-488a-956a-431404fb5ce6 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:37.212280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-662559c4-8705-488a-956a-431404fb5ce6 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:37.219505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-662559c4-8705-488a-956a-431404fb5ce6 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:37.220709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-662559c4-8705-488a-956a-431404fb5ce6 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:37.221746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-662559c4-8705-488a-956a-431404fb5ce6 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:37.222336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-662559c4-8705-488a-956a-431404fb5ce6 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:37.244750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:37.259436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-662559c4-8705-488a-956a-431404fb5ce6 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:10:37.350130 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-662559c4-8705-488a-956a-431404fb5ce6 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3" status: 204 len: 0 microversion: 2.1 time: 0.141892 Aug 02 07:10:37.351562 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2410/4749] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:10:37 2022] DELETE /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:10:37.360548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e9d2a94c-f504-4cf2-9542-c1f3ef751bbe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:37.361542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e9d2a94c-f504-4cf2-9542-c1f3ef751bbe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:37.370446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9d2a94c-f504-4cf2-9542-c1f3ef751bbe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:37.371427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9d2a94c-f504-4cf2-9542-c1f3ef751bbe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:37.373466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9d2a94c-f504-4cf2-9542-c1f3ef751bbe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:37.374124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9d2a94c-f504-4cf2-9542-c1f3ef751bbe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:37.440530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1ff930f1-838f-43eb-a3ad-3c1ac5667cf5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:37.441865 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1ff930f1-838f-43eb-a3ad-3c1ac5667cf5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:37.449305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ff930f1-838f-43eb-a3ad-3c1ac5667cf5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:37.450081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ff930f1-838f-43eb-a3ad-3c1ac5667cf5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:37.451036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ff930f1-838f-43eb-a3ad-3c1ac5667cf5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:37.451471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ff930f1-838f-43eb-a3ad-3c1ac5667cf5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:37.580898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e9d2a94c-f504-4cf2-9542-c1f3ef751bbe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:37.590764 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e9d2a94c-f504-4cf2-9542-c1f3ef751bbe tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3" status: 200 len: 1478 microversion: 2.1 time: 0.235181 Aug 02 07:10:37.591713 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2340/4750] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:37 2022] GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 => generated 1478 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:37.631133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1ff930f1-838f-43eb-a3ad-3c1ac5667cf5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:37.639225 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1ff930f1-838f-43eb-a3ad-3c1ac5667cf5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1697 microversion: 2.1 time: 0.203342 Aug 02 07:10:37.639793 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2411/4751] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:37 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1697 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:37.676853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0d8b6754-8d97-45b9-85c9-913ac7f524bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:37.677859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0d8b6754-8d97-45b9-85c9-913ac7f524bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:37.684330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d8b6754-8d97-45b9-85c9-913ac7f524bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:37.684853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d8b6754-8d97-45b9-85c9-913ac7f524bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:37.685693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d8b6754-8d97-45b9-85c9-913ac7f524bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:37.686262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d8b6754-8d97-45b9-85c9-913ac7f524bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:37.755900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0d8b6754-8d97-45b9-85c9-913ac7f524bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:37.764922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0d8b6754-8d97-45b9-85c9-913ac7f524bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:37.766442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0d8b6754-8d97-45b9-85c9-913ac7f524bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:37.767558 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0d8b6754-8d97-45b9-85c9-913ac7f524bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1331 microversion: 2.20 time: 0.094786 Aug 02 07:10:37.768445 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2341/4752] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:37 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:10:38.044749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ae1e4737-3cc5-40ab-9a77-3048cff6a3b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:38.045360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae1e4737-3cc5-40ab-9a77-3048cff6a3b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:38.052601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae1e4737-3cc5-40ab-9a77-3048cff6a3b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:38.053055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae1e4737-3cc5-40ab-9a77-3048cff6a3b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:38.054054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae1e4737-3cc5-40ab-9a77-3048cff6a3b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:38.054485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae1e4737-3cc5-40ab-9a77-3048cff6a3b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:38.125591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-61e0e2d7-033f-4505-b789-f2c29ce12a4d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:38.126902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-61e0e2d7-033f-4505-b789-f2c29ce12a4d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:38.135789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61e0e2d7-033f-4505-b789-f2c29ce12a4d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:38.136475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61e0e2d7-033f-4505-b789-f2c29ce12a4d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:38.138077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61e0e2d7-033f-4505-b789-f2c29ce12a4d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:38.138640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61e0e2d7-033f-4505-b789-f2c29ce12a4d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:38.201613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ae1e4737-3cc5-40ab-9a77-3048cff6a3b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:38.210654 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ae1e4737-3cc5-40ab-9a77-3048cff6a3b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 0.170075 Aug 02 07:10:38.211350 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2412/4753] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:38 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:38.548367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-61e0e2d7-033f-4505-b789-f2c29ce12a4d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:38.558302 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-61e0e2d7-033f-4505-b789-f2c29ce12a4d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.437868 Aug 02 07:10:38.559622 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2342/4754] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:38 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:38.612699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-49256bcc-384a-4354-82e1-d5ac60b3bf65 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:38.613345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-49256bcc-384a-4354-82e1-d5ac60b3bf65 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:38.620092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49256bcc-384a-4354-82e1-d5ac60b3bf65 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:38.620529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49256bcc-384a-4354-82e1-d5ac60b3bf65 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:38.621278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49256bcc-384a-4354-82e1-d5ac60b3bf65 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:38.621700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49256bcc-384a-4354-82e1-d5ac60b3bf65 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:38.661350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a117e480-b84e-49f1-8dd9-e1ad9a16d9c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:38.662356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a117e480-b84e-49f1-8dd9-e1ad9a16d9c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:38.669539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a117e480-b84e-49f1-8dd9-e1ad9a16d9c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:38.670396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a117e480-b84e-49f1-8dd9-e1ad9a16d9c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:38.671897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a117e480-b84e-49f1-8dd9-e1ad9a16d9c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:38.672631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a117e480-b84e-49f1-8dd9-e1ad9a16d9c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:38.807381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-49256bcc-384a-4354-82e1-d5ac60b3bf65 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:38.816377 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-49256bcc-384a-4354-82e1-d5ac60b3bf65 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3" status: 200 len: 1478 microversion: 2.1 time: 0.207502 Aug 02 07:10:38.817808 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2413/4755] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:38 2022] GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 => generated 1478 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:38.822759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fa81e4f9-c2a6-4632-9259-281bbdfa23f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:38.823366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fa81e4f9-c2a6-4632-9259-281bbdfa23f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:38.830312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa81e4f9-c2a6-4632-9259-281bbdfa23f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:38.831258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa81e4f9-c2a6-4632-9259-281bbdfa23f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:38.832664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa81e4f9-c2a6-4632-9259-281bbdfa23f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:38.833115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa81e4f9-c2a6-4632-9259-281bbdfa23f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:38.871218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a117e480-b84e-49f1-8dd9-e1ad9a16d9c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:38.879834 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a117e480-b84e-49f1-8dd9-e1ad9a16d9c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1697 microversion: 2.1 time: 0.223155 Aug 02 07:10:38.880458 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2343/4756] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:38 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1697 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:38.901874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fa81e4f9-c2a6-4632-9259-281bbdfa23f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:38.910443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fa81e4f9-c2a6-4632-9259-281bbdfa23f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:38.911958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fa81e4f9-c2a6-4632-9259-281bbdfa23f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:38.913091 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fa81e4f9-c2a6-4632-9259-281bbdfa23f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1331 microversion: 2.20 time: 0.093971 Aug 02 07:10:38.913653 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2414/4757] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:38 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:10:39.028544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5ccb7dbf-9e4d-4136-a8c8-7513bbd2b352 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29ecad49-aa77-42c0-a46c-7cbc402fa5a2"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:39.031043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5ccb7dbf-9e4d-4136-a8c8-7513bbd2b352 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:39.046267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ccb7dbf-9e4d-4136-a8c8-7513bbd2b352 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:39.046728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ccb7dbf-9e4d-4136-a8c8-7513bbd2b352 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:39.047503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ccb7dbf-9e4d-4136-a8c8-7513bbd2b352 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:39.047931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ccb7dbf-9e4d-4136-a8c8-7513bbd2b352 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:39.235042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-70c4e51e-300c-4893-8ba5-bc0c25a60425 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:39.236414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-70c4e51e-300c-4893-8ba5-bc0c25a60425 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:39.251560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70c4e51e-300c-4893-8ba5-bc0c25a60425 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:39.256842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70c4e51e-300c-4893-8ba5-bc0c25a60425 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:39.258570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70c4e51e-300c-4893-8ba5-bc0c25a60425 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:39.259223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70c4e51e-300c-4893-8ba5-bc0c25a60425 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:39.474766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-70c4e51e-300c-4893-8ba5-bc0c25a60425 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:39.486401 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-70c4e51e-300c-4893-8ba5-bc0c25a60425 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 0.256517 Aug 02 07:10:39.487919 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2415/4758] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:39 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:39.510364 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5ccb7dbf-9e4d-4136-a8c8-7513bbd2b352 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "POST /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485800 Aug 02 07:10:39.511105 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2344/4759] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:10:39 2022] POST /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:39.587061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a6e13ad7-e4bb-409a-b258-fe6b18483bf9 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:39.588108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a6e13ad7-e4bb-409a-b258-fe6b18483bf9 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:39.596487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6e13ad7-e4bb-409a-b258-fe6b18483bf9 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:39.596806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6e13ad7-e4bb-409a-b258-fe6b18483bf9 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:39.597993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6e13ad7-e4bb-409a-b258-fe6b18483bf9 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:39.610175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6e13ad7-e4bb-409a-b258-fe6b18483bf9 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:39.770102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a6e13ad7-e4bb-409a-b258-fe6b18483bf9 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:39.777951 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a6e13ad7-e4bb-409a-b258-fe6b18483bf9 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.195216 Aug 02 07:10:39.779238 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2416/4760] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:39 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:39.840101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2e2e3b67-2132-4e8e-a1d7-b1f117eae1b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:39.840800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2e2e3b67-2132-4e8e-a1d7-b1f117eae1b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:39.847508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e2e3b67-2132-4e8e-a1d7-b1f117eae1b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:39.847959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e2e3b67-2132-4e8e-a1d7-b1f117eae1b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:39.848745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e2e3b67-2132-4e8e-a1d7-b1f117eae1b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:39.849185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e2e3b67-2132-4e8e-a1d7-b1f117eae1b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:39.901606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-502810ee-aea3-4d98-a8f6-c25f84c3329c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:39.902650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-502810ee-aea3-4d98-a8f6-c25f84c3329c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:39.914621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-502810ee-aea3-4d98-a8f6-c25f84c3329c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:39.915458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-502810ee-aea3-4d98-a8f6-c25f84c3329c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:39.929442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-502810ee-aea3-4d98-a8f6-c25f84c3329c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:39.932647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-502810ee-aea3-4d98-a8f6-c25f84c3329c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:39.979997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2e2e3b67-2132-4e8e-a1d7-b1f117eae1b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0971d7961d5a4e8996ea2c0f958382ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da31144cd8b94b76821c8a01029ffb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:39.989790 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2e2e3b67-2132-4e8e-a1d7-b1f117eae1b5 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3" status: 200 len: 1436 microversion: 2.1 time: 0.154674 Aug 02 07:10:39.995032 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2345/4761] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:39 2022] GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 => generated 1436 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:40.015366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-192ee554-e07c-4476-9211-bf60c9076092 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:40.016318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-192ee554-e07c-4476-9211-bf60c9076092 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:40.032716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-192ee554-e07c-4476-9211-bf60c9076092 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:40.033183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-192ee554-e07c-4476-9211-bf60c9076092 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:40.034074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-192ee554-e07c-4476-9211-bf60c9076092 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:40.036908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-192ee554-e07c-4476-9211-bf60c9076092 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:40.164503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-192ee554-e07c-4476-9211-bf60c9076092 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:40.175703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-192ee554-e07c-4476-9211-bf60c9076092 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:40.177401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-192ee554-e07c-4476-9211-bf60c9076092 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:40.179118 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-192ee554-e07c-4476-9211-bf60c9076092 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1337 microversion: 2.20 time: 0.179922 Aug 02 07:10:40.179920 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2346/4762] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:39 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1337 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:10:40.214090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-30b05f5a-94da-4e61-8093-3f4b018cf534 req-ab2c07d9-54fe-4aa2-8243-82565ccdbd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6df8190-3206-4d0e-97d9-7e80986012a3", "name": "network-vif-deleted", "tag": "9f4e2fd7-50f2-4305-acd9-a197edde8479"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:40.227437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-502810ee-aea3-4d98-a8f6-c25f84c3329c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:40.234047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-30b05f5a-94da-4e61-8093-3f4b018cf534 req-ab2c07d9-54fe-4aa2-8243-82565ccdbd77 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:40.234743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-30b05f5a-94da-4e61-8093-3f4b018cf534 req-ab2c07d9-54fe-4aa2-8243-82565ccdbd77 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:40.238954 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-502810ee-aea3-4d98-a8f6-c25f84c3329c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1697 microversion: 2.1 time: 0.341932 Aug 02 07:10:40.254000 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2417/4763] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:39 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1697 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:40.255739 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-30b05f5a-94da-4e61-8093-3f4b018cf534 req-ab2c07d9-54fe-4aa2-8243-82565ccdbd77 service nova] Creating event network-vif-deleted:9f4e2fd7-50f2-4305-acd9-a197edde8479 for instance f6df8190-3206-4d0e-97d9-7e80986012a3 on n-h1-851337-3 Aug 02 07:10:40.262326 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-30b05f5a-94da-4e61-8093-3f4b018cf534 req-ab2c07d9-54fe-4aa2-8243-82565ccdbd77 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054442 Aug 02 07:10:40.263208 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2347/4764] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:40.510819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3212df55-3177-40c4-b3bb-a84ad82d0cb4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:40.511547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3212df55-3177-40c4-b3bb-a84ad82d0cb4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:40.524418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3212df55-3177-40c4-b3bb-a84ad82d0cb4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:40.525181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3212df55-3177-40c4-b3bb-a84ad82d0cb4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:40.526180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3212df55-3177-40c4-b3bb-a84ad82d0cb4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:40.526715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3212df55-3177-40c4-b3bb-a84ad82d0cb4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:40.690696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3212df55-3177-40c4-b3bb-a84ad82d0cb4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:40.699608 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3212df55-3177-40c4-b3bb-a84ad82d0cb4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 0.192980 Aug 02 07:10:40.714236 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2418/4765] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:40 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:40.809941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4743a3d7-7106-4f1f-aad4-0753a635d085 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:40.810635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4743a3d7-7106-4f1f-aad4-0753a635d085 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:40.817087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4743a3d7-7106-4f1f-aad4-0753a635d085 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:40.817530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4743a3d7-7106-4f1f-aad4-0753a635d085 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:40.818627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4743a3d7-7106-4f1f-aad4-0753a635d085 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:40.819067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4743a3d7-7106-4f1f-aad4-0753a635d085 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:40.824430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:40.996826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4743a3d7-7106-4f1f-aad4-0753a635d085 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:41.007389 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4743a3d7-7106-4f1f-aad4-0753a635d085 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.210157 Aug 02 07:10:41.009777 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2348/4766] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:40 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:41.028158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7284416-d18d-4835-8a39-a1e103974295 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:41.028855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e7284416-d18d-4835-8a39-a1e103974295 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] [instance: f6df8190-3206-4d0e-97d9-7e80986012a3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:41.035762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7284416-d18d-4835-8a39-a1e103974295 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:41.036215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7284416-d18d-4835-8a39-a1e103974295 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:41.036992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7284416-d18d-4835-8a39-a1e103974295 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:41.037766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7284416-d18d-4835-8a39-a1e103974295 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:41.055284 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-e7284416-d18d-4835-8a39-a1e103974295 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] HTTP exception thrown: Instance f6df8190-3206-4d0e-97d9-7e80986012a3 could not be found. Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7284416-d18d-4835-8a39-a1e103974295 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Request method failure captured: Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 HTTP/1.1 Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M0coGCiPHbrPCVEfC9kzTpzPq4xUPxl7F4aLR6cT1J_Ak1wYZDspubs3xvkGyLdRF2ztHg-X8d4ayw7yxI0E_0dfBvBHikCgHhyhMKCKtUsANYPZ4Fd_HFIyHuH7PboKfrB8bEfcdHxV1DLCbB0JhV1wfwSLGm8DsCg_fgi3WOEnnE Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da31144cd8b94b76821c8a01029ffb37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da31144cd8b94b76821c8a01029ffb37"}]}] Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersTestJSON-1589567689 Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: da31144cd8b94b76821c8a01029ffb37 Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersTestJSON-1589567689 Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0971d7961d5a4e8996ea2c0f958382ad Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersTestJSON-1589567689-project Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance f6df8190-3206-4d0e-97d9-7e80986012a3 could not be found. Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'f6df8190-3206-4d0e-97d9-7e80986012a3'} Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6df8190-3206-4d0e-97d9-7e80986012a3 could not be found. Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6df8190-3206-4d0e-97d9-7e80986012a3 could not be found. Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:41.058185 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:41.062316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:41.062316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:41.062316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:41.062316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:41.062316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:41.062316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6df8190-3206-4d0e-97d9-7e80986012a3 could not be found. Aug 02 07:10:41.062316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:10:41.062316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7284416-d18d-4835-8a39-a1e103974295 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] Returning 404 to user: Instance f6df8190-3206-4d0e-97d9-7e80986012a3 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:41.062316 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7284416-d18d-4835-8a39-a1e103974295 tempest-ServersTestJSON-1589567689 tempest-ServersTestJSON-1589567689-project] 10.222.0.79 "GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3" status: 404 len: 111 microversion: 2.1 time: 0.035997 Aug 02 07:10:41.062316 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2419/4767] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:41 2022] GET /compute/v2.1/servers/f6df8190-3206-4d0e-97d9-7e80986012a3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:41.205498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7d0fc8ed-e990-4fe0-b05e-bde7debfda59 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:41.206402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7d0fc8ed-e990-4fe0-b05e-bde7debfda59 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:41.214280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d0fc8ed-e990-4fe0-b05e-bde7debfda59 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:41.214772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d0fc8ed-e990-4fe0-b05e-bde7debfda59 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:41.215540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d0fc8ed-e990-4fe0-b05e-bde7debfda59 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:41.215971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d0fc8ed-e990-4fe0-b05e-bde7debfda59 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:41.262080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a371d659-60b7-42c3-adea-33801bb84d1b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:41.263001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a371d659-60b7-42c3-adea-33801bb84d1b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:41.270099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a371d659-60b7-42c3-adea-33801bb84d1b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:41.270864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a371d659-60b7-42c3-adea-33801bb84d1b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:41.271849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a371d659-60b7-42c3-adea-33801bb84d1b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:41.272488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a371d659-60b7-42c3-adea-33801bb84d1b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:41.514722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7d0fc8ed-e990-4fe0-b05e-bde7debfda59 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:41.531384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7d0fc8ed-e990-4fe0-b05e-bde7debfda59 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:41.533698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7d0fc8ed-e990-4fe0-b05e-bde7debfda59 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:41.537495 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7d0fc8ed-e990-4fe0-b05e-bde7debfda59 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1405 microversion: 2.20 time: 0.337266 Aug 02 07:10:41.548545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a371d659-60b7-42c3-adea-33801bb84d1b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:41.551525 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2349/4768] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:41 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1405 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:10:41.559036 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a371d659-60b7-42c3-adea-33801bb84d1b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1697 microversion: 2.1 time: 0.300803 Aug 02 07:10:41.559530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2d6d2125-ea75-4207-b2bb-5d33bcd124ea tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:41.560044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2d6d2125-ea75-4207-b2bb-5d33bcd124ea tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:41.560875 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2420/4769] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:41 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1697 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:41.571431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d6d2125-ea75-4207-b2bb-5d33bcd124ea tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:41.572098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d6d2125-ea75-4207-b2bb-5d33bcd124ea tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:41.573073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d6d2125-ea75-4207-b2bb-5d33bcd124ea tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:41.573663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d6d2125-ea75-4207-b2bb-5d33bcd124ea tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:41.602790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2d6d2125-ea75-4207-b2bb-5d33bcd124ea tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:10:41.687644 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2d6d2125-ea75-4207-b2bb-5d33bcd124ea tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "DELETE /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0" status: 204 len: 0 microversion: 2.1 time: 0.134146 Aug 02 07:10:41.688342 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2350/4770] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:10:41 2022] DELETE /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:10:41.697030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-67d7b4d5-4a80-4355-9125-f6ce8a76fcd9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:41.697738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-67d7b4d5-4a80-4355-9125-f6ce8a76fcd9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:41.704894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-67d7b4d5-4a80-4355-9125-f6ce8a76fcd9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:41.705348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-67d7b4d5-4a80-4355-9125-f6ce8a76fcd9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:41.706443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-67d7b4d5-4a80-4355-9125-f6ce8a76fcd9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:41.706897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-67d7b4d5-4a80-4355-9125-f6ce8a76fcd9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:41.725660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-57811d89-75d0-4ff8-81b5-d3386e4da5c3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:41.727082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-57811d89-75d0-4ff8-81b5-d3386e4da5c3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:41.734718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-57811d89-75d0-4ff8-81b5-d3386e4da5c3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:41.735476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-57811d89-75d0-4ff8-81b5-d3386e4da5c3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:41.736514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-57811d89-75d0-4ff8-81b5-d3386e4da5c3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:41.737369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-57811d89-75d0-4ff8-81b5-d3386e4da5c3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:41.940808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-57811d89-75d0-4ff8-81b5-d3386e4da5c3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:41.948323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-67d7b4d5-4a80-4355-9125-f6ce8a76fcd9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:41.949404 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-57811d89-75d0-4ff8-81b5-d3386e4da5c3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 0.231801 Aug 02 07:10:41.962212 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-67d7b4d5-4a80-4355-9125-f6ce8a76fcd9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0" status: 200 len: 1513 microversion: 2.1 time: 0.263599 Aug 02 07:10:41.962931 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2351/4771] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:41 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:41.965008 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2421/4772] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:41 2022] GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0 => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:42.029320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-406f1f7c-70eb-43d6-ba89-931b2e9d14ad tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:42.030599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-406f1f7c-70eb-43d6-ba89-931b2e9d14ad tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:42.039344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-406f1f7c-70eb-43d6-ba89-931b2e9d14ad tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:42.041168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-406f1f7c-70eb-43d6-ba89-931b2e9d14ad tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:42.042711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-406f1f7c-70eb-43d6-ba89-931b2e9d14ad tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:42.043051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-406f1f7c-70eb-43d6-ba89-931b2e9d14ad tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:42.225592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-406f1f7c-70eb-43d6-ba89-931b2e9d14ad tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:42.246899 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-406f1f7c-70eb-43d6-ba89-931b2e9d14ad tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.221837 Aug 02 07:10:42.251923 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2352/4773] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:42 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:42.319718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e944df6f-8db1-4a07-b481-8f9e7cb9d636 req-0d02146d-f477-4874-b710-0331eed63674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8979e165-921d-4e06-92fc-dba834a53b1b", "tag": "768fa789-2440-4838-8853-20f834aabcea"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:42.333305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e944df6f-8db1-4a07-b481-8f9e7cb9d636 req-0d02146d-f477-4874-b710-0331eed63674 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:42.334597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e944df6f-8db1-4a07-b481-8f9e7cb9d636 req-0d02146d-f477-4874-b710-0331eed63674 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:42.348883 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e944df6f-8db1-4a07-b481-8f9e7cb9d636 req-0d02146d-f477-4874-b710-0331eed63674 service nova] Creating event network-changed:768fa789-2440-4838-8853-20f834aabcea for instance 8979e165-921d-4e06-92fc-dba834a53b1b on n-h1-851337-3 Aug 02 07:10:42.356349 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e944df6f-8db1-4a07-b481-8f9e7cb9d636 req-0d02146d-f477-4874-b710-0331eed63674 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041963 Aug 02 07:10:42.357502 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2422/4774] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:10:42.563874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-23d082e6-88f4-4946-8b38-e1a0a9b9c0c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:42.564709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-23d082e6-88f4-4946-8b38-e1a0a9b9c0c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:42.571748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23d082e6-88f4-4946-8b38-e1a0a9b9c0c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:42.572474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23d082e6-88f4-4946-8b38-e1a0a9b9c0c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:42.573366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23d082e6-88f4-4946-8b38-e1a0a9b9c0c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:42.575775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23d082e6-88f4-4946-8b38-e1a0a9b9c0c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:42.582729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cc4d49b5-0832-4f29-afa9-c3fbe3c4d34c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:42.583768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cc4d49b5-0832-4f29-afa9-c3fbe3c4d34c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:42.599564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc4d49b5-0832-4f29-afa9-c3fbe3c4d34c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:42.600132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc4d49b5-0832-4f29-afa9-c3fbe3c4d34c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:42.601198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc4d49b5-0832-4f29-afa9-c3fbe3c4d34c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:42.602970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc4d49b5-0832-4f29-afa9-c3fbe3c4d34c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:42.892838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23d082e6-88f4-4946-8b38-e1a0a9b9c0c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:42.906416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23d082e6-88f4-4946-8b38-e1a0a9b9c0c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:42.907973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23d082e6-88f4-4946-8b38-e1a0a9b9c0c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:42.908624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cc4d49b5-0832-4f29-afa9-c3fbe3c4d34c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:42.919493 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cc4d49b5-0832-4f29-afa9-c3fbe3c4d34c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1697 microversion: 2.1 time: 0.341358 Aug 02 07:10:42.922245 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2423/4775] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:42 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1697 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:42.924690 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-23d082e6-88f4-4946-8b38-e1a0a9b9c0c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1405 microversion: 2.20 time: 0.364863 Aug 02 07:10:42.925935 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2353/4776] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:42 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1405 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:10:42.978276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4870f3c6-f916-4388-824c-cac98ed219a5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:42.980200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4870f3c6-f916-4388-824c-cac98ed219a5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:42.981417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-68b65b10-57eb-4faa-a491-47515fff6ac5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:42.982306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-68b65b10-57eb-4faa-a491-47515fff6ac5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:42.984594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:42.990250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68b65b10-57eb-4faa-a491-47515fff6ac5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:42.991306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68b65b10-57eb-4faa-a491-47515fff6ac5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:42.992225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4870f3c6-f916-4388-824c-cac98ed219a5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:42.992549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68b65b10-57eb-4faa-a491-47515fff6ac5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:42.992679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4870f3c6-f916-4388-824c-cac98ed219a5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:42.993390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68b65b10-57eb-4faa-a491-47515fff6ac5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:42.993625 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4870f3c6-f916-4388-824c-cac98ed219a5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:42.994118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4870f3c6-f916-4388-824c-cac98ed219a5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:43.236203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-68b65b10-57eb-4faa-a491-47515fff6ac5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:43.244423 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-68b65b10-57eb-4faa-a491-47515fff6ac5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 0.274874 Aug 02 07:10:43.245259 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2424/4777] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:42 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:43.269045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4870f3c6-f916-4388-824c-cac98ed219a5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:43.272447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c00a3688-5822-4caf-962c-2d0cbfa6b8f2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:43.273067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c00a3688-5822-4caf-962c-2d0cbfa6b8f2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:43.277150 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4870f3c6-f916-4388-824c-cac98ed219a5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0" status: 200 len: 1513 microversion: 2.1 time: 0.302913 Aug 02 07:10:43.284806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c00a3688-5822-4caf-962c-2d0cbfa6b8f2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:43.285280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c00a3688-5822-4caf-962c-2d0cbfa6b8f2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:43.286115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c00a3688-5822-4caf-962c-2d0cbfa6b8f2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:43.292624 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2354/4778] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:42 2022] GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0 => generated 1513 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:43.298067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c00a3688-5822-4caf-962c-2d0cbfa6b8f2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:43.456078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c00a3688-5822-4caf-962c-2d0cbfa6b8f2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:43.466924 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c00a3688-5822-4caf-962c-2d0cbfa6b8f2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.196772 Aug 02 07:10:43.468154 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2425/4779] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:43 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:43.942185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f8dfc67-5f77-4c5a-b66d-ee1e67c54c78 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:43.943221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3f8dfc67-5f77-4c5a-b66d-ee1e67c54c78 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:43.952654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2981bdb1-af2a-4cde-b920-d0044ebfc7fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:43.953293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2981bdb1-af2a-4cde-b920-d0044ebfc7fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:43.965556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2981bdb1-af2a-4cde-b920-d0044ebfc7fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:43.968457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2981bdb1-af2a-4cde-b920-d0044ebfc7fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:43.969159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f8dfc67-5f77-4c5a-b66d-ee1e67c54c78 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:43.970190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2981bdb1-af2a-4cde-b920-d0044ebfc7fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:43.970817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f8dfc67-5f77-4c5a-b66d-ee1e67c54c78 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:43.971776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f8dfc67-5f77-4c5a-b66d-ee1e67c54c78 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:43.972420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2981bdb1-af2a-4cde-b920-d0044ebfc7fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:43.974405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f8dfc67-5f77-4c5a-b66d-ee1e67c54c78 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:44.339434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3f8dfc67-5f77-4c5a-b66d-ee1e67c54c78 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:44.348113 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3f8dfc67-5f77-4c5a-b66d-ee1e67c54c78 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1697 microversion: 2.1 time: 0.409906 Aug 02 07:10:44.350375 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2355/4780] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:43 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1697 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:44.357132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c9217bda-b51d-4af9-ba43-b7b5c6917be6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:44.358194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c9217bda-b51d-4af9-ba43-b7b5c6917be6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:44.366676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9217bda-b51d-4af9-ba43-b7b5c6917be6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:44.367615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9217bda-b51d-4af9-ba43-b7b5c6917be6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:44.368957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9217bda-b51d-4af9-ba43-b7b5c6917be6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:44.369626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9217bda-b51d-4af9-ba43-b7b5c6917be6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:44.371585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2981bdb1-af2a-4cde-b920-d0044ebfc7fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:44.375181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:44.389265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2981bdb1-af2a-4cde-b920-d0044ebfc7fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:44.390813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2981bdb1-af2a-4cde-b920-d0044ebfc7fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:44.391988 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2981bdb1-af2a-4cde-b920-d0044ebfc7fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1405 microversion: 2.20 time: 0.443580 Aug 02 07:10:44.402372 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2426/4781] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:43 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:10:44.407715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b484e465-0cbf-429a-b6ff-0aa4b11722cd tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:44.408331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b484e465-0cbf-429a-b6ff-0aa4b11722cd tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:44.421279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b484e465-0cbf-429a-b6ff-0aa4b11722cd tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:44.422030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b484e465-0cbf-429a-b6ff-0aa4b11722cd tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:44.422974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b484e465-0cbf-429a-b6ff-0aa4b11722cd tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:44.423576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b484e465-0cbf-429a-b6ff-0aa4b11722cd tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:44.505292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b484e465-0cbf-429a-b6ff-0aa4b11722cd tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:44.517918 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b484e465-0cbf-429a-b6ff-0aa4b11722cd tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0" status: 200 len: 1471 microversion: 2.1 time: 0.114296 Aug 02 07:10:44.521354 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2427/4782] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:44 2022] GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0 => generated 1471 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:44.529453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ee06f55b-4851-43ed-88d8-53881f8d53dd req-81ead5ce-929f-405b-85ad-39668141f3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9cce51-3636-4177-ae1a-6439b8273ff0", "name": "network-vif-deleted", "tag": "869bd5e2-d110-49ca-ac08-aed58db97575"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:44.540102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ee06f55b-4851-43ed-88d8-53881f8d53dd req-81ead5ce-929f-405b-85ad-39668141f3cc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:44.540837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ee06f55b-4851-43ed-88d8-53881f8d53dd req-81ead5ce-929f-405b-85ad-39668141f3cc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:44.555089 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ee06f55b-4851-43ed-88d8-53881f8d53dd req-81ead5ce-929f-405b-85ad-39668141f3cc service nova] Creating event network-vif-deleted:869bd5e2-d110-49ca-ac08-aed58db97575 for instance df9cce51-3636-4177-ae1a-6439b8273ff0 on n-h2-851337-3 Aug 02 07:10:44.573340 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ee06f55b-4851-43ed-88d8-53881f8d53dd req-81ead5ce-929f-405b-85ad-39668141f3cc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050478 Aug 02 07:10:44.576529 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2428/4783] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:44.583379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f4472892-de0b-43a2-857b-f2749a677be2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:44.585071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f4472892-de0b-43a2-857b-f2749a677be2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:44.603042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4472892-de0b-43a2-857b-f2749a677be2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:44.603812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4472892-de0b-43a2-857b-f2749a677be2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:44.604805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4472892-de0b-43a2-857b-f2749a677be2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:44.605404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4472892-de0b-43a2-857b-f2749a677be2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:44.695236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c9217bda-b51d-4af9-ba43-b7b5c6917be6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:44.708911 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c9217bda-b51d-4af9-ba43-b7b5c6917be6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 0.352374 Aug 02 07:10:44.721909 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2356/4784] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:44 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:44.858849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f4472892-de0b-43a2-857b-f2749a677be2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:44.867178 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f4472892-de0b-43a2-857b-f2749a677be2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.289172 Aug 02 07:10:44.867951 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2429/4785] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:44 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:45.379684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9fbfba03-f33f-4a7d-aa08-05185dcd83ad tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:45.385131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9fbfba03-f33f-4a7d-aa08-05185dcd83ad tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:45.402064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9fbfba03-f33f-4a7d-aa08-05185dcd83ad tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:45.403790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9fbfba03-f33f-4a7d-aa08-05185dcd83ad tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:45.406213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9fbfba03-f33f-4a7d-aa08-05185dcd83ad tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:45.406685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9fbfba03-f33f-4a7d-aa08-05185dcd83ad tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:45.424630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f11d3adc-d4aa-437e-b09a-8e71685b6e15 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:45.425336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f11d3adc-d4aa-437e-b09a-8e71685b6e15 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:45.432555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f11d3adc-d4aa-437e-b09a-8e71685b6e15 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:45.441254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f11d3adc-d4aa-437e-b09a-8e71685b6e15 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:45.442145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f11d3adc-d4aa-437e-b09a-8e71685b6e15 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:45.442594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f11d3adc-d4aa-437e-b09a-8e71685b6e15 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:45.770722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9fbfba03-f33f-4a7d-aa08-05185dcd83ad tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:45.788175 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9fbfba03-f33f-4a7d-aa08-05185dcd83ad tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1697 microversion: 2.1 time: 0.414480 Aug 02 07:10:45.788175 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2357/4786] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:45 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1697 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:45.798997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cba8bfe2-4c0d-47c4-a8d6-4e2f9bf2c965 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:45.801362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cba8bfe2-4c0d-47c4-a8d6-4e2f9bf2c965 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: df9cce51-3636-4177-ae1a-6439b8273ff0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:45.804872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f11d3adc-d4aa-437e-b09a-8e71685b6e15 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:45.814194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f11d3adc-d4aa-437e-b09a-8e71685b6e15 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:45.816030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f11d3adc-d4aa-437e-b09a-8e71685b6e15 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:45.816164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cba8bfe2-4c0d-47c4-a8d6-4e2f9bf2c965 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:45.816523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cba8bfe2-4c0d-47c4-a8d6-4e2f9bf2c965 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:45.817141 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f11d3adc-d4aa-437e-b09a-8e71685b6e15 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1405 microversion: 2.20 time: 0.398013 Aug 02 07:10:45.817481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cba8bfe2-4c0d-47c4-a8d6-4e2f9bf2c965 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:45.817932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cba8bfe2-4c0d-47c4-a8d6-4e2f9bf2c965 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:45.818605 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2430/4787] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:45 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:10:45.826924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e5e99c9d-53c5-4977-b930-aa6234f18cf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:45.827742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e5e99c9d-53c5-4977-b930-aa6234f18cf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:45.834529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5e99c9d-53c5-4977-b930-aa6234f18cf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:45.835167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5e99c9d-53c5-4977-b930-aa6234f18cf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:45.836096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5e99c9d-53c5-4977-b930-aa6234f18cf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:45.836869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5e99c9d-53c5-4977-b930-aa6234f18cf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:45.865322 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-cba8bfe2-4c0d-47c4-a8d6-4e2f9bf2c965 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] HTTP exception thrown: Instance df9cce51-3636-4177-ae1a-6439b8273ff0 could not be found. Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cba8bfe2-4c0d-47c4-a8d6-4e2f9bf2c965 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Request method failure captured: Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0 HTTP/1.1 Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M0-wu0JACzQQNT6Mptyldt5678YjABkJlZXeNIzY1M33BrtgO2cYBUEtgk65KYzpZxe70UKuOn6uRCaTFvzj5Q_FamIYOkbN2-AErjePEV__E9AezmP9WhpVsLx6MAyqlyx4EJyIR0qwrvZN87hi3QdVREpBQW3NLlb6HIVtVAUE2Y Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 5220c59e230140e382ba24d3ae86fcd1 Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-VolumesSnapshotTestJSON-826193195 Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5220c59e230140e382ba24d3ae86fcd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5220c59e230140e382ba24d3ae86fcd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5220c59e230140e382ba24d3ae86fcd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5220c59e230140e382ba24d3ae86fcd1"}]}] Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-VolumesSnapshotTestJSON-826193195 Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 5220c59e230140e382ba24d3ae86fcd1 Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-826193195 Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-VolumesSnapshotTestJSON-826193195-project Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 54d1bc2a5837436dae121d0c5574d1b9 Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-VolumesSnapshotTestJSON-826193195-project Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance df9cce51-3636-4177-ae1a-6439b8273ff0 could not be found. Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'df9cce51-3636-4177-ae1a-6439b8273ff0'} Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df9cce51-3636-4177-ae1a-6439b8273ff0 could not be found. Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df9cce51-3636-4177-ae1a-6439b8273ff0 could not be found. Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:10:45.869991 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:45.875228 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:10:45.875228 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:10:45.875228 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:10:45.875228 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:10:45.875228 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:10:45.875228 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df9cce51-3636-4177-ae1a-6439b8273ff0 could not be found. Aug 02 07:10:45.875228 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:10:45.875228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cba8bfe2-4c0d-47c4-a8d6-4e2f9bf2c965 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Returning 404 to user: Instance df9cce51-3636-4177-ae1a-6439b8273ff0 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:10:45.875228 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cba8bfe2-4c0d-47c4-a8d6-4e2f9bf2c965 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0" status: 404 len: 111 microversion: 2.1 time: 0.082224 Aug 02 07:10:45.875228 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2358/4788] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:45 2022] GET /compute/v2.1/servers/df9cce51-3636-4177-ae1a-6439b8273ff0 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:10:45.889976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cbb8c43a-a639-47ca-a44a-53553562667b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:45.893926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cbb8c43a-a639-47ca-a44a-53553562667b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:45.918694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbb8c43a-a639-47ca-a44a-53553562667b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:45.919333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbb8c43a-a639-47ca-a44a-53553562667b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:45.920152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbb8c43a-a639-47ca-a44a-53553562667b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:45.920586 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbb8c43a-a639-47ca-a44a-53553562667b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:46.088683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=16 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:46.144622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e5e99c9d-53c5-4977-b930-aa6234f18cf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:46.153261 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e5e99c9d-53c5-4977-b930-aa6234f18cf5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 0.333402 Aug 02 07:10:46.155920 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2431/4789] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:45 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:46.166646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f626df2-7521-4d71-acd7-c094ab42da79 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:46.173167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5f626df2-7521-4d71-acd7-c094ab42da79 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:46.188664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f626df2-7521-4d71-acd7-c094ab42da79 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:46.189383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f626df2-7521-4d71-acd7-c094ab42da79 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:46.190429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f626df2-7521-4d71-acd7-c094ab42da79 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:46.191037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f626df2-7521-4d71-acd7-c094ab42da79 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:46.208822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cbb8c43a-a639-47ca-a44a-53553562667b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:46.220677 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cbb8c43a-a639-47ca-a44a-53553562667b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.335653 Aug 02 07:10:46.222376 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2359/4790] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:45 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:46.349534 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5f626df2-7521-4d71-acd7-c094ab42da79 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.191367 Aug 02 07:10:46.350623 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2432/4791] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:10:46 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:10:46.360263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-338d7eb0-eef6-4b64-a6db-0336eba2f571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:46.360643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-338d7eb0-eef6-4b64-a6db-0336eba2f571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:46.363260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:46.371113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-338d7eb0-eef6-4b64-a6db-0336eba2f571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:46.372120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-338d7eb0-eef6-4b64-a6db-0336eba2f571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:46.373702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-338d7eb0-eef6-4b64-a6db-0336eba2f571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:46.374271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-338d7eb0-eef6-4b64-a6db-0336eba2f571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:46.391901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=12 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:46.606561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-338d7eb0-eef6-4b64-a6db-0336eba2f571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:46.615383 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-338d7eb0-eef6-4b64-a6db-0336eba2f571 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1671 microversion: 2.1 time: 0.260423 Aug 02 07:10:46.615991 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2360/4792] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:46 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1671 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:46.807203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:46.813222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e94fcdf8-10ab-413d-b640-d0098c82fbd5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:46.814268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e94fcdf8-10ab-413d-b640-d0098c82fbd5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:46.821641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e94fcdf8-10ab-413d-b640-d0098c82fbd5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:46.822419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e94fcdf8-10ab-413d-b640-d0098c82fbd5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:46.823442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e94fcdf8-10ab-413d-b640-d0098c82fbd5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:46.824321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e94fcdf8-10ab-413d-b640-d0098c82fbd5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:46.843459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f153a8e-41d6-4cc8-82d8-dbdf7548f4a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:46.844134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3f153a8e-41d6-4cc8-82d8-dbdf7548f4a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:46.857323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f153a8e-41d6-4cc8-82d8-dbdf7548f4a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:46.859816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f153a8e-41d6-4cc8-82d8-dbdf7548f4a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:46.861860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f153a8e-41d6-4cc8-82d8-dbdf7548f4a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:46.862819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f153a8e-41d6-4cc8-82d8-dbdf7548f4a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:47.075945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e94fcdf8-10ab-413d-b640-d0098c82fbd5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:47.098673 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e94fcdf8-10ab-413d-b640-d0098c82fbd5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1697 microversion: 2.1 time: 0.293337 Aug 02 07:10:47.108937 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2433/4793] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:46 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1697 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:47.135101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3f153a8e-41d6-4cc8-82d8-dbdf7548f4a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:47.145429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3f153a8e-41d6-4cc8-82d8-dbdf7548f4a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:47.146994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3f153a8e-41d6-4cc8-82d8-dbdf7548f4a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:47.148185 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3f153a8e-41d6-4cc8-82d8-dbdf7548f4a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1405 microversion: 2.20 time: 0.309170 Aug 02 07:10:47.155265 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2361/4794] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:46 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1405 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:10:47.183718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b6ad8d52-1a5b-4095-b8bd-2f0dab303696 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:47.185599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b6ad8d52-1a5b-4095-b8bd-2f0dab303696 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:47.192688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6ad8d52-1a5b-4095-b8bd-2f0dab303696 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:47.193750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6ad8d52-1a5b-4095-b8bd-2f0dab303696 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:47.194950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6ad8d52-1a5b-4095-b8bd-2f0dab303696 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:47.195694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6ad8d52-1a5b-4095-b8bd-2f0dab303696 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:47.249808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-470f18e8-f007-4822-a0d9-0b86cff23e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:47.250581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-470f18e8-f007-4822-a0d9-0b86cff23e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:47.258459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-470f18e8-f007-4822-a0d9-0b86cff23e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:47.259003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-470f18e8-f007-4822-a0d9-0b86cff23e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:47.260030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-470f18e8-f007-4822-a0d9-0b86cff23e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:47.260474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-470f18e8-f007-4822-a0d9-0b86cff23e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:47.393844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b6ad8d52-1a5b-4095-b8bd-2f0dab303696 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:47.419656 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b6ad8d52-1a5b-4095-b8bd-2f0dab303696 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 0.243036 Aug 02 07:10:47.434277 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2434/4795] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:47 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:47.485489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-470f18e8-f007-4822-a0d9-0b86cff23e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:47.494258 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-470f18e8-f007-4822-a0d9-0b86cff23e33 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.252927 Aug 02 07:10:47.494896 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2362/4796] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:47 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:47.642637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6bd81c9d-b060-47ff-af74-aef91cebdf03 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:47.643470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6bd81c9d-b060-47ff-af74-aef91cebdf03 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:47.650146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bd81c9d-b060-47ff-af74-aef91cebdf03 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:47.650668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bd81c9d-b060-47ff-af74-aef91cebdf03 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:47.651500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bd81c9d-b060-47ff-af74-aef91cebdf03 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:47.652015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bd81c9d-b060-47ff-af74-aef91cebdf03 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:47.860907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6bd81c9d-b060-47ff-af74-aef91cebdf03 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:47.879116 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6bd81c9d-b060-47ff-af74-aef91cebdf03 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1676 microversion: 2.1 time: 0.240080 Aug 02 07:10:47.881148 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2435/4797] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:47 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:48.120521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bcbbc93d-da99-4451-b357-68b1ffc0da99 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:48.121153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bcbbc93d-da99-4451-b357-68b1ffc0da99 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:48.131460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcbbc93d-da99-4451-b357-68b1ffc0da99 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:48.131919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcbbc93d-da99-4451-b357-68b1ffc0da99 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:48.132717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcbbc93d-da99-4451-b357-68b1ffc0da99 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:48.133152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcbbc93d-da99-4451-b357-68b1ffc0da99 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:48.178149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-04a7a61a-df88-4c56-afac-1c9b7bda9e50 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:48.178857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-04a7a61a-df88-4c56-afac-1c9b7bda9e50 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:48.190878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04a7a61a-df88-4c56-afac-1c9b7bda9e50 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:48.191658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04a7a61a-df88-4c56-afac-1c9b7bda9e50 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:48.192474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04a7a61a-df88-4c56-afac-1c9b7bda9e50 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:48.193218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04a7a61a-df88-4c56-afac-1c9b7bda9e50 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:48.494886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bcbbc93d-da99-4451-b357-68b1ffc0da99 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:48.499089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:48.510697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-04a7a61a-df88-4c56-afac-1c9b7bda9e50 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:48.518785 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bcbbc93d-da99-4451-b357-68b1ffc0da99 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1697 microversion: 2.1 time: 0.402106 Aug 02 07:10:48.520174 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2363/4798] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:48 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1697 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:48.523463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-04a7a61a-df88-4c56-afac-1c9b7bda9e50 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:48.525426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-04a7a61a-df88-4c56-afac-1c9b7bda9e50 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:48.527074 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-04a7a61a-df88-4c56-afac-1c9b7bda9e50 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1405 microversion: 2.20 time: 0.353240 Aug 02 07:10:48.528259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b6b520d9-9893-41e5-a45c-e1491aae0eff tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:48.529092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b6b520d9-9893-41e5-a45c-e1491aae0eff tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:48.533828 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2436/4799] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:48 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1405 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:10:48.536260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6b520d9-9893-41e5-a45c-e1491aae0eff tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:48.536884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6b520d9-9893-41e5-a45c-e1491aae0eff tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:48.537998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6b520d9-9893-41e5-a45c-e1491aae0eff tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:48.538599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b6b520d9-9893-41e5-a45c-e1491aae0eff tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:48.541264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a711048e-6899-475f-81f0-2ba7081501a6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:48.542173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a711048e-6899-475f-81f0-2ba7081501a6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:48.568445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a711048e-6899-475f-81f0-2ba7081501a6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:48.573283 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a711048e-6899-475f-81f0-2ba7081501a6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:48.574975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a711048e-6899-475f-81f0-2ba7081501a6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:48.575527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a711048e-6899-475f-81f0-2ba7081501a6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:48.791171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b6b520d9-9893-41e5-a45c-e1491aae0eff tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:48.802548 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b6b520d9-9893-41e5-a45c-e1491aae0eff tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 0.278371 Aug 02 07:10:48.803714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a711048e-6899-475f-81f0-2ba7081501a6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:48.804392 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2364/4800] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:48 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:48.812803 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a711048e-6899-475f-81f0-2ba7081501a6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.277623 Aug 02 07:10:48.813399 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2437/4801] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:48 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:48.900932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d22e177-f038-4227-8f3e-5f75bacff467 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:48.901647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5d22e177-f038-4227-8f3e-5f75bacff467 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:48.909879 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d22e177-f038-4227-8f3e-5f75bacff467 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:48.910676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d22e177-f038-4227-8f3e-5f75bacff467 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:48.911754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d22e177-f038-4227-8f3e-5f75bacff467 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:48.912283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d22e177-f038-4227-8f3e-5f75bacff467 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:49.060692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5d22e177-f038-4227-8f3e-5f75bacff467 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:49.070121 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5d22e177-f038-4227-8f3e-5f75bacff467 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.172755 Aug 02 07:10:49.082269 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2365/4802] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:48 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:49.541698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f3cc7b7c-5afa-424b-9898-995e8609e528 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:49.543373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f3cc7b7c-5afa-424b-9898-995e8609e528 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:49.552598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e254145f-34eb-44ab-9366-d3861c42ed42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:49.554293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e254145f-34eb-44ab-9366-d3861c42ed42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:49.569321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3cc7b7c-5afa-424b-9898-995e8609e528 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:49.572889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3cc7b7c-5afa-424b-9898-995e8609e528 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:49.573792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e254145f-34eb-44ab-9366-d3861c42ed42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:49.574759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e254145f-34eb-44ab-9366-d3861c42ed42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:49.575465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3cc7b7c-5afa-424b-9898-995e8609e528 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:49.576823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3cc7b7c-5afa-424b-9898-995e8609e528 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:49.577574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e254145f-34eb-44ab-9366-d3861c42ed42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:49.579004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e254145f-34eb-44ab-9366-d3861c42ed42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:49.923085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f3cc7b7c-5afa-424b-9898-995e8609e528 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:49.940463 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f3cc7b7c-5afa-424b-9898-995e8609e528 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1697 microversion: 2.1 time: 0.403798 Aug 02 07:10:49.941861 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2438/4803] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:49 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1697 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:49.948865 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fa069e9c-af6a-4d14-98ff-40b0393dc19a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:49.950070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fa069e9c-af6a-4d14-98ff-40b0393dc19a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:49.959368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa069e9c-af6a-4d14-98ff-40b0393dc19a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:49.978736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa069e9c-af6a-4d14-98ff-40b0393dc19a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:49.979927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa069e9c-af6a-4d14-98ff-40b0393dc19a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:49.981516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa069e9c-af6a-4d14-98ff-40b0393dc19a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:50.104770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e254145f-34eb-44ab-9366-d3861c42ed42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:50.125773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e254145f-34eb-44ab-9366-d3861c42ed42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:50.133678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e254145f-34eb-44ab-9366-d3861c42ed42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:50.133678 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e254145f-34eb-44ab-9366-d3861c42ed42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1405 microversion: 2.20 time: 0.582753 Aug 02 07:10:50.142440 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2366/4804] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:49 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1405 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:10:50.150154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-80e0e208-9479-405f-86df-f4e97dbe0e6a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:50.150793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-80e0e208-9479-405f-86df-f4e97dbe0e6a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:50.161672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-80e0e208-9479-405f-86df-f4e97dbe0e6a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:50.162163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-80e0e208-9479-405f-86df-f4e97dbe0e6a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:50.169440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-80e0e208-9479-405f-86df-f4e97dbe0e6a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:50.170044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-80e0e208-9479-405f-86df-f4e97dbe0e6a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:50.434725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fa069e9c-af6a-4d14-98ff-40b0393dc19a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:50.443508 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fa069e9c-af6a-4d14-98ff-40b0393dc19a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 0.500191 Aug 02 07:10:50.444381 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2439/4805] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:49 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:50.464478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-0e800b6d-5975-4a1d-9c6b-bb25e093d976 req-cba382d9-ae6d-4b2c-9222-c457b64ab6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8979e165-921d-4e06-92fc-dba834a53b1b", "name": "network-vif-plugged", "status": "completed", "tag": "768fa789-2440-4838-8853-20f834aabcea"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:50.474586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0e800b6d-5975-4a1d-9c6b-bb25e093d976 req-cba382d9-ae6d-4b2c-9222-c457b64ab6f3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:50.475224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0e800b6d-5975-4a1d-9c6b-bb25e093d976 req-cba382d9-ae6d-4b2c-9222-c457b64ab6f3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:50.532986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-80e0e208-9479-405f-86df-f4e97dbe0e6a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:50.541983 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-80e0e208-9479-405f-86df-f4e97dbe0e6a tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.398245 Aug 02 07:10:50.543187 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2367/4806] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:50 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:50.789963 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-0e800b6d-5975-4a1d-9c6b-bb25e093d976 req-cba382d9-ae6d-4b2c-9222-c457b64ab6f3 service nova] Creating event network-vif-plugged:768fa789-2440-4838-8853-20f834aabcea for instance 8979e165-921d-4e06-92fc-dba834a53b1b on n-h1-851337-3 Aug 02 07:10:50.795976 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-0e800b6d-5975-4a1d-9c6b-bb25e093d976 req-cba382d9-ae6d-4b2c-9222-c457b64ab6f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.350258 Aug 02 07:10:50.797086 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2440/4807] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:50.971097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bdfcd14f-ffe1-4bc0-bba7-bc6b4732dad8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:50.973043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bdfcd14f-ffe1-4bc0-bba7-bc6b4732dad8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:50.982773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bdfcd14f-ffe1-4bc0-bba7-bc6b4732dad8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:50.983532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bdfcd14f-ffe1-4bc0-bba7-bc6b4732dad8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:50.984785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bdfcd14f-ffe1-4bc0-bba7-bc6b4732dad8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:50.985420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bdfcd14f-ffe1-4bc0-bba7-bc6b4732dad8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:51.158652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-804065a5-8629-47d9-8f1e-a6edbb1bd4ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:51.159619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-804065a5-8629-47d9-8f1e-a6edbb1bd4ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:51.171136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-804065a5-8629-47d9-8f1e-a6edbb1bd4ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:51.171900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-804065a5-8629-47d9-8f1e-a6edbb1bd4ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:51.172977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-804065a5-8629-47d9-8f1e-a6edbb1bd4ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:51.173965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-804065a5-8629-47d9-8f1e-a6edbb1bd4ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:51.276274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bdfcd14f-ffe1-4bc0-bba7-bc6b4732dad8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:51.286288 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bdfcd14f-ffe1-4bc0-bba7-bc6b4732dad8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1697 microversion: 2.1 time: 0.326758 Aug 02 07:10:51.295303 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2368/4808] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:50 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1697 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:51.452627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-804065a5-8629-47d9-8f1e-a6edbb1bd4ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:51.467585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-059ef7bc-b87c-49d3-8231-304b008602be tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:51.468107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-059ef7bc-b87c-49d3-8231-304b008602be tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:51.470013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-804065a5-8629-47d9-8f1e-a6edbb1bd4ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:51.473662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-804065a5-8629-47d9-8f1e-a6edbb1bd4ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:51.476459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-059ef7bc-b87c-49d3-8231-304b008602be tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:51.477700 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-804065a5-8629-47d9-8f1e-a6edbb1bd4ae tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1405 microversion: 2.20 time: 0.322954 Aug 02 07:10:51.479434 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2441/4809] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:51 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1405 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:10:51.479585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-059ef7bc-b87c-49d3-8231-304b008602be tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:51.480423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-059ef7bc-b87c-49d3-8231-304b008602be tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:51.480858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-059ef7bc-b87c-49d3-8231-304b008602be tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:51.563268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab158f01-cfa3-4e0f-80f0-732bbfd761d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:51.564699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab158f01-cfa3-4e0f-80f0-732bbfd761d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:51.576517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab158f01-cfa3-4e0f-80f0-732bbfd761d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:51.576976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab158f01-cfa3-4e0f-80f0-732bbfd761d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:51.578392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab158f01-cfa3-4e0f-80f0-732bbfd761d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:51.578833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab158f01-cfa3-4e0f-80f0-732bbfd761d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:51.864729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-059ef7bc-b87c-49d3-8231-304b008602be tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:51.873809 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-059ef7bc-b87c-49d3-8231-304b008602be tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 0.410512 Aug 02 07:10:51.887307 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2369/4810] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:51 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:51.912911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab158f01-cfa3-4e0f-80f0-732bbfd761d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:51.923416 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab158f01-cfa3-4e0f-80f0-732bbfd761d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.363865 Aug 02 07:10:51.937352 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2442/4811] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:51 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:52.312819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-02aa2804-e190-4cba-a703-488300ed9591 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:52.313334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-02aa2804-e190-4cba-a703-488300ed9591 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:52.325764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02aa2804-e190-4cba-a703-488300ed9591 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:52.326542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02aa2804-e190-4cba-a703-488300ed9591 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:52.327578 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02aa2804-e190-4cba-a703-488300ed9591 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:52.328192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02aa2804-e190-4cba-a703-488300ed9591 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:52.500973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8fc8359f-9fbe-4201-b03e-b9f0e2ac2eb6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:52.501591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8fc8359f-9fbe-4201-b03e-b9f0e2ac2eb6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:52.514717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fc8359f-9fbe-4201-b03e-b9f0e2ac2eb6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:52.518304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fc8359f-9fbe-4201-b03e-b9f0e2ac2eb6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:52.519353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fc8359f-9fbe-4201-b03e-b9f0e2ac2eb6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:52.519961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8fc8359f-9fbe-4201-b03e-b9f0e2ac2eb6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:52.825453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-02aa2804-e190-4cba-a703-488300ed9591 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:52.834169 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-02aa2804-e190-4cba-a703-488300ed9591 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1697 microversion: 2.1 time: 0.525707 Aug 02 07:10:52.834765 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2370/4812] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:52 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1697 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:52.899131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c4fd9b22-ccac-4925-8a7a-3da32d1ad490 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:52.899363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8fc8359f-9fbe-4201-b03e-b9f0e2ac2eb6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:52.900238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c4fd9b22-ccac-4925-8a7a-3da32d1ad490 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:52.906292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:52.912023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4fd9b22-ccac-4925-8a7a-3da32d1ad490 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:52.915873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4fd9b22-ccac-4925-8a7a-3da32d1ad490 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:52.917114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4fd9b22-ccac-4925-8a7a-3da32d1ad490 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:52.921374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4fd9b22-ccac-4925-8a7a-3da32d1ad490 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:52.925006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8fc8359f-9fbe-4201-b03e-b9f0e2ac2eb6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:52.932918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8fc8359f-9fbe-4201-b03e-b9f0e2ac2eb6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:52.937113 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8fc8359f-9fbe-4201-b03e-b9f0e2ac2eb6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1405 microversion: 2.20 time: 0.438574 Aug 02 07:10:52.957620 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2443/4813] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:52 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:10:52.967882 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-794ede47-5cf3-4ccd-b271-6e263c55b736 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:52.968782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-794ede47-5cf3-4ccd-b271-6e263c55b736 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:52.986838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-794ede47-5cf3-4ccd-b271-6e263c55b736 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:52.987297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-794ede47-5cf3-4ccd-b271-6e263c55b736 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:52.988613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-794ede47-5cf3-4ccd-b271-6e263c55b736 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:52.989472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-794ede47-5cf3-4ccd-b271-6e263c55b736 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:53.606912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-794ede47-5cf3-4ccd-b271-6e263c55b736 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:53.614545 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-794ede47-5cf3-4ccd-b271-6e263c55b736 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.655246 Aug 02 07:10:53.615315 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2444/4814] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:52 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:53.624191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1031027981", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "43221104-4b88-4bfc-b42e-9ed37fe0b67d"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:53.639261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c4fd9b22-ccac-4925-8a7a-3da32d1ad490 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:53.651144 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c4fd9b22-ccac-4925-8a7a-3da32d1ad490 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 0.757012 Aug 02 07:10:53.661959 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2371/4815] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:52 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:53.710326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] validate_networks() for [('43221104-4b88-4bfc-b42e-9ed37fe0b67d', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:10:53.862615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-de590953-4ce0-4ec5-a1eb-c1345e51842f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:53.863348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-de590953-4ce0-4ec5-a1eb-c1345e51842f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:53.875393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de590953-4ce0-4ec5-a1eb-c1345e51842f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:53.877050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de590953-4ce0-4ec5-a1eb-c1345e51842f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:53.878835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de590953-4ce0-4ec5-a1eb-c1345e51842f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:53.879557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de590953-4ce0-4ec5-a1eb-c1345e51842f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:54.237595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-de590953-4ce0-4ec5-a1eb-c1345e51842f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:54.250696 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-de590953-4ce0-4ec5-a1eb-c1345e51842f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1697 microversion: 2.1 time: 0.393296 Aug 02 07:10:54.271268 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2372/4816] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:53 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1697 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:54.277485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bbba0d6a-3d72-4c5b-9dd9-0c8e2e24450a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:54.279176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bbba0d6a-3d72-4c5b-9dd9-0c8e2e24450a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:54.285602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbba0d6a-3d72-4c5b-9dd9-0c8e2e24450a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:54.286104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbba0d6a-3d72-4c5b-9dd9-0c8e2e24450a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:54.287283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbba0d6a-3d72-4c5b-9dd9-0c8e2e24450a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:54.288304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bbba0d6a-3d72-4c5b-9dd9-0c8e2e24450a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:54.411739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-bbba0d6a-3d72-4c5b-9dd9-0c8e2e24450a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lazy-loading 'services' on Instance uuid 65f2010c-11ee-485b-b841-11e8b795aeb8 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:10:54.537628 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bbba0d6a-3d72-4c5b-9dd9-0c8e2e24450a tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments/29ecad49-aa77-42c0-a46c-7cbc402fa5a2" status: 202 len: 0 microversion: 2.1 time: 0.264641 Aug 02 07:10:54.542338 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2373/4817] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:10:54 2022] DELETE /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments/29ecad49-aa77-42c0-a46c-7cbc402fa5a2 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:10:54.554684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-eddd635f-ee16-4101-ba11-e7ededd6496a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:54.556062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-eddd635f-ee16-4101-ba11-e7ededd6496a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:54.573333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eddd635f-ee16-4101-ba11-e7ededd6496a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:54.577276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eddd635f-ee16-4101-ba11-e7ededd6496a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:54.578318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eddd635f-ee16-4101-ba11-e7ededd6496a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:54.578911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eddd635f-ee16-4101-ba11-e7ededd6496a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:54.635471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:10:54.636008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:10:54.636595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:10:54.637012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:10:54.637471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:10:54.656063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:54.656513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:54.657315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:54.657746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:54.689272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Getting quotas for project 5220c59e230140e382ba24d3ae86fcd1. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:10:54.701835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Getting quotas for user 54d1bc2a5837436dae121d0c5574d1b9 and project 5220c59e230140e382ba24d3ae86fcd1. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:10:54.722683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:10:54.733940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:10:54.829797 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7f96ec44-1bd2-4e96-9d2a-831eddfcd8e5 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.211408 Aug 02 07:10:54.831740 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2445/4818] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:10:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:10:54.852448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1e062681-5f81-4d35-93ee-05caba9de5fc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:54.858124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1e062681-5f81-4d35-93ee-05caba9de5fc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:54.865545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e062681-5f81-4d35-93ee-05caba9de5fc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:54.866193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e062681-5f81-4d35-93ee-05caba9de5fc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:54.867423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e062681-5f81-4d35-93ee-05caba9de5fc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:54.868683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e062681-5f81-4d35-93ee-05caba9de5fc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:54.871249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-eddd635f-ee16-4101-ba11-e7ededd6496a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:54.880105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-eddd635f-ee16-4101-ba11-e7ededd6496a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:54.881621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-eddd635f-ee16-4101-ba11-e7ededd6496a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:54.900434 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-eddd635f-ee16-4101-ba11-e7ededd6496a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1596 microversion: 2.20 time: 0.355647 Aug 02 07:10:54.903608 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2374/4819] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:10:54 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1596 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:10:54.912267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9d3455d6-4d1e-42ab-a637-27326993acc7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:54.912893 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9d3455d6-4d1e-42ab-a637-27326993acc7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:54.933291 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d3455d6-4d1e-42ab-a637-27326993acc7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:54.933742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d3455d6-4d1e-42ab-a637-27326993acc7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:54.934605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d3455d6-4d1e-42ab-a637-27326993acc7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:54.935045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d3455d6-4d1e-42ab-a637-27326993acc7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:54.937153 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1e062681-5f81-4d35-93ee-05caba9de5fc tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095230 Aug 02 07:10:54.938157 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2446/4820] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:10:54 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:54.944563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1b47a124-733a-4c4c-97bc-b4f6919bebc3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:54.945461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1b47a124-733a-4c4c-97bc-b4f6919bebc3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:54.955341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b47a124-733a-4c4c-97bc-b4f6919bebc3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:54.956034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b47a124-733a-4c4c-97bc-b4f6919bebc3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:54.957005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b47a124-733a-4c4c-97bc-b4f6919bebc3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:54.957863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b47a124-733a-4c4c-97bc-b4f6919bebc3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:55.299744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1b47a124-733a-4c4c-97bc-b4f6919bebc3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:55.315678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9d3455d6-4d1e-42ab-a637-27326993acc7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:55.316631 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1b47a124-733a-4c4c-97bc-b4f6919bebc3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 0.375941 Aug 02 07:10:55.317865 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2447/4821] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:54 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:55.325690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cd27da62-987d-486c-b731-17ac4776b623 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:55.327212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cd27da62-987d-486c-b731-17ac4776b623 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:55.330453 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9d3455d6-4d1e-42ab-a637-27326993acc7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.425485 Aug 02 07:10:55.333060 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2375/4822] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:54 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:55.335482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:55.339544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-323e4532-6ae3-4348-a43a-2c1baeae5b7c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:55.340454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-323e4532-6ae3-4348-a43a-2c1baeae5b7c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:55.352810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-323e4532-6ae3-4348-a43a-2c1baeae5b7c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:55.353651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-323e4532-6ae3-4348-a43a-2c1baeae5b7c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:55.363545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-323e4532-6ae3-4348-a43a-2c1baeae5b7c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:55.364693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-323e4532-6ae3-4348-a43a-2c1baeae5b7c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:55.532099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cd27da62-987d-486c-b731-17ac4776b623 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:55.544116 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cd27da62-987d-486c-b731-17ac4776b623 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1219 microversion: 2.1 time: 0.224491 Aug 02 07:10:55.544758 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2448/4823] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:55 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1219 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:55.555505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-724c81f4-b77f-487f-9955-6d0d1d2386a6 req-6869ace5-2fa4-4dd5-be8f-26e5afbe0768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a5964c-4da3-4792-9d53-9c7a77632724", "name": "network-vif-unplugged", "status": "completed", "tag": "a4d951c8-7fd6-4964-b8d1-fffe96300cc7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:55.580606 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-323e4532-6ae3-4348-a43a-2c1baeae5b7c tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.246213 Aug 02 07:10:55.581236 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2376/4824] 10.222.0.79 () {60 vars in 1316 bytes} [Tue Aug 2 07:10:55 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b/os-interface => generated 284 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:10:55.586369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5bf183f6-b299-48e7-863f-adfa5a638dc5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:55.587465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5bf183f6-b299-48e7-863f-adfa5a638dc5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:55.594253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-724c81f4-b77f-487f-9955-6d0d1d2386a6 req-6869ace5-2fa4-4dd5-be8f-26e5afbe0768 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:55.594825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-724c81f4-b77f-487f-9955-6d0d1d2386a6 req-6869ace5-2fa4-4dd5-be8f-26e5afbe0768 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:55.595313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5bf183f6-b299-48e7-863f-adfa5a638dc5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:55.595987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5bf183f6-b299-48e7-863f-adfa5a638dc5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:55.597019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5bf183f6-b299-48e7-863f-adfa5a638dc5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:55.597619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5bf183f6-b299-48e7-863f-adfa5a638dc5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:55.639122 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-724c81f4-b77f-487f-9955-6d0d1d2386a6 req-6869ace5-2fa4-4dd5-be8f-26e5afbe0768 service nova] Creating event network-vif-unplugged:a4d951c8-7fd6-4964-b8d1-fffe96300cc7 for instance e9a5964c-4da3-4792-9d53-9c7a77632724 on n-h1-851337-3 Aug 02 07:10:55.654489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-724c81f4-b77f-487f-9955-6d0d1d2386a6 req-6869ace5-2fa4-4dd5-be8f-26e5afbe0768 service nova] Instance e9a5964c-4da3-4792-9d53-9c7a77632724 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:10:55.669924 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-724c81f4-b77f-487f-9955-6d0d1d2386a6 req-6869ace5-2fa4-4dd5-be8f-26e5afbe0768 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123846 Aug 02 07:10:55.671209 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2449/4825] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:55.951248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b6ba95b6-1403-4ecd-9ade-4b4976931bc9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:55.954017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b6ba95b6-1403-4ecd-9ade-4b4976931bc9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:55.962846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6ba95b6-1403-4ecd-9ade-4b4976931bc9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:55.963652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6ba95b6-1403-4ecd-9ade-4b4976931bc9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:55.964950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6ba95b6-1403-4ecd-9ade-4b4976931bc9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:55.965627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6ba95b6-1403-4ecd-9ade-4b4976931bc9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:55.998601 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b6ba95b6-1403-4ecd-9ade-4b4976931bc9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052088 Aug 02 07:10:55.999342 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2450/4826] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:10:55 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:56.057030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5bf183f6-b299-48e7-863f-adfa5a638dc5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:56.064917 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5bf183f6-b299-48e7-863f-adfa5a638dc5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1696 microversion: 2.1 time: 0.482317 Aug 02 07:10:56.066218 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2377/4827] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:55 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1696 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:56.338818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2d5feb8c-ad89-4c25-ad20-2cc2e91e586d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:56.339430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2d5feb8c-ad89-4c25-ad20-2cc2e91e586d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:56.347153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d5feb8c-ad89-4c25-ad20-2cc2e91e586d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:56.347603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d5feb8c-ad89-4c25-ad20-2cc2e91e586d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:56.348390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d5feb8c-ad89-4c25-ad20-2cc2e91e586d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:56.348845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d5feb8c-ad89-4c25-ad20-2cc2e91e586d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:56.357835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8238cfad-c0a9-4117-8d67-b3a4e14fa7f6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:56.359662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8238cfad-c0a9-4117-8d67-b3a4e14fa7f6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:56.373830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8238cfad-c0a9-4117-8d67-b3a4e14fa7f6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:56.376623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8238cfad-c0a9-4117-8d67-b3a4e14fa7f6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:56.378852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8238cfad-c0a9-4117-8d67-b3a4e14fa7f6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:56.391671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8238cfad-c0a9-4117-8d67-b3a4e14fa7f6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:57.356055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8238cfad-c0a9-4117-8d67-b3a4e14fa7f6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:57.365747 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8238cfad-c0a9-4117-8d67-b3a4e14fa7f6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 1.014928 Aug 02 07:10:57.378636 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2378/4828] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:56 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:57.387201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5db73063-c50f-4f30-a4e9-4fd713b5d3d3 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:57.388808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5db73063-c50f-4f30-a4e9-4fd713b5d3d3 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:57.399448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2d5feb8c-ad89-4c25-ad20-2cc2e91e586d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:57.408455 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2d5feb8c-ad89-4c25-ad20-2cc2e91e586d tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1521 microversion: 2.1 time: 1.073573 Aug 02 07:10:57.412826 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2451/4829] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:56 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1521 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:57.427645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5db73063-c50f-4f30-a4e9-4fd713b5d3d3 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:57.429912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5db73063-c50f-4f30-a4e9-4fd713b5d3d3 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:57.434512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5db73063-c50f-4f30-a4e9-4fd713b5d3d3 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:57.435129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5db73063-c50f-4f30-a4e9-4fd713b5d3d3 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:57.439507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e769af8-79fb-4ca9-a22f-382d2fc85d18 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:57.444469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7e769af8-79fb-4ca9-a22f-382d2fc85d18 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:57.460797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e769af8-79fb-4ca9-a22f-382d2fc85d18 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:57.461612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e769af8-79fb-4ca9-a22f-382d2fc85d18 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:57.462619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e769af8-79fb-4ca9-a22f-382d2fc85d18 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:57.464481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e769af8-79fb-4ca9-a22f-382d2fc85d18 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:57.521996 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7e769af8-79fb-4ca9-a22f-382d2fc85d18 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092800 Aug 02 07:10:57.522814 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2452/4830] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:10:57 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:57.527826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-166765d6-e0ba-494b-81f2-c443104f5e7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:57.528639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-166765d6-e0ba-494b-81f2-c443104f5e7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:57.535250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-166765d6-e0ba-494b-81f2-c443104f5e7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:57.535965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-166765d6-e0ba-494b-81f2-c443104f5e7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:57.536930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-166765d6-e0ba-494b-81f2-c443104f5e7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:57.537530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-166765d6-e0ba-494b-81f2-c443104f5e7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:57.859037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-166765d6-e0ba-494b-81f2-c443104f5e7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:57.864210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5db73063-c50f-4f30-a4e9-4fd713b5d3d3 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:57.888511 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5db73063-c50f-4f30-a4e9-4fd713b5d3d3 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1319 microversion: 2.1 time: 0.508271 Aug 02 07:10:57.901917 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-166765d6-e0ba-494b-81f2-c443104f5e7c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1694 microversion: 2.1 time: 0.352417 Aug 02 07:10:57.901917 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2453/4831] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:57 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1694 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:57.902267 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2379/4832] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:57 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:57.908018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-797bce45-ba36-496b-893b-8140893e393b req-ce04c6bb-a533-4119-bd04-8875c0484224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a5964c-4da3-4792-9d53-9c7a77632724", "tag": "a4d951c8-7fd6-4964-b8d1-fffe96300cc7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:57.924831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-797bce45-ba36-496b-893b-8140893e393b req-ce04c6bb-a533-4119-bd04-8875c0484224 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:57.924831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-797bce45-ba36-496b-893b-8140893e393b req-ce04c6bb-a533-4119-bd04-8875c0484224 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:57.952827 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-797bce45-ba36-496b-893b-8140893e393b req-ce04c6bb-a533-4119-bd04-8875c0484224 service nova] Creating event network-changed:a4d951c8-7fd6-4964-b8d1-fffe96300cc7 for instance e9a5964c-4da3-4792-9d53-9c7a77632724 on n-h1-851337-3 Aug 02 07:10:57.959376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-797bce45-ba36-496b-893b-8140893e393b req-ce04c6bb-a533-4119-bd04-8875c0484224 service nova] Instance e9a5964c-4da3-4792-9d53-9c7a77632724 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:10:57.973445 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-797bce45-ba36-496b-893b-8140893e393b req-ce04c6bb-a533-4119-bd04-8875c0484224 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081928 Aug 02 07:10:57.974602 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2454/4833] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:58.306648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-dddc223b-8b70-4455-8528-911d5eb71438 req-e5788cc7-8961-4e3e-af3c-ff20d9ba6515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8979e165-921d-4e06-92fc-dba834a53b1b", "tag": "768fa789-2440-4838-8853-20f834aabcea"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:58.321524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-dddc223b-8b70-4455-8528-911d5eb71438 req-e5788cc7-8961-4e3e-af3c-ff20d9ba6515 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:58.322448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-dddc223b-8b70-4455-8528-911d5eb71438 req-e5788cc7-8961-4e3e-af3c-ff20d9ba6515 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:58.333925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:10:58.359239 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-dddc223b-8b70-4455-8528-911d5eb71438 req-e5788cc7-8961-4e3e-af3c-ff20d9ba6515 service nova] Creating event network-changed:768fa789-2440-4838-8853-20f834aabcea for instance 8979e165-921d-4e06-92fc-dba834a53b1b on n-h1-851337-3 Aug 02 07:10:58.374739 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-dddc223b-8b70-4455-8528-911d5eb71438 req-e5788cc7-8961-4e3e-af3c-ff20d9ba6515 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071711 Aug 02 07:10:58.376052 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2380/4834] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:58.396766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-68a988d2-3ad2-4622-8adc-8547fd1d3fd5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:58.397567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-68a988d2-3ad2-4622-8adc-8547fd1d3fd5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:58.415142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68a988d2-3ad2-4622-8adc-8547fd1d3fd5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:58.415941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68a988d2-3ad2-4622-8adc-8547fd1d3fd5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:58.417484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68a988d2-3ad2-4622-8adc-8547fd1d3fd5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:58.417963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68a988d2-3ad2-4622-8adc-8547fd1d3fd5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:58.438937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b20cbe4e-6d78-418f-8c19-45d5f4e5aa12 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:58.439673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b20cbe4e-6d78-418f-8c19-45d5f4e5aa12 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:58.468393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b20cbe4e-6d78-418f-8c19-45d5f4e5aa12 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:58.470813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b20cbe4e-6d78-418f-8c19-45d5f4e5aa12 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:58.472804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b20cbe4e-6d78-418f-8c19-45d5f4e5aa12 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:58.473567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b20cbe4e-6d78-418f-8c19-45d5f4e5aa12 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:58.916812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b20cbe4e-6d78-418f-8c19-45d5f4e5aa12 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:58.933369 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b20cbe4e-6d78-418f-8c19-45d5f4e5aa12 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1498 microversion: 2.1 time: 0.500958 Aug 02 07:10:58.950448 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2381/4835] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:58 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1498 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:58.956728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-01e1f4f4-2cf9-4ce3-a548-0cef99c7fb98 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:58.959584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-01e1f4f4-2cf9-4ce3-a548-0cef99c7fb98 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:58.967436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01e1f4f4-2cf9-4ce3-a548-0cef99c7fb98 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:58.968198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01e1f4f4-2cf9-4ce3-a548-0cef99c7fb98 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:58.969219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01e1f4f4-2cf9-4ce3-a548-0cef99c7fb98 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:58.969877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01e1f4f4-2cf9-4ce3-a548-0cef99c7fb98 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:58.995007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-68a988d2-3ad2-4622-8adc-8547fd1d3fd5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:59.006082 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-68a988d2-3ad2-4622-8adc-8547fd1d3fd5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.618647 Aug 02 07:10:59.011841 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2455/4836] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:58 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:10:59.030462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c17fd794-8612-4352-89c1-8ac6011eb586 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:59.032439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c17fd794-8612-4352-89c1-8ac6011eb586 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:59.039716 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-01e1f4f4-2cf9-4ce3-a548-0cef99c7fb98 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087574 Aug 02 07:10:59.045802 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2382/4837] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:10:58 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:59.048315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c17fd794-8612-4352-89c1-8ac6011eb586 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:59.050520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c17fd794-8612-4352-89c1-8ac6011eb586 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:59.051634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c17fd794-8612-4352-89c1-8ac6011eb586 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:59.054244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8a2d8535-b1e4-420a-9b67-202fe2d32238 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:59.055273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c17fd794-8612-4352-89c1-8ac6011eb586 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:59.058784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8a2d8535-b1e4-420a-9b67-202fe2d32238 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:59.073041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a2d8535-b1e4-420a-9b67-202fe2d32238 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:59.074525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a2d8535-b1e4-420a-9b67-202fe2d32238 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:59.078765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a2d8535-b1e4-420a-9b67-202fe2d32238 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:59.079625 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a2d8535-b1e4-420a-9b67-202fe2d32238 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:59.519943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8a2d8535-b1e4-420a-9b67-202fe2d32238 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:59.531624 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8a2d8535-b1e4-420a-9b67-202fe2d32238 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1319 microversion: 2.1 time: 0.484346 Aug 02 07:10:59.533967 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2383/4838] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:59 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:59.548618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6c684612-f464-4a0a-82a4-2f8418859b23 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:59.554466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6c684612-f464-4a0a-82a4-2f8418859b23 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:59.560533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6c684612-f464-4a0a-82a4-2f8418859b23 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:10:59.569131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c17fd794-8612-4352-89c1-8ac6011eb586 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:10:59.584720 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c17fd794-8612-4352-89c1-8ac6011eb586 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1694 microversion: 2.1 time: 0.553818 Aug 02 07:10:59.587852 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2456/4839] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:59 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1694 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:10:59.589392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c684612-f464-4a0a-82a4-2f8418859b23 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:59.590117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c684612-f464-4a0a-82a4-2f8418859b23 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:59.591459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c684612-f464-4a0a-82a4-2f8418859b23 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:59.592131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c684612-f464-4a0a-82a4-2f8418859b23 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:59.627876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-6c684612-f464-4a0a-82a4-2f8418859b23 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:10:59.682393 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6c684612-f464-4a0a-82a4-2f8418859b23 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.146981 Aug 02 07:10:59.683737 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2384/4840] 10.222.0.79 () {58 vars in 1154 bytes} [Tue Aug 2 07:10:59 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:10:59.695335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3b51422c-5b5e-4650-964e-ad627bf64934 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:10:59.703012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b51422c-5b5e-4650-964e-ad627bf64934 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:59.703689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b51422c-5b5e-4650-964e-ad627bf64934 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:59.747182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3b51422c-5b5e-4650-964e-ad627bf64934 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Going to try to start instance {{(pid=126120) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 07:10:59.818062 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3b51422c-5b5e-4650-964e-ad627bf64934 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "POST /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56/action" status: 202 len: 0 microversion: 2.1 time: 0.122986 Aug 02 07:10:59.818669 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2457/4841] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:10:59 2022] POST /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:10:59.827371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bc69ba3f-32ec-4446-8a51-5c32177ff477 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:10:59.828366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bc69ba3f-32ec-4446-8a51-5c32177ff477 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:10:59.837414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc69ba3f-32ec-4446-8a51-5c32177ff477 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:59.840919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc69ba3f-32ec-4446-8a51-5c32177ff477 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:10:59.845689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc69ba3f-32ec-4446-8a51-5c32177ff477 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:10:59.846632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc69ba3f-32ec-4446-8a51-5c32177ff477 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:00.033836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-541f130a-9a1d-4b8a-8362-4d706534d8b0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:00.034797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-541f130a-9a1d-4b8a-8362-4d706534d8b0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:00.045039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-541f130a-9a1d-4b8a-8362-4d706534d8b0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:00.051135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-541f130a-9a1d-4b8a-8362-4d706534d8b0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:00.052248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-541f130a-9a1d-4b8a-8362-4d706534d8b0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:00.052874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-541f130a-9a1d-4b8a-8362-4d706534d8b0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:00.422001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bc69ba3f-32ec-4446-8a51-5c32177ff477 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:00.433702 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bc69ba3f-32ec-4446-8a51-5c32177ff477 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1507 microversion: 2.1 time: 0.610407 Aug 02 07:11:00.447870 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2385/4842] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:10:59 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1507 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:00.474733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9269bca9-986d-44dd-a672-7adb39af060b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:00.485306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9269bca9-986d-44dd-a672-7adb39af060b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:00.495651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9269bca9-986d-44dd-a672-7adb39af060b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:00.500432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-541f130a-9a1d-4b8a-8362-4d706534d8b0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:00.501250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9269bca9-986d-44dd-a672-7adb39af060b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:00.502589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9269bca9-986d-44dd-a672-7adb39af060b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:00.505553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9269bca9-986d-44dd-a672-7adb39af060b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:00.510254 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-541f130a-9a1d-4b8a-8362-4d706534d8b0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.481312 Aug 02 07:11:00.526536 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2458/4843] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:00 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:00.554883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-04751d28-33d9-40f4-87fe-c8d00c1e4433 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:00.555833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-04751d28-33d9-40f4-87fe-c8d00c1e4433 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:00.566402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04751d28-33d9-40f4-87fe-c8d00c1e4433 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:00.571562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04751d28-33d9-40f4-87fe-c8d00c1e4433 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:00.572988 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9269bca9-986d-44dd-a672-7adb39af060b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123118 Aug 02 07:11:00.573612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04751d28-33d9-40f4-87fe-c8d00c1e4433 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:00.574255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04751d28-33d9-40f4-87fe-c8d00c1e4433 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:00.574916 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2386/4844] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:11:00 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:00.622381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6b784050-c15f-4963-9d17-631b5e945c32 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:00.625587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6b784050-c15f-4963-9d17-631b5e945c32 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:00.644429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b784050-c15f-4963-9d17-631b5e945c32 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:00.645103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b784050-c15f-4963-9d17-631b5e945c32 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:00.646361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b784050-c15f-4963-9d17-631b5e945c32 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:00.647007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b784050-c15f-4963-9d17-631b5e945c32 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:00.978499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6b784050-c15f-4963-9d17-631b5e945c32 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:00.994202 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6b784050-c15f-4963-9d17-631b5e945c32 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1691 microversion: 2.1 time: 0.387584 Aug 02 07:11:00.994819 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2387/4845] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:00 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1691 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:01.019874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-77e03fa3-7ca7-4959-981b-72b2fee89f02 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:01.020655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-77e03fa3-7ca7-4959-981b-72b2fee89f02 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:01.029612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77e03fa3-7ca7-4959-981b-72b2fee89f02 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:01.030452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77e03fa3-7ca7-4959-981b-72b2fee89f02 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:01.032111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77e03fa3-7ca7-4959-981b-72b2fee89f02 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:01.032844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77e03fa3-7ca7-4959-981b-72b2fee89f02 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:01.043868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-04751d28-33d9-40f4-87fe-c8d00c1e4433 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:01.082951 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-04751d28-33d9-40f4-87fe-c8d00c1e4433 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1319 microversion: 2.1 time: 0.530544 Aug 02 07:11:01.087179 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2459/4846] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:00 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1319 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:01.297855 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-77e03fa3-7ca7-4959-981b-72b2fee89f02 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724/action" status: 202 len: 0 microversion: 2.1 time: 0.280995 Aug 02 07:11:01.299092 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2388/4847] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:11:01 2022] POST /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:11:01.309603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cb55d54c-b8c7-4b6e-99ca-b70da6fcc364 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:01.310780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cb55d54c-b8c7-4b6e-99ca-b70da6fcc364 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:01.323537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb55d54c-b8c7-4b6e-99ca-b70da6fcc364 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:01.324341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb55d54c-b8c7-4b6e-99ca-b70da6fcc364 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:01.326801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb55d54c-b8c7-4b6e-99ca-b70da6fcc364 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:01.328941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb55d54c-b8c7-4b6e-99ca-b70da6fcc364 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:01.457640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d1a4dcc5-3dbf-477e-8a50-8145d552a667 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:01.458395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d1a4dcc5-3dbf-477e-8a50-8145d552a667 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:01.476630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d1a4dcc5-3dbf-477e-8a50-8145d552a667 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:01.477094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d1a4dcc5-3dbf-477e-8a50-8145d552a667 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:01.477907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d1a4dcc5-3dbf-477e-8a50-8145d552a667 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:01.478365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d1a4dcc5-3dbf-477e-8a50-8145d552a667 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:01.713757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cb55d54c-b8c7-4b6e-99ca-b70da6fcc364 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:01.730340 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cb55d54c-b8c7-4b6e-99ca-b70da6fcc364 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.426160 Aug 02 07:11:01.731151 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2460/4848] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:01 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:01.736072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c5f92cba-d73f-4e67-b011-18d9a4ba3d11 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:01.742243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c5f92cba-d73f-4e67-b011-18d9a4ba3d11 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:01.759349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5f92cba-d73f-4e67-b011-18d9a4ba3d11 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:01.760085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5f92cba-d73f-4e67-b011-18d9a4ba3d11 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:01.761750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5f92cba-d73f-4e67-b011-18d9a4ba3d11 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:01.795418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5f92cba-d73f-4e67-b011-18d9a4ba3d11 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:01.804021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d1a4dcc5-3dbf-477e-8a50-8145d552a667 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:01.814796 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d1a4dcc5-3dbf-477e-8a50-8145d552a667 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1507 microversion: 2.1 time: 0.362614 Aug 02 07:11:01.816003 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2389/4849] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:01 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:01.829226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b530fcd4-167f-45c0-9040-6d9231376f5b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:01.834605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b530fcd4-167f-45c0-9040-6d9231376f5b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:01.845636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b530fcd4-167f-45c0-9040-6d9231376f5b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:01.846295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b530fcd4-167f-45c0-9040-6d9231376f5b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:01.847227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b530fcd4-167f-45c0-9040-6d9231376f5b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:01.847896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b530fcd4-167f-45c0-9040-6d9231376f5b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:01.923181 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b530fcd4-167f-45c0-9040-6d9231376f5b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105763 Aug 02 07:11:01.931284 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2390/4850] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:11:01 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:02.107856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e1b7ac2a-5c6f-4b7b-83ae-e4a37a734efc tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:02.108695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e1b7ac2a-5c6f-4b7b-83ae-e4a37a734efc tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:02.122231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1b7ac2a-5c6f-4b7b-83ae-e4a37a734efc tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:02.122958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1b7ac2a-5c6f-4b7b-83ae-e4a37a734efc tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:02.123930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1b7ac2a-5c6f-4b7b-83ae-e4a37a734efc tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:02.128505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1b7ac2a-5c6f-4b7b-83ae-e4a37a734efc tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:02.166417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c5f92cba-d73f-4e67-b011-18d9a4ba3d11 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:02.173571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:02.181776 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c5f92cba-d73f-4e67-b011-18d9a4ba3d11 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.448918 Aug 02 07:11:02.185659 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2461/4851] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:01 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:02.385546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e1b7ac2a-5c6f-4b7b-83ae-e4a37a734efc tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:02.395802 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e1b7ac2a-5c6f-4b7b-83ae-e4a37a734efc tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1319 microversion: 2.1 time: 0.291699 Aug 02 07:11:02.396756 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2391/4852] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:02 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:02.757295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44d614e6-d9a7-4ecc-a518-55717f2c6302 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:02.758085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-44d614e6-d9a7-4ecc-a518-55717f2c6302 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:02.778026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44d614e6-d9a7-4ecc-a518-55717f2c6302 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:02.778828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44d614e6-d9a7-4ecc-a518-55717f2c6302 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:02.780275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44d614e6-d9a7-4ecc-a518-55717f2c6302 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:02.780978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44d614e6-d9a7-4ecc-a518-55717f2c6302 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:02.839199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c43cab49-bd15-47d1-8686-378ff1f286cc tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:02.840599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c43cab49-bd15-47d1-8686-378ff1f286cc tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:02.865352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c43cab49-bd15-47d1-8686-378ff1f286cc tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:02.870863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c43cab49-bd15-47d1-8686-378ff1f286cc tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:02.871903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c43cab49-bd15-47d1-8686-378ff1f286cc tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:02.874397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c43cab49-bd15-47d1-8686-378ff1f286cc tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.051068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-44d614e6-d9a7-4ecc-a518-55717f2c6302 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:03.061844 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-44d614e6-d9a7-4ecc-a518-55717f2c6302 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.309238 Aug 02 07:11:03.063731 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2462/4853] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:02 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:03.069111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b7fd312b-b5b1-4705-bee1-ed0b7fbecc9b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:03.072135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b7fd312b-b5b1-4705-bee1-ed0b7fbecc9b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:03.079075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7fd312b-b5b1-4705-bee1-ed0b7fbecc9b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.079893 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7fd312b-b5b1-4705-bee1-ed0b7fbecc9b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.080865 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7fd312b-b5b1-4705-bee1-ed0b7fbecc9b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.081471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7fd312b-b5b1-4705-bee1-ed0b7fbecc9b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.119506 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b7fd312b-b5b1-4705-bee1-ed0b7fbecc9b tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054228 Aug 02 07:11:03.121803 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2463/4854] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:11:03 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:11:03.150768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c43cab49-bd15-47d1-8686-378ff1f286cc tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:03.161564 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c43cab49-bd15-47d1-8686-378ff1f286cc tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1511 microversion: 2.1 time: 0.328199 Aug 02 07:11:03.162943 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2392/4855] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:02 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:03.195104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9d542697-9960-4707-98a3-6d4602b93232 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:03.205178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9d542697-9960-4707-98a3-6d4602b93232 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:03.206204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.compute.servers [None req-9d542697-9960-4707-98a3-6d4602b93232 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Removing options 'limit' from query {{(pid=126120) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 02 07:11:03.207135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9d542697-9960-4707-98a3-6d4602b93232 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:11:03.208700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d542697-9960-4707-98a3-6d4602b93232 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.209989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d542697-9960-4707-98a3-6d4602b93232 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.211264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e10599b2-2fe0-4ab4-80e5-2c4ed9c2bf91 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:03.211935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e10599b2-2fe0-4ab4-80e5-2c4ed9c2bf91 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:03.212315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d542697-9960-4707-98a3-6d4602b93232 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.213074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d542697-9960-4707-98a3-6d4602b93232 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.215086 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9d542697-9960-4707-98a3-6d4602b93232 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.026571 Aug 02 07:11:03.215938 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2464/4856] 10.222.0.79 () {58 vars in 1140 bytes} [Tue Aug 2 07:11:03 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:11:03.221385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fe7f69dc-2b03-4cd4-b640-4a35195dece9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:03.222281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fe7f69dc-2b03-4cd4-b640-4a35195dece9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:03.223147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e10599b2-2fe0-4ab4-80e5-2c4ed9c2bf91 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.223599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e10599b2-2fe0-4ab4-80e5-2c4ed9c2bf91 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.224388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e10599b2-2fe0-4ab4-80e5-2c4ed9c2bf91 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.224824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e10599b2-2fe0-4ab4-80e5-2c4ed9c2bf91 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.230458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe7f69dc-2b03-4cd4-b640-4a35195dece9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.231196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe7f69dc-2b03-4cd4-b640-4a35195dece9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.232379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe7f69dc-2b03-4cd4-b640-4a35195dece9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.232998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe7f69dc-2b03-4cd4-b640-4a35195dece9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.270096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fe7f69dc-2b03-4cd4-b640-4a35195dece9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:11:03.416424 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fe7f69dc-2b03-4cd4-b640-4a35195dece9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 204 len: 0 microversion: 2.1 time: 0.198270 Aug 02 07:11:03.417029 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2465/4857] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:03 2022] DELETE /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:11:03.428835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-db85b962-a1f6-4dca-a134-18ee2e0c1c3e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:03.429575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-db85b962-a1f6-4dca-a134-18ee2e0c1c3e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:03.436400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db85b962-a1f6-4dca-a134-18ee2e0c1c3e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.436856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db85b962-a1f6-4dca-a134-18ee2e0c1c3e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.437647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db85b962-a1f6-4dca-a134-18ee2e0c1c3e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.438327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db85b962-a1f6-4dca-a134-18ee2e0c1c3e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.476090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e10599b2-2fe0-4ab4-80e5-2c4ed9c2bf91 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:03.493227 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e10599b2-2fe0-4ab4-80e5-2c4ed9c2bf91 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.290286 Aug 02 07:11:03.494566 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2393/4858] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:03 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:03.513597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-08ee6931-954c-49ea-9d51-b55e7d2dacb8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:03.514726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-08ee6931-954c-49ea-9d51-b55e7d2dacb8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:03.529982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08ee6931-954c-49ea-9d51-b55e7d2dacb8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.530819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08ee6931-954c-49ea-9d51-b55e7d2dacb8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.531874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08ee6931-954c-49ea-9d51-b55e7d2dacb8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.532544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08ee6931-954c-49ea-9d51-b55e7d2dacb8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.675416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-db85b962-a1f6-4dca-a134-18ee2e0c1c3e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:03.691522 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-db85b962-a1f6-4dca-a134-18ee2e0c1c3e tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1511 microversion: 2.1 time: 0.271407 Aug 02 07:11:03.692145 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2466/4859] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:03 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1511 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:03.704916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0ba67960-18e5-4b19-bc98-e636cba626e5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:03.705696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0ba67960-18e5-4b19-bc98-e636cba626e5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:03.722911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-08ee6931-954c-49ea-9d51-b55e7d2dacb8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:03.727555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ba67960-18e5-4b19-bc98-e636cba626e5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.727938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ba67960-18e5-4b19-bc98-e636cba626e5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.728730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ba67960-18e5-4b19-bc98-e636cba626e5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.729168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ba67960-18e5-4b19-bc98-e636cba626e5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.732998 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-08ee6931-954c-49ea-9d51-b55e7d2dacb8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1319 microversion: 2.1 time: 0.236576 Aug 02 07:11:03.735329 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2394/4860] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:03 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:03.740498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8441003b-db8c-40fb-bcde-48ebd86ddcd7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:03.741419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8441003b-db8c-40fb-bcde-48ebd86ddcd7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: fd8b1e0a-9584-420c-82e0-5c60e8d17a35] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:03.748857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8441003b-db8c-40fb-bcde-48ebd86ddcd7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.749393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8441003b-db8c-40fb-bcde-48ebd86ddcd7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.750324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8441003b-db8c-40fb-bcde-48ebd86ddcd7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:03.750863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8441003b-db8c-40fb-bcde-48ebd86ddcd7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:03.756891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:03.987970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0ba67960-18e5-4b19-bc98-e636cba626e5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:03.997612 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0ba67960-18e5-4b19-bc98-e636cba626e5 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1683 microversion: 2.1 time: 0.302831 Aug 02 07:11:03.998514 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2467/4861] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:03 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1683 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:04.006219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-daa24538-eda2-417b-b766-3e4835e267af req-b01bc8d4-1d9f-442f-ab23-0ac1958e0876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f30eee-cead-423c-995f-3148f1ccb0b4", "tag": "76b8561b-ea50-4b30-b705-61d124891db1"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:04.012826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8441003b-db8c-40fb-bcde-48ebd86ddcd7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:04.016114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-daa24538-eda2-417b-b766-3e4835e267af req-b01bc8d4-1d9f-442f-ab23-0ac1958e0876 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:04.016565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-daa24538-eda2-417b-b766-3e4835e267af req-b01bc8d4-1d9f-442f-ab23-0ac1958e0876 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:04.021463 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8441003b-db8c-40fb-bcde-48ebd86ddcd7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35" status: 200 len: 1510 microversion: 2.1 time: 0.284780 Aug 02 07:11:04.022102 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2395/4862] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:03 2022] GET /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35 => generated 1510 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:04.032756 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-daa24538-eda2-417b-b766-3e4835e267af req-b01bc8d4-1d9f-442f-ab23-0ac1958e0876 service nova] Creating event network-changed:76b8561b-ea50-4b30-b705-61d124891db1 for instance 03f30eee-cead-423c-995f-3148f1ccb0b4 on n-h1-851337-3 Aug 02 07:11:04.037722 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-daa24538-eda2-417b-b766-3e4835e267af req-b01bc8d4-1d9f-442f-ab23-0ac1958e0876 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035554 Aug 02 07:11:04.039198 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2468/4863] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:04.042059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2eee4007-f24a-4b3e-9b32-64e1f2484c4f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:04.042752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2eee4007-f24a-4b3e-9b32-64e1f2484c4f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:04.049449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2eee4007-f24a-4b3e-9b32-64e1f2484c4f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:04.050235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2eee4007-f24a-4b3e-9b32-64e1f2484c4f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:04.050978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2eee4007-f24a-4b3e-9b32-64e1f2484c4f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:04.051423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2eee4007-f24a-4b3e-9b32-64e1f2484c4f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:04.084728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-553a2594-469a-40fe-8292-967103ff6cbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:04.086105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-553a2594-469a-40fe-8292-967103ff6cbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:04.093813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-553a2594-469a-40fe-8292-967103ff6cbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:04.094247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-553a2594-469a-40fe-8292-967103ff6cbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:04.095257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-553a2594-469a-40fe-8292-967103ff6cbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:04.095682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-553a2594-469a-40fe-8292-967103ff6cbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:04.241137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2eee4007-f24a-4b3e-9b32-64e1f2484c4f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:04.255356 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2eee4007-f24a-4b3e-9b32-64e1f2484c4f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1510 microversion: 2.1 time: 0.217203 Aug 02 07:11:04.256556 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2396/4864] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:04 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:04.275304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7df23f55-f4b3-4e1f-b5b7-d9f0638e8af7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:04.281068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7df23f55-f4b3-4e1f-b5b7-d9f0638e8af7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:04.282033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7df23f55-f4b3-4e1f-b5b7-d9f0638e8af7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:11:04.288213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-553a2594-469a-40fe-8292-967103ff6cbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:04.299880 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-553a2594-469a-40fe-8292-967103ff6cbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.219287 Aug 02 07:11:04.301406 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2469/4865] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:04 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:04.463031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7df23f55-f4b3-4e1f-b5b7-d9f0638e8af7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:04.464487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7df23f55-f4b3-4e1f-b5b7-d9f0638e8af7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:04.465878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7df23f55-f4b3-4e1f-b5b7-d9f0638e8af7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:04.466685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7df23f55-f4b3-4e1f-b5b7-d9f0638e8af7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:04.515482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e38dbf31-14a8-4993-9d90-e124f11102d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:04.516504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e38dbf31-14a8-4993-9d90-e124f11102d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:04.525090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e38dbf31-14a8-4993-9d90-e124f11102d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:04.525540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e38dbf31-14a8-4993-9d90-e124f11102d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:04.535089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e38dbf31-14a8-4993-9d90-e124f11102d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:04.535454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e38dbf31-14a8-4993-9d90-e124f11102d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:04.604192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-7df23f55-f4b3-4e1f-b5b7-d9f0638e8af7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:11:04.672309 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7df23f55-f4b3-4e1f-b5b7-d9f0638e8af7 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 345 microversion: 2.1 time: 0.400837 Aug 02 07:11:04.673299 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2397/4866] 10.222.0.79 () {58 vars in 1154 bytes} [Tue Aug 2 07:11:04 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 345 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:11:04.681347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:04.686358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-607653d1-5aaf-4cec-8bdb-b3b0e4554c2f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:04.689071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-607653d1-5aaf-4cec-8bdb-b3b0e4554c2f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:04.694416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-607653d1-5aaf-4cec-8bdb-b3b0e4554c2f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:04.695190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-607653d1-5aaf-4cec-8bdb-b3b0e4554c2f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:04.696286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-607653d1-5aaf-4cec-8bdb-b3b0e4554c2f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:04.696952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-607653d1-5aaf-4cec-8bdb-b3b0e4554c2f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:04.945045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e38dbf31-14a8-4993-9d90-e124f11102d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:04.974824 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e38dbf31-14a8-4993-9d90-e124f11102d3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.463317 Aug 02 07:11:04.984142 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2470/4867] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:04 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:04.995964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1e414959-9d81-4695-a3c1-e7264deb432f tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:05.014941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1e414959-9d81-4695-a3c1-e7264deb432f tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:05.028039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e414959-9d81-4695-a3c1-e7264deb432f tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:05.029626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e414959-9d81-4695-a3c1-e7264deb432f tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:05.030734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e414959-9d81-4695-a3c1-e7264deb432f tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:05.031368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e414959-9d81-4695-a3c1-e7264deb432f tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:05.407138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-607653d1-5aaf-4cec-8bdb-b3b0e4554c2f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:05.417579 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-607653d1-5aaf-4cec-8bdb-b3b0e4554c2f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1511 microversion: 2.1 time: 0.735420 Aug 02 07:11:05.418639 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2398/4868] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:04 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1511 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:05.426431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8fe05135-9568-4143-9599-d02463b7a2c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:05.429253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8fe05135-9568-4143-9599-d02463b7a2c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:05.439188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe05135-9568-4143-9599-d02463b7a2c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:05.439645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe05135-9568-4143-9599-d02463b7a2c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:05.440444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe05135-9568-4143-9599-d02463b7a2c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:05.440897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe05135-9568-4143-9599-d02463b7a2c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:05.538403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:05.681665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1e414959-9d81-4695-a3c1-e7264deb432f tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:05.694118 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1e414959-9d81-4695-a3c1-e7264deb432f tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1319 microversion: 2.1 time: 0.707005 Aug 02 07:11:05.695375 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2471/4869] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:04 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1319 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:05.704727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-26a2744f-2d49-41d6-a8e3-bf637d996c91 req-ab0e1a14-8a23-4019-b41a-07805834efb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a5964c-4da3-4792-9d53-9c7a77632724", "name": "network-vif-plugged", "status": "completed", "tag": "a4d951c8-7fd6-4964-b8d1-fffe96300cc7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:05.722250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-26a2744f-2d49-41d6-a8e3-bf637d996c91 req-ab0e1a14-8a23-4019-b41a-07805834efb0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:05.723205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-26a2744f-2d49-41d6-a8e3-bf637d996c91 req-ab0e1a14-8a23-4019-b41a-07805834efb0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:05.743864 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-26a2744f-2d49-41d6-a8e3-bf637d996c91 req-ab0e1a14-8a23-4019-b41a-07805834efb0 service nova] Creating event network-vif-plugged:a4d951c8-7fd6-4964-b8d1-fffe96300cc7 for instance e9a5964c-4da3-4792-9d53-9c7a77632724 on n-h1-851337-3 Aug 02 07:11:05.751827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-26a2744f-2d49-41d6-a8e3-bf637d996c91 req-ab0e1a14-8a23-4019-b41a-07805834efb0 service nova] Instance e9a5964c-4da3-4792-9d53-9c7a77632724 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:11:05.770793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8fe05135-9568-4143-9599-d02463b7a2c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:05.782350 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-26a2744f-2d49-41d6-a8e3-bf637d996c91 req-ab0e1a14-8a23-4019-b41a-07805834efb0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080030 Aug 02 07:11:05.784450 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8fe05135-9568-4143-9599-d02463b7a2c7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1683 microversion: 2.1 time: 0.364492 Aug 02 07:11:05.784916 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2472/4870] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:05.787568 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2399/4871] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:05 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1683 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:05.793777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-22242e6d-dcfe-494a-ad3c-c49fdc4381b2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:05.797516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d82ed0e-5de0-4d0a-aaff-db76babd2297 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:05.798155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5d82ed0e-5de0-4d0a-aaff-db76babd2297 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: fd8b1e0a-9584-420c-82e0-5c60e8d17a35] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:05.799022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-22242e6d-dcfe-494a-ad3c-c49fdc4381b2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:05.810766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22242e6d-dcfe-494a-ad3c-c49fdc4381b2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:05.813379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d82ed0e-5de0-4d0a-aaff-db76babd2297 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:05.814050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d82ed0e-5de0-4d0a-aaff-db76babd2297 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:05.815623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22242e6d-dcfe-494a-ad3c-c49fdc4381b2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:05.817221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d82ed0e-5de0-4d0a-aaff-db76babd2297 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:05.817821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d82ed0e-5de0-4d0a-aaff-db76babd2297 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:05.818063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22242e6d-dcfe-494a-ad3c-c49fdc4381b2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:05.819907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22242e6d-dcfe-494a-ad3c-c49fdc4381b2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:06.053592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5d82ed0e-5de0-4d0a-aaff-db76babd2297 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:06.067358 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5d82ed0e-5de0-4d0a-aaff-db76babd2297 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35" status: 200 len: 1510 microversion: 2.1 time: 0.277748 Aug 02 07:11:06.068466 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2400/4872] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:05 2022] GET /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35 => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:06.077053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2909a928-c1ab-4327-8094-687ad3ead910 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:06.077680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2909a928-c1ab-4327-8094-687ad3ead910 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:06.112480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2909a928-c1ab-4327-8094-687ad3ead910 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:06.112953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2909a928-c1ab-4327-8094-687ad3ead910 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:06.113739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2909a928-c1ab-4327-8094-687ad3ead910 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:06.114316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2909a928-c1ab-4327-8094-687ad3ead910 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:06.468874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2909a928-c1ab-4327-8094-687ad3ead910 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:06.481350 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2909a928-c1ab-4327-8094-687ad3ead910 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1518 microversion: 2.1 time: 0.412226 Aug 02 07:11:06.494314 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2401/4873] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:06 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1518 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:06.506989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6fa7e27d-2df0-4ea6-8d44-e94166025bba tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:06.507980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6fa7e27d-2df0-4ea6-8d44-e94166025bba tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:06.519317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6fa7e27d-2df0-4ea6-8d44-e94166025bba tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:06.521481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6fa7e27d-2df0-4ea6-8d44-e94166025bba tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:06.522693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6fa7e27d-2df0-4ea6-8d44-e94166025bba tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:06.523503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6fa7e27d-2df0-4ea6-8d44-e94166025bba tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:06.655062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-22242e6d-dcfe-494a-ad3c-c49fdc4381b2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:06.665590 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-22242e6d-dcfe-494a-ad3c-c49fdc4381b2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.879147 Aug 02 07:11:06.666534 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2473/4874] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:05 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:06.715196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-11affb34-9b25-4746-bbe5-b4cebd9ba0f8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:06.716232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-11affb34-9b25-4746-bbe5-b4cebd9ba0f8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:06.725570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11affb34-9b25-4746-bbe5-b4cebd9ba0f8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:06.729715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11affb34-9b25-4746-bbe5-b4cebd9ba0f8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:06.730534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11affb34-9b25-4746-bbe5-b4cebd9ba0f8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:06.732290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11affb34-9b25-4746-bbe5-b4cebd9ba0f8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:06.940005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6fa7e27d-2df0-4ea6-8d44-e94166025bba tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:06.953981 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6fa7e27d-2df0-4ea6-8d44-e94166025bba tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1510 microversion: 2.1 time: 0.451147 Aug 02 07:11:06.957518 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2402/4875] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:06 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1510 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:06.977764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8e3e9a4b-c7f2-4284-90e8-d056e82e1910 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:06.978411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8e3e9a4b-c7f2-4284-90e8-d056e82e1910 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:06.981387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:06.996532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e3e9a4b-c7f2-4284-90e8-d056e82e1910 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:06.996988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e3e9a4b-c7f2-4284-90e8-d056e82e1910 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:06.997799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e3e9a4b-c7f2-4284-90e8-d056e82e1910 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:06.998272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e3e9a4b-c7f2-4284-90e8-d056e82e1910 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:07.202336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-11affb34-9b25-4746-bbe5-b4cebd9ba0f8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:07.212639 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-11affb34-9b25-4746-bbe5-b4cebd9ba0f8 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1319 microversion: 2.1 time: 0.501166 Aug 02 07:11:07.214552 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2474/4876] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:06 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:07.224153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9b29eace-3034-4632-86d6-52f81f33c455 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:07.232838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9b29eace-3034-4632-86d6-52f81f33c455 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:07.234644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9b29eace-3034-4632-86d6-52f81f33c455 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:11:07.243572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b29eace-3034-4632-86d6-52f81f33c455 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:07.243572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b29eace-3034-4632-86d6-52f81f33c455 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:07.244911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b29eace-3034-4632-86d6-52f81f33c455 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:07.245584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b29eace-3034-4632-86d6-52f81f33c455 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:07.287589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-9b29eace-3034-4632-86d6-52f81f33c455 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:11:07.296654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8e3e9a4b-c7f2-4284-90e8-d056e82e1910 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:07.316568 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8e3e9a4b-c7f2-4284-90e8-d056e82e1910 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1683 microversion: 2.1 time: 0.347040 Aug 02 07:11:07.317689 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2403/4877] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:06 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1683 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:07.362814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9b29eace-3034-4632-86d6-52f81f33c455 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:07.372066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b29eace-3034-4632-86d6-52f81f33c455 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:07.372901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b29eace-3034-4632-86d6-52f81f33c455 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:07.509300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0814280-96c1-4bc4-972f-bb1678bb5d7b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:07.510602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d0814280-96c1-4bc4-972f-bb1678bb5d7b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:07.523712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0814280-96c1-4bc4-972f-bb1678bb5d7b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:07.525473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0814280-96c1-4bc4-972f-bb1678bb5d7b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:07.526686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0814280-96c1-4bc4-972f-bb1678bb5d7b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:07.527541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0814280-96c1-4bc4-972f-bb1678bb5d7b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:07.675345 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9b29eace-3034-4632-86d6-52f81f33c455 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 0.459246 Aug 02 07:11:07.676759 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2475/4878] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 07:11:07 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:07.698222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-554ba82b-c5ad-466c-838f-1d4810752286 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:07.698957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-554ba82b-c5ad-466c-838f-1d4810752286 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:07.706148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-554ba82b-c5ad-466c-838f-1d4810752286 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:07.707192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-554ba82b-c5ad-466c-838f-1d4810752286 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:07.708205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-554ba82b-c5ad-466c-838f-1d4810752286 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:07.708857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-554ba82b-c5ad-466c-838f-1d4810752286 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:07.833803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d0814280-96c1-4bc4-972f-bb1678bb5d7b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:07.868665 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d0814280-96c1-4bc4-972f-bb1678bb5d7b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1524 microversion: 2.1 time: 0.365296 Aug 02 07:11:07.869297 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2404/4879] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:07 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1524 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:07.894787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ebf23d93-cfeb-4603-8406-3f16a16c66e2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:07.899880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ebf23d93-cfeb-4603-8406-3f16a16c66e2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:07.900562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ebf23d93-cfeb-4603-8406-3f16a16c66e2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:11:08.058980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebf23d93-cfeb-4603-8406-3f16a16c66e2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:08.058980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebf23d93-cfeb-4603-8406-3f16a16c66e2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:08.058980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebf23d93-cfeb-4603-8406-3f16a16c66e2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:08.059470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebf23d93-cfeb-4603-8406-3f16a16c66e2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:08.075025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-554ba82b-c5ad-466c-838f-1d4810752286 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:08.093044 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-554ba82b-c5ad-466c-838f-1d4810752286 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.403450 Aug 02 07:11:08.093826 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2476/4880] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:07 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:08.101933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e72b0b87-dd5c-46a4-bf17-bf01535b7111 req-906d63ea-f83e-4d2c-ac4f-539613caf7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65f2010c-11ee-485b-b841-11e8b795aeb8", "name": "network-vif-deleted", "tag": "d729d2b4-ee94-4a77-b294-583f29177fe3"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:08.114743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e72b0b87-dd5c-46a4-bf17-bf01535b7111 req-906d63ea-f83e-4d2c-ac4f-539613caf7b9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:08.115456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e72b0b87-dd5c-46a4-bf17-bf01535b7111 req-906d63ea-f83e-4d2c-ac4f-539613caf7b9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:08.121057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-ebf23d93-cfeb-4603-8406-3f16a16c66e2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:11:08.134485 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e72b0b87-dd5c-46a4-bf17-bf01535b7111 req-906d63ea-f83e-4d2c-ac4f-539613caf7b9 service nova] Creating event network-vif-deleted:d729d2b4-ee94-4a77-b294-583f29177fe3 for instance 65f2010c-11ee-485b-b841-11e8b795aeb8 on n-h1-851337-3 Aug 02 07:11:08.148980 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e72b0b87-dd5c-46a4-bf17-bf01535b7111 req-906d63ea-f83e-4d2c-ac4f-539613caf7b9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050659 Aug 02 07:11:08.152296 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2477/4881] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:08.153374 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ebf23d93-cfeb-4603-8406-3f16a16c66e2 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.267834 Aug 02 07:11:08.154148 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2405/4882] 10.222.0.79 () {58 vars in 1150 bytes} [Tue Aug 2 07:11:07 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:08.170453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8dd5db6c-8c23-44e7-b108-521663c3dc3f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:08.176437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8dd5db6c-8c23-44e7-b108-521663c3dc3f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:08.177635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8dd5db6c-8c23-44e7-b108-521663c3dc3f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:11:08.188764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8dd5db6c-8c23-44e7-b108-521663c3dc3f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:08.189530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8dd5db6c-8c23-44e7-b108-521663c3dc3f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:08.190669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8dd5db6c-8c23-44e7-b108-521663c3dc3f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:08.191499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8dd5db6c-8c23-44e7-b108-521663c3dc3f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:08.239245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-08a0324f-0396-4a3e-9864-6b344376b443 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:08.239904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-08a0324f-0396-4a3e-9864-6b344376b443 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:08.249788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08a0324f-0396-4a3e-9864-6b344376b443 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:08.253040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08a0324f-0396-4a3e-9864-6b344376b443 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:08.254203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08a0324f-0396-4a3e-9864-6b344376b443 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:08.256260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08a0324f-0396-4a3e-9864-6b344376b443 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:08.307477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-8dd5db6c-8c23-44e7-b108-521663c3dc3f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:11:08.351672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:08.445040 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8dd5db6c-8c23-44e7-b108-521663c3dc3f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.278838 Aug 02 07:11:08.446016 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2478/4883] 10.222.0.79 () {58 vars in 1212 bytes} [Tue Aug 2 07:11:08 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:08.450884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9e95006e-d480-4661-8fc2-ef390a6c1798 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:08.451622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9e95006e-d480-4661-8fc2-ef390a6c1798 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:08.461488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e95006e-d480-4661-8fc2-ef390a6c1798 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:08.462954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e95006e-d480-4661-8fc2-ef390a6c1798 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:08.465239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e95006e-d480-4661-8fc2-ef390a6c1798 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:08.468500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e95006e-d480-4661-8fc2-ef390a6c1798 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:08.508785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-08a0324f-0396-4a3e-9864-6b344376b443 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:08.519816 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-08a0324f-0396-4a3e-9864-6b344376b443 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1319 microversion: 2.1 time: 0.285018 Aug 02 07:11:08.524996 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2406/4884] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:08 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:08.530511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c7d7b91c-deb0-4327-8edc-bc802a7157c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:08.540091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c7d7b91c-deb0-4327-8edc-bc802a7157c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:08.541062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c7d7b91c-deb0-4327-8edc-bc802a7157c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:11:08.552097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7d7b91c-deb0-4327-8edc-bc802a7157c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:08.552708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7d7b91c-deb0-4327-8edc-bc802a7157c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:08.553915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7d7b91c-deb0-4327-8edc-bc802a7157c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:08.554554 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7d7b91c-deb0-4327-8edc-bc802a7157c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:08.633554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9e95006e-d480-4661-8fc2-ef390a6c1798 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:08.653553 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9e95006e-d480-4661-8fc2-ef390a6c1798 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1615 microversion: 2.1 time: 0.206311 Aug 02 07:11:08.654789 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2479/4885] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:08 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1615 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:08.689063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-c7d7b91c-deb0-4327-8edc-bc802a7157c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:11:08.766976 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c7d7b91c-deb0-4327-8edc-bc802a7157c4 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.240406 Aug 02 07:11:08.767915 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2407/4886] 10.222.0.79 () {58 vars in 1196 bytes} [Tue Aug 2 07:11:08 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:08.780679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-65d4d2ec-6098-4dd5-9d61-87d807348602 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:08.786028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-65d4d2ec-6098-4dd5-9d61-87d807348602 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:08.787294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-65d4d2ec-6098-4dd5-9d61-87d807348602 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'name': '1247937769', 'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:11:08.793638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65d4d2ec-6098-4dd5-9d61-87d807348602 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:08.794504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65d4d2ec-6098-4dd5-9d61-87d807348602 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:08.795587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65d4d2ec-6098-4dd5-9d61-87d807348602 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:08.796226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65d4d2ec-6098-4dd5-9d61-87d807348602 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:08.930204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-65d4d2ec-6098-4dd5-9d61-87d807348602 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:11:08.956546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1692128773", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "1f5f120a-b630-441f-a3e1-8f1ff1e2a3f5"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:09.020464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] validate_networks() for [('1f5f120a-b630-441f-a3e1-8f1ff1e2a3f5', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:11:09.054042 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-65d4d2ec-6098-4dd5-9d61-87d807348602 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers?name=1247937769" status: 200 len: 346 microversion: 2.1 time: 0.277433 Aug 02 07:11:09.055204 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2408/4887] 10.222.0.79 () {58 vars in 1156 bytes} [Tue Aug 2 07:11:08 2022] GET /compute/v2.1/servers?name=1247937769 => generated 346 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:11:09.066454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8ff146d4-34ca-4426-8b76-0727caf7180d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:09.073616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8ff146d4-34ca-4426-8b76-0727caf7180d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:09.086566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ff146d4-34ca-4426-8b76-0727caf7180d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:09.087427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ff146d4-34ca-4426-8b76-0727caf7180d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:09.088251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ff146d4-34ca-4426-8b76-0727caf7180d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:09.088851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ff146d4-34ca-4426-8b76-0727caf7180d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:09.456846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8ff146d4-34ca-4426-8b76-0727caf7180d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:09.467339 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8ff146d4-34ca-4426-8b76-0727caf7180d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1524 microversion: 2.1 time: 0.405102 Aug 02 07:11:09.470768 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2409/4888] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:09 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1524 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:09.488818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d43919e3-9d51-42b9-9228-b7d1d18a9ca3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:09.510794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d43919e3-9d51-42b9-9228-b7d1d18a9ca3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:09.512008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d43919e3-9d51-42b9-9228-b7d1d18a9ca3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:11:09.523428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d43919e3-9d51-42b9-9228-b7d1d18a9ca3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:09.524147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d43919e3-9d51-42b9-9228-b7d1d18a9ca3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:09.524868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d43919e3-9d51-42b9-9228-b7d1d18a9ca3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:09.526042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d43919e3-9d51-42b9-9228-b7d1d18a9ca3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:09.681839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-d43919e3-9d51-42b9-9228-b7d1d18a9ca3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:11:09.740908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:09.766549 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d43919e3-9d51-42b9-9228-b7d1d18a9ca3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.293991 Aug 02 07:11:09.778636 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2410/4889] 10.222.0.79 () {58 vars in 1154 bytes} [Tue Aug 2 07:11:09 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:09.784696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8e614a30-9465-4780-9abc-eafabfd365cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:09.785870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8e614a30-9465-4780-9abc-eafabfd365cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:09.795492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e614a30-9465-4780-9abc-eafabfd365cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:09.796226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e614a30-9465-4780-9abc-eafabfd365cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:09.797060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e614a30-9465-4780-9abc-eafabfd365cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:09.797540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e614a30-9465-4780-9abc-eafabfd365cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:09.833444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:11:09.834769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:11:09.835260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:11:09.835787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:11:09.836216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:11:09.872566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:09.873328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:09.874358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:09.874992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:09.896044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Getting quotas for project c6e5e9e32a994bff8b788028ead79326. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:11:09.902943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Getting quotas for user dfd34377977d459eb182908f6807583c and project c6e5e9e32a994bff8b788028ead79326. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:11:09.919085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:11:09.922187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:11:10.026990 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0f0f4975-28a9-417f-920d-d2ba8a84821b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.321711 Aug 02 07:11:10.027645 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2480/4890] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:11:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 07:11:10.071918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2bc9c694-f820-4c3f-858f-c38140cf1519 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:10.072550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2bc9c694-f820-4c3f-858f-c38140cf1519 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:10.097981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bc9c694-f820-4c3f-858f-c38140cf1519 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:10.098404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bc9c694-f820-4c3f-858f-c38140cf1519 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:10.099191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bc9c694-f820-4c3f-858f-c38140cf1519 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:10.099625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bc9c694-f820-4c3f-858f-c38140cf1519 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:10.109488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8e614a30-9465-4780-9abc-eafabfd365cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:10.120062 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8e614a30-9465-4780-9abc-eafabfd365cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.339718 Aug 02 07:11:10.122981 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2411/4891] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:09 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:10.138086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c5e2391c-4e60-4a82-b36b-4090da2d6ebb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:10.142953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c5e2391c-4e60-4a82-b36b-4090da2d6ebb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:10.168910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5e2391c-4e60-4a82-b36b-4090da2d6ebb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:10.170429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5e2391c-4e60-4a82-b36b-4090da2d6ebb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:10.172089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5e2391c-4e60-4a82-b36b-4090da2d6ebb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:10.175583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5e2391c-4e60-4a82-b36b-4090da2d6ebb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:10.362007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2bc9c694-f820-4c3f-858f-c38140cf1519 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:10.362745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c5e2391c-4e60-4a82-b36b-4090da2d6ebb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:10.373705 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c5e2391c-4e60-4a82-b36b-4090da2d6ebb tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1326 microversion: 2.1 time: 0.249375 Aug 02 07:11:10.374809 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2412/4892] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:10 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1326 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:10.381214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-60a2a894-5e4d-4995-9a2e-2cca5c14f35f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:10.387492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-60a2a894-5e4d-4995-9a2e-2cca5c14f35f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:10.388425 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2bc9c694-f820-4c3f-858f-c38140cf1519 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1319 microversion: 2.1 time: 0.331399 Aug 02 07:11:10.388756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-60a2a894-5e4d-4995-9a2e-2cca5c14f35f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-124793776', 'deleted': False, 'project_id': '6adeb58dc1964c3b93a757b1440b5624'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:11:10.392322 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2481/4893] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:10 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:10.395259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60a2a894-5e4d-4995-9a2e-2cca5c14f35f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:10.395878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60a2a894-5e4d-4995-9a2e-2cca5c14f35f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:10.397062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60a2a894-5e4d-4995-9a2e-2cca5c14f35f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:10.397903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60a2a894-5e4d-4995-9a2e-2cca5c14f35f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:10.404625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3196ac4a-cbe9-4624-b40f-748417dff7e1 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:10.405416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3196ac4a-cbe9-4624-b40f-748417dff7e1 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:10.502883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-60a2a894-5e4d-4995-9a2e-2cca5c14f35f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:11:10.531891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3196ac4a-cbe9-4624-b40f-748417dff7e1 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:10.542139 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3196ac4a-cbe9-4624-b40f-748417dff7e1 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1228 microversion: 2.1 time: 0.147150 Aug 02 07:11:10.542750 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2482/4894] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:10 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1228 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:10.557945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d124a809-b94a-4146-9da4-ecd011868cd6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:10.558896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d124a809-b94a-4146-9da4-ecd011868cd6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:10.612197 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-60a2a894-5e4d-4995-9a2e-2cca5c14f35f tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-124793776" status: 200 len: 346 microversion: 2.1 time: 0.235926 Aug 02 07:11:10.612805 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2413/4895] 10.222.0.79 () {58 vars in 1228 bytes} [Tue Aug 2 07:11:10 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-124793776 => generated 346 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:10.620137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d124a809-b94a-4146-9da4-ecd011868cd6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:10.620820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d124a809-b94a-4146-9da4-ecd011868cd6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:10.621616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d124a809-b94a-4146-9da4-ecd011868cd6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:10.622103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d124a809-b94a-4146-9da4-ecd011868cd6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:10.630392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab45d503-89b3-462c-8eff-a79d622ae6af tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:10.631352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ab45d503-89b3-462c-8eff-a79d622ae6af tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:10.641552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab45d503-89b3-462c-8eff-a79d622ae6af tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:10.642084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab45d503-89b3-462c-8eff-a79d622ae6af tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:10.642828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab45d503-89b3-462c-8eff-a79d622ae6af tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:10.643506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab45d503-89b3-462c-8eff-a79d622ae6af tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:10.681782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ab45d503-89b3-462c-8eff-a79d622ae6af tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:11:10.791711 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ab45d503-89b3-462c-8eff-a79d622ae6af tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "DELETE /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 204 len: 0 microversion: 2.1 time: 0.168242 Aug 02 07:11:10.797879 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2414/4896] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:10 2022] DELETE /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:11:10.804110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c3a5af84-78af-470f-b141-9d3c7a36d4fa tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:10.805735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c3a5af84-78af-470f-b141-9d3c7a36d4fa tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:10.812663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3a5af84-78af-470f-b141-9d3c7a36d4fa tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:10.813111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3a5af84-78af-470f-b141-9d3c7a36d4fa tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:10.814049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3a5af84-78af-470f-b141-9d3c7a36d4fa tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:10.814340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3a5af84-78af-470f-b141-9d3c7a36d4fa tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:10.823350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d124a809-b94a-4146-9da4-ecd011868cd6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:10.836779 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d124a809-b94a-4146-9da4-ecd011868cd6 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1524 microversion: 2.1 time: 0.288339 Aug 02 07:11:10.849950 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2483/4897] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:10 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1524 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:10.941783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-be259842-adea-4e8c-9c60-ef38f82c5a50 req-54ec5e9e-8cf1-499d-8b14-379fc1d9825f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32378f59-645b-4f54-8d09-d30c783496d1", "name": "network-vif-plugged", "status": "completed", "tag": "5f4865d9-a451-4b8f-929a-4afc9ed99e04"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:10.956061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-be259842-adea-4e8c-9c60-ef38f82c5a50 req-54ec5e9e-8cf1-499d-8b14-379fc1d9825f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:10.956061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-be259842-adea-4e8c-9c60-ef38f82c5a50 req-54ec5e9e-8cf1-499d-8b14-379fc1d9825f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:10.971819 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-be259842-adea-4e8c-9c60-ef38f82c5a50 req-54ec5e9e-8cf1-499d-8b14-379fc1d9825f service nova] Creating event network-vif-plugged:5f4865d9-a451-4b8f-929a-4afc9ed99e04 for instance 32378f59-645b-4f54-8d09-d30c783496d1 on n-h2-851337-3 Aug 02 07:11:10.983712 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-be259842-adea-4e8c-9c60-ef38f82c5a50 req-54ec5e9e-8cf1-499d-8b14-379fc1d9825f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045722 Aug 02 07:11:10.985062 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2484/4898] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:11:10.999207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c3a5af84-78af-470f-b141-9d3c7a36d4fa tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:11.012765 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c3a5af84-78af-470f-b141-9d3c7a36d4fa tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1516 microversion: 2.1 time: 0.213068 Aug 02 07:11:11.015720 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2415/4899] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:10 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1516 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:11.149189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4fe01375-791e-4631-a8d6-9a34fcd5c50f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:11.149916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4fe01375-791e-4631-a8d6-9a34fcd5c50f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:11.156848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fe01375-791e-4631-a8d6-9a34fcd5c50f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:11.157300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fe01375-791e-4631-a8d6-9a34fcd5c50f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:11.159091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fe01375-791e-4631-a8d6-9a34fcd5c50f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:11.159698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fe01375-791e-4631-a8d6-9a34fcd5c50f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:11.312755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4fe01375-791e-4631-a8d6-9a34fcd5c50f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:11.323316 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4fe01375-791e-4631-a8d6-9a34fcd5c50f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.178589 Aug 02 07:11:11.323934 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2485/4900] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:11 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:11.400311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-25dae0b8-8037-4e58-9aa8-6ac7bcfcb5b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:11.401260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-25dae0b8-8037-4e58-9aa8-6ac7bcfcb5b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:11.412045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25dae0b8-8037-4e58-9aa8-6ac7bcfcb5b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:11.412734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25dae0b8-8037-4e58-9aa8-6ac7bcfcb5b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:11.414021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25dae0b8-8037-4e58-9aa8-6ac7bcfcb5b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:11.414489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-25dae0b8-8037-4e58-9aa8-6ac7bcfcb5b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:11.415266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0c36edfe-cf7d-47a9-b73b-495c0b523217 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:11.415895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0c36edfe-cf7d-47a9-b73b-495c0b523217 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:11.417980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:11.424398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c36edfe-cf7d-47a9-b73b-495c0b523217 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:11.424915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c36edfe-cf7d-47a9-b73b-495c0b523217 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:11.425700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c36edfe-cf7d-47a9-b73b-495c0b523217 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:11.426167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c36edfe-cf7d-47a9-b73b-495c0b523217 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:11.486822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-25dae0b8-8037-4e58-9aa8-6ac7bcfcb5b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:11.494780 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-25dae0b8-8037-4e58-9aa8-6ac7bcfcb5b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1326 microversion: 2.1 time: 0.101843 Aug 02 07:11:11.495400 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2416/4901] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:11 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:11.563559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b489f441-2a83-4cd0-8149-5c8272fb3b49 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:11.564112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b489f441-2a83-4cd0-8149-5c8272fb3b49 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:11.570746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b489f441-2a83-4cd0-8149-5c8272fb3b49 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:11.571194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b489f441-2a83-4cd0-8149-5c8272fb3b49 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:11.571964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b489f441-2a83-4cd0-8149-5c8272fb3b49 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:11.572412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b489f441-2a83-4cd0-8149-5c8272fb3b49 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:11.580303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0c36edfe-cf7d-47a9-b73b-495c0b523217 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:11.588282 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0c36edfe-cf7d-47a9-b73b-495c0b523217 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1319 microversion: 2.1 time: 0.178399 Aug 02 07:11:11.589087 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2486/4902] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:11 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:11.639009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b489f441-2a83-4cd0-8149-5c8272fb3b49 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:11.646699 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b489f441-2a83-4cd0-8149-5c8272fb3b49 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1232 microversion: 2.1 time: 0.087175 Aug 02 07:11:11.647268 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2417/4903] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:11 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1232 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:11.861748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-84bd1872-0555-45a0-914c-43c53b6cc2f8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:11.862601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-84bd1872-0555-45a0-914c-43c53b6cc2f8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:11.871231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84bd1872-0555-45a0-914c-43c53b6cc2f8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:11.871679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84bd1872-0555-45a0-914c-43c53b6cc2f8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:11.872434 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84bd1872-0555-45a0-914c-43c53b6cc2f8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:11.872861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84bd1872-0555-45a0-914c-43c53b6cc2f8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:12.020990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84bd1872-0555-45a0-914c-43c53b6cc2f8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:12.028896 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-84bd1872-0555-45a0-914c-43c53b6cc2f8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1524 microversion: 2.1 time: 0.173679 Aug 02 07:11:12.029482 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2487/4904] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:11 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1524 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:12.034147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-47c6b9e6-1b82-4c46-b3ca-01f7631e8635 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:12.034869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-47c6b9e6-1b82-4c46-b3ca-01f7631e8635 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:12.041649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47c6b9e6-1b82-4c46-b3ca-01f7631e8635 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:12.042204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47c6b9e6-1b82-4c46-b3ca-01f7631e8635 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:12.042962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47c6b9e6-1b82-4c46-b3ca-01f7631e8635 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:12.043445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47c6b9e6-1b82-4c46-b3ca-01f7631e8635 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:12.177845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-47c6b9e6-1b82-4c46-b3ca-01f7631e8635 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:12.187094 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-47c6b9e6-1b82-4c46-b3ca-01f7631e8635 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1516 microversion: 2.1 time: 0.156450 Aug 02 07:11:12.187695 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2418/4905] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:12 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:12.345192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5df657bb-4f9a-47dc-81ba-4cc46776dfbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:12.345949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5df657bb-4f9a-47dc-81ba-4cc46776dfbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:12.353087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5df657bb-4f9a-47dc-81ba-4cc46776dfbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:12.353537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5df657bb-4f9a-47dc-81ba-4cc46776dfbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:12.354318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5df657bb-4f9a-47dc-81ba-4cc46776dfbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:12.354979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5df657bb-4f9a-47dc-81ba-4cc46776dfbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:12.517464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f6fd9229-4a9b-44ef-bed4-bba0d2dc3e85 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:12.519199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f6fd9229-4a9b-44ef-bed4-bba0d2dc3e85 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:12.532895 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6fd9229-4a9b-44ef-bed4-bba0d2dc3e85 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:12.533737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6fd9229-4a9b-44ef-bed4-bba0d2dc3e85 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:12.537103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6fd9229-4a9b-44ef-bed4-bba0d2dc3e85 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:12.537814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6fd9229-4a9b-44ef-bed4-bba0d2dc3e85 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:12.542876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5df657bb-4f9a-47dc-81ba-4cc46776dfbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:12.552151 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5df657bb-4f9a-47dc-81ba-4cc46776dfbc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.210471 Aug 02 07:11:12.552575 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2488/4906] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:12 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:12.614194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0a2e6118-8da0-4544-86d2-b1303da71420 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:12.615155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0a2e6118-8da0-4544-86d2-b1303da71420 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:12.636378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a2e6118-8da0-4544-86d2-b1303da71420 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:12.636378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a2e6118-8da0-4544-86d2-b1303da71420 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:12.636378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a2e6118-8da0-4544-86d2-b1303da71420 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:12.637272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a2e6118-8da0-4544-86d2-b1303da71420 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:12.670759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f6fd9229-4a9b-44ef-bed4-bba0d2dc3e85 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:12.682657 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f6fd9229-4a9b-44ef-bed4-bba0d2dc3e85 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1326 microversion: 2.1 time: 0.166176 Aug 02 07:11:12.687076 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2419/4907] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:12 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1326 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:12.692011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85c7ce7d-cb82-405c-9974-37c783767d25 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:12.695692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-85c7ce7d-cb82-405c-9974-37c783767d25 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:12.706636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85c7ce7d-cb82-405c-9974-37c783767d25 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:12.707269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85c7ce7d-cb82-405c-9974-37c783767d25 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:12.708150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85c7ce7d-cb82-405c-9974-37c783767d25 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:12.708687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85c7ce7d-cb82-405c-9974-37c783767d25 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:12.807506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-85c7ce7d-cb82-405c-9974-37c783767d25 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:12.822039 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-85c7ce7d-cb82-405c-9974-37c783767d25 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1232 microversion: 2.1 time: 0.133436 Aug 02 07:11:12.822992 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2420/4908] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:12 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1232 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:12.871031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0a2e6118-8da0-4544-86d2-b1303da71420 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:12.879239 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0a2e6118-8da0-4544-86d2-b1303da71420 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1319 microversion: 2.1 time: 0.273038 Aug 02 07:11:12.879813 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2489/4909] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:12 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:13.050430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-39823539-2e33-4d98-afb1-06872cae74b2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:13.051070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-39823539-2e33-4d98-afb1-06872cae74b2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:13.060492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39823539-2e33-4d98-afb1-06872cae74b2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.061272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39823539-2e33-4d98-afb1-06872cae74b2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.062575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39823539-2e33-4d98-afb1-06872cae74b2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.063159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39823539-2e33-4d98-afb1-06872cae74b2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.214936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0064ed1e-5095-403e-91ef-bb6bf3208293 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:13.215634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0064ed1e-5095-403e-91ef-bb6bf3208293 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:13.222145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0064ed1e-5095-403e-91ef-bb6bf3208293 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.222673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0064ed1e-5095-403e-91ef-bb6bf3208293 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.223514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0064ed1e-5095-403e-91ef-bb6bf3208293 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.224021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0064ed1e-5095-403e-91ef-bb6bf3208293 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.274230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-39823539-2e33-4d98-afb1-06872cae74b2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:13.282745 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-39823539-2e33-4d98-afb1-06872cae74b2 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1509 microversion: 2.1 time: 0.236602 Aug 02 07:11:13.283325 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2421/4910] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:13 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:13.303187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c3bc6b80-eaf0-423a-973d-8f84ea7e455f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:13.303802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c3bc6b80-eaf0-423a-973d-8f84ea7e455f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:13.310281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3bc6b80-eaf0-423a-973d-8f84ea7e455f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.310730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3bc6b80-eaf0-423a-973d-8f84ea7e455f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.311490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3bc6b80-eaf0-423a-973d-8f84ea7e455f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.311922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3bc6b80-eaf0-423a-973d-8f84ea7e455f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.368637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0064ed1e-5095-403e-91ef-bb6bf3208293 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:13.376628 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0064ed1e-5095-403e-91ef-bb6bf3208293 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1516 microversion: 2.1 time: 0.165637 Aug 02 07:11:13.377612 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2490/4911] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:13 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:13.454044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c3bc6b80-eaf0-423a-973d-8f84ea7e455f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:13.462497 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c3bc6b80-eaf0-423a-973d-8f84ea7e455f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 200 len: 1509 microversion: 2.1 time: 0.163036 Aug 02 07:11:13.462989 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2422/4912] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:13 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:13.486067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f410b428-0b9b-4c4e-9961-df1ee66507c8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:13.486747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f410b428-0b9b-4c4e-9961-df1ee66507c8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:13.495410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f410b428-0b9b-4c4e-9961-df1ee66507c8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.495853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f410b428-0b9b-4c4e-9961-df1ee66507c8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.497046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f410b428-0b9b-4c4e-9961-df1ee66507c8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.497666 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f410b428-0b9b-4c4e-9961-df1ee66507c8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.526937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f410b428-0b9b-4c4e-9961-df1ee66507c8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:11:13.578579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-08c0913c-7ed5-4384-9a3c-f821c830a234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:13.579977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-08c0913c-7ed5-4384-9a3c-f821c830a234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:13.588259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08c0913c-7ed5-4384-9a3c-f821c830a234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.589110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08c0913c-7ed5-4384-9a3c-f821c830a234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.590284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08c0913c-7ed5-4384-9a3c-f821c830a234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.591180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08c0913c-7ed5-4384-9a3c-f821c830a234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.667701 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f410b428-0b9b-4c4e-9961-df1ee66507c8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "DELETE /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 204 len: 0 microversion: 2.1 time: 0.187399 Aug 02 07:11:13.687159 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2491/4913] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:13 2022] DELETE /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:11:13.708318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-001ce718-2979-4e4f-9f21-ccc86ee86af3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:13.710500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-001ce718-2979-4e4f-9f21-ccc86ee86af3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:13.727911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-001ce718-2979-4e4f-9f21-ccc86ee86af3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.729454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-001ce718-2979-4e4f-9f21-ccc86ee86af3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.731228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-001ce718-2979-4e4f-9f21-ccc86ee86af3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.731784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-001ce718-2979-4e4f-9f21-ccc86ee86af3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.779550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-001ce718-2979-4e4f-9f21-ccc86ee86af3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.781243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-001ce718-2979-4e4f-9f21-ccc86ee86af3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.785259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-001ce718-2979-4e4f-9f21-ccc86ee86af3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lazy-loading 'fault' on Instance uuid 65f2010c-11ee-485b-b841-11e8b795aeb8 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:11:13.903843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-08c0913c-7ed5-4384-9a3c-f821c830a234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:13.906352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-001ce718-2979-4e4f-9f21-ccc86ee86af3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2629fa08b5419a96c2942118d38dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee1befa077542b9a17865baad3c9999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:13.911766 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-08c0913c-7ed5-4384-9a3c-f821c830a234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.337308 Aug 02 07:11:13.912345 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2423/4914] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:13 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:13.914816 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-001ce718-2979-4e4f-9f21-ccc86ee86af3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 200 len: 1331 microversion: 2.1 time: 0.213650 Aug 02 07:11:13.915946 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2492/4915] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:13 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 1331 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:13.917264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-60fbc6e3-e24d-4dd3-b6fe-ea393289459c tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:13.918113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-60fbc6e3-e24d-4dd3-b6fe-ea393289459c tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:13.921708 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1079181320", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "0c6b1f64-899d-4e1f-bc89-61a10c8bc1e2"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:13.924877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60fbc6e3-e24d-4dd3-b6fe-ea393289459c tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.925537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60fbc6e3-e24d-4dd3-b6fe-ea393289459c tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.926513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60fbc6e3-e24d-4dd3-b6fe-ea393289459c tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:13.927135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60fbc6e3-e24d-4dd3-b6fe-ea393289459c tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:13.979654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] validate_networks() for [('0c6b1f64-899d-4e1f-bc89-61a10c8bc1e2', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:11:13.997500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-60fbc6e3-e24d-4dd3-b6fe-ea393289459c tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:14.001322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:14.006860 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-60fbc6e3-e24d-4dd3-b6fe-ea393289459c tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1280 microversion: 2.1 time: 0.093317 Aug 02 07:11:14.007577 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2424/4916] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:13 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:14.014159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c633fc4d-fd36-4ecd-9c1a-9f452a7f9f60 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:14.014773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c633fc4d-fd36-4ecd-9c1a-9f452a7f9f60 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:14.021625 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c633fc4d-fd36-4ecd-9c1a-9f452a7f9f60 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:14.022333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c633fc4d-fd36-4ecd-9c1a-9f452a7f9f60 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:14.023339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c633fc4d-fd36-4ecd-9c1a-9f452a7f9f60 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:14.023775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c633fc4d-fd36-4ecd-9c1a-9f452a7f9f60 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:14.264894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c633fc4d-fd36-4ecd-9c1a-9f452a7f9f60 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:14.282518 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c633fc4d-fd36-4ecd-9c1a-9f452a7f9f60 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1319 microversion: 2.1 time: 0.273282 Aug 02 07:11:14.284236 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2425/4917] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:14 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:14.399760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2d1627aa-c899-48c5-8d91-9e3c93104ba5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:14.401952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2d1627aa-c899-48c5-8d91-9e3c93104ba5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:14.413434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d1627aa-c899-48c5-8d91-9e3c93104ba5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:14.416888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d1627aa-c899-48c5-8d91-9e3c93104ba5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:14.419377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d1627aa-c899-48c5-8d91-9e3c93104ba5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:14.420435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d1627aa-c899-48c5-8d91-9e3c93104ba5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:14.521681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2d1627aa-c899-48c5-8d91-9e3c93104ba5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:14.531780 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2d1627aa-c899-48c5-8d91-9e3c93104ba5 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 200 len: 1474 microversion: 2.1 time: 0.137664 Aug 02 07:11:14.532757 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2426/4918] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:14 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 1474 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:14.539403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b9b7b1a6-cac2-4dbb-8eb7-59ec3e5dc91a req-429e509a-e3e2-40d5-96b3-81c8026919fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698accff-ea86-4c25-9757-cf21b7e06d5e", "name": "network-vif-deleted", "tag": "57c8008d-c1fe-4d6d-9a07-a8cdc41b7f50"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:14.564638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b9b7b1a6-cac2-4dbb-8eb7-59ec3e5dc91a req-429e509a-e3e2-40d5-96b3-81c8026919fa service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:14.566558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b9b7b1a6-cac2-4dbb-8eb7-59ec3e5dc91a req-429e509a-e3e2-40d5-96b3-81c8026919fa service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:14.585343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:11:14.586545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:11:14.587197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:11:14.587761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:11:14.588451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:11:14.596504 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b9b7b1a6-cac2-4dbb-8eb7-59ec3e5dc91a req-429e509a-e3e2-40d5-96b3-81c8026919fa service nova] Creating event network-vif-deleted:57c8008d-c1fe-4d6d-9a07-a8cdc41b7f50 for instance 698accff-ea86-4c25-9757-cf21b7e06d5e on n-h1-851337-3 Aug 02 07:11:14.603178 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b9b7b1a6-cac2-4dbb-8eb7-59ec3e5dc91a req-429e509a-e3e2-40d5-96b3-81c8026919fa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067822 Aug 02 07:11:14.603829 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2427/4919] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:14.608857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:14.609303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:14.611057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:14.612302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:14.639777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Getting quotas for project 4a324b72e01a4bbfb25e822709ba2ddc. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:11:14.645404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Getting quotas for user af2e27618e26434e9f320ba83533cfa2 and project 4a324b72e01a4bbfb25e822709ba2ddc. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:11:14.659931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:11:14.662648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:11:14.714823 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5be724b9-7e95-47b2-abeb-d7d82bc14e3d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797525 Aug 02 07:11:14.722239 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2493/4920] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:11:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:11:14.730840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d7fa1f7-ada8-4f89-9a05-752a2c6a8cd5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:14.731815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5d7fa1f7-ada8-4f89-9a05-752a2c6a8cd5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:14.860193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5d7fa1f7-ada8-4f89-9a05-752a2c6a8cd5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:14.872827 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5d7fa1f7-ada8-4f89-9a05-752a2c6a8cd5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1218 microversion: 2.1 time: 0.147905 Aug 02 07:11:14.887309 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2428/4921] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:14 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:14.940817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-785d574f-340f-4c4d-afcf-3a48abcc83b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:14.941437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-785d574f-340f-4c4d-afcf-3a48abcc83b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:14.943044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5754e19e-4e3a-429c-b8b5-fafbe9d22ef0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:14.945748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5754e19e-4e3a-429c-b8b5-fafbe9d22ef0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:14.961700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5754e19e-4e3a-429c-b8b5-fafbe9d22ef0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:14.974408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-785d574f-340f-4c4d-afcf-3a48abcc83b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:14.978230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-785d574f-340f-4c4d-afcf-3a48abcc83b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:14.979281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-785d574f-340f-4c4d-afcf-3a48abcc83b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:14.979796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-785d574f-340f-4c4d-afcf-3a48abcc83b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:14.980592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5754e19e-4e3a-429c-b8b5-fafbe9d22ef0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:14.983777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5754e19e-4e3a-429c-b8b5-fafbe9d22ef0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:14.983777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5754e19e-4e3a-429c-b8b5-fafbe9d22ef0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:15.042258 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-5754e19e-4e3a-429c-b8b5-fafbe9d22ef0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] HTTP exception thrown: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5754e19e-4e3a-429c-b8b5-fafbe9d22ef0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Request method failure captured: Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 HTTP/1.1 Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mw13SPusoL2oig6z8JKTC1nUbf8Rw_5jT5YPT1CWrOABe8wYL59aYsXiUDtU2vA3es6LryNsakcXkaddV2SmWSmf9b0Kir8iKyeHQ1V913RDI7OxthQkB34rsjOk5zDf7k87yoaJrxDD4eFsnTmbVoTrOLyxwi8jQau6VljX5rXYUE Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ee1befa077542b9a17865baad3c9999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}] Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3a2629fa08b5419a96c2942118d38dad Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '65f2010c-11ee-485b-b841-11e8b795aeb8'} Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:15.052634 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:15.057964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:15.057964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:15.057964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:15.057964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:15.057964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:15.057964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:15.057964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:15.057964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5754e19e-4e3a-429c-b8b5-fafbe9d22ef0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Returning 404 to user: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:15.066205 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5754e19e-4e3a-429c-b8b5-fafbe9d22ef0 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 404 len: 111 microversion: 2.1 time: 0.125652 Aug 02 07:11:15.068206 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2494/4922] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:14 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:15.080164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bf862dc5-edff-47c5-b2f8-093f115ca045 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:15.081167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bf862dc5-edff-47c5-b2f8-093f115ca045 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:15.092684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf862dc5-edff-47c5-b2f8-093f115ca045 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:15.093451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf862dc5-edff-47c5-b2f8-093f115ca045 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:15.094446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf862dc5-edff-47c5-b2f8-093f115ca045 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:15.095050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf862dc5-edff-47c5-b2f8-093f115ca045 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:15.686602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-785d574f-340f-4c4d-afcf-3a48abcc83b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:15.700830 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-785d574f-340f-4c4d-afcf-3a48abcc83b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.766252 Aug 02 07:11:15.702273 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2429/4923] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:14 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:15.717809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d58b77be-6655-4bba-abba-89e18eea6881 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '.version_select at 0x7f928c43ae50>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:15.763572 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d58b77be-6655-4bba-abba-89e18eea6881 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599287358" status: 202 len: 0 microversion: 2.1 time: 0.055241 Aug 02 07:11:15.766473 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2430/4924] 10.222.0.79 () {58 vars in 1221 bytes} [Tue Aug 2 07:11:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599287358 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:11:15.772464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-95d62933-3a39-43ac-81d4-fa62a6c00481 req-4b0327d8-a451-4863-8729-8e712154795a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f30eee-cead-423c-995f-3148f1ccb0b4", "name": "network-vif-plugged", "status": "completed", "tag": "76b8561b-ea50-4b30-b705-61d124891db1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:15.787363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-95d62933-3a39-43ac-81d4-fa62a6c00481 req-4b0327d8-a451-4863-8729-8e712154795a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:15.788208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-95d62933-3a39-43ac-81d4-fa62a6c00481 req-4b0327d8-a451-4863-8729-8e712154795a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:15.802530 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-95d62933-3a39-43ac-81d4-fa62a6c00481 req-4b0327d8-a451-4863-8729-8e712154795a service nova] Creating event network-vif-plugged:76b8561b-ea50-4b30-b705-61d124891db1 for instance 03f30eee-cead-423c-995f-3148f1ccb0b4 on n-h1-851337-3 Aug 02 07:11:15.809239 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-95d62933-3a39-43ac-81d4-fa62a6c00481 req-4b0327d8-a451-4863-8729-8e712154795a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041224 Aug 02 07:11:15.815028 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2431/4925] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:15.821785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6b972791-0ee3-48b2-90cb-0e02afe60e22 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:15.822897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6b972791-0ee3-48b2-90cb-0e02afe60e22 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:15.830633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b972791-0ee3-48b2-90cb-0e02afe60e22 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:15.832124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b972791-0ee3-48b2-90cb-0e02afe60e22 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:15.833273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b972791-0ee3-48b2-90cb-0e02afe60e22 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:15.834680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b972791-0ee3-48b2-90cb-0e02afe60e22 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:15.919828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bf862dc5-edff-47c5-b2f8-093f115ca045 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:15.934112 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bf862dc5-edff-47c5-b2f8-093f115ca045 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1328 microversion: 2.1 time: 0.864162 Aug 02 07:11:15.938091 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2495/4926] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:15 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1328 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:15.953838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-600088de-7df2-4b84-8f3a-ec2496d1aa18 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:15.954781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-600088de-7df2-4b84-8f3a-ec2496d1aa18 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 698accff-ea86-4c25-9757-cf21b7e06d5e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:15.965003 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-600088de-7df2-4b84-8f3a-ec2496d1aa18 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:15.965738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-600088de-7df2-4b84-8f3a-ec2496d1aa18 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:15.966718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-600088de-7df2-4b84-8f3a-ec2496d1aa18 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:15.967323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-600088de-7df2-4b84-8f3a-ec2496d1aa18 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:15.995802 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-600088de-7df2-4b84-8f3a-ec2496d1aa18 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] HTTP exception thrown: Instance 698accff-ea86-4c25-9757-cf21b7e06d5e could not be found. Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-600088de-7df2-4b84-8f3a-ec2496d1aa18 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Request method failure captured: Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e HTTP/1.1 Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M3RlQscmyWUrrGZ0wMG1-Dut_tpuRrjqjHKQjYuNHNA8CKZtvQDNTaek6BcnYp7sdBB4jiI4OZhfH0D5KgYuIrtwbMrckIyCYsUJCh5R788nBQu7sXN911JJ4SG28o55pqe2_9P9hnizYugEyz6Br80mcjf-XdSqz8W-j8oYdedF6A Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6adeb58dc1964c3b93a757b1440b5624 Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ListServerFiltersTestJSON-70137300 Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6adeb58dc1964c3b93a757b1440b5624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6adeb58dc1964c3b93a757b1440b5624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6adeb58dc1964c3b93a757b1440b5624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6adeb58dc1964c3b93a757b1440b5624"}]}] Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ListServerFiltersTestJSON-70137300 Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6adeb58dc1964c3b93a757b1440b5624 Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-70137300 Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ListServerFiltersTestJSON-70137300-project Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 67a8eca82e1747eba4bd9a283720df28 Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ListServerFiltersTestJSON-70137300-project Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 698accff-ea86-4c25-9757-cf21b7e06d5e could not be found. Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '698accff-ea86-4c25-9757-cf21b7e06d5e'} Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698accff-ea86-4c25-9757-cf21b7e06d5e could not be found. Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698accff-ea86-4c25-9757-cf21b7e06d5e could not be found. Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:15.997570 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:16.001918 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:16.001918 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:16.001918 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:16.001918 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:16.001918 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:16.001918 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698accff-ea86-4c25-9757-cf21b7e06d5e could not be found. Aug 02 07:11:16.001918 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:16.001918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-600088de-7df2-4b84-8f3a-ec2496d1aa18 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Returning 404 to user: Instance 698accff-ea86-4c25-9757-cf21b7e06d5e could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:16.001918 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-600088de-7df2-4b84-8f3a-ec2496d1aa18 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e" status: 404 len: 111 microversion: 2.1 time: 0.059771 Aug 02 07:11:16.003812 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2496/4927] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:15 2022] GET /compute/v2.1/servers/698accff-ea86-4c25-9757-cf21b7e06d5e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:16.010023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aab49eb8-6de4-4a1e-b118-63abe9df4014 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:16.010654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aab49eb8-6de4-4a1e-b118-63abe9df4014 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:16.017716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aab49eb8-6de4-4a1e-b118-63abe9df4014 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:16.018214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aab49eb8-6de4-4a1e-b118-63abe9df4014 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:16.019005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aab49eb8-6de4-4a1e-b118-63abe9df4014 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:16.019448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aab49eb8-6de4-4a1e-b118-63abe9df4014 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:16.052465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:16.181167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-aab49eb8-6de4-4a1e-b118-63abe9df4014 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:16.203307 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aab49eb8-6de4-4a1e-b118-63abe9df4014 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1214 microversion: 2.1 time: 0.198000 Aug 02 07:11:16.204906 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2497/4928] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:16 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1214 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:16.210919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-db03abf4-e1bd-42a8-bea9-2f4cf633a08b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:16.211648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-db03abf4-e1bd-42a8-bea9-2f4cf633a08b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: fd8b1e0a-9584-420c-82e0-5c60e8d17a35] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:16.223358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db03abf4-e1bd-42a8-bea9-2f4cf633a08b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:16.223935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db03abf4-e1bd-42a8-bea9-2f4cf633a08b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:16.224887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db03abf4-e1bd-42a8-bea9-2f4cf633a08b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:16.225638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db03abf4-e1bd-42a8-bea9-2f4cf633a08b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:16.264772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-db03abf4-e1bd-42a8-bea9-2f4cf633a08b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: fd8b1e0a-9584-420c-82e0-5c60e8d17a35] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:11:16.383972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6b972791-0ee3-48b2-90cb-0e02afe60e22 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:16.389963 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-db03abf4-e1bd-42a8-bea9-2f4cf633a08b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35" status: 204 len: 0 microversion: 2.1 time: 0.183678 Aug 02 07:11:16.391020 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2498/4929] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:16 2022] DELETE /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:11:16.397156 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6b972791-0ee3-48b2-90cb-0e02afe60e22 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1319 microversion: 2.1 time: 0.580224 Aug 02 07:11:16.399630 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2432/4930] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:15 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1319 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:16.406624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ffe5afd4-1f7e-4ad1-a646-66cff4765d88 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:16.407861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ffe5afd4-1f7e-4ad1-a646-66cff4765d88 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: fd8b1e0a-9584-420c-82e0-5c60e8d17a35] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:16.416702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ffe5afd4-1f7e-4ad1-a646-66cff4765d88 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:16.417230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ffe5afd4-1f7e-4ad1-a646-66cff4765d88 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:16.418090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ffe5afd4-1f7e-4ad1-a646-66cff4765d88 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:16.418538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ffe5afd4-1f7e-4ad1-a646-66cff4765d88 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:16.729043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d07ebdb9-6195-4a8d-a608-a2a5a9a5d9ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:16.730399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d07ebdb9-6195-4a8d-a608-a2a5a9a5d9ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:16.741784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d07ebdb9-6195-4a8d-a608-a2a5a9a5d9ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:16.742652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d07ebdb9-6195-4a8d-a608-a2a5a9a5d9ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:16.745582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d07ebdb9-6195-4a8d-a608-a2a5a9a5d9ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:16.747313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d07ebdb9-6195-4a8d-a608-a2a5a9a5d9ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:17.263104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ffe5afd4-1f7e-4ad1-a646-66cff4765d88 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:17.271862 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ffe5afd4-1f7e-4ad1-a646-66cff4765d88 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35" status: 200 len: 1516 microversion: 2.1 time: 0.872355 Aug 02 07:11:17.272810 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2499/4931] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:16 2022] GET /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35 => generated 1516 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:17.278072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-92b0c8af-a6e7-4db4-9f41-df573820f8e4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:17.279524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-92b0c8af-a6e7-4db4-9f41-df573820f8e4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:17.290417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-92b0c8af-a6e7-4db4-9f41-df573820f8e4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:17.290996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-92b0c8af-a6e7-4db4-9f41-df573820f8e4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:17.291842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-92b0c8af-a6e7-4db4-9f41-df573820f8e4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:17.292349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-92b0c8af-a6e7-4db4-9f41-df573820f8e4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:17.315324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d07ebdb9-6195-4a8d-a608-a2a5a9a5d9ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:17.332763 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d07ebdb9-6195-4a8d-a608-a2a5a9a5d9ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.610432 Aug 02 07:11:17.333857 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2433/4932] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:16 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:17.340914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-df071e2e-d450-4a11-951b-007e78617619 req-f97aaafe-7da7-4814-823f-4f98484cb379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32378f59-645b-4f54-8d09-d30c783496d1", "name": "network-vif-deleted", "tag": "5f4865d9-a451-4b8f-929a-4afc9ed99e04"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:17.353100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-df071e2e-d450-4a11-951b-007e78617619 req-f97aaafe-7da7-4814-823f-4f98484cb379 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:17.353823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-df071e2e-d450-4a11-951b-007e78617619 req-f97aaafe-7da7-4814-823f-4f98484cb379 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:17.372529 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-df071e2e-d450-4a11-951b-007e78617619 req-f97aaafe-7da7-4814-823f-4f98484cb379 service nova] Creating event network-vif-deleted:5f4865d9-a451-4b8f-929a-4afc9ed99e04 for instance 32378f59-645b-4f54-8d09-d30c783496d1 on n-h2-851337-3 Aug 02 07:11:17.380470 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-df071e2e-d450-4a11-951b-007e78617619 req-f97aaafe-7da7-4814-823f-4f98484cb379 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044603 Aug 02 07:11:17.381257 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2434/4933] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:17.390752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ebb95d08-0c87-4f72-9396-1f3c3246b684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:17.391466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ebb95d08-0c87-4f72-9396-1f3c3246b684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:17.400389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebb95d08-0c87-4f72-9396-1f3c3246b684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:17.401233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebb95d08-0c87-4f72-9396-1f3c3246b684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:17.402915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebb95d08-0c87-4f72-9396-1f3c3246b684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:17.403631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebb95d08-0c87-4f72-9396-1f3c3246b684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:17.543180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ebb95d08-0c87-4f72-9396-1f3c3246b684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:17.579765 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ebb95d08-0c87-4f72-9396-1f3c3246b684 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1276 microversion: 2.1 time: 0.196930 Aug 02 07:11:17.580869 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2435/4934] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:17 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:17.588434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-74b5873d-3acb-4df7-b3d5-139e6619650a tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:17.589473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-74b5873d-3acb-4df7-b3d5-139e6619650a tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:17.604618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74b5873d-3acb-4df7-b3d5-139e6619650a tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:17.604937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74b5873d-3acb-4df7-b3d5-139e6619650a tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:17.608550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74b5873d-3acb-4df7-b3d5-139e6619650a tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:17.609109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74b5873d-3acb-4df7-b3d5-139e6619650a tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:17.652117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-92b0c8af-a6e7-4db4-9f41-df573820f8e4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:17.660956 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-92b0c8af-a6e7-4db4-9f41-df573820f8e4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1328 microversion: 2.1 time: 0.386849 Aug 02 07:11:17.661786 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2500/4935] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:17 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1328 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:17.835429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-15a2a969-0d4a-4664-b16b-e17320e630f1 req-699e01db-99bd-48a3-81ca-e0df61db571e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a5964c-4da3-4792-9d53-9c7a77632724", "name": "network-vif-unplugged", "status": "completed", "tag": "a4d951c8-7fd6-4964-b8d1-fffe96300cc7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:17.850181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-15a2a969-0d4a-4664-b16b-e17320e630f1 req-699e01db-99bd-48a3-81ca-e0df61db571e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:17.850623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-15a2a969-0d4a-4664-b16b-e17320e630f1 req-699e01db-99bd-48a3-81ca-e0df61db571e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:17.868293 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-15a2a969-0d4a-4664-b16b-e17320e630f1 req-699e01db-99bd-48a3-81ca-e0df61db571e service nova] Creating event network-vif-unplugged:a4d951c8-7fd6-4964-b8d1-fffe96300cc7 for instance e9a5964c-4da3-4792-9d53-9c7a77632724 on n-h2-851337-3 Aug 02 07:11:17.881036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-15a2a969-0d4a-4664-b16b-e17320e630f1 req-699e01db-99bd-48a3-81ca-e0df61db571e service nova] Instance e9a5964c-4da3-4792-9d53-9c7a77632724 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:11:17.894603 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-15a2a969-0d4a-4664-b16b-e17320e630f1 req-699e01db-99bd-48a3-81ca-e0df61db571e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065947 Aug 02 07:11:17.895908 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2501/4936] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:17.931303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-74b5873d-3acb-4df7-b3d5-139e6619650a tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:17.939534 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-74b5873d-3acb-4df7-b3d5-139e6619650a tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1319 microversion: 2.1 time: 0.357129 Aug 02 07:11:17.941017 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2436/4937] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:17 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:18.212814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-af4e60ef-52d2-465a-a84b-f4ce559dc38d req-b104bf45-3871-40aa-9427-bfc5f708e383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1165b720-c55d-4110-8e97-a0b8252fecd0", "tag": "0204d204-02b1-4e50-b405-131215d30efb"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:18.252638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-af4e60ef-52d2-465a-a84b-f4ce559dc38d req-b104bf45-3871-40aa-9427-bfc5f708e383 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:18.253500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-af4e60ef-52d2-465a-a84b-f4ce559dc38d req-b104bf45-3871-40aa-9427-bfc5f708e383 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:18.269231 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-af4e60ef-52d2-465a-a84b-f4ce559dc38d req-b104bf45-3871-40aa-9427-bfc5f708e383 service nova] Creating event network-changed:0204d204-02b1-4e50-b405-131215d30efb for instance 1165b720-c55d-4110-8e97-a0b8252fecd0 on n-h1-851337-3 Aug 02 07:11:18.312868 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-af4e60ef-52d2-465a-a84b-f4ce559dc38d req-b104bf45-3871-40aa-9427-bfc5f708e383 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097053 Aug 02 07:11:18.315221 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2502/4938] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:18.323093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-eb6f240f-5c3e-4be8-981a-31d8a2d6b45b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:18.323979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-eb6f240f-5c3e-4be8-981a-31d8a2d6b45b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: fd8b1e0a-9584-420c-82e0-5c60e8d17a35] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:18.341730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eb6f240f-5c3e-4be8-981a-31d8a2d6b45b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:18.342698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eb6f240f-5c3e-4be8-981a-31d8a2d6b45b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:18.344076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eb6f240f-5c3e-4be8-981a-31d8a2d6b45b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:18.344769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eb6f240f-5c3e-4be8-981a-31d8a2d6b45b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:18.365633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9a57835a-64e0-4c18-b421-7f6dc33436e5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:18.366435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9a57835a-64e0-4c18-b421-7f6dc33436e5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:18.392505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a57835a-64e0-4c18-b421-7f6dc33436e5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:18.393999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a57835a-64e0-4c18-b421-7f6dc33436e5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:18.395741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a57835a-64e0-4c18-b421-7f6dc33436e5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:18.398963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a57835a-64e0-4c18-b421-7f6dc33436e5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:18.896564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-eb6f240f-5c3e-4be8-981a-31d8a2d6b45b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:18.908888 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-eb6f240f-5c3e-4be8-981a-31d8a2d6b45b tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35" status: 200 len: 1516 microversion: 2.1 time: 0.615955 Aug 02 07:11:18.912036 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2437/4939] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:18 2022] GET /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35 => generated 1516 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:18.922834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1f0e9e1c-89eb-43f7-96bc-b0aa388de47f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:18.924461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1f0e9e1c-89eb-43f7-96bc-b0aa388de47f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:18.941101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f0e9e1c-89eb-43f7-96bc-b0aa388de47f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:18.945224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f0e9e1c-89eb-43f7-96bc-b0aa388de47f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:18.946300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f0e9e1c-89eb-43f7-96bc-b0aa388de47f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:18.950225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f0e9e1c-89eb-43f7-96bc-b0aa388de47f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:19.274720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9a57835a-64e0-4c18-b421-7f6dc33436e5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:19.292766 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9a57835a-64e0-4c18-b421-7f6dc33436e5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.932197 Aug 02 07:11:19.294711 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2503/4940] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:18 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:19.306025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-765b0a57-2445-425d-93ac-6d8775752ea7 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:19.306652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-765b0a57-2445-425d-93ac-6d8775752ea7 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:19.334658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-765b0a57-2445-425d-93ac-6d8775752ea7 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:19.336895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-765b0a57-2445-425d-93ac-6d8775752ea7 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:19.337730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-765b0a57-2445-425d-93ac-6d8775752ea7 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:19.338444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-765b0a57-2445-425d-93ac-6d8775752ea7 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:19.348962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1f0e9e1c-89eb-43f7-96bc-b0aa388de47f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:19.371016 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1f0e9e1c-89eb-43f7-96bc-b0aa388de47f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1318 microversion: 2.1 time: 0.453570 Aug 02 07:11:19.374446 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2438/4941] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:18 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:19.381326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c5cd78e7-fdf9-4236-8710-c7afd38af25d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:19.382397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c5cd78e7-fdf9-4236-8710-c7afd38af25d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:19.404576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5cd78e7-fdf9-4236-8710-c7afd38af25d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:19.405051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5cd78e7-fdf9-4236-8710-c7afd38af25d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:19.405993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5cd78e7-fdf9-4236-8710-c7afd38af25d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:19.406424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5cd78e7-fdf9-4236-8710-c7afd38af25d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:19.710248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-765b0a57-2445-425d-93ac-6d8775752ea7 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:19.714321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c5cd78e7-fdf9-4236-8710-c7afd38af25d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:19.721230 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-765b0a57-2445-425d-93ac-6d8775752ea7 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1328 microversion: 2.1 time: 0.420362 Aug 02 07:11:19.722226 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2504/4942] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:19 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1328 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:19.723713 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c5cd78e7-fdf9-4236-8710-c7afd38af25d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1507 microversion: 2.1 time: 0.347939 Aug 02 07:11:19.724298 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2439/4943] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:19 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:19.729011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b291e274-4a56-4fe8-a840-37eb89a1c10f req-32217872-b189-436d-ad1d-3bcbaf2fee00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8b1e0a-9584-420c-82e0-5c60e8d17a35", "name": "network-vif-deleted", "tag": "2561b1e6-dd74-4efb-9bae-86ac94e53546"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:19.758141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b291e274-4a56-4fe8-a840-37eb89a1c10f req-32217872-b189-436d-ad1d-3bcbaf2fee00 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:19.758891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b291e274-4a56-4fe8-a840-37eb89a1c10f req-32217872-b189-436d-ad1d-3bcbaf2fee00 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:19.759350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ec9ca09b-775d-4769-bb2a-c3f4c10c97b9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b128786-7cae-4d51-8195-3a1247cdd69d", "device": "/dev/sdb"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:19.762165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ec9ca09b-775d-4769-bb2a-c3f4c10c97b9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:19.772429 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b291e274-4a56-4fe8-a840-37eb89a1c10f req-32217872-b189-436d-ad1d-3bcbaf2fee00 service nova] Creating event network-vif-deleted:2561b1e6-dd74-4efb-9bae-86ac94e53546 for instance fd8b1e0a-9584-420c-82e0-5c60e8d17a35 on n-h2-851337-3 Aug 02 07:11:19.775639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec9ca09b-775d-4769-bb2a-c3f4c10c97b9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:19.778087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec9ca09b-775d-4769-bb2a-c3f4c10c97b9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:19.778982 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b291e274-4a56-4fe8-a840-37eb89a1c10f req-32217872-b189-436d-ad1d-3bcbaf2fee00 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053548 Aug 02 07:11:19.779543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec9ca09b-775d-4769-bb2a-c3f4c10c97b9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:19.779667 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2505/4944] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:19.780353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec9ca09b-775d-4769-bb2a-c3f4c10c97b9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:19.937299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c6a465f9-add2-4016-a16f-fee186d769a1 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:19.938369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c6a465f9-add2-4016-a16f-fee186d769a1 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: fd8b1e0a-9584-420c-82e0-5c60e8d17a35] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:19.945844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6a465f9-add2-4016-a16f-fee186d769a1 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:19.946938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6a465f9-add2-4016-a16f-fee186d769a1 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:19.947960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6a465f9-add2-4016-a16f-fee186d769a1 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:19.948616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6a465f9-add2-4016-a16f-fee186d769a1 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:19.964847 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-c6a465f9-add2-4016-a16f-fee186d769a1 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] HTTP exception thrown: Instance fd8b1e0a-9584-420c-82e0-5c60e8d17a35 could not be found. Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c6a465f9-add2-4016-a16f-fee186d769a1 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Request method failure captured: Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35 HTTP/1.1 Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M3RlQscmyWUrrGZ0wMG1-Dut_tpuRrjqjHKQjYuNHNA8CKZtvQDNTaek6BcnYp7sdBB4jiI4OZhfH0D5KgYuIrtwbMrckIyCYsUJCh5R788nBQu7sXN911JJ4SG28o55pqe2_9P9hnizYugEyz6Br80mcjf-XdSqz8W-j8oYdedF6A Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6adeb58dc1964c3b93a757b1440b5624 Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ListServerFiltersTestJSON-70137300 Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6adeb58dc1964c3b93a757b1440b5624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6adeb58dc1964c3b93a757b1440b5624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6adeb58dc1964c3b93a757b1440b5624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6adeb58dc1964c3b93a757b1440b5624"}]}] Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ListServerFiltersTestJSON-70137300 Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6adeb58dc1964c3b93a757b1440b5624 Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-70137300 Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ListServerFiltersTestJSON-70137300-project Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 67a8eca82e1747eba4bd9a283720df28 Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ListServerFiltersTestJSON-70137300-project Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance fd8b1e0a-9584-420c-82e0-5c60e8d17a35 could not be found. Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'fd8b1e0a-9584-420c-82e0-5c60e8d17a35'} Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd8b1e0a-9584-420c-82e0-5c60e8d17a35 could not be found. Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd8b1e0a-9584-420c-82e0-5c60e8d17a35 could not be found. Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:19.968061 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:19.973016 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:19.973016 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:19.973016 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:19.973016 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:19.973016 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:19.973016 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd8b1e0a-9584-420c-82e0-5c60e8d17a35 could not be found. Aug 02 07:11:19.973016 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:19.974513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c6a465f9-add2-4016-a16f-fee186d769a1 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Returning 404 to user: Instance fd8b1e0a-9584-420c-82e0-5c60e8d17a35 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:19.975570 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c6a465f9-add2-4016-a16f-fee186d769a1 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35" status: 404 len: 111 microversion: 2.1 time: 0.042897 Aug 02 07:11:19.976665 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2506/4945] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:19 2022] GET /compute/v2.1/servers/fd8b1e0a-9584-420c-82e0-5c60e8d17a35 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:19.985336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2c65856-4cd8-43a0-a301-bb0c9c06ec62 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:19.986575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f2c65856-4cd8-43a0-a301-bb0c9c06ec62 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:19.995823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2c65856-4cd8-43a0-a301-bb0c9c06ec62 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:19.996547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2c65856-4cd8-43a0-a301-bb0c9c06ec62 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:19.998062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2c65856-4cd8-43a0-a301-bb0c9c06ec62 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:19.998845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2c65856-4cd8-43a0-a301-bb0c9c06ec62 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:20.028645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f2c65856-4cd8-43a0-a301-bb0c9c06ec62 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:11:20.130474 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f2c65856-4cd8-43a0-a301-bb0c9c06ec62 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 204 len: 0 microversion: 2.1 time: 0.149082 Aug 02 07:11:20.131308 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2507/4946] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:19 2022] DELETE /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:11:20.141277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43fd2c74-14b6-4339-9473-7cc20012873a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:20.142125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-43fd2c74-14b6-4339-9473-7cc20012873a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:20.152449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43fd2c74-14b6-4339-9473-7cc20012873a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:20.153160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43fd2c74-14b6-4339-9473-7cc20012873a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:20.154662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43fd2c74-14b6-4339-9473-7cc20012873a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:20.155568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43fd2c74-14b6-4339-9473-7cc20012873a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:20.312361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43fd2c74-14b6-4339-9473-7cc20012873a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:20.322554 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43fd2c74-14b6-4339-9473-7cc20012873a tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1517 microversion: 2.1 time: 0.186391 Aug 02 07:11:20.323677 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2508/4947] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:20 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:20.329467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d61c1808-dec4-4bf3-b6e8-9cb4490d5d96 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:20.330221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d61c1808-dec4-4bf3-b6e8-9cb4490d5d96 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:20.337973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d61c1808-dec4-4bf3-b6e8-9cb4490d5d96 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:20.338922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d61c1808-dec4-4bf3-b6e8-9cb4490d5d96 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:20.339754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d61c1808-dec4-4bf3-b6e8-9cb4490d5d96 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:20.340195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d61c1808-dec4-4bf3-b6e8-9cb4490d5d96 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:20.442567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=14 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:20.495150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d61c1808-dec4-4bf3-b6e8-9cb4490d5d96 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:20.504007 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d61c1808-dec4-4bf3-b6e8-9cb4490d5d96 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.178801 Aug 02 07:11:20.504777 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2509/4948] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:20 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:20.509638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7cdf6a97-b247-4282-b7dc-3a9c459f9e58 req-f5a224c0-b2a1-435b-817a-77555d255911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a5964c-4da3-4792-9d53-9c7a77632724", "tag": "a4d951c8-7fd6-4964-b8d1-fffe96300cc7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:20.520067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7cdf6a97-b247-4282-b7dc-3a9c459f9e58 req-f5a224c0-b2a1-435b-817a-77555d255911 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:20.520400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7cdf6a97-b247-4282-b7dc-3a9c459f9e58 req-f5a224c0-b2a1-435b-817a-77555d255911 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:20.534027 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7cdf6a97-b247-4282-b7dc-3a9c459f9e58 req-f5a224c0-b2a1-435b-817a-77555d255911 service nova] Creating event network-changed:a4d951c8-7fd6-4964-b8d1-fffe96300cc7 for instance e9a5964c-4da3-4792-9d53-9c7a77632724 on n-h2-851337-3 Aug 02 07:11:20.539908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-7cdf6a97-b247-4282-b7dc-3a9c459f9e58 req-f5a224c0-b2a1-435b-817a-77555d255911 service nova] Instance e9a5964c-4da3-4792-9d53-9c7a77632724 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:11:20.551460 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7cdf6a97-b247-4282-b7dc-3a9c459f9e58 req-f5a224c0-b2a1-435b-817a-77555d255911 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044987 Aug 02 07:11:20.552072 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2510/4949] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:20.558470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-db9b8e41-a7bb-4047-8dc0-ef1f0b90646c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:20.559392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-db9b8e41-a7bb-4047-8dc0-ef1f0b90646c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:20.579930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db9b8e41-a7bb-4047-8dc0-ef1f0b90646c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:20.579930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db9b8e41-a7bb-4047-8dc0-ef1f0b90646c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:20.579930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db9b8e41-a7bb-4047-8dc0-ef1f0b90646c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:20.579930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-db9b8e41-a7bb-4047-8dc0-ef1f0b90646c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:20.707196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-db9b8e41-a7bb-4047-8dc0-ef1f0b90646c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:20.716567 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-db9b8e41-a7bb-4047-8dc0-ef1f0b90646c tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1318 microversion: 2.1 time: 0.163037 Aug 02 07:11:20.717182 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2511/4950] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:20 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:20.758243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4a44224a-0ec8-4391-9371-c914c7ce107b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:20.758868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4a44224a-0ec8-4391-9371-c914c7ce107b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:20.765609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a44224a-0ec8-4391-9371-c914c7ce107b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:20.766078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a44224a-0ec8-4391-9371-c914c7ce107b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:20.766861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a44224a-0ec8-4391-9371-c914c7ce107b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:20.767299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a44224a-0ec8-4391-9371-c914c7ce107b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:20.911322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4a44224a-0ec8-4391-9371-c914c7ce107b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:20.919848 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4a44224a-0ec8-4391-9371-c914c7ce107b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1328 microversion: 2.1 time: 0.165684 Aug 02 07:11:20.920433 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2512/4951] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:20 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1328 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:21.350852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0d079c29-4cd0-4e5a-9103-b2ed190e133c tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:21.352357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0d079c29-4cd0-4e5a-9103-b2ed190e133c tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:21.359559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d079c29-4cd0-4e5a-9103-b2ed190e133c tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:21.360011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d079c29-4cd0-4e5a-9103-b2ed190e133c tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:21.360784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d079c29-4cd0-4e5a-9103-b2ed190e133c tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:21.361222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d079c29-4cd0-4e5a-9103-b2ed190e133c tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:21.381878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:21.506659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0d079c29-4cd0-4e5a-9103-b2ed190e133c tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:21.514520 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0d079c29-4cd0-4e5a-9103-b2ed190e133c tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1517 microversion: 2.1 time: 0.172752 Aug 02 07:11:21.515137 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2513/4952] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:21 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:21.533877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ed2dc0b-5733-42b7-aabd-6467f111ad6a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:21.534517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9ed2dc0b-5733-42b7-aabd-6467f111ad6a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:21.540712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ed2dc0b-5733-42b7-aabd-6467f111ad6a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:21.541169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ed2dc0b-5733-42b7-aabd-6467f111ad6a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:21.541962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ed2dc0b-5733-42b7-aabd-6467f111ad6a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:21.542408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ed2dc0b-5733-42b7-aabd-6467f111ad6a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:21.692027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9ed2dc0b-5733-42b7-aabd-6467f111ad6a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:21.699959 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9ed2dc0b-5733-42b7-aabd-6467f111ad6a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.170962 Aug 02 07:11:21.700628 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2514/4953] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:21 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:21.705127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4d6d9f84-75f6-4e3e-b829-b3c4c004c0b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:21.705665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4d6d9f84-75f6-4e3e-b829-b3c4c004c0b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:21.712131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d6d9f84-75f6-4e3e-b829-b3c4c004c0b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:21.712591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d6d9f84-75f6-4e3e-b829-b3c4c004c0b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:21.713376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d6d9f84-75f6-4e3e-b829-b3c4c004c0b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:21.713815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d6d9f84-75f6-4e3e-b829-b3c4c004c0b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:21.728210 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-4d6d9f84-75f6-4e3e-b829-b3c4c004c0b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] HTTP exception thrown: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4d6d9f84-75f6-4e3e-b829-b3c4c004c0b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Request method failure captured: Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 HTTP/1.1 Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mw13SPusoL2oig6z8JKTC1nUbf8Rw_5jT5YPT1CWrOABe8wYL59aYsXiUDtU2vA3es6LryNsakcXkaddV2SmWSmf9b0Kir8iKyeHQ1V913RDI7OxthQkB34rsjOk5zDf7k87yoaJrxDD4eFsnTmbVoTrOLyxwi8jQau6VljX5rXYUE Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ee1befa077542b9a17865baad3c9999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}] Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3a2629fa08b5419a96c2942118d38dad Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '65f2010c-11ee-485b-b841-11e8b795aeb8'} Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:21.729997 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:21.734484 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:21.734484 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:21.734484 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:21.734484 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:21.734484 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:21.734484 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:21.734484 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:21.734484 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:21.734484 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:21.734484 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:21.734484 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:21.734484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4d6d9f84-75f6-4e3e-b829-b3c4c004c0b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Returning 404 to user: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:21.734484 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4d6d9f84-75f6-4e3e-b829-b3c4c004c0b7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 404 len: 111 microversion: 2.1 time: 0.029797 Aug 02 07:11:21.734484 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2515/4954] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:21 2022] DELETE /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:21.740909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fa8966bc-7cf6-4f88-844f-cb22fd0ca7c5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:21.741525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fa8966bc-7cf6-4f88-844f-cb22fd0ca7c5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:21.748215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa8966bc-7cf6-4f88-844f-cb22fd0ca7c5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:21.748670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa8966bc-7cf6-4f88-844f-cb22fd0ca7c5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:21.749447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa8966bc-7cf6-4f88-844f-cb22fd0ca7c5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:21.749885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa8966bc-7cf6-4f88-844f-cb22fd0ca7c5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:21.885219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fa8966bc-7cf6-4f88-844f-cb22fd0ca7c5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:21.893147 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fa8966bc-7cf6-4f88-844f-cb22fd0ca7c5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1318 microversion: 2.1 time: 0.156014 Aug 02 07:11:21.893727 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2516/4955] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:21 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:21.898347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-187d1c4a-df0a-42d9-8baf-ecb0306d96f7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:21.898955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-187d1c4a-df0a-42d9-8baf-ecb0306d96f7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 65f2010c-11ee-485b-b841-11e8b795aeb8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:21.905269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-187d1c4a-df0a-42d9-8baf-ecb0306d96f7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:21.905859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-187d1c4a-df0a-42d9-8baf-ecb0306d96f7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:21.906740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-187d1c4a-df0a-42d9-8baf-ecb0306d96f7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:21.907241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-187d1c4a-df0a-42d9-8baf-ecb0306d96f7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:21.921091 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-187d1c4a-df0a-42d9-8baf-ecb0306d96f7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] HTTP exception thrown: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-187d1c4a-df0a-42d9-8baf-ecb0306d96f7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Request method failure captured: Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 HTTP/1.1 Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mw13SPusoL2oig6z8JKTC1nUbf8Rw_5jT5YPT1CWrOABe8wYL59aYsXiUDtU2vA3es6LryNsakcXkaddV2SmWSmf9b0Kir8iKyeHQ1V913RDI7OxthQkB34rsjOk5zDf7k87yoaJrxDD4eFsnTmbVoTrOLyxwi8jQau6VljX5rXYUE Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ee1befa077542b9a17865baad3c9999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}] Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3a2629fa08b5419a96c2942118d38dad Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '65f2010c-11ee-485b-b841-11e8b795aeb8'} Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:21.922826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:21.927322 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:21.927322 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:21.927322 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:21.927322 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:21.927322 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:21.927322 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. Aug 02 07:11:21.927322 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:21.927322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-187d1c4a-df0a-42d9-8baf-ecb0306d96f7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Returning 404 to user: Instance 65f2010c-11ee-485b-b841-11e8b795aeb8 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:21.927322 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-187d1c4a-df0a-42d9-8baf-ecb0306d96f7 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8" status: 404 len: 111 microversion: 2.1 time: 0.029546 Aug 02 07:11:21.927322 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2517/4956] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:21 2022] GET /compute/v2.1/servers/65f2010c-11ee-485b-b841-11e8b795aeb8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:21.940534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-98553a72-e43d-4142-bbbb-b71a4d32ed85 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:21.941239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-98553a72-e43d-4142-bbbb-b71a4d32ed85 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:21.948024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98553a72-e43d-4142-bbbb-b71a4d32ed85 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:21.948549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98553a72-e43d-4142-bbbb-b71a4d32ed85 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:21.949387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98553a72-e43d-4142-bbbb-b71a4d32ed85 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:21.949929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98553a72-e43d-4142-bbbb-b71a4d32ed85 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:22.104136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-98553a72-e43d-4142-bbbb-b71a4d32ed85 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:22.112266 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-98553a72-e43d-4142-bbbb-b71a4d32ed85 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1328 microversion: 2.1 time: 0.175664 Aug 02 07:11:22.112844 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2518/4957] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:21 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1328 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:22.381557 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ec9ca09b-775d-4769-bb2a-c3f4c10c97b9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "POST /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.625644 Aug 02 07:11:22.391521 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2440/4958] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:11:19 2022] POST /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4/os-volume_attachments => generated 194 bytes in 2638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:22.539329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dee22eb0-f523-4720-928d-f2291cc4b9bd tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:22.540022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dee22eb0-f523-4720-928d-f2291cc4b9bd tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:22.542972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:22.551290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dee22eb0-f523-4720-928d-f2291cc4b9bd tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:22.552042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dee22eb0-f523-4720-928d-f2291cc4b9bd tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:22.553001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dee22eb0-f523-4720-928d-f2291cc4b9bd tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:22.553662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dee22eb0-f523-4720-928d-f2291cc4b9bd tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:22.721863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9479e631-ae0e-4df3-bf17-513073893794 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:22.722696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9479e631-ae0e-4df3-bf17-513073893794 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:22.738074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9479e631-ae0e-4df3-bf17-513073893794 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:22.743537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9479e631-ae0e-4df3-bf17-513073893794 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:22.744683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9479e631-ae0e-4df3-bf17-513073893794 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:22.745341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9479e631-ae0e-4df3-bf17-513073893794 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:23.291324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dee22eb0-f523-4720-928d-f2291cc4b9bd tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:23.304657 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dee22eb0-f523-4720-928d-f2291cc4b9bd tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1517 microversion: 2.1 time: 0.769377 Aug 02 07:11:23.306419 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2519/4959] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:22 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1517 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:23.316933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2d15ef0e-0cef-4364-9bd5-8b19d1a802f7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:23.317962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2d15ef0e-0cef-4364-9bd5-8b19d1a802f7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:23.339973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d15ef0e-0cef-4364-9bd5-8b19d1a802f7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:23.343248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d15ef0e-0cef-4364-9bd5-8b19d1a802f7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:23.345187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d15ef0e-0cef-4364-9bd5-8b19d1a802f7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:23.347580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d15ef0e-0cef-4364-9bd5-8b19d1a802f7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:23.403957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9479e631-ae0e-4df3-bf17-513073893794 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:23.419017 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9479e631-ae0e-4df3-bf17-513073893794 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1690 microversion: 2.1 time: 0.701893 Aug 02 07:11:23.423467 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2441/4960] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:22 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1690 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:23.434283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-452bd65e-e23e-4a3b-9452-bc43bc17d171 req-1ba0327b-24e3-47e2-aa28-cbdb34665ecd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b1beaf-f005-4422-865a-e876cf79a1f4", "tag": "d07222b2-653a-4c37-ab00-8d03e3bc9a58"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:23.472741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-452bd65e-e23e-4a3b-9452-bc43bc17d171 req-1ba0327b-24e3-47e2-aa28-cbdb34665ecd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:23.477257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-452bd65e-e23e-4a3b-9452-bc43bc17d171 req-1ba0327b-24e3-47e2-aa28-cbdb34665ecd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:23.517971 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-452bd65e-e23e-4a3b-9452-bc43bc17d171 req-1ba0327b-24e3-47e2-aa28-cbdb34665ecd service nova] Creating event network-changed:d07222b2-653a-4c37-ab00-8d03e3bc9a58 for instance a1b1beaf-f005-4422-865a-e876cf79a1f4 on n-h1-851337-3 Aug 02 07:11:23.537578 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-452bd65e-e23e-4a3b-9452-bc43bc17d171 req-1ba0327b-24e3-47e2-aa28-cbdb34665ecd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108349 Aug 02 07:11:23.542742 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2442/4961] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:23.548508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7545a50b-d865-4984-b5b5-69218250c44f tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:23.555672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7545a50b-d865-4984-b5b5-69218250c44f tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:23.569829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7545a50b-d865-4984-b5b5-69218250c44f tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:23.571784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7545a50b-d865-4984-b5b5-69218250c44f tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:23.573488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7545a50b-d865-4984-b5b5-69218250c44f tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:23.576176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7545a50b-d865-4984-b5b5-69218250c44f tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:23.902949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2d15ef0e-0cef-4364-9bd5-8b19d1a802f7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:23.915714 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2d15ef0e-0cef-4364-9bd5-8b19d1a802f7 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1318 microversion: 2.1 time: 0.604921 Aug 02 07:11:23.925914 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2520/4962] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:23 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:24.051167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7545a50b-d865-4984-b5b5-69218250c44f tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:24.067771 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7545a50b-d865-4984-b5b5-69218250c44f tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1328 microversion: 2.1 time: 0.523399 Aug 02 07:11:24.096528 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2443/4963] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:23 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1328 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:24.331706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-30dcedfd-edcb-4a66-8d5d-fba79bd49fe6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:24.332530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-30dcedfd-edcb-4a66-8d5d-fba79bd49fe6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:24.343284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30dcedfd-edcb-4a66-8d5d-fba79bd49fe6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:24.350134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30dcedfd-edcb-4a66-8d5d-fba79bd49fe6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:24.351440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30dcedfd-edcb-4a66-8d5d-fba79bd49fe6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:24.352135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30dcedfd-edcb-4a66-8d5d-fba79bd49fe6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:24.400841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-0d267d72-7938-4e5b-a464-f01010f48fb8 req-04f68a77-2f39-4f0a-8690-c0264eac069a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d100437-b34c-4421-8793-64b8a4480a56", "name": "network-vif-deleted", "tag": "b6435b4c-d475-4e8b-8eae-b2a4f33ad4f1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:24.416892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0d267d72-7938-4e5b-a464-f01010f48fb8 req-04f68a77-2f39-4f0a-8690-c0264eac069a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:24.424820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0d267d72-7938-4e5b-a464-f01010f48fb8 req-04f68a77-2f39-4f0a-8690-c0264eac069a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:24.458320 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-0d267d72-7938-4e5b-a464-f01010f48fb8 req-04f68a77-2f39-4f0a-8690-c0264eac069a service nova] Creating event network-vif-deleted:b6435b4c-d475-4e8b-8eae-b2a4f33ad4f1 for instance 9d100437-b34c-4421-8793-64b8a4480a56 on n-h2-851337-3 Aug 02 07:11:24.472795 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-0d267d72-7938-4e5b-a464-f01010f48fb8 req-04f68a77-2f39-4f0a-8690-c0264eac069a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076406 Aug 02 07:11:24.477116 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2444/4964] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:24.483022 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ae73fe99-0b3f-47a5-b4c4-3eb8911d4685 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:24.488570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ae73fe99-0b3f-47a5-b4c4-3eb8911d4685 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:24.499761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-30dcedfd-edcb-4a66-8d5d-fba79bd49fe6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a8eca82e1747eba4bd9a283720df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adeb58dc1964c3b93a757b1440b5624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:24.514680 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-30dcedfd-edcb-4a66-8d5d-fba79bd49fe6 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 200 len: 1475 microversion: 2.1 time: 0.189931 Aug 02 07:11:24.517643 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2521/4965] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:24 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 1475 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:24.518007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae73fe99-0b3f-47a5-b4c4-3eb8911d4685 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:24.518763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae73fe99-0b3f-47a5-b4c4-3eb8911d4685 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:24.519959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae73fe99-0b3f-47a5-b4c4-3eb8911d4685 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:24.521367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae73fe99-0b3f-47a5-b4c4-3eb8911d4685 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:24.547377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:24.755816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ae73fe99-0b3f-47a5-b4c4-3eb8911d4685 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:24.772019 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ae73fe99-0b3f-47a5-b4c4-3eb8911d4685 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1683 microversion: 2.1 time: 0.293472 Aug 02 07:11:24.775494 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2445/4966] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:24 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1683 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:24.941552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5b0452a0-59bc-41c8-8b2f-390f9cf9b496 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:24.942295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5b0452a0-59bc-41c8-8b2f-390f9cf9b496 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:24.945024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:24.945805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=16 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:24.952094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b0452a0-59bc-41c8-8b2f-390f9cf9b496 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:24.952849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b0452a0-59bc-41c8-8b2f-390f9cf9b496 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:24.953711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b0452a0-59bc-41c8-8b2f-390f9cf9b496 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:24.954257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5b0452a0-59bc-41c8-8b2f-390f9cf9b496 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:25.109518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f5ebf6cb-b582-4535-9be1-3c1e0fe8377b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:25.110689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f5ebf6cb-b582-4535-9be1-3c1e0fe8377b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:25.120315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:25.122019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5ebf6cb-b582-4535-9be1-3c1e0fe8377b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:25.122572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5ebf6cb-b582-4535-9be1-3c1e0fe8377b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:25.123445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5ebf6cb-b582-4535-9be1-3c1e0fe8377b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:25.123956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5ebf6cb-b582-4535-9be1-3c1e0fe8377b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:25.146115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5b0452a0-59bc-41c8-8b2f-390f9cf9b496 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:25.157474 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5b0452a0-59bc-41c8-8b2f-390f9cf9b496 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1318 microversion: 2.1 time: 0.221196 Aug 02 07:11:25.159135 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2522/4967] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:24 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:25.293419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f5ebf6cb-b582-4535-9be1-3c1e0fe8377b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:25.302922 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f5ebf6cb-b582-4535-9be1-3c1e0fe8377b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1328 microversion: 2.1 time: 0.201334 Aug 02 07:11:25.304014 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2446/4968] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:25 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1328 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:25.528986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-c0ed51ca-9ee2-4a1d-ad50-dabb0a77faf0 req-c6ef3701-6bc0-46ac-9e8f-d04711c0988a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a5964c-4da3-4792-9d53-9c7a77632724", "name": "network-vif-plugged", "status": "completed", "tag": "a4d951c8-7fd6-4964-b8d1-fffe96300cc7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:25.542713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4d6ed281-b651-4887-96a4-1299d4b334b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:25.543321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4d6ed281-b651-4887-96a4-1299d4b334b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] [instance: 9d100437-b34c-4421-8793-64b8a4480a56] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:25.550129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c0ed51ca-9ee2-4a1d-ad50-dabb0a77faf0 req-c6ef3701-6bc0-46ac-9e8f-d04711c0988a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:25.551046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c0ed51ca-9ee2-4a1d-ad50-dabb0a77faf0 req-c6ef3701-6bc0-46ac-9e8f-d04711c0988a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:25.554306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d6ed281-b651-4887-96a4-1299d4b334b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:25.555100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d6ed281-b651-4887-96a4-1299d4b334b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:25.556476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d6ed281-b651-4887-96a4-1299d4b334b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:25.556945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d6ed281-b651-4887-96a4-1299d4b334b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:25.571504 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-c0ed51ca-9ee2-4a1d-ad50-dabb0a77faf0 req-c6ef3701-6bc0-46ac-9e8f-d04711c0988a service nova] Creating event network-vif-plugged:a4d951c8-7fd6-4964-b8d1-fffe96300cc7 for instance e9a5964c-4da3-4792-9d53-9c7a77632724 on n-h2-851337-3 Aug 02 07:11:25.577944 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-c0ed51ca-9ee2-4a1d-ad50-dabb0a77faf0 req-c6ef3701-6bc0-46ac-9e8f-d04711c0988a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052739 Aug 02 07:11:25.579703 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2523/4969] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:25.584909 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-4d6ed281-b651-4887-96a4-1299d4b334b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] HTTP exception thrown: Instance 9d100437-b34c-4421-8793-64b8a4480a56 could not be found. Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4d6ed281-b651-4887-96a4-1299d4b334b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Request method failure captured: Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 HTTP/1.1 Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M3RlQscmyWUrrGZ0wMG1-Dut_tpuRrjqjHKQjYuNHNA8CKZtvQDNTaek6BcnYp7sdBB4jiI4OZhfH0D5KgYuIrtwbMrckIyCYsUJCh5R788nBQu7sXN911JJ4SG28o55pqe2_9P9hnizYugEyz6Br80mcjf-XdSqz8W-j8oYdedF6A Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 6adeb58dc1964c3b93a757b1440b5624 Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ListServerFiltersTestJSON-70137300 Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6adeb58dc1964c3b93a757b1440b5624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6adeb58dc1964c3b93a757b1440b5624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6adeb58dc1964c3b93a757b1440b5624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6adeb58dc1964c3b93a757b1440b5624"}]}] Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ListServerFiltersTestJSON-70137300 Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 6adeb58dc1964c3b93a757b1440b5624 Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-70137300 Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ListServerFiltersTestJSON-70137300-project Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 67a8eca82e1747eba4bd9a283720df28 Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ListServerFiltersTestJSON-70137300-project Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 9d100437-b34c-4421-8793-64b8a4480a56 could not be found. Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '9d100437-b34c-4421-8793-64b8a4480a56'} Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d100437-b34c-4421-8793-64b8a4480a56 could not be found. Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d100437-b34c-4421-8793-64b8a4480a56 could not be found. Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:25.586927 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:25.593280 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:25.593280 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:25.593280 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:25.593280 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:25.593280 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:25.593280 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d100437-b34c-4421-8793-64b8a4480a56 could not be found. Aug 02 07:11:25.593280 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:25.596409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4d6ed281-b651-4887-96a4-1299d4b334b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] Returning 404 to user: Instance 9d100437-b34c-4421-8793-64b8a4480a56 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:25.597529 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4d6ed281-b651-4887-96a4-1299d4b334b3 tempest-ListServerFiltersTestJSON-70137300 tempest-ListServerFiltersTestJSON-70137300-project] 10.222.0.79 "GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56" status: 404 len: 111 microversion: 2.1 time: 0.059103 Aug 02 07:11:25.598680 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2447/4970] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:25 2022] GET /compute/v2.1/servers/9d100437-b34c-4421-8793-64b8a4480a56 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:11:26.194883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-85709e4a-3517-4e65-8c04-e23a3517b66d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:26.196489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-85709e4a-3517-4e65-8c04-e23a3517b66d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:26.217322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-85709e4a-3517-4e65-8c04-e23a3517b66d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:26.219494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-85709e4a-3517-4e65-8c04-e23a3517b66d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:26.220541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-85709e4a-3517-4e65-8c04-e23a3517b66d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:26.221788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-85709e4a-3517-4e65-8c04-e23a3517b66d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:26.325002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5eed6b4b-eeba-4b6c-ae42-b0904bf7a741 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:26.326913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5eed6b4b-eeba-4b6c-ae42-b0904bf7a741 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:26.348746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5eed6b4b-eeba-4b6c-ae42-b0904bf7a741 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:26.349609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5eed6b4b-eeba-4b6c-ae42-b0904bf7a741 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:26.351094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5eed6b4b-eeba-4b6c-ae42-b0904bf7a741 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:26.355041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5eed6b4b-eeba-4b6c-ae42-b0904bf7a741 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:26.492909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-85709e4a-3517-4e65-8c04-e23a3517b66d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:26.509053 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-85709e4a-3517-4e65-8c04-e23a3517b66d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1318 microversion: 2.1 time: 0.329734 Aug 02 07:11:26.512761 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2524/4971] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:26 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:26.537313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ad89ee21-8df5-4067-81ae-2c28b8cfba6f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:26.540178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ad89ee21-8df5-4067-81ae-2c28b8cfba6f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:26.558647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad89ee21-8df5-4067-81ae-2c28b8cfba6f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:26.559392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad89ee21-8df5-4067-81ae-2c28b8cfba6f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:26.560609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad89ee21-8df5-4067-81ae-2c28b8cfba6f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:26.561742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad89ee21-8df5-4067-81ae-2c28b8cfba6f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:26.595224 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-ad89ee21-8df5-4067-81ae-2c28b8cfba6f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] HTTP exception thrown: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ad89ee21-8df5-4067-81ae-2c28b8cfba6f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Request method failure captured: Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 HTTP/1.1 Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mw13SPusoL2oig6z8JKTC1nUbf8Rw_5jT5YPT1CWrOABe8wYL59aYsXiUDtU2vA3es6LryNsakcXkaddV2SmWSmf9b0Kir8iKyeHQ1V913RDI7OxthQkB34rsjOk5zDf7k87yoaJrxDD4eFsnTmbVoTrOLyxwi8jQau6VljX5rXYUE Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ee1befa077542b9a17865baad3c9999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}] Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3a2629fa08b5419a96c2942118d38dad Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '416496be-7b54-49d4-9d90-3d0be9463e67'} Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:26.599428 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:26.604230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:11:26.604230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.604230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:26.604230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.604230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:26.604230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:26.604230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:26.604230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:26.604230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:26.604230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:11:26.604230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.604230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ad89ee21-8df5-4067-81ae-2c28b8cfba6f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Returning 404 to user: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:26.604230 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ad89ee21-8df5-4067-81ae-2c28b8cfba6f tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 404 len: 111 microversion: 2.1 time: 0.082831 Aug 02 07:11:26.605764 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2525/4972] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:26 2022] DELETE /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:26.612883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-27705222-c36f-4eed-b453-0550631efc06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:26.613507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-27705222-c36f-4eed-b453-0550631efc06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: 416496be-7b54-49d4-9d90-3d0be9463e67] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:26.621377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27705222-c36f-4eed-b453-0550631efc06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:26.621844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27705222-c36f-4eed-b453-0550631efc06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:26.622660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27705222-c36f-4eed-b453-0550631efc06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:26.623112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27705222-c36f-4eed-b453-0550631efc06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:26.643487 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-27705222-c36f-4eed-b453-0550631efc06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] HTTP exception thrown: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-27705222-c36f-4eed-b453-0550631efc06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Request method failure captured: Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 HTTP/1.1 Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mw13SPusoL2oig6z8JKTC1nUbf8Rw_5jT5YPT1CWrOABe8wYL59aYsXiUDtU2vA3es6LryNsakcXkaddV2SmWSmf9b0Kir8iKyeHQ1V913RDI7OxthQkB34rsjOk5zDf7k87yoaJrxDD4eFsnTmbVoTrOLyxwi8jQau6VljX5rXYUE Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ee1befa077542b9a17865baad3c9999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}] Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3a2629fa08b5419a96c2942118d38dad Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '416496be-7b54-49d4-9d90-3d0be9463e67'} Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:26.655785 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.660707 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:26.660707 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:26.660707 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:26.660707 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:26.660707 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:26.660707 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. Aug 02 07:11:26.660707 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.660707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-27705222-c36f-4eed-b453-0550631efc06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Returning 404 to user: Instance 416496be-7b54-49d4-9d90-3d0be9463e67 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:26.662680 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-27705222-c36f-4eed-b453-0550631efc06 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67" status: 404 len: 111 microversion: 2.1 time: 0.053750 Aug 02 07:11:26.666927 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2526/4973] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:26 2022] GET /compute/v2.1/servers/416496be-7b54-49d4-9d90-3d0be9463e67 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:26.676709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ecf04988-4f5e-4213-a737-0962f7e63775 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:26.680384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ecf04988-4f5e-4213-a737-0962f7e63775 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:26.697076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ecf04988-4f5e-4213-a737-0962f7e63775 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:26.697807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ecf04988-4f5e-4213-a737-0962f7e63775 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:26.699068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ecf04988-4f5e-4213-a737-0962f7e63775 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:26.699665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ecf04988-4f5e-4213-a737-0962f7e63775 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:26.723419 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-ecf04988-4f5e-4213-a737-0962f7e63775 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] HTTP exception thrown: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ecf04988-4f5e-4213-a737-0962f7e63775 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Request method failure captured: Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f HTTP/1.1 Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mw13SPusoL2oig6z8JKTC1nUbf8Rw_5jT5YPT1CWrOABe8wYL59aYsXiUDtU2vA3es6LryNsakcXkaddV2SmWSmf9b0Kir8iKyeHQ1V913RDI7OxthQkB34rsjOk5zDf7k87yoaJrxDD4eFsnTmbVoTrOLyxwi8jQau6VljX5rXYUE Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ee1befa077542b9a17865baad3c9999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}] Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3a2629fa08b5419a96c2942118d38dad Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'ee50e87a-eb21-4ce8-82c5-9cf1be097c4f'} Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:26.726063 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:26.730900 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:11:26.730900 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.730900 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:26.730900 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.730900 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:26.730900 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:26.730900 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:26.730900 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:26.730900 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:26.730900 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:11:26.730900 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.730900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ecf04988-4f5e-4213-a737-0962f7e63775 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Returning 404 to user: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:26.730900 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ecf04988-4f5e-4213-a737-0962f7e63775 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 404 len: 111 microversion: 2.1 time: 0.059519 Aug 02 07:11:26.730900 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2527/4974] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:26 2022] DELETE /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:26.740220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6ff9c48f-a482-43ec-ac09-3620f8e5863d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:26.740891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6ff9c48f-a482-43ec-ac09-3620f8e5863d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: ee50e87a-eb21-4ce8-82c5-9cf1be097c4f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:26.761005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ff9c48f-a482-43ec-ac09-3620f8e5863d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:26.761005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ff9c48f-a482-43ec-ac09-3620f8e5863d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:26.761005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ff9c48f-a482-43ec-ac09-3620f8e5863d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:26.761005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ff9c48f-a482-43ec-ac09-3620f8e5863d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:26.779403 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-6ff9c48f-a482-43ec-ac09-3620f8e5863d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] HTTP exception thrown: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6ff9c48f-a482-43ec-ac09-3620f8e5863d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Request method failure captured: Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f HTTP/1.1 Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mw13SPusoL2oig6z8JKTC1nUbf8Rw_5jT5YPT1CWrOABe8wYL59aYsXiUDtU2vA3es6LryNsakcXkaddV2SmWSmf9b0Kir8iKyeHQ1V913RDI7OxthQkB34rsjOk5zDf7k87yoaJrxDD4eFsnTmbVoTrOLyxwi8jQau6VljX5rXYUE Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ee1befa077542b9a17865baad3c9999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}] Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3a2629fa08b5419a96c2942118d38dad Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'ee50e87a-eb21-4ce8-82c5-9cf1be097c4f'} Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:26.783635 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.789244 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:26.789244 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:26.789244 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:26.789244 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:26.789244 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:26.789244 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. Aug 02 07:11:26.789244 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:26.789244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6ff9c48f-a482-43ec-ac09-3620f8e5863d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Returning 404 to user: Instance ee50e87a-eb21-4ce8-82c5-9cf1be097c4f could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:26.789244 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6ff9c48f-a482-43ec-ac09-3620f8e5863d tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f" status: 404 len: 111 microversion: 2.1 time: 0.052618 Aug 02 07:11:26.791242 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2528/4975] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:26 2022] GET /compute/v2.1/servers/ee50e87a-eb21-4ce8-82c5-9cf1be097c4f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:27.026488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5eed6b4b-eeba-4b6c-ae42-b0904bf7a741 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:27.038530 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5eed6b4b-eeba-4b6c-ae42-b0904bf7a741 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1328 microversion: 2.1 time: 0.717329 Aug 02 07:11:27.039312 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2448/4976] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:26 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1328 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:27.539255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-767dcdff-b32b-4929-b445-613778178f23 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:27.540966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-767dcdff-b32b-4929-b445-613778178f23 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:27.556026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-767dcdff-b32b-4929-b445-613778178f23 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:27.557113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-767dcdff-b32b-4929-b445-613778178f23 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:27.558344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-767dcdff-b32b-4929-b445-613778178f23 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:27.559085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-767dcdff-b32b-4929-b445-613778178f23 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:27.651224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-24e8d94b-04a0-4e36-b8e2-025f8d4a4ff8 req-01a917fb-9a3a-48ea-b2d2-a6aa8934be4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1165b720-c55d-4110-8e97-a0b8252fecd0", "name": "network-vif-plugged", "status": "completed", "tag": "0204d204-02b1-4e50-b405-131215d30efb"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:27.668135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:27.671577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-24e8d94b-04a0-4e36-b8e2-025f8d4a4ff8 req-01a917fb-9a3a-48ea-b2d2-a6aa8934be4f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:27.672493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-24e8d94b-04a0-4e36-b8e2-025f8d4a4ff8 req-01a917fb-9a3a-48ea-b2d2-a6aa8934be4f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:27.691566 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-24e8d94b-04a0-4e36-b8e2-025f8d4a4ff8 req-01a917fb-9a3a-48ea-b2d2-a6aa8934be4f service nova] Creating event network-vif-plugged:0204d204-02b1-4e50-b405-131215d30efb for instance 1165b720-c55d-4110-8e97-a0b8252fecd0 on n-h1-851337-3 Aug 02 07:11:27.699229 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-24e8d94b-04a0-4e36-b8e2-025f8d4a4ff8 req-01a917fb-9a3a-48ea-b2d2-a6aa8934be4f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051927 Aug 02 07:11:27.700788 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2449/4977] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:27.773215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-767dcdff-b32b-4929-b445-613778178f23 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:27.784022 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-767dcdff-b32b-4929-b445-613778178f23 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1318 microversion: 2.1 time: 0.248022 Aug 02 07:11:27.794416 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2529/4978] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:27 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:28.065209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5b54c344-c3a2-47f6-abe3-114bc1658000 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:28.066034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5b54c344-c3a2-47f6-abe3-114bc1658000 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:28.081729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b54c344-c3a2-47f6-abe3-114bc1658000 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:28.082204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b54c344-c3a2-47f6-abe3-114bc1658000 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:28.083009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b54c344-c3a2-47f6-abe3-114bc1658000 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:28.083444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b54c344-c3a2-47f6-abe3-114bc1658000 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:28.250194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5b54c344-c3a2-47f6-abe3-114bc1658000 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:28.260507 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5b54c344-c3a2-47f6-abe3-114bc1658000 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1328 microversion: 2.1 time: 0.200420 Aug 02 07:11:28.274552 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2450/4979] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:28 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1328 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:28.805181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab4e1a85-6dad-4d9a-b058-17750c9cc035 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:28.805800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab4e1a85-6dad-4d9a-b058-17750c9cc035 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:28.820124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab4e1a85-6dad-4d9a-b058-17750c9cc035 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:28.820768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab4e1a85-6dad-4d9a-b058-17750c9cc035 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:28.821832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab4e1a85-6dad-4d9a-b058-17750c9cc035 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:28.822682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab4e1a85-6dad-4d9a-b058-17750c9cc035 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:29.063082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab4e1a85-6dad-4d9a-b058-17750c9cc035 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:29.077682 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab4e1a85-6dad-4d9a-b058-17750c9cc035 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1318 microversion: 2.1 time: 0.276302 Aug 02 07:11:29.078964 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2530/4980] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:28 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:29.283685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-86937ddc-95d0-4328-99b3-262a3d84dff6 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:29.284406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-86937ddc-95d0-4328-99b3-262a3d84dff6 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:29.299327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86937ddc-95d0-4328-99b3-262a3d84dff6 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:29.299779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86937ddc-95d0-4328-99b3-262a3d84dff6 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:29.306860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86937ddc-95d0-4328-99b3-262a3d84dff6 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:29.307345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86937ddc-95d0-4328-99b3-262a3d84dff6 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:29.506940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-86937ddc-95d0-4328-99b3-262a3d84dff6 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:29.518747 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-86937ddc-95d0-4328-99b3-262a3d84dff6 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1328 microversion: 2.1 time: 0.241516 Aug 02 07:11:29.519928 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2451/4981] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:29 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1328 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:30.099977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-27377b57-f10d-4e3a-bcff-e0d422ec81b3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:30.100638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-27377b57-f10d-4e3a-bcff-e0d422ec81b3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:30.111053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27377b57-f10d-4e3a-bcff-e0d422ec81b3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:30.111547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27377b57-f10d-4e3a-bcff-e0d422ec81b3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:30.112334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27377b57-f10d-4e3a-bcff-e0d422ec81b3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:30.112776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27377b57-f10d-4e3a-bcff-e0d422ec81b3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:30.542672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2d4fd903-4614-47a9-8d4e-5e4c3c41afa5 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:30.543375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2d4fd903-4614-47a9-8d4e-5e4c3c41afa5 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:30.561339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d4fd903-4614-47a9-8d4e-5e4c3c41afa5 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:30.565211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d4fd903-4614-47a9-8d4e-5e4c3c41afa5 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:30.569994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d4fd903-4614-47a9-8d4e-5e4c3c41afa5 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:30.570757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d4fd903-4614-47a9-8d4e-5e4c3c41afa5 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:30.657836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-27377b57-f10d-4e3a-bcff-e0d422ec81b3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:30.673404 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-27377b57-f10d-4e3a-bcff-e0d422ec81b3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1318 microversion: 2.1 time: 0.578066 Aug 02 07:11:30.687465 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2531/4982] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:30 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:31.109543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2d4fd903-4614-47a9-8d4e-5e4c3c41afa5 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:31.120231 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2d4fd903-4614-47a9-8d4e-5e4c3c41afa5 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1529 microversion: 2.1 time: 0.583492 Aug 02 07:11:31.124601 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2452/4983] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:30 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1529 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:31.148764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-243d6e6e-3468-4c04-a86b-8d2523dab4e0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:31.149507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-243d6e6e-3468-4c04-a86b-8d2523dab4e0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:31.160524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-243d6e6e-3468-4c04-a86b-8d2523dab4e0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:31.161193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-243d6e6e-3468-4c04-a86b-8d2523dab4e0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:31.162593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-243d6e6e-3468-4c04-a86b-8d2523dab4e0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:31.163565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-243d6e6e-3468-4c04-a86b-8d2523dab4e0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:31.494396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-243d6e6e-3468-4c04-a86b-8d2523dab4e0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:31.504950 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-243d6e6e-3468-4c04-a86b-8d2523dab4e0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1529 microversion: 2.1 time: 0.361293 Aug 02 07:11:31.506482 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2532/4984] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:31 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1529 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:31.697798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-162f8f1a-f7e9-4883-9a53-f810632951c1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:31.698854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-162f8f1a-f7e9-4883-9a53-f810632951c1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:31.708390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-162f8f1a-f7e9-4883-9a53-f810632951c1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:31.709259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-162f8f1a-f7e9-4883-9a53-f810632951c1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:31.710614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-162f8f1a-f7e9-4883-9a53-f810632951c1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:31.711220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-162f8f1a-f7e9-4883-9a53-f810632951c1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:31.759900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15c71141-8a92-484a-9019-93d0a5d31493 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:31.760509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-15c71141-8a92-484a-9019-93d0a5d31493 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:31.770676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15c71141-8a92-484a-9019-93d0a5d31493 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:31.771296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15c71141-8a92-484a-9019-93d0a5d31493 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:31.772418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15c71141-8a92-484a-9019-93d0a5d31493 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:31.773128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15c71141-8a92-484a-9019-93d0a5d31493 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:31.792594 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-15c71141-8a92-484a-9019-93d0a5d31493 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] HTTP exception thrown: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15c71141-8a92-484a-9019-93d0a5d31493 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] Request method failure captured: Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 HTTP/1.1 Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M4MJWP-YR2qn4IeA1vpkB4Vxw7W5Sf9kOprX6CiQaITnZRxhNKdx5mrgkEVAYlqpWMzYjW_UDTJvpFV_ASe_PHqwhMhgsczs2IShIFjz7x8nPvWrpl4qxFbPMiB7U60ndRH0wokHYMFxzerOiRK8TXFoXYm4BWhWbc-JH7fyar4K0o Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 61914f0c851b407193f13e218cb4018c Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1824388635 Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/61914f0c851b407193f13e218cb4018c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/61914f0c851b407193f13e218cb4018c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_61914f0c851b407193f13e218cb4018c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/61914f0c851b407193f13e218cb4018c"}]}] Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1824388635 Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 61914f0c851b407193f13e218cb4018c Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1824388635 Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1824388635-project Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: a517ebdd89414707b7bfe98c993b86ea Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1824388635-project Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1165b720-c55d-4110-8e97-a0b8252fecd0'} Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:31.794705 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:31.800487 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:31.800487 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:31.800487 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:31.800487 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:31.800487 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:31.800487 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:31.800487 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:31.800487 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:31.800487 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:31.800487 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:31.800487 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:31.804054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15c71141-8a92-484a-9019-93d0a5d31493 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] Returning 404 to user: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:31.805205 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-15c71141-8a92-484a-9019-93d0a5d31493 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 404 len: 111 microversion: 2.1 time: 0.281325 Aug 02 07:11:31.806651 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2453/4985] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:31 2022] DELETE /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 111 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:31.815947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-745fe963-54ee-4155-9ed4-2c5a4252394b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:31.816912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-745fe963-54ee-4155-9ed4-2c5a4252394b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:31.827956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-745fe963-54ee-4155-9ed4-2c5a4252394b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:31.829140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-745fe963-54ee-4155-9ed4-2c5a4252394b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:31.831141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-745fe963-54ee-4155-9ed4-2c5a4252394b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:31.831975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-745fe963-54ee-4155-9ed4-2c5a4252394b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:32.032486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-162f8f1a-f7e9-4883-9a53-f810632951c1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:32.057497 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-162f8f1a-f7e9-4883-9a53-f810632951c1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1318 microversion: 2.1 time: 0.364312 Aug 02 07:11:32.058890 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2533/4986] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:31 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:32.170013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-745fe963-54ee-4155-9ed4-2c5a4252394b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:32.185749 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-745fe963-54ee-4155-9ed4-2c5a4252394b tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1529 microversion: 2.1 time: 0.369256 Aug 02 07:11:32.198390 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2454/4987] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:31 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1529 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:32.211306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd2411ec-25d2-46bb-8eb3-1bcd6a0a57c9 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] Action: 'update', calling method: >, body: {"server": {"name": "1165b720-c55d-4110-8e97-a0b8252fecd0_new"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:32.214292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dd2411ec-25d2-46bb-8eb3-1bcd6a0a57c9 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:32.231820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd2411ec-25d2-46bb-8eb3-1bcd6a0a57c9 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:32.232636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd2411ec-25d2-46bb-8eb3-1bcd6a0a57c9 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:32.233501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd2411ec-25d2-46bb-8eb3-1bcd6a0a57c9 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:32.233967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd2411ec-25d2-46bb-8eb3-1bcd6a0a57c9 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:32.259888 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-dd2411ec-25d2-46bb-8eb3-1bcd6a0a57c9 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] HTTP exception thrown: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd2411ec-25d2-46bb-8eb3-1bcd6a0a57c9 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] Request method failure captured: Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: request: PUT /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 HTTP/1.1 Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 64 Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M4MJWP-YR2qn4IeA1vpkB4Vxw7W5Sf9kOprX6CiQaITnZRxhNKdx5mrgkEVAYlqpWMzYjW_UDTJvpFV_ASe_PHqwhMhgsczs2IShIFjz7x8nPvWrpl4qxFbPMiB7U60ndRH0wokHYMFxzerOiRK8TXFoXYm4BWhWbc-JH7fyar4K0o Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 61914f0c851b407193f13e218cb4018c Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1824388635 Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/61914f0c851b407193f13e218cb4018c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/61914f0c851b407193f13e218cb4018c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_61914f0c851b407193f13e218cb4018c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/61914f0c851b407193f13e218cb4018c"}]}] Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1824388635 Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 61914f0c851b407193f13e218cb4018c Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1824388635 Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1824388635-project Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a517ebdd89414707b7bfe98c993b86ea Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1824388635-project Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "1165b720-c55d-4110-8e97-a0b8252fecd0_new"}} Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '1165b720-c55d-4110-8e97-a0b8252fecd0', 'body': {'server': {'name': '1165b720-c55d-4110-8e97-a0b8252fecd0_new'}}} Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:11:32.263964 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:32.271556 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.275453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd2411ec-25d2-46bb-8eb3-1bcd6a0a57c9 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] Returning 404 to user: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:32.277813 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dd2411ec-25d2-46bb-8eb3-1bcd6a0a57c9 tempest-ServersNegativeTestMultiTenantJSON-1824388635 tempest-ServersNegativeTestMultiTenantJSON-1824388635-project] 10.222.0.79 "PUT /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 404 len: 111 microversion: 2.1 time: 0.071208 Aug 02 07:11:32.285379 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2534/4988] 10.222.0.79 () {60 vars in 1256 bytes} [Tue Aug 2 07:11:32 2022] PUT /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:32.288990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-26d8c0ee-03b7-4737-8630-6fd98a44b30a tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:32.289616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-26d8c0ee-03b7-4737-8630-6fd98a44b30a tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:32.299942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26d8c0ee-03b7-4737-8630-6fd98a44b30a tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:32.301542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26d8c0ee-03b7-4737-8630-6fd98a44b30a tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:32.304005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26d8c0ee-03b7-4737-8630-6fd98a44b30a tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:32.305385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26d8c0ee-03b7-4737-8630-6fd98a44b30a tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:32.312190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b6caf357-9a0d-4d8b-8709-4ede7a6ef63d req-6267a44a-ef71-447a-a8e9-81e5f6baafeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b1beaf-f005-4422-865a-e876cf79a1f4", "name": "network-vif-plugged", "status": "completed", "tag": "d07222b2-653a-4c37-ab00-8d03e3bc9a58"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:32.340636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b6caf357-9a0d-4d8b-8709-4ede7a6ef63d req-6267a44a-ef71-447a-a8e9-81e5f6baafeb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:32.341705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b6caf357-9a0d-4d8b-8709-4ede7a6ef63d req-6267a44a-ef71-447a-a8e9-81e5f6baafeb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:32.380240 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b6caf357-9a0d-4d8b-8709-4ede7a6ef63d req-6267a44a-ef71-447a-a8e9-81e5f6baafeb service nova] Creating event network-vif-plugged:d07222b2-653a-4c37-ab00-8d03e3bc9a58 for instance a1b1beaf-f005-4422-865a-e876cf79a1f4 on n-h1-851337-3 Aug 02 07:11:32.384332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-26d8c0ee-03b7-4737-8630-6fd98a44b30a tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:11:32.390297 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b6caf357-9a0d-4d8b-8709-4ede7a6ef63d req-6267a44a-ef71-447a-a8e9-81e5f6baafeb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081291 Aug 02 07:11:32.392497 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2535/4989] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:11:32.404428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7088eabe-108c-43d7-a5a0-8358911c7ce9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:32.407110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7088eabe-108c-43d7-a5a0-8358911c7ce9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:32.425713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7088eabe-108c-43d7-a5a0-8358911c7ce9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:32.426988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7088eabe-108c-43d7-a5a0-8358911c7ce9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:32.428015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7088eabe-108c-43d7-a5a0-8358911c7ce9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:32.429191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7088eabe-108c-43d7-a5a0-8358911c7ce9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:32.495935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:32.509128 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-7088eabe-108c-43d7-a5a0-8358911c7ce9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] HTTP exception thrown: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7088eabe-108c-43d7-a5a0-8358911c7ce9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Request method failure captured: Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 HTTP/1.1 Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mw13SPusoL2oig6z8JKTC1nUbf8Rw_5jT5YPT1CWrOABe8wYL59aYsXiUDtU2vA3es6LryNsakcXkaddV2SmWSmf9b0Kir8iKyeHQ1V913RDI7OxthQkB34rsjOk5zDf7k87yoaJrxDD4eFsnTmbVoTrOLyxwi8jQau6VljX5rXYUE Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ee1befa077542b9a17865baad3c9999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}] Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3a2629fa08b5419a96c2942118d38dad Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'fce30096-300b-4242-b360-ff6617fd5173'} Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:32.511982 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:32.517738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:11:32.517738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.517738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:32.517738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.517738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:32.517738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:32.517738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:32.517738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:32.517738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:32.517738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:11:32.517738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.525430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7088eabe-108c-43d7-a5a0-8358911c7ce9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Returning 404 to user: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:32.526877 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7088eabe-108c-43d7-a5a0-8358911c7ce9 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 404 len: 111 microversion: 2.1 time: 0.131744 Aug 02 07:11:32.529505 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2536/4990] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:32 2022] DELETE /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:32.561793 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-26d8c0ee-03b7-4737-8630-6fd98a44b30a tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 204 len: 0 microversion: 2.1 time: 0.276368 Aug 02 07:11:32.567391 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2455/4991] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:32 2022] DELETE /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:11:32.569257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-70b00868-4f6a-461a-aff0-ed3ae80c8ca3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:32.571403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-70b00868-4f6a-461a-aff0-ed3ae80c8ca3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] [instance: fce30096-300b-4242-b360-ff6617fd5173] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:32.576173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9bd33f51-377e-43e4-adff-0eff08b021e9 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:32.578432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9bd33f51-377e-43e4-adff-0eff08b021e9 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:32.588718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bd33f51-377e-43e4-adff-0eff08b021e9 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:32.589422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bd33f51-377e-43e4-adff-0eff08b021e9 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:32.590832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bd33f51-377e-43e4-adff-0eff08b021e9 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:32.591530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bd33f51-377e-43e4-adff-0eff08b021e9 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:32.597509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70b00868-4f6a-461a-aff0-ed3ae80c8ca3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:32.614575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70b00868-4f6a-461a-aff0-ed3ae80c8ca3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:32.621183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70b00868-4f6a-461a-aff0-ed3ae80c8ca3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:32.625279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70b00868-4f6a-461a-aff0-ed3ae80c8ca3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:32.678947 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-70b00868-4f6a-461a-aff0-ed3ae80c8ca3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] HTTP exception thrown: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-70b00868-4f6a-461a-aff0-ed3ae80c8ca3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Request method failure captured: Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 HTTP/1.1 Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mw13SPusoL2oig6z8JKTC1nUbf8Rw_5jT5YPT1CWrOABe8wYL59aYsXiUDtU2vA3es6LryNsakcXkaddV2SmWSmf9b0Kir8iKyeHQ1V913RDI7OxthQkB34rsjOk5zDf7k87yoaJrxDD4eFsnTmbVoTrOLyxwi8jQau6VljX5rXYUE Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ee1befa077542b9a17865baad3c9999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ee1befa077542b9a17865baad3c9999"}]}] Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 6ee1befa077542b9a17865baad3c9999 Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-249587827 Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 3a2629fa08b5419a96c2942118d38dad Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AttachVolumeNegativeTest-249587827-project Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'fce30096-300b-4242-b360-ff6617fd5173'} Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:32.687842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.692226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:32.692226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:32.692226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:32.692226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:32.692226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:32.692226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. Aug 02 07:11:32.692226 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:32.694782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-70b00868-4f6a-461a-aff0-ed3ae80c8ca3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] Returning 404 to user: Instance fce30096-300b-4242-b360-ff6617fd5173 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:32.695904 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-70b00868-4f6a-461a-aff0-ed3ae80c8ca3 tempest-AttachVolumeNegativeTest-249587827 tempest-AttachVolumeNegativeTest-249587827-project] 10.222.0.79 "GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173" status: 404 len: 111 microversion: 2.1 time: 0.161060 Aug 02 07:11:32.699673 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2537/4992] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:32 2022] GET /compute/v2.1/servers/fce30096-300b-4242-b360-ff6617fd5173 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:33.051216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9bd33f51-377e-43e4-adff-0eff08b021e9 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:33.068988 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9bd33f51-377e-43e4-adff-0eff08b021e9 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1535 microversion: 2.1 time: 0.496640 Aug 02 07:11:33.078123 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2456/4993] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:32 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1535 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:33.079964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b9c272b-06be-4153-901b-a86f89722b1f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:33.080917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4b9c272b-06be-4153-901b-a86f89722b1f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:33.088121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b9c272b-06be-4153-901b-a86f89722b1f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:33.090316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b9c272b-06be-4153-901b-a86f89722b1f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:33.091631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b9c272b-06be-4153-901b-a86f89722b1f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:33.092602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b9c272b-06be-4153-901b-a86f89722b1f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:33.406270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4b9c272b-06be-4153-901b-a86f89722b1f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:33.416782 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4b9c272b-06be-4153-901b-a86f89722b1f tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1318 microversion: 2.1 time: 0.341056 Aug 02 07:11:33.418122 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2538/4994] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:33 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:34.097364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34178c5a-4d63-4411-af20-b9cce2b8c1e1 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:34.098223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-34178c5a-4d63-4411-af20-b9cce2b8c1e1 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:34.108931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34178c5a-4d63-4411-af20-b9cce2b8c1e1 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:34.112504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34178c5a-4d63-4411-af20-b9cce2b8c1e1 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:34.115575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34178c5a-4d63-4411-af20-b9cce2b8c1e1 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:34.118145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34178c5a-4d63-4411-af20-b9cce2b8c1e1 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:34.439454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c12267c7-2851-4b99-8704-5d64a17529e1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:34.440354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c12267c7-2851-4b99-8704-5d64a17529e1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:34.453228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c12267c7-2851-4b99-8704-5d64a17529e1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:34.457427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c12267c7-2851-4b99-8704-5d64a17529e1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:34.458804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c12267c7-2851-4b99-8704-5d64a17529e1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:34.459660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c12267c7-2851-4b99-8704-5d64a17529e1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:34.465510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-34178c5a-4d63-4411-af20-b9cce2b8c1e1 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:34.482922 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-34178c5a-4d63-4411-af20-b9cce2b8c1e1 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1535 microversion: 2.1 time: 0.391244 Aug 02 07:11:34.484856 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2457/4995] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:34 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1535 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:34.740000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c12267c7-2851-4b99-8704-5d64a17529e1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:34.760756 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c12267c7-2851-4b99-8704-5d64a17529e1 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1318 microversion: 2.1 time: 0.325672 Aug 02 07:11:34.761850 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2539/4996] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:34 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:35.526557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1ccbc3dd-e471-4d77-a8ad-98d8d2f96258 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:35.526557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1ccbc3dd-e471-4d77-a8ad-98d8d2f96258 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:35.533374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ccbc3dd-e471-4d77-a8ad-98d8d2f96258 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:35.534246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ccbc3dd-e471-4d77-a8ad-98d8d2f96258 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:35.535218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ccbc3dd-e471-4d77-a8ad-98d8d2f96258 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:35.535939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ccbc3dd-e471-4d77-a8ad-98d8d2f96258 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:35.827875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b5db0e4d-22fe-439d-ba7a-e42c94c6ad2c tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] Action: 'create', calling method: .version_select at 0x7f927b2bc550>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:35.850946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-b5db0e4d-22fe-439d-ba7a-e42c94c6ad2c tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] Getting quotas for project ab551d52673a40d4858756a13ab80630. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:11:35.852942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1ccbc3dd-e471-4d77-a8ad-98d8d2f96258 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:35.863797 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1ccbc3dd-e471-4d77-a8ad-98d8d2f96258 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1535 microversion: 2.1 time: 0.356007 Aug 02 07:11:35.865244 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2458/4997] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:35 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1535 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:35.869854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-b5db0e4d-22fe-439d-ba7a-e42c94c6ad2c tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] Getting quotas for user 81ab45ff6dd7420baaeee5ce2b603cdc and project ab551d52673a40d4858756a13ab80630. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:11:35.870587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d5c262fe-7688-440b-b50d-00421238b774 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:35.871414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d5c262fe-7688-440b-b50d-00421238b774 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:35.878485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5c262fe-7688-440b-b50d-00421238b774 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:35.879498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5c262fe-7688-440b-b50d-00421238b774 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:35.880513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5c262fe-7688-440b-b50d-00421238b774 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:35.881161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5c262fe-7688-440b-b50d-00421238b774 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:35.939674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-b5db0e4d-22fe-439d-ba7a-e42c94c6ad2c tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] Getting quotas for project ab551d52673a40d4858756a13ab80630. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:11:35.946353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-b5db0e4d-22fe-439d-ba7a-e42c94c6ad2c tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] Getting quotas for user 81ab45ff6dd7420baaeee5ce2b603cdc and project ab551d52673a40d4858756a13ab80630. Resources: {'server_groups'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:11:35.964722 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b5db0e4d-22fe-439d-ba7a-e42c94c6ad2c tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.245665 Aug 02 07:11:35.966050 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2540/4998] 10.222.0.79 () {62 vars in 1214 bytes} [Tue Aug 2 07:11:35 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:11:35.977318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-226ec81f-c840-4c3b-ba78-6fc6ae2cd366 tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:35.988301 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-226ec81f-c840-4c3b-ba78-6fc6ae2cd366 tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.015008 Aug 02 07:11:35.989378 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2541/4999] 10.222.0.79 () {60 vars in 1193 bytes} [Tue Aug 2 07:11:35 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:11:36.003752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-30bc764b-4df7-4883-aacf-9c44ccc80ccf tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:36.019192 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-30bc764b-4df7-4883-aacf-9c44ccc80ccf tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/31b4aee5-23a8-4cdd-8a38-bdb7aab44bd5" status: 200 len: 235 microversion: 2.64 time: 0.022393 Aug 02 07:11:36.020277 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2542/5000] 10.222.0.79 () {60 vars in 1304 bytes} [Tue Aug 2 07:11:35 2022] GET /compute/v2.1/os-server-groups/31b4aee5-23a8-4cdd-8a38-bdb7aab44bd5 => generated 235 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 07:11:36.032314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9bcac9a1-2f30-4498-b7cd-626a8d073352 tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:36.065776 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9bcac9a1-2f30-4498-b7cd-626a8d073352 tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/31b4aee5-23a8-4cdd-8a38-bdb7aab44bd5" status: 204 len: 0 microversion: 2.64 time: 0.037619 Aug 02 07:11:36.073128 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2543/5001] 10.222.0.79 () {60 vars in 1307 bytes} [Tue Aug 2 07:11:36 2022] DELETE /compute/v2.1/os-server-groups/31b4aee5-23a8-4cdd-8a38-bdb7aab44bd5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:11:36.079976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d0eab302-13fd-478a-b169-7eb81743804e tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:36.084684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d5c262fe-7688-440b-b50d-00421238b774 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:36.087535 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-d0eab302-13fd-478a-b169-7eb81743804e tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] HTTP exception thrown: Instance group 31b4aee5-23a8-4cdd-8a38-bdb7aab44bd5 could not be found. Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d0eab302-13fd-478a-b169-7eb81743804e tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] Request method failure captured: Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-server-groups/31b4aee5-23a8-4cdd-8a38-bdb7aab44bd5 HTTP/1.1 Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M4nljr8t7Hjp19nHUle0zi_l6lfgksIzAonlBgCymEuuka3-1VcnslQJ9gJb0l-Gk4K389hcFH4ZG7ogzXUMbkdEe21Sn1UcgHKXnWZ82RpOP3_SuKcOy5S-6AwkfeWcrCsxxo2I-aZ1Y2O4NdmhgLc2R-CPETxMtHBCcd-zXnt4UY Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.64 Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: ab551d52673a40d4858756a13ab80630 Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerGroup264TestJSON-853570108 Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ab551d52673a40d4858756a13ab80630"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab551d52673a40d4858756a13ab80630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ab551d52673a40d4858756a13ab80630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ab551d52673a40d4858756a13ab80630"}]}] Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerGroup264TestJSON-853570108 Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: ab551d52673a40d4858756a13ab80630 Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerGroup264TestJSON-853570108 Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerGroup264TestJSON-853570108-project Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 81ab45ff6dd7420baaeee5ce2b603cdc Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerGroup264TestJSON-853570108-project Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance group 31b4aee5-23a8-4cdd-8a38-bdb7aab44bd5 could not be found. Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '31b4aee5-23a8-4cdd-8a38-bdb7aab44bd5'} Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 31b4aee5-23a8-4cdd-8a38-bdb7aab44bd5 could not be found. Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 31b4aee5-23a8-4cdd-8a38-bdb7aab44bd5 could not be found. Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:36.090346 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:36.094738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:36.094738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:36.094738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:36.094738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:36.094738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 31b4aee5-23a8-4cdd-8a38-bdb7aab44bd5 could not be found. Aug 02 07:11:36.094738 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:36.094738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d0eab302-13fd-478a-b169-7eb81743804e tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] Returning 404 to user: Instance group 31b4aee5-23a8-4cdd-8a38-bdb7aab44bd5 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:36.095675 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d0eab302-13fd-478a-b169-7eb81743804e tempest-ServerGroup264TestJSON-853570108 tempest-ServerGroup264TestJSON-853570108-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/31b4aee5-23a8-4cdd-8a38-bdb7aab44bd5" status: 404 len: 117 microversion: 2.64 time: 0.021194 Aug 02 07:11:36.095675 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2544/5002] 10.222.0.79 () {60 vars in 1307 bytes} [Tue Aug 2 07:11:36 2022] DELETE /compute/v2.1/os-server-groups/31b4aee5-23a8-4cdd-8a38-bdb7aab44bd5 => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:11:36.103261 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d5c262fe-7688-440b-b50d-00421238b774 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1508 microversion: 2.1 time: 0.236592 Aug 02 07:11:36.104043 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2459/5003] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:35 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:36.131170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-96ce68da-bd7f-4465-829d-4f10de50c2cd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:36.131913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-96ce68da-bd7f-4465-829d-4f10de50c2cd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:36.139348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96ce68da-bd7f-4465-829d-4f10de50c2cd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:36.139797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96ce68da-bd7f-4465-829d-4f10de50c2cd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:36.140571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96ce68da-bd7f-4465-829d-4f10de50c2cd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:36.141001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96ce68da-bd7f-4465-829d-4f10de50c2cd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:36.349764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-23a28f81-0746-467a-a259-1a2685052df2 req-20509d3e-fe7f-45af-87b3-c31603e5fa2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1165b720-c55d-4110-8e97-a0b8252fecd0", "name": "network-vif-deleted", "tag": "0204d204-02b1-4e50-b405-131215d30efb"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:36.377382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-23a28f81-0746-467a-a259-1a2685052df2 req-20509d3e-fe7f-45af-87b3-c31603e5fa2c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:36.378289 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-23a28f81-0746-467a-a259-1a2685052df2 req-20509d3e-fe7f-45af-87b3-c31603e5fa2c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:36.403269 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-23a28f81-0746-467a-a259-1a2685052df2 req-20509d3e-fe7f-45af-87b3-c31603e5fa2c service nova] Creating event network-vif-deleted:0204d204-02b1-4e50-b405-131215d30efb for instance 1165b720-c55d-4110-8e97-a0b8252fecd0 on n-h1-851337-3 Aug 02 07:11:36.410278 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-23a28f81-0746-467a-a259-1a2685052df2 req-20509d3e-fe7f-45af-87b3-c31603e5fa2c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064099 Aug 02 07:11:36.411493 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2460/5004] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:11:36.805348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-96ce68da-bd7f-4465-829d-4f10de50c2cd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:36.827613 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-96ce68da-bd7f-4465-829d-4f10de50c2cd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1508 microversion: 2.1 time: 0.701607 Aug 02 07:11:36.831444 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2545/5005] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:36 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1508 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:36.864581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fc24671a-bbfb-4cb9-9407-c3d6b5867b60 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:36.890199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-76e04a3d-ad6a-4ed5-8527-9a92bbbfd1b0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:36.891065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-76e04a3d-ad6a-4ed5-8527-9a92bbbfd1b0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:36.894923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fc24671a-bbfb-4cb9-9407-c3d6b5867b60 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:36.898507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76e04a3d-ad6a-4ed5-8527-9a92bbbfd1b0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:36.901928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76e04a3d-ad6a-4ed5-8527-9a92bbbfd1b0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:36.905338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76e04a3d-ad6a-4ed5-8527-9a92bbbfd1b0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:36.905990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76e04a3d-ad6a-4ed5-8527-9a92bbbfd1b0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:36.919663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc24671a-bbfb-4cb9-9407-c3d6b5867b60 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:36.920217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc24671a-bbfb-4cb9-9407-c3d6b5867b60 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:36.928291 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc24671a-bbfb-4cb9-9407-c3d6b5867b60 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:36.929790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc24671a-bbfb-4cb9-9407-c3d6b5867b60 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:37.134502 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fc24671a-bbfb-4cb9-9407-c3d6b5867b60 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "PUT /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1080 microversion: 2.1 time: 0.268335 Aug 02 07:11:37.142449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-76e04a3d-ad6a-4ed5-8527-9a92bbbfd1b0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd34377977d459eb182908f6807583c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e5e9e32a994bff8b788028ead79326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:37.150617 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2461/5006] 10.222.0.79 () {60 vars in 1256 bytes} [Tue Aug 2 07:11:36 2022] PUT /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1080 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:37.157245 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-76e04a3d-ad6a-4ed5-8527-9a92bbbfd1b0 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 200 len: 1313 microversion: 2.1 time: 0.271578 Aug 02 07:11:37.157873 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2546/5007] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:36 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:37.164113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7c812dc8-7a2d-421f-809e-de57b5df6cfd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:37.165364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7c812dc8-7a2d-421f-809e-de57b5df6cfd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:37.183701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c812dc8-7a2d-421f-809e-de57b5df6cfd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:37.184613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c812dc8-7a2d-421f-809e-de57b5df6cfd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:37.185772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c812dc8-7a2d-421f-809e-de57b5df6cfd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:37.186573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c812dc8-7a2d-421f-809e-de57b5df6cfd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:37.219061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:37.492201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7c812dc8-7a2d-421f-809e-de57b5df6cfd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:37.528034 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7c812dc8-7a2d-421f-809e-de57b5df6cfd tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1506 microversion: 2.1 time: 0.347008 Aug 02 07:11:37.530301 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2462/5008] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:37 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:37.553466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-225f96a3-898a-4797-b9d0-9b5049a57857 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:37.559691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-225f96a3-898a-4797-b9d0-9b5049a57857 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:37.577508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-225f96a3-898a-4797-b9d0-9b5049a57857 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:37.578260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-225f96a3-898a-4797-b9d0-9b5049a57857 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:37.579256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-225f96a3-898a-4797-b9d0-9b5049a57857 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:37.581798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-225f96a3-898a-4797-b9d0-9b5049a57857 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:37.899914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-225f96a3-898a-4797-b9d0-9b5049a57857 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:37.911558 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-225f96a3-898a-4797-b9d0-9b5049a57857 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1506 microversion: 2.1 time: 0.362311 Aug 02 07:11:37.912574 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2547/5009] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:37 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:37.938395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cea41d90-06f1-4f85-b246-457196281481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:37.940953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cea41d90-06f1-4f85-b246-457196281481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:37.954564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cea41d90-06f1-4f85-b246-457196281481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:37.955038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cea41d90-06f1-4f85-b246-457196281481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:37.955851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cea41d90-06f1-4f85-b246-457196281481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:37.960481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cea41d90-06f1-4f85-b246-457196281481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:38.119782 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cea41d90-06f1-4f85-b246-457196281481 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "PUT /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1082 microversion: 2.1 time: 0.185675 Aug 02 07:11:38.132837 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2463/5010] 10.222.0.79 () {60 vars in 1256 bytes} [Tue Aug 2 07:11:37 2022] PUT /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1082 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:38.140566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fb3258fd-4b96-480b-8d9a-39db60baa9c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:38.141552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fb3258fd-4b96-480b-8d9a-39db60baa9c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:38.159737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb3258fd-4b96-480b-8d9a-39db60baa9c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:38.160494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb3258fd-4b96-480b-8d9a-39db60baa9c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:38.164292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb3258fd-4b96-480b-8d9a-39db60baa9c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:38.165531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fb3258fd-4b96-480b-8d9a-39db60baa9c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:38.182369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a6f71be4-484c-4b80-8c2a-e61c571358a4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:38.183055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a6f71be4-484c-4b80-8c2a-e61c571358a4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] [instance: 1165b720-c55d-4110-8e97-a0b8252fecd0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:38.205503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6f71be4-484c-4b80-8c2a-e61c571358a4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:38.207415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6f71be4-484c-4b80-8c2a-e61c571358a4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:38.208469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6f71be4-484c-4b80-8c2a-e61c571358a4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:38.212442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6f71be4-484c-4b80-8c2a-e61c571358a4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:38.258642 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-a6f71be4-484c-4b80-8c2a-e61c571358a4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] HTTP exception thrown: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a6f71be4-484c-4b80-8c2a-e61c571358a4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Request method failure captured: Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 HTTP/1.1 Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M4BraDA8XQ-B6guVpojzAqWTYgWoF_nalGl7H4Navgv4aTbtl3bGyqPiel1hNUi59YpYdp4BQJbY5utGpGdAT9XV8MyYFevzaogJMSw3y4WCkfAT7i0mCtgv1xSvrevBojX-bBTPc5Cf2qWTZ6teeIpcqol8zxdBT4enGIy9SvQYI8 Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: c6e5e9e32a994bff8b788028ead79326 Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1788746345 Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c6e5e9e32a994bff8b788028ead79326"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c6e5e9e32a994bff8b788028ead79326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c6e5e9e32a994bff8b788028ead79326"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c6e5e9e32a994bff8b788028ead79326"}]}] Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1788746345 Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: c6e5e9e32a994bff8b788028ead79326 Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1788746345 Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1788746345-project Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: dfd34377977d459eb182908f6807583c Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1788746345-project Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1165b720-c55d-4110-8e97-a0b8252fecd0'} Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:38.261611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:38.266504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:38.266504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:38.266504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:38.266504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:38.266504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:38.266504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:38.266504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:38.266504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. Aug 02 07:11:38.266504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:38.281726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a6f71be4-484c-4b80-8c2a-e61c571358a4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] Returning 404 to user: Instance 1165b720-c55d-4110-8e97-a0b8252fecd0 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:38.283277 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a6f71be4-484c-4b80-8c2a-e61c571358a4 tempest-ServersNegativeTestMultiTenantJSON-1788746345 tempest-ServersNegativeTestMultiTenantJSON-1788746345-project] 10.222.0.79 "GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0" status: 404 len: 111 microversion: 2.1 time: 0.107519 Aug 02 07:11:38.286530 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2464/5011] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:38 2022] GET /compute/v2.1/servers/1165b720-c55d-4110-8e97-a0b8252fecd0 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:38.754798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fb3258fd-4b96-480b-8d9a-39db60baa9c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:38.768978 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fb3258fd-4b96-480b-8d9a-39db60baa9c3 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1508 microversion: 2.1 time: 0.630591 Aug 02 07:11:38.771781 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2548/5012] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:38 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1508 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:38.791850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a260ba44-b005-4025-9d93-0faf3810eb17 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:38.792704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a260ba44-b005-4025-9d93-0faf3810eb17 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:38.799816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a260ba44-b005-4025-9d93-0faf3810eb17 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:38.800722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a260ba44-b005-4025-9d93-0faf3810eb17 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:38.801678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a260ba44-b005-4025-9d93-0faf3810eb17 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:38.802305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a260ba44-b005-4025-9d93-0faf3810eb17 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:39.192089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a260ba44-b005-4025-9d93-0faf3810eb17 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:39.209297 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a260ba44-b005-4025-9d93-0faf3810eb17 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1508 microversion: 2.1 time: 0.419009 Aug 02 07:11:39.209981 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2465/5013] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:38 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1508 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:39.233424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-42dcaeef-cc43-4069-a77b-f6d5a3b18a3e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:39.234617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-42dcaeef-cc43-4069-a77b-f6d5a3b18a3e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:39.288315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42dcaeef-cc43-4069-a77b-f6d5a3b18a3e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:39.289437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42dcaeef-cc43-4069-a77b-f6d5a3b18a3e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:39.291592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42dcaeef-cc43-4069-a77b-f6d5a3b18a3e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:39.292204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42dcaeef-cc43-4069-a77b-f6d5a3b18a3e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:39.334414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-42dcaeef-cc43-4069-a77b-f6d5a3b18a3e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:11:39.521399 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-42dcaeef-cc43-4069-a77b-f6d5a3b18a3e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 204 len: 0 microversion: 2.1 time: 0.293565 Aug 02 07:11:39.522463 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2549/5014] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:39 2022] DELETE /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:11:39.535583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e8ed3556-4727-4f01-9982-5f3b400a7c96 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:39.537397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e8ed3556-4727-4f01-9982-5f3b400a7c96 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:39.557556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8ed3556-4727-4f01-9982-5f3b400a7c96 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:39.558452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8ed3556-4727-4f01-9982-5f3b400a7c96 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:39.561062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8ed3556-4727-4f01-9982-5f3b400a7c96 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:39.561743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8ed3556-4727-4f01-9982-5f3b400a7c96 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:39.621007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e8ed3556-4727-4f01-9982-5f3b400a7c96 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:11:39.725821 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.compute.api [None req-e8ed3556-4727-4f01-9982-5f3b400a7c96 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Instance is already in deleting state, ignoring this request Aug 02 07:11:39.726764 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e8ed3556-4727-4f01-9982-5f3b400a7c96 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 204 len: 0 microversion: 2.1 time: 0.195808 Aug 02 07:11:39.727351 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2466/5015] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:39 2022] DELETE /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:11:39.736826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-26f6589a-570b-4751-bab8-599b446e8793 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:39.737558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-26f6589a-570b-4751-bab8-599b446e8793 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:39.748592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:39.759912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26f6589a-570b-4751-bab8-599b446e8793 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:39.764877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26f6589a-570b-4751-bab8-599b446e8793 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:39.767705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26f6589a-570b-4751-bab8-599b446e8793 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:39.770283 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-26f6589a-570b-4751-bab8-599b446e8793 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:40.055674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-26f6589a-570b-4751-bab8-599b446e8793 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:40.071227 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-26f6589a-570b-4751-bab8-599b446e8793 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1514 microversion: 2.1 time: 0.338800 Aug 02 07:11:40.074611 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2550/5016] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:39 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1514 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:41.101395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-99f16f68-014d-4804-9532-61f42c5a3c5e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:41.103471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-99f16f68-014d-4804-9532-61f42c5a3c5e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:41.119523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99f16f68-014d-4804-9532-61f42c5a3c5e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:41.120525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99f16f68-014d-4804-9532-61f42c5a3c5e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:41.124566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99f16f68-014d-4804-9532-61f42c5a3c5e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:41.125532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99f16f68-014d-4804-9532-61f42c5a3c5e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:41.279793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5dfb41b2-aa93-494f-953e-550a53a0db79 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Action: 'create', calling method: .version_select at 0x7f927a96cc10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1320488803", "metadata": {"Type": "work"}}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5dfb41b2-aa93-494f-953e-550a53a0db79 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Request method failure captured: Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 122 Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M4sYiIR8d_apQsE08lwYFa6bGsEU8oSpTJG7Gn-oY3dzsjWd5mDXsu9qXIsUv26RzxpkezjHug40HOjVgOrjXHzVF9lnFSFq2-ipeMeAde0elrUUWXbyRxS439y533jM5oqfkyaHNzjwvGv4BvcP-lw0D-MV5te-_iAptDmdWoYl7c Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 307c0310d389484eb619f119ac3d0b1f Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/307c0310d389484eb619f119ac3d0b1f"}]}] Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 307c0310d389484eb619f119ac3d0b1f Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-VolumesNegativeTest-150590992-project Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 8cb522b9854a452cb50990bcaecb1d97 Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-VolumesNegativeTest-150590992-project Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1320488803", "metadata": {"Type": "work"}}} Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1320488803', 'metadata': {'Type': 'work'}}}} Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi '#$%' Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:11:41.291540 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:11:41.298526 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 07:11:41.298526 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.298526 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.298526 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.298526 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.298526 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:41.298526 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:41.298526 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:11:41.298526 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:11:41.298526 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 07:11:41.298526 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.298526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5dfb41b2-aa93-494f-953e-550a53a0db79 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:41.298526 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5dfb41b2-aa93-494f-953e-550a53a0db79 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.231452 Aug 02 07:11:41.301710 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2467/5017] 10.222.0.79 () {60 vars in 1156 bytes} [Tue Aug 2 07:11:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 240 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:11:41.313230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-37389403-c219-4db2-86b4-203056926d4d tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Action: 'create', calling method: .version_select at 0x7f927aa79a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1953823715", "metadata": {"Type": "work"}}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-37389403-c219-4db2-86b4-203056926d4d tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Request method failure captured: Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 120 Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M4sYiIR8d_apQsE08lwYFa6bGsEU8oSpTJG7Gn-oY3dzsjWd5mDXsu9qXIsUv26RzxpkezjHug40HOjVgOrjXHzVF9lnFSFq2-ipeMeAde0elrUUWXbyRxS439y533jM5oqfkyaHNzjwvGv4BvcP-lw0D-MV5te-_iAptDmdWoYl7c Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 307c0310d389484eb619f119ac3d0b1f Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/307c0310d389484eb619f119ac3d0b1f"}]}] Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 307c0310d389484eb619f119ac3d0b1f Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-VolumesNegativeTest-150590992-project Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 8cb522b9854a452cb50990bcaecb1d97 Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-VolumesNegativeTest-150590992-project Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1953823715", "metadata": {"Type": "work"}}} Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1953823715', 'metadata': {'Type': 'work'}}}} Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi '0' Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:11:41.318418 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:11:41.327696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 07:11:41.327696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.327696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.327696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.327696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.327696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:41.327696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:41.327696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:11:41.327696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:11:41.327696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 07:11:41.327696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.327696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-37389403-c219-4db2-86b4-203056926d4d tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:41.327696 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-37389403-c219-4db2-86b4-203056926d4d tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011773 Aug 02 07:11:41.327696 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2468/5018] 10.222.0.79 () {60 vars in 1156 bytes} [Tue Aug 2 07:11:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 07:11:41.338227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-99f16f68-014d-4804-9532-61f42c5a3c5e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:41.344944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d763db6-40fe-4184-aa5b-f4ee976a60e5 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Action: 'create', calling method: .version_select at 0x7f927a96cb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-112581489", "metadata": {"Type": "work"}}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d763db6-40fe-4184-aa5b-f4ee976a60e5 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Request method failure captured: Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 118 Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M4sYiIR8d_apQsE08lwYFa6bGsEU8oSpTJG7Gn-oY3dzsjWd5mDXsu9qXIsUv26RzxpkezjHug40HOjVgOrjXHzVF9lnFSFq2-ipeMeAde0elrUUWXbyRxS439y533jM5oqfkyaHNzjwvGv4BvcP-lw0D-MV5te-_iAptDmdWoYl7c Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 307c0310d389484eb619f119ac3d0b1f Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/307c0310d389484eb619f119ac3d0b1f"}]}] Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 307c0310d389484eb619f119ac3d0b1f Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-VolumesNegativeTest-150590992-project Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 8cb522b9854a452cb50990bcaecb1d97 Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-VolumesNegativeTest-150590992-project Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-112581489", "metadata": {"Type": "work"}}} Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-112581489', 'metadata': {'Type': 'work'}}}} Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi '' Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:11:41.348709 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:11:41.353371 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 07:11:41.353371 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.353371 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.353371 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.353371 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.353371 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:41.353371 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:41.353371 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:11:41.353371 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:11:41.353371 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 07:11:41.353371 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.353371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d763db6-40fe-4184-aa5b-f4ee976a60e5 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:41.353371 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5d763db6-40fe-4184-aa5b-f4ee976a60e5 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017703 Aug 02 07:11:41.356568 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2469/5019] 10.222.0.79 () {60 vars in 1156 bytes} [Tue Aug 2 07:11:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:11:41.362863 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-99f16f68-014d-4804-9532-61f42c5a3c5e tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1514 microversion: 2.1 time: 0.269100 Aug 02 07:11:41.364364 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2551/5020] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:41 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1514 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:11:41.370342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6f0d7a32-4db2-4c19-9455-279109e5e036 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Calling method '.version_select at 0x7f928c24dee0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:41.405262 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-6f0d7a32-4db2-4c19-9455-279109e5e036 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] HTTP exception thrown: Volume tempest-invalid-1376114637 could not be found. Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6f0d7a32-4db2-4c19-9455-279109e5e036 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Request method failure captured: Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1376114637 HTTP/1.1 Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M4sYiIR8d_apQsE08lwYFa6bGsEU8oSpTJG7Gn-oY3dzsjWd5mDXsu9qXIsUv26RzxpkezjHug40HOjVgOrjXHzVF9lnFSFq2-ipeMeAde0elrUUWXbyRxS439y533jM5oqfkyaHNzjwvGv4BvcP-lw0D-MV5te-_iAptDmdWoYl7c Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 307c0310d389484eb619f119ac3d0b1f Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/307c0310d389484eb619f119ac3d0b1f"}]}] Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 307c0310d389484eb619f119ac3d0b1f Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-VolumesNegativeTest-150590992-project Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 8cb522b9854a452cb50990bcaecb1d97 Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-VolumesNegativeTest-150590992-project Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: exception: Volume tempest-invalid-1376114637 could not be found. Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'tempest-invalid-1376114637'} Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1376114637 could not be found. (HTTP 404) (Request-ID: req-3571f4f1-01ee-45dd-8772-82c615de8ed3) Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 07:11:41.407367 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1376114637 could not be found. Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1376114637 could not be found. Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1376114637 could not be found. Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6f0d7a32-4db2-4c19-9455-279109e5e036 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Returning 404 to user: Volume tempest-invalid-1376114637 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:41.412557 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6f0d7a32-4db2-4c19-9455-279109e5e036 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1376114637" status: 404 len: 99 microversion: 2.1 time: 0.050325 Aug 02 07:11:41.417071 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2470/5021] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Aug 2 07:11:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1376114637 => generated 99 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:11:41.420254 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e22e50c4-1501-4961-99ac-8a9c1e0f7e29 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003831 Aug 02 07:11:41.421071 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2552/5022] 10.222.0.79 () {58 vars in 1140 bytes} [Tue Aug 2 07:11:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 07:11:41.429949 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e76703e6-4cac-47ab-b124-4f2d5bdc99c4 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003924 Aug 02 07:11:41.430444 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2471/5023] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 07:11:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 07:11:41.439491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ee54cce2-29da-43c9-84dc-453e26aaf902 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Calling method '.version_select at 0x7f927a880670>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:41.480322 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-ee54cce2-29da-43c9-84dc-453e26aaf902 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] HTTP exception thrown: Volume 1820f40f-7c8d-46b5-bc66-d8aba4f036db could not be found. Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ee54cce2-29da-43c9-84dc-453e26aaf902 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Request method failure captured: Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-volumes/1820f40f-7c8d-46b5-bc66-d8aba4f036db HTTP/1.1 Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M4sYiIR8d_apQsE08lwYFa6bGsEU8oSpTJG7Gn-oY3dzsjWd5mDXsu9qXIsUv26RzxpkezjHug40HOjVgOrjXHzVF9lnFSFq2-ipeMeAde0elrUUWXbyRxS439y533jM5oqfkyaHNzjwvGv4BvcP-lw0D-MV5te-_iAptDmdWoYl7c Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 307c0310d389484eb619f119ac3d0b1f Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/307c0310d389484eb619f119ac3d0b1f"}]}] Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 307c0310d389484eb619f119ac3d0b1f Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-VolumesNegativeTest-150590992-project Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 8cb522b9854a452cb50990bcaecb1d97 Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-VolumesNegativeTest-150590992-project Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: exception: Volume 1820f40f-7c8d-46b5-bc66-d8aba4f036db could not be found. Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '1820f40f-7c8d-46b5-bc66-d8aba4f036db'} Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1820f40f-7c8d-46b5-bc66-d8aba4f036db could not be found. (HTTP 404) (Request-ID: req-4a459450-2be9-40c7-926c-76eb7117f7ff) Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 07:11:41.483439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1820f40f-7c8d-46b5-bc66-d8aba4f036db could not be found. Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1820f40f-7c8d-46b5-bc66-d8aba4f036db could not be found. Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1820f40f-7c8d-46b5-bc66-d8aba4f036db could not be found. Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ee54cce2-29da-43c9-84dc-453e26aaf902 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Returning 404 to user: Volume 1820f40f-7c8d-46b5-bc66-d8aba4f036db could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ee54cce2-29da-43c9-84dc-453e26aaf902 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/1820f40f-7c8d-46b5-bc66-d8aba4f036db" status: 404 len: 109 microversion: 2.1 time: 0.050012 Aug 02 07:11:41.494549 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2553/5024] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 07:11:41 2022] DELETE /compute/v2.1/os-volumes/1820f40f-7c8d-46b5-bc66-d8aba4f036db => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:41.506724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e2e92b9b-cb8b-4d66-bb83-4071ec3272c4 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Calling method '.version_select at 0x7f927a96cb80>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:41.554601 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-e2e92b9b-cb8b-4d66-bb83-4071ec3272c4 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] HTTP exception thrown: Volume 8976c156-7125-4f69-83a1-f518859fec2a could not be found. Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e2e92b9b-cb8b-4d66-bb83-4071ec3272c4 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Request method failure captured: Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/os-volumes/8976c156-7125-4f69-83a1-f518859fec2a HTTP/1.1 Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M4sYiIR8d_apQsE08lwYFa6bGsEU8oSpTJG7Gn-oY3dzsjWd5mDXsu9qXIsUv26RzxpkezjHug40HOjVgOrjXHzVF9lnFSFq2-ipeMeAde0elrUUWXbyRxS439y533jM5oqfkyaHNzjwvGv4BvcP-lw0D-MV5te-_iAptDmdWoYl7c Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 307c0310d389484eb619f119ac3d0b1f Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_307c0310d389484eb619f119ac3d0b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/307c0310d389484eb619f119ac3d0b1f"}]}] Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 307c0310d389484eb619f119ac3d0b1f Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-VolumesNegativeTest-150590992 Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-VolumesNegativeTest-150590992-project Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 8cb522b9854a452cb50990bcaecb1d97 Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-VolumesNegativeTest-150590992-project Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: method: Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: exception: Volume 8976c156-7125-4f69-83a1-f518859fec2a could not be found. Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '8976c156-7125-4f69-83a1-f518859fec2a'} Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8976c156-7125-4f69-83a1-f518859fec2a could not be found. (HTTP 404) (Request-ID: req-dad31957-6cb3-4c0c-84dc-0b24a6f13a63) Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 07:11:41.561643 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8976c156-7125-4f69-83a1-f518859fec2a could not be found. Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8976c156-7125-4f69-83a1-f518859fec2a could not be found. Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8976c156-7125-4f69-83a1-f518859fec2a could not be found. Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:41.577786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e2e92b9b-cb8b-4d66-bb83-4071ec3272c4 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] Returning 404 to user: Volume 8976c156-7125-4f69-83a1-f518859fec2a could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:41.591968 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e2e92b9b-cb8b-4d66-bb83-4071ec3272c4 tempest-VolumesNegativeTest-150590992 tempest-VolumesNegativeTest-150590992-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/8976c156-7125-4f69-83a1-f518859fec2a" status: 404 len: 109 microversion: 2.1 time: 0.078636 Aug 02 07:11:41.602516 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2472/5025] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:11:41 2022] GET /compute/v2.1/os-volumes/8976c156-7125-4f69-83a1-f518859fec2a => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:42.399111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b7e673ec-0e9e-4238-a162-6772ae2c50ce tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:42.399750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b7e673ec-0e9e-4238-a162-6772ae2c50ce tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:42.412256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7e673ec-0e9e-4238-a162-6772ae2c50ce tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:42.412733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7e673ec-0e9e-4238-a162-6772ae2c50ce tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:42.413543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7e673ec-0e9e-4238-a162-6772ae2c50ce tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:42.419111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7e673ec-0e9e-4238-a162-6772ae2c50ce tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:42.656378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b7e673ec-0e9e-4238-a162-6772ae2c50ce tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:42.674406 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b7e673ec-0e9e-4238-a162-6772ae2c50ce tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1472 microversion: 2.1 time: 0.282366 Aug 02 07:11:42.691759 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2554/5026] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:42 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1472 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:43.119619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-1ec03623-a109-45e0-b764-2c75354bb8d4 req-8f2daa0a-4642-4557-8307-05752ae3980e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b1beaf-f005-4422-865a-e876cf79a1f4", "name": "network-vif-deleted", "tag": "d07222b2-653a-4c37-ab00-8d03e3bc9a58"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:43.182934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1ec03623-a109-45e0-b764-2c75354bb8d4 req-8f2daa0a-4642-4557-8307-05752ae3980e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:43.184802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1ec03623-a109-45e0-b764-2c75354bb8d4 req-8f2daa0a-4642-4557-8307-05752ae3980e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:43.232923 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-1ec03623-a109-45e0-b764-2c75354bb8d4 req-8f2daa0a-4642-4557-8307-05752ae3980e service nova] Creating event network-vif-deleted:d07222b2-653a-4c37-ab00-8d03e3bc9a58 for instance a1b1beaf-f005-4422-865a-e876cf79a1f4 on n-h1-851337-3 Aug 02 07:11:43.250753 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-1ec03623-a109-45e0-b764-2c75354bb8d4 req-8f2daa0a-4642-4557-8307-05752ae3980e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139747 Aug 02 07:11:43.253105 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2473/5027] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:11:43.701988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-53367434-ba4f-474f-9649-940144b84db8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:43.703141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-53367434-ba4f-474f-9649-940144b84db8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:43.728870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53367434-ba4f-474f-9649-940144b84db8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:43.731970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53367434-ba4f-474f-9649-940144b84db8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:43.737461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53367434-ba4f-474f-9649-940144b84db8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:43.738085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53367434-ba4f-474f-9649-940144b84db8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:43.896751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53367434-ba4f-474f-9649-940144b84db8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:43.897288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53367434-ba4f-474f-9649-940144b84db8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:43.905430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-53367434-ba4f-474f-9649-940144b84db8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lazy-loading 'fault' on Instance uuid a1b1beaf-f005-4422-865a-e876cf79a1f4 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:11:44.021151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-53367434-ba4f-474f-9649-940144b84db8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2e27618e26434e9f320ba83533cfa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a324b72e01a4bbfb25e822709ba2ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:44.032465 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-53367434-ba4f-474f-9649-940144b84db8 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 200 len: 1308 microversion: 2.1 time: 0.333886 Aug 02 07:11:44.051247 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2555/5028] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:43 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 1308 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:45.062785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b94d70b4-82cf-469d-bbc1-4bf288383a0d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:45.064749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b94d70b4-82cf-469d-bbc1-4bf288383a0d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: a1b1beaf-f005-4422-865a-e876cf79a1f4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:45.081014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b94d70b4-82cf-469d-bbc1-4bf288383a0d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:45.081014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b94d70b4-82cf-469d-bbc1-4bf288383a0d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:45.082360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b94d70b4-82cf-469d-bbc1-4bf288383a0d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:45.082500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b94d70b4-82cf-469d-bbc1-4bf288383a0d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:45.101039 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-b94d70b4-82cf-469d-bbc1-4bf288383a0d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] HTTP exception thrown: Instance a1b1beaf-f005-4422-865a-e876cf79a1f4 could not be found. Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b94d70b4-82cf-469d-bbc1-4bf288383a0d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Request method failure captured: Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 HTTP/1.1 Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M2UQZ3gCaAK_-awyNOr2vW3cictnhT2VC4tYdvDnzisc_ns-VqS6Nc2qUkiVrcEKpEcbN8i3xt9LVCFbKMt2nwPLN8vVUshSKJVUAG7uTS_dHtfEju4YFIsghiuV_LJKZFOyRk6MEufPi7Jk27mnT9SqR8YFBJpi072Q_4iyazy_Zs Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 4a324b72e01a4bbfb25e822709ba2ddc Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4a324b72e01a4bbfb25e822709ba2ddc"}]}] Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 4a324b72e01a4bbfb25e822709ba2ddc Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerDiskConfigTestJSON-1994607797-project Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: af2e27618e26434e9f320ba83533cfa2 Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerDiskConfigTestJSON-1994607797-project Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance a1b1beaf-f005-4422-865a-e876cf79a1f4 could not be found. Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'a1b1beaf-f005-4422-865a-e876cf79a1f4'} Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b1beaf-f005-4422-865a-e876cf79a1f4 could not be found. Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b1beaf-f005-4422-865a-e876cf79a1f4 could not be found. Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:45.103521 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.111005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.111005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:45.111005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:45.111005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:45.111005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:45.111005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b1beaf-f005-4422-865a-e876cf79a1f4 could not be found. Aug 02 07:11:45.111005 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.111005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b94d70b4-82cf-469d-bbc1-4bf288383a0d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Returning 404 to user: Instance a1b1beaf-f005-4422-865a-e876cf79a1f4 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:45.111005 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b94d70b4-82cf-469d-bbc1-4bf288383a0d tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4" status: 404 len: 111 microversion: 2.1 time: 0.051501 Aug 02 07:11:45.111005 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2474/5029] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:45 2022] GET /compute/v2.1/servers/a1b1beaf-f005-4422-865a-e876cf79a1f4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:45.126251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-05138bbd-7bd1-4098-a28d-1060c8b1736b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:45.128070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-05138bbd-7bd1-4098-a28d-1060c8b1736b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:45.170103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05138bbd-7bd1-4098-a28d-1060c8b1736b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:45.173347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05138bbd-7bd1-4098-a28d-1060c8b1736b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:45.178512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05138bbd-7bd1-4098-a28d-1060c8b1736b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:45.179153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05138bbd-7bd1-4098-a28d-1060c8b1736b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:45.242770 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-05138bbd-7bd1-4098-a28d-1060c8b1736b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] HTTP exception thrown: Instance 32378f59-645b-4f54-8d09-d30c783496d1 could not be found. Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-05138bbd-7bd1-4098-a28d-1060c8b1736b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Request method failure captured: Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 HTTP/1.1 Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M2UQZ3gCaAK_-awyNOr2vW3cictnhT2VC4tYdvDnzisc_ns-VqS6Nc2qUkiVrcEKpEcbN8i3xt9LVCFbKMt2nwPLN8vVUshSKJVUAG7uTS_dHtfEju4YFIsghiuV_LJKZFOyRk6MEufPi7Jk27mnT9SqR8YFBJpi072Q_4iyazy_Zs Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 4a324b72e01a4bbfb25e822709ba2ddc Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4a324b72e01a4bbfb25e822709ba2ddc"}]}] Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 4a324b72e01a4bbfb25e822709ba2ddc Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerDiskConfigTestJSON-1994607797-project Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: af2e27618e26434e9f320ba83533cfa2 Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerDiskConfigTestJSON-1994607797-project Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 32378f59-645b-4f54-8d09-d30c783496d1 could not be found. Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '32378f59-645b-4f54-8d09-d30c783496d1'} Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32378f59-645b-4f54-8d09-d30c783496d1 could not be found. Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:45.250922 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:45.257874 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32378f59-645b-4f54-8d09-d30c783496d1 could not be found. Aug 02 07:11:45.257874 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.257874 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:45.257874 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.257874 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.257874 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:45.257874 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:45.257874 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:45.257874 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:45.257874 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32378f59-645b-4f54-8d09-d30c783496d1 could not be found. Aug 02 07:11:45.257874 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.257874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-05138bbd-7bd1-4098-a28d-1060c8b1736b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Returning 404 to user: Instance 32378f59-645b-4f54-8d09-d30c783496d1 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:45.257874 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-05138bbd-7bd1-4098-a28d-1060c8b1736b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "DELETE /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 404 len: 111 microversion: 2.1 time: 0.140940 Aug 02 07:11:45.260119 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2556/5030] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:45 2022] DELETE /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:45.268339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a183fee3-c003-4051-8081-abd95db9dfe5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:45.269312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a183fee3-c003-4051-8081-abd95db9dfe5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: 32378f59-645b-4f54-8d09-d30c783496d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:45.279398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a183fee3-c003-4051-8081-abd95db9dfe5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:45.281071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a183fee3-c003-4051-8081-abd95db9dfe5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:45.282447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a183fee3-c003-4051-8081-abd95db9dfe5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:45.288151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a183fee3-c003-4051-8081-abd95db9dfe5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:45.354516 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-a183fee3-c003-4051-8081-abd95db9dfe5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] HTTP exception thrown: Instance 32378f59-645b-4f54-8d09-d30c783496d1 could not be found. Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a183fee3-c003-4051-8081-abd95db9dfe5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Request method failure captured: Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 HTTP/1.1 Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M2UQZ3gCaAK_-awyNOr2vW3cictnhT2VC4tYdvDnzisc_ns-VqS6Nc2qUkiVrcEKpEcbN8i3xt9LVCFbKMt2nwPLN8vVUshSKJVUAG7uTS_dHtfEju4YFIsghiuV_LJKZFOyRk6MEufPi7Jk27mnT9SqR8YFBJpi072Q_4iyazy_Zs Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 4a324b72e01a4bbfb25e822709ba2ddc Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4a324b72e01a4bbfb25e822709ba2ddc"}]}] Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 4a324b72e01a4bbfb25e822709ba2ddc Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerDiskConfigTestJSON-1994607797-project Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: af2e27618e26434e9f320ba83533cfa2 Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerDiskConfigTestJSON-1994607797-project Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 32378f59-645b-4f54-8d09-d30c783496d1 could not be found. Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '32378f59-645b-4f54-8d09-d30c783496d1'} Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32378f59-645b-4f54-8d09-d30c783496d1 could not be found. Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32378f59-645b-4f54-8d09-d30c783496d1 could not be found. Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:45.359198 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.363610 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.363610 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:45.363610 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:45.363610 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:45.363610 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:45.363610 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32378f59-645b-4f54-8d09-d30c783496d1 could not be found. Aug 02 07:11:45.363610 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.373828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a183fee3-c003-4051-8081-abd95db9dfe5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Returning 404 to user: Instance 32378f59-645b-4f54-8d09-d30c783496d1 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:45.375334 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a183fee3-c003-4051-8081-abd95db9dfe5 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1" status: 404 len: 111 microversion: 2.1 time: 0.111330 Aug 02 07:11:45.379049 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2475/5031] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:45 2022] GET /compute/v2.1/servers/32378f59-645b-4f54-8d09-d30c783496d1 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:45.390873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-33ffe604-fd4d-49a5-956d-d0a0ecbf715b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:45.390873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-33ffe604-fd4d-49a5-956d-d0a0ecbf715b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:45.398002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33ffe604-fd4d-49a5-956d-d0a0ecbf715b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:45.398462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33ffe604-fd4d-49a5-956d-d0a0ecbf715b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:45.399483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33ffe604-fd4d-49a5-956d-d0a0ecbf715b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:45.399934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33ffe604-fd4d-49a5-956d-d0a0ecbf715b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:45.419856 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-33ffe604-fd4d-49a5-956d-d0a0ecbf715b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] HTTP exception thrown: Instance ba90067e-50cc-4009-886b-124ae5608b6f could not be found. Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-33ffe604-fd4d-49a5-956d-d0a0ecbf715b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Request method failure captured: Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f HTTP/1.1 Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M2UQZ3gCaAK_-awyNOr2vW3cictnhT2VC4tYdvDnzisc_ns-VqS6Nc2qUkiVrcEKpEcbN8i3xt9LVCFbKMt2nwPLN8vVUshSKJVUAG7uTS_dHtfEju4YFIsghiuV_LJKZFOyRk6MEufPi7Jk27mnT9SqR8YFBJpi072Q_4iyazy_Zs Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 4a324b72e01a4bbfb25e822709ba2ddc Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4a324b72e01a4bbfb25e822709ba2ddc"}]}] Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 4a324b72e01a4bbfb25e822709ba2ddc Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerDiskConfigTestJSON-1994607797-project Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: af2e27618e26434e9f320ba83533cfa2 Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerDiskConfigTestJSON-1994607797-project Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance ba90067e-50cc-4009-886b-124ae5608b6f could not be found. Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'ba90067e-50cc-4009-886b-124ae5608b6f'} Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba90067e-50cc-4009-886b-124ae5608b6f could not be found. Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:45.422301 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:45.427551 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba90067e-50cc-4009-886b-124ae5608b6f could not be found. Aug 02 07:11:45.427551 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.427551 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:45.427551 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.427551 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.427551 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:45.427551 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:45.427551 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:45.427551 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:45.427551 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba90067e-50cc-4009-886b-124ae5608b6f could not be found. Aug 02 07:11:45.427551 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.430029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-33ffe604-fd4d-49a5-956d-d0a0ecbf715b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Returning 404 to user: Instance ba90067e-50cc-4009-886b-124ae5608b6f could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:45.431092 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-33ffe604-fd4d-49a5-956d-d0a0ecbf715b tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 404 len: 111 microversion: 2.1 time: 0.048392 Aug 02 07:11:45.432043 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2557/5032] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:11:45 2022] DELETE /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:45.440557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fc0d1caf-1c3c-4279-ab1f-b9385e7752e0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:45.440938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fc0d1caf-1c3c-4279-ab1f-b9385e7752e0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] [instance: ba90067e-50cc-4009-886b-124ae5608b6f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:45.447890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc0d1caf-1c3c-4279-ab1f-b9385e7752e0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:45.448752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc0d1caf-1c3c-4279-ab1f-b9385e7752e0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:45.449540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc0d1caf-1c3c-4279-ab1f-b9385e7752e0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:45.450017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc0d1caf-1c3c-4279-ab1f-b9385e7752e0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:45.469852 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-fc0d1caf-1c3c-4279-ab1f-b9385e7752e0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] HTTP exception thrown: Instance ba90067e-50cc-4009-886b-124ae5608b6f could not be found. Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fc0d1caf-1c3c-4279-ab1f-b9385e7752e0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Request method failure captured: Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f HTTP/1.1 Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M2UQZ3gCaAK_-awyNOr2vW3cictnhT2VC4tYdvDnzisc_ns-VqS6Nc2qUkiVrcEKpEcbN8i3xt9LVCFbKMt2nwPLN8vVUshSKJVUAG7uTS_dHtfEju4YFIsghiuV_LJKZFOyRk6MEufPi7Jk27mnT9SqR8YFBJpi072Q_4iyazy_Zs Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 4a324b72e01a4bbfb25e822709ba2ddc Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4a324b72e01a4bbfb25e822709ba2ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4a324b72e01a4bbfb25e822709ba2ddc"}]}] Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 4a324b72e01a4bbfb25e822709ba2ddc Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1994607797 Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerDiskConfigTestJSON-1994607797-project Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: af2e27618e26434e9f320ba83533cfa2 Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerDiskConfigTestJSON-1994607797-project Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance ba90067e-50cc-4009-886b-124ae5608b6f could not be found. Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'ba90067e-50cc-4009-886b-124ae5608b6f'} Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba90067e-50cc-4009-886b-124ae5608b6f could not be found. Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba90067e-50cc-4009-886b-124ae5608b6f could not be found. Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:11:45.471558 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.475885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:11:45.475885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:11:45.475885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:11:45.475885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:11:45.475885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:11:45.475885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba90067e-50cc-4009-886b-124ae5608b6f could not be found. Aug 02 07:11:45.475885 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:11:45.475885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fc0d1caf-1c3c-4279-ab1f-b9385e7752e0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] Returning 404 to user: Instance ba90067e-50cc-4009-886b-124ae5608b6f could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:11:45.475885 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fc0d1caf-1c3c-4279-ab1f-b9385e7752e0 tempest-ServerDiskConfigTestJSON-1994607797 tempest-ServerDiskConfigTestJSON-1994607797-project] 10.222.0.79 "GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f" status: 404 len: 111 microversion: 2.1 time: 0.036637 Aug 02 07:11:45.477819 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2476/5033] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:45 2022] GET /compute/v2.1/servers/ba90067e-50cc-4009-886b-124ae5608b6f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:11:49.024608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ae3ea240-7dc8-4bb7-bdb4-61c51e2905ab tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:49.032772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae3ea240-7dc8-4bb7-bdb4-61c51e2905ab tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:49.051864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:49.055849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae3ea240-7dc8-4bb7-bdb4-61c51e2905ab tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:49.064090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae3ea240-7dc8-4bb7-bdb4-61c51e2905ab tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:49.065607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae3ea240-7dc8-4bb7-bdb4-61c51e2905ab tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:49.066531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae3ea240-7dc8-4bb7-bdb4-61c51e2905ab tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:49.160583 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ae3ea240-7dc8-4bb7-bdb4-61c51e2905ab tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724/action" status: 200 len: 63191 microversion: 2.1 time: 0.142371 Aug 02 07:11:49.171988 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2558/5034] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:11:49 2022] POST /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724/action => generated 63191 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:11:52.356284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-23f96bc2-9b0b-442d-9a73-c57d20a5d72f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:52.357121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-23f96bc2-9b0b-442d-9a73-c57d20a5d72f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:52.385524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23f96bc2-9b0b-442d-9a73-c57d20a5d72f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:52.387481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23f96bc2-9b0b-442d-9a73-c57d20a5d72f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:52.388706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23f96bc2-9b0b-442d-9a73-c57d20a5d72f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:52.393140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23f96bc2-9b0b-442d-9a73-c57d20a5d72f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:52.833121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23f96bc2-9b0b-442d-9a73-c57d20a5d72f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:52.850123 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-23f96bc2-9b0b-442d-9a73-c57d20a5d72f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.498531 Aug 02 07:11:52.850947 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2477/5035] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:52 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:52.879739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3c46823f-ae16-467d-a2bd-df798c0bc7f3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:52.880459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3c46823f-ae16-467d-a2bd-df798c0bc7f3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:52.907943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c46823f-ae16-467d-a2bd-df798c0bc7f3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:52.908408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c46823f-ae16-467d-a2bd-df798c0bc7f3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:52.913153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c46823f-ae16-467d-a2bd-df798c0bc7f3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:52.915749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c46823f-ae16-467d-a2bd-df798c0bc7f3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:53.384860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3c46823f-ae16-467d-a2bd-df798c0bc7f3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:53.397986 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3c46823f-ae16-467d-a2bd-df798c0bc7f3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.524103 Aug 02 07:11:53.398572 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2559/5036] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:52 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:53.420867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85d7c97b-07a0-40bd-8f42-734dabccadcd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:53.426437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-85d7c97b-07a0-40bd-8f42-734dabccadcd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:53.434977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85d7c97b-07a0-40bd-8f42-734dabccadcd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:53.435745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85d7c97b-07a0-40bd-8f42-734dabccadcd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:53.436847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85d7c97b-07a0-40bd-8f42-734dabccadcd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:53.437544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85d7c97b-07a0-40bd-8f42-734dabccadcd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:54.073072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-85d7c97b-07a0-40bd-8f42-734dabccadcd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:54.105747 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-85d7c97b-07a0-40bd-8f42-734dabccadcd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.690117 Aug 02 07:11:54.133799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8d44b314-54ad-41d3-9806-204a40666e18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:54.135050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8d44b314-54ad-41d3-9806-204a40666e18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:54.142908 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2478/5037] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:53 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:54.145359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d44b314-54ad-41d3-9806-204a40666e18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:54.147080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d44b314-54ad-41d3-9806-204a40666e18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:54.148519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d44b314-54ad-41d3-9806-204a40666e18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:54.150982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d44b314-54ad-41d3-9806-204a40666e18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:54.722812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8d44b314-54ad-41d3-9806-204a40666e18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:54.745814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:54.754499 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8d44b314-54ad-41d3-9806-204a40666e18 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.625636 Aug 02 07:11:54.760297 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2560/5038] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:54 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:55.052269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1884665585", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "4a2e64a4-c6ee-43d5-bb6a-002018e2c279"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:11:55.182882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] validate_networks() for [('4a2e64a4-c6ee-43d5-bb6a-002018e2c279', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:11:55.205318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-96555f89-058c-45b3-9ab5-f5664c912e20 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:55.209277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-96555f89-058c-45b3-9ab5-f5664c912e20 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:55.254947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96555f89-058c-45b3-9ab5-f5664c912e20 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:55.255583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96555f89-058c-45b3-9ab5-f5664c912e20 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:55.256536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96555f89-058c-45b3-9ab5-f5664c912e20 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:55.256987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-96555f89-058c-45b3-9ab5-f5664c912e20 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:55.444933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-96555f89-058c-45b3-9ab5-f5664c912e20 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lazy-loading 'services' on Instance uuid 03f30eee-cead-423c-995f-3148f1ccb0b4 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:11:55.646232 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-96555f89-058c-45b3-9ab5-f5664c912e20 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4/os-volume_attachments/6b128786-7cae-4d51-8195-3a1247cdd69d" status: 202 len: 0 microversion: 2.1 time: 0.446028 Aug 02 07:11:55.647739 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2561/5039] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:11:55 2022] DELETE /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4/os-volume_attachments/6b128786-7cae-4d51-8195-3a1247cdd69d => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:11:56.228024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ebb392a8-98d7-4b08-8797-97f8261a2f1e tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:56.229141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ebb392a8-98d7-4b08-8797-97f8261a2f1e tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:56.241816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebb392a8-98d7-4b08-8797-97f8261a2f1e tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:56.243089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebb392a8-98d7-4b08-8797-97f8261a2f1e tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:56.244764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebb392a8-98d7-4b08-8797-97f8261a2f1e tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:56.245752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebb392a8-98d7-4b08-8797-97f8261a2f1e tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:56.760650 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ebb392a8-98d7-4b08-8797-97f8261a2f1e tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1834 microversion: 2.1 time: 1.107848 Aug 02 07:11:56.764156 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2562/5040] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:55 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1834 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:56.794838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:11:56.795810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:11:56.796465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:11:56.797033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:11:56.797610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:11:56.830065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:56.830704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:56.833191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:56.835977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:56.903241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Getting quotas for project daaad725b62041d1ac0af9ff8efcdfc5. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:11:56.915383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Getting quotas for user 35f9bc6690f3473a99804c14351b93b6 and project daaad725b62041d1ac0af9ff8efcdfc5. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:11:56.951538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:11:56.955363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:11:57.238420 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ded10fe0-dffe-4d4e-b913-978c14684faa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.192338 Aug 02 07:11:57.241212 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2479/5041] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:11:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:11:57.251407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-24603a2a-562c-405d-8b43-2d37f15a3f41 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:57.254086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-24603a2a-562c-405d-8b43-2d37f15a3f41 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:57.361249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-24603a2a-562c-405d-8b43-2d37f15a3f41 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:57.375251 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-24603a2a-562c-405d-8b43-2d37f15a3f41 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1215 microversion: 2.1 time: 0.127863 Aug 02 07:11:57.378989 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2563/5042] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:57 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:58.400286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f9abb141-8545-4a28-a2bd-cf2a5db57819 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:58.401072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f9abb141-8545-4a28-a2bd-cf2a5db57819 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:58.412783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:11:58.546986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f9abb141-8545-4a28-a2bd-cf2a5db57819 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:58.560646 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f9abb141-8545-4a28-a2bd-cf2a5db57819 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1215 microversion: 2.1 time: 0.162980 Aug 02 07:11:58.579176 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2480/5043] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:58 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:11:59.597631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cb0b53c4-2c34-46ab-b1d5-6fc7747fc2b6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:11:59.598802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cb0b53c4-2c34-46ab-b1d5-6fc7747fc2b6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:11:59.659550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb0b53c4-2c34-46ab-b1d5-6fc7747fc2b6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:59.660194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb0b53c4-2c34-46ab-b1d5-6fc7747fc2b6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:59.661265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb0b53c4-2c34-46ab-b1d5-6fc7747fc2b6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:11:59.661484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cb0b53c4-2c34-46ab-b1d5-6fc7747fc2b6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:11:59.817221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cb0b53c4-2c34-46ab-b1d5-6fc7747fc2b6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:11:59.852158 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cb0b53c4-2c34-46ab-b1d5-6fc7747fc2b6 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1275 microversion: 2.1 time: 0.270916 Aug 02 07:11:59.853062 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2564/5044] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:11:59 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1275 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:00.893120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1d6e2625-a353-428e-a033-8e83819c8165 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:00.896331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1d6e2625-a353-428e-a033-8e83819c8165 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:00.908356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d6e2625-a353-428e-a033-8e83819c8165 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:00.909053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d6e2625-a353-428e-a033-8e83819c8165 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:00.922620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d6e2625-a353-428e-a033-8e83819c8165 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:00.923738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d6e2625-a353-428e-a033-8e83819c8165 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:01.007843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c73083c1-1f40-4e99-8895-bf0b085985cc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:01.009871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c73083c1-1f40-4e99-8895-bf0b085985cc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:01.026537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c73083c1-1f40-4e99-8895-bf0b085985cc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:01.032095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c73083c1-1f40-4e99-8895-bf0b085985cc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:01.033340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c73083c1-1f40-4e99-8895-bf0b085985cc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:01.034227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c73083c1-1f40-4e99-8895-bf0b085985cc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:01.079292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c73083c1-1f40-4e99-8895-bf0b085985cc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:12:01.104859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1d6e2625-a353-428e-a033-8e83819c8165 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:01.113337 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1d6e2625-a353-428e-a033-8e83819c8165 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1273 microversion: 2.1 time: 0.228228 Aug 02 07:12:01.126307 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2481/5045] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:00 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:01.239678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-cc65eb99-8358-45af-bdda-48d099a0646c req-337dd666-e5e1-439d-acab-18b3f77a8177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a5964c-4da3-4792-9d53-9c7a77632724", "tag": "a4d951c8-7fd6-4964-b8d1-fffe96300cc7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:01.242930 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c73083c1-1f40-4e99-8895-bf0b085985cc tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 204 len: 0 microversion: 2.1 time: 0.239816 Aug 02 07:12:01.244019 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2565/5046] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:12:01 2022] DELETE /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:12:01.258357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5e0106b1-a74d-4d20-8b81-41cfbe9469e8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:01.260505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5e0106b1-a74d-4d20-8b81-41cfbe9469e8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:01.264553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cc65eb99-8358-45af-bdda-48d099a0646c req-337dd666-e5e1-439d-acab-18b3f77a8177 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:01.268382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cc65eb99-8358-45af-bdda-48d099a0646c req-337dd666-e5e1-439d-acab-18b3f77a8177 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:01.288407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e0106b1-a74d-4d20-8b81-41cfbe9469e8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:01.289561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e0106b1-a74d-4d20-8b81-41cfbe9469e8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:01.291649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e0106b1-a74d-4d20-8b81-41cfbe9469e8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:01.295537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e0106b1-a74d-4d20-8b81-41cfbe9469e8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:01.297160 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-cc65eb99-8358-45af-bdda-48d099a0646c req-337dd666-e5e1-439d-acab-18b3f77a8177 service nova] Creating event network-changed:a4d951c8-7fd6-4964-b8d1-fffe96300cc7 for instance e9a5964c-4da3-4792-9d53-9c7a77632724 on n-h2-851337-3 Aug 02 07:12:01.317303 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-cc65eb99-8358-45af-bdda-48d099a0646c req-337dd666-e5e1-439d-acab-18b3f77a8177 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081174 Aug 02 07:12:01.321301 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2482/5047] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:01.753791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5e0106b1-a74d-4d20-8b81-41cfbe9469e8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:01.767147 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5e0106b1-a74d-4d20-8b81-41cfbe9469e8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1689 microversion: 2.1 time: 0.518197 Aug 02 07:12:01.773811 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2566/5048] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:01 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1689 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:12:02.140426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0d7f548-d611-4716-b425-6a1be4673bb3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:02.146892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d0d7f548-d611-4716-b425-6a1be4673bb3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:02.175684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0d7f548-d611-4716-b425-6a1be4673bb3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:02.177491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0d7f548-d611-4716-b425-6a1be4673bb3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:02.180434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0d7f548-d611-4716-b425-6a1be4673bb3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:02.182141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0d7f548-d611-4716-b425-6a1be4673bb3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:02.414593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d0d7f548-d611-4716-b425-6a1be4673bb3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:02.428636 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d0d7f548-d611-4716-b425-6a1be4673bb3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1273 microversion: 2.1 time: 0.297082 Aug 02 07:12:02.445586 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2483/5049] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:02 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1273 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:02.796751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-18a5f0b1-92b3-4a5c-9a49-2bb9c1879589 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:02.797469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-18a5f0b1-92b3-4a5c-9a49-2bb9c1879589 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:02.813834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18a5f0b1-92b3-4a5c-9a49-2bb9c1879589 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:02.815111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18a5f0b1-92b3-4a5c-9a49-2bb9c1879589 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:02.819978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18a5f0b1-92b3-4a5c-9a49-2bb9c1879589 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:02.821523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18a5f0b1-92b3-4a5c-9a49-2bb9c1879589 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:03.493210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-96426318", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "016da4cb-923e-4a39-b41a-052985ca210a"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:03.607962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] validate_networks() for [('016da4cb-923e-4a39-b41a-052985ca210a', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:12:05.207161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-18a5f0b1-92b3-4a5c-9a49-2bb9c1879589 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:05.220433 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-18a5f0b1-92b3-4a5c-9a49-2bb9c1879589 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 200 len: 1689 microversion: 2.1 time: 2.426682 Aug 02 07:12:05.221360 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2567/5050] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:02 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 1689 bytes in 2429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:05.252148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d3717d15-1e49-47cf-a854-ba49f24ea43e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:05.252777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d3717d15-1e49-47cf-a854-ba49f24ea43e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:05.270238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3717d15-1e49-47cf-a854-ba49f24ea43e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:05.270688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3717d15-1e49-47cf-a854-ba49f24ea43e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:05.274203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3717d15-1e49-47cf-a854-ba49f24ea43e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:05.274660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3717d15-1e49-47cf-a854-ba49f24ea43e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:06.313961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d3717d15-1e49-47cf-a854-ba49f24ea43e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:06.331226 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d3717d15-1e49-47cf-a854-ba49f24ea43e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1315 microversion: 2.1 time: 1.093148 Aug 02 07:12:06.332690 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2568/5051] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:05 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1315 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:06.641470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:12:06.642128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:12:06.642411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:12:06.642867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:12:06.643288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:12:06.658063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:06.658755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:06.659723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:06.660442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:06.681128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Getting quotas for project df3ae5d403a5490993efce0589d43b2c. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:12:06.684022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7543d818-8f9b-4766-a06f-8ab4295986ea req-cbfeeaab-c97d-4432-bec5-00e97e34527d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b0eba9-58fc-47d6-a778-2a580f26f2d1", "tag": "483dedf3-572c-4e4a-9350-d84e20e2f8ee"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:06.689341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Getting quotas for user ccabca8ae1214d6fb6d0753d9e2c6265 and project df3ae5d403a5490993efce0589d43b2c. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:12:06.711277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:12:06.716052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:12:06.717673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7543d818-8f9b-4766-a06f-8ab4295986ea req-cbfeeaab-c97d-4432-bec5-00e97e34527d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:06.718359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7543d818-8f9b-4766-a06f-8ab4295986ea req-cbfeeaab-c97d-4432-bec5-00e97e34527d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:06.740024 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7543d818-8f9b-4766-a06f-8ab4295986ea req-cbfeeaab-c97d-4432-bec5-00e97e34527d service nova] Creating event network-changed:483dedf3-572c-4e4a-9350-d84e20e2f8ee for instance c2b0eba9-58fc-47d6-a778-2a580f26f2d1 on n-h2-851337-3 Aug 02 07:12:06.759475 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7543d818-8f9b-4766-a06f-8ab4295986ea req-cbfeeaab-c97d-4432-bec5-00e97e34527d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.424119 Aug 02 07:12:06.760632 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2569/5052] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:06.806215 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ef9cbe66-fd37-4ed2-af50-2597027cc6ca tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.665112 Aug 02 07:12:06.809925 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2484/5053] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:12:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 07:12:06.821876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-59cf53d1-3b41-4e7a-98d9-65f7030504e1 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:06.823813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-59cf53d1-3b41-4e7a-98d9-65f7030504e1 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:06.834626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59cf53d1-3b41-4e7a-98d9-65f7030504e1 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:06.836128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59cf53d1-3b41-4e7a-98d9-65f7030504e1 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:06.838095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59cf53d1-3b41-4e7a-98d9-65f7030504e1 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:06.839152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-59cf53d1-3b41-4e7a-98d9-65f7030504e1 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:06.950689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-59cf53d1-3b41-4e7a-98d9-65f7030504e1 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:12:07.224207 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-59cf53d1-3b41-4e7a-98d9-65f7030504e1 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 204 len: 0 microversion: 2.1 time: 0.408636 Aug 02 07:12:07.225753 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2485/5054] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:12:06 2022] DELETE /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:12:07.250859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-22bc0ee5-4b85-4004-a58d-406d97710603 req-b3b8a552-1c6b-4f17-addb-267338e62250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a5964c-4da3-4792-9d53-9c7a77632724", "name": "network-vif-deleted", "tag": "a4d951c8-7fd6-4964-b8d1-fffe96300cc7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:07.260303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d6319d29-2779-4acc-9880-e7a4e9276840 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:07.263017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d6319d29-2779-4acc-9880-e7a4e9276840 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: e9a5964c-4da3-4792-9d53-9c7a77632724] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:07.279093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-22bc0ee5-4b85-4004-a58d-406d97710603 req-b3b8a552-1c6b-4f17-addb-267338e62250 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:07.282059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6319d29-2779-4acc-9880-e7a4e9276840 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:07.282263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6319d29-2779-4acc-9880-e7a4e9276840 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:07.283579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6319d29-2779-4acc-9880-e7a4e9276840 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:07.288463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6319d29-2779-4acc-9880-e7a4e9276840 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:07.288846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-22bc0ee5-4b85-4004-a58d-406d97710603 req-b3b8a552-1c6b-4f17-addb-267338e62250 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:07.302015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:07.319976 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-d6319d29-2779-4acc-9880-e7a4e9276840 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] HTTP exception thrown: Instance e9a5964c-4da3-4792-9d53-9c7a77632724 could not be found. Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d6319d29-2779-4acc-9880-e7a4e9276840 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Request method failure captured: Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 HTTP/1.1 Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mzd332IyHs8WEC33t3YUNz7sq1ptUIAHfE__Qv8aBPsjD5fgOPUMjL9QNhBtDeuMmcahY94wYnuhI_ZDX9lnldCseQtzbltYf6Z0vf9AbPytvHxBPNUlbLU5KkXMkrC0xu54w449QvxMiAm33sZhpVGvyWLihgN3WhItHGPM7rvGsc Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: bfa05afa69e04974ad3de049c511c674 Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1158041327 Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bfa05afa69e04974ad3de049c511c674"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bfa05afa69e04974ad3de049c511c674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bfa05afa69e04974ad3de049c511c674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bfa05afa69e04974ad3de049c511c674"}]}] Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1158041327 Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: bfa05afa69e04974ad3de049c511c674 Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1158041327 Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestNetworkAdvancedServerOps-1158041327-project Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: a44367c6be00413eb7b6c79272448cf4 Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1158041327-project Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance e9a5964c-4da3-4792-9d53-9c7a77632724 could not be found. Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'e9a5964c-4da3-4792-9d53-9c7a77632724'} Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a5964c-4da3-4792-9d53-9c7a77632724 could not be found. Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a5964c-4da3-4792-9d53-9c7a77632724 could not be found. Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:07.323741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:12:07.328799 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:07.328799 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:12:07.328799 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:12:07.328799 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:12:07.328799 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:12:07.328799 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:12:07.328799 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a5964c-4da3-4792-9d53-9c7a77632724 could not be found. Aug 02 07:12:07.328799 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:07.328799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d6319d29-2779-4acc-9880-e7a4e9276840 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Returning 404 to user: Instance e9a5964c-4da3-4792-9d53-9c7a77632724 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:12:07.328799 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d6319d29-2779-4acc-9880-e7a4e9276840 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724" status: 404 len: 111 microversion: 2.1 time: 0.095172 Aug 02 07:12:07.328799 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2486/5055] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:07 2022] GET /compute/v2.1/servers/e9a5964c-4da3-4792-9d53-9c7a77632724 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:12:07.332725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-de7588ee-4391-4fcb-91f9-d8f2bdf49677 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:07.333134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-de7588ee-4391-4fcb-91f9-d8f2bdf49677 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:07.334740 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-22bc0ee5-4b85-4004-a58d-406d97710603 req-b3b8a552-1c6b-4f17-addb-267338e62250 service nova] Creating event network-vif-deleted:a4d951c8-7fd6-4964-b8d1-fffe96300cc7 for instance e9a5964c-4da3-4792-9d53-9c7a77632724 on n-h2-851337-3 Aug 02 07:12:07.351064 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-22bc0ee5-4b85-4004-a58d-406d97710603 req-b3b8a552-1c6b-4f17-addb-267338e62250 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.588805 Aug 02 07:12:07.355647 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2570/5056] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:07.372574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0fe61514-0ce6-4bdc-b31f-669ebb441fde tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:07.373282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0fe61514-0ce6-4bdc-b31f-669ebb441fde tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:07.381731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:07.388774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0fe61514-0ce6-4bdc-b31f-669ebb441fde tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:07.389541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0fe61514-0ce6-4bdc-b31f-669ebb441fde tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:07.390892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0fe61514-0ce6-4bdc-b31f-669ebb441fde tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:07.392953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0fe61514-0ce6-4bdc-b31f-669ebb441fde tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:07.575486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-de7588ee-4391-4fcb-91f9-d8f2bdf49677 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:07.587307 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-de7588ee-4391-4fcb-91f9-d8f2bdf49677 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1214 microversion: 2.1 time: 0.258897 Aug 02 07:12:07.588914 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2487/5057] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:07 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1214 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:07.610153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-54909d00-f656-4ddc-9565-7bce18781b9f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:07.612274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-54909d00-f656-4ddc-9565-7bce18781b9f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:07.633855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-54909d00-f656-4ddc-9565-7bce18781b9f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:07.635997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-54909d00-f656-4ddc-9565-7bce18781b9f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:07.637782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-54909d00-f656-4ddc-9565-7bce18781b9f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:07.640676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-54909d00-f656-4ddc-9565-7bce18781b9f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:08.229819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-54909d00-f656-4ddc-9565-7bce18781b9f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:08.245460 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-54909d00-f656-4ddc-9565-7bce18781b9f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1315 microversion: 2.1 time: 0.653952 Aug 02 07:12:08.246903 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2488/5058] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:07 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:08.415169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0fe61514-0ce6-4bdc-b31f-669ebb441fde tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:08.433160 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0fe61514-0ce6-4bdc-b31f-669ebb441fde tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1513 microversion: 2.1 time: 1.075938 Aug 02 07:12:08.434065 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2571/5059] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:07 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1513 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:08.610608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bf4b1edb-e882-4d65-88c6-a66f575efa81 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:08.611534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bf4b1edb-e882-4d65-88c6-a66f575efa81 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:08.621881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf4b1edb-e882-4d65-88c6-a66f575efa81 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:08.627746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf4b1edb-e882-4d65-88c6-a66f575efa81 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:08.630083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf4b1edb-e882-4d65-88c6-a66f575efa81 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:08.631485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf4b1edb-e882-4d65-88c6-a66f575efa81 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:08.861927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bf4b1edb-e882-4d65-88c6-a66f575efa81 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:08.874320 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bf4b1edb-e882-4d65-88c6-a66f575efa81 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1218 microversion: 2.1 time: 0.268236 Aug 02 07:12:08.874930 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2489/5060] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:08 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1218 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:09.269583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-be580327-bfcd-48c2-baaf-a073818f8d7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:09.270226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-be580327-bfcd-48c2-baaf-a073818f8d7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:09.305742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be580327-bfcd-48c2-baaf-a073818f8d7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:09.305742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be580327-bfcd-48c2-baaf-a073818f8d7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:09.305742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be580327-bfcd-48c2-baaf-a073818f8d7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:09.305742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be580327-bfcd-48c2-baaf-a073818f8d7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:09.459770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e0e87621-3f2b-47fb-9474-4a2cdfcbf57d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:09.460402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e0e87621-3f2b-47fb-9474-4a2cdfcbf57d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:09.486209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0e87621-3f2b-47fb-9474-4a2cdfcbf57d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:09.488509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0e87621-3f2b-47fb-9474-4a2cdfcbf57d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:09.489682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0e87621-3f2b-47fb-9474-4a2cdfcbf57d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:09.491536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0e87621-3f2b-47fb-9474-4a2cdfcbf57d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:10.724721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-be580327-bfcd-48c2-baaf-a073818f8d7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:10.735661 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-be580327-bfcd-48c2-baaf-a073818f8d7b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1315 microversion: 2.1 time: 1.471516 Aug 02 07:12:10.755989 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2572/5061] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:09 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1315 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:10.768592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-216cfd5d-b651-4b8d-8a6a-59a014da08ea tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:10.770479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-216cfd5d-b651-4b8d-8a6a-59a014da08ea tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:10.777410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:10.790543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-216cfd5d-b651-4b8d-8a6a-59a014da08ea tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:10.792341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-216cfd5d-b651-4b8d-8a6a-59a014da08ea tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:10.793820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-216cfd5d-b651-4b8d-8a6a-59a014da08ea tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:10.794761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-216cfd5d-b651-4b8d-8a6a-59a014da08ea tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:10.947373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e0e87621-3f2b-47fb-9474-4a2cdfcbf57d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:10.968623 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e0e87621-3f2b-47fb-9474-4a2cdfcbf57d tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1513 microversion: 2.1 time: 1.508572 Aug 02 07:12:10.970749 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2490/5062] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:09 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1513 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:11.002814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-216cfd5d-b651-4b8d-8a6a-59a014da08ea tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:11.017876 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-216cfd5d-b651-4b8d-8a6a-59a014da08ea tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1272 microversion: 2.1 time: 0.260174 Aug 02 07:12:11.019392 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2573/5063] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:10 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:11.532300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-96ea6000-3735-4a95-adec-a9044dd8e140 req-1dfc3a90-a147-4102-bab0-4159d2a1b2f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f30eee-cead-423c-995f-3148f1ccb0b4", "name": "network-vif-deleted", "tag": "76b8561b-ea50-4b30-b705-61d124891db1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:11.552917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-96ea6000-3735-4a95-adec-a9044dd8e140 req-1dfc3a90-a147-4102-bab0-4159d2a1b2f7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:11.556871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-96ea6000-3735-4a95-adec-a9044dd8e140 req-1dfc3a90-a147-4102-bab0-4159d2a1b2f7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:11.588826 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-96ea6000-3735-4a95-adec-a9044dd8e140 req-1dfc3a90-a147-4102-bab0-4159d2a1b2f7 service nova] Creating event network-vif-deleted:76b8561b-ea50-4b30-b705-61d124891db1 for instance 03f30eee-cead-423c-995f-3148f1ccb0b4 on n-h1-851337-3 Aug 02 07:12:11.601115 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-96ea6000-3735-4a95-adec-a9044dd8e140 req-1dfc3a90-a147-4102-bab0-4159d2a1b2f7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073313 Aug 02 07:12:11.608304 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2491/5064] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:11.757360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b0eb69c8-6a99-4ab2-9dad-66ccc33eec48 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:11.758041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b0eb69c8-6a99-4ab2-9dad-66ccc33eec48 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:11.764889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0eb69c8-6a99-4ab2-9dad-66ccc33eec48 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:11.765335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0eb69c8-6a99-4ab2-9dad-66ccc33eec48 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:11.766141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0eb69c8-6a99-4ab2-9dad-66ccc33eec48 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:11.766860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0eb69c8-6a99-4ab2-9dad-66ccc33eec48 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:11.995750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fea0f7ae-b96c-4352-beed-4bfd1f5ce62b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:11.996581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fea0f7ae-b96c-4352-beed-4bfd1f5ce62b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:12.026309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea0f7ae-b96c-4352-beed-4bfd1f5ce62b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:12.026767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea0f7ae-b96c-4352-beed-4bfd1f5ce62b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:12.027561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea0f7ae-b96c-4352-beed-4bfd1f5ce62b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:12.027998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea0f7ae-b96c-4352-beed-4bfd1f5ce62b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:12.124780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea0f7ae-b96c-4352-beed-4bfd1f5ce62b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:12.125227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fea0f7ae-b96c-4352-beed-4bfd1f5ce62b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:12.131290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-fea0f7ae-b96c-4352-beed-4bfd1f5ce62b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lazy-loading 'fault' on Instance uuid 03f30eee-cead-423c-995f-3148f1ccb0b4 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:12:12.395978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fea0f7ae-b96c-4352-beed-4bfd1f5ce62b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1bc2a5837436dae121d0c5574d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5220c59e230140e382ba24d3ae86fcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:12.405525 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fea0f7ae-b96c-4352-beed-4bfd1f5ce62b tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 200 len: 1309 microversion: 2.1 time: 0.416326 Aug 02 07:12:12.409155 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2492/5065] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:11 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 1309 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:12:12.416432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-35c5a6df-e4f1-4b2b-ad25-940981c179da tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:12.421859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-35c5a6df-e4f1-4b2b-ad25-940981c179da tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:12.434606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-35c5a6df-e4f1-4b2b-ad25-940981c179da tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:12.438143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-35c5a6df-e4f1-4b2b-ad25-940981c179da tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:12.439153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-35c5a6df-e4f1-4b2b-ad25-940981c179da tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:12.441877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-35c5a6df-e4f1-4b2b-ad25-940981c179da tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:12.542230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b0eb69c8-6a99-4ab2-9dad-66ccc33eec48 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:12.550177 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b0eb69c8-6a99-4ab2-9dad-66ccc33eec48 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1315 microversion: 2.1 time: 0.796615 Aug 02 07:12:12.550781 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2574/5066] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:11 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1315 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:12.637957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-35c5a6df-e4f1-4b2b-ad25-940981c179da tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:12.668996 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-35c5a6df-e4f1-4b2b-ad25-940981c179da tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1272 microversion: 2.1 time: 0.255942 Aug 02 07:12:12.684229 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2493/5067] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:12 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1272 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:13.112044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-85366ec0-f9b3-403e-a616-17a01ad99201 req-53ecf336-5fdd-48b6-b639-8b720b6d2a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b0eba9-58fc-47d6-a778-2a580f26f2d1", "name": "network-vif-plugged", "status": "completed", "tag": "483dedf3-572c-4e4a-9350-d84e20e2f8ee"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:13.128730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-85366ec0-f9b3-403e-a616-17a01ad99201 req-53ecf336-5fdd-48b6-b639-8b720b6d2a4d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:13.129297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-85366ec0-f9b3-403e-a616-17a01ad99201 req-53ecf336-5fdd-48b6-b639-8b720b6d2a4d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:13.168143 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-85366ec0-f9b3-403e-a616-17a01ad99201 req-53ecf336-5fdd-48b6-b639-8b720b6d2a4d service nova] Creating event network-vif-plugged:483dedf3-572c-4e4a-9350-d84e20e2f8ee for instance c2b0eba9-58fc-47d6-a778-2a580f26f2d1 on n-h2-851337-3 Aug 02 07:12:13.175697 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-85366ec0-f9b3-403e-a616-17a01ad99201 req-53ecf336-5fdd-48b6-b639-8b720b6d2a4d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.621785 Aug 02 07:12:13.176460 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2575/5068] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:13.435176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-969e28f6-6fdc-4254-a9ba-ff1d987e83d9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:13.435820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-969e28f6-6fdc-4254-a9ba-ff1d987e83d9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] [instance: 03f30eee-cead-423c-995f-3148f1ccb0b4] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:13.456562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-969e28f6-6fdc-4254-a9ba-ff1d987e83d9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:13.458473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-969e28f6-6fdc-4254-a9ba-ff1d987e83d9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:13.461111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-969e28f6-6fdc-4254-a9ba-ff1d987e83d9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:13.464695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-969e28f6-6fdc-4254-a9ba-ff1d987e83d9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:13.501025 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-969e28f6-6fdc-4254-a9ba-ff1d987e83d9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] HTTP exception thrown: Instance 03f30eee-cead-423c-995f-3148f1ccb0b4 could not be found. Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-969e28f6-6fdc-4254-a9ba-ff1d987e83d9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Request method failure captured: Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 HTTP/1.1 Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M0-wu0JACzQQNT6Mptyldt5678YjABkJlZXeNIzY1M33BrtgO2cYBUEtgk65KYzpZxe70UKuOn6uRCaTFvzj5Q_FamIYOkbN2-AErjePEV__E9AezmP9WhpVsLx6MAyqlyx4EJyIR0qwrvZN87hi3QdVREpBQW3NLlb6HIVtVAUE2Y Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 5220c59e230140e382ba24d3ae86fcd1 Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-VolumesSnapshotTestJSON-826193195 Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5220c59e230140e382ba24d3ae86fcd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5220c59e230140e382ba24d3ae86fcd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5220c59e230140e382ba24d3ae86fcd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5220c59e230140e382ba24d3ae86fcd1"}]}] Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-VolumesSnapshotTestJSON-826193195 Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 5220c59e230140e382ba24d3ae86fcd1 Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-826193195 Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-VolumesSnapshotTestJSON-826193195-project Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 54d1bc2a5837436dae121d0c5574d1b9 Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-VolumesSnapshotTestJSON-826193195-project Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 03f30eee-cead-423c-995f-3148f1ccb0b4 could not be found. Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '03f30eee-cead-423c-995f-3148f1ccb0b4'} Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f30eee-cead-423c-995f-3148f1ccb0b4 could not be found. Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f30eee-cead-423c-995f-3148f1ccb0b4 could not be found. Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:12:13.511444 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:13.516794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:12:13.516794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:12:13.516794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:12:13.516794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:12:13.516794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:12:13.516794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f30eee-cead-423c-995f-3148f1ccb0b4 could not be found. Aug 02 07:12:13.516794 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:13.518361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-969e28f6-6fdc-4254-a9ba-ff1d987e83d9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] Returning 404 to user: Instance 03f30eee-cead-423c-995f-3148f1ccb0b4 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:12:13.519822 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-969e28f6-6fdc-4254-a9ba-ff1d987e83d9 tempest-VolumesSnapshotTestJSON-826193195 tempest-VolumesSnapshotTestJSON-826193195-project] 10.222.0.79 "GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4" status: 404 len: 111 microversion: 2.1 time: 0.089872 Aug 02 07:12:13.521214 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2494/5069] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:13 2022] GET /compute/v2.1/servers/03f30eee-cead-423c-995f-3148f1ccb0b4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:12:13.574296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-24ba5b1c-cb69-4de5-a630-de37a102723e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:13.575011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-24ba5b1c-cb69-4de5-a630-de37a102723e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:13.597284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24ba5b1c-cb69-4de5-a630-de37a102723e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:13.597747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24ba5b1c-cb69-4de5-a630-de37a102723e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:13.609854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24ba5b1c-cb69-4de5-a630-de37a102723e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:13.610516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24ba5b1c-cb69-4de5-a630-de37a102723e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:13.693342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fbd45110-6ccc-4255-bb26-2256639b583e tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:13.694063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fbd45110-6ccc-4255-bb26-2256639b583e tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:13.701087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbd45110-6ccc-4255-bb26-2256639b583e tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:13.703828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbd45110-6ccc-4255-bb26-2256639b583e tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:13.708309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbd45110-6ccc-4255-bb26-2256639b583e tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:13.709055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbd45110-6ccc-4255-bb26-2256639b583e tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:14.034868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-24ba5b1c-cb69-4de5-a630-de37a102723e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:14.043641 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-24ba5b1c-cb69-4de5-a630-de37a102723e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1315 microversion: 2.1 time: 0.475593 Aug 02 07:12:14.051031 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2576/5070] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:13 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:14.078694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2306f77-ceab-455e-9b30-f60acb5ece01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:14.079206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f2306f77-ceab-455e-9b30-f60acb5ece01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:14.108695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2306f77-ceab-455e-9b30-f60acb5ece01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:14.109133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2306f77-ceab-455e-9b30-f60acb5ece01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:14.112676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2306f77-ceab-455e-9b30-f60acb5ece01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:14.113323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2306f77-ceab-455e-9b30-f60acb5ece01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:14.191797 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f2306f77-ceab-455e-9b30-f60acb5ece01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b/ips" status: 200 len: 150 microversion: 2.20 time: 0.139531 Aug 02 07:12:14.210277 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2577/5071] 10.222.0.79 () {60 vars in 1289 bytes} [Tue Aug 2 07:12:14 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b/ips => generated 150 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:12:15.071482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6c5fbb38-de68-4c49-a11b-0fd6361edaca tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:15.072009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6c5fbb38-de68-4c49-a11b-0fd6361edaca tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:15.086404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6c5fbb38-de68-4c49-a11b-0fd6361edaca tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:15.094277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6c5fbb38-de68-4c49-a11b-0fd6361edaca tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:15.096178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6c5fbb38-de68-4c49-a11b-0fd6361edaca tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:15.098655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6c5fbb38-de68-4c49-a11b-0fd6361edaca tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:15.142358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:15.294088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fbd45110-6ccc-4255-bb26-2256639b583e tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:15.308134 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fbd45110-6ccc-4255-bb26-2256639b583e tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1314 microversion: 2.1 time: 1.619216 Aug 02 07:12:15.314528 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2495/5072] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:13 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1314 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:15.911497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6c5fbb38-de68-4c49-a11b-0fd6361edaca tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:15.932335 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6c5fbb38-de68-4c49-a11b-0fd6361edaca tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1315 microversion: 2.1 time: 0.865725 Aug 02 07:12:15.947436 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2578/5073] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:15 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1315 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:12:16.338991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3765cdca-3199-447b-a4ca-2d158e61faf7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:16.340302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3765cdca-3199-447b-a4ca-2d158e61faf7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:16.362627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3765cdca-3199-447b-a4ca-2d158e61faf7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:16.364193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3765cdca-3199-447b-a4ca-2d158e61faf7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:16.365096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3765cdca-3199-447b-a4ca-2d158e61faf7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:16.371712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3765cdca-3199-447b-a4ca-2d158e61faf7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:16.672778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:16.959839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c161b7b-4a75-4ed9-b1a9-865d5adcc43d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:16.961395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1c161b7b-4a75-4ed9-b1a9-865d5adcc43d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:16.985769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c161b7b-4a75-4ed9-b1a9-865d5adcc43d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:16.987702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c161b7b-4a75-4ed9-b1a9-865d5adcc43d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:16.991578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c161b7b-4a75-4ed9-b1a9-865d5adcc43d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:16.992913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c161b7b-4a75-4ed9-b1a9-865d5adcc43d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:17.004660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3765cdca-3199-447b-a4ca-2d158e61faf7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:17.023365 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3765cdca-3199-447b-a4ca-2d158e61faf7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1314 microversion: 2.1 time: 0.688392 Aug 02 07:12:17.029480 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2496/5074] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:16 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1314 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:17.748013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1c161b7b-4a75-4ed9-b1a9-865d5adcc43d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:17.760279 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1c161b7b-4a75-4ed9-b1a9-865d5adcc43d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1501 microversion: 2.1 time: 0.805905 Aug 02 07:12:17.769657 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2579/5075] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:16 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1501 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:12:17.801572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8e1c8fde-9ab8-4cea-a98d-97bd79fee66e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:17.812436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8e1c8fde-9ab8-4cea-a98d-97bd79fee66e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:17.816704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=16 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:17.835343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e1c8fde-9ab8-4cea-a98d-97bd79fee66e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:17.837292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e1c8fde-9ab8-4cea-a98d-97bd79fee66e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:17.843184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e1c8fde-9ab8-4cea-a98d-97bd79fee66e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:17.844053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e1c8fde-9ab8-4cea-a98d-97bd79fee66e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:18.053279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e35d1fff-049e-44c8-a8a3-84e5db78bb5f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:18.056050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e35d1fff-049e-44c8-a8a3-84e5db78bb5f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:18.079447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e35d1fff-049e-44c8-a8a3-84e5db78bb5f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:18.081539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e35d1fff-049e-44c8-a8a3-84e5db78bb5f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:18.082640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e35d1fff-049e-44c8-a8a3-84e5db78bb5f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:18.083079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e35d1fff-049e-44c8-a8a3-84e5db78bb5f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:18.324626 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.network.security_group_api [None req-8e1c8fde-9ab8-4cea-a98d-97bd79fee66e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Removing security group e8dd9a08-7560-46c9-ae74-e8040668fe32 from port 483dedf3-572c-4e4a-9350-d84e20e2f8ee Aug 02 07:12:19.081487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e35d1fff-049e-44c8-a8a3-84e5db78bb5f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:19.101021 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e35d1fff-049e-44c8-a8a3-84e5db78bb5f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1314 microversion: 2.1 time: 1.050188 Aug 02 07:12:19.102168 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2580/5076] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:18 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1314 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:19.122689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-dd2b3139-04e6-4fcc-af7e-35215bc815d2 req-a484816b-d4e8-4db5-be95-9c7a55c9cf6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3057f6-9330-4cc9-a85f-e7fb2ff200ae", "tag": "905ce9e7-90a1-4cd9-b534-c8d45a07c666"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:19.149372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-dd2b3139-04e6-4fcc-af7e-35215bc815d2 req-a484816b-d4e8-4db5-be95-9c7a55c9cf6f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:19.150741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-dd2b3139-04e6-4fcc-af7e-35215bc815d2 req-a484816b-d4e8-4db5-be95-9c7a55c9cf6f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:19.177411 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-dd2b3139-04e6-4fcc-af7e-35215bc815d2 req-a484816b-d4e8-4db5-be95-9c7a55c9cf6f service nova] Creating event network-changed:905ce9e7-90a1-4cd9-b534-c8d45a07c666 for instance af3057f6-9330-4cc9-a85f-e7fb2ff200ae on n-h1-851337-3 Aug 02 07:12:19.185766 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-dd2b3139-04e6-4fcc-af7e-35215bc815d2 req-a484816b-d4e8-4db5-be95-9c7a55c9cf6f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080769 Aug 02 07:12:19.188594 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2581/5077] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:19.197719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-08336137-3e54-4376-a77a-df148ddfb452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:19.198795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-08336137-3e54-4376-a77a-df148ddfb452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:19.210169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08336137-3e54-4376-a77a-df148ddfb452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:19.211217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08336137-3e54-4376-a77a-df148ddfb452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:19.215073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08336137-3e54-4376-a77a-df148ddfb452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:19.216506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08336137-3e54-4376-a77a-df148ddfb452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:19.274953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-08336137-3e54-4376-a77a-df148ddfb452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lazy-loading 'flavor' on Instance uuid 8979e165-921d-4e06-92fc-dba834a53b1b {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:12:19.836928 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-08336137-3e54-4376-a77a-df148ddfb452 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "POST /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b/action" status: 202 len: 0 microversion: 2.20 time: 0.624475 Aug 02 07:12:19.843412 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2582/5078] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Aug 2 07:12:19 2022] POST /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:12:19.961481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-76598484-2dac-49dd-a9fc-e9d9c9a04af6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:19.982242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-76598484-2dac-49dd-a9fc-e9d9c9a04af6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:20.009310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76598484-2dac-49dd-a9fc-e9d9c9a04af6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:20.010322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76598484-2dac-49dd-a9fc-e9d9c9a04af6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:20.013936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76598484-2dac-49dd-a9fc-e9d9c9a04af6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:20.015529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76598484-2dac-49dd-a9fc-e9d9c9a04af6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:20.020602 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8e1c8fde-9ab8-4cea-a98d-97bd79fee66e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1/action" status: 202 len: 0 microversion: 2.1 time: 2.229669 Aug 02 07:12:20.021412 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2497/5079] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:12:17 2022] POST /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1/action => generated 0 bytes in 2232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:12:20.029929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-32b33b1e-cd0e-4844-aa3a-b0355000333e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:20.034902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-32b33b1e-cd0e-4844-aa3a-b0355000333e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:20.136629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32b33b1e-cd0e-4844-aa3a-b0355000333e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:20.137433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32b33b1e-cd0e-4844-aa3a-b0355000333e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:20.227987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32b33b1e-cd0e-4844-aa3a-b0355000333e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:20.228473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32b33b1e-cd0e-4844-aa3a-b0355000333e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:20.646786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-32b33b1e-cd0e-4844-aa3a-b0355000333e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:20.671258 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-32b33b1e-cd0e-4844-aa3a-b0355000333e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1459 microversion: 2.1 time: 0.636216 Aug 02 07:12:20.680659 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2498/5080] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:20 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1459 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:20.690658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-821b1ee6-5642-4277-931e-7ca8f245965a req-d1e87172-80d1-43fd-9d3d-2a7e5993ad6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b0eba9-58fc-47d6-a778-2a580f26f2d1", "tag": "483dedf3-572c-4e4a-9350-d84e20e2f8ee"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:20.722717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-821b1ee6-5642-4277-931e-7ca8f245965a req-d1e87172-80d1-43fd-9d3d-2a7e5993ad6e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:20.727587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-821b1ee6-5642-4277-931e-7ca8f245965a req-d1e87172-80d1-43fd-9d3d-2a7e5993ad6e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:20.734512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-76598484-2dac-49dd-a9fc-e9d9c9a04af6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:20.747202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-76598484-2dac-49dd-a9fc-e9d9c9a04af6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:20.749665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-76598484-2dac-49dd-a9fc-e9d9c9a04af6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:20.753051 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-76598484-2dac-49dd-a9fc-e9d9c9a04af6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1720 microversion: 2.20 time: 0.865985 Aug 02 07:12:20.756787 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2583/5081] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:19 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1720 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:20.765074 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-821b1ee6-5642-4277-931e-7ca8f245965a req-d1e87172-80d1-43fd-9d3d-2a7e5993ad6e service nova] Creating event network-changed:483dedf3-572c-4e4a-9350-d84e20e2f8ee for instance c2b0eba9-58fc-47d6-a778-2a580f26f2d1 on n-h2-851337-3 Aug 02 07:12:20.766885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8a16b1a7-4d26-455e-b93d-16273d03f106 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:20.769360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8a16b1a7-4d26-455e-b93d-16273d03f106 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:20.780925 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-821b1ee6-5642-4277-931e-7ca8f245965a req-d1e87172-80d1-43fd-9d3d-2a7e5993ad6e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098991 Aug 02 07:12:20.788797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a16b1a7-4d26-455e-b93d-16273d03f106 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:20.789646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a16b1a7-4d26-455e-b93d-16273d03f106 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:20.790623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a16b1a7-4d26-455e-b93d-16273d03f106 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:20.791228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8a16b1a7-4d26-455e-b93d-16273d03f106 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:20.801838 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2499/5082] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:20.808650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f5ee9e21-bf06-4449-8c8e-1aeb107e53fc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:20.809375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f5ee9e21-bf06-4449-8c8e-1aeb107e53fc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:20.870380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5ee9e21-bf06-4449-8c8e-1aeb107e53fc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:20.871164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5ee9e21-bf06-4449-8c8e-1aeb107e53fc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:20.883339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5ee9e21-bf06-4449-8c8e-1aeb107e53fc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:20.885143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5ee9e21-bf06-4449-8c8e-1aeb107e53fc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:21.302940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8a16b1a7-4d26-455e-b93d-16273d03f106 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:21.323556 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8a16b1a7-4d26-455e-b93d-16273d03f106 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1314 microversion: 2.1 time: 0.565285 Aug 02 07:12:21.324181 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2584/5083] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:20 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:21.432284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f5ee9e21-bf06-4449-8c8e-1aeb107e53fc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:21.440228 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f5ee9e21-bf06-4449-8c8e-1aeb107e53fc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.636791 Aug 02 07:12:21.444817 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2500/5084] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:20 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:21.465259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7371025b-429d-46be-9dbb-2780acd597b5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:21.465883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7371025b-429d-46be-9dbb-2780acd597b5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:21.483898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7371025b-429d-46be-9dbb-2780acd597b5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:21.484351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7371025b-429d-46be-9dbb-2780acd597b5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:21.485136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7371025b-429d-46be-9dbb-2780acd597b5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:21.497010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7371025b-429d-46be-9dbb-2780acd597b5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:21.801559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1228915678", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "8725c1f4-8d29-4621-8e45-b63d16f2b407"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:21.935441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] validate_networks() for [('8725c1f4-8d29-4621-8e45-b63d16f2b407', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:12:22.510854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7371025b-429d-46be-9dbb-2780acd597b5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:22.523724 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7371025b-429d-46be-9dbb-2780acd597b5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 1.062397 Aug 02 07:12:22.528912 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2501/5085] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:21 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:22.530036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7371025b-429d-46be-9dbb-2780acd597b5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:22.530977 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7371025b-429d-46be-9dbb-2780acd597b5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001222 Aug 02 07:12:22.531464 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2502/5086] 10.222.0.79 () {56 vars in 886 bytes} [Tue Aug 2 07:12:22 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 02 07:12:22.551759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f3b007b4-23e4-474f-badc-fb293eaf72a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:22.560340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f3b007b4-23e4-474f-badc-fb293eaf72a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:22.575724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3b007b4-23e4-474f-badc-fb293eaf72a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:22.586664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3b007b4-23e4-474f-badc-fb293eaf72a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:22.587516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3b007b4-23e4-474f-badc-fb293eaf72a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:22.587954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3b007b4-23e4-474f-badc-fb293eaf72a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:22.944980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f3b007b4-23e4-474f-badc-fb293eaf72a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:22.967055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f3b007b4-23e4-474f-badc-fb293eaf72a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:22.969121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f3b007b4-23e4-474f-badc-fb293eaf72a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:22.970418 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f3b007b4-23e4-474f-badc-fb293eaf72a6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1720 microversion: 2.20 time: 0.438082 Aug 02 07:12:22.971009 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2503/5087] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:22 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1720 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:23.015047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6d41b1a8-50b5-4ea6-b270-c1ffa4af547c tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:23.015966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6d41b1a8-50b5-4ea6-b270-c1ffa4af547c tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:23.041420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d41b1a8-50b5-4ea6-b270-c1ffa4af547c tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:23.041878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d41b1a8-50b5-4ea6-b270-c1ffa4af547c tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:23.042687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d41b1a8-50b5-4ea6-b270-c1ffa4af547c tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:23.043119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d41b1a8-50b5-4ea6-b270-c1ffa4af547c tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:23.324744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:12:23.325646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:12:23.326464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:12:23.327167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:12:23.328181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:12:23.373950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:23.379331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:23.381322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:23.382065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:23.432726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6d41b1a8-50b5-4ea6-b270-c1ffa4af547c tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:23.447897 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6d41b1a8-50b5-4ea6-b270-c1ffa4af547c tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1314 microversion: 2.1 time: 0.446706 Aug 02 07:12:23.482587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Getting quotas for project aa3438094cbb4bab88b2fc4d69a1b65a. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:12:23.483777 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2504/5088] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:22 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:23.499607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Getting quotas for user 61352a4cbcad4685bc40f72b4beee3fe and project aa3438094cbb4bab88b2fc4d69a1b65a. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:12:23.503319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a72aa2e4-06bf-4df6-863e-13750540f236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:23.504732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a72aa2e4-06bf-4df6-863e-13750540f236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:23.521913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Going to run 2 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:12:23.524521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a72aa2e4-06bf-4df6-863e-13750540f236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:23.525477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b5c7c88d-a72e-4f06-9732-e5fac295fbb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:12:23.527352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a72aa2e4-06bf-4df6-863e-13750540f236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:23.529055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a72aa2e4-06bf-4df6-863e-13750540f236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:23.532630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a72aa2e4-06bf-4df6-863e-13750540f236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:23.613417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b1a86dee-3a87-406e-a50d-fb9bb584ab76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=b5c7c88d-a72e-4f06-9732-e5fac295fbb6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:12:23.750356 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f695cad0-cf40-4167-b981-0722f5fb73f6 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.424752 Aug 02 07:12:23.752008 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2585/5089] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:12:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:12:23.764570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d1e2b3b8-4b62-44dd-bad1-316af1458945 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:23.769928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d1e2b3b8-4b62-44dd-bad1-316af1458945 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:23.771124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d1e2b3b8-4b62-44dd-bad1-316af1458945 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Searching by: {'deleted': False, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:12:23.798391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1e2b3b8-4b62-44dd-bad1-316af1458945 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:23.799358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1e2b3b8-4b62-44dd-bad1-316af1458945 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:23.800360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1e2b3b8-4b62-44dd-bad1-316af1458945 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:23.800962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1e2b3b8-4b62-44dd-bad1-316af1458945 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:23.886160 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d1e2b3b8-4b62-44dd-bad1-316af1458945 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.127224 Aug 02 07:12:23.887375 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2586/5090] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Aug 2 07:12:23 2022] GET /compute/v2.1/servers => generated 677 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:23.899884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-be58d779-0bbf-460d-8232-ba66e95d54f5 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:23.900728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-be58d779-0bbf-460d-8232-ba66e95d54f5 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b1a86dee-3a87-406e-a50d-fb9bb584ab76] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:24.123239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a72aa2e4-06bf-4df6-863e-13750540f236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:24.136912 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a72aa2e4-06bf-4df6-863e-13750540f236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.650966 Aug 02 07:12:24.140891 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2505/5091] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:23 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:24.147785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-be58d779-0bbf-460d-8232-ba66e95d54f5 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:24.158255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-24a40f16-a58b-425a-bd80-be89f6fe84c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:24.159166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-24a40f16-a58b-425a-bd80-be89f6fe84c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:24.161496 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-be58d779-0bbf-460d-8232-ba66e95d54f5 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76" status: 200 len: 1220 microversion: 2.1 time: 0.265805 Aug 02 07:12:24.162495 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2587/5092] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:23 2022] GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76 => generated 1220 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:12:24.175158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24a40f16-a58b-425a-bd80-be89f6fe84c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:24.175524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ef2ef01f-ec15-4c50-a7bf-189ae91bbfd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:24.176154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ef2ef01f-ec15-4c50-a7bf-189ae91bbfd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:24.176652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24a40f16-a58b-425a-bd80-be89f6fe84c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:24.180572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24a40f16-a58b-425a-bd80-be89f6fe84c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:24.181241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24a40f16-a58b-425a-bd80-be89f6fe84c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:24.229824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef2ef01f-ec15-4c50-a7bf-189ae91bbfd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:24.255233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef2ef01f-ec15-4c50-a7bf-189ae91bbfd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:24.256525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef2ef01f-ec15-4c50-a7bf-189ae91bbfd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:24.257643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef2ef01f-ec15-4c50-a7bf-189ae91bbfd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:24.940780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-24a40f16-a58b-425a-bd80-be89f6fe84c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:24.952070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-24a40f16-a58b-425a-bd80-be89f6fe84c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:24.960873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ef2ef01f-ec15-4c50-a7bf-189ae91bbfd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:24.965605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-24a40f16-a58b-425a-bd80-be89f6fe84c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:24.966886 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-24a40f16-a58b-425a-bd80-be89f6fe84c4 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1720 microversion: 2.20 time: 0.823805 Aug 02 07:12:24.993094 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ef2ef01f-ec15-4c50-a7bf-189ae91bbfd0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.829031 Aug 02 07:12:24.993931 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2588/5093] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:24 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:24.994654 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2506/5094] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:24 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1720 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:25.015003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34a3f566-1ab9-4534-9d7e-52f6643dac91 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:25.015818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-34a3f566-1ab9-4534-9d7e-52f6643dac91 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:25.023483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34a3f566-1ab9-4534-9d7e-52f6643dac91 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:25.024288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34a3f566-1ab9-4534-9d7e-52f6643dac91 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:25.025293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34a3f566-1ab9-4534-9d7e-52f6643dac91 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:25.026205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34a3f566-1ab9-4534-9d7e-52f6643dac91 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:25.067837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:25.188241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3c38d2ac-5741-422e-94c9-52fd54bed0fe tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:25.189467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3c38d2ac-5741-422e-94c9-52fd54bed0fe tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b1a86dee-3a87-406e-a50d-fb9bb584ab76] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:25.459551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3c38d2ac-5741-422e-94c9-52fd54bed0fe tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:25.488585 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3c38d2ac-5741-422e-94c9-52fd54bed0fe tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76" status: 200 len: 1220 microversion: 2.1 time: 0.298951 Aug 02 07:12:25.489820 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2589/5095] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:25 2022] GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76 => generated 1220 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:12:25.509257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-780852035", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "4a2e64a4-c6ee-43d5-bb6a-002018e2c279"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:25.696883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] validate_networks() for [('4a2e64a4-c6ee-43d5-bb6a-002018e2c279', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:12:26.103352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-34a3f566-1ab9-4534-9d7e-52f6643dac91 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:26.160692 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-34a3f566-1ab9-4534-9d7e-52f6643dac91 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1314 microversion: 2.1 time: 1.160267 Aug 02 07:12:26.177638 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2507/5096] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:24 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1314 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:26.188528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-840f6e44-786c-40ed-99f2-88cb2d12cc77 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:26.189166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-840f6e44-786c-40ed-99f2-88cb2d12cc77 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:26.207172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-840f6e44-786c-40ed-99f2-88cb2d12cc77 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:26.207630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-840f6e44-786c-40ed-99f2-88cb2d12cc77 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:26.212624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-840f6e44-786c-40ed-99f2-88cb2d12cc77 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:26.213915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-840f6e44-786c-40ed-99f2-88cb2d12cc77 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:26.739782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-840f6e44-786c-40ed-99f2-88cb2d12cc77 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:26.756821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-840f6e44-786c-40ed-99f2-88cb2d12cc77 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:26.759527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-840f6e44-786c-40ed-99f2-88cb2d12cc77 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:26.761000 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-840f6e44-786c-40ed-99f2-88cb2d12cc77 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1720 microversion: 2.20 time: 0.591439 Aug 02 07:12:26.793342 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2508/5097] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:26 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1720 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:26.825768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9bb89469-f753-435a-ae6c-2eb2e84e231b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '.version_select at 0x7f927a96c040>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:26.873833 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9bb89469-f753-435a-ae6c-2eb2e84e231b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1804463986" status: 202 len: 0 microversion: 2.1 time: 0.077073 Aug 02 07:12:26.877993 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2509/5098] 10.222.0.79 () {58 vars in 1284 bytes} [Tue Aug 2 07:12:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1804463986 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:12:26.896281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f9cf8c9d-02f1-4ad1-9844-28e33656c245 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:26.897173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f9cf8c9d-02f1-4ad1-9844-28e33656c245 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b1a86dee-3a87-406e-a50d-fb9bb584ab76] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:26.920799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9cf8c9d-02f1-4ad1-9844-28e33656c245 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:26.922294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9cf8c9d-02f1-4ad1-9844-28e33656c245 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:26.923506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9cf8c9d-02f1-4ad1-9844-28e33656c245 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:26.924456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f9cf8c9d-02f1-4ad1-9844-28e33656c245 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:28.120776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f9cf8c9d-02f1-4ad1-9844-28e33656c245 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:28.141611 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f9cf8c9d-02f1-4ad1-9844-28e33656c245 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76" status: 200 len: 1280 microversion: 2.1 time: 1.261500 Aug 02 07:12:28.142584 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2510/5099] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:26 2022] GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76 => generated 1280 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:28.157560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f36e81ba-72c5-46d4-9022-55bf388a8194 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'create', calling method: .version_select at 0x7f927ae3edc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1802691961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGiFuhaz90aYIbgqjqoVLZtU2mowYxQngQZh5pmRUfrh3J/rblkUnsRqkL69z4ndYLppeTh1mulj5OmeclAGfkjiPezvHeq6MmEOHY+VKuTpTlFHU6VMQI6+kCl1zYMiA=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:28.218445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f36e81ba-72c5-46d4-9022-55bf388a8194 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for project bfa05afa69e04974ad3de049c511c674. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:12:28.238964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f36e81ba-72c5-46d4-9022-55bf388a8194 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for user a44367c6be00413eb7b6c79272448cf4 and project bfa05afa69e04974ad3de049c511c674. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:12:28.327901 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f36e81ba-72c5-46d4-9022-55bf388a8194 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.183387 Aug 02 07:12:28.340729 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2511/5100] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:12:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:28.357995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-adedfd13-c906-44f7-b7fb-664744db4ffc tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:28.365417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-adedfd13-c906-44f7-b7fb-664744db4ffc tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:28.373767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:28.384890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-adedfd13-c906-44f7-b7fb-664744db4ffc tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:28.385358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-adedfd13-c906-44f7-b7fb-664744db4ffc tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:28.394791 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-adedfd13-c906-44f7-b7fb-664744db4ffc tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:28.395854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-adedfd13-c906-44f7-b7fb-664744db4ffc tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:28.733162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:12:28.734476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:12:28.735201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:12:28.735800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:12:28.737074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:12:28.792721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:28.793688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:28.794551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:28.794987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:28.819935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-adedfd13-c906-44f7-b7fb-664744db4ffc tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:28.832152 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-adedfd13-c906-44f7-b7fb-664744db4ffc tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1314 microversion: 2.1 time: 0.490089 Aug 02 07:12:28.839687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Getting quotas for project daaad725b62041d1ac0af9ff8efcdfc5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:12:28.848823 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2512/5101] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:28 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:28.855507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Getting quotas for user 35f9bc6690f3473a99804c14351b93b6 and project daaad725b62041d1ac0af9ff8efcdfc5. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:12:28.861297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79480347-cea2-4822-b61c-aff4c7d70cbe tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:28.861989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79480347-cea2-4822-b61c-aff4c7d70cbe tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:28.883226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79480347-cea2-4822-b61c-aff4c7d70cbe tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:28.884000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79480347-cea2-4822-b61c-aff4c7d70cbe tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:28.884450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79480347-cea2-4822-b61c-aff4c7d70cbe tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:28.884885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79480347-cea2-4822-b61c-aff4c7d70cbe tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:28.895090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:12:28.902171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:12:29.052665 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-04a23536-92be-4878-9a12-d6dd4484e52d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.557908 Aug 02 07:12:29.053962 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2590/5102] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:12:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:12:29.071649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a8a4bf9d-8162-4821-9f2e-cd1174ebc456 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:29.078896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a8a4bf9d-8162-4821-9f2e-cd1174ebc456 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:29.239759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a8a4bf9d-8162-4821-9f2e-cd1174ebc456 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:29.243478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79480347-cea2-4822-b61c-aff4c7d70cbe tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:29.258811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79480347-cea2-4822-b61c-aff4c7d70cbe tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:29.259754 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a8a4bf9d-8162-4821-9f2e-cd1174ebc456 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1214 microversion: 2.1 time: 0.197864 Aug 02 07:12:29.260583 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2591/5103] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:29 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:29.260738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79480347-cea2-4822-b61c-aff4c7d70cbe tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:29.266045 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79480347-cea2-4822-b61c-aff4c7d70cbe tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1720 microversion: 2.20 time: 0.413360 Aug 02 07:12:29.271567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a0bd92ea-788e-4974-a87c-99827be9695f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:29.272827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a0bd92ea-788e-4974-a87c-99827be9695f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b1a86dee-3a87-406e-a50d-fb9bb584ab76] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:29.282010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0bd92ea-788e-4974-a87c-99827be9695f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:29.282429 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2513/5104] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:28 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1720 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:29.285257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0bd92ea-788e-4974-a87c-99827be9695f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:29.286210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0bd92ea-788e-4974-a87c-99827be9695f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:29.287442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0bd92ea-788e-4974-a87c-99827be9695f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:29.309791 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b43c9e07-640c-401b-8b83-efd08b0573d2 req-287ab429-1ab6-4c56-a975-2ac35e29740d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3057f6-9330-4cc9-a85f-e7fb2ff200ae", "name": "network-vif-plugged", "status": "completed", "tag": "905ce9e7-90a1-4cd9-b534-c8d45a07c666"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:29.330006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b43c9e07-640c-401b-8b83-efd08b0573d2 req-287ab429-1ab6-4c56-a975-2ac35e29740d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:29.330981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b43c9e07-640c-401b-8b83-efd08b0573d2 req-287ab429-1ab6-4c56-a975-2ac35e29740d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:29.362816 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b43c9e07-640c-401b-8b83-efd08b0573d2 req-287ab429-1ab6-4c56-a975-2ac35e29740d service nova] Creating event network-vif-plugged:905ce9e7-90a1-4cd9-b534-c8d45a07c666 for instance af3057f6-9330-4cc9-a85f-e7fb2ff200ae on n-h1-851337-3 Aug 02 07:12:29.386110 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b43c9e07-640c-401b-8b83-efd08b0573d2 req-287ab429-1ab6-4c56-a975-2ac35e29740d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078173 Aug 02 07:12:29.389427 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2514/5105] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:29.411676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a0bd92ea-788e-4974-a87c-99827be9695f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:29.422120 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a0bd92ea-788e-4974-a87c-99827be9695f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76" status: 200 len: 1278 microversion: 2.1 time: 0.160012 Aug 02 07:12:29.423320 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2592/5106] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:29 2022] GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:29.886301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c223e4c6-6db1-4bb3-868c-762599c34e8a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:29.887562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c223e4c6-6db1-4bb3-868c-762599c34e8a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:29.923971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c223e4c6-6db1-4bb3-868c-762599c34e8a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:29.935355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c223e4c6-6db1-4bb3-868c-762599c34e8a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:29.936374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c223e4c6-6db1-4bb3-868c-762599c34e8a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:29.936820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c223e4c6-6db1-4bb3-868c-762599c34e8a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:30.290588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8c12cdc3-bc83-460d-8d58-4880a58bb42e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:30.292030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8c12cdc3-bc83-460d-8d58-4880a58bb42e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:30.318982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c12cdc3-bc83-460d-8d58-4880a58bb42e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:30.319460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c12cdc3-bc83-460d-8d58-4880a58bb42e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:30.320267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c12cdc3-bc83-460d-8d58-4880a58bb42e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:30.325937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c12cdc3-bc83-460d-8d58-4880a58bb42e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:30.660558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c223e4c6-6db1-4bb3-868c-762599c34e8a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:30.677092 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c223e4c6-6db1-4bb3-868c-762599c34e8a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1314 microversion: 2.1 time: 0.800081 Aug 02 07:12:30.680579 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2515/5107] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:29 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:12:30.692043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f2d8a03b-48c6-4ab5-9769-22ab46ba58dd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:30.697187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f2d8a03b-48c6-4ab5-9769-22ab46ba58dd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:30.729677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2d8a03b-48c6-4ab5-9769-22ab46ba58dd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:30.734621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2d8a03b-48c6-4ab5-9769-22ab46ba58dd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:30.736110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2d8a03b-48c6-4ab5-9769-22ab46ba58dd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:30.740430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2d8a03b-48c6-4ab5-9769-22ab46ba58dd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:30.771931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8c12cdc3-bc83-460d-8d58-4880a58bb42e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:30.788009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8c12cdc3-bc83-460d-8d58-4880a58bb42e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:30.790500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8c12cdc3-bc83-460d-8d58-4880a58bb42e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:30.795962 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8c12cdc3-bc83-460d-8d58-4880a58bb42e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1720 microversion: 2.20 time: 0.506847 Aug 02 07:12:30.801236 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2593/5108] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:30 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1720 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:30.815209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-435b2307-187f-49ab-aad4-08ee67752c33 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:30.815896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-435b2307-187f-49ab-aad4-08ee67752c33 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b1a86dee-3a87-406e-a50d-fb9bb584ab76] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:30.830989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-435b2307-187f-49ab-aad4-08ee67752c33 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:30.831750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-435b2307-187f-49ab-aad4-08ee67752c33 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:30.832709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-435b2307-187f-49ab-aad4-08ee67752c33 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:30.833340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-435b2307-187f-49ab-aad4-08ee67752c33 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:31.038034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f2d8a03b-48c6-4ab5-9769-22ab46ba58dd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:31.046812 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f2d8a03b-48c6-4ab5-9769-22ab46ba58dd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1266 microversion: 2.1 time: 0.364685 Aug 02 07:12:31.047421 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2516/5109] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:30 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1266 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:31.162760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-435b2307-187f-49ab-aad4-08ee67752c33 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:31.174737 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-435b2307-187f-49ab-aad4-08ee67752c33 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76" status: 200 len: 1320 microversion: 2.1 time: 0.372009 Aug 02 07:12:31.175338 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2594/5110] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:30 2022] GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76 => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:31.719504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e809f430-67c6-4f57-a513-6545d9e9104f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:31.720758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e809f430-67c6-4f57-a513-6545d9e9104f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:31.736106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e809f430-67c6-4f57-a513-6545d9e9104f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:31.752158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e809f430-67c6-4f57-a513-6545d9e9104f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:31.753633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e809f430-67c6-4f57-a513-6545d9e9104f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:31.755081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e809f430-67c6-4f57-a513-6545d9e9104f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:31.823172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f50e10a7-e16a-4ff3-b9ac-dd62e8f4fd7e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:31.825563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f50e10a7-e16a-4ff3-b9ac-dd62e8f4fd7e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:31.880999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f50e10a7-e16a-4ff3-b9ac-dd62e8f4fd7e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:31.900002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f50e10a7-e16a-4ff3-b9ac-dd62e8f4fd7e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:31.901579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f50e10a7-e16a-4ff3-b9ac-dd62e8f4fd7e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:31.903199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f50e10a7-e16a-4ff3-b9ac-dd62e8f4fd7e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:32.439170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e809f430-67c6-4f57-a513-6545d9e9104f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:32.452749 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e809f430-67c6-4f57-a513-6545d9e9104f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1314 microversion: 2.1 time: 0.737738 Aug 02 07:12:32.462915 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2517/5111] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:31 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1314 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:32.470920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f50e10a7-e16a-4ff3-b9ac-dd62e8f4fd7e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:32.481285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-edd6fa85-f33e-4d49-b3ac-1a202269ded8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:32.482305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-edd6fa85-f33e-4d49-b3ac-1a202269ded8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:32.484972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f50e10a7-e16a-4ff3-b9ac-dd62e8f4fd7e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:32.489306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f50e10a7-e16a-4ff3-b9ac-dd62e8f4fd7e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:32.492920 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f50e10a7-e16a-4ff3-b9ac-dd62e8f4fd7e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1741 microversion: 2.20 time: 0.673474 Aug 02 07:12:32.496027 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2595/5112] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:31 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1741 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:12:32.510945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2f46c2ac-6978-45cb-af38-d610cb4fe156 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:32.511991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2f46c2ac-6978-45cb-af38-d610cb4fe156 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b1a86dee-3a87-406e-a50d-fb9bb584ab76] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:32.517850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-edd6fa85-f33e-4d49-b3ac-1a202269ded8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:32.523520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f46c2ac-6978-45cb-af38-d610cb4fe156 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:32.526729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-edd6fa85-f33e-4d49-b3ac-1a202269ded8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:32.527447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f46c2ac-6978-45cb-af38-d610cb4fe156 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:32.528473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f46c2ac-6978-45cb-af38-d610cb4fe156 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:32.529073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f46c2ac-6978-45cb-af38-d610cb4fe156 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:32.538894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-edd6fa85-f33e-4d49-b3ac-1a202269ded8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:32.540209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-edd6fa85-f33e-4d49-b3ac-1a202269ded8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:32.896120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-edd6fa85-f33e-4d49-b3ac-1a202269ded8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:32.914135 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-edd6fa85-f33e-4d49-b3ac-1a202269ded8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1272 microversion: 2.1 time: 0.448328 Aug 02 07:12:32.919545 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2518/5113] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:32 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1272 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:33.098430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2f46c2ac-6978-45cb-af38-d610cb4fe156 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:33.108955 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2f46c2ac-6978-45cb-af38-d610cb4fe156 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76" status: 200 len: 1320 microversion: 2.1 time: 0.611565 Aug 02 07:12:33.110114 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2596/5114] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:32 2022] GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76 => generated 1320 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:33.482101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-797c402a-8b3d-4d68-8e15-f29146395eb7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:33.483227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-797c402a-8b3d-4d68-8e15-f29146395eb7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:33.493157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-797c402a-8b3d-4d68-8e15-f29146395eb7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:33.494353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-797c402a-8b3d-4d68-8e15-f29146395eb7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:33.495754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-797c402a-8b3d-4d68-8e15-f29146395eb7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:33.496762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-797c402a-8b3d-4d68-8e15-f29146395eb7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:33.533604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-f6e4579c-62ae-4992-9030-e9f0ec74b3fd req-06e3327e-10ae-4d7e-b537-f940e92146fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a86dee-3a87-406e-a50d-fb9bb584ab76", "tag": "b691ce26-d3d3-473f-8543-6d6934097f97"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:33.568456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f6e4579c-62ae-4992-9030-e9f0ec74b3fd req-06e3327e-10ae-4d7e-b537-f940e92146fc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:33.568901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f6e4579c-62ae-4992-9030-e9f0ec74b3fd req-06e3327e-10ae-4d7e-b537-f940e92146fc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:33.619953 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f6e4579c-62ae-4992-9030-e9f0ec74b3fd req-06e3327e-10ae-4d7e-b537-f940e92146fc service nova] Creating event network-changed:b691ce26-d3d3-473f-8543-6d6934097f97 for instance b1a86dee-3a87-406e-a50d-fb9bb584ab76 on n-h1-851337-3 Aug 02 07:12:33.630336 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-f6e4579c-62ae-4992-9030-e9f0ec74b3fd req-06e3327e-10ae-4d7e-b537-f940e92146fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102737 Aug 02 07:12:33.630968 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2597/5115] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:33.640121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7c51a469-0ed5-48b5-990c-fcdae70e4fa6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:33.640883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7c51a469-0ed5-48b5-990c-fcdae70e4fa6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:33.674638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c51a469-0ed5-48b5-990c-fcdae70e4fa6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:33.689533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c51a469-0ed5-48b5-990c-fcdae70e4fa6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:33.694093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c51a469-0ed5-48b5-990c-fcdae70e4fa6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:33.694766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c51a469-0ed5-48b5-990c-fcdae70e4fa6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:34.374891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-797c402a-8b3d-4d68-8e15-f29146395eb7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:34.386336 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-797c402a-8b3d-4d68-8e15-f29146395eb7 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1502 microversion: 2.1 time: 0.909938 Aug 02 07:12:34.392197 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2519/5116] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:33 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1502 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:34.407517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4a85fe22-feda-4218-be82-de98d358a474 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:34.409587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4a85fe22-feda-4218-be82-de98d358a474 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:34.423200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a85fe22-feda-4218-be82-de98d358a474 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:34.425323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a85fe22-feda-4218-be82-de98d358a474 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:34.426998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a85fe22-feda-4218-be82-de98d358a474 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:34.430432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a85fe22-feda-4218-be82-de98d358a474 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:34.499335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7c51a469-0ed5-48b5-990c-fcdae70e4fa6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:34.513616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7c51a469-0ed5-48b5-990c-fcdae70e4fa6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:34.522479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7c51a469-0ed5-48b5-990c-fcdae70e4fa6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:34.525362 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7c51a469-0ed5-48b5-990c-fcdae70e4fa6 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1741 microversion: 2.20 time: 0.889095 Aug 02 07:12:34.532967 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2598/5117] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:33 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1741 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:34.560254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3e15b87a-618a-481d-a87d-d0fe71afe202 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:34.563546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3e15b87a-618a-481d-a87d-d0fe71afe202 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b1a86dee-3a87-406e-a50d-fb9bb584ab76] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:34.596315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e15b87a-618a-481d-a87d-d0fe71afe202 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:34.599545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e15b87a-618a-481d-a87d-d0fe71afe202 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:34.604751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e15b87a-618a-481d-a87d-d0fe71afe202 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:34.611588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e15b87a-618a-481d-a87d-d0fe71afe202 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:34.662926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:36.153841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3e15b87a-618a-481d-a87d-d0fe71afe202 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:36.169001 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3e15b87a-618a-481d-a87d-d0fe71afe202 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76" status: 200 len: 1320 microversion: 2.1 time: 1.634088 Aug 02 07:12:36.173521 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2599/5118] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:34 2022] GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76 => generated 1320 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:36.188413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bdf3be9d-2519-4739-ba37-7343750bc4ef tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:36.194882 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bdf3be9d-2519-4739-ba37-7343750bc4ef tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:36.217554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdf3be9d-2519-4739-ba37-7343750bc4ef tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:36.218034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdf3be9d-2519-4739-ba37-7343750bc4ef tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:36.218842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdf3be9d-2519-4739-ba37-7343750bc4ef tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:36.219638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdf3be9d-2519-4739-ba37-7343750bc4ef tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:36.365293 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bdf3be9d-2519-4739-ba37-7343750bc4ef tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.185844 Aug 02 07:12:36.367400 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2600/5119] 10.222.0.79 () {58 vars in 1296 bytes} [Tue Aug 2 07:12:36 2022] DELETE /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae/os-server-password => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:12:36.398263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4a85fe22-feda-4218-be82-de98d358a474 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:36.423548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fcff35da-a76a-4aef-be8c-1dc4752eda53 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:36.424328 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4a85fe22-feda-4218-be82-de98d358a474 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1314 microversion: 2.1 time: 2.028582 Aug 02 07:12:36.425106 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2520/5120] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:34 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1314 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:36.440982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fcff35da-a76a-4aef-be8c-1dc4752eda53 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:36.450987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-7c05641d-72b6-4ac2-a1a2-6833213924df req-e83c88d2-d581-40a0-a161-e312e643edb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1a6b1e-adf6-45b2-8b9e-387276fde90c", "tag": "233d855a-4615-492c-b3f0-c628240ca34b"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:36.458521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fcff35da-a76a-4aef-be8c-1dc4752eda53 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:36.459688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fcff35da-a76a-4aef-be8c-1dc4752eda53 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:36.463571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fcff35da-a76a-4aef-be8c-1dc4752eda53 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:36.470211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fcff35da-a76a-4aef-be8c-1dc4752eda53 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:36.488667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7c05641d-72b6-4ac2-a1a2-6833213924df req-e83c88d2-d581-40a0-a161-e312e643edb7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:36.493455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7c05641d-72b6-4ac2-a1a2-6833213924df req-e83c88d2-d581-40a0-a161-e312e643edb7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:36.531232 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-7c05641d-72b6-4ac2-a1a2-6833213924df req-e83c88d2-d581-40a0-a161-e312e643edb7 service nova] Creating event network-changed:233d855a-4615-492c-b3f0-c628240ca34b for instance 9e1a6b1e-adf6-45b2-8b9e-387276fde90c on n-h2-851337-3 Aug 02 07:12:36.545200 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-7c05641d-72b6-4ac2-a1a2-6833213924df req-e83c88d2-d581-40a0-a161-e312e643edb7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101867 Aug 02 07:12:36.549757 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2521/5121] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:36.563549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-cb50bdf5-6b75-455e-8345-616c0f299256 req-20c44e6f-1245-436d-9e2d-acb3e92605c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c7c88d-a72e-4f06-9732-e5fac295fbb6", "tag": "009a0f78-2efc-4701-940e-c386c774fe82"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:36.588387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cb50bdf5-6b75-455e-8345-616c0f299256 req-20c44e6f-1245-436d-9e2d-acb3e92605c9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:36.589022 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cb50bdf5-6b75-455e-8345-616c0f299256 req-20c44e6f-1245-436d-9e2d-acb3e92605c9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:36.604983 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-cb50bdf5-6b75-455e-8345-616c0f299256 req-20c44e6f-1245-436d-9e2d-acb3e92605c9 service nova] Creating event network-changed:009a0f78-2efc-4701-940e-c386c774fe82 for instance b5c7c88d-a72e-4f06-9732-e5fac295fbb6 on n-h2-851337-3 Aug 02 07:12:36.612271 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-cb50bdf5-6b75-455e-8345-616c0f299256 req-20c44e6f-1245-436d-9e2d-acb3e92605c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059105 Aug 02 07:12:36.613482 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2522/5122] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:36.619834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-006b71e8-1323-4f44-9f2d-524778ba8bd6 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:36.622313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-006b71e8-1323-4f44-9f2d-524778ba8bd6 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:36.650589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-006b71e8-1323-4f44-9f2d-524778ba8bd6 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:36.651396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-006b71e8-1323-4f44-9f2d-524778ba8bd6 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:36.653833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-006b71e8-1323-4f44-9f2d-524778ba8bd6 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:36.658162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-006b71e8-1323-4f44-9f2d-524778ba8bd6 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:36.725298 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-006b71e8-1323-4f44-9f2d-524778ba8bd6 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.107915 Aug 02 07:12:36.726586 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2523/5123] 10.222.0.79 () {58 vars in 1293 bytes} [Tue Aug 2 07:12:36 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae/os-server-password => generated 16 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:12:36.753195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-186a00b9-a08b-46c6-9cd7-5b2ee6836432 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:36.761158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-186a00b9-a08b-46c6-9cd7-5b2ee6836432 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:36.787044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-186a00b9-a08b-46c6-9cd7-5b2ee6836432 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:36.787792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-186a00b9-a08b-46c6-9cd7-5b2ee6836432 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:36.788812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-186a00b9-a08b-46c6-9cd7-5b2ee6836432 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:36.789685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-186a00b9-a08b-46c6-9cd7-5b2ee6836432 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:36.837432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-186a00b9-a08b-46c6-9cd7-5b2ee6836432 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:12:36.995487 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-186a00b9-a08b-46c6-9cd7-5b2ee6836432 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 204 len: 0 microversion: 2.1 time: 0.259726 Aug 02 07:12:36.999323 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2524/5124] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:12:36 2022] DELETE /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:12:37.009783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a4c34046-39b0-4f08-ae06-4c030e6198fb tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:37.010978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a4c34046-39b0-4f08-ae06-4c030e6198fb tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:37.036737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4c34046-39b0-4f08-ae06-4c030e6198fb tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:37.041533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4c34046-39b0-4f08-ae06-4c030e6198fb tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:37.046722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4c34046-39b0-4f08-ae06-4c030e6198fb tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:37.048402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4c34046-39b0-4f08-ae06-4c030e6198fb tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:37.163067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fcff35da-a76a-4aef-be8c-1dc4752eda53 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:37.176351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fcff35da-a76a-4aef-be8c-1dc4752eda53 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:37.179840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fcff35da-a76a-4aef-be8c-1dc4752eda53 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:37.182583 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fcff35da-a76a-4aef-be8c-1dc4752eda53 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1741 microversion: 2.20 time: 0.810339 Aug 02 07:12:37.202556 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2601/5125] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:36 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1741 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:37.208855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-537b97ad-1bcb-4137-b714-699b4aa0ee79 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:37.209850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-537b97ad-1bcb-4137-b714-699b4aa0ee79 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b1a86dee-3a87-406e-a50d-fb9bb584ab76] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:37.218605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-537b97ad-1bcb-4137-b714-699b4aa0ee79 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:37.219809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-537b97ad-1bcb-4137-b714-699b4aa0ee79 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:37.221230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-537b97ad-1bcb-4137-b714-699b4aa0ee79 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:37.222109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-537b97ad-1bcb-4137-b714-699b4aa0ee79 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:37.684443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a4c34046-39b0-4f08-ae06-4c030e6198fb tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:37.693727 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a4c34046-39b0-4f08-ae06-4c030e6198fb tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1508 microversion: 2.1 time: 0.692158 Aug 02 07:12:37.694374 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2525/5126] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:36 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1508 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:37.710256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c804c21a-d6d4-4b94-9955-a3b14c4a9440 req-188596e6-ba0f-43c3-a1dc-e2323d3c2e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8979e165-921d-4e06-92fc-dba834a53b1b", "name": "network-vif-plugged", "status": "completed", "tag": "768fa789-2440-4838-8853-20f834aabcea"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:37.730350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c804c21a-d6d4-4b94-9955-a3b14c4a9440 req-188596e6-ba0f-43c3-a1dc-e2323d3c2e58 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:37.730537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c804c21a-d6d4-4b94-9955-a3b14c4a9440 req-188596e6-ba0f-43c3-a1dc-e2323d3c2e58 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:37.754769 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c804c21a-d6d4-4b94-9955-a3b14c4a9440 req-188596e6-ba0f-43c3-a1dc-e2323d3c2e58 service nova] Creating event network-vif-plugged:768fa789-2440-4838-8853-20f834aabcea for instance 8979e165-921d-4e06-92fc-dba834a53b1b on n-h1-851337-3 Aug 02 07:12:37.765060 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c804c21a-d6d4-4b94-9955-a3b14c4a9440 req-188596e6-ba0f-43c3-a1dc-e2323d3c2e58 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069152 Aug 02 07:12:37.765742 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2526/5127] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:37.777491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-16a038fe-4b95-493d-aec0-6bce6f7dff88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:37.778224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-16a038fe-4b95-493d-aec0-6bce6f7dff88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:37.800503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16a038fe-4b95-493d-aec0-6bce6f7dff88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:37.800943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16a038fe-4b95-493d-aec0-6bce6f7dff88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:37.802050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16a038fe-4b95-493d-aec0-6bce6f7dff88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:37.802815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16a038fe-4b95-493d-aec0-6bce6f7dff88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:37.829175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:37.872028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-537b97ad-1bcb-4137-b714-699b4aa0ee79 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:37.881207 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-537b97ad-1bcb-4137-b714-699b4aa0ee79 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76" status: 200 len: 1320 microversion: 2.1 time: 0.676953 Aug 02 07:12:37.886927 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2602/5128] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:37 2022] GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76 => generated 1320 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:38.086927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-16a038fe-4b95-493d-aec0-6bce6f7dff88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:38.095285 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-16a038fe-4b95-493d-aec0-6bce6f7dff88 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1314 microversion: 2.1 time: 0.327138 Aug 02 07:12:38.100671 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2527/5129] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:37 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:38.221221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-066a97ad-be3f-487b-a3a0-916373cc107a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:38.222302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-066a97ad-be3f-487b-a3a0-916373cc107a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:38.249813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-066a97ad-be3f-487b-a3a0-916373cc107a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:38.250393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-066a97ad-be3f-487b-a3a0-916373cc107a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:38.251573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-066a97ad-be3f-487b-a3a0-916373cc107a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:38.252019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-066a97ad-be3f-487b-a3a0-916373cc107a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:38.664331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-066a97ad-be3f-487b-a3a0-916373cc107a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:38.713287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:38.719035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1f7dab27-84d5-4daf-a28e-c40bfa53a80a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:38.719932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1f7dab27-84d5-4daf-a28e-c40bfa53a80a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:38.729224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-066a97ad-be3f-487b-a3a0-916373cc107a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:38.735274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-066a97ad-be3f-487b-a3a0-916373cc107a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:38.740447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f7dab27-84d5-4daf-a28e-c40bfa53a80a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:38.740814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f7dab27-84d5-4daf-a28e-c40bfa53a80a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:38.741379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f7dab27-84d5-4daf-a28e-c40bfa53a80a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:38.746249 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-066a97ad-be3f-487b-a3a0-916373cc107a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1741 microversion: 2.20 time: 0.531801 Aug 02 07:12:38.746859 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2603/5130] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:38 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1741 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:38.754121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f7dab27-84d5-4daf-a28e-c40bfa53a80a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:38.907624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a4a54fe7-4d84-4aba-99dc-adc10f98bd75 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:38.908250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a4a54fe7-4d84-4aba-99dc-adc10f98bd75 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b1a86dee-3a87-406e-a50d-fb9bb584ab76] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:38.914651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:38.915816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:38.931566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a54fe7-4d84-4aba-99dc-adc10f98bd75 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:38.932015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a54fe7-4d84-4aba-99dc-adc10f98bd75 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:38.936374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a54fe7-4d84-4aba-99dc-adc10f98bd75 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:38.939838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4a54fe7-4d84-4aba-99dc-adc10f98bd75 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:39.252407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=18 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:39.333831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1f7dab27-84d5-4daf-a28e-c40bfa53a80a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:39.355172 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1f7dab27-84d5-4daf-a28e-c40bfa53a80a tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1508 microversion: 2.1 time: 0.638642 Aug 02 07:12:39.356964 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2528/5131] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:38 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1508 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:39.393504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ba774f51-517f-4f52-8488-d80178872780 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:39.394223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ba774f51-517f-4f52-8488-d80178872780 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:39.415166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba774f51-517f-4f52-8488-d80178872780 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:39.415969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba774f51-517f-4f52-8488-d80178872780 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:39.417967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba774f51-517f-4f52-8488-d80178872780 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:39.418421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ba774f51-517f-4f52-8488-d80178872780 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:40.346670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a4a54fe7-4d84-4aba-99dc-adc10f98bd75 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:40.355249 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a4a54fe7-4d84-4aba-99dc-adc10f98bd75 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76" status: 200 len: 1320 microversion: 2.1 time: 1.451301 Aug 02 07:12:40.360337 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2604/5132] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:38 2022] GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76 => generated 1320 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:40.377372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-52ed7d65-5082-4462-bcf6-1c25940c86f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:40.378789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-52ed7d65-5082-4462-bcf6-1c25940c86f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:40.390015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52ed7d65-5082-4462-bcf6-1c25940c86f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:40.390780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52ed7d65-5082-4462-bcf6-1c25940c86f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:40.392239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52ed7d65-5082-4462-bcf6-1c25940c86f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:40.395231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-52ed7d65-5082-4462-bcf6-1c25940c86f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:40.914757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ba774f51-517f-4f52-8488-d80178872780 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:40.923686 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ba774f51-517f-4f52-8488-d80178872780 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1314 microversion: 2.1 time: 1.549685 Aug 02 07:12:40.928526 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2529/5133] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:39 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1314 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:40.948222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7cccae03-040f-478d-b926-9b308c46aff8 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:40.949044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7cccae03-040f-478d-b926-9b308c46aff8 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:40.969611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cccae03-040f-478d-b926-9b308c46aff8 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:40.977229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cccae03-040f-478d-b926-9b308c46aff8 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:40.983125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cccae03-040f-478d-b926-9b308c46aff8 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:40.983125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7cccae03-040f-478d-b926-9b308c46aff8 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:41.049333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-52ed7d65-5082-4462-bcf6-1c25940c86f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:41.059377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-52ed7d65-5082-4462-bcf6-1c25940c86f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:41.073411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-52ed7d65-5082-4462-bcf6-1c25940c86f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:41.079267 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-52ed7d65-5082-4462-bcf6-1c25940c86f8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1736 microversion: 2.20 time: 0.717456 Aug 02 07:12:41.082360 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2605/5134] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:40 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1736 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:41.169752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b22ccf82-2c25-44c7-96aa-7551381b74f7 req-29dde719-91d5-417b-9baa-2ef678ee811c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3057f6-9330-4cc9-a85f-e7fb2ff200ae", "name": "network-vif-deleted", "tag": "905ce9e7-90a1-4cd9-b534-c8d45a07c666"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:41.181741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b22ccf82-2c25-44c7-96aa-7551381b74f7 req-29dde719-91d5-417b-9baa-2ef678ee811c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:41.186677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b22ccf82-2c25-44c7-96aa-7551381b74f7 req-29dde719-91d5-417b-9baa-2ef678ee811c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:41.219353 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b22ccf82-2c25-44c7-96aa-7551381b74f7 req-29dde719-91d5-417b-9baa-2ef678ee811c service nova] Creating event network-vif-deleted:905ce9e7-90a1-4cd9-b534-c8d45a07c666 for instance af3057f6-9330-4cc9-a85f-e7fb2ff200ae on n-h1-851337-3 Aug 02 07:12:41.235715 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b22ccf82-2c25-44c7-96aa-7551381b74f7 req-29dde719-91d5-417b-9baa-2ef678ee811c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069291 Aug 02 07:12:41.236981 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2606/5135] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:41.343315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7cccae03-040f-478d-b926-9b308c46aff8 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccabca8ae1214d6fb6d0753d9e2c6265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ae5d403a5490993efce0589d43b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:41.358730 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7cccae03-040f-478d-b926-9b308c46aff8 tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 200 len: 1466 microversion: 2.1 time: 0.426475 Aug 02 07:12:41.359610 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2530/5136] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:40 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 1466 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:41.385458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-971a53ea-e7c0-4219-88ff-a5fde17f5598 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:41.387511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-971a53ea-e7c0-4219-88ff-a5fde17f5598 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b1a86dee-3a87-406e-a50d-fb9bb584ab76] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:41.405689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-971a53ea-e7c0-4219-88ff-a5fde17f5598 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:41.406804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-971a53ea-e7c0-4219-88ff-a5fde17f5598 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:41.407820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-971a53ea-e7c0-4219-88ff-a5fde17f5598 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:41.410733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-971a53ea-e7c0-4219-88ff-a5fde17f5598 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:41.684867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-fe9eb66d-c4fb-4c34-a127-13537373c58f req-b327a648-5e84-4fe2-8b3b-2dfcd7b38fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a86dee-3a87-406e-a50d-fb9bb584ab76", "name": "network-vif-plugged", "status": "completed", "tag": "b691ce26-d3d3-473f-8543-6d6934097f97"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:41.729106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fe9eb66d-c4fb-4c34-a127-13537373c58f req-b327a648-5e84-4fe2-8b3b-2dfcd7b38fd4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:41.731235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fe9eb66d-c4fb-4c34-a127-13537373c58f req-b327a648-5e84-4fe2-8b3b-2dfcd7b38fd4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:41.773826 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-fe9eb66d-c4fb-4c34-a127-13537373c58f req-b327a648-5e84-4fe2-8b3b-2dfcd7b38fd4 service nova] Creating event network-vif-plugged:b691ce26-d3d3-473f-8543-6d6934097f97 for instance b1a86dee-3a87-406e-a50d-fb9bb584ab76 on n-h1-851337-3 Aug 02 07:12:41.787274 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-fe9eb66d-c4fb-4c34-a127-13537373c58f req-b327a648-5e84-4fe2-8b3b-2dfcd7b38fd4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104929 Aug 02 07:12:41.794176 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2531/5137] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:41.950060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-758fb6ab-8fba-4f91-97cc-3d13887c8766 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:41.951577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-758fb6ab-8fba-4f91-97cc-3d13887c8766 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:41.964968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-758fb6ab-8fba-4f91-97cc-3d13887c8766 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:41.967118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-758fb6ab-8fba-4f91-97cc-3d13887c8766 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:41.970432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-758fb6ab-8fba-4f91-97cc-3d13887c8766 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:41.971301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-758fb6ab-8fba-4f91-97cc-3d13887c8766 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:42.784640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-971a53ea-e7c0-4219-88ff-a5fde17f5598 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:42.795469 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-971a53ea-e7c0-4219-88ff-a5fde17f5598 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76" status: 200 len: 1320 microversion: 2.1 time: 1.417521 Aug 02 07:12:42.813584 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2607/5138] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:41 2022] GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76 => generated 1320 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:42.828479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cd419684-2256-46c3-b9e6-bb74babadd43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:42.831992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cd419684-2256-46c3-b9e6-bb74babadd43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:42.857252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd419684-2256-46c3-b9e6-bb74babadd43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:42.857720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd419684-2256-46c3-b9e6-bb74babadd43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:42.858532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd419684-2256-46c3-b9e6-bb74babadd43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:42.866356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd419684-2256-46c3-b9e6-bb74babadd43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:43.482396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-758fb6ab-8fba-4f91-97cc-3d13887c8766 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:43.500865 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-758fb6ab-8fba-4f91-97cc-3d13887c8766 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1314 microversion: 2.1 time: 1.555630 Aug 02 07:12:43.506003 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2532/5139] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:41 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1314 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:12:43.531740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-316e82de-19ef-4fb9-a925-e326d4ef1c2f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:43.534654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-316e82de-19ef-4fb9-a925-e326d4ef1c2f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] [instance: af3057f6-9330-4cc9-a85f-e7fb2ff200ae] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:43.552735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-316e82de-19ef-4fb9-a925-e326d4ef1c2f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:43.558617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-316e82de-19ef-4fb9-a925-e326d4ef1c2f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:43.567808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-316e82de-19ef-4fb9-a925-e326d4ef1c2f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:43.568324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-316e82de-19ef-4fb9-a925-e326d4ef1c2f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:43.657658 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-316e82de-19ef-4fb9-a925-e326d4ef1c2f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] HTTP exception thrown: Instance af3057f6-9330-4cc9-a85f-e7fb2ff200ae could not be found. Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-316e82de-19ef-4fb9-a925-e326d4ef1c2f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Request method failure captured: Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae HTTP/1.1 Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M5CtHC5RDLlrFiKBXXW7ym3EMraRzPAbHOXZosQgh-aGUFegOD4JjcnJgUmkKNacVh_zmbLWnH9LWirhlUIGqhGci3lwrUDFrTLZZyZdfUScm091FMW8wHY30i_AMAE93WOu-0lOoPyIXexUgKLdiMMBnM_7Tk7L4zNzrixRK6YZrQ Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: df3ae5d403a5490993efce0589d43b2c Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerPasswordTestJSON-1939312804 Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/df3ae5d403a5490993efce0589d43b2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/df3ae5d403a5490993efce0589d43b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_df3ae5d403a5490993efce0589d43b2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/df3ae5d403a5490993efce0589d43b2c"}]}] Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerPasswordTestJSON-1939312804 Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: df3ae5d403a5490993efce0589d43b2c Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1939312804 Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerPasswordTestJSON-1939312804-project Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: ccabca8ae1214d6fb6d0753d9e2c6265 Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerPasswordTestJSON-1939312804-project Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance af3057f6-9330-4cc9-a85f-e7fb2ff200ae could not be found. Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'af3057f6-9330-4cc9-a85f-e7fb2ff200ae'} Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af3057f6-9330-4cc9-a85f-e7fb2ff200ae could not be found. Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af3057f6-9330-4cc9-a85f-e7fb2ff200ae could not be found. Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:12:43.660412 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:43.666136 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:12:43.666136 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:12:43.666136 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:12:43.666136 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:12:43.666136 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:12:43.666136 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af3057f6-9330-4cc9-a85f-e7fb2ff200ae could not be found. Aug 02 07:12:43.666136 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:12:43.681159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-316e82de-19ef-4fb9-a925-e326d4ef1c2f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] Returning 404 to user: Instance af3057f6-9330-4cc9-a85f-e7fb2ff200ae could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:12:43.694522 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-316e82de-19ef-4fb9-a925-e326d4ef1c2f tempest-ServerPasswordTestJSON-1939312804 tempest-ServerPasswordTestJSON-1939312804-project] 10.222.0.79 "GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae" status: 404 len: 111 microversion: 2.1 time: 0.175236 Aug 02 07:12:43.696255 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2533/5140] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:43 2022] GET /compute/v2.1/servers/af3057f6-9330-4cc9-a85f-e7fb2ff200ae => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:12:43.816843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1c12673e-e105-43e0-9eb8-9c159ccb001a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:43.818281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1c12673e-e105-43e0-9eb8-9c159ccb001a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b1a86dee-3a87-406e-a50d-fb9bb584ab76] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:43.831032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c12673e-e105-43e0-9eb8-9c159ccb001a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:43.837195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c12673e-e105-43e0-9eb8-9c159ccb001a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:43.853852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c12673e-e105-43e0-9eb8-9c159ccb001a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:43.858886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c12673e-e105-43e0-9eb8-9c159ccb001a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:43.952899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cd419684-2256-46c3-b9e6-bb74babadd43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:43.967520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cd419684-2256-46c3-b9e6-bb74babadd43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:43.971698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cd419684-2256-46c3-b9e6-bb74babadd43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:43.976198 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cd419684-2256-46c3-b9e6-bb74babadd43 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1736 microversion: 2.20 time: 1.160175 Aug 02 07:12:43.977452 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2608/5141] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:42 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1736 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:44.007418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ea84d743-b87b-4b79-86e8-6dfe66f8d44c req-87515bda-fd88-44d1-b61d-464c12b67bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1a6b1e-adf6-45b2-8b9e-387276fde90c", "name": "network-vif-plugged", "status": "completed", "tag": "233d855a-4615-492c-b3f0-c628240ca34b"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:44.050755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ea84d743-b87b-4b79-86e8-6dfe66f8d44c req-87515bda-fd88-44d1-b61d-464c12b67bde service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:44.054406 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ea84d743-b87b-4b79-86e8-6dfe66f8d44c req-87515bda-fd88-44d1-b61d-464c12b67bde service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:44.100438 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ea84d743-b87b-4b79-86e8-6dfe66f8d44c req-87515bda-fd88-44d1-b61d-464c12b67bde service nova] Creating event network-vif-plugged:233d855a-4615-492c-b3f0-c628240ca34b for instance 9e1a6b1e-adf6-45b2-8b9e-387276fde90c on n-h2-851337-3 Aug 02 07:12:44.146283 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ea84d743-b87b-4b79-86e8-6dfe66f8d44c req-87515bda-fd88-44d1-b61d-464c12b67bde service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166322 Aug 02 07:12:44.151623 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2609/5142] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:44.529407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e0c427e9-e50d-405a-b8ef-9acdaab263da tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:44.530337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e0c427e9-e50d-405a-b8ef-9acdaab263da tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:44.546990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0c427e9-e50d-405a-b8ef-9acdaab263da tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:44.547994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0c427e9-e50d-405a-b8ef-9acdaab263da tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:44.550069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0c427e9-e50d-405a-b8ef-9acdaab263da tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:44.551560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0c427e9-e50d-405a-b8ef-9acdaab263da tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:44.789584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1c12673e-e105-43e0-9eb8-9c159ccb001a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:44.801368 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1c12673e-e105-43e0-9eb8-9c159ccb001a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76" status: 200 len: 1508 microversion: 2.1 time: 0.988369 Aug 02 07:12:44.824832 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2534/5143] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:43 2022] GET /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76 => generated 1508 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:12:44.836275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-31486cc8-3fab-486b-a467-351df25cef4c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:44.844177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-31486cc8-3fab-486b-a467-351df25cef4c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b5c7c88d-a72e-4f06-9732-e5fac295fbb6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:44.873289 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31486cc8-3fab-486b-a467-351df25cef4c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:44.875053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31486cc8-3fab-486b-a467-351df25cef4c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:44.880348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31486cc8-3fab-486b-a467-351df25cef4c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:44.881503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31486cc8-3fab-486b-a467-351df25cef4c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:45.679318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e0c427e9-e50d-405a-b8ef-9acdaab263da tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:45.690293 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e0c427e9-e50d-405a-b8ef-9acdaab263da tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1314 microversion: 2.1 time: 1.166864 Aug 02 07:12:45.695885 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2610/5144] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:44 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1314 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:12:45.715926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b3a4ce37-a292-4297-809b-4797ce79b755 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:45.716759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b3a4ce37-a292-4297-809b-4797ce79b755 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:45.737827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3a4ce37-a292-4297-809b-4797ce79b755 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:45.738336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3a4ce37-a292-4297-809b-4797ce79b755 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:45.750035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3a4ce37-a292-4297-809b-4797ce79b755 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:45.750509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b3a4ce37-a292-4297-809b-4797ce79b755 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:46.155645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-31486cc8-3fab-486b-a467-351df25cef4c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:46.171243 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-31486cc8-3fab-486b-a467-351df25cef4c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/b5c7c88d-a72e-4f06-9732-e5fac295fbb6" status: 200 len: 1320 microversion: 2.1 time: 1.341066 Aug 02 07:12:46.176512 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2535/5145] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:44 2022] GET /compute/v2.1/servers/b5c7c88d-a72e-4f06-9732-e5fac295fbb6 => generated 1320 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:46.181978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b3a4ce37-a292-4297-809b-4797ce79b755 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:46.196810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b3a4ce37-a292-4297-809b-4797ce79b755 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:46.201047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b3a4ce37-a292-4297-809b-4797ce79b755 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:46.205497 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b3a4ce37-a292-4297-809b-4797ce79b755 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1736 microversion: 2.20 time: 0.501299 Aug 02 07:12:46.215292 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2611/5146] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:45 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1736 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:46.469800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-f625066a-db93-4230-8c2a-1428f945dd00 req-1846aa67-d0fb-43b7-9898-d3b5ab132454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c7c88d-a72e-4f06-9732-e5fac295fbb6", "name": "network-vif-plugged", "status": "completed", "tag": "009a0f78-2efc-4701-940e-c386c774fe82"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:46.496728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f625066a-db93-4230-8c2a-1428f945dd00 req-1846aa67-d0fb-43b7-9898-d3b5ab132454 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:46.497516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f625066a-db93-4230-8c2a-1428f945dd00 req-1846aa67-d0fb-43b7-9898-d3b5ab132454 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:46.537125 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-f625066a-db93-4230-8c2a-1428f945dd00 req-1846aa67-d0fb-43b7-9898-d3b5ab132454 service nova] Creating event network-vif-plugged:009a0f78-2efc-4701-940e-c386c774fe82 for instance b5c7c88d-a72e-4f06-9732-e5fac295fbb6 on n-h2-851337-3 Aug 02 07:12:46.563566 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-f625066a-db93-4230-8c2a-1428f945dd00 req-1846aa67-d0fb-43b7-9898-d3b5ab132454 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096353 Aug 02 07:12:46.567057 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2536/5147] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:46.711491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-510ab7b7-0228-49cd-abdd-9c83c1d8ff5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:46.712173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-510ab7b7-0228-49cd-abdd-9c83c1d8ff5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:46.735288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-510ab7b7-0228-49cd-abdd-9c83c1d8ff5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:46.742892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-510ab7b7-0228-49cd-abdd-9c83c1d8ff5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:46.747826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-510ab7b7-0228-49cd-abdd-9c83c1d8ff5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:46.750453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-510ab7b7-0228-49cd-abdd-9c83c1d8ff5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:47.194872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a4ad37a0-32b1-4eeb-bd51-de7b57de970b tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:47.195801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a4ad37a0-32b1-4eeb-bd51-de7b57de970b tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b5c7c88d-a72e-4f06-9732-e5fac295fbb6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:47.207560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-510ab7b7-0228-49cd-abdd-9c83c1d8ff5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:47.224004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4ad37a0-32b1-4eeb-bd51-de7b57de970b tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:47.226482 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-510ab7b7-0228-49cd-abdd-9c83c1d8ff5f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1314 microversion: 2.1 time: 0.518600 Aug 02 07:12:47.226742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4ad37a0-32b1-4eeb-bd51-de7b57de970b tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:47.231047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4ad37a0-32b1-4eeb-bd51-de7b57de970b tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:47.231768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4ad37a0-32b1-4eeb-bd51-de7b57de970b tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:47.245284 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2612/5148] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:46 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:47.251958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f0d315f-3238-40b3-8722-a092c1f31c09 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:47.259319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1f0d315f-3238-40b3-8722-a092c1f31c09 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:47.283525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f0d315f-3238-40b3-8722-a092c1f31c09 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:47.284614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f0d315f-3238-40b3-8722-a092c1f31c09 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:47.285802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f0d315f-3238-40b3-8722-a092c1f31c09 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:47.286462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f0d315f-3238-40b3-8722-a092c1f31c09 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:48.080137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f0d315f-3238-40b3-8722-a092c1f31c09 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:48.096241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f0d315f-3238-40b3-8722-a092c1f31c09 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:48.109391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a4ad37a0-32b1-4eeb-bd51-de7b57de970b tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:48.117949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f0d315f-3238-40b3-8722-a092c1f31c09 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:48.120562 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f0d315f-3238-40b3-8722-a092c1f31c09 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1736 microversion: 2.20 time: 0.872820 Aug 02 07:12:48.121850 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a4ad37a0-32b1-4eeb-bd51-de7b57de970b tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/b5c7c88d-a72e-4f06-9732-e5fac295fbb6" status: 200 len: 1320 microversion: 2.1 time: 0.932243 Aug 02 07:12:48.125298 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2613/5150] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:47 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1736 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:48.126956 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2537/5149] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:47 2022] GET /compute/v2.1/servers/b5c7c88d-a72e-4f06-9732-e5fac295fbb6 => generated 1320 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:12:48.257743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c48e7593-cef2-4421-914c-395bad191a20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:48.258574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c48e7593-cef2-4421-914c-395bad191a20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:48.277389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c48e7593-cef2-4421-914c-395bad191a20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:48.278392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c48e7593-cef2-4421-914c-395bad191a20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:48.279999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c48e7593-cef2-4421-914c-395bad191a20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:48.282598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c48e7593-cef2-4421-914c-395bad191a20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:49.148775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b217433c-b66a-46c4-bf17-92262be65de8 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:49.149663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b217433c-b66a-46c4-bf17-92262be65de8 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b5c7c88d-a72e-4f06-9732-e5fac295fbb6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:49.169050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b217433c-b66a-46c4-bf17-92262be65de8 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:49.169814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b217433c-b66a-46c4-bf17-92262be65de8 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:49.174313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b217433c-b66a-46c4-bf17-92262be65de8 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:49.178187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b217433c-b66a-46c4-bf17-92262be65de8 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:49.664779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c48e7593-cef2-4421-914c-395bad191a20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:49.679308 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c48e7593-cef2-4421-914c-395bad191a20 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1500 microversion: 2.1 time: 1.430189 Aug 02 07:12:49.681675 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2614/5151] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:48 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1500 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:49.710016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bcac5ded-3c44-48a7-b727-e462475d25fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:49.718895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bcac5ded-3c44-48a7-b727-e462475d25fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:49.734285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcac5ded-3c44-48a7-b727-e462475d25fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:49.735109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcac5ded-3c44-48a7-b727-e462475d25fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:49.736418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcac5ded-3c44-48a7-b727-e462475d25fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:49.737132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bcac5ded-3c44-48a7-b727-e462475d25fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:50.190839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b217433c-b66a-46c4-bf17-92262be65de8 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:50.200867 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b217433c-b66a-46c4-bf17-92262be65de8 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/b5c7c88d-a72e-4f06-9732-e5fac295fbb6" status: 200 len: 1508 microversion: 2.1 time: 1.057311 Aug 02 07:12:50.212382 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2538/5152] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:49 2022] GET /compute/v2.1/servers/b5c7c88d-a72e-4f06-9732-e5fac295fbb6 => generated 1508 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:50.235043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e49719a3-ff7d-4aa7-b533-5635dd6a9241 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:50.237178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e49719a3-ff7d-4aa7-b533-5635dd6a9241 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:50.264851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e49719a3-ff7d-4aa7-b533-5635dd6a9241 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:50.268744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e49719a3-ff7d-4aa7-b533-5635dd6a9241 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:50.269668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e49719a3-ff7d-4aa7-b533-5635dd6a9241 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:50.270238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e49719a3-ff7d-4aa7-b533-5635dd6a9241 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:50.575482 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e49719a3-ff7d-4aa7-b533-5635dd6a9241 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c/action" status: 202 len: 0 microversion: 2.1 time: 0.361383 Aug 02 07:12:50.584476 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2539/5153] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:12:50 2022] POST /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:12:50.622544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-454d1b79-e8d3-47e7-850a-9eae2bdfc6de tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:50.633830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-454d1b79-e8d3-47e7-850a-9eae2bdfc6de tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b5c7c88d-a72e-4f06-9732-e5fac295fbb6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:50.647067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-454d1b79-e8d3-47e7-850a-9eae2bdfc6de tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:50.656674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-454d1b79-e8d3-47e7-850a-9eae2bdfc6de tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:50.659430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-454d1b79-e8d3-47e7-850a-9eae2bdfc6de tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:50.666436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-454d1b79-e8d3-47e7-850a-9eae2bdfc6de tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:50.760632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-454d1b79-e8d3-47e7-850a-9eae2bdfc6de tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b5c7c88d-a72e-4f06-9732-e5fac295fbb6] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:12:51.093705 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-454d1b79-e8d3-47e7-850a-9eae2bdfc6de tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b5c7c88d-a72e-4f06-9732-e5fac295fbb6" status: 204 len: 0 microversion: 2.1 time: 0.504950 Aug 02 07:12:51.094786 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2540/5154] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:12:50 2022] DELETE /compute/v2.1/servers/b5c7c88d-a72e-4f06-9732-e5fac295fbb6 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:12:51.117717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3bb05987-fb56-4da2-86db-c8ee05647dfa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:51.117717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3bb05987-fb56-4da2-86db-c8ee05647dfa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:51.161318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bb05987-fb56-4da2-86db-c8ee05647dfa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:51.162094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bb05987-fb56-4da2-86db-c8ee05647dfa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:51.162557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bb05987-fb56-4da2-86db-c8ee05647dfa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:51.163184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bb05987-fb56-4da2-86db-c8ee05647dfa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:52.116121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bcac5ded-3c44-48a7-b727-e462475d25fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:52.135862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bcac5ded-3c44-48a7-b727-e462475d25fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:52.153011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bcac5ded-3c44-48a7-b727-e462475d25fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:52.154354 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bcac5ded-3c44-48a7-b727-e462475d25fc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1736 microversion: 2.20 time: 2.471180 Aug 02 07:12:52.154953 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2615/5155] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:49 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1736 bytes in 2472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:52.189040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f9a919c7-1a55-40b6-9325-da432c6c38dc tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:52.190733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f9a919c7-1a55-40b6-9325-da432c6c38dc tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b1a86dee-3a87-406e-a50d-fb9bb584ab76] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:52.207644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9a919c7-1a55-40b6-9325-da432c6c38dc tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:52.208417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9a919c7-1a55-40b6-9325-da432c6c38dc tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:52.212846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9a919c7-1a55-40b6-9325-da432c6c38dc tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:52.214838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9a919c7-1a55-40b6-9325-da432c6c38dc tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:52.230625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:52.389321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f9a919c7-1a55-40b6-9325-da432c6c38dc tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: b1a86dee-3a87-406e-a50d-fb9bb584ab76] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:12:52.749507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3bb05987-fb56-4da2-86db-c8ee05647dfa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:52.760655 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3bb05987-fb56-4da2-86db-c8ee05647dfa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1485 microversion: 2.1 time: 1.663098 Aug 02 07:12:52.777067 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2541/5156] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:51 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1485 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:52.823528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b25062e8-8bb6-4b56-b19a-275384d88f1d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:52.824801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b25062e8-8bb6-4b56-b19a-275384d88f1d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:52.856452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b25062e8-8bb6-4b56-b19a-275384d88f1d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:52.861682 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f9a919c7-1a55-40b6-9325-da432c6c38dc tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76" status: 204 len: 0 microversion: 2.1 time: 0.676515 Aug 02 07:12:52.865954 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2616/5157] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:12:52 2022] DELETE /compute/v2.1/servers/b1a86dee-3a87-406e-a50d-fb9bb584ab76 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:12:52.874560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b25062e8-8bb6-4b56-b19a-275384d88f1d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:52.874560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b25062e8-8bb6-4b56-b19a-275384d88f1d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:52.874560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b25062e8-8bb6-4b56-b19a-275384d88f1d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:52.986497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-b25062e8-8bb6-4b56-b19a-275384d88f1d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lazy-loading 'flavor' on Instance uuid 9e1a6b1e-adf6-45b2-8b9e-387276fde90c {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:12:53.096260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:12:53.181108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ad91a8b1-ff3f-4aa1-b5bc-6c1bd745878a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:53.183092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ad91a8b1-ff3f-4aa1-b5bc-6c1bd745878a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:53.201965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad91a8b1-ff3f-4aa1-b5bc-6c1bd745878a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:53.212582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad91a8b1-ff3f-4aa1-b5bc-6c1bd745878a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:53.224940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad91a8b1-ff3f-4aa1-b5bc-6c1bd745878a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:53.230638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad91a8b1-ff3f-4aa1-b5bc-6c1bd745878a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:53.485243 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b25062e8-8bb6-4b56-b19a-275384d88f1d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c/action" status: 202 len: 0 microversion: 2.1 time: 0.692291 Aug 02 07:12:53.486349 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2542/5158] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:12:52 2022] POST /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:12:53.507914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1290157588", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "8725c1f4-8d29-4621-8e45-b63d16f2b407"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:53.726312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] validate_networks() for [('8725c1f4-8d29-4621-8e45-b63d16f2b407', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:12:54.457636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ad91a8b1-ff3f-4aa1-b5bc-6c1bd745878a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:54.473281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ad91a8b1-ff3f-4aa1-b5bc-6c1bd745878a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:54.478971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ad91a8b1-ff3f-4aa1-b5bc-6c1bd745878a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:54.484434 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ad91a8b1-ff3f-4aa1-b5bc-6c1bd745878a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1736 microversion: 2.20 time: 1.307282 Aug 02 07:12:54.513999 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2617/5159] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:53 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1736 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:54.534337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5d14e3e3-b609-4045-b804-318942a5334a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:54.535643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5d14e3e3-b609-4045-b804-318942a5334a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:54.548214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d14e3e3-b609-4045-b804-318942a5334a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:54.548990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d14e3e3-b609-4045-b804-318942a5334a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:54.550095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d14e3e3-b609-4045-b804-318942a5334a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:54.550705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d14e3e3-b609-4045-b804-318942a5334a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:56.579360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5d14e3e3-b609-4045-b804-318942a5334a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:56.594290 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5d14e3e3-b609-4045-b804-318942a5334a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1512 microversion: 2.1 time: 2.077440 Aug 02 07:12:56.614899 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2618/5160] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:54 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1512 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:56.641632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-de83c882-11e0-47c9-ace0-0c71599481b1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:56.643005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-de83c882-11e0-47c9-ace0-0c71599481b1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:56.666397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de83c882-11e0-47c9-ace0-0c71599481b1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:56.667492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de83c882-11e0-47c9-ace0-0c71599481b1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:56.669479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de83c882-11e0-47c9-ace0-0c71599481b1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:56.671388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de83c882-11e0-47c9-ace0-0c71599481b1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:57.282699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:12:57.283444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:12:57.284082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:12:57.284632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:12:57.285728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:12:57.312840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:57.316263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:57.318712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:57.324078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:57.405015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Getting quotas for project aa3438094cbb4bab88b2fc4d69a1b65a. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:12:57.422226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Getting quotas for user 61352a4cbcad4685bc40f72b4beee3fe and project aa3438094cbb4bab88b2fc4d69a1b65a. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:12:57.455370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Going to run 2 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:12:57.458134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: fc4739d2-43d0-4a76-9c6c-eabc6c075beb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:12:57.555487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=fc4739d2-43d0-4a76-9c6c-eabc6c075beb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:12:57.835870 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ffb20ac8-f0a2-45e8-ab60-50fc4770f930 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 4.347839 Aug 02 07:12:57.836977 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2543/5161] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:12:53 2022] POST /compute/v2.1/servers => generated 32 bytes in 4350 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 02 07:12:57.843266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e1e95d7e-4082-4e64-bbbf-d13db5bd9768 req-614a049c-b475-4624-ae47-38c2e4582e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a86dee-3a87-406e-a50d-fb9bb584ab76", "name": "network-vif-deleted", "tag": "b691ce26-d3d3-473f-8543-6d6934097f97"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:12:57.892376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e1e95d7e-4082-4e64-bbbf-d13db5bd9768 req-614a049c-b475-4624-ae47-38c2e4582e00 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:57.896720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e1e95d7e-4082-4e64-bbbf-d13db5bd9768 req-614a049c-b475-4624-ae47-38c2e4582e00 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:57.949694 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e1e95d7e-4082-4e64-bbbf-d13db5bd9768 req-614a049c-b475-4624-ae47-38c2e4582e00 service nova] Creating event network-vif-deleted:b691ce26-d3d3-473f-8543-6d6934097f97 for instance b1a86dee-3a87-406e-a50d-fb9bb584ab76 on n-h1-851337-3 Aug 02 07:12:57.971126 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e1e95d7e-4082-4e64-bbbf-d13db5bd9768 req-614a049c-b475-4624-ae47-38c2e4582e00 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131574 Aug 02 07:12:57.971749 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2544/5162] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:12:57.989954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7e00b620-95a9-4110-b1fd-da50cce97138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:57.990840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7e00b620-95a9-4110-b1fd-da50cce97138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:12:58.020008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e00b620-95a9-4110-b1fd-da50cce97138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:58.020499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e00b620-95a9-4110-b1fd-da50cce97138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:58.021325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e00b620-95a9-4110-b1fd-da50cce97138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:58.021775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e00b620-95a9-4110-b1fd-da50cce97138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:58.415831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-de83c882-11e0-47c9-ace0-0c71599481b1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:58.439180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-de83c882-11e0-47c9-ace0-0c71599481b1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:58.447190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-de83c882-11e0-47c9-ace0-0c71599481b1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:58.448832 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-de83c882-11e0-47c9-ace0-0c71599481b1 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1736 microversion: 2.20 time: 1.828608 Aug 02 07:12:58.453963 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2619/5163] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:12:56 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1736 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:12:58.472589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5d6e727e-1f8c-4724-a00e-d9c97e899797 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:58.520868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5d6e727e-1f8c-4724-a00e-d9c97e899797 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:12:58.521961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5d6e727e-1f8c-4724-a00e-d9c97e899797 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Searching by: {'deleted': False, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:12:58.595283 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d6e727e-1f8c-4724-a00e-d9c97e899797 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:58.602764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d6e727e-1f8c-4724-a00e-d9c97e899797 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:58.604411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d6e727e-1f8c-4724-a00e-d9c97e899797 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:12:58.619670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d6e727e-1f8c-4724-a00e-d9c97e899797 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:12:58.783136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-5d6e727e-1f8c-4724-a00e-d9c97e899797 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:12:58.905275 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5d6e727e-1f8c-4724-a00e-d9c97e899797 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1005 microversion: 2.1 time: 0.438045 Aug 02 07:12:58.925037 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2620/5164] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Aug 2 07:12:58 2022] GET /compute/v2.1/servers => generated 1005 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:12:58.936513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a89e51da-ba95-44ef-b80e-1f016d0d1528 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:12:58.943382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a89e51da-ba95-44ef-b80e-1f016d0d1528 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:00.493923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a89e51da-ba95-44ef-b80e-1f016d0d1528 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:00.511445 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a89e51da-ba95-44ef-b80e-1f016d0d1528 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200" status: 200 len: 1218 microversion: 2.1 time: 1.584806 Aug 02 07:13:00.512045 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2621/5165] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:58 2022] GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 => generated 1218 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:00.538968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c05bce63-bb1d-45d3-9cd7-bd716788f220 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:00.540057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c05bce63-bb1d-45d3-9cd7-bd716788f220 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:00.548493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c05bce63-bb1d-45d3-9cd7-bd716788f220 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:00.549204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c05bce63-bb1d-45d3-9cd7-bd716788f220 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:00.550207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c05bce63-bb1d-45d3-9cd7-bd716788f220 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:00.550923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c05bce63-bb1d-45d3-9cd7-bd716788f220 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:01.908500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7e00b620-95a9-4110-b1fd-da50cce97138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:01.931588 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7e00b620-95a9-4110-b1fd-da50cce97138 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1507 microversion: 2.1 time: 3.946130 Aug 02 07:13:01.947635 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2545/5166] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:12:57 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1507 bytes in 3968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:01.954433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-7d35a119-1294-46c0-a222-83e30a923d06 req-32edcab8-f9a5-426d-bd7e-3d1644f46516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c7c88d-a72e-4f06-9732-e5fac295fbb6", "name": "network-vif-deleted", "tag": "009a0f78-2efc-4701-940e-c386c774fe82"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:02.024492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:02.043758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7d35a119-1294-46c0-a222-83e30a923d06 req-32edcab8-f9a5-426d-bd7e-3d1644f46516 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:02.045012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7d35a119-1294-46c0-a222-83e30a923d06 req-32edcab8-f9a5-426d-bd7e-3d1644f46516 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:02.085164 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-7d35a119-1294-46c0-a222-83e30a923d06 req-32edcab8-f9a5-426d-bd7e-3d1644f46516 service nova] Creating event network-vif-deleted:009a0f78-2efc-4701-940e-c386c774fe82 for instance b5c7c88d-a72e-4f06-9732-e5fac295fbb6 on n-h2-851337-3 Aug 02 07:13:02.106567 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-7d35a119-1294-46c0-a222-83e30a923d06 req-32edcab8-f9a5-426d-bd7e-3d1644f46516 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157081 Aug 02 07:13:02.114950 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2546/5167] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:13:02.143017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-89496d4f-9316-4432-8704-a00dae1277c9 req-8fd12b66-35dc-48d9-82dc-4e3c1a85f6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1a6b1e-adf6-45b2-8b9e-387276fde90c", "name": "network-vif-plugged", "status": "completed", "tag": "233d855a-4615-492c-b3f0-c628240ca34b"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:02.171302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-89496d4f-9316-4432-8704-a00dae1277c9 req-8fd12b66-35dc-48d9-82dc-4e3c1a85f6b6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:02.185719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-89496d4f-9316-4432-8704-a00dae1277c9 req-8fd12b66-35dc-48d9-82dc-4e3c1a85f6b6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:02.232934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c05bce63-bb1d-45d3-9cd7-bd716788f220 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:02.242178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c05bce63-bb1d-45d3-9cd7-bd716788f220 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:02.269775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c05bce63-bb1d-45d3-9cd7-bd716788f220 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:02.272750 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-89496d4f-9316-4432-8704-a00dae1277c9 req-8fd12b66-35dc-48d9-82dc-4e3c1a85f6b6 service nova] Creating event network-vif-plugged:233d855a-4615-492c-b3f0-c628240ca34b for instance 9e1a6b1e-adf6-45b2-8b9e-387276fde90c on n-h2-851337-3 Aug 02 07:13:02.279260 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c05bce63-bb1d-45d3-9cd7-bd716788f220 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1736 microversion: 2.20 time: 1.740530 Aug 02 07:13:02.284138 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2622/5168] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:00 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1736 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:02.299802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6a960b18-e012-4d60-a013-6bb31d4934af tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:02.311570 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-89496d4f-9316-4432-8704-a00dae1277c9 req-8fd12b66-35dc-48d9-82dc-4e3c1a85f6b6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194652 Aug 02 07:13:02.313295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6a960b18-e012-4d60-a013-6bb31d4934af tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:02.322755 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2547/5169] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:13:02.340772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a960b18-e012-4d60-a013-6bb31d4934af tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:02.348744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a960b18-e012-4d60-a013-6bb31d4934af tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:02.354390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a960b18-e012-4d60-a013-6bb31d4934af tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:02.359073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a960b18-e012-4d60-a013-6bb31d4934af tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:02.920101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6a960b18-e012-4d60-a013-6bb31d4934af tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:02.933776 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6a960b18-e012-4d60-a013-6bb31d4934af tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200" status: 200 len: 1276 microversion: 2.1 time: 0.647978 Aug 02 07:13:02.962129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3d0ee1e0-c38c-4a19-b428-080f90ddc8bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:02.963388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3d0ee1e0-c38c-4a19-b428-080f90ddc8bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:02.968536 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2623/5170] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:02 2022] GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 => generated 1276 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:03.006182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d0ee1e0-c38c-4a19-b428-080f90ddc8bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:03.007505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d0ee1e0-c38c-4a19-b428-080f90ddc8bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:03.009400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d0ee1e0-c38c-4a19-b428-080f90ddc8bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:03.010213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d0ee1e0-c38c-4a19-b428-080f90ddc8bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:03.307367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cced2825-bc3b-4442-ada2-3d846b4a0c7f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:03.308256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cced2825-bc3b-4442-ada2-3d846b4a0c7f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:03.336556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cced2825-bc3b-4442-ada2-3d846b4a0c7f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:03.336966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cced2825-bc3b-4442-ada2-3d846b4a0c7f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:03.337822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cced2825-bc3b-4442-ada2-3d846b4a0c7f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:03.340108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cced2825-bc3b-4442-ada2-3d846b4a0c7f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:05.800675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cced2825-bc3b-4442-ada2-3d846b4a0c7f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:05.821842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cced2825-bc3b-4442-ada2-3d846b4a0c7f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:05.834994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cced2825-bc3b-4442-ada2-3d846b4a0c7f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:05.840089 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cced2825-bc3b-4442-ada2-3d846b4a0c7f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1736 microversion: 2.20 time: 2.533447 Aug 02 07:13:05.842335 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2624/5171] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:03 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1736 bytes in 2540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:05.866345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-47a0f137-19fa-44ca-aacd-904aca76174c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:05.872183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-47a0f137-19fa-44ca-aacd-904aca76174c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:05.900504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3d0ee1e0-c38c-4a19-b428-080f90ddc8bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:05.913578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47a0f137-19fa-44ca-aacd-904aca76174c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:05.914069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47a0f137-19fa-44ca-aacd-904aca76174c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:05.914891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47a0f137-19fa-44ca-aacd-904aca76174c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:05.915335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47a0f137-19fa-44ca-aacd-904aca76174c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:05.919625 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3d0ee1e0-c38c-4a19-b428-080f90ddc8bd tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1507 microversion: 2.1 time: 2.954221 Aug 02 07:13:05.932171 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2548/5172] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:02 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1507 bytes in 2975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:06.898442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5841e8f3-d221-438d-ae46-91772f95eb33 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:06.899281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5841e8f3-d221-438d-ae46-91772f95eb33 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:06.957491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5841e8f3-d221-438d-ae46-91772f95eb33 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:06.958639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5841e8f3-d221-438d-ae46-91772f95eb33 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:06.966321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5841e8f3-d221-438d-ae46-91772f95eb33 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:06.966712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5841e8f3-d221-438d-ae46-91772f95eb33 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:07.376663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:07.449062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:07.549274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-47a0f137-19fa-44ca-aacd-904aca76174c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:07.564385 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-47a0f137-19fa-44ca-aacd-904aca76174c tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200" status: 200 len: 1318 microversion: 2.1 time: 1.718795 Aug 02 07:13:07.565011 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2625/5173] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:05 2022] GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 => generated 1318 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:07.592300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3f68e815-fd73-48d5-8ab0-de8cb189605c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:07.597944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3f68e815-fd73-48d5-8ab0-de8cb189605c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:07.660855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f68e815-fd73-48d5-8ab0-de8cb189605c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:07.669023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f68e815-fd73-48d5-8ab0-de8cb189605c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:07.678698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f68e815-fd73-48d5-8ab0-de8cb189605c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:07.681540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f68e815-fd73-48d5-8ab0-de8cb189605c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:07.955712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5841e8f3-d221-438d-ae46-91772f95eb33 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:07.997225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5841e8f3-d221-438d-ae46-91772f95eb33 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:08.008864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5841e8f3-d221-438d-ae46-91772f95eb33 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:08.026071 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5841e8f3-d221-438d-ae46-91772f95eb33 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1736 microversion: 2.20 time: 1.149607 Aug 02 07:13:08.049924 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2549/5174] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:06 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1736 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:08.349202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3f68e815-fd73-48d5-8ab0-de8cb189605c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:08.375494 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3f68e815-fd73-48d5-8ab0-de8cb189605c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1507 microversion: 2.1 time: 0.808994 Aug 02 07:13:08.381225 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2626/5175] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:07 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1507 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:08.600054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bacffe07-f30a-4a90-9c6f-b5b90bba718e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:08.601363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bacffe07-f30a-4a90-9c6f-b5b90bba718e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:08.622189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bacffe07-f30a-4a90-9c6f-b5b90bba718e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:08.623442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bacffe07-f30a-4a90-9c6f-b5b90bba718e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:08.638138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bacffe07-f30a-4a90-9c6f-b5b90bba718e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:08.640514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bacffe07-f30a-4a90-9c6f-b5b90bba718e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:09.062703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1161176500", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "4fe9ee7c-053f-488e-b9f6-c36a9a712e31"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1802691961", "security_groups": [{"name": "tempest-secgroup-smoke-361324163"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:09.145297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:09.147952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:09.244922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bacffe07-f30a-4a90-9c6f-b5b90bba718e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:09.257508 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bacffe07-f30a-4a90-9c6f-b5b90bba718e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200" status: 200 len: 1318 microversion: 2.1 time: 0.659826 Aug 02 07:13:09.273692 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2550/5176] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:08 2022] GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:09.294343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3d54d8e7-bdc7-412a-9924-2f5296accce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:09.295759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3d54d8e7-bdc7-412a-9924-2f5296accce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:09.312109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d54d8e7-bdc7-412a-9924-2f5296accce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:09.326303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d54d8e7-bdc7-412a-9924-2f5296accce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:09.327689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d54d8e7-bdc7-412a-9924-2f5296accce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:09.329312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d54d8e7-bdc7-412a-9924-2f5296accce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:09.855136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3d54d8e7-bdc7-412a-9924-2f5296accce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:09.874093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3d54d8e7-bdc7-412a-9924-2f5296accce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:09.887322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3d54d8e7-bdc7-412a-9924-2f5296accce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:09.900935 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3d54d8e7-bdc7-412a-9924-2f5296accce8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1736 microversion: 2.20 time: 0.625881 Aug 02 07:13:09.907262 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2551/5177] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:09 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1736 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:09.935155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-932514c1-7048-442a-9a1f-114c7bbde27f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:09.944558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-932514c1-7048-442a-9a1f-114c7bbde27f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:10.002913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-932514c1-7048-442a-9a1f-114c7bbde27f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:10.004847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-932514c1-7048-442a-9a1f-114c7bbde27f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:10.012338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-932514c1-7048-442a-9a1f-114c7bbde27f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:10.014462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-932514c1-7048-442a-9a1f-114c7bbde27f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:10.512068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:10.677634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-932514c1-7048-442a-9a1f-114c7bbde27f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:10.688990 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-932514c1-7048-442a-9a1f-114c7bbde27f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1507 microversion: 2.1 time: 0.780529 Aug 02 07:13:10.691136 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2552/5178] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:09 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1507 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:10.704239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-7ee6c3a4-0f6f-4293-a027-8e4aa6ca5ac7 req-fba6bd4e-0b33-4058-9ea3-9852f1b82d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c2c09e7-06e4-4a3e-854f-341d88ba5200", "tag": "1f5a4a86-3435-46b6-bac0-77faa3eea157"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:10.745430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7ee6c3a4-0f6f-4293-a027-8e4aa6ca5ac7 req-fba6bd4e-0b33-4058-9ea3-9852f1b82d44 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:10.759190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7ee6c3a4-0f6f-4293-a027-8e4aa6ca5ac7 req-fba6bd4e-0b33-4058-9ea3-9852f1b82d44 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:10.787715 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-7ee6c3a4-0f6f-4293-a027-8e4aa6ca5ac7 req-fba6bd4e-0b33-4058-9ea3-9852f1b82d44 service nova] Creating event network-changed:1f5a4a86-3435-46b6-bac0-77faa3eea157 for instance 0c2c09e7-06e4-4a3e-854f-341d88ba5200 on n-h1-851337-3 Aug 02 07:13:10.869039 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-7ee6c3a4-0f6f-4293-a027-8e4aa6ca5ac7 req-fba6bd4e-0b33-4058-9ea3-9852f1b82d44 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168214 Aug 02 07:13:10.870751 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2553/5179] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:13:10.889575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8f5074eb-de0e-4fd3-b59b-7c1422bc4fab tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:10.896500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8f5074eb-de0e-4fd3-b59b-7c1422bc4fab tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:10.923780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f5074eb-de0e-4fd3-b59b-7c1422bc4fab tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:10.925865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f5074eb-de0e-4fd3-b59b-7c1422bc4fab tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:10.926918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f5074eb-de0e-4fd3-b59b-7c1422bc4fab tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:10.929814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f5074eb-de0e-4fd3-b59b-7c1422bc4fab tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:11.700747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8f5074eb-de0e-4fd3-b59b-7c1422bc4fab tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:11.721443 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8f5074eb-de0e-4fd3-b59b-7c1422bc4fab tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200" status: 200 len: 1318 microversion: 2.1 time: 0.848930 Aug 02 07:13:11.727478 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2554/5180] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:10 2022] GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 => generated 1318 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:11.746066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c64b010a-ca3b-497b-aa0b-a581a3ec8688 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:11.748216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c64b010a-ca3b-497b-aa0b-a581a3ec8688 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:11.769646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c64b010a-ca3b-497b-aa0b-a581a3ec8688 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:11.773371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c64b010a-ca3b-497b-aa0b-a581a3ec8688 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:11.777875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c64b010a-ca3b-497b-aa0b-a581a3ec8688 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:11.778693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c64b010a-ca3b-497b-aa0b-a581a3ec8688 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:11.827285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] validate_networks() for [('4fe9ee7c-053f-488e-b9f6-c36a9a712e31', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:13:12.738239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c64b010a-ca3b-497b-aa0b-a581a3ec8688 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:12.757393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c64b010a-ca3b-497b-aa0b-a581a3ec8688 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:12.769645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c64b010a-ca3b-497b-aa0b-a581a3ec8688 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:12.776972 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c64b010a-ca3b-497b-aa0b-a581a3ec8688 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1736 microversion: 2.20 time: 1.041874 Aug 02 07:13:12.777988 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2555/5181] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:11 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1736 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:12.808586 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-688bbf80-b4d1-40bd-8708-5aaf96b33917 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:12.809212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-688bbf80-b4d1-40bd-8708-5aaf96b33917 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:12.861827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-688bbf80-b4d1-40bd-8708-5aaf96b33917 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:12.865475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-688bbf80-b4d1-40bd-8708-5aaf96b33917 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:12.869511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-688bbf80-b4d1-40bd-8708-5aaf96b33917 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:12.870331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-688bbf80-b4d1-40bd-8708-5aaf96b33917 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:13.159021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-688bbf80-b4d1-40bd-8708-5aaf96b33917 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:13.171053 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-688bbf80-b4d1-40bd-8708-5aaf96b33917 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1507 microversion: 2.1 time: 0.391917 Aug 02 07:13:13.183218 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2556/5182] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:12 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:13.192666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-51c8828a-f42f-43e5-a65d-75b5c0b40022 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:13.201655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-51c8828a-f42f-43e5-a65d-75b5c0b40022 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:13.239243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51c8828a-f42f-43e5-a65d-75b5c0b40022 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:13.243246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51c8828a-f42f-43e5-a65d-75b5c0b40022 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:13.249521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51c8828a-f42f-43e5-a65d-75b5c0b40022 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:13.250415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51c8828a-f42f-43e5-a65d-75b5c0b40022 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:13.283253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:13:13.283909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:13:13.285128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:13:13.286044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:13:13.288359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:13:13.321152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:13.321607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:13.328126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:13.328598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:13.414122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for project bfa05afa69e04974ad3de049c511c674. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:13:13.435296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for user a44367c6be00413eb7b6c79272448cf4 and project bfa05afa69e04974ad3de049c511c674. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:13:13.469260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:13:13.479873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:13:13.588528 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-36d468d6-b1bf-4457-bf5e-14b3266beef3 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.531349 Aug 02 07:13:13.591668 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2627/5183] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:13:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 4535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:13:13.601540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-f58907af-eb67-49a1-ba19-31d476cc8b1c req-629c5d04-ca16-4cd8-b2a4-89b731eaeb46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc4739d2-43d0-4a76-9c6c-eabc6c075beb", "tag": "9dc50749-fc03-4a1a-9d6c-aa11050ba621"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:13.680543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f58907af-eb67-49a1-ba19-31d476cc8b1c req-629c5d04-ca16-4cd8-b2a4-89b731eaeb46 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:13.685459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f58907af-eb67-49a1-ba19-31d476cc8b1c req-629c5d04-ca16-4cd8-b2a4-89b731eaeb46 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:13.743929 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f58907af-eb67-49a1-ba19-31d476cc8b1c req-629c5d04-ca16-4cd8-b2a4-89b731eaeb46 service nova] Creating event network-changed:9dc50749-fc03-4a1a-9d6c-aa11050ba621 for instance fc4739d2-43d0-4a76-9c6c-eabc6c075beb on n-h1-851337-3 Aug 02 07:13:13.796753 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-f58907af-eb67-49a1-ba19-31d476cc8b1c req-629c5d04-ca16-4cd8-b2a4-89b731eaeb46 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199684 Aug 02 07:13:13.799845 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2628/5184] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:13:13.815077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f3652dd1-8d22-4104-adaa-8f088084473b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:13.816848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f3652dd1-8d22-4104-adaa-8f088084473b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:13.915888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-51c8828a-f42f-43e5-a65d-75b5c0b40022 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:13.957482 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-51c8828a-f42f-43e5-a65d-75b5c0b40022 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200" status: 200 len: 1318 microversion: 2.1 time: 0.770666 Aug 02 07:13:13.961046 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2557/5185] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:13 2022] GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 => generated 1318 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:13.968766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4881db1c-0cba-49cb-8c5b-d4d2d1009f9d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:13.969749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4881db1c-0cba-49cb-8c5b-d4d2d1009f9d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:13.989239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4881db1c-0cba-49cb-8c5b-d4d2d1009f9d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:13.992556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4881db1c-0cba-49cb-8c5b-d4d2d1009f9d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:13.996113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4881db1c-0cba-49cb-8c5b-d4d2d1009f9d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:13.997536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4881db1c-0cba-49cb-8c5b-d4d2d1009f9d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:14.365948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f3652dd1-8d22-4104-adaa-8f088084473b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:14.381090 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f3652dd1-8d22-4104-adaa-8f088084473b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1267 microversion: 2.1 time: 0.577050 Aug 02 07:13:14.393967 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2629/5186] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:13 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1267 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:14.414753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2c1b1053-5d72-4b17-b04c-9bca77da8c9e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:14.420942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2c1b1053-5d72-4b17-b04c-9bca77da8c9e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:14.452542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c1b1053-5d72-4b17-b04c-9bca77da8c9e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:14.462744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c1b1053-5d72-4b17-b04c-9bca77da8c9e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:14.464019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c1b1053-5d72-4b17-b04c-9bca77da8c9e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:14.464742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2c1b1053-5d72-4b17-b04c-9bca77da8c9e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:14.996589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4881db1c-0cba-49cb-8c5b-d4d2d1009f9d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:15.006228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4881db1c-0cba-49cb-8c5b-d4d2d1009f9d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:15.007787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4881db1c-0cba-49cb-8c5b-d4d2d1009f9d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:15.009135 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4881db1c-0cba-49cb-8c5b-d4d2d1009f9d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1718 microversion: 2.20 time: 1.045668 Aug 02 07:13:15.009746 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2558/5187] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:13 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1718 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:15.048394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4022ae16-ad01-4c7e-87cf-ca5d43c9fded tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:15.058378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4022ae16-ad01-4c7e-87cf-ca5d43c9fded tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:15.084436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4022ae16-ad01-4c7e-87cf-ca5d43c9fded tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:15.088365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4022ae16-ad01-4c7e-87cf-ca5d43c9fded tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:15.091400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4022ae16-ad01-4c7e-87cf-ca5d43c9fded tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:15.093467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4022ae16-ad01-4c7e-87cf-ca5d43c9fded tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:15.343135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2c1b1053-5d72-4b17-b04c-9bca77da8c9e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:15.353128 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2c1b1053-5d72-4b17-b04c-9bca77da8c9e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1507 microversion: 2.1 time: 0.966668 Aug 02 07:13:15.370806 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2630/5188] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:14 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1507 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:15.409274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-68f102ec-b93e-4fe4-ae55-4521fb2c8be4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:15.411164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-68f102ec-b93e-4fe4-ae55-4521fb2c8be4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:15.442807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68f102ec-b93e-4fe4-ae55-4521fb2c8be4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:15.443790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68f102ec-b93e-4fe4-ae55-4521fb2c8be4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:15.448564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68f102ec-b93e-4fe4-ae55-4521fb2c8be4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:15.450068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68f102ec-b93e-4fe4-ae55-4521fb2c8be4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:15.570962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4022ae16-ad01-4c7e-87cf-ca5d43c9fded tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:15.583856 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4022ae16-ad01-4c7e-87cf-ca5d43c9fded tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200" status: 200 len: 1318 microversion: 2.1 time: 0.552237 Aug 02 07:13:15.585410 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2559/5189] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:15 2022] GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:15.797690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-68f102ec-b93e-4fe4-ae55-4521fb2c8be4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:15.815453 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-68f102ec-b93e-4fe4-ae55-4521fb2c8be4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1263 microversion: 2.1 time: 0.409335 Aug 02 07:13:15.840177 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2631/5190] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:15 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1263 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:16.042446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ed559194-162f-4a9c-b0b1-bef485d5a905 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:16.044270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ed559194-162f-4a9c-b0b1-bef485d5a905 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:16.065597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed559194-162f-4a9c-b0b1-bef485d5a905 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:16.066498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed559194-162f-4a9c-b0b1-bef485d5a905 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:16.067495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed559194-162f-4a9c-b0b1-bef485d5a905 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:16.077064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed559194-162f-4a9c-b0b1-bef485d5a905 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:16.391048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-06c229ea-60bb-4154-a206-5da2f9145f6d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:16.391677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-06c229ea-60bb-4154-a206-5da2f9145f6d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:16.423833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06c229ea-60bb-4154-a206-5da2f9145f6d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:16.430410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06c229ea-60bb-4154-a206-5da2f9145f6d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:16.438299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06c229ea-60bb-4154-a206-5da2f9145f6d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:16.438591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06c229ea-60bb-4154-a206-5da2f9145f6d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:16.887208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ed559194-162f-4a9c-b0b1-bef485d5a905 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:16.902731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ed559194-162f-4a9c-b0b1-bef485d5a905 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:16.905530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ed559194-162f-4a9c-b0b1-bef485d5a905 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:16.907185 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ed559194-162f-4a9c-b0b1-bef485d5a905 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1718 microversion: 2.20 time: 0.868834 Aug 02 07:13:16.908219 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2560/5191] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:16 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1718 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:16.916614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3d975daa-ef02-460d-8c9b-1431950e364e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:16.917378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3d975daa-ef02-460d-8c9b-1431950e364e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:16.925226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d975daa-ef02-460d-8c9b-1431950e364e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:16.926211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d975daa-ef02-460d-8c9b-1431950e364e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:16.927239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d975daa-ef02-460d-8c9b-1431950e364e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:16.927913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d975daa-ef02-460d-8c9b-1431950e364e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:16.969913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:17.059407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-06c229ea-60bb-4154-a206-5da2f9145f6d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:17.068174 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-06c229ea-60bb-4154-a206-5da2f9145f6d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1507 microversion: 2.1 time: 0.684461 Aug 02 07:13:17.079909 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2632/5192] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:16 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1507 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:17.084899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cec1de8c-83e5-40b8-8501-6efca55f8435 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:17.085535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cec1de8c-83e5-40b8-8501-6efca55f8435 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:17.135497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cec1de8c-83e5-40b8-8501-6efca55f8435 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:17.136006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cec1de8c-83e5-40b8-8501-6efca55f8435 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:17.136870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cec1de8c-83e5-40b8-8501-6efca55f8435 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:17.137328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cec1de8c-83e5-40b8-8501-6efca55f8435 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:17.413632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cec1de8c-83e5-40b8-8501-6efca55f8435 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:17.423326 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cec1de8c-83e5-40b8-8501-6efca55f8435 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1325 microversion: 2.1 time: 0.342230 Aug 02 07:13:17.424364 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2633/5193] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:17 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1325 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:17.693641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3d975daa-ef02-460d-8c9b-1431950e364e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:17.770467 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3d975daa-ef02-460d-8c9b-1431950e364e tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200" status: 200 len: 1318 microversion: 2.1 time: 0.859095 Aug 02 07:13:17.771103 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2561/5194] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:16 2022] GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 => generated 1318 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:17.984377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ae8a4f04-31e5-44e5-8168-ebde88b7d834 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:17.985019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ae8a4f04-31e5-44e5-8168-ebde88b7d834 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:18.029835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-a069703c-e044-4e9e-bc4a-4fb31dd9f560 req-8d0c1b43-8931-433c-a43c-dc3e8229b810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8979e165-921d-4e06-92fc-dba834a53b1b", "name": "network-vif-unplugged", "status": "completed", "tag": "768fa789-2440-4838-8853-20f834aabcea"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:18.032092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae8a4f04-31e5-44e5-8168-ebde88b7d834 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:18.034200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae8a4f04-31e5-44e5-8168-ebde88b7d834 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:18.035700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae8a4f04-31e5-44e5-8168-ebde88b7d834 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:18.036047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae8a4f04-31e5-44e5-8168-ebde88b7d834 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:18.060552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a069703c-e044-4e9e-bc4a-4fb31dd9f560 req-8d0c1b43-8931-433c-a43c-dc3e8229b810 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:18.061291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a069703c-e044-4e9e-bc4a-4fb31dd9f560 req-8d0c1b43-8931-433c-a43c-dc3e8229b810 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:18.078967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:18.082414 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-a069703c-e044-4e9e-bc4a-4fb31dd9f560 req-8d0c1b43-8931-433c-a43c-dc3e8229b810 service nova] Creating event network-vif-unplugged:768fa789-2440-4838-8853-20f834aabcea for instance 8979e165-921d-4e06-92fc-dba834a53b1b on n-h1-851337-3 Aug 02 07:13:18.091154 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-a069703c-e044-4e9e-bc4a-4fb31dd9f560 req-8d0c1b43-8931-433c-a43c-dc3e8229b810 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110685 Aug 02 07:13:18.092634 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2634/5195] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:13:18.100931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b9787884-b812-43f1-b592-4f56b3d4e236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:18.101880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b9787884-b812-43f1-b592-4f56b3d4e236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:18.111835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9787884-b812-43f1-b592-4f56b3d4e236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:18.112615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9787884-b812-43f1-b592-4f56b3d4e236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:18.113581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9787884-b812-43f1-b592-4f56b3d4e236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:18.114330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9787884-b812-43f1-b592-4f56b3d4e236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:19.041915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ae8a4f04-31e5-44e5-8168-ebde88b7d834 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:19.059410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ae8a4f04-31e5-44e5-8168-ebde88b7d834 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:19.061182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ae8a4f04-31e5-44e5-8168-ebde88b7d834 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:19.075729 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ae8a4f04-31e5-44e5-8168-ebde88b7d834 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1718 microversion: 2.20 time: 1.094564 Aug 02 07:13:19.077940 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2562/5196] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:17 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1718 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:19.096399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a36eda6b-7a14-40f5-a27b-db4c15008c73 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:19.100570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a36eda6b-7a14-40f5-a27b-db4c15008c73 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:19.131176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a36eda6b-7a14-40f5-a27b-db4c15008c73 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:19.135880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a36eda6b-7a14-40f5-a27b-db4c15008c73 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:19.139101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a36eda6b-7a14-40f5-a27b-db4c15008c73 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:19.139606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a36eda6b-7a14-40f5-a27b-db4c15008c73 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:19.224453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b9787884-b812-43f1-b592-4f56b3d4e236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:19.243904 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b9787884-b812-43f1-b592-4f56b3d4e236 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1507 microversion: 2.1 time: 1.145779 Aug 02 07:13:19.261283 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2635/5197] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:18 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1507 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:19.304046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-13fd3b22-c7e5-4758-949e-11ac2a3ee88f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:19.304775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-13fd3b22-c7e5-4758-949e-11ac2a3ee88f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:19.348322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13fd3b22-c7e5-4758-949e-11ac2a3ee88f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:19.348841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13fd3b22-c7e5-4758-949e-11ac2a3ee88f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:19.349716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13fd3b22-c7e5-4758-949e-11ac2a3ee88f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:19.356529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13fd3b22-c7e5-4758-949e-11ac2a3ee88f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:19.492724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a36eda6b-7a14-40f5-a27b-db4c15008c73 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:19.506794 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a36eda6b-7a14-40f5-a27b-db4c15008c73 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1325 microversion: 2.1 time: 0.427600 Aug 02 07:13:19.512267 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2563/5198] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:19 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1325 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:19.970321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-13fd3b22-c7e5-4758-949e-11ac2a3ee88f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:19.984178 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-13fd3b22-c7e5-4758-949e-11ac2a3ee88f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200" status: 200 len: 1318 microversion: 2.1 time: 0.718654 Aug 02 07:13:19.987090 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2636/5199] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:19 2022] GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 => generated 1318 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:20.104514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85f84252-0e41-40db-9170-86b0c510ea41 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:20.105791 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-85f84252-0e41-40db-9170-86b0c510ea41 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:20.117640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85f84252-0e41-40db-9170-86b0c510ea41 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:20.120758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85f84252-0e41-40db-9170-86b0c510ea41 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:20.121934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85f84252-0e41-40db-9170-86b0c510ea41 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:20.126146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85f84252-0e41-40db-9170-86b0c510ea41 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:20.274172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3f6e0068-e52a-4a76-8924-3d09529b7d8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:20.275374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3f6e0068-e52a-4a76-8924-3d09529b7d8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:20.289221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f6e0068-e52a-4a76-8924-3d09529b7d8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:20.291080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f6e0068-e52a-4a76-8924-3d09529b7d8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:20.295398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f6e0068-e52a-4a76-8924-3d09529b7d8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:20.317829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f6e0068-e52a-4a76-8924-3d09529b7d8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:21.367645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-85f84252-0e41-40db-9170-86b0c510ea41 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:21.389486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3f6e0068-e52a-4a76-8924-3d09529b7d8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:21.395552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-85f84252-0e41-40db-9170-86b0c510ea41 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:21.402185 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3f6e0068-e52a-4a76-8924-3d09529b7d8d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1507 microversion: 2.1 time: 1.132399 Aug 02 07:13:21.403634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-85f84252-0e41-40db-9170-86b0c510ea41 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:21.408957 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-85f84252-0e41-40db-9170-86b0c510ea41 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1718 microversion: 2.20 time: 1.308460 Aug 02 07:13:21.409165 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2637/5200] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:20 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1507 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:13:21.419701 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2564/5201] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:20 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1718 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:21.424836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ab9b070a-3ddc-4a9a-85b1-79022eb459e4 req-8c8e3154-0961-4edc-8f7e-70d3eef2286a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2c09e7-06e4-4a3e-854f-341d88ba5200", "name": "network-vif-plugged", "status": "completed", "tag": "1f5a4a86-3435-46b6-bac0-77faa3eea157"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:21.438171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d1f03728-61d4-4957-b241-19bd4c957a7a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:21.438798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d1f03728-61d4-4957-b241-19bd4c957a7a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:21.448251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ab9b070a-3ddc-4a9a-85b1-79022eb459e4 req-8c8e3154-0961-4edc-8f7e-70d3eef2286a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:21.450505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ab9b070a-3ddc-4a9a-85b1-79022eb459e4 req-8c8e3154-0961-4edc-8f7e-70d3eef2286a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:21.458112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1f03728-61d4-4957-b241-19bd4c957a7a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:21.458563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1f03728-61d4-4957-b241-19bd4c957a7a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:21.459355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1f03728-61d4-4957-b241-19bd4c957a7a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:21.459791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1f03728-61d4-4957-b241-19bd4c957a7a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:21.479583 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ab9b070a-3ddc-4a9a-85b1-79022eb459e4 req-8c8e3154-0961-4edc-8f7e-70d3eef2286a service nova] Creating event network-vif-plugged:1f5a4a86-3435-46b6-bac0-77faa3eea157 for instance 0c2c09e7-06e4-4a3e-854f-341d88ba5200 on n-h1-851337-3 Aug 02 07:13:21.497953 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ab9b070a-3ddc-4a9a-85b1-79022eb459e4 req-8c8e3154-0961-4edc-8f7e-70d3eef2286a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076635 Aug 02 07:13:21.503339 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2565/5202] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:13:21.515650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-659e639c-9a92-46d9-b238-2dfdadee0c0f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:21.517081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-659e639c-9a92-46d9-b238-2dfdadee0c0f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:21.536297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-659e639c-9a92-46d9-b238-2dfdadee0c0f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:21.540594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-659e639c-9a92-46d9-b238-2dfdadee0c0f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:21.541732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-659e639c-9a92-46d9-b238-2dfdadee0c0f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:21.546966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-659e639c-9a92-46d9-b238-2dfdadee0c0f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:22.067290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d1f03728-61d4-4957-b241-19bd4c957a7a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:22.090764 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d1f03728-61d4-4957-b241-19bd4c957a7a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1392 microversion: 2.1 time: 0.666373 Aug 02 07:13:22.095424 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2638/5203] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:21 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1392 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:22.136252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-659e639c-9a92-46d9-b238-2dfdadee0c0f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:22.145170 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-659e639c-9a92-46d9-b238-2dfdadee0c0f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200" status: 200 len: 1318 microversion: 2.1 time: 0.640270 Aug 02 07:13:22.151186 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2566/5204] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:21 2022] GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 => generated 1318 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:22.434972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eefad01a-aac3-448a-a01e-bd299b982410 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:22.435576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-eefad01a-aac3-448a-a01e-bd299b982410 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:22.437186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-37d3063d-eec3-45fc-8108-2fa400b21d01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:22.438322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-37d3063d-eec3-45fc-8108-2fa400b21d01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:22.448203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37d3063d-eec3-45fc-8108-2fa400b21d01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:22.450301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eefad01a-aac3-448a-a01e-bd299b982410 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:22.451110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37d3063d-eec3-45fc-8108-2fa400b21d01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:22.453676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37d3063d-eec3-45fc-8108-2fa400b21d01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:22.454767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eefad01a-aac3-448a-a01e-bd299b982410 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:22.455564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37d3063d-eec3-45fc-8108-2fa400b21d01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:22.460412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eefad01a-aac3-448a-a01e-bd299b982410 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:22.464142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eefad01a-aac3-448a-a01e-bd299b982410 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:23.343106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:23.360454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-37d3063d-eec3-45fc-8108-2fa400b21d01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:23.379386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-eefad01a-aac3-448a-a01e-bd299b982410 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:23.384488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-37d3063d-eec3-45fc-8108-2fa400b21d01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:23.392780 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-eefad01a-aac3-448a-a01e-bd299b982410 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1507 microversion: 2.1 time: 0.963660 Aug 02 07:13:23.393979 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2639/5205] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:22 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1507 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:13:23.394435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-37d3063d-eec3-45fc-8108-2fa400b21d01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:23.396116 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-37d3063d-eec3-45fc-8108-2fa400b21d01 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1718 microversion: 2.20 time: 0.964453 Aug 02 07:13:23.401406 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1de869e8-1342-4557-aff5-62187669ff0b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:23.408752 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2567/5206] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:22 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1718 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:23.423657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1de869e8-1342-4557-aff5-62187669ff0b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:23.427408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c7085a11-4ff6-4a98-8ab3-54541275bf27 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:23.428972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c7085a11-4ff6-4a98-8ab3-54541275bf27 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:23.458674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1de869e8-1342-4557-aff5-62187669ff0b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:23.459966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1de869e8-1342-4557-aff5-62187669ff0b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:23.461658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1de869e8-1342-4557-aff5-62187669ff0b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:23.463512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7085a11-4ff6-4a98-8ab3-54541275bf27 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:23.464946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1de869e8-1342-4557-aff5-62187669ff0b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:23.470854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7085a11-4ff6-4a98-8ab3-54541275bf27 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:23.472399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7085a11-4ff6-4a98-8ab3-54541275bf27 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:23.473079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7085a11-4ff6-4a98-8ab3-54541275bf27 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:24.377549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:25.408341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1de869e8-1342-4557-aff5-62187669ff0b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:25.467496 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1de869e8-1342-4557-aff5-62187669ff0b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1392 microversion: 2.1 time: 2.067297 Aug 02 07:13:25.470785 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2640/5207] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:23 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1392 bytes in 2074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:25.485595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bdbe690d-26cd-4190-9a86-525697941180 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:25.490594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bdbe690d-26cd-4190-9a86-525697941180 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:25.505664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdbe690d-26cd-4190-9a86-525697941180 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:25.509144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdbe690d-26cd-4190-9a86-525697941180 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:25.524910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdbe690d-26cd-4190-9a86-525697941180 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:25.526078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdbe690d-26cd-4190-9a86-525697941180 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:26.256937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c7085a11-4ff6-4a98-8ab3-54541275bf27 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:26.268491 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c7085a11-4ff6-4a98-8ab3-54541275bf27 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200" status: 200 len: 1318 microversion: 2.1 time: 2.854466 Aug 02 07:13:26.276145 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2568/5208] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:23 2022] GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 => generated 1318 bytes in 2866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:26.291005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d29c11e1-1704-432a-9c3a-599139cc2218 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:26.302742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d29c11e1-1704-432a-9c3a-599139cc2218 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:26.338274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d29c11e1-1704-432a-9c3a-599139cc2218 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:26.352259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d29c11e1-1704-432a-9c3a-599139cc2218 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:26.353412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d29c11e1-1704-432a-9c3a-599139cc2218 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:26.354065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d29c11e1-1704-432a-9c3a-599139cc2218 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:26.400627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bdbe690d-26cd-4190-9a86-525697941180 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:26.418925 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bdbe690d-26cd-4190-9a86-525697941180 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1507 microversion: 2.1 time: 0.945399 Aug 02 07:13:26.422949 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2641/5209] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:25 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1507 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:26.443243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7308a608-caf6-47ac-b174-a0351d4c03e4 req-353eb2e7-633d-4783-ae7e-d1cbf1ab18e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc4739d2-43d0-4a76-9c6c-eabc6c075beb", "name": "network-vif-plugged", "status": "completed", "tag": "9dc50749-fc03-4a1a-9d6c-aa11050ba621"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:26.474309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7308a608-caf6-47ac-b174-a0351d4c03e4 req-353eb2e7-633d-4783-ae7e-d1cbf1ab18e6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:26.479631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7308a608-caf6-47ac-b174-a0351d4c03e4 req-353eb2e7-633d-4783-ae7e-d1cbf1ab18e6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:26.538138 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7308a608-caf6-47ac-b174-a0351d4c03e4 req-353eb2e7-633d-4783-ae7e-d1cbf1ab18e6 service nova] Creating event network-vif-plugged:9dc50749-fc03-4a1a-9d6c-aa11050ba621 for instance fc4739d2-43d0-4a76-9c6c-eabc6c075beb on n-h1-851337-3 Aug 02 07:13:26.554131 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7308a608-caf6-47ac-b174-a0351d4c03e4 req-353eb2e7-633d-4783-ae7e-d1cbf1ab18e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129340 Aug 02 07:13:26.562118 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2642/5210] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:13:26.590348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-3d711aaa-f0ee-4762-a74e-74c98f64226a req-395017e8-9684-41b5-96f1-9913061dc87c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b35b7f-de5b-4d19-bd55-55d7b06b3536", "tag": "9b7ae46e-d7eb-481e-947a-5b8889d64199"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:26.630598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-3d711aaa-f0ee-4762-a74e-74c98f64226a req-395017e8-9684-41b5-96f1-9913061dc87c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:26.633378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-3d711aaa-f0ee-4762-a74e-74c98f64226a req-395017e8-9684-41b5-96f1-9913061dc87c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:26.697197 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-3d711aaa-f0ee-4762-a74e-74c98f64226a req-395017e8-9684-41b5-96f1-9913061dc87c service nova] Creating event network-changed:9b7ae46e-d7eb-481e-947a-5b8889d64199 for instance 03b35b7f-de5b-4d19-bd55-55d7b06b3536 on n-h2-851337-3 Aug 02 07:13:26.746931 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-3d711aaa-f0ee-4762-a74e-74c98f64226a req-395017e8-9684-41b5-96f1-9913061dc87c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175134 Aug 02 07:13:26.754164 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2643/5211] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:13:26.783065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-51b3f443-ce3e-42aa-b829-1d48d4e8eb84 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:26.786683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-51b3f443-ce3e-42aa-b829-1d48d4e8eb84 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:26.803210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51b3f443-ce3e-42aa-b829-1d48d4e8eb84 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:26.803998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51b3f443-ce3e-42aa-b829-1d48d4e8eb84 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:26.805181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51b3f443-ce3e-42aa-b829-1d48d4e8eb84 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:26.805868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51b3f443-ce3e-42aa-b829-1d48d4e8eb84 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:26.827516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d29c11e1-1704-432a-9c3a-599139cc2218 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:26.836395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d29c11e1-1704-432a-9c3a-599139cc2218 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:26.840512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d29c11e1-1704-432a-9c3a-599139cc2218 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:26.841806 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d29c11e1-1704-432a-9c3a-599139cc2218 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1661 microversion: 2.20 time: 0.564541 Aug 02 07:13:26.842434 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2569/5212] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:26 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1661 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:26.871473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1b57dcfa-36d0-4932-a32c-6104525b2c74 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72dbe974-462a-4571-b5ac-6be99e4c9057"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:26.884577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1b57dcfa-36d0-4932-a32c-6104525b2c74 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:26.900832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b57dcfa-36d0-4932-a32c-6104525b2c74 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:26.900832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b57dcfa-36d0-4932-a32c-6104525b2c74 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:26.908620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b57dcfa-36d0-4932-a32c-6104525b2c74 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:26.909356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b57dcfa-36d0-4932-a32c-6104525b2c74 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:27.231985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-51b3f443-ce3e-42aa-b829-1d48d4e8eb84 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:27.243165 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-51b3f443-ce3e-42aa-b829-1d48d4e8eb84 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1392 microversion: 2.1 time: 0.485316 Aug 02 07:13:27.258412 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2644/5213] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:26 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1392 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:27.290227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0a5465b4-ed01-4076-bb5b-e67d6836ee03 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:27.291417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0a5465b4-ed01-4076-bb5b-e67d6836ee03 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:27.305285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a5465b4-ed01-4076-bb5b-e67d6836ee03 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:27.306172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a5465b4-ed01-4076-bb5b-e67d6836ee03 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:27.307245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a5465b4-ed01-4076-bb5b-e67d6836ee03 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:27.309177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a5465b4-ed01-4076-bb5b-e67d6836ee03 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:27.672856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0a5465b4-ed01-4076-bb5b-e67d6836ee03 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:27.683489 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0a5465b4-ed01-4076-bb5b-e67d6836ee03 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200" status: 200 len: 1506 microversion: 2.1 time: 0.399794 Aug 02 07:13:27.684165 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2645/5214] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:27 2022] GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:13:27.711485 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1b57dcfa-36d0-4932-a32c-6104525b2c74 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "POST /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.845697 Aug 02 07:13:27.713043 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2570/5215] 10.222.0.79 () {62 vars in 1364 bytes} [Tue Aug 2 07:13:26 2022] POST /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b/os-volume_attachments => generated 188 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:13:27.734510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0bae35b7-e016-4956-874b-39f88d7d0b59 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:27.736832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0bae35b7-e016-4956-874b-39f88d7d0b59 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: fc4739d2-43d0-4a76-9c6c-eabc6c075beb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:27.770056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bae35b7-e016-4956-874b-39f88d7d0b59 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:27.773397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bae35b7-e016-4956-874b-39f88d7d0b59 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:27.775038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bae35b7-e016-4956-874b-39f88d7d0b59 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:27.776607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bae35b7-e016-4956-874b-39f88d7d0b59 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:28.255164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0bae35b7-e016-4956-874b-39f88d7d0b59 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:28.277881 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0bae35b7-e016-4956-874b-39f88d7d0b59 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb" status: 200 len: 1318 microversion: 2.1 time: 0.563225 Aug 02 07:13:28.280841 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2571/5216] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:27 2022] GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:28.299094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6a2141f2-eba3-4f1c-8002-1cc5871873da tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:28.299974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6a2141f2-eba3-4f1c-8002-1cc5871873da tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:28.310251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a2141f2-eba3-4f1c-8002-1cc5871873da tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:28.311112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a2141f2-eba3-4f1c-8002-1cc5871873da tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:28.312532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a2141f2-eba3-4f1c-8002-1cc5871873da tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:28.314963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a2141f2-eba3-4f1c-8002-1cc5871873da tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:28.626407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-949f3e0e-09f3-4db9-8019-24794e3365f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:28.627335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-949f3e0e-09f3-4db9-8019-24794e3365f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:28.658896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-949f3e0e-09f3-4db9-8019-24794e3365f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:28.667947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-949f3e0e-09f3-4db9-8019-24794e3365f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:28.670181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-949f3e0e-09f3-4db9-8019-24794e3365f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:28.675138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-949f3e0e-09f3-4db9-8019-24794e3365f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:28.899698 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6a2141f2-eba3-4f1c-8002-1cc5871873da tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b/os-volume_attachments/72dbe974-462a-4571-b5ac-6be99e4c9057" status: 202 len: 0 microversion: 2.20 time: 0.617391 Aug 02 07:13:28.900445 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2572/5217] 10.222.0.79 () {60 vars in 1457 bytes} [Tue Aug 2 07:13:28 2022] DELETE /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b/os-volume_attachments/72dbe974-462a-4571-b5ac-6be99e4c9057 => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:13:28.915881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d8c20f61-4fbf-48a5-8efd-1ed717fad00f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:28.916638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d8c20f61-4fbf-48a5-8efd-1ed717fad00f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:28.936056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8c20f61-4fbf-48a5-8efd-1ed717fad00f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:28.941041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8c20f61-4fbf-48a5-8efd-1ed717fad00f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:28.944991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8c20f61-4fbf-48a5-8efd-1ed717fad00f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:28.945956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8c20f61-4fbf-48a5-8efd-1ed717fad00f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:29.078627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:29.515325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-949f3e0e-09f3-4db9-8019-24794e3365f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:29.528423 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-949f3e0e-09f3-4db9-8019-24794e3365f2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1507 microversion: 2.1 time: 1.840720 Aug 02 07:13:29.540037 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2646/5218] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:27 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1507 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:29.552659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-70c5b4ab-275c-470a-9f60-3c1bd7eb7294 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:29.553288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-70c5b4ab-275c-470a-9f60-3c1bd7eb7294 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:29.577946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70c5b4ab-275c-470a-9f60-3c1bd7eb7294 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:29.578401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70c5b4ab-275c-470a-9f60-3c1bd7eb7294 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:29.585643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70c5b4ab-275c-470a-9f60-3c1bd7eb7294 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:29.587205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-70c5b4ab-275c-470a-9f60-3c1bd7eb7294 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:29.663751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-70c5b4ab-275c-470a-9f60-3c1bd7eb7294 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126120) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 07:13:29.808070 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-70c5b4ab-275c-470a-9f60-3c1bd7eb7294 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "POST /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b/action" status: 202 len: 0 microversion: 2.20 time: 0.266344 Aug 02 07:13:29.808730 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2647/5219] 10.222.0.79 () {62 vars in 1319 bytes} [Tue Aug 2 07:13:29 2022] POST /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:13:29.827123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dbf55d42-0028-407e-a4d9-36de108b28d7 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:29.828439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dbf55d42-0028-407e-a4d9-36de108b28d7 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: fc4739d2-43d0-4a76-9c6c-eabc6c075beb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:29.864169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbf55d42-0028-407e-a4d9-36de108b28d7 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:29.864686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbf55d42-0028-407e-a4d9-36de108b28d7 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:29.865582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbf55d42-0028-407e-a4d9-36de108b28d7 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:29.866092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbf55d42-0028-407e-a4d9-36de108b28d7 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:30.353174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d8c20f61-4fbf-48a5-8efd-1ed717fad00f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:30.374639 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d8c20f61-4fbf-48a5-8efd-1ed717fad00f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1392 microversion: 2.1 time: 1.460871 Aug 02 07:13:30.375386 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2573/5220] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:28 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1392 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:30.391145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0c733c0-e394-45fc-a50f-6f023ea4c3fb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:30.394001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d0c733c0-e394-45fc-a50f-6f023ea4c3fb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:30.418896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0c733c0-e394-45fc-a50f-6f023ea4c3fb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:30.419349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0c733c0-e394-45fc-a50f-6f023ea4c3fb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:30.420146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0c733c0-e394-45fc-a50f-6f023ea4c3fb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:30.420579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0c733c0-e394-45fc-a50f-6f023ea4c3fb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:31.087340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dbf55d42-0028-407e-a4d9-36de108b28d7 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:31.102438 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dbf55d42-0028-407e-a4d9-36de108b28d7 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb" status: 200 len: 1507 microversion: 2.1 time: 1.287187 Aug 02 07:13:31.103117 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2648/5221] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:29 2022] GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb => generated 1507 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:31.135289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f823ae48-de33-4e72-a90b-0e7671cf0ed8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:31.143807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f823ae48-de33-4e72-a90b-0e7671cf0ed8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:31.164075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f823ae48-de33-4e72-a90b-0e7671cf0ed8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:31.170806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f823ae48-de33-4e72-a90b-0e7671cf0ed8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:31.171953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f823ae48-de33-4e72-a90b-0e7671cf0ed8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:31.177084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f823ae48-de33-4e72-a90b-0e7671cf0ed8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:31.219453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d0c733c0-e394-45fc-a50f-6f023ea4c3fb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:31.233855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d0c733c0-e394-45fc-a50f-6f023ea4c3fb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:31.235715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d0c733c0-e394-45fc-a50f-6f023ea4c3fb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:31.241117 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d0c733c0-e394-45fc-a50f-6f023ea4c3fb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1669 microversion: 2.20 time: 0.863685 Aug 02 07:13:31.242536 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2574/5222] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:30 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1669 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:31.263933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2ebc2353-b078-4a27-b8f2-8b096e433073 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:31.265466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2ebc2353-b078-4a27-b8f2-8b096e433073 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: fc4739d2-43d0-4a76-9c6c-eabc6c075beb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:31.281085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ebc2353-b078-4a27-b8f2-8b096e433073 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:31.285161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ebc2353-b078-4a27-b8f2-8b096e433073 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:31.287658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ebc2353-b078-4a27-b8f2-8b096e433073 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:31.288983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ebc2353-b078-4a27-b8f2-8b096e433073 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:31.378773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2ebc2353-b078-4a27-b8f2-8b096e433073 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: fc4739d2-43d0-4a76-9c6c-eabc6c075beb] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:13:31.476138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f823ae48-de33-4e72-a90b-0e7671cf0ed8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:31.488534 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f823ae48-de33-4e72-a90b-0e7671cf0ed8 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1504 microversion: 2.1 time: 0.365405 Aug 02 07:13:31.492462 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2649/5223] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:31 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:31.507471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-640689d6-7bb3-46b4-9f88-e808dc77379a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:31.511927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-640689d6-7bb3-46b4-9f88-e808dc77379a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:31.533222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-640689d6-7bb3-46b4-9f88-e808dc77379a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:31.539976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-640689d6-7bb3-46b4-9f88-e808dc77379a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:31.542853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-640689d6-7bb3-46b4-9f88-e808dc77379a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:31.543795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-640689d6-7bb3-46b4-9f88-e808dc77379a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:31.586544 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2ebc2353-b078-4a27-b8f2-8b096e433073 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb" status: 204 len: 0 microversion: 2.1 time: 0.342477 Aug 02 07:13:31.591764 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2575/5224] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:13:31 2022] DELETE /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:13:31.598884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fa484673-7733-4f10-b7f1-599092da547d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:31.600521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fa484673-7733-4f10-b7f1-599092da547d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:31.614874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa484673-7733-4f10-b7f1-599092da547d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:31.615323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa484673-7733-4f10-b7f1-599092da547d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:31.623482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa484673-7733-4f10-b7f1-599092da547d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:31.624116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fa484673-7733-4f10-b7f1-599092da547d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:31.664832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fa484673-7733-4f10-b7f1-599092da547d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:13:31.850474 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fa484673-7733-4f10-b7f1-599092da547d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200" status: 204 len: 0 microversion: 2.1 time: 0.252294 Aug 02 07:13:31.854091 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2576/5225] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:13:31 2022] DELETE /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:13:31.874853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ea12b8a4-ab13-4171-8c44-f449d3f0125f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:31.877224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ea12b8a4-ab13-4171-8c44-f449d3f0125f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: fc4739d2-43d0-4a76-9c6c-eabc6c075beb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:31.895151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ea12b8a4-ab13-4171-8c44-f449d3f0125f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:31.895623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ea12b8a4-ab13-4171-8c44-f449d3f0125f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:31.896439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ea12b8a4-ab13-4171-8c44-f449d3f0125f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:31.900652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ea12b8a4-ab13-4171-8c44-f449d3f0125f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:31.917333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-640689d6-7bb3-46b4-9f88-e808dc77379a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:31.928989 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-640689d6-7bb3-46b4-9f88-e808dc77379a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1392 microversion: 2.1 time: 0.435307 Aug 02 07:13:31.943205 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2650/5226] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:31 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1392 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:32.187543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ea12b8a4-ab13-4171-8c44-f449d3f0125f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:32.199753 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ea12b8a4-ab13-4171-8c44-f449d3f0125f tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb" status: 200 len: 1513 microversion: 2.1 time: 0.340491 Aug 02 07:13:32.201030 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2577/5227] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:31 2022] GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb => generated 1513 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:32.270064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-14cc4f7e-54ca-4b74-9213-9782702788b8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:32.270064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-14cc4f7e-54ca-4b74-9213-9782702788b8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:32.288107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14cc4f7e-54ca-4b74-9213-9782702788b8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:32.288565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14cc4f7e-54ca-4b74-9213-9782702788b8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:32.289446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14cc4f7e-54ca-4b74-9213-9782702788b8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:32.289917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14cc4f7e-54ca-4b74-9213-9782702788b8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:32.514999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a2cebbba-398b-443e-8ee4-0e898742a2de tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:32.516525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a2cebbba-398b-443e-8ee4-0e898742a2de tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:32.527898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:32.532562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2cebbba-398b-443e-8ee4-0e898742a2de tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:32.535173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2cebbba-398b-443e-8ee4-0e898742a2de tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:32.537506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2cebbba-398b-443e-8ee4-0e898742a2de tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:32.538287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2cebbba-398b-443e-8ee4-0e898742a2de tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:32.843212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-14cc4f7e-54ca-4b74-9213-9782702788b8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:32.848014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:32.863388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-14cc4f7e-54ca-4b74-9213-9782702788b8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:32.865063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-14cc4f7e-54ca-4b74-9213-9782702788b8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:32.866385 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-14cc4f7e-54ca-4b74-9213-9782702788b8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1669 microversion: 2.20 time: 0.604141 Aug 02 07:13:32.867047 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2651/5228] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:32 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1669 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:13:32.883380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-23881591-e29b-4014-bebf-1e3ffa2794ee req-b82cc5aa-29a0-4cbb-8868-2537517e200e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b35b7f-de5b-4d19-bd55-55d7b06b3536", "name": "network-vif-plugged", "status": "completed", "tag": "9b7ae46e-d7eb-481e-947a-5b8889d64199"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:32.912485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-23881591-e29b-4014-bebf-1e3ffa2794ee req-b82cc5aa-29a0-4cbb-8868-2537517e200e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:32.913233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-23881591-e29b-4014-bebf-1e3ffa2794ee req-b82cc5aa-29a0-4cbb-8868-2537517e200e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:32.938859 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-23881591-e29b-4014-bebf-1e3ffa2794ee req-b82cc5aa-29a0-4cbb-8868-2537517e200e service nova] Creating event network-vif-plugged:9b7ae46e-d7eb-481e-947a-5b8889d64199 for instance 03b35b7f-de5b-4d19-bd55-55d7b06b3536 on n-h2-851337-3 Aug 02 07:13:32.955963 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-23881591-e29b-4014-bebf-1e3ffa2794ee req-b82cc5aa-29a0-4cbb-8868-2537517e200e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087435 Aug 02 07:13:32.956555 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2652/5229] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:13:32.962412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fd768155-5647-437d-9d1a-b0def5037234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:32.965393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fd768155-5647-437d-9d1a-b0def5037234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:32.980211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fd768155-5647-437d-9d1a-b0def5037234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:32.982606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fd768155-5647-437d-9d1a-b0def5037234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:32.983616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fd768155-5647-437d-9d1a-b0def5037234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:32.989945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fd768155-5647-437d-9d1a-b0def5037234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:33.145326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a2cebbba-398b-443e-8ee4-0e898742a2de tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:33.155876 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a2cebbba-398b-443e-8ee4-0e898742a2de tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1504 microversion: 2.1 time: 0.643742 Aug 02 07:13:33.159351 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2578/5230] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:32 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1504 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:33.226458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d9ad43c1-2f53-4686-8844-bae3103e525d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:33.227221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d9ad43c1-2f53-4686-8844-bae3103e525d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: fc4739d2-43d0-4a76-9c6c-eabc6c075beb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:33.234051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9ad43c1-2f53-4686-8844-bae3103e525d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:33.235277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9ad43c1-2f53-4686-8844-bae3103e525d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:33.236634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9ad43c1-2f53-4686-8844-bae3103e525d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:33.238697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9ad43c1-2f53-4686-8844-bae3103e525d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:33.424417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fd768155-5647-437d-9d1a-b0def5037234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:33.431673 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fd768155-5647-437d-9d1a-b0def5037234 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1392 microversion: 2.1 time: 0.473556 Aug 02 07:13:33.432874 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2653/5231] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:32 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1392 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:33.644804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d9ad43c1-2f53-4686-8844-bae3103e525d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:33.658234 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d9ad43c1-2f53-4686-8844-bae3103e525d tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb" status: 200 len: 1513 microversion: 2.1 time: 0.435755 Aug 02 07:13:33.676341 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2579/5232] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:33 2022] GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb => generated 1513 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:13:33.689677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1130317095", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:33.768672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] validate_networks() for [('ab38293c-b029-4eb4-b287-a436f06799c5', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:13:33.894782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-01009de9-ea78-4a07-b16d-712f436ea65e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:33.895396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-01009de9-ea78-4a07-b16d-712f436ea65e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:33.907298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01009de9-ea78-4a07-b16d-712f436ea65e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:33.907988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01009de9-ea78-4a07-b16d-712f436ea65e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:33.908787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01009de9-ea78-4a07-b16d-712f436ea65e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:33.913220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01009de9-ea78-4a07-b16d-712f436ea65e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:34.356760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-01009de9-ea78-4a07-b16d-712f436ea65e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:34.366890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-01009de9-ea78-4a07-b16d-712f436ea65e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:34.380415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-01009de9-ea78-4a07-b16d-712f436ea65e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:34.381843 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-01009de9-ea78-4a07-b16d-712f436ea65e tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1669 microversion: 2.20 time: 0.493532 Aug 02 07:13:34.409253 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2580/5233] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:33 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1669 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:34.417288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ea9473bd-fb93-482b-b936-608a853ac9af tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:34.417956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ea9473bd-fb93-482b-b936-608a853ac9af tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:34.436191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ea9473bd-fb93-482b-b936-608a853ac9af tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:34.436635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ea9473bd-fb93-482b-b936-608a853ac9af tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:34.437407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ea9473bd-fb93-482b-b936-608a853ac9af tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:34.447740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ea9473bd-fb93-482b-b936-608a853ac9af tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:34.998438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ea9473bd-fb93-482b-b936-608a853ac9af tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:35.010383 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ea9473bd-fb93-482b-b936-608a853ac9af tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1504 microversion: 2.1 time: 0.599638 Aug 02 07:13:35.011479 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2581/5234] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:34 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1504 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:35.019539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6443e7ec-de1c-4cd3-b47c-6f485f6b0e24 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:35.020327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6443e7ec-de1c-4cd3-b47c-6f485f6b0e24 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:35.043831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6443e7ec-de1c-4cd3-b47c-6f485f6b0e24 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:35.048099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6443e7ec-de1c-4cd3-b47c-6f485f6b0e24 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:35.049189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6443e7ec-de1c-4cd3-b47c-6f485f6b0e24 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:35.049868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6443e7ec-de1c-4cd3-b47c-6f485f6b0e24 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:35.492766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6443e7ec-de1c-4cd3-b47c-6f485f6b0e24 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:35.502261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:13:35.502851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:13:35.503332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:13:35.503748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:13:35.504159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:13:35.528070 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6443e7ec-de1c-4cd3-b47c-6f485f6b0e24 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1392 microversion: 2.1 time: 0.505896 Aug 02 07:13:35.532869 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2582/5235] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:35 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1392 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:35.553631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:35.555236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:35.562879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:35.563317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c8d03232-cc93-4649-954b-61ae5f82530a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:35.564812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c8d03232-cc93-4649-954b-61ae5f82530a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: fc4739d2-43d0-4a76-9c6c-eabc6c075beb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:35.568177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:35.610458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8d03232-cc93-4649-954b-61ae5f82530a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:35.613719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8d03232-cc93-4649-954b-61ae5f82530a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:35.615601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8d03232-cc93-4649-954b-61ae5f82530a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:35.619314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8d03232-cc93-4649-954b-61ae5f82530a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:35.667676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Getting quotas for project cd671dbd40de4332800d131413db30ec. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:13:35.685485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Getting quotas for user a44f176bdb674f05b727b751c69382ac and project cd671dbd40de4332800d131413db30ec. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:13:35.742791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:13:35.758665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:13:35.927508 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8ce8d5b6-bcf9-4914-9f5e-122a3bba4891 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.492970 Aug 02 07:13:35.932788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c8d03232-cc93-4649-954b-61ae5f82530a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:35.936200 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2654/5236] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:13:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 2502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:13:35.944588 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c8d03232-cc93-4649-954b-61ae5f82530a tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb" status: 200 len: 1513 microversion: 2.1 time: 0.406985 Aug 02 07:13:35.945738 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2583/5237] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:35 2022] GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb => generated 1513 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:35.964366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-2d775c36-1c93-47a5-a267-e21c748d05ec req-ecb857cc-d5c2-4330-8770-ab29ff765147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1a6b1e-adf6-45b2-8b9e-387276fde90c", "name": "network-vif-unplugged", "status": "completed", "tag": "233d855a-4615-492c-b3f0-c628240ca34b"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:35.964692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0812e3a4-4819-4dee-8e67-5749e20d3232 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:35.965627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0812e3a4-4819-4dee-8e67-5749e20d3232 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:35.978609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0812e3a4-4819-4dee-8e67-5749e20d3232 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:35.979429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0812e3a4-4819-4dee-8e67-5749e20d3232 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:35.981217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0812e3a4-4819-4dee-8e67-5749e20d3232 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:35.982194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0812e3a4-4819-4dee-8e67-5749e20d3232 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:35.996330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2d775c36-1c93-47a5-a267-e21c748d05ec req-ecb857cc-d5c2-4330-8770-ab29ff765147 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:35.996910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2d775c36-1c93-47a5-a267-e21c748d05ec req-ecb857cc-d5c2-4330-8770-ab29ff765147 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:36.068261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.compute.server_external_events [req-2d775c36-1c93-47a5-a267-e21c748d05ec req-ecb857cc-d5c2-4330-8770-ab29ff765147 service nova] Unable to find a host for instance 9e1a6b1e-adf6-45b2-8b9e-387276fde90c. Dropping event network-vif-unplugged {{(pid=126120) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 02 07:13:36.072686 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-2d775c36-1c93-47a5-a267-e21c748d05ec req-ecb857cc-d5c2-4330-8770-ab29ff765147 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.135231 Aug 02 07:13:36.086092 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2655/5238] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 149 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 02 07:13:36.126501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd7cf96f-7591-4e99-aff8-8ac3f7554dba tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:36.128585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dd7cf96f-7591-4e99-aff8-8ac3f7554dba tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:36.492220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dd7cf96f-7591-4e99-aff8-8ac3f7554dba tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:36.500001 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dd7cf96f-7591-4e99-aff8-8ac3f7554dba tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1214 microversion: 2.1 time: 0.409968 Aug 02 07:13:36.513715 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2656/5239] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:36 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1214 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:36.525937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-391939d5-65f9-4c05-acc2-b1bb24e13847 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:36.532497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-391939d5-65f9-4c05-acc2-b1bb24e13847 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:36.555995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:36.561740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-391939d5-65f9-4c05-acc2-b1bb24e13847 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:36.562232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-391939d5-65f9-4c05-acc2-b1bb24e13847 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:36.563043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-391939d5-65f9-4c05-acc2-b1bb24e13847 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:36.563480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-391939d5-65f9-4c05-acc2-b1bb24e13847 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:36.750902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0812e3a4-4819-4dee-8e67-5749e20d3232 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:36.766555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0812e3a4-4819-4dee-8e67-5749e20d3232 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:36.768021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0812e3a4-4819-4dee-8e67-5749e20d3232 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:36.769301 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0812e3a4-4819-4dee-8e67-5749e20d3232 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.822436 Aug 02 07:13:36.769916 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2584/5240] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:35 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:36.813453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ad78a52e-1d6f-4cc1-a97b-aeadf80b5b9a req-4bbef522-f19c-437a-9530-b7891720fcf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc4739d2-43d0-4a76-9c6c-eabc6c075beb", "name": "network-vif-deleted", "tag": "9dc50749-fc03-4a1a-9d6c-aa11050ba621"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:36.883832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ad78a52e-1d6f-4cc1-a97b-aeadf80b5b9a req-4bbef522-f19c-437a-9530-b7891720fcf1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:36.894675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ad78a52e-1d6f-4cc1-a97b-aeadf80b5b9a req-4bbef522-f19c-437a-9530-b7891720fcf1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:36.959471 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ad78a52e-1d6f-4cc1-a97b-aeadf80b5b9a req-4bbef522-f19c-437a-9530-b7891720fcf1 service nova] Creating event network-vif-deleted:9dc50749-fc03-4a1a-9d6c-aa11050ba621 for instance fc4739d2-43d0-4a76-9c6c-eabc6c075beb on n-h1-851337-3 Aug 02 07:13:36.974156 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ad78a52e-1d6f-4cc1-a97b-aeadf80b5b9a req-4bbef522-f19c-437a-9530-b7891720fcf1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164685 Aug 02 07:13:36.975217 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2585/5241] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:13:36.988530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8a51396f-25a1-4bf6-85e2-eaf121bd580f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:36.990921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8a51396f-25a1-4bf6-85e2-eaf121bd580f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:37.004270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a51396f-25a1-4bf6-85e2-eaf121bd580f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:37.006512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a51396f-25a1-4bf6-85e2-eaf121bd580f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:37.009553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a51396f-25a1-4bf6-85e2-eaf121bd580f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:37.010593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a51396f-25a1-4bf6-85e2-eaf121bd580f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:37.064080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-391939d5-65f9-4c05-acc2-b1bb24e13847 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:37.077484 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-391939d5-65f9-4c05-acc2-b1bb24e13847 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 200 len: 1447 microversion: 2.1 time: 0.567673 Aug 02 07:13:37.095936 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2657/5242] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:36 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 1447 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:37.104964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0559198e-53aa-4f0c-8f1d-a1f4750fe413 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:37.105879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0559198e-53aa-4f0c-8f1d-a1f4750fe413 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: fc4739d2-43d0-4a76-9c6c-eabc6c075beb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:37.116553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0559198e-53aa-4f0c-8f1d-a1f4750fe413 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:37.117634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0559198e-53aa-4f0c-8f1d-a1f4750fe413 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:37.119327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0559198e-53aa-4f0c-8f1d-a1f4750fe413 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:37.120019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0559198e-53aa-4f0c-8f1d-a1f4750fe413 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:37.263589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0559198e-53aa-4f0c-8f1d-a1f4750fe413 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:37.264544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0559198e-53aa-4f0c-8f1d-a1f4750fe413 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:37.265791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-0559198e-53aa-4f0c-8f1d-a1f4750fe413 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lazy-loading 'fault' on Instance uuid fc4739d2-43d0-4a76-9c6c-eabc6c075beb {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:13:37.441036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0559198e-53aa-4f0c-8f1d-a1f4750fe413 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61352a4cbcad4685bc40f72b4beee3fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3438094cbb4bab88b2fc4d69a1b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:37.452552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8a51396f-25a1-4bf6-85e2-eaf121bd580f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:37.461206 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8a51396f-25a1-4bf6-85e2-eaf121bd580f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1563 microversion: 2.1 time: 0.484091 Aug 02 07:13:37.475826 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0559198e-53aa-4f0c-8f1d-a1f4750fe413 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb" status: 200 len: 1308 microversion: 2.1 time: 0.377754 Aug 02 07:13:37.479478 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2658/5243] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:37 2022] GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb => generated 1308 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:37.481264 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2586/5244] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:36 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1563 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:37.498368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2a2bc958-d079-44f2-bc9b-e557782be930 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:37.499321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a22a911b-a75a-4969-a37d-e7711723aeb1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:37.499796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2a2bc958-d079-44f2-bc9b-e557782be930 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:37.500051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a22a911b-a75a-4969-a37d-e7711723aeb1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:37.508424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a2bc958-d079-44f2-bc9b-e557782be930 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:37.509359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a2bc958-d079-44f2-bc9b-e557782be930 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:37.511179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a2bc958-d079-44f2-bc9b-e557782be930 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:37.513577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a22a911b-a75a-4969-a37d-e7711723aeb1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:37.514789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2a2bc958-d079-44f2-bc9b-e557782be930 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:37.515966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a22a911b-a75a-4969-a37d-e7711723aeb1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:37.520526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a22a911b-a75a-4969-a37d-e7711723aeb1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:37.521730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a22a911b-a75a-4969-a37d-e7711723aeb1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:37.579779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:37.874811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2a2bc958-d079-44f2-bc9b-e557782be930 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:37.883950 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2a2bc958-d079-44f2-bc9b-e557782be930 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1563 microversion: 2.1 time: 0.397655 Aug 02 07:13:37.903040 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2659/5245] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:37 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1563 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:37.916078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eef02649-c2aa-460c-9e9d-9b6c1942c297 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:37.918585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-eef02649-c2aa-460c-9e9d-9b6c1942c297 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:37.938759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a22a911b-a75a-4969-a37d-e7711723aeb1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:37.949739 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a22a911b-a75a-4969-a37d-e7711723aeb1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.466962 Aug 02 07:13:37.951990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eef02649-c2aa-460c-9e9d-9b6c1942c297 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:37.952552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eef02649-c2aa-460c-9e9d-9b6c1942c297 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:37.953330 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2587/5246] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:37 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:37.954398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eef02649-c2aa-460c-9e9d-9b6c1942c297 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:37.956530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eef02649-c2aa-460c-9e9d-9b6c1942c297 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:37.964943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a9039c87-801f-436f-8e4b-98fb1a20ce1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:37.968050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a9039c87-801f-436f-8e4b-98fb1a20ce1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:37.987181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9039c87-801f-436f-8e4b-98fb1a20ce1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:37.991548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9039c87-801f-436f-8e4b-98fb1a20ce1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:37.993975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9039c87-801f-436f-8e4b-98fb1a20ce1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:37.997583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9039c87-801f-436f-8e4b-98fb1a20ce1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:38.163293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-eef02649-c2aa-460c-9e9d-9b6c1942c297 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:38.179724 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-eef02649-c2aa-460c-9e9d-9b6c1942c297 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1266 microversion: 2.1 time: 0.274703 Aug 02 07:13:38.195090 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2660/5247] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:37 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:38.200146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-91c07d51-f5b3-44b9-bd6c-180cf4890bd7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:38.200769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-91c07d51-f5b3-44b9-bd6c-180cf4890bd7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:38.229258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91c07d51-f5b3-44b9-bd6c-180cf4890bd7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:38.229702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91c07d51-f5b3-44b9-bd6c-180cf4890bd7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:38.235609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91c07d51-f5b3-44b9-bd6c-180cf4890bd7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:38.245167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91c07d51-f5b3-44b9-bd6c-180cf4890bd7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:38.897090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-91c07d51-f5b3-44b9-bd6c-180cf4890bd7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:38.930389 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-91c07d51-f5b3-44b9-bd6c-180cf4890bd7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.731292 Aug 02 07:13:38.933832 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2661/5248] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:38 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:38.959636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fe345edf-ace4-47e8-b9ce-ed2f93dec609 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:38.960341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fe345edf-ace4-47e8-b9ce-ed2f93dec609 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: fc4739d2-43d0-4a76-9c6c-eabc6c075beb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:38.965537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a9039c87-801f-436f-8e4b-98fb1a20ce1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:38.990142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a9039c87-801f-436f-8e4b-98fb1a20ce1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:38.996003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a9039c87-801f-436f-8e4b-98fb1a20ce1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:38.999789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe345edf-ace4-47e8-b9ce-ed2f93dec609 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:39.003150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe345edf-ace4-47e8-b9ce-ed2f93dec609 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:39.003789 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a9039c87-801f-436f-8e4b-98fb1a20ce1f tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 1.044020 Aug 02 07:13:39.004735 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2588/5249] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:37 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:39.010314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe345edf-ace4-47e8-b9ce-ed2f93dec609 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:39.013873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fe345edf-ace4-47e8-b9ce-ed2f93dec609 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:39.035694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a27da32c-d419-46e0-ac70-bc844c5f5ffc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:39.048804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a27da32c-d419-46e0-ac70-bc844c5f5ffc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:39.086851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a27da32c-d419-46e0-ac70-bc844c5f5ffc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:39.087665 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-fe345edf-ace4-47e8-b9ce-ed2f93dec609 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] HTTP exception thrown: Instance fc4739d2-43d0-4a76-9c6c-eabc6c075beb could not be found. Aug 02 07:13:39.093784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a27da32c-d419-46e0-ac70-bc844c5f5ffc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:39.100104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a27da32c-d419-46e0-ac70-bc844c5f5ffc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fe345edf-ace4-47e8-b9ce-ed2f93dec609 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Request method failure captured: Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb HTTP/1.1 Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M5Uh53_o8My2KZ2Kf7052ndLZ1CS8m0qUP-RR_a6tAVxo5Eiw78o8oJaEP8UIduxJZEdUh_G_0veRiKSLiUb7s3_zs65291o3VGXdM2jvKwDHQzbY5cIM99aYXT1DyPi_W2WdGoAmkhDMUe216WXT0v0tixhKC3_7Dp2GhldHmT58o Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: aa3438094cbb4bab88b2fc4d69a1b65a Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-MultipleCreateTestJSON-1717891876 Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/aa3438094cbb4bab88b2fc4d69a1b65a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aa3438094cbb4bab88b2fc4d69a1b65a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_aa3438094cbb4bab88b2fc4d69a1b65a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aa3438094cbb4bab88b2fc4d69a1b65a"}]}] Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-MultipleCreateTestJSON-1717891876 Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: aa3438094cbb4bab88b2fc4d69a1b65a Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1717891876 Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-MultipleCreateTestJSON-1717891876-project Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 61352a4cbcad4685bc40f72b4beee3fe Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-MultipleCreateTestJSON-1717891876-project Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance fc4739d2-43d0-4a76-9c6c-eabc6c075beb could not be found. Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'fc4739d2-43d0-4a76-9c6c-eabc6c075beb'} Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc4739d2-43d0-4a76-9c6c-eabc6c075beb could not be found. Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc4739d2-43d0-4a76-9c6c-eabc6c075beb could not be found. Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:13:39.100934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:13:39.107277 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:13:39.107277 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:13:39.107277 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:13:39.107277 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:13:39.107277 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:13:39.107277 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc4739d2-43d0-4a76-9c6c-eabc6c075beb could not be found. Aug 02 07:13:39.107277 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:13:39.108524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a27da32c-d419-46e0-ac70-bc844c5f5ffc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:39.115777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fe345edf-ace4-47e8-b9ce-ed2f93dec609 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Returning 404 to user: Instance fc4739d2-43d0-4a76-9c6c-eabc6c075beb could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:13:39.123260 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fe345edf-ace4-47e8-b9ce-ed2f93dec609 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb" status: 404 len: 111 microversion: 2.1 time: 0.181783 Aug 02 07:13:39.127958 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2662/5250] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:38 2022] GET /compute/v2.1/servers/fc4739d2-43d0-4a76-9c6c-eabc6c075beb => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:13:39.146479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ed416da-43f8-4dd2-b479-1cfb29c8c160 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:39.166172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2ed416da-43f8-4dd2-b479-1cfb29c8c160 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] [instance: 0c2c09e7-06e4-4a3e-854f-341d88ba5200] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:39.183531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ed416da-43f8-4dd2-b479-1cfb29c8c160 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:39.185407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ed416da-43f8-4dd2-b479-1cfb29c8c160 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:39.188222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ed416da-43f8-4dd2-b479-1cfb29c8c160 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:39.189519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ed416da-43f8-4dd2-b479-1cfb29c8c160 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:39.254106 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-2ed416da-43f8-4dd2-b479-1cfb29c8c160 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] HTTP exception thrown: Instance 0c2c09e7-06e4-4a3e-854f-341d88ba5200 could not be found. Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ed416da-43f8-4dd2-b479-1cfb29c8c160 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Request method failure captured: Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 HTTP/1.1 Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M5Uh53_o8My2KZ2Kf7052ndLZ1CS8m0qUP-RR_a6tAVxo5Eiw78o8oJaEP8UIduxJZEdUh_G_0veRiKSLiUb7s3_zs65291o3VGXdM2jvKwDHQzbY5cIM99aYXT1DyPi_W2WdGoAmkhDMUe216WXT0v0tixhKC3_7Dp2GhldHmT58o Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: aa3438094cbb4bab88b2fc4d69a1b65a Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-MultipleCreateTestJSON-1717891876 Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/aa3438094cbb4bab88b2fc4d69a1b65a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aa3438094cbb4bab88b2fc4d69a1b65a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_aa3438094cbb4bab88b2fc4d69a1b65a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aa3438094cbb4bab88b2fc4d69a1b65a"}]}] Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-MultipleCreateTestJSON-1717891876 Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: aa3438094cbb4bab88b2fc4d69a1b65a Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1717891876 Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-MultipleCreateTestJSON-1717891876-project Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 61352a4cbcad4685bc40f72b4beee3fe Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-MultipleCreateTestJSON-1717891876-project Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 0c2c09e7-06e4-4a3e-854f-341d88ba5200 could not be found. Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '0c2c09e7-06e4-4a3e-854f-341d88ba5200'} Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2c09e7-06e4-4a3e-854f-341d88ba5200 could not be found. Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2c09e7-06e4-4a3e-854f-341d88ba5200 could not be found. Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:13:39.260611 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:13:39.266209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:13:39.266209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:13:39.266209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:13:39.266209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:13:39.266209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:13:39.266209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2c09e7-06e4-4a3e-854f-341d88ba5200 could not be found. Aug 02 07:13:39.266209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:13:39.268710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ed416da-43f8-4dd2-b479-1cfb29c8c160 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] Returning 404 to user: Instance 0c2c09e7-06e4-4a3e-854f-341d88ba5200 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:13:39.275410 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2ed416da-43f8-4dd2-b479-1cfb29c8c160 tempest-MultipleCreateTestJSON-1717891876 tempest-MultipleCreateTestJSON-1717891876-project] 10.222.0.79 "GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200" status: 404 len: 111 microversion: 2.1 time: 0.136853 Aug 02 07:13:39.276799 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2663/5251] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:39 2022] GET /compute/v2.1/servers/0c2c09e7-06e4-4a3e-854f-341d88ba5200 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:13:39.305853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3e20683d-2c31-4392-8e81-abc881b3f369 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:39.309319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3e20683d-2c31-4392-8e81-abc881b3f369 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:39.330286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e20683d-2c31-4392-8e81-abc881b3f369 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:39.331297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e20683d-2c31-4392-8e81-abc881b3f369 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:39.335241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e20683d-2c31-4392-8e81-abc881b3f369 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:39.335867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e20683d-2c31-4392-8e81-abc881b3f369 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:40.315854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3e20683d-2c31-4392-8e81-abc881b3f369 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:40.342025 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3e20683d-2c31-4392-8e81-abc881b3f369 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1272 microversion: 2.1 time: 1.047684 Aug 02 07:13:40.342291 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2664/5252] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:39 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1272 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:40.347501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-bc3f4558-e486-4f1b-b747-b3f91e039d07 req-c1c4f6f3-2cb9-4cf6-bcb8-26b89d9684f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2c09e7-06e4-4a3e-854f-341d88ba5200", "name": "network-vif-deleted", "tag": "1f5a4a86-3435-46b6-bac0-77faa3eea157"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:40.391953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-bc3f4558-e486-4f1b-b747-b3f91e039d07 req-c1c4f6f3-2cb9-4cf6-bcb8-26b89d9684f5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:40.396898 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-bc3f4558-e486-4f1b-b747-b3f91e039d07 req-c1c4f6f3-2cb9-4cf6-bcb8-26b89d9684f5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:40.433606 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-bc3f4558-e486-4f1b-b747-b3f91e039d07 req-c1c4f6f3-2cb9-4cf6-bcb8-26b89d9684f5 service nova] Creating event network-vif-deleted:1f5a4a86-3435-46b6-bac0-77faa3eea157 for instance 0c2c09e7-06e4-4a3e-854f-341d88ba5200 on n-h1-851337-3 Aug 02 07:13:40.445146 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-bc3f4558-e486-4f1b-b747-b3f91e039d07 req-c1c4f6f3-2cb9-4cf6-bcb8-26b89d9684f5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101087 Aug 02 07:13:40.446139 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2665/5253] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:13:40.464417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ff6d8f8e-4de1-4f40-8770-03f8cfaf2794 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:40.465881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ff6d8f8e-4de1-4f40-8770-03f8cfaf2794 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:40.495519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff6d8f8e-4de1-4f40-8770-03f8cfaf2794 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:40.495980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff6d8f8e-4de1-4f40-8770-03f8cfaf2794 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:40.496835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff6d8f8e-4de1-4f40-8770-03f8cfaf2794 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:40.497292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff6d8f8e-4de1-4f40-8770-03f8cfaf2794 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:40.536154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a27da32c-d419-46e0-ac70-bc844c5f5ffc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:40.550593 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a27da32c-d419-46e0-ac70-bc844c5f5ffc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 1.540738 Aug 02 07:13:40.566866 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2589/5254] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:39 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:40.574946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-555c88a8-c745-4e95-a8f0-d3f3e628736f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:40.575852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-555c88a8-c745-4e95-a8f0-d3f3e628736f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:40.583098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-555c88a8-c745-4e95-a8f0-d3f3e628736f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:40.583830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-555c88a8-c745-4e95-a8f0-d3f3e628736f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:40.585791 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-555c88a8-c745-4e95-a8f0-d3f3e628736f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:40.586444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-555c88a8-c745-4e95-a8f0-d3f3e628736f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:41.415020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ff6d8f8e-4de1-4f40-8770-03f8cfaf2794 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:41.430576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ff6d8f8e-4de1-4f40-8770-03f8cfaf2794 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:41.436363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ff6d8f8e-4de1-4f40-8770-03f8cfaf2794 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:41.443556 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ff6d8f8e-4de1-4f40-8770-03f8cfaf2794 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.989328 Aug 02 07:13:41.444342 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2666/5255] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:40 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:41.450200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a8de21b3-4d14-4c73-8220-765404fe704a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:41.455417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a8de21b3-4d14-4c73-8220-765404fe704a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:41.480324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8de21b3-4d14-4c73-8220-765404fe704a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:41.484981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8de21b3-4d14-4c73-8220-765404fe704a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:41.486476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8de21b3-4d14-4c73-8220-765404fe704a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:41.488640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8de21b3-4d14-4c73-8220-765404fe704a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:41.587573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-555c88a8-c745-4e95-a8f0-d3f3e628736f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:41.613871 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-555c88a8-c745-4e95-a8f0-d3f3e628736f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 1.037532 Aug 02 07:13:41.615138 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2590/5256] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:40 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:41.644989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0e3cc40d-7d00-4fe7-b8fa-42d1815d4108 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:41.675226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e3cc40d-7d00-4fe7-b8fa-42d1815d4108 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:41.677973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e3cc40d-7d00-4fe7-b8fa-42d1815d4108 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:41.695717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a8de21b3-4d14-4c73-8220-765404fe704a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:41.709819 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a8de21b3-4d14-4c73-8220-765404fe704a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1272 microversion: 2.1 time: 0.264033 Aug 02 07:13:41.711978 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2667/5257] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:41 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1272 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:41.787115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0e3cc40d-7d00-4fe7-b8fa-42d1815d4108 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Going to try to stop instance {{(pid=126119) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 07:13:41.919712 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0e3cc40d-7d00-4fe7-b8fa-42d1815d4108 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.283208 Aug 02 07:13:41.920959 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2591/5258] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:13:41 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:13:41.933496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1e152824-e673-49f8-9c8c-54e88a96b012 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:41.934364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1e152824-e673-49f8-9c8c-54e88a96b012 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:41.953467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e152824-e673-49f8-9c8c-54e88a96b012 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:41.959192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e152824-e673-49f8-9c8c-54e88a96b012 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:41.963956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e152824-e673-49f8-9c8c-54e88a96b012 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:41.964823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e152824-e673-49f8-9c8c-54e88a96b012 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:42.317393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1e152824-e673-49f8-9c8c-54e88a96b012 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:42.331773 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1e152824-e673-49f8-9c8c-54e88a96b012 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.404071 Aug 02 07:13:42.332420 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2668/5259] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:41 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:42.472657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2e143aa9-81f9-49d3-96e0-f0dcd0408a56 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:42.473340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2e143aa9-81f9-49d3-96e0-f0dcd0408a56 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:42.486266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e143aa9-81f9-49d3-96e0-f0dcd0408a56 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:42.487126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e143aa9-81f9-49d3-96e0-f0dcd0408a56 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:42.495285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e143aa9-81f9-49d3-96e0-f0dcd0408a56 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:42.496029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e143aa9-81f9-49d3-96e0-f0dcd0408a56 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:42.731038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-39fff3fc-ab9b-4742-b6ce-77909b9949ca tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:42.731669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-39fff3fc-ab9b-4742-b6ce-77909b9949ca tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:42.752547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39fff3fc-ab9b-4742-b6ce-77909b9949ca tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:42.754956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39fff3fc-ab9b-4742-b6ce-77909b9949ca tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:42.756914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39fff3fc-ab9b-4742-b6ce-77909b9949ca tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:42.762314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39fff3fc-ab9b-4742-b6ce-77909b9949ca tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:43.404889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2e143aa9-81f9-49d3-96e0-f0dcd0408a56 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:43.416182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2e143aa9-81f9-49d3-96e0-f0dcd0408a56 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:43.417797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2e143aa9-81f9-49d3-96e0-f0dcd0408a56 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:43.419190 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2e143aa9-81f9-49d3-96e0-f0dcd0408a56 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.951597 Aug 02 07:13:43.438032 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2592/5260] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:42 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:43.460036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1efffd02-9580-40e6-a739-aa317035270b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:43.462659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1efffd02-9580-40e6-a739-aa317035270b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:43.501946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1efffd02-9580-40e6-a739-aa317035270b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:43.507204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1efffd02-9580-40e6-a739-aa317035270b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:43.512749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1efffd02-9580-40e6-a739-aa317035270b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:43.515827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1efffd02-9580-40e6-a739-aa317035270b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:43.542972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-39fff3fc-ab9b-4742-b6ce-77909b9949ca tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:43.551834 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-39fff3fc-ab9b-4742-b6ce-77909b9949ca tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1314 microversion: 2.1 time: 0.824788 Aug 02 07:13:43.558644 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2669/5261] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:42 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1314 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:44.444465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-de453315-7369-48ed-a151-7423d5879dc3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:44.445923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-de453315-7369-48ed-a151-7423d5879dc3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:44.476292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de453315-7369-48ed-a151-7423d5879dc3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:44.477050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de453315-7369-48ed-a151-7423d5879dc3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:44.481214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de453315-7369-48ed-a151-7423d5879dc3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:44.486409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de453315-7369-48ed-a151-7423d5879dc3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:44.811223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1efffd02-9580-40e6-a739-aa317035270b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:44.835306 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1efffd02-9580-40e6-a739-aa317035270b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 1.381168 Aug 02 07:13:44.836831 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2593/5262] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:43 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:44.873661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b02a5f94-ec08-43b1-af32-ba30ac1ad4f6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:44.874316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b02a5f94-ec08-43b1-af32-ba30ac1ad4f6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:44.894066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b02a5f94-ec08-43b1-af32-ba30ac1ad4f6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:44.894066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b02a5f94-ec08-43b1-af32-ba30ac1ad4f6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:44.894663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b02a5f94-ec08-43b1-af32-ba30ac1ad4f6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:44.901281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b02a5f94-ec08-43b1-af32-ba30ac1ad4f6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:45.009791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-de453315-7369-48ed-a151-7423d5879dc3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:45.025718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-de453315-7369-48ed-a151-7423d5879dc3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:45.029030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-de453315-7369-48ed-a151-7423d5879dc3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:45.031556 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-de453315-7369-48ed-a151-7423d5879dc3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.591620 Aug 02 07:13:45.036915 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2670/5263] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:44 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:45.872223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:45.897416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ed082b00-fb4c-4f08-9ec9-98752dbe33c0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:45.903566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ed082b00-fb4c-4f08-9ec9-98752dbe33c0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:45.934106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ed082b00-fb4c-4f08-9ec9-98752dbe33c0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:45.937720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b02a5f94-ec08-43b1-af32-ba30ac1ad4f6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:45.944327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ed082b00-fb4c-4f08-9ec9-98752dbe33c0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:45.951234 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b02a5f94-ec08-43b1-af32-ba30ac1ad4f6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1314 microversion: 2.1 time: 1.101112 Aug 02 07:13:45.953551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ed082b00-fb4c-4f08-9ec9-98752dbe33c0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:45.955171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ed082b00-fb4c-4f08-9ec9-98752dbe33c0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:45.955579 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2594/5264] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:44 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1314 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:46.066215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5bbe9aa7-ce98-4729-a9b0-7f01b1c69023 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:46.066841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5bbe9aa7-ce98-4729-a9b0-7f01b1c69023 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:46.084130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5bbe9aa7-ce98-4729-a9b0-7f01b1c69023 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:46.084585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5bbe9aa7-ce98-4729-a9b0-7f01b1c69023 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:46.085485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5bbe9aa7-ce98-4729-a9b0-7f01b1c69023 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:46.085935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5bbe9aa7-ce98-4729-a9b0-7f01b1c69023 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:46.499818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:46.869476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5bbe9aa7-ce98-4729-a9b0-7f01b1c69023 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:46.906618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5bbe9aa7-ce98-4729-a9b0-7f01b1c69023 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:46.911729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5bbe9aa7-ce98-4729-a9b0-7f01b1c69023 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:46.914605 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5bbe9aa7-ce98-4729-a9b0-7f01b1c69023 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.853038 Aug 02 07:13:46.916884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ed082b00-fb4c-4f08-9ec9-98752dbe33c0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:46.936035 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ed082b00-fb4c-4f08-9ec9-98752dbe33c0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 1.066571 Aug 02 07:13:46.936035 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2671/5265] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:45 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:46.950809 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2595/5266] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:46 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:13:46.965656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ded15a53-5164-4803-96b4-19e6e51eacb2 req-0426b48a-168a-4612-a1cb-ef692f0bc792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b35b7f-de5b-4d19-bd55-55d7b06b3536", "tag": "9b7ae46e-d7eb-481e-947a-5b8889d64199"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:46.979541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-130cd847-83c1-441c-9b04-16f0689a26d6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:46.985332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-130cd847-83c1-441c-9b04-16f0689a26d6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:47.004383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ded15a53-5164-4803-96b4-19e6e51eacb2 req-0426b48a-168a-4612-a1cb-ef692f0bc792 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:47.004815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ded15a53-5164-4803-96b4-19e6e51eacb2 req-0426b48a-168a-4612-a1cb-ef692f0bc792 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:47.029757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-130cd847-83c1-441c-9b04-16f0689a26d6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:47.035490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-130cd847-83c1-441c-9b04-16f0689a26d6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:47.037208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-130cd847-83c1-441c-9b04-16f0689a26d6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:47.041548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-130cd847-83c1-441c-9b04-16f0689a26d6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:47.046682 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ded15a53-5164-4803-96b4-19e6e51eacb2 req-0426b48a-168a-4612-a1cb-ef692f0bc792 service nova] Creating event network-changed:9b7ae46e-d7eb-481e-947a-5b8889d64199 for instance 03b35b7f-de5b-4d19-bd55-55d7b06b3536 on n-h2-851337-3 Aug 02 07:13:47.070701 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ded15a53-5164-4803-96b4-19e6e51eacb2 req-0426b48a-168a-4612-a1cb-ef692f0bc792 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113788 Aug 02 07:13:47.070701 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2596/5267] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:13:47.096223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb4f0f63-d7f0-407b-b1fd-ebb5db9c2331 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:47.098035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cb4f0f63-d7f0-407b-b1fd-ebb5db9c2331 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:47.123675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb4f0f63-d7f0-407b-b1fd-ebb5db9c2331 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:47.127610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb4f0f63-d7f0-407b-b1fd-ebb5db9c2331 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:47.128747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb4f0f63-d7f0-407b-b1fd-ebb5db9c2331 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:47.134637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb4f0f63-d7f0-407b-b1fd-ebb5db9c2331 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:48.503216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-130cd847-83c1-441c-9b04-16f0689a26d6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:48.516685 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-130cd847-83c1-441c-9b04-16f0689a26d6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1563 microversion: 2.1 time: 1.564596 Aug 02 07:13:48.540635 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2672/5268] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:46 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1563 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:48.548609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e12a910-91d2-4795-8cfb-382055de5af7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:48.554171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7e12a910-91d2-4795-8cfb-382055de5af7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:48.586198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e12a910-91d2-4795-8cfb-382055de5af7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:48.590387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e12a910-91d2-4795-8cfb-382055de5af7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:48.595600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e12a910-91d2-4795-8cfb-382055de5af7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:48.600259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e12a910-91d2-4795-8cfb-382055de5af7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:48.604362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cb4f0f63-d7f0-407b-b1fd-ebb5db9c2331 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:48.616786 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cb4f0f63-d7f0-407b-b1fd-ebb5db9c2331 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1314 microversion: 2.1 time: 1.546379 Aug 02 07:13:48.623638 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2597/5269] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:47 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1314 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:48.633820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:48.639310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2a4e26d1-675d-4073-aec2-6f13a8b4fa80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:48.646084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2a4e26d1-675d-4073-aec2-6f13a8b4fa80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:48.668122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a4e26d1-675d-4073-aec2-6f13a8b4fa80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:48.669010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a4e26d1-675d-4073-aec2-6f13a8b4fa80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:48.670034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a4e26d1-675d-4073-aec2-6f13a8b4fa80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:48.679175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a4e26d1-675d-4073-aec2-6f13a8b4fa80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:49.412614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7e12a910-91d2-4795-8cfb-382055de5af7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:49.431718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7e12a910-91d2-4795-8cfb-382055de5af7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:49.437414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7e12a910-91d2-4795-8cfb-382055de5af7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:49.439139 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7e12a910-91d2-4795-8cfb-382055de5af7 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.896955 Aug 02 07:13:49.448443 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2673/5270] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:48 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:49.641278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-639bab14-d900-4543-94ed-024c4b9b2686 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:49.647851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-639bab14-d900-4543-94ed-024c4b9b2686 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:49.668291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-639bab14-d900-4543-94ed-024c4b9b2686 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:49.674709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-639bab14-d900-4543-94ed-024c4b9b2686 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:49.676553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-639bab14-d900-4543-94ed-024c4b9b2686 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:49.680576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-639bab14-d900-4543-94ed-024c4b9b2686 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:49.716434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2a4e26d1-675d-4073-aec2-6f13a8b4fa80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:49.749761 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2a4e26d1-675d-4073-aec2-6f13a8b4fa80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 1.124673 Aug 02 07:13:49.770618 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2598/5271] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:48 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:49.984357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a19abcf7-c687-4a69-9c44-d8e80c745a92 req-ec3825c2-5c1d-4df5-8b3e-047dc7702ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b724a4-b410-4a25-b75e-40f78d9c3537", "tag": "22289b0f-98a7-4313-b0cd-e51d916a1047"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:50.003569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a19abcf7-c687-4a69-9c44-d8e80c745a92 req-ec3825c2-5c1d-4df5-8b3e-047dc7702ab3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:50.011994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a19abcf7-c687-4a69-9c44-d8e80c745a92 req-ec3825c2-5c1d-4df5-8b3e-047dc7702ab3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:50.062074 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a19abcf7-c687-4a69-9c44-d8e80c745a92 req-ec3825c2-5c1d-4df5-8b3e-047dc7702ab3 service nova] Creating event network-changed:22289b0f-98a7-4313-b0cd-e51d916a1047 for instance c1b724a4-b410-4a25-b75e-40f78d9c3537 on n-h1-851337-3 Aug 02 07:13:50.085631 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a19abcf7-c687-4a69-9c44-d8e80c745a92 req-ec3825c2-5c1d-4df5-8b3e-047dc7702ab3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105004 Aug 02 07:13:50.113642 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2599/5272] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:13:50.127993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-639bab14-d900-4543-94ed-024c4b9b2686 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:50.159046 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-639bab14-d900-4543-94ed-024c4b9b2686 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1314 microversion: 2.1 time: 0.515978 Aug 02 07:13:50.160259 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2674/5273] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:49 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:50.473423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0a970753-6022-417c-8882-aad057c4f715 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:50.493932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0a970753-6022-417c-8882-aad057c4f715 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:50.505927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a970753-6022-417c-8882-aad057c4f715 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:50.534341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a970753-6022-417c-8882-aad057c4f715 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:50.535262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a970753-6022-417c-8882-aad057c4f715 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:50.535716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a970753-6022-417c-8882-aad057c4f715 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:50.797840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b55bd17a-96a4-4116-b13d-c76431f18121 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:50.799451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b55bd17a-96a4-4116-b13d-c76431f18121 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:50.821402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b55bd17a-96a4-4116-b13d-c76431f18121 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:50.823210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b55bd17a-96a4-4116-b13d-c76431f18121 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:50.827005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b55bd17a-96a4-4116-b13d-c76431f18121 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:50.831563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b55bd17a-96a4-4116-b13d-c76431f18121 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:51.032292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0a970753-6022-417c-8882-aad057c4f715 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:51.065377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0a970753-6022-417c-8882-aad057c4f715 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:51.070762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0a970753-6022-417c-8882-aad057c4f715 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:51.073273 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0a970753-6022-417c-8882-aad057c4f715 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.607827 Aug 02 07:13:51.087650 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2600/5274] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:50 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:51.185575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bb264482-3f2e-4594-86b5-4101b2e86f8b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:51.186664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bb264482-3f2e-4594-86b5-4101b2e86f8b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:51.208045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb264482-3f2e-4594-86b5-4101b2e86f8b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:51.209480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb264482-3f2e-4594-86b5-4101b2e86f8b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:51.214171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb264482-3f2e-4594-86b5-4101b2e86f8b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:51.215033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb264482-3f2e-4594-86b5-4101b2e86f8b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:51.284887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b55bd17a-96a4-4116-b13d-c76431f18121 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:51.293273 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b55bd17a-96a4-4116-b13d-c76431f18121 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.500088 Aug 02 07:13:51.297546 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2675/5275] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:50 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:51.542346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bb264482-3f2e-4594-86b5-4101b2e86f8b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:51.550476 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bb264482-3f2e-4594-86b5-4101b2e86f8b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1314 microversion: 2.1 time: 0.369170 Aug 02 07:13:51.551083 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2601/5276] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:51 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:52.111050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3317d5d7-554b-46f0-9e27-6b9f35cc6440 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:52.112804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3317d5d7-554b-46f0-9e27-6b9f35cc6440 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:52.129619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3317d5d7-554b-46f0-9e27-6b9f35cc6440 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:52.149134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3317d5d7-554b-46f0-9e27-6b9f35cc6440 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:52.151105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3317d5d7-554b-46f0-9e27-6b9f35cc6440 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:52.151942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3317d5d7-554b-46f0-9e27-6b9f35cc6440 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:52.327349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dbc3b691-fa72-48bf-b154-7b481c41f63d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:52.328497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dbc3b691-fa72-48bf-b154-7b481c41f63d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:52.351394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbc3b691-fa72-48bf-b154-7b481c41f63d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:52.352020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbc3b691-fa72-48bf-b154-7b481c41f63d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:52.352908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbc3b691-fa72-48bf-b154-7b481c41f63d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:52.354075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbc3b691-fa72-48bf-b154-7b481c41f63d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:52.619066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3317d5d7-554b-46f0-9e27-6b9f35cc6440 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:52.638600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3317d5d7-554b-46f0-9e27-6b9f35cc6440 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:52.640404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3317d5d7-554b-46f0-9e27-6b9f35cc6440 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:52.641733 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3317d5d7-554b-46f0-9e27-6b9f35cc6440 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.536977 Aug 02 07:13:52.646003 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2676/5277] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:52 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:52.654971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-584813d7-8d0d-4813-8cbf-c3a7f1310c12 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:52.658125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-584813d7-8d0d-4813-8cbf-c3a7f1310c12 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:52.671677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-584813d7-8d0d-4813-8cbf-c3a7f1310c12 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:52.681184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-584813d7-8d0d-4813-8cbf-c3a7f1310c12 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:52.682211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-584813d7-8d0d-4813-8cbf-c3a7f1310c12 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:52.682753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-584813d7-8d0d-4813-8cbf-c3a7f1310c12 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:52.821189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dbc3b691-fa72-48bf-b154-7b481c41f63d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:52.852801 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dbc3b691-fa72-48bf-b154-7b481c41f63d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.539399 Aug 02 07:13:52.867541 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2602/5278] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:52 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:53.076928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-584813d7-8d0d-4813-8cbf-c3a7f1310c12 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:53.088814 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-584813d7-8d0d-4813-8cbf-c3a7f1310c12 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1314 microversion: 2.1 time: 0.441326 Aug 02 07:13:53.089426 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2677/5279] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:52 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:53.677217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-65460eed-7a6a-41e6-b4e1-8b199bdfb2fd tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:53.678070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-65460eed-7a6a-41e6-b4e1-8b199bdfb2fd tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:53.707750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65460eed-7a6a-41e6-b4e1-8b199bdfb2fd tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:53.708230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65460eed-7a6a-41e6-b4e1-8b199bdfb2fd tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:53.709139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65460eed-7a6a-41e6-b4e1-8b199bdfb2fd tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:53.709646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-65460eed-7a6a-41e6-b4e1-8b199bdfb2fd tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:53.881271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3e0cdce5-ed2e-4ad6-a848-24707de460bf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:53.882120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3e0cdce5-ed2e-4ad6-a848-24707de460bf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:53.893363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e0cdce5-ed2e-4ad6-a848-24707de460bf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:53.893825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e0cdce5-ed2e-4ad6-a848-24707de460bf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:53.894657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e0cdce5-ed2e-4ad6-a848-24707de460bf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:53.895094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e0cdce5-ed2e-4ad6-a848-24707de460bf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:54.783140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-65460eed-7a6a-41e6-b4e1-8b199bdfb2fd tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:54.796243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-65460eed-7a6a-41e6-b4e1-8b199bdfb2fd tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:54.804054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-65460eed-7a6a-41e6-b4e1-8b199bdfb2fd tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:54.810452 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-65460eed-7a6a-41e6-b4e1-8b199bdfb2fd tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 1.135920 Aug 02 07:13:54.814184 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2603/5280] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:53 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:54.816919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3e0cdce5-ed2e-4ad6-a848-24707de460bf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:54.830268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0e6f085e-775f-456a-8a44-c2d0bc0d374a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:54.832393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0e6f085e-775f-456a-8a44-c2d0bc0d374a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:54.836218 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3e0cdce5-ed2e-4ad6-a848-24707de460bf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1679 microversion: 2.1 time: 0.958894 Aug 02 07:13:54.838031 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2678/5281] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:53 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1679 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:54.883206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e6f085e-775f-456a-8a44-c2d0bc0d374a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:54.886728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e6f085e-775f-456a-8a44-c2d0bc0d374a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:54.887646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e6f085e-775f-456a-8a44-c2d0bc0d374a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:54.888095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e6f085e-775f-456a-8a44-c2d0bc0d374a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:54.947526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:13:55.449267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0e6f085e-775f-456a-8a44-c2d0bc0d374a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:55.458077 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0e6f085e-775f-456a-8a44-c2d0bc0d374a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1314 microversion: 2.1 time: 0.640817 Aug 02 07:13:55.466271 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2604/5282] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:54 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:55.841459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1abb1d2d-15a6-466f-bd01-759e4c48c878 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:55.842501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1abb1d2d-15a6-466f-bd01-759e4c48c878 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:55.863922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-35405b9e-f20f-48a5-9092-4c0bfc461db7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:55.865428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-35405b9e-f20f-48a5-9092-4c0bfc461db7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:55.878331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1abb1d2d-15a6-466f-bd01-759e4c48c878 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:55.878772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1abb1d2d-15a6-466f-bd01-759e4c48c878 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:55.879622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1abb1d2d-15a6-466f-bd01-759e4c48c878 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:55.880069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1abb1d2d-15a6-466f-bd01-759e4c48c878 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:55.886038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-35405b9e-f20f-48a5-9092-4c0bfc461db7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:55.888621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-35405b9e-f20f-48a5-9092-4c0bfc461db7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:55.890160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-35405b9e-f20f-48a5-9092-4c0bfc461db7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:55.891021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-35405b9e-f20f-48a5-9092-4c0bfc461db7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:56.406395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1abb1d2d-15a6-466f-bd01-759e4c48c878 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:56.414176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-35405b9e-f20f-48a5-9092-4c0bfc461db7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:56.421293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1abb1d2d-15a6-466f-bd01-759e4c48c878 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:56.425518 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-35405b9e-f20f-48a5-9092-4c0bfc461db7 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1656 microversion: 2.1 time: 0.563708 Aug 02 07:13:56.441440 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2605/5283] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:55 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1656 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:56.441941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1abb1d2d-15a6-466f-bd01-759e4c48c878 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:56.441941 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1abb1d2d-15a6-466f-bd01-759e4c48c878 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.600463 Aug 02 07:13:56.441941 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2679/5284] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:55 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:13:56.446714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-796de08d-2ccb-4c80-9713-463d1e459d07 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:56.460010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-796de08d-2ccb-4c80-9713-463d1e459d07 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:56.460804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-796de08d-2ccb-4c80-9713-463d1e459d07 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:56.490478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-796de08d-2ccb-4c80-9713-463d1e459d07 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Going to try to start instance {{(pid=126119) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 07:13:56.504121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-998d36ed-df8a-40b7-a6a0-096e42c3fa11 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:56.505607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-998d36ed-df8a-40b7-a6a0-096e42c3fa11 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:56.516576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-998d36ed-df8a-40b7-a6a0-096e42c3fa11 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:56.517532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-998d36ed-df8a-40b7-a6a0-096e42c3fa11 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:56.520093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-998d36ed-df8a-40b7-a6a0-096e42c3fa11 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:56.521207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-998d36ed-df8a-40b7-a6a0-096e42c3fa11 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:56.564814 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-796de08d-2ccb-4c80-9713-463d1e459d07 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.121673 Aug 02 07:13:56.569149 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2606/5285] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:13:56 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:13:56.582428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-eb00f3c3-7af7-4c26-98ad-eeb04b2ef77a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:56.583135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-eb00f3c3-7af7-4c26-98ad-eeb04b2ef77a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:56.591984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eb00f3c3-7af7-4c26-98ad-eeb04b2ef77a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:56.594297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eb00f3c3-7af7-4c26-98ad-eeb04b2ef77a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:56.595108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eb00f3c3-7af7-4c26-98ad-eeb04b2ef77a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:56.595548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eb00f3c3-7af7-4c26-98ad-eeb04b2ef77a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:56.877778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-998d36ed-df8a-40b7-a6a0-096e42c3fa11 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:56.886635 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-998d36ed-df8a-40b7-a6a0-096e42c3fa11 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1314 microversion: 2.1 time: 0.391268 Aug 02 07:13:56.888112 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2680/5286] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:56 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:56.968792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-eb00f3c3-7af7-4c26-98ad-eeb04b2ef77a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:56.981338 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-eb00f3c3-7af7-4c26-98ad-eeb04b2ef77a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1665 microversion: 2.1 time: 0.408907 Aug 02 07:13:56.989965 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2607/5287] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:56 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1665 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:57.463409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c28b79d9-dea6-4577-b2b0-efc4ef604fc8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:57.464176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c28b79d9-dea6-4577-b2b0-efc4ef604fc8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:57.473336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c28b79d9-dea6-4577-b2b0-efc4ef604fc8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:57.474741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c28b79d9-dea6-4577-b2b0-efc4ef604fc8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:57.476149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c28b79d9-dea6-4577-b2b0-efc4ef604fc8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:57.477149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c28b79d9-dea6-4577-b2b0-efc4ef604fc8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:57.700287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c28b79d9-dea6-4577-b2b0-efc4ef604fc8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:57.711523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c28b79d9-dea6-4577-b2b0-efc4ef604fc8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:57.713696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c28b79d9-dea6-4577-b2b0-efc4ef604fc8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:57.715424 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c28b79d9-dea6-4577-b2b0-efc4ef604fc8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.256179 Aug 02 07:13:57.734136 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2681/5288] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:57 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:57.828989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-77564642-02dd-4459-9c1b-a012b10d1bef req-753993a2-b501-4850-b59c-230d31b3b1af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b724a4-b410-4a25-b75e-40f78d9c3537", "name": "network-vif-plugged", "status": "completed", "tag": "22289b0f-98a7-4313-b0cd-e51d916a1047"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:13:57.853420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-77564642-02dd-4459-9c1b-a012b10d1bef req-753993a2-b501-4850-b59c-230d31b3b1af service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:57.854465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-77564642-02dd-4459-9c1b-a012b10d1bef req-753993a2-b501-4850-b59c-230d31b3b1af service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:57.882306 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-77564642-02dd-4459-9c1b-a012b10d1bef req-753993a2-b501-4850-b59c-230d31b3b1af service nova] Creating event network-vif-plugged:22289b0f-98a7-4313-b0cd-e51d916a1047 for instance c1b724a4-b410-4a25-b75e-40f78d9c3537 on n-h1-851337-3 Aug 02 07:13:57.893753 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-77564642-02dd-4459-9c1b-a012b10d1bef req-753993a2-b501-4850-b59c-230d31b3b1af service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070431 Aug 02 07:13:57.895644 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2608/5289] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:13:57.911964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ca7ba4c8-7158-4827-8a5e-0fb6c042db4d tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:57.919040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ca7ba4c8-7158-4827-8a5e-0fb6c042db4d tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:57.939287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca7ba4c8-7158-4827-8a5e-0fb6c042db4d tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:57.941729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca7ba4c8-7158-4827-8a5e-0fb6c042db4d tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:57.943193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca7ba4c8-7158-4827-8a5e-0fb6c042db4d tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:57.943921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca7ba4c8-7158-4827-8a5e-0fb6c042db4d tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:58.007404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-af5dbab5-758f-46ff-9bbe-e55fbbf1be80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:58.009666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-af5dbab5-758f-46ff-9bbe-e55fbbf1be80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:58.022550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af5dbab5-758f-46ff-9bbe-e55fbbf1be80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:58.023931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af5dbab5-758f-46ff-9bbe-e55fbbf1be80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:58.029008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af5dbab5-758f-46ff-9bbe-e55fbbf1be80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:58.030668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-af5dbab5-758f-46ff-9bbe-e55fbbf1be80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:58.277179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ca7ba4c8-7158-4827-8a5e-0fb6c042db4d tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:58.300384 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ca7ba4c8-7158-4827-8a5e-0fb6c042db4d tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1314 microversion: 2.1 time: 0.395699 Aug 02 07:13:58.311273 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2682/5290] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:57 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:13:58.337957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-af5dbab5-758f-46ff-9bbe-e55fbbf1be80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:58.347777 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-af5dbab5-758f-46ff-9bbe-e55fbbf1be80 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1665 microversion: 2.1 time: 0.347252 Aug 02 07:13:58.348734 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2609/5291] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:57 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1665 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:13:58.745366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2bd6f1bc-c808-427d-8422-6b47f7f8a1bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:58.746567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2bd6f1bc-c808-427d-8422-6b47f7f8a1bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:58.755038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bd6f1bc-c808-427d-8422-6b47f7f8a1bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:58.756207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bd6f1bc-c808-427d-8422-6b47f7f8a1bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:58.759866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bd6f1bc-c808-427d-8422-6b47f7f8a1bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:58.760581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bd6f1bc-c808-427d-8422-6b47f7f8a1bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:59.162782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2bd6f1bc-c808-427d-8422-6b47f7f8a1bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:59.172892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2bd6f1bc-c808-427d-8422-6b47f7f8a1bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:59.177979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2bd6f1bc-c808-427d-8422-6b47f7f8a1bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:13:59.181303 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2bd6f1bc-c808-427d-8422-6b47f7f8a1bb tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.445040 Aug 02 07:13:59.186541 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2683/5292] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:13:58 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:13:59.326987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f53d12b-8e79-4629-af60-a44219d727d4 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:59.328126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3f53d12b-8e79-4629-af60-a44219d727d4 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:59.340599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f53d12b-8e79-4629-af60-a44219d727d4 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:59.341187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f53d12b-8e79-4629-af60-a44219d727d4 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:59.342636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f53d12b-8e79-4629-af60-a44219d727d4 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:59.344770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f53d12b-8e79-4629-af60-a44219d727d4 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:59.369170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b5ff16b2-24c6-4391-bc21-5878068674a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:13:59.370044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b5ff16b2-24c6-4391-bc21-5878068674a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:13:59.382205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5ff16b2-24c6-4391-bc21-5878068674a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:59.382933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5ff16b2-24c6-4391-bc21-5878068674a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:13:59.388487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5ff16b2-24c6-4391-bc21-5878068674a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:13:59.391607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5ff16b2-24c6-4391-bc21-5878068674a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:00.332544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b5ff16b2-24c6-4391-bc21-5878068674a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:00.341785 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b5ff16b2-24c6-4391-bc21-5878068674a2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1665 microversion: 2.1 time: 0.976771 Aug 02 07:14:00.343886 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2684/5293] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:59 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1665 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:00.351947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3f53d12b-8e79-4629-af60-a44219d727d4 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:00.360052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8ac80168-f669-40a0-a5a4-9a8ea1ff53a8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:00.361033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8ac80168-f669-40a0-a5a4-9a8ea1ff53a8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:00.363090 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3f53d12b-8e79-4629-af60-a44219d727d4 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1314 microversion: 2.1 time: 1.040649 Aug 02 07:14:00.374483 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2610/5294] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:13:59 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1314 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:00.388045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ac80168-f669-40a0-a5a4-9a8ea1ff53a8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:00.389292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ac80168-f669-40a0-a5a4-9a8ea1ff53a8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:00.395962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ac80168-f669-40a0-a5a4-9a8ea1ff53a8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:00.405872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ac80168-f669-40a0-a5a4-9a8ea1ff53a8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:00.563141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b8dba783-b106-4ca5-b374-c7ab2cf750b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:00.565997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b8dba783-b106-4ca5-b374-c7ab2cf750b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:00.581449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8dba783-b106-4ca5-b374-c7ab2cf750b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:00.589793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8dba783-b106-4ca5-b374-c7ab2cf750b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:00.590911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8dba783-b106-4ca5-b374-c7ab2cf750b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:00.591373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8dba783-b106-4ca5-b374-c7ab2cf750b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:00.762181 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b8dba783-b106-4ca5-b374-c7ab2cf750b7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536/action" status: 200 len: 24566 microversion: 2.1 time: 0.202839 Aug 02 07:14:00.763254 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2611/5295] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:14:00 2022] POST /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536/action => generated 24566 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:14:01.313079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8ac80168-f669-40a0-a5a4-9a8ea1ff53a8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:01.324465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8ac80168-f669-40a0-a5a4-9a8ea1ff53a8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:01.327289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8ac80168-f669-40a0-a5a4-9a8ea1ff53a8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:01.330265 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8ac80168-f669-40a0-a5a4-9a8ea1ff53a8 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.983722 Aug 02 07:14:01.331072 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2685/5296] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:14:00 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:14:01.366784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-205920ff-add5-410c-b57b-5de615f6a2b0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:01.367877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-205920ff-add5-410c-b57b-5de615f6a2b0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:01.383402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-205920ff-add5-410c-b57b-5de615f6a2b0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:01.384265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-205920ff-add5-410c-b57b-5de615f6a2b0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:01.387743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-205920ff-add5-410c-b57b-5de615f6a2b0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:01.388359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-205920ff-add5-410c-b57b-5de615f6a2b0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:01.405912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0aea0d2f-b191-4b53-843c-afe38eee514f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:01.406678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0aea0d2f-b191-4b53-843c-afe38eee514f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:01.417223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0aea0d2f-b191-4b53-843c-afe38eee514f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:01.425478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0aea0d2f-b191-4b53-843c-afe38eee514f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:01.435663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0aea0d2f-b191-4b53-843c-afe38eee514f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:01.437455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0aea0d2f-b191-4b53-843c-afe38eee514f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:01.985823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0aea0d2f-b191-4b53-843c-afe38eee514f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:01.996826 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0aea0d2f-b191-4b53-843c-afe38eee514f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1314 microversion: 2.1 time: 0.594694 Aug 02 07:14:01.998220 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2686/5297] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:01 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:02.357625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-84da402f-623d-4fbe-9604-86ced06e12d9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:02.358347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-84da402f-623d-4fbe-9604-86ced06e12d9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:02.370435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84da402f-623d-4fbe-9604-86ced06e12d9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:02.370899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84da402f-623d-4fbe-9604-86ced06e12d9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:02.371763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84da402f-623d-4fbe-9604-86ced06e12d9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:02.372229 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-84da402f-623d-4fbe-9604-86ced06e12d9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:02.519317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-205920ff-add5-410c-b57b-5de615f6a2b0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:02.529957 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-205920ff-add5-410c-b57b-5de615f6a2b0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1665 microversion: 2.1 time: 1.168901 Aug 02 07:14:02.534029 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2612/5298] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:01 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1665 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:02.739888 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84da402f-623d-4fbe-9604-86ced06e12d9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:02.754831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84da402f-623d-4fbe-9604-86ced06e12d9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:02.756339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84da402f-623d-4fbe-9604-86ced06e12d9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:02.757559 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-84da402f-623d-4fbe-9604-86ced06e12d9 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.405652 Aug 02 07:14:02.758509 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2687/5299] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:14:02 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:14:03.019608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-77f5d567-01cf-42a1-9acd-e59d8e5fe7fc tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:03.021552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-77f5d567-01cf-42a1-9acd-e59d8e5fe7fc tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:03.030277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=70 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:03.032380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77f5d567-01cf-42a1-9acd-e59d8e5fe7fc tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:03.033305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77f5d567-01cf-42a1-9acd-e59d8e5fe7fc tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:03.034192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77f5d567-01cf-42a1-9acd-e59d8e5fe7fc tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:03.034896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-77f5d567-01cf-42a1-9acd-e59d8e5fe7fc tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:03.383326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-77f5d567-01cf-42a1-9acd-e59d8e5fe7fc tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:03.399236 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-77f5d567-01cf-42a1-9acd-e59d8e5fe7fc tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1500 microversion: 2.1 time: 0.384026 Aug 02 07:14:03.399997 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2613/5300] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:03 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1500 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:03.423698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-558a384d-d16e-4b07-91c5-d54a7ba24831 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:03.426394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-558a384d-d16e-4b07-91c5-d54a7ba24831 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:03.442870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-558a384d-d16e-4b07-91c5-d54a7ba24831 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:03.444508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-558a384d-d16e-4b07-91c5-d54a7ba24831 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:03.449789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-558a384d-d16e-4b07-91c5-d54a7ba24831 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:03.450583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-558a384d-d16e-4b07-91c5-d54a7ba24831 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:03.502432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-558a384d-d16e-4b07-91c5-d54a7ba24831 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lazy-loading 'flavor' on Instance uuid c1b724a4-b410-4a25-b75e-40f78d9c3537 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:14:03.557997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f4384237-0f7f-4eb3-974d-77912e99149a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:03.561992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f4384237-0f7f-4eb3-974d-77912e99149a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:03.576518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4384237-0f7f-4eb3-974d-77912e99149a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:03.577656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4384237-0f7f-4eb3-974d-77912e99149a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:03.584680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4384237-0f7f-4eb3-974d-77912e99149a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:03.588747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4384237-0f7f-4eb3-974d-77912e99149a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:03.671018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:03.803971 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-558a384d-d16e-4b07-91c5-d54a7ba24831 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "POST /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537/action" status: 200 len: 32 microversion: 2.1 time: 0.382714 Aug 02 07:14:03.819869 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2688/5301] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:14:03 2022] POST /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537/action => generated 32 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:14:03.846064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-78e92248-9768-47ec-8c5a-afb61432f575 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:03.848922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-78e92248-9768-47ec-8c5a-afb61432f575 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:03.862546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e92248-9768-47ec-8c5a-afb61432f575 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:03.863564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e92248-9768-47ec-8c5a-afb61432f575 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:03.864721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e92248-9768-47ec-8c5a-afb61432f575 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:03.865484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e92248-9768-47ec-8c5a-afb61432f575 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:03.989538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f4384237-0f7f-4eb3-974d-77912e99149a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:03.998330 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f4384237-0f7f-4eb3-974d-77912e99149a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.444216 Aug 02 07:14:04.016924 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2614/5302] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:03 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:04.026054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-343cc88c-217d-4296-9305-e01fac461820 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:04.031314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-343cc88c-217d-4296-9305-e01fac461820 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:04.049767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-343cc88c-217d-4296-9305-e01fac461820 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:04.050603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-343cc88c-217d-4296-9305-e01fac461820 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:04.052836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-343cc88c-217d-4296-9305-e01fac461820 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:04.053732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-343cc88c-217d-4296-9305-e01fac461820 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:04.341624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-78e92248-9768-47ec-8c5a-afb61432f575 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:04.350892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-78e92248-9768-47ec-8c5a-afb61432f575 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:04.367524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-78e92248-9768-47ec-8c5a-afb61432f575 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:04.369223 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-78e92248-9768-47ec-8c5a-afb61432f575 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.547487 Aug 02 07:14:04.370587 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2689/5303] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:14:03 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:14:04.381517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-90708dc8-ebd0-4f64-b780-4be68b7a3793 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:04.382390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-90708dc8-ebd0-4f64-b780-4be68b7a3793 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:04.411173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90708dc8-ebd0-4f64-b780-4be68b7a3793 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:04.414212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90708dc8-ebd0-4f64-b780-4be68b7a3793 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:04.415819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90708dc8-ebd0-4f64-b780-4be68b7a3793 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:04.416450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90708dc8-ebd0-4f64-b780-4be68b7a3793 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:04.569835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-343cc88c-217d-4296-9305-e01fac461820 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:04.583070 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-343cc88c-217d-4296-9305-e01fac461820 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.564539 Aug 02 07:14:04.585813 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2615/5304] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:04 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:04.886013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-90708dc8-ebd0-4f64-b780-4be68b7a3793 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:04.900115 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-90708dc8-ebd0-4f64-b780-4be68b7a3793 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.526110 Aug 02 07:14:04.900844 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2690/5305] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:04 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:04.944487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-698c6e5d-13b9-43e4-abd0-9ab1898fe9d1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:04.946083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-698c6e5d-13b9-43e4-abd0-9ab1898fe9d1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:04.956525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-698c6e5d-13b9-43e4-abd0-9ab1898fe9d1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:04.961258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-698c6e5d-13b9-43e4-abd0-9ab1898fe9d1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:04.962907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-698c6e5d-13b9-43e4-abd0-9ab1898fe9d1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:04.963683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-698c6e5d-13b9-43e4-abd0-9ab1898fe9d1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:05.397087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a36292d3-9768-474a-b0a5-f214d8d95cc0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:05.398179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a36292d3-9768-474a-b0a5-f214d8d95cc0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:05.405218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a36292d3-9768-474a-b0a5-f214d8d95cc0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:05.406082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a36292d3-9768-474a-b0a5-f214d8d95cc0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:05.407191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a36292d3-9768-474a-b0a5-f214d8d95cc0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:05.407961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a36292d3-9768-474a-b0a5-f214d8d95cc0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:05.880260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-698c6e5d-13b9-43e4-abd0-9ab1898fe9d1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:05.905408 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-698c6e5d-13b9-43e4-abd0-9ab1898fe9d1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.960626 Aug 02 07:14:05.908171 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2616/5306] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:04 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:05.919603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4a9fc4ee-3c8e-45ac-ac1d-b740e6b51715 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:05.922817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4a9fc4ee-3c8e-45ac-ac1d-b740e6b51715 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:05.942979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a36292d3-9768-474a-b0a5-f214d8d95cc0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:05.950113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a9fc4ee-3c8e-45ac-ac1d-b740e6b51715 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:05.950873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a9fc4ee-3c8e-45ac-ac1d-b740e6b51715 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:05.952013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a9fc4ee-3c8e-45ac-ac1d-b740e6b51715 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:05.952655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a9fc4ee-3c8e-45ac-ac1d-b740e6b51715 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:05.960038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a36292d3-9768-474a-b0a5-f214d8d95cc0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:05.964380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a36292d3-9768-474a-b0a5-f214d8d95cc0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:05.973195 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a36292d3-9768-474a-b0a5-f214d8d95cc0 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.576904 Aug 02 07:14:05.975780 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2691/5307] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:14:05 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:14:05.991259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-4549a28b-54cf-45b7-b3df-f8705297294b req-43c565a2-6f4f-43c9-b9cd-21163eb4ec79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8979e165-921d-4e06-92fc-dba834a53b1b", "name": "network-vif-plugged", "status": "completed", "tag": "768fa789-2440-4838-8853-20f834aabcea"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:06.046538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4549a28b-54cf-45b7-b3df-f8705297294b req-43c565a2-6f4f-43c9-b9cd-21163eb4ec79 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:06.047848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4549a28b-54cf-45b7-b3df-f8705297294b req-43c565a2-6f4f-43c9-b9cd-21163eb4ec79 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:06.091638 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-4549a28b-54cf-45b7-b3df-f8705297294b req-43c565a2-6f4f-43c9-b9cd-21163eb4ec79 service nova] Creating event network-vif-plugged:768fa789-2440-4838-8853-20f834aabcea for instance 8979e165-921d-4e06-92fc-dba834a53b1b on n-h1-851337-3 Aug 02 07:14:06.110930 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-4549a28b-54cf-45b7-b3df-f8705297294b req-43c565a2-6f4f-43c9-b9cd-21163eb4ec79 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130048 Aug 02 07:14:06.113806 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2692/5308] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:14:06.130971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b546bc9-468f-4936-8ec9-bafdc369a0e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:06.133355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4b546bc9-468f-4936-8ec9-bafdc369a0e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:06.148537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b546bc9-468f-4936-8ec9-bafdc369a0e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:06.151395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b546bc9-468f-4936-8ec9-bafdc369a0e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:06.154169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b546bc9-468f-4936-8ec9-bafdc369a0e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:06.155551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b546bc9-468f-4936-8ec9-bafdc369a0e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:06.545838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4a9fc4ee-3c8e-45ac-ac1d-b740e6b51715 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:06.556671 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4a9fc4ee-3c8e-45ac-ac1d-b740e6b51715 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.645468 Aug 02 07:14:06.557419 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2617/5309] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:05 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:06.749383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4b546bc9-468f-4936-8ec9-bafdc369a0e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:06.763690 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4b546bc9-468f-4936-8ec9-bafdc369a0e3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.646534 Aug 02 07:14:06.764973 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2693/5310] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:06 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:06.789328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dd5f6118-ea67-41d1-ae56-5f953337d16d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:06.789983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dd5f6118-ea67-41d1-ae56-5f953337d16d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:06.809148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd5f6118-ea67-41d1-ae56-5f953337d16d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:06.809610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd5f6118-ea67-41d1-ae56-5f953337d16d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:06.810429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd5f6118-ea67-41d1-ae56-5f953337d16d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:06.810871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dd5f6118-ea67-41d1-ae56-5f953337d16d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:07.002706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-16045c64-64bc-485e-b6e3-0311caaec445 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:07.004079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-16045c64-64bc-485e-b6e3-0311caaec445 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:07.035191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=75 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:07.041527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16045c64-64bc-485e-b6e3-0311caaec445 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:07.045517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16045c64-64bc-485e-b6e3-0311caaec445 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:07.048857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16045c64-64bc-485e-b6e3-0311caaec445 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:07.049834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-16045c64-64bc-485e-b6e3-0311caaec445 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:07.338339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dd5f6118-ea67-41d1-ae56-5f953337d16d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:07.348304 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dd5f6118-ea67-41d1-ae56-5f953337d16d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.563753 Aug 02 07:14:07.348911 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2618/5311] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:06 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:07.372891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1880c44d-179b-4efc-9854-ca9f94b8442b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:07.373821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1880c44d-179b-4efc-9854-ca9f94b8442b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:07.384529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1880c44d-179b-4efc-9854-ca9f94b8442b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:07.391478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1880c44d-179b-4efc-9854-ca9f94b8442b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:07.393261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1880c44d-179b-4efc-9854-ca9f94b8442b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:07.393982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1880c44d-179b-4efc-9854-ca9f94b8442b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:07.450057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-1880c44d-179b-4efc-9854-ca9f94b8442b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lazy-loading 'flavor' on Instance uuid 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:14:07.496721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-16045c64-64bc-485e-b6e3-0311caaec445 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:07.525853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-16045c64-64bc-485e-b6e3-0311caaec445 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:07.530226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-16045c64-64bc-485e-b6e3-0311caaec445 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:07.532970 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-16045c64-64bc-485e-b6e3-0311caaec445 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.536102 Aug 02 07:14:07.535060 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2694/5312] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:14:06 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:14:07.566698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:07.586028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c4b4173d-8779-4009-9134-b5b0dac933a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:07.587374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c4b4173d-8779-4009-9134-b5b0dac933a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:07.603547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4b4173d-8779-4009-9134-b5b0dac933a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:07.605379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4b4173d-8779-4009-9134-b5b0dac933a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:07.607004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4b4173d-8779-4009-9134-b5b0dac933a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:07.607454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4b4173d-8779-4009-9134-b5b0dac933a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:07.631941 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1880c44d-179b-4efc-9854-ca9f94b8442b tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.262746 Aug 02 07:14:07.633533 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2619/5313] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:14:07 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:14:07.652740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fd9ac70c-6fba-49a5-afe3-2f03c9a7b5a3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:07.655858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fd9ac70c-6fba-49a5-afe3-2f03c9a7b5a3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:07.683403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd9ac70c-6fba-49a5-afe3-2f03c9a7b5a3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:07.685491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd9ac70c-6fba-49a5-afe3-2f03c9a7b5a3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:07.689322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd9ac70c-6fba-49a5-afe3-2f03c9a7b5a3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:07.692473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd9ac70c-6fba-49a5-afe3-2f03c9a7b5a3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:08.115583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fd9ac70c-6fba-49a5-afe3-2f03c9a7b5a3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:08.126613 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fd9ac70c-6fba-49a5-afe3-2f03c9a7b5a3 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1677 microversion: 2.1 time: 0.486680 Aug 02 07:14:08.145964 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2620/5314] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:07 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1677 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:08.233293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c4b4173d-8779-4009-9134-b5b0dac933a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:08.246608 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c4b4173d-8779-4009-9134-b5b0dac933a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.670024 Aug 02 07:14:08.249232 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2695/5315] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:07 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:08.566554 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a6c87f87-9984-4a9f-98d9-c06c062a0070 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:08.567182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a6c87f87-9984-4a9f-98d9-c06c062a0070 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:08.579014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6c87f87-9984-4a9f-98d9-c06c062a0070 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:08.586884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6c87f87-9984-4a9f-98d9-c06c062a0070 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:08.588824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6c87f87-9984-4a9f-98d9-c06c062a0070 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:08.592301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6c87f87-9984-4a9f-98d9-c06c062a0070 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:09.125959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a6c87f87-9984-4a9f-98d9-c06c062a0070 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:09.137245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a6c87f87-9984-4a9f-98d9-c06c062a0070 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:09.148092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a6c87f87-9984-4a9f-98d9-c06c062a0070 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:09.154438 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a6c87f87-9984-4a9f-98d9-c06c062a0070 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1727 microversion: 2.20 time: 0.595463 Aug 02 07:14:09.160620 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2621/5316] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:14:08 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1727 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:14:09.164910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6cdf9e2f-07ba-4e5d-b777-66090420685d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:09.165876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6cdf9e2f-07ba-4e5d-b777-66090420685d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:09.192552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6cdf9e2f-07ba-4e5d-b777-66090420685d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:09.193252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6cdf9e2f-07ba-4e5d-b777-66090420685d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:09.196626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6cdf9e2f-07ba-4e5d-b777-66090420685d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:09.199627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6cdf9e2f-07ba-4e5d-b777-66090420685d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:09.273826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3b87ff0a-2af2-43fc-973d-51fd15e0f87f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:09.274504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3b87ff0a-2af2-43fc-973d-51fd15e0f87f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:09.286274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b87ff0a-2af2-43fc-973d-51fd15e0f87f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:09.286766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b87ff0a-2af2-43fc-973d-51fd15e0f87f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:09.298060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b87ff0a-2af2-43fc-973d-51fd15e0f87f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:09.302836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b87ff0a-2af2-43fc-973d-51fd15e0f87f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:10.144021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6cdf9e2f-07ba-4e5d-b777-66090420685d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:10.162290 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6cdf9e2f-07ba-4e5d-b777-66090420685d tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1660 microversion: 2.1 time: 1.007982 Aug 02 07:14:10.162898 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2696/5317] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:09 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1660 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:10.191782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cfe59df5-0e84-4c1e-9c20-67dd8a1c3a1e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:10.192678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cfe59df5-0e84-4c1e-9c20-67dd8a1c3a1e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:10.200615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfe59df5-0e84-4c1e-9c20-67dd8a1c3a1e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:10.201395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfe59df5-0e84-4c1e-9c20-67dd8a1c3a1e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:10.202451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfe59df5-0e84-4c1e-9c20-67dd8a1c3a1e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:10.203359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cfe59df5-0e84-4c1e-9c20-67dd8a1c3a1e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:10.277003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3b87ff0a-2af2-43fc-973d-51fd15e0f87f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:10.288702 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3b87ff0a-2af2-43fc-973d-51fd15e0f87f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 1.019643 Aug 02 07:14:10.291355 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2622/5318] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:09 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:10.302173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bfdc3fe7-ab37-43af-ae7d-ab5fecd710dc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:10.319553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bfdc3fe7-ab37-43af-ae7d-ab5fecd710dc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:10.344871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfdc3fe7-ab37-43af-ae7d-ab5fecd710dc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:10.348864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfdc3fe7-ab37-43af-ae7d-ab5fecd710dc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:10.351551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfdc3fe7-ab37-43af-ae7d-ab5fecd710dc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:10.355443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfdc3fe7-ab37-43af-ae7d-ab5fecd710dc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:10.396546 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cfe59df5-0e84-4c1e-9c20-67dd8a1c3a1e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.211762 Aug 02 07:14:10.404448 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2697/5319] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:14:10 2022] POST /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:14:10.420460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-998481fd-0edd-4982-bfbd-9912cb1026e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:10.424350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-998481fd-0edd-4982-bfbd-9912cb1026e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:10.439642 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-998481fd-0edd-4982-bfbd-9912cb1026e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:10.441795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-998481fd-0edd-4982-bfbd-9912cb1026e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:10.444102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-998481fd-0edd-4982-bfbd-9912cb1026e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:10.446191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-998481fd-0edd-4982-bfbd-9912cb1026e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:11.208666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bfdc3fe7-ab37-43af-ae7d-ab5fecd710dc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:11.238870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bfdc3fe7-ab37-43af-ae7d-ab5fecd710dc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:11.253580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bfdc3fe7-ab37-43af-ae7d-ab5fecd710dc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:11.265253 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bfdc3fe7-ab37-43af-ae7d-ab5fecd710dc tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1714 microversion: 2.20 time: 0.972624 Aug 02 07:14:11.277981 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2623/5320] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:14:10 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1714 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:14:11.316218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c6df65d9-9ce8-47b4-a872-63f3d8e3be63 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:11.316951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c6df65d9-9ce8-47b4-a872-63f3d8e3be63 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:11.325467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6df65d9-9ce8-47b4-a872-63f3d8e3be63 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:11.331168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6df65d9-9ce8-47b4-a872-63f3d8e3be63 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:11.334961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6df65d9-9ce8-47b4-a872-63f3d8e3be63 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:11.338779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6df65d9-9ce8-47b4-a872-63f3d8e3be63 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:11.658472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-998481fd-0edd-4982-bfbd-9912cb1026e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:11.673623 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-998481fd-0edd-4982-bfbd-9912cb1026e2 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1666 microversion: 2.1 time: 1.263463 Aug 02 07:14:11.683644 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2698/5321] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:10 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1666 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:11.763365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-87796db3-c104-4fd3-8eb7-26bf37f8320b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:11.764427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-87796db3-c104-4fd3-8eb7-26bf37f8320b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:11.788090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87796db3-c104-4fd3-8eb7-26bf37f8320b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:11.788943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87796db3-c104-4fd3-8eb7-26bf37f8320b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:11.790016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87796db3-c104-4fd3-8eb7-26bf37f8320b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:11.790696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87796db3-c104-4fd3-8eb7-26bf37f8320b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:12.184664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c6df65d9-9ce8-47b4-a872-63f3d8e3be63 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:12.194993 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c6df65d9-9ce8-47b4-a872-63f3d8e3be63 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.882818 Aug 02 07:14:12.195601 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2624/5322] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:11 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:12.708207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1107498258", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "c4995307-68f0-4358-8040-04277e8914f6"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:12.804160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-87796db3-c104-4fd3-8eb7-26bf37f8320b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:12.808747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] validate_networks() for [('c4995307-68f0-4358-8040-04277e8914f6', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:14:12.822781 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-87796db3-c104-4fd3-8eb7-26bf37f8320b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1681 microversion: 2.1 time: 1.066825 Aug 02 07:14:12.823374 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2699/5323] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:11 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1681 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:12.838967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-89506ddd-752b-44b0-b08d-0314422e4f04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:12.839792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-89506ddd-752b-44b0-b08d-0314422e4f04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:12.847368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89506ddd-752b-44b0-b08d-0314422e4f04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:12.850690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89506ddd-752b-44b0-b08d-0314422e4f04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:12.857237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89506ddd-752b-44b0-b08d-0314422e4f04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:12.857986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-89506ddd-752b-44b0-b08d-0314422e4f04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:14.223211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-89506ddd-752b-44b0-b08d-0314422e4f04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:14.245710 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-89506ddd-752b-44b0-b08d-0314422e4f04 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1666 microversion: 2.1 time: 1.421006 Aug 02 07:14:14.247767 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2700/5324] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:12 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1666 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:14.257921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9f723a0d-7e6f-4fa2-b8e9-82fa0ea76f80 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:14.258907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9f723a0d-7e6f-4fa2-b8e9-82fa0ea76f80 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:14.282799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f723a0d-7e6f-4fa2-b8e9-82fa0ea76f80 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:14.300078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f723a0d-7e6f-4fa2-b8e9-82fa0ea76f80 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:14.303849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f723a0d-7e6f-4fa2-b8e9-82fa0ea76f80 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:14.305971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f723a0d-7e6f-4fa2-b8e9-82fa0ea76f80 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:14.825433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9f723a0d-7e6f-4fa2-b8e9-82fa0ea76f80 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:14.839552 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9f723a0d-7e6f-4fa2-b8e9-82fa0ea76f80 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.590382 Aug 02 07:14:14.867915 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2701/5325] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:14 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:14.873333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4fa8aa90-69cd-4b1c-8c0c-626c214141de tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:14.877768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4fa8aa90-69cd-4b1c-8c0c-626c214141de tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:14.892090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fa8aa90-69cd-4b1c-8c0c-626c214141de tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:14.893098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fa8aa90-69cd-4b1c-8c0c-626c214141de tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:14.896688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fa8aa90-69cd-4b1c-8c0c-626c214141de tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:14.897275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fa8aa90-69cd-4b1c-8c0c-626c214141de tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:14.991320 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4fa8aa90-69cd-4b1c-8c0c-626c214141de tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536/action" status: 200 len: 32639 microversion: 2.1 time: 0.122361 Aug 02 07:14:15.001660 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2702/5326] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:14:14 2022] POST /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536/action => generated 32639 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:14:15.138664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-399cfe73-e7fe-4a46-a20b-d5bf6552a59c tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:15.139683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-399cfe73-e7fe-4a46-a20b-d5bf6552a59c tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:15.154064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-399cfe73-e7fe-4a46-a20b-d5bf6552a59c tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:15.156078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-399cfe73-e7fe-4a46-a20b-d5bf6552a59c tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:15.157660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-399cfe73-e7fe-4a46-a20b-d5bf6552a59c tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:15.158438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-399cfe73-e7fe-4a46-a20b-d5bf6552a59c tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:15.544293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:14:15.544818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:14:15.545188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:14:15.545736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:14:15.546177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:14:15.585332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:15.586406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:15.592763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:15.593217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:15.681460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Getting quotas for project c940de04b236429ba65bc34a644376d7. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:14:15.697468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Getting quotas for user 085809c8790f430d9cd61ece8c14f7d1 and project c940de04b236429ba65bc34a644376d7. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:14:15.751032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:14:15.757675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:14:15.926681 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d4028d72-f71c-4302-9031-b306f5670ee2 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.484694 Aug 02 07:14:15.927656 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2625/5327] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:14:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 07:14:15.955229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ff448f6f-d588-4b66-8736-b31ed73065f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:15.961146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ff448f6f-d588-4b66-8736-b31ed73065f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:15.972564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff448f6f-d588-4b66-8736-b31ed73065f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:15.973011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff448f6f-d588-4b66-8736-b31ed73065f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:15.973786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff448f6f-d588-4b66-8736-b31ed73065f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:15.975201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff448f6f-d588-4b66-8736-b31ed73065f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:16.361668 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-399cfe73-e7fe-4a46-a20b-d5bf6552a59c tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1832 microversion: 2.1 time: 1.229054 Aug 02 07:14:16.375348 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2703/5328] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:15 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1832 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:16.393391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f7a27291-3a87-479e-ab74-bfbe7ead9d28 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:16.410703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f7a27291-3a87-479e-ab74-bfbe7ead9d28 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:16.441849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7a27291-3a87-479e-ab74-bfbe7ead9d28 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:16.442764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7a27291-3a87-479e-ab74-bfbe7ead9d28 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:16.443877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7a27291-3a87-479e-ab74-bfbe7ead9d28 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:16.450417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7a27291-3a87-479e-ab74-bfbe7ead9d28 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:16.476554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:16.679528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ff448f6f-d588-4b66-8736-b31ed73065f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:16.693614 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ff448f6f-d588-4b66-8736-b31ed73065f4 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.761926 Aug 02 07:14:16.709921 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2626/5329] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:15 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:16.715310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-57fa0430-7bfb-48e0-8d90-31cb1ac8b605 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:16.715432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-57fa0430-7bfb-48e0-8d90-31cb1ac8b605 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:16.952998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f7a27291-3a87-479e-ab74-bfbe7ead9d28 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:16.966323 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f7a27291-3a87-479e-ab74-bfbe7ead9d28 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.587918 Aug 02 07:14:16.967966 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2704/5330] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:16 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:16.987399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7a61db6c-133b-44b7-adbf-1811e8bd4d4b tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:16.990934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7a61db6c-133b-44b7-adbf-1811e8bd4d4b tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:17.012696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a61db6c-133b-44b7-adbf-1811e8bd4d4b tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:17.014727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a61db6c-133b-44b7-adbf-1811e8bd4d4b tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:17.018648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a61db6c-133b-44b7-adbf-1811e8bd4d4b tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:17.019375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a61db6c-133b-44b7-adbf-1811e8bd4d4b tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:17.068268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-7a61db6c-133b-44b7-adbf-1811e8bd4d4b tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lazy-loading 'flavor' on Instance uuid 03b35b7f-de5b-4d19-bd55-55d7b06b3536 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:14:17.087058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7a61db6c-133b-44b7-adbf-1811e8bd4d4b tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Going to try to live migrate instance to another host {{(pid=126120) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 02 07:14:17.302983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-57fa0430-7bfb-48e0-8d90-31cb1ac8b605 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:17.314495 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-57fa0430-7bfb-48e0-8d90-31cb1ac8b605 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1225 microversion: 2.1 time: 0.615300 Aug 02 07:14:17.326937 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2627/5331] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:16 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1225 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:17.336419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-311ae59c-0e12-4ed3-99d5-c14450e127e1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:17.337048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-311ae59c-0e12-4ed3-99d5-c14450e127e1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:17.355154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-311ae59c-0e12-4ed3-99d5-c14450e127e1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:17.355455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-311ae59c-0e12-4ed3-99d5-c14450e127e1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:17.356238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-311ae59c-0e12-4ed3-99d5-c14450e127e1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:17.368161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-311ae59c-0e12-4ed3-99d5-c14450e127e1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:18.313304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-311ae59c-0e12-4ed3-99d5-c14450e127e1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:18.322943 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-311ae59c-0e12-4ed3-99d5-c14450e127e1 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1669 microversion: 2.1 time: 0.994475 Aug 02 07:14:18.326119 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2628/5332] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:17 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1669 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:18.342545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d00293f4-f835-4693-81bd-87fcf81052ff tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:18.346490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d00293f4-f835-4693-81bd-87fcf81052ff tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:18.365704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d00293f4-f835-4693-81bd-87fcf81052ff tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:18.366466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d00293f4-f835-4693-81bd-87fcf81052ff tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:18.367712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d00293f4-f835-4693-81bd-87fcf81052ff tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:18.378618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d00293f4-f835-4693-81bd-87fcf81052ff tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:18.861637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d00293f4-f835-4693-81bd-87fcf81052ff tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:18.870415 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d00293f4-f835-4693-81bd-87fcf81052ff tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.538902 Aug 02 07:14:18.875607 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2629/5333] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:18 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:18.900516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-14e27a85-0e02-4fec-b258-aeb13522d25d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:18.901345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-14e27a85-0e02-4fec-b258-aeb13522d25d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:18.918123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14e27a85-0e02-4fec-b258-aeb13522d25d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:18.923074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14e27a85-0e02-4fec-b258-aeb13522d25d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:18.926643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14e27a85-0e02-4fec-b258-aeb13522d25d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:18.927211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14e27a85-0e02-4fec-b258-aeb13522d25d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:19.083311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-14e27a85-0e02-4fec-b258-aeb13522d25d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:19.092613 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-14e27a85-0e02-4fec-b258-aeb13522d25d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1283 microversion: 2.1 time: 0.211591 Aug 02 07:14:19.093521 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2630/5334] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:18 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1283 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:19.100972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:19.101739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:19.109193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:19.110208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:19.111389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:19.113844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:19.192960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:14:19.210363 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.compute.api [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Working on deleting snapshot 11716323-71c7-4176-82b7-c25121bbc6e6 from shelved instance... Aug 02 07:14:21.078654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Doing local delete in cell c3b7f982-e927-4a3f-b699-817c726d55c4(cell1) {{(pid=126119) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 02 07:14:21.082143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:21.082828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:21.083699 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.compute.api [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 02 07:14:21.088403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] deallocate_for_instance() {{(pid=126119) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 02 07:14:22.119375 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7a61db6c-133b-44b7-adbf-1811e8bd4d4b tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536/action" status: 202 len: 0 microversion: 2.1 time: 5.149531 Aug 02 07:14:22.124324 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2705/5335] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:14:16 2022] POST /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536/action => generated 0 bytes in 5151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:14:22.129879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b2833036-7cd3-4ce6-8fcb-359219b90d8e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:22.133793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b2833036-7cd3-4ce6-8fcb-359219b90d8e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:22.164276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2833036-7cd3-4ce6-8fcb-359219b90d8e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:22.164730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2833036-7cd3-4ce6-8fcb-359219b90d8e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:22.165547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2833036-7cd3-4ce6-8fcb-359219b90d8e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:22.180140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2833036-7cd3-4ce6-8fcb-359219b90d8e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:22.971543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b2833036-7cd3-4ce6-8fcb-359219b90d8e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:23.009222 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b2833036-7cd3-4ce6-8fcb-359219b90d8e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.888032 Aug 02 07:14:23.010300 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2706/5336] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:22 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:23.022489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dc4068b7-a10d-4891-ae48-9b293d4ee310 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:23.023563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dc4068b7-a10d-4891-ae48-9b293d4ee310 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:23.036391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc4068b7-a10d-4891-ae48-9b293d4ee310 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:23.037685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc4068b7-a10d-4891-ae48-9b293d4ee310 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:23.038699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc4068b7-a10d-4891-ae48-9b293d4ee310 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:23.039618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc4068b7-a10d-4891-ae48-9b293d4ee310 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:23.613788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Updating instance_info_cache with network_info: [] {{(pid=126119) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 02 07:14:23.660942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dc4068b7-a10d-4891-ae48-9b293d4ee310 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:23.696691 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dc4068b7-a10d-4891-ae48-9b293d4ee310 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1325 microversion: 2.1 time: 0.683978 Aug 02 07:14:23.697716 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2707/5337] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:23 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1325 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:23.704183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ad92d1c9-8959-4012-9f3d-93f49fff45e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:23.705236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ad92d1c9-8959-4012-9f3d-93f49fff45e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:23.715074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad92d1c9-8959-4012-9f3d-93f49fff45e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:23.716503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad92d1c9-8959-4012-9f3d-93f49fff45e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:23.717532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad92d1c9-8959-4012-9f3d-93f49fff45e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:23.718290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ad92d1c9-8959-4012-9f3d-93f49fff45e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:24.375401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:24.394268 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4f399e4d-b2e7-48a6-b7a7-a54aa28c182e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 204 len: 0 microversion: 2.1 time: 5.299410 Aug 02 07:14:24.395080 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2631/5338] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:14:19 2022] DELETE /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 0 bytes in 5301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:14:24.422440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-fd937c58-3585-4601-b4b1-35e42ef07bd7 req-0daa99fb-1960-45dd-a666-26201a6b663b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92e5496-b560-4d91-a830-240c09f47a31", "tag": "996fadbc-7996-43e5-850b-a4b7e716046f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:24.428067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ad92d1c9-8959-4012-9f3d-93f49fff45e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:24.452215 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ad92d1c9-8959-4012-9f3d-93f49fff45e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.752021 Aug 02 07:14:24.453109 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2708/5339] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:23 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:24.474370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fd937c58-3585-4601-b4b1-35e42ef07bd7 req-0daa99fb-1960-45dd-a666-26201a6b663b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:24.481613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fd937c58-3585-4601-b4b1-35e42ef07bd7 req-0daa99fb-1960-45dd-a666-26201a6b663b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:24.482892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e1468bb0-3629-42f9-ba54-9396a4d93bfb req-fca54307-be1e-4c7b-aa68-19523557668f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1a6b1e-adf6-45b2-8b9e-387276fde90c", "name": "network-vif-deleted", "tag": "233d855a-4615-492c-b3f0-c628240ca34b"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:24.504735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e1468bb0-3629-42f9-ba54-9396a4d93bfb req-fca54307-be1e-4c7b-aa68-19523557668f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:24.506342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e1468bb0-3629-42f9-ba54-9396a4d93bfb req-fca54307-be1e-4c7b-aa68-19523557668f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:24.521976 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-fd937c58-3585-4601-b4b1-35e42ef07bd7 req-0daa99fb-1960-45dd-a666-26201a6b663b service nova] Creating event network-changed:996fadbc-7996-43e5-850b-a4b7e716046f for instance a92e5496-b560-4d91-a830-240c09f47a31 on n-h1-851337-3 Aug 02 07:14:24.541883 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-fd937c58-3585-4601-b4b1-35e42ef07bd7 req-0daa99fb-1960-45dd-a666-26201a6b663b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144614 Aug 02 07:14:24.543936 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2632/5340] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:14:24.551871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.compute.server_external_events [req-e1468bb0-3629-42f9-ba54-9396a4d93bfb req-fca54307-be1e-4c7b-aa68-19523557668f service nova] Unable to find a host for instance 9e1a6b1e-adf6-45b2-8b9e-387276fde90c. Dropping event network-vif-deleted {{(pid=126120) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 02 07:14:24.552795 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e1468bb0-3629-42f9-ba54-9396a4d93bfb req-fca54307-be1e-4c7b-aa68-19523557668f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.090009 Aug 02 07:14:24.553041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-22c62f71-5b31-423c-886f-e7d3c1269ae2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:24.554421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-22c62f71-5b31-423c-886f-e7d3c1269ae2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:24.563219 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2709/5341] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 101 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 02 07:14:24.566558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22c62f71-5b31-423c-886f-e7d3c1269ae2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:24.567658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22c62f71-5b31-423c-886f-e7d3c1269ae2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:24.568805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22c62f71-5b31-423c-886f-e7d3c1269ae2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:24.570444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22c62f71-5b31-423c-886f-e7d3c1269ae2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:24.571213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-57fe0242-21d0-4d86-9ef2-569ef0f5b042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:24.573053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-57fe0242-21d0-4d86-9ef2-569ef0f5b042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 9e1a6b1e-adf6-45b2-8b9e-387276fde90c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:24.597475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57fe0242-21d0-4d86-9ef2-569ef0f5b042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:24.598551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57fe0242-21d0-4d86-9ef2-569ef0f5b042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:24.599519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57fe0242-21d0-4d86-9ef2-569ef0f5b042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:24.599972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57fe0242-21d0-4d86-9ef2-569ef0f5b042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:24.635366 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-57fe0242-21d0-4d86-9ef2-569ef0f5b042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] HTTP exception thrown: Instance 9e1a6b1e-adf6-45b2-8b9e-387276fde90c could not be found. Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-57fe0242-21d0-4d86-9ef2-569ef0f5b042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Request method failure captured: Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c HTTP/1.1 Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mw7zphSbQMyV1VXzUHwZd5rIpAe-J0qyHXkZOXqSTF1d6X6i4GdQd6SAUR575sU6Hm3N4AxhP_yLKO8F3_7Y95D5F9Xzk9hsnx3CQybTj1H2lx-bESaz2CLvMeK80wW4lAMQ_yzam-Q_YptKuaWSXkoL0Pz6P3TXT8PIXRbAKIUaKg Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: daaad725b62041d1ac0af9ff8efcdfc5 Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/daaad725b62041d1ac0af9ff8efcdfc5"}]}] Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: daaad725b62041d1ac0af9ff8efcdfc5 Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerActionsTestJSON-1022755064-project Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 35f9bc6690f3473a99804c14351b93b6 Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerActionsTestJSON-1022755064-project Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 9e1a6b1e-adf6-45b2-8b9e-387276fde90c could not be found. Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '9e1a6b1e-adf6-45b2-8b9e-387276fde90c'} Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e1a6b1e-adf6-45b2-8b9e-387276fde90c could not be found. Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e1a6b1e-adf6-45b2-8b9e-387276fde90c could not be found. Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:24.637162 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:24.645156 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:24.645156 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:24.645156 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:24.645156 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:14:24.645156 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:14:24.645156 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e1a6b1e-adf6-45b2-8b9e-387276fde90c could not be found. Aug 02 07:14:24.645156 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:24.645156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-57fe0242-21d0-4d86-9ef2-569ef0f5b042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Returning 404 to user: Instance 9e1a6b1e-adf6-45b2-8b9e-387276fde90c could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:14:24.645156 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-57fe0242-21d0-4d86-9ef2-569ef0f5b042 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c" status: 404 len: 111 microversion: 2.1 time: 0.074147 Aug 02 07:14:24.645156 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2710/5342] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:24 2022] GET /compute/v2.1/servers/9e1a6b1e-adf6-45b2-8b9e-387276fde90c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:14:24.647771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0391d406-a982-4635-9559-b7076faf2425 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:24.648264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0391d406-a982-4635-9559-b7076faf2425 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:24.656849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0391d406-a982-4635-9559-b7076faf2425 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:24.657341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0391d406-a982-4635-9559-b7076faf2425 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:24.660486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0391d406-a982-4635-9559-b7076faf2425 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:24.661084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0391d406-a982-4635-9559-b7076faf2425 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:24.705045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0391d406-a982-4635-9559-b7076faf2425 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:14:24.875991 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0391d406-a982-4635-9559-b7076faf2425 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 204 len: 0 microversion: 2.1 time: 0.231363 Aug 02 07:14:24.877867 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2711/5343] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:14:24 2022] DELETE /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 07:14:24.884328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-18e5c532-753b-47f1-b87a-2774069dd910 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:24.885616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-18e5c532-753b-47f1-b87a-2774069dd910 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:24.892761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18e5c532-753b-47f1-b87a-2774069dd910 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:24.893618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18e5c532-753b-47f1-b87a-2774069dd910 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:24.894811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18e5c532-753b-47f1-b87a-2774069dd910 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:24.895488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18e5c532-753b-47f1-b87a-2774069dd910 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:25.068258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-22c62f71-5b31-423c-886f-e7d3c1269ae2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:25.076881 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-22c62f71-5b31-423c-886f-e7d3c1269ae2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.529367 Aug 02 07:14:25.079700 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2633/5344] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:24 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:25.097075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5404f0c5-6346-4de3-a7ef-095afd845ea0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:25.098154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5404f0c5-6346-4de3-a7ef-095afd845ea0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:25.107611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5404f0c5-6346-4de3-a7ef-095afd845ea0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:25.108407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5404f0c5-6346-4de3-a7ef-095afd845ea0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:25.110070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5404f0c5-6346-4de3-a7ef-095afd845ea0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:25.110923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5404f0c5-6346-4de3-a7ef-095afd845ea0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:25.263125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-18e5c532-753b-47f1-b87a-2774069dd910 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:25.277619 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-18e5c532-753b-47f1-b87a-2774069dd910 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1325 microversion: 2.1 time: 0.394023 Aug 02 07:14:25.293357 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2712/5345] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:24 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1325 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:25.308197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5404f0c5-6346-4de3-a7ef-095afd845ea0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:25.316674 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5404f0c5-6346-4de3-a7ef-095afd845ea0 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1465 microversion: 2.1 time: 0.223585 Aug 02 07:14:25.317280 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2634/5346] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:25 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1465 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:25.476150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2969ba27-77f8-446c-a494-21b737f51aa4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:25.477033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2969ba27-77f8-446c-a494-21b737f51aa4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:25.484722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2969ba27-77f8-446c-a494-21b737f51aa4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:25.485567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2969ba27-77f8-446c-a494-21b737f51aa4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:25.486989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2969ba27-77f8-446c-a494-21b737f51aa4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:25.487854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2969ba27-77f8-446c-a494-21b737f51aa4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:25.779372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2969ba27-77f8-446c-a494-21b737f51aa4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:25.792659 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2969ba27-77f8-446c-a494-21b737f51aa4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.321303 Aug 02 07:14:25.793702 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2713/5347] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:25 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:26.099683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-124fee3f-a8bc-4305-b7a1-7be57684bff3 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:26.101297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-124fee3f-a8bc-4305-b7a1-7be57684bff3 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:26.111427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:26.117088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-124fee3f-a8bc-4305-b7a1-7be57684bff3 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:26.117595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-124fee3f-a8bc-4305-b7a1-7be57684bff3 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:26.118722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-124fee3f-a8bc-4305-b7a1-7be57684bff3 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:26.122644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-124fee3f-a8bc-4305-b7a1-7be57684bff3 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:26.302552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6f4628e1-2585-4580-b918-90c69d2f47b6 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:26.303492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6f4628e1-2585-4580-b918-90c69d2f47b6 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:26.315564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f4628e1-2585-4580-b918-90c69d2f47b6 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:26.318591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f4628e1-2585-4580-b918-90c69d2f47b6 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:26.319722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f4628e1-2585-4580-b918-90c69d2f47b6 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:26.322652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f4628e1-2585-4580-b918-90c69d2f47b6 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:26.692986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-124fee3f-a8bc-4305-b7a1-7be57684bff3 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:26.705058 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-124fee3f-a8bc-4305-b7a1-7be57684bff3 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.609173 Aug 02 07:14:26.721720 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2635/5348] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:26 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:26.737751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3bada3df-e32c-44be-a4e8-ef4395fc49aa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:26.739339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3bada3df-e32c-44be-a4e8-ef4395fc49aa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:26.774347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bada3df-e32c-44be-a4e8-ef4395fc49aa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:26.786111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bada3df-e32c-44be-a4e8-ef4395fc49aa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:26.787726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bada3df-e32c-44be-a4e8-ef4395fc49aa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:26.788330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bada3df-e32c-44be-a4e8-ef4395fc49aa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:26.788569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6f4628e1-2585-4580-b918-90c69d2f47b6 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:26.809551 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6f4628e1-2585-4580-b918-90c69d2f47b6 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1325 microversion: 2.1 time: 0.511439 Aug 02 07:14:26.837670 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2714/5349] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:26 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1325 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:26.850164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-997f5b6f-b04f-4013-a4dd-1fb4322d5e50 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:26.853383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-997f5b6f-b04f-4013-a4dd-1fb4322d5e50 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:26.882339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-997f5b6f-b04f-4013-a4dd-1fb4322d5e50 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:26.883549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-997f5b6f-b04f-4013-a4dd-1fb4322d5e50 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:26.885964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-997f5b6f-b04f-4013-a4dd-1fb4322d5e50 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:26.886461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-997f5b6f-b04f-4013-a4dd-1fb4322d5e50 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:27.040301 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:14:27.040582 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 07:14:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 (ip 10.222.0.79) !!! Aug 02 07:14:27.067265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3bada3df-e32c-44be-a4e8-ef4395fc49aa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:27.081651 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3bada3df-e32c-44be-a4e8-ef4395fc49aa tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1465 microversion: 2.1 time: 0.357823 Aug 02 07:14:27.082697 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2636/5350] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:26 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1465 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:27.202974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-997f5b6f-b04f-4013-a4dd-1fb4322d5e50 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:27.218259 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-997f5b6f-b04f-4013-a4dd-1fb4322d5e50 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.377119 Aug 02 07:14:27.235396 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2715/5351] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:26 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:27.749033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e7e25bd5-323c-4a9f-b4aa-5e2a231c8eba tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:27.751339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e7e25bd5-323c-4a9f-b4aa-5e2a231c8eba tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:27.754781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=8 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:27.761357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7e25bd5-323c-4a9f-b4aa-5e2a231c8eba tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:27.761849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7e25bd5-323c-4a9f-b4aa-5e2a231c8eba tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:27.762649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7e25bd5-323c-4a9f-b4aa-5e2a231c8eba tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:27.763363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7e25bd5-323c-4a9f-b4aa-5e2a231c8eba tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:27.845109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1cadb2af-3788-4674-a139-80c125e82ac3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:27.847022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1cadb2af-3788-4674-a139-80c125e82ac3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:27.876540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1cadb2af-3788-4674-a139-80c125e82ac3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:27.877443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1cadb2af-3788-4674-a139-80c125e82ac3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:27.880504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1cadb2af-3788-4674-a139-80c125e82ac3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:27.882445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1cadb2af-3788-4674-a139-80c125e82ac3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:28.042701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e7e25bd5-323c-4a9f-b4aa-5e2a231c8eba tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:28.059275 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e7e25bd5-323c-4a9f-b4aa-5e2a231c8eba tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.313206 Aug 02 07:14:28.062241 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2637/5352] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:27 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:28.111496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dadf3181-c0c7-4801-9205-e2deb22cfe11 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:28.112662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dadf3181-c0c7-4801-9205-e2deb22cfe11 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:28.126496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dadf3181-c0c7-4801-9205-e2deb22cfe11 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:28.128136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dadf3181-c0c7-4801-9205-e2deb22cfe11 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:28.129573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dadf3181-c0c7-4801-9205-e2deb22cfe11 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:28.130986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dadf3181-c0c7-4801-9205-e2deb22cfe11 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:28.185809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1cadb2af-3788-4674-a139-80c125e82ac3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:28.199261 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1cadb2af-3788-4674-a139-80c125e82ac3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1325 microversion: 2.1 time: 0.362516 Aug 02 07:14:28.202691 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2716/5353] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:27 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1325 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:28.255024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9d6976e2-770d-4516-abe4-89ce92ebbc3d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:28.255738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9d6976e2-770d-4516-abe4-89ce92ebbc3d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:28.271773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dadf3181-c0c7-4801-9205-e2deb22cfe11 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:28.274854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d6976e2-770d-4516-abe4-89ce92ebbc3d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:28.275303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d6976e2-770d-4516-abe4-89ce92ebbc3d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:28.276282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d6976e2-770d-4516-abe4-89ce92ebbc3d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:28.276902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d6976e2-770d-4516-abe4-89ce92ebbc3d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:28.288592 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dadf3181-c0c7-4801-9205-e2deb22cfe11 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1465 microversion: 2.1 time: 0.188255 Aug 02 07:14:28.325414 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2638/5354] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:28 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1465 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:28.549733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9d6976e2-770d-4516-abe4-89ce92ebbc3d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:28.561793 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9d6976e2-770d-4516-abe4-89ce92ebbc3d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.315607 Aug 02 07:14:28.564610 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2717/5355] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:28 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:28.757393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c9ebff3b-6c9b-4c89-849f-694324e5e281 req-ca76b327-a05a-4e6e-9c15-69fad96f6c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b35b7f-de5b-4d19-bd55-55d7b06b3536", "name": "network-vif-unplugged", "status": "completed", "tag": "9b7ae46e-d7eb-481e-947a-5b8889d64199"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:28.793830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c9ebff3b-6c9b-4c89-849f-694324e5e281 req-ca76b327-a05a-4e6e-9c15-69fad96f6c90 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:28.795189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c9ebff3b-6c9b-4c89-849f-694324e5e281 req-ca76b327-a05a-4e6e-9c15-69fad96f6c90 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:28.819041 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c9ebff3b-6c9b-4c89-849f-694324e5e281 req-ca76b327-a05a-4e6e-9c15-69fad96f6c90 service nova] Creating event network-vif-unplugged:9b7ae46e-d7eb-481e-947a-5b8889d64199 for instance 03b35b7f-de5b-4d19-bd55-55d7b06b3536 on n-h2-851337-3 Aug 02 07:14:28.829648 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c9ebff3b-6c9b-4c89-849f-694324e5e281 req-ca76b327-a05a-4e6e-9c15-69fad96f6c90 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075332 Aug 02 07:14:28.831766 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2639/5356] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:14:29.085466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-28c08723-90dc-4e92-9a83-460b21a854e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:29.086906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-28c08723-90dc-4e92-9a83-460b21a854e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:29.095472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28c08723-90dc-4e92-9a83-460b21a854e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:29.095908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28c08723-90dc-4e92-9a83-460b21a854e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:29.096877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28c08723-90dc-4e92-9a83-460b21a854e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:29.097487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28c08723-90dc-4e92-9a83-460b21a854e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:29.228887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-885c3dca-a2ae-453e-bf4a-5e688581be7f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:29.230300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-885c3dca-a2ae-453e-bf4a-5e688581be7f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:29.237573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-885c3dca-a2ae-453e-bf4a-5e688581be7f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:29.238131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-885c3dca-a2ae-453e-bf4a-5e688581be7f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:29.238984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-885c3dca-a2ae-453e-bf4a-5e688581be7f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:29.239443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-885c3dca-a2ae-453e-bf4a-5e688581be7f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:29.297505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-28c08723-90dc-4e92-9a83-460b21a854e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:29.306155 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-28c08723-90dc-4e92-9a83-460b21a854e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.224516 Aug 02 07:14:29.321953 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2718/5357] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:29 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:29.321953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a4bc753d-7e5d-4a40-8d50-dac06dc6a562 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:29.321953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a4bc753d-7e5d-4a40-8d50-dac06dc6a562 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:29.343577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4bc753d-7e5d-4a40-8d50-dac06dc6a562 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:29.344117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4bc753d-7e5d-4a40-8d50-dac06dc6a562 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:29.345053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4bc753d-7e5d-4a40-8d50-dac06dc6a562 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:29.345552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a4bc753d-7e5d-4a40-8d50-dac06dc6a562 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:29.350154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:29.512416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a4bc753d-7e5d-4a40-8d50-dac06dc6a562 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:29.525548 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a4bc753d-7e5d-4a40-8d50-dac06dc6a562 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1465 microversion: 2.1 time: 0.211430 Aug 02 07:14:29.528623 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2719/5358] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:29 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1465 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:29.547119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-885c3dca-a2ae-453e-bf4a-5e688581be7f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:29.561957 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-885c3dca-a2ae-453e-bf4a-5e688581be7f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1325 microversion: 2.1 time: 0.339202 Aug 02 07:14:29.562852 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2640/5359] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:29 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1325 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:29.585074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-712652fc-04a8-4b80-9834-6b53703d891f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:29.586073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-712652fc-04a8-4b80-9834-6b53703d891f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:29.594251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-712652fc-04a8-4b80-9834-6b53703d891f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:29.595266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-712652fc-04a8-4b80-9834-6b53703d891f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:29.597037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-712652fc-04a8-4b80-9834-6b53703d891f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:29.597671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-712652fc-04a8-4b80-9834-6b53703d891f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:29.790755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-712652fc-04a8-4b80-9834-6b53703d891f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:29.802415 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-712652fc-04a8-4b80-9834-6b53703d891f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.221265 Aug 02 07:14:29.803280 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2720/5360] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:29 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:30.332941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0d21286b-8c18-4d66-939b-38b6f9bf19c8 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:30.333560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0d21286b-8c18-4d66-939b-38b6f9bf19c8 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:30.340839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d21286b-8c18-4d66-939b-38b6f9bf19c8 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:30.341633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d21286b-8c18-4d66-939b-38b6f9bf19c8 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:30.352641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d21286b-8c18-4d66-939b-38b6f9bf19c8 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:30.353967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d21286b-8c18-4d66-939b-38b6f9bf19c8 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:30.560792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a965815e-8bf2-4b8c-bef8-5f5cf4b02341 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:30.565923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a965815e-8bf2-4b8c-bef8-5f5cf4b02341 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:30.580860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a965815e-8bf2-4b8c-bef8-5f5cf4b02341 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:30.582464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a965815e-8bf2-4b8c-bef8-5f5cf4b02341 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:30.583665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a965815e-8bf2-4b8c-bef8-5f5cf4b02341 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:30.584278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a965815e-8bf2-4b8c-bef8-5f5cf4b02341 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:30.641208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a965815e-8bf2-4b8c-bef8-5f5cf4b02341 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:30.641800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a965815e-8bf2-4b8c-bef8-5f5cf4b02341 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:30.642548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-a965815e-8bf2-4b8c-bef8-5f5cf4b02341 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lazy-loading 'fault' on Instance uuid c2b0eba9-58fc-47d6-a778-2a580f26f2d1 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:14:30.647579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0d21286b-8c18-4d66-939b-38b6f9bf19c8 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:30.656431 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0d21286b-8c18-4d66-939b-38b6f9bf19c8 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.327536 Aug 02 07:14:30.657053 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2641/5361] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:30 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:30.671489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6d90befd-c80c-4c32-9fdc-b0482d16223d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:30.673062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6d90befd-c80c-4c32-9fdc-b0482d16223d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:30.692802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d90befd-c80c-4c32-9fdc-b0482d16223d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:30.693619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d90befd-c80c-4c32-9fdc-b0482d16223d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:30.694663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d90befd-c80c-4c32-9fdc-b0482d16223d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:30.695797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d90befd-c80c-4c32-9fdc-b0482d16223d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:30.703166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a965815e-8bf2-4b8c-bef8-5f5cf4b02341 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:30.712971 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a965815e-8bf2-4b8c-bef8-5f5cf4b02341 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 200 len: 1305 microversion: 2.1 time: 0.167596 Aug 02 07:14:30.714457 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2721/5362] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:30 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 1305 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:30.825055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c06647bd-169c-4d40-800a-982b0293d76e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:30.826457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c06647bd-169c-4d40-800a-982b0293d76e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:30.838904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c06647bd-169c-4d40-800a-982b0293d76e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:30.841806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c06647bd-169c-4d40-800a-982b0293d76e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:30.846412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c06647bd-169c-4d40-800a-982b0293d76e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:30.847316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c06647bd-169c-4d40-800a-982b0293d76e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:30.901482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6d90befd-c80c-4c32-9fdc-b0482d16223d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:30.911171 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6d90befd-c80c-4c32-9fdc-b0482d16223d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1325 microversion: 2.1 time: 0.247545 Aug 02 07:14:30.914478 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2642/5363] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:30 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1325 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:31.612631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a6daadde-4143-4009-b8eb-80643d16707b req-5546f010-156a-4239-aaea-6fb1769425f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b0eba9-58fc-47d6-a778-2a580f26f2d1", "name": "network-vif-deleted", "tag": "483dedf3-572c-4e4a-9350-d84e20e2f8ee"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:31.632779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a6daadde-4143-4009-b8eb-80643d16707b req-5546f010-156a-4239-aaea-6fb1769425f3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:31.633219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a6daadde-4143-4009-b8eb-80643d16707b req-5546f010-156a-4239-aaea-6fb1769425f3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:31.658014 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a6daadde-4143-4009-b8eb-80643d16707b req-5546f010-156a-4239-aaea-6fb1769425f3 service nova] Creating event network-vif-deleted:483dedf3-572c-4e4a-9350-d84e20e2f8ee for instance c2b0eba9-58fc-47d6-a778-2a580f26f2d1 on n-h2-851337-3 Aug 02 07:14:31.664171 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a6daadde-4143-4009-b8eb-80643d16707b req-5546f010-156a-4239-aaea-6fb1769425f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066535 Aug 02 07:14:31.664795 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2643/5364] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:14:31.691462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e3a68019-8a9f-48db-97f1-835202c59c4e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:31.693126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e3a68019-8a9f-48db-97f1-835202c59c4e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:31.699759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c06647bd-169c-4d40-800a-982b0293d76e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:31.716268 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c06647bd-169c-4d40-800a-982b0293d76e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.896021 Aug 02 07:14:31.718243 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2722/5365] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:30 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:31.722139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3a68019-8a9f-48db-97f1-835202c59c4e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:31.722882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3a68019-8a9f-48db-97f1-835202c59c4e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:31.724038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3a68019-8a9f-48db-97f1-835202c59c4e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:31.724696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3a68019-8a9f-48db-97f1-835202c59c4e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:31.743343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b1f23f70-2794-49a3-9590-4b374b37f8f5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:31.744497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b1f23f70-2794-49a3-9590-4b374b37f8f5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: c2b0eba9-58fc-47d6-a778-2a580f26f2d1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:31.760004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1f23f70-2794-49a3-9590-4b374b37f8f5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:31.761002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1f23f70-2794-49a3-9590-4b374b37f8f5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:31.764195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1f23f70-2794-49a3-9590-4b374b37f8f5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:31.765690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1f23f70-2794-49a3-9590-4b374b37f8f5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:31.830333 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-b1f23f70-2794-49a3-9590-4b374b37f8f5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] HTTP exception thrown: Instance c2b0eba9-58fc-47d6-a778-2a580f26f2d1 could not be found. Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b1f23f70-2794-49a3-9590-4b374b37f8f5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Request method failure captured: Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 HTTP/1.1 Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mw7zphSbQMyV1VXzUHwZd5rIpAe-J0qyHXkZOXqSTF1d6X6i4GdQd6SAUR575sU6Hm3N4AxhP_yLKO8F3_7Y95D5F9Xzk9hsnx3CQybTj1H2lx-bESaz2CLvMeK80wW4lAMQ_yzam-Q_YptKuaWSXkoL0Pz6P3TXT8PIXRbAKIUaKg Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: daaad725b62041d1ac0af9ff8efcdfc5 Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/daaad725b62041d1ac0af9ff8efcdfc5"}]}] Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: daaad725b62041d1ac0af9ff8efcdfc5 Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerActionsTestJSON-1022755064-project Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 35f9bc6690f3473a99804c14351b93b6 Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerActionsTestJSON-1022755064-project Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance c2b0eba9-58fc-47d6-a778-2a580f26f2d1 could not be found. Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'c2b0eba9-58fc-47d6-a778-2a580f26f2d1'} Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b0eba9-58fc-47d6-a778-2a580f26f2d1 could not be found. Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b0eba9-58fc-47d6-a778-2a580f26f2d1 could not be found. Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:31.850020 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:31.858700 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:31.858700 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:31.858700 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:31.858700 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:14:31.858700 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:14:31.858700 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b0eba9-58fc-47d6-a778-2a580f26f2d1 could not be found. Aug 02 07:14:31.858700 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:31.858700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b1f23f70-2794-49a3-9590-4b374b37f8f5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Returning 404 to user: Instance c2b0eba9-58fc-47d6-a778-2a580f26f2d1 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:14:31.858700 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b1f23f70-2794-49a3-9590-4b374b37f8f5 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1" status: 404 len: 111 microversion: 2.1 time: 0.115481 Aug 02 07:14:31.858700 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2723/5366] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:31 2022] GET /compute/v2.1/servers/c2b0eba9-58fc-47d6-a778-2a580f26f2d1 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:14:31.885785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5c38a2f6-17a6-4d5c-bef2-f1f53a3ca7fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:31.886433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5c38a2f6-17a6-4d5c-bef2-f1f53a3ca7fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:31.925674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c38a2f6-17a6-4d5c-bef2-f1f53a3ca7fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:31.926430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c38a2f6-17a6-4d5c-bef2-f1f53a3ca7fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:31.934029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c38a2f6-17a6-4d5c-bef2-f1f53a3ca7fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:31.937275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c38a2f6-17a6-4d5c-bef2-f1f53a3ca7fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:32.060309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5c38a2f6-17a6-4d5c-bef2-f1f53a3ca7fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:14:32.093429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e3a68019-8a9f-48db-97f1-835202c59c4e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:32.115397 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e3a68019-8a9f-48db-97f1-835202c59c4e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.430104 Aug 02 07:14:32.126642 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2644/5367] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:31 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:32.138195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3861cde3-bdee-4bb0-8070-f61619265669 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:32.140125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3861cde3-bdee-4bb0-8070-f61619265669 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:32.154522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3861cde3-bdee-4bb0-8070-f61619265669 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:32.155123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3861cde3-bdee-4bb0-8070-f61619265669 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:32.156142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3861cde3-bdee-4bb0-8070-f61619265669 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:32.156716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3861cde3-bdee-4bb0-8070-f61619265669 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:32.274092 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5c38a2f6-17a6-4d5c-bef2-f1f53a3ca7fb tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 204 len: 0 microversion: 2.1 time: 0.410252 Aug 02 07:14:32.274914 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2724/5368] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:14:31 2022] DELETE /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:14:32.285987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7c61ff9c-0946-482f-a68a-1d19c933f394 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:32.287824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7c61ff9c-0946-482f-a68a-1d19c933f394 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:32.302666 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c61ff9c-0946-482f-a68a-1d19c933f394 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:32.303155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c61ff9c-0946-482f-a68a-1d19c933f394 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:32.305631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c61ff9c-0946-482f-a68a-1d19c933f394 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:32.307740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c61ff9c-0946-482f-a68a-1d19c933f394 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:32.566404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3861cde3-bdee-4bb0-8070-f61619265669 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:32.578557 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3861cde3-bdee-4bb0-8070-f61619265669 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1325 microversion: 2.1 time: 0.448345 Aug 02 07:14:32.579571 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2645/5369] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:32 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1325 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:32.659837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7c61ff9c-0946-482f-a68a-1d19c933f394 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:32.669661 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7c61ff9c-0946-482f-a68a-1d19c933f394 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 200 len: 1508 microversion: 2.1 time: 0.390291 Aug 02 07:14:32.682823 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2725/5370] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:32 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 1508 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:32.736579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-9990f08b-fdf3-4311-8f15-6a7d5e719ae1 req-706b794e-ab06-47a7-8d32-ff105c274291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92e5496-b560-4d91-a830-240c09f47a31", "name": "network-vif-plugged", "status": "completed", "tag": "996fadbc-7996-43e5-850b-a4b7e716046f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:32.745588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df69e6c0-b166-4ea0-9871-36b94c30826e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:32.746326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df69e6c0-b166-4ea0-9871-36b94c30826e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:32.749123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9990f08b-fdf3-4311-8f15-6a7d5e719ae1 req-706b794e-ab06-47a7-8d32-ff105c274291 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:32.750231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9990f08b-fdf3-4311-8f15-6a7d5e719ae1 req-706b794e-ab06-47a7-8d32-ff105c274291 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:32.754826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df69e6c0-b166-4ea0-9871-36b94c30826e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:32.755508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df69e6c0-b166-4ea0-9871-36b94c30826e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:32.756451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df69e6c0-b166-4ea0-9871-36b94c30826e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:32.757076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df69e6c0-b166-4ea0-9871-36b94c30826e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:32.769260 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-9990f08b-fdf3-4311-8f15-6a7d5e719ae1 req-706b794e-ab06-47a7-8d32-ff105c274291 service nova] Creating event network-vif-plugged:996fadbc-7996-43e5-850b-a4b7e716046f for instance a92e5496-b560-4d91-a830-240c09f47a31 on n-h1-851337-3 Aug 02 07:14:32.775207 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-9990f08b-fdf3-4311-8f15-6a7d5e719ae1 req-706b794e-ab06-47a7-8d32-ff105c274291 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042398 Aug 02 07:14:32.776393 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2646/5371] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:14:33.053816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-df69e6c0-b166-4ea0-9871-36b94c30826e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:33.062014 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df69e6c0-b166-4ea0-9871-36b94c30826e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.320961 Aug 02 07:14:33.063565 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2726/5372] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:32 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:33.149309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15bf5700-3d49-438e-8259-609942b400ce tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:33.150189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-15bf5700-3d49-438e-8259-609942b400ce tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:33.156981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:33.160396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15bf5700-3d49-438e-8259-609942b400ce tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:33.164440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15bf5700-3d49-438e-8259-609942b400ce tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:33.166019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15bf5700-3d49-438e-8259-609942b400ce tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:33.166734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15bf5700-3d49-438e-8259-609942b400ce tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:33.534536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-15bf5700-3d49-438e-8259-609942b400ce tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:33.564055 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-15bf5700-3d49-438e-8259-609942b400ce tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.418967 Aug 02 07:14:33.565082 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2647/5373] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:33 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:33.602059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3d91a822-02c0-4bcc-86f3-57f94b17774c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:33.602742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3d91a822-02c0-4bcc-86f3-57f94b17774c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:33.612613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d91a822-02c0-4bcc-86f3-57f94b17774c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:33.618300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d91a822-02c0-4bcc-86f3-57f94b17774c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:33.619211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d91a822-02c0-4bcc-86f3-57f94b17774c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:33.619638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3d91a822-02c0-4bcc-86f3-57f94b17774c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:33.693003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7ff4f751-5639-4b7c-9b50-9287f3b00a37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:33.693953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7ff4f751-5639-4b7c-9b50-9287f3b00a37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:33.701284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ff4f751-5639-4b7c-9b50-9287f3b00a37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:33.702145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ff4f751-5639-4b7c-9b50-9287f3b00a37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:33.703161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ff4f751-5639-4b7c-9b50-9287f3b00a37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:33.704028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ff4f751-5639-4b7c-9b50-9287f3b00a37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:33.987207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3d91a822-02c0-4bcc-86f3-57f94b17774c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:34.008271 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3d91a822-02c0-4bcc-86f3-57f94b17774c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1325 microversion: 2.1 time: 0.411038 Aug 02 07:14:34.009875 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2727/5374] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:33 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1325 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:34.016843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ed3185c6-b996-4ee3-af88-fb6f11261468 req-ee3aea8f-9eb3-46c1-8119-4abe964be483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b35b7f-de5b-4d19-bd55-55d7b06b3536", "tag": "9b7ae46e-d7eb-481e-947a-5b8889d64199"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:34.069952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7ff4f751-5639-4b7c-9b50-9287f3b00a37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:34.093462 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7ff4f751-5639-4b7c-9b50-9287f3b00a37 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 200 len: 1508 microversion: 2.1 time: 0.404183 Aug 02 07:14:34.094087 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2648/5375] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:33 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 1508 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:34.105542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ed3185c6-b996-4ee3-af88-fb6f11261468 req-ee3aea8f-9eb3-46c1-8119-4abe964be483 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:34.111238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ed3185c6-b996-4ee3-af88-fb6f11261468 req-ee3aea8f-9eb3-46c1-8119-4abe964be483 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:34.115794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a2e9ea0a-c13b-4929-97f4-bb7740d21083 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:34.116843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a2e9ea0a-c13b-4929-97f4-bb7740d21083 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:34.129777 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ed3185c6-b996-4ee3-af88-fb6f11261468 req-ee3aea8f-9eb3-46c1-8119-4abe964be483 service nova] Creating event network-changed:9b7ae46e-d7eb-481e-947a-5b8889d64199 for instance 03b35b7f-de5b-4d19-bd55-55d7b06b3536 on n-h2-851337-3 Aug 02 07:14:34.132008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2e9ea0a-c13b-4929-97f4-bb7740d21083 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:34.132677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2e9ea0a-c13b-4929-97f4-bb7740d21083 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:34.133670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2e9ea0a-c13b-4929-97f4-bb7740d21083 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:34.134304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2e9ea0a-c13b-4929-97f4-bb7740d21083 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:34.147416 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ed3185c6-b996-4ee3-af88-fb6f11261468 req-ee3aea8f-9eb3-46c1-8119-4abe964be483 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135953 Aug 02 07:14:34.149274 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2728/5376] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:14:34.586162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-42761b86-9328-433a-b7ef-e7eb9394f5c0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:34.587679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-42761b86-9328-433a-b7ef-e7eb9394f5c0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:34.606542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42761b86-9328-433a-b7ef-e7eb9394f5c0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:34.606999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42761b86-9328-433a-b7ef-e7eb9394f5c0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:34.607801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42761b86-9328-433a-b7ef-e7eb9394f5c0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:34.608242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42761b86-9328-433a-b7ef-e7eb9394f5c0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:34.773136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a2e9ea0a-c13b-4929-97f4-bb7740d21083 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:34.795084 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a2e9ea0a-c13b-4929-97f4-bb7740d21083 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.687832 Aug 02 07:14:34.796433 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2649/5377] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:34 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:35.029960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-08470d4a-63cf-41cd-9b8d-f57169636ec3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:35.030537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-08470d4a-63cf-41cd-9b8d-f57169636ec3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:35.039745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08470d4a-63cf-41cd-9b8d-f57169636ec3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:35.040203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08470d4a-63cf-41cd-9b8d-f57169636ec3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:35.045813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08470d4a-63cf-41cd-9b8d-f57169636ec3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:35.046558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08470d4a-63cf-41cd-9b8d-f57169636ec3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:35.199248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-42761b86-9328-433a-b7ef-e7eb9394f5c0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:35.208585 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-42761b86-9328-433a-b7ef-e7eb9394f5c0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.627276 Aug 02 07:14:35.222632 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2729/5378] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:34 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:35.229050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-590da4a5-581c-4231-8bbf-ad257a5dd89a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:35.229858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-590da4a5-581c-4231-8bbf-ad257a5dd89a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:35.240608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-590da4a5-581c-4231-8bbf-ad257a5dd89a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:35.243343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-590da4a5-581c-4231-8bbf-ad257a5dd89a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:35.244316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-590da4a5-581c-4231-8bbf-ad257a5dd89a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:35.244894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-590da4a5-581c-4231-8bbf-ad257a5dd89a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:35.305989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-590da4a5-581c-4231-8bbf-ad257a5dd89a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:35.306441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-590da4a5-581c-4231-8bbf-ad257a5dd89a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:35.307411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-590da4a5-581c-4231-8bbf-ad257a5dd89a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lazy-loading 'fault' on Instance uuid 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:14:35.476461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-590da4a5-581c-4231-8bbf-ad257a5dd89a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:35.485709 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-590da4a5-581c-4231-8bbf-ad257a5dd89a tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 200 len: 1305 microversion: 2.1 time: 0.261691 Aug 02 07:14:35.489976 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2730/5379] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:35 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 1305 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:35.753735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-08470d4a-63cf-41cd-9b8d-f57169636ec3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:35.761002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:DELETE=2,nova_cell1:SELECT=98 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:35.768644 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-08470d4a-63cf-41cd-9b8d-f57169636ec3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1325 microversion: 2.1 time: 0.743656 Aug 02 07:14:35.783651 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2650/5380] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:35 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1325 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:35.817724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-73fa484a-aeec-4ad9-a63c-79d92422204a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:35.818558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-73fa484a-aeec-4ad9-a63c-79d92422204a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:35.835904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73fa484a-aeec-4ad9-a63c-79d92422204a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:35.856547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73fa484a-aeec-4ad9-a63c-79d92422204a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:35.860475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73fa484a-aeec-4ad9-a63c-79d92422204a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:35.861822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73fa484a-aeec-4ad9-a63c-79d92422204a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:36.244630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c9cdab4c-df0c-4fcd-a72e-6f38dc694a54 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Action: 'create', calling method: .version_select at 0x7f927af374c0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-735811759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfqSsJcY2diw3hE5uxiH60ShFXgZFaczdnIQRPenk3TGdtqQbq5ZX56471QfTRGYj+FXkKs2LOXc4WzDcki6KHqCKqbDOb1zW4Ak3ORGanyIpDmQdZIlPfrLkzOb19eeQ=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:36.298334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-c9cdab4c-df0c-4fcd-a72e-6f38dc694a54 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Getting quotas for project 3c82289264d443baa513f341d4da7523. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:14:36.312887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-c9cdab4c-df0c-4fcd-a72e-6f38dc694a54 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Getting quotas for user fd0bd714baa542488384215c55f2eb84 and project 3c82289264d443baa513f341d4da7523. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:14:36.381138 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c9cdab4c-df0c-4fcd-a72e-6f38dc694a54 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.406551 Aug 02 07:14:36.381842 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2651/5381] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:14:35 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:14:36.403867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-58e8e36a-82e3-475a-ae70-8227d832554d req-f5dbcfd5-24af-402d-9e99-d70feebeddf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3bfd41-7a86-4a91-a51d-e6f38888fd9b", "name": "network-vif-deleted", "tag": "3b96a15e-6e4a-44c3-84a8-40430d1e2f35"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:36.433924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-58e8e36a-82e3-475a-ae70-8227d832554d req-f5dbcfd5-24af-402d-9e99-d70feebeddf7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:36.435498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-58e8e36a-82e3-475a-ae70-8227d832554d req-f5dbcfd5-24af-402d-9e99-d70feebeddf7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:36.468893 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-58e8e36a-82e3-475a-ae70-8227d832554d req-f5dbcfd5-24af-402d-9e99-d70feebeddf7 service nova] Creating event network-vif-deleted:3b96a15e-6e4a-44c3-84a8-40430d1e2f35 for instance 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b on n-h2-851337-3 Aug 02 07:14:36.480076 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-58e8e36a-82e3-475a-ae70-8227d832554d req-f5dbcfd5-24af-402d-9e99-d70feebeddf7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083534 Aug 02 07:14:36.482629 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2652/5382] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:14:36.497237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6ecbc169-d0c0-4824-a1d8-16978c8f2e27 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:36.498216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6ecbc169-d0c0-4824-a1d8-16978c8f2e27 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:36.520664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ecbc169-d0c0-4824-a1d8-16978c8f2e27 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:36.523616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ecbc169-d0c0-4824-a1d8-16978c8f2e27 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:36.525872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ecbc169-d0c0-4824-a1d8-16978c8f2e27 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:36.526969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ecbc169-d0c0-4824-a1d8-16978c8f2e27 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:36.729649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-73fa484a-aeec-4ad9-a63c-79d92422204a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:36.739970 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-73fa484a-aeec-4ad9-a63c-79d92422204a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.926827 Aug 02 07:14:36.740592 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2731/5383] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:35 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:36.752316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1d7728db-d4c4-42ec-a3e0-d05ac8d2b1ab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:36.762668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1d7728db-d4c4-42ec-a3e0-d05ac8d2b1ab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:36.778023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d7728db-d4c4-42ec-a3e0-d05ac8d2b1ab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:36.778483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d7728db-d4c4-42ec-a3e0-d05ac8d2b1ab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:36.779278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d7728db-d4c4-42ec-a3e0-d05ac8d2b1ab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:36.779712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d7728db-d4c4-42ec-a3e0-d05ac8d2b1ab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:36.817130 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-1d7728db-d4c4-42ec-a3e0-d05ac8d2b1ab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] HTTP exception thrown: Instance 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b could not be found. Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1d7728db-d4c4-42ec-a3e0-d05ac8d2b1ab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Request method failure captured: Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b HTTP/1.1 Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mw7zphSbQMyV1VXzUHwZd5rIpAe-J0qyHXkZOXqSTF1d6X6i4GdQd6SAUR575sU6Hm3N4AxhP_yLKO8F3_7Y95D5F9Xzk9hsnx3CQybTj1H2lx-bESaz2CLvMeK80wW4lAMQ_yzam-Q_YptKuaWSXkoL0Pz6P3TXT8PIXRbAKIUaKg Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: daaad725b62041d1ac0af9ff8efcdfc5 Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/daaad725b62041d1ac0af9ff8efcdfc5"}]}] Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: daaad725b62041d1ac0af9ff8efcdfc5 Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerActionsTestJSON-1022755064-project Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 35f9bc6690f3473a99804c14351b93b6 Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerActionsTestJSON-1022755064-project Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b could not be found. Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '4c3bfd41-7a86-4a91-a51d-e6f38888fd9b'} Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b could not be found. Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b could not be found. Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:36.835041 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:36.841826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:36.841826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:36.841826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:36.841826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:14:36.841826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:14:36.841826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b could not be found. Aug 02 07:14:36.841826 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:36.844586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1d7728db-d4c4-42ec-a3e0-d05ac8d2b1ab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Returning 404 to user: Instance 4c3bfd41-7a86-4a91-a51d-e6f38888fd9b could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:14:36.846400 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1d7728db-d4c4-42ec-a3e0-d05ac8d2b1ab tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b" status: 404 len: 111 microversion: 2.1 time: 0.098040 Aug 02 07:14:36.847623 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2732/5384] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:36 2022] GET /compute/v2.1/servers/4c3bfd41-7a86-4a91-a51d-e6f38888fd9b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:14:36.876042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b02b9e23-f733-4a93-bb5d-f83a4ecc8a58 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:36.877153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b02b9e23-f733-4a93-bb5d-f83a4ecc8a58 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:36.910609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b02b9e23-f733-4a93-bb5d-f83a4ecc8a58 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:36.911820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b02b9e23-f733-4a93-bb5d-f83a4ecc8a58 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:36.913523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b02b9e23-f733-4a93-bb5d-f83a4ecc8a58 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:36.916470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b02b9e23-f733-4a93-bb5d-f83a4ecc8a58 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:37.228133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6ecbc169-d0c0-4824-a1d8-16978c8f2e27 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:37.238410 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6ecbc169-d0c0-4824-a1d8-16978c8f2e27 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.754349 Aug 02 07:14:37.239512 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2653/5385] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:36 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:37.245027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2e81340a-8974-45c3-8083-496fd1942646 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:37.245775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2e81340a-8974-45c3-8083-496fd1942646 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:37.257457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e81340a-8974-45c3-8083-496fd1942646 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:37.258419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e81340a-8974-45c3-8083-496fd1942646 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:37.259637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e81340a-8974-45c3-8083-496fd1942646 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:37.260090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e81340a-8974-45c3-8083-496fd1942646 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:37.326417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2e81340a-8974-45c3-8083-496fd1942646 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:14:37.386282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b02b9e23-f733-4a93-bb5d-f83a4ecc8a58 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:37.396885 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b02b9e23-f733-4a93-bb5d-f83a4ecc8a58 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1522 microversion: 2.1 time: 0.542560 Aug 02 07:14:37.400423 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2733/5386] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:36 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1522 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:37.422976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ce5306a-ef30-4f59-95bd-c5ea2fddf3b3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:37.423887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2ce5306a-ef30-4f59-95bd-c5ea2fddf3b3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:37.437796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:37.440548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ce5306a-ef30-4f59-95bd-c5ea2fddf3b3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:37.441660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ce5306a-ef30-4f59-95bd-c5ea2fddf3b3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:37.442632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ce5306a-ef30-4f59-95bd-c5ea2fddf3b3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:37.443289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ce5306a-ef30-4f59-95bd-c5ea2fddf3b3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:37.451830 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2e81340a-8974-45c3-8083-496fd1942646 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 204 len: 0 microversion: 2.1 time: 0.210237 Aug 02 07:14:37.452583 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2654/5387] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:14:37 2022] DELETE /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:14:37.462377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7d85908d-f3ae-4e22-8028-30db12c1bead tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:37.463186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7d85908d-f3ae-4e22-8028-30db12c1bead tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:37.470466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d85908d-f3ae-4e22-8028-30db12c1bead tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:37.471004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d85908d-f3ae-4e22-8028-30db12c1bead tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:37.472029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d85908d-f3ae-4e22-8028-30db12c1bead tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:37.472540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d85908d-f3ae-4e22-8028-30db12c1bead tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:37.474075 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-2ce5306a-ef30-4f59-95bd-c5ea2fddf3b3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] HTTP exception thrown: Instance is not a member of specified network Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ce5306a-ef30-4f59-95bd-c5ea2fddf3b3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Request method failure captured: Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31/ips/invalid HTTP/1.1 Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M7ENMICG0kuYAwTAHLoDDZU0XeWJiWBPiwjUcQQrSrZvWfdo4O1let-uhvcw_UzNos45diXYnWNyqghIYYE2-7ZuDhaBlxn7v6OUSzVfsrvBb5zcSfIHggF7ofFdcwCcFxpf4AUJdKqVgmr8qLm8h3cPGAgXN4t-E2J2RHB0oe2MwI Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: c940de04b236429ba65bc34a644376d7 Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1870846805 Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c940de04b236429ba65bc34a644376d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c940de04b236429ba65bc34a644376d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c940de04b236429ba65bc34a644376d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c940de04b236429ba65bc34a644376d7"}]}] Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1870846805 Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: c940de04b236429ba65bc34a644376d7 Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1870846805 Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerAddressesNegativeTestJSON-1870846805-project Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 085809c8790f430d9cd61ece8c14f7d1 Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1870846805-project Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance is not a member of specified network Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'server_id': 'a92e5496-b560-4d91-a830-240c09f47a31', 'id': 'invalid'} Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 02 07:14:37.483458 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:37.487672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ce5306a-ef30-4f59-95bd-c5ea2fddf3b3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Returning 404 to user: Instance is not a member of specified network {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:14:37.490029 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2ce5306a-ef30-4f59-95bd-c5ea2fddf3b3 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.071513 Aug 02 07:14:37.491156 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2734/5388] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 07:14:37 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31/ips/invalid => generated 91 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 02 07:14:37.502381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b52eca95-d081-4e36-af23-5e27f02b188e tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:37.502945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b52eca95-d081-4e36-af23-5e27f02b188e tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Failed to fetch instance by id 999 {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 02 07:14:37.503628 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-b52eca95-d081-4e36-af23-5e27f02b188e tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] HTTP exception thrown: Instance 999 could not be found. Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b52eca95-d081-4e36-af23-5e27f02b188e tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Request method failure captured: Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M7ENMICG0kuYAwTAHLoDDZU0XeWJiWBPiwjUcQQrSrZvWfdo4O1let-uhvcw_UzNos45diXYnWNyqghIYYE2-7ZuDhaBlxn7v6OUSzVfsrvBb5zcSfIHggF7ofFdcwCcFxpf4AUJdKqVgmr8qLm8h3cPGAgXN4t-E2J2RHB0oe2MwI Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: c940de04b236429ba65bc34a644376d7 Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1870846805 Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c940de04b236429ba65bc34a644376d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c940de04b236429ba65bc34a644376d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c940de04b236429ba65bc34a644376d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c940de04b236429ba65bc34a644376d7"}]}] Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1870846805 Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: c940de04b236429ba65bc34a644376d7 Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1870846805 Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerAddressesNegativeTestJSON-1870846805-project Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 085809c8790f430d9cd61ece8c14f7d1 Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1870846805-project Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 999 could not be found. Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'server_id': '999'} Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 02 07:14:37.505257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:14:37.513185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b52eca95-d081-4e36-af23-5e27f02b188e tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Returning 404 to user: Instance 999 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:14:37.513185 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b52eca95-d081-4e36-af23-5e27f02b188e tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.009803 Aug 02 07:14:37.513185 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2735/5389] 10.222.0.79 () {58 vars in 1149 bytes} [Tue Aug 2 07:14:37 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:14:37.518795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-64e2f0f3-52a8-4e17-a94a-045c3a1dc8a7 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:37.520131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-64e2f0f3-52a8-4e17-a94a-045c3a1dc8a7 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:37.532114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64e2f0f3-52a8-4e17-a94a-045c3a1dc8a7 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:37.533297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64e2f0f3-52a8-4e17-a94a-045c3a1dc8a7 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:37.534285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64e2f0f3-52a8-4e17-a94a-045c3a1dc8a7 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:37.534876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64e2f0f3-52a8-4e17-a94a-045c3a1dc8a7 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:37.565446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-64e2f0f3-52a8-4e17-a94a-045c3a1dc8a7 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:14:37.569596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:37.671875 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-64e2f0f3-52a8-4e17-a94a-045c3a1dc8a7 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 204 len: 0 microversion: 2.1 time: 0.159069 Aug 02 07:14:37.672498 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2736/5390] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:14:37 2022] DELETE /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:14:37.683194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ed7c9d76-3766-4ac5-8a6c-7dd4eed33403 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:37.683885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ed7c9d76-3766-4ac5-8a6c-7dd4eed33403 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:37.694073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ed7c9d76-3766-4ac5-8a6c-7dd4eed33403 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:37.694755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ed7c9d76-3766-4ac5-8a6c-7dd4eed33403 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:37.695759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ed7c9d76-3766-4ac5-8a6c-7dd4eed33403 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:37.696532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ed7c9d76-3766-4ac5-8a6c-7dd4eed33403 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:37.944462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7d85908d-f3ae-4e22-8028-30db12c1bead tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:37.964341 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7d85908d-f3ae-4e22-8028-30db12c1bead tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1495 microversion: 2.1 time: 0.507283 Aug 02 07:14:37.965107 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2655/5391] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:37 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1495 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:37.971737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2efbf521-461e-4dfa-9cb7-8d7c4b802270 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:37.972808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2efbf521-461e-4dfa-9cb7-8d7c4b802270 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:37.989024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2efbf521-461e-4dfa-9cb7-8d7c4b802270 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:37.989700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2efbf521-461e-4dfa-9cb7-8d7c4b802270 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:37.990648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2efbf521-461e-4dfa-9cb7-8d7c4b802270 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:37.991090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2efbf521-461e-4dfa-9cb7-8d7c4b802270 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:38.310155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ed7c9d76-3766-4ac5-8a6c-7dd4eed33403 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:38.327665 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ed7c9d76-3766-4ac5-8a6c-7dd4eed33403 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1528 microversion: 2.1 time: 0.648698 Aug 02 07:14:38.341224 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2737/5392] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:37 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1528 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:38.346539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9b054118-0e4e-4a0a-ab1a-874ce97b5b7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:38.347338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9b054118-0e4e-4a0a-ab1a-874ce97b5b7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:38.354649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b054118-0e4e-4a0a-ab1a-874ce97b5b7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:38.355258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b054118-0e4e-4a0a-ab1a-874ce97b5b7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:38.356185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b054118-0e4e-4a0a-ab1a-874ce97b5b7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:38.356766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b054118-0e4e-4a0a-ab1a-874ce97b5b7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:38.594119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2efbf521-461e-4dfa-9cb7-8d7c4b802270 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:38.602922 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2efbf521-461e-4dfa-9cb7-8d7c4b802270 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.635616 Aug 02 07:14:38.606444 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2656/5393] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:37 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:38.991013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-32c4c8ef-0192-4d1e-9480-4f705914c3e9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:38.992511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-32c4c8ef-0192-4d1e-9480-4f705914c3e9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:39.004897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9b054118-0e4e-4a0a-ab1a-874ce97b5b7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:39.026168 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9b054118-0e4e-4a0a-ab1a-874ce97b5b7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.679064 Aug 02 07:14:39.028561 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2738/5394] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:38 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:39.033861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32c4c8ef-0192-4d1e-9480-4f705914c3e9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:39.036111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32c4c8ef-0192-4d1e-9480-4f705914c3e9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:39.036941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32c4c8ef-0192-4d1e-9480-4f705914c3e9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:39.037386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32c4c8ef-0192-4d1e-9480-4f705914c3e9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:39.065236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-558868882", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-735811759", "security_groups": [{"name": "tempest-secgroup-smoke-706602529"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "92b9765b-e2db-449a-8930-4c3a7abb41ad"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:39.274776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-32c4c8ef-0192-4d1e-9480-4f705914c3e9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:39.294758 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-32c4c8ef-0192-4d1e-9480-4f705914c3e9 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 200 len: 1453 microversion: 2.1 time: 0.301880 Aug 02 07:14:39.297060 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2657/5395] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:38 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 1453 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:39.310569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-94e9c43a-e852-47c7-b344-1a5f19ab2c73 req-15be459c-efb8-4451-ac9d-bbcdafa5b2fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d415b6-b9f4-4c0c-bd81-67d9b571ea81", "name": "network-vif-deleted", "tag": "21354a97-6003-4b29-b2d1-6d99fd2581b8"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:39.333453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-94e9c43a-e852-47c7-b344-1a5f19ab2c73 req-15be459c-efb8-4451-ac9d-bbcdafa5b2fd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:39.334686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-94e9c43a-e852-47c7-b344-1a5f19ab2c73 req-15be459c-efb8-4451-ac9d-bbcdafa5b2fd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:39.382285 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-94e9c43a-e852-47c7-b344-1a5f19ab2c73 req-15be459c-efb8-4451-ac9d-bbcdafa5b2fd service nova] Creating event network-vif-deleted:21354a97-6003-4b29-b2d1-6d99fd2581b8 for instance 03d415b6-b9f4-4c0c-bd81-67d9b571ea81 on n-h2-851337-3 Aug 02 07:14:39.387765 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-94e9c43a-e852-47c7-b344-1a5f19ab2c73 req-15be459c-efb8-4451-ac9d-bbcdafa5b2fd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088318 Aug 02 07:14:39.389147 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2658/5396] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:14:39.399772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f0b1c691-baef-45d6-8db9-3287bea41035 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:39.400832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f0b1c691-baef-45d6-8db9-3287bea41035 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:39.410222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0b1c691-baef-45d6-8db9-3287bea41035 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:39.411093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0b1c691-baef-45d6-8db9-3287bea41035 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:39.412037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0b1c691-baef-45d6-8db9-3287bea41035 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:39.412665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0b1c691-baef-45d6-8db9-3287bea41035 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:39.416064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] validate_networks() for [('92b9765b-e2db-449a-8930-4c3a7abb41ad', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:14:39.656339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f0b1c691-baef-45d6-8db9-3287bea41035 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:39.665720 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f0b1c691-baef-45d6-8db9-3287bea41035 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1528 microversion: 2.1 time: 0.274957 Aug 02 07:14:39.681731 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2659/5397] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:39 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1528 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:39.687381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cf494622-dd3b-491d-8dde-d2133fce5a16 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:39.688504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cf494622-dd3b-491d-8dde-d2133fce5a16 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:39.695858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf494622-dd3b-491d-8dde-d2133fce5a16 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:39.696389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf494622-dd3b-491d-8dde-d2133fce5a16 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:39.697732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf494622-dd3b-491d-8dde-d2133fce5a16 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:39.698780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf494622-dd3b-491d-8dde-d2133fce5a16 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:40.027558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cf494622-dd3b-491d-8dde-d2133fce5a16 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:40.039471 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cf494622-dd3b-491d-8dde-d2133fce5a16 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.356415 Aug 02 07:14:40.054128 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2660/5398] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:39 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:40.059889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dbfff24e-a6e2-458e-a3b1-26c5e5aac706 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:40.060512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dbfff24e-a6e2-458e-a3b1-26c5e5aac706 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:40.078257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbfff24e-a6e2-458e-a3b1-26c5e5aac706 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:40.078870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbfff24e-a6e2-458e-a3b1-26c5e5aac706 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:40.080229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbfff24e-a6e2-458e-a3b1-26c5e5aac706 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:40.086563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbfff24e-a6e2-458e-a3b1-26c5e5aac706 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:40.404604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Getting quotas for project 3c82289264d443baa513f341d4da7523. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:14:40.429676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Getting quotas for user fd0bd714baa542488384215c55f2eb84 and project 3c82289264d443baa513f341d4da7523. Resources: dict_keys(['metadata_items']) {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:14:40.469361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:14:40.472570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:14:40.473276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:14:40.473834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:14:40.474424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:14:40.484341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:40.485957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:40.487011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:40.487593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:40.527942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dbfff24e-a6e2-458e-a3b1-26c5e5aac706 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:40.529977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Getting quotas for project 3c82289264d443baa513f341d4da7523. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:14:40.538219 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dbfff24e-a6e2-458e-a3b1-26c5e5aac706 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.482845 Aug 02 07:14:40.539243 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2661/5399] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:40 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:40.550678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Getting quotas for user fd0bd714baa542488384215c55f2eb84 and project 3c82289264d443baa513f341d4da7523. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:14:40.550962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-701f9fed-ba17-4c22-b83a-b3c0b94ede31 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:40.551609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-701f9fed-ba17-4c22-b83a-b3c0b94ede31 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 03d415b6-b9f4-4c0c-bd81-67d9b571ea81] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:40.577766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-701f9fed-ba17-4c22-b83a-b3c0b94ede31 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:40.578265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-701f9fed-ba17-4c22-b83a-b3c0b94ede31 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:40.579089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-701f9fed-ba17-4c22-b83a-b3c0b94ede31 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:40.579518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-701f9fed-ba17-4c22-b83a-b3c0b94ede31 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:40.584584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:14:40.587060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:14:40.610022 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-701f9fed-ba17-4c22-b83a-b3c0b94ede31 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] HTTP exception thrown: Instance 03d415b6-b9f4-4c0c-bd81-67d9b571ea81 could not be found. Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-701f9fed-ba17-4c22-b83a-b3c0b94ede31 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Request method failure captured: Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 HTTP/1.1 Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mw7zphSbQMyV1VXzUHwZd5rIpAe-J0qyHXkZOXqSTF1d6X6i4GdQd6SAUR575sU6Hm3N4AxhP_yLKO8F3_7Y95D5F9Xzk9hsnx3CQybTj1H2lx-bESaz2CLvMeK80wW4lAMQ_yzam-Q_YptKuaWSXkoL0Pz6P3TXT8PIXRbAKIUaKg Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: daaad725b62041d1ac0af9ff8efcdfc5 Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/daaad725b62041d1ac0af9ff8efcdfc5"}]}] Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: daaad725b62041d1ac0af9ff8efcdfc5 Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerActionsTestJSON-1022755064-project Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 35f9bc6690f3473a99804c14351b93b6 Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerActionsTestJSON-1022755064-project Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 03d415b6-b9f4-4c0c-bd81-67d9b571ea81 could not be found. Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '03d415b6-b9f4-4c0c-bd81-67d9b571ea81'} Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d415b6-b9f4-4c0c-bd81-67d9b571ea81 could not be found. Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d415b6-b9f4-4c0c-bd81-67d9b571ea81 could not be found. Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:40.614309 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:40.618036 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:40.618036 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:40.618036 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:40.618036 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:14:40.618036 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:14:40.618036 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d415b6-b9f4-4c0c-bd81-67d9b571ea81 could not be found. Aug 02 07:14:40.618036 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:40.622792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-701f9fed-ba17-4c22-b83a-b3c0b94ede31 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Returning 404 to user: Instance 03d415b6-b9f4-4c0c-bd81-67d9b571ea81 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:14:40.623884 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-701f9fed-ba17-4c22-b83a-b3c0b94ede31 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81" status: 404 len: 111 microversion: 2.1 time: 0.083246 Aug 02 07:14:40.624602 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2662/5400] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:40 2022] GET /compute/v2.1/servers/03d415b6-b9f4-4c0c-bd81-67d9b571ea81 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:14:40.647854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ec84ce79-d35a-4852-aaed-1ac3b50b9d1c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:40.654012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ec84ce79-d35a-4852-aaed-1ac3b50b9d1c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:40.660930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec84ce79-d35a-4852-aaed-1ac3b50b9d1c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:40.662054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec84ce79-d35a-4852-aaed-1ac3b50b9d1c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:40.663023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec84ce79-d35a-4852-aaed-1ac3b50b9d1c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:40.663621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec84ce79-d35a-4852-aaed-1ac3b50b9d1c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:40.684855 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aa478432-3fa4-4dd5-bef4-f181fbf3023c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.623891 Aug 02 07:14:40.686048 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2739/5401] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:14:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:14:40.691745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e43a9025-8a2e-4685-8e50-ace4f8e5d612 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:40.692784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e43a9025-8a2e-4685-8e50-ace4f8e5d612 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:40.701113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e43a9025-8a2e-4685-8e50-ace4f8e5d612 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:40.701784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e43a9025-8a2e-4685-8e50-ace4f8e5d612 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:40.702926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e43a9025-8a2e-4685-8e50-ace4f8e5d612 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:40.703609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e43a9025-8a2e-4685-8e50-ace4f8e5d612 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:40.709667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ec84ce79-d35a-4852-aaed-1ac3b50b9d1c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:14:40.902277 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ec84ce79-d35a-4852-aaed-1ac3b50b9d1c tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "DELETE /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 204 len: 0 microversion: 2.1 time: 0.270782 Aug 02 07:14:40.908382 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2663/5402] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:14:40 2022] DELETE /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:14:40.917849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d7a2b296-38df-471b-a01d-4bb4092989ad tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:40.919352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d7a2b296-38df-471b-a01d-4bb4092989ad tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:41.072541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d7a2b296-38df-471b-a01d-4bb4092989ad tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:41.078323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e43a9025-8a2e-4685-8e50-ace4f8e5d612 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:41.092511 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e43a9025-8a2e-4685-8e50-ace4f8e5d612 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1528 microversion: 2.1 time: 0.405179 Aug 02 07:14:41.095115 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d7a2b296-38df-471b-a01d-4bb4092989ad tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1301 microversion: 2.1 time: 0.182710 Aug 02 07:14:41.096188 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2664/5403] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:40 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1301 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:41.103716 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2740/5404] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:40 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1528 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:41.109269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bdb111d5-ffe9-4b05-aa12-5962e899de58 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:41.110133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bdb111d5-ffe9-4b05-aa12-5962e899de58 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:41.131960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-67e9b58c-7c36-4560-ae60-58aa391a1706 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:41.133146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-67e9b58c-7c36-4560-ae60-58aa391a1706 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:41.135858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdb111d5-ffe9-4b05-aa12-5962e899de58 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:41.137332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdb111d5-ffe9-4b05-aa12-5962e899de58 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:41.138475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdb111d5-ffe9-4b05-aa12-5962e899de58 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:41.139117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bdb111d5-ffe9-4b05-aa12-5962e899de58 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:41.151615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67e9b58c-7c36-4560-ae60-58aa391a1706 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:41.152071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67e9b58c-7c36-4560-ae60-58aa391a1706 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:41.155524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67e9b58c-7c36-4560-ae60-58aa391a1706 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:41.158119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67e9b58c-7c36-4560-ae60-58aa391a1706 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:41.448744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bdb111d5-ffe9-4b05-aa12-5962e899de58 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:41.460988 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bdb111d5-ffe9-4b05-aa12-5962e899de58 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.355984 Aug 02 07:14:41.463046 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2741/5405] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:41 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:41.490039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-67e9b58c-7c36-4560-ae60-58aa391a1706 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:41.501863 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-67e9b58c-7c36-4560-ae60-58aa391a1706 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1675 microversion: 2.1 time: 0.403316 Aug 02 07:14:41.510033 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2665/5406] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:41 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1675 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:41.565688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0ead0d46-c75e-4e66-b537-181beed9f97b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:41.566340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0ead0d46-c75e-4e66-b537-181beed9f97b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:41.593639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ead0d46-c75e-4e66-b537-181beed9f97b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:41.594394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ead0d46-c75e-4e66-b537-181beed9f97b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:41.595300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ead0d46-c75e-4e66-b537-181beed9f97b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:41.596048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0ead0d46-c75e-4e66-b537-181beed9f97b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:41.930248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0ead0d46-c75e-4e66-b537-181beed9f97b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:41.941095 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0ead0d46-c75e-4e66-b537-181beed9f97b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.379491 Aug 02 07:14:41.942096 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2742/5407] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:41 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:42.124455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a1da989e-d9a3-4e61-b3ef-a6f341ddcc7f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:42.125582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a1da989e-d9a3-4e61-b3ef-a6f341ddcc7f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:42.132159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-332565b4-29c9-4414-8490-d782de5de28b tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:42.132431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-332565b4-29c9-4414-8490-d782de5de28b tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:42.142358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1da989e-d9a3-4e61-b3ef-a6f341ddcc7f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:42.143751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-332565b4-29c9-4414-8490-d782de5de28b tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:42.143901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1da989e-d9a3-4e61-b3ef-a6f341ddcc7f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:42.144286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-332565b4-29c9-4414-8490-d782de5de28b tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:42.145049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-332565b4-29c9-4414-8490-d782de5de28b tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:42.145784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1da989e-d9a3-4e61-b3ef-a6f341ddcc7f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:42.145927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-332565b4-29c9-4414-8490-d782de5de28b tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:42.146781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a1da989e-d9a3-4e61-b3ef-a6f341ddcc7f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:42.267004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a1da989e-d9a3-4e61-b3ef-a6f341ddcc7f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:42.281336 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a1da989e-d9a3-4e61-b3ef-a6f341ddcc7f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1353 microversion: 2.1 time: 0.161444 Aug 02 07:14:42.283155 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2666/5408] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:42 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:42.432747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-332565b4-29c9-4414-8490-d782de5de28b tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:42.455706 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-332565b4-29c9-4414-8490-d782de5de28b tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1528 microversion: 2.1 time: 0.327578 Aug 02 07:14:42.468098 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2743/5409] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:42 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1528 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:42.484809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e9a2c586-de25-4cf6-bb3d-28ae01fd2df7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:42.485653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e9a2c586-de25-4cf6-bb3d-28ae01fd2df7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:42.493615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9a2c586-de25-4cf6-bb3d-28ae01fd2df7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:42.494357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9a2c586-de25-4cf6-bb3d-28ae01fd2df7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:42.498547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9a2c586-de25-4cf6-bb3d-28ae01fd2df7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:42.499304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9a2c586-de25-4cf6-bb3d-28ae01fd2df7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:42.533628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1fe85154-a047-4a37-96c1-ee4ed97f8604 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:42.534455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1fe85154-a047-4a37-96c1-ee4ed97f8604 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:42.550604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fe85154-a047-4a37-96c1-ee4ed97f8604 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:42.555566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fe85154-a047-4a37-96c1-ee4ed97f8604 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:42.557275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fe85154-a047-4a37-96c1-ee4ed97f8604 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:42.561258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1fe85154-a047-4a37-96c1-ee4ed97f8604 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:43.031185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1fe85154-a047-4a37-96c1-ee4ed97f8604 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:43.043263 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1fe85154-a047-4a37-96c1-ee4ed97f8604 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1675 microversion: 2.1 time: 0.516416 Aug 02 07:14:43.044567 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2744/5410] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:42 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1675 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:43.050041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f872f221-c9ef-4cc3-a3e9-f90c46731e2e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:43.050861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f872f221-c9ef-4cc3-a3e9-f90c46731e2e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:43.059452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f872f221-c9ef-4cc3-a3e9-f90c46731e2e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:43.060212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f872f221-c9ef-4cc3-a3e9-f90c46731e2e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:43.063105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f872f221-c9ef-4cc3-a3e9-f90c46731e2e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:43.063764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f872f221-c9ef-4cc3-a3e9-f90c46731e2e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:43.138538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e9a2c586-de25-4cf6-bb3d-28ae01fd2df7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:43.164713 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e9a2c586-de25-4cf6-bb3d-28ae01fd2df7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.684582 Aug 02 07:14:43.167742 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2667/5411] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:42 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:43.304528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f42f5317-2fbe-469a-868a-91c9910800ee tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:43.305769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f42f5317-2fbe-469a-868a-91c9910800ee tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:43.314510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f42f5317-2fbe-469a-868a-91c9910800ee tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:43.315702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f42f5317-2fbe-469a-868a-91c9910800ee tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:43.316699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f42f5317-2fbe-469a-868a-91c9910800ee tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:43.317403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f42f5317-2fbe-469a-868a-91c9910800ee tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:43.323796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:43.445171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f42f5317-2fbe-469a-868a-91c9910800ee tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:43.455895 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f42f5317-2fbe-469a-868a-91c9910800ee tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1359 microversion: 2.1 time: 0.155601 Aug 02 07:14:43.457679 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2668/5412] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:43 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:43.475436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f872f221-c9ef-4cc3-a3e9-f90c46731e2e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:43.485914 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f872f221-c9ef-4cc3-a3e9-f90c46731e2e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.439970 Aug 02 07:14:43.495970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b49fdcb4-1c6e-4689-926d-6d579646fb3d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:43.497679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b49fdcb4-1c6e-4689-926d-6d579646fb3d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:43.500839 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2745/5413] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:43 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:43.507807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b49fdcb4-1c6e-4689-926d-6d579646fb3d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:43.508485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b49fdcb4-1c6e-4689-926d-6d579646fb3d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:43.509560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b49fdcb4-1c6e-4689-926d-6d579646fb3d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:43.510332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b49fdcb4-1c6e-4689-926d-6d579646fb3d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:44.072474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d2c101c8-db4d-4190-9d97-7737dd9eaedc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:44.073167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d2c101c8-db4d-4190-9d97-7737dd9eaedc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:44.101526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2c101c8-db4d-4190-9d97-7737dd9eaedc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:44.102195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2c101c8-db4d-4190-9d97-7737dd9eaedc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:44.102992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2c101c8-db4d-4190-9d97-7737dd9eaedc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:44.104037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2c101c8-db4d-4190-9d97-7737dd9eaedc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:44.237781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b49fdcb4-1c6e-4689-926d-6d579646fb3d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:44.250109 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b49fdcb4-1c6e-4689-926d-6d579646fb3d tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1528 microversion: 2.1 time: 0.759046 Aug 02 07:14:44.251351 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2669/5414] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:43 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1528 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:44.288562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f66dac19-13f1-42de-9a15-af6fd223b233 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:44.290028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f66dac19-13f1-42de-9a15-af6fd223b233 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:44.300901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f66dac19-13f1-42de-9a15-af6fd223b233 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:44.301962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f66dac19-13f1-42de-9a15-af6fd223b233 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:44.305384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f66dac19-13f1-42de-9a15-af6fd223b233 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:44.307177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f66dac19-13f1-42de-9a15-af6fd223b233 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:44.369956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d2c101c8-db4d-4190-9d97-7737dd9eaedc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:44.379166 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d2c101c8-db4d-4190-9d97-7737dd9eaedc tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1675 microversion: 2.1 time: 0.312777 Aug 02 07:14:44.379766 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2746/5415] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:44 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1675 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:44.484689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-10ecad53-f29c-4ba0-91cf-3a7f941c205c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:44.491913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-10ecad53-f29c-4ba0-91cf-3a7f941c205c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:44.503603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10ecad53-f29c-4ba0-91cf-3a7f941c205c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:44.505573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10ecad53-f29c-4ba0-91cf-3a7f941c205c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:44.507099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10ecad53-f29c-4ba0-91cf-3a7f941c205c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:44.507936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10ecad53-f29c-4ba0-91cf-3a7f941c205c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:44.559074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f66dac19-13f1-42de-9a15-af6fd223b233 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:44.573140 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f66dac19-13f1-42de-9a15-af6fd223b233 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.306801 Aug 02 07:14:44.576573 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2670/5416] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:44 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:44.596832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-27afd9ad-cc02-4710-ac4d-63de086ae053 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:44.597452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-27afd9ad-cc02-4710-ac4d-63de086ae053 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:44.613567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-27afd9ad-cc02-4710-ac4d-63de086ae053 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:44.617040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-27afd9ad-cc02-4710-ac4d-63de086ae053 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:44.617879 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-27afd9ad-cc02-4710-ac4d-63de086ae053 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:44.618370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-27afd9ad-cc02-4710-ac4d-63de086ae053 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:44.820983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-10ecad53-f29c-4ba0-91cf-3a7f941c205c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:44.829295 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-10ecad53-f29c-4ba0-91cf-3a7f941c205c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1426 microversion: 2.1 time: 0.355096 Aug 02 07:14:44.847801 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2747/5417] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:44 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1426 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:44.955885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-27afd9ad-cc02-4710-ac4d-63de086ae053 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:44.965327 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-27afd9ad-cc02-4710-ac4d-63de086ae053 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1506 microversion: 2.1 time: 0.386808 Aug 02 07:14:44.965981 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2671/5418] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:44 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:45.276554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d969c4c2-209d-4bbf-a0aa-c56ad95bda4c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:45.277074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d969c4c2-209d-4bbf-a0aa-c56ad95bda4c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:45.285354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d969c4c2-209d-4bbf-a0aa-c56ad95bda4c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:45.286186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d969c4c2-209d-4bbf-a0aa-c56ad95bda4c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:45.287302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d969c4c2-209d-4bbf-a0aa-c56ad95bda4c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:45.288012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d969c4c2-209d-4bbf-a0aa-c56ad95bda4c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:45.402313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2e016974-0679-4e00-8a40-b3dea1b0795f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:45.404348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2e016974-0679-4e00-8a40-b3dea1b0795f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:45.416060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e016974-0679-4e00-8a40-b3dea1b0795f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:45.416780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e016974-0679-4e00-8a40-b3dea1b0795f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:45.418046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e016974-0679-4e00-8a40-b3dea1b0795f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:45.418458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e016974-0679-4e00-8a40-b3dea1b0795f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:45.444747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d969c4c2-209d-4bbf-a0aa-c56ad95bda4c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:45.454971 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d969c4c2-209d-4bbf-a0aa-c56ad95bda4c tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1528 microversion: 2.1 time: 0.182424 Aug 02 07:14:45.456183 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2748/5419] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:45 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1528 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:45.562875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2e016974-0679-4e00-8a40-b3dea1b0795f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:45.571086 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2e016974-0679-4e00-8a40-b3dea1b0795f tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1675 microversion: 2.1 time: 0.173484 Aug 02 07:14:45.571675 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2672/5420] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:45 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:45.597263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-131644f0-b6a6-4cbc-bc3f-181b4975dcc4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:45.597995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-131644f0-b6a6-4cbc-bc3f-181b4975dcc4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:45.605018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-131644f0-b6a6-4cbc-bc3f-181b4975dcc4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:45.605510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-131644f0-b6a6-4cbc-bc3f-181b4975dcc4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:45.606700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-131644f0-b6a6-4cbc-bc3f-181b4975dcc4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:45.607166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-131644f0-b6a6-4cbc-bc3f-181b4975dcc4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:45.753500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-131644f0-b6a6-4cbc-bc3f-181b4975dcc4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:45.761417 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-131644f0-b6a6-4cbc-bc3f-181b4975dcc4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.168617 Aug 02 07:14:45.762024 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2749/5421] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:45 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:45.859227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b791515b-f2fd-475f-882e-6b9bb77b8786 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:45.860628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b791515b-f2fd-475f-882e-6b9bb77b8786 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:45.867678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b791515b-f2fd-475f-882e-6b9bb77b8786 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:45.868127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b791515b-f2fd-475f-882e-6b9bb77b8786 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:45.869588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b791515b-f2fd-475f-882e-6b9bb77b8786 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:45.870125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b791515b-f2fd-475f-882e-6b9bb77b8786 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:45.986253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-748d9bd6-3252-41a0-b52a-4d21f5847e30 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:45.986903 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-748d9bd6-3252-41a0-b52a-4d21f5847e30 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:45.993388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-748d9bd6-3252-41a0-b52a-4d21f5847e30 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:45.993822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-748d9bd6-3252-41a0-b52a-4d21f5847e30 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:45.994809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-748d9bd6-3252-41a0-b52a-4d21f5847e30 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:45.995233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-748d9bd6-3252-41a0-b52a-4d21f5847e30 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:46.018334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b791515b-f2fd-475f-882e-6b9bb77b8786 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:46.028238 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b791515b-f2fd-475f-882e-6b9bb77b8786 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1426 microversion: 2.1 time: 0.179290 Aug 02 07:14:46.028946 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2673/5422] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:45 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1426 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:46.138615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-748d9bd6-3252-41a0-b52a-4d21f5847e30 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:46.146781 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-748d9bd6-3252-41a0-b52a-4d21f5847e30 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1486 microversion: 2.1 time: 0.164784 Aug 02 07:14:46.160388 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2750/5423] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:45 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1486 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:46.286489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1687523365", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:46.365489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] validate_networks() for [('ab38293c-b029-4eb4-b287-a436f06799c5', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:14:46.477873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df3386dd-9a10-45f0-97db-0ddf84c17fa1 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:46.479413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df3386dd-9a10-45f0-97db-0ddf84c17fa1 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:46.492860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df3386dd-9a10-45f0-97db-0ddf84c17fa1 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:46.494478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df3386dd-9a10-45f0-97db-0ddf84c17fa1 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:46.498396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df3386dd-9a10-45f0-97db-0ddf84c17fa1 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:46.500414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df3386dd-9a10-45f0-97db-0ddf84c17fa1 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:46.907722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-df3386dd-9a10-45f0-97db-0ddf84c17fa1 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:46.920866 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df3386dd-9a10-45f0-97db-0ddf84c17fa1 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1528 microversion: 2.1 time: 0.447599 Aug 02 07:14:46.922568 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2751/5424] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:46 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1528 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:46.929310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4c3d0da1-71ec-4422-b464-3955c475df5e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:46.930328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4c3d0da1-71ec-4422-b464-3955c475df5e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:46.938524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c3d0da1-71ec-4422-b464-3955c475df5e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:46.939353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c3d0da1-71ec-4422-b464-3955c475df5e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:46.940407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c3d0da1-71ec-4422-b464-3955c475df5e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:46.941068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4c3d0da1-71ec-4422-b464-3955c475df5e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:46.972183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:47.439671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4c3d0da1-71ec-4422-b464-3955c475df5e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:47.456831 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4c3d0da1-71ec-4422-b464-3955c475df5e tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1675 microversion: 2.1 time: 0.532152 Aug 02 07:14:47.470785 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2752/5425] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:46 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1675 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:47.470785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f1c88041-2b70-4e40-8712-90dc375ed8d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:47.470785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f1c88041-2b70-4e40-8712-90dc375ed8d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:47.484825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1c88041-2b70-4e40-8712-90dc375ed8d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:47.485265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1c88041-2b70-4e40-8712-90dc375ed8d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:47.486091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1c88041-2b70-4e40-8712-90dc375ed8d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:47.486521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1c88041-2b70-4e40-8712-90dc375ed8d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:47.543163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:14:47.544284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:14:47.544956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:14:47.545561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:14:47.546193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:14:47.560754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:47.561591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:47.563495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:47.566133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:47.613763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Getting quotas for project cd671dbd40de4332800d131413db30ec. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:14:47.620678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Getting quotas for user a44f176bdb674f05b727b751c69382ac and project cd671dbd40de4332800d131413db30ec. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:14:47.657312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:14:47.659875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:14:47.774282 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cc2944b4-8b73-4e6a-bdd9-615c9843cc34 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.502477 Aug 02 07:14:47.780935 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2674/5426] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:14:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:14:47.795244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7eff1e89-9d39-4bec-8e8c-95c5d59f385f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:47.796387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7eff1e89-9d39-4bec-8e8c-95c5d59f385f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:47.839309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7eff1e89-9d39-4bec-8e8c-95c5d59f385f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:47.840681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7eff1e89-9d39-4bec-8e8c-95c5d59f385f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:47.841690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7eff1e89-9d39-4bec-8e8c-95c5d59f385f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:47.842331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7eff1e89-9d39-4bec-8e8c-95c5d59f385f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:47.919690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f1c88041-2b70-4e40-8712-90dc375ed8d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:47.929997 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f1c88041-2b70-4e40-8712-90dc375ed8d0 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.471445 Aug 02 07:14:47.930752 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2753/5427] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:47 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:47.949356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-09105ba7-a971-4b29-b6f1-8b526b73c606 req-f4c58651-b3c7-46c2-ae67-1a2b6eedc1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92e5496-b560-4d91-a830-240c09f47a31", "name": "network-vif-deleted", "tag": "996fadbc-7996-43e5-850b-a4b7e716046f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:47.976646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-09105ba7-a971-4b29-b6f1-8b526b73c606 req-f4c58651-b3c7-46c2-ae67-1a2b6eedc1f5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:47.979011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-09105ba7-a971-4b29-b6f1-8b526b73c606 req-f4c58651-b3c7-46c2-ae67-1a2b6eedc1f5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:47.996949 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-09105ba7-a971-4b29-b6f1-8b526b73c606 req-f4c58651-b3c7-46c2-ae67-1a2b6eedc1f5 service nova] Creating event network-vif-deleted:996fadbc-7996-43e5-850b-a4b7e716046f for instance a92e5496-b560-4d91-a830-240c09f47a31 on n-h1-851337-3 Aug 02 07:14:48.007850 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-09105ba7-a971-4b29-b6f1-8b526b73c606 req-f4c58651-b3c7-46c2-ae67-1a2b6eedc1f5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063593 Aug 02 07:14:48.009153 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2754/5428] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:14:48.016658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b5bfad75-dc96-45de-9cda-842f41b58303 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:48.017589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b5bfad75-dc96-45de-9cda-842f41b58303 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:48.209535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b5bfad75-dc96-45de-9cda-842f41b58303 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:48.218105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7eff1e89-9d39-4bec-8e8c-95c5d59f385f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:48.221143 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b5bfad75-dc96-45de-9cda-842f41b58303 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1214 microversion: 2.1 time: 0.207849 Aug 02 07:14:48.221973 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2755/5429] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:48 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1214 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:48.241034 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7eff1e89-9d39-4bec-8e8c-95c5d59f385f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1426 microversion: 2.1 time: 0.451756 Aug 02 07:14:48.241748 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2675/5430] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:47 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1426 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:48.248703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1dbfac4e-46e2-4f45-a7ae-e14d3838f124 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:48.249371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1dbfac4e-46e2-4f45-a7ae-e14d3838f124 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:48.264616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1dbfac4e-46e2-4f45-a7ae-e14d3838f124 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:48.266275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1dbfac4e-46e2-4f45-a7ae-e14d3838f124 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:48.268175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1dbfac4e-46e2-4f45-a7ae-e14d3838f124 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:48.269393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1dbfac4e-46e2-4f45-a7ae-e14d3838f124 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:48.357490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1dbfac4e-46e2-4f45-a7ae-e14d3838f124 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:48.357838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1dbfac4e-46e2-4f45-a7ae-e14d3838f124 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:48.360031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-1dbfac4e-46e2-4f45-a7ae-e14d3838f124 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lazy-loading 'fault' on Instance uuid a92e5496-b560-4d91-a830-240c09f47a31 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:14:48.484225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c8c1beee-7552-4149-ae6d-1477284a3718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:48.485827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c8c1beee-7552-4149-ae6d-1477284a3718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:48.492194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1dbfac4e-46e2-4f45-a7ae-e14d3838f124 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085809c8790f430d9cd61ece8c14f7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c940de04b236429ba65bc34a644376d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:48.506135 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1dbfac4e-46e2-4f45-a7ae-e14d3838f124 tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 200 len: 1315 microversion: 2.1 time: 0.268002 Aug 02 07:14:48.526235 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2756/5431] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:48 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:48.526412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8c1beee-7552-4149-ae6d-1477284a3718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:48.526919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8c1beee-7552-4149-ae6d-1477284a3718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:48.528118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8c1beee-7552-4149-ae6d-1477284a3718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:48.528715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8c1beee-7552-4149-ae6d-1477284a3718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:48.895856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c8c1beee-7552-4149-ae6d-1477284a3718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:48.907883 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c8c1beee-7552-4149-ae6d-1477284a3718 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1675 microversion: 2.1 time: 0.429005 Aug 02 07:14:48.923000 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2676/5432] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:48 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1675 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:48.954311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-749f70a8-049a-4cd0-91da-9a5f96d1d932 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:48.955664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-749f70a8-049a-4cd0-91da-9a5f96d1d932 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:48.976545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-749f70a8-049a-4cd0-91da-9a5f96d1d932 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:48.977814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-749f70a8-049a-4cd0-91da-9a5f96d1d932 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:48.980593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-749f70a8-049a-4cd0-91da-9a5f96d1d932 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:48.980785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-749f70a8-049a-4cd0-91da-9a5f96d1d932 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:49.243549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8f3b3bec-69ac-4900-b5c7-ad5331923f10 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:49.245153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8f3b3bec-69ac-4900-b5c7-ad5331923f10 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:49.263126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f3b3bec-69ac-4900-b5c7-ad5331923f10 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:49.263852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f3b3bec-69ac-4900-b5c7-ad5331923f10 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:49.264922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f3b3bec-69ac-4900-b5c7-ad5331923f10 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:49.265556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f3b3bec-69ac-4900-b5c7-ad5331923f10 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:49.365381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-749f70a8-049a-4cd0-91da-9a5f96d1d932 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:49.376545 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-749f70a8-049a-4cd0-91da-9a5f96d1d932 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1691 microversion: 2.1 time: 0.426762 Aug 02 07:14:49.391653 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2757/5433] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:48 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1691 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:49.411442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-114ec877-6904-4f15-9d10-a0ee455df045 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:49.413381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-114ec877-6904-4f15-9d10-a0ee455df045 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:49.429613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-114ec877-6904-4f15-9d10-a0ee455df045 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:49.430091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-114ec877-6904-4f15-9d10-a0ee455df045 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:49.430870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-114ec877-6904-4f15-9d10-a0ee455df045 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:49.431306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-114ec877-6904-4f15-9d10-a0ee455df045 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:49.455159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8f3b3bec-69ac-4900-b5c7-ad5331923f10 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:49.464874 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8f3b3bec-69ac-4900-b5c7-ad5331923f10 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1274 microversion: 2.1 time: 0.226314 Aug 02 07:14:49.468451 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2677/5434] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:49 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1274 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:49.531513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f3b7c2e9-f500-4be7-bd16-a590f6c8e68f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:49.532568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f3b7c2e9-f500-4be7-bd16-a590f6c8e68f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] [instance: a92e5496-b560-4d91-a830-240c09f47a31] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:49.534788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:49.540683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3b7c2e9-f500-4be7-bd16-a590f6c8e68f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:49.541433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3b7c2e9-f500-4be7-bd16-a590f6c8e68f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:49.542511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3b7c2e9-f500-4be7-bd16-a590f6c8e68f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:49.544054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3b7c2e9-f500-4be7-bd16-a590f6c8e68f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:49.575574 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-f3b7c2e9-f500-4be7-bd16-a590f6c8e68f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] HTTP exception thrown: Instance a92e5496-b560-4d91-a830-240c09f47a31 could not be found. Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f3b7c2e9-f500-4be7-bd16-a590f6c8e68f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Request method failure captured: Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 HTTP/1.1 Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M7ENMICG0kuYAwTAHLoDDZU0XeWJiWBPiwjUcQQrSrZvWfdo4O1let-uhvcw_UzNos45diXYnWNyqghIYYE2-7ZuDhaBlxn7v6OUSzVfsrvBb5zcSfIHggF7ofFdcwCcFxpf4AUJdKqVgmr8qLm8h3cPGAgXN4t-E2J2RHB0oe2MwI Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: c940de04b236429ba65bc34a644376d7 Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1870846805 Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c940de04b236429ba65bc34a644376d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c940de04b236429ba65bc34a644376d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c940de04b236429ba65bc34a644376d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c940de04b236429ba65bc34a644376d7"}]}] Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1870846805 Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: c940de04b236429ba65bc34a644376d7 Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1870846805 Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerAddressesNegativeTestJSON-1870846805-project Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 085809c8790f430d9cd61ece8c14f7d1 Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1870846805-project Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance a92e5496-b560-4d91-a830-240c09f47a31 could not be found. Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'a92e5496-b560-4d91-a830-240c09f47a31'} Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92e5496-b560-4d91-a830-240c09f47a31 could not be found. Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92e5496-b560-4d91-a830-240c09f47a31 could not be found. Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:49.582292 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:49.585506 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:49.585506 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:49.585506 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:49.585506 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:49.585506 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:14:49.585506 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:14:49.585506 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92e5496-b560-4d91-a830-240c09f47a31 could not be found. Aug 02 07:14:49.585506 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:49.589462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f3b7c2e9-f500-4be7-bd16-a590f6c8e68f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] Returning 404 to user: Instance a92e5496-b560-4d91-a830-240c09f47a31 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:14:49.590697 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f3b7c2e9-f500-4be7-bd16-a590f6c8e68f tempest-ServerAddressesNegativeTestJSON-1870846805 tempest-ServerAddressesNegativeTestJSON-1870846805-project] 10.222.0.79 "GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31" status: 404 len: 111 microversion: 2.1 time: 0.064687 Aug 02 07:14:49.592406 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2678/5435] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:49 2022] GET /compute/v2.1/servers/a92e5496-b560-4d91-a830-240c09f47a31 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:14:49.822845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-114ec877-6904-4f15-9d10-a0ee455df045 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:49.830712 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-114ec877-6904-4f15-9d10-a0ee455df045 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1426 microversion: 2.1 time: 0.437875 Aug 02 07:14:49.854359 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2758/5436] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:49 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1426 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:49.933381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-893c5332-4158-4814-801e-4b38d39c9bcf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:49.934970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-893c5332-4158-4814-801e-4b38d39c9bcf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:49.952104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-893c5332-4158-4814-801e-4b38d39c9bcf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:49.952848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-893c5332-4158-4814-801e-4b38d39c9bcf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:49.954245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-893c5332-4158-4814-801e-4b38d39c9bcf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:49.956099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-893c5332-4158-4814-801e-4b38d39c9bcf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:50.072853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-98ac602b-fb2a-4909-8a15-30c4fa2c99fd req-8c9fbe02-e56a-4e1c-a1fc-3cbc4b5f9bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3", "tag": "5aeee3e0-ac9e-4c5d-8a71-64f5b5643227"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:50.084117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-98ac602b-fb2a-4909-8a15-30c4fa2c99fd req-8c9fbe02-e56a-4e1c-a1fc-3cbc4b5f9bbc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:50.084955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-98ac602b-fb2a-4909-8a15-30c4fa2c99fd req-8c9fbe02-e56a-4e1c-a1fc-3cbc4b5f9bbc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:50.099028 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-98ac602b-fb2a-4909-8a15-30c4fa2c99fd req-8c9fbe02-e56a-4e1c-a1fc-3cbc4b5f9bbc service nova] Creating event network-changed:5aeee3e0-ac9e-4c5d-8a71-64f5b5643227 for instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 on n-h2-851337-3 Aug 02 07:14:50.105174 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-98ac602b-fb2a-4909-8a15-30c4fa2c99fd req-8c9fbe02-e56a-4e1c-a1fc-3cbc4b5f9bbc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036239 Aug 02 07:14:50.106490 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2759/5437] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:14:50.114889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-893c5332-4158-4814-801e-4b38d39c9bcf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f9bc6690f3473a99804c14351b93b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daaad725b62041d1ac0af9ff8efcdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:50.126472 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-893c5332-4158-4814-801e-4b38d39c9bcf tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 200 len: 1607 microversion: 2.1 time: 0.197040 Aug 02 07:14:50.127744 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2679/5438] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:49 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 1607 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:50.421087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-507063d7-2afc-4de6-882b-cd9dff7d94c2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:50.422043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-507063d7-2afc-4de6-882b-cd9dff7d94c2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:50.468458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-507063d7-2afc-4de6-882b-cd9dff7d94c2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:50.473756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-507063d7-2afc-4de6-882b-cd9dff7d94c2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:50.476078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-507063d7-2afc-4de6-882b-cd9dff7d94c2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:50.478602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-507063d7-2afc-4de6-882b-cd9dff7d94c2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:50.489431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-08918d60-ea85-4d68-8adc-7fce67ea96a0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:50.490466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-08918d60-ea85-4d68-8adc-7fce67ea96a0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:50.508454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08918d60-ea85-4d68-8adc-7fce67ea96a0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:50.509503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08918d60-ea85-4d68-8adc-7fce67ea96a0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:50.510580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08918d60-ea85-4d68-8adc-7fce67ea96a0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:50.511257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08918d60-ea85-4d68-8adc-7fce67ea96a0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:50.573606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:50.988263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-08918d60-ea85-4d68-8adc-7fce67ea96a0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:51.001067 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-08918d60-ea85-4d68-8adc-7fce67ea96a0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1272 microversion: 2.1 time: 0.515970 Aug 02 07:14:51.001751 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2680/5439] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:50 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1272 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:51.010718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34f35a23-2ad9-449f-92a0-d7055093f2e3 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:51.013228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-34f35a23-2ad9-449f-92a0-d7055093f2e3 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:51.034407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34f35a23-2ad9-449f-92a0-d7055093f2e3 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:51.035207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34f35a23-2ad9-449f-92a0-d7055093f2e3 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:51.036157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34f35a23-2ad9-449f-92a0-d7055093f2e3 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:51.036599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34f35a23-2ad9-449f-92a0-d7055093f2e3 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:51.522090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-34f35a23-2ad9-449f-92a0-d7055093f2e3 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:51.537315 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-34f35a23-2ad9-449f-92a0-d7055093f2e3 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1426 microversion: 2.1 time: 0.534361 Aug 02 07:14:51.537935 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2681/5440] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:51 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1426 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:51.556789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e5e584ba-fa6d-4cbd-88e3-a0cf2f0a8cae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:51.557737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e5e584ba-fa6d-4cbd-88e3-a0cf2f0a8cae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] [instance: 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:51.562954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-507063d7-2afc-4de6-882b-cd9dff7d94c2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:51.565601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5e584ba-fa6d-4cbd-88e3-a0cf2f0a8cae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:51.566395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5e584ba-fa6d-4cbd-88e3-a0cf2f0a8cae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:51.567401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5e584ba-fa6d-4cbd-88e3-a0cf2f0a8cae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:51.568732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5e584ba-fa6d-4cbd-88e3-a0cf2f0a8cae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:51.580603 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-507063d7-2afc-4de6-882b-cd9dff7d94c2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1681 microversion: 2.1 time: 1.180997 Aug 02 07:14:51.582567 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2760/5441] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:50 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1681 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:51.596736 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-e5e584ba-fa6d-4cbd-88e3-a0cf2f0a8cae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] HTTP exception thrown: Instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe could not be found. Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e5e584ba-fa6d-4cbd-88e3-a0cf2f0a8cae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Request method failure captured: Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe HTTP/1.1 Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mw7zphSbQMyV1VXzUHwZd5rIpAe-J0qyHXkZOXqSTF1d6X6i4GdQd6SAUR575sU6Hm3N4AxhP_yLKO8F3_7Y95D5F9Xzk9hsnx3CQybTj1H2lx-bESaz2CLvMeK80wW4lAMQ_yzam-Q_YptKuaWSXkoL0Pz6P3TXT8PIXRbAKIUaKg Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: daaad725b62041d1ac0af9ff8efcdfc5 Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_daaad725b62041d1ac0af9ff8efcdfc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/daaad725b62041d1ac0af9ff8efcdfc5"}]}] Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: daaad725b62041d1ac0af9ff8efcdfc5 Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerActionsTestJSON-1022755064 Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerActionsTestJSON-1022755064-project Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 35f9bc6690f3473a99804c14351b93b6 Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerActionsTestJSON-1022755064-project Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe could not be found. Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '84ccfed8-393e-4223-b2a8-7dbf8c77d3fe'} Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe could not be found. Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe could not be found. Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:14:51.599564 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:51.603496 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:14:51.603496 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:14:51.603496 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:14:51.603496 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:14:51.603496 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:14:51.603496 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe could not be found. Aug 02 07:14:51.603496 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:14:51.603496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e5e584ba-fa6d-4cbd-88e3-a0cf2f0a8cae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Returning 404 to user: Instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:14:51.604279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ba0c15a8-e9a7-4245-a3ae-9208b3a6baad tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:51.605567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ba0c15a8-e9a7-4245-a3ae-9208b3a6baad tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:51.606235 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e5e584ba-fa6d-4cbd-88e3-a0cf2f0a8cae tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe" status: 404 len: 111 microversion: 2.1 time: 0.052094 Aug 02 07:14:51.606900 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2682/5442] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:51 2022] GET /compute/v2.1/servers/84ccfed8-393e-4223-b2a8-7dbf8c77d3fe => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:14:51.612847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba0c15a8-e9a7-4245-a3ae-9208b3a6baad tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:51.613628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba0c15a8-e9a7-4245-a3ae-9208b3a6baad tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:51.614715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba0c15a8-e9a7-4245-a3ae-9208b3a6baad tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:51.615896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba0c15a8-e9a7-4245-a3ae-9208b3a6baad tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:51.618141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-af7b569b-5b10-4857-bb1d-88c39d1dd115 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] Calling method '.version_select at 0x7f927ad84670>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:51.661703 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-af7b569b-5b10-4857-bb1d-88c39d1dd115 tempest-ServerActionsTestJSON-1022755064 tempest-ServerActionsTestJSON-1022755064-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-829538096" status: 202 len: 0 microversion: 2.1 time: 0.047426 Aug 02 07:14:51.662520 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2683/5443] 10.222.0.79 () {58 vars in 1218 bytes} [Tue Aug 2 07:14:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-829538096 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:14:52.025046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-da2d16a1-6bdc-4719-b10c-0075a5dc8d40 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:52.025670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-da2d16a1-6bdc-4719-b10c-0075a5dc8d40 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:52.037426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da2d16a1-6bdc-4719-b10c-0075a5dc8d40 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:52.041014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da2d16a1-6bdc-4719-b10c-0075a5dc8d40 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:52.043028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da2d16a1-6bdc-4719-b10c-0075a5dc8d40 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:52.043674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da2d16a1-6bdc-4719-b10c-0075a5dc8d40 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:52.109330 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ba0c15a8-e9a7-4245-a3ae-9208b3a6baad tempest-TestNetworkAdvancedServerOps-1488470245 tempest-TestNetworkAdvancedServerOps-1488470245-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1832 microversion: 2.1 time: 0.508789 Aug 02 07:14:52.112898 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2761/5444] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:51 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1832 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:52.141386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a71b90c9-3ce4-41e9-add7-24456a4c1d4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:52.142032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a71b90c9-3ce4-41e9-add7-24456a4c1d4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:52.149099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a71b90c9-3ce4-41e9-add7-24456a4c1d4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:52.149881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a71b90c9-3ce4-41e9-add7-24456a4c1d4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:52.150869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a71b90c9-3ce4-41e9-add7-24456a4c1d4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:52.151484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a71b90c9-3ce4-41e9-add7-24456a4c1d4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:52.676408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-da2d16a1-6bdc-4719-b10c-0075a5dc8d40 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:52.683585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a71b90c9-3ce4-41e9-add7-24456a4c1d4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:52.691247 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-da2d16a1-6bdc-4719-b10c-0075a5dc8d40 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1314 microversion: 2.1 time: 0.667351 Aug 02 07:14:52.692576 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2684/5445] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:52 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:52.699852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-85e8303c-1e97-4c21-8dfc-6c6e9d09a9aa req-57297231-db02-42f0-ab5a-2cae749c18c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ccfed8-393e-4223-b2a8-7dbf8c77d3fe", "name": "network-vif-deleted", "tag": "96c2e36a-4761-4b9b-b02e-96b42f53d06e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:52.720449 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a71b90c9-3ce4-41e9-add7-24456a4c1d4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1681 microversion: 2.1 time: 0.580079 Aug 02 07:14:52.723182 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2762/5446] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:52 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1681 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:52.738932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-85e8303c-1e97-4c21-8dfc-6c6e9d09a9aa req-57297231-db02-42f0-ab5a-2cae749c18c3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:52.739377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-85e8303c-1e97-4c21-8dfc-6c6e9d09a9aa req-57297231-db02-42f0-ab5a-2cae749c18c3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:52.751754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9784ecf7-8214-42e3-9f37-feba1807d416 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:52.752367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9784ecf7-8214-42e3-9f37-feba1807d416 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:52.773667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9784ecf7-8214-42e3-9f37-feba1807d416 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:52.774394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9784ecf7-8214-42e3-9f37-feba1807d416 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:52.775327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9784ecf7-8214-42e3-9f37-feba1807d416 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:52.775923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9784ecf7-8214-42e3-9f37-feba1807d416 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:52.778868 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-85e8303c-1e97-4c21-8dfc-6c6e9d09a9aa req-57297231-db02-42f0-ab5a-2cae749c18c3 service nova] Creating event network-vif-deleted:96c2e36a-4761-4b9b-b02e-96b42f53d06e for instance 84ccfed8-393e-4223-b2a8-7dbf8c77d3fe on n-h1-851337-3 Aug 02 07:14:52.785456 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-85e8303c-1e97-4c21-8dfc-6c6e9d09a9aa req-57297231-db02-42f0-ab5a-2cae749c18c3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091057 Aug 02 07:14:52.786113 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2685/5447] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:14:53.052414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fff1b6f0-5141-41cf-8ba5-cdfc86fc28bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:53.056611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fff1b6f0-5141-41cf-8ba5-cdfc86fc28bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:53.073222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fff1b6f0-5141-41cf-8ba5-cdfc86fc28bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:53.079325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fff1b6f0-5141-41cf-8ba5-cdfc86fc28bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:53.080479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fff1b6f0-5141-41cf-8ba5-cdfc86fc28bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:53.082305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fff1b6f0-5141-41cf-8ba5-cdfc86fc28bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:53.194813 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fff1b6f0-5141-41cf-8ba5-cdfc86fc28bf tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536/action" status: 200 len: 38581 microversion: 2.1 time: 0.148011 Aug 02 07:14:53.196282 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2686/5448] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:14:53 2022] POST /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536/action => generated 38581 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 07:14:53.252471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9784ecf7-8214-42e3-9f37-feba1807d416 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:53.272357 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9784ecf7-8214-42e3-9f37-feba1807d416 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1426 microversion: 2.1 time: 0.536581 Aug 02 07:14:53.273358 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2763/5449] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:52 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1426 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:53.715054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f0c8dc0b-d05b-429e-b0c0-166001d46083 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:53.715961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f0c8dc0b-d05b-429e-b0c0-166001d46083 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:53.728659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0c8dc0b-d05b-429e-b0c0-166001d46083 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:53.730945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0c8dc0b-d05b-429e-b0c0-166001d46083 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:53.732550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0c8dc0b-d05b-429e-b0c0-166001d46083 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:53.733177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0c8dc0b-d05b-429e-b0c0-166001d46083 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:54.298390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-17cba428-97c9-4dbb-8fde-402c844be547 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:54.300140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-17cba428-97c9-4dbb-8fde-402c844be547 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:54.308868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17cba428-97c9-4dbb-8fde-402c844be547 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:54.310119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17cba428-97c9-4dbb-8fde-402c844be547 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:54.311302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17cba428-97c9-4dbb-8fde-402c844be547 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:54.312211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17cba428-97c9-4dbb-8fde-402c844be547 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:54.503127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f0c8dc0b-d05b-429e-b0c0-166001d46083 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:54.513087 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f0c8dc0b-d05b-429e-b0c0-166001d46083 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1314 microversion: 2.1 time: 0.803889 Aug 02 07:14:54.520402 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2687/5450] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:53 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:54.961423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-aee07d36-77b9-4ddd-9bbc-bfe00777cde7 req-f89a821c-a688-412f-a11e-4faee04c18fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3", "name": "network-vif-plugged", "status": "completed", "tag": "5aeee3e0-ac9e-4c5d-8a71-64f5b5643227"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:54.982363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-aee07d36-77b9-4ddd-9bbc-bfe00777cde7 req-f89a821c-a688-412f-a11e-4faee04c18fb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:54.985197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-aee07d36-77b9-4ddd-9bbc-bfe00777cde7 req-f89a821c-a688-412f-a11e-4faee04c18fb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:54.998133 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-aee07d36-77b9-4ddd-9bbc-bfe00777cde7 req-f89a821c-a688-412f-a11e-4faee04c18fb service nova] Creating event network-vif-plugged:5aeee3e0-ac9e-4c5d-8a71-64f5b5643227 for instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 on n-h2-851337-3 Aug 02 07:14:55.005927 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-aee07d36-77b9-4ddd-9bbc-bfe00777cde7 req-f89a821c-a688-412f-a11e-4faee04c18fb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049328 Aug 02 07:14:55.007797 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2688/5451] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:14:55.281508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-17cba428-97c9-4dbb-8fde-402c844be547 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:55.297221 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-17cba428-97c9-4dbb-8fde-402c844be547 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1426 microversion: 2.1 time: 1.004398 Aug 02 07:14:55.298436 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2764/5452] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:54 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1426 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:55.441652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-6faeebc6-2450-4533-965e-736154fcf875 req-14cf75bb-fac3-4d03-828f-e5e59a9caf96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a2fd828-d443-4c27-b928-e791d83afadc", "tag": "05e52296-92ce-4276-9f17-830a87fb7799"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:55.464393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6faeebc6-2450-4533-965e-736154fcf875 req-14cf75bb-fac3-4d03-828f-e5e59a9caf96 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:55.465293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6faeebc6-2450-4533-965e-736154fcf875 req-14cf75bb-fac3-4d03-828f-e5e59a9caf96 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:55.488580 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-6faeebc6-2450-4533-965e-736154fcf875 req-14cf75bb-fac3-4d03-828f-e5e59a9caf96 service nova] Creating event network-changed:05e52296-92ce-4276-9f17-830a87fb7799 for instance 1a2fd828-d443-4c27-b928-e791d83afadc on n-h2-851337-3 Aug 02 07:14:55.497938 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-6faeebc6-2450-4533-965e-736154fcf875 req-14cf75bb-fac3-4d03-828f-e5e59a9caf96 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065262 Aug 02 07:14:55.499008 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2689/5453] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:14:55.537346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e9e3d028-4006-49ce-aa39-649473fb1190 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:55.538863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e9e3d028-4006-49ce-aa39-649473fb1190 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:55.550364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9e3d028-4006-49ce-aa39-649473fb1190 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:55.550904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9e3d028-4006-49ce-aa39-649473fb1190 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:55.551775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9e3d028-4006-49ce-aa39-649473fb1190 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:55.553140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9e3d028-4006-49ce-aa39-649473fb1190 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:56.044874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e9e3d028-4006-49ce-aa39-649473fb1190 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:56.057839 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e9e3d028-4006-49ce-aa39-649473fb1190 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1314 microversion: 2.1 time: 0.526483 Aug 02 07:14:56.059206 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2765/5454] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:55 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:56.322328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-97a27742-7cf8-4dd9-803c-7005044e8fd0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:56.323954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-97a27742-7cf8-4dd9-803c-7005044e8fd0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:56.354867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97a27742-7cf8-4dd9-803c-7005044e8fd0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:56.358582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97a27742-7cf8-4dd9-803c-7005044e8fd0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:56.359727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97a27742-7cf8-4dd9-803c-7005044e8fd0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:56.364941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97a27742-7cf8-4dd9-803c-7005044e8fd0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:56.376177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:56.929050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-97a27742-7cf8-4dd9-803c-7005044e8fd0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:56.933782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ba96c1f2-0713-40a4-bf93-34fb644d76c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:56.934411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ba96c1f2-0713-40a4-bf93-34fb644d76c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:56.938037 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-97a27742-7cf8-4dd9-803c-7005044e8fd0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1426 microversion: 2.1 time: 0.621394 Aug 02 07:14:56.948025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba96c1f2-0713-40a4-bf93-34fb644d76c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:56.949407 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2690/5455] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:56 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1426 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:56.958850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba96c1f2-0713-40a4-bf93-34fb644d76c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:56.965986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba96c1f2-0713-40a4-bf93-34fb644d76c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:56.967468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba96c1f2-0713-40a4-bf93-34fb644d76c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:57.056021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ba96c1f2-0713-40a4-bf93-34fb644d76c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:14:57.078826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a7d2cab7-30fb-4c77-92f1-e38666717334 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:57.079770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a7d2cab7-30fb-4c77-92f1-e38666717334 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:57.092369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7d2cab7-30fb-4c77-92f1-e38666717334 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:57.093158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7d2cab7-30fb-4c77-92f1-e38666717334 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:57.094262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7d2cab7-30fb-4c77-92f1-e38666717334 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:57.102739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7d2cab7-30fb-4c77-92f1-e38666717334 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:57.198784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:57.208182 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ba96c1f2-0713-40a4-bf93-34fb644d76c8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 204 len: 0 microversion: 2.1 time: 0.278372 Aug 02 07:14:57.210524 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2766/5456] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:14:56 2022] DELETE /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:14:57.236889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b00d7ae-4af8-4766-b997-d5e796ae24ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:57.239942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6b00d7ae-4af8-4766-b997-d5e796ae24ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:57.269046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b00d7ae-4af8-4766-b997-d5e796ae24ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:57.274706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b00d7ae-4af8-4766-b997-d5e796ae24ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:57.276423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b00d7ae-4af8-4766-b997-d5e796ae24ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:57.277046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b00d7ae-4af8-4766-b997-d5e796ae24ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:57.593420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a7d2cab7-30fb-4c77-92f1-e38666717334 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:57.599699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:57.601958 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a7d2cab7-30fb-4c77-92f1-e38666717334 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1314 microversion: 2.1 time: 0.527119 Aug 02 07:14:57.602545 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2691/5457] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:57 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:14:57.610783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-d895713b-e8e3-43fc-bdb4-72be01cbac4e req-5cc271d9-75a8-4485-ab71-c087912d9816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b35b7f-de5b-4d19-bd55-55d7b06b3536", "tag": "9b7ae46e-d7eb-481e-947a-5b8889d64199"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:14:57.636838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d895713b-e8e3-43fc-bdb4-72be01cbac4e req-5cc271d9-75a8-4485-ab71-c087912d9816 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:57.638407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d895713b-e8e3-43fc-bdb4-72be01cbac4e req-5cc271d9-75a8-4485-ab71-c087912d9816 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:57.671517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=12 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:57.674449 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-d895713b-e8e3-43fc-bdb4-72be01cbac4e req-5cc271d9-75a8-4485-ab71-c087912d9816 service nova] Creating event network-changed:9b7ae46e-d7eb-481e-947a-5b8889d64199 for instance 03b35b7f-de5b-4d19-bd55-55d7b06b3536 on n-h1-851337-3 Aug 02 07:14:57.687741 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-d895713b-e8e3-43fc-bdb4-72be01cbac4e req-5cc271d9-75a8-4485-ab71-c087912d9816 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080156 Aug 02 07:14:57.688880 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2692/5458] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:14:57.809258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6b00d7ae-4af8-4766-b997-d5e796ae24ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:57.818143 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6b00d7ae-4af8-4766-b997-d5e796ae24ba tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1687 microversion: 2.1 time: 0.602609 Aug 02 07:14:57.830099 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2767/5459] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:57 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1687 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:57.972670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1b385aa0-e2e8-4b3f-92de-61bf8b166bcb tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:57.973292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1b385aa0-e2e8-4b3f-92de-61bf8b166bcb tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:57.983273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b385aa0-e2e8-4b3f-92de-61bf8b166bcb tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:57.983770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b385aa0-e2e8-4b3f-92de-61bf8b166bcb tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:57.984530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b385aa0-e2e8-4b3f-92de-61bf8b166bcb tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:57.987162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b385aa0-e2e8-4b3f-92de-61bf8b166bcb tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:58.284190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1b385aa0-e2e8-4b3f-92de-61bf8b166bcb tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:58.296436 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1b385aa0-e2e8-4b3f-92de-61bf8b166bcb tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1607 microversion: 2.1 time: 0.328282 Aug 02 07:14:58.311991 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2693/5460] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:57 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1607 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:58.317707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ddcd6f2-1188-40f5-b991-763db5847cc1 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:58.326315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9ddcd6f2-1188-40f5-b991-763db5847cc1 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:58.335435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=12 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:58.355592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ddcd6f2-1188-40f5-b991-763db5847cc1 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:58.364251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ddcd6f2-1188-40f5-b991-763db5847cc1 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:58.365100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ddcd6f2-1188-40f5-b991-763db5847cc1 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:58.365528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ddcd6f2-1188-40f5-b991-763db5847cc1 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:58.625266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cc5acf94-911d-4188-b021-97feae587c2c tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:58.625911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cc5acf94-911d-4188-b021-97feae587c2c tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:58.645328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc5acf94-911d-4188-b021-97feae587c2c tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:58.645789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc5acf94-911d-4188-b021-97feae587c2c tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:58.646628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc5acf94-911d-4188-b021-97feae587c2c tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:58.647076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cc5acf94-911d-4188-b021-97feae587c2c tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:59.344966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9ddcd6f2-1188-40f5-b991-763db5847cc1 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:59.363688 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9ddcd6f2-1188-40f5-b991-763db5847cc1 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1607 microversion: 2.1 time: 1.049944 Aug 02 07:14:59.365709 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2768/5461] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:58 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1607 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:59.372307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-849e1696-3f32-4f90-80d9-7b05bf6f76e7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:59.373150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-849e1696-3f32-4f90-80d9-7b05bf6f76e7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:59.392983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-849e1696-3f32-4f90-80d9-7b05bf6f76e7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:59.393605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-849e1696-3f32-4f90-80d9-7b05bf6f76e7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:59.395290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cc5acf94-911d-4188-b021-97feae587c2c tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:59.397698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-849e1696-3f32-4f90-80d9-7b05bf6f76e7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:59.398401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-849e1696-3f32-4f90-80d9-7b05bf6f76e7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:59.406363 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cc5acf94-911d-4188-b021-97feae587c2c tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1314 microversion: 2.1 time: 0.785864 Aug 02 07:14:59.410237 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2694/5462] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:58 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:59.426619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-009b4848-8fee-4f74-9127-3aef444edd3f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:14:59.427609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-009b4848-8fee-4f74-9127-3aef444edd3f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:14:59.437478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-009b4848-8fee-4f74-9127-3aef444edd3f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:59.438947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-009b4848-8fee-4f74-9127-3aef444edd3f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:59.440258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-009b4848-8fee-4f74-9127-3aef444edd3f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:14:59.441741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-009b4848-8fee-4f74-9127-3aef444edd3f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:14:59.444577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:14:59.725877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-849e1696-3f32-4f90-80d9-7b05bf6f76e7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:59.734543 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-849e1696-3f32-4f90-80d9-7b05bf6f76e7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1687 microversion: 2.1 time: 0.366344 Aug 02 07:14:59.735574 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2769/5463] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:59 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1687 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:14:59.753045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-009b4848-8fee-4f74-9127-3aef444edd3f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:14:59.764161 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-009b4848-8fee-4f74-9127-3aef444edd3f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1607 microversion: 2.1 time: 0.352024 Aug 02 07:14:59.765686 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2695/5464] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:14:59 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1607 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:00.435767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-15af0af7-c27f-4f60-bf76-1cd57f067cac tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:00.436344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-15af0af7-c27f-4f60-bf76-1cd57f067cac tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:00.445363 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15af0af7-c27f-4f60-bf76-1cd57f067cac tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:00.445846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15af0af7-c27f-4f60-bf76-1cd57f067cac tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:00.446628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15af0af7-c27f-4f60-bf76-1cd57f067cac tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:00.447064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15af0af7-c27f-4f60-bf76-1cd57f067cac tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:00.756783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-194fcd73-36a0-42b8-8125-fdfef7472a37 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:00.757293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-194fcd73-36a0-42b8-8125-fdfef7472a37 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:00.773158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-194fcd73-36a0-42b8-8125-fdfef7472a37 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:00.773930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-194fcd73-36a0-42b8-8125-fdfef7472a37 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:00.774903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-194fcd73-36a0-42b8-8125-fdfef7472a37 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:00.775503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-194fcd73-36a0-42b8-8125-fdfef7472a37 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:00.808668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-15af0af7-c27f-4f60-bf76-1cd57f067cac tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:00.820382 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-15af0af7-c27f-4f60-bf76-1cd57f067cac tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1314 microversion: 2.1 time: 0.388366 Aug 02 07:15:00.823718 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2770/5465] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:00 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:01.130567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-194fcd73-36a0-42b8-8125-fdfef7472a37 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:01.143353 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-194fcd73-36a0-42b8-8125-fdfef7472a37 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 200 len: 1687 microversion: 2.1 time: 0.390601 Aug 02 07:15:01.154497 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2696/5466] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:00 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 1687 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:01.205430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-a95178fb-d0e8-4e4b-9933-22ec228751b3 req-392065d1-96c7-449c-9ae5-9c1bd3cd1517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2fd828-d443-4c27-b928-e791d83afadc", "name": "network-vif-plugged", "status": "completed", "tag": "05e52296-92ce-4276-9f17-830a87fb7799"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:01.218614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a95178fb-d0e8-4e4b-9933-22ec228751b3 req-392065d1-96c7-449c-9ae5-9c1bd3cd1517 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:01.219454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a95178fb-d0e8-4e4b-9933-22ec228751b3 req-392065d1-96c7-449c-9ae5-9c1bd3cd1517 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:01.250538 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-a95178fb-d0e8-4e4b-9933-22ec228751b3 req-392065d1-96c7-449c-9ae5-9c1bd3cd1517 service nova] Creating event network-vif-plugged:05e52296-92ce-4276-9f17-830a87fb7799 for instance 1a2fd828-d443-4c27-b928-e791d83afadc on n-h2-851337-3 Aug 02 07:15:01.262757 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-a95178fb-d0e8-4e4b-9933-22ec228751b3 req-392065d1-96c7-449c-9ae5-9c1bd3cd1517 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061587 Aug 02 07:15:01.266913 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2771/5467] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:01.468139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a3769f4e-d73d-439e-8054-103f97f80e83 req-dde721a7-bffb-49b8-b52c-0f0c12a9a798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b35b7f-de5b-4d19-bd55-55d7b06b3536", "name": "network-vif-deleted", "tag": "9b7ae46e-d7eb-481e-947a-5b8889d64199"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:01.507548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a3769f4e-d73d-439e-8054-103f97f80e83 req-dde721a7-bffb-49b8-b52c-0f0c12a9a798 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:01.508010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a3769f4e-d73d-439e-8054-103f97f80e83 req-dde721a7-bffb-49b8-b52c-0f0c12a9a798 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:01.536441 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a3769f4e-d73d-439e-8054-103f97f80e83 req-dde721a7-bffb-49b8-b52c-0f0c12a9a798 service nova] Creating event network-vif-deleted:9b7ae46e-d7eb-481e-947a-5b8889d64199 for instance 03b35b7f-de5b-4d19-bd55-55d7b06b3536 on n-h1-851337-3 Aug 02 07:15:01.551832 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a3769f4e-d73d-439e-8054-103f97f80e83 req-dde721a7-bffb-49b8-b52c-0f0c12a9a798 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087861 Aug 02 07:15:01.552768 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2697/5468] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:01.845388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-488e47dc-4425-4fb3-9b87-815fedde7506 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:01.848331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-488e47dc-4425-4fb3-9b87-815fedde7506 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:01.869862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-488e47dc-4425-4fb3-9b87-815fedde7506 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:01.873583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-488e47dc-4425-4fb3-9b87-815fedde7506 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:01.879054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-488e47dc-4425-4fb3-9b87-815fedde7506 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:01.879513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-488e47dc-4425-4fb3-9b87-815fedde7506 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:02.167486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d52bcb40-9a5a-4c5c-93a9-63d82164b2be tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:02.168735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d52bcb40-9a5a-4c5c-93a9-63d82164b2be tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: 03b35b7f-de5b-4d19-bd55-55d7b06b3536] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:02.176182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d52bcb40-9a5a-4c5c-93a9-63d82164b2be tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:02.176638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d52bcb40-9a5a-4c5c-93a9-63d82164b2be tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:02.177402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d52bcb40-9a5a-4c5c-93a9-63d82164b2be tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:02.177832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d52bcb40-9a5a-4c5c-93a9-63d82164b2be tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:02.206161 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-d52bcb40-9a5a-4c5c-93a9-63d82164b2be tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] HTTP exception thrown: Instance 03b35b7f-de5b-4d19-bd55-55d7b06b3536 could not be found. Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d52bcb40-9a5a-4c5c-93a9-63d82164b2be tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Request method failure captured: Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 HTTP/1.1 Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Mzd332IyHs8WEC33t3YUNz7sq1ptUIAHfE__Qv8aBPsjD5fgOPUMjL9QNhBtDeuMmcahY94wYnuhI_ZDX9lnldCseQtzbltYf6Z0vf9AbPytvHxBPNUlbLU5KkXMkrC0xu54w449QvxMiAm33sZhpVGvyWLihgN3WhItHGPM7rvGsc Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: bfa05afa69e04974ad3de049c511c674 Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1158041327 Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bfa05afa69e04974ad3de049c511c674"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bfa05afa69e04974ad3de049c511c674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bfa05afa69e04974ad3de049c511c674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bfa05afa69e04974ad3de049c511c674"}]}] Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1158041327 Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: bfa05afa69e04974ad3de049c511c674 Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1158041327 Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestNetworkAdvancedServerOps-1158041327-project Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: a44367c6be00413eb7b6c79272448cf4 Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1158041327-project Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 03b35b7f-de5b-4d19-bd55-55d7b06b3536 could not be found. Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '03b35b7f-de5b-4d19-bd55-55d7b06b3536'} Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b35b7f-de5b-4d19-bd55-55d7b06b3536 could not be found. Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b35b7f-de5b-4d19-bd55-55d7b06b3536 could not be found. Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:02.207861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:02.211646 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:02.211646 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:02.211646 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:02.211646 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:02.211646 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:15:02.211646 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:15:02.211646 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b35b7f-de5b-4d19-bd55-55d7b06b3536 could not be found. Aug 02 07:15:02.211646 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:02.211646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d52bcb40-9a5a-4c5c-93a9-63d82164b2be tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Returning 404 to user: Instance 03b35b7f-de5b-4d19-bd55-55d7b06b3536 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:02.211646 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d52bcb40-9a5a-4c5c-93a9-63d82164b2be tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536" status: 404 len: 111 microversion: 2.1 time: 0.046936 Aug 02 07:15:02.213643 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2698/5469] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:02 2022] GET /compute/v2.1/servers/03b35b7f-de5b-4d19-bd55-55d7b06b3536 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:15:02.510914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-488e47dc-4425-4fb3-9b87-815fedde7506 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:02.526935 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-488e47dc-4425-4fb3-9b87-815fedde7506 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1314 microversion: 2.1 time: 0.686390 Aug 02 07:15:02.527925 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2772/5470] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:01 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1314 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:03.560694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e7f5ea9c-773b-41c5-8c48-83781c2c101e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:03.561468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e7f5ea9c-773b-41c5-8c48-83781c2c101e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:03.580021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7f5ea9c-773b-41c5-8c48-83781c2c101e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:03.582559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7f5ea9c-773b-41c5-8c48-83781c2c101e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:03.592349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7f5ea9c-773b-41c5-8c48-83781c2c101e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:03.593114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7f5ea9c-773b-41c5-8c48-83781c2c101e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:04.149961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e7f5ea9c-773b-41c5-8c48-83781c2c101e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:04.157836 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e7f5ea9c-773b-41c5-8c48-83781c2c101e tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1501 microversion: 2.1 time: 0.600985 Aug 02 07:15:04.159024 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2699/5471] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:03 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1501 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:04.179591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-be87b570-7737-4c80-86e7-a5258029b99a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:04.182099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-be87b570-7737-4c80-86e7-a5258029b99a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:04.191630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be87b570-7737-4c80-86e7-a5258029b99a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:04.192058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be87b570-7737-4c80-86e7-a5258029b99a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:04.192838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be87b570-7737-4c80-86e7-a5258029b99a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:04.193294 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be87b570-7737-4c80-86e7-a5258029b99a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:04.223115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-be87b570-7737-4c80-86e7-a5258029b99a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lazy-loading 'flavor' on Instance uuid 1a2fd828-d443-4c27-b928-e791d83afadc {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:15:04.383824 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-be87b570-7737-4c80-86e7-a5258029b99a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "POST /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc/action" status: 200 len: 32 microversion: 2.1 time: 0.207130 Aug 02 07:15:04.391696 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2773/5472] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:15:04 2022] POST /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc/action => generated 32 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 07:15:04.394916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f2c177b7-4cd9-44aa-a196-88bc302d6e9a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:04.396137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f2c177b7-4cd9-44aa-a196-88bc302d6e9a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:04.410429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2c177b7-4cd9-44aa-a196-88bc302d6e9a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:04.410936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2c177b7-4cd9-44aa-a196-88bc302d6e9a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:04.414588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2c177b7-4cd9-44aa-a196-88bc302d6e9a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:04.416451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2c177b7-4cd9-44aa-a196-88bc302d6e9a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:04.451463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e463499d-bd08-4d3f-aeda-e0ac75a652cb req-4ca2255a-5cbd-4efb-bfc5-a27f033f5193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3", "tag": "5aeee3e0-ac9e-4c5d-8a71-64f5b5643227"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:04.483396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e463499d-bd08-4d3f-aeda-e0ac75a652cb req-4ca2255a-5cbd-4efb-bfc5-a27f033f5193 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:04.484143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e463499d-bd08-4d3f-aeda-e0ac75a652cb req-4ca2255a-5cbd-4efb-bfc5-a27f033f5193 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:04.504683 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e463499d-bd08-4d3f-aeda-e0ac75a652cb req-4ca2255a-5cbd-4efb-bfc5-a27f033f5193 service nova] Creating event network-changed:5aeee3e0-ac9e-4c5d-8a71-64f5b5643227 for instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 on n-h2-851337-3 Aug 02 07:15:04.510312 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e463499d-bd08-4d3f-aeda-e0ac75a652cb req-4ca2255a-5cbd-4efb-bfc5-a27f033f5193 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066001 Aug 02 07:15:04.511534 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2774/5473] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:15:05.266929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f2c177b7-4cd9-44aa-a196-88bc302d6e9a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:05.281434 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f2c177b7-4cd9-44aa-a196-88bc302d6e9a tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.890165 Aug 02 07:15:05.282884 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2700/5474] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:04 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:06.303655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c576a0a-cf5c-4475-8a2e-f5f6ed690608 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:06.304358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9c576a0a-cf5c-4475-8a2e-f5f6ed690608 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:06.314794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c576a0a-cf5c-4475-8a2e-f5f6ed690608 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:06.315271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c576a0a-cf5c-4475-8a2e-f5f6ed690608 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:06.316065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c576a0a-cf5c-4475-8a2e-f5f6ed690608 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:06.324381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c576a0a-cf5c-4475-8a2e-f5f6ed690608 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:06.693649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9c576a0a-cf5c-4475-8a2e-f5f6ed690608 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:06.726701 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9c576a0a-cf5c-4475-8a2e-f5f6ed690608 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.406194 Aug 02 07:15:06.727755 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2775/5475] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:06 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:07.753206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d27ab119-4c91-4da9-8438-a326c524a1f1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:07.754534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d27ab119-4c91-4da9-8438-a326c524a1f1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:07.768535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d27ab119-4c91-4da9-8438-a326c524a1f1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:07.772326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d27ab119-4c91-4da9-8438-a326c524a1f1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:07.773375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d27ab119-4c91-4da9-8438-a326c524a1f1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:07.776269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d27ab119-4c91-4da9-8438-a326c524a1f1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:08.208647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d27ab119-4c91-4da9-8438-a326c524a1f1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:08.225463 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d27ab119-4c91-4da9-8438-a326c524a1f1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.476704 Aug 02 07:15:08.240633 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2701/5476] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:07 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:09.247411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4bbc54b1-3738-494d-b082-3b16d187d211 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:09.247876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4bbc54b1-3738-494d-b082-3b16d187d211 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:09.266864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bbc54b1-3738-494d-b082-3b16d187d211 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:09.267617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bbc54b1-3738-494d-b082-3b16d187d211 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:09.268617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bbc54b1-3738-494d-b082-3b16d187d211 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:09.270415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bbc54b1-3738-494d-b082-3b16d187d211 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:10.388960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4bbc54b1-3738-494d-b082-3b16d187d211 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:10.402575 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4bbc54b1-3738-494d-b082-3b16d187d211 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 1.159098 Aug 02 07:15:10.403859 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2776/5477] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:09 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:11.439282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-13a2cb2b-a3f0-4728-9891-236fcb86116b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:11.440152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-13a2cb2b-a3f0-4728-9891-236fcb86116b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:11.458816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13a2cb2b-a3f0-4728-9891-236fcb86116b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:11.460436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13a2cb2b-a3f0-4728-9891-236fcb86116b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:11.461696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13a2cb2b-a3f0-4728-9891-236fcb86116b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:11.462683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13a2cb2b-a3f0-4728-9891-236fcb86116b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:12.070333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-13a2cb2b-a3f0-4728-9891-236fcb86116b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:12.081337 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-13a2cb2b-a3f0-4728-9891-236fcb86116b tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.658783 Aug 02 07:15:12.102388 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2702/5478] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:11 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:12.979361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ebfb6d39-92eb-486f-8086-df1ed189734b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '.version_select at 0x7f927a4dfc10>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:13.037669 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ebfb6d39-92eb-486f-8086-df1ed189734b tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1802691961" status: 202 len: 0 microversion: 2.1 time: 0.063535 Aug 02 07:15:13.038314 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2777/5479] 10.222.0.79 () {58 vars in 1284 bytes} [Tue Aug 2 07:15:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1802691961 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:15:13.079337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a3a26d6d-5be7-40aa-a5fd-7228de666a25 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'create', calling method: .version_select at 0x7f927bd1f550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1127880425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlqzXjltPStmECZVowlM0kHB9jjHOeoNCHqPnYcqTr9WL+fIpCGypqo6nYWGB37sO1jVX5lNUGNv79Bf8Dt+iWB7PYwB3MvDMiFlZY9Iyav4OfOPVhgN9grnddvQm22oQ=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:13.115403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ae65e08a-20ed-4165-b769-fd66f91ae2df tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:13.115403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae65e08a-20ed-4165-b769-fd66f91ae2df tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:13.116486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a3a26d6d-5be7-40aa-a5fd-7228de666a25 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for project bfa05afa69e04974ad3de049c511c674. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:15:13.127366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a3a26d6d-5be7-40aa-a5fd-7228de666a25 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for user a44367c6be00413eb7b6c79272448cf4 and project bfa05afa69e04974ad3de049c511c674. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:15:13.131955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae65e08a-20ed-4165-b769-fd66f91ae2df tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:13.132658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae65e08a-20ed-4165-b769-fd66f91ae2df tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:13.133608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae65e08a-20ed-4165-b769-fd66f91ae2df tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:13.134300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae65e08a-20ed-4165-b769-fd66f91ae2df tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:13.179468 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a3a26d6d-5be7-40aa-a5fd-7228de666a25 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.103988 Aug 02 07:15:13.196640 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2703/5480] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:15:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:15:14.027441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ae65e08a-20ed-4165-b769-fd66f91ae2df tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:14.035851 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ae65e08a-20ed-4165-b769-fd66f91ae2df tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.925355 Aug 02 07:15:14.047529 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2778/5481] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:13 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:15.061589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a0f67c7a-d92c-4d3c-a686-dfc764645a48 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:15.064390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a0f67c7a-d92c-4d3c-a686-dfc764645a48 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:15.083784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a0f67c7a-d92c-4d3c-a686-dfc764645a48 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:15.084256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a0f67c7a-d92c-4d3c-a686-dfc764645a48 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:15.085161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a0f67c7a-d92c-4d3c-a686-dfc764645a48 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:15.085595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a0f67c7a-d92c-4d3c-a686-dfc764645a48 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:15.742216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a0f67c7a-d92c-4d3c-a686-dfc764645a48 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:15.754689 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a0f67c7a-d92c-4d3c-a686-dfc764645a48 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.699318 Aug 02 07:15:15.758590 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2704/5482] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:15 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:16.781728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-57395506-882d-4b57-86a7-8a3845133226 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:16.782454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-57395506-882d-4b57-86a7-8a3845133226 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:16.790033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57395506-882d-4b57-86a7-8a3845133226 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:16.790775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57395506-882d-4b57-86a7-8a3845133226 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:16.791766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57395506-882d-4b57-86a7-8a3845133226 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:16.792349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57395506-882d-4b57-86a7-8a3845133226 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:17.651697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-57395506-882d-4b57-86a7-8a3845133226 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:17.665296 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-57395506-882d-4b57-86a7-8a3845133226 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.883734 Aug 02 07:15:17.666285 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2779/5483] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:16 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:18.692792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-229399a7-7404-4c0a-80da-92d2d40acaa2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:18.694127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-229399a7-7404-4c0a-80da-92d2d40acaa2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:18.712441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-229399a7-7404-4c0a-80da-92d2d40acaa2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:18.716277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-229399a7-7404-4c0a-80da-92d2d40acaa2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:18.718361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-229399a7-7404-4c0a-80da-92d2d40acaa2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:18.720144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-229399a7-7404-4c0a-80da-92d2d40acaa2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:19.082184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-517d0fef-6e72-40f0-ade4-69b1e674a786 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:19.084625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-517d0fef-6e72-40f0-ade4-69b1e674a786 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:19.126960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-517d0fef-6e72-40f0-ade4-69b1e674a786 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:19.127548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-517d0fef-6e72-40f0-ade4-69b1e674a786 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:19.128439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-517d0fef-6e72-40f0-ade4-69b1e674a786 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:19.128875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-517d0fef-6e72-40f0-ade4-69b1e674a786 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:19.186395 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-517d0fef-6e72-40f0-ade4-69b1e674a786 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.109087 Aug 02 07:15:19.193442 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2780/5484] 10.222.0.79 () {60 vars in 1343 bytes} [Tue Aug 2 07:15:19 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:19.274149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4ae4f4ed-ddb5-48c3-8979-2bcbb03b49a5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:19.274926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4ae4f4ed-ddb5-48c3-8979-2bcbb03b49a5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:19.282308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ae4f4ed-ddb5-48c3-8979-2bcbb03b49a5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:19.282986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ae4f4ed-ddb5-48c3-8979-2bcbb03b49a5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:19.284942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ae4f4ed-ddb5-48c3-8979-2bcbb03b49a5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:19.285569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ae4f4ed-ddb5-48c3-8979-2bcbb03b49a5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:19.323869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4ae4f4ed-ddb5-48c3-8979-2bcbb03b49a5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:15:19.485601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-229399a7-7404-4c0a-80da-92d2d40acaa2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:19.487870 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4ae4f4ed-ddb5-48c3-8979-2bcbb03b49a5 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 204 len: 0 microversion: 2.20 time: 0.217643 Aug 02 07:15:19.497492 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-229399a7-7404-4c0a-80da-92d2d40acaa2 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.808626 Aug 02 07:15:19.503577 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2781/5485] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 07:15:19 2022] DELETE /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:15:19.504792 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2705/5486] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:18 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:19.527295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-15013af3-76fd-426b-82f2-5b87231e6eec tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:19.537147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-15013af3-76fd-426b-82f2-5b87231e6eec tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:19.561128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15013af3-76fd-426b-82f2-5b87231e6eec tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:19.567821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15013af3-76fd-426b-82f2-5b87231e6eec tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:19.569405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15013af3-76fd-426b-82f2-5b87231e6eec tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:19.570232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15013af3-76fd-426b-82f2-5b87231e6eec tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:20.495470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-15013af3-76fd-426b-82f2-5b87231e6eec tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:20.508465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-15013af3-76fd-426b-82f2-5b87231e6eec tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:20.510456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-15013af3-76fd-426b-82f2-5b87231e6eec tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:20.511892 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-15013af3-76fd-426b-82f2-5b87231e6eec tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1720 microversion: 2.20 time: 1.006766 Aug 02 07:15:20.522541 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2782/5487] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:15:19 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1720 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:15:20.525568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fb9ec746-7749-4402-935d-1056403f5659 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:20.526207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fb9ec746-7749-4402-935d-1056403f5659 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:20.529293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:20.539260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb9ec746-7749-4402-935d-1056403f5659 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:20.539713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb9ec746-7749-4402-935d-1056403f5659 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:20.540549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb9ec746-7749-4402-935d-1056403f5659 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:20.541090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb9ec746-7749-4402-935d-1056403f5659 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:21.162725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fb9ec746-7749-4402-935d-1056403f5659 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:21.175975 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fb9ec746-7749-4402-935d-1056403f5659 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.654222 Aug 02 07:15:21.183691 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2706/5488] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:20 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:21.535862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b7e162b6-f433-4160-b479-102ab8f6252a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:21.537401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b7e162b6-f433-4160-b479-102ab8f6252a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:21.553655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7e162b6-f433-4160-b479-102ab8f6252a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:21.560127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7e162b6-f433-4160-b479-102ab8f6252a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:21.566285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7e162b6-f433-4160-b479-102ab8f6252a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:21.568092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7e162b6-f433-4160-b479-102ab8f6252a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:21.744354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-434805724", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "ee4da363-e613-4759-9949-ed224c5e3dfe"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:21.882215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] validate_networks() for [('ee4da363-e613-4759-9949-ed224c5e3dfe', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:15:22.291104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b7e162b6-f433-4160-b479-102ab8f6252a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:22.304600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b7e162b6-f433-4160-b479-102ab8f6252a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:22.311182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b7e162b6-f433-4160-b479-102ab8f6252a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5865db38184a5c85b48def8ef9cf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ee4714199b427db6ee9e17d6fd93dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:22.316624 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b7e162b6-f433-4160-b479-102ab8f6252a tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 200 len: 1720 microversion: 2.20 time: 0.784726 Aug 02 07:15:22.317849 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2707/5489] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:15:21 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 1720 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:15:22.329321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9e24054c-c57c-4741-928f-2deb909eca47 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:22.341332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9e24054c-c57c-4741-928f-2deb909eca47 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:22.349347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e24054c-c57c-4741-928f-2deb909eca47 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:22.350208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e24054c-c57c-4741-928f-2deb909eca47 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:22.351230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e24054c-c57c-4741-928f-2deb909eca47 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:22.351893 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e24054c-c57c-4741-928f-2deb909eca47 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:22.817313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9e24054c-c57c-4741-928f-2deb909eca47 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:22.829751 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9e24054c-c57c-4741-928f-2deb909eca47 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.510443 Aug 02 07:15:22.834802 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2708/5490] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:22 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:23.139576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:23.236270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-155141462", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:23.338393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] validate_networks() for [('0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:15:25.227731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:15:25.228473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:15:25.228865 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:15:25.229532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:15:25.230569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:15:25.249475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:25.250292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:25.251525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:25.253258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:25.296202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Getting quotas for project 78c011bbdb5c4b16916c6d08bcd223ab. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:15:25.310042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Getting quotas for user c4b2ca5524d246f6927f6946f885b3e3 and project 78c011bbdb5c4b16916c6d08bcd223ab. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:15:25.350822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:15:25.358613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:15:25.477077 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b1994cf6-0935-41ee-ac39-921bc42cfb24 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.151230 Aug 02 07:15:25.484773 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2783/5491] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:15:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:15:25.491227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b2847cc3-c1a2-431d-817a-9a417edfe920 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:25.492042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b2847cc3-c1a2-431d-817a-9a417edfe920 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:25.502832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2847cc3-c1a2-431d-817a-9a417edfe920 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:25.503291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2847cc3-c1a2-431d-817a-9a417edfe920 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:25.504080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2847cc3-c1a2-431d-817a-9a417edfe920 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:25.504513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2847cc3-c1a2-431d-817a-9a417edfe920 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:25.584466 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-b2847cc3-c1a2-431d-817a-9a417edfe920 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] HTTP exception thrown: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b2847cc3-c1a2-431d-817a-9a417edfe920 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Request method failure captured: Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b HTTP/1.1 Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MykMNz6zTP3YmWmN8RFvg4OuoQ7ofP79l7lC8TxwC-OXzZDZidEgPJRv9-ffdPPw8o2qbzgmjbG2TUCMcLDsOKrX4Dsu-x-EDiGY1JC0T6Cs5bYOW4hgrN8stmhVKgexGtvYBtG5q_VMETNRzsABzIfAOFDItvpYy5GcNmYHJa-PzE Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 15ee4714199b427db6ee9e17d6fd93dc Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/15ee4714199b427db6ee9e17d6fd93dc"}]}] Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 15ee4714199b427db6ee9e17d6fd93dc Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AttachVolumeShelveTestJSON-1804433436-project Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 2b5865db38184a5c85b48def8ef9cf97 Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1804433436-project Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '8979e165-921d-4e06-92fc-dba834a53b1b'} Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:25.588125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:25.592921 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:25.592921 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:25.592921 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:25.592921 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:25.592921 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:15:25.592921 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:15:25.592921 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:25.592921 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:25.592921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b2847cc3-c1a2-431d-817a-9a417edfe920 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Returning 404 to user: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:25.592921 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b2847cc3-c1a2-431d-817a-9a417edfe920 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 404 len: 111 microversion: 2.20 time: 0.103564 Aug 02 07:15:25.595899 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2784/5492] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:15:25 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:15:25.603169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dfdf562b-afec-411c-a599-a211e630efa6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:25.604193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dfdf562b-afec-411c-a599-a211e630efa6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:25.618911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dfdf562b-afec-411c-a599-a211e630efa6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:25.620316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dfdf562b-afec-411c-a599-a211e630efa6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:25.621123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dfdf562b-afec-411c-a599-a211e630efa6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:25.621755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dfdf562b-afec-411c-a599-a211e630efa6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:26.484926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:15:26.486086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:15:26.487082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:15:26.488119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:15:26.488728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:15:26.509988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:26.512677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:26.513683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:26.514161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:26.583305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:26.614960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Getting quotas for project 2ebb8ddce03f488b8842589c2622366a. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:15:26.629918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Getting quotas for user 4daee0d1130940a7bd83c339ea56cd3b and project 2ebb8ddce03f488b8842589c2622366a. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:15:26.673828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:15:26.684624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:15:26.822792 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-71660997-3c4a-4f29-9ef9-12825111d1be tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.734128 Aug 02 07:15:26.827353 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2709/5493] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:15:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 07:15:26.871918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e6a62821-9ce5-4b8c-ad93-32d2264cc438 req-81b0355b-bde1-417c-bcd8-f83d88fafb2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8979e165-921d-4e06-92fc-dba834a53b1b", "name": "network-vif-deleted", "tag": "768fa789-2440-4838-8853-20f834aabcea"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:26.928429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e6a62821-9ce5-4b8c-ad93-32d2264cc438 req-81b0355b-bde1-417c-bcd8-f83d88fafb2c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:26.933390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e6a62821-9ce5-4b8c-ad93-32d2264cc438 req-81b0355b-bde1-417c-bcd8-f83d88fafb2c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:26.963425 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e6a62821-9ce5-4b8c-ad93-32d2264cc438 req-81b0355b-bde1-417c-bcd8-f83d88fafb2c service nova] Creating event network-vif-deleted:768fa789-2440-4838-8853-20f834aabcea for instance 8979e165-921d-4e06-92fc-dba834a53b1b on n-h1-851337-3 Aug 02 07:15:26.972081 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e6a62821-9ce5-4b8c-ad93-32d2264cc438 req-81b0355b-bde1-417c-bcd8-f83d88fafb2c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143055 Aug 02 07:15:26.973643 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2710/5494] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:26.980118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f6523bb8-a574-46d2-90ae-684fc42885dd tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:26.983848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f6523bb8-a574-46d2-90ae-684fc42885dd tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:26.994349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6523bb8-a574-46d2-90ae-684fc42885dd tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:26.995116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6523bb8-a574-46d2-90ae-684fc42885dd tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:26.996239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6523bb8-a574-46d2-90ae-684fc42885dd tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:27.006222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f6523bb8-a574-46d2-90ae-684fc42885dd tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:27.163472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dfdf562b-afec-411c-a599-a211e630efa6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:27.188240 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dfdf562b-afec-411c-a599-a211e630efa6 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 1.590923 Aug 02 07:15:27.192292 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2785/5495] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:25 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:27.208083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1272bacf-3f2a-4e12-a797-10b6e8728e19 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '.version_select at 0x7f9279e7e280>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:27.271543 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1272bacf-3f2a-4e12-a797-10b6e8728e19 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994474532" status: 204 len: 0 microversion: 2.20 time: 0.076405 Aug 02 07:15:27.277829 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2786/5496] 10.222.0.79 () {60 vars in 1259 bytes} [Tue Aug 2 07:15:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994474532 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:15:27.290728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cdabce92-b337-4a2c-bb9e-3711587b829c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:27.291398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cdabce92-b337-4a2c-bb9e-3711587b829c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:27.399327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f6523bb8-a574-46d2-90ae-684fc42885dd tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:27.431438 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f6523bb8-a574-46d2-90ae-684fc42885dd tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1219 microversion: 2.1 time: 0.452011 Aug 02 07:15:27.432275 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2711/5497] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:26 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1219 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:27.899184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cdabce92-b337-4a2c-bb9e-3711587b829c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:27.930218 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cdabce92-b337-4a2c-bb9e-3711587b829c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1216 microversion: 2.1 time: 0.648078 Aug 02 07:15:27.933355 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2787/5498] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:27 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1216 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:28.228535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4c432aaa-608b-417b-9bfa-9dbf292ed6b5 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:28.229364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4c432aaa-608b-417b-9bfa-9dbf292ed6b5 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:28.255621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c432aaa-608b-417b-9bfa-9dbf292ed6b5 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:28.256667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c432aaa-608b-417b-9bfa-9dbf292ed6b5 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:28.257966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c432aaa-608b-417b-9bfa-9dbf292ed6b5 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:28.258666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c432aaa-608b-417b-9bfa-9dbf292ed6b5 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:28.453514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d7b959fb-257c-435d-a191-4807ca1d50eb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:28.456251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d7b959fb-257c-435d-a191-4807ca1d50eb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:28.465320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:28.473360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7b959fb-257c-435d-a191-4807ca1d50eb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:28.478183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7b959fb-257c-435d-a191-4807ca1d50eb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:28.481621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7b959fb-257c-435d-a191-4807ca1d50eb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:28.482329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7b959fb-257c-435d-a191-4807ca1d50eb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:28.501423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:29.080078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d7b959fb-257c-435d-a191-4807ca1d50eb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:29.086413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4c432aaa-608b-417b-9bfa-9dbf292ed6b5 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:29.089593 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d7b959fb-257c-435d-a191-4807ca1d50eb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1281 microversion: 2.1 time: 0.640469 Aug 02 07:15:29.094274 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2788/5499] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:28 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1281 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:29.114541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-901905019", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "f800c8a2-1cbb-4833-893e-2e3d40d46605"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1127880425", "security_groups": [{"name": "tempest-secgroup-smoke-488739576"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:29.117759 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4c432aaa-608b-417b-9bfa-9dbf292ed6b5 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.893493 Aug 02 07:15:29.121494 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2712/5500] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:28 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:29.139021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a60a4235-eb18-4516-b824-51c79d54a570 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:29.139905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a60a4235-eb18-4516-b824-51c79d54a570 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:29.189996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a60a4235-eb18-4516-b824-51c79d54a570 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:29.190787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a60a4235-eb18-4516-b824-51c79d54a570 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:29.197030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a60a4235-eb18-4516-b824-51c79d54a570 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:29.206788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a60a4235-eb18-4516-b824-51c79d54a570 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:29.461072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a60a4235-eb18-4516-b824-51c79d54a570 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:29.476640 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a60a4235-eb18-4516-b824-51c79d54a570 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1286 microversion: 2.1 time: 0.349364 Aug 02 07:15:29.478399 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2713/5501] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:29 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1286 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:29.541664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] validate_networks() for [('f800c8a2-1cbb-4833-893e-2e3d40d46605', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:15:30.116650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8b92a38f-2751-4547-8f78-c7d7e0c66969 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:30.117521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8b92a38f-2751-4547-8f78-c7d7e0c66969 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:30.130906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8b92a38f-2751-4547-8f78-c7d7e0c66969 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:30.131673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8b92a38f-2751-4547-8f78-c7d7e0c66969 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:30.132743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8b92a38f-2751-4547-8f78-c7d7e0c66969 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:30.133478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8b92a38f-2751-4547-8f78-c7d7e0c66969 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:30.326857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8b92a38f-2751-4547-8f78-c7d7e0c66969 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:30.357367 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8b92a38f-2751-4547-8f78-c7d7e0c66969 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1281 microversion: 2.1 time: 0.246049 Aug 02 07:15:30.360132 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2714/5502] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:30 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1281 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:30.380031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2652c067-a706-4cae-bfa9-bfacc88ed4e9 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:30.380915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2652c067-a706-4cae-bfa9-bfacc88ed4e9 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:30.399530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2652c067-a706-4cae-bfa9-bfacc88ed4e9 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:30.400425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2652c067-a706-4cae-bfa9-bfacc88ed4e9 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:30.401429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2652c067-a706-4cae-bfa9-bfacc88ed4e9 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:30.404192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2652c067-a706-4cae-bfa9-bfacc88ed4e9 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:31.091953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2652c067-a706-4cae-bfa9-bfacc88ed4e9 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:31.117431 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2652c067-a706-4cae-bfa9-bfacc88ed4e9 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.753593 Aug 02 07:15:31.129920 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2715/5503] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:30 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:31.129920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d45d637e-9ff9-47fd-8c37-4f67d241646d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:31.129920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d45d637e-9ff9-47fd-8c37-4f67d241646d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:31.146703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d45d637e-9ff9-47fd-8c37-4f67d241646d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:31.150636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d45d637e-9ff9-47fd-8c37-4f67d241646d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:31.150636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d45d637e-9ff9-47fd-8c37-4f67d241646d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:31.150636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d45d637e-9ff9-47fd-8c37-4f67d241646d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:31.442599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d45d637e-9ff9-47fd-8c37-4f67d241646d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:31.482441 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d45d637e-9ff9-47fd-8c37-4f67d241646d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1274 microversion: 2.1 time: 0.361021 Aug 02 07:15:31.483690 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2716/5504] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:31 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1274 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:31.507934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-39cced14-10a3-46ee-86bf-39d36db545fe tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:31.508621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-39cced14-10a3-46ee-86bf-39d36db545fe tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:31.517855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39cced14-10a3-46ee-86bf-39d36db545fe tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:31.518461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39cced14-10a3-46ee-86bf-39d36db545fe tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:31.519467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39cced14-10a3-46ee-86bf-39d36db545fe tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:31.520078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39cced14-10a3-46ee-86bf-39d36db545fe tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:31.712335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:15:31.713464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:15:31.714301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:15:31.714908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:15:31.715513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:15:31.743030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:31.743785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:31.744822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:31.745465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:31.809170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for project bfa05afa69e04974ad3de049c511c674. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:15:31.823102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Getting quotas for user a44367c6be00413eb7b6c79272448cf4 and project bfa05afa69e04974ad3de049c511c674. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:15:31.861620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:15:31.867367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:15:31.890330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-39cced14-10a3-46ee-86bf-39d36db545fe tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:31.901003 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-39cced14-10a3-46ee-86bf-39d36db545fe tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1323 microversion: 2.1 time: 0.414886 Aug 02 07:15:31.914753 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2717/5505] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:31 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:32.035927 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0e368807-ade8-4c6d-a7fe-8f35b2aa9583 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.940256 Aug 02 07:15:32.039738 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2789/5506] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:15:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 2945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:15:32.051812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ad953544-9d04-4c64-957d-28f8323a8cf9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:32.052937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ad953544-9d04-4c64-957d-28f8323a8cf9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:32.144480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-68504d3e-de32-46fa-b9d9-f6b4798b5f85 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:32.145337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-68504d3e-de32-46fa-b9d9-f6b4798b5f85 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:32.157196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68504d3e-de32-46fa-b9d9-f6b4798b5f85 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:32.162336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68504d3e-de32-46fa-b9d9-f6b4798b5f85 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:32.167005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68504d3e-de32-46fa-b9d9-f6b4798b5f85 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:32.170070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68504d3e-de32-46fa-b9d9-f6b4798b5f85 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:32.234572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ad953544-9d04-4c64-957d-28f8323a8cf9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:32.246224 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ad953544-9d04-4c64-957d-28f8323a8cf9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1266 microversion: 2.1 time: 0.198673 Aug 02 07:15:32.260366 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2718/5507] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:32 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:32.514710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ed969dcc-5288-4688-806c-12fe44602736 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:32.515671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ed969dcc-5288-4688-806c-12fe44602736 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:32.566848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed969dcc-5288-4688-806c-12fe44602736 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:32.569592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed969dcc-5288-4688-806c-12fe44602736 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:32.572876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed969dcc-5288-4688-806c-12fe44602736 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:32.574310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed969dcc-5288-4688-806c-12fe44602736 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:32.804573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-68504d3e-de32-46fa-b9d9-f6b4798b5f85 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:32.815936 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-68504d3e-de32-46fa-b9d9-f6b4798b5f85 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.675552 Aug 02 07:15:32.823273 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2790/5508] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:32 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:32.937278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-41e24d19-d4a4-4688-87bf-6c423f3d36d6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:32.938346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-41e24d19-d4a4-4688-87bf-6c423f3d36d6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:32.969816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41e24d19-d4a4-4688-87bf-6c423f3d36d6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:32.979299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41e24d19-d4a4-4688-87bf-6c423f3d36d6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:32.980206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41e24d19-d4a4-4688-87bf-6c423f3d36d6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:32.980613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41e24d19-d4a4-4688-87bf-6c423f3d36d6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:33.036239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ed969dcc-5288-4688-806c-12fe44602736 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:33.066564 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ed969dcc-5288-4688-806c-12fe44602736 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1316 microversion: 2.1 time: 0.546404 Aug 02 07:15:33.068210 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2719/5509] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:32 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:33.268460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e1965cff-ab83-40c9-8290-a8053b16dbee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:33.269125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e1965cff-ab83-40c9-8290-a8053b16dbee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:33.285520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1965cff-ab83-40c9-8290-a8053b16dbee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:33.286105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1965cff-ab83-40c9-8290-a8053b16dbee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:33.287154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1965cff-ab83-40c9-8290-a8053b16dbee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:33.287686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1965cff-ab83-40c9-8290-a8053b16dbee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:33.431695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e1965cff-ab83-40c9-8290-a8053b16dbee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:33.446904 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e1965cff-ab83-40c9-8290-a8053b16dbee tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1262 microversion: 2.1 time: 0.177495 Aug 02 07:15:33.447804 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2720/5510] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:33 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1262 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:33.496900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-41e24d19-d4a4-4688-87bf-6c423f3d36d6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:33.505490 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-41e24d19-d4a4-4688-87bf-6c423f3d36d6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1323 microversion: 2.1 time: 0.573617 Aug 02 07:15:33.513661 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2791/5511] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:32 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1323 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:33.864225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a46913a3-6d25-4e9a-a2ca-9bee9183ae57 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:33.864963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a46913a3-6d25-4e9a-a2ca-9bee9183ae57 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:33.880882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a46913a3-6d25-4e9a-a2ca-9bee9183ae57 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:33.885561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a46913a3-6d25-4e9a-a2ca-9bee9183ae57 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:33.886838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a46913a3-6d25-4e9a-a2ca-9bee9183ae57 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:33.887455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a46913a3-6d25-4e9a-a2ca-9bee9183ae57 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:34.090364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0d5224da-05a5-494a-a64c-c6f78b72a0a7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:34.091696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0d5224da-05a5-494a-a64c-c6f78b72a0a7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:34.135214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d5224da-05a5-494a-a64c-c6f78b72a0a7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:34.135709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d5224da-05a5-494a-a64c-c6f78b72a0a7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:34.136562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d5224da-05a5-494a-a64c-c6f78b72a0a7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:34.148281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d5224da-05a5-494a-a64c-c6f78b72a0a7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:34.534425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a46913a3-6d25-4e9a-a2ca-9bee9183ae57 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:34.543188 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a46913a3-6d25-4e9a-a2ca-9bee9183ae57 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1487 microversion: 2.1 time: 0.706180 Aug 02 07:15:34.566079 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2721/5512] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:33 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1487 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:34.575655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a725b6bd-3c2e-40d9-8f8e-2044333f0ff1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:34.576279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a725b6bd-3c2e-40d9-8f8e-2044333f0ff1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:34.590720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a725b6bd-3c2e-40d9-8f8e-2044333f0ff1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:34.592151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a725b6bd-3c2e-40d9-8f8e-2044333f0ff1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:34.598616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a725b6bd-3c2e-40d9-8f8e-2044333f0ff1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:34.599317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a725b6bd-3c2e-40d9-8f8e-2044333f0ff1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:34.732322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a725b6bd-3c2e-40d9-8f8e-2044333f0ff1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:34.751390 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a725b6bd-3c2e-40d9-8f8e-2044333f0ff1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1324 microversion: 2.1 time: 0.183832 Aug 02 07:15:34.752287 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2722/5513] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:34 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1324 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:34.756156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0d5224da-05a5-494a-a64c-c6f78b72a0a7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:34.757965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cded2ff0-323b-4f33-9cd9-dfeec207c1c2 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:34.758756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cded2ff0-323b-4f33-9cd9-dfeec207c1c2 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:34.774475 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0d5224da-05a5-494a-a64c-c6f78b72a0a7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1316 microversion: 2.1 time: 0.689487 Aug 02 07:15:34.776266 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2792/5514] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:34 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1316 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:34.782484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cded2ff0-323b-4f33-9cd9-dfeec207c1c2 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:34.783281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cded2ff0-323b-4f33-9cd9-dfeec207c1c2 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:34.785561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cded2ff0-323b-4f33-9cd9-dfeec207c1c2 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:34.786251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cded2ff0-323b-4f33-9cd9-dfeec207c1c2 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:34.788176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e425c969-14de-4b89-bd1d-9e973d4b2102 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:34.789101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e425c969-14de-4b89-bd1d-9e973d4b2102 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:34.805580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e425c969-14de-4b89-bd1d-9e973d4b2102 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:34.808555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e425c969-14de-4b89-bd1d-9e973d4b2102 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:34.809798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e425c969-14de-4b89-bd1d-9e973d4b2102 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:34.810446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e425c969-14de-4b89-bd1d-9e973d4b2102 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:34.992922 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e425c969-14de-4b89-bd1d-9e973d4b2102 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "POST /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc/action" status: 202 len: 0 microversion: 2.1 time: 0.214873 Aug 02 07:15:34.997951 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2793/5515] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:15:34 2022] POST /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:15:35.019772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3150d675-f2e3-4134-8938-028b40c6fb7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:35.024433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3150d675-f2e3-4134-8938-028b40c6fb7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:35.041603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3150d675-f2e3-4134-8938-028b40c6fb7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:35.042369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3150d675-f2e3-4134-8938-028b40c6fb7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:35.043324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3150d675-f2e3-4134-8938-028b40c6fb7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:35.047061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3150d675-f2e3-4134-8938-028b40c6fb7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:35.349714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cded2ff0-323b-4f33-9cd9-dfeec207c1c2 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:35.367575 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cded2ff0-323b-4f33-9cd9-dfeec207c1c2 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1323 microversion: 2.1 time: 0.613972 Aug 02 07:15:35.368229 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2723/5516] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:34 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1323 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:35.595963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3150d675-f2e3-4134-8938-028b40c6fb7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:35.612542 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3150d675-f2e3-4134-8938-028b40c6fb7f tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1495 microversion: 2.1 time: 0.613896 Aug 02 07:15:35.627574 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2794/5517] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:34 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1495 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:35.776614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-76e7f468-3aa1-47e7-a6db-e4376badd983 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:35.778193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-76e7f468-3aa1-47e7-a6db-e4376badd983 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:35.785455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76e7f468-3aa1-47e7-a6db-e4376badd983 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:35.786307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76e7f468-3aa1-47e7-a6db-e4376badd983 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:35.787468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76e7f468-3aa1-47e7-a6db-e4376badd983 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:35.788116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76e7f468-3aa1-47e7-a6db-e4376badd983 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:35.799910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0e57bc97-d510-4788-8e20-60885a57df72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:35.800894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0e57bc97-d510-4788-8e20-60885a57df72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:35.821593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e57bc97-d510-4788-8e20-60885a57df72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:35.822518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e57bc97-d510-4788-8e20-60885a57df72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:35.825949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e57bc97-d510-4788-8e20-60885a57df72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:35.826821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e57bc97-d510-4788-8e20-60885a57df72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:35.952096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-76e7f468-3aa1-47e7-a6db-e4376badd983 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:35.966528 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-76e7f468-3aa1-47e7-a6db-e4376badd983 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1324 microversion: 2.1 time: 0.193823 Aug 02 07:15:35.967197 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2724/5518] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:35 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1324 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:35.976174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9881e971-f7aa-4041-990e-0a761dec681d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:35.976681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9881e971-f7aa-4041-990e-0a761dec681d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:36.006576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9881e971-f7aa-4041-990e-0a761dec681d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:36.007395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9881e971-f7aa-4041-990e-0a761dec681d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:36.009849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9881e971-f7aa-4041-990e-0a761dec681d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:36.011771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9881e971-f7aa-4041-990e-0a761dec681d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:36.047074 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-9881e971-f7aa-4041-990e-0a761dec681d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] HTTP exception thrown: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9881e971-f7aa-4041-990e-0a761dec681d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Request method failure captured: Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b HTTP/1.1 Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MykMNz6zTP3YmWmN8RFvg4OuoQ7ofP79l7lC8TxwC-OXzZDZidEgPJRv9-ffdPPw8o2qbzgmjbG2TUCMcLDsOKrX4Dsu-x-EDiGY1JC0T6Cs5bYOW4hgrN8stmhVKgexGtvYBtG5q_VMETNRzsABzIfAOFDItvpYy5GcNmYHJa-PzE Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 15ee4714199b427db6ee9e17d6fd93dc Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/15ee4714199b427db6ee9e17d6fd93dc"}]}] Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 15ee4714199b427db6ee9e17d6fd93dc Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachVolumeShelveTestJSON-1804433436-project Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 2b5865db38184a5c85b48def8ef9cf97 Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1804433436-project Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '8979e165-921d-4e06-92fc-dba834a53b1b'} Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:15:36.049154 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:15:36.054455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:36.054455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:36.054455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:36.054455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:36.054455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:36.054455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:36.054455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:36.054455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:15:36.054455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:15:36.054455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:36.054455 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:36.059616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9881e971-f7aa-4041-990e-0a761dec681d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Returning 404 to user: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:36.061329 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9881e971-f7aa-4041-990e-0a761dec681d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 404 len: 111 microversion: 2.20 time: 0.090205 Aug 02 07:15:36.072146 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2725/5519] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 07:15:35 2022] DELETE /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:15:36.093297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bda5d6a6-172e-4228-8825-1b5d50bb2a42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:36.096950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bda5d6a6-172e-4228-8825-1b5d50bb2a42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 8979e165-921d-4e06-92fc-dba834a53b1b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:36.110332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bda5d6a6-172e-4228-8825-1b5d50bb2a42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:36.112234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bda5d6a6-172e-4228-8825-1b5d50bb2a42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:36.115719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bda5d6a6-172e-4228-8825-1b5d50bb2a42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:36.117272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bda5d6a6-172e-4228-8825-1b5d50bb2a42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:36.181404 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-bda5d6a6-172e-4228-8825-1b5d50bb2a42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] HTTP exception thrown: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bda5d6a6-172e-4228-8825-1b5d50bb2a42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Request method failure captured: Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b HTTP/1.1 Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MykMNz6zTP3YmWmN8RFvg4OuoQ7ofP79l7lC8TxwC-OXzZDZidEgPJRv9-ffdPPw8o2qbzgmjbG2TUCMcLDsOKrX4Dsu-x-EDiGY1JC0T6Cs5bYOW4hgrN8stmhVKgexGtvYBtG5q_VMETNRzsABzIfAOFDItvpYy5GcNmYHJa-PzE Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 15ee4714199b427db6ee9e17d6fd93dc Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/15ee4714199b427db6ee9e17d6fd93dc"}]}] Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 15ee4714199b427db6ee9e17d6fd93dc Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachVolumeShelveTestJSON-1804433436-project Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 2b5865db38184a5c85b48def8ef9cf97 Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1804433436-project Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '8979e165-921d-4e06-92fc-dba834a53b1b'} Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:36.185667 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:36.190334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:36.190334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:36.190334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:36.190334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:36.190334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:15:36.190334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:15:36.190334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. Aug 02 07:15:36.190334 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:36.191476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bda5d6a6-172e-4228-8825-1b5d50bb2a42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Returning 404 to user: Instance 8979e165-921d-4e06-92fc-dba834a53b1b could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:36.194328 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bda5d6a6-172e-4228-8825-1b5d50bb2a42 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b" status: 404 len: 111 microversion: 2.20 time: 0.108091 Aug 02 07:15:36.221444 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2726/5520] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:15:36 2022] GET /compute/v2.1/servers/8979e165-921d-4e06-92fc-dba834a53b1b => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:15:36.349426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b6c646f2-ff79-48ad-9230-fbddd853ec2e req-0143e4d0-878f-4cd4-8e54-dcd448c66d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f452b3-d2e2-4b10-b02f-49f5eec59f5d", "tag": "fd998c6c-3787-4804-addf-8b5c9647643a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:36.377952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b6c646f2-ff79-48ad-9230-fbddd853ec2e req-0143e4d0-878f-4cd4-8e54-dcd448c66d32 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:36.378604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b6c646f2-ff79-48ad-9230-fbddd853ec2e req-0143e4d0-878f-4cd4-8e54-dcd448c66d32 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:36.396095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0e57bc97-d510-4788-8e20-60885a57df72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:36.415169 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b6c646f2-ff79-48ad-9230-fbddd853ec2e req-0143e4d0-878f-4cd4-8e54-dcd448c66d32 service nova] Creating event network-changed:fd998c6c-3787-4804-addf-8b5c9647643a for instance 60f452b3-d2e2-4b10-b02f-49f5eec59f5d on n-h2-851337-3 Aug 02 07:15:36.424695 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0e57bc97-d510-4788-8e20-60885a57df72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1316 microversion: 2.1 time: 0.631227 Aug 02 07:15:36.425305 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b6c646f2-ff79-48ad-9230-fbddd853ec2e req-0143e4d0-878f-4cd4-8e54-dcd448c66d32 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079664 Aug 02 07:15:36.427356 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2795/5521] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:35 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1316 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:36.427830 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2727/5522] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:15:36.457593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-505ae157-291f-46a8-9652-1296354b0602 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:36.461709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-505ae157-291f-46a8-9652-1296354b0602 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:36.498049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-505ae157-291f-46a8-9652-1296354b0602 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:36.499368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-505ae157-291f-46a8-9652-1296354b0602 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:36.501764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-505ae157-291f-46a8-9652-1296354b0602 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:36.503730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-505ae157-291f-46a8-9652-1296354b0602 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:36.635524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:36.640518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-38e8d713-9b8e-40cd-8694-658ef1500db1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:36.641260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-38e8d713-9b8e-40cd-8694-658ef1500db1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:36.669079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38e8d713-9b8e-40cd-8694-658ef1500db1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:36.669912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38e8d713-9b8e-40cd-8694-658ef1500db1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:36.679269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38e8d713-9b8e-40cd-8694-658ef1500db1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:36.679971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38e8d713-9b8e-40cd-8694-658ef1500db1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:37.184968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-38e8d713-9b8e-40cd-8694-658ef1500db1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:37.199139 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-38e8d713-9b8e-40cd-8694-658ef1500db1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1495 microversion: 2.1 time: 0.564422 Aug 02 07:15:37.202029 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2728/5523] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:36 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1495 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:37.208364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-49ca7ec9-a0a5-4c56-97bd-e240e19eda97 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:37.209186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-49ca7ec9-a0a5-4c56-97bd-e240e19eda97 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:37.218865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49ca7ec9-a0a5-4c56-97bd-e240e19eda97 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:37.219608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49ca7ec9-a0a5-4c56-97bd-e240e19eda97 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:37.220665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49ca7ec9-a0a5-4c56-97bd-e240e19eda97 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:37.222186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49ca7ec9-a0a5-4c56-97bd-e240e19eda97 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:37.277031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-505ae157-291f-46a8-9652-1296354b0602 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:37.277979 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-49ca7ec9-a0a5-4c56-97bd-e240e19eda97 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.070094 Aug 02 07:15:37.279193 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2729/5524] 10.222.0.79 () {58 vars in 1293 bytes} [Tue Aug 2 07:15:37 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3/os-server-password => generated 116 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:37.293786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb7e5b5b-6216-4c09-b15f-ea285f60f395 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:37.294452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cb7e5b5b-6216-4c09-b15f-ea285f60f395 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:37.305445 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-505ae157-291f-46a8-9652-1296354b0602 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1323 microversion: 2.1 time: 0.876215 Aug 02 07:15:37.306527 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2796/5525] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:36 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1323 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:37.315657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb7e5b5b-6216-4c09-b15f-ea285f60f395 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:37.315657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb7e5b5b-6216-4c09-b15f-ea285f60f395 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:37.315657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb7e5b5b-6216-4c09-b15f-ea285f60f395 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:37.315657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb7e5b5b-6216-4c09-b15f-ea285f60f395 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:37.351123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:37.447633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ae1897ed-1c59-4c85-9d1c-c20908a0c929 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:37.448491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae1897ed-1c59-4c85-9d1c-c20908a0c929 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:37.461199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae1897ed-1c59-4c85-9d1c-c20908a0c929 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:37.465002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae1897ed-1c59-4c85-9d1c-c20908a0c929 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:37.466113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae1897ed-1c59-4c85-9d1c-c20908a0c929 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:37.466768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae1897ed-1c59-4c85-9d1c-c20908a0c929 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:37.524080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cb7e5b5b-6216-4c09-b15f-ea285f60f395 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:37.533304 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cb7e5b5b-6216-4c09-b15f-ea285f60f395 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1324 microversion: 2.1 time: 0.252250 Aug 02 07:15:37.539586 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2730/5526] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:37 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1324 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:37.866826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ae1897ed-1c59-4c85-9d1c-c20908a0c929 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:37.875490 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ae1897ed-1c59-4c85-9d1c-c20908a0c929 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1316 microversion: 2.1 time: 0.431703 Aug 02 07:15:37.876092 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2797/5527] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:37 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:38.222889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-298b05d4-d80c-4d6b-9ff1-f41189b943e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:38.224168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-298b05d4-d80c-4d6b-9ff1-f41189b943e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:38.231639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-298b05d4-d80c-4d6b-9ff1-f41189b943e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:38.232410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-298b05d4-d80c-4d6b-9ff1-f41189b943e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:38.233666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-298b05d4-d80c-4d6b-9ff1-f41189b943e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:38.234428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-298b05d4-d80c-4d6b-9ff1-f41189b943e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:38.355148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0741ae2d-5ef2-4461-8d77-58b21ec4cf7d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:38.356485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0741ae2d-5ef2-4461-8d77-58b21ec4cf7d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:38.365040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0741ae2d-5ef2-4461-8d77-58b21ec4cf7d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:38.365792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0741ae2d-5ef2-4461-8d77-58b21ec4cf7d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:38.366712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0741ae2d-5ef2-4461-8d77-58b21ec4cf7d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:38.367322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0741ae2d-5ef2-4461-8d77-58b21ec4cf7d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:38.951726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-298b05d4-d80c-4d6b-9ff1-f41189b943e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:38.960991 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-298b05d4-d80c-4d6b-9ff1-f41189b943e0 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1501 microversion: 2.1 time: 0.741991 Aug 02 07:15:38.965659 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2731/5528] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:38 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1501 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:38.971152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-fdd27132-6a72-4b57-b08e-3de650bf622c req-7b5e5e63-b0b0-4cd1-a6b8-590d1dbeb957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2edf07-e6a8-472c-9d71-a0691e66b90d", "tag": "45cd9e1c-cdfb-4648-a6ce-ee7537957267"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:38.983118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fdd27132-6a72-4b57-b08e-3de650bf622c req-7b5e5e63-b0b0-4cd1-a6b8-590d1dbeb957 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:38.983845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fdd27132-6a72-4b57-b08e-3de650bf622c req-7b5e5e63-b0b0-4cd1-a6b8-590d1dbeb957 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:39.007608 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-fdd27132-6a72-4b57-b08e-3de650bf622c req-7b5e5e63-b0b0-4cd1-a6b8-590d1dbeb957 service nova] Creating event network-changed:45cd9e1c-cdfb-4648-a6ce-ee7537957267 for instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d on n-h1-851337-3 Aug 02 07:15:39.027465 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-fdd27132-6a72-4b57-b08e-3de650bf622c req-7b5e5e63-b0b0-4cd1-a6b8-590d1dbeb957 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060035 Aug 02 07:15:39.033415 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2732/5529] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:39.052403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7e43490b-0c83-44fa-8c86-d14cf678b1a8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:39.053732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7e43490b-0c83-44fa-8c86-d14cf678b1a8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:39.077530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0741ae2d-5ef2-4461-8d77-58b21ec4cf7d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:39.080239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e43490b-0c83-44fa-8c86-d14cf678b1a8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:39.080699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e43490b-0c83-44fa-8c86-d14cf678b1a8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:39.081485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e43490b-0c83-44fa-8c86-d14cf678b1a8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:39.081946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e43490b-0c83-44fa-8c86-d14cf678b1a8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:39.090963 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0741ae2d-5ef2-4461-8d77-58b21ec4cf7d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1323 microversion: 2.1 time: 0.739612 Aug 02 07:15:39.092992 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2798/5530] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:38 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1323 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:39.100314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df2a7af1-5579-4e70-87d1-5d8d49f27a5c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:39.101494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df2a7af1-5579-4e70-87d1-5d8d49f27a5c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:39.155405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df2a7af1-5579-4e70-87d1-5d8d49f27a5c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:39.166066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df2a7af1-5579-4e70-87d1-5d8d49f27a5c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:39.169926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df2a7af1-5579-4e70-87d1-5d8d49f27a5c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:39.171769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df2a7af1-5579-4e70-87d1-5d8d49f27a5c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:39.468015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-df2a7af1-5579-4e70-87d1-5d8d49f27a5c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:39.471939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7e43490b-0c83-44fa-8c86-d14cf678b1a8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:39.479435 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df2a7af1-5579-4e70-87d1-5d8d49f27a5c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1316 microversion: 2.1 time: 0.382899 Aug 02 07:15:39.486307 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2799/5531] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:39 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:39.494663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b25be6db-f88c-4a53-97f1-cfc69f387307 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:39.495185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b25be6db-f88c-4a53-97f1-cfc69f387307 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:39.498182 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7e43490b-0c83-44fa-8c86-d14cf678b1a8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1391 microversion: 2.1 time: 0.456322 Aug 02 07:15:39.499563 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2733/5532] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:39 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1391 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:39.512043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b25be6db-f88c-4a53-97f1-cfc69f387307 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:39.512650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b25be6db-f88c-4a53-97f1-cfc69f387307 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:39.513631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b25be6db-f88c-4a53-97f1-cfc69f387307 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:39.514392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b25be6db-f88c-4a53-97f1-cfc69f387307 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:39.582081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b25be6db-f88c-4a53-97f1-cfc69f387307 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:15:39.753706 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b25be6db-f88c-4a53-97f1-cfc69f387307 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 204 len: 0 microversion: 2.1 time: 0.265475 Aug 02 07:15:39.754636 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2800/5533] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:15:39 2022] DELETE /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:15:39.767282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8c71b0d9-5945-4338-a032-b49f02c22fcf tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:39.768875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8c71b0d9-5945-4338-a032-b49f02c22fcf tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:39.780379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c71b0d9-5945-4338-a032-b49f02c22fcf tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:39.781477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c71b0d9-5945-4338-a032-b49f02c22fcf tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:39.783028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c71b0d9-5945-4338-a032-b49f02c22fcf tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:39.783919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c71b0d9-5945-4338-a032-b49f02c22fcf tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:40.126156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9292ffbf-e0c3-4de1-b440-a22e85da52a1 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:40.126882 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9292ffbf-e0c3-4de1-b440-a22e85da52a1 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:40.133164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9292ffbf-e0c3-4de1-b440-a22e85da52a1 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:40.133598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9292ffbf-e0c3-4de1-b440-a22e85da52a1 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:40.134400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9292ffbf-e0c3-4de1-b440-a22e85da52a1 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:40.134828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9292ffbf-e0c3-4de1-b440-a22e85da52a1 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:40.322742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8c71b0d9-5945-4338-a032-b49f02c22fcf tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:40.332676 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8c71b0d9-5945-4338-a032-b49f02c22fcf tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.572455 Aug 02 07:15:40.347164 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2734/5534] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:39 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:40.510934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-66014277-9730-4ec6-b3ea-f175451fbeed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:40.513668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-66014277-9730-4ec6-b3ea-f175451fbeed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:40.521996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9292ffbf-e0c3-4de1-b440-a22e85da52a1 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:40.530453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66014277-9730-4ec6-b3ea-f175451fbeed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:40.532503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66014277-9730-4ec6-b3ea-f175451fbeed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:40.533538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66014277-9730-4ec6-b3ea-f175451fbeed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:40.535493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66014277-9730-4ec6-b3ea-f175451fbeed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:40.537501 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9292ffbf-e0c3-4de1-b440-a22e85da52a1 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1323 microversion: 2.1 time: 0.417750 Aug 02 07:15:40.538775 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2801/5535] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:40 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1323 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:40.544155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c6b6fbd7-e2a3-4f8b-8c0b-304950a74099 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:40.545289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c6b6fbd7-e2a3-4f8b-8c0b-304950a74099 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:40.552271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6b6fbd7-e2a3-4f8b-8c0b-304950a74099 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:40.553014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6b6fbd7-e2a3-4f8b-8c0b-304950a74099 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:40.560261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6b6fbd7-e2a3-4f8b-8c0b-304950a74099 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:40.562753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6b6fbd7-e2a3-4f8b-8c0b-304950a74099 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:40.883017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-66014277-9730-4ec6-b3ea-f175451fbeed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:40.901630 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-66014277-9730-4ec6-b3ea-f175451fbeed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1316 microversion: 2.1 time: 0.403501 Aug 02 07:15:40.914389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c6b6fbd7-e2a3-4f8b-8c0b-304950a74099 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:40.926319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:40.927183 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2735/5536] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:40 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1316 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:40.932895 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c6b6fbd7-e2a3-4f8b-8c0b-304950a74099 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1391 microversion: 2.1 time: 0.392731 Aug 02 07:15:40.933857 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2802/5537] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:40 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1391 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:40.943037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4f5d5429-c970-476f-a7d5-30189972c6e3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:40.943800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4f5d5429-c970-476f-a7d5-30189972c6e3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:40.969155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f5d5429-c970-476f-a7d5-30189972c6e3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:40.969618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f5d5429-c970-476f-a7d5-30189972c6e3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:40.970439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f5d5429-c970-476f-a7d5-30189972c6e3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:40.970878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f5d5429-c970-476f-a7d5-30189972c6e3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:40.989624 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-4f5d5429-c970-476f-a7d5-30189972c6e3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] HTTP exception thrown: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4f5d5429-c970-476f-a7d5-30189972c6e3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Request method failure captured: Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb HTTP/1.1 Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6MykMNz6zTP3YmWmN8RFvg4OuoQ7ofP79l7lC8TxwC-OXzZDZidEgPJRv9-ffdPPw8o2qbzgmjbG2TUCMcLDsOKrX4Dsu-x-EDiGY1JC0T6Cs5bYOW4hgrN8stmhVKgexGtvYBtG5q_VMETNRzsABzIfAOFDItvpYy5GcNmYHJa-PzE Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 15ee4714199b427db6ee9e17d6fd93dc Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/15ee4714199b427db6ee9e17d6fd93dc"}]}] Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 15ee4714199b427db6ee9e17d6fd93dc Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-AttachVolumeShelveTestJSON-1804433436-project Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 2b5865db38184a5c85b48def8ef9cf97 Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1804433436-project Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '9a9ae016-6a95-4257-8d74-99fcd50ae1cb'} Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:15:40.991782 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:15:40.995984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:15:40.995984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:40.995984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:40.995984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:40.995984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:40.995984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:40.995984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:40.995984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:15:40.995984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:15:40.995984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:15:40.995984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:40.997996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4f5d5429-c970-476f-a7d5-30189972c6e3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Returning 404 to user: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:40.999487 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4f5d5429-c970-476f-a7d5-30189972c6e3 tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 404 len: 111 microversion: 2.20 time: 0.061337 Aug 02 07:15:41.000671 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2736/5538] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 07:15:40 2022] DELETE /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:15:41.009451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-521a7238-e5ca-49e6-be59-188d67b6f74d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:41.010093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-521a7238-e5ca-49e6-be59-188d67b6f74d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] [instance: 9a9ae016-6a95-4257-8d74-99fcd50ae1cb] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:41.018449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-521a7238-e5ca-49e6-be59-188d67b6f74d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:41.022047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-521a7238-e5ca-49e6-be59-188d67b6f74d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:41.023329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-521a7238-e5ca-49e6-be59-188d67b6f74d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:41.023992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-521a7238-e5ca-49e6-be59-188d67b6f74d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:41.053220 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-521a7238-e5ca-49e6-be59-188d67b6f74d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] HTTP exception thrown: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-521a7238-e5ca-49e6-be59-188d67b6f74d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Request method failure captured: Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb HTTP/1.1 Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6MykMNz6zTP3YmWmN8RFvg4OuoQ7ofP79l7lC8TxwC-OXzZDZidEgPJRv9-ffdPPw8o2qbzgmjbG2TUCMcLDsOKrX4Dsu-x-EDiGY1JC0T6Cs5bYOW4hgrN8stmhVKgexGtvYBtG5q_VMETNRzsABzIfAOFDItvpYy5GcNmYHJa-PzE Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 15ee4714199b427db6ee9e17d6fd93dc Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_15ee4714199b427db6ee9e17d6fd93dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/15ee4714199b427db6ee9e17d6fd93dc"}]}] Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 15ee4714199b427db6ee9e17d6fd93dc Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1804433436 Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-AttachVolumeShelveTestJSON-1804433436-project Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 2b5865db38184a5c85b48def8ef9cf97 Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1804433436-project Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '9a9ae016-6a95-4257-8d74-99fcd50ae1cb'} Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:41.056507 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:41.061324 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:41.061324 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:41.061324 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:41.061324 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:41.061324 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:15:41.061324 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:15:41.061324 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. Aug 02 07:15:41.061324 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:41.064224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-521a7238-e5ca-49e6-be59-188d67b6f74d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] Returning 404 to user: Instance 9a9ae016-6a95-4257-8d74-99fcd50ae1cb could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:41.066635 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-521a7238-e5ca-49e6-be59-188d67b6f74d tempest-AttachVolumeShelveTestJSON-1804433436 tempest-AttachVolumeShelveTestJSON-1804433436-project] 10.222.0.79 "GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb" status: 404 len: 111 microversion: 2.20 time: 0.061472 Aug 02 07:15:41.067696 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2803/5539] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:15:41 2022] GET /compute/v2.1/servers/9a9ae016-6a95-4257-8d74-99fcd50ae1cb => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:15:41.353808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e9673e52-5b07-42a3-a917-6d98c7fafd53 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:41.355236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e9673e52-5b07-42a3-a917-6d98c7fafd53 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:41.368835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9673e52-5b07-42a3-a917-6d98c7fafd53 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:41.375532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9673e52-5b07-42a3-a917-6d98c7fafd53 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:41.376575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9673e52-5b07-42a3-a917-6d98c7fafd53 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:41.377557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9673e52-5b07-42a3-a917-6d98c7fafd53 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:41.560118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-49dd931b-821c-44e1-bdda-edd9170d9236 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:41.561000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-49dd931b-821c-44e1-bdda-edd9170d9236 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:41.575893 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49dd931b-821c-44e1-bdda-edd9170d9236 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:41.576400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49dd931b-821c-44e1-bdda-edd9170d9236 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:41.580409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49dd931b-821c-44e1-bdda-edd9170d9236 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:41.580933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49dd931b-821c-44e1-bdda-edd9170d9236 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:41.785607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:41.846360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=14 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:41.861365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e9673e52-5b07-42a3-a917-6d98c7fafd53 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:41.872973 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e9673e52-5b07-42a3-a917-6d98c7fafd53 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.522881 Aug 02 07:15:41.875716 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2737/5540] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:41 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:41.943884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-081dd876-86a9-4ab1-85b5-cc2a7cf5df52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:41.944672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-081dd876-86a9-4ab1-85b5-cc2a7cf5df52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:41.958682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-081dd876-86a9-4ab1-85b5-cc2a7cf5df52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:41.959492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-081dd876-86a9-4ab1-85b5-cc2a7cf5df52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:41.960514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-081dd876-86a9-4ab1-85b5-cc2a7cf5df52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:41.961328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-081dd876-86a9-4ab1-85b5-cc2a7cf5df52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:42.112540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-49dd931b-821c-44e1-bdda-edd9170d9236 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:42.121202 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-49dd931b-821c-44e1-bdda-edd9170d9236 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1323 microversion: 2.1 time: 0.566262 Aug 02 07:15:42.127188 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2804/5541] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:41 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1323 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:42.133759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-78ecc11c-79dc-4feb-b4bf-a2088bb8bda2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:42.142490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-78ecc11c-79dc-4feb-b4bf-a2088bb8bda2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:42.162949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78ecc11c-79dc-4feb-b4bf-a2088bb8bda2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:42.163463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78ecc11c-79dc-4feb-b4bf-a2088bb8bda2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:42.165664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78ecc11c-79dc-4feb-b4bf-a2088bb8bda2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:42.166247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78ecc11c-79dc-4feb-b4bf-a2088bb8bda2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:42.239788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=8 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:42.367471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-081dd876-86a9-4ab1-85b5-cc2a7cf5df52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:42.376086 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-081dd876-86a9-4ab1-85b5-cc2a7cf5df52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1316 microversion: 2.1 time: 0.436665 Aug 02 07:15:42.392105 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2738/5542] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:41 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:42.580110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-78ecc11c-79dc-4feb-b4bf-a2088bb8bda2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:42.592426 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-78ecc11c-79dc-4feb-b4bf-a2088bb8bda2 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1391 microversion: 2.1 time: 0.462980 Aug 02 07:15:42.593051 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2805/5543] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:42 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1391 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:42.899510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9eda1285-884d-4b06-92b0-118e10b8be66 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:42.900195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9eda1285-884d-4b06-92b0-118e10b8be66 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:42.911293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9eda1285-884d-4b06-92b0-118e10b8be66 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:42.913713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9eda1285-884d-4b06-92b0-118e10b8be66 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:42.915532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9eda1285-884d-4b06-92b0-118e10b8be66 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:42.917435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9eda1285-884d-4b06-92b0-118e10b8be66 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:43.145816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d3f4c50e-9ac5-4264-b5c8-8f13c9222f35 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:43.146805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d3f4c50e-9ac5-4264-b5c8-8f13c9222f35 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:43.163435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3f4c50e-9ac5-4264-b5c8-8f13c9222f35 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:43.163874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3f4c50e-9ac5-4264-b5c8-8f13c9222f35 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:43.164980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3f4c50e-9ac5-4264-b5c8-8f13c9222f35 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:43.166589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3f4c50e-9ac5-4264-b5c8-8f13c9222f35 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:43.788607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9eda1285-884d-4b06-92b0-118e10b8be66 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:43.827221 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9eda1285-884d-4b06-92b0-118e10b8be66 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.931611 Aug 02 07:15:43.831286 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2739/5544] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:42 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:43.842249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8c7c43d1-ebc0-4138-92a7-40fe02fe9416 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:43.843529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8c7c43d1-ebc0-4138-92a7-40fe02fe9416 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:43.855441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c7c43d1-ebc0-4138-92a7-40fe02fe9416 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:43.856294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c7c43d1-ebc0-4138-92a7-40fe02fe9416 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:43.863258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c7c43d1-ebc0-4138-92a7-40fe02fe9416 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:43.864342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c7c43d1-ebc0-4138-92a7-40fe02fe9416 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:44.157081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d3f4c50e-9ac5-4264-b5c8-8f13c9222f35 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:44.167535 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d3f4c50e-9ac5-4264-b5c8-8f13c9222f35 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1323 microversion: 2.1 time: 1.026498 Aug 02 07:15:44.169570 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2806/5545] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:43 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1323 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:44.174744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b3ee72b5-f392-43fb-8224-fc61d00a56a8 req-0678620e-99df-4af0-bee5-806a3df4013b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f452b3-d2e2-4b10-b02f-49f5eec59f5d", "name": "network-vif-plugged", "status": "completed", "tag": "fd998c6c-3787-4804-addf-8b5c9647643a"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:44.188442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b3ee72b5-f392-43fb-8224-fc61d00a56a8 req-0678620e-99df-4af0-bee5-806a3df4013b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:44.189209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b3ee72b5-f392-43fb-8224-fc61d00a56a8 req-0678620e-99df-4af0-bee5-806a3df4013b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:44.204442 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b3ee72b5-f392-43fb-8224-fc61d00a56a8 req-0678620e-99df-4af0-bee5-806a3df4013b service nova] Creating event network-vif-plugged:fd998c6c-3787-4804-addf-8b5c9647643a for instance 60f452b3-d2e2-4b10-b02f-49f5eec59f5d on n-h2-851337-3 Aug 02 07:15:44.211396 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b3ee72b5-f392-43fb-8224-fc61d00a56a8 req-0678620e-99df-4af0-bee5-806a3df4013b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040344 Aug 02 07:15:44.212159 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2807/5546] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:44.218751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4494faf0-0f03-42cc-8e30-b0db579f7e49 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:44.220122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4494faf0-0f03-42cc-8e30-b0db579f7e49 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:44.227775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4494faf0-0f03-42cc-8e30-b0db579f7e49 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:44.228590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4494faf0-0f03-42cc-8e30-b0db579f7e49 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:44.229546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4494faf0-0f03-42cc-8e30-b0db579f7e49 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:44.230291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4494faf0-0f03-42cc-8e30-b0db579f7e49 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:44.667427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8c7c43d1-ebc0-4138-92a7-40fe02fe9416 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:44.677559 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8c7c43d1-ebc0-4138-92a7-40fe02fe9416 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1316 microversion: 2.1 time: 0.843127 Aug 02 07:15:44.678357 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2740/5547] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:43 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1316 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:44.684393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-823c2ea3-8dad-42de-82d1-617e1bf82f96 req-7e5d837d-f459-4c8d-bccd-68164681bfef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc", "tag": "f84ab8a1-e3d2-4d29-97b2-2cf74d942511"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:44.696585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-823c2ea3-8dad-42de-82d1-617e1bf82f96 req-7e5d837d-f459-4c8d-bccd-68164681bfef service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:44.697409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-823c2ea3-8dad-42de-82d1-617e1bf82f96 req-7e5d837d-f459-4c8d-bccd-68164681bfef service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:44.711675 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-823c2ea3-8dad-42de-82d1-617e1bf82f96 req-7e5d837d-f459-4c8d-bccd-68164681bfef service nova] Creating event network-changed:f84ab8a1-e3d2-4d29-97b2-2cf74d942511 for instance d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc on n-h1-851337-3 Aug 02 07:15:44.719685 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-823c2ea3-8dad-42de-82d1-617e1bf82f96 req-7e5d837d-f459-4c8d-bccd-68164681bfef service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039990 Aug 02 07:15:44.720703 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2741/5548] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:44.865584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9306bf3a-ea9f-42fb-81a0-356aa1c33fd1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:44.866597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9306bf3a-ea9f-42fb-81a0-356aa1c33fd1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:44.875973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9306bf3a-ea9f-42fb-81a0-356aa1c33fd1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:44.876697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9306bf3a-ea9f-42fb-81a0-356aa1c33fd1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:44.877713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9306bf3a-ea9f-42fb-81a0-356aa1c33fd1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:44.878344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9306bf3a-ea9f-42fb-81a0-356aa1c33fd1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:44.934149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4494faf0-0f03-42cc-8e30-b0db579f7e49 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:44.948108 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4494faf0-0f03-42cc-8e30-b0db579f7e49 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1391 microversion: 2.1 time: 0.733633 Aug 02 07:15:44.949419 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2808/5549] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:44 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1391 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:45.203176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc5e6c72-910c-4482-b5e3-fd6a41f3c8ce tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:45.214215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bc5e6c72-910c-4482-b5e3-fd6a41f3c8ce tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:45.227531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc5e6c72-910c-4482-b5e3-fd6a41f3c8ce tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:45.228224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc5e6c72-910c-4482-b5e3-fd6a41f3c8ce tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:45.229297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc5e6c72-910c-4482-b5e3-fd6a41f3c8ce tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:45.230076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc5e6c72-910c-4482-b5e3-fd6a41f3c8ce tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:45.518724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9306bf3a-ea9f-42fb-81a0-356aa1c33fd1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:45.542677 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9306bf3a-ea9f-42fb-81a0-356aa1c33fd1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 200 len: 1507 microversion: 2.1 time: 0.682850 Aug 02 07:15:45.544803 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2742/5550] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:44 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 1507 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:45.628351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b6c60940-c610-4b3f-8531-f5e67b6b33a9 req-a159ea5c-bfe9-4db2-b227-2e1deea7d9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2fd828-d443-4c27-b928-e791d83afadc", "name": "network-vif-deleted", "tag": "05e52296-92ce-4276-9f17-830a87fb7799"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:45.656123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b6c60940-c610-4b3f-8531-f5e67b6b33a9 req-a159ea5c-bfe9-4db2-b227-2e1deea7d9b4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:45.656858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b6c60940-c610-4b3f-8531-f5e67b6b33a9 req-a159ea5c-bfe9-4db2-b227-2e1deea7d9b4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:45.675821 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b6c60940-c610-4b3f-8531-f5e67b6b33a9 req-a159ea5c-bfe9-4db2-b227-2e1deea7d9b4 service nova] Creating event network-vif-deleted:05e52296-92ce-4276-9f17-830a87fb7799 for instance 1a2fd828-d443-4c27-b928-e791d83afadc on n-h2-851337-3 Aug 02 07:15:45.685574 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b6c60940-c610-4b3f-8531-f5e67b6b33a9 req-a159ea5c-bfe9-4db2-b227-2e1deea7d9b4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062105 Aug 02 07:15:45.688537 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2743/5551] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:45.711037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1789c1b8-b65b-49eb-8f74-8ce7a499fde1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:45.712674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1789c1b8-b65b-49eb-8f74-8ce7a499fde1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:45.722106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1789c1b8-b65b-49eb-8f74-8ce7a499fde1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:45.723138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1789c1b8-b65b-49eb-8f74-8ce7a499fde1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:45.725129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1789c1b8-b65b-49eb-8f74-8ce7a499fde1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:45.726431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1789c1b8-b65b-49eb-8f74-8ce7a499fde1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:45.776932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bc5e6c72-910c-4482-b5e3-fd6a41f3c8ce tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:45.796223 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc5e6c72-910c-4482-b5e3-fd6a41f3c8ce tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1323 microversion: 2.1 time: 0.609236 Aug 02 07:15:45.797040 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2809/5552] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:45 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1323 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:45.972049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-17c6bd22-c7a5-47d2-913f-415aa5771e4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:45.973074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-17c6bd22-c7a5-47d2-913f-415aa5771e4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:45.980831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17c6bd22-c7a5-47d2-913f-415aa5771e4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:45.981520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17c6bd22-c7a5-47d2-913f-415aa5771e4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:45.982690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17c6bd22-c7a5-47d2-913f-415aa5771e4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:45.983271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17c6bd22-c7a5-47d2-913f-415aa5771e4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:46.193069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1789c1b8-b65b-49eb-8f74-8ce7a499fde1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:46.201791 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1789c1b8-b65b-49eb-8f74-8ce7a499fde1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1316 microversion: 2.1 time: 0.502036 Aug 02 07:15:46.214962 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2744/5553] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:45 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:46.230614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b058576f-64b0-4c5b-9bb0-071b9350101e req-59003900-bc0b-402a-bb70-deaa9b081825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2edf07-e6a8-472c-9d71-a0691e66b90d", "name": "network-vif-plugged", "status": "completed", "tag": "45cd9e1c-cdfb-4648-a6ce-ee7537957267"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:46.269411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b058576f-64b0-4c5b-9bb0-071b9350101e req-59003900-bc0b-402a-bb70-deaa9b081825 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:46.272255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b058576f-64b0-4c5b-9bb0-071b9350101e req-59003900-bc0b-402a-bb70-deaa9b081825 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:46.317191 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b058576f-64b0-4c5b-9bb0-071b9350101e req-59003900-bc0b-402a-bb70-deaa9b081825 service nova] Creating event network-vif-plugged:45cd9e1c-cdfb-4648-a6ce-ee7537957267 for instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d on n-h1-851337-3 Aug 02 07:15:46.327106 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b058576f-64b0-4c5b-9bb0-071b9350101e req-59003900-bc0b-402a-bb70-deaa9b081825 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103745 Aug 02 07:15:46.333611 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2745/5554] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:46.549084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-17c6bd22-c7a5-47d2-913f-415aa5771e4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:46.564571 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-17c6bd22-c7a5-47d2-913f-415aa5771e4f tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1391 microversion: 2.1 time: 0.596930 Aug 02 07:15:46.565944 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2810/5555] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:45 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1391 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:46.570445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-356fe638-2152-49aa-88b5-0ef95734d926 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:46.577809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-356fe638-2152-49aa-88b5-0ef95734d926 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: 1a2fd828-d443-4c27-b928-e791d83afadc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:46.601915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-356fe638-2152-49aa-88b5-0ef95734d926 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:46.602908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-356fe638-2152-49aa-88b5-0ef95734d926 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:46.603880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-356fe638-2152-49aa-88b5-0ef95734d926 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:46.606466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-356fe638-2152-49aa-88b5-0ef95734d926 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:46.625812 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-356fe638-2152-49aa-88b5-0ef95734d926 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] HTTP exception thrown: Instance 1a2fd828-d443-4c27-b928-e791d83afadc could not be found. Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-356fe638-2152-49aa-88b5-0ef95734d926 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Request method failure captured: Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc HTTP/1.1 Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M6dEJCwsqisvJMx1FltdaU8ZN7iGdMQsr8GGz1LM7LGGrTgpfEyg-nFcWErqu2ZxFs2MyI7uatnNqy943nzzNd6SaYfTcTXM8Iw9UbHnwWTlCmBsa8CMdJAwtw205sNGUPnQInkcowSSZ4QJRGr3cLDTiVZXNwXaQa3TWJQhEXnTvw Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: cd671dbd40de4332800d131413db30ec Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerRescueTestJSON-1808803529 Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cd671dbd40de4332800d131413db30ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd671dbd40de4332800d131413db30ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cd671dbd40de4332800d131413db30ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd671dbd40de4332800d131413db30ec"}]}] Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerRescueTestJSON-1808803529 Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: cd671dbd40de4332800d131413db30ec Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerRescueTestJSON-1808803529 Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerRescueTestJSON-1808803529-project Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: a44f176bdb674f05b727b751c69382ac Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerRescueTestJSON-1808803529-project Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 1a2fd828-d443-4c27-b928-e791d83afadc could not be found. Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1a2fd828-d443-4c27-b928-e791d83afadc'} Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a2fd828-d443-4c27-b928-e791d83afadc could not be found. Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a2fd828-d443-4c27-b928-e791d83afadc could not be found. Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:46.627615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:46.633033 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:46.633033 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:46.633033 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:46.633033 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:15:46.633033 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:15:46.633033 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a2fd828-d443-4c27-b928-e791d83afadc could not be found. Aug 02 07:15:46.633033 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:46.633033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-356fe638-2152-49aa-88b5-0ef95734d926 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Returning 404 to user: Instance 1a2fd828-d443-4c27-b928-e791d83afadc could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:46.633033 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-356fe638-2152-49aa-88b5-0ef95734d926 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc" status: 404 len: 111 microversion: 2.1 time: 0.068163 Aug 02 07:15:46.634943 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2746/5556] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:46 2022] GET /compute/v2.1/servers/1a2fd828-d443-4c27-b928-e791d83afadc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:15:46.642353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-07406de4-e1d6-40e0-a8c0-19f66f480f81 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:46.642353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-07406de4-e1d6-40e0-a8c0-19f66f480f81 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:46.648506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07406de4-e1d6-40e0-a8c0-19f66f480f81 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:46.648938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07406de4-e1d6-40e0-a8c0-19f66f480f81 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:46.649797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07406de4-e1d6-40e0-a8c0-19f66f480f81 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:46.650262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07406de4-e1d6-40e0-a8c0-19f66f480f81 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:46.692448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-07406de4-e1d6-40e0-a8c0-19f66f480f81 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:15:46.802936 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-07406de4-e1d6-40e0-a8c0-19f66f480f81 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 204 len: 0 microversion: 2.1 time: 0.164791 Aug 02 07:15:46.805255 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2811/5557] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:15:46 2022] DELETE /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 07:15:46.813678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e3ddf3f3-7fba-4e1c-b941-69ece13c6867 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:46.815331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e3ddf3f3-7fba-4e1c-b941-69ece13c6867 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:46.819851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-73c299fe-d195-4961-ac4a-4c97fb71202d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:46.826057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-73c299fe-d195-4961-ac4a-4c97fb71202d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:46.827423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3ddf3f3-7fba-4e1c-b941-69ece13c6867 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:46.828441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3ddf3f3-7fba-4e1c-b941-69ece13c6867 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:46.830488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3ddf3f3-7fba-4e1c-b941-69ece13c6867 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:46.832182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e3ddf3f3-7fba-4e1c-b941-69ece13c6867 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:46.856609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73c299fe-d195-4961-ac4a-4c97fb71202d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:46.856609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73c299fe-d195-4961-ac4a-4c97fb71202d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:46.857401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73c299fe-d195-4961-ac4a-4c97fb71202d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:46.857941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73c299fe-d195-4961-ac4a-4c97fb71202d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:47.191608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e3ddf3f3-7fba-4e1c-b941-69ece13c6867 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:47.200137 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e3ddf3f3-7fba-4e1c-b941-69ece13c6867 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1492 microversion: 2.1 time: 0.391094 Aug 02 07:15:47.214333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-73c299fe-d195-4961-ac4a-4c97fb71202d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:47.226811 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2747/5558] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:46 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1492 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:47.231461 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-73c299fe-d195-4961-ac4a-4c97fb71202d tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1520 microversion: 2.1 time: 0.416136 Aug 02 07:15:47.231845 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2812/5559] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:46 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:47.240378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a8b75534-6c2c-4ef0-93e1-2a920910f1ad tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:47.241749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a8b75534-6c2c-4ef0-93e1-2a920910f1ad tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:47.251859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:47.263989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8b75534-6c2c-4ef0-93e1-2a920910f1ad tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:47.264624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8b75534-6c2c-4ef0-93e1-2a920910f1ad tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:47.265560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8b75534-6c2c-4ef0-93e1-2a920910f1ad tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:47.266311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a8b75534-6c2c-4ef0-93e1-2a920910f1ad tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:47.316088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-613d1287-f7c3-4a22-b881-67bde05137a6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1336787434", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "ee4da363-e613-4759-9949-ed224c5e3dfe"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-613d1287-f7c3-4a22-b881-67bde05137a6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Request method failure captured: Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 243 Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8JXEchYBUDUSEZxs2mrmfT3OIHRNE94ISmNu0qgcI0LxthoflP3z1BvzbQiUVULSSbQji-6D_oVRzobK0S4TWRA9Rirbh9ROKDQE_xfAtqjWv-g4kozYUv5CyE6q0xmOdxmW8qOAPZuS825ZQO7EJgMwmvjIsdGJQbRt5A2h_ceJw Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}] Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: c4b2ca5524d246f6927f6946f885b3e3 Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1336787434", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "ee4da363-e613-4759-9949-ed224c5e3dfe"}]}} Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1336787434', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'ee4da363-e613-4759-9949-ed224c5e3dfe'}]}}} Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:47.321093 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-613d1287-f7c3-4a22-b881-67bde05137a6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-613d1287-f7c3-4a22-b881-67bde05137a6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.011030 Aug 02 07:15:47.325331 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2813/5560] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:15:47 2022] POST /compute/v2.1/servers => generated 175 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 07:15:47.334815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-039fa178-ef54-4bb7-8ddd-ead89f0020f7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:47.335577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-039fa178-ef54-4bb7-8ddd-ead89f0020f7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 5bb0ce08-a85f-42a7-bab4-3f6221d2dbde] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:47.343270 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-039fa178-ef54-4bb7-8ddd-ead89f0020f7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] HTTP exception thrown: Instance 5bb0ce08-a85f-42a7-bab4-3f6221d2dbde could not be found. Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-039fa178-ef54-4bb7-8ddd-ead89f0020f7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Request method failure captured: Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/5bb0ce08-a85f-42a7-bab4-3f6221d2dbde/metadata HTTP/1.1 Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8JXEchYBUDUSEZxs2mrmfT3OIHRNE94ISmNu0qgcI0LxthoflP3z1BvzbQiUVULSSbQji-6D_oVRzobK0S4TWRA9Rirbh9ROKDQE_xfAtqjWv-g4kozYUv5CyE6q0xmOdxmW8qOAPZuS825ZQO7EJgMwmvjIsdGJQbRt5A2h_ceJw Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}] Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: c4b2ca5524d246f6927f6946f885b3e3 Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 5bb0ce08-a85f-42a7-bab4-3f6221d2dbde could not be found. Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'server_id': '5bb0ce08-a85f-42a7-bab4-3f6221d2dbde'} Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb0ce08-a85f-42a7-bab4-3f6221d2dbde could not be found. Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb0ce08-a85f-42a7-bab4-3f6221d2dbde could not be found. Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:47.359372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:47.371986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:15:47.371986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:15:47.371986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb0ce08-a85f-42a7-bab4-3f6221d2dbde could not be found. Aug 02 07:15:47.371986 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.371986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-039fa178-ef54-4bb7-8ddd-ead89f0020f7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Returning 404 to user: Instance 5bb0ce08-a85f-42a7-bab4-3f6221d2dbde could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:47.371986 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-039fa178-ef54-4bb7-8ddd-ead89f0020f7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/5bb0ce08-a85f-42a7-bab4-3f6221d2dbde/metadata" status: 404 len: 111 microversion: 2.1 time: 0.030347 Aug 02 07:15:47.371986 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2814/5561] 10.222.0.79 () {58 vars in 1263 bytes} [Tue Aug 2 07:15:47 2022] GET /compute/v2.1/servers/5bb0ce08-a85f-42a7-bab4-3f6221d2dbde/metadata => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:15:47.428503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-50ebbaac-fbd6-4301-8ad4-5a7df31a1e37 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1597156304", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee4da363-e613-4759-9949-ed224c5e3dfe"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-50ebbaac-fbd6-4301-8ad4-5a7df31a1e37 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Request method failure captured: Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 499 Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8JXEchYBUDUSEZxs2mrmfT3OIHRNE94ISmNu0qgcI0LxthoflP3z1BvzbQiUVULSSbQji-6D_oVRzobK0S4TWRA9Rirbh9ROKDQE_xfAtqjWv-g4kozYUv5CyE6q0xmOdxmW8qOAPZuS825ZQO7EJgMwmvjIsdGJQbRt5A2h_ceJw Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}] Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: c4b2ca5524d246f6927f6946f885b3e3 Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1597156304", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee4da363-e613-4759-9949-ed224c5e3dfe"}]}} Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1597156304', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ee4da363-e613-4759-9949-ed224c5e3dfe'}]}}} Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 02 07:15:47.433312 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-50ebbaac-fbd6-4301-8ad4-5a7df31a1e37 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-50ebbaac-fbd6-4301-8ad4-5a7df31a1e37 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.011779 Aug 02 07:15:47.436439 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2815/5562] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:15:47 2022] POST /compute/v2.1/servers => generated 687 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:15:47.495692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c199479c-ce96-4b11-beb7-b870af52b0e7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1118123957", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee4da363-e613-4759-9949-ed224c5e3dfe"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c199479c-ce96-4b11-beb7-b870af52b0e7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Request method failure captured: Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 500 Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8JXEchYBUDUSEZxs2mrmfT3OIHRNE94ISmNu0qgcI0LxthoflP3z1BvzbQiUVULSSbQji-6D_oVRzobK0S4TWRA9Rirbh9ROKDQE_xfAtqjWv-g4kozYUv5CyE6q0xmOdxmW8qOAPZuS825ZQO7EJgMwmvjIsdGJQbRt5A2h_ceJw Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}] Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: c4b2ca5524d246f6927f6946f885b3e3 Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1118123957", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee4da363-e613-4759-9949-ed224c5e3dfe"}]}} Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1118123957', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ee4da363-e613-4759-9949-ed224c5e3dfe'}]}}} Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 02 07:15:47.501366 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.504138 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.508067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c199479c-ce96-4b11-beb7-b870af52b0e7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:47.509248 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c199479c-ce96-4b11-beb7-b870af52b0e7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.018545 Aug 02 07:15:47.510199 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2816/5563] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:15:47 2022] POST /compute/v2.1/servers => generated 689 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 07:15:47.578934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b827af0-f9be-4c89-bbc3-5b0c734b6326 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-487269612", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee4da363-e613-4759-9949-ed224c5e3dfe"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b827af0-f9be-4c89-bbc3-5b0c734b6326 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Request method failure captured: Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 753 Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8JXEchYBUDUSEZxs2mrmfT3OIHRNE94ISmNu0qgcI0LxthoflP3z1BvzbQiUVULSSbQji-6D_oVRzobK0S4TWRA9Rirbh9ROKDQE_xfAtqjWv-g4kozYUv5CyE6q0xmOdxmW8qOAPZuS825ZQO7EJgMwmvjIsdGJQbRt5A2h_ceJw Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}] Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: c4b2ca5524d246f6927f6946f885b3e3 Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-487269612", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee4da363-e613-4759-9949-ed224c5e3dfe"}]}} Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-487269612', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ee4da363-e613-4759-9949-ed224c5e3dfe'}]}}} Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:15:47.588194 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:15:47.592817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:15:47.597152 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.597152 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.600079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b827af0-f9be-4c89-bbc3-5b0c734b6326 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:47.604990 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4b827af0-f9be-4c89-bbc3-5b0c734b6326 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.033908 Aug 02 07:15:47.618047 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2817/5564] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:15:47 2022] POST /compute/v2.1/servers => generated 1197 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 02 07:15:47.630480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2daf18bb-c925-4042-be67-38930c0236e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:47.631326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2daf18bb-c925-4042-be67-38930c0236e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:47.634210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a8b75534-6c2c-4ef0-93e1-2a920910f1ad tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:47.648990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2daf18bb-c925-4042-be67-38930c0236e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:47.652292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2daf18bb-c925-4042-be67-38930c0236e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:47.653367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2daf18bb-c925-4042-be67-38930c0236e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:47.656289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2daf18bb-c925-4042-be67-38930c0236e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:47.659055 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a8b75534-6c2c-4ef0-93e1-2a920910f1ad tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1316 microversion: 2.1 time: 0.425077 Aug 02 07:15:47.677519 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2748/5565] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:47 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:47.711257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c380f97b-b367-4f7f-9172-6c8dae993abe tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1773667659", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee4da363-e613-4759-9949-ed224c5e3dfe"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c380f97b-b367-4f7f-9172-6c8dae993abe tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Request method failure captured: Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 1266 Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8JXEchYBUDUSEZxs2mrmfT3OIHRNE94ISmNu0qgcI0LxthoflP3z1BvzbQiUVULSSbQji-6D_oVRzobK0S4TWRA9Rirbh9ROKDQE_xfAtqjWv-g4kozYUv5CyE6q0xmOdxmW8qOAPZuS825ZQO7EJgMwmvjIsdGJQbRt5A2h_ceJw Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}] Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: c4b2ca5524d246f6927f6946f885b3e3 Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1773667659", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ee4da363-e613-4759-9949-ed224c5e3dfe"}]}} Aug 02 07:15:47.720917 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1773667659', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ee4da363-e613-4759-9949-ed224c5e3dfe'}]}}} Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.723197 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:15:47.724362 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:15:47.726321 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 02 07:15:47.726321 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.728678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c380f97b-b367-4f7f-9172-6c8dae993abe tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:47.730822 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c380f97b-b367-4f7f-9172-6c8dae993abe tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.025849 Aug 02 07:15:47.734100 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2749/5566] 10.222.0.79 () {60 vars in 1148 bytes} [Tue Aug 2 07:15:47 2022] POST /compute/v2.1/servers => generated 2221 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 02 07:15:47.746066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a35fa5ae-04c7-4016-bc0a-203b1adbe5ce tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:47.746876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a35fa5ae-04c7-4016-bc0a-203b1adbe5ce tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: e4e74a2e-90a6-47b6-ba25-bebb8935dddd] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:47.756576 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-a35fa5ae-04c7-4016-bc0a-203b1adbe5ce tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] HTTP exception thrown: Instance e4e74a2e-90a6-47b6-ba25-bebb8935dddd could not be found. Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a35fa5ae-04c7-4016-bc0a-203b1adbe5ce tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Request method failure captured: Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/e4e74a2e-90a6-47b6-ba25-bebb8935dddd/metadata/test2 HTTP/1.1 Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8JXEchYBUDUSEZxs2mrmfT3OIHRNE94ISmNu0qgcI0LxthoflP3z1BvzbQiUVULSSbQji-6D_oVRzobK0S4TWRA9Rirbh9ROKDQE_xfAtqjWv-g4kozYUv5CyE6q0xmOdxmW8qOAPZuS825ZQO7EJgMwmvjIsdGJQbRt5A2h_ceJw Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}] Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: c4b2ca5524d246f6927f6946f885b3e3 Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance e4e74a2e-90a6-47b6-ba25-bebb8935dddd could not be found. Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'server_id': 'e4e74a2e-90a6-47b6-ba25-bebb8935dddd', 'id': 'test2'} Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4e74a2e-90a6-47b6-ba25-bebb8935dddd could not be found. Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4e74a2e-90a6-47b6-ba25-bebb8935dddd could not be found. Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:47.759574 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:47.763904 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:15:47.763904 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:15:47.763904 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4e74a2e-90a6-47b6-ba25-bebb8935dddd could not be found. Aug 02 07:15:47.763904 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:47.763904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a35fa5ae-04c7-4016-bc0a-203b1adbe5ce tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Returning 404 to user: Instance e4e74a2e-90a6-47b6-ba25-bebb8935dddd could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:47.764640 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a35fa5ae-04c7-4016-bc0a-203b1adbe5ce tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/e4e74a2e-90a6-47b6-ba25-bebb8935dddd/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.024582 Aug 02 07:15:47.765635 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2750/5567] 10.222.0.79 () {58 vars in 1281 bytes} [Tue Aug 2 07:15:47 2022] GET /compute/v2.1/servers/e4e74a2e-90a6-47b6-ba25-bebb8935dddd/metadata/test2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:15:47.792059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-829412e7-c1ac-45b2-b5e0-dde0c0ad9213 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:47.792584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-829412e7-c1ac-45b2-b5e0-dde0c0ad9213 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:47.807396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-829412e7-c1ac-45b2-b5e0-dde0c0ad9213 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:47.808050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-829412e7-c1ac-45b2-b5e0-dde0c0ad9213 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:47.809814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-829412e7-c1ac-45b2-b5e0-dde0c0ad9213 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:47.810689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-829412e7-c1ac-45b2-b5e0-dde0c0ad9213 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:47.882616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-829412e7-c1ac-45b2-b5e0-dde0c0ad9213 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:15:47.946552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:48.069769 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-829412e7-c1ac-45b2-b5e0-dde0c0ad9213 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "DELETE /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 204 len: 0 microversion: 2.1 time: 0.282779 Aug 02 07:15:48.071049 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2751/5568] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:15:47 2022] DELETE /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:15:48.082563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3af19f34-c6d2-4005-819f-1f9c3915d4e3 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:48.083911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3af19f34-c6d2-4005-819f-1f9c3915d4e3 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:48.093096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3af19f34-c6d2-4005-819f-1f9c3915d4e3 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:48.094148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3af19f34-c6d2-4005-819f-1f9c3915d4e3 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:48.095555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3af19f34-c6d2-4005-819f-1f9c3915d4e3 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:48.096203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3af19f34-c6d2-4005-819f-1f9c3915d4e3 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:48.400079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2daf18bb-c925-4042-be67-38930c0236e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:48.437117 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2daf18bb-c925-4042-be67-38930c0236e6 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1391 microversion: 2.1 time: 0.826323 Aug 02 07:15:48.437726 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2818/5569] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:47 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1391 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:48.443474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dc3d52b8-c892-492e-b3ca-40ac78378662 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:48.444096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dc3d52b8-c892-492e-b3ca-40ac78378662 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:48.456505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc3d52b8-c892-492e-b3ca-40ac78378662 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:48.457210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc3d52b8-c892-492e-b3ca-40ac78378662 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:48.458269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc3d52b8-c892-492e-b3ca-40ac78378662 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:48.458903 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc3d52b8-c892-492e-b3ca-40ac78378662 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:48.575203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3af19f34-c6d2-4005-819f-1f9c3915d4e3 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:48.585294 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3af19f34-c6d2-4005-819f-1f9c3915d4e3 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1526 microversion: 2.1 time: 0.508917 Aug 02 07:15:48.595381 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2752/5570] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:48 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1526 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:48.683472 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-19ccf017-f4c5-461b-9dff-4e81b6d6df36 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:48.685358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-19ccf017-f4c5-461b-9dff-4e81b6d6df36 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:48.695684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19ccf017-f4c5-461b-9dff-4e81b6d6df36 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:48.696688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19ccf017-f4c5-461b-9dff-4e81b6d6df36 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:48.700353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19ccf017-f4c5-461b-9dff-4e81b6d6df36 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:48.701802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19ccf017-f4c5-461b-9dff-4e81b6d6df36 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:49.330473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dc3d52b8-c892-492e-b3ca-40ac78378662 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:49.341345 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dc3d52b8-c892-492e-b3ca-40ac78378662 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1492 microversion: 2.1 time: 0.902127 Aug 02 07:15:49.342278 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2819/5571] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:48 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1492 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:49.464097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e4ed8769-e61e-47fe-9520-9cd49594f53d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:49.465366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e4ed8769-e61e-47fe-9520-9cd49594f53d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:49.475983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e4ed8769-e61e-47fe-9520-9cd49594f53d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:49.477637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e4ed8769-e61e-47fe-9520-9cd49594f53d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:49.478851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e4ed8769-e61e-47fe-9520-9cd49594f53d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:49.479393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e4ed8769-e61e-47fe-9520-9cd49594f53d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:49.507065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-19ccf017-f4c5-461b-9dff-4e81b6d6df36 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:49.540321 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-19ccf017-f4c5-461b-9dff-4e81b6d6df36 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1316 microversion: 2.1 time: 0.864299 Aug 02 07:15:49.568280 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2753/5572] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:48 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1316 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:49.616724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7a58592a-22e5-412f-901b-2c14c2754ab6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:49.617786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7a58592a-22e5-412f-901b-2c14c2754ab6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:49.631032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a58592a-22e5-412f-901b-2c14c2754ab6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:49.631745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a58592a-22e5-412f-901b-2c14c2754ab6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:49.632731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a58592a-22e5-412f-901b-2c14c2754ab6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:49.633177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a58592a-22e5-412f-901b-2c14c2754ab6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:50.146163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e4ed8769-e61e-47fe-9520-9cd49594f53d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:50.156434 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e4ed8769-e61e-47fe-9520-9cd49594f53d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1391 microversion: 2.1 time: 0.698325 Aug 02 07:15:50.161247 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2820/5573] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:49 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1391 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:50.205023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7a58592a-22e5-412f-901b-2c14c2754ab6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:50.215268 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7a58592a-22e5-412f-901b-2c14c2754ab6 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1526 microversion: 2.1 time: 0.603587 Aug 02 07:15:50.215866 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2754/5574] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:49 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1526 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:50.365919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-92114083-5a02-4b45-9346-bc0b0afed620 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:50.366539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-92114083-5a02-4b45-9346-bc0b0afed620 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:50.375090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-92114083-5a02-4b45-9346-bc0b0afed620 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:50.381439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-92114083-5a02-4b45-9346-bc0b0afed620 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:50.382309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-92114083-5a02-4b45-9346-bc0b0afed620 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:50.382970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-92114083-5a02-4b45-9346-bc0b0afed620 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:50.467719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-68a86b9e-d006-464a-a462-bf4a458361d0 req-a532856b-16f6-42fe-8a61-4275b28a9afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc", "name": "network-vif-plugged", "status": "completed", "tag": "f84ab8a1-e3d2-4d29-97b2-2cf74d942511"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:50.496165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-68a86b9e-d006-464a-a462-bf4a458361d0 req-a532856b-16f6-42fe-8a61-4275b28a9afb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:50.496165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-68a86b9e-d006-464a-a462-bf4a458361d0 req-a532856b-16f6-42fe-8a61-4275b28a9afb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:50.518936 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-68a86b9e-d006-464a-a462-bf4a458361d0 req-a532856b-16f6-42fe-8a61-4275b28a9afb service nova] Creating event network-vif-plugged:f84ab8a1-e3d2-4d29-97b2-2cf74d942511 for instance d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc on n-h1-851337-3 Aug 02 07:15:50.533809 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-68a86b9e-d006-464a-a462-bf4a458361d0 req-a532856b-16f6-42fe-8a61-4275b28a9afb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070266 Aug 02 07:15:50.537177 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2755/5575] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:50.574216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ddb7cb6-95c8-4a3d-8cba-b2837bb033b5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:50.575247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ddb7cb6-95c8-4a3d-8cba-b2837bb033b5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:50.592767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ddb7cb6-95c8-4a3d-8cba-b2837bb033b5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:50.593500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ddb7cb6-95c8-4a3d-8cba-b2837bb033b5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:50.594500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ddb7cb6-95c8-4a3d-8cba-b2837bb033b5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:50.595096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ddb7cb6-95c8-4a3d-8cba-b2837bb033b5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:50.967284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-92114083-5a02-4b45-9346-bc0b0afed620 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:50.984143 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-92114083-5a02-4b45-9346-bc0b0afed620 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1492 microversion: 2.1 time: 0.623010 Aug 02 07:15:50.986257 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2821/5576] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:50 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1492 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:51.013847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e103739d-d3cd-4d19-a82e-0c531190b515 req-aaaed104-11b2-4c2e-b0ba-646c391c8624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f452b3-d2e2-4b10-b02f-49f5eec59f5d", "name": "network-vif-deleted", "tag": "fd998c6c-3787-4804-addf-8b5c9647643a"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:51.035811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e103739d-d3cd-4d19-a82e-0c531190b515 req-aaaed104-11b2-4c2e-b0ba-646c391c8624 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:51.036264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e103739d-d3cd-4d19-a82e-0c531190b515 req-aaaed104-11b2-4c2e-b0ba-646c391c8624 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:51.066816 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e103739d-d3cd-4d19-a82e-0c531190b515 req-aaaed104-11b2-4c2e-b0ba-646c391c8624 service nova] Creating event network-vif-deleted:fd998c6c-3787-4804-addf-8b5c9647643a for instance 60f452b3-d2e2-4b10-b02f-49f5eec59f5d on n-h2-851337-3 Aug 02 07:15:51.075155 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e103739d-d3cd-4d19-a82e-0c531190b515 req-aaaed104-11b2-4c2e-b0ba-646c391c8624 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065521 Aug 02 07:15:51.078918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ddb7cb6-95c8-4a3d-8cba-b2837bb033b5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:51.079623 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2822/5577] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:15:51.091055 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ddb7cb6-95c8-4a3d-8cba-b2837bb033b5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1316 microversion: 2.1 time: 0.522393 Aug 02 07:15:51.093230 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2756/5578] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:50 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1316 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:51.179020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a357be6e-02b7-4d07-809f-199d224a8f65 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:51.179986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a357be6e-02b7-4d07-809f-199d224a8f65 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:51.194569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a357be6e-02b7-4d07-809f-199d224a8f65 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:51.195295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a357be6e-02b7-4d07-809f-199d224a8f65 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:51.196516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a357be6e-02b7-4d07-809f-199d224a8f65 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:51.197291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a357be6e-02b7-4d07-809f-199d224a8f65 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:51.241490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5a8c5b8e-bac1-46e5-9323-c502f8de95bb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:51.242442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5a8c5b8e-bac1-46e5-9323-c502f8de95bb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:51.256274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a8c5b8e-bac1-46e5-9323-c502f8de95bb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:51.260167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a8c5b8e-bac1-46e5-9323-c502f8de95bb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:51.262012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a8c5b8e-bac1-46e5-9323-c502f8de95bb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:51.262874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a8c5b8e-bac1-46e5-9323-c502f8de95bb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:51.313675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a8c5b8e-bac1-46e5-9323-c502f8de95bb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:51.314607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5a8c5b8e-bac1-46e5-9323-c502f8de95bb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:51.315325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-5a8c5b8e-bac1-46e5-9323-c502f8de95bb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lazy-loading 'fault' on Instance uuid 60f452b3-d2e2-4b10-b02f-49f5eec59f5d {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:15:51.432593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5a8c5b8e-bac1-46e5-9323-c502f8de95bb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4b2ca5524d246f6927f6946f885b3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c011bbdb5c4b16916c6d08bcd223ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:51.452114 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5a8c5b8e-bac1-46e5-9323-c502f8de95bb tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 200 len: 1313 microversion: 2.1 time: 0.213327 Aug 02 07:15:51.465924 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2757/5579] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:51 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:51.581556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a357be6e-02b7-4d07-809f-199d224a8f65 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:51.591715 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a357be6e-02b7-4d07-809f-199d224a8f65 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1391 microversion: 2.1 time: 0.417246 Aug 02 07:15:51.616689 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2823/5580] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:51 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1391 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:52.009427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-29f6634e-d01e-4c7d-af2a-12bc4b27fef1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:52.010442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-29f6634e-d01e-4c7d-af2a-12bc4b27fef1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:52.027744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f6634e-d01e-4c7d-af2a-12bc4b27fef1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:52.030661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f6634e-d01e-4c7d-af2a-12bc4b27fef1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:52.031635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f6634e-d01e-4c7d-af2a-12bc4b27fef1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:52.032110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f6634e-d01e-4c7d-af2a-12bc4b27fef1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:52.114495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a79a8177-b208-47bd-8adb-c8e84bf54779 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:52.115394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a79a8177-b208-47bd-8adb-c8e84bf54779 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:52.142239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a79a8177-b208-47bd-8adb-c8e84bf54779 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:52.143685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a79a8177-b208-47bd-8adb-c8e84bf54779 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:52.146310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a79a8177-b208-47bd-8adb-c8e84bf54779 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:52.149289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a79a8177-b208-47bd-8adb-c8e84bf54779 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:52.310243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-29f6634e-d01e-4c7d-af2a-12bc4b27fef1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44f176bdb674f05b727b751c69382ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd671dbd40de4332800d131413db30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:52.321454 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-29f6634e-d01e-4c7d-af2a-12bc4b27fef1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 200 len: 1450 microversion: 2.1 time: 0.315591 Aug 02 07:15:52.322627 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2758/5581] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:52 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 1450 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:52.331499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-839ecb6d-6645-4040-b30b-d01dc8eeb03f req-5012c678-d4d8-4325-bd6e-243bc146b236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b724a4-b410-4a25-b75e-40f78d9c3537", "name": "network-vif-deleted", "tag": "22289b0f-98a7-4313-b0cd-e51d916a1047"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:52.349682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-839ecb6d-6645-4040-b30b-d01dc8eeb03f req-5012c678-d4d8-4325-bd6e-243bc146b236 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:52.350432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-839ecb6d-6645-4040-b30b-d01dc8eeb03f req-5012c678-d4d8-4325-bd6e-243bc146b236 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:52.368290 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-839ecb6d-6645-4040-b30b-d01dc8eeb03f req-5012c678-d4d8-4325-bd6e-243bc146b236 service nova] Creating event network-vif-deleted:22289b0f-98a7-4313-b0cd-e51d916a1047 for instance c1b724a4-b410-4a25-b75e-40f78d9c3537 on n-h1-851337-3 Aug 02 07:15:52.376554 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-839ecb6d-6645-4040-b30b-d01dc8eeb03f req-5012c678-d4d8-4325-bd6e-243bc146b236 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051977 Aug 02 07:15:52.378715 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2759/5582] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:52.477309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-41d461f8-226d-4117-b365-71bc2e37e1d7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:52.478724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-41d461f8-226d-4117-b365-71bc2e37e1d7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] [instance: 60f452b3-d2e2-4b10-b02f-49f5eec59f5d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:52.490560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41d461f8-226d-4117-b365-71bc2e37e1d7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:52.491049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41d461f8-226d-4117-b365-71bc2e37e1d7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:52.491944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41d461f8-226d-4117-b365-71bc2e37e1d7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:52.492468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41d461f8-226d-4117-b365-71bc2e37e1d7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:52.509122 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-41d461f8-226d-4117-b365-71bc2e37e1d7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] HTTP exception thrown: Instance 60f452b3-d2e2-4b10-b02f-49f5eec59f5d could not be found. Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-41d461f8-226d-4117-b365-71bc2e37e1d7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Request method failure captured: Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d HTTP/1.1 Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8JXEchYBUDUSEZxs2mrmfT3OIHRNE94ISmNu0qgcI0LxthoflP3z1BvzbQiUVULSSbQji-6D_oVRzobK0S4TWRA9Rirbh9ROKDQE_xfAtqjWv-g4kozYUv5CyE6q0xmOdxmW8qOAPZuS825ZQO7EJgMwmvjIsdGJQbRt5A2h_ceJw Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_78c011bbdb5c4b16916c6d08bcd223ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/78c011bbdb5c4b16916c6d08bcd223ab"}]}] Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 78c011bbdb5c4b16916c6d08bcd223ab Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-336677216 Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: c4b2ca5524d246f6927f6946f885b3e3 Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-336677216-project Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 60f452b3-d2e2-4b10-b02f-49f5eec59f5d could not be found. Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '60f452b3-d2e2-4b10-b02f-49f5eec59f5d'} Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60f452b3-d2e2-4b10-b02f-49f5eec59f5d could not be found. Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60f452b3-d2e2-4b10-b02f-49f5eec59f5d could not be found. Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:52.517247 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:52.521914 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:52.521914 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:52.521914 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:52.521914 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:52.521914 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:15:52.521914 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:15:52.521914 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60f452b3-d2e2-4b10-b02f-49f5eec59f5d could not be found. Aug 02 07:15:52.521914 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:52.527920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-41d461f8-226d-4117-b365-71bc2e37e1d7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] Returning 404 to user: Instance 60f452b3-d2e2-4b10-b02f-49f5eec59f5d could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:52.529046 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-41d461f8-226d-4117-b365-71bc2e37e1d7 tempest-ServerMetadataNegativeTestJSON-336677216 tempest-ServerMetadataNegativeTestJSON-336677216-project] 10.222.0.79 "GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d" status: 404 len: 111 microversion: 2.1 time: 0.056157 Aug 02 07:15:52.530798 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2760/5583] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:52 2022] GET /compute/v2.1/servers/60f452b3-d2e2-4b10-b02f-49f5eec59f5d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:15:52.614674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a79a8177-b208-47bd-8adb-c8e84bf54779 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:52.619680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9babb9e6-17b1-4816-a8a3-0a759ca92429 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:52.620835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9babb9e6-17b1-4816-a8a3-0a759ca92429 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:52.627268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:52.627941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9babb9e6-17b1-4816-a8a3-0a759ca92429 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:52.628571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9babb9e6-17b1-4816-a8a3-0a759ca92429 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:52.629510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9babb9e6-17b1-4816-a8a3-0a759ca92429 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:52.630442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9babb9e6-17b1-4816-a8a3-0a759ca92429 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:52.637291 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a79a8177-b208-47bd-8adb-c8e84bf54779 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.527903 Aug 02 07:15:52.639384 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2824/5584] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:52 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:52.880043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1487017458", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:52.962959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] validate_networks() for [('0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:15:53.200424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9babb9e6-17b1-4816-a8a3-0a759ca92429 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:53.210638 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9babb9e6-17b1-4816-a8a3-0a759ca92429 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1391 microversion: 2.1 time: 0.594819 Aug 02 07:15:53.212127 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2761/5585] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:52 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1391 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:53.428491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6c43128f-8edc-4aa4-9867-ffa67506de01 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Action: 'create', calling method: .version_select at 0x7f927abc8ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-231533863"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:53.886933 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6c43128f-8edc-4aa4-9867-ffa67506de01 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.672950 Aug 02 07:15:53.888021 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2762/5586] 10.222.0.79 () {60 vars in 1155 bytes} [Tue Aug 2 07:15:53 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 675 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 02 07:15:53.904334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-01b38b5a-fc7c-45c2-932f-fc53d27996a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:53.905367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-01b38b5a-fc7c-45c2-932f-fc53d27996a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] [instance: c1b724a4-b410-4a25-b75e-40f78d9c3537] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:53.915415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01b38b5a-fc7c-45c2-932f-fc53d27996a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:53.916025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01b38b5a-fc7c-45c2-932f-fc53d27996a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:53.917929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01b38b5a-fc7c-45c2-932f-fc53d27996a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:53.918487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-01b38b5a-fc7c-45c2-932f-fc53d27996a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:53.963141 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-01b38b5a-fc7c-45c2-932f-fc53d27996a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] HTTP exception thrown: Instance c1b724a4-b410-4a25-b75e-40f78d9c3537 could not be found. Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-01b38b5a-fc7c-45c2-932f-fc53d27996a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Request method failure captured: Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 HTTP/1.1 Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M6dEJCwsqisvJMx1FltdaU8ZN7iGdMQsr8GGz1LM7LGGrTgpfEyg-nFcWErqu2ZxFs2MyI7uatnNqy943nzzNd6SaYfTcTXM8Iw9UbHnwWTlCmBsa8CMdJAwtw205sNGUPnQInkcowSSZ4QJRGr3cLDTiVZXNwXaQa3TWJQhEXnTvw Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: cd671dbd40de4332800d131413db30ec Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerRescueTestJSON-1808803529 Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cd671dbd40de4332800d131413db30ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd671dbd40de4332800d131413db30ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cd671dbd40de4332800d131413db30ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd671dbd40de4332800d131413db30ec"}]}] Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerRescueTestJSON-1808803529 Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: cd671dbd40de4332800d131413db30ec Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerRescueTestJSON-1808803529 Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerRescueTestJSON-1808803529-project Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: a44f176bdb674f05b727b751c69382ac Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerRescueTestJSON-1808803529-project Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance c1b724a4-b410-4a25-b75e-40f78d9c3537 could not be found. Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'c1b724a4-b410-4a25-b75e-40f78d9c3537'} Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1b724a4-b410-4a25-b75e-40f78d9c3537 could not be found. Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1b724a4-b410-4a25-b75e-40f78d9c3537 could not be found. Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:15:53.970635 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:53.974212 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:15:53.974212 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:15:53.974212 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:15:53.974212 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:15:53.974212 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:15:53.974212 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1b724a4-b410-4a25-b75e-40f78d9c3537 could not be found. Aug 02 07:15:53.974212 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:15:53.983715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-01b38b5a-fc7c-45c2-932f-fc53d27996a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] Returning 404 to user: Instance c1b724a4-b410-4a25-b75e-40f78d9c3537 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:15:53.985025 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-01b38b5a-fc7c-45c2-932f-fc53d27996a1 tempest-ServerRescueTestJSON-1808803529 tempest-ServerRescueTestJSON-1808803529-project] 10.222.0.79 "GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537" status: 404 len: 111 microversion: 2.1 time: 0.091294 Aug 02 07:15:53.986763 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2763/5587] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:53 2022] GET /compute/v2.1/servers/c1b724a4-b410-4a25-b75e-40f78d9c3537 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:15:54.011717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15163d1d-9c26-47cc-840f-cd2c37fae716 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f927b9b2820>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:54.087463 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-15163d1d-9c26-47cc-840f-cd2c37fae716 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5" status: 200 len: 344 microversion: 2.1 time: 0.099355 Aug 02 07:15:54.088477 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2764/5588] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:15:53 2022] GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5 => generated 344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:54.241085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d7ba1241-7a62-4289-aefd-ebce8d0ce05c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:54.241777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d7ba1241-7a62-4289-aefd-ebce8d0ce05c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:54.262040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7ba1241-7a62-4289-aefd-ebce8d0ce05c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:54.262501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7ba1241-7a62-4289-aefd-ebce8d0ce05c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:54.263300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7ba1241-7a62-4289-aefd-ebce8d0ce05c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:54.263771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d7ba1241-7a62-4289-aefd-ebce8d0ce05c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:54.651112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:15:54.651694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:15:54.651988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:15:54.652540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:15:54.652950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:15:54.673212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:54.673687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:54.674510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:54.674939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:54.724015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Getting quotas for project 2ebb8ddce03f488b8842589c2622366a. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:15:54.724015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:15:54.729445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Getting quotas for user 4daee0d1130940a7bd83c339ea56cd3b and project 2ebb8ddce03f488b8842589c2622366a. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:15:54.764442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:15:54.767099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:15:54.841557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d7ba1241-7a62-4289-aefd-ebce8d0ce05c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:54.858987 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d7ba1241-7a62-4289-aefd-ebce8d0ce05c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1563 microversion: 2.1 time: 0.629452 Aug 02 07:15:54.862133 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2f079548-5fb0-418b-b2cd-5b2be36b672f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.989991 Aug 02 07:15:54.867989 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2825/5589] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:15:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:15:54.870507 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2765/5590] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:54 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1563 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:54.882260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02bd3f1c-d425-4ef6-8d47-aebaa0c36ea7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:54.883614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb09914b-279c-4b10-a19c-925181be136e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:54.886032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cb09914b-279c-4b10-a19c-925181be136e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:54.887302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-02bd3f1c-d425-4ef6-8d47-aebaa0c36ea7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:54.905266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb09914b-279c-4b10-a19c-925181be136e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:54.906848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb09914b-279c-4b10-a19c-925181be136e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:54.907734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb09914b-279c-4b10-a19c-925181be136e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:54.908237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb09914b-279c-4b10-a19c-925181be136e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:55.113466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-02bd3f1c-d425-4ef6-8d47-aebaa0c36ea7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:55.122062 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-02bd3f1c-d425-4ef6-8d47-aebaa0c36ea7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 200 len: 1217 microversion: 2.1 time: 0.249389 Aug 02 07:15:55.124619 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2826/5591] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:54 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 1217 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:55.131794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-33ea4045-c84b-4e6b-a442-2cd4ea0db89a tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f927a6d7820>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:55.202623 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-33ea4045-c84b-4e6b-a442-2cd4ea0db89a tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5" status: 200 len: 344 microversion: 2.1 time: 0.075967 Aug 02 07:15:55.204869 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2827/5592] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:15:55 2022] GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:55.418049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cb09914b-279c-4b10-a19c-925181be136e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:55.433430 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cb09914b-279c-4b10-a19c-925181be136e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1563 microversion: 2.1 time: 0.553689 Aug 02 07:15:55.435078 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2766/5593] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:54 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1563 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:15:56.161953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5de6aead-0fab-4782-9c17-fb26909c3a9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:56.163875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5de6aead-0fab-4782-9c17-fb26909c3a9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:56.174589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5de6aead-0fab-4782-9c17-fb26909c3a9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:56.175857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5de6aead-0fab-4782-9c17-fb26909c3a9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:56.194033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5de6aead-0fab-4782-9c17-fb26909c3a9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:56.196280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5de6aead-0fab-4782-9c17-fb26909c3a9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:56.220988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1d987eb0-7222-4b91-942f-1a128a6213d9 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f9279ee0ca0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:56.317560 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1d987eb0-7222-4b91-942f-1a128a6213d9 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5" status: 200 len: 345 microversion: 2.1 time: 0.087490 Aug 02 07:15:56.317560 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2767/5594] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:15:56 2022] GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5 => generated 345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:15:56.327388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f47338c6-6b65-4a3f-bb32-dd6aabcf0550 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Action: 'create', calling method: .version_select at 0x7f927abd6f70>, body: {"snapshot": {"volume_id": "98ccdfc9-6945-4654-b535-584393d31cf5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2073810814"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:15:56.345147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5de6aead-0fab-4782-9c17-fb26909c3a9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:56.378078 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5de6aead-0fab-4782-9c17-fb26909c3a9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 200 len: 1277 microversion: 2.1 time: 0.202631 Aug 02 07:15:56.379173 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2828/5595] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:56 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:56.570075 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f47338c6-6b65-4a3f-bb32-dd6aabcf0550 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.247779 Aug 02 07:15:56.571283 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2768/5596] 10.222.0.79 () {60 vars in 1162 bytes} [Tue Aug 2 07:15:56 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:56.582707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-90ac97be-1640-4ef7-8248-8e0dda202339 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f927a6d7a60>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:56.637589 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-90ac97be-1640-4ef7-8248-8e0dda202339 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5" status: 200 len: 287 microversion: 2.1 time: 0.058960 Aug 02 07:15:56.643968 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2829/5597] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Aug 2 07:15:56 2022] GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:56.653953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-476b4143-3ed1-4207-979a-33ef146de8c5 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f927aa9fd30>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:56.718749 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-476b4143-3ed1-4207-979a-33ef146de8c5 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.072939 Aug 02 07:15:56.726741 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2769/5598] 10.222.0.79 () {58 vars in 1140 bytes} [Tue Aug 2 07:15:56 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:56.739847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f3158d42-92f6-4bab-8cf8-ba35c56bfd5a tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f9279e7ed30>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:56.799779 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f3158d42-92f6-4bab-8cf8-ba35c56bfd5a tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5" status: 200 len: 287 microversion: 2.1 time: 0.068609 Aug 02 07:15:56.802028 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2830/5599] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Aug 2 07:15:56 2022] GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:57.400934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-86e62647-0338-4c2a-acd0-c76ed10576f8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:57.401939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-86e62647-0338-4c2a-acd0-c76ed10576f8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:57.424109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86e62647-0338-4c2a-acd0-c76ed10576f8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:57.424790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86e62647-0338-4c2a-acd0-c76ed10576f8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:57.425777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86e62647-0338-4c2a-acd0-c76ed10576f8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:57.426409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86e62647-0338-4c2a-acd0-c76ed10576f8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:57.643021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-86e62647-0338-4c2a-acd0-c76ed10576f8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:57.671686 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-86e62647-0338-4c2a-acd0-c76ed10576f8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 200 len: 1275 microversion: 2.1 time: 0.268201 Aug 02 07:15:57.678371 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2770/5600] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:57 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 1275 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:57.829197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7278f13f-4923-4724-bb6b-afb674bf424a tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f9279e1f550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:57.886938 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7278f13f-4923-4724-bb6b-afb674bf424a tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5" status: 200 len: 287 microversion: 2.1 time: 0.075876 Aug 02 07:15:57.889957 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2831/5601] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Aug 2 07:15:57 2022] GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:58.691464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4416b4fe-98c6-4b71-ab6b-f74fe33b3cda tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:58.692131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4416b4fe-98c6-4b71-ab6b-f74fe33b3cda tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:58.707590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4416b4fe-98c6-4b71-ab6b-f74fe33b3cda tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:58.708172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4416b4fe-98c6-4b71-ab6b-f74fe33b3cda tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:58.709868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4416b4fe-98c6-4b71-ab6b-f74fe33b3cda tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:58.710511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4416b4fe-98c6-4b71-ab6b-f74fe33b3cda tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:58.888742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4416b4fe-98c6-4b71-ab6b-f74fe33b3cda tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:15:58.901324 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4416b4fe-98c6-4b71-ab6b-f74fe33b3cda tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 200 len: 1275 microversion: 2.1 time: 0.214928 Aug 02 07:15:58.901772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b5581e09-7a0f-4931-b041-3396b7ec1b86 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f9279de2f70>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:58.903885 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2771/5602] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:58 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:15:58.958576 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b5581e09-7a0f-4931-b041-3396b7ec1b86 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5" status: 200 len: 288 microversion: 2.1 time: 0.060321 Aug 02 07:15:58.959155 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2832/5603] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Aug 2 07:15:58 2022] GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5 => generated 288 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:58.974570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0de2ace1-1491-48ba-8554-ef7a560d9593 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f927ac0f310>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:59.109599 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0de2ace1-1491-48ba-8554-ef7a560d9593 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "DELETE /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5" status: 202 len: 0 microversion: 2.1 time: 0.138144 Aug 02 07:15:59.127122 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2772/5604] 10.222.0.79 () {58 vars in 1254 bytes} [Tue Aug 2 07:15:58 2022] DELETE /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:15:59.137113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1a630ecb-777b-42ef-95e8-0ccae1eae8f8 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f9279dd8700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:59.189049 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1a630ecb-777b-42ef-95e8-0ccae1eae8f8 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5" status: 200 len: 287 microversion: 2.1 time: 0.057845 Aug 02 07:15:59.189744 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2833/5605] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Aug 2 07:15:59 2022] GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:15:59.924721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-91037133-8567-45b8-b5da-0b931ed3656c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:15:59.926080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-91037133-8567-45b8-b5da-0b931ed3656c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:15:59.936642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91037133-8567-45b8-b5da-0b931ed3656c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:59.937386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91037133-8567-45b8-b5da-0b931ed3656c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:15:59.938413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91037133-8567-45b8-b5da-0b931ed3656c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:15:59.939004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-91037133-8567-45b8-b5da-0b931ed3656c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:00.204765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b9462795-8312-4b41-8d0b-69aa7f9e2e10 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f9279e1fb80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:00.289154 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b9462795-8312-4b41-8d0b-69aa7f9e2e10 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5" status: 200 len: 287 microversion: 2.1 time: 0.090826 Aug 02 07:16:00.289668 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2834/5606] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Aug 2 07:16:00 2022] GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5 => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:16:00.451383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-91037133-8567-45b8-b5da-0b931ed3656c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:00.463232 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-91037133-8567-45b8-b5da-0b931ed3656c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 200 len: 1317 microversion: 2.1 time: 0.540372 Aug 02 07:16:00.464359 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2773/5607] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:15:59 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:01.305110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ca971dc3-f2f7-4d91-8835-34d338e4a3bd tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f9279de2dc0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:01.353769 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-ca971dc3-f2f7-4d91-8835-34d338e4a3bd tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] HTTP exception thrown: Snapshot f6cd9374-473a-43d1-ba39-08324aa167b5 could not be found. Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ca971dc3-f2f7-4d91-8835-34d338e4a3bd tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Request method failure captured: Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5 HTTP/1.1 Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8ojUxK28MidGew3lkx3ENO3NFEGQprigNn2cUBRwd4N1FTEY74921_zgxSGHiGpvaft-xniJ82dBUkyjzZpyq5yP0DBZHL4MUZTPjjiKvo35Ovsxu7lWz5Effw1EqQm5e0qkbCpL-q5TYmIjm5MpbXOOllZW3mSIySzEhzxzKbdUI Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 68988e1ec5e64377ba742089b4761fe5 Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-966520329 Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/68988e1ec5e64377ba742089b4761fe5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/68988e1ec5e64377ba742089b4761fe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_68988e1ec5e64377ba742089b4761fe5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/68988e1ec5e64377ba742089b4761fe5"}]}] Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-VolumesSnapshotsTestJSON-966520329 Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 68988e1ec5e64377ba742089b4761fe5 Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-966520329 Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-VolumesSnapshotsTestJSON-966520329-project Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 167934ba9cb0410f8b4a175466ecf7e4 Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-VolumesSnapshotsTestJSON-966520329-project Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: exception: Snapshot f6cd9374-473a-43d1-ba39-08324aa167b5 could not be found. Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'f6cd9374-473a-43d1-ba39-08324aa167b5'} Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f6cd9374-473a-43d1-ba39-08324aa167b5 could not be found. (HTTP 404) (Request-ID: req-a6487bc4-da93-49b0-ad96-b6b8772926c6) Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 07:16:01.361880 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f6cd9374-473a-43d1-ba39-08324aa167b5 could not be found. Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f6cd9374-473a-43d1-ba39-08324aa167b5 could not be found. Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f6cd9374-473a-43d1-ba39-08324aa167b5 could not be found. Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ca971dc3-f2f7-4d91-8835-34d338e4a3bd tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Returning 404 to user: Snapshot f6cd9374-473a-43d1-ba39-08324aa167b5 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ca971dc3-f2f7-4d91-8835-34d338e4a3bd tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5" status: 404 len: 111 microversion: 2.1 time: 0.064797 Aug 02 07:16:01.369316 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2835/5608] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Aug 2 07:16:01 2022] GET /compute/v2.1/os-snapshots/f6cd9374-473a-43d1-ba39-08324aa167b5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:16:01.377176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-947529c0-ce6a-4cf2-a009-4b85c5fd1ec6 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f927b18eca0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:01.469252 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-947529c0-ce6a-4cf2-a009-4b85c5fd1ec6 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5" status: 202 len: 0 microversion: 2.1 time: 0.097542 Aug 02 07:16:01.470551 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2774/5609] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 07:16:01 2022] DELETE /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:16:01.490136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-de65d37a-bf0a-46d0-94fb-50314dd3decd tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f9279dd8040>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:01.492781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0a87aa6-4df3-4811-a9dd-89ae8f185f1b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:01.493607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d0a87aa6-4df3-4811-a9dd-89ae8f185f1b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:01.505942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0a87aa6-4df3-4811-a9dd-89ae8f185f1b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:01.506683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0a87aa6-4df3-4811-a9dd-89ae8f185f1b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:01.509395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0a87aa6-4df3-4811-a9dd-89ae8f185f1b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:01.510238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0a87aa6-4df3-4811-a9dd-89ae8f185f1b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:01.576595 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-de65d37a-bf0a-46d0-94fb-50314dd3decd tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5" status: 200 len: 344 microversion: 2.1 time: 0.101354 Aug 02 07:16:01.577163 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2836/5610] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:16:01 2022] GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5 => generated 344 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:16:02.283515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d0a87aa6-4df3-4811-a9dd-89ae8f185f1b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:02.299693 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d0a87aa6-4df3-4811-a9dd-89ae8f185f1b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 200 len: 1317 microversion: 2.1 time: 0.817031 Aug 02 07:16:02.305611 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2775/5611] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:01 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 1317 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:02.592815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f363b907-3c1c-4abb-9cfb-38681d2d6160 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f9279e0c9d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:02.649733 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f363b907-3c1c-4abb-9cfb-38681d2d6160 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5" status: 200 len: 344 microversion: 2.1 time: 0.060847 Aug 02 07:16:02.650694 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2837/5612] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:16:02 2022] GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:16:02.969724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8c1df544-e12b-4087-8324-1fdff136a847 req-01ba1406-ba59-48b9-8913-276628e38e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b35b77a-867b-42a3-a5fa-cef71f4a2b2e", "tag": "a63f05eb-7b84-4817-afe7-6f60d1ee6e28"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:03.017043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8c1df544-e12b-4087-8324-1fdff136a847 req-01ba1406-ba59-48b9-8913-276628e38e64 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:03.017822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8c1df544-e12b-4087-8324-1fdff136a847 req-01ba1406-ba59-48b9-8913-276628e38e64 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:03.042700 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8c1df544-e12b-4087-8324-1fdff136a847 req-01ba1406-ba59-48b9-8913-276628e38e64 service nova] Creating event network-changed:a63f05eb-7b84-4817-afe7-6f60d1ee6e28 for instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e on n-h2-851337-3 Aug 02 07:16:03.066264 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8c1df544-e12b-4087-8324-1fdff136a847 req-01ba1406-ba59-48b9-8913-276628e38e64 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101950 Aug 02 07:16:03.068228 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2776/5613] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:16:03.357833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ae66a83e-80e4-420f-b9e3-1c44fe1afca8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:03.358483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae66a83e-80e4-420f-b9e3-1c44fe1afca8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:03.362500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79c859b7-4d6e-4fde-ad61-ebffb10927fe tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:03.363215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79c859b7-4d6e-4fde-ad61-ebffb10927fe tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:03.379305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae66a83e-80e4-420f-b9e3-1c44fe1afca8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:03.379754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae66a83e-80e4-420f-b9e3-1c44fe1afca8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:03.380543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae66a83e-80e4-420f-b9e3-1c44fe1afca8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:03.380990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae66a83e-80e4-420f-b9e3-1c44fe1afca8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:03.395034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79c859b7-4d6e-4fde-ad61-ebffb10927fe tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:03.395626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79c859b7-4d6e-4fde-ad61-ebffb10927fe tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:03.399868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79c859b7-4d6e-4fde-ad61-ebffb10927fe tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:03.400412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79c859b7-4d6e-4fde-ad61-ebffb10927fe tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:04.208427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79c859b7-4d6e-4fde-ad61-ebffb10927fe tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:04.264234 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79c859b7-4d6e-4fde-ad61-ebffb10927fe tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1563 microversion: 2.1 time: 0.906529 Aug 02 07:16:04.265601 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2777/5614] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:03 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1563 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:04.279833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4f47a8d4-c940-4959-a797-aec962816e55 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f927aa319d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:04.344768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ae66a83e-80e4-420f-b9e3-1c44fe1afca8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:04.358675 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ae66a83e-80e4-420f-b9e3-1c44fe1afca8 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 200 len: 1317 microversion: 2.1 time: 1.033627 Aug 02 07:16:04.359312 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2838/5615] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:03 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 1317 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:04.399620 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4f47a8d4-c940-4959-a797-aec962816e55 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5" status: 200 len: 344 microversion: 2.1 time: 0.131274 Aug 02 07:16:04.401063 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2778/5616] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:16:04 2022] GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:16:05.115633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-67d3388d-d37c-4deb-89ff-af8551aa6fcf req-0b2fb6d7-6f61-4e77-9d63-dd828be784a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc", "tag": "f84ab8a1-e3d2-4d29-97b2-2cf74d942511"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:05.129000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:05.129689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:05.151288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-67d3388d-d37c-4deb-89ff-af8551aa6fcf req-0b2fb6d7-6f61-4e77-9d63-dd828be784a1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:05.151908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-67d3388d-d37c-4deb-89ff-af8551aa6fcf req-0b2fb6d7-6f61-4e77-9d63-dd828be784a1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:05.177335 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-67d3388d-d37c-4deb-89ff-af8551aa6fcf req-0b2fb6d7-6f61-4e77-9d63-dd828be784a1 service nova] Creating event network-changed:f84ab8a1-e3d2-4d29-97b2-2cf74d942511 for instance d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc on n-h1-851337-3 Aug 02 07:16:05.202175 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-67d3388d-d37c-4deb-89ff-af8551aa6fcf req-0b2fb6d7-6f61-4e77-9d63-dd828be784a1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080264 Aug 02 07:16:05.204711 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2839/5617] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:16:05.391765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0457e8d8-4f62-4eab-9869-acf7147f7713 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:05.396658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0457e8d8-4f62-4eab-9869-acf7147f7713 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:05.417230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0457e8d8-4f62-4eab-9869-acf7147f7713 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:05.417659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-84262af1-9402-4b33-8d29-6fd3ac2654c6 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f9279e3a0d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:05.419324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0457e8d8-4f62-4eab-9869-acf7147f7713 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:05.420276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0457e8d8-4f62-4eab-9869-acf7147f7713 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:05.422163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0457e8d8-4f62-4eab-9869-acf7147f7713 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:05.438073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:05.478393 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-84262af1-9402-4b33-8d29-6fd3ac2654c6 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] HTTP exception thrown: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-84262af1-9402-4b33-8d29-6fd3ac2654c6 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Request method failure captured: Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5 HTTP/1.1 Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8ojUxK28MidGew3lkx3ENO3NFEGQprigNn2cUBRwd4N1FTEY74921_zgxSGHiGpvaft-xniJ82dBUkyjzZpyq5yP0DBZHL4MUZTPjjiKvo35Ovsxu7lWz5Effw1EqQm5e0qkbCpL-q5TYmIjm5MpbXOOllZW3mSIySzEhzxzKbdUI Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 68988e1ec5e64377ba742089b4761fe5 Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-966520329 Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/68988e1ec5e64377ba742089b4761fe5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/68988e1ec5e64377ba742089b4761fe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_68988e1ec5e64377ba742089b4761fe5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/68988e1ec5e64377ba742089b4761fe5"}]}] Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-VolumesSnapshotsTestJSON-966520329 Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 68988e1ec5e64377ba742089b4761fe5 Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-966520329 Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-VolumesSnapshotsTestJSON-966520329-project Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 167934ba9cb0410f8b4a175466ecf7e4 Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-VolumesSnapshotsTestJSON-966520329-project Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: exception: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '98ccdfc9-6945-4654-b535-584393d31cf5'} Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. (HTTP 404) (Request-ID: req-0eec19e4-837e-441a-ae95-62f93bbcf044) Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 07:16:05.481612 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-84262af1-9402-4b33-8d29-6fd3ac2654c6 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Returning 404 to user: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-84262af1-9402-4b33-8d29-6fd3ac2654c6 tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5" status: 404 len: 109 microversion: 2.1 time: 0.073452 Aug 02 07:16:05.485799 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2840/5618] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:16:05 2022] GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:16:05.507469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-67eae6fd-f9e9-4f08-8e93-603da57d82ee tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f9279e74af0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:05.547562 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-67eae6fd-f9e9-4f08-8e93-603da57d82ee tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] HTTP exception thrown: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-67eae6fd-f9e9-4f08-8e93-603da57d82ee tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Request method failure captured: Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5 HTTP/1.1 Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8ojUxK28MidGew3lkx3ENO3NFEGQprigNn2cUBRwd4N1FTEY74921_zgxSGHiGpvaft-xniJ82dBUkyjzZpyq5yP0DBZHL4MUZTPjjiKvo35Ovsxu7lWz5Effw1EqQm5e0qkbCpL-q5TYmIjm5MpbXOOllZW3mSIySzEhzxzKbdUI Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 68988e1ec5e64377ba742089b4761fe5 Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-966520329 Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/68988e1ec5e64377ba742089b4761fe5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/68988e1ec5e64377ba742089b4761fe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_68988e1ec5e64377ba742089b4761fe5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/68988e1ec5e64377ba742089b4761fe5"}]}] Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-VolumesSnapshotsTestJSON-966520329 Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 68988e1ec5e64377ba742089b4761fe5 Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-966520329 Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-VolumesSnapshotsTestJSON-966520329-project Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 167934ba9cb0410f8b4a175466ecf7e4 Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-VolumesSnapshotsTestJSON-966520329-project Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: exception: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '98ccdfc9-6945-4654-b535-584393d31cf5'} Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. (HTTP 404) (Request-ID: req-309b3b48-c57d-4437-9502-bc24a725d021) Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 07:16:05.550145 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.554471 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.559322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-67eae6fd-f9e9-4f08-8e93-603da57d82ee tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Returning 404 to user: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:05.560617 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-67eae6fd-f9e9-4f08-8e93-603da57d82ee tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5" status: 404 len: 109 microversion: 2.1 time: 0.068253 Aug 02 07:16:05.561385 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2841/5619] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 07:16:05 2022] DELETE /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:16:05.574944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ec1ff59-d4ff-42af-9b97-805aeb8c459f tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Calling method '.version_select at 0x7f9279e749d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:05.652189 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-9ec1ff59-d4ff-42af-9b97-805aeb8c459f tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] HTTP exception thrown: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ec1ff59-d4ff-42af-9b97-805aeb8c459f tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Request method failure captured: Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5 HTTP/1.1 Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8ojUxK28MidGew3lkx3ENO3NFEGQprigNn2cUBRwd4N1FTEY74921_zgxSGHiGpvaft-xniJ82dBUkyjzZpyq5yP0DBZHL4MUZTPjjiKvo35Ovsxu7lWz5Effw1EqQm5e0qkbCpL-q5TYmIjm5MpbXOOllZW3mSIySzEhzxzKbdUI Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 68988e1ec5e64377ba742089b4761fe5 Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-966520329 Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/68988e1ec5e64377ba742089b4761fe5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/68988e1ec5e64377ba742089b4761fe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_68988e1ec5e64377ba742089b4761fe5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/68988e1ec5e64377ba742089b4761fe5"}]}] Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-VolumesSnapshotsTestJSON-966520329 Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 68988e1ec5e64377ba742089b4761fe5 Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-966520329 Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-VolumesSnapshotsTestJSON-966520329-project Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 167934ba9cb0410f8b4a175466ecf7e4 Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-VolumesSnapshotsTestJSON-966520329-project Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: exception: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '98ccdfc9-6945-4654-b535-584393d31cf5'} Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. (HTTP 404) (Request-ID: req-4f34a437-971f-4648-9a9f-60ea688b404a) Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 07:16:05.655495 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. Aug 02 07:16:05.658960 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:05.665454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ec1ff59-d4ff-42af-9b97-805aeb8c459f tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] Returning 404 to user: Volume 98ccdfc9-6945-4654-b535-584393d31cf5 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:05.666640 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9ec1ff59-d4ff-42af-9b97-805aeb8c459f tempest-VolumesSnapshotsTestJSON-966520329 tempest-VolumesSnapshotsTestJSON-966520329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5" status: 404 len: 109 microversion: 2.1 time: 0.100352 Aug 02 07:16:05.667380 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2842/5620] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:16:05 2022] GET /compute/v2.1/os-volumes/98ccdfc9-6945-4654-b535-584393d31cf5 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:16:06.165102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0457e8d8-4f62-4eab-9869-acf7147f7713 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:06.177767 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0457e8d8-4f62-4eab-9869-acf7147f7713 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 200 len: 1317 microversion: 2.1 time: 0.797364 Aug 02 07:16:06.180325 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2779/5621] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:05 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 1317 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:16:07.204350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7fbeed72-4700-4a05-a884-d1bea80d0119 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:07.205744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7fbeed72-4700-4a05-a884-d1bea80d0119 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:07.226408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7fbeed72-4700-4a05-a884-d1bea80d0119 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:07.227283 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7fbeed72-4700-4a05-a884-d1bea80d0119 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:07.228411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7fbeed72-4700-4a05-a884-d1bea80d0119 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:07.229040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7fbeed72-4700-4a05-a884-d1bea80d0119 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:07.807471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7fbeed72-4700-4a05-a884-d1bea80d0119 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:07.816173 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7fbeed72-4700-4a05-a884-d1bea80d0119 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 200 len: 1317 microversion: 2.1 time: 0.617123 Aug 02 07:16:07.832711 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2843/5622] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:07 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:08.861881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1f471b5a-fdb1-4248-aa12-137612579945 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:08.865408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1f471b5a-fdb1-4248-aa12-137612579945 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:08.907620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f471b5a-fdb1-4248-aa12-137612579945 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:08.911050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f471b5a-fdb1-4248-aa12-137612579945 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:08.915599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f471b5a-fdb1-4248-aa12-137612579945 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:08.916263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f471b5a-fdb1-4248-aa12-137612579945 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:09.366134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1f471b5a-fdb1-4248-aa12-137612579945 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:09.390500 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1f471b5a-fdb1-4248-aa12-137612579945 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 200 len: 1317 microversion: 2.1 time: 0.539138 Aug 02 07:16:09.393076 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2780/5623] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:08 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:09.891981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-1a148059-8b4e-4387-be14-0365ab7959d6 req-9fe36cc7-cc62-4db7-90e2-b98ed12e2c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b35b77a-867b-42a3-a5fa-cef71f4a2b2e", "name": "network-vif-plugged", "status": "completed", "tag": "a63f05eb-7b84-4817-afe7-6f60d1ee6e28"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:09.927287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-1a148059-8b4e-4387-be14-0365ab7959d6 req-9fe36cc7-cc62-4db7-90e2-b98ed12e2c02 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:09.932473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-1a148059-8b4e-4387-be14-0365ab7959d6 req-9fe36cc7-cc62-4db7-90e2-b98ed12e2c02 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:09.972982 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-1a148059-8b4e-4387-be14-0365ab7959d6 req-9fe36cc7-cc62-4db7-90e2-b98ed12e2c02 service nova] Creating event network-vif-plugged:a63f05eb-7b84-4817-afe7-6f60d1ee6e28 for instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e on n-h2-851337-3 Aug 02 07:16:09.987699 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-1a148059-8b4e-4387-be14-0365ab7959d6 req-9fe36cc7-cc62-4db7-90e2-b98ed12e2c02 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098666 Aug 02 07:16:09.990722 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2844/5624] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:16:10.424917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b52679ea-f749-4f3c-ac23-08ef226bdba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:10.426782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b52679ea-f749-4f3c-ac23-08ef226bdba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:10.451801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b52679ea-f749-4f3c-ac23-08ef226bdba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:10.452844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b52679ea-f749-4f3c-ac23-08ef226bdba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:10.453930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b52679ea-f749-4f3c-ac23-08ef226bdba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:10.456241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b52679ea-f749-4f3c-ac23-08ef226bdba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:11.000726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b52679ea-f749-4f3c-ac23-08ef226bdba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:11.022499 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b52679ea-f749-4f3c-ac23-08ef226bdba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 200 len: 1317 microversion: 2.1 time: 0.608606 Aug 02 07:16:11.033933 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2781/5625] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:10 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:12.050401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8cf6313b-fe01-4e7a-af6d-566625cf8f38 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:12.051215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8cf6313b-fe01-4e7a-af6d-566625cf8f38 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:12.069205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8cf6313b-fe01-4e7a-af6d-566625cf8f38 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:12.069427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8cf6313b-fe01-4e7a-af6d-566625cf8f38 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:12.070481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8cf6313b-fe01-4e7a-af6d-566625cf8f38 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:12.070910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8cf6313b-fe01-4e7a-af6d-566625cf8f38 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:12.439780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8cf6313b-fe01-4e7a-af6d-566625cf8f38 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:12.483218 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8cf6313b-fe01-4e7a-af6d-566625cf8f38 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 200 len: 1507 microversion: 2.1 time: 0.437340 Aug 02 07:16:12.483853 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2845/5626] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:12 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:12.516216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c5a7dc55-4247-42a1-8288-e27dc8ffcb52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:12.516216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c5a7dc55-4247-42a1-8288-e27dc8ffcb52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:12.530681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5a7dc55-4247-42a1-8288-e27dc8ffcb52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:12.531117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5a7dc55-4247-42a1-8288-e27dc8ffcb52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:12.531923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5a7dc55-4247-42a1-8288-e27dc8ffcb52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:12.532336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5a7dc55-4247-42a1-8288-e27dc8ffcb52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:12.582590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c5a7dc55-4247-42a1-8288-e27dc8ffcb52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:16:12.747659 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c5a7dc55-4247-42a1-8288-e27dc8ffcb52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 204 len: 0 microversion: 2.1 time: 0.241306 Aug 02 07:16:12.749451 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2782/5627] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:16:12 2022] DELETE /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:16:12.759964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eee0beae-b9c3-46db-b4e0-7035efd77b74 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:12.761262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-eee0beae-b9c3-46db-b4e0-7035efd77b74 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:12.782286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eee0beae-b9c3-46db-b4e0-7035efd77b74 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:12.784153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eee0beae-b9c3-46db-b4e0-7035efd77b74 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:12.784966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eee0beae-b9c3-46db-b4e0-7035efd77b74 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:12.789232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eee0beae-b9c3-46db-b4e0-7035efd77b74 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:13.130219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-eee0beae-b9c3-46db-b4e0-7035efd77b74 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:13.140243 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-eee0beae-b9c3-46db-b4e0-7035efd77b74 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 200 len: 1513 microversion: 2.1 time: 0.386164 Aug 02 07:16:13.142938 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2846/5628] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:12 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 1513 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:14.171530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-344347dc-77da-4b94-b69a-991c4ad24bb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:14.174654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-344347dc-77da-4b94-b69a-991c4ad24bb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:14.200788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-344347dc-77da-4b94-b69a-991c4ad24bb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:14.201805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-344347dc-77da-4b94-b69a-991c4ad24bb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:14.206034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-344347dc-77da-4b94-b69a-991c4ad24bb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:14.206494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-344347dc-77da-4b94-b69a-991c4ad24bb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:15.099782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-344347dc-77da-4b94-b69a-991c4ad24bb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:15.123200 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-344347dc-77da-4b94-b69a-991c4ad24bb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 200 len: 1513 microversion: 2.1 time: 0.961771 Aug 02 07:16:15.125372 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2783/5629] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:14 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 1513 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:15.539207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-93bea2a7-1598-40a5-bea2-0bab14f0ce66 req-4230772a-570f-4a07-b417-f23e2c8b9195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b35b77a-867b-42a3-a5fa-cef71f4a2b2e", "name": "network-vif-deleted", "tag": "a63f05eb-7b84-4817-afe7-6f60d1ee6e28"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:15.619513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-93bea2a7-1598-40a5-bea2-0bab14f0ce66 req-4230772a-570f-4a07-b417-f23e2c8b9195 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:15.620454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-93bea2a7-1598-40a5-bea2-0bab14f0ce66 req-4230772a-570f-4a07-b417-f23e2c8b9195 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:15.633472 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-93bea2a7-1598-40a5-bea2-0bab14f0ce66 req-4230772a-570f-4a07-b417-f23e2c8b9195 service nova] Creating event network-vif-deleted:a63f05eb-7b84-4817-afe7-6f60d1ee6e28 for instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e on n-h2-851337-3 Aug 02 07:16:15.640637 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-93bea2a7-1598-40a5-bea2-0bab14f0ce66 req-4230772a-570f-4a07-b417-f23e2c8b9195 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113009 Aug 02 07:16:15.642013 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2847/5630] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:16:16.153420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c3319e27-a388-4d8b-a60f-ba727a2d6bc1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:16.154155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c3319e27-a388-4d8b-a60f-ba727a2d6bc1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:16.164738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3319e27-a388-4d8b-a60f-ba727a2d6bc1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:16.165790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3319e27-a388-4d8b-a60f-ba727a2d6bc1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:16.166686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3319e27-a388-4d8b-a60f-ba727a2d6bc1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:16.167126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3319e27-a388-4d8b-a60f-ba727a2d6bc1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:16.224233 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-c3319e27-a388-4d8b-a60f-ba727a2d6bc1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c3319e27-a388-4d8b-a60f-ba727a2d6bc1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e HTTP/1.1 Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '8b35b77a-867b-42a3-a5fa-cef71f4a2b2e'} Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:16.227368 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:16.232089 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:16.232089 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:16.232089 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:16.232089 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:16.232089 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:16.232089 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:16:16.232089 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:16.234847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c3319e27-a388-4d8b-a60f-ba727a2d6bc1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:16.235924 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c3319e27-a388-4d8b-a60f-ba727a2d6bc1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 404 len: 111 microversion: 2.1 time: 0.089050 Aug 02 07:16:16.266497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8bffe990-5b3d-42d7-a848-39185bcd5832 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:16.267263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8bffe990-5b3d-42d7-a848-39185bcd5832 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:16.270716 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2784/5631] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:16 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:16:16.277809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bffe990-5b3d-42d7-a848-39185bcd5832 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:16.278343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bffe990-5b3d-42d7-a848-39185bcd5832 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:16.279138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bffe990-5b3d-42d7-a848-39185bcd5832 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:16.279571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bffe990-5b3d-42d7-a848-39185bcd5832 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:17.155966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8bffe990-5b3d-42d7-a848-39185bcd5832 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:17.165863 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8bffe990-5b3d-42d7-a848-39185bcd5832 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.904160 Aug 02 07:16:17.167243 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2848/5632] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:16 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:17.346825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2410aff5-fca3-4d13-bd2a-10afbfa0c2ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2410aff5-fca3-4d13-bd2a-10afbfa0c2ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 163 Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: {"server": {"name": 12345, "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'networks': [{'uuid': '0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf'}]}}} Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 12345 Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:16:17.351793 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:16:17.356592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:16:17.356592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 02 07:16:17.356592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:17.356592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:17.356592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:17.356592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:17.356592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:17.356592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:17.356592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:16:17.356592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:16:17.356592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 02 07:16:17.356592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:17.358957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2410aff5-fca3-4d13-bd2a-10afbfa0c2ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:17.360117 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2410aff5-fca3-4d13-bd2a-10afbfa0c2ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.019944 Aug 02 07:16:17.361323 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2785/5633] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:16:17 2022] POST /compute/v2.1/servers => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:16:17.370978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2b4895d-e3d9-434e-8244-c9086f8f29a1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:17.372100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f2b4895d-e3d9-434e-8244-c9086f8f29a1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:17.382120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2b4895d-e3d9-434e-8244-c9086f8f29a1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:17.382831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2b4895d-e3d9-434e-8244-c9086f8f29a1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:17.383835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2b4895d-e3d9-434e-8244-c9086f8f29a1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:17.384431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2b4895d-e3d9-434e-8244-c9086f8f29a1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:18.379777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f2b4895d-e3d9-434e-8244-c9086f8f29a1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:18.389065 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f2b4895d-e3d9-434e-8244-c9086f8f29a1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 1.023551 Aug 02 07:16:18.399033 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2849/5634] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:17 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:18.429921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c214295f-9fdb-4b69-9348-c5799009fed9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:18.430582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c214295f-9fdb-4b69-9348-c5799009fed9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:18.444943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:18.485222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c214295f-9fdb-4b69-9348-c5799009fed9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:18.487868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c214295f-9fdb-4b69-9348-c5799009fed9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:18.498292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c214295f-9fdb-4b69-9348-c5799009fed9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:18.501450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c214295f-9fdb-4b69-9348-c5799009fed9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:19.328899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c214295f-9fdb-4b69-9348-c5799009fed9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:19.339965 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c214295f-9fdb-4b69-9348-c5799009fed9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.915375 Aug 02 07:16:19.340688 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2786/5635] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:18 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:22.815977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e14fb9b-50a9-44d4-8557-4c2b6cf75ed5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-740885898", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5aef3cbe-02c4-4f98-9031-08ce0601481c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:23.023169 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-7e14fb9b-50a9-44d4-8557-4c2b6cf75ed5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Block Device 5aef3cbe-02c4-4f98-9031-08ce0601481c is not bootable. Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e14fb9b-50a9-44d4-8557-4c2b6cf75ed5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 357 Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-740885898", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5aef3cbe-02c4-4f98-9031-08ce0601481c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: exception: Block Device 5aef3cbe-02c4-4f98-9031-08ce0601481c is not bootable. Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-740885898', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '5aef3cbe-02c4-4f98-9031-08ce0601481c'}], 'networks': [{'uuid': '0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf'}]}}} Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 5aef3cbe-02c4-4f98-9031-08ce0601481c is not bootable. Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:23.031897 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 5aef3cbe-02c4-4f98-9031-08ce0601481c is not bootable. Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 5aef3cbe-02c4-4f98-9031-08ce0601481c is not bootable. Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e14fb9b-50a9-44d4-8557-4c2b6cf75ed5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Block Device 5aef3cbe-02c4-4f98-9031-08ce0601481c is not bootable. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7e14fb9b-50a9-44d4-8557-4c2b6cf75ed5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.222147 Aug 02 07:16:23.035397 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2850/5636] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:16:22 2022] POST /compute/v2.1/servers => generated 110 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:16:23.042833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3ccb560f-f8a7-4fc2-a91e-6cf4ed32e3ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:23.043881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3ccb560f-f8a7-4fc2-a91e-6cf4ed32e3ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:23.051762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ccb560f-f8a7-4fc2-a91e-6cf4ed32e3ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:23.052641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ccb560f-f8a7-4fc2-a91e-6cf4ed32e3ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:23.053854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ccb560f-f8a7-4fc2-a91e-6cf4ed32e3ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:23.054850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ccb560f-f8a7-4fc2-a91e-6cf4ed32e3ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:23.082256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=51 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:23.310212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1863478078", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "9ff13004-5388-45ee-9d8c-e0945ea16ab8"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:23.399290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] validate_networks() for [('9ff13004-5388-45ee-9d8c-e0945ea16ab8', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:16:23.980876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3ccb560f-f8a7-4fc2-a91e-6cf4ed32e3ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:23.989181 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3ccb560f-f8a7-4fc2-a91e-6cf4ed32e3ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.950328 Aug 02 07:16:23.994291 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2851/5637] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:23 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:16:24.016348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1624e515-3d14-4655-a196-178d2ff980b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:24.016979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1624e515-3d14-4655-a196-178d2ff980b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:24.025504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1624e515-3d14-4655-a196-178d2ff980b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:24.032450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1624e515-3d14-4655-a196-178d2ff980b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:24.034103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1624e515-3d14-4655-a196-178d2ff980b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:24.040747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1624e515-3d14-4655-a196-178d2ff980b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:24.568677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1624e515-3d14-4655-a196-178d2ff980b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:24.581707 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1624e515-3d14-4655-a196-178d2ff980b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.569387 Aug 02 07:16:24.582932 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2852/5638] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:24 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:16:25.256514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:16:25.257009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:16:25.262590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:16:25.263773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:16:25.265937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:16:25.286037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:25.286489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:25.287284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:25.287717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:25.349115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Getting quotas for project 166aac436c6044559c2573db34994c6a. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:16:25.357401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Getting quotas for user 701ccf1916e74b96abedd44c121c1b99 and project 166aac436c6044559c2573db34994c6a. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:16:25.407547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:16:25.411536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:16:25.473122 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-490cc81b-1484-4cad-a8f9-608b4dd19895 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.596417 Aug 02 07:16:25.474512 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2787/5639] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 07:16:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2601 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 07:16:25.485881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6720388b-9f60-4199-b3a8-0c619354a37b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:25.486550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6720388b-9f60-4199-b3a8-0c619354a37b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:25.498622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:25.764264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6720388b-9f60-4199-b3a8-0c619354a37b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:25.784933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6720388b-9f60-4199-b3a8-0c619354a37b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:25.787341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6720388b-9f60-4199-b3a8-0c619354a37b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:25.788640 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6720388b-9f60-4199-b3a8-0c619354a37b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1262 microversion: 2.26 time: 0.307525 Aug 02 07:16:25.792171 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2853/5640] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:25 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1262 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:16:26.818886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-50044170-5be1-469b-99f0-2d23b1d6c6c1 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:26.820279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-50044170-5be1-469b-99f0-2d23b1d6c6c1 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:26.842609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50044170-5be1-469b-99f0-2d23b1d6c6c1 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:26.843233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50044170-5be1-469b-99f0-2d23b1d6c6c1 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:26.848151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50044170-5be1-469b-99f0-2d23b1d6c6c1 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:26.848626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50044170-5be1-469b-99f0-2d23b1d6c6c1 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:27.102856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-50044170-5be1-469b-99f0-2d23b1d6c6c1 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:27.160944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-50044170-5be1-469b-99f0-2d23b1d6c6c1 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:27.166382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-50044170-5be1-469b-99f0-2d23b1d6c6c1 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:27.175168 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-50044170-5be1-469b-99f0-2d23b1d6c6c1 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1266 microversion: 2.26 time: 0.361752 Aug 02 07:16:27.175801 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2788/5641] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:26 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1266 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:16:27.729658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-030976e8-9002-43f1-add5-35107f59e6e7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-641649480", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "fbc11386-7cb6-4309-932b-7acee00d4676", "destination_type": "local"}, {"source_type": "volume", "uuid": "a8885dca-9e42-49d3-a24d-d73796f40fef", "destination_type": "invalid"}], "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-030976e8-9002-43f1-add5-35107f59e6e7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 494 Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-641649480", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "fbc11386-7cb6-4309-932b-7acee00d4676", "destination_type": "local"}, {"source_type": "volume", "uuid": "a8885dca-9e42-49d3-a24d-d73796f40fef", "destination_type": "invalid"}], "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-641649480', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'a8885dca-9e42-49d3-a24d-d73796f40fef', 'destination_type': 'invalid'}], 'networks': [{'uuid': '0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf'}]}}} Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'invalid' Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:27.752858 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 02 07:16:27.756210 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:27.770771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-030976e8-9002-43f1-add5-35107f59e6e7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:27.772004 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-030976e8-9002-43f1-add5-35107f59e6e7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.048898 Aug 02 07:16:27.785092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2adf9cd3-34b1-4ff4-bf4a-2297c3563b9c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:27.786896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2adf9cd3-34b1-4ff4-bf4a-2297c3563b9c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:27.788212 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2854/5642] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:16:27 2022] POST /compute/v2.1/servers => generated 155 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:16:27.823135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2adf9cd3-34b1-4ff4-bf4a-2297c3563b9c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:27.824827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2adf9cd3-34b1-4ff4-bf4a-2297c3563b9c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:27.826339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2adf9cd3-34b1-4ff4-bf4a-2297c3563b9c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:27.827256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2adf9cd3-34b1-4ff4-bf4a-2297c3563b9c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:28.206562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-77bc279b-3702-4d82-841e-d7398b01edc4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:28.207898 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-77bc279b-3702-4d82-841e-d7398b01edc4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:28.224435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77bc279b-3702-4d82-841e-d7398b01edc4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:28.225875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77bc279b-3702-4d82-841e-d7398b01edc4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:28.241986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77bc279b-3702-4d82-841e-d7398b01edc4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:28.243676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77bc279b-3702-4d82-841e-d7398b01edc4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:28.827557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-77bc279b-3702-4d82-841e-d7398b01edc4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:28.848166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-77bc279b-3702-4d82-841e-d7398b01edc4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:28.855036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-77bc279b-3702-4d82-841e-d7398b01edc4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:28.856657 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-77bc279b-3702-4d82-841e-d7398b01edc4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1320 microversion: 2.26 time: 0.660719 Aug 02 07:16:28.856847 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2855/5643] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:28 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1320 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:16:29.215938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2adf9cd3-34b1-4ff4-bf4a-2297c3563b9c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:29.229005 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2adf9cd3-34b1-4ff4-bf4a-2297c3563b9c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 1.450216 Aug 02 07:16:29.237434 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2789/5644] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:27 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:29.261751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2b9db478-1c12-4298-933a-d545cf431278 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:29.263021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2b9db478-1c12-4298-933a-d545cf431278 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:29.270834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b9db478-1c12-4298-933a-d545cf431278 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:29.271597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b9db478-1c12-4298-933a-d545cf431278 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:29.272620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b9db478-1c12-4298-933a-d545cf431278 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:29.273261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b9db478-1c12-4298-933a-d545cf431278 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:29.825605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2b9db478-1c12-4298-933a-d545cf431278 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:29.835033 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2b9db478-1c12-4298-933a-d545cf431278 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.577906 Aug 02 07:16:29.846429 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2856/5645] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:29 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:29.884821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b6c115cc-757e-4a0a-8a62-54d92ba9cbf7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:29.886447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b6c115cc-757e-4a0a-8a62-54d92ba9cbf7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:29.905681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6c115cc-757e-4a0a-8a62-54d92ba9cbf7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:29.909765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6c115cc-757e-4a0a-8a62-54d92ba9cbf7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:29.911839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6c115cc-757e-4a0a-8a62-54d92ba9cbf7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:29.912385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6c115cc-757e-4a0a-8a62-54d92ba9cbf7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:30.125789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b6c115cc-757e-4a0a-8a62-54d92ba9cbf7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:30.139518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b6c115cc-757e-4a0a-8a62-54d92ba9cbf7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:30.141883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b6c115cc-757e-4a0a-8a62-54d92ba9cbf7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:30.143791 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b6c115cc-757e-4a0a-8a62-54d92ba9cbf7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1320 microversion: 2.26 time: 0.267364 Aug 02 07:16:30.144629 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2857/5646] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:29 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1320 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:16:30.170347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-10e869f2-3bab-4e0b-91b1-c842d8e509b9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1457195531", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-10e869f2-3bab-4e0b-91b1-c842d8e509b9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 492 Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1457195531", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1457195531', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf'}]}}} Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:30.177704 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 02 07:16:30.181337 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:30.185270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-10e869f2-3bab-4e0b-91b1-c842d8e509b9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:30.186453 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-10e869f2-3bab-4e0b-91b1-c842d8e509b9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.025124 Aug 02 07:16:30.187734 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2858/5647] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:16:30 2022] POST /compute/v2.1/servers => generated 624 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:16:30.198591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7a33f146-2afd-43e2-99ba-424cedb4e896 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:30.199735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7a33f146-2afd-43e2-99ba-424cedb4e896 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:30.216061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a33f146-2afd-43e2-99ba-424cedb4e896 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:30.217097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a33f146-2afd-43e2-99ba-424cedb4e896 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:30.218193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a33f146-2afd-43e2-99ba-424cedb4e896 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:30.218877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a33f146-2afd-43e2-99ba-424cedb4e896 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:30.389506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f609deec-5c01-477a-92da-1862dd609e02 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:30.393562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f609deec-5c01-477a-92da-1862dd609e02 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:30.421317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f609deec-5c01-477a-92da-1862dd609e02 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:30.422671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f609deec-5c01-477a-92da-1862dd609e02 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:30.425866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f609deec-5c01-477a-92da-1862dd609e02 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:30.426564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f609deec-5c01-477a-92da-1862dd609e02 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:30.522719 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f609deec-5c01-477a-92da-1862dd609e02 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc/action" status: 200 len: 24575 microversion: 2.1 time: 0.664686 Aug 02 07:16:30.524222 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2790/5648] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:16:29 2022] POST /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc/action => generated 24575 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:16:30.818946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7a33f146-2afd-43e2-99ba-424cedb4e896 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:30.828971 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7a33f146-2afd-43e2-99ba-424cedb4e896 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.636439 Aug 02 07:16:30.835539 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2859/5649] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:30 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:16:30.876338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c8cb9a6d-62b5-4c0a-b245-3ec672c173bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:30.877369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c8cb9a6d-62b5-4c0a-b245-3ec672c173bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:30.910728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8cb9a6d-62b5-4c0a-b245-3ec672c173bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:30.913196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8cb9a6d-62b5-4c0a-b245-3ec672c173bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:30.914188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8cb9a6d-62b5-4c0a-b245-3ec672c173bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:30.916090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8cb9a6d-62b5-4c0a-b245-3ec672c173bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:31.172629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-683b1648-da91-4637-834b-5d04642a99c0 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:31.173258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-683b1648-da91-4637-834b-5d04642a99c0 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:31.186701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-683b1648-da91-4637-834b-5d04642a99c0 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:31.187449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-683b1648-da91-4637-834b-5d04642a99c0 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:31.188405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-683b1648-da91-4637-834b-5d04642a99c0 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:31.188993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-683b1648-da91-4637-834b-5d04642a99c0 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:31.500374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c8cb9a6d-62b5-4c0a-b245-3ec672c173bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:31.514558 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c8cb9a6d-62b5-4c0a-b245-3ec672c173bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.652009 Aug 02 07:16:31.515637 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2791/5650] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:30 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:31.698958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ad1c8476-f199-4191-afcf-772d8ae120a0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ad1c8476-f199-4191-afcf-772d8ae120a0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 416 Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'networks': [{'uuid': '0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf'}]}}} Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:31.704053 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 07:16:31.706935 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:31.709866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ad1c8476-f199-4191-afcf-772d8ae120a0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:31.711139 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ad1c8476-f199-4191-afcf-772d8ae120a0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.016568 Aug 02 07:16:31.711973 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2792/5651] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:16:31 2022] POST /compute/v2.1/servers => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 07:16:31.733452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4f1d7d93-3211-4ee3-aa56-9e8a830a01c4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:31.734349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4f1d7d93-3211-4ee3-aa56-9e8a830a01c4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:31.737571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-683b1648-da91-4637-834b-5d04642a99c0 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:31.744729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f1d7d93-3211-4ee3-aa56-9e8a830a01c4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:31.748003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f1d7d93-3211-4ee3-aa56-9e8a830a01c4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:31.750887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f1d7d93-3211-4ee3-aa56-9e8a830a01c4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:31.751624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f1d7d93-3211-4ee3-aa56-9e8a830a01c4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:31.754387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-683b1648-da91-4637-834b-5d04642a99c0 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:31.765327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-683b1648-da91-4637-834b-5d04642a99c0 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:31.770079 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-683b1648-da91-4637-834b-5d04642a99c0 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1362 microversion: 2.26 time: 0.600439 Aug 02 07:16:31.772149 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2860/5652] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:31 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1362 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:16:32.247283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4f1d7d93-3211-4ee3-aa56-9e8a830a01c4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:32.260477 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4f1d7d93-3211-4ee3-aa56-9e8a830a01c4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.543069 Aug 02 07:16:32.261880 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2793/5653] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:31 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:32.290661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3dddadf2-5020-4324-a908-7d773877359e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:32.291279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3dddadf2-5020-4324-a908-7d773877359e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:32.322198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3dddadf2-5020-4324-a908-7d773877359e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:32.323318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3dddadf2-5020-4324-a908-7d773877359e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:32.327596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3dddadf2-5020-4324-a908-7d773877359e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:32.328124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3dddadf2-5020-4324-a908-7d773877359e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:32.802751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ea816c52-44f6-4b7e-a50e-30c069e49deb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:32.804116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ea816c52-44f6-4b7e-a50e-30c069e49deb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:32.813622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ea816c52-44f6-4b7e-a50e-30c069e49deb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:32.815962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ea816c52-44f6-4b7e-a50e-30c069e49deb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:32.817525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ea816c52-44f6-4b7e-a50e-30c069e49deb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:32.818335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ea816c52-44f6-4b7e-a50e-30c069e49deb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:33.224813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3dddadf2-5020-4324-a908-7d773877359e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:33.237229 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3dddadf2-5020-4324-a908-7d773877359e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.950376 Aug 02 07:16:33.237825 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2861/5654] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:32 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:33.403323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8eefed52-fe31-4b46-ab5c-61db16ff6a42 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1551684800", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": -1, "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:33.445079 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-8eefed52-fe31-4b46-ab5c-61db16ff6a42 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Flavor -1 could not be found. Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8eefed52-fe31-4b46-ab5c-61db16ff6a42 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 206 Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1551684800", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": -1, "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: exception: Flavor -1 could not be found. Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1551684800', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': -1, 'networks': [{'uuid': '0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf'}]}}} Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:33.451237 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 02 07:16:33.455607 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:33.458629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8eefed52-fe31-4b46-ab5c-61db16ff6a42 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:33.459710 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8eefed52-fe31-4b46-ab5c-61db16ff6a42 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.063406 Aug 02 07:16:33.461009 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2862/5655] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:16:33 2022] POST /compute/v2.1/servers => generated 73 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 02 07:16:33.473775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3efb1f4c-4873-46bc-b231-dd48af8e3100 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:33.478611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3efb1f4c-4873-46bc-b231-dd48af8e3100 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:33.505598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3efb1f4c-4873-46bc-b231-dd48af8e3100 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:33.506547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3efb1f4c-4873-46bc-b231-dd48af8e3100 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:33.507606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3efb1f4c-4873-46bc-b231-dd48af8e3100 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:33.508533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3efb1f4c-4873-46bc-b231-dd48af8e3100 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:33.757420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ea816c52-44f6-4b7e-a50e-30c069e49deb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:33.771564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ea816c52-44f6-4b7e-a50e-30c069e49deb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:33.775880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ea816c52-44f6-4b7e-a50e-30c069e49deb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:33.780716 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ea816c52-44f6-4b7e-a50e-30c069e49deb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1362 microversion: 2.26 time: 0.984079 Aug 02 07:16:33.782702 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2794/5656] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:32 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1362 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:16:33.922218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3efb1f4c-4873-46bc-b231-dd48af8e3100 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:33.937877 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3efb1f4c-4873-46bc-b231-dd48af8e3100 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.471953 Aug 02 07:16:33.940243 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2863/5657] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:33 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:33.963907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4f91c0fd-2c38-47bb-befe-1ea6df3e5693 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:33.965471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4f91c0fd-2c38-47bb-befe-1ea6df3e5693 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:33.974005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f91c0fd-2c38-47bb-befe-1ea6df3e5693 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:33.974642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f91c0fd-2c38-47bb-befe-1ea6df3e5693 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:33.975594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f91c0fd-2c38-47bb-befe-1ea6df3e5693 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:33.976656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4f91c0fd-2c38-47bb-befe-1ea6df3e5693 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:34.053207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ed19a076-81c4-42c4-9fd2-42cb341f994a req-219e961b-f095-45b7-bca3-c3bcad90f490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f4180d1-2f62-47a9-9605-a07f646758f1", "tag": "dad28cc1-2036-4adf-afb0-c073c8b09d58"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:34.073154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ed19a076-81c4-42c4-9fd2-42cb341f994a req-219e961b-f095-45b7-bca3-c3bcad90f490 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:34.083227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ed19a076-81c4-42c4-9fd2-42cb341f994a req-219e961b-f095-45b7-bca3-c3bcad90f490 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:34.099871 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ed19a076-81c4-42c4-9fd2-42cb341f994a req-219e961b-f095-45b7-bca3-c3bcad90f490 service nova] Creating event network-changed:dad28cc1-2036-4adf-afb0-c073c8b09d58 for instance 2f4180d1-2f62-47a9-9605-a07f646758f1 on n-h2-851337-3 Aug 02 07:16:34.107884 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ed19a076-81c4-42c4-9fd2-42cb341f994a req-219e961b-f095-45b7-bca3-c3bcad90f490 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058673 Aug 02 07:16:34.109128 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2864/5658] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:16:34.272381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4f91c0fd-2c38-47bb-befe-1ea6df3e5693 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:34.284193 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4f91c0fd-2c38-47bb-befe-1ea6df3e5693 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.324128 Aug 02 07:16:34.287975 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2795/5659] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:33 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:16:34.581767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2cd64c65-63e0-4ca0-b94f-3425a041100f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-47433044", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2cd64c65-63e0-4ca0-b94f-3425a041100f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 171 Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-47433044", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-47433044', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf'}]}}} Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi -1 Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:16:34.591934 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:16:34.595626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:16:34.595626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:16:34.595626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:16:34.595626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 02 07:16:34.595626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:34.595626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:34.595626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:34.595626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:34.595626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:34.595626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:34.595626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:16:34.595626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:16:34.595626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 02 07:16:34.595626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:34.600705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2cd64c65-63e0-4ca0-b94f-3425a041100f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:34.601728 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2cd64c65-63e0-4ca0-b94f-3425a041100f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.032188 Aug 02 07:16:34.609272 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2865/5660] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:16:34 2022] POST /compute/v2.1/servers => generated 145 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:16:34.618535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ae8fe024-06bd-4225-a175-0b9b793dc330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:34.619196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ae8fe024-06bd-4225-a175-0b9b793dc330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:34.642231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae8fe024-06bd-4225-a175-0b9b793dc330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:34.642675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae8fe024-06bd-4225-a175-0b9b793dc330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:34.643463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae8fe024-06bd-4225-a175-0b9b793dc330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:34.643896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae8fe024-06bd-4225-a175-0b9b793dc330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:34.806215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-291fb134-beec-4f2d-af94-cea1534619ff tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:34.807268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-291fb134-beec-4f2d-af94-cea1534619ff tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:34.832300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-291fb134-beec-4f2d-af94-cea1534619ff tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:34.833990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-291fb134-beec-4f2d-af94-cea1534619ff tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:34.837722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-291fb134-beec-4f2d-af94-cea1534619ff tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:34.838873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-291fb134-beec-4f2d-af94-cea1534619ff tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:35.131700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-291fb134-beec-4f2d-af94-cea1534619ff tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:35.155481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-291fb134-beec-4f2d-af94-cea1534619ff tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:35.163575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-291fb134-beec-4f2d-af94-cea1534619ff tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:35.166613 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-291fb134-beec-4f2d-af94-cea1534619ff tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1362 microversion: 2.26 time: 0.365160 Aug 02 07:16:35.172343 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2866/5661] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:34 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:16:35.294899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ae8fe024-06bd-4225-a175-0b9b793dc330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:35.315603 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ae8fe024-06bd-4225-a175-0b9b793dc330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.701778 Aug 02 07:16:35.316933 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2796/5662] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:34 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:35.343717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-746ea188-c03e-421b-99cf-6f52e4d5a78b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:35.344732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-746ea188-c03e-421b-99cf-6f52e4d5a78b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:35.359996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-746ea188-c03e-421b-99cf-6f52e4d5a78b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:35.360575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-746ea188-c03e-421b-99cf-6f52e4d5a78b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:35.363416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-746ea188-c03e-421b-99cf-6f52e4d5a78b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:35.365535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-746ea188-c03e-421b-99cf-6f52e4d5a78b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:35.717574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-746ea188-c03e-421b-99cf-6f52e4d5a78b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:35.728113 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-746ea188-c03e-421b-99cf-6f52e4d5a78b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.392457 Aug 02 07:16:35.729380 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2867/5663] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:35 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:36.018491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d6a5a940-59f9-4a95-b672-364e540dc637 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1893977257", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:36.028685 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-d6a5a940-59f9-4a95-b672-364e540dc637 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d6a5a940-59f9-4a95-b672-364e540dc637 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 216 Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1893977257", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1893977257', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:36.031716 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:36.037320 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:36.037320 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:36.037320 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:36.037320 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:36.037320 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:36.037320 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:36.037320 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 02 07:16:36.037320 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:36.039177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d6a5a940-59f9-4a95-b672-364e540dc637 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:36.040350 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d6a5a940-59f9-4a95-b672-364e540dc637 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.028415 Aug 02 07:16:36.041125 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2797/5664] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:16:36 2022] POST /compute/v2.1/servers => generated 123 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:16:36.046623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:36.051437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fab4338a-bf62-4e68-8a29-bf6400f4f93b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:36.052061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fab4338a-bf62-4e68-8a29-bf6400f4f93b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:36.059759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fab4338a-bf62-4e68-8a29-bf6400f4f93b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:36.060677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fab4338a-bf62-4e68-8a29-bf6400f4f93b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:36.061568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fab4338a-bf62-4e68-8a29-bf6400f4f93b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:36.062028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fab4338a-bf62-4e68-8a29-bf6400f4f93b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:36.204505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:36.214328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:36.279362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2872dcd5-57d0-4b6e-b426-f4958fcb0342 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:36.281432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2872dcd5-57d0-4b6e-b426-f4958fcb0342 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:36.293401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2872dcd5-57d0-4b6e-b426-f4958fcb0342 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:36.294935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2872dcd5-57d0-4b6e-b426-f4958fcb0342 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:36.296306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2872dcd5-57d0-4b6e-b426-f4958fcb0342 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:36.296939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2872dcd5-57d0-4b6e-b426-f4958fcb0342 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:36.302934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:36.636768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fab4338a-bf62-4e68-8a29-bf6400f4f93b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:36.649014 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fab4338a-bf62-4e68-8a29-bf6400f4f93b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.603167 Aug 02 07:16:36.663752 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2868/5665] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:36 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:36.675109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b6509950-c83a-47ba-8e19-9f56c91e5f53 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:36.676044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b6509950-c83a-47ba-8e19-9f56c91e5f53 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:36.683542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6509950-c83a-47ba-8e19-9f56c91e5f53 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:36.684288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6509950-c83a-47ba-8e19-9f56c91e5f53 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:36.685266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6509950-c83a-47ba-8e19-9f56c91e5f53 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:36.685859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6509950-c83a-47ba-8e19-9f56c91e5f53 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:37.003566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2872dcd5-57d0-4b6e-b426-f4958fcb0342 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:37.013300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2872dcd5-57d0-4b6e-b426-f4958fcb0342 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:37.014845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2872dcd5-57d0-4b6e-b426-f4958fcb0342 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:37.016023 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2872dcd5-57d0-4b6e-b426-f4958fcb0342 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1362 microversion: 2.26 time: 0.819731 Aug 02 07:16:37.016583 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2798/5666] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:36 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1362 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:16:37.199605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b6509950-c83a-47ba-8e19-9f56c91e5f53 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:37.208183 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b6509950-c83a-47ba-8e19-9f56c91e5f53 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.537518 Aug 02 07:16:37.210337 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2869/5667] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:36 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:16:37.754597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-02afaf0f-45a0-4b94-93e0-a6478ccee047 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-254096068", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "key_name": "tempest-key-476502947", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:37.825947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-02afaf0f-45a0-4b94-93e0-a6478ccee047 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] validate_networks() for [('0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:16:38.054684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-309e7c74-ecea-452b-9ef3-635db66212f4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:38.056361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-309e7c74-ecea-452b-9ef3-635db66212f4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:38.067230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-309e7c74-ecea-452b-9ef3-635db66212f4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:38.070289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-309e7c74-ecea-452b-9ef3-635db66212f4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:38.072334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-309e7c74-ecea-452b-9ef3-635db66212f4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:38.073035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-309e7c74-ecea-452b-9ef3-635db66212f4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:38.411070 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-02afaf0f-45a0-4b94-93e0-a6478ccee047 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Invalid key_name provided. Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-02afaf0f-45a0-4b94-93e0-a6478ccee047 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 245 Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-254096068", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "key_name": "tempest-key-476502947", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid key_name provided. Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-254096068', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'key_name': 'tempest-key-476502947', 'networks': [{'uuid': '0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf'}]}}} Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-476502947 not found for user 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:38.412917 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-02afaf0f-45a0-4b94-93e0-a6478ccee047 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Invalid key_name provided. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:38.417330 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-02afaf0f-45a0-4b94-93e0-a6478ccee047 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.664276 Aug 02 07:16:38.419365 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2799/5668] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:16:37 2022] POST /compute/v2.1/servers => generated 70 bytes in 669 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 02 07:16:38.425015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b41c3469-ae3e-488a-9851-5df7d13aaebe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:38.425814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b41c3469-ae3e-488a-9851-5df7d13aaebe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:38.435842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b41c3469-ae3e-488a-9851-5df7d13aaebe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:38.436315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b41c3469-ae3e-488a-9851-5df7d13aaebe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:38.437581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b41c3469-ae3e-488a-9851-5df7d13aaebe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:38.438200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b41c3469-ae3e-488a-9851-5df7d13aaebe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:38.510593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-309e7c74-ecea-452b-9ef3-635db66212f4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:38.523277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-309e7c74-ecea-452b-9ef3-635db66212f4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:38.525134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-309e7c74-ecea-452b-9ef3-635db66212f4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:38.529409 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-309e7c74-ecea-452b-9ef3-635db66212f4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1362 microversion: 2.26 time: 0.481646 Aug 02 07:16:38.530058 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2870/5669] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:38 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1362 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:16:39.193730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b41c3469-ae3e-488a-9851-5df7d13aaebe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:39.208493 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b41c3469-ae3e-488a-9851-5df7d13aaebe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.788034 Aug 02 07:16:39.209565 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2800/5670] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:38 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:39.231656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1cc43d34-dd56-440a-a34e-ffdb038836f1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:39.232899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1cc43d34-dd56-440a-a34e-ffdb038836f1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:39.241119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1cc43d34-dd56-440a-a34e-ffdb038836f1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:39.241659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1cc43d34-dd56-440a-a34e-ffdb038836f1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:39.243312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1cc43d34-dd56-440a-a34e-ffdb038836f1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:39.243985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1cc43d34-dd56-440a-a34e-ffdb038836f1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:39.552719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-99c93a9b-a0a9-40aa-beb6-b6e6cee7fc56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:39.553343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-99c93a9b-a0a9-40aa-beb6-b6e6cee7fc56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:39.563814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99c93a9b-a0a9-40aa-beb6-b6e6cee7fc56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:39.564273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99c93a9b-a0a9-40aa-beb6-b6e6cee7fc56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:39.565278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99c93a9b-a0a9-40aa-beb6-b6e6cee7fc56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:39.567028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-99c93a9b-a0a9-40aa-beb6-b6e6cee7fc56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:39.795951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1cc43d34-dd56-440a-a34e-ffdb038836f1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:39.808438 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1cc43d34-dd56-440a-a34e-ffdb038836f1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.580901 Aug 02 07:16:39.810785 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2871/5671] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:39 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:39.841814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-d115dd27-2207-4309-b930-5e63f234a445 req-eff2cd8f-396f-4e04-bb57-9f59bd3b480a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f4180d1-2f62-47a9-9605-a07f646758f1", "name": "network-vif-plugged", "status": "completed", "tag": "dad28cc1-2036-4adf-afb0-c073c8b09d58"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:39.868439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d115dd27-2207-4309-b930-5e63f234a445 req-eff2cd8f-396f-4e04-bb57-9f59bd3b480a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:39.868883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d115dd27-2207-4309-b930-5e63f234a445 req-eff2cd8f-396f-4e04-bb57-9f59bd3b480a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:39.900296 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-d115dd27-2207-4309-b930-5e63f234a445 req-eff2cd8f-396f-4e04-bb57-9f59bd3b480a service nova] Creating event network-vif-plugged:dad28cc1-2036-4adf-afb0-c073c8b09d58 for instance 2f4180d1-2f62-47a9-9605-a07f646758f1 on n-h2-851337-3 Aug 02 07:16:39.912318 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-d115dd27-2207-4309-b930-5e63f234a445 req-eff2cd8f-396f-4e04-bb57-9f59bd3b480a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072342 Aug 02 07:16:39.915360 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2872/5672] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:16:40.063324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-99c93a9b-a0a9-40aa-beb6-b6e6cee7fc56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:40.088326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-99c93a9b-a0a9-40aa-beb6-b6e6cee7fc56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:40.096026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-99c93a9b-a0a9-40aa-beb6-b6e6cee7fc56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:40.097248 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-99c93a9b-a0a9-40aa-beb6-b6e6cee7fc56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1362 microversion: 2.26 time: 0.548503 Aug 02 07:16:40.109568 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2801/5673] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:39 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1362 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:16:40.290416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0718bd2a-658d-4e13-930b-cd0f98dc20f1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1080064001", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:40.501171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.security_group_api [None req-0718bd2a-658d-4e13-930b-cd0f98dc20f1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Neutron security group does_not_exist not found {{(pid=126120) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 02 07:16:40.502069 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-0718bd2a-658d-4e13-930b-cd0f98dc20f1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0718bd2a-658d-4e13-930b-cd0f98dc20f1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 258 Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1080064001", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1080064001', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf'}]}}} Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 02 07:16:40.518748 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 02 07:16:40.523257 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:40.528959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0718bd2a-658d-4e13-930b-cd0f98dc20f1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:40.529850 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0718bd2a-658d-4e13-930b-cd0f98dc20f1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.245651 Aug 02 07:16:40.530494 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2873/5674] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:16:40 2022] POST /compute/v2.1/servers => generated 106 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:16:40.539061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e8214d53-fae1-4f1a-b676-d81646bc3686 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:40.540548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e8214d53-fae1-4f1a-b676-d81646bc3686 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:40.550302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8214d53-fae1-4f1a-b676-d81646bc3686 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:40.553183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8214d53-fae1-4f1a-b676-d81646bc3686 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:40.554292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8214d53-fae1-4f1a-b676-d81646bc3686 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:40.556348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e8214d53-fae1-4f1a-b676-d81646bc3686 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:41.137925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b241b5e-d496-4c8e-abf5-a17ee3fa75b7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:41.139695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4b241b5e-d496-4c8e-abf5-a17ee3fa75b7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:41.148023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b241b5e-d496-4c8e-abf5-a17ee3fa75b7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:41.151593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b241b5e-d496-4c8e-abf5-a17ee3fa75b7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:41.152804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b241b5e-d496-4c8e-abf5-a17ee3fa75b7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:41.153458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b241b5e-d496-4c8e-abf5-a17ee3fa75b7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:41.546049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4b241b5e-d496-4c8e-abf5-a17ee3fa75b7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:41.567012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4b241b5e-d496-4c8e-abf5-a17ee3fa75b7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:41.573078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4b241b5e-d496-4c8e-abf5-a17ee3fa75b7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:41.582378 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4b241b5e-d496-4c8e-abf5-a17ee3fa75b7 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1362 microversion: 2.26 time: 0.454671 Aug 02 07:16:41.590191 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2874/5675] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:41 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1362 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:16:41.709187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e8214d53-fae1-4f1a-b676-d81646bc3686 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:41.733194 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e8214d53-fae1-4f1a-b676-d81646bc3686 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 1.184525 Aug 02 07:16:41.746487 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2802/5676] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:40 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:41.762400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-696528a0-1685-416f-8679-1d5400de52b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:41.763055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-696528a0-1685-416f-8679-1d5400de52b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:41.776185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-696528a0-1685-416f-8679-1d5400de52b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:41.776845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-696528a0-1685-416f-8679-1d5400de52b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:41.778949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-696528a0-1685-416f-8679-1d5400de52b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:41.780576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-696528a0-1685-416f-8679-1d5400de52b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:41.788951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:42.089063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-696528a0-1685-416f-8679-1d5400de52b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:42.105192 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-696528a0-1685-416f-8679-1d5400de52b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.348207 Aug 02 07:16:42.117517 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2875/5677] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:41 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:42.128039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-595cacd7-cac7-49ad-a3fd-0fe92b7213ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:42.128759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-595cacd7-cac7-49ad-a3fd-0fe92b7213ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: d6a3c01c-2232-4999-9be4-f896d3874f8c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:42.136551 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-595cacd7-cac7-49ad-a3fd-0fe92b7213ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance d6a3c01c-2232-4999-9be4-f896d3874f8c could not be found. Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-595cacd7-cac7-49ad-a3fd-0fe92b7213ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/d6a3c01c-2232-4999-9be4-f896d3874f8c HTTP/1.1 Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance d6a3c01c-2232-4999-9be4-f896d3874f8c could not be found. Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'd6a3c01c-2232-4999-9be4-f896d3874f8c'} Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6a3c01c-2232-4999-9be4-f896d3874f8c could not be found. Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6a3c01c-2232-4999-9be4-f896d3874f8c could not be found. Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:42.138684 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:42.143125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:42.143125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:42.143125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:42.143125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:42.143125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:42.143125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:42.143125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6a3c01c-2232-4999-9be4-f896d3874f8c could not be found. Aug 02 07:16:42.143125 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:42.144943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-595cacd7-cac7-49ad-a3fd-0fe92b7213ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance d6a3c01c-2232-4999-9be4-f896d3874f8c could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:42.146086 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-595cacd7-cac7-49ad-a3fd-0fe92b7213ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d6a3c01c-2232-4999-9be4-f896d3874f8c" status: 404 len: 111 microversion: 2.1 time: 0.022801 Aug 02 07:16:42.155351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-509d44d5-36a8-48ab-98ea-8d7a9dcb9e35 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:42.156781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-509d44d5-36a8-48ab-98ea-8d7a9dcb9e35 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:42.161861 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2803/5678] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:16:42 2022] DELETE /compute/v2.1/servers/d6a3c01c-2232-4999-9be4-f896d3874f8c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:16:42.164808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-509d44d5-36a8-48ab-98ea-8d7a9dcb9e35 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:42.165621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-509d44d5-36a8-48ab-98ea-8d7a9dcb9e35 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:42.166740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-509d44d5-36a8-48ab-98ea-8d7a9dcb9e35 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:42.167389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-509d44d5-36a8-48ab-98ea-8d7a9dcb9e35 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:42.553485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-509d44d5-36a8-48ab-98ea-8d7a9dcb9e35 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:42.567483 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-509d44d5-36a8-48ab-98ea-8d7a9dcb9e35 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.415976 Aug 02 07:16:42.568409 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2876/5679] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:42 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:42.589452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e6eaaaaf-1646-4344-ac7a-007ab8522988 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:42.592794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e6eaaaaf-1646-4344-ac7a-007ab8522988 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:42.603793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6eaaaaf-1646-4344-ac7a-007ab8522988 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:42.604135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6eaaaaf-1646-4344-ac7a-007ab8522988 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:42.604954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6eaaaaf-1646-4344-ac7a-007ab8522988 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:42.605419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6eaaaaf-1646-4344-ac7a-007ab8522988 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:42.616031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-42e76117-fabe-4b6b-9dba-d19ec353c0cd tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:42.616031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-42e76117-fabe-4b6b-9dba-d19ec353c0cd tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:42.628952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42e76117-fabe-4b6b-9dba-d19ec353c0cd tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:42.630964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42e76117-fabe-4b6b-9dba-d19ec353c0cd tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:42.632362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42e76117-fabe-4b6b-9dba-d19ec353c0cd tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:42.634314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42e76117-fabe-4b6b-9dba-d19ec353c0cd tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:42.999284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-42e76117-fabe-4b6b-9dba-d19ec353c0cd tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:43.013688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-42e76117-fabe-4b6b-9dba-d19ec353c0cd tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:43.018733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-42e76117-fabe-4b6b-9dba-d19ec353c0cd tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:43.022824 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-42e76117-fabe-4b6b-9dba-d19ec353c0cd tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1546 microversion: 2.26 time: 0.414715 Aug 02 07:16:43.040341 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2877/5680] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:42 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1546 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:16:43.061023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2490fe1d-8fd4-45de-b69c-67dcfecf9a4a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f9279dc2f70>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:43.101876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2490fe1d-8fd4-45de-b69c-67dcfecf9a4a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.102352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2490fe1d-8fd4-45de-b69c-67dcfecf9a4a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.102837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2490fe1d-8fd4-45de-b69c-67dcfecf9a4a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:43.126760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2490fe1d-8fd4-45de-b69c-67dcfecf9a4a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.127198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2490fe1d-8fd4-45de-b69c-67dcfecf9a4a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.127977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2490fe1d-8fd4-45de-b69c-67dcfecf9a4a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.128412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2490fe1d-8fd4-45de-b69c-67dcfecf9a4a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.208673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2490fe1d-8fd4-45de-b69c-67dcfecf9a4a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.214995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2490fe1d-8fd4-45de-b69c-67dcfecf9a4a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.231926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2490fe1d-8fd4-45de-b69c-67dcfecf9a4a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.232612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2490fe1d-8fd4-45de-b69c-67dcfecf9a4a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.242797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e6eaaaaf-1646-4344-ac7a-007ab8522988 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:43.256880 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e6eaaaaf-1646-4344-ac7a-007ab8522988 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.669787 Aug 02 07:16:43.258953 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2804/5681] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:42 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:43.286240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-2490fe1d-8fd4-45de-b69c-67dcfecf9a4a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lazy-loading 'flavor' on Instance uuid 2f4180d1-2f62-47a9-9605-a07f646758f1 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:16:43.300448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c323d66b-f8d8-4f27-abd0-8ec2e49c35fd tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:43.305192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c323d66b-f8d8-4f27-abd0-8ec2e49c35fd tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Failed to fetch instance by id 9223372036854775808 {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 02 07:16:43.308308 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-c323d66b-f8d8-4f27-abd0-8ec2e49c35fd tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c323d66b-f8d8-4f27-abd0-8ec2e49c35fd tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 9223372036854775808 could not be found. Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '9223372036854775808'} Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:43.317142 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:43.321689 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:43.321689 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:43.321689 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:43.321689 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 02 07:16:43.321689 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:43.327796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c323d66b-f8d8-4f27-abd0-8ec2e49c35fd tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:43.334013 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c323d66b-f8d8-4f27-abd0-8ec2e49c35fd tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.053564 Aug 02 07:16:43.334362 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2490fe1d-8fd4-45de-b69c-67dcfecf9a4a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "PUT /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-1801910661" status: 201 len: 0 microversion: 2.26 time: 0.281189 Aug 02 07:16:43.335246 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2878/5682] 10.222.0.79 () {62 vars in 1380 bytes} [Tue Aug 2 07:16:43 2022] PUT /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-1801910661 => generated 0 bytes in 285 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 02 07:16:43.339766 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2805/5683] 10.222.0.79 () {58 vars in 1188 bytes} [Tue Aug 2 07:16:43 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:16:43.347717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-34f26bdd-7316-4d11-b201-7bfa7260fb6a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f9279e74dc0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:43.351096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6e3fc019-8148-44c9-a2f8-9c1b27fefa2f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:43.354719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6e3fc019-8148-44c9-a2f8-9c1b27fefa2f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:43.362621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34f26bdd-7316-4d11-b201-7bfa7260fb6a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.363234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e3fc019-8148-44c9-a2f8-9c1b27fefa2f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.363627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34f26bdd-7316-4d11-b201-7bfa7260fb6a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.363870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e3fc019-8148-44c9-a2f8-9c1b27fefa2f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.364847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e3fc019-8148-44c9-a2f8-9c1b27fefa2f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.365407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e3fc019-8148-44c9-a2f8-9c1b27fefa2f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.378534 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-34f26bdd-7316-4d11-b201-7bfa7260fb6a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-1801910661" status: 204 len: 0 microversion: 2.26 time: 0.034721 Aug 02 07:16:43.379629 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2879/5684] 10.222.0.79 () {60 vars in 1361 bytes} [Tue Aug 2 07:16:43 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-1801910661 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:16:43.394632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-882477cc-49c7-4a9c-84f5-88e6d6d5d340 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f9279dfdb80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:43.413881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-882477cc-49c7-4a9c-84f5-88e6d6d5d340 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.416885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-882477cc-49c7-4a9c-84f5-88e6d6d5d340 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.417882 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-882477cc-49c7-4a9c-84f5-88e6d6d5d340 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:43.427855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-882477cc-49c7-4a9c-84f5-88e6d6d5d340 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.428495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-882477cc-49c7-4a9c-84f5-88e6d6d5d340 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.429551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-882477cc-49c7-4a9c-84f5-88e6d6d5d340 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.430155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-882477cc-49c7-4a9c-84f5-88e6d6d5d340 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.462941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-882477cc-49c7-4a9c-84f5-88e6d6d5d340 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.463593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-882477cc-49c7-4a9c-84f5-88e6d6d5d340 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.494259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-882477cc-49c7-4a9c-84f5-88e6d6d5d340 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lazy-loading 'flavor' on Instance uuid 2f4180d1-2f62-47a9-9605-a07f646758f1 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:16:43.520684 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-882477cc-49c7-4a9c-84f5-88e6d6d5d340 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags" status: 204 len: 0 microversion: 2.26 time: 0.136370 Aug 02 07:16:43.526770 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2880/5685] 10.222.0.79 () {60 vars in 1295 bytes} [Tue Aug 2 07:16:43 2022] DELETE /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 02 07:16:43.532427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0e0f7303-7e85-40e3-890e-37c481100ac1 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f9279da8940>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:43.546934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e0f7303-7e85-40e3-890e-37c481100ac1 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.547685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e0f7303-7e85-40e3-890e-37c481100ac1 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.560190 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0e0f7303-7e85-40e3-890e-37c481100ac1 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags" status: 200 len: 12 microversion: 2.26 time: 0.032076 Aug 02 07:16:43.562019 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2881/5686] 10.222.0.79 () {60 vars in 1292 bytes} [Tue Aug 2 07:16:43 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags => generated 12 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:43.580683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3f96dab1-3f3b-4344-bd49-3d054eb6973f tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f9279da8310>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:43.595039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f96dab1-3f3b-4344-bd49-3d054eb6973f tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.595770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f96dab1-3f3b-4344-bd49-3d054eb6973f tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.596415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3f96dab1-3f3b-4344-bd49-3d054eb6973f tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:43.613513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f96dab1-3f3b-4344-bd49-3d054eb6973f tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.613513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f96dab1-3f3b-4344-bd49-3d054eb6973f tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.613513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f96dab1-3f3b-4344-bd49-3d054eb6973f tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.616083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f96dab1-3f3b-4344-bd49-3d054eb6973f tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.664100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f96dab1-3f3b-4344-bd49-3d054eb6973f tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.664631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f96dab1-3f3b-4344-bd49-3d054eb6973f tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.677571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f96dab1-3f3b-4344-bd49-3d054eb6973f tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.678053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f96dab1-3f3b-4344-bd49-3d054eb6973f tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.712116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-3f96dab1-3f3b-4344-bd49-3d054eb6973f tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lazy-loading 'flavor' on Instance uuid 2f4180d1-2f62-47a9-9605-a07f646758f1 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:16:43.733318 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3f96dab1-3f3b-4344-bd49-3d054eb6973f tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "PUT /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-1061765303" status: 201 len: 0 microversion: 2.26 time: 0.158942 Aug 02 07:16:43.734640 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2882/5687] 10.222.0.79 () {62 vars in 1380 bytes} [Tue Aug 2 07:16:43 2022] PUT /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-1061765303 => generated 0 bytes in 161 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 02 07:16:43.747237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6e12a3cd-d9d4-495b-8ed7-f0aa0bdebeba tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f9279e21550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:43.759410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e12a3cd-d9d4-495b-8ed7-f0aa0bdebeba tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.760279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e12a3cd-d9d4-495b-8ed7-f0aa0bdebeba tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.764813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6e3fc019-8148-44c9-a2f8-9c1b27fefa2f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:43.780323 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6e3fc019-8148-44c9-a2f8-9c1b27fefa2f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.439409 Aug 02 07:16:43.791099 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6e12a3cd-d9d4-495b-8ed7-f0aa0bdebeba tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags" status: 200 len: 36 microversion: 2.26 time: 0.050864 Aug 02 07:16:43.799310 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2883/5688] 10.222.0.79 () {60 vars in 1292 bytes} [Tue Aug 2 07:16:43 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags => generated 36 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:43.799639 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2806/5689] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:43 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:43.805113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6ab98a18-a248-46aa-84ac-4540ee903d09 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:43.805813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fb950653-bbd4-4603-a69e-14e2fd156b5e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f927ac0f8b0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:43.806391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6ab98a18-a248-46aa-84ac-4540ee903d09 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:43.814066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ab98a18-a248-46aa-84ac-4540ee903d09 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.814738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ab98a18-a248-46aa-84ac-4540ee903d09 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.815689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb950653-bbd4-4603-a69e-14e2fd156b5e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.816068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ab98a18-a248-46aa-84ac-4540ee903d09 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.816486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb950653-bbd4-4603-a69e-14e2fd156b5e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.816624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ab98a18-a248-46aa-84ac-4540ee903d09 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.817239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fb950653-bbd4-4603-a69e-14e2fd156b5e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:43.825361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb950653-bbd4-4603-a69e-14e2fd156b5e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.826036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb950653-bbd4-4603-a69e-14e2fd156b5e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.826973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb950653-bbd4-4603-a69e-14e2fd156b5e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.827560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb950653-bbd4-4603-a69e-14e2fd156b5e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.859846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb950653-bbd4-4603-a69e-14e2fd156b5e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.860706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb950653-bbd4-4603-a69e-14e2fd156b5e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.923146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-fb950653-bbd4-4603-a69e-14e2fd156b5e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lazy-loading 'flavor' on Instance uuid 2f4180d1-2f62-47a9-9605-a07f646758f1 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:16:43.947675 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fb950653-bbd4-4603-a69e-14e2fd156b5e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-1061765303" status: 204 len: 0 microversion: 2.26 time: 0.146717 Aug 02 07:16:43.948974 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2807/5690] 10.222.0.79 () {60 vars in 1364 bytes} [Tue Aug 2 07:16:43 2022] DELETE /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-1061765303 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:16:43.961926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e9ae9382-d7a8-4389-9918-b48b8766374d tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f927ac0f430>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:43.976261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9ae9382-d7a8-4389-9918-b48b8766374d tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:43.977729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9ae9382-d7a8-4389-9918-b48b8766374d tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:43.994503 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e9ae9382-d7a8-4389-9918-b48b8766374d tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags" status: 200 len: 12 microversion: 2.26 time: 0.040569 Aug 02 07:16:43.996354 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2808/5691] 10.222.0.79 () {60 vars in 1292 bytes} [Tue Aug 2 07:16:43 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags => generated 12 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:16:44.015766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4c50894d-dd72-4803-8f87-4faeaaef17c5 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f927aa311f0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:44.028657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c50894d-dd72-4803-8f87-4faeaaef17c5 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.029676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c50894d-dd72-4803-8f87-4faeaaef17c5 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.030468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4c50894d-dd72-4803-8f87-4faeaaef17c5 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:44.038505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c50894d-dd72-4803-8f87-4faeaaef17c5 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.039635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c50894d-dd72-4803-8f87-4faeaaef17c5 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.040754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c50894d-dd72-4803-8f87-4faeaaef17c5 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.041374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c50894d-dd72-4803-8f87-4faeaaef17c5 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.070206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c50894d-dd72-4803-8f87-4faeaaef17c5 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.070948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c50894d-dd72-4803-8f87-4faeaaef17c5 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.086388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-4c50894d-dd72-4803-8f87-4faeaaef17c5 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lazy-loading 'flavor' on Instance uuid 2f4180d1-2f62-47a9-9605-a07f646758f1 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:16:44.111727 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4c50894d-dd72-4803-8f87-4faeaaef17c5 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags" status: 204 len: 0 microversion: 2.26 time: 0.107460 Aug 02 07:16:44.112973 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2809/5692] 10.222.0.79 () {60 vars in 1295 bytes} [Tue Aug 2 07:16:44 2022] DELETE /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:16:44.125437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2c23f38e-96a4-42dc-95a8-6ff2f734d24b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f927b412b80>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:44.140098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c23f38e-96a4-42dc-95a8-6ff2f734d24b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.140682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c23f38e-96a4-42dc-95a8-6ff2f734d24b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.141466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2c23f38e-96a4-42dc-95a8-6ff2f734d24b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:44.157265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c23f38e-96a4-42dc-95a8-6ff2f734d24b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.158218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c23f38e-96a4-42dc-95a8-6ff2f734d24b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.159087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c23f38e-96a4-42dc-95a8-6ff2f734d24b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.159935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c23f38e-96a4-42dc-95a8-6ff2f734d24b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.206490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c23f38e-96a4-42dc-95a8-6ff2f734d24b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.207487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c23f38e-96a4-42dc-95a8-6ff2f734d24b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.231852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c23f38e-96a4-42dc-95a8-6ff2f734d24b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.233765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c23f38e-96a4-42dc-95a8-6ff2f734d24b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.287089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-2c23f38e-96a4-42dc-95a8-6ff2f734d24b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lazy-loading 'flavor' on Instance uuid 2f4180d1-2f62-47a9-9605-a07f646758f1 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:16:44.310053 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2c23f38e-96a4-42dc-95a8-6ff2f734d24b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "PUT /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-1832776726" status: 201 len: 0 microversion: 2.26 time: 0.190661 Aug 02 07:16:44.311611 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2810/5693] 10.222.0.79 () {62 vars in 1380 bytes} [Tue Aug 2 07:16:44 2022] PUT /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-1832776726 => generated 0 bytes in 193 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 02 07:16:44.327218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c0f2e500-cf6a-4c14-a3d3-914d843efd4e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f927aa4fca0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:44.344159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0f2e500-cf6a-4c14-a3d3-914d843efd4e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.344944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0f2e500-cf6a-4c14-a3d3-914d843efd4e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.346816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c0f2e500-cf6a-4c14-a3d3-914d843efd4e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:44.354414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0f2e500-cf6a-4c14-a3d3-914d843efd4e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.354993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0f2e500-cf6a-4c14-a3d3-914d843efd4e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.355933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0f2e500-cf6a-4c14-a3d3-914d843efd4e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.356315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0f2e500-cf6a-4c14-a3d3-914d843efd4e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.443857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0f2e500-cf6a-4c14-a3d3-914d843efd4e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.454754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0f2e500-cf6a-4c14-a3d3-914d843efd4e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.473967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0f2e500-cf6a-4c14-a3d3-914d843efd4e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.474719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0f2e500-cf6a-4c14-a3d3-914d843efd4e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.505521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6ab98a18-a248-46aa-84ac-4540ee903d09 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:44.508528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-c0f2e500-cf6a-4c14-a3d3-914d843efd4e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lazy-loading 'flavor' on Instance uuid 2f4180d1-2f62-47a9-9605-a07f646758f1 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:16:44.521571 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6ab98a18-a248-46aa-84ac-4540ee903d09 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.719128 Aug 02 07:16:44.535360 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c0f2e500-cf6a-4c14-a3d3-914d843efd4e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "PUT /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-2110555868" status: 201 len: 0 microversion: 2.26 time: 0.216984 Aug 02 07:16:44.536130 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2811/5694] 10.222.0.79 () {62 vars in 1380 bytes} [Tue Aug 2 07:16:44 2022] PUT /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-2110555868 => generated 0 bytes in 219 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 02 07:16:44.539842 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2884/5695] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:43 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:44.545781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e164d93f-05ab-4475-b601-13654796f036 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f928c2a05e0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:44.554730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e164d93f-05ab-4475-b601-13654796f036 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.555551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e164d93f-05ab-4475-b601-13654796f036 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.555861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e164d93f-05ab-4475-b601-13654796f036 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:44.565805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e164d93f-05ab-4475-b601-13654796f036 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.567063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e164d93f-05ab-4475-b601-13654796f036 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.568067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e164d93f-05ab-4475-b601-13654796f036 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.568664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e164d93f-05ab-4475-b601-13654796f036 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.569373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cdab50f7-cff9-40cd-acd6-3f911334d280 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:44.570844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cdab50f7-cff9-40cd-acd6-3f911334d280 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Failed to fetch instance by id -1 {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 02 07:16:44.571779 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-cdab50f7-cff9-40cd-acd6-3f911334d280 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance -1 could not be found. Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cdab50f7-cff9-40cd-acd6-3f911334d280 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance -1 could not be found. Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '-1'} Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:44.574842 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:44.587151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:44.587151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:44.587151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 02 07:16:44.587151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:44.587151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cdab50f7-cff9-40cd-acd6-3f911334d280 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance -1 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:44.587151 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cdab50f7-cff9-40cd-acd6-3f911334d280 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.020691 Aug 02 07:16:44.589353 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2885/5696] 10.222.0.79 () {58 vars in 1137 bytes} [Tue Aug 2 07:16:44 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:16:44.598965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d1fd7010-9093-489c-9739-46fe547d75cc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:44.600016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d1fd7010-9093-489c-9739-46fe547d75cc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:44.606156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e164d93f-05ab-4475-b601-13654796f036 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.606787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e164d93f-05ab-4475-b601-13654796f036 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.613245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1fd7010-9093-489c-9739-46fe547d75cc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.614013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1fd7010-9093-489c-9739-46fe547d75cc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.615072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1fd7010-9093-489c-9739-46fe547d75cc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.615801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d1fd7010-9093-489c-9739-46fe547d75cc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.625276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:44.646491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-e164d93f-05ab-4475-b601-13654796f036 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lazy-loading 'flavor' on Instance uuid 2f4180d1-2f62-47a9-9605-a07f646758f1 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:16:44.682062 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e164d93f-05ab-4475-b601-13654796f036 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags" status: 204 len: 0 microversion: 2.26 time: 0.140218 Aug 02 07:16:44.691239 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2812/5697] 10.222.0.79 () {60 vars in 1295 bytes} [Tue Aug 2 07:16:44 2022] DELETE /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 02 07:16:44.700616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8afbc4f6-3459-4861-9045-38b8260e5d9d tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f927af904c0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:44.722847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8afbc4f6-3459-4861-9045-38b8260e5d9d tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.724441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8afbc4f6-3459-4861-9045-38b8260e5d9d tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.757856 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8afbc4f6-3459-4861-9045-38b8260e5d9d tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags" status: 200 len: 12 microversion: 2.26 time: 0.062978 Aug 02 07:16:44.758876 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2813/5698] 10.222.0.79 () {60 vars in 1292 bytes} [Tue Aug 2 07:16:44 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags => generated 12 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:44.779869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f0f644a3-fc57-40b1-9176-ad3762e5a964 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f928c2a41f0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:44.790306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0f644a3-fc57-40b1-9176-ad3762e5a964 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.791790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0f644a3-fc57-40b1-9176-ad3762e5a964 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.792494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f0f644a3-fc57-40b1-9176-ad3762e5a964 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:44.800608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0f644a3-fc57-40b1-9176-ad3762e5a964 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.801379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0f644a3-fc57-40b1-9176-ad3762e5a964 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.802393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0f644a3-fc57-40b1-9176-ad3762e5a964 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.803021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0f644a3-fc57-40b1-9176-ad3762e5a964 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.834649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0f644a3-fc57-40b1-9176-ad3762e5a964 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.835388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f0f644a3-fc57-40b1-9176-ad3762e5a964 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.849334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-f0f644a3-fc57-40b1-9176-ad3762e5a964 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lazy-loading 'flavor' on Instance uuid 2f4180d1-2f62-47a9-9605-a07f646758f1 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:16:44.869070 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f0f644a3-fc57-40b1-9176-ad3762e5a964 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags" status: 204 len: 0 microversion: 2.26 time: 0.093570 Aug 02 07:16:44.869070 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2814/5699] 10.222.0.79 () {60 vars in 1295 bytes} [Tue Aug 2 07:16:44 2022] DELETE /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:16:44.881359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b9cfa2d0-1951-4df6-8a20-c5e5ca1963c4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f927b167af0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:44.892099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9cfa2d0-1951-4df6-8a20-c5e5ca1963c4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.892559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9cfa2d0-1951-4df6-8a20-c5e5ca1963c4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.894085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b9cfa2d0-1951-4df6-8a20-c5e5ca1963c4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:44.899829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9cfa2d0-1951-4df6-8a20-c5e5ca1963c4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.900339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9cfa2d0-1951-4df6-8a20-c5e5ca1963c4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.901308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9cfa2d0-1951-4df6-8a20-c5e5ca1963c4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.901755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9cfa2d0-1951-4df6-8a20-c5e5ca1963c4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.940640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9cfa2d0-1951-4df6-8a20-c5e5ca1963c4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.941159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9cfa2d0-1951-4df6-8a20-c5e5ca1963c4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.951057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9cfa2d0-1951-4df6-8a20-c5e5ca1963c4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:44.951482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b9cfa2d0-1951-4df6-8a20-c5e5ca1963c4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:44.987781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-b9cfa2d0-1951-4df6-8a20-c5e5ca1963c4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lazy-loading 'flavor' on Instance uuid 2f4180d1-2f62-47a9-9605-a07f646758f1 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:16:45.006207 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b9cfa2d0-1951-4df6-8a20-c5e5ca1963c4 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "PUT /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-385175346" status: 201 len: 0 microversion: 2.26 time: 0.131008 Aug 02 07:16:45.007290 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2815/5700] 10.222.0.79 () {62 vars in 1377 bytes} [Tue Aug 2 07:16:44 2022] PUT /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-385175346 => generated 0 bytes in 133 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 02 07:16:45.017958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a9ef0313-5370-43e0-bcba-af3c6f35104a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f927b6ca0d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:45.028044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9ef0313-5370-43e0-bcba-af3c6f35104a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.028489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9ef0313-5370-43e0-bcba-af3c6f35104a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.028971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a9ef0313-5370-43e0-bcba-af3c6f35104a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:45.048516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9ef0313-5370-43e0-bcba-af3c6f35104a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.048952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9ef0313-5370-43e0-bcba-af3c6f35104a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.049788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9ef0313-5370-43e0-bcba-af3c6f35104a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.050435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9ef0313-5370-43e0-bcba-af3c6f35104a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.121780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9ef0313-5370-43e0-bcba-af3c6f35104a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.122193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9ef0313-5370-43e0-bcba-af3c6f35104a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.141271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9ef0313-5370-43e0-bcba-af3c6f35104a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.141734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9ef0313-5370-43e0-bcba-af3c6f35104a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.188585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d1fd7010-9093-489c-9739-46fe547d75cc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:45.198898 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d1fd7010-9093-489c-9739-46fe547d75cc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.608036 Aug 02 07:16:45.203568 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2886/5701] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:44 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:45.214220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-a9ef0313-5370-43e0-bcba-af3c6f35104a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lazy-loading 'flavor' on Instance uuid 2f4180d1-2f62-47a9-9605-a07f646758f1 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:16:45.237465 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a9ef0313-5370-43e0-bcba-af3c6f35104a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "PUT /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-1279855406" status: 201 len: 0 microversion: 2.26 time: 0.223303 Aug 02 07:16:45.243726 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2816/5702] 10.222.0.79 () {62 vars in 1380 bytes} [Tue Aug 2 07:16:45 2022] PUT /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags/tempest-tag-1279855406 => generated 0 bytes in 231 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 02 07:16:45.244777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b1e7552-29ed-4af5-bc8e-a04747edf40f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:45.246417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b1e7552-29ed-4af5-bc8e-a04747edf40f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:45.251888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a3150e3e-eba6-463f-9e5d-55055b66d9f2 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Action: 'update_all', calling method: .version_select at 0x7f927aa4f040>, body: {"tags": ["tempest-tag-303348860", "tempest-tag-1566067040"]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:45.258775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b1e7552-29ed-4af5-bc8e-a04747edf40f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.259229 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b1e7552-29ed-4af5-bc8e-a04747edf40f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.260032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b1e7552-29ed-4af5-bc8e-a04747edf40f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.260709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b1e7552-29ed-4af5-bc8e-a04747edf40f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.265384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3150e3e-eba6-463f-9e5d-55055b66d9f2 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.266383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3150e3e-eba6-463f-9e5d-55055b66d9f2 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.267390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a3150e3e-eba6-463f-9e5d-55055b66d9f2 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:45.275826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3150e3e-eba6-463f-9e5d-55055b66d9f2 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.276685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3150e3e-eba6-463f-9e5d-55055b66d9f2 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.277672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3150e3e-eba6-463f-9e5d-55055b66d9f2 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.278304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3150e3e-eba6-463f-9e5d-55055b66d9f2 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.311101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3150e3e-eba6-463f-9e5d-55055b66d9f2 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.311977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3150e3e-eba6-463f-9e5d-55055b66d9f2 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.345094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-a3150e3e-eba6-463f-9e5d-55055b66d9f2 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lazy-loading 'flavor' on Instance uuid 2f4180d1-2f62-47a9-9605-a07f646758f1 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:16:45.372364 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a3150e3e-eba6-463f-9e5d-55055b66d9f2 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "PUT /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags" status: 200 len: 61 microversion: 2.26 time: 0.126459 Aug 02 07:16:45.380396 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2817/5703] 10.222.0.79 () {62 vars in 1312 bytes} [Tue Aug 2 07:16:45 2022] PUT /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags => generated 61 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:45.388221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2c4a0c47-f5bc-402a-aaa5-583205c63d18 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f927b141e50>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:45.400119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c4a0c47-f5bc-402a-aaa5-583205c63d18 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.401270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c4a0c47-f5bc-402a-aaa5-583205c63d18 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.412520 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2c4a0c47-f5bc-402a-aaa5-583205c63d18 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags" status: 200 len: 61 microversion: 2.26 time: 0.029693 Aug 02 07:16:45.419072 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2818/5704] 10.222.0.79 () {60 vars in 1292 bytes} [Tue Aug 2 07:16:45 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags => generated 61 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:45.429144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f4355378-5e8f-49af-a327-5098c64f2fbb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '.version_select at 0x7f927b6caa60>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:45.450063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4355378-5e8f-49af-a327-5098c64f2fbb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.451427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4355378-5e8f-49af-a327-5098c64f2fbb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.452496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f4355378-5e8f-49af-a327-5098c64f2fbb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:45.463109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4355378-5e8f-49af-a327-5098c64f2fbb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.463809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4355378-5e8f-49af-a327-5098c64f2fbb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.465134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4355378-5e8f-49af-a327-5098c64f2fbb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.465799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4355378-5e8f-49af-a327-5098c64f2fbb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.492414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4355378-5e8f-49af-a327-5098c64f2fbb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.493339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4355378-5e8f-49af-a327-5098c64f2fbb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.513766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-f4355378-5e8f-49af-a327-5098c64f2fbb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lazy-loading 'flavor' on Instance uuid 2f4180d1-2f62-47a9-9605-a07f646758f1 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:16:45.536258 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f4355378-5e8f-49af-a327-5098c64f2fbb tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags" status: 204 len: 0 microversion: 2.26 time: 0.114287 Aug 02 07:16:45.538104 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2819/5705] 10.222.0.79 () {60 vars in 1295 bytes} [Tue Aug 2 07:16:45 2022] DELETE /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1/tags => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:16:45.553636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6d6928e9-1137-434c-a6f0-0133e5e1ee7b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:45.553636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6d6928e9-1137-434c-a6f0-0133e5e1ee7b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:45.576916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d6928e9-1137-434c-a6f0-0133e5e1ee7b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.582396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d6928e9-1137-434c-a6f0-0133e5e1ee7b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.583442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d6928e9-1137-434c-a6f0-0133e5e1ee7b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.583966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6d6928e9-1137-434c-a6f0-0133e5e1ee7b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.646292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6d6928e9-1137-434c-a6f0-0133e5e1ee7b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:16:45.869560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:45.874665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7b1e7552-29ed-4af5-bc8e-a04747edf40f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:45.889718 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b1e7552-29ed-4af5-bc8e-a04747edf40f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.652293 Aug 02 07:16:45.892266 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2887/5706] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:45 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:45.917065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6280d862-af3e-4be8-b30d-a13ec1fce78e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:45.917611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6280d862-af3e-4be8-b30d-a13ec1fce78e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: a857c85d-3129-4763-a0f0-582c9eb82159] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:45.924648 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-6280d862-af3e-4be8-b30d-a13ec1fce78e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance a857c85d-3129-4763-a0f0-582c9eb82159 could not be found. Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6280d862-af3e-4be8-b30d-a13ec1fce78e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/a857c85d-3129-4763-a0f0-582c9eb82159/action HTTP/1.1 Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 19 Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: {"forceDelete": {}} Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance a857c85d-3129-4763-a0f0-582c9eb82159 could not be found. Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'a857c85d-3129-4763-a0f0-582c9eb82159', 'body': {'forceDelete': {}}} Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a857c85d-3129-4763-a0f0-582c9eb82159 could not be found. Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a857c85d-3129-4763-a0f0-582c9eb82159 could not be found. Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:45.937056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:45.941479 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:45.941479 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:45.941479 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a857c85d-3129-4763-a0f0-582c9eb82159 could not be found. Aug 02 07:16:45.941479 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:45.953274 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6d6928e9-1137-434c-a6f0-0133e5e1ee7b tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 204 len: 0 microversion: 2.26 time: 0.407840 Aug 02 07:16:45.957462 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2820/5707] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 07:16:45 2022] DELETE /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:16:45.958243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6280d862-af3e-4be8-b30d-a13ec1fce78e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance a857c85d-3129-4763-a0f0-582c9eb82159 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:45.971366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-44955df8-2bd6-49b4-ab8a-13f050994a56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:45.972569 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6280d862-af3e-4be8-b30d-a13ec1fce78e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/a857c85d-3129-4763-a0f0-582c9eb82159/action" status: 404 len: 111 microversion: 2.1 time: 0.059654 Aug 02 07:16:45.976405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-44955df8-2bd6-49b4-ab8a-13f050994a56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:45.977089 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2888/5708] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:16:45 2022] POST /compute/v2.1/servers/a857c85d-3129-4763-a0f0-582c9eb82159/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:16:45.982194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e14bed5e-3e62-48ef-b78c-8fd6c780a18c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:45.986697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e14bed5e-3e62-48ef-b78c-8fd6c780a18c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:45.989232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44955df8-2bd6-49b4-ab8a-13f050994a56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.989700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44955df8-2bd6-49b4-ab8a-13f050994a56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:45.993186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44955df8-2bd6-49b4-ab8a-13f050994a56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:45.993644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44955df8-2bd6-49b4-ab8a-13f050994a56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:46.023665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e14bed5e-3e62-48ef-b78c-8fd6c780a18c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:46.024364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e14bed5e-3e62-48ef-b78c-8fd6c780a18c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:46.025489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e14bed5e-3e62-48ef-b78c-8fd6c780a18c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:46.026172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e14bed5e-3e62-48ef-b78c-8fd6c780a18c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:46.459781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e14bed5e-3e62-48ef-b78c-8fd6c780a18c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:46.469488 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e14bed5e-3e62-48ef-b78c-8fd6c780a18c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.491091 Aug 02 07:16:46.473118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44955df8-2bd6-49b4-ab8a-13f050994a56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:46.486773 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2889/5709] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:45 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:46.489981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44955df8-2bd6-49b4-ab8a-13f050994a56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:46.493826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44955df8-2bd6-49b4-ab8a-13f050994a56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:46.496265 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-44955df8-2bd6-49b4-ab8a-13f050994a56 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1552 microversion: 2.26 time: 0.537021 Aug 02 07:16:46.497758 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2821/5710] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:45 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1552 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:16:46.503360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b021af01-9285-4c44-9956-bcf670b79faa tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:46.504364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b021af01-9285-4c44-9956-bcf670b79faa tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:46.515039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b021af01-9285-4c44-9956-bcf670b79faa tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:46.515681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b021af01-9285-4c44-9956-bcf670b79faa tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:46.516458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b021af01-9285-4c44-9956-bcf670b79faa tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:46.516881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b021af01-9285-4c44-9956-bcf670b79faa tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:46.851961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b021af01-9285-4c44-9956-bcf670b79faa tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:46.867099 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b021af01-9285-4c44-9956-bcf670b79faa tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.372926 Aug 02 07:16:46.868109 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2890/5711] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:46 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:46.890228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c4f13343-cf21-4525-a9fc-f5ec9a8a1b13 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:46.894016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c4f13343-cf21-4525-a9fc-f5ec9a8a1b13 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 16971262-f4df-43ea-896e-75759702afa2] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:46.900386 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-c4f13343-cf21-4525-a9fc-f5ec9a8a1b13 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance 16971262-f4df-43ea-896e-75759702afa2 could not be found. Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c4f13343-cf21-4525-a9fc-f5ec9a8a1b13 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/16971262-f4df-43ea-896e-75759702afa2/action HTTP/1.1 Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 39 Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: {"os-getConsoleOutput": {"length": 10}} Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 16971262-f4df-43ea-896e-75759702afa2 could not be found. Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '16971262-f4df-43ea-896e-75759702afa2', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16971262-f4df-43ea-896e-75759702afa2 could not be found. Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16971262-f4df-43ea-896e-75759702afa2 could not be found. Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:46.914405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:46.919054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:46.919054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:46.919054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:46.919054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:46.919054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16971262-f4df-43ea-896e-75759702afa2 could not be found. Aug 02 07:16:46.919054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:46.919054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c4f13343-cf21-4525-a9fc-f5ec9a8a1b13 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance 16971262-f4df-43ea-896e-75759702afa2 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:46.919054 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c4f13343-cf21-4525-a9fc-f5ec9a8a1b13 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/16971262-f4df-43ea-896e-75759702afa2/action" status: 404 len: 111 microversion: 2.1 time: 0.032178 Aug 02 07:16:46.919054 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2822/5712] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:16:46 2022] POST /compute/v2.1/servers/16971262-f4df-43ea-896e-75759702afa2/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:16:46.930398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b5be19da-94ef-4572-948b-3885a16626c6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:46.931724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b5be19da-94ef-4572-948b-3885a16626c6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:46.945142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5be19da-94ef-4572-948b-3885a16626c6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:46.945798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5be19da-94ef-4572-948b-3885a16626c6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:46.947290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5be19da-94ef-4572-948b-3885a16626c6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:46.947732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5be19da-94ef-4572-948b-3885a16626c6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:46.958416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:47.399623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b5be19da-94ef-4572-948b-3885a16626c6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:47.413694 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b5be19da-94ef-4572-948b-3885a16626c6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.489463 Aug 02 07:16:47.413694 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2891/5713] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:46 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:47.445588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-53a8c929-af77-41e6-b982-301d553ca91d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:47.448601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-53a8c929-af77-41e6-b982-301d553ca91d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:47.469191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53a8c929-af77-41e6-b982-301d553ca91d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:47.470274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53a8c929-af77-41e6-b982-301d553ca91d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:47.475597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53a8c929-af77-41e6-b982-301d553ca91d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:47.481139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53a8c929-af77-41e6-b982-301d553ca91d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:47.523556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f4828f5-47d2-4704-b369-bb5f56625057 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:47.524537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4f4828f5-47d2-4704-b369-bb5f56625057 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:47.532347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f4828f5-47d2-4704-b369-bb5f56625057 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:47.536176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f4828f5-47d2-4704-b369-bb5f56625057 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:47.538230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f4828f5-47d2-4704-b369-bb5f56625057 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:47.539001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f4828f5-47d2-4704-b369-bb5f56625057 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:48.201731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-53a8c929-af77-41e6-b982-301d553ca91d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:48.209212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=88,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:48.218834 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-53a8c929-af77-41e6-b982-301d553ca91d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.777600 Aug 02 07:16:48.219877 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2823/5714] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:47 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:48.243688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bbcc93c6-d967-4abc-9be4-0a365b350fd6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:48.244551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bbcc93c6-d967-4abc-9be4-0a365b350fd6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 9e2653d1-52a2-4611-a910-c6997e3a4f1e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:48.259363 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-bbcc93c6-d967-4abc-9be4-0a365b350fd6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance 9e2653d1-52a2-4611-a910-c6997e3a4f1e could not be found. Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bbcc93c6-d967-4abc-9be4-0a365b350fd6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/9e2653d1-52a2-4611-a910-c6997e3a4f1e HTTP/1.1 Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 9e2653d1-52a2-4611-a910-c6997e3a4f1e could not be found. Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '9e2653d1-52a2-4611-a910-c6997e3a4f1e'} Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e2653d1-52a2-4611-a910-c6997e3a4f1e could not be found. Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e2653d1-52a2-4611-a910-c6997e3a4f1e could not be found. Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:48.264820 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:48.269239 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:48.269239 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:48.269239 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:48.269239 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e2653d1-52a2-4611-a910-c6997e3a4f1e could not be found. Aug 02 07:16:48.269239 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:48.273943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bbcc93c6-d967-4abc-9be4-0a365b350fd6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance 9e2653d1-52a2-4611-a910-c6997e3a4f1e could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:48.274937 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bbcc93c6-d967-4abc-9be4-0a365b350fd6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/9e2653d1-52a2-4611-a910-c6997e3a4f1e" status: 404 len: 111 microversion: 2.1 time: 0.036975 Aug 02 07:16:48.275548 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2824/5715] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:48 2022] GET /compute/v2.1/servers/9e2653d1-52a2-4611-a910-c6997e3a4f1e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:16:48.289959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fe62685a-4fda-47c0-8ce5-e1e564d7e374 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:48.290592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fe62685a-4fda-47c0-8ce5-e1e564d7e374 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:48.321279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe62685a-4fda-47c0-8ce5-e1e564d7e374 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:48.323702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe62685a-4fda-47c0-8ce5-e1e564d7e374 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:48.325140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe62685a-4fda-47c0-8ce5-e1e564d7e374 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:48.327975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe62685a-4fda-47c0-8ce5-e1e564d7e374 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:48.393568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4f4828f5-47d2-4704-b369-bb5f56625057 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:48.414445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4f4828f5-47d2-4704-b369-bb5f56625057 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:48.419491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4f4828f5-47d2-4704-b369-bb5f56625057 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:48.423418 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4f4828f5-47d2-4704-b369-bb5f56625057 tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1552 microversion: 2.26 time: 0.903614 Aug 02 07:16:48.427377 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2892/5716] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:47 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1552 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:16:49.452979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ce50caa1-42d3-46d7-95f6-aacc3efdde6e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:49.454446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ce50caa1-42d3-46d7-95f6-aacc3efdde6e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:49.467602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fe62685a-4fda-47c0-8ce5-e1e564d7e374 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:49.481606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce50caa1-42d3-46d7-95f6-aacc3efdde6e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:49.490573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce50caa1-42d3-46d7-95f6-aacc3efdde6e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:49.491887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce50caa1-42d3-46d7-95f6-aacc3efdde6e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:49.492666 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce50caa1-42d3-46d7-95f6-aacc3efdde6e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:49.504160 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fe62685a-4fda-47c0-8ce5-e1e564d7e374 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 1.220615 Aug 02 07:16:49.504780 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2825/5717] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:48 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:49.532189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fd357782-464d-4b7c-943f-05ea64a0c905 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:49.532856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fd357782-464d-4b7c-943f-05ea64a0c905 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:49.544465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd357782-464d-4b7c-943f-05ea64a0c905 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:49.545170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd357782-464d-4b7c-943f-05ea64a0c905 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:49.545821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd357782-464d-4b7c-943f-05ea64a0c905 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:49.546279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd357782-464d-4b7c-943f-05ea64a0c905 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:49.656515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ce50caa1-42d3-46d7-95f6-aacc3efdde6e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:49.674371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ce50caa1-42d3-46d7-95f6-aacc3efdde6e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:49.676316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ce50caa1-42d3-46d7-95f6-aacc3efdde6e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '701ccf1916e74b96abedd44c121c1b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166aac436c6044559c2573db34994c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:49.677581 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ce50caa1-42d3-46d7-95f6-aacc3efdde6e tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 200 len: 1510 microversion: 2.26 time: 0.231387 Aug 02 07:16:49.678596 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2893/5718] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:49 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 1510 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:16:49.701634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-83d9c186-420c-4f92-a221-0abb0e8e2dd7 req-45e59df9-649e-49f5-b061-a9696dc48117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f4180d1-2f62-47a9-9605-a07f646758f1", "name": "network-vif-deleted", "tag": "dad28cc1-2036-4adf-afb0-c073c8b09d58"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:49.732163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-83d9c186-420c-4f92-a221-0abb0e8e2dd7 req-45e59df9-649e-49f5-b061-a9696dc48117 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:49.732952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-83d9c186-420c-4f92-a221-0abb0e8e2dd7 req-45e59df9-649e-49f5-b061-a9696dc48117 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:49.779292 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-83d9c186-420c-4f92-a221-0abb0e8e2dd7 req-45e59df9-649e-49f5-b061-a9696dc48117 service nova] Creating event network-vif-deleted:dad28cc1-2036-4adf-afb0-c073c8b09d58 for instance 2f4180d1-2f62-47a9-9605-a07f646758f1 on n-h2-851337-3 Aug 02 07:16:49.794343 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-83d9c186-420c-4f92-a221-0abb0e8e2dd7 req-45e59df9-649e-49f5-b061-a9696dc48117 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103203 Aug 02 07:16:49.795385 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2894/5719] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:16:49.964309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fd357782-464d-4b7c-943f-05ea64a0c905 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:49.977674 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fd357782-464d-4b7c-943f-05ea64a0c905 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.447003 Aug 02 07:16:49.981507 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2826/5720] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:49 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:16:50.259638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3cb8cdde-af76-49a3-a37c-b72bba294f04 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1671922088", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3cb8cdde-af76-49a3-a37c-b72bba294f04 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 238 Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1671922088", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1671922088', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf'}]}}} Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:50.284765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 02 07:16:50.289510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:50.294499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3cb8cdde-af76-49a3-a37c-b72bba294f04 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:50.294499 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3cb8cdde-af76-49a3-a37c-b72bba294f04 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.041244 Aug 02 07:16:50.297949 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2895/5721] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:16:50 2022] POST /compute/v2.1/servers => generated 139 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:16:50.314846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f2454a6c-cb82-4d14-b7e1-4451533e784e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:50.315546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f2454a6c-cb82-4d14-b7e1-4451533e784e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:50.324167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2454a6c-cb82-4d14-b7e1-4451533e784e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:50.324623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2454a6c-cb82-4d14-b7e1-4451533e784e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:50.325422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2454a6c-cb82-4d14-b7e1-4451533e784e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:50.325871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f2454a6c-cb82-4d14-b7e1-4451533e784e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:50.582187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f2454a6c-cb82-4d14-b7e1-4451533e784e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:50.614077 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f2454a6c-cb82-4d14-b7e1-4451533e784e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.311678 Aug 02 07:16:50.656032 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2827/5722] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:50 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:50.671532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c8039d64-95b1-4c7d-bb48-7943e5371c9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:50.673847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c8039d64-95b1-4c7d-bb48-7943e5371c9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:50.688872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c8039d64-95b1-4c7d-bb48-7943e5371c9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:50.690543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c8039d64-95b1-4c7d-bb48-7943e5371c9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:50.693288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c8039d64-95b1-4c7d-bb48-7943e5371c9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:50.695841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c8039d64-95b1-4c7d-bb48-7943e5371c9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:50.707398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-66ff9b11-f8b9-41d2-b511-e43d615c3a8a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:50.708012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-66ff9b11-f8b9-41d2-b511-e43d615c3a8a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] [instance: 2f4180d1-2f62-47a9-9605-a07f646758f1] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:50.728554 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66ff9b11-f8b9-41d2-b511-e43d615c3a8a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:50.731113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66ff9b11-f8b9-41d2-b511-e43d615c3a8a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:50.733222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66ff9b11-f8b9-41d2-b511-e43d615c3a8a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:50.742385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66ff9b11-f8b9-41d2-b511-e43d615c3a8a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:50.832006 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-66ff9b11-f8b9-41d2-b511-e43d615c3a8a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] HTTP exception thrown: Instance 2f4180d1-2f62-47a9-9605-a07f646758f1 could not be found. Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-66ff9b11-f8b9-41d2-b511-e43d615c3a8a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Request method failure captured: Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 HTTP/1.1 Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M9GF1u4BZg0AsYe2ejDbj7BsnP4aMdmD-vgVDv351E8gSdAxR7hL5HjUtjJIAhK9CNF1b4PPFnUFEJMXq5Wc1iS2tv6Gk9Zecv7VeM5-L0T7fQ82TO61YnTsnZBYdLrH3CImTF6UsfUku19Snq_TbOBmJZuKP92B2l3yjpzM_Jlg44 Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Openstack-Nova-Api-Version: 2.26 Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 166aac436c6044559c2573db34994c6a Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerTagsTestJSON-568158163 Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/166aac436c6044559c2573db34994c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/166aac436c6044559c2573db34994c6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_166aac436c6044559c2573db34994c6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/166aac436c6044559c2573db34994c6a"}]}] Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerTagsTestJSON-568158163 Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 166aac436c6044559c2573db34994c6a Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerTagsTestJSON-568158163 Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerTagsTestJSON-568158163-project Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 701ccf1916e74b96abedd44c121c1b99 Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerTagsTestJSON-568158163-project Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 2f4180d1-2f62-47a9-9605-a07f646758f1 could not be found. Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '2f4180d1-2f62-47a9-9605-a07f646758f1'} Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f4180d1-2f62-47a9-9605-a07f646758f1 could not be found. Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f4180d1-2f62-47a9-9605-a07f646758f1 could not be found. Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:50.833593 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:50.853434 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:50.853434 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:50.853434 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:50.853434 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:50.853434 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:50.853434 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f4180d1-2f62-47a9-9605-a07f646758f1 could not be found. Aug 02 07:16:50.853434 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:50.853434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-66ff9b11-f8b9-41d2-b511-e43d615c3a8a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] Returning 404 to user: Instance 2f4180d1-2f62-47a9-9605-a07f646758f1 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:50.853434 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-66ff9b11-f8b9-41d2-b511-e43d615c3a8a tempest-ServerTagsTestJSON-568158163 tempest-ServerTagsTestJSON-568158163-project] 10.222.0.79 "GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1" status: 404 len: 111 microversion: 2.26 time: 0.142771 Aug 02 07:16:50.853434 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2828/5723] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:16:50 2022] GET /compute/v2.1/servers/2f4180d1-2f62-47a9-9605-a07f646758f1 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:16:51.147189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c8039d64-95b1-4c7d-bb48-7943e5371c9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:51.219636 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c8039d64-95b1-4c7d-bb48-7943e5371c9e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.556715 Aug 02 07:16:51.226592 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2896/5724] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:50 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:51.455436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0b88329c-6173-42a9-a5bf-4f00e97a5c24 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1251611862", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0b88329c-6173-42a9-a5bf-4f00e97a5c24 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 235 Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1251611862", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1251611862', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf'}]}}} Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:51.467224 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 02 07:16:51.471363 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:51.474822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0b88329c-6173-42a9-a5bf-4f00e97a5c24 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:51.476352 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0b88329c-6173-42a9-a5bf-4f00e97a5c24 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.025378 Aug 02 07:16:51.479216 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2829/5725] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:16:51 2022] POST /compute/v2.1/servers => generated 133 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:16:51.489384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-127a2a84-2a42-4842-b165-dc3ff5bf25c5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:51.490506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-127a2a84-2a42-4842-b165-dc3ff5bf25c5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:51.503705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-127a2a84-2a42-4842-b165-dc3ff5bf25c5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:51.508552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-127a2a84-2a42-4842-b165-dc3ff5bf25c5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:51.510278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-127a2a84-2a42-4842-b165-dc3ff5bf25c5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:51.511182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-127a2a84-2a42-4842-b165-dc3ff5bf25c5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:52.091627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-127a2a84-2a42-4842-b165-dc3ff5bf25c5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:52.103995 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-127a2a84-2a42-4842-b165-dc3ff5bf25c5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.620061 Aug 02 07:16:52.107465 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2897/5726] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:51 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:52.134936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b8d770e3-e904-44f9-82f3-b4aef150cc44 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:52.136698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b8d770e3-e904-44f9-82f3-b4aef150cc44 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:52.148568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8d770e3-e904-44f9-82f3-b4aef150cc44 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:52.149704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8d770e3-e904-44f9-82f3-b4aef150cc44 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:52.150872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8d770e3-e904-44f9-82f3-b4aef150cc44 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:52.151611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b8d770e3-e904-44f9-82f3-b4aef150cc44 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:52.573328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b8d770e3-e904-44f9-82f3-b4aef150cc44 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:52.582261 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b8d770e3-e904-44f9-82f3-b4aef150cc44 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.452476 Aug 02 07:16:52.586742 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2830/5727] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:52 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:52.617431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-28ba1404-e672-45ed-a589-9288bdb20427 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:52.618028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-28ba1404-e672-45ed-a589-9288bdb20427 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 99f435b4-1b5f-4a98-a622-c8d473caa09c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:52.630347 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-28ba1404-e672-45ed-a589-9288bdb20427 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance 99f435b4-1b5f-4a98-a622-c8d473caa09c could not be found. Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-28ba1404-e672-45ed-a589-9288bdb20427 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/99f435b4-1b5f-4a98-a622-c8d473caa09c/action HTTP/1.1 Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 13 Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: {"pause": {}} Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 99f435b4-1b5f-4a98-a622-c8d473caa09c could not be found. Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '99f435b4-1b5f-4a98-a622-c8d473caa09c', 'body': {'pause': {}}} Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f435b4-1b5f-4a98-a622-c8d473caa09c could not be found. Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f435b4-1b5f-4a98-a622-c8d473caa09c could not be found. Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:52.638779 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:52.642722 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:52.642722 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:52.642722 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f435b4-1b5f-4a98-a622-c8d473caa09c could not be found. Aug 02 07:16:52.642722 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:52.645697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-28ba1404-e672-45ed-a589-9288bdb20427 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance 99f435b4-1b5f-4a98-a622-c8d473caa09c could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:52.646711 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-28ba1404-e672-45ed-a589-9288bdb20427 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/99f435b4-1b5f-4a98-a622-c8d473caa09c/action" status: 404 len: 111 microversion: 2.1 time: 0.033767 Aug 02 07:16:52.648898 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2898/5728] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:16:52 2022] POST /compute/v2.1/servers/99f435b4-1b5f-4a98-a622-c8d473caa09c/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:16:52.657489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9998e7da-40af-40bd-ad3b-855b706db9e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:52.658183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9998e7da-40af-40bd-ad3b-855b706db9e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:52.669071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9998e7da-40af-40bd-ad3b-855b706db9e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:52.669535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9998e7da-40af-40bd-ad3b-855b706db9e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:52.671194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9998e7da-40af-40bd-ad3b-855b706db9e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:52.671194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9998e7da-40af-40bd-ad3b-855b706db9e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:53.156559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9998e7da-40af-40bd-ad3b-855b706db9e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:53.187512 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9998e7da-40af-40bd-ad3b-855b706db9e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.533781 Aug 02 07:16:53.189758 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2831/5729] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:52 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:16:53.213228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-516bf308-bb0f-4602-ac40-d5f8c5391824 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:53.214946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-516bf308-bb0f-4602-ac40-d5f8c5391824 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:53.225587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-516bf308-bb0f-4602-ac40-d5f8c5391824 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:53.226552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-516bf308-bb0f-4602-ac40-d5f8c5391824 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:53.227653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-516bf308-bb0f-4602-ac40-d5f8c5391824 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:53.228486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-516bf308-bb0f-4602-ac40-d5f8c5391824 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:53.556507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-516bf308-bb0f-4602-ac40-d5f8c5391824 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:53.572364 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-516bf308-bb0f-4602-ac40-d5f8c5391824 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.360906 Aug 02 07:16:53.573587 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2899/5730] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:53 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:53.598877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-32fdcc8c-adad-4586-a066-2d9712130733 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:53.599430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-32fdcc8c-adad-4586-a066-2d9712130733 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:53.612968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32fdcc8c-adad-4586-a066-2d9712130733 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:53.613423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32fdcc8c-adad-4586-a066-2d9712130733 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:53.614258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32fdcc8c-adad-4586-a066-2d9712130733 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:53.614711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32fdcc8c-adad-4586-a066-2d9712130733 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:53.822117 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-32fdcc8c-adad-4586-a066-2d9712130733 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action" status: 202 len: 0 microversion: 2.1 time: 0.212598 Aug 02 07:16:53.827922 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2832/5731] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:16:53 2022] POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:16:53.849544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cc81f1ea-cdd3-4726-be41-052303ee19da tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:53.850353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cc81f1ea-cdd3-4726-be41-052303ee19da tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:53.873367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc81f1ea-cdd3-4726-be41-052303ee19da tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:53.878765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc81f1ea-cdd3-4726-be41-052303ee19da tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:53.881318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc81f1ea-cdd3-4726-be41-052303ee19da tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:53.882328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cc81f1ea-cdd3-4726-be41-052303ee19da tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:54.497786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cc81f1ea-cdd3-4726-be41-052303ee19da tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:54.514611 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cc81f1ea-cdd3-4726-be41-052303ee19da tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1510 microversion: 2.1 time: 0.685373 Aug 02 07:16:54.518003 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2900/5732] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:53 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1510 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:16:55.559834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a28cc599-7530-49d5-81ac-fe2831aa8ed3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:55.562089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a28cc599-7530-49d5-81ac-fe2831aa8ed3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:55.573817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a28cc599-7530-49d5-81ac-fe2831aa8ed3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:55.574561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a28cc599-7530-49d5-81ac-fe2831aa8ed3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:55.575568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a28cc599-7530-49d5-81ac-fe2831aa8ed3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:55.576160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a28cc599-7530-49d5-81ac-fe2831aa8ed3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:56.336365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a28cc599-7530-49d5-81ac-fe2831aa8ed3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:56.349321 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a28cc599-7530-49d5-81ac-fe2831aa8ed3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1490 microversion: 2.1 time: 0.803249 Aug 02 07:16:56.358813 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2833/5733] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:55 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1490 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:56.388932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c126708f-40b7-4fb8-9ee8-15b4c66056b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:56.390376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c126708f-40b7-4fb8-9ee8-15b4c66056b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:56.395525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=94 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:16:56.412054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c126708f-40b7-4fb8-9ee8-15b4c66056b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:56.416864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c126708f-40b7-4fb8-9ee8-15b4c66056b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:56.418676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c126708f-40b7-4fb8-9ee8-15b4c66056b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:56.420378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c126708f-40b7-4fb8-9ee8-15b4c66056b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:56.479637 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-c126708f-40b7-4fb8-9ee8-15b4c66056b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Cannot 'pause' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state paused Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c126708f-40b7-4fb8-9ee8-15b4c66056b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action HTTP/1.1 Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 13 Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: {"pause": {}} Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: exception: Cannot 'pause' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state paused Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '3d2edf07-e6a8-472c-9d71-a0691e66b90d', 'body': {'pause': {}}} Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d in vm_state paused. Cannot pause while the instance is in this state. Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state paused Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:56.485230 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:56.489817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:56.489817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:56.489817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:56.489817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state paused Aug 02 07:16:56.489817 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:16:56.489817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c126708f-40b7-4fb8-9ee8-15b4c66056b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 409 to user: Cannot 'pause' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state paused {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:56.491653 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c126708f-40b7-4fb8-9ee8-15b4c66056b6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action" status: 409 len: 143 microversion: 2.1 time: 0.107615 Aug 02 07:16:56.495961 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2901/5734] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:16:56 2022] POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action => generated 143 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:16:56.503272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-70f6ef7a-5a69-4bce-ae7f-7973756cf53d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:56.503820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-70f6ef7a-5a69-4bce-ae7f-7973756cf53d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:56.519896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70f6ef7a-5a69-4bce-ae7f-7973756cf53d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:56.520566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70f6ef7a-5a69-4bce-ae7f-7973756cf53d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:56.522551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70f6ef7a-5a69-4bce-ae7f-7973756cf53d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:56.527042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70f6ef7a-5a69-4bce-ae7f-7973756cf53d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:56.819979 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-70f6ef7a-5a69-4bce-ae7f-7973756cf53d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action" status: 202 len: 0 microversion: 2.1 time: 0.319240 Aug 02 07:16:56.821464 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2834/5735] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:16:56 2022] POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:16:56.833860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f1b9af0-f733-47a0-87dd-8432ad8a1e25 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:56.834877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5f1b9af0-f733-47a0-87dd-8432ad8a1e25 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:56.853974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f1b9af0-f733-47a0-87dd-8432ad8a1e25 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:56.854494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f1b9af0-f733-47a0-87dd-8432ad8a1e25 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:56.855405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f1b9af0-f733-47a0-87dd-8432ad8a1e25 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:56.855681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f1b9af0-f733-47a0-87dd-8432ad8a1e25 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:57.451094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5f1b9af0-f733-47a0-87dd-8432ad8a1e25 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:57.462624 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5f1b9af0-f733-47a0-87dd-8432ad8a1e25 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1497 microversion: 2.1 time: 0.636248 Aug 02 07:16:57.487113 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2902/5736] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:56 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1497 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:58.503942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3fd2ec93-fb96-4ff2-a656-36e06f6935a0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:58.504654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3fd2ec93-fb96-4ff2-a656-36e06f6935a0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:58.531134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fd2ec93-fb96-4ff2-a656-36e06f6935a0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:58.531589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fd2ec93-fb96-4ff2-a656-36e06f6935a0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:58.532390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fd2ec93-fb96-4ff2-a656-36e06f6935a0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:58.532822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fd2ec93-fb96-4ff2-a656-36e06f6935a0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:59.002321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3fd2ec93-fb96-4ff2-a656-36e06f6935a0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:59.014137 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3fd2ec93-fb96-4ff2-a656-36e06f6935a0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.514479 Aug 02 07:16:59.032813 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2835/5737] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:58 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:59.038816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fecb2229-d03c-45ea-b933-e3e8ff6568ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:59.042710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fecb2229-d03c-45ea-b933-e3e8ff6568ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:59.069577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fecb2229-d03c-45ea-b933-e3e8ff6568ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:59.093142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fecb2229-d03c-45ea-b933-e3e8ff6568ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:59.095967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fecb2229-d03c-45ea-b933-e3e8ff6568ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:59.098818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fecb2229-d03c-45ea-b933-e3e8ff6568ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:59.568399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fecb2229-d03c-45ea-b933-e3e8ff6568ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:16:59.605776 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fecb2229-d03c-45ea-b933-e3e8ff6568ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.569098 Aug 02 07:16:59.607811 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2903/5738] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:59 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:16:59.630840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5ce78870-21cf-47ea-9d17-febc490d180c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:16:59.633198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5ce78870-21cf-47ea-9d17-febc490d180c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:59.646027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ce78870-21cf-47ea-9d17-febc490d180c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:59.646839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ce78870-21cf-47ea-9d17-febc490d180c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:59.647841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ce78870-21cf-47ea-9d17-febc490d180c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:59.648941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ce78870-21cf-47ea-9d17-febc490d180c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:59.685019 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-5ce78870-21cf-47ea-9d17-febc490d180c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5ce78870-21cf-47ea-9d17-febc490d180c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e/action HTTP/1.1 Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 28 Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: {"reboot": {"type": "SOFT"}} Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '8b35b77a-867b-42a3-a5fa-cef71f4a2b2e', 'body': {'reboot': {'type': 'SOFT'}}} Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:16:59.687133 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:16:59.691811 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:16:59.691811 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:59.691811 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:16:59.691811 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:59.691811 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:16:59.691811 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:16:59.691811 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:16:59.691811 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:16:59.691811 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:16:59.691811 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:16:59.691811 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:16:59.700935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5ce78870-21cf-47ea-9d17-febc490d180c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:16:59.702380 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5ce78870-21cf-47ea-9d17-febc490d180c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e/action" status: 404 len: 111 microversion: 2.1 time: 0.076183 Aug 02 07:16:59.703473 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2836/5739] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:16:59 2022] POST /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e/action => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:16:59.714834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c1ceee12-0717-488b-8eba-fa0369f11ae9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:16:59.715665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c1ceee12-0717-488b-8eba-fa0369f11ae9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:16:59.726208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1ceee12-0717-488b-8eba-fa0369f11ae9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:59.726812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1ceee12-0717-488b-8eba-fa0369f11ae9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:16:59.727780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1ceee12-0717-488b-8eba-fa0369f11ae9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:16:59.728340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1ceee12-0717-488b-8eba-fa0369f11ae9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:00.539941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c1ceee12-0717-488b-8eba-fa0369f11ae9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:00.561520 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c1ceee12-0717-488b-8eba-fa0369f11ae9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.850484 Aug 02 07:17:00.589307 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2904/5740] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:16:59 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:00.606238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b249b09a-9672-4949-8425-cc432c7abd5e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:00.608327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b249b09a-9672-4949-8425-cc432c7abd5e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:00.636538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b249b09a-9672-4949-8425-cc432c7abd5e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:00.639578 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b249b09a-9672-4949-8425-cc432c7abd5e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:00.643948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b249b09a-9672-4949-8425-cc432c7abd5e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:00.645598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b249b09a-9672-4949-8425-cc432c7abd5e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:01.111026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b249b09a-9672-4949-8425-cc432c7abd5e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:01.121941 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b249b09a-9672-4949-8425-cc432c7abd5e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.531159 Aug 02 07:17:01.123183 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2837/5741] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:00 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:01.155441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c09daac7-b235-43dd-9807-7dd6431bae2b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:01.159088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c09daac7-b235-43dd-9807-7dd6431bae2b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 6ef3971f-b911-416d-8c40-bbf523507033] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:01.169022 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-c09daac7-b235-43dd-9807-7dd6431bae2b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance 6ef3971f-b911-416d-8c40-bbf523507033 could not be found. Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c09daac7-b235-43dd-9807-7dd6431bae2b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/6ef3971f-b911-416d-8c40-bbf523507033/action HTTP/1.1 Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 28 Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: {"reboot": {"type": "SOFT"}} Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 6ef3971f-b911-416d-8c40-bbf523507033 could not be found. Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '6ef3971f-b911-416d-8c40-bbf523507033', 'body': {'reboot': {'type': 'SOFT'}}} Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef3971f-b911-416d-8c40-bbf523507033 could not be found. Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef3971f-b911-416d-8c40-bbf523507033 could not be found. Aug 02 07:17:01.171332 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:01.175115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:01.175115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:01.175115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:01.175115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:01.175115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:01.175115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:17:01.175115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:17:01.175115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef3971f-b911-416d-8c40-bbf523507033 could not be found. Aug 02 07:17:01.175115 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:01.179716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c09daac7-b235-43dd-9807-7dd6431bae2b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance 6ef3971f-b911-416d-8c40-bbf523507033 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:17:01.183634 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c09daac7-b235-43dd-9807-7dd6431bae2b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/6ef3971f-b911-416d-8c40-bbf523507033/action" status: 404 len: 111 microversion: 2.1 time: 0.035910 Aug 02 07:17:01.184404 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2905/5742] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:17:01 2022] POST /compute/v2.1/servers/6ef3971f-b911-416d-8c40-bbf523507033/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:17:01.195613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fd8d5bb0-623c-441c-ac8b-3c70bcf6e48c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:01.196752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fd8d5bb0-623c-441c-ac8b-3c70bcf6e48c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:01.211231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd8d5bb0-623c-441c-ac8b-3c70bcf6e48c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:01.212098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd8d5bb0-623c-441c-ac8b-3c70bcf6e48c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:01.213091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd8d5bb0-623c-441c-ac8b-3c70bcf6e48c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:01.215899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd8d5bb0-623c-441c-ac8b-3c70bcf6e48c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:01.433252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fd8d5bb0-623c-441c-ac8b-3c70bcf6e48c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:01.454577 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fd8d5bb0-623c-441c-ac8b-3c70bcf6e48c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.251513 Aug 02 07:17:01.455261 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2838/5743] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:01 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:01.483554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7255bed7-2cb8-4836-bb71-96efbf8b8fe6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:01.486132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7255bed7-2cb8-4836-bb71-96efbf8b8fe6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:01.506013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7255bed7-2cb8-4836-bb71-96efbf8b8fe6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:01.508283 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7255bed7-2cb8-4836-bb71-96efbf8b8fe6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:01.512422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7255bed7-2cb8-4836-bb71-96efbf8b8fe6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:01.513819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7255bed7-2cb8-4836-bb71-96efbf8b8fe6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:01.827268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7255bed7-2cb8-4836-bb71-96efbf8b8fe6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:01.845267 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7255bed7-2cb8-4836-bb71-96efbf8b8fe6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.368562 Aug 02 07:17:01.851317 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2906/5744] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:01 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:01.875624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-26579d61-c54c-4c7a-890e-60a26e5e1cfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:01.878556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-26579d61-c54c-4c7a-890e-60a26e5e1cfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:01.888571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26579d61-c54c-4c7a-890e-60a26e5e1cfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:01.889253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26579d61-c54c-4c7a-890e-60a26e5e1cfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:01.890299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26579d61-c54c-4c7a-890e-60a26e5e1cfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:01.891107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-26579d61-c54c-4c7a-890e-60a26e5e1cfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:01.916927 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-26579d61-c54c-4c7a-890e-60a26e5e1cfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-26579d61-c54c-4c7a-890e-60a26e5e1cfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e/action HTTP/1.1 Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 65 Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: {"rebuild": {"imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676"}} Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '8b35b77a-867b-42a3-a5fa-cef71f4a2b2e', 'body': {'rebuild': {'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676'}}} Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 02 07:17:01.919313 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:17:01.924380 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:01.929134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-26579d61-c54c-4c7a-890e-60a26e5e1cfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:17:01.931269 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-26579d61-c54c-4c7a-890e-60a26e5e1cfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e/action" status: 404 len: 111 microversion: 2.1 time: 0.059914 Aug 02 07:17:01.933167 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2839/5745] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:17:01 2022] POST /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:17:01.943030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-23830f44-560e-4b10-b001-80b7cb9e8e72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:01.943650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-23830f44-560e-4b10-b001-80b7cb9e8e72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:01.954921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23830f44-560e-4b10-b001-80b7cb9e8e72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:01.961247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23830f44-560e-4b10-b001-80b7cb9e8e72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:01.962724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23830f44-560e-4b10-b001-80b7cb9e8e72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:01.964562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23830f44-560e-4b10-b001-80b7cb9e8e72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:02.349688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-23830f44-560e-4b10-b001-80b7cb9e8e72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:02.368417 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-23830f44-560e-4b10-b001-80b7cb9e8e72 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.419662 Aug 02 07:17:02.370735 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2907/5746] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:01 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:02.407112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-846a1b4b-2d51-4ca7-bfcd-0b03a2f47162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:02.408993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-846a1b4b-2d51-4ca7-bfcd-0b03a2f47162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:02.416845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-846a1b4b-2d51-4ca7-bfcd-0b03a2f47162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:02.418154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-846a1b4b-2d51-4ca7-bfcd-0b03a2f47162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:02.419368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-846a1b4b-2d51-4ca7-bfcd-0b03a2f47162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:02.420299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-846a1b4b-2d51-4ca7-bfcd-0b03a2f47162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:02.677005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-846a1b4b-2d51-4ca7-bfcd-0b03a2f47162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:02.688005 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-846a1b4b-2d51-4ca7-bfcd-0b03a2f47162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.286138 Aug 02 07:17:02.688737 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2840/5747] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:02 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:02.717932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8f01603c-fabb-41be-8274-dc331adb226e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:02.722061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8f01603c-fabb-41be-8274-dc331adb226e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: a3b6c39b-2c7e-46c2-a92f-012afc68d3af] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:02.738239 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-8f01603c-fabb-41be-8274-dc331adb226e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance a3b6c39b-2c7e-46c2-a92f-012afc68d3af could not be found. Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8f01603c-fabb-41be-8274-dc331adb226e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/a3b6c39b-2c7e-46c2-a92f-012afc68d3af/action HTTP/1.1 Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 65 Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: {"rebuild": {"imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676"}} Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance a3b6c39b-2c7e-46c2-a92f-012afc68d3af could not be found. Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'a3b6c39b-2c7e-46c2-a92f-012afc68d3af', 'body': {'rebuild': {'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676'}}} Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3b6c39b-2c7e-46c2-a92f-012afc68d3af could not be found. Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 02 07:17:02.741087 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3b6c39b-2c7e-46c2-a92f-012afc68d3af could not be found. Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3b6c39b-2c7e-46c2-a92f-012afc68d3af could not be found. Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:02.747763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8f01603c-fabb-41be-8274-dc331adb226e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance a3b6c39b-2c7e-46c2-a92f-012afc68d3af could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:17:02.751134 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8f01603c-fabb-41be-8274-dc331adb226e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/a3b6c39b-2c7e-46c2-a92f-012afc68d3af/action" status: 404 len: 111 microversion: 2.1 time: 0.040136 Aug 02 07:17:02.757181 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2908/5748] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:17:02 2022] POST /compute/v2.1/servers/a3b6c39b-2c7e-46c2-a92f-012afc68d3af/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:17:02.774957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-71069370-4a76-4d18-923a-11be4a86ab8c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:02.776214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-71069370-4a76-4d18-923a-11be4a86ab8c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:02.802829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71069370-4a76-4d18-923a-11be4a86ab8c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:02.803695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71069370-4a76-4d18-923a-11be4a86ab8c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:02.805479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71069370-4a76-4d18-923a-11be4a86ab8c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:02.806061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71069370-4a76-4d18-923a-11be4a86ab8c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:03.366922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-71069370-4a76-4d18-923a-11be4a86ab8c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:03.381964 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-71069370-4a76-4d18-923a-11be4a86ab8c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.618300 Aug 02 07:17:03.384307 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2841/5749] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:02 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:03.418762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8da7f6eb-2d3f-47a5-8bc9-545b05692576 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:03.419576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8da7f6eb-2d3f-47a5-8bc9-545b05692576 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:03.432882 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8da7f6eb-2d3f-47a5-8bc9-545b05692576 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:03.434172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8da7f6eb-2d3f-47a5-8bc9-545b05692576 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:03.435267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8da7f6eb-2d3f-47a5-8bc9-545b05692576 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:03.436192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8da7f6eb-2d3f-47a5-8bc9-545b05692576 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:03.757005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8da7f6eb-2d3f-47a5-8bc9-545b05692576 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:03.790570 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8da7f6eb-2d3f-47a5-8bc9-545b05692576 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.380489 Aug 02 07:17:03.810351 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2909/5750] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:03 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:03.827454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f41bda35-0e70-41d5-8849-2f74ed8e2705 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:03.831020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f41bda35-0e70-41d5-8849-2f74ed8e2705 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: c16409a1-aa79-4e8e-bcc6-bd1adec868de] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:03.852141 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-f41bda35-0e70-41d5-8849-2f74ed8e2705 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance c16409a1-aa79-4e8e-bcc6-bd1adec868de could not be found. Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f41bda35-0e70-41d5-8849-2f74ed8e2705 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/c16409a1-aa79-4e8e-bcc6-bd1adec868de/action HTTP/1.1 Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 15 Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: {"restore": {}} Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance c16409a1-aa79-4e8e-bcc6-bd1adec868de could not be found. Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'c16409a1-aa79-4e8e-bcc6-bd1adec868de', 'body': {'restore': {}}} Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c16409a1-aa79-4e8e-bcc6-bd1adec868de could not be found. Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c16409a1-aa79-4e8e-bcc6-bd1adec868de could not be found. Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:03.856731 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:03.860892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:17:03.860892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:17:03.860892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c16409a1-aa79-4e8e-bcc6-bd1adec868de could not be found. Aug 02 07:17:03.860892 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:03.860892 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f41bda35-0e70-41d5-8849-2f74ed8e2705 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance c16409a1-aa79-4e8e-bcc6-bd1adec868de could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:17:03.860892 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f41bda35-0e70-41d5-8849-2f74ed8e2705 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/c16409a1-aa79-4e8e-bcc6-bd1adec868de/action" status: 404 len: 111 microversion: 2.1 time: 0.045860 Aug 02 07:17:03.866272 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2910/5751] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:17:03 2022] POST /compute/v2.1/servers/c16409a1-aa79-4e8e-bcc6-bd1adec868de/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:17:03.877348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9cc1d42e-b1ef-4da5-8485-a26c9cdd23b9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:03.881074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9cc1d42e-b1ef-4da5-8485-a26c9cdd23b9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:03.907810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cc1d42e-b1ef-4da5-8485-a26c9cdd23b9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:03.908546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cc1d42e-b1ef-4da5-8485-a26c9cdd23b9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:03.910268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cc1d42e-b1ef-4da5-8485-a26c9cdd23b9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:03.913720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cc1d42e-b1ef-4da5-8485-a26c9cdd23b9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:04.223248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9cc1d42e-b1ef-4da5-8485-a26c9cdd23b9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:04.233654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-72131400", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": "none"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:04.241903 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9cc1d42e-b1ef-4da5-8485-a26c9cdd23b9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.372223 Aug 02 07:17:04.260383 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2911/5752] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:03 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:04.280362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9a38040e-86d8-45d2-90ff-5ada76a316ed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:04.281128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9a38040e-86d8-45d2-90ff-5ada76a316ed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:04.299008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a38040e-86d8-45d2-90ff-5ada76a316ed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:04.301206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a38040e-86d8-45d2-90ff-5ada76a316ed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:04.302077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a38040e-86d8-45d2-90ff-5ada76a316ed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:04.305011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a38040e-86d8-45d2-90ff-5ada76a316ed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:04.377795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:17:04.379188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:17:04.379919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:17:04.381324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:17:04.382104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:17:04.398439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:04.400133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:04.402717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:04.403457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:04.434001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Getting quotas for project 319151eea4f94457b7d0603065e6075d. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:17:04.443907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Getting quotas for user 04dbb2ed43ed4ec88ecab768d5be11dd and project 319151eea4f94457b7d0603065e6075d. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:17:04.467458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:17:04.498957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:17:04.614045 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a01daf8c-1f5f-4c2c-8cd4-e89d8b1bb4ac tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.044508 Aug 02 07:17:04.627280 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2842/5753] 10.222.0.79 () {62 vars in 1188 bytes} [Tue Aug 2 07:17:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 07:17:04.640984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b6df6741-7cb1-4e4c-a11c-db8abc4994c8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:04.644005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b6df6741-7cb1-4e4c-a11c-db8abc4994c8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:04.858467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b6df6741-7cb1-4e4c-a11c-db8abc4994c8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:04.876093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b6df6741-7cb1-4e4c-a11c-db8abc4994c8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:04.885180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b6df6741-7cb1-4e4c-a11c-db8abc4994c8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:04.887344 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b6df6741-7cb1-4e4c-a11c-db8abc4994c8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1276 microversion: 2.57 time: 0.258252 Aug 02 07:17:04.890472 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2843/5754] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:04 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:04.961585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9a38040e-86d8-45d2-90ff-5ada76a316ed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:04.972391 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9a38040e-86d8-45d2-90ff-5ada76a316ed tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.700344 Aug 02 07:17:04.982554 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2912/5755] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:04 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:17:05.011719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b609bc77-ae65-4c98-98af-d851e4b542ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:05.012665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b609bc77-ae65-4c98-98af-d851e4b542ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:05.027914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b609bc77-ae65-4c98-98af-d851e4b542ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:05.028555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b609bc77-ae65-4c98-98af-d851e4b542ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:05.029508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b609bc77-ae65-4c98-98af-d851e4b542ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:05.030172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b609bc77-ae65-4c98-98af-d851e4b542ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:05.043431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:17:05.090295 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-b609bc77-ae65-4c98-98af-d851e4b542ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Cannot 'restore' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b609bc77-ae65-4c98-98af-d851e4b542ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action HTTP/1.1 Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 15 Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: {"restore": {}} Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: exception: Cannot 'restore' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '3d2edf07-e6a8-472c-9d71-a0691e66b90d', 'body': {'restore': {}}} Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d in vm_state active. Cannot restore while the instance is in this state. Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:05.106405 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:05.114828 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:05.114828 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:17:05.114828 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:17:05.114828 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:17:05.114828 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:05.114828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b609bc77-ae65-4c98-98af-d851e4b542ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 409 to user: Cannot 'restore' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:17:05.114828 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b609bc77-ae65-4c98-98af-d851e4b542ca tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action" status: 409 len: 145 microversion: 2.1 time: 0.100745 Aug 02 07:17:05.114828 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2844/5756] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:17:05 2022] POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action => generated 145 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:17:05.117682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-17ddaed5-27a4-4d6d-ab98-59509aaf85e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:05.118461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-17ddaed5-27a4-4d6d-ab98-59509aaf85e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:05.133043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17ddaed5-27a4-4d6d-ab98-59509aaf85e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:05.134070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17ddaed5-27a4-4d6d-ab98-59509aaf85e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:05.135350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17ddaed5-27a4-4d6d-ab98-59509aaf85e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:05.137984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-17ddaed5-27a4-4d6d-ab98-59509aaf85e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:05.924628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0863db02-aead-4549-8134-d7d8f7ededff tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:05.925370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0863db02-aead-4549-8134-d7d8f7ededff tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:05.942027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0863db02-aead-4549-8134-d7d8f7ededff tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:05.951988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0863db02-aead-4549-8134-d7d8f7ededff tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:05.953127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0863db02-aead-4549-8134-d7d8f7ededff tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:05.953710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0863db02-aead-4549-8134-d7d8f7ededff tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:06.009630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-17ddaed5-27a4-4d6d-ab98-59509aaf85e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:06.012111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:17:06.042102 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-17ddaed5-27a4-4d6d-ab98-59509aaf85e6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.916177 Aug 02 07:17:06.043139 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2913/5757] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:05 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:06.071246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dbe75434-7cea-4911-8184-091ab0f95a70 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:06.071807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dbe75434-7cea-4911-8184-091ab0f95a70 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:06.082217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbe75434-7cea-4911-8184-091ab0f95a70 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:06.085595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbe75434-7cea-4911-8184-091ab0f95a70 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:06.087160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbe75434-7cea-4911-8184-091ab0f95a70 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:06.094877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbe75434-7cea-4911-8184-091ab0f95a70 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:06.170737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0863db02-aead-4549-8134-d7d8f7ededff tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:06.182470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0863db02-aead-4549-8134-d7d8f7ededff tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:06.184410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0863db02-aead-4549-8134-d7d8f7ededff tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:06.186228 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0863db02-aead-4549-8134-d7d8f7ededff tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1280 microversion: 2.57 time: 0.266838 Aug 02 07:17:06.187698 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2845/5758] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:05 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1280 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:06.643608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dbe75434-7cea-4911-8184-091ab0f95a70 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:06.655461 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dbe75434-7cea-4911-8184-091ab0f95a70 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.588233 Aug 02 07:17:06.658960 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2914/5759] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:06 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:06.682183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bca01c92-ac50-4eb0-b263-4d9c2d4345ae tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:06.685756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bca01c92-ac50-4eb0-b263-4d9c2d4345ae tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: bcbb3fe5-b065-4a29-9fe3-e97e5a3c548f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:06.706160 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-bca01c92-ac50-4eb0-b263-4d9c2d4345ae tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance bcbb3fe5-b065-4a29-9fe3-e97e5a3c548f could not be found. Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bca01c92-ac50-4eb0-b263-4d9c2d4345ae tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/bcbb3fe5-b065-4a29-9fe3-e97e5a3c548f/action HTTP/1.1 Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 14 Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: {"resume": {}} Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance bcbb3fe5-b065-4a29-9fe3-e97e5a3c548f could not be found. Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'bcbb3fe5-b065-4a29-9fe3-e97e5a3c548f', 'body': {'resume': {}}} Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcbb3fe5-b065-4a29-9fe3-e97e5a3c548f could not be found. Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcbb3fe5-b065-4a29-9fe3-e97e5a3c548f could not be found. Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:06.717073 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:06.721753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:17:06.721753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:17:06.721753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcbb3fe5-b065-4a29-9fe3-e97e5a3c548f could not be found. Aug 02 07:17:06.721753 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:06.723264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bca01c92-ac50-4eb0-b263-4d9c2d4345ae tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance bcbb3fe5-b065-4a29-9fe3-e97e5a3c548f could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:17:06.724775 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bca01c92-ac50-4eb0-b263-4d9c2d4345ae tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/bcbb3fe5-b065-4a29-9fe3-e97e5a3c548f/action" status: 404 len: 111 microversion: 2.1 time: 0.050335 Aug 02 07:17:06.726057 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2846/5760] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:17:06 2022] POST /compute/v2.1/servers/bcbb3fe5-b065-4a29-9fe3-e97e5a3c548f/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:17:06.737507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df98fdeb-63d1-4468-91f0-ca6645ce8756 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:06.738608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df98fdeb-63d1-4468-91f0-ca6645ce8756 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:06.755510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df98fdeb-63d1-4468-91f0-ca6645ce8756 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:06.762605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df98fdeb-63d1-4468-91f0-ca6645ce8756 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:06.764332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df98fdeb-63d1-4468-91f0-ca6645ce8756 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:06.766031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df98fdeb-63d1-4468-91f0-ca6645ce8756 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:07.214415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ae6f8acc-21bb-4ac1-9942-286772669946 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:07.215892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ae6f8acc-21bb-4ac1-9942-286772669946 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:07.246701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae6f8acc-21bb-4ac1-9942-286772669946 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:07.249145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae6f8acc-21bb-4ac1-9942-286772669946 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:07.251335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae6f8acc-21bb-4ac1-9942-286772669946 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:07.254457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae6f8acc-21bb-4ac1-9942-286772669946 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:07.283985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-df98fdeb-63d1-4468-91f0-ca6645ce8756 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:07.317493 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df98fdeb-63d1-4468-91f0-ca6645ce8756 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.584501 Aug 02 07:17:07.324305 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2915/5761] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:06 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:17:07.351100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0cf652da-ad45-44ae-a9f0-7196cf310162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:07.351977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0cf652da-ad45-44ae-a9f0-7196cf310162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:07.371246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0cf652da-ad45-44ae-a9f0-7196cf310162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:07.371708 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0cf652da-ad45-44ae-a9f0-7196cf310162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:07.372495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0cf652da-ad45-44ae-a9f0-7196cf310162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:07.374647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0cf652da-ad45-44ae-a9f0-7196cf310162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:07.447977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ae6f8acc-21bb-4ac1-9942-286772669946 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:07.471309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ae6f8acc-21bb-4ac1-9942-286772669946 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:07.472420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ae6f8acc-21bb-4ac1-9942-286772669946 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:07.473612 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ae6f8acc-21bb-4ac1-9942-286772669946 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1334 microversion: 2.57 time: 0.266437 Aug 02 07:17:07.474234 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2847/5762] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:07 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1334 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:17:07.819850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0cf652da-ad45-44ae-a9f0-7196cf310162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:07.851650 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0cf652da-ad45-44ae-a9f0-7196cf310162 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.504770 Aug 02 07:17:07.856936 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2916/5763] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:07 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:07.893859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-306ec9eb-f8b7-4b66-9b71-372ea7bf3ff0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:07.894835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-306ec9eb-f8b7-4b66-9b71-372ea7bf3ff0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:07.902089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-306ec9eb-f8b7-4b66-9b71-372ea7bf3ff0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:07.903432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-306ec9eb-f8b7-4b66-9b71-372ea7bf3ff0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:07.904829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-306ec9eb-f8b7-4b66-9b71-372ea7bf3ff0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:07.905429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-306ec9eb-f8b7-4b66-9b71-372ea7bf3ff0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:07.939402 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-306ec9eb-f8b7-4b66-9b71-372ea7bf3ff0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Cannot 'resume' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-306ec9eb-f8b7-4b66-9b71-372ea7bf3ff0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action HTTP/1.1 Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 14 Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: {"resume": {}} Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: exception: Cannot 'resume' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '3d2edf07-e6a8-472c-9d71-a0691e66b90d', 'body': {'resume': {}}} Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d in vm_state active. Cannot resume while the instance is in this state. Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:07.945484 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:07.953739 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:07.953739 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:17:07.953739 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:17:07.953739 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:17:07.953739 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:07.953739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-306ec9eb-f8b7-4b66-9b71-372ea7bf3ff0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 409 to user: Cannot 'resume' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:17:07.953739 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-306ec9eb-f8b7-4b66-9b71-372ea7bf3ff0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action" status: 409 len: 144 microversion: 2.1 time: 0.059488 Aug 02 07:17:07.953739 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2848/5764] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:17:07 2022] POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action => generated 144 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:17:07.958745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ac82ae39-8a34-4435-8b74-a2284bdc9346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:07.959732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ac82ae39-8a34-4435-8b74-a2284bdc9346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:07.968386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac82ae39-8a34-4435-8b74-a2284bdc9346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:07.968832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac82ae39-8a34-4435-8b74-a2284bdc9346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:07.970402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac82ae39-8a34-4435-8b74-a2284bdc9346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:07.970840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac82ae39-8a34-4435-8b74-a2284bdc9346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:08.473868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ac82ae39-8a34-4435-8b74-a2284bdc9346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:08.485383 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ac82ae39-8a34-4435-8b74-a2284bdc9346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.531981 Aug 02 07:17:08.487838 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2917/5765] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:07 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:08.504103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-23a972dd-83a2-4843-871c-03071c119d36 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:08.506532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-23a972dd-83a2-4843-871c-03071c119d36 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:08.515925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23a972dd-83a2-4843-871c-03071c119d36 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:08.516644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23a972dd-83a2-4843-871c-03071c119d36 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:08.517756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23a972dd-83a2-4843-871c-03071c119d36 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:08.518510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23a972dd-83a2-4843-871c-03071c119d36 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:08.521078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-00c420b3-c8da-4cca-809e-c17e2171896a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:08.522339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-00c420b3-c8da-4cca-809e-c17e2171896a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:08.532205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00c420b3-c8da-4cca-809e-c17e2171896a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:08.533035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00c420b3-c8da-4cca-809e-c17e2171896a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:08.534457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00c420b3-c8da-4cca-809e-c17e2171896a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:08.535129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00c420b3-c8da-4cca-809e-c17e2171896a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:09.036423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23a972dd-83a2-4843-871c-03071c119d36 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:09.059624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23a972dd-83a2-4843-871c-03071c119d36 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:09.067008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23a972dd-83a2-4843-871c-03071c119d36 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:09.076610 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-23a972dd-83a2-4843-871c-03071c119d36 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1334 microversion: 2.57 time: 0.575059 Aug 02 07:17:09.079584 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2849/5766] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:08 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1334 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:09.526049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:09.528825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:09.549741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:09.550249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:09.551041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:09.551477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:09.751403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:17:09.753763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:17:09.754307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:17:09.758000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:17:09.758465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:17:09.906642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:09.917729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:09.918435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:09.919438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:09.920180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:09.966313 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8496dc17-3bc5-46d2-8b47-2236f95981c4 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc/action" status: 202 len: 1137 microversion: 2.1 time: 0.446969 Aug 02 07:17:09.967674 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2850/5767] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:17:09 2022] POST /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc/action => generated 1137 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 02 07:17:09.997443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4d2d53c9-8d78-4e1f-8e15-c9b1d08a9704 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:09.998561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4d2d53c9-8d78-4e1f-8e15-c9b1d08a9704 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:10.007652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d2d53c9-8d78-4e1f-8e15-c9b1d08a9704 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:10.008580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d2d53c9-8d78-4e1f-8e15-c9b1d08a9704 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:10.011451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d2d53c9-8d78-4e1f-8e15-c9b1d08a9704 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:10.012184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d2d53c9-8d78-4e1f-8e15-c9b1d08a9704 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:10.264364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-00c420b3-c8da-4cca-809e-c17e2171896a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:10.276182 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-00c420b3-c8da-4cca-809e-c17e2171896a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 1.762397 Aug 02 07:17:10.280828 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2918/5768] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:08 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:17:10.290968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-97ac73b9-1487-4148-9184-578bc4704806 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:10.292094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-97ac73b9-1487-4148-9184-578bc4704806 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:10.323456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97ac73b9-1487-4148-9184-578bc4704806 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:10.329996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97ac73b9-1487-4148-9184-578bc4704806 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:10.331314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97ac73b9-1487-4148-9184-578bc4704806 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:10.336992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97ac73b9-1487-4148-9184-578bc4704806 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:10.650307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-97ac73b9-1487-4148-9184-578bc4704806 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:10.663524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-97ac73b9-1487-4148-9184-578bc4704806 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:10.670592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-97ac73b9-1487-4148-9184-578bc4704806 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:10.675755 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-97ac73b9-1487-4148-9184-578bc4704806 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1355 microversion: 2.57 time: 0.393466 Aug 02 07:17:10.676773 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2919/5769] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:10 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1355 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:10.688753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-be762437-6850-4bd5-a619-f6ea78658710 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-be762437-6850-4bd5-a619-f6ea78658710 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 160 Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: {"server": {"name": "", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf"}]}} Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'body': {'server': {'name': '', 'imageRef': 'fbc11386-7cb6-4309-932b-7acee00d4676', 'flavorRef': '452', 'networks': [{'uuid': '0d9a70a6-be90-4c04-81e4-aecc3fa8e3cf'}]}}} Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi '' Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:17:10.697821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:17:10.703057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:17:10.703057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 02 07:17:10.703057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:10.703057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:10.703057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:10.703057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:10.703057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:10.703057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:10.703057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:17:10.703057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:17:10.703057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 02 07:17:10.703057 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:10.707937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-be762437-6850-4bd5-a619-f6ea78658710 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:17:10.710677 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-be762437-6850-4bd5-a619-f6ea78658710 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.032627 Aug 02 07:17:10.712116 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2920/5770] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:17:10 2022] POST /compute/v2.1/servers => generated 108 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:17:10.723589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:10.733695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:10.754997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:10.756182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:10.758282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:10.759880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:10.810689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4d2d53c9-8d78-4e1f-8e15-c9b1d08a9704 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:10.824657 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4d2d53c9-8d78-4e1f-8e15-c9b1d08a9704 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1691 microversion: 2.1 time: 0.834285 Aug 02 07:17:10.831946 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2851/5771] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:09 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1691 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:10.837088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5cf4b6a2-8a5b-4850-8b92-e4ea710691a3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:10.845405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5cf4b6a2-8a5b-4850-8b92-e4ea710691a3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:10.859739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cf4b6a2-8a5b-4850-8b92-e4ea710691a3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:10.860389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cf4b6a2-8a5b-4850-8b92-e4ea710691a3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:10.861336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cf4b6a2-8a5b-4850-8b92-e4ea710691a3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:10.862414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cf4b6a2-8a5b-4850-8b92-e4ea710691a3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:10.955424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:17:10.959001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:17:10.960223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:17:10.961313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:17:10.961519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:17:11.087174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:11.099284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:11.100946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:11.101990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:11.102584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:11.171288 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f279e151-141b-49f0-8f42-189c895e1e08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "POST /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6/action" status: 202 len: 1136 microversion: 2.57 time: 0.455313 Aug 02 07:17:11.172332 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2921/5772] 10.222.0.79 () {62 vars in 1320 bytes} [Tue Aug 2 07:17:10 2022] POST /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6/action => generated 1136 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 02 07:17:11.215569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c4133390-9025-419e-aa0d-c0a51554ba2b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:11.216620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c4133390-9025-419e-aa0d-c0a51554ba2b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:11.226130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4133390-9025-419e-aa0d-c0a51554ba2b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:11.226707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4133390-9025-419e-aa0d-c0a51554ba2b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:11.227574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4133390-9025-419e-aa0d-c0a51554ba2b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:11.228278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4133390-9025-419e-aa0d-c0a51554ba2b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:11.383652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c4133390-9025-419e-aa0d-c0a51554ba2b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:11.399305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c4133390-9025-419e-aa0d-c0a51554ba2b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:11.402156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c4133390-9025-419e-aa0d-c0a51554ba2b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:11.403405 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c4133390-9025-419e-aa0d-c0a51554ba2b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.202848 Aug 02 07:17:11.404317 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2922/5773] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:11 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:11.485324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5cf4b6a2-8a5b-4850-8b92-e4ea710691a3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:11.496265 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5cf4b6a2-8a5b-4850-8b92-e4ea710691a3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.662914 Aug 02 07:17:11.498172 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2852/5774] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:10 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:11.523692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-81f40a9c-58cb-4d79-8be5-3b2e5f3c8705 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:11.524865 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-81f40a9c-58cb-4d79-8be5-3b2e5f3c8705 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:11.553690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81f40a9c-58cb-4d79-8be5-3b2e5f3c8705 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:11.556700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81f40a9c-58cb-4d79-8be5-3b2e5f3c8705 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:11.557758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81f40a9c-58cb-4d79-8be5-3b2e5f3c8705 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:11.558591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81f40a9c-58cb-4d79-8be5-3b2e5f3c8705 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:11.869019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-da9daf3a-3522-4255-b091-a9ef743863b8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:11.869819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-da9daf3a-3522-4255-b091-a9ef743863b8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:11.887930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da9daf3a-3522-4255-b091-a9ef743863b8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:11.890982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da9daf3a-3522-4255-b091-a9ef743863b8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:11.893377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da9daf3a-3522-4255-b091-a9ef743863b8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:11.894095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-da9daf3a-3522-4255-b091-a9ef743863b8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:11.911033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-81f40a9c-58cb-4d79-8be5-3b2e5f3c8705 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:11.937851 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-81f40a9c-58cb-4d79-8be5-3b2e5f3c8705 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.412545 Aug 02 07:17:11.939170 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2923/5775] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:11 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:11.964975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-35a53f16-acca-49c1-90e2-9933a66aaf7b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:11.966773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-35a53f16-acca-49c1-90e2-9933a66aaf7b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: eefec9a2-58b6-4b76-9620-92dc0d5fa06c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:11.984944 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-35a53f16-acca-49c1-90e2-9933a66aaf7b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance eefec9a2-58b6-4b76-9620-92dc0d5fa06c could not be found. Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-35a53f16-acca-49c1-90e2-9933a66aaf7b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/eefec9a2-58b6-4b76-9620-92dc0d5fa06c/action HTTP/1.1 Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 14 Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: {"shelve": {}} Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance eefec9a2-58b6-4b76-9620-92dc0d5fa06c could not be found. Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'eefec9a2-58b6-4b76-9620-92dc0d5fa06c', 'body': {'shelve': {}}} Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eefec9a2-58b6-4b76-9620-92dc0d5fa06c could not be found. Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eefec9a2-58b6-4b76-9620-92dc0d5fa06c could not be found. Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:12.002317 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:12.013216 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:17:12.013216 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:17:12.013216 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eefec9a2-58b6-4b76-9620-92dc0d5fa06c could not be found. Aug 02 07:17:12.013216 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:17:12.015933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-35a53f16-acca-49c1-90e2-9933a66aaf7b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance eefec9a2-58b6-4b76-9620-92dc0d5fa06c could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:17:12.017157 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-35a53f16-acca-49c1-90e2-9933a66aaf7b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/eefec9a2-58b6-4b76-9620-92dc0d5fa06c/action" status: 404 len: 111 microversion: 2.1 time: 0.059303 Aug 02 07:17:12.019760 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2924/5776] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:17:11 2022] POST /compute/v2.1/servers/eefec9a2-58b6-4b76-9620-92dc0d5fa06c/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:17:12.032393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b698e270-aacf-42e1-a053-369ea112abb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:12.035057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b698e270-aacf-42e1-a053-369ea112abb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:12.061538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b698e270-aacf-42e1-a053-369ea112abb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:12.067776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b698e270-aacf-42e1-a053-369ea112abb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:12.072222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b698e270-aacf-42e1-a053-369ea112abb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:12.072923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b698e270-aacf-42e1-a053-369ea112abb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:12.276731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-da9daf3a-3522-4255-b091-a9ef743863b8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:12.302333 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-da9daf3a-3522-4255-b091-a9ef743863b8 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1691 microversion: 2.1 time: 0.436350 Aug 02 07:17:12.303367 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2853/5777] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:11 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1691 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:12.434631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6f1be22e-7829-4cf8-bd15-b84c7633e504 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:12.435742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6f1be22e-7829-4cf8-bd15-b84c7633e504 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:12.446881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f1be22e-7829-4cf8-bd15-b84c7633e504 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:12.447834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f1be22e-7829-4cf8-bd15-b84c7633e504 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:12.448717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f1be22e-7829-4cf8-bd15-b84c7633e504 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:12.449451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f1be22e-7829-4cf8-bd15-b84c7633e504 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:12.535206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b698e270-aacf-42e1-a053-369ea112abb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:12.546188 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b698e270-aacf-42e1-a053-369ea112abb0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.521074 Aug 02 07:17:12.546757 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2925/5778] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:12 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:17:12.571432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c027cb2c-716a-4cfc-bcb6-4bf38099dc10 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:12.572150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c027cb2c-716a-4cfc-bcb6-4bf38099dc10 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:12.580563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c027cb2c-716a-4cfc-bcb6-4bf38099dc10 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:12.581097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c027cb2c-716a-4cfc-bcb6-4bf38099dc10 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:12.582172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c027cb2c-716a-4cfc-bcb6-4bf38099dc10 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:12.582809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c027cb2c-716a-4cfc-bcb6-4bf38099dc10 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:12.618367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6f1be22e-7829-4cf8-bd15-b84c7633e504 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:12.633143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6f1be22e-7829-4cf8-bd15-b84c7633e504 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:12.638542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6f1be22e-7829-4cf8-bd15-b84c7633e504 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:12.642464 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6f1be22e-7829-4cf8-bd15-b84c7633e504 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.214747 Aug 02 07:17:12.660007 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2854/5779] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:12 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 07:17:12.986270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c027cb2c-716a-4cfc-bcb6-4bf38099dc10 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:13.006737 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c027cb2c-716a-4cfc-bcb6-4bf38099dc10 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.433056 Aug 02 07:17:13.008048 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2926/5780] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:12 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:13.035692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-30fd0c47-1d47-4ef2-9fee-cbc4389d6b16 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:13.036655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-30fd0c47-1d47-4ef2-9fee-cbc4389d6b16 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:13.044878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30fd0c47-1d47-4ef2-9fee-cbc4389d6b16 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:13.045356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30fd0c47-1d47-4ef2-9fee-cbc4389d6b16 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:13.046493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30fd0c47-1d47-4ef2-9fee-cbc4389d6b16 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:13.047086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30fd0c47-1d47-4ef2-9fee-cbc4389d6b16 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:13.073231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-30fd0c47-1d47-4ef2-9fee-cbc4389d6b16 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lazy-loading 'flavor' on Instance uuid 3d2edf07-e6a8-472c-9d71-a0691e66b90d {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:17:13.329178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bac3b2bb-c9bf-4f2a-9ad2-1743689f7962 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:13.330157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bac3b2bb-c9bf-4f2a-9ad2-1743689f7962 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:13.347061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bac3b2bb-c9bf-4f2a-9ad2-1743689f7962 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:13.348945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bac3b2bb-c9bf-4f2a-9ad2-1743689f7962 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:13.350010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bac3b2bb-c9bf-4f2a-9ad2-1743689f7962 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:13.351238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bac3b2bb-c9bf-4f2a-9ad2-1743689f7962 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:13.503093 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-30fd0c47-1d47-4ef2-9fee-cbc4389d6b16 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action" status: 202 len: 0 microversion: 2.1 time: 0.470718 Aug 02 07:17:13.510347 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2855/5781] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:17:13 2022] POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:17:13.518675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-12981505-207e-4220-b222-b9ec0d7b8f9b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:13.520083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-12981505-207e-4220-b222-b9ec0d7b8f9b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:13.531034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12981505-207e-4220-b222-b9ec0d7b8f9b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:13.532995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12981505-207e-4220-b222-b9ec0d7b8f9b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:13.534245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12981505-207e-4220-b222-b9ec0d7b8f9b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:13.536195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12981505-207e-4220-b222-b9ec0d7b8f9b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:13.917537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bac3b2bb-c9bf-4f2a-9ad2-1743689f7962 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:13.931678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-12981505-207e-4220-b222-b9ec0d7b8f9b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:13.934911 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bac3b2bb-c9bf-4f2a-9ad2-1743689f7962 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1691 microversion: 2.1 time: 0.611188 Aug 02 07:17:13.949024 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2927/5782] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:13 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1691 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:13.951268 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-12981505-207e-4220-b222-b9ec0d7b8f9b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1511 microversion: 2.1 time: 0.437529 Aug 02 07:17:13.954461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7022124c-7910-433f-b134-93e6d2659bba tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:13.955337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7022124c-7910-433f-b134-93e6d2659bba tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:13.969045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7022124c-7910-433f-b134-93e6d2659bba tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:13.970751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7022124c-7910-433f-b134-93e6d2659bba tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:13.971788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7022124c-7910-433f-b134-93e6d2659bba tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:13.976205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7022124c-7910-433f-b134-93e6d2659bba tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:13.977538 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2856/5783] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:13 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1511 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:14.432984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7022124c-7910-433f-b134-93e6d2659bba tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:14.449571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7022124c-7910-433f-b134-93e6d2659bba tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:14.453753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7022124c-7910-433f-b134-93e6d2659bba tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:14.455526 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7022124c-7910-433f-b134-93e6d2659bba tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.504963 Aug 02 07:17:14.456587 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2928/5784] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:13 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:14.959418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-22a541a7-bafa-47bf-9105-194b220277c7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:14.960796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-22a541a7-bafa-47bf-9105-194b220277c7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:14.980812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:17:14.983905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2bdfc8e1-6318-4dfa-aa39-d5faab382036 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:14.984672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2bdfc8e1-6318-4dfa-aa39-d5faab382036 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:14.987663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=8 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:17:14.996205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22a541a7-bafa-47bf-9105-194b220277c7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:15.000742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bdfc8e1-6318-4dfa-aa39-d5faab382036 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:15.001149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22a541a7-bafa-47bf-9105-194b220277c7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:15.002148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22a541a7-bafa-47bf-9105-194b220277c7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:15.002598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22a541a7-bafa-47bf-9105-194b220277c7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:15.005350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bdfc8e1-6318-4dfa-aa39-d5faab382036 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:15.006908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bdfc8e1-6318-4dfa-aa39-d5faab382036 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:15.007778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bdfc8e1-6318-4dfa-aa39-d5faab382036 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:15.369398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-22a541a7-bafa-47bf-9105-194b220277c7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:15.377089 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-22a541a7-bafa-47bf-9105-194b220277c7 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1691 microversion: 2.1 time: 0.424265 Aug 02 07:17:15.390874 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2857/5785] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:14 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1691 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:15.480663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c52a28e0-13aa-479c-a405-c125fa61d7e9 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:15.481264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c52a28e0-13aa-479c-a405-c125fa61d7e9 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:15.498264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c52a28e0-13aa-479c-a405-c125fa61d7e9 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:15.498704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c52a28e0-13aa-479c-a405-c125fa61d7e9 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:15.499499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c52a28e0-13aa-479c-a405-c125fa61d7e9 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:15.499935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c52a28e0-13aa-479c-a405-c125fa61d7e9 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:15.554305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:17:15.701368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2bdfc8e1-6318-4dfa-aa39-d5faab382036 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:15.704810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c52a28e0-13aa-479c-a405-c125fa61d7e9 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:15.720364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c52a28e0-13aa-479c-a405-c125fa61d7e9 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:15.721671 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2bdfc8e1-6318-4dfa-aa39-d5faab382036 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1511 microversion: 2.1 time: 0.742624 Aug 02 07:17:15.723801 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2929/5786] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:14 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1511 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:17:15.726141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c52a28e0-13aa-479c-a405-c125fa61d7e9 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:15.727500 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c52a28e0-13aa-479c-a405-c125fa61d7e9 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.250997 Aug 02 07:17:15.728640 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2858/5787] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:15 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:16.401475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b7ec0169-8822-4108-a408-081c97568890 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:16.402553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b7ec0169-8822-4108-a408-081c97568890 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:16.415630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7ec0169-8822-4108-a408-081c97568890 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:16.416392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7ec0169-8822-4108-a408-081c97568890 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:16.418271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7ec0169-8822-4108-a408-081c97568890 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:16.418738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7ec0169-8822-4108-a408-081c97568890 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:16.437234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:17:16.753294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ff18d79f-be5b-4fa7-bebe-6b3e03ab31f7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:16.754651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ff18d79f-be5b-4fa7-bebe-6b3e03ab31f7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:16.757929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:17:16.772729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff18d79f-be5b-4fa7-bebe-6b3e03ab31f7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:16.778147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff18d79f-be5b-4fa7-bebe-6b3e03ab31f7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:16.779530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff18d79f-be5b-4fa7-bebe-6b3e03ab31f7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:16.780434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ff18d79f-be5b-4fa7-bebe-6b3e03ab31f7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:16.834199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b7ec0169-8822-4108-a408-081c97568890 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:16.848481 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b7ec0169-8822-4108-a408-081c97568890 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1691 microversion: 2.1 time: 0.452437 Aug 02 07:17:16.849088 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2930/5788] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:16 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1691 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:16.873045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-608f8de4-53cf-4f90-a82e-0458b801b0e1 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:16.873939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-608f8de4-53cf-4f90-a82e-0458b801b0e1 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:16.891714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-608f8de4-53cf-4f90-a82e-0458b801b0e1 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:16.892255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-608f8de4-53cf-4f90-a82e-0458b801b0e1 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:16.893113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-608f8de4-53cf-4f90-a82e-0458b801b0e1 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:16.893554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-608f8de4-53cf-4f90-a82e-0458b801b0e1 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:17.159532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-608f8de4-53cf-4f90-a82e-0458b801b0e1 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:17.180707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-608f8de4-53cf-4f90-a82e-0458b801b0e1 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:17.183025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-608f8de4-53cf-4f90-a82e-0458b801b0e1 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:17.188200 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-608f8de4-53cf-4f90-a82e-0458b801b0e1 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.335123 Aug 02 07:17:17.189135 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2931/5789] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:16 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:17.219960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ff18d79f-be5b-4fa7-bebe-6b3e03ab31f7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:17.245047 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ff18d79f-be5b-4fa7-bebe-6b3e03ab31f7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1511 microversion: 2.1 time: 0.497134 Aug 02 07:17:17.246249 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2859/5790] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:16 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:17:17.873346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-af89230d-9eeb-475c-ac86-8df45162a8ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:17.874180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-af89230d-9eeb-475c-ac86-8df45162a8ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:17.889479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af89230d-9eeb-475c-ac86-8df45162a8ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:17.890070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af89230d-9eeb-475c-ac86-8df45162a8ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:17.890984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af89230d-9eeb-475c-ac86-8df45162a8ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:17.895184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af89230d-9eeb-475c-ac86-8df45162a8ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:18.218042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-22cf64da-012d-4913-8f26-ef38e3928748 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:18.218854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-22cf64da-012d-4913-8f26-ef38e3928748 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:18.237749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22cf64da-012d-4913-8f26-ef38e3928748 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:18.238613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22cf64da-012d-4913-8f26-ef38e3928748 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:18.239701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22cf64da-012d-4913-8f26-ef38e3928748 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:18.240497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22cf64da-012d-4913-8f26-ef38e3928748 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:18.386254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-22cf64da-012d-4913-8f26-ef38e3928748 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:18.410091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-22cf64da-012d-4913-8f26-ef38e3928748 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:18.413971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-22cf64da-012d-4913-8f26-ef38e3928748 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:18.416449 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-22cf64da-012d-4913-8f26-ef38e3928748 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.203399 Aug 02 07:17:18.417923 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2860/5791] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:18 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:18.435404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5e972f47-7ee6-46fc-b10e-b29905418acb tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:18.437187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5e972f47-7ee6-46fc-b10e-b29905418acb tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:18.450577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e972f47-7ee6-46fc-b10e-b29905418acb tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:18.453179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e972f47-7ee6-46fc-b10e-b29905418acb tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:18.454750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e972f47-7ee6-46fc-b10e-b29905418acb tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:18.455632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e972f47-7ee6-46fc-b10e-b29905418acb tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:18.459237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-af89230d-9eeb-475c-ac86-8df45162a8ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:18.474452 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-af89230d-9eeb-475c-ac86-8df45162a8ce tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1691 microversion: 2.1 time: 0.604803 Aug 02 07:17:18.474983 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2932/5792] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:17 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1691 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:18.802324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5e972f47-7ee6-46fc-b10e-b29905418acb tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:18.828906 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5e972f47-7ee6-46fc-b10e-b29905418acb tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1511 microversion: 2.1 time: 0.408140 Aug 02 07:17:18.831140 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2861/5793] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:18 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1511 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:19.440969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bb60b4e5-747a-446d-a5b0-215bd53de881 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:19.441749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bb60b4e5-747a-446d-a5b0-215bd53de881 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:19.460921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb60b4e5-747a-446d-a5b0-215bd53de881 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:19.461642 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb60b4e5-747a-446d-a5b0-215bd53de881 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:19.462696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb60b4e5-747a-446d-a5b0-215bd53de881 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:19.463279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb60b4e5-747a-446d-a5b0-215bd53de881 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:19.503066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-31113b5d-bbe5-41ae-a453-3877d5d5bb60 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:19.507499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-31113b5d-bbe5-41ae-a453-3877d5d5bb60 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:19.540420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31113b5d-bbe5-41ae-a453-3877d5d5bb60 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:19.540420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31113b5d-bbe5-41ae-a453-3877d5d5bb60 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:19.540420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31113b5d-bbe5-41ae-a453-3877d5d5bb60 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:19.540420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31113b5d-bbe5-41ae-a453-3877d5d5bb60 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:19.799745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bb60b4e5-747a-446d-a5b0-215bd53de881 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:19.826690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bb60b4e5-747a-446d-a5b0-215bd53de881 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:19.828784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bb60b4e5-747a-446d-a5b0-215bd53de881 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:19.831208 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bb60b4e5-747a-446d-a5b0-215bd53de881 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.393731 Aug 02 07:17:19.832418 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2933/5794] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:19 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:19.878557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8bdde77b-876e-4c2c-a92c-385414f58afc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:19.880115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8bdde77b-876e-4c2c-a92c-385414f58afc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:19.890530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bdde77b-876e-4c2c-a92c-385414f58afc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:19.891419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bdde77b-876e-4c2c-a92c-385414f58afc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:19.892425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bdde77b-876e-4c2c-a92c-385414f58afc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:19.893733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8bdde77b-876e-4c2c-a92c-385414f58afc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:20.162498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-31113b5d-bbe5-41ae-a453-3877d5d5bb60 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:20.190382 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-31113b5d-bbe5-41ae-a453-3877d5d5bb60 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1691 microversion: 2.1 time: 0.693314 Aug 02 07:17:20.191352 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2862/5795] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:19 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1691 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:20.260086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8bdde77b-876e-4c2c-a92c-385414f58afc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:20.293068 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8bdde77b-876e-4c2c-a92c-385414f58afc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1511 microversion: 2.1 time: 0.443094 Aug 02 07:17:20.295595 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2934/5796] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:19 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1511 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:20.868511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e46a045b-30ac-4fde-817b-c0c77d2a4872 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:20.870751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e46a045b-30ac-4fde-817b-c0c77d2a4872 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:20.890619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e46a045b-30ac-4fde-817b-c0c77d2a4872 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:20.892071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e46a045b-30ac-4fde-817b-c0c77d2a4872 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:20.894196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e46a045b-30ac-4fde-817b-c0c77d2a4872 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:20.894849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e46a045b-30ac-4fde-817b-c0c77d2a4872 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:21.038467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e46a045b-30ac-4fde-817b-c0c77d2a4872 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:21.061747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e46a045b-30ac-4fde-817b-c0c77d2a4872 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:21.065963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e46a045b-30ac-4fde-817b-c0c77d2a4872 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:21.075344 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e46a045b-30ac-4fde-817b-c0c77d2a4872 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.217037 Aug 02 07:17:21.077152 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2863/5797] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:20 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:21.221145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ba06733c-4a29-4515-9731-6c0f94c1b011 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:21.222068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ba06733c-4a29-4515-9731-6c0f94c1b011 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:21.240815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba06733c-4a29-4515-9731-6c0f94c1b011 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:21.242108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba06733c-4a29-4515-9731-6c0f94c1b011 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:21.244158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba06733c-4a29-4515-9731-6c0f94c1b011 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:21.245558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ba06733c-4a29-4515-9731-6c0f94c1b011 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:21.316032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-60f5890e-7426-43cd-a19f-0568023e31e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:21.317029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-60f5890e-7426-43cd-a19f-0568023e31e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:21.327855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60f5890e-7426-43cd-a19f-0568023e31e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:21.328297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60f5890e-7426-43cd-a19f-0568023e31e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:21.331076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60f5890e-7426-43cd-a19f-0568023e31e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:21.331713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60f5890e-7426-43cd-a19f-0568023e31e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:21.710304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ba06733c-4a29-4515-9731-6c0f94c1b011 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:21.729317 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ba06733c-4a29-4515-9731-6c0f94c1b011 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1691 microversion: 2.1 time: 0.519835 Aug 02 07:17:21.730669 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2935/5798] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:21 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1691 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:21.748689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-60f5890e-7426-43cd-a19f-0568023e31e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:21.761059 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-60f5890e-7426-43cd-a19f-0568023e31e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1511 microversion: 2.1 time: 0.448563 Aug 02 07:17:21.762177 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2864/5799] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:21 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1511 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:22.103592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-372f83e2-ec21-4e6b-860f-d6e48cd93cc8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:22.104671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-372f83e2-ec21-4e6b-860f-d6e48cd93cc8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:22.113141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-372f83e2-ec21-4e6b-860f-d6e48cd93cc8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:22.113754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-372f83e2-ec21-4e6b-860f-d6e48cd93cc8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:22.114829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-372f83e2-ec21-4e6b-860f-d6e48cd93cc8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:22.115625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-372f83e2-ec21-4e6b-860f-d6e48cd93cc8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:22.456241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-372f83e2-ec21-4e6b-860f-d6e48cd93cc8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:22.468045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-372f83e2-ec21-4e6b-860f-d6e48cd93cc8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:22.470055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-372f83e2-ec21-4e6b-860f-d6e48cd93cc8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:22.471574 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-372f83e2-ec21-4e6b-860f-d6e48cd93cc8 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.372839 Aug 02 07:17:22.472738 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2936/5800] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:22 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:22.759823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-759a4173-9a4a-42a4-a527-fe9455a62d6e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:22.761770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-759a4173-9a4a-42a4-a527-fe9455a62d6e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:22.772102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-759a4173-9a4a-42a4-a527-fe9455a62d6e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:22.773007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-759a4173-9a4a-42a4-a527-fe9455a62d6e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:22.774562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-759a4173-9a4a-42a4-a527-fe9455a62d6e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:22.775666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-759a4173-9a4a-42a4-a527-fe9455a62d6e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:22.796600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-daee000c-e3f3-417b-abff-d9c6e773e83d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:22.797684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-daee000c-e3f3-417b-abff-d9c6e773e83d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:22.820497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-daee000c-e3f3-417b-abff-d9c6e773e83d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:22.821015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-daee000c-e3f3-417b-abff-d9c6e773e83d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:22.821940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-daee000c-e3f3-417b-abff-d9c6e773e83d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:22.828301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-daee000c-e3f3-417b-abff-d9c6e773e83d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:23.378978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-daee000c-e3f3-417b-abff-d9c6e773e83d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:23.383606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-759a4173-9a4a-42a4-a527-fe9455a62d6e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:23.393849 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-759a4173-9a4a-42a4-a527-fe9455a62d6e tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1691 microversion: 2.1 time: 0.641759 Aug 02 07:17:23.398547 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2865/5801] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:22 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1691 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:23.425575 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-daee000c-e3f3-417b-abff-d9c6e773e83d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1511 microversion: 2.1 time: 0.644852 Aug 02 07:17:23.430577 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2937/5802] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:22 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1511 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:23.495701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fff504df-f54b-43bd-944c-3925f0d5a6eb tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:23.496311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fff504df-f54b-43bd-944c-3925f0d5a6eb tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:23.505958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fff504df-f54b-43bd-944c-3925f0d5a6eb tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:23.510904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fff504df-f54b-43bd-944c-3925f0d5a6eb tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:23.517814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fff504df-f54b-43bd-944c-3925f0d5a6eb tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:23.518887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fff504df-f54b-43bd-944c-3925f0d5a6eb tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:23.696633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fff504df-f54b-43bd-944c-3925f0d5a6eb tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:23.720313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fff504df-f54b-43bd-944c-3925f0d5a6eb tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:23.722362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fff504df-f54b-43bd-944c-3925f0d5a6eb tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:23.723829 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fff504df-f54b-43bd-944c-3925f0d5a6eb tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.232540 Aug 02 07:17:23.725101 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2866/5803] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:23 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:24.420309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1d1578dc-a5f9-4e9b-9422-3e80b168aa9c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:24.421207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1d1578dc-a5f9-4e9b-9422-3e80b168aa9c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:24.429526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d1578dc-a5f9-4e9b-9422-3e80b168aa9c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:24.430465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d1578dc-a5f9-4e9b-9422-3e80b168aa9c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:24.431686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d1578dc-a5f9-4e9b-9422-3e80b168aa9c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:24.432399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d1578dc-a5f9-4e9b-9422-3e80b168aa9c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:24.456101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6e928409-82f9-49db-ae1e-771e41e4a865 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:24.458183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6e928409-82f9-49db-ae1e-771e41e4a865 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:24.468268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e928409-82f9-49db-ae1e-771e41e4a865 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:24.468976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e928409-82f9-49db-ae1e-771e41e4a865 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:24.470262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e928409-82f9-49db-ae1e-771e41e4a865 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:24.470850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e928409-82f9-49db-ae1e-771e41e4a865 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:25.026832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1d1578dc-a5f9-4e9b-9422-3e80b168aa9c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:25.035230 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1d1578dc-a5f9-4e9b-9422-3e80b168aa9c tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1691 microversion: 2.1 time: 0.618806 Aug 02 07:17:25.043213 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2938/5804] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:24 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1691 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:25.048521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-57701b21-42f2-4150-8067-524a0d84b913 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:25.058906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-57701b21-42f2-4150-8067-524a0d84b913 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:25.071599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57701b21-42f2-4150-8067-524a0d84b913 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:25.071922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57701b21-42f2-4150-8067-524a0d84b913 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:25.072679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57701b21-42f2-4150-8067-524a0d84b913 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:25.073142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57701b21-42f2-4150-8067-524a0d84b913 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:25.190311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6e928409-82f9-49db-ae1e-771e41e4a865 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:25.198971 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6e928409-82f9-49db-ae1e-771e41e4a865 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1511 microversion: 2.1 time: 0.747956 Aug 02 07:17:25.203572 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2867/5805] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:24 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1511 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:17:25.341722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-57701b21-42f2-4150-8067-524a0d84b913 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:25.354065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-57701b21-42f2-4150-8067-524a0d84b913 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:25.356121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-57701b21-42f2-4150-8067-524a0d84b913 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:25.364156 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-57701b21-42f2-4150-8067-524a0d84b913 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.312783 Aug 02 07:17:25.364890 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2939/5806] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:25 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:26.064225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-05bc7570-9f27-4cfc-b588-6a010e989b22 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:26.065281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-05bc7570-9f27-4cfc-b588-6a010e989b22 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:26.091547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-05bc7570-9f27-4cfc-b588-6a010e989b22 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:26.093299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-05bc7570-9f27-4cfc-b588-6a010e989b22 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:26.105204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-05bc7570-9f27-4cfc-b588-6a010e989b22 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:26.106120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-05bc7570-9f27-4cfc-b588-6a010e989b22 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:26.225147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4a614e28-fed7-4c68-9f12-4907b7b9b480 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:26.225769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4a614e28-fed7-4c68-9f12-4907b7b9b480 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:26.242443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a614e28-fed7-4c68-9f12-4907b7b9b480 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:26.243439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a614e28-fed7-4c68-9f12-4907b7b9b480 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:26.244627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a614e28-fed7-4c68-9f12-4907b7b9b480 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:26.245318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a614e28-fed7-4c68-9f12-4907b7b9b480 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:26.664413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-05bc7570-9f27-4cfc-b588-6a010e989b22 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:26.686663 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-05bc7570-9f27-4cfc-b588-6a010e989b22 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1691 microversion: 2.1 time: 0.626230 Aug 02 07:17:26.689227 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2868/5807] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:26 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1691 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:26.699097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34028db5-f566-467f-9dc3-02347aa51407 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:26.700296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-34028db5-f566-467f-9dc3-02347aa51407 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:26.710902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34028db5-f566-467f-9dc3-02347aa51407 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:26.714807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34028db5-f566-467f-9dc3-02347aa51407 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:26.716518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34028db5-f566-467f-9dc3-02347aa51407 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:26.718076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34028db5-f566-467f-9dc3-02347aa51407 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:26.761699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4a614e28-fed7-4c68-9f12-4907b7b9b480 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:26.776373 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4a614e28-fed7-4c68-9f12-4907b7b9b480 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1532 microversion: 2.1 time: 0.555048 Aug 02 07:17:26.777374 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2940/5808] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:26 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1532 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:17:26.880700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-34028db5-f566-467f-9dc3-02347aa51407 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:26.907205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-34028db5-f566-467f-9dc3-02347aa51407 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:26.920837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-34028db5-f566-467f-9dc3-02347aa51407 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:26.922718 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-34028db5-f566-467f-9dc3-02347aa51407 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.232001 Aug 02 07:17:26.923951 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2869/5809] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:26 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:27.716948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c0311ac7-14c5-4107-b0b4-67a4e3dc992a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:27.717774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c0311ac7-14c5-4107-b0b4-67a4e3dc992a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:27.722428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=82 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:17:27.739703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0311ac7-14c5-4107-b0b4-67a4e3dc992a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:27.741110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0311ac7-14c5-4107-b0b4-67a4e3dc992a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:27.743597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0311ac7-14c5-4107-b0b4-67a4e3dc992a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:27.745514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0311ac7-14c5-4107-b0b4-67a4e3dc992a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:27.822413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5565b525-409a-4f4c-8932-701da49017f3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:27.823263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5565b525-409a-4f4c-8932-701da49017f3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:27.844366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5565b525-409a-4f4c-8932-701da49017f3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:27.848236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5565b525-409a-4f4c-8932-701da49017f3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:27.850344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5565b525-409a-4f4c-8932-701da49017f3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:27.851783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5565b525-409a-4f4c-8932-701da49017f3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:28.248918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c0311ac7-14c5-4107-b0b4-67a4e3dc992a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:28.262873 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c0311ac7-14c5-4107-b0b4-67a4e3dc992a tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1697 microversion: 2.1 time: 0.551288 Aug 02 07:17:28.263831 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2941/5810] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:27 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1697 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:28.283190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a9fe39f2-5637-4137-a715-8b6be55e8d38 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:28.283190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a9fe39f2-5637-4137-a715-8b6be55e8d38 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:28.303842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9fe39f2-5637-4137-a715-8b6be55e8d38 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:28.304135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9fe39f2-5637-4137-a715-8b6be55e8d38 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:28.304934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9fe39f2-5637-4137-a715-8b6be55e8d38 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:28.305557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9fe39f2-5637-4137-a715-8b6be55e8d38 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:28.432068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a9fe39f2-5637-4137-a715-8b6be55e8d38 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:28.446981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a9fe39f2-5637-4137-a715-8b6be55e8d38 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:28.452433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a9fe39f2-5637-4137-a715-8b6be55e8d38 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:28.458069 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a9fe39f2-5637-4137-a715-8b6be55e8d38 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.192883 Aug 02 07:17:28.459362 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2942/5811] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:28 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:28.500504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5565b525-409a-4f4c-8932-701da49017f3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:28.511628 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5565b525-409a-4f4c-8932-701da49017f3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1532 microversion: 2.1 time: 0.694414 Aug 02 07:17:28.513511 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2870/5812] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:27 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1532 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:29.288147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3cbb0601-0413-4f38-8bea-3f5e93d57eb1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:29.289172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3cbb0601-0413-4f38-8bea-3f5e93d57eb1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:29.318008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cbb0601-0413-4f38-8bea-3f5e93d57eb1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:29.318657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cbb0601-0413-4f38-8bea-3f5e93d57eb1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:29.319518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cbb0601-0413-4f38-8bea-3f5e93d57eb1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:29.319963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cbb0601-0413-4f38-8bea-3f5e93d57eb1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:29.582313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-459f5e71-b0d6-440f-80c8-fd2b91d2780a req-2fe1c503-ca4b-4d27-aa26-9d0d4b615259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2edf07-e6a8-472c-9d71-a0691e66b90d", "name": "network-vif-plugged", "status": "completed", "tag": "45cd9e1c-cdfb-4648-a6ce-ee7537957267"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:29.598389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-459f5e71-b0d6-440f-80c8-fd2b91d2780a req-2fe1c503-ca4b-4d27-aa26-9d0d4b615259 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:29.599215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-459f5e71-b0d6-440f-80c8-fd2b91d2780a req-2fe1c503-ca4b-4d27-aa26-9d0d4b615259 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:29.622873 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-459f5e71-b0d6-440f-80c8-fd2b91d2780a req-2fe1c503-ca4b-4d27-aa26-9d0d4b615259 service nova] Creating event network-vif-plugged:45cd9e1c-cdfb-4648-a6ce-ee7537957267 for instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d on n-h1-851337-3 Aug 02 07:17:29.629025 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-459f5e71-b0d6-440f-80c8-fd2b91d2780a req-2fe1c503-ca4b-4d27-aa26-9d0d4b615259 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.418770 Aug 02 07:17:29.630253 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2943/5813] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:17:29.639207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-54bb7eef-717b-407b-a48f-2df7ccbb0c7b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:29.640208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-54bb7eef-717b-407b-a48f-2df7ccbb0c7b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:29.650503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54bb7eef-717b-407b-a48f-2df7ccbb0c7b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:29.650998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54bb7eef-717b-407b-a48f-2df7ccbb0c7b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:29.651795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54bb7eef-717b-407b-a48f-2df7ccbb0c7b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:29.652226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54bb7eef-717b-407b-a48f-2df7ccbb0c7b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:29.773623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-54bb7eef-717b-407b-a48f-2df7ccbb0c7b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:29.784532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-54bb7eef-717b-407b-a48f-2df7ccbb0c7b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:29.787122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-54bb7eef-717b-407b-a48f-2df7ccbb0c7b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:29.789743 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-54bb7eef-717b-407b-a48f-2df7ccbb0c7b tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.157233 Aug 02 07:17:29.792633 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2944/5814] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:29 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:29.802854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f9afd15-3af5-4f8b-8661-5246af5c1ba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:29.804207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1f9afd15-3af5-4f8b-8661-5246af5c1ba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:29.813042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f9afd15-3af5-4f8b-8661-5246af5c1ba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:29.814149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f9afd15-3af5-4f8b-8661-5246af5c1ba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:29.815371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f9afd15-3af5-4f8b-8661-5246af5c1ba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:29.817058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f9afd15-3af5-4f8b-8661-5246af5c1ba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:29.909151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3cbb0601-0413-4f38-8bea-3f5e93d57eb1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:29.924397 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3cbb0601-0413-4f38-8bea-3f5e93d57eb1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1697 microversion: 2.1 time: 0.642265 Aug 02 07:17:29.940005 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2871/5815] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:29 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1697 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:30.126911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f9afd15-3af5-4f8b-8661-5246af5c1ba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:30.142024 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f9afd15-3af5-4f8b-8661-5246af5c1ba6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1532 microversion: 2.1 time: 0.345961 Aug 02 07:17:30.143387 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2945/5816] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:29 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1532 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:30.820803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c9a273db-e655-4635-960a-f358de947b08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:30.821416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c9a273db-e655-4635-960a-f358de947b08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:30.877740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9a273db-e655-4635-960a-f358de947b08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:30.880328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9a273db-e655-4635-960a-f358de947b08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:30.882697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9a273db-e655-4635-960a-f358de947b08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:30.885651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9a273db-e655-4635-960a-f358de947b08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:30.950685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7cac2b65-00d7-4634-a47c-d94c7cc01a41 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:30.952083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7cac2b65-00d7-4634-a47c-d94c7cc01a41 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:30.987216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7cac2b65-00d7-4634-a47c-d94c7cc01a41 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:30.987727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7cac2b65-00d7-4634-a47c-d94c7cc01a41 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:30.993824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7cac2b65-00d7-4634-a47c-d94c7cc01a41 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:30.994390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7cac2b65-00d7-4634-a47c-d94c7cc01a41 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:31.127736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c9a273db-e655-4635-960a-f358de947b08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:31.146326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c9a273db-e655-4635-960a-f358de947b08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:31.149811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c9a273db-e655-4635-960a-f358de947b08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:31.152356 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c9a273db-e655-4635-960a-f358de947b08 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.335399 Aug 02 07:17:31.153862 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2872/5817] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:30 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:31.176979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79e34778-ed0e-4924-ba99-7eda08db4c5f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:31.179047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79e34778-ed0e-4924-ba99-7eda08db4c5f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:31.194964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79e34778-ed0e-4924-ba99-7eda08db4c5f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:31.196815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79e34778-ed0e-4924-ba99-7eda08db4c5f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:31.198136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79e34778-ed0e-4924-ba99-7eda08db4c5f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:31.198770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79e34778-ed0e-4924-ba99-7eda08db4c5f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:31.508082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7cac2b65-00d7-4634-a47c-d94c7cc01a41 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:31.520060 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7cac2b65-00d7-4634-a47c-d94c7cc01a41 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1697 microversion: 2.1 time: 0.574180 Aug 02 07:17:31.524912 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2946/5818] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:30 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1697 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:17:31.530117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79e34778-ed0e-4924-ba99-7eda08db4c5f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:31.547998 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79e34778-ed0e-4924-ba99-7eda08db4c5f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1532 microversion: 2.1 time: 0.380089 Aug 02 07:17:31.549064 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2873/5819] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:31 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1532 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:17:31.653590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-5c8bc4c9-de67-413d-9cdc-c3962294a372 req-963a2f60-a08a-4387-ad25-86c26af635e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc", "name": "network-vif-unplugged", "status": "completed", "tag": "f84ab8a1-e3d2-4d29-97b2-2cf74d942511"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:31.671220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-5c8bc4c9-de67-413d-9cdc-c3962294a372 req-963a2f60-a08a-4387-ad25-86c26af635e1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:31.671942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-5c8bc4c9-de67-413d-9cdc-c3962294a372 req-963a2f60-a08a-4387-ad25-86c26af635e1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:31.687188 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-5c8bc4c9-de67-413d-9cdc-c3962294a372 req-963a2f60-a08a-4387-ad25-86c26af635e1 service nova] Creating event network-vif-unplugged:f84ab8a1-e3d2-4d29-97b2-2cf74d942511 for instance d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc on n-h1-851337-3 Aug 02 07:17:31.716116 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-5c8bc4c9-de67-413d-9cdc-c3962294a372 req-963a2f60-a08a-4387-ad25-86c26af635e1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066025 Aug 02 07:17:31.717369 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2947/5820] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:17:32.180167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-183a5025-3cb4-49b9-bbb2-100004ee4a46 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:32.181622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-183a5025-3cb4-49b9-bbb2-100004ee4a46 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:32.191921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-183a5025-3cb4-49b9-bbb2-100004ee4a46 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:32.192745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-183a5025-3cb4-49b9-bbb2-100004ee4a46 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:32.195458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-183a5025-3cb4-49b9-bbb2-100004ee4a46 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:32.196961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-183a5025-3cb4-49b9-bbb2-100004ee4a46 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:32.396173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-183a5025-3cb4-49b9-bbb2-100004ee4a46 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:32.409506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-183a5025-3cb4-49b9-bbb2-100004ee4a46 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:32.418351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-183a5025-3cb4-49b9-bbb2-100004ee4a46 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:32.423570 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-183a5025-3cb4-49b9-bbb2-100004ee4a46 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.244537 Aug 02 07:17:32.426350 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2874/5821] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:32 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:32.551141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a6a9783b-9bb7-4528-8813-9433b34f6a18 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:32.551864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a6a9783b-9bb7-4528-8813-9433b34f6a18 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:32.571570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6a9783b-9bb7-4528-8813-9433b34f6a18 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:32.571769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-173188a1-879b-41bd-97ee-4d75954669e4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:32.572147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-173188a1-879b-41bd-97ee-4d75954669e4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:32.572850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6a9783b-9bb7-4528-8813-9433b34f6a18 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:32.576522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6a9783b-9bb7-4528-8813-9433b34f6a18 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:32.577163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6a9783b-9bb7-4528-8813-9433b34f6a18 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:32.581048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-173188a1-879b-41bd-97ee-4d75954669e4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:32.582132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-173188a1-879b-41bd-97ee-4d75954669e4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:32.583341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-173188a1-879b-41bd-97ee-4d75954669e4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:32.585304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-173188a1-879b-41bd-97ee-4d75954669e4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:32.594863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:17:32.607583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:17:33.202750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a6a9783b-9bb7-4528-8813-9433b34f6a18 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:33.220940 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a6a9783b-9bb7-4528-8813-9433b34f6a18 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1697 microversion: 2.1 time: 0.672422 Aug 02 07:17:33.222450 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2948/5822] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:32 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1697 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:33.355775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-173188a1-879b-41bd-97ee-4d75954669e4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:33.369935 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-173188a1-879b-41bd-97ee-4d75954669e4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1527 microversion: 2.1 time: 0.803012 Aug 02 07:17:33.388900 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2875/5823] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:32 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1527 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:33.450378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-800be319-ec16-4307-a00e-776a8d4b86ab tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:33.451058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-800be319-ec16-4307-a00e-776a8d4b86ab tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:33.476013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-800be319-ec16-4307-a00e-776a8d4b86ab tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:33.479805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-800be319-ec16-4307-a00e-776a8d4b86ab tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:33.483080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-800be319-ec16-4307-a00e-776a8d4b86ab tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:33.484675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-800be319-ec16-4307-a00e-776a8d4b86ab tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:33.696309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-800be319-ec16-4307-a00e-776a8d4b86ab tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:33.708328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-800be319-ec16-4307-a00e-776a8d4b86ab tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:33.713442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-800be319-ec16-4307-a00e-776a8d4b86ab tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:33.715660 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-800be319-ec16-4307-a00e-776a8d4b86ab tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.270605 Aug 02 07:17:33.719708 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2949/5824] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:33 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:34.251152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a5fdf19c-e00a-4759-9d15-eea02f5f5d4d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:34.251684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a5fdf19c-e00a-4759-9d15-eea02f5f5d4d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:34.267570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5fdf19c-e00a-4759-9d15-eea02f5f5d4d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:34.268619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5fdf19c-e00a-4759-9d15-eea02f5f5d4d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:34.275234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5fdf19c-e00a-4759-9d15-eea02f5f5d4d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:34.276649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5fdf19c-e00a-4759-9d15-eea02f5f5d4d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:34.400674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bbcddfbd-34f2-43e2-ba53-ae557a926117 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:34.401767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bbcddfbd-34f2-43e2-ba53-ae557a926117 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:34.448449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbcddfbd-34f2-43e2-ba53-ae557a926117 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:34.452860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbcddfbd-34f2-43e2-ba53-ae557a926117 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:34.456963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbcddfbd-34f2-43e2-ba53-ae557a926117 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:34.465215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbcddfbd-34f2-43e2-ba53-ae557a926117 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:35.549049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a5fdf19c-e00a-4759-9d15-eea02f5f5d4d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:35.550801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bbcddfbd-34f2-43e2-ba53-ae557a926117 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:35.567216 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a5fdf19c-e00a-4759-9d15-eea02f5f5d4d tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1682 microversion: 2.1 time: 1.321792 Aug 02 07:17:35.571756 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bbcddfbd-34f2-43e2-ba53-ae557a926117 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1527 microversion: 2.1 time: 1.180675 Aug 02 07:17:35.574542 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2950/5825] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:34 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1527 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:35.578565 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2876/5826] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:34 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1682 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:35.585281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-6e233537-fa13-4037-9f8d-7cf5b1facd71 req-a695df9f-10c8-4bc5-b107-2f8de5bde224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc", "name": "network-vif-plugged", "status": "completed", "tag": "f84ab8a1-e3d2-4d29-97b2-2cf74d942511"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:35.590729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5282c68a-5d01-4c4d-b105-afa54f234fca tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:35.593094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5282c68a-5d01-4c4d-b105-afa54f234fca tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:35.618532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5282c68a-5d01-4c4d-b105-afa54f234fca tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:35.623337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5282c68a-5d01-4c4d-b105-afa54f234fca tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:35.627396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6e233537-fa13-4037-9f8d-7cf5b1facd71 req-a695df9f-10c8-4bc5-b107-2f8de5bde224 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:35.629190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5282c68a-5d01-4c4d-b105-afa54f234fca tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:35.630198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5282c68a-5d01-4c4d-b105-afa54f234fca tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:35.636779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6e233537-fa13-4037-9f8d-7cf5b1facd71 req-a695df9f-10c8-4bc5-b107-2f8de5bde224 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:35.681122 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-6e233537-fa13-4037-9f8d-7cf5b1facd71 req-a695df9f-10c8-4bc5-b107-2f8de5bde224 service nova] Creating event network-vif-plugged:f84ab8a1-e3d2-4d29-97b2-2cf74d942511 for instance d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc on n-h1-851337-3 Aug 02 07:17:35.721075 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-6e233537-fa13-4037-9f8d-7cf5b1facd71 req-a695df9f-10c8-4bc5-b107-2f8de5bde224 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140619 Aug 02 07:17:35.723374 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2877/5827] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:17:35.832156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5282c68a-5d01-4c4d-b105-afa54f234fca tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:35.865529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5282c68a-5d01-4c4d-b105-afa54f234fca tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:35.875719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5282c68a-5d01-4c4d-b105-afa54f234fca tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:35.877223 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5282c68a-5d01-4c4d-b105-afa54f234fca tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.301207 Aug 02 07:17:35.877971 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2951/5828] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:35 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:36.598136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f01957e8-ff22-4f5e-9906-82117f3b2425 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:36.600013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f01957e8-ff22-4f5e-9906-82117f3b2425 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:36.616372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f01957e8-ff22-4f5e-9906-82117f3b2425 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:36.620066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f01957e8-ff22-4f5e-9906-82117f3b2425 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:36.621158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f01957e8-ff22-4f5e-9906-82117f3b2425 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:36.621754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f01957e8-ff22-4f5e-9906-82117f3b2425 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:36.902563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3c2715be-9da3-4f50-9b65-b6dcfe16f4e3 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:36.903463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3c2715be-9da3-4f50-9b65-b6dcfe16f4e3 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:36.920917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c2715be-9da3-4f50-9b65-b6dcfe16f4e3 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:36.920917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c2715be-9da3-4f50-9b65-b6dcfe16f4e3 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:36.921408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c2715be-9da3-4f50-9b65-b6dcfe16f4e3 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:36.921798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c2715be-9da3-4f50-9b65-b6dcfe16f4e3 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:37.049539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3c2715be-9da3-4f50-9b65-b6dcfe16f4e3 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:37.054881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f01957e8-ff22-4f5e-9906-82117f3b2425 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:37.064306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3c2715be-9da3-4f50-9b65-b6dcfe16f4e3 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:37.073434 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3c2715be-9da3-4f50-9b65-b6dcfe16f4e3 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:37.073762 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f01957e8-ff22-4f5e-9906-82117f3b2425 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1527 microversion: 2.1 time: 0.481130 Aug 02 07:17:37.076499 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2878/5829] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:36 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1527 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:37.079760 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3c2715be-9da3-4f50-9b65-b6dcfe16f4e3 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1364 microversion: 2.57 time: 0.181773 Aug 02 07:17:37.081330 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2952/5830] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:36 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:38.105308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-97d60bbc-1101-40b4-a150-51aec70fd184 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:38.109660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f3e2d93e-ba3e-492c-808c-32a9b4a55dc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:38.110873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f3e2d93e-ba3e-492c-808c-32a9b4a55dc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:38.113767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-97d60bbc-1101-40b4-a150-51aec70fd184 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:38.129176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97d60bbc-1101-40b4-a150-51aec70fd184 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:38.134283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3e2d93e-ba3e-492c-808c-32a9b4a55dc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:38.134830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3e2d93e-ba3e-492c-808c-32a9b4a55dc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:38.140906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97d60bbc-1101-40b4-a150-51aec70fd184 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:38.141733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97d60bbc-1101-40b4-a150-51aec70fd184 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:38.142948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3e2d93e-ba3e-492c-808c-32a9b4a55dc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:38.143614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97d60bbc-1101-40b4-a150-51aec70fd184 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:38.149007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3e2d93e-ba3e-492c-808c-32a9b4a55dc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:38.469496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-97d60bbc-1101-40b4-a150-51aec70fd184 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:38.479391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-97d60bbc-1101-40b4-a150-51aec70fd184 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:38.480949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-97d60bbc-1101-40b4-a150-51aec70fd184 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:38.482204 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-97d60bbc-1101-40b4-a150-51aec70fd184 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1370 microversion: 2.57 time: 0.380950 Aug 02 07:17:38.493923 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2953/5831] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:38 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1370 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:38.826207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f3e2d93e-ba3e-492c-808c-32a9b4a55dc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:38.883891 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f3e2d93e-ba3e-492c-808c-32a9b4a55dc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1527 microversion: 2.1 time: 0.779839 Aug 02 07:17:38.896895 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2879/5832] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:38 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1527 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:39.513118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f248bc99-2019-4ec9-9a68-f7c3de071de5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:39.515071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f248bc99-2019-4ec9-9a68-f7c3de071de5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:39.530121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f248bc99-2019-4ec9-9a68-f7c3de071de5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:39.530578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f248bc99-2019-4ec9-9a68-f7c3de071de5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:39.531374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f248bc99-2019-4ec9-9a68-f7c3de071de5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:39.531800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f248bc99-2019-4ec9-9a68-f7c3de071de5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:39.692301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f248bc99-2019-4ec9-9a68-f7c3de071de5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:39.710767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f248bc99-2019-4ec9-9a68-f7c3de071de5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:39.712923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f248bc99-2019-4ec9-9a68-f7c3de071de5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:39.714452 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f248bc99-2019-4ec9-9a68-f7c3de071de5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1370 microversion: 2.57 time: 0.208147 Aug 02 07:17:39.718552 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2954/5833] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:39 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:39.920938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-69aa641a-7f51-4f53-989e-37fbedf3a782 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:39.922579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-69aa641a-7f51-4f53-989e-37fbedf3a782 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:39.947442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69aa641a-7f51-4f53-989e-37fbedf3a782 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:39.949599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69aa641a-7f51-4f53-989e-37fbedf3a782 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:39.952896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69aa641a-7f51-4f53-989e-37fbedf3a782 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:39.957382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69aa641a-7f51-4f53-989e-37fbedf3a782 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:40.480945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-69aa641a-7f51-4f53-989e-37fbedf3a782 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:40.519020 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-69aa641a-7f51-4f53-989e-37fbedf3a782 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1527 microversion: 2.1 time: 0.602289 Aug 02 07:17:40.519665 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2880/5834] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:39 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1527 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:40.740914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-53757e24-5268-4042-bb33-4b9970663ae7 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:40.741535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-53757e24-5268-4042-bb33-4b9970663ae7 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:40.758240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53757e24-5268-4042-bb33-4b9970663ae7 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:40.758927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53757e24-5268-4042-bb33-4b9970663ae7 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:40.759859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53757e24-5268-4042-bb33-4b9970663ae7 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:40.760295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53757e24-5268-4042-bb33-4b9970663ae7 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:41.112824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-53757e24-5268-4042-bb33-4b9970663ae7 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:41.121708 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-53757e24-5268-4042-bb33-4b9970663ae7 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:41.123661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-53757e24-5268-4042-bb33-4b9970663ae7 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:41.145150 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-53757e24-5268-4042-bb33-4b9970663ae7 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1355 microversion: 2.57 time: 0.408114 Aug 02 07:17:41.146122 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2955/5835] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:40 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1355 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:41.189653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-02ea264c-6571-4ca0-b425-b692e9ef85e5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:41.190279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-02ea264c-6571-4ca0-b425-b692e9ef85e5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:41.218668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02ea264c-6571-4ca0-b425-b692e9ef85e5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:41.218668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02ea264c-6571-4ca0-b425-b692e9ef85e5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:41.219510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02ea264c-6571-4ca0-b425-b692e9ef85e5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:41.220220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02ea264c-6571-4ca0-b425-b692e9ef85e5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:41.324145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-02ea264c-6571-4ca0-b425-b692e9ef85e5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:17:41.555713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-672c5d77-e194-46eb-94e5-478bd4210f2d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:41.562977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-672c5d77-e194-46eb-94e5-478bd4210f2d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:41.572532 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-02ea264c-6571-4ca0-b425-b692e9ef85e5 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 204 len: 0 microversion: 2.57 time: 0.390380 Aug 02 07:17:41.573142 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2881/5836] 10.222.0.79 () {60 vars in 1280 bytes} [Tue Aug 2 07:17:41 2022] DELETE /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 07:17:41.576264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-672c5d77-e194-46eb-94e5-478bd4210f2d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:41.577043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-672c5d77-e194-46eb-94e5-478bd4210f2d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:41.578198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-672c5d77-e194-46eb-94e5-478bd4210f2d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:41.578868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-672c5d77-e194-46eb-94e5-478bd4210f2d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:41.585433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-023390a4-5952-4e3b-99ed-68d156b3ef31 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:41.589023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-023390a4-5952-4e3b-99ed-68d156b3ef31 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:41.600845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-023390a4-5952-4e3b-99ed-68d156b3ef31 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:41.602140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-023390a4-5952-4e3b-99ed-68d156b3ef31 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:41.604504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-023390a4-5952-4e3b-99ed-68d156b3ef31 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:41.604952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-023390a4-5952-4e3b-99ed-68d156b3ef31 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:41.809811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-023390a4-5952-4e3b-99ed-68d156b3ef31 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:41.830117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-023390a4-5952-4e3b-99ed-68d156b3ef31 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:41.835946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-023390a4-5952-4e3b-99ed-68d156b3ef31 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:41.839399 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-023390a4-5952-4e3b-99ed-68d156b3ef31 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1361 microversion: 2.57 time: 0.261790 Aug 02 07:17:41.844107 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2882/5837] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:41 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:42.215975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-672c5d77-e194-46eb-94e5-478bd4210f2d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:42.263578 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-672c5d77-e194-46eb-94e5-478bd4210f2d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1527 microversion: 2.1 time: 0.717312 Aug 02 07:17:42.264222 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2956/5838] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:41 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1527 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:42.869450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-333b917c-e7f1-4251-9ff6-018db0bcbe7e tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:42.870823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-333b917c-e7f1-4251-9ff6-018db0bcbe7e tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:42.893389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-333b917c-e7f1-4251-9ff6-018db0bcbe7e tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:42.893834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-333b917c-e7f1-4251-9ff6-018db0bcbe7e tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:42.898111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-333b917c-e7f1-4251-9ff6-018db0bcbe7e tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:42.898780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-333b917c-e7f1-4251-9ff6-018db0bcbe7e tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:43.219062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-333b917c-e7f1-4251-9ff6-018db0bcbe7e tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:43.231288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-333b917c-e7f1-4251-9ff6-018db0bcbe7e tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:43.241080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-333b917c-e7f1-4251-9ff6-018db0bcbe7e tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:43.257298 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-333b917c-e7f1-4251-9ff6-018db0bcbe7e tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1361 microversion: 2.57 time: 0.391787 Aug 02 07:17:43.265249 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2883/5839] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:42 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1361 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:43.290921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e9242bf5-a631-4523-819c-dbd215ba1a2c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:43.292388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e9242bf5-a631-4523-819c-dbd215ba1a2c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:43.311030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9242bf5-a631-4523-819c-dbd215ba1a2c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:43.317825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9242bf5-a631-4523-819c-dbd215ba1a2c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:43.319957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9242bf5-a631-4523-819c-dbd215ba1a2c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:43.323102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9242bf5-a631-4523-819c-dbd215ba1a2c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:44.308838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-354095a6-95c1-42f2-9195-90540b34a118 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:44.312057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-354095a6-95c1-42f2-9195-90540b34a118 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:44.388364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-354095a6-95c1-42f2-9195-90540b34a118 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:44.393414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-354095a6-95c1-42f2-9195-90540b34a118 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:44.399486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-354095a6-95c1-42f2-9195-90540b34a118 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:44.401339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-354095a6-95c1-42f2-9195-90540b34a118 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:44.628460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-354095a6-95c1-42f2-9195-90540b34a118 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:44.629311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-354095a6-95c1-42f2-9195-90540b34a118 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:44.640332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-354095a6-95c1-42f2-9195-90540b34a118 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lazy-loading 'fault' on Instance uuid 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:17:44.870083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-354095a6-95c1-42f2-9195-90540b34a118 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:44.887970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-354095a6-95c1-42f2-9195-90540b34a118 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:44.897487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-354095a6-95c1-42f2-9195-90540b34a118 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04dbb2ed43ed4ec88ecab768d5be11dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319151eea4f94457b7d0603065e6075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:44.907543 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-354095a6-95c1-42f2-9195-90540b34a118 tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 200 len: 1366 microversion: 2.57 time: 0.601514 Aug 02 07:17:44.909941 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2884/5840] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:44 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 1366 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 07:17:45.113211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e9242bf5-a631-4523-819c-dbd215ba1a2c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:45.121813 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e9242bf5-a631-4523-819c-dbd215ba1a2c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1527 microversion: 2.1 time: 1.835722 Aug 02 07:17:45.131986 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2957/5841] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:43 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1527 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:45.945361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-524b750b-208c-4aef-8b69-2bab3e86f76f tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:45.946605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-524b750b-208c-4aef-8b69-2bab3e86f76f tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] [instance: 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:45.965365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-524b750b-208c-4aef-8b69-2bab3e86f76f tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:45.972152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-524b750b-208c-4aef-8b69-2bab3e86f76f tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:45.976938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-524b750b-208c-4aef-8b69-2bab3e86f76f tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:45.983726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-524b750b-208c-4aef-8b69-2bab3e86f76f tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:46.060073 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-524b750b-208c-4aef-8b69-2bab3e86f76f tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] HTTP exception thrown: Instance 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 could not be found. Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-524b750b-208c-4aef-8b69-2bab3e86f76f tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Request method failure captured: Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 HTTP/1.1 Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M9vJZFbxvAZOfTsBbhTequsBwOUuY3To7GksfjAQ1M2FZSzXSwI35STd1_3wnNUb8K4yQ7vdWT261EmZZOGDX-ufD8z61JGJK8ZNhkN_VgOPdyltVNlyVhCYmrJN0iMJRJ_KDSQ9LBdWgqB3riYp4PKeDFTgNbZdD-zDdRH9Ee6ebc Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Openstack-Nova-Api-Version: 2.57 Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 319151eea4f94457b7d0603065e6075d Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerShowV257Test-1579257765 Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/319151eea4f94457b7d0603065e6075d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/319151eea4f94457b7d0603065e6075d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_319151eea4f94457b7d0603065e6075d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/319151eea4f94457b7d0603065e6075d"}]}] Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerShowV257Test-1579257765 Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 319151eea4f94457b7d0603065e6075d Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerShowV257Test-1579257765 Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerShowV257Test-1579257765-project Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 04dbb2ed43ed4ec88ecab768d5be11dd Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerShowV257Test-1579257765-project Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 could not be found. Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6'} Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 could not be found. Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 could not be found. Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:17:46.070061 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:46.074286 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:17:46.074286 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:17:46.074286 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:17:46.074286 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:17:46.074286 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:17:46.074286 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 could not be found. Aug 02 07:17:46.074286 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:17:46.081643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-524b750b-208c-4aef-8b69-2bab3e86f76f tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] Returning 404 to user: Instance 1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:17:46.082760 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-524b750b-208c-4aef-8b69-2bab3e86f76f tempest-ServerShowV257Test-1579257765 tempest-ServerShowV257Test-1579257765-project] 10.222.0.79 "GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6" status: 404 len: 111 microversion: 2.57 time: 0.142439 Aug 02 07:17:46.089560 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2885/5842] 10.222.0.79 () {60 vars in 1277 bytes} [Tue Aug 2 07:17:45 2022] GET /compute/v2.1/servers/1b6965b5-c5fe-4ed3-85bb-f22f85bb5ec6 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:17:46.159642 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9cb76157-0cec-4e49-b042-afcb4f5c5cf3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:46.160993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9cb76157-0cec-4e49-b042-afcb4f5c5cf3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:46.178830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cb76157-0cec-4e49-b042-afcb4f5c5cf3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:46.181609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cb76157-0cec-4e49-b042-afcb4f5c5cf3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:46.182676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cb76157-0cec-4e49-b042-afcb4f5c5cf3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:46.186804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cb76157-0cec-4e49-b042-afcb4f5c5cf3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:46.946499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9cb76157-0cec-4e49-b042-afcb4f5c5cf3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:46.958813 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9cb76157-0cec-4e49-b042-afcb4f5c5cf3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1527 microversion: 2.1 time: 0.803316 Aug 02 07:17:46.959432 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2958/5843] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:46 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1527 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:47.988296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0fb855b5-ed2c-4e45-93c2-bea43e438314 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:47.989779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0fb855b5-ed2c-4e45-93c2-bea43e438314 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:48.000941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:17:48.005958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fb855b5-ed2c-4e45-93c2-bea43e438314 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:48.009658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fb855b5-ed2c-4e45-93c2-bea43e438314 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:48.010780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fb855b5-ed2c-4e45-93c2-bea43e438314 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:48.012628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fb855b5-ed2c-4e45-93c2-bea43e438314 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:48.651082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0fb855b5-ed2c-4e45-93c2-bea43e438314 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:48.664710 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0fb855b5-ed2c-4e45-93c2-bea43e438314 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1527 microversion: 2.1 time: 0.688839 Aug 02 07:17:48.665992 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2886/5844] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:47 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1527 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:49.688287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cbdb7e69-9469-4b3d-bb70-395b9ee1a456 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:49.689117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cbdb7e69-9469-4b3d-bb70-395b9ee1a456 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:49.704170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbdb7e69-9469-4b3d-bb70-395b9ee1a456 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:49.711192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbdb7e69-9469-4b3d-bb70-395b9ee1a456 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:49.712448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbdb7e69-9469-4b3d-bb70-395b9ee1a456 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:49.719891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cbdb7e69-9469-4b3d-bb70-395b9ee1a456 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:50.728582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0fb855b5-ed2c-4e45-93c2-bea43e438314 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:50.732421 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0fb855b5-ed2c-4e45-93c2-bea43e438314 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004396 Aug 02 07:17:50.733336 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2887/5845] 10.222.0.79 () {56 vars in 886 bytes} [Tue Aug 2 07:17:50 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 02 07:17:51.171318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cbdb7e69-9469-4b3d-bb70-395b9ee1a456 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:51.188290 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cbdb7e69-9469-4b3d-bb70-395b9ee1a456 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1527 microversion: 2.1 time: 1.502881 Aug 02 07:17:51.189138 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2959/5846] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:49 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1527 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:52.211891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-16fffe3b-d34c-4a17-8e22-7f01593cf985 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:52.213265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-16fffe3b-d34c-4a17-8e22-7f01593cf985 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:52.221815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16fffe3b-d34c-4a17-8e22-7f01593cf985 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:52.222599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16fffe3b-d34c-4a17-8e22-7f01593cf985 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:52.223750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16fffe3b-d34c-4a17-8e22-7f01593cf985 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:52.224395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-16fffe3b-d34c-4a17-8e22-7f01593cf985 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:52.779902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-16fffe3b-d34c-4a17-8e22-7f01593cf985 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:52.793673 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-16fffe3b-d34c-4a17-8e22-7f01593cf985 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1527 microversion: 2.1 time: 0.586031 Aug 02 07:17:52.818382 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2888/5847] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:52 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1527 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:53.815841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-381c2439-14ef-4cd8-b3d5-de10d80ab375 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:53.816609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-381c2439-14ef-4cd8-b3d5-de10d80ab375 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:53.838476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-381c2439-14ef-4cd8-b3d5-de10d80ab375 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:53.838927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-381c2439-14ef-4cd8-b3d5-de10d80ab375 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:53.839725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-381c2439-14ef-4cd8-b3d5-de10d80ab375 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:53.840165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-381c2439-14ef-4cd8-b3d5-de10d80ab375 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:54.317011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-381c2439-14ef-4cd8-b3d5-de10d80ab375 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:54.330556 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-381c2439-14ef-4cd8-b3d5-de10d80ab375 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1527 microversion: 2.1 time: 0.518703 Aug 02 07:17:54.344567 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2960/5848] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:53 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1527 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:55.281003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-87e25028-3b8f-4c17-bd6a-936797966dc2 tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] Action: 'create', calling method: .version_select at 0x7f927af905e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-818921053", "metadata": {"Type": "work"}}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:17:55.356724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-779a3fbb-faf9-4a3f-b722-8c5be6a7d793 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:55.365290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-779a3fbb-faf9-4a3f-b722-8c5be6a7d793 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:55.410042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-779a3fbb-faf9-4a3f-b722-8c5be6a7d793 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:55.419350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-779a3fbb-faf9-4a3f-b722-8c5be6a7d793 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:55.426342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-779a3fbb-faf9-4a3f-b722-8c5be6a7d793 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:55.434947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-779a3fbb-faf9-4a3f-b722-8c5be6a7d793 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:56.025378 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-87e25028-3b8f-4c17-bd6a-936797966dc2 tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.202351 Aug 02 07:17:56.040712 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2889/5849] 10.222.0.79 () {60 vars in 1156 bytes} [Tue Aug 2 07:17:54 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1210 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 02 07:17:56.064087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-19007dda-858e-4354-8df2-672d8d2773a5 tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] Calling method '.version_select at 0x7f927ae3e430>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:56.180701 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-19007dda-858e-4354-8df2-672d8d2773a5 tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32" status: 200 len: 352 microversion: 2.1 time: 0.132194 Aug 02 07:17:56.182085 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2890/5850] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:17:56 2022] GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32 => generated 352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:17:56.278841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-779a3fbb-faf9-4a3f-b722-8c5be6a7d793 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:56.294528 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-779a3fbb-faf9-4a3f-b722-8c5be6a7d793 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1527 microversion: 2.1 time: 0.944542 Aug 02 07:17:56.310381 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2961/5851] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:55 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1527 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:57.197354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7319b3fa-63ea-403d-987f-5ae85386d868 tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] Calling method '.version_select at 0x7f927abd6790>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:57.308757 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7319b3fa-63ea-403d-987f-5ae85386d868 tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32" status: 200 len: 352 microversion: 2.1 time: 0.117043 Aug 02 07:17:57.309272 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2891/5852] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:17:57 2022] GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:17:57.317660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-13d193ce-2605-4fa1-ad17-a468ee33aa52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:57.318372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-13d193ce-2605-4fa1-ad17-a468ee33aa52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:57.336492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13d193ce-2605-4fa1-ad17-a468ee33aa52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:57.340618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13d193ce-2605-4fa1-ad17-a468ee33aa52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:57.348560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13d193ce-2605-4fa1-ad17-a468ee33aa52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:57.349058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-13d193ce-2605-4fa1-ad17-a468ee33aa52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:57.650642 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-13d193ce-2605-4fa1-ad17-a468ee33aa52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:57.665462 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-13d193ce-2605-4fa1-ad17-a468ee33aa52 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1509 microversion: 2.1 time: 0.351798 Aug 02 07:17:57.668628 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2962/5853] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:57 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1509 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:58.326266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-21355d20-4b50-4d5f-bee5-a628660349da tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] Calling method '.version_select at 0x7f927abd6160>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:58.435113 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-21355d20-4b50-4d5f-bee5-a628660349da tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32" status: 200 len: 353 microversion: 2.1 time: 0.115908 Aug 02 07:17:58.449077 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2892/5854] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:17:58 2022] GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:17:58.451218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-965d3d75-fefe-4ee0-8d8e-223f65e7678c tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] Calling method '.version_select at 0x7f9279e21dc0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:58.514389 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-965d3d75-fefe-4ee0-8d8e-223f65e7678c tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32" status: 200 len: 353 microversion: 2.1 time: 0.068769 Aug 02 07:17:58.514915 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2963/5855] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:17:58 2022] GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32 => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:17:58.533529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2399976c-cd35-497d-a551-60306a154d65 tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] Calling method '.version_select at 0x7f927ab3c280>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:58.613626 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2399976c-cd35-497d-a551-60306a154d65 tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32" status: 202 len: 0 microversion: 2.1 time: 0.087149 Aug 02 07:17:58.614226 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2893/5856] 10.222.0.79 () {58 vars in 1248 bytes} [Tue Aug 2 07:17:58 2022] DELETE /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:17:58.625199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c6dac925-2bb0-48b7-9edb-d3eb4a2c94cf tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] Calling method '.version_select at 0x7f927a4df670>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:58.691405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7181e3e2-0428-40c5-a35e-d799fae480d7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:58.692212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7181e3e2-0428-40c5-a35e-d799fae480d7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:17:58.704503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7181e3e2-0428-40c5-a35e-d799fae480d7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:58.704633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7181e3e2-0428-40c5-a35e-d799fae480d7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:58.705424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7181e3e2-0428-40c5-a35e-d799fae480d7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:17:58.710562 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c6dac925-2bb0-48b7-9edb-d3eb4a2c94cf tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32" status: 200 len: 352 microversion: 2.1 time: 0.089242 Aug 02 07:17:58.711396 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2964/5857] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:17:58 2022] GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32 => generated 352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:17:58.712671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7181e3e2-0428-40c5-a35e-d799fae480d7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:17:59.046630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7181e3e2-0428-40c5-a35e-d799fae480d7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:17:59.066503 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7181e3e2-0428-40c5-a35e-d799fae480d7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1509 microversion: 2.1 time: 0.380529 Aug 02 07:17:59.067395 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2894/5858] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:17:58 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1509 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:17:59.729120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-951c4330-6929-484a-9f8e-119c7e1ca790 tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] Calling method '.version_select at 0x7f9279e1fca0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:17:59.830059 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-951c4330-6929-484a-9f8e-119c7e1ca790 tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32" status: 200 len: 352 microversion: 2.1 time: 0.108741 Aug 02 07:17:59.831214 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2965/5859] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:17:59 2022] GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:18:00.088310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ece5d04-fcbb-4128-9198-bac7efaa1878 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:00.089591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ece5d04-fcbb-4128-9198-bac7efaa1878 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:00.104328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ece5d04-fcbb-4128-9198-bac7efaa1878 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:00.110241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ece5d04-fcbb-4128-9198-bac7efaa1878 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:00.111126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ece5d04-fcbb-4128-9198-bac7efaa1878 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:00.111581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ece5d04-fcbb-4128-9198-bac7efaa1878 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:00.527600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ece5d04-fcbb-4128-9198-bac7efaa1878 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:00.537562 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ece5d04-fcbb-4128-9198-bac7efaa1878 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1509 microversion: 2.1 time: 0.453110 Aug 02 07:18:00.553831 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2895/5860] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:00 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:00.855544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-21068d9f-304b-4f1a-bd3c-53ba5f7a10d4 tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] Calling method '.version_select at 0x7f927a60daf0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:01.034962 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-21068d9f-304b-4f1a-bd3c-53ba5f7a10d4 tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32" status: 200 len: 352 microversion: 2.1 time: 0.194573 Aug 02 07:18:01.035708 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2966/5861] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:18:00 2022] GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32 => generated 352 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:18:01.289095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-21ca3df6-a862-4e2f-9fe6-67fcf4a9f1fb req-dcc0223a-59af-43f2-b764-732b4c925ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2edf07-e6a8-472c-9d71-a0691e66b90d", "name": "network-vif-unplugged", "status": "completed", "tag": "45cd9e1c-cdfb-4648-a6ce-ee7537957267"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:01.321205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-21ca3df6-a862-4e2f-9fe6-67fcf4a9f1fb req-dcc0223a-59af-43f2-b764-732b4c925ad8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:01.322017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-21ca3df6-a862-4e2f-9fe6-67fcf4a9f1fb req-dcc0223a-59af-43f2-b764-732b4c925ad8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:01.342182 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-21ca3df6-a862-4e2f-9fe6-67fcf4a9f1fb req-dcc0223a-59af-43f2-b764-732b4c925ad8 service nova] Creating event network-vif-unplugged:45cd9e1c-cdfb-4648-a6ce-ee7537957267 for instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d on n-h1-851337-3 Aug 02 07:18:01.351805 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-21ca3df6-a862-4e2f-9fe6-67fcf4a9f1fb req-dcc0223a-59af-43f2-b764-732b4c925ad8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066637 Aug 02 07:18:01.353257 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2896/5862] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:18:01.577785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f6566cbb-8c65-42bf-a1e9-5d76e09a2070 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:01.578466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f6566cbb-8c65-42bf-a1e9-5d76e09a2070 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:01.580489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=44 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:18:01.595343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6566cbb-8c65-42bf-a1e9-5d76e09a2070 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:01.595802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6566cbb-8c65-42bf-a1e9-5d76e09a2070 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:01.596590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6566cbb-8c65-42bf-a1e9-5d76e09a2070 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:01.597029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6566cbb-8c65-42bf-a1e9-5d76e09a2070 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:01.947202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f6566cbb-8c65-42bf-a1e9-5d76e09a2070 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:01.958974 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f6566cbb-8c65-42bf-a1e9-5d76e09a2070 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1452 microversion: 2.1 time: 0.386016 Aug 02 07:18:01.975161 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2967/5863] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:01 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1452 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:01.991050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-63f0a08e-55f5-4134-9653-f4e8bf3d29a2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:01.991050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-63f0a08e-55f5-4134-9653-f4e8bf3d29a2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:01.997547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f0a08e-55f5-4134-9653-f4e8bf3d29a2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:01.998021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f0a08e-55f5-4134-9653-f4e8bf3d29a2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:01.998806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f0a08e-55f5-4134-9653-f4e8bf3d29a2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:01.999239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f0a08e-55f5-4134-9653-f4e8bf3d29a2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:02.055967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d7e7dfb8-d426-4278-bb90-e4e62186129c tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] Calling method '.version_select at 0x7f9279e06700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:02.131273 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-d7e7dfb8-d426-4278-bb90-e4e62186129c tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] HTTP exception thrown: Volume c7941182-98cd-4f6f-9238-a90abf0dbc32 could not be found. Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d7e7dfb8-d426-4278-bb90-e4e62186129c tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] Request method failure captured: Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32 HTTP/1.1 Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M-ibfokLBIIaVohGXGF_SF3hDAuEZlzaXAUV_4SFJqjGhDO5odn2qmYYtnjNJxjiU2QS7zD1iYZMM2SBvMitfx5l9DgETJXLplN_4uB0inA3e3vDl4LELsRJf_xLjiJVzDFcy1JClo6pSMXPRsCWPGN8P-51oPOyNJg8uqputy7Dm0 Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: f3676494df974e8780ef0baccaab94b5 Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-VolumesGetTestJSON-1677732287 Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f3676494df974e8780ef0baccaab94b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f3676494df974e8780ef0baccaab94b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f3676494df974e8780ef0baccaab94b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f3676494df974e8780ef0baccaab94b5"}]}] Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-VolumesGetTestJSON-1677732287 Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: f3676494df974e8780ef0baccaab94b5 Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-VolumesGetTestJSON-1677732287 Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-VolumesGetTestJSON-1677732287-project Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 86a418ce716c4051b8f0c3641e7cb0e6 Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-VolumesGetTestJSON-1677732287-project Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: method: Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: exception: Volume c7941182-98cd-4f6f-9238-a90abf0dbc32 could not be found. Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'c7941182-98cd-4f6f-9238-a90abf0dbc32'} Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7941182-98cd-4f6f-9238-a90abf0dbc32 could not be found. (HTTP 404) (Request-ID: req-0954abfe-ee24-4479-9969-aea304ace2a2) Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 07:18:02.133493 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7941182-98cd-4f6f-9238-a90abf0dbc32 could not be found. Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7941182-98cd-4f6f-9238-a90abf0dbc32 could not be found. Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7941182-98cd-4f6f-9238-a90abf0dbc32 could not be found. Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d7e7dfb8-d426-4278-bb90-e4e62186129c tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] Returning 404 to user: Volume c7941182-98cd-4f6f-9238-a90abf0dbc32 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:18:02.138437 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d7e7dfb8-d426-4278-bb90-e4e62186129c tempest-VolumesGetTestJSON-1677732287 tempest-VolumesGetTestJSON-1677732287-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32" status: 404 len: 109 microversion: 2.1 time: 0.083816 Aug 02 07:18:02.141329 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2968/5864] 10.222.0.79 () {58 vars in 1245 bytes} [Tue Aug 2 07:18:02 2022] GET /compute/v2.1/os-volumes/c7941182-98cd-4f6f-9238-a90abf0dbc32 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:18:02.673131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-63f0a08e-55f5-4134-9653-f4e8bf3d29a2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:02.683756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:18:02.703171 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-63f0a08e-55f5-4134-9653-f4e8bf3d29a2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1452 microversion: 2.1 time: 0.719106 Aug 02 07:18:02.727175 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2897/5865] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:01 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1452 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:02.779775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6fde0a20-fe9f-44fb-8d50-0347cf30991d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:02.780680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6fde0a20-fe9f-44fb-8d50-0347cf30991d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:02.793243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fde0a20-fe9f-44fb-8d50-0347cf30991d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:02.795836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fde0a20-fe9f-44fb-8d50-0347cf30991d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:02.798945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fde0a20-fe9f-44fb-8d50-0347cf30991d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:02.802065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fde0a20-fe9f-44fb-8d50-0347cf30991d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:02.806059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=94 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:18:02.865559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-6fde0a20-fe9f-44fb-8d50-0347cf30991d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lazy-loading 'flavor' on Instance uuid 3d2edf07-e6a8-472c-9d71-a0691e66b90d {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:18:02.898750 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-6fde0a20-fe9f-44fb-8d50-0347cf30991d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Cannot 'shelve' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state shelved_offloaded Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6fde0a20-fe9f-44fb-8d50-0347cf30991d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action HTTP/1.1 Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 14 Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: {"shelve": {}} Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: exception: Cannot 'shelve' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state shelved_offloaded Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '3d2edf07-e6a8-472c-9d71-a0691e66b90d', 'body': {'shelve': {}}} Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 02 07:18:02.902123 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state shelved_offloaded Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state shelved_offloaded Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6fde0a20-fe9f-44fb-8d50-0347cf30991d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 409 to user: Cannot 'shelve' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state shelved_offloaded {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6fde0a20-fe9f-44fb-8d50-0347cf30991d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action" status: 409 len: 155 microversion: 2.1 time: 0.130335 Aug 02 07:18:02.911384 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2969/5866] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:18:02 2022] POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action => generated 155 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:18:02.915842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8856dffd-b3a8-4ad4-9497-d3d689ee2e9a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:02.916456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8856dffd-b3a8-4ad4-9497-d3d689ee2e9a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:02.938454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8856dffd-b3a8-4ad4-9497-d3d689ee2e9a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:02.939034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8856dffd-b3a8-4ad4-9497-d3d689ee2e9a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:02.942359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8856dffd-b3a8-4ad4-9497-d3d689ee2e9a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:02.943248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8856dffd-b3a8-4ad4-9497-d3d689ee2e9a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:03.333667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8856dffd-b3a8-4ad4-9497-d3d689ee2e9a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126119) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 07:18:03.460045 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8856dffd-b3a8-4ad4-9497-d3d689ee2e9a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action" status: 202 len: 0 microversion: 2.1 time: 0.549065 Aug 02 07:18:03.461266 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2898/5867] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:18:02 2022] POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:18:03.470300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9cd7b57f-38ee-4cbb-bc12-10b50b45cd32 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:03.470909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9cd7b57f-38ee-4cbb-bc12-10b50b45cd32 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:03.488424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cd7b57f-38ee-4cbb-bc12-10b50b45cd32 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:03.493530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cd7b57f-38ee-4cbb-bc12-10b50b45cd32 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:03.495901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cd7b57f-38ee-4cbb-bc12-10b50b45cd32 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:03.499901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9cd7b57f-38ee-4cbb-bc12-10b50b45cd32 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:04.458331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9cd7b57f-38ee-4cbb-bc12-10b50b45cd32 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:04.467492 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9cd7b57f-38ee-4cbb-bc12-10b50b45cd32 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1460 microversion: 2.1 time: 1.001180 Aug 02 07:18:04.485151 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2970/5868] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:03 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1460 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:05.501126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b635a2df-a160-47f4-83eb-2aa71aee8553 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:05.504728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b635a2df-a160-47f4-83eb-2aa71aee8553 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:05.523921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b635a2df-a160-47f4-83eb-2aa71aee8553 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:05.524732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b635a2df-a160-47f4-83eb-2aa71aee8553 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:05.526996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b635a2df-a160-47f4-83eb-2aa71aee8553 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:05.527623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b635a2df-a160-47f4-83eb-2aa71aee8553 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:06.147166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b635a2df-a160-47f4-83eb-2aa71aee8553 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:06.156955 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b635a2df-a160-47f4-83eb-2aa71aee8553 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 0.671270 Aug 02 07:18:06.163133 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2899/5869] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:05 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:07.186643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c62e07cc-524d-4b79-877a-21d81de9e377 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:07.188076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c62e07cc-524d-4b79-877a-21d81de9e377 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:07.201540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c62e07cc-524d-4b79-877a-21d81de9e377 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:07.202027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c62e07cc-524d-4b79-877a-21d81de9e377 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:07.202826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c62e07cc-524d-4b79-877a-21d81de9e377 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:07.203270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c62e07cc-524d-4b79-877a-21d81de9e377 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:07.696995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c62e07cc-524d-4b79-877a-21d81de9e377 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:07.714618 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c62e07cc-524d-4b79-877a-21d81de9e377 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 0.531870 Aug 02 07:18:07.718743 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2971/5870] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:07 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:08.680270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e52b3104-2495-41ac-b1a4-fb8c80211a51 req-2233a5a4-d789-40d9-b504-71ea5c6988e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2edf07-e6a8-472c-9d71-a0691e66b90d", "tag": "45cd9e1c-cdfb-4648-a6ce-ee7537957267"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:08.703145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e52b3104-2495-41ac-b1a4-fb8c80211a51 req-2233a5a4-d789-40d9-b504-71ea5c6988e7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:08.704269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e52b3104-2495-41ac-b1a4-fb8c80211a51 req-2233a5a4-d789-40d9-b504-71ea5c6988e7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:08.728850 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e52b3104-2495-41ac-b1a4-fb8c80211a51 req-2233a5a4-d789-40d9-b504-71ea5c6988e7 service nova] Creating event network-changed:45cd9e1c-cdfb-4648-a6ce-ee7537957267 for instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d on n-h2-851337-3 Aug 02 07:18:08.745539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd41ab5d-d22a-4e81-817b-2f3580d0c8db tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:08.748474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dd41ab5d-d22a-4e81-817b-2f3580d0c8db tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:08.752874 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e52b3104-2495-41ac-b1a4-fb8c80211a51 req-2233a5a4-d789-40d9-b504-71ea5c6988e7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.442546 Aug 02 07:18:08.755079 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2900/5871] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:18:08.758707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd41ab5d-d22a-4e81-817b-2f3580d0c8db tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:08.758901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd41ab5d-d22a-4e81-817b-2f3580d0c8db tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:08.759940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd41ab5d-d22a-4e81-817b-2f3580d0c8db tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:08.760526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd41ab5d-d22a-4e81-817b-2f3580d0c8db tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:09.862296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dd41ab5d-d22a-4e81-817b-2f3580d0c8db tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:09.875561 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dd41ab5d-d22a-4e81-817b-2f3580d0c8db tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 1.133360 Aug 02 07:18:09.876727 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2972/5872] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:08 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:18:10.105878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-769e43bf-85af-4c20-b898-a6c8c26b71cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:10.110685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-769e43bf-85af-4c20-b898-a6c8c26b71cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:10.137393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-769e43bf-85af-4c20-b898-a6c8c26b71cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:10.138564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-769e43bf-85af-4c20-b898-a6c8c26b71cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:10.140246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-769e43bf-85af-4c20-b898-a6c8c26b71cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:10.140915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-769e43bf-85af-4c20-b898-a6c8c26b71cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:10.237859 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-769e43bf-85af-4c20-b898-a6c8c26b71cd tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "POST /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc/action" status: 200 len: 24573 microversion: 2.1 time: 0.135051 Aug 02 07:18:10.239839 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2901/5873] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:18:10 2022] POST /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc/action => generated 24573 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:18:10.899558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3cc217c0-8d73-421e-a53a-7aeaa8146a26 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:10.900462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3cc217c0-8d73-421e-a53a-7aeaa8146a26 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:10.918054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cc217c0-8d73-421e-a53a-7aeaa8146a26 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:10.919706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cc217c0-8d73-421e-a53a-7aeaa8146a26 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:10.922797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cc217c0-8d73-421e-a53a-7aeaa8146a26 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:10.923379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cc217c0-8d73-421e-a53a-7aeaa8146a26 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:11.798140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3cc217c0-8d73-421e-a53a-7aeaa8146a26 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:11.813572 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3cc217c0-8d73-421e-a53a-7aeaa8146a26 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 0.920498 Aug 02 07:18:11.823297 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2973/5874] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:10 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:12.841135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79067968-28d1-4302-805d-f1242762878f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:12.842633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79067968-28d1-4302-805d-f1242762878f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:12.884449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79067968-28d1-4302-805d-f1242762878f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:12.885810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79067968-28d1-4302-805d-f1242762878f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:12.891894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79067968-28d1-4302-805d-f1242762878f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:12.892837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79067968-28d1-4302-805d-f1242762878f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:13.434272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79067968-28d1-4302-805d-f1242762878f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:13.455954 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79067968-28d1-4302-805d-f1242762878f tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 0.617715 Aug 02 07:18:13.475574 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2902/5875] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:12 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:14.504228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aa2af28f-2f50-4a26-849d-04ba72819025 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:14.505108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aa2af28f-2f50-4a26-849d-04ba72819025 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:14.533484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa2af28f-2f50-4a26-849d-04ba72819025 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:14.535639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa2af28f-2f50-4a26-849d-04ba72819025 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:14.541056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa2af28f-2f50-4a26-849d-04ba72819025 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:14.545994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa2af28f-2f50-4a26-849d-04ba72819025 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:15.492715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-aa2af28f-2f50-4a26-849d-04ba72819025 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:15.505415 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aa2af28f-2f50-4a26-849d-04ba72819025 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 1.005435 Aug 02 07:18:15.509485 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2974/5876] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:14 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:16.537016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-45bbd0f5-0af4-4746-8be5-817ddf96c1f9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:16.538493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-45bbd0f5-0af4-4746-8be5-817ddf96c1f9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:16.551665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45bbd0f5-0af4-4746-8be5-817ddf96c1f9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:16.554939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45bbd0f5-0af4-4746-8be5-817ddf96c1f9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:16.559922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45bbd0f5-0af4-4746-8be5-817ddf96c1f9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:16.560935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45bbd0f5-0af4-4746-8be5-817ddf96c1f9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:17.529416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-45bbd0f5-0af4-4746-8be5-817ddf96c1f9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:17.551475 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-45bbd0f5-0af4-4746-8be5-817ddf96c1f9 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 1.016739 Aug 02 07:18:17.555513 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2903/5877] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:16 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:18.581391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-889bfbf4-3b1e-44b2-8c45-3bd1be1ba192 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:18.582277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-889bfbf4-3b1e-44b2-8c45-3bd1be1ba192 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:18.610737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-889bfbf4-3b1e-44b2-8c45-3bd1be1ba192 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:18.612576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-889bfbf4-3b1e-44b2-8c45-3bd1be1ba192 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:18.616203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-889bfbf4-3b1e-44b2-8c45-3bd1be1ba192 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:18.622226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-889bfbf4-3b1e-44b2-8c45-3bd1be1ba192 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:20.816573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-889bfbf4-3b1e-44b2-8c45-3bd1be1ba192 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:20.841912 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-889bfbf4-3b1e-44b2-8c45-3bd1be1ba192 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 2.267801 Aug 02 07:18:20.860401 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2975/5878] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:18 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 2287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:21.869753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-230cd141-f294-4437-a4eb-0a1571015a33 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:21.873368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-230cd141-f294-4437-a4eb-0a1571015a33 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:21.888220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:18:21.891851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-230cd141-f294-4437-a4eb-0a1571015a33 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:21.892939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-230cd141-f294-4437-a4eb-0a1571015a33 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:21.894371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-230cd141-f294-4437-a4eb-0a1571015a33 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:21.897018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-230cd141-f294-4437-a4eb-0a1571015a33 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:22.938955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-230cd141-f294-4437-a4eb-0a1571015a33 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:22.963811 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-230cd141-f294-4437-a4eb-0a1571015a33 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 1.083604 Aug 02 07:18:22.984828 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2904/5879] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:21 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:24.004769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3adcb5ff-0d1d-47cd-8a8a-1f52333654b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:24.011771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3adcb5ff-0d1d-47cd-8a8a-1f52333654b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:24.040139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3adcb5ff-0d1d-47cd-8a8a-1f52333654b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:24.040588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3adcb5ff-0d1d-47cd-8a8a-1f52333654b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:24.041388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3adcb5ff-0d1d-47cd-8a8a-1f52333654b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:24.041826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3adcb5ff-0d1d-47cd-8a8a-1f52333654b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:24.562313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3adcb5ff-0d1d-47cd-8a8a-1f52333654b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:24.573942 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3adcb5ff-0d1d-47cd-8a8a-1f52333654b2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 0.584708 Aug 02 07:18:24.576665 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2976/5880] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:23 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:25.598530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2e265598-571e-47a7-8914-ce85142dec86 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:25.599159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2e265598-571e-47a7-8914-ce85142dec86 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:25.615390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e265598-571e-47a7-8914-ce85142dec86 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:25.615854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e265598-571e-47a7-8914-ce85142dec86 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:25.616677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e265598-571e-47a7-8914-ce85142dec86 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:25.617124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e265598-571e-47a7-8914-ce85142dec86 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:26.082376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2e265598-571e-47a7-8914-ce85142dec86 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:26.091475 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2e265598-571e-47a7-8914-ce85142dec86 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 0.496876 Aug 02 07:18:26.092023 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2905/5881] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:25 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:27.130790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ce755edb-3d59-4377-b791-1617c9b45bfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:27.132054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ce755edb-3d59-4377-b791-1617c9b45bfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:27.152140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce755edb-3d59-4377-b791-1617c9b45bfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:27.154030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce755edb-3d59-4377-b791-1617c9b45bfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:27.158960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce755edb-3d59-4377-b791-1617c9b45bfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:27.160913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce755edb-3d59-4377-b791-1617c9b45bfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:27.586465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ce755edb-3d59-4377-b791-1617c9b45bfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:27.603569 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ce755edb-3d59-4377-b791-1617c9b45bfe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 0.479606 Aug 02 07:18:27.617545 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2977/5882] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:27 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:28.626410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d5223277-bec6-43a7-ab24-edb9166a5dba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:28.627936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d5223277-bec6-43a7-ab24-edb9166a5dba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:28.657750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5223277-bec6-43a7-ab24-edb9166a5dba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:28.664947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5223277-bec6-43a7-ab24-edb9166a5dba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:28.665806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5223277-bec6-43a7-ab24-edb9166a5dba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:28.666259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5223277-bec6-43a7-ab24-edb9166a5dba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:29.563086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d5223277-bec6-43a7-ab24-edb9166a5dba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:29.618448 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d5223277-bec6-43a7-ab24-edb9166a5dba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 0.993915 Aug 02 07:18:29.630468 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2906/5883] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:28 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:30.671220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e78262b2-e38f-4106-8181-e2ca3716dfdf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:30.672476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e78262b2-e38f-4106-8181-e2ca3716dfdf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:30.686216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e78262b2-e38f-4106-8181-e2ca3716dfdf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:30.687326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e78262b2-e38f-4106-8181-e2ca3716dfdf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:30.688283 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e78262b2-e38f-4106-8181-e2ca3716dfdf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:30.688850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e78262b2-e38f-4106-8181-e2ca3716dfdf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:31.236401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e78262b2-e38f-4106-8181-e2ca3716dfdf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:31.273392 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e78262b2-e38f-4106-8181-e2ca3716dfdf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 0.599852 Aug 02 07:18:31.274863 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2978/5884] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:30 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:32.300070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9dd3dc69-b5df-4db9-a573-751ca707f4d5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:32.301992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9dd3dc69-b5df-4db9-a573-751ca707f4d5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:32.324584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9dd3dc69-b5df-4db9-a573-751ca707f4d5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:32.336602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9dd3dc69-b5df-4db9-a573-751ca707f4d5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:32.338659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9dd3dc69-b5df-4db9-a573-751ca707f4d5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:32.339718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9dd3dc69-b5df-4db9-a573-751ca707f4d5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:32.723111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9dd3dc69-b5df-4db9-a573-751ca707f4d5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:32.733064 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9dd3dc69-b5df-4db9-a573-751ca707f4d5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 0.439829 Aug 02 07:18:32.735996 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2907/5885] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:32 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:33.761221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f78ddb3d-b50f-406c-bdc2-abce335dd6c7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:33.761845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f78ddb3d-b50f-406c-bdc2-abce335dd6c7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:33.788739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=22 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:18:33.794393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f78ddb3d-b50f-406c-bdc2-abce335dd6c7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:33.794887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f78ddb3d-b50f-406c-bdc2-abce335dd6c7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:33.799896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f78ddb3d-b50f-406c-bdc2-abce335dd6c7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:33.802811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f78ddb3d-b50f-406c-bdc2-abce335dd6c7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:33.822377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=60 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:18:34.325058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f78ddb3d-b50f-406c-bdc2-abce335dd6c7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:34.351758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-7e27b6f9-c769-47d6-b726-8e2e48d2556b req-edfce009-629f-4123-aac7-1349466f14ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2edf07-e6a8-472c-9d71-a0691e66b90d", "name": "network-vif-plugged", "status": "completed", "tag": "45cd9e1c-cdfb-4648-a6ce-ee7537957267"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:34.374589 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f78ddb3d-b50f-406c-bdc2-abce335dd6c7 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 0.618919 Aug 02 07:18:34.390596 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2979/5886] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:33 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:34.405947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7e27b6f9-c769-47d6-b726-8e2e48d2556b req-edfce009-629f-4123-aac7-1349466f14ee service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:34.406554 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7e27b6f9-c769-47d6-b726-8e2e48d2556b req-edfce009-629f-4123-aac7-1349466f14ee service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:34.443858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:18:34.448183 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-7e27b6f9-c769-47d6-b726-8e2e48d2556b req-edfce009-629f-4123-aac7-1349466f14ee service nova] Creating event network-vif-plugged:45cd9e1c-cdfb-4648-a6ce-ee7537957267 for instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d on n-h2-851337-3 Aug 02 07:18:34.465614 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-7e27b6f9-c769-47d6-b726-8e2e48d2556b req-edfce009-629f-4123-aac7-1349466f14ee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119489 Aug 02 07:18:34.470366 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2908/5887] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:18:35.399176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-283a186b-0ea6-4e0f-9dd2-1cd2de8d3a4e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:35.400420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-283a186b-0ea6-4e0f-9dd2-1cd2de8d3a4e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:35.414980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-283a186b-0ea6-4e0f-9dd2-1cd2de8d3a4e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:35.415736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-283a186b-0ea6-4e0f-9dd2-1cd2de8d3a4e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:35.417104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-283a186b-0ea6-4e0f-9dd2-1cd2de8d3a4e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:35.417571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-283a186b-0ea6-4e0f-9dd2-1cd2de8d3a4e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:35.787972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-283a186b-0ea6-4e0f-9dd2-1cd2de8d3a4e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:35.805305 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-283a186b-0ea6-4e0f-9dd2-1cd2de8d3a4e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 0.410949 Aug 02 07:18:35.820603 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2980/5888] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:35 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:36.835125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e6be5324-473f-48d6-acdb-46be85192b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:36.835895 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e6be5324-473f-48d6-acdb-46be85192b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:36.848599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6be5324-473f-48d6-acdb-46be85192b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:36.849044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6be5324-473f-48d6-acdb-46be85192b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:36.849831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6be5324-473f-48d6-acdb-46be85192b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:36.850287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e6be5324-473f-48d6-acdb-46be85192b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:37.369938 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e6be5324-473f-48d6-acdb-46be85192b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:37.382850 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e6be5324-473f-48d6-acdb-46be85192b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1518 microversion: 2.1 time: 0.554731 Aug 02 07:18:37.396848 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2909/5889] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:36 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1518 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:38.407549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-044d750c-5c24-4a8c-9567-5ae93edd61e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:38.408991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-044d750c-5c24-4a8c-9567-5ae93edd61e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:38.429512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-044d750c-5c24-4a8c-9567-5ae93edd61e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:38.430315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-044d750c-5c24-4a8c-9567-5ae93edd61e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:38.431518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-044d750c-5c24-4a8c-9567-5ae93edd61e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:38.432183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-044d750c-5c24-4a8c-9567-5ae93edd61e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:38.858878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-044d750c-5c24-4a8c-9567-5ae93edd61e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:38.870102 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-044d750c-5c24-4a8c-9567-5ae93edd61e1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.469766 Aug 02 07:18:38.872829 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2981/5890] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:38 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:38.891666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a43c7bd1-4c2f-4436-a1b2-940f86ef3993 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:38.892384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a43c7bd1-4c2f-4436-a1b2-940f86ef3993 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:38.900233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a43c7bd1-4c2f-4436-a1b2-940f86ef3993 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:38.900888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a43c7bd1-4c2f-4436-a1b2-940f86ef3993 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:38.901871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a43c7bd1-4c2f-4436-a1b2-940f86ef3993 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:38.902570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a43c7bd1-4c2f-4436-a1b2-940f86ef3993 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:39.461168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a43c7bd1-4c2f-4436-a1b2-940f86ef3993 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:39.477870 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a43c7bd1-4c2f-4436-a1b2-940f86ef3993 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.590253 Aug 02 07:18:39.478921 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2910/5891] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:38 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:39.516350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f2ca5c1-043f-41bf-ad19-ebe4f43f3dbc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:39.517629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5f2ca5c1-043f-41bf-ad19-ebe4f43f3dbc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:39.529130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f2ca5c1-043f-41bf-ad19-ebe4f43f3dbc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:39.534751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f2ca5c1-043f-41bf-ad19-ebe4f43f3dbc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:39.535718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f2ca5c1-043f-41bf-ad19-ebe4f43f3dbc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:39.536306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f2ca5c1-043f-41bf-ad19-ebe4f43f3dbc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:39.926411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5f2ca5c1-043f-41bf-ad19-ebe4f43f3dbc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:39.939862 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5f2ca5c1-043f-41bf-ad19-ebe4f43f3dbc tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.427407 Aug 02 07:18:39.940520 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2982/5892] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:39 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:39.960811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-09d61884-f068-4322-8374-444422ec52d6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:39.967594 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-09d61884-f068-4322-8374-444422ec52d6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance cb1ea9ad-c6f4-469d-9ce8-53467ed09ab7 has no mapping to a cell. Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-09d61884-f068-4322-8374-444422ec52d6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/cb1ea9ad-c6f4-469d-9ce8-53467ed09ab7/action HTTP/1.1 Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 15 Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: {"os-stop": {}} Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance cb1ea9ad-c6f4-469d-9ce8-53467ed09ab7 has no mapping to a cell. Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'cb1ea9ad-c6f4-469d-9ce8-53467ed09ab7', 'body': {'os-stop': {}}} Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance cb1ea9ad-c6f4-469d-9ce8-53467ed09ab7 has no mapping to a cell. Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:18:39.983648 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb1ea9ad-c6f4-469d-9ce8-53467ed09ab7 has no mapping to a cell. Aug 02 07:18:39.990112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:39.990112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:39.990112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:39.990112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:39.990112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:39.990112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:39.990112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:18:39.990112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:18:39.990112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb1ea9ad-c6f4-469d-9ce8-53467ed09ab7 has no mapping to a cell. Aug 02 07:18:39.990112 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:39.990112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-09d61884-f068-4322-8374-444422ec52d6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance cb1ea9ad-c6f4-469d-9ce8-53467ed09ab7 has no mapping to a cell. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:18:39.990112 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-09d61884-f068-4322-8374-444422ec52d6 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/cb1ea9ad-c6f4-469d-9ce8-53467ed09ab7/action" status: 404 len: 117 microversion: 2.1 time: 0.029672 Aug 02 07:18:39.990112 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2911/5893] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:18:39 2022] POST /compute/v2.1/servers/cb1ea9ad-c6f4-469d-9ce8-53467ed09ab7/action => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:18:40.000653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6cc44862-cfdb-4455-b09a-234b834d4656 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:40.001710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6cc44862-cfdb-4455-b09a-234b834d4656 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:40.011204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6cc44862-cfdb-4455-b09a-234b834d4656 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:40.011676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6cc44862-cfdb-4455-b09a-234b834d4656 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:40.012742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6cc44862-cfdb-4455-b09a-234b834d4656 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:40.013250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6cc44862-cfdb-4455-b09a-234b834d4656 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:40.345967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6cc44862-cfdb-4455-b09a-234b834d4656 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:40.362580 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6cc44862-cfdb-4455-b09a-234b834d4656 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.369052 Aug 02 07:18:40.374688 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2983/5894] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:39 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:40.386757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d81c9afc-218d-4573-91be-4e6c630840ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:40.388012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d81c9afc-218d-4573-91be-4e6c630840ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:40.402270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d81c9afc-218d-4573-91be-4e6c630840ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:40.402838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d81c9afc-218d-4573-91be-4e6c630840ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:40.404794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d81c9afc-218d-4573-91be-4e6c630840ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:40.408937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d81c9afc-218d-4573-91be-4e6c630840ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:40.676008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d81c9afc-218d-4573-91be-4e6c630840ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:40.689829 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d81c9afc-218d-4573-91be-4e6c630840ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.307758 Aug 02 07:18:40.702371 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2912/5895] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:40 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:40.711452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43c7a4e2-93ff-493d-8fe0-636f2bfa17e0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:40.712798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-43c7a4e2-93ff-493d-8fe0-636f2bfa17e0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: de9e0dac-53cf-48a9-a0ba-ad49c407ee89] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:40.721059 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-43c7a4e2-93ff-493d-8fe0-636f2bfa17e0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance de9e0dac-53cf-48a9-a0ba-ad49c407ee89 could not be found. Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43c7a4e2-93ff-493d-8fe0-636f2bfa17e0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/de9e0dac-53cf-48a9-a0ba-ad49c407ee89/action HTTP/1.1 Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 15 Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: {"suspend": {}} Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance de9e0dac-53cf-48a9-a0ba-ad49c407ee89 could not be found. Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'de9e0dac-53cf-48a9-a0ba-ad49c407ee89', 'body': {'suspend': {}}} Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9e0dac-53cf-48a9-a0ba-ad49c407ee89 could not be found. Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9e0dac-53cf-48a9-a0ba-ad49c407ee89 could not be found. Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:40.722895 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:40.727557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:18:40.727557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:18:40.727557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9e0dac-53cf-48a9-a0ba-ad49c407ee89 could not be found. Aug 02 07:18:40.727557 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:40.730260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43c7a4e2-93ff-493d-8fe0-636f2bfa17e0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance de9e0dac-53cf-48a9-a0ba-ad49c407ee89 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:18:40.731479 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43c7a4e2-93ff-493d-8fe0-636f2bfa17e0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/de9e0dac-53cf-48a9-a0ba-ad49c407ee89/action" status: 404 len: 111 microversion: 2.1 time: 0.024628 Aug 02 07:18:40.732321 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2984/5896] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:18:40 2022] POST /compute/v2.1/servers/de9e0dac-53cf-48a9-a0ba-ad49c407ee89/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:18:40.741093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6dcd466b-5904-436c-b5cb-5ee6042e9dfd tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:40.742177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6dcd466b-5904-436c-b5cb-5ee6042e9dfd tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:40.749341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6dcd466b-5904-436c-b5cb-5ee6042e9dfd tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:40.750359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6dcd466b-5904-436c-b5cb-5ee6042e9dfd tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:40.751904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6dcd466b-5904-436c-b5cb-5ee6042e9dfd tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:40.752574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6dcd466b-5904-436c-b5cb-5ee6042e9dfd tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:40.955493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6dcd466b-5904-436c-b5cb-5ee6042e9dfd tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:40.965385 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6dcd466b-5904-436c-b5cb-5ee6042e9dfd tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.227830 Aug 02 07:18:40.967235 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2913/5897] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:40 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:40.990438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c4cbd5a6-7588-47e5-9435-84084e2ef4bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:40.991309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c4cbd5a6-7588-47e5-9435-84084e2ef4bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:41.017561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4cbd5a6-7588-47e5-9435-84084e2ef4bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:41.020876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4cbd5a6-7588-47e5-9435-84084e2ef4bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:41.022398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4cbd5a6-7588-47e5-9435-84084e2ef4bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:41.024314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c4cbd5a6-7588-47e5-9435-84084e2ef4bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:41.266920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c4cbd5a6-7588-47e5-9435-84084e2ef4bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:41.294052 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c4cbd5a6-7588-47e5-9435-84084e2ef4bf tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.309000 Aug 02 07:18:41.294674 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2985/5898] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:40 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:41.320149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b5c7e3ba-4efe-4146-8646-a0092029dea4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:41.322046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b5c7e3ba-4efe-4146-8646-a0092029dea4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:41.334492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5c7e3ba-4efe-4146-8646-a0092029dea4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:41.334793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5c7e3ba-4efe-4146-8646-a0092029dea4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:41.339547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5c7e3ba-4efe-4146-8646-a0092029dea4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:41.340014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b5c7e3ba-4efe-4146-8646-a0092029dea4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:41.394682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-b5c7e3ba-4efe-4146-8646-a0092029dea4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lazy-loading 'flavor' on Instance uuid 3d2edf07-e6a8-472c-9d71-a0691e66b90d {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:18:41.577265 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b5c7e3ba-4efe-4146-8646-a0092029dea4 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action" status: 202 len: 0 microversion: 2.1 time: 0.261819 Aug 02 07:18:41.579059 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2914/5899] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:18:41 2022] POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:18:41.599192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-74a6b820-e388-4b63-becc-8d901c15f346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:41.600096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-74a6b820-e388-4b63-becc-8d901c15f346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:41.617741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74a6b820-e388-4b63-becc-8d901c15f346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:41.620705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74a6b820-e388-4b63-becc-8d901c15f346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:41.625540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74a6b820-e388-4b63-becc-8d901c15f346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:41.626331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74a6b820-e388-4b63-becc-8d901c15f346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:42.024335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-74a6b820-e388-4b63-becc-8d901c15f346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:42.045311 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-74a6b820-e388-4b63-becc-8d901c15f346 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1513 microversion: 2.1 time: 0.461464 Aug 02 07:18:42.047954 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2986/5900] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:41 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1513 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:43.069950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d99ec6a3-8c10-4950-a41d-fd0054b61cc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:43.070782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d99ec6a3-8c10-4950-a41d-fd0054b61cc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:43.078468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d99ec6a3-8c10-4950-a41d-fd0054b61cc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:43.079415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d99ec6a3-8c10-4950-a41d-fd0054b61cc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:43.080616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d99ec6a3-8c10-4950-a41d-fd0054b61cc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:43.081328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d99ec6a3-8c10-4950-a41d-fd0054b61cc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:43.632277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d99ec6a3-8c10-4950-a41d-fd0054b61cc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:43.644263 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d99ec6a3-8c10-4950-a41d-fd0054b61cc2 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1496 microversion: 2.1 time: 0.578862 Aug 02 07:18:43.662873 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2915/5901] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:43 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1496 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:43.672512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-105e6d73-0c1f-4e31-842e-0fad18ee3330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:43.673039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-105e6d73-0c1f-4e31-842e-0fad18ee3330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:43.687040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-105e6d73-0c1f-4e31-842e-0fad18ee3330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:43.687910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-105e6d73-0c1f-4e31-842e-0fad18ee3330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:43.696352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-105e6d73-0c1f-4e31-842e-0fad18ee3330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:43.697825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-105e6d73-0c1f-4e31-842e-0fad18ee3330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:43.729513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-105e6d73-0c1f-4e31-842e-0fad18ee3330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lazy-loading 'flavor' on Instance uuid 3d2edf07-e6a8-472c-9d71-a0691e66b90d {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:18:43.746227 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-105e6d73-0c1f-4e31-842e-0fad18ee3330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Cannot 'suspend' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state suspended Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-105e6d73-0c1f-4e31-842e-0fad18ee3330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action HTTP/1.1 Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 15 Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: {"suspend": {}} Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: exception: Cannot 'suspend' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state suspended Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '3d2edf07-e6a8-472c-9d71-a0691e66b90d', 'body': {'suspend': {}}} Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d in vm_state suspended. Cannot suspend while the instance is in this state. Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 02 07:18:43.750238 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 07:18:43.754407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 07:18:43.754407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 07:18:43.754407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state suspended Aug 02 07:18:43.754407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:43.754407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:43.754407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:43.754407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:43.754407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:43.754407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:43.754407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:18:43.754407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:18:43.754407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state suspended Aug 02 07:18:43.754407 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:43.758721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-105e6d73-0c1f-4e31-842e-0fad18ee3330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 409 to user: Cannot 'suspend' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state suspended {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:18:43.759883 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-105e6d73-0c1f-4e31-842e-0fad18ee3330 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action" status: 409 len: 148 microversion: 2.1 time: 0.091415 Aug 02 07:18:43.764265 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2987/5902] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:18:43 2022] POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action => generated 148 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 02 07:18:43.770578 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b2fdd0ad-693b-46d3-81a4-54876fccc21e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:43.772110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b2fdd0ad-693b-46d3-81a4-54876fccc21e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:43.782134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2fdd0ad-693b-46d3-81a4-54876fccc21e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:43.782914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2fdd0ad-693b-46d3-81a4-54876fccc21e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:43.784905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2fdd0ad-693b-46d3-81a4-54876fccc21e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:43.785310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2fdd0ad-693b-46d3-81a4-54876fccc21e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:43.896646 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b2fdd0ad-693b-46d3-81a4-54876fccc21e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action" status: 202 len: 0 microversion: 2.1 time: 0.130082 Aug 02 07:18:43.897386 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2916/5903] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:18:43 2022] POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:18:43.906978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0232ce67-6874-4204-9d9f-b85537172951 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:43.907985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0232ce67-6874-4204-9d9f-b85537172951 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:43.919441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0232ce67-6874-4204-9d9f-b85537172951 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:43.919899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0232ce67-6874-4204-9d9f-b85537172951 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:43.922805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0232ce67-6874-4204-9d9f-b85537172951 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:43.923265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0232ce67-6874-4204-9d9f-b85537172951 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:45.111029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0232ce67-6874-4204-9d9f-b85537172951 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:45.123569 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0232ce67-6874-4204-9d9f-b85537172951 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1502 microversion: 2.1 time: 1.220091 Aug 02 07:18:45.125796 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2988/5904] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:43 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1502 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:46.157352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c63c32b9-6279-44d3-b068-1bb128c78c61 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:46.158851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c63c32b9-6279-44d3-b068-1bb128c78c61 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:46.182295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c63c32b9-6279-44d3-b068-1bb128c78c61 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:46.186660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c63c32b9-6279-44d3-b068-1bb128c78c61 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:46.191042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c63c32b9-6279-44d3-b068-1bb128c78c61 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:46.191753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c63c32b9-6279-44d3-b068-1bb128c78c61 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:47.051551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c63c32b9-6279-44d3-b068-1bb128c78c61 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:47.071258 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c63c32b9-6279-44d3-b068-1bb128c78c61 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1502 microversion: 2.1 time: 0.920159 Aug 02 07:18:47.073730 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2917/5905] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:46 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1502 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:48.095871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f72813fd-5340-44c8-9d7f-36ed71f0a8c3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:48.101849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f72813fd-5340-44c8-9d7f-36ed71f0a8c3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:48.111432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f72813fd-5340-44c8-9d7f-36ed71f0a8c3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:48.112145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f72813fd-5340-44c8-9d7f-36ed71f0a8c3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:48.113554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f72813fd-5340-44c8-9d7f-36ed71f0a8c3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:48.115677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f72813fd-5340-44c8-9d7f-36ed71f0a8c3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:48.390332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f72813fd-5340-44c8-9d7f-36ed71f0a8c3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:48.410213 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f72813fd-5340-44c8-9d7f-36ed71f0a8c3 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.311283 Aug 02 07:18:48.411686 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2989/5906] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:48 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:48.439305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9b2d8483-d5a5-406c-824d-9d33995646ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:48.439930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9b2d8483-d5a5-406c-824d-9d33995646ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:48.463216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b2d8483-d5a5-406c-824d-9d33995646ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:48.464019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b2d8483-d5a5-406c-824d-9d33995646ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:48.465281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b2d8483-d5a5-406c-824d-9d33995646ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:48.466003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b2d8483-d5a5-406c-824d-9d33995646ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:48.978685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9b2d8483-d5a5-406c-824d-9d33995646ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:48.990050 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9b2d8483-d5a5-406c-824d-9d33995646ce tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.554586 Aug 02 07:18:48.990711 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2918/5907] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:48 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:49.021224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-646429b8-48a0-48cf-8119-351610dc5c38 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:49.021999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-646429b8-48a0-48cf-8119-351610dc5c38 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 5d3304db-bf84-470d-becf-992d420db0fd] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:49.031364 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-646429b8-48a0-48cf-8119-351610dc5c38 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance 5d3304db-bf84-470d-becf-992d420db0fd could not be found. Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-646429b8-48a0-48cf-8119-351610dc5c38 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/5d3304db-bf84-470d-becf-992d420db0fd/action HTTP/1.1 Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 15 Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: {"unpause": {}} Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 5d3304db-bf84-470d-becf-992d420db0fd could not be found. Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '5d3304db-bf84-470d-becf-992d420db0fd', 'body': {'unpause': {}}} Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d3304db-bf84-470d-becf-992d420db0fd could not be found. Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d3304db-bf84-470d-becf-992d420db0fd could not be found. Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:49.033686 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:49.040722 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:18:49.040722 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:18:49.040722 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d3304db-bf84-470d-becf-992d420db0fd could not be found. Aug 02 07:18:49.040722 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:49.040722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-646429b8-48a0-48cf-8119-351610dc5c38 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance 5d3304db-bf84-470d-becf-992d420db0fd could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:18:49.040722 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-646429b8-48a0-48cf-8119-351610dc5c38 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/5d3304db-bf84-470d-becf-992d420db0fd/action" status: 404 len: 111 microversion: 2.1 time: 0.026969 Aug 02 07:18:49.040722 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2990/5908] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:18:49 2022] POST /compute/v2.1/servers/5d3304db-bf84-470d-becf-992d420db0fd/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:18:49.048558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-48195caa-0c7c-4dfb-a014-c27a1a5aa91b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:49.049258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-48195caa-0c7c-4dfb-a014-c27a1a5aa91b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:49.061053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48195caa-0c7c-4dfb-a014-c27a1a5aa91b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:49.062959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48195caa-0c7c-4dfb-a014-c27a1a5aa91b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:49.064499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48195caa-0c7c-4dfb-a014-c27a1a5aa91b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:49.065940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48195caa-0c7c-4dfb-a014-c27a1a5aa91b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:49.629476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-48195caa-0c7c-4dfb-a014-c27a1a5aa91b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:49.651425 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-48195caa-0c7c-4dfb-a014-c27a1a5aa91b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.607528 Aug 02 07:18:49.659772 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2919/5909] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:49 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:49.687164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-77187db4-6a3f-48d0-a32a-7c73a402d9b1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:49.687975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-77187db4-6a3f-48d0-a32a-7c73a402d9b1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:49.701567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77187db4-6a3f-48d0-a32a-7c73a402d9b1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:49.703022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77187db4-6a3f-48d0-a32a-7c73a402d9b1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:49.704108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77187db4-6a3f-48d0-a32a-7c73a402d9b1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:49.705077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-77187db4-6a3f-48d0-a32a-7c73a402d9b1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:50.179241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-77187db4-6a3f-48d0-a32a-7c73a402d9b1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:50.187853 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-77187db4-6a3f-48d0-a32a-7c73a402d9b1 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.505964 Aug 02 07:18:50.191817 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2991/5910] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:49 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:50.219081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-13f72f89-80dc-4b9f-bd15-62b2e61f536b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:50.219819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-13f72f89-80dc-4b9f-bd15-62b2e61f536b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:50.250375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13f72f89-80dc-4b9f-bd15-62b2e61f536b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:50.251018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13f72f89-80dc-4b9f-bd15-62b2e61f536b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:50.252631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13f72f89-80dc-4b9f-bd15-62b2e61f536b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:50.254321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-13f72f89-80dc-4b9f-bd15-62b2e61f536b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-13f72f89-80dc-4b9f-bd15-62b2e61f536b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Cannot 'unpause' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-13f72f89-80dc-4b9f-bd15-62b2e61f536b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action HTTP/1.1 Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 15 Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: {"unpause": {}} Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: exception: Cannot 'unpause' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '3d2edf07-e6a8-472c-9d71-a0691e66b90d', 'body': {'unpause': {}}} Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d in vm_state active. Cannot unpause while the instance is in this state. Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:18:50.350071 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:50.356707 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:50.356707 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:50.356707 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:50.356707 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:50.356707 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:50.356707 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:18:50.356707 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:18:50.356707 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:18:50.356707 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:50.356707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-13f72f89-80dc-4b9f-bd15-62b2e61f536b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 409 to user: Cannot 'unpause' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:18:50.367869 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-13f72f89-80dc-4b9f-bd15-62b2e61f536b tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action" status: 409 len: 145 microversion: 2.1 time: 0.155600 Aug 02 07:18:50.368522 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2920/5911] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:18:50 2022] POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action => generated 145 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:18:50.383842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-167c5fcd-1797-4e54-a2ea-a0e3ad3d6577 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:50.386222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-167c5fcd-1797-4e54-a2ea-a0e3ad3d6577 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:50.400056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-167c5fcd-1797-4e54-a2ea-a0e3ad3d6577 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:50.402464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-167c5fcd-1797-4e54-a2ea-a0e3ad3d6577 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:50.403912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-167c5fcd-1797-4e54-a2ea-a0e3ad3d6577 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:50.406381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-167c5fcd-1797-4e54-a2ea-a0e3ad3d6577 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:51.082191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-167c5fcd-1797-4e54-a2ea-a0e3ad3d6577 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:51.096098 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-167c5fcd-1797-4e54-a2ea-a0e3ad3d6577 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.722173 Aug 02 07:18:51.096692 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2992/5912] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:50 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:51.121086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3995bb89-e755-4d32-b1ad-e947182102fe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:51.122722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3995bb89-e755-4d32-b1ad-e947182102fe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:51.132473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3995bb89-e755-4d32-b1ad-e947182102fe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:51.141834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3995bb89-e755-4d32-b1ad-e947182102fe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:51.142907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3995bb89-e755-4d32-b1ad-e947182102fe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:51.143350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3995bb89-e755-4d32-b1ad-e947182102fe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:51.537598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3995bb89-e755-4d32-b1ad-e947182102fe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:51.572124 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3995bb89-e755-4d32-b1ad-e947182102fe tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.454787 Aug 02 07:18:51.572626 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2921/5913] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:51 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:51.604140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-68b3046e-83fe-42db-9d92-72d448491e14 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:51.605501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-68b3046e-83fe-42db-9d92-72d448491e14 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 604a4823-1dc0-43ec-9fb6-11ce9d869a6a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:51.613536 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-68b3046e-83fe-42db-9d92-72d448491e14 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance 604a4823-1dc0-43ec-9fb6-11ce9d869a6a could not be found. Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-68b3046e-83fe-42db-9d92-72d448491e14 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/604a4823-1dc0-43ec-9fb6-11ce9d869a6a/action HTTP/1.1 Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 18 Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: {"unshelve": null} Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 604a4823-1dc0-43ec-9fb6-11ce9d869a6a could not be found. Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '604a4823-1dc0-43ec-9fb6-11ce9d869a6a', 'body': {'unshelve': None}} Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604a4823-1dc0-43ec-9fb6-11ce9d869a6a could not be found. Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604a4823-1dc0-43ec-9fb6-11ce9d869a6a could not be found. Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:51.616133 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:51.620511 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:51.620511 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:51.620511 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:51.620511 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:51.620511 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:18:51.620511 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:18:51.620511 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604a4823-1dc0-43ec-9fb6-11ce9d869a6a could not be found. Aug 02 07:18:51.620511 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:51.623319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-68b3046e-83fe-42db-9d92-72d448491e14 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance 604a4823-1dc0-43ec-9fb6-11ce9d869a6a could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:18:51.624504 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-68b3046e-83fe-42db-9d92-72d448491e14 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/604a4823-1dc0-43ec-9fb6-11ce9d869a6a/action" status: 404 len: 111 microversion: 2.1 time: 0.034649 Aug 02 07:18:51.625695 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2993/5914] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:18:51 2022] POST /compute/v2.1/servers/604a4823-1dc0-43ec-9fb6-11ce9d869a6a/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:18:51.638650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-232bb67a-3fd6-41c0-99d8-12aa8f0f9149 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:51.640106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-232bb67a-3fd6-41c0-99d8-12aa8f0f9149 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:51.657335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-232bb67a-3fd6-41c0-99d8-12aa8f0f9149 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:51.657798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-232bb67a-3fd6-41c0-99d8-12aa8f0f9149 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:51.658657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-232bb67a-3fd6-41c0-99d8-12aa8f0f9149 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:51.659101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-232bb67a-3fd6-41c0-99d8-12aa8f0f9149 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:52.235523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-232bb67a-3fd6-41c0-99d8-12aa8f0f9149 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:52.250191 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-232bb67a-3fd6-41c0-99d8-12aa8f0f9149 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.619889 Aug 02 07:18:52.267554 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2922/5915] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:51 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:18:52.275649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f6d51862-343b-4b5e-95f3-7c68fc4cfd4a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:52.276266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f6d51862-343b-4b5e-95f3-7c68fc4cfd4a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:52.285041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6d51862-343b-4b5e-95f3-7c68fc4cfd4a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:52.285816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6d51862-343b-4b5e-95f3-7c68fc4cfd4a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:52.286800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6d51862-343b-4b5e-95f3-7c68fc4cfd4a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:52.287404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6d51862-343b-4b5e-95f3-7c68fc4cfd4a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:52.487462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f6d51862-343b-4b5e-95f3-7c68fc4cfd4a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:52.498466 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f6d51862-343b-4b5e-95f3-7c68fc4cfd4a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.226710 Aug 02 07:18:52.499381 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2994/5916] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:52 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:52.519600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b857b873-69b4-48e3-a1b9-a829ff841b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:52.520805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b857b873-69b4-48e3-a1b9-a829ff841b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:52.523132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=38 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:18:52.529855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b857b873-69b4-48e3-a1b9-a829ff841b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:52.530788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b857b873-69b4-48e3-a1b9-a829ff841b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:52.531800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b857b873-69b4-48e3-a1b9-a829ff841b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:52.532509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b857b873-69b4-48e3-a1b9-a829ff841b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:52.571682 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-b857b873-69b4-48e3-a1b9-a829ff841b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Cannot 'unshelve' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b857b873-69b4-48e3-a1b9-a829ff841b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action HTTP/1.1 Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 18 Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: {"unshelve": null} Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: exception: Cannot 'unshelve' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '3d2edf07-e6a8-472c-9d71-a0691e66b90d', 'body': {'unshelve': None}} Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d in vm_state active. Cannot unshelve while the instance is in this state. Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 07:18:52.574359 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 07:18:52.578425 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:18:52.578425 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:52.578425 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:52.578425 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:52.578425 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:52.578425 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:52.578425 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:52.578425 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:18:52.578425 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:18:52.578425 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active Aug 02 07:18:52.578425 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:52.583937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b857b873-69b4-48e3-a1b9-a829ff841b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 409 to user: Cannot 'unshelve' instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d while it is in vm_state active {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:18:52.590399 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b857b873-69b4-48e3-a1b9-a829ff841b22 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action" status: 409 len: 146 microversion: 2.1 time: 0.074372 Aug 02 07:18:52.595136 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2923/5917] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:18:52 2022] POST /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d/action => generated 146 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 07:18:52.600075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9f5712df-a4e3-44cf-80c9-1698c0c3fe75 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:52.600942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9f5712df-a4e3-44cf-80c9-1698c0c3fe75 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:52.608405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f5712df-a4e3-44cf-80c9-1698c0c3fe75 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:52.609101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f5712df-a4e3-44cf-80c9-1698c0c3fe75 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:52.610248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f5712df-a4e3-44cf-80c9-1698c0c3fe75 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:52.610873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f5712df-a4e3-44cf-80c9-1698c0c3fe75 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:52.834976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c8d39a42-364f-4d3b-92ff-e7bfe6ad8855 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:52.836345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c8d39a42-364f-4d3b-92ff-e7bfe6ad8855 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:52.846336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8d39a42-364f-4d3b-92ff-e7bfe6ad8855 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:52.847298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8d39a42-364f-4d3b-92ff-e7bfe6ad8855 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:52.848495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8d39a42-364f-4d3b-92ff-e7bfe6ad8855 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:52.849666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8d39a42-364f-4d3b-92ff-e7bfe6ad8855 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:52.875328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:18:52.891212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c8d39a42-364f-4d3b-92ff-e7bfe6ad8855 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:18:52.981695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9f5712df-a4e3-44cf-80c9-1698c0c3fe75 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:52.999551 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c8d39a42-364f-4d3b-92ff-e7bfe6ad8855 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 204 len: 0 microversion: 2.1 time: 0.170152 Aug 02 07:18:53.000600 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2924/5918] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:18:52 2022] DELETE /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 07:18:53.009219 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9f5712df-a4e3-44cf-80c9-1698c0c3fe75 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.409845 Aug 02 07:18:53.011858 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2995/5919] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:52 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:53.030043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b050a46-9b2e-4bfe-a407-2e2c07746ae5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:53.030709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6b050a46-9b2e-4bfe-a407-2e2c07746ae5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:53.044349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b050a46-9b2e-4bfe-a407-2e2c07746ae5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:53.046009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b050a46-9b2e-4bfe-a407-2e2c07746ae5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:53.046833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b050a46-9b2e-4bfe-a407-2e2c07746ae5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:53.048687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b050a46-9b2e-4bfe-a407-2e2c07746ae5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:53.289362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-371882d6-fe25-410c-83b7-cab86bc00768 req-cf98623f-c5b3-4596-b4c3-1ab12ea1e377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc", "tag": "f84ab8a1-e3d2-4d29-97b2-2cf74d942511"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:53.296352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6b050a46-9b2e-4bfe-a407-2e2c07746ae5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:53.311951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-371882d6-fe25-410c-83b7-cab86bc00768 req-cf98623f-c5b3-4596-b4c3-1ab12ea1e377 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:53.312742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-371882d6-fe25-410c-83b7-cab86bc00768 req-cf98623f-c5b3-4596-b4c3-1ab12ea1e377 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:53.322369 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6b050a46-9b2e-4bfe-a407-2e2c07746ae5 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1688 microversion: 2.1 time: 0.309001 Aug 02 07:18:53.326287 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2996/5920] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:53 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1688 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:53.336441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-069a45e9-bf63-41bf-9677-1577b75746ea tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:53.337061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-069a45e9-bf63-41bf-9677-1577b75746ea tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:53.341632 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-371882d6-fe25-410c-83b7-cab86bc00768 req-cf98623f-c5b3-4596-b4c3-1ab12ea1e377 service nova] Creating event network-changed:f84ab8a1-e3d2-4d29-97b2-2cf74d942511 for instance d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc on n-h1-851337-3 Aug 02 07:18:53.353212 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-371882d6-fe25-410c-83b7-cab86bc00768 req-cf98623f-c5b3-4596-b4c3-1ab12ea1e377 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.350366 Aug 02 07:18:53.354610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-069a45e9-bf63-41bf-9677-1577b75746ea tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:53.355556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-069a45e9-bf63-41bf-9677-1577b75746ea tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:53.355750 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2925/5921] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:18:53.356031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-069a45e9-bf63-41bf-9677-1577b75746ea tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:53.356244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-069a45e9-bf63-41bf-9677-1577b75746ea tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:53.756500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-069a45e9-bf63-41bf-9677-1577b75746ea tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:53.776891 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-069a45e9-bf63-41bf-9677-1577b75746ea tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.449103 Aug 02 07:18:53.784147 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2997/5922] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:53 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:53.850526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e0296b41-47a7-48b9-97c9-1bb72e3b855a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1366378513_updated"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:53.868597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e0296b41-47a7-48b9-97c9-1bb72e3b855a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 5a39dc93-6c6c-409f-aa93-2b4f69fe2f46] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:53.891318 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-e0296b41-47a7-48b9-97c9-1bb72e3b855a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance 5a39dc93-6c6c-409f-aa93-2b4f69fe2f46 could not be found. Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e0296b41-47a7-48b9-97c9-1bb72e3b855a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: request: PUT /compute/v2.1/servers/5a39dc93-6c6c-409f-aa93-2b4f69fe2f46 HTTP/1.1 Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 81 Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1366378513_updated"}} Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 5a39dc93-6c6c-409f-aa93-2b4f69fe2f46 could not be found. Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '5a39dc93-6c6c-409f-aa93-2b4f69fe2f46', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1366378513_updated'}}} Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a39dc93-6c6c-409f-aa93-2b4f69fe2f46 could not be found. Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 02 07:18:53.901770 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:18:53.906062 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:18:53.906062 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:18:53.906062 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:18:53.906062 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a39dc93-6c6c-409f-aa93-2b4f69fe2f46 could not be found. Aug 02 07:18:53.906062 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:53.906062 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:53.906062 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:53.906062 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:53.906062 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:53.906062 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:53.906062 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:18:53.906062 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:18:53.906062 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a39dc93-6c6c-409f-aa93-2b4f69fe2f46 could not be found. Aug 02 07:18:53.906062 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:53.910766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e0296b41-47a7-48b9-97c9-1bb72e3b855a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance 5a39dc93-6c6c-409f-aa93-2b4f69fe2f46 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:18:53.912854 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e0296b41-47a7-48b9-97c9-1bb72e3b855a tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "PUT /compute/v2.1/servers/5a39dc93-6c6c-409f-aa93-2b4f69fe2f46" status: 404 len: 111 microversion: 2.1 time: 0.090580 Aug 02 07:18:53.919841 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2926/5923] 10.222.0.79 () {60 vars in 1256 bytes} [Tue Aug 2 07:18:53 2022] PUT /compute/v2.1/servers/5a39dc93-6c6c-409f-aa93-2b4f69fe2f46 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:18:53.929591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ef495136-c693-4c1d-a30e-84c61e0e2539 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:53.930690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ef495136-c693-4c1d-a30e-84c61e0e2539 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:53.961711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef495136-c693-4c1d-a30e-84c61e0e2539 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:53.964274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef495136-c693-4c1d-a30e-84c61e0e2539 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:53.965718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef495136-c693-4c1d-a30e-84c61e0e2539 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:53.970603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef495136-c693-4c1d-a30e-84c61e0e2539 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:54.344933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1c44e13-d9b0-41ae-97e4-298b9411c1e1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:54.345642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b1c44e13-d9b0-41ae-97e4-298b9411c1e1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:54.350247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ef495136-c693-4c1d-a30e-84c61e0e2539 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:54.362257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1c44e13-d9b0-41ae-97e4-298b9411c1e1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:54.362717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:18:54.362858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1c44e13-d9b0-41ae-97e4-298b9411c1e1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:54.363616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1c44e13-d9b0-41ae-97e4-298b9411c1e1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:54.364088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1c44e13-d9b0-41ae-97e4-298b9411c1e1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:54.373729 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ef495136-c693-4c1d-a30e-84c61e0e2539 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.451822 Aug 02 07:18:54.376278 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2998/5924] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:53 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:18:54.401574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-50f74460-6071-444b-ab26-cc2a042d4683 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:54.402804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-50f74460-6071-444b-ab26-cc2a042d4683 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:54.410890 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50f74460-6071-444b-ab26-cc2a042d4683 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:54.411953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50f74460-6071-444b-ab26-cc2a042d4683 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:54.415460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50f74460-6071-444b-ab26-cc2a042d4683 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:54.416269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50f74460-6071-444b-ab26-cc2a042d4683 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:54.878024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b1c44e13-d9b0-41ae-97e4-298b9411c1e1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:54.911958 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b1c44e13-d9b0-41ae-97e4-298b9411c1e1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1688 microversion: 2.1 time: 0.570533 Aug 02 07:18:54.915029 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2927/5925] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:54 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1688 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:18:54.957829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-50f74460-6071-444b-ab26-cc2a042d4683 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:54.969216 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-50f74460-6071-444b-ab26-cc2a042d4683 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.573894 Aug 02 07:18:54.975619 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 2999/5926] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:54 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:54.999949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ac87d1f1-e9e1-4230-bbc1-defc65968693 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ac87d1f1-e9e1-4230-bbc1-defc65968693 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: request: PUT /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d HTTP/1.1 Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 280 Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '3d2edf07-e6a8-472c-9d71-a0691e66b90d', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:55.004614 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 02 07:18:55.008182 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:55.012105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ac87d1f1-e9e1-4230-bbc1-defc65968693 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:18:55.013293 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ac87d1f1-e9e1-4230-bbc1-defc65968693 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "PUT /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 400 len: 619 microversion: 2.1 time: 0.019324 Aug 02 07:18:55.024878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e885af36-d999-4bf5-a3f9-520fae37c84e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:55.024878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e885af36-d999-4bf5-a3f9-520fae37c84e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:55.025187 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2928/5927] 10.222.0.79 () {60 vars in 1257 bytes} [Tue Aug 2 07:18:54 2022] PUT /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 619 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:18:55.035604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e885af36-d999-4bf5-a3f9-520fae37c84e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:55.036070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e885af36-d999-4bf5-a3f9-520fae37c84e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:55.039280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e885af36-d999-4bf5-a3f9-520fae37c84e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:55.039745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e885af36-d999-4bf5-a3f9-520fae37c84e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:55.579173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e885af36-d999-4bf5-a3f9-520fae37c84e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:55.609658 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e885af36-d999-4bf5-a3f9-520fae37c84e tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.590078 Aug 02 07:18:55.610746 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3000/5928] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:55 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:55.640824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-abb66c1d-f71c-469f-8f9c-6f945ace15ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:55.646392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-abb66c1d-f71c-469f-8f9c-6f945ace15ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:55.657627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abb66c1d-f71c-469f-8f9c-6f945ace15ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:55.658122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abb66c1d-f71c-469f-8f9c-6f945ace15ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:55.662305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abb66c1d-f71c-469f-8f9c-6f945ace15ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:55.667184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abb66c1d-f71c-469f-8f9c-6f945ace15ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:55.900660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-abb66c1d-f71c-469f-8f9c-6f945ace15ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:55.913925 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-abb66c1d-f71c-469f-8f9c-6f945ace15ba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 0.281856 Aug 02 07:18:55.915053 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2929/5929] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:55 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:55.936244 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-45a2a38b-4808-443c-a5fa-4b2f3d528f86 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:55.937295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-45a2a38b-4808-443c-a5fa-4b2f3d528f86 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:55.938777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-66a0ccf9-ae90-4d9d-bc9c-d388848d617c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-66a0ccf9-ae90-4d9d-bc9c-d388848d617c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: request: PUT /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d HTTP/1.1 Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 24 Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: {"server": {"name": ""}} Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '3d2edf07-e6a8-472c-9d71-a0691e66b90d', 'body': {'server': {'name': ''}}} Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi '' Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:18:55.942804 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:18:55.947054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 02 07:18:55.947054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:55.947054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:55.947054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:55.947054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:55.947054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:55.947054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:55.947054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:18:55.947054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:18:55.947054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 02 07:18:55.947054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:18:55.952225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-66a0ccf9-ae90-4d9d-bc9c-d388848d617c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:18:55.953408 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-66a0ccf9-ae90-4d9d-bc9c-d388848d617c tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "PUT /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 400 len: 108 microversion: 2.1 time: 0.019321 Aug 02 07:18:55.954240 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2930/5930] 10.222.0.79 () {60 vars in 1256 bytes} [Tue Aug 2 07:18:55 2022] PUT /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 07:18:55.960591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45a2a38b-4808-443c-a5fa-4b2f3d528f86 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:55.961327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45a2a38b-4808-443c-a5fa-4b2f3d528f86 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:55.962639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45a2a38b-4808-443c-a5fa-4b2f3d528f86 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:55.964571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45a2a38b-4808-443c-a5fa-4b2f3d528f86 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:55.966950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fb0fc681-f639-4853-a9a2-512dd1292e3d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:55.967825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fb0fc681-f639-4853-a9a2-512dd1292e3d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:55.984254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb0fc681-f639-4853-a9a2-512dd1292e3d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:55.985041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb0fc681-f639-4853-a9a2-512dd1292e3d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:55.988614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb0fc681-f639-4853-a9a2-512dd1292e3d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:55.989849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fb0fc681-f639-4853-a9a2-512dd1292e3d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:56.748247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-45a2a38b-4808-443c-a5fa-4b2f3d528f86 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:56.781143 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-45a2a38b-4808-443c-a5fa-4b2f3d528f86 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1688 microversion: 2.1 time: 0.848911 Aug 02 07:18:56.784642 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3001/5931] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:55 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1688 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:18:56.955262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fb0fc681-f639-4853-a9a2-512dd1292e3d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:56.975029 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fb0fc681-f639-4853-a9a2-512dd1292e3d tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1505 microversion: 2.1 time: 1.015181 Aug 02 07:18:56.977849 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2931/5932] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:55 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1505 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:18:57.410093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-01fc3b34-8cda-49f4-8e89-78b4df1b2501 req-f6d93d61-9212-4007-89bd-d227f64c3b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc", "name": "network-vif-deleted", "tag": "f84ab8a1-e3d2-4d29-97b2-2cf74d942511"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:18:57.428998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-01fc3b34-8cda-49f4-8e89-78b4df1b2501 req-f6d93d61-9212-4007-89bd-d227f64c3b1b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:57.429410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-01fc3b34-8cda-49f4-8e89-78b4df1b2501 req-f6d93d61-9212-4007-89bd-d227f64c3b1b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:57.465602 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-01fc3b34-8cda-49f4-8e89-78b4df1b2501 req-f6d93d61-9212-4007-89bd-d227f64c3b1b service nova] Creating event network-vif-deleted:f84ab8a1-e3d2-4d29-97b2-2cf74d942511 for instance d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc on n-h1-851337-3 Aug 02 07:18:57.473043 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-01fc3b34-8cda-49f4-8e89-78b4df1b2501 req-f6d93d61-9212-4007-89bd-d227f64c3b1b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069454 Aug 02 07:18:57.474195 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3002/5933] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:18:57.806844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4b53432f-4961-40dd-85b5-1724b61392e9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:57.807567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4b53432f-4961-40dd-85b5-1724b61392e9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:57.825826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b53432f-4961-40dd-85b5-1724b61392e9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:57.827958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b53432f-4961-40dd-85b5-1724b61392e9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:57.830263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b53432f-4961-40dd-85b5-1724b61392e9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:57.831973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b53432f-4961-40dd-85b5-1724b61392e9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:57.936523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b53432f-4961-40dd-85b5-1724b61392e9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:57.942334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b53432f-4961-40dd-85b5-1724b61392e9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:57.947481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-4b53432f-4961-40dd-85b5-1724b61392e9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lazy-loading 'fault' on Instance uuid d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:18:58.069162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4b53432f-4961-40dd-85b5-1724b61392e9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a44367c6be00413eb7b6c79272448cf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa05afa69e04974ad3de049c511c674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:18:58.080337 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4b53432f-4961-40dd-85b5-1724b61392e9 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 200 len: 1356 microversion: 2.1 time: 0.277997 Aug 02 07:18:58.084003 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2932/5934] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:57 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 1356 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:18:59.107727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aadfb22b-03ca-41d3-b9a1-fc0d60d49ec1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:18:59.128103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aadfb22b-03ca-41d3-b9a1-fc0d60d49ec1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [instance: d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:18:59.157288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aadfb22b-03ca-41d3-b9a1-fc0d60d49ec1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:59.166966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aadfb22b-03ca-41d3-b9a1-fc0d60d49ec1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:59.168178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aadfb22b-03ca-41d3-b9a1-fc0d60d49ec1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:18:59.168985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aadfb22b-03ca-41d3-b9a1-fc0d60d49ec1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:18:59.215557 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-aadfb22b-03ca-41d3-b9a1-fc0d60d49ec1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] HTTP exception thrown: Instance d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc could not be found. Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aadfb22b-03ca-41d3-b9a1-fc0d60d49ec1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Request method failure captured: Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc HTTP/1.1 Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Mzd332IyHs8WEC33t3YUNz7sq1ptUIAHfE__Qv8aBPsjD5fgOPUMjL9QNhBtDeuMmcahY94wYnuhI_ZDX9lnldCseQtzbltYf6Z0vf9AbPytvHxBPNUlbLU5KkXMkrC0xu54w449QvxMiAm33sZhpVGvyWLihgN3WhItHGPM7rvGsc Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: bfa05afa69e04974ad3de049c511c674 Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1158041327 Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bfa05afa69e04974ad3de049c511c674"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bfa05afa69e04974ad3de049c511c674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bfa05afa69e04974ad3de049c511c674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bfa05afa69e04974ad3de049c511c674"}]}] Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1158041327 Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: bfa05afa69e04974ad3de049c511c674 Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1158041327 Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestNetworkAdvancedServerOps-1158041327-project Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: a44367c6be00413eb7b6c79272448cf4 Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1158041327-project Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc could not be found. Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'd6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc'} Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc could not be found. Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc could not be found. Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:59.226394 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:18:59.231492 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:59.231492 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:18:59.231492 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:18:59.231492 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:18:59.231492 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:18:59.231492 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:18:59.231492 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc could not be found. Aug 02 07:18:59.231492 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:18:59.231492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aadfb22b-03ca-41d3-b9a1-fc0d60d49ec1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Returning 404 to user: Instance d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:18:59.233219 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aadfb22b-03ca-41d3-b9a1-fc0d60d49ec1 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc" status: 404 len: 111 microversion: 2.1 time: 0.129848 Aug 02 07:18:59.250211 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3003/5935] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:18:59 2022] GET /compute/v2.1/servers/d6f52ba8-802c-4ac0-8f65-0f6f4e9a7cfc => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:19:06.342447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0bdc1b1f-1f20-4fc7-9942-8197f36c1286 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:06.343008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0bdc1b1f-1f20-4fc7-9942-8197f36c1286 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:06.358201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bdc1b1f-1f20-4fc7-9942-8197f36c1286 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:06.358647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bdc1b1f-1f20-4fc7-9942-8197f36c1286 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:06.359434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bdc1b1f-1f20-4fc7-9942-8197f36c1286 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:06.359866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0bdc1b1f-1f20-4fc7-9942-8197f36c1286 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:06.423796 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-0bdc1b1f-1f20-4fc7-9942-8197f36c1286 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0bdc1b1f-1f20-4fc7-9942-8197f36c1286 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e HTTP/1.1 Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '8b35b77a-867b-42a3-a5fa-cef71f4a2b2e'} Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:19:06.432822 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:19:06.436790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:19:06.436790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:19:06.436790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:19:06.436790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:19:06.436790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:06.436790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:19:06.436790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:19:06.436790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:19:06.436790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:19:06.436790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:19:06.436790 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:19:06.439610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0bdc1b1f-1f20-4fc7-9942-8197f36c1286 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:19:06.441162 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0bdc1b1f-1f20-4fc7-9942-8197f36c1286 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 404 len: 111 microversion: 2.1 time: 0.103008 Aug 02 07:19:06.442719 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2933/5936] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:19:06 2022] DELETE /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:19:06.451920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43a8db5b-162e-49d2-9c3c-45b90f6f0ce0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:06.453595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-43a8db5b-162e-49d2-9c3c-45b90f6f0ce0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:06.460682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=50 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:19:06.476996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43a8db5b-162e-49d2-9c3c-45b90f6f0ce0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:06.478135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43a8db5b-162e-49d2-9c3c-45b90f6f0ce0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:06.479156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43a8db5b-162e-49d2-9c3c-45b90f6f0ce0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:06.479837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43a8db5b-162e-49d2-9c3c-45b90f6f0ce0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:06.521246 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-43a8db5b-162e-49d2-9c3c-45b90f6f0ce0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43a8db5b-162e-49d2-9c3c-45b90f6f0ce0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e HTTP/1.1 Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '8b35b77a-867b-42a3-a5fa-cef71f4a2b2e'} Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:19:06.523523 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:06.527453 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:06.527453 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:19:06.527453 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:19:06.527453 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:19:06.527453 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:19:06.527453 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. Aug 02 07:19:06.527453 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:06.529489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43a8db5b-162e-49d2-9c3c-45b90f6f0ce0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance 8b35b77a-867b-42a3-a5fa-cef71f4a2b2e could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:19:06.531292 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43a8db5b-162e-49d2-9c3c-45b90f6f0ce0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e" status: 404 len: 111 microversion: 2.1 time: 0.084267 Aug 02 07:19:06.532465 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3004/5937] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:06 2022] GET /compute/v2.1/servers/8b35b77a-867b-42a3-a5fa-cef71f4a2b2e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:19:06.541948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2afd4eca-5827-40e8-8806-4df565df7eba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:06.542825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2afd4eca-5827-40e8-8806-4df565df7eba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:06.554698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2afd4eca-5827-40e8-8806-4df565df7eba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:06.555623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2afd4eca-5827-40e8-8806-4df565df7eba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:06.558135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2afd4eca-5827-40e8-8806-4df565df7eba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:06.562408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2afd4eca-5827-40e8-8806-4df565df7eba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:06.657774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2afd4eca-5827-40e8-8806-4df565df7eba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:19:06.891912 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2afd4eca-5827-40e8-8806-4df565df7eba tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 204 len: 0 microversion: 2.1 time: 0.354272 Aug 02 07:19:06.911618 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2934/5938] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:19:06 2022] DELETE /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:19:06.916988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b9892f2a-468e-48ea-9f4c-1a766794f021 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:06.918484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b9892f2a-468e-48ea-9f4c-1a766794f021 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:06.934292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9892f2a-468e-48ea-9f4c-1a766794f021 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:06.934742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9892f2a-468e-48ea-9f4c-1a766794f021 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:06.935736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9892f2a-468e-48ea-9f4c-1a766794f021 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:06.948953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9892f2a-468e-48ea-9f4c-1a766794f021 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:07.685068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b9892f2a-468e-48ea-9f4c-1a766794f021 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:19:07.702630 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b9892f2a-468e-48ea-9f4c-1a766794f021 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1511 microversion: 2.1 time: 0.789569 Aug 02 07:19:07.706257 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3005/5939] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:06 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1511 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:19:08.728150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-678c95e5-85eb-4406-a071-ee2695d4ab99 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:08.728949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-678c95e5-85eb-4406-a071-ee2695d4ab99 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:08.743657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-678c95e5-85eb-4406-a071-ee2695d4ab99 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:08.744111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-678c95e5-85eb-4406-a071-ee2695d4ab99 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:08.745043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-678c95e5-85eb-4406-a071-ee2695d4ab99 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:08.749428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-678c95e5-85eb-4406-a071-ee2695d4ab99 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:09.918228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-678c95e5-85eb-4406-a071-ee2695d4ab99 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:19:09.947128 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-678c95e5-85eb-4406-a071-ee2695d4ab99 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1511 microversion: 2.1 time: 1.223594 Aug 02 07:19:09.948994 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2935/5940] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:08 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1511 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:19:10.975869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c31f99b4-4448-4895-938e-a2f0883f03f5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:10.976501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c31f99b4-4448-4895-938e-a2f0883f03f5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:11.017273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c31f99b4-4448-4895-938e-a2f0883f03f5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:11.020224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c31f99b4-4448-4895-938e-a2f0883f03f5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:11.025240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c31f99b4-4448-4895-938e-a2f0883f03f5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:11.025726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c31f99b4-4448-4895-938e-a2f0883f03f5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:11.668366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c31f99b4-4448-4895-938e-a2f0883f03f5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daee0d1130940a7bd83c339ea56cd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb8ddce03f488b8842589c2622366a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:19:11.680850 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c31f99b4-4448-4895-938e-a2f0883f03f5 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 200 len: 1511 microversion: 2.1 time: 0.711154 Aug 02 07:19:11.683836 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3006/5941] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:10 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 1511 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:19:12.271813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-4de2cf8f-6c1e-4d04-9f95-6eae48f5a03e req-1bc65b4f-e926-494b-91ec-c983c0f5de45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2edf07-e6a8-472c-9d71-a0691e66b90d", "name": "network-vif-deleted", "tag": "45cd9e1c-cdfb-4648-a6ce-ee7537957267"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:19:12.310822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-4de2cf8f-6c1e-4d04-9f95-6eae48f5a03e req-1bc65b4f-e926-494b-91ec-c983c0f5de45 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:12.311270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-4de2cf8f-6c1e-4d04-9f95-6eae48f5a03e req-1bc65b4f-e926-494b-91ec-c983c0f5de45 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:12.358205 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-4de2cf8f-6c1e-4d04-9f95-6eae48f5a03e req-1bc65b4f-e926-494b-91ec-c983c0f5de45 service nova] Creating event network-vif-deleted:45cd9e1c-cdfb-4648-a6ce-ee7537957267 for instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d on n-h2-851337-3 Aug 02 07:19:12.382450 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-4de2cf8f-6c1e-4d04-9f95-6eae48f5a03e req-1bc65b4f-e926-494b-91ec-c983c0f5de45 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111749 Aug 02 07:19:12.385170 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2936/5942] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:19:12.713110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d3092fce-8c64-4bdd-8a75-e27b12a2fca0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:12.714091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d3092fce-8c64-4bdd-8a75-e27b12a2fca0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] [instance: 3d2edf07-e6a8-472c-9d71-a0691e66b90d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:12.729188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3092fce-8c64-4bdd-8a75-e27b12a2fca0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:12.735976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3092fce-8c64-4bdd-8a75-e27b12a2fca0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:12.742814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3092fce-8c64-4bdd-8a75-e27b12a2fca0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:12.743485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d3092fce-8c64-4bdd-8a75-e27b12a2fca0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:12.845740 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-d3092fce-8c64-4bdd-8a75-e27b12a2fca0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] HTTP exception thrown: Instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d could not be found. Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d3092fce-8c64-4bdd-8a75-e27b12a2fca0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Request method failure captured: Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d HTTP/1.1 Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M8KuXP0Td37NchgET_Tg6CTOgPja6hV0lGQgm6HBWQzlhXywBBpBu4dqtI6hkgi3vZdGM7BkipUs0j2TMDd5bWKSeyoogD31FB5VM1cH6VTp6z3YKe7kpOwgqMIkiA603gsnpGnzcbQ5uZ2_pWIa-mygLRr40tR0AQI1kQEpvp9JVM Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2ebb8ddce03f488b8842589c2622366a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2ebb8ddce03f488b8842589c2622366a"}]}] Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 2ebb8ddce03f488b8842589c2622366a Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073073353 Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 4daee0d1130940a7bd83c339ea56cd3b Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-1073073353-project Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d could not be found. Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '3d2edf07-e6a8-472c-9d71-a0691e66b90d'} Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d could not be found. Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d could not be found. Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:19:12.851901 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:12.859335 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:12.859335 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:19:12.859335 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:19:12.859335 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:19:12.859335 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:19:12.859335 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d could not be found. Aug 02 07:19:12.859335 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:12.866232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d3092fce-8c64-4bdd-8a75-e27b12a2fca0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] Returning 404 to user: Instance 3d2edf07-e6a8-472c-9d71-a0691e66b90d could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:19:12.867982 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d3092fce-8c64-4bdd-8a75-e27b12a2fca0 tempest-ServersNegativeTestJSON-1073073353 tempest-ServersNegativeTestJSON-1073073353-project] 10.222.0.79 "GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d" status: 404 len: 111 microversion: 2.1 time: 0.158961 Aug 02 07:19:12.870945 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3007/5943] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:12 2022] GET /compute/v2.1/servers/3d2edf07-e6a8-472c-9d71-a0691e66b90d => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:19:15.066737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ba18eb27-8d56-42e2-9ae8-ac993a35ba88 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] Calling method '.version_select at 0x7f9279ee0820>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:15.071495 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ba18eb27-8d56-42e2-9ae8-ac993a35ba88 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [af7f37fb-ea4c-4e48-9dc2-e8e7aa30923e] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 07:19:16.082721 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [None req-ba18eb27-8d56-42e2-9ae8-ac993a35ba88 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] [af7f37fb-ea4c-4e48-9dc2-e8e7aa30923e] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 45396. Aug 02 07:19:16.130784 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ba18eb27-8d56-42e2-9ae8-ac993a35ba88 tempest-TestNetworkAdvancedServerOps-1158041327 tempest-TestNetworkAdvancedServerOps-1158041327-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1127880425" status: 202 len: 0 microversion: 2.1 time: 1.073372 Aug 02 07:19:16.138515 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2937/5944] 10.222.0.79 () {58 vars in 1284 bytes} [Tue Aug 2 07:19:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1127880425 => generated 0 bytes in 1080 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:19:27.067451 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:19:27.070029 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 07:19:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.79) !!! Aug 02 07:19:27.083301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=7 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:19:27.089832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=39 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:19:27.936468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-63abb375-66d5-4a6b-b18c-ade21c4b575b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Action: 'create', calling method: .version_select at 0x7f9279e1fd30>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-312687304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgaQH7CMeKtnTLuR1+BAzpBgNzBfw2/8sBQSWvqcoXahRjUcfqmvUJNl3ZLhPQdRhzH0K6ijxLrck5CohGUohkEg9DR+PyuHNVl3+u1iYvB28E1ABgk/5SyNQpdFv6Dyg=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:19:28.024670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-63abb375-66d5-4a6b-b18c-ade21c4b575b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Getting quotas for project db58e49a483a42f884f9e945c883a8e7. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:19:28.061795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-63abb375-66d5-4a6b-b18c-ade21c4b575b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Getting quotas for user 58418aade898447398de5eb0aecc3798 and project db58e49a483a42f884f9e945c883a8e7. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:19:28.159999 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-63abb375-66d5-4a6b-b18c-ade21c4b575b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 1.090575 Aug 02 07:19:28.168708 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3008/5945] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:19:27 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:19:29.099903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:19:29.101151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:19:29.405173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-75a405ab-a12c-46b8-bf9c-8a0362f438d4 tempest-QuotasTestJSON-1464520119 tempest-QuotasTestJSON-1464520119-project] Calling method '.version_select at 0x7f927aa4fd30>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:29.776447 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-75a405ab-a12c-46b8-bf9c-8a0362f438d4 tempest-QuotasTestJSON-1464520119 tempest-QuotasTestJSON-1464520119-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/630824a733c44dd48c7b1177729c7b68/defaults" status: 200 len: 371 microversion: 2.1 time: 0.678644 Aug 02 07:19:29.778228 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2938/5946] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 07:19:29 2022] GET /compute/v2.1/os-quota-sets/630824a733c44dd48c7b1177729c7b68/defaults => generated 371 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:19:29.803396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-61919620-a3b2-4989-8669-875a5c4fdc66 tempest-QuotasTestJSON-1464520119 tempest-QuotasTestJSON-1464520119-project] Calling method '.version_select at 0x7f9279e215e0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:30.015708 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-61919620-a3b2-4989-8669-875a5c4fdc66 tempest-QuotasTestJSON-1464520119 tempest-QuotasTestJSON-1464520119-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/630824a733c44dd48c7b1177729c7b68" status: 200 len: 371 microversion: 2.1 time: 0.226047 Aug 02 07:19:30.020739 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3009/5947] 10.222.0.79 () {58 vars in 1242 bytes} [Tue Aug 2 07:19:29 2022] GET /compute/v2.1/os-quota-sets/630824a733c44dd48c7b1177729c7b68 => generated 371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:19:30.038201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-388614c4-b7a9-46d0-9711-2dff5a35508f tempest-QuotasTestJSON-1464520119 tempest-QuotasTestJSON-1464520119-project] Calling method '.version_select at 0x7f927aa79ee0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:30.757825 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-388614c4-b7a9-46d0-9711-2dff5a35508f tempest-QuotasTestJSON-1464520119 tempest-QuotasTestJSON-1464520119-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/630824a733c44dd48c7b1177729c7b68/defaults" status: 200 len: 371 microversion: 2.1 time: 0.727354 Aug 02 07:19:30.759310 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2939/5948] 10.222.0.79 () {58 vars in 1269 bytes} [Tue Aug 2 07:19:30 2022] GET /compute/v2.1/os-quota-sets/630824a733c44dd48c7b1177729c7b68/defaults => generated 371 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:19:30.773241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f1847aae-7bda-417e-85bf-97a56ffe521c tempest-QuotasTestJSON-1464520119 tempest-QuotasTestJSON-1464520119-project] Calling method '.version_select at 0x7f9279da8700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:31.254732 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f1847aae-7bda-417e-85bf-97a56ffe521c tempest-QuotasTestJSON-1464520119 tempest-QuotasTestJSON-1464520119-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/630824a733c44dd48c7b1177729c7b68" status: 200 len: 371 microversion: 2.1 time: 0.485699 Aug 02 07:19:31.256501 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3010/5949] 10.222.0.79 () {58 vars in 1242 bytes} [Tue Aug 2 07:19:30 2022] GET /compute/v2.1/os-quota-sets/630824a733c44dd48c7b1177729c7b68 => generated 371 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:19:31.270145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7789e82d-9426-4846-bd13-36ffbad19542 tempest-QuotasTestJSON-1464520119 tempest-QuotasTestJSON-1464520119-project] Calling method '.version_select at 0x7f927a9abd30>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:32.141125 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7789e82d-9426-4846-bd13-36ffbad19542 tempest-QuotasTestJSON-1464520119 tempest-QuotasTestJSON-1464520119-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/630824a733c44dd48c7b1177729c7b68?user_id=4121ae3d074e4e4dbba8d482a4e8496b" status: 200 len: 371 microversion: 2.1 time: 0.875131 Aug 02 07:19:32.146652 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2940/5950] 10.222.0.79 () {58 vars in 1323 bytes} [Tue Aug 2 07:19:31 2022] GET /compute/v2.1/os-quota-sets/630824a733c44dd48c7b1177729c7b68?user_id=4121ae3d074e4e4dbba8d482a4e8496b => generated 371 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:19:37.103465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3f2dbf1b-40a8-4c2b-8e99-610a1ac422c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545-project-admin] Calling method '.version_select at 0x7f9279cf89d0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:37.104401 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:19:37.104401 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 07:19:37.105619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f2dbf1b-40a8-4c2b-8e99-610a1ac422c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:37.106106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f2dbf1b-40a8-4c2b-8e99-610a1ac422c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:37.166231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f2dbf1b-40a8-4c2b-8e99-610a1ac422c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:37.166686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f2dbf1b-40a8-4c2b-8e99-610a1ac422c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:37.217200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f2dbf1b-40a8-4c2b-8e99-610a1ac422c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:37.217669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f2dbf1b-40a8-4c2b-8e99-610a1ac422c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:37.232308 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3f2dbf1b-40a8-4c2b-8e99-610a1ac422c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1044989545-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.911047 Aug 02 07:19:37.232913 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3011/5951] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 07:19:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:19:41.734692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-53410d6a-3c37-40fd-bdba-e66704b5785d tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:41.735387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-53410d6a-3c37-40fd-bdba-e66704b5785d tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:41.760742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53410d6a-3c37-40fd-bdba-e66704b5785d tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:41.762828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53410d6a-3c37-40fd-bdba-e66704b5785d tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:41.764050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53410d6a-3c37-40fd-bdba-e66704b5785d tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:41.767394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53410d6a-3c37-40fd-bdba-e66704b5785d tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:41.904424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-53410d6a-3c37-40fd-bdba-e66704b5785d tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:19:42.162308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:19:42.240089 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-53410d6a-3c37-40fd-bdba-e66704b5785d tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 204 len: 0 microversion: 2.1 time: 1.187312 Aug 02 07:19:42.242969 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2941/5952] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:19:41 2022] DELETE /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 0 bytes in 1192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:19:42.253554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-79c36fb7-2737-49a7-8080-770de43b75d0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:42.256591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-79c36fb7-2737-49a7-8080-770de43b75d0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:42.269651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:19:42.286807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79c36fb7-2737-49a7-8080-770de43b75d0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:42.288093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79c36fb7-2737-49a7-8080-770de43b75d0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:42.290433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79c36fb7-2737-49a7-8080-770de43b75d0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:42.291109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79c36fb7-2737-49a7-8080-770de43b75d0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:42.913347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-79c36fb7-2737-49a7-8080-770de43b75d0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:19:42.926693 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-79c36fb7-2737-49a7-8080-770de43b75d0 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1732 microversion: 2.1 time: 0.678978 Aug 02 07:19:42.927981 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3012/5953] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:42 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1732 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:19:43.958330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c1f44abc-f361-4707-9a5f-46429e7f7004 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:43.960383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c1f44abc-f361-4707-9a5f-46429e7f7004 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:43.975031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1f44abc-f361-4707-9a5f-46429e7f7004 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:43.980216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1f44abc-f361-4707-9a5f-46429e7f7004 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:43.982149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1f44abc-f361-4707-9a5f-46429e7f7004 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:43.982786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1f44abc-f361-4707-9a5f-46429e7f7004 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:45.595837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c1f44abc-f361-4707-9a5f-46429e7f7004 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:19:45.626845 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c1f44abc-f361-4707-9a5f-46429e7f7004 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1665 microversion: 2.1 time: 1.660815 Aug 02 07:19:45.627972 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2942/5954] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:43 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1665 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:19:46.486737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-82dd061c-862e-46b6-ba56-46c6b339d647 req-7290b2e6-89ef-4781-9cfb-a3391a19c618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3", "name": "network-vif-deleted", "tag": "5aeee3e0-ac9e-4c5d-8a71-64f5b5643227"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:19:46.514493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-82dd061c-862e-46b6-ba56-46c6b339d647 req-7290b2e6-89ef-4781-9cfb-a3391a19c618 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:46.515214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-82dd061c-862e-46b6-ba56-46c6b339d647 req-7290b2e6-89ef-4781-9cfb-a3391a19c618 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:46.543468 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-82dd061c-862e-46b6-ba56-46c6b339d647 req-7290b2e6-89ef-4781-9cfb-a3391a19c618 service nova] Creating event network-vif-deleted:5aeee3e0-ac9e-4c5d-8a71-64f5b5643227 for instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 on n-h2-851337-3 Aug 02 07:19:46.550661 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-82dd061c-862e-46b6-ba56-46c6b339d647 req-7290b2e6-89ef-4781-9cfb-a3391a19c618 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068764 Aug 02 07:19:46.551617 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3013/5955] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:19:46.660710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c3172aaf-db83-4182-9e78-b684069f030f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:46.661519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c3172aaf-db83-4182-9e78-b684069f030f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:46.684709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3172aaf-db83-4182-9e78-b684069f030f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:46.685262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3172aaf-db83-4182-9e78-b684069f030f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:46.693288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3172aaf-db83-4182-9e78-b684069f030f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:46.694344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3172aaf-db83-4182-9e78-b684069f030f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:46.787046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3172aaf-db83-4182-9e78-b684069f030f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:46.787492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3172aaf-db83-4182-9e78-b684069f030f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:46.787951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-c3172aaf-db83-4182-9e78-b684069f030f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lazy-loading 'fault' on Instance uuid aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:19:47.091464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c3172aaf-db83-4182-9e78-b684069f030f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0bd714baa542488384215c55f2eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82289264d443baa513f341d4da7523', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:19:47.105757 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c3172aaf-db83-4182-9e78-b684069f030f tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 200 len: 1387 microversion: 2.1 time: 0.448838 Aug 02 07:19:47.116032 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2943/5956] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:46 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 1387 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:19:48.139028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-41f11d44-b8e7-4967-a349-3dca0f1c7293 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:48.139748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-41f11d44-b8e7-4967-a349-3dca0f1c7293 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:48.172460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41f11d44-b8e7-4967-a349-3dca0f1c7293 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:48.176018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41f11d44-b8e7-4967-a349-3dca0f1c7293 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:48.181264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41f11d44-b8e7-4967-a349-3dca0f1c7293 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:48.182974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41f11d44-b8e7-4967-a349-3dca0f1c7293 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:48.235405 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-41f11d44-b8e7-4967-a349-3dca0f1c7293 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] HTTP exception thrown: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-41f11d44-b8e7-4967-a349-3dca0f1c7293 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Request method failure captured: Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 HTTP/1.1 Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M7L3XaXaL-YGIF-HgAixNVoSNPoz8vpMlILRvCyDFOOzxn6LJXgM_IP6fr1PJaCvr2NNR0p4wfa8cSvW9KrBsinyaePrB0uz7N2PaAMHIG0EPwkTvKIQDGRujW_kszJLqoBedILeYItWEbbUW-ABovTuFgcmuoIdX-cQXdb1Q5lGeo Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 3c82289264d443baa513f341d4da7523 Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestServerBasicOps-128441814 Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3c82289264d443baa513f341d4da7523"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c82289264d443baa513f341d4da7523"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3c82289264d443baa513f341d4da7523"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c82289264d443baa513f341d4da7523"}]}] Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestServerBasicOps-128441814 Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 3c82289264d443baa513f341d4da7523 Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestServerBasicOps-128441814 Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestServerBasicOps-128441814-project Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: fd0bd714baa542488384215c55f2eb84 Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestServerBasicOps-128441814-project Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3'} Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:19:48.247620 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:48.252953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:48.252953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:19:48.252953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:19:48.252953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:19:48.252953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:19:48.252953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:48.252953 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:48.252953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-41f11d44-b8e7-4967-a349-3dca0f1c7293 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Returning 404 to user: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:19:48.254873 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-41f11d44-b8e7-4967-a349-3dca0f1c7293 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 404 len: 111 microversion: 2.1 time: 0.119250 Aug 02 07:19:48.255571 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3014/5957] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:48 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:19:49.798920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1971778367-access_point-670114242", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "89bed308-fa5b-4b0f-8bb4-09a057bbdf62"}], "key_name": "tempest-TestSecurityGroupsBasicOps-312687304", "security_groups": [{"name": "tempest-secgroup_access--1069430134"}, {"name": "tempest-secgroup_general--1037875545"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:19:51.189704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] validate_networks() for [('89bed308-fa5b-4b0f-8bb4-09a057bbdf62', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:19:51.572410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d9894de9-1fb7-4d61-b702-643398fb27e7 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:51.574188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d9894de9-1fb7-4d61-b702-643398fb27e7 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:51.591305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9894de9-1fb7-4d61-b702-643398fb27e7 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:51.601930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9894de9-1fb7-4d61-b702-643398fb27e7 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:51.605456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9894de9-1fb7-4d61-b702-643398fb27e7 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:51.608183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9894de9-1fb7-4d61-b702-643398fb27e7 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:51.658381 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-d9894de9-1fb7-4d61-b702-643398fb27e7 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] HTTP exception thrown: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d9894de9-1fb7-4d61-b702-643398fb27e7 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Request method failure captured: Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 HTTP/1.1 Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M7L3XaXaL-YGIF-HgAixNVoSNPoz8vpMlILRvCyDFOOzxn6LJXgM_IP6fr1PJaCvr2NNR0p4wfa8cSvW9KrBsinyaePrB0uz7N2PaAMHIG0EPwkTvKIQDGRujW_kszJLqoBedILeYItWEbbUW-ABovTuFgcmuoIdX-cQXdb1Q5lGeo Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 3c82289264d443baa513f341d4da7523 Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestServerBasicOps-128441814 Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3c82289264d443baa513f341d4da7523"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c82289264d443baa513f341d4da7523"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3c82289264d443baa513f341d4da7523"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c82289264d443baa513f341d4da7523"}]}] Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestServerBasicOps-128441814 Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 3c82289264d443baa513f341d4da7523 Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestServerBasicOps-128441814 Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestServerBasicOps-128441814-project Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: fd0bd714baa542488384215c55f2eb84 Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestServerBasicOps-128441814-project Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3'} Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:19:51.671178 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:19:51.675580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:51.675580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:51.675580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:19:51.675580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:51.675580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:51.675580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:19:51.675580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:19:51.675580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:19:51.675580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:19:51.675580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:51.675580 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:51.675580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d9894de9-1fb7-4d61-b702-643398fb27e7 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Returning 404 to user: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:19:51.675580 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d9894de9-1fb7-4d61-b702-643398fb27e7 tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 404 len: 111 microversion: 2.1 time: 0.104880 Aug 02 07:19:51.682070 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3015/5958] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:19:51 2022] DELETE /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:19:51.690026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-32bfa602-a92f-4309-bc19-44fad6f3b9aa tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:51.690802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-32bfa602-a92f-4309-bc19-44fad6f3b9aa tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] [instance: aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:51.697796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32bfa602-a92f-4309-bc19-44fad6f3b9aa tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:51.698337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32bfa602-a92f-4309-bc19-44fad6f3b9aa tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:51.699114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32bfa602-a92f-4309-bc19-44fad6f3b9aa tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:51.699642 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32bfa602-a92f-4309-bc19-44fad6f3b9aa tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:51.754130 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-32bfa602-a92f-4309-bc19-44fad6f3b9aa tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] HTTP exception thrown: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-32bfa602-a92f-4309-bc19-44fad6f3b9aa tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Request method failure captured: Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 HTTP/1.1 Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M7L3XaXaL-YGIF-HgAixNVoSNPoz8vpMlILRvCyDFOOzxn6LJXgM_IP6fr1PJaCvr2NNR0p4wfa8cSvW9KrBsinyaePrB0uz7N2PaAMHIG0EPwkTvKIQDGRujW_kszJLqoBedILeYItWEbbUW-ABovTuFgcmuoIdX-cQXdb1Q5lGeo Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 3c82289264d443baa513f341d4da7523 Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestServerBasicOps-128441814 Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3c82289264d443baa513f341d4da7523"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c82289264d443baa513f341d4da7523"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3c82289264d443baa513f341d4da7523"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c82289264d443baa513f341d4da7523"}]}] Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestServerBasicOps-128441814 Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 3c82289264d443baa513f341d4da7523 Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestServerBasicOps-128441814 Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestServerBasicOps-128441814-project Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: fd0bd714baa542488384215c55f2eb84 Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestServerBasicOps-128441814-project Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3'} Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:19:51.757504 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:51.762541 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:19:51.762541 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:19:51.762541 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:19:51.762541 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:19:51.762541 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:19:51.762541 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. Aug 02 07:19:51.762541 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:19:51.762541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-32bfa602-a92f-4309-bc19-44fad6f3b9aa tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Returning 404 to user: Instance aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:19:51.762541 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-32bfa602-a92f-4309-bc19-44fad6f3b9aa tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3" status: 404 len: 111 microversion: 2.1 time: 0.075789 Aug 02 07:19:51.765593 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3016/5959] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:51 2022] GET /compute/v2.1/servers/aca9f2f3-b5c3-4b7d-98a9-29ac4c389ef3 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:19:53.127997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:19:53.131169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:19:53.134606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:19:53.135426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:19:53.137071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:19:53.202807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:53.207044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:53.208916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:53.209939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:53.281241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Getting quotas for project db58e49a483a42f884f9e945c883a8e7. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:19:53.289452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Getting quotas for user 58418aade898447398de5eb0aecc3798 and project db58e49a483a42f884f9e945c883a8e7. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:19:53.348926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:19:53.356843 n-d-851337-3 devstack@n-api.service[126119]: WARNING nova.utils [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1971778367-access_point-670114242 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1971778367-ac Aug 02 07:19:53.360846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:19:53.559156 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-34189c35-b451-4490-9916-e597d1ee4ce7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 3.763868 Aug 02 07:19:53.566394 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2944/5960] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:19:49 2022] POST /compute/v2.1/servers => generated 458 bytes in 3772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:19:53.577556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6bf241f5-62c0-4f13-9006-067278ffecf3 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:53.578983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6bf241f5-62c0-4f13-9006-067278ffecf3 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:54.430777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-acaca661-f0d9-41cf-a589-c83fd3e2ee4c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] Calling method '.version_select at 0x7f928c3184c0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:54.516172 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-acaca661-f0d9-41cf-a589-c83fd3e2ee4c tempest-TestServerBasicOps-128441814 tempest-TestServerBasicOps-128441814-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-735811759" status: 202 len: 0 microversion: 2.1 time: 0.090328 Aug 02 07:19:54.517321 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2945/5961] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Aug 2 07:19:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-735811759 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:19:54.572443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6bf241f5-62c0-4f13-9006-067278ffecf3 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:19:54.606736 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6bf241f5-62c0-4f13-9006-067278ffecf3 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1293 microversion: 2.1 time: 1.031954 Aug 02 07:19:54.611999 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3017/5962] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:53 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1293 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:19:55.633799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-153bef4a-5700-470b-ba73-344637cd2030 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:55.643185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-153bef4a-5700-470b-ba73-344637cd2030 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:55.654999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-153bef4a-5700-470b-ba73-344637cd2030 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:55.655787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-153bef4a-5700-470b-ba73-344637cd2030 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:55.656788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-153bef4a-5700-470b-ba73-344637cd2030 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:55.657425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-153bef4a-5700-470b-ba73-344637cd2030 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:55.805301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-153bef4a-5700-470b-ba73-344637cd2030 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:19:55.831845 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-153bef4a-5700-470b-ba73-344637cd2030 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1345 microversion: 2.1 time: 0.201845 Aug 02 07:19:55.832508 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2946/5963] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:55 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1345 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:19:56.861703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7158987-6760-4f5c-ae8f-35ac89fe0264 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:56.863328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e7158987-6760-4f5c-ae8f-35ac89fe0264 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:56.887940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7158987-6760-4f5c-ae8f-35ac89fe0264 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:56.888355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7158987-6760-4f5c-ae8f-35ac89fe0264 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:56.889200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7158987-6760-4f5c-ae8f-35ac89fe0264 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:56.889757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7158987-6760-4f5c-ae8f-35ac89fe0264 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:57.159002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e7158987-6760-4f5c-ae8f-35ac89fe0264 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:19:57.178519 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7158987-6760-4f5c-ae8f-35ac89fe0264 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1351 microversion: 2.1 time: 0.321890 Aug 02 07:19:57.182799 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3018/5964] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:56 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1351 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:19:58.202045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bfb9c384-a563-42e2-b16e-34ea9f3fbb50 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:58.203777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bfb9c384-a563-42e2-b16e-34ea9f3fbb50 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:58.222203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfb9c384-a563-42e2-b16e-34ea9f3fbb50 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:58.223306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfb9c384-a563-42e2-b16e-34ea9f3fbb50 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:58.224808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfb9c384-a563-42e2-b16e-34ea9f3fbb50 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:58.225477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bfb9c384-a563-42e2-b16e-34ea9f3fbb50 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:58.439762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bfb9c384-a563-42e2-b16e-34ea9f3fbb50 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:19:58.453948 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bfb9c384-a563-42e2-b16e-34ea9f3fbb50 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1351 microversion: 2.1 time: 0.253747 Aug 02 07:19:58.454745 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2947/5965] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:58 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1351 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:19:59.479151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-adfbafaa-43c8-4da4-b91a-163b58c3a194 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:19:59.481046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-adfbafaa-43c8-4da4-b91a-163b58c3a194 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:19:59.488252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:19:59.526941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-adfbafaa-43c8-4da4-b91a-163b58c3a194 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:59.527607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-adfbafaa-43c8-4da4-b91a-163b58c3a194 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:59.528900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-adfbafaa-43c8-4da4-b91a-163b58c3a194 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:19:59.529637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-adfbafaa-43c8-4da4-b91a-163b58c3a194 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:19:59.732090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-adfbafaa-43c8-4da4-b91a-163b58c3a194 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:19:59.740984 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-adfbafaa-43c8-4da4-b91a-163b58c3a194 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1351 microversion: 2.1 time: 0.268968 Aug 02 07:19:59.741578 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3019/5966] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:19:59 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1351 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:00.763753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-356f832a-983e-4a7a-abe4-c412fd8d108b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:00.764515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-356f832a-983e-4a7a-abe4-c412fd8d108b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:00.773032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:20:00.785942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-356f832a-983e-4a7a-abe4-c412fd8d108b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:00.793538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-356f832a-983e-4a7a-abe4-c412fd8d108b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:00.794688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-356f832a-983e-4a7a-abe4-c412fd8d108b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:00.795360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-356f832a-983e-4a7a-abe4-c412fd8d108b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:01.038583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-356f832a-983e-4a7a-abe4-c412fd8d108b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:01.057167 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-356f832a-983e-4a7a-abe4-c412fd8d108b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1351 microversion: 2.1 time: 0.294663 Aug 02 07:20:01.059138 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2948/5967] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:00 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1351 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:02.086809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a7afe8c7-5a46-443f-a2c3-e650a5360a5d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:02.087488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a7afe8c7-5a46-443f-a2c3-e650a5360a5d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:02.105742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7afe8c7-5a46-443f-a2c3-e650a5360a5d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:02.106476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7afe8c7-5a46-443f-a2c3-e650a5360a5d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:02.108906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7afe8c7-5a46-443f-a2c3-e650a5360a5d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:02.109719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7afe8c7-5a46-443f-a2c3-e650a5360a5d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:03.084437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a7afe8c7-5a46-443f-a2c3-e650a5360a5d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:03.111146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-410186538", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:20:03.133036 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a7afe8c7-5a46-443f-a2c3-e650a5360a5d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1471 microversion: 2.1 time: 1.030748 Aug 02 07:20:03.163112 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3020/5968] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:02 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1471 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:03.251888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:20:03.263192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:20:03.317417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:20:04.165734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2bc6424b-55d0-4df5-aa0a-ca14a6a167ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:04.166553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2bc6424b-55d0-4df5-aa0a-ca14a6a167ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:04.176693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bc6424b-55d0-4df5-aa0a-ca14a6a167ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:04.180116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bc6424b-55d0-4df5-aa0a-ca14a6a167ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:04.182299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bc6424b-55d0-4df5-aa0a-ca14a6a167ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:04.184056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bc6424b-55d0-4df5-aa0a-ca14a6a167ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:04.601691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:20:05.582003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:20:05.583231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:20:05.583977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:20:05.584856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:20:05.586412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:20:05.600860 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:05.601976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:05.603028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:05.604051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:05.643587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Getting quotas for project 51a9c77e5528457eb4e71889657b3cba. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:20:05.652438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Getting quotas for user 5be6b974e5af41bda0d27e11853789b5 and project 51a9c77e5528457eb4e71889657b3cba. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:20:05.704216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:20:05.707919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:20:05.714780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2bc6424b-55d0-4df5-aa0a-ca14a6a167ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:05.727563 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2bc6424b-55d0-4df5-aa0a-ca14a6a167ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1471 microversion: 2.1 time: 1.567028 Aug 02 07:20:05.731182 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3021/5969] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:04 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1471 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:20:05.747526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-695deec4-7be9-4d96-965d-f0787d410258 req-49dc961f-0748-4441-ac84-d5b7fcdf97a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10884d11-79f9-4213-be06-4ac8ac56515b", "tag": "c7d751b1-c882-400d-b408-2c110d2a2d66"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:20:05.771762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-695deec4-7be9-4d96-965d-f0787d410258 req-49dc961f-0748-4441-ac84-d5b7fcdf97a8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:05.774596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-695deec4-7be9-4d96-965d-f0787d410258 req-49dc961f-0748-4441-ac84-d5b7fcdf97a8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:05.800510 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-695deec4-7be9-4d96-965d-f0787d410258 req-49dc961f-0748-4441-ac84-d5b7fcdf97a8 service nova] Creating event network-changed:c7d751b1-c882-400d-b408-2c110d2a2d66 for instance 10884d11-79f9-4213-be06-4ac8ac56515b on n-h1-851337-3 Aug 02 07:20:05.815508 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-695deec4-7be9-4d96-965d-f0787d410258 req-49dc961f-0748-4441-ac84-d5b7fcdf97a8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082824 Aug 02 07:20:05.817035 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3022/5970] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:20:05.847129 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9b0f45db-ce03-4495-a665-46ce89e105e2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.739519 Aug 02 07:20:05.850087 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2949/5971] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:20:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:20:05.861660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f677e278-43b3-408f-bf95-d65bc817a710 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:05.862651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f677e278-43b3-408f-bf95-d65bc817a710 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:06.240023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f677e278-43b3-408f-bf95-d65bc817a710 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:06.251594 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f677e278-43b3-408f-bf95-d65bc817a710 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1213 microversion: 2.1 time: 0.392952 Aug 02 07:20:06.254662 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3023/5972] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:05 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1213 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:06.756401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-718e9b4e-cd67-444d-a534-8a46b708c9b5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:06.757045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-718e9b4e-cd67-444d-a534-8a46b708c9b5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:06.805290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-718e9b4e-cd67-444d-a534-8a46b708c9b5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:06.806935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-718e9b4e-cd67-444d-a534-8a46b708c9b5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:06.817091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-718e9b4e-cd67-444d-a534-8a46b708c9b5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:06.818289 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-718e9b4e-cd67-444d-a534-8a46b708c9b5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:07.276082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9d04995b-8424-4be3-9f43-90dd36f3bc67 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:07.276843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9d04995b-8424-4be3-9f43-90dd36f3bc67 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:07.294346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d04995b-8424-4be3-9f43-90dd36f3bc67 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:07.295523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d04995b-8424-4be3-9f43-90dd36f3bc67 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:07.300241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d04995b-8424-4be3-9f43-90dd36f3bc67 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:07.300955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d04995b-8424-4be3-9f43-90dd36f3bc67 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:07.324996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=47 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:20:07.609947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9d04995b-8424-4be3-9f43-90dd36f3bc67 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:07.630598 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9d04995b-8424-4be3-9f43-90dd36f3bc67 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1209 microversion: 2.1 time: 0.360739 Aug 02 07:20:07.632224 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3024/5973] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:07 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1209 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:07.759288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-718e9b4e-cd67-444d-a534-8a46b708c9b5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:07.767655 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-718e9b4e-cd67-444d-a534-8a46b708c9b5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1471 microversion: 2.1 time: 1.020742 Aug 02 07:20:07.778323 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2950/5974] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:06 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1471 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:08.654270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f6ada284-4c53-4206-a151-29aea6140576 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:08.654997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f6ada284-4c53-4206-a151-29aea6140576 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:08.678350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6ada284-4c53-4206-a151-29aea6140576 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:08.678648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6ada284-4c53-4206-a151-29aea6140576 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:08.679510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6ada284-4c53-4206-a151-29aea6140576 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:08.679952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6ada284-4c53-4206-a151-29aea6140576 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:08.790246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0ae45b5a-2b92-41b9-ad65-aff63c4e23ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:08.791815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0ae45b5a-2b92-41b9-ad65-aff63c4e23ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:08.806002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ae45b5a-2b92-41b9-ad65-aff63c4e23ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:08.830443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ae45b5a-2b92-41b9-ad65-aff63c4e23ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:08.831531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ae45b5a-2b92-41b9-ad65-aff63c4e23ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:08.832575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ae45b5a-2b92-41b9-ad65-aff63c4e23ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:09.865063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f6ada284-4c53-4206-a151-29aea6140576 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:09.882574 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f6ada284-4c53-4206-a151-29aea6140576 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1271 microversion: 2.1 time: 1.233609 Aug 02 07:20:09.892983 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3025/5975] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:08 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1271 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:10.541006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0ae45b5a-2b92-41b9-ad65-aff63c4e23ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:10.552134 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0ae45b5a-2b92-41b9-ad65-aff63c4e23ef tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1471 microversion: 2.1 time: 1.766834 Aug 02 07:20:10.558903 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2951/5976] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:08 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1471 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:20:10.913379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-224be04e-08b6-498c-9d4f-9fd55d2407cd tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:10.915678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-224be04e-08b6-498c-9d4f-9fd55d2407cd tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:10.932661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-224be04e-08b6-498c-9d4f-9fd55d2407cd tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:10.933119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-224be04e-08b6-498c-9d4f-9fd55d2407cd tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:10.940382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-224be04e-08b6-498c-9d4f-9fd55d2407cd tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:10.940846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-224be04e-08b6-498c-9d4f-9fd55d2407cd tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:11.286701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-224be04e-08b6-498c-9d4f-9fd55d2407cd tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:11.303769 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-224be04e-08b6-498c-9d4f-9fd55d2407cd tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1271 microversion: 2.1 time: 0.394364 Aug 02 07:20:11.308589 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3026/5977] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:10 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1271 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:11.584121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fbee15fc-5679-4d37-a0ce-0d2fda1b05ed tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:11.584815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fbee15fc-5679-4d37-a0ce-0d2fda1b05ed tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:11.610992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbee15fc-5679-4d37-a0ce-0d2fda1b05ed tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:11.614615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbee15fc-5679-4d37-a0ce-0d2fda1b05ed tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:11.619977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbee15fc-5679-4d37-a0ce-0d2fda1b05ed tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:11.623704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbee15fc-5679-4d37-a0ce-0d2fda1b05ed tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:11.718411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:20:12.330292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3f8b24fc-2eb9-40fe-a908-4a9059cd50e7 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:12.331590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3f8b24fc-2eb9-40fe-a908-4a9059cd50e7 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:12.346635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f8b24fc-2eb9-40fe-a908-4a9059cd50e7 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:12.350718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f8b24fc-2eb9-40fe-a908-4a9059cd50e7 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:12.351964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f8b24fc-2eb9-40fe-a908-4a9059cd50e7 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:12.354045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f8b24fc-2eb9-40fe-a908-4a9059cd50e7 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:12.641031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fbee15fc-5679-4d37-a0ce-0d2fda1b05ed tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:12.654772 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fbee15fc-5679-4d37-a0ce-0d2fda1b05ed tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1471 microversion: 2.1 time: 1.076749 Aug 02 07:20:12.662819 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2952/5978] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:11 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1471 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:12.736039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3f8b24fc-2eb9-40fe-a908-4a9059cd50e7 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:12.757456 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3f8b24fc-2eb9-40fe-a908-4a9059cd50e7 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1271 microversion: 2.1 time: 0.432355 Aug 02 07:20:12.758997 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3027/5979] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:12 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1271 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:20:13.676547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-69e19243-a58b-4861-9fde-deba2353894b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:13.677315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-69e19243-a58b-4861-9fde-deba2353894b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:13.695928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69e19243-a58b-4861-9fde-deba2353894b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:13.696752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69e19243-a58b-4861-9fde-deba2353894b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:13.697757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69e19243-a58b-4861-9fde-deba2353894b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:13.698422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69e19243-a58b-4861-9fde-deba2353894b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:13.789386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0a3b3bd5-c5eb-4520-bb0d-68f49b0f12f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:13.791584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0a3b3bd5-c5eb-4520-bb0d-68f49b0f12f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:13.802479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a3b3bd5-c5eb-4520-bb0d-68f49b0f12f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:13.803211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a3b3bd5-c5eb-4520-bb0d-68f49b0f12f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:13.804411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a3b3bd5-c5eb-4520-bb0d-68f49b0f12f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:13.805201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a3b3bd5-c5eb-4520-bb0d-68f49b0f12f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:14.063185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0a3b3bd5-c5eb-4520-bb0d-68f49b0f12f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:14.080823 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0a3b3bd5-c5eb-4520-bb0d-68f49b0f12f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1271 microversion: 2.1 time: 0.297232 Aug 02 07:20:14.084282 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3028/5980] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:13 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1271 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:20:14.558008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-69e19243-a58b-4861-9fde-deba2353894b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:14.571857 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-69e19243-a58b-4861-9fde-deba2353894b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1471 microversion: 2.1 time: 0.898409 Aug 02 07:20:14.589363 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2953/5981] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:13 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1471 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:15.136811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-29ce56ba-2449-4e7e-9d4e-fa02491ff9d8 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:15.138154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-29ce56ba-2449-4e7e-9d4e-fa02491ff9d8 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:15.160494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29ce56ba-2449-4e7e-9d4e-fa02491ff9d8 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:15.161218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29ce56ba-2449-4e7e-9d4e-fa02491ff9d8 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:15.166982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29ce56ba-2449-4e7e-9d4e-fa02491ff9d8 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:15.169831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29ce56ba-2449-4e7e-9d4e-fa02491ff9d8 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:15.596065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bcebb6da-370e-426c-8546-5bbb5a81009d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:15.596845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bcebb6da-370e-426c-8546-5bbb5a81009d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:15.612693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcebb6da-370e-426c-8546-5bbb5a81009d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:15.613519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcebb6da-370e-426c-8546-5bbb5a81009d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:15.614572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcebb6da-370e-426c-8546-5bbb5a81009d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:15.615440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcebb6da-370e-426c-8546-5bbb5a81009d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:15.618551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:20:15.681024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:20:16.248311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:20:16.616673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-29ce56ba-2449-4e7e-9d4e-fa02491ff9d8 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:16.630310 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-29ce56ba-2449-4e7e-9d4e-fa02491ff9d8 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1313 microversion: 2.1 time: 1.499491 Aug 02 07:20:16.634041 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3029/5982] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:15 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1313 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:16.644829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-873a3555-c6cb-4bfa-84ff-9995e5c8e23a req-059fccba-3377-4505-afd8-4ed5af56c6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10884d11-79f9-4213-be06-4ac8ac56515b", "name": "network-vif-plugged", "status": "completed", "tag": "c7d751b1-c882-400d-b408-2c110d2a2d66"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:20:16.652961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bcebb6da-370e-426c-8546-5bbb5a81009d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:16.670566 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bcebb6da-370e-426c-8546-5bbb5a81009d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1471 microversion: 2.1 time: 1.078881 Aug 02 07:20:16.675339 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2954/5983] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:15 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1471 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:20:16.676265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-873a3555-c6cb-4bfa-84ff-9995e5c8e23a req-059fccba-3377-4505-afd8-4ed5af56c6b7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:16.677574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-873a3555-c6cb-4bfa-84ff-9995e5c8e23a req-059fccba-3377-4505-afd8-4ed5af56c6b7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:16.706042 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-873a3555-c6cb-4bfa-84ff-9995e5c8e23a req-059fccba-3377-4505-afd8-4ed5af56c6b7 service nova] Creating event network-vif-plugged:c7d751b1-c882-400d-b408-2c110d2a2d66 for instance 10884d11-79f9-4213-be06-4ac8ac56515b on n-h1-851337-3 Aug 02 07:20:16.728595 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-873a3555-c6cb-4bfa-84ff-9995e5c8e23a req-059fccba-3377-4505-afd8-4ed5af56c6b7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092427 Aug 02 07:20:16.740509 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3030/5984] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:20:17.656464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79a8128c-f8f3-49f4-bf1c-e57e20e12ec1 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:17.657082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79a8128c-f8f3-49f4-bf1c-e57e20e12ec1 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:17.670290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79a8128c-f8f3-49f4-bf1c-e57e20e12ec1 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:17.671942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79a8128c-f8f3-49f4-bf1c-e57e20e12ec1 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:17.672754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79a8128c-f8f3-49f4-bf1c-e57e20e12ec1 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:17.673181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79a8128c-f8f3-49f4-bf1c-e57e20e12ec1 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:17.702368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8f3ae8f2-4f0a-4c10-8912-86387cd02531 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:17.703864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8f3ae8f2-4f0a-4c10-8912-86387cd02531 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:17.738436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f3ae8f2-4f0a-4c10-8912-86387cd02531 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:17.741654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f3ae8f2-4f0a-4c10-8912-86387cd02531 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:17.743919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f3ae8f2-4f0a-4c10-8912-86387cd02531 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:17.750367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f3ae8f2-4f0a-4c10-8912-86387cd02531 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:18.899002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79a8128c-f8f3-49f4-bf1c-e57e20e12ec1 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:18.919564 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79a8128c-f8f3-49f4-bf1c-e57e20e12ec1 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1313 microversion: 2.1 time: 1.266043 Aug 02 07:20:18.923515 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2955/5985] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:17 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1313 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:19.081339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8f3ae8f2-4f0a-4c10-8912-86387cd02531 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:19.124493 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8f3ae8f2-4f0a-4c10-8912-86387cd02531 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1471 microversion: 2.1 time: 1.431612 Aug 02 07:20:19.136996 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3031/5986] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:17 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1471 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:19.369595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c74cba86-7c51-4fa8-8744-8ce9e51bd7b1 req-b7dfe042-d4ec-4890-8f98-6f16b3774988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8658f0ef-e09e-4004-b5fd-170a5c216dc0", "tag": "cafe4a26-2533-4022-bad8-2ea639f08151"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:20:19.436224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c74cba86-7c51-4fa8-8744-8ce9e51bd7b1 req-b7dfe042-d4ec-4890-8f98-6f16b3774988 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:19.440169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c74cba86-7c51-4fa8-8744-8ce9e51bd7b1 req-b7dfe042-d4ec-4890-8f98-6f16b3774988 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:19.483751 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c74cba86-7c51-4fa8-8744-8ce9e51bd7b1 req-b7dfe042-d4ec-4890-8f98-6f16b3774988 service nova] Creating event network-changed:cafe4a26-2533-4022-bad8-2ea639f08151 for instance 8658f0ef-e09e-4004-b5fd-170a5c216dc0 on n-h2-851337-3 Aug 02 07:20:19.509822 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c74cba86-7c51-4fa8-8744-8ce9e51bd7b1 req-b7dfe042-d4ec-4890-8f98-6f16b3774988 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142215 Aug 02 07:20:19.515510 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2956/5987] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:20:19.945538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9a99f1e3-698e-4d0c-bbc2-5b91592e0522 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:19.946198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9a99f1e3-698e-4d0c-bbc2-5b91592e0522 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:19.960242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a99f1e3-698e-4d0c-bbc2-5b91592e0522 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:19.974504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a99f1e3-698e-4d0c-bbc2-5b91592e0522 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:19.977754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a99f1e3-698e-4d0c-bbc2-5b91592e0522 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:19.979416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a99f1e3-698e-4d0c-bbc2-5b91592e0522 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:20.158681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fc100daa-e03a-4972-af1d-938a9896e31d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:20.167285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fc100daa-e03a-4972-af1d-938a9896e31d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:20.187156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc100daa-e03a-4972-af1d-938a9896e31d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:20.189713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc100daa-e03a-4972-af1d-938a9896e31d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:20.190963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc100daa-e03a-4972-af1d-938a9896e31d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:20.192602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc100daa-e03a-4972-af1d-938a9896e31d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:20.669419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9a99f1e3-698e-4d0c-bbc2-5b91592e0522 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:20.681511 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9a99f1e3-698e-4d0c-bbc2-5b91592e0522 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1313 microversion: 2.1 time: 0.740436 Aug 02 07:20:20.686617 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3032/5988] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:19 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1313 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:20.847973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fc100daa-e03a-4972-af1d-938a9896e31d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:20.876291 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fc100daa-e03a-4972-af1d-938a9896e31d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1643 microversion: 2.1 time: 0.717369 Aug 02 07:20:20.882428 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2957/5989] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:20 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1643 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:20.903002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f47af76e-f17f-45f5-9a51-9167893eb88e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:20.903734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f47af76e-f17f-45f5-9a51-9167893eb88e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:20.914565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f47af76e-f17f-45f5-9a51-9167893eb88e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:20.915014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f47af76e-f17f-45f5-9a51-9167893eb88e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:20.919239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f47af76e-f17f-45f5-9a51-9167893eb88e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:20.919717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f47af76e-f17f-45f5-9a51-9167893eb88e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:21.354794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f47af76e-f17f-45f5-9a51-9167893eb88e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:21.371529 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f47af76e-f17f-45f5-9a51-9167893eb88e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1643 microversion: 2.1 time: 0.470746 Aug 02 07:20:21.389083 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3033/5990] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:20 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1643 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:21.396456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-97e9eae1-c3c2-450a-8f4e-576f0c7b45bd tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:21.397213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-97e9eae1-c3c2-450a-8f4e-576f0c7b45bd tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:21.406993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97e9eae1-c3c2-450a-8f4e-576f0c7b45bd tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:21.413942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97e9eae1-c3c2-450a-8f4e-576f0c7b45bd tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:21.415234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97e9eae1-c3c2-450a-8f4e-576f0c7b45bd tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:21.416044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97e9eae1-c3c2-450a-8f4e-576f0c7b45bd tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:21.713288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-72703104-5c7a-4e54-b11d-3be53777ec63 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:21.715305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-72703104-5c7a-4e54-b11d-3be53777ec63 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:21.744333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72703104-5c7a-4e54-b11d-3be53777ec63 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:21.746799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72703104-5c7a-4e54-b11d-3be53777ec63 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:21.751579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72703104-5c7a-4e54-b11d-3be53777ec63 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:21.752926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72703104-5c7a-4e54-b11d-3be53777ec63 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:22.354288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-72703104-5c7a-4e54-b11d-3be53777ec63 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:22.368614 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-72703104-5c7a-4e54-b11d-3be53777ec63 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1313 microversion: 2.1 time: 0.665187 Aug 02 07:20:22.372253 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3034/5991] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:21 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1313 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:20:22.750203 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-97e9eae1-c3c2-450a-8f4e-576f0c7b45bd tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1794 microversion: 2.1 time: 1.355088 Aug 02 07:20:22.753173 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2958/5992] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:21 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1794 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:23.392505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5d429444-5537-44b7-920e-5f2a1a48a0f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:23.394013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5d429444-5537-44b7-920e-5f2a1a48a0f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:23.414535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d429444-5537-44b7-920e-5f2a1a48a0f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:23.415137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d429444-5537-44b7-920e-5f2a1a48a0f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:23.416038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d429444-5537-44b7-920e-5f2a1a48a0f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:23.417146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5d429444-5537-44b7-920e-5f2a1a48a0f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:24.049561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5d429444-5537-44b7-920e-5f2a1a48a0f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:24.064700 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5d429444-5537-44b7-920e-5f2a1a48a0f5 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1313 microversion: 2.1 time: 0.678067 Aug 02 07:20:24.078480 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3035/5993] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:23 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1313 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:25.093873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e9f1da7e-461e-4644-aa6c-80f274087a1e tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:25.094532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e9f1da7e-461e-4644-aa6c-80f274087a1e tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:25.115948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9f1da7e-461e-4644-aa6c-80f274087a1e tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:25.128010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9f1da7e-461e-4644-aa6c-80f274087a1e tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:25.129542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9f1da7e-461e-4644-aa6c-80f274087a1e tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:25.130226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9f1da7e-461e-4644-aa6c-80f274087a1e tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:25.646392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e9f1da7e-461e-4644-aa6c-80f274087a1e tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:25.659064 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e9f1da7e-461e-4644-aa6c-80f274087a1e tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1313 microversion: 2.1 time: 0.570140 Aug 02 07:20:25.683493 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2959/5994] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:25 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1313 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:26.455182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-a89f7dc3-1509-40ff-acb2-8781216ab976 req-c60ed0b4-2ed5-4c53-a726-d3c9dfb7e639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8658f0ef-e09e-4004-b5fd-170a5c216dc0", "name": "network-vif-plugged", "status": "completed", "tag": "cafe4a26-2533-4022-bad8-2ea639f08151"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:20:26.481498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a89f7dc3-1509-40ff-acb2-8781216ab976 req-c60ed0b4-2ed5-4c53-a726-d3c9dfb7e639 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:26.482802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a89f7dc3-1509-40ff-acb2-8781216ab976 req-c60ed0b4-2ed5-4c53-a726-d3c9dfb7e639 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:26.514119 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-a89f7dc3-1509-40ff-acb2-8781216ab976 req-c60ed0b4-2ed5-4c53-a726-d3c9dfb7e639 service nova] Creating event network-vif-plugged:cafe4a26-2533-4022-bad8-2ea639f08151 for instance 8658f0ef-e09e-4004-b5fd-170a5c216dc0 on n-h2-851337-3 Aug 02 07:20:26.528857 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-a89f7dc3-1509-40ff-acb2-8781216ab976 req-c60ed0b4-2ed5-4c53-a726-d3c9dfb7e639 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078497 Aug 02 07:20:26.530130 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3036/5995] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:20:26.691042 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d9171c6-f211-4e58-9317-c714dcf0b8d2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:26.692582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5d9171c6-f211-4e58-9317-c714dcf0b8d2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:26.706734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d9171c6-f211-4e58-9317-c714dcf0b8d2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:26.709669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d9171c6-f211-4e58-9317-c714dcf0b8d2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:26.712516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d9171c6-f211-4e58-9317-c714dcf0b8d2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:26.713158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d9171c6-f211-4e58-9317-c714dcf0b8d2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:27.511687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5d9171c6-f211-4e58-9317-c714dcf0b8d2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:27.529359 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5d9171c6-f211-4e58-9317-c714dcf0b8d2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1313 microversion: 2.1 time: 0.841728 Aug 02 07:20:27.542856 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2960/5996] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:26 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1313 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:28.570026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-50d5dab6-5e23-434a-bbfd-5d5fdb54ac59 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:28.570870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-50d5dab6-5e23-434a-bbfd-5d5fdb54ac59 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:28.593352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50d5dab6-5e23-434a-bbfd-5d5fdb54ac59 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:28.593867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50d5dab6-5e23-434a-bbfd-5d5fdb54ac59 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:28.595999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50d5dab6-5e23-434a-bbfd-5d5fdb54ac59 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:28.609704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50d5dab6-5e23-434a-bbfd-5d5fdb54ac59 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:29.103178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-50d5dab6-5e23-434a-bbfd-5d5fdb54ac59 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:29.117663 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-50d5dab6-5e23-434a-bbfd-5d5fdb54ac59 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1313 microversion: 2.1 time: 0.559628 Aug 02 07:20:29.118731 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3037/5997] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:28 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:29.332851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-59b63054-990a-4597-b262-64e61878d994 req-42a8d28d-c913-48ef-995d-2e7d72cf3431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10884d11-79f9-4213-be06-4ac8ac56515b", "tag": "c7d751b1-c882-400d-b408-2c110d2a2d66"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:20:29.369502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-59b63054-990a-4597-b262-64e61878d994 req-42a8d28d-c913-48ef-995d-2e7d72cf3431 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:29.372073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-59b63054-990a-4597-b262-64e61878d994 req-42a8d28d-c913-48ef-995d-2e7d72cf3431 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:29.392284 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-59b63054-990a-4597-b262-64e61878d994 req-42a8d28d-c913-48ef-995d-2e7d72cf3431 service nova] Creating event network-changed:c7d751b1-c882-400d-b408-2c110d2a2d66 for instance 10884d11-79f9-4213-be06-4ac8ac56515b on n-h1-851337-3 Aug 02 07:20:29.398494 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-59b63054-990a-4597-b262-64e61878d994 req-42a8d28d-c913-48ef-995d-2e7d72cf3431 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071541 Aug 02 07:20:29.399505 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2961/5998] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:20:30.145475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-63b94349-166d-4e52-8606-6613727e405d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:20:30.147663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-63b94349-166d-4e52-8606-6613727e405d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:30.151106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=40 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:20:30.165975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63b94349-166d-4e52-8606-6613727e405d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:30.171329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63b94349-166d-4e52-8606-6613727e405d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:30.172687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63b94349-166d-4e52-8606-6613727e405d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:30.173644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63b94349-166d-4e52-8606-6613727e405d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:30.548327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-63b94349-166d-4e52-8606-6613727e405d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:20:30.564067 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-63b94349-166d-4e52-8606-6613727e405d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1463 microversion: 2.1 time: 0.423818 Aug 02 07:20:30.565243 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3038/5999] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:20:30 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1463 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:20:30.591357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-09c6a2fb-e317-4911-a315-a4c320214ee3 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d00eaab7-8ead-4d64-b456-c0798622c53c", "device": "/dev/sdb"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:20:30.594667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-09c6a2fb-e317-4911-a315-a4c320214ee3 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:20:30.610929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09c6a2fb-e317-4911-a315-a4c320214ee3 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:30.611615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09c6a2fb-e317-4911-a315-a4c320214ee3 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:30.623104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09c6a2fb-e317-4911-a315-a4c320214ee3 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:20:30.623837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09c6a2fb-e317-4911-a315-a4c320214ee3 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:20:31.267865 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-09c6a2fb-e317-4911-a315-a4c320214ee3 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "POST /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.681231 Aug 02 07:20:31.273435 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2962/6000] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:20:30 2022] POST /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0/os-volume_attachments => generated 194 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:21:13.681456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:21:13.682846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=81 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:21:13.969981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ac84fea2-2afa-4556-97cb-080fd2d6e06f tempest-PortsAdminExtendedAttrsTestJSON-1478843265 tempest-PortsAdminExtendedAttrsTestJSON-1478843265-project-admin] Calling method '.version_select at 0x7f9279cf8f70>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:21:13.971225 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:21:13.971225 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 07:21:13.973643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac84fea2-2afa-4556-97cb-080fd2d6e06f tempest-PortsAdminExtendedAttrsTestJSON-1478843265 tempest-PortsAdminExtendedAttrsTestJSON-1478843265-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:21:13.974186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac84fea2-2afa-4556-97cb-080fd2d6e06f tempest-PortsAdminExtendedAttrsTestJSON-1478843265 tempest-PortsAdminExtendedAttrsTestJSON-1478843265-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:21:14.010324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac84fea2-2afa-4556-97cb-080fd2d6e06f tempest-PortsAdminExtendedAttrsTestJSON-1478843265 tempest-PortsAdminExtendedAttrsTestJSON-1478843265-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:21:14.010786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac84fea2-2afa-4556-97cb-080fd2d6e06f tempest-PortsAdminExtendedAttrsTestJSON-1478843265 tempest-PortsAdminExtendedAttrsTestJSON-1478843265-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:21:14.061160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac84fea2-2afa-4556-97cb-080fd2d6e06f tempest-PortsAdminExtendedAttrsTestJSON-1478843265 tempest-PortsAdminExtendedAttrsTestJSON-1478843265-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:21:14.062125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac84fea2-2afa-4556-97cb-080fd2d6e06f tempest-PortsAdminExtendedAttrsTestJSON-1478843265 tempest-PortsAdminExtendedAttrsTestJSON-1478843265-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:21:14.080107 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ac84fea2-2afa-4556-97cb-080fd2d6e06f tempest-PortsAdminExtendedAttrsTestJSON-1478843265 tempest-PortsAdminExtendedAttrsTestJSON-1478843265-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.403797 Aug 02 07:21:14.083243 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3039/6001] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 07:21:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:21:48.424720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:21:48.426815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:21:48.436632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1988345082", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "8e3e8168-cc50-4e05-aefd-822450c33efc"}], "key_name": "tempest-TestSecurityGroupsBasicOps-312687304", "security_groups": []}, "os:scheduler_hints": {"different_host": ["10884d11-79f9-4213-be06-4ac8ac56515b"]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:21:49.081666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] validate_networks() for [('8e3e8168-cc50-4e05-aefd-822450c33efc', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:21:50.973917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:21:50.974508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:21:50.975080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:21:50.975746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:21:50.978411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:21:51.011723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:21:51.012563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:21:51.013697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:21:51.014373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:21:51.043596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Getting quotas for project db58e49a483a42f884f9e945c883a8e7. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:21:51.054915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Getting quotas for user 58418aade898447398de5eb0aecc3798 and project db58e49a483a42f884f9e945c883a8e7. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:21:51.088329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:21:51.098753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:21:51.264114 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2798045e-b073-403f-b2a2-8460eba53da1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.847004 Aug 02 07:21:51.275046 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2963/6002] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:21:48 2022] POST /compute/v2.1/servers => generated 361 bytes in 2859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:21:51.287177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9b7e3d92-336a-4b11-a694-aa7a2cb4616f tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:21:51.292301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9b7e3d92-336a-4b11-a694-aa7a2cb4616f tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:21:51.299877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:21:51.303521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:21:53.270395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9b7e3d92-336a-4b11-a694-aa7a2cb4616f tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:21:53.284654 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9b7e3d92-336a-4b11-a694-aa7a2cb4616f tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1241 microversion: 2.1 time: 2.001060 Aug 02 07:21:53.286085 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3040/6003] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:21:51 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1241 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:21:54.311836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-350dd4c3-b023-4cbc-ad00-26330e6edfb5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:21:54.313653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-350dd4c3-b023-4cbc-ad00-26330e6edfb5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:21:54.340963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-350dd4c3-b023-4cbc-ad00-26330e6edfb5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:21:54.341689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-350dd4c3-b023-4cbc-ad00-26330e6edfb5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:21:54.343251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-350dd4c3-b023-4cbc-ad00-26330e6edfb5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:21:54.343819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-350dd4c3-b023-4cbc-ad00-26330e6edfb5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:21:54.841969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-350dd4c3-b023-4cbc-ad00-26330e6edfb5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:21:54.851713 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-350dd4c3-b023-4cbc-ad00-26330e6edfb5 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1299 microversion: 2.1 time: 0.546279 Aug 02 07:21:54.856428 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2964/6004] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:21:54 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1299 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:21:55.885878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-47d88fd1-5845-4ac8-85f5-f4f6f0adb98e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:21:55.887096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-47d88fd1-5845-4ac8-85f5-f4f6f0adb98e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:21:55.902453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47d88fd1-5845-4ac8-85f5-f4f6f0adb98e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:21:55.902967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47d88fd1-5845-4ac8-85f5-f4f6f0adb98e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:21:55.905421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47d88fd1-5845-4ac8-85f5-f4f6f0adb98e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:21:55.905871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47d88fd1-5845-4ac8-85f5-f4f6f0adb98e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:21:56.144982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-47d88fd1-5845-4ac8-85f5-f4f6f0adb98e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:21:56.154208 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-47d88fd1-5845-4ac8-85f5-f4f6f0adb98e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1299 microversion: 2.1 time: 0.278735 Aug 02 07:21:56.161210 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3041/6005] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:21:55 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1299 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:21:57.180832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0a29f775-b511-454c-9ddd-2156685ccd86 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:21:57.181461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0a29f775-b511-454c-9ddd-2156685ccd86 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:21:57.207006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a29f775-b511-454c-9ddd-2156685ccd86 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:21:57.207377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a29f775-b511-454c-9ddd-2156685ccd86 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:21:57.211792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a29f775-b511-454c-9ddd-2156685ccd86 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:21:57.215423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a29f775-b511-454c-9ddd-2156685ccd86 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:21:57.583474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0a29f775-b511-454c-9ddd-2156685ccd86 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:21:57.594917 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0a29f775-b511-454c-9ddd-2156685ccd86 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1299 microversion: 2.1 time: 0.415433 Aug 02 07:21:57.596579 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2965/6006] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:21:57 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1299 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:21:58.619990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4fcf1875-a5e4-470c-8af8-d66708fab167 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:21:58.620609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4fcf1875-a5e4-470c-8af8-d66708fab167 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:21:58.632307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fcf1875-a5e4-470c-8af8-d66708fab167 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:21:58.634463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fcf1875-a5e4-470c-8af8-d66708fab167 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:21:58.636169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fcf1875-a5e4-470c-8af8-d66708fab167 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:21:58.640095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fcf1875-a5e4-470c-8af8-d66708fab167 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:21:59.964025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4fcf1875-a5e4-470c-8af8-d66708fab167 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:21:59.986946 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4fcf1875-a5e4-470c-8af8-d66708fab167 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1299 microversion: 2.1 time: 1.371597 Aug 02 07:22:00.000752 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3042/6007] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:21:58 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1299 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:01.014921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-08dc3800-bc95-4447-ac15-adcfad092803 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:01.017072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-08dc3800-bc95-4447-ac15-adcfad092803 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:01.027120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08dc3800-bc95-4447-ac15-adcfad092803 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:01.028796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08dc3800-bc95-4447-ac15-adcfad092803 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:01.031474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08dc3800-bc95-4447-ac15-adcfad092803 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:01.032824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08dc3800-bc95-4447-ac15-adcfad092803 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:01.035771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:22:01.104896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:22:01.680704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-08dc3800-bc95-4447-ac15-adcfad092803 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:01.701572 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-08dc3800-bc95-4447-ac15-adcfad092803 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1299 microversion: 2.1 time: 0.690479 Aug 02 07:22:01.709694 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2966/6008] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:01 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1299 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:02.732913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3ae7d00a-fea4-45d2-8c96-86307bdd7c6e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:02.735231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3ae7d00a-fea4-45d2-8c96-86307bdd7c6e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:02.751818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ae7d00a-fea4-45d2-8c96-86307bdd7c6e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:02.752280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ae7d00a-fea4-45d2-8c96-86307bdd7c6e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:02.753093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ae7d00a-fea4-45d2-8c96-86307bdd7c6e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:02.753535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ae7d00a-fea4-45d2-8c96-86307bdd7c6e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:02.965688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-df536335-b476-4e81-9323-22c31da7c072 req-66d4544c-b491-4a69-8801-7f7a2fa78ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d736bb6-be76-46f8-b05f-53cb3a10c418", "tag": "f8a75c6c-8f99-406d-b68e-d2291996fc1c"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:22:02.988374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-df536335-b476-4e81-9323-22c31da7c072 req-66d4544c-b491-4a69-8801-7f7a2fa78ed2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:02.989041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-df536335-b476-4e81-9323-22c31da7c072 req-66d4544c-b491-4a69-8801-7f7a2fa78ed2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:03.002278 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-df536335-b476-4e81-9323-22c31da7c072 req-66d4544c-b491-4a69-8801-7f7a2fa78ed2 service nova] Creating event network-changed:f8a75c6c-8f99-406d-b68e-d2291996fc1c for instance 9d736bb6-be76-46f8-b05f-53cb3a10c418 on n-h2-851337-3 Aug 02 07:22:03.025648 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-df536335-b476-4e81-9323-22c31da7c072 req-66d4544c-b491-4a69-8801-7f7a2fa78ed2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059484 Aug 02 07:22:03.029976 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2967/6009] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:22:03.224439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3ae7d00a-fea4-45d2-8c96-86307bdd7c6e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:03.249784 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3ae7d00a-fea4-45d2-8c96-86307bdd7c6e tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1299 microversion: 2.1 time: 0.517009 Aug 02 07:22:03.250544 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3043/6010] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:02 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1299 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:04.276257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6e5adeb4-15fc-41fa-8cf6-d3d7c3908fc6 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:04.277858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6e5adeb4-15fc-41fa-8cf6-d3d7c3908fc6 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:04.286170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e5adeb4-15fc-41fa-8cf6-d3d7c3908fc6 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:04.298422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e5adeb4-15fc-41fa-8cf6-d3d7c3908fc6 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:04.299282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e5adeb4-15fc-41fa-8cf6-d3d7c3908fc6 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:04.299921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e5adeb4-15fc-41fa-8cf6-d3d7c3908fc6 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:04.706114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6e5adeb4-15fc-41fa-8cf6-d3d7c3908fc6 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:04.715902 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6e5adeb4-15fc-41fa-8cf6-d3d7c3908fc6 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1299 microversion: 2.1 time: 0.443875 Aug 02 07:22:04.729926 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2968/6011] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:04 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1299 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:05.741335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bade869e-239c-423c-ac62-a4f43754aa4c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:05.743492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bade869e-239c-423c-ac62-a4f43754aa4c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:05.757025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:22:05.763073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bade869e-239c-423c-ac62-a4f43754aa4c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:05.764848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bade869e-239c-423c-ac62-a4f43754aa4c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:05.769175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bade869e-239c-423c-ac62-a4f43754aa4c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:05.782872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bade869e-239c-423c-ac62-a4f43754aa4c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:06.441088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bade869e-239c-423c-ac62-a4f43754aa4c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:06.458879 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bade869e-239c-423c-ac62-a4f43754aa4c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1299 microversion: 2.1 time: 0.721921 Aug 02 07:22:06.459674 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3044/6012] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:05 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1299 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:07.480558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d9f473fd-fa96-4188-a066-b8ce48f2c9e0 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:07.481279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d9f473fd-fa96-4188-a066-b8ce48f2c9e0 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:07.492064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9f473fd-fa96-4188-a066-b8ce48f2c9e0 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:07.492519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9f473fd-fa96-4188-a066-b8ce48f2c9e0 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:07.493304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9f473fd-fa96-4188-a066-b8ce48f2c9e0 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:07.520174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9f473fd-fa96-4188-a066-b8ce48f2c9e0 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:08.271254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d9f473fd-fa96-4188-a066-b8ce48f2c9e0 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:08.283319 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d9f473fd-fa96-4188-a066-b8ce48f2c9e0 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1299 microversion: 2.1 time: 0.806632 Aug 02 07:22:08.285310 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2969/6013] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:07 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1299 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:09.309219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a8786fc7-861a-43d3-8586-5f11be8a1599 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:09.309841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a8786fc7-861a-43d3-8586-5f11be8a1599 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:09.323115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8786fc7-861a-43d3-8586-5f11be8a1599 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:09.329340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8786fc7-861a-43d3-8586-5f11be8a1599 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:09.330401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8786fc7-861a-43d3-8586-5f11be8a1599 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:09.330863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8786fc7-861a-43d3-8586-5f11be8a1599 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:10.029267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a8786fc7-861a-43d3-8586-5f11be8a1599 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:10.052088 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a8786fc7-861a-43d3-8586-5f11be8a1599 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1299 microversion: 2.1 time: 0.746487 Aug 02 07:22:10.053505 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3045/6014] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:09 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1299 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:11.078916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7e52c59c-e12d-4d35-b2f1-1059db17185b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:11.079547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7e52c59c-e12d-4d35-b2f1-1059db17185b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:11.091794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e52c59c-e12d-4d35-b2f1-1059db17185b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:11.093316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e52c59c-e12d-4d35-b2f1-1059db17185b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:11.095900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e52c59c-e12d-4d35-b2f1-1059db17185b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:11.098878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e52c59c-e12d-4d35-b2f1-1059db17185b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:11.396895 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7e52c59c-e12d-4d35-b2f1-1059db17185b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:11.405767 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7e52c59c-e12d-4d35-b2f1-1059db17185b tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1299 microversion: 2.1 time: 0.333681 Aug 02 07:22:11.412000 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2970/6015] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:11 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1299 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:11.653398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-bb7009c6-c9a2-45a6-b4f6-b6e57318e552 req-295881ba-3c99-4989-90cb-4441e6608c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d736bb6-be76-46f8-b05f-53cb3a10c418", "name": "network-vif-plugged", "status": "completed", "tag": "f8a75c6c-8f99-406d-b68e-d2291996fc1c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:22:11.697296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-bb7009c6-c9a2-45a6-b4f6-b6e57318e552 req-295881ba-3c99-4989-90cb-4441e6608c12 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:11.697844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-bb7009c6-c9a2-45a6-b4f6-b6e57318e552 req-295881ba-3c99-4989-90cb-4441e6608c12 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:11.739694 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-bb7009c6-c9a2-45a6-b4f6-b6e57318e552 req-295881ba-3c99-4989-90cb-4441e6608c12 service nova] Creating event network-vif-plugged:f8a75c6c-8f99-406d-b68e-d2291996fc1c for instance 9d736bb6-be76-46f8-b05f-53cb3a10c418 on n-h2-851337-3 Aug 02 07:22:11.759942 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-bb7009c6-c9a2-45a6-b4f6-b6e57318e552 req-295881ba-3c99-4989-90cb-4441e6608c12 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113349 Aug 02 07:22:11.760578 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3046/6016] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:22:12.433293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-09cfa609-e260-4833-8e7b-3cf65e8c45ee tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:12.435017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-09cfa609-e260-4833-8e7b-3cf65e8c45ee tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:12.474580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09cfa609-e260-4833-8e7b-3cf65e8c45ee tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:12.479435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09cfa609-e260-4833-8e7b-3cf65e8c45ee tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:12.482153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09cfa609-e260-4833-8e7b-3cf65e8c45ee tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:12.487914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-09cfa609-e260-4833-8e7b-3cf65e8c45ee tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:12.699878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-09cfa609-e260-4833-8e7b-3cf65e8c45ee tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:12.715066 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-09cfa609-e260-4833-8e7b-3cf65e8c45ee tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1299 microversion: 2.1 time: 0.286524 Aug 02 07:22:12.732462 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2971/6017] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:12 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1299 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:13.740752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-66d08d80-da3a-4fc6-bcc6-9d9fefd0b4ab tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:13.741627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-66d08d80-da3a-4fc6-bcc6-9d9fefd0b4ab tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:13.755154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-66d08d80-da3a-4fc6-bcc6-9d9fefd0b4ab tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:13.760760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-66d08d80-da3a-4fc6-bcc6-9d9fefd0b4ab tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:13.761753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-66d08d80-da3a-4fc6-bcc6-9d9fefd0b4ab tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:13.762318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-66d08d80-da3a-4fc6-bcc6-9d9fefd0b4ab tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:14.051242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-66d08d80-da3a-4fc6-bcc6-9d9fefd0b4ab tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:14.059942 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-66d08d80-da3a-4fc6-bcc6-9d9fefd0b4ab tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1472 microversion: 2.1 time: 0.325008 Aug 02 07:22:14.088583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b176c131-36f2-4d13-92d5-700eed4b2879 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:14.089859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b176c131-36f2-4d13-92d5-700eed4b2879 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:14.093615 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3047/6018] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:13 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1472 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:14.103207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b176c131-36f2-4d13-92d5-700eed4b2879 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:14.111490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b176c131-36f2-4d13-92d5-700eed4b2879 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:14.112864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b176c131-36f2-4d13-92d5-700eed4b2879 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:14.116780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b176c131-36f2-4d13-92d5-700eed4b2879 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:14.417475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b176c131-36f2-4d13-92d5-700eed4b2879 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:14.436618 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b176c131-36f2-4d13-92d5-700eed4b2879 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1472 microversion: 2.1 time: 0.352474 Aug 02 07:22:14.442284 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2972/6019] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:14 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1472 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:14.460726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ef8d10ed-9fae-41fc-83df-329040480b45 tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:14.461364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ef8d10ed-9fae-41fc-83df-329040480b45 tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:14.471868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef8d10ed-9fae-41fc-83df-329040480b45 tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:14.472649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef8d10ed-9fae-41fc-83df-329040480b45 tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:14.479411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef8d10ed-9fae-41fc-83df-329040480b45 tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:14.480142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef8d10ed-9fae-41fc-83df-329040480b45 tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:14.820793 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ef8d10ed-9fae-41fc-83df-329040480b45 tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1623 microversion: 2.1 time: 0.366343 Aug 02 07:22:14.823966 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3048/6020] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:14 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1623 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:14.842314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-43e55c4f-8ce1-45f2-a4f5-a220ab2b20c6 tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:14.843446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-43e55c4f-8ce1-45f2-a4f5-a220ab2b20c6 tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:14.854939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43e55c4f-8ce1-45f2-a4f5-a220ab2b20c6 tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:14.857117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43e55c4f-8ce1-45f2-a4f5-a220ab2b20c6 tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:14.858201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43e55c4f-8ce1-45f2-a4f5-a220ab2b20c6 tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:14.861083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-43e55c4f-8ce1-45f2-a4f5-a220ab2b20c6 tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:15.547213 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-43e55c4f-8ce1-45f2-a4f5-a220ab2b20c6 tempest-TestSecurityGroupsBasicOps-579562826 tempest-TestSecurityGroupsBasicOps-579562826-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1913 microversion: 2.1 time: 0.708530 Aug 02 07:22:15.547870 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2973/6021] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:14 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1913 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:15.922960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7feabc6e-8e7e-4567-9516-cb96d597aefe tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:15.923570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7feabc6e-8e7e-4567-9516-cb96d597aefe tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:15.937030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7feabc6e-8e7e-4567-9516-cb96d597aefe tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:15.940265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7feabc6e-8e7e-4567-9516-cb96d597aefe tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:15.941762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7feabc6e-8e7e-4567-9516-cb96d597aefe tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:15.942524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7feabc6e-8e7e-4567-9516-cb96d597aefe tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:15.983526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7feabc6e-8e7e-4567-9516-cb96d597aefe tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:22:16.175254 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7feabc6e-8e7e-4567-9516-cb96d597aefe tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 204 len: 0 microversion: 2.1 time: 0.274366 Aug 02 07:22:16.176704 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3049/6022] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:22:15 2022] DELETE /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:22:16.185200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-74f86385-2b8a-43b9-9ab2-f2f0c4a20fb7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:16.186090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-74f86385-2b8a-43b9-9ab2-f2f0c4a20fb7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:16.205001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74f86385-2b8a-43b9-9ab2-f2f0c4a20fb7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:16.205458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74f86385-2b8a-43b9-9ab2-f2f0c4a20fb7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:16.206644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74f86385-2b8a-43b9-9ab2-f2f0c4a20fb7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:16.207114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74f86385-2b8a-43b9-9ab2-f2f0c4a20fb7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:16.456437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-74f86385-2b8a-43b9-9ab2-f2f0c4a20fb7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:16.466469 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-74f86385-2b8a-43b9-9ab2-f2f0c4a20fb7 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1478 microversion: 2.1 time: 0.285335 Aug 02 07:22:16.471900 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2974/6023] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:16 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1478 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:17.494483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b0e3ab90-ca35-42b5-a91a-3e244b78113c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:17.496129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b0e3ab90-ca35-42b5-a91a-3e244b78113c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:17.517041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0e3ab90-ca35-42b5-a91a-3e244b78113c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:17.521089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0e3ab90-ca35-42b5-a91a-3e244b78113c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:17.522844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0e3ab90-ca35-42b5-a91a-3e244b78113c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:17.523493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0e3ab90-ca35-42b5-a91a-3e244b78113c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:17.965876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b0e3ab90-ca35-42b5-a91a-3e244b78113c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:17.974865 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b0e3ab90-ca35-42b5-a91a-3e244b78113c tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1478 microversion: 2.1 time: 0.485319 Aug 02 07:22:17.989925 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3050/6024] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:17 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1478 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:18.998739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bf97f42f-b41d-430a-b27b-2a5d7ee0f768 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:19.000080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bf97f42f-b41d-430a-b27b-2a5d7ee0f768 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:19.012122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:22:19.014169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf97f42f-b41d-430a-b27b-2a5d7ee0f768 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:19.014617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf97f42f-b41d-430a-b27b-2a5d7ee0f768 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:19.017661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf97f42f-b41d-430a-b27b-2a5d7ee0f768 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:19.018148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf97f42f-b41d-430a-b27b-2a5d7ee0f768 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:19.037906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=65 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:22:19.305081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bf97f42f-b41d-430a-b27b-2a5d7ee0f768 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:19.317745 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bf97f42f-b41d-430a-b27b-2a5d7ee0f768 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1478 microversion: 2.1 time: 0.325069 Aug 02 07:22:19.340792 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2975/6025] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:18 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1478 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:20.343986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-99fbf25c-5cd9-4313-bffb-7ea602616a96 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:20.345389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-99fbf25c-5cd9-4313-bffb-7ea602616a96 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:20.355564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99fbf25c-5cd9-4313-bffb-7ea602616a96 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:20.356407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99fbf25c-5cd9-4313-bffb-7ea602616a96 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:20.357477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99fbf25c-5cd9-4313-bffb-7ea602616a96 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:20.358173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99fbf25c-5cd9-4313-bffb-7ea602616a96 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:20.575839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-99fbf25c-5cd9-4313-bffb-7ea602616a96 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:20.590306 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-99fbf25c-5cd9-4313-bffb-7ea602616a96 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 200 len: 1478 microversion: 2.1 time: 0.246986 Aug 02 07:22:20.591405 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3051/6026] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:20 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 1478 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:20.737163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-04d8baef-5057-4fd3-9414-3df84722084e req-58014721-cef8-4338-a099-77c39b445da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d736bb6-be76-46f8-b05f-53cb3a10c418", "name": "network-vif-deleted", "tag": "f8a75c6c-8f99-406d-b68e-d2291996fc1c"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:22:20.761231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-04d8baef-5057-4fd3-9414-3df84722084e req-58014721-cef8-4338-a099-77c39b445da0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:20.762183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-04d8baef-5057-4fd3-9414-3df84722084e req-58014721-cef8-4338-a099-77c39b445da0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:20.777875 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-04d8baef-5057-4fd3-9414-3df84722084e req-58014721-cef8-4338-a099-77c39b445da0 service nova] Creating event network-vif-deleted:f8a75c6c-8f99-406d-b68e-d2291996fc1c for instance 9d736bb6-be76-46f8-b05f-53cb3a10c418 on n-h2-851337-3 Aug 02 07:22:20.787529 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-04d8baef-5057-4fd3-9414-3df84722084e req-58014721-cef8-4338-a099-77c39b445da0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056337 Aug 02 07:22:20.788152 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2976/6027] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:22:21.616660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-50e39e88-5f91-48b4-aa9c-15d7d04eafb1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:21.617547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-50e39e88-5f91-48b4-aa9c-15d7d04eafb1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 9d736bb6-be76-46f8-b05f-53cb3a10c418] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:21.621869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:22:21.639224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50e39e88-5f91-48b4-aa9c-15d7d04eafb1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:21.640063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50e39e88-5f91-48b4-aa9c-15d7d04eafb1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:21.643765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50e39e88-5f91-48b4-aa9c-15d7d04eafb1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:21.651801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50e39e88-5f91-48b4-aa9c-15d7d04eafb1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:21.657604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:22:21.699060 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-50e39e88-5f91-48b4-aa9c-15d7d04eafb1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] HTTP exception thrown: Instance 9d736bb6-be76-46f8-b05f-53cb3a10c418 could not be found. Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-50e39e88-5f91-48b4-aa9c-15d7d04eafb1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Request method failure captured: Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 HTTP/1.1 Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6M_7okFLQoBFe7W_bisoyk_E1osrAheFdMl9tuGIMQaHjS6trym1Tphv0ssO18J_7k6UMEeROca5Yz1BB6QGc8V3n2mKYpzQmcniplQfK3bxfTmseDD1SzhNwf-4XjSti72QgA3EUnYTrNwrN4BIAgj-wH6iHzB8IitjR2LFxEJ4Owc Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: db58e49a483a42f884f9e945c883a8e7 Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1971778367 Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db58e49a483a42f884f9e945c883a8e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db58e49a483a42f884f9e945c883a8e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db58e49a483a42f884f9e945c883a8e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db58e49a483a42f884f9e945c883a8e7"}]}] Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1971778367 Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: db58e49a483a42f884f9e945c883a8e7 Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1971778367 Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestSecurityGroupsBasicOps-1971778367-project Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 58418aade898447398de5eb0aecc3798 Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1971778367-project Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 9d736bb6-be76-46f8-b05f-53cb3a10c418 could not be found. Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '9d736bb6-be76-46f8-b05f-53cb3a10c418'} Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d736bb6-be76-46f8-b05f-53cb3a10c418 could not be found. Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d736bb6-be76-46f8-b05f-53cb3a10c418 could not be found. Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:22:21.706439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:22:21.711815 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:22:21.711815 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:22:21.711815 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:22:21.711815 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:22:21.711815 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:22:21.711815 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:22:21.711815 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d736bb6-be76-46f8-b05f-53cb3a10c418 could not be found. Aug 02 07:22:21.711815 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:22:21.713710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-50e39e88-5f91-48b4-aa9c-15d7d04eafb1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Returning 404 to user: Instance 9d736bb6-be76-46f8-b05f-53cb3a10c418 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:22:21.714969 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-50e39e88-5f91-48b4-aa9c-15d7d04eafb1 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418" status: 404 len: 111 microversion: 2.1 time: 0.102949 Aug 02 07:22:21.716322 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3052/6028] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:21 2022] GET /compute/v2.1/servers/9d736bb6-be76-46f8-b05f-53cb3a10c418 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:22:28.597245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b0c63ab8-bc5c-4dd0-a144-5980e68fdd2d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:28.597751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b0c63ab8-bc5c-4dd0-a144-5980e68fdd2d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:28.621152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0c63ab8-bc5c-4dd0-a144-5980e68fdd2d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:28.621610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0c63ab8-bc5c-4dd0-a144-5980e68fdd2d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:28.627079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0c63ab8-bc5c-4dd0-a144-5980e68fdd2d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:28.627701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0c63ab8-bc5c-4dd0-a144-5980e68fdd2d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:28.840125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-b0c63ab8-bc5c-4dd0-a144-5980e68fdd2d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lazy-loading 'services' on Instance uuid 8658f0ef-e09e-4004-b5fd-170a5c216dc0 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:22:28.980538 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b0c63ab8-bc5c-4dd0-a144-5980e68fdd2d tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0/os-volume_attachments/d00eaab7-8ead-4d64-b456-c0798622c53c" status: 202 len: 0 microversion: 2.1 time: 0.388791 Aug 02 07:22:28.981230 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2977/6029] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:22:28 2022] DELETE /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0/os-volume_attachments/d00eaab7-8ead-4d64-b456-c0798622c53c => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:22:39.407852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e08f36a4-c7a2-4682-be9e-a2ed928ecbe2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:39.408465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e08f36a4-c7a2-4682-be9e-a2ed928ecbe2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:39.415660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:22:39.463660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e08f36a4-c7a2-4682-be9e-a2ed928ecbe2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:39.463857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e08f36a4-c7a2-4682-be9e-a2ed928ecbe2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:39.468647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e08f36a4-c7a2-4682-be9e-a2ed928ecbe2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:39.472392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e08f36a4-c7a2-4682-be9e-a2ed928ecbe2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:39.575778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e08f36a4-c7a2-4682-be9e-a2ed928ecbe2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:22:39.843104 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e08f36a4-c7a2-4682-be9e-a2ed928ecbe2 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 204 len: 0 microversion: 2.1 time: 0.445922 Aug 02 07:22:39.844219 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3053/6030] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:22:39 2022] DELETE /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:22:39.853304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0a17cc3c-8a2a-42d8-97d1-83be62bd9060 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:39.854755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0a17cc3c-8a2a-42d8-97d1-83be62bd9060 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:39.873549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=5 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:22:39.876381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:22:39.879553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a17cc3c-8a2a-42d8-97d1-83be62bd9060 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:39.881376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a17cc3c-8a2a-42d8-97d1-83be62bd9060 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:39.883807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a17cc3c-8a2a-42d8-97d1-83be62bd9060 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:39.884426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a17cc3c-8a2a-42d8-97d1-83be62bd9060 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:40.182685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0a17cc3c-8a2a-42d8-97d1-83be62bd9060 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:40.195209 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0a17cc3c-8a2a-42d8-97d1-83be62bd9060 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1469 microversion: 2.1 time: 0.346159 Aug 02 07:22:40.203016 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2978/6031] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:39 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1469 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:40.997733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-166ce262-a487-4994-bada-bf7584b0e170 req-ac37f4bf-2f68-49c0-bcbd-e904107a0988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10884d11-79f9-4213-be06-4ac8ac56515b", "tag": "c7d751b1-c882-400d-b408-2c110d2a2d66"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:22:40.998971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-281f9f76-a728-4ce1-a321-292ee26121af tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:40.999931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-281f9f76-a728-4ce1-a321-292ee26121af tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:41.028378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-281f9f76-a728-4ce1-a321-292ee26121af tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:41.029191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-281f9f76-a728-4ce1-a321-292ee26121af tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:41.032401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-281f9f76-a728-4ce1-a321-292ee26121af tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:41.032850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-281f9f76-a728-4ce1-a321-292ee26121af tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:41.035271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-166ce262-a487-4994-bada-bf7584b0e170 req-ac37f4bf-2f68-49c0-bcbd-e904107a0988 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:41.039469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-166ce262-a487-4994-bada-bf7584b0e170 req-ac37f4bf-2f68-49c0-bcbd-e904107a0988 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:41.073314 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-166ce262-a487-4994-bada-bf7584b0e170 req-ac37f4bf-2f68-49c0-bcbd-e904107a0988 service nova] Creating event network-changed:c7d751b1-c882-400d-b408-2c110d2a2d66 for instance 10884d11-79f9-4213-be06-4ac8ac56515b on n-h1-851337-3 Aug 02 07:22:41.091928 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-166ce262-a487-4994-bada-bf7584b0e170 req-ac37f4bf-2f68-49c0-bcbd-e904107a0988 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096512 Aug 02 07:22:41.098655 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2979/6032] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:22:41.158098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-281f9f76-a728-4ce1-a321-292ee26121af tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:22:41.227845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-37afd3c2-7f4f-4702-a34a-7a047ebffc6f tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:41.228845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-37afd3c2-7f4f-4702-a34a-7a047ebffc6f tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:41.249352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37afd3c2-7f4f-4702-a34a-7a047ebffc6f tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:41.254001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37afd3c2-7f4f-4702-a34a-7a047ebffc6f tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:41.256963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37afd3c2-7f4f-4702-a34a-7a047ebffc6f tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:41.258417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37afd3c2-7f4f-4702-a34a-7a047ebffc6f tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:41.468575 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-281f9f76-a728-4ce1-a321-292ee26121af tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "DELETE /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 204 len: 0 microversion: 2.1 time: 0.481206 Aug 02 07:22:41.476522 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3054/6033] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:22:40 2022] DELETE /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:22:41.489279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4bcbd9ff-298c-46e1-be2d-a9ed218d163a tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:41.490436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4bcbd9ff-298c-46e1-be2d-a9ed218d163a tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:41.500202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bcbd9ff-298c-46e1-be2d-a9ed218d163a tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:41.500965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bcbd9ff-298c-46e1-be2d-a9ed218d163a tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:41.502406 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bcbd9ff-298c-46e1-be2d-a9ed218d163a tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:41.503568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4bcbd9ff-298c-46e1-be2d-a9ed218d163a tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:42.313474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-37afd3c2-7f4f-4702-a34a-7a047ebffc6f tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:42.322028 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-37afd3c2-7f4f-4702-a34a-7a047ebffc6f tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1469 microversion: 2.1 time: 1.099022 Aug 02 07:22:42.330937 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2980/6034] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:41 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1469 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:42.486314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4bcbd9ff-298c-46e1-be2d-a9ed218d163a tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:42.501024 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4bcbd9ff-298c-46e1-be2d-a9ed218d163a tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1768 microversion: 2.1 time: 1.022801 Aug 02 07:22:42.503083 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3055/6035] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:41 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1768 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:43.360087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4a8949c7-6dc1-4c0e-991c-dd6fef1b2444 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:43.360718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4a8949c7-6dc1-4c0e-991c-dd6fef1b2444 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:43.373064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a8949c7-6dc1-4c0e-991c-dd6fef1b2444 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:43.373792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a8949c7-6dc1-4c0e-991c-dd6fef1b2444 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:43.374623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a8949c7-6dc1-4c0e-991c-dd6fef1b2444 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:43.375056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a8949c7-6dc1-4c0e-991c-dd6fef1b2444 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:43.524604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-23d8fcdb-746e-4c50-90e8-56b0f4355918 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:43.525143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-23d8fcdb-746e-4c50-90e8-56b0f4355918 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:43.538521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23d8fcdb-746e-4c50-90e8-56b0f4355918 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:43.538977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23d8fcdb-746e-4c50-90e8-56b0f4355918 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:43.539764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23d8fcdb-746e-4c50-90e8-56b0f4355918 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:43.540224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23d8fcdb-746e-4c50-90e8-56b0f4355918 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:43.564179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4a8949c7-6dc1-4c0e-991c-dd6fef1b2444 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be6b974e5af41bda0d27e11853789b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a9c77e5528457eb4e71889657b3cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:43.580814 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4a8949c7-6dc1-4c0e-991c-dd6fef1b2444 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 200 len: 1427 microversion: 2.1 time: 0.224809 Aug 02 07:22:43.600555 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2981/6036] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:43 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 1427 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:22:43.904758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-24ff4400-94db-49e3-9b02-c8dafeb44504 req-0e73cbb3-6db1-4188-bb5a-5521c5f4e551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8658f0ef-e09e-4004-b5fd-170a5c216dc0", "name": "network-vif-deleted", "tag": "cafe4a26-2533-4022-bad8-2ea639f08151"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:22:43.916248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-24ff4400-94db-49e3-9b02-c8dafeb44504 req-0e73cbb3-6db1-4188-bb5a-5521c5f4e551 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:43.916952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-24ff4400-94db-49e3-9b02-c8dafeb44504 req-0e73cbb3-6db1-4188-bb5a-5521c5f4e551 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:43.932085 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-24ff4400-94db-49e3-9b02-c8dafeb44504 req-0e73cbb3-6db1-4188-bb5a-5521c5f4e551 service nova] Creating event network-vif-deleted:cafe4a26-2533-4022-bad8-2ea639f08151 for instance 8658f0ef-e09e-4004-b5fd-170a5c216dc0 on n-h2-851337-3 Aug 02 07:22:43.938714 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-24ff4400-94db-49e3-9b02-c8dafeb44504 req-0e73cbb3-6db1-4188-bb5a-5521c5f4e551 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037207 Aug 02 07:22:43.939538 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2982/6037] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:22:44.175007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-23d8fcdb-746e-4c50-90e8-56b0f4355918 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58418aade898447398de5eb0aecc3798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db58e49a483a42f884f9e945c883a8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:22:44.189270 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-23d8fcdb-746e-4c50-90e8-56b0f4355918 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 200 len: 1649 microversion: 2.1 time: 0.668443 Aug 02 07:22:44.194523 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3056/6038] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:43 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 1649 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:22:44.513409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-88c37b80-5293-4bdd-a610-e3243df64954 req-4ca345f3-058b-4e53-8afa-546625092776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10884d11-79f9-4213-be06-4ac8ac56515b", "name": "network-vif-deleted", "tag": "c7d751b1-c882-400d-b408-2c110d2a2d66"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:22:44.544807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-88c37b80-5293-4bdd-a610-e3243df64954 req-4ca345f3-058b-4e53-8afa-546625092776 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:44.563392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-88c37b80-5293-4bdd-a610-e3243df64954 req-4ca345f3-058b-4e53-8afa-546625092776 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:44.600021 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-88c37b80-5293-4bdd-a610-e3243df64954 req-4ca345f3-058b-4e53-8afa-546625092776 service nova] Creating event network-vif-deleted:c7d751b1-c882-400d-b408-2c110d2a2d66 for instance 10884d11-79f9-4213-be06-4ac8ac56515b on n-h1-851337-3 Aug 02 07:22:44.609215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4a19d5a6-d45f-4c75-aa3e-17282a098571 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:44.610063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4a19d5a6-d45f-4c75-aa3e-17282a098571 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] [instance: 8658f0ef-e09e-4004-b5fd-170a5c216dc0] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:44.627298 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-88c37b80-5293-4bdd-a610-e3243df64954 req-4ca345f3-058b-4e53-8afa-546625092776 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120707 Aug 02 07:22:44.630750 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2983/6039] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:22:44.631510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a19d5a6-d45f-4c75-aa3e-17282a098571 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:44.633231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a19d5a6-d45f-4c75-aa3e-17282a098571 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:44.637607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a19d5a6-d45f-4c75-aa3e-17282a098571 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:44.641010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a19d5a6-d45f-4c75-aa3e-17282a098571 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:44.673803 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-4a19d5a6-d45f-4c75-aa3e-17282a098571 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] HTTP exception thrown: Instance 8658f0ef-e09e-4004-b5fd-170a5c216dc0 could not be found. Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4a19d5a6-d45f-4c75-aa3e-17282a098571 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Request method failure captured: Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 HTTP/1.1 Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NAeeJXOhOTli5YwnuxV-YpYvXOUKUxsTQMukIfQCaaodibtUsG0h-UuhtIvHqc0aLxBoWzW-mXhe737s68BwSyS81wid2ryjRpPLAyJJ6kF7bM6WfaFpCbxwS5tkf4G2JoR_z69-xkg5qwxPBTN3cxOf5ZFlWgYGzy19lF26o0HLbA Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 51a9c77e5528457eb4e71889657b3cba Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-VolumesBackupsTest-202816073 Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/51a9c77e5528457eb4e71889657b3cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/51a9c77e5528457eb4e71889657b3cba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_51a9c77e5528457eb4e71889657b3cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/51a9c77e5528457eb4e71889657b3cba"}]}] Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-VolumesBackupsTest-202816073 Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 51a9c77e5528457eb4e71889657b3cba Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-VolumesBackupsTest-202816073 Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-VolumesBackupsTest-202816073-project Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 5be6b974e5af41bda0d27e11853789b5 Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-VolumesBackupsTest-202816073-project Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 8658f0ef-e09e-4004-b5fd-170a5c216dc0 could not be found. Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '8658f0ef-e09e-4004-b5fd-170a5c216dc0'} Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8658f0ef-e09e-4004-b5fd-170a5c216dc0 could not be found. Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8658f0ef-e09e-4004-b5fd-170a5c216dc0 could not be found. Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:22:44.681241 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:22:44.691681 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:22:44.691681 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:22:44.691681 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:22:44.691681 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:22:44.691681 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:22:44.691681 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8658f0ef-e09e-4004-b5fd-170a5c216dc0 could not be found. Aug 02 07:22:44.691681 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:22:44.691681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4a19d5a6-d45f-4c75-aa3e-17282a098571 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] Returning 404 to user: Instance 8658f0ef-e09e-4004-b5fd-170a5c216dc0 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:22:44.691681 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4a19d5a6-d45f-4c75-aa3e-17282a098571 tempest-VolumesBackupsTest-202816073 tempest-VolumesBackupsTest-202816073-project] 10.222.0.79 "GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0" status: 404 len: 111 microversion: 2.1 time: 0.078959 Aug 02 07:22:44.691681 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3057/6040] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:44 2022] GET /compute/v2.1/servers/8658f0ef-e09e-4004-b5fd-170a5c216dc0 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:22:45.223942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1ec960a-484a-44d0-b9b2-fe89a5744089 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:45.226516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b1ec960a-484a-44d0-b9b2-fe89a5744089 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] [instance: 10884d11-79f9-4213-be06-4ac8ac56515b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:22:45.253950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1ec960a-484a-44d0-b9b2-fe89a5744089 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:45.254428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1ec960a-484a-44d0-b9b2-fe89a5744089 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:45.256468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1ec960a-484a-44d0-b9b2-fe89a5744089 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:22:45.257303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1ec960a-484a-44d0-b9b2-fe89a5744089 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:22:45.288373 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-b1ec960a-484a-44d0-b9b2-fe89a5744089 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] HTTP exception thrown: Instance 10884d11-79f9-4213-be06-4ac8ac56515b could not be found. Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1ec960a-484a-44d0-b9b2-fe89a5744089 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Request method failure captured: Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b HTTP/1.1 Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6M_7okFLQoBFe7W_bisoyk_E1osrAheFdMl9tuGIMQaHjS6trym1Tphv0ssO18J_7k6UMEeROca5Yz1BB6QGc8V3n2mKYpzQmcniplQfK3bxfTmseDD1SzhNwf-4XjSti72QgA3EUnYTrNwrN4BIAgj-wH6iHzB8IitjR2LFxEJ4Owc Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: db58e49a483a42f884f9e945c883a8e7 Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1971778367 Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db58e49a483a42f884f9e945c883a8e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db58e49a483a42f884f9e945c883a8e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db58e49a483a42f884f9e945c883a8e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db58e49a483a42f884f9e945c883a8e7"}]}] Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1971778367 Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: db58e49a483a42f884f9e945c883a8e7 Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1971778367 Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestSecurityGroupsBasicOps-1971778367-project Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 58418aade898447398de5eb0aecc3798 Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1971778367-project Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 10884d11-79f9-4213-be06-4ac8ac56515b could not be found. Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '10884d11-79f9-4213-be06-4ac8ac56515b'} Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10884d11-79f9-4213-be06-4ac8ac56515b could not be found. Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10884d11-79f9-4213-be06-4ac8ac56515b could not be found. Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:22:45.291675 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:22:45.296831 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:22:45.296831 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:22:45.296831 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:22:45.296831 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:22:45.296831 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:22:45.296831 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:22:45.296831 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10884d11-79f9-4213-be06-4ac8ac56515b could not be found. Aug 02 07:22:45.296831 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:22:45.299890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1ec960a-484a-44d0-b9b2-fe89a5744089 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Returning 404 to user: Instance 10884d11-79f9-4213-be06-4ac8ac56515b could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:22:45.301181 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b1ec960a-484a-44d0-b9b2-fe89a5744089 tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b" status: 404 len: 111 microversion: 2.1 time: 0.085099 Aug 02 07:22:45.305996 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2984/6041] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:22:45 2022] GET /compute/v2.1/servers/10884d11-79f9-4213-be06-4ac8ac56515b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:22:46.063881 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:22:46.066467 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 07:22:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:22:47.094217 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:22:47.094746 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 07:22:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:22:47.174999 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:22:47.175259 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 07:22:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:22:56.802307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-38906920-8b67-4fea-a4ed-99819a61435d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] Calling method '.version_select at 0x7f928c299b80>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:22:56.819787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:22:56.822476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:22:56.867287 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-38906920-8b67-4fea-a4ed-99819a61435d tempest-TestSecurityGroupsBasicOps-1971778367 tempest-TestSecurityGroupsBasicOps-1971778367-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-312687304" status: 202 len: 0 microversion: 2.1 time: 0.065788 Aug 02 07:22:56.874159 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3058/6042] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 07:22:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-312687304 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:24:26.144574 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:24:26.145095 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 07:24:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:25:32.252970 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52c7fbf0-ab5b-40ba-9153-7d2f92273477] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 07:25:32.253874 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ad41dfa6-acfa-4002-ab8d-84c3526bc6c6] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 07:25:32.254718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=14 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:25:32.255698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=26 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:25:32.267377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1307044971", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:25:32.434756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] validate_networks() for None {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:25:33.268422 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] [52c7fbf0-ab5b-40ba-9153-7d2f92273477] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 54590. Aug 02 07:25:33.270971 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] [ad41dfa6-acfa-4002-ab8d-84c3526bc6c6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 54592. Aug 02 07:25:34.083986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:25:34.084662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:25:34.085294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:25:34.087922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:25:34.088530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:25:34.105747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:34.110023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:34.110964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:34.111407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:34.184522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Getting quotas for project e34e83510fc54aa48f279f6f8293cd51. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:25:34.208097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Getting quotas for user 48da17e5c61e4776b4a62e819ad54f19 and project e34e83510fc54aa48f279f6f8293cd51. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:25:34.270577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:25:34.275939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:25:34.371736 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-766bec5f-fa58-401d-a930-03e86194337b tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.120863 Aug 02 07:25:34.373337 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2985/6043] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:25:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:25:34.382936 n-d-851337-3 devstack@n-api.service[126120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da609bec-98c7-4964-8d17-beefad60c655] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 07:25:34.387736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ed1b94a2-c028-4c0a-b74f-d877266298ae tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:34.388542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ed1b94a2-c028-4c0a-b74f-d877266298ae tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:34.400629 n-d-851337-3 devstack@n-api.service[126120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c0c3e5c9-f933-4314-bd57-3d2ecb041378] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 07:25:34.572493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ed1b94a2-c028-4c0a-b74f-d877266298ae tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:34.579903 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ed1b94a2-c028-4c0a-b74f-d877266298ae tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1215 microversion: 2.1 time: 0.199580 Aug 02 07:25:34.582840 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3059/6044] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:34 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:35.610231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d128c761-1d36-42f4-91b5-5896be86a654 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:35.611555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d128c761-1d36-42f4-91b5-5896be86a654 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:35.766220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d128c761-1d36-42f4-91b5-5896be86a654 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:35.794663 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d128c761-1d36-42f4-91b5-5896be86a654 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1215 microversion: 2.1 time: 0.190511 Aug 02 07:25:35.797505 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2986/6045] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:35 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:36.817449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cad79036-888c-477a-8f84-0e5565e11053 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:36.818148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cad79036-888c-477a-8f84-0e5565e11053 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:36.851045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cad79036-888c-477a-8f84-0e5565e11053 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:36.854379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cad79036-888c-477a-8f84-0e5565e11053 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:36.855461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cad79036-888c-477a-8f84-0e5565e11053 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:36.858488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cad79036-888c-477a-8f84-0e5565e11053 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:36.937000 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] [c0c3e5c9-f933-4314-bd57-3d2ecb041378] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 54656. Aug 02 07:25:36.939513 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] [da609bec-98c7-4964-8d17-beefad60c655] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 54654. Aug 02 07:25:37.059513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cad79036-888c-477a-8f84-0e5565e11053 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:37.068224 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cad79036-888c-477a-8f84-0e5565e11053 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1275 microversion: 2.1 time: 0.255154 Aug 02 07:25:37.069389 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3060/6046] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:36 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:38.090434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-92f262fa-5850-4f99-a65c-9e70ff12890d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:38.095345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-92f262fa-5850-4f99-a65c-9e70ff12890d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:38.122704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92f262fa-5850-4f99-a65c-9e70ff12890d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:38.122974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92f262fa-5850-4f99-a65c-9e70ff12890d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:38.123826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92f262fa-5850-4f99-a65c-9e70ff12890d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:38.124355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92f262fa-5850-4f99-a65c-9e70ff12890d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:38.567152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-92f262fa-5850-4f99-a65c-9e70ff12890d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:38.587359 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-92f262fa-5850-4f99-a65c-9e70ff12890d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1273 microversion: 2.1 time: 0.500651 Aug 02 07:25:38.592194 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2987/6047] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:38 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1273 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:39.613922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-99ecec9c-a841-425d-b760-6f47773c5766 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:39.614677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-99ecec9c-a841-425d-b760-6f47773c5766 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:39.625772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99ecec9c-a841-425d-b760-6f47773c5766 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:39.626256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99ecec9c-a841-425d-b760-6f47773c5766 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:39.630877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99ecec9c-a841-425d-b760-6f47773c5766 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:39.632770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99ecec9c-a841-425d-b760-6f47773c5766 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:40.919714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-99ecec9c-a841-425d-b760-6f47773c5766 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:40.944711 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-99ecec9c-a841-425d-b760-6f47773c5766 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1315 microversion: 2.1 time: 1.335661 Aug 02 07:25:40.945358 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3061/6048] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:39 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1315 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:41.970978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-76ca8e6d-9f34-49dd-8fe4-a2c5a9045481 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:41.971599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-76ca8e6d-9f34-49dd-8fe4-a2c5a9045481 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:41.982821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76ca8e6d-9f34-49dd-8fe4-a2c5a9045481 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:41.992623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76ca8e6d-9f34-49dd-8fe4-a2c5a9045481 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:41.994475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76ca8e6d-9f34-49dd-8fe4-a2c5a9045481 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:41.994926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76ca8e6d-9f34-49dd-8fe4-a2c5a9045481 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:42.207543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-dc0742e3-c0c4-4227-8198-5bf7b43b98ca req-2bba1128-b07c-40a3-8f61-a1b223a1483f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41c69a9f-4b32-4511-a507-3c7ac2f68d63", "tag": "6a706a8d-41fc-463e-ad11-506c081f11a1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:25:42.230840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-dc0742e3-c0c4-4227-8198-5bf7b43b98ca req-2bba1128-b07c-40a3-8f61-a1b223a1483f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:42.231221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-dc0742e3-c0c4-4227-8198-5bf7b43b98ca req-2bba1128-b07c-40a3-8f61-a1b223a1483f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:42.275648 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-dc0742e3-c0c4-4227-8198-5bf7b43b98ca req-2bba1128-b07c-40a3-8f61-a1b223a1483f service nova] Creating event network-changed:6a706a8d-41fc-463e-ad11-506c081f11a1 for instance 41c69a9f-4b32-4511-a507-3c7ac2f68d63 on n-h2-851337-3 Aug 02 07:25:42.286655 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-dc0742e3-c0c4-4227-8198-5bf7b43b98ca req-2bba1128-b07c-40a3-8f61-a1b223a1483f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.507778 Aug 02 07:25:42.290246 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2988/6049] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:25:42.695397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-76ca8e6d-9f34-49dd-8fe4-a2c5a9045481 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:42.706392 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-76ca8e6d-9f34-49dd-8fe4-a2c5a9045481 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1315 microversion: 2.1 time: 0.739380 Aug 02 07:25:42.715162 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3062/6050] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:41 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1315 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:43.731592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-89d838e9-7b36-491f-8af9-d13745b1c520 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:43.732573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-89d838e9-7b36-491f-8af9-d13745b1c520 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:43.749204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89d838e9-7b36-491f-8af9-d13745b1c520 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:43.753958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89d838e9-7b36-491f-8af9-d13745b1c520 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:43.755416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89d838e9-7b36-491f-8af9-d13745b1c520 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:43.756050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-89d838e9-7b36-491f-8af9-d13745b1c520 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:44.154494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:25:44.283063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-89d838e9-7b36-491f-8af9-d13745b1c520 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:44.296335 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-89d838e9-7b36-491f-8af9-d13745b1c520 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1315 microversion: 2.1 time: 0.567253 Aug 02 07:25:44.297611 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2989/6051] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:43 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:45.320128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3c73f414-1938-4dac-8dc8-991ae8d5aea7 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:45.321218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3c73f414-1938-4dac-8dc8-991ae8d5aea7 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:45.323985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:25:45.333495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c73f414-1938-4dac-8dc8-991ae8d5aea7 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:45.333975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c73f414-1938-4dac-8dc8-991ae8d5aea7 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:45.334750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c73f414-1938-4dac-8dc8-991ae8d5aea7 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:45.335178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3c73f414-1938-4dac-8dc8-991ae8d5aea7 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:45.660378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3c73f414-1938-4dac-8dc8-991ae8d5aea7 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:45.673485 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3c73f414-1938-4dac-8dc8-991ae8d5aea7 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1315 microversion: 2.1 time: 0.357966 Aug 02 07:25:45.674079 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3063/6052] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:45 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:46.699485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-566364de-568f-43af-9651-37efd920d966 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:46.700102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-566364de-568f-43af-9651-37efd920d966 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:46.703076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=8 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:25:46.718702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-566364de-568f-43af-9651-37efd920d966 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:46.719448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-566364de-568f-43af-9651-37efd920d966 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:46.720927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-566364de-568f-43af-9651-37efd920d966 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:46.721354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-566364de-568f-43af-9651-37efd920d966 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:46.952492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-566364de-568f-43af-9651-37efd920d966 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:46.965718 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-566364de-568f-43af-9651-37efd920d966 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1315 microversion: 2.1 time: 0.270060 Aug 02 07:25:46.979084 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2990/6053] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:46 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:47.989060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e655b1b5-c6cb-4b09-8a80-b8ad5ef813ec tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:47.990914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e655b1b5-c6cb-4b09-8a80-b8ad5ef813ec tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:48.019123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e655b1b5-c6cb-4b09-8a80-b8ad5ef813ec tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:48.019702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e655b1b5-c6cb-4b09-8a80-b8ad5ef813ec tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:48.020499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e655b1b5-c6cb-4b09-8a80-b8ad5ef813ec tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:48.020930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e655b1b5-c6cb-4b09-8a80-b8ad5ef813ec tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:48.270891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ca153008-f58b-4a80-b254-083f4f6e7250 req-ecd47f1b-beae-49ca-b762-94a31f2716bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41c69a9f-4b32-4511-a507-3c7ac2f68d63", "name": "network-vif-plugged", "status": "completed", "tag": "6a706a8d-41fc-463e-ad11-506c081f11a1"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:25:48.289611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ca153008-f58b-4a80-b254-083f4f6e7250 req-ecd47f1b-beae-49ca-b762-94a31f2716bf service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:48.293627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ca153008-f58b-4a80-b254-083f4f6e7250 req-ecd47f1b-beae-49ca-b762-94a31f2716bf service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:48.317265 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ca153008-f58b-4a80-b254-083f4f6e7250 req-ecd47f1b-beae-49ca-b762-94a31f2716bf service nova] Creating event network-vif-plugged:6a706a8d-41fc-463e-ad11-506c081f11a1 for instance 41c69a9f-4b32-4511-a507-3c7ac2f68d63 on n-h2-851337-3 Aug 02 07:25:48.325063 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ca153008-f58b-4a80-b254-083f4f6e7250 req-ecd47f1b-beae-49ca-b762-94a31f2716bf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256782 Aug 02 07:25:48.331108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e655b1b5-c6cb-4b09-8a80-b8ad5ef813ec tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:48.342000 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e655b1b5-c6cb-4b09-8a80-b8ad5ef813ec tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1315 microversion: 2.1 time: 0.357378 Aug 02 07:25:48.344477 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2991/6054] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:25:48.350546 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3064/6055] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:47 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:49.375549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f47692da-93a8-4914-87e6-7e31cb758a8d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:49.383857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f47692da-93a8-4914-87e6-7e31cb758a8d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:49.391687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f47692da-93a8-4914-87e6-7e31cb758a8d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:49.392141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f47692da-93a8-4914-87e6-7e31cb758a8d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:49.392922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f47692da-93a8-4914-87e6-7e31cb758a8d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:49.398015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f47692da-93a8-4914-87e6-7e31cb758a8d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:49.769551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f47692da-93a8-4914-87e6-7e31cb758a8d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:49.786386 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f47692da-93a8-4914-87e6-7e31cb758a8d tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1315 microversion: 2.1 time: 0.422172 Aug 02 07:25:49.800656 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2992/6056] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:49 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:50.807535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ac77e6ab-baa3-4eca-83d1-556bdbf586ee tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:50.808271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ac77e6ab-baa3-4eca-83d1-556bdbf586ee tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:50.825715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac77e6ab-baa3-4eca-83d1-556bdbf586ee tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:50.826461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac77e6ab-baa3-4eca-83d1-556bdbf586ee tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:50.827255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac77e6ab-baa3-4eca-83d1-556bdbf586ee tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:50.828066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac77e6ab-baa3-4eca-83d1-556bdbf586ee tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:51.052638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ac77e6ab-baa3-4eca-83d1-556bdbf586ee tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:51.062008 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ac77e6ab-baa3-4eca-83d1-556bdbf586ee tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1465 microversion: 2.1 time: 0.258653 Aug 02 07:25:51.068669 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3065/6057] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:50 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1465 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:51.121191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a52efb4e-c751-4b0e-8fad-156412664a4f tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:51.121706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a52efb4e-c751-4b0e-8fad-156412664a4f tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:51.134378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a52efb4e-c751-4b0e-8fad-156412664a4f tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:51.135910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a52efb4e-c751-4b0e-8fad-156412664a4f tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:51.137577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a52efb4e-c751-4b0e-8fad-156412664a4f tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:51.139008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a52efb4e-c751-4b0e-8fad-156412664a4f tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:51.208011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a52efb4e-c751-4b0e-8fad-156412664a4f tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:25:51.386478 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a52efb4e-c751-4b0e-8fad-156412664a4f tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "DELETE /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 204 len: 0 microversion: 2.1 time: 0.268610 Aug 02 07:25:51.387309 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2993/6058] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:25:51 2022] DELETE /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:25:51.396211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-67dc9e5a-ddd3-45b4-90fc-c255b15c9ddb tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:51.396859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-67dc9e5a-ddd3-45b4-90fc-c255b15c9ddb tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:51.407606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-67dc9e5a-ddd3-45b4-90fc-c255b15c9ddb tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:51.410204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-67dc9e5a-ddd3-45b4-90fc-c255b15c9ddb tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:51.411053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-67dc9e5a-ddd3-45b4-90fc-c255b15c9ddb tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:51.411513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-67dc9e5a-ddd3-45b4-90fc-c255b15c9ddb tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:51.684535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-67dc9e5a-ddd3-45b4-90fc-c255b15c9ddb tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:51.695077 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-67dc9e5a-ddd3-45b4-90fc-c255b15c9ddb tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1471 microversion: 2.1 time: 0.302907 Aug 02 07:25:51.698867 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3066/6059] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:51 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1471 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:52.727582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b602f71c-29ed-4ca5-ba64-fe0d184585ba tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:52.728518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b602f71c-29ed-4ca5-ba64-fe0d184585ba tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:52.744308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b602f71c-29ed-4ca5-ba64-fe0d184585ba tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:52.744876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b602f71c-29ed-4ca5-ba64-fe0d184585ba tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:52.745982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b602f71c-29ed-4ca5-ba64-fe0d184585ba tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:52.746427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b602f71c-29ed-4ca5-ba64-fe0d184585ba tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:53.333657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b602f71c-29ed-4ca5-ba64-fe0d184585ba tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:53.341929 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b602f71c-29ed-4ca5-ba64-fe0d184585ba tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1471 microversion: 2.1 time: 0.621873 Aug 02 07:25:53.342719 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2994/6060] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:52 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1471 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:53.906476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-4fa6b550-212e-45c0-a98d-220c0f2e2a23 req-38c49e28-ce25-4af2-a7d5-270b93895da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41c69a9f-4b32-4511-a507-3c7ac2f68d63", "name": "network-vif-deleted", "tag": "6a706a8d-41fc-463e-ad11-506c081f11a1"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:25:53.928396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4fa6b550-212e-45c0-a98d-220c0f2e2a23 req-38c49e28-ce25-4af2-a7d5-270b93895da6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:53.933535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4fa6b550-212e-45c0-a98d-220c0f2e2a23 req-38c49e28-ce25-4af2-a7d5-270b93895da6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:53.976421 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-4fa6b550-212e-45c0-a98d-220c0f2e2a23 req-38c49e28-ce25-4af2-a7d5-270b93895da6 service nova] Creating event network-vif-deleted:6a706a8d-41fc-463e-ad11-506c081f11a1 for instance 41c69a9f-4b32-4511-a507-3c7ac2f68d63 on n-h2-851337-3 Aug 02 07:25:53.994311 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-4fa6b550-212e-45c0-a98d-220c0f2e2a23 req-38c49e28-ce25-4af2-a7d5-270b93895da6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091690 Aug 02 07:25:53.995258 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3067/6061] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:25:54.363335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-293ee218-e733-4934-b7e1-ac18c003c637 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:54.365168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-293ee218-e733-4934-b7e1-ac18c003c637 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:54.380868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-293ee218-e733-4934-b7e1-ac18c003c637 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:54.381335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-293ee218-e733-4934-b7e1-ac18c003c637 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:54.387509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-293ee218-e733-4934-b7e1-ac18c003c637 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:54.388355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-293ee218-e733-4934-b7e1-ac18c003c637 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:54.460573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-293ee218-e733-4934-b7e1-ac18c003c637 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:54.461201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-293ee218-e733-4934-b7e1-ac18c003c637 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:54.461828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-293ee218-e733-4934-b7e1-ac18c003c637 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lazy-loading 'fault' on Instance uuid 41c69a9f-4b32-4511-a507-3c7ac2f68d63 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:25:54.521528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-293ee218-e733-4934-b7e1-ac18c003c637 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48da17e5c61e4776b4a62e819ad54f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34e83510fc54aa48f279f6f8293cd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:25:54.531174 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-293ee218-e733-4934-b7e1-ac18c003c637 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 200 len: 1305 microversion: 2.1 time: 0.172182 Aug 02 07:25:54.532375 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2995/6062] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:54 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 1305 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:25:55.553842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c1116e23-8ac8-4ae8-81bc-ab8dc5e18b42 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:25:55.555657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c1116e23-8ac8-4ae8-81bc-ab8dc5e18b42 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] [instance: 41c69a9f-4b32-4511-a507-3c7ac2f68d63] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:25:55.571032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1116e23-8ac8-4ae8-81bc-ab8dc5e18b42 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:55.571983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1116e23-8ac8-4ae8-81bc-ab8dc5e18b42 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:55.573548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1116e23-8ac8-4ae8-81bc-ab8dc5e18b42 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:25:55.574337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1116e23-8ac8-4ae8-81bc-ab8dc5e18b42 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:25:55.596463 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-c1116e23-8ac8-4ae8-81bc-ab8dc5e18b42 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] HTTP exception thrown: Instance 41c69a9f-4b32-4511-a507-3c7ac2f68d63 could not be found. Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c1116e23-8ac8-4ae8-81bc-ab8dc5e18b42 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Request method failure captured: Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 HTTP/1.1 Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NFo3IY6G7RfdkKt_yqsBt38lZqp8VzIifwTYl2PbKup2EoacxzDsU-722qUTyfEAcglBi1Jeh7KmmxfTI19m6WGDHja8oEimabV3GMyOcKGAQmD8760r4lf5hZx34rRdT7jM70jSz39q2rkQi0zk4xmG9IE1kDeU0Pv8l0zn8MRH3g Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: e34e83510fc54aa48f279f6f8293cd51 Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-VolumesNegativeTest-1550902345 Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e34e83510fc54aa48f279f6f8293cd51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e34e83510fc54aa48f279f6f8293cd51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e34e83510fc54aa48f279f6f8293cd51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e34e83510fc54aa48f279f6f8293cd51"}]}] Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-VolumesNegativeTest-1550902345 Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: e34e83510fc54aa48f279f6f8293cd51 Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-VolumesNegativeTest-1550902345 Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-VolumesNegativeTest-1550902345-project Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 48da17e5c61e4776b4a62e819ad54f19 Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-VolumesNegativeTest-1550902345-project Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 41c69a9f-4b32-4511-a507-3c7ac2f68d63 could not be found. Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '41c69a9f-4b32-4511-a507-3c7ac2f68d63'} Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41c69a9f-4b32-4511-a507-3c7ac2f68d63 could not be found. Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41c69a9f-4b32-4511-a507-3c7ac2f68d63 could not be found. Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:25:55.599018 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:25:55.602732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:25:55.602732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:25:55.602732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:25:55.602732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:25:55.602732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:25:55.602732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41c69a9f-4b32-4511-a507-3c7ac2f68d63 could not be found. Aug 02 07:25:55.602732 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:25:55.605380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c1116e23-8ac8-4ae8-81bc-ab8dc5e18b42 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] Returning 404 to user: Instance 41c69a9f-4b32-4511-a507-3c7ac2f68d63 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:25:55.606570 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c1116e23-8ac8-4ae8-81bc-ab8dc5e18b42 tempest-VolumesNegativeTest-1550902345 tempest-VolumesNegativeTest-1550902345-project] 10.222.0.79 "GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63" status: 404 len: 111 microversion: 2.1 time: 0.057536 Aug 02 07:25:55.607722 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3068/6063] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:25:55 2022] GET /compute/v2.1/servers/41c69a9f-4b32-4511-a507-3c7ac2f68d63 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:26:06.077244 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:26:06.078111 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 07:26:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:26:07.104323 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:26:07.104879 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 07:26:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:26:07.184572 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:26:07.185098 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 07:26:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:26:11.638691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:11.639783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:12.154085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-29fc3305-2880-46c1-a7f9-f237fafad719 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:12.155328 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:26:12.155328 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 07:26:12.157743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29fc3305-2880-46c1-a7f9-f237fafad719 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:12.158772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29fc3305-2880-46c1-a7f9-f237fafad719 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:12.159760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29fc3305-2880-46c1-a7f9-f237fafad719 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:12.171863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29fc3305-2880-46c1-a7f9-f237fafad719 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:12.292209 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-29fc3305-2880-46c1-a7f9-f237fafad719 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.656761 Aug 02 07:26:12.294860 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2996/6064] 10.222.0.79 () {58 vars in 1185 bytes} [Tue Aug 2 07:26:11 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:26:12.557238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-454375214", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "availability_zone": "nova:n-h2-851337-3", "networks": [{"uuid": "26eead16-19d2-42be-b941-93c402f87b05"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:26:12.577496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:12.578188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=46 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:12.693933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] validate_networks() for [('26eead16-19d2-42be-b941-93c402f87b05', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:26:13.848626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:26:13.849292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:26:13.849510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:26:13.854289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:26:13.854987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:26:13.881060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:13.882162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:13.883729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:13.884353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:13.910211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Getting quotas for project cd06840f7a2d4a9aa9dd62e06dfb2549. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:26:13.917872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Getting quotas for user 065ae734106843be9e076edb0e198e35 and project cd06840f7a2d4a9aa9dd62e06dfb2549. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:26:13.933534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:26:13.936391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:26:14.040812 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bbc2c535-ce64-4c25-a8aa-0b88b4cc6d50 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.488264 Aug 02 07:26:14.041382 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3069/6065] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:26:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:26:14.055099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d01eff01-98a7-42b6-89db-7f4e4906fe79 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:14.056799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d01eff01-98a7-42b6-89db-7f4e4906fe79 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:14.257747 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d01eff01-98a7-42b6-89db-7f4e4906fe79 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1328 microversion: 2.1 time: 0.206849 Aug 02 07:26:14.258209 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2997/6066] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:14 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1328 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:15.283551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7d3a6e59-5b03-436f-905d-aee546033778 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:15.286360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7d3a6e59-5b03-436f-905d-aee546033778 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:15.313557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d3a6e59-5b03-436f-905d-aee546033778 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:15.318218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d3a6e59-5b03-436f-905d-aee546033778 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:15.320222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d3a6e59-5b03-436f-905d-aee546033778 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:15.320691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d3a6e59-5b03-436f-905d-aee546033778 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:15.542404 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7d3a6e59-5b03-436f-905d-aee546033778 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1345 microversion: 2.1 time: 0.263288 Aug 02 07:26:15.559435 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3070/6067] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:15 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1345 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:16.571606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-318f92e6-0576-4645-99f3-61c92c0e0e47 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:16.572822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-318f92e6-0576-4645-99f3-61c92c0e0e47 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:16.627864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-318f92e6-0576-4645-99f3-61c92c0e0e47 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:16.628319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-318f92e6-0576-4645-99f3-61c92c0e0e47 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:16.629122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-318f92e6-0576-4645-99f3-61c92c0e0e47 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:16.629560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-318f92e6-0576-4645-99f3-61c92c0e0e47 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:16.925198 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-318f92e6-0576-4645-99f3-61c92c0e0e47 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1423 microversion: 2.1 time: 0.358804 Aug 02 07:26:16.929690 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2998/6068] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:16 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1423 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:17.951655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8ba49971-5b2a-40ca-861c-a28efa2c8092 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:17.952972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8ba49971-5b2a-40ca-861c-a28efa2c8092 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:17.962992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ba49971-5b2a-40ca-861c-a28efa2c8092 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:17.965699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ba49971-5b2a-40ca-861c-a28efa2c8092 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:17.969622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ba49971-5b2a-40ca-861c-a28efa2c8092 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:17.971773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ba49971-5b2a-40ca-861c-a28efa2c8092 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:18.338828 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8ba49971-5b2a-40ca-861c-a28efa2c8092 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1421 microversion: 2.1 time: 0.391144 Aug 02 07:26:18.339445 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3071/6069] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:17 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1421 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:19.360636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-76e1e843-6517-4f9b-9c66-0b61e3e7be57 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:19.361258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-76e1e843-6517-4f9b-9c66-0b61e3e7be57 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:19.378281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76e1e843-6517-4f9b-9c66-0b61e3e7be57 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:19.378733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76e1e843-6517-4f9b-9c66-0b61e3e7be57 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:19.379519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76e1e843-6517-4f9b-9c66-0b61e3e7be57 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:19.379957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76e1e843-6517-4f9b-9c66-0b61e3e7be57 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:20.756939 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-76e1e843-6517-4f9b-9c66-0b61e3e7be57 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1463 microversion: 2.1 time: 1.399942 Aug 02 07:26:20.759197 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 2999/6070] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:19 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1463 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:21.781145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-538bfb2d-ae7a-44dc-a254-80e1e31442d1 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:21.781763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-538bfb2d-ae7a-44dc-a254-80e1e31442d1 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:21.792321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-538bfb2d-ae7a-44dc-a254-80e1e31442d1 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:21.798860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-538bfb2d-ae7a-44dc-a254-80e1e31442d1 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:21.804678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-538bfb2d-ae7a-44dc-a254-80e1e31442d1 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:21.806481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-538bfb2d-ae7a-44dc-a254-80e1e31442d1 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:22.436865 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-538bfb2d-ae7a-44dc-a254-80e1e31442d1 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1463 microversion: 2.1 time: 0.659378 Aug 02 07:26:22.453007 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3072/6071] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:21 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1463 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:22.750010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-6d9c2649-6005-4c8f-92f9-57aa38c7919f req-b106b73d-819d-4a1a-9722-be6c64fa49f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a830a0-668d-4532-a672-53b6b7a6c301", "tag": "9f88dd16-502a-4070-9db2-33078c31802c"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:26:22.776049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:22.783727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6d9c2649-6005-4c8f-92f9-57aa38c7919f req-b106b73d-819d-4a1a-9722-be6c64fa49f9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:22.785081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6d9c2649-6005-4c8f-92f9-57aa38c7919f req-b106b73d-819d-4a1a-9722-be6c64fa49f9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:22.823804 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-6d9c2649-6005-4c8f-92f9-57aa38c7919f req-b106b73d-819d-4a1a-9722-be6c64fa49f9 service nova] Creating event network-changed:9f88dd16-502a-4070-9db2-33078c31802c for instance b8a830a0-668d-4532-a672-53b6b7a6c301 on n-h2-851337-3 Aug 02 07:26:22.842863 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-6d9c2649-6005-4c8f-92f9-57aa38c7919f req-b106b73d-819d-4a1a-9722-be6c64fa49f9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095169 Aug 02 07:26:22.843861 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3000/6072] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:26:23.461379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-30496828-b184-40c6-b129-3008daab3ade tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:23.462102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-30496828-b184-40c6-b129-3008daab3ade tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:23.474874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30496828-b184-40c6-b129-3008daab3ade tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:23.479181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30496828-b184-40c6-b129-3008daab3ade tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:23.480260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30496828-b184-40c6-b129-3008daab3ade tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:23.480918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30496828-b184-40c6-b129-3008daab3ade tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:23.898040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:23.927952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:23.938006 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-30496828-b184-40c6-b129-3008daab3ade tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1463 microversion: 2.1 time: 0.481220 Aug 02 07:26:23.957765 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3073/6073] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:23 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1463 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:24.963755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2d29f4e2-ec24-4d57-805a-cd484f04e5ad tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:24.966654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2d29f4e2-ec24-4d57-805a-cd484f04e5ad tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:24.991972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:24.997168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d29f4e2-ec24-4d57-805a-cd484f04e5ad tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:24.997168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d29f4e2-ec24-4d57-805a-cd484f04e5ad tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:24.997353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d29f4e2-ec24-4d57-805a-cd484f04e5ad tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:25.010779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d29f4e2-ec24-4d57-805a-cd484f04e5ad tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:25.758174 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2d29f4e2-ec24-4d57-805a-cd484f04e5ad tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1463 microversion: 2.1 time: 0.801658 Aug 02 07:26:25.766081 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3001/6074] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:24 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1463 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:26.781790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f0e980c-8384-4d18-8536-a72b613c2b17 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:26.789104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5f0e980c-8384-4d18-8536-a72b613c2b17 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:26.800425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0e980c-8384-4d18-8536-a72b613c2b17 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:26.816218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0e980c-8384-4d18-8536-a72b613c2b17 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:26.821408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0e980c-8384-4d18-8536-a72b613c2b17 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:26.821992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0e980c-8384-4d18-8536-a72b613c2b17 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:27.263729 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5f0e980c-8384-4d18-8536-a72b613c2b17 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1463 microversion: 2.1 time: 0.483892 Aug 02 07:26:27.268785 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3074/6075] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:26 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1463 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:28.302950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-205064bc-2926-4aa4-9f91-3565a356fcb0 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:28.303675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-205064bc-2926-4aa4-9f91-3565a356fcb0 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:28.323485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-205064bc-2926-4aa4-9f91-3565a356fcb0 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:28.324039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-205064bc-2926-4aa4-9f91-3565a356fcb0 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:28.338393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-0c5fbe5d-183b-4def-b3c8-d75652b9d657 req-ac6b71ba-f9a3-4e2c-ad95-dc355692107f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a830a0-668d-4532-a672-53b6b7a6c301", "name": "network-vif-plugged", "status": "completed", "tag": "9f88dd16-502a-4070-9db2-33078c31802c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:26:28.347639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-205064bc-2926-4aa4-9f91-3565a356fcb0 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:28.348133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-205064bc-2926-4aa4-9f91-3565a356fcb0 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:28.371119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0c5fbe5d-183b-4def-b3c8-d75652b9d657 req-ac6b71ba-f9a3-4e2c-ad95-dc355692107f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:28.378270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0c5fbe5d-183b-4def-b3c8-d75652b9d657 req-ac6b71ba-f9a3-4e2c-ad95-dc355692107f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:28.422159 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-0c5fbe5d-183b-4def-b3c8-d75652b9d657 req-ac6b71ba-f9a3-4e2c-ad95-dc355692107f service nova] Creating event network-vif-plugged:9f88dd16-502a-4070-9db2-33078c31802c for instance b8a830a0-668d-4532-a672-53b6b7a6c301 on n-h2-851337-3 Aug 02 07:26:28.443621 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-0c5fbe5d-183b-4def-b3c8-d75652b9d657 req-ac6b71ba-f9a3-4e2c-ad95-dc355692107f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108484 Aug 02 07:26:28.456218 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3075/6076] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:26:28.832257 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-205064bc-2926-4aa4-9f91-3565a356fcb0 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1463 microversion: 2.1 time: 0.541066 Aug 02 07:26:28.838562 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3002/6077] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:28 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1463 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:29.861389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e973185c-8c13-42a4-8a63-6f088691323c tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:29.862786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e973185c-8c13-42a4-8a63-6f088691323c tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:29.878069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e973185c-8c13-42a4-8a63-6f088691323c tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:29.878533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e973185c-8c13-42a4-8a63-6f088691323c tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:29.879340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e973185c-8c13-42a4-8a63-6f088691323c tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:29.879776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e973185c-8c13-42a4-8a63-6f088691323c tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:30.196231 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e973185c-8c13-42a4-8a63-6f088691323c tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1463 microversion: 2.1 time: 0.339958 Aug 02 07:26:30.198471 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3076/6078] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:29 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1463 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:31.223489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b0e4006c-e3d3-4d39-840f-49da3ee0f27d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:31.224541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b0e4006c-e3d3-4d39-840f-49da3ee0f27d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:31.241343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0e4006c-e3d3-4d39-840f-49da3ee0f27d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:31.242282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0e4006c-e3d3-4d39-840f-49da3ee0f27d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:31.244670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0e4006c-e3d3-4d39-840f-49da3ee0f27d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:31.245575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0e4006c-e3d3-4d39-840f-49da3ee0f27d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:31.784278 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b0e4006c-e3d3-4d39-840f-49da3ee0f27d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1647 microversion: 2.1 time: 0.565721 Aug 02 07:26:31.787727 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3003/6079] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:31 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1647 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:31.811488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f4639293-d6ec-41f2-a906-14fe271eb7a9 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:31.812702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f4639293-d6ec-41f2-a906-14fe271eb7a9 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:31.825166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4639293-d6ec-41f2-a906-14fe271eb7a9 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:31.825926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4639293-d6ec-41f2-a906-14fe271eb7a9 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:31.826707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4639293-d6ec-41f2-a906-14fe271eb7a9 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:31.827284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f4639293-d6ec-41f2-a906-14fe271eb7a9 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:32.805649 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f4639293-d6ec-41f2-a906-14fe271eb7a9 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1647 microversion: 2.1 time: 1.001506 Aug 02 07:26:32.815360 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3077/6080] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:31 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1647 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:32.831711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-00b285b2-f3f2-430a-90e4-7efd2d40c84f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:32.833014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-00b285b2-f3f2-430a-90e4-7efd2d40c84f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:32.860924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00b285b2-f3f2-430a-90e4-7efd2d40c84f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:32.862004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00b285b2-f3f2-430a-90e4-7efd2d40c84f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:32.863667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00b285b2-f3f2-430a-90e4-7efd2d40c84f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:32.864424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00b285b2-f3f2-430a-90e4-7efd2d40c84f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:33.335442 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-00b285b2-f3f2-430a-90e4-7efd2d40c84f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1647 microversion: 2.1 time: 0.507509 Aug 02 07:26:33.351070 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3004/6081] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:32 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1647 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:33.560824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-456048178", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "availability_zone": "nova:n-h1-851337-3", "networks": [{"uuid": "26eead16-19d2-42be-b941-93c402f87b05"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:26:33.692267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] validate_networks() for [('26eead16-19d2-42be-b941-93c402f87b05', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:26:35.416972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:26:35.417484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:26:35.418005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:26:35.418489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:26:35.418976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:26:35.431840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:35.432465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:35.433413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:35.438401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:35.517672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Getting quotas for project cd06840f7a2d4a9aa9dd62e06dfb2549. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:26:35.524552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Getting quotas for user 065ae734106843be9e076edb0e198e35 and project cd06840f7a2d4a9aa9dd62e06dfb2549. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:26:35.557873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:26:35.560638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:26:35.663406 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-787b1f31-18e5-47f5-9982-f4f3dd10b894 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.107861 Aug 02 07:26:35.664696 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3078/6082] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:26:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:26:35.675531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4256309d-c5c1-4b78-b8d1-09a0e0006804 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:35.676154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4256309d-c5c1-4b78-b8d1-09a0e0006804 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:35.921133 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4256309d-c5c1-4b78-b8d1-09a0e0006804 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1328 microversion: 2.1 time: 0.249381 Aug 02 07:26:35.923738 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3005/6083] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:35 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1328 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:36.945966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4c32e5e7-bb74-4214-ad22-4f81113b8754 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:36.947364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4c32e5e7-bb74-4214-ad22-4f81113b8754 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:36.971486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c32e5e7-bb74-4214-ad22-4f81113b8754 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:36.972014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c32e5e7-bb74-4214-ad22-4f81113b8754 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:36.978837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c32e5e7-bb74-4214-ad22-4f81113b8754 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:36.979297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4c32e5e7-bb74-4214-ad22-4f81113b8754 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:37.070681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f5d92ec9-5f59-4094-8efc-899bad86d24b tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1641828193", "availability_zone": "foo_zone"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:26:37.075190 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:26:37.075190 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 07:26:37.076299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.aggregate [None req-f5d92ec9-5f59-4094-8efc-899bad86d24b tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Generated uuid bf8c7bd0-bc16-42eb-95df-69dc42370a18 for aggregate {{(pid=126120) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 02 07:26:37.132648 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f5d92ec9-5f59-4094-8efc-899bad86d24b tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.324291 Aug 02 07:26:37.134273 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3079/6084] 10.222.0.79 () {60 vars in 1164 bytes} [Tue Aug 2 07:26:36 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:26:37.155281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7ed29604-bca2-4779-9d5e-09bb8be9a21b tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:26:37.174218 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4c32e5e7-bb74-4214-ad22-4f81113b8754 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1337 microversion: 2.1 time: 0.232370 Aug 02 07:26:37.175663 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:26:37.175663 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 07:26:37.177734 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3006/6085] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:36 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1337 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:37.227116 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7ed29604-bca2-4779-9d5e-09bb8be9a21b tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.084144 Aug 02 07:26:37.230953 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3080/6086] 10.222.0.79 () {60 vars in 1194 bytes} [Tue Aug 2 07:26:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:26:37.250455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1748d1fc-a493-4b6c-8798-84abecf57372 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:37.258598 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:26:37.258598 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 07:26:37.261953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1748d1fc-a493-4b6c-8798-84abecf57372 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:37.262694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1748d1fc-a493-4b6c-8798-84abecf57372 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:37.263721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1748d1fc-a493-4b6c-8798-84abecf57372 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:37.264149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1748d1fc-a493-4b6c-8798-84abecf57372 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:37.293573 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1748d1fc-a493-4b6c-8798-84abecf57372 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.053981 Aug 02 07:26:37.301354 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3007/6087] 10.222.0.79 () {58 vars in 1176 bytes} [Tue Aug 2 07:26:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:26:37.306676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2d248f52-3bac-4fa9-badf-4c688191481c tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:37.307739 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:26:37.307739 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 07:26:37.316298 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2d248f52-3bac-4fa9-badf-4c688191481c tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.014197 Aug 02 07:26:37.317069 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3081/6088] 10.222.0.79 () {58 vars in 1143 bytes} [Tue Aug 2 07:26:37 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:26:37.328492 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1e4ab8e7-0d36-44a6-8286-324bba52bbee tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851337-3"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:26:37.331618 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:26:37.331618 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 07:26:37.344974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e4ab8e7-0d36-44a6-8286-324bba52bbee tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:37.345771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e4ab8e7-0d36-44a6-8286-324bba52bbee tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:37.728542 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1e4ab8e7-0d36-44a6-8286-324bba52bbee tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.403974 Aug 02 07:26:37.735763 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3008/6089] 10.222.0.79 () {60 vars in 1194 bytes} [Tue Aug 2 07:26:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:26:37.742148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-abdaef0f-f382-4bc8-836e-ec9e88926a02 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:37.743081 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:26:37.743081 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 07:26:37.751559 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-abdaef0f-f382-4bc8-836e-ec9e88926a02 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.014413 Aug 02 07:26:37.760853 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3082/6090] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 07:26:37 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:26:37.767005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5ab812d7-7c10-45e9-9779-2313a68dd082 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-315964268", "availability_zone": "foo_zone"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:26:37.946255 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:26:37.946255 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 07:26:38.040615 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5ab812d7-7c10-45e9-9779-2313a68dd082 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.277692 Aug 02 07:26:38.041514 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3009/6091] 10.222.0.79 () {60 vars in 1173 bytes} [Tue Aug 2 07:26:37 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:26:38.054466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7fd6f3fc-c762-4ded-b2c2-1831a46d4c3f tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:26:38.058472 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:26:38.058472 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 07:26:38.168225 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7fd6f3fc-c762-4ded-b2c2-1831a46d4c3f tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.119284 Aug 02 07:26:38.169334 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3083/6092] 10.222.0.79 () {60 vars in 1194 bytes} [Tue Aug 2 07:26:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:26:38.180438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34fb51f8-d8f6-4ffd-bd05-295885ecbb24 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:38.182030 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:26:38.182030 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 07:26:38.204004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2fc5a95-21d6-452a-9cea-1b02913fa556 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:38.204890 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f2fc5a95-21d6-452a-9cea-1b02913fa556 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:38.206634 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-34fb51f8-d8f6-4ffd-bd05-295885ecbb24 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.029902 Aug 02 07:26:38.215106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2fc5a95-21d6-452a-9cea-1b02913fa556 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:38.217450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2fc5a95-21d6-452a-9cea-1b02913fa556 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:38.218158 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3010/6093] 10.222.0.79 () {58 vars in 1152 bytes} [Tue Aug 2 07:26:38 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:26:38.218531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2fc5a95-21d6-452a-9cea-1b02913fa556 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:38.219969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2fc5a95-21d6-452a-9cea-1b02913fa556 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:38.227642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ed4e41da-9c10-4297-8926-6516253903f8 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851337-3"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:26:38.237014 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:26:38.237014 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 07:26:38.261507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed4e41da-9c10-4297-8926-6516253903f8 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:38.263594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed4e41da-9c10-4297-8926-6516253903f8 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:38.380466 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f2fc5a95-21d6-452a-9cea-1b02913fa556 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1421 microversion: 2.1 time: 0.171260 Aug 02 07:26:38.383021 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3084/6094] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:38 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1421 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:38.519342 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ed4e41da-9c10-4297-8926-6516253903f8 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.294285 Aug 02 07:26:38.521103 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3011/6095] 10.222.0.79 () {60 vars in 1194 bytes} [Tue Aug 2 07:26:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:26:38.533956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b0c15473-cfc5-4077-9a5a-796e24040c63 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:38.534945 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:26:38.534945 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 07:26:38.635180 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b0c15473-cfc5-4077-9a5a-796e24040c63 tempest-TestAggregatesBasicOps-1435977908 tempest-TestAggregatesBasicOps-1435977908-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.102946 Aug 02 07:26:38.641015 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3085/6096] 10.222.0.79 () {58 vars in 1155 bytes} [Tue Aug 2 07:26:38 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 02 07:26:39.409668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1b332258-47bb-4cc8-a0f3-aad06dc0ae81 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:39.411091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1b332258-47bb-4cc8-a0f3-aad06dc0ae81 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:39.430022 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b332258-47bb-4cc8-a0f3-aad06dc0ae81 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:39.435114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b332258-47bb-4cc8-a0f3-aad06dc0ae81 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:39.448779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b332258-47bb-4cc8-a0f3-aad06dc0ae81 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:39.449752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1b332258-47bb-4cc8-a0f3-aad06dc0ae81 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:39.972782 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1b332258-47bb-4cc8-a0f3-aad06dc0ae81 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1463 microversion: 2.1 time: 0.568535 Aug 02 07:26:39.973360 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3012/6097] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:39 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1463 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:40.999699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-418be0d1-8b46-45a9-96d3-3b2476f65b6c tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:41.000249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-418be0d1-8b46-45a9-96d3-3b2476f65b6c tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:41.030796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-418be0d1-8b46-45a9-96d3-3b2476f65b6c tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:41.041021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-418be0d1-8b46-45a9-96d3-3b2476f65b6c tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:41.043730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-418be0d1-8b46-45a9-96d3-3b2476f65b6c tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:41.043730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-418be0d1-8b46-45a9-96d3-3b2476f65b6c tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:41.747233 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-418be0d1-8b46-45a9-96d3-3b2476f65b6c tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1463 microversion: 2.1 time: 0.757428 Aug 02 07:26:41.750469 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3086/6098] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:40 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1463 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:42.371712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-017e189c-28d4-419f-80fc-d7f471a1b027 req-0cb98f65-fe64-421a-843f-4feb62dbcda3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d1a6fd-af22-471f-bcbd-3cb77e15f464", "tag": "ceedac10-49e6-4f5b-9622-98206072e3c6"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:26:42.390646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:42.393341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-017e189c-28d4-419f-80fc-d7f471a1b027 req-0cb98f65-fe64-421a-843f-4feb62dbcda3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:42.395908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-017e189c-28d4-419f-80fc-d7f471a1b027 req-0cb98f65-fe64-421a-843f-4feb62dbcda3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:42.419369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=63 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:42.446937 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-017e189c-28d4-419f-80fc-d7f471a1b027 req-0cb98f65-fe64-421a-843f-4feb62dbcda3 service nova] Creating event network-changed:ceedac10-49e6-4f5b-9622-98206072e3c6 for instance 71d1a6fd-af22-471f-bcbd-3cb77e15f464 on n-h1-851337-3 Aug 02 07:26:42.455987 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-017e189c-28d4-419f-80fc-d7f471a1b027 req-0cb98f65-fe64-421a-843f-4feb62dbcda3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.894557 Aug 02 07:26:42.457728 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3013/6099] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:26:42.771422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9eec027d-c1ab-4091-8562-e28871deac39 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:42.772655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9eec027d-c1ab-4091-8562-e28871deac39 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:42.777633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=10,nova_api:DELETE=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:42.795378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9eec027d-c1ab-4091-8562-e28871deac39 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:42.797007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9eec027d-c1ab-4091-8562-e28871deac39 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:42.799021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9eec027d-c1ab-4091-8562-e28871deac39 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:42.800130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9eec027d-c1ab-4091-8562-e28871deac39 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:42.812271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=61 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:43.440924 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9eec027d-c1ab-4091-8562-e28871deac39 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1463 microversion: 2.1 time: 0.674602 Aug 02 07:26:43.458782 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3087/6100] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:42 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1463 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:44.483595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-21dac080-a173-42e4-b965-ed2a09f957bb tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:44.484686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-21dac080-a173-42e4-b965-ed2a09f957bb tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:44.497023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21dac080-a173-42e4-b965-ed2a09f957bb tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:44.498484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21dac080-a173-42e4-b965-ed2a09f957bb tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:44.499465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21dac080-a173-42e4-b965-ed2a09f957bb tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:44.500060 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-21dac080-a173-42e4-b965-ed2a09f957bb tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:44.732872 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-21dac080-a173-42e4-b965-ed2a09f957bb tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1463 microversion: 2.1 time: 0.268780 Aug 02 07:26:44.733654 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3014/6101] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:44 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1463 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:45.756768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-632502c0-3d65-4d1b-97a1-513237724800 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:45.758757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-632502c0-3d65-4d1b-97a1-513237724800 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:45.762894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:45.763782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:45.787107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-632502c0-3d65-4d1b-97a1-513237724800 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:45.788913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-632502c0-3d65-4d1b-97a1-513237724800 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:45.792013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-632502c0-3d65-4d1b-97a1-513237724800 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:45.793520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-632502c0-3d65-4d1b-97a1-513237724800 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:46.153451 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-632502c0-3d65-4d1b-97a1-513237724800 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1463 microversion: 2.1 time: 0.402491 Aug 02 07:26:46.155302 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3088/6102] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:45 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1463 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:47.177122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2311c7bb-8dba-4d36-ae11-d9cd8b381805 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:47.177744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2311c7bb-8dba-4d36-ae11-d9cd8b381805 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:47.180902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:47.196066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2311c7bb-8dba-4d36-ae11-d9cd8b381805 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:47.196856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2311c7bb-8dba-4d36-ae11-d9cd8b381805 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:47.197933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2311c7bb-8dba-4d36-ae11-d9cd8b381805 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:47.198950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2311c7bb-8dba-4d36-ae11-d9cd8b381805 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:47.277024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:26:47.469625 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2311c7bb-8dba-4d36-ae11-d9cd8b381805 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1463 microversion: 2.1 time: 0.296173 Aug 02 07:26:47.486401 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3015/6103] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:47 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1463 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:47.972580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-9a42e717-149e-4d2c-84d0-2e7ef96b86ae req-71422c42-3675-415c-b324-27ce8dd07d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d1a6fd-af22-471f-bcbd-3cb77e15f464", "name": "network-vif-plugged", "status": "completed", "tag": "ceedac10-49e6-4f5b-9622-98206072e3c6"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:26:47.995486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9a42e717-149e-4d2c-84d0-2e7ef96b86ae req-71422c42-3675-415c-b324-27ce8dd07d09 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:47.996208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9a42e717-149e-4d2c-84d0-2e7ef96b86ae req-71422c42-3675-415c-b324-27ce8dd07d09 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:48.017264 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-9a42e717-149e-4d2c-84d0-2e7ef96b86ae req-71422c42-3675-415c-b324-27ce8dd07d09 service nova] Creating event network-vif-plugged:ceedac10-49e6-4f5b-9622-98206072e3c6 for instance 71d1a6fd-af22-471f-bcbd-3cb77e15f464 on n-h1-851337-3 Aug 02 07:26:48.023399 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-9a42e717-149e-4d2c-84d0-2e7ef96b86ae req-71422c42-3675-415c-b324-27ce8dd07d09 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055115 Aug 02 07:26:48.024571 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3089/6104] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:26:48.494362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-88d049da-d5d2-421a-9928-acdab74c827b tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:48.495846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-88d049da-d5d2-421a-9928-acdab74c827b tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:48.514783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88d049da-d5d2-421a-9928-acdab74c827b tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:48.515237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88d049da-d5d2-421a-9928-acdab74c827b tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:48.516023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88d049da-d5d2-421a-9928-acdab74c827b tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:48.517106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88d049da-d5d2-421a-9928-acdab74c827b tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:49.277948 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-88d049da-d5d2-421a-9928-acdab74c827b tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1463 microversion: 2.1 time: 0.785921 Aug 02 07:26:49.277948 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3016/6105] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:48 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1463 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:50.301998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-604afee0-76af-4ea7-8713-f6ec9fd16752 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:50.302698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-604afee0-76af-4ea7-8713-f6ec9fd16752 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:50.317855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-604afee0-76af-4ea7-8713-f6ec9fd16752 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:50.318578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-604afee0-76af-4ea7-8713-f6ec9fd16752 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:50.319615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-604afee0-76af-4ea7-8713-f6ec9fd16752 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:50.320274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-604afee0-76af-4ea7-8713-f6ec9fd16752 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:50.722721 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-604afee0-76af-4ea7-8713-f6ec9fd16752 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1647 microversion: 2.1 time: 0.426113 Aug 02 07:26:50.723981 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3090/6106] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:50 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1647 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:50.744787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3ca1b2cc-5b53-4881-9ce6-ea47395d8244 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:50.746201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3ca1b2cc-5b53-4881-9ce6-ea47395d8244 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:50.757527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ca1b2cc-5b53-4881-9ce6-ea47395d8244 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:50.761009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ca1b2cc-5b53-4881-9ce6-ea47395d8244 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:50.762746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ca1b2cc-5b53-4881-9ce6-ea47395d8244 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:50.763446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ca1b2cc-5b53-4881-9ce6-ea47395d8244 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:51.051901 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3ca1b2cc-5b53-4881-9ce6-ea47395d8244 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1647 microversion: 2.1 time: 0.312252 Aug 02 07:26:51.070700 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3017/6107] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:50 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1647 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:51.076251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ced495ac-f491-45d8-be26-6bd0602fd779 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:51.076947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ced495ac-f491-45d8-be26-6bd0602fd779 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:51.087206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ced495ac-f491-45d8-be26-6bd0602fd779 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:51.092332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ced495ac-f491-45d8-be26-6bd0602fd779 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:51.093485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ced495ac-f491-45d8-be26-6bd0602fd779 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:51.094880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ced495ac-f491-45d8-be26-6bd0602fd779 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:51.429461 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ced495ac-f491-45d8-be26-6bd0602fd779 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1647 microversion: 2.1 time: 0.357453 Aug 02 07:26:51.434883 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3091/6108] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:51 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1647 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:51.458231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-75ebc42b-cd0d-4b98-84ff-2d6792f8ef86 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:51.458769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-75ebc42b-cd0d-4b98-84ff-2d6792f8ef86 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:51.468285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75ebc42b-cd0d-4b98-84ff-2d6792f8ef86 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:51.468836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75ebc42b-cd0d-4b98-84ff-2d6792f8ef86 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:51.469622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75ebc42b-cd0d-4b98-84ff-2d6792f8ef86 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:51.483169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75ebc42b-cd0d-4b98-84ff-2d6792f8ef86 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:51.660844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-75ebc42b-cd0d-4b98-84ff-2d6792f8ef86 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:26:51.918013 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-75ebc42b-cd0d-4b98-84ff-2d6792f8ef86 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "DELETE /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 204 len: 0 microversion: 2.1 time: 0.463723 Aug 02 07:26:51.923786 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3018/6109] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:26:51 2022] DELETE /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:26:51.931740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-55c20a11-6861-4bc0-939e-e0701b7c2327 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:51.931740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-55c20a11-6861-4bc0-939e-e0701b7c2327 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:51.943125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55c20a11-6861-4bc0-939e-e0701b7c2327 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:51.945254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55c20a11-6861-4bc0-939e-e0701b7c2327 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:51.947810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55c20a11-6861-4bc0-939e-e0701b7c2327 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:51.948202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55c20a11-6861-4bc0-939e-e0701b7c2327 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:52.152228 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-55c20a11-6861-4bc0-939e-e0701b7c2327 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1653 microversion: 2.1 time: 0.227414 Aug 02 07:26:52.153282 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3092/6110] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:51 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1653 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:53.174871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8387f7c4-5eb1-4b7c-aefb-3f18e7f09f02 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:53.176161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8387f7c4-5eb1-4b7c-aefb-3f18e7f09f02 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:53.187271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8387f7c4-5eb1-4b7c-aefb-3f18e7f09f02 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:53.189700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8387f7c4-5eb1-4b7c-aefb-3f18e7f09f02 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:53.194932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8387f7c4-5eb1-4b7c-aefb-3f18e7f09f02 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:53.195595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8387f7c4-5eb1-4b7c-aefb-3f18e7f09f02 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:53.496959 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8387f7c4-5eb1-4b7c-aefb-3f18e7f09f02 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1653 microversion: 2.1 time: 0.326908 Aug 02 07:26:53.499825 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3019/6111] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:53 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1653 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:54.054215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-9faa69db-f3a4-4237-9907-9422daec0925 req-e3cfb7e8-5bf5-4286-af71-010267565588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d1a6fd-af22-471f-bcbd-3cb77e15f464", "name": "network-vif-deleted", "tag": "ceedac10-49e6-4f5b-9622-98206072e3c6"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:26:54.078440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9faa69db-f3a4-4237-9907-9422daec0925 req-e3cfb7e8-5bf5-4286-af71-010267565588 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:54.079148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-9faa69db-f3a4-4237-9907-9422daec0925 req-e3cfb7e8-5bf5-4286-af71-010267565588 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:54.110057 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-9faa69db-f3a4-4237-9907-9422daec0925 req-e3cfb7e8-5bf5-4286-af71-010267565588 service nova] Creating event network-vif-deleted:ceedac10-49e6-4f5b-9622-98206072e3c6 for instance 71d1a6fd-af22-471f-bcbd-3cb77e15f464 on n-h1-851337-3 Aug 02 07:26:54.126970 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-9faa69db-f3a4-4237-9907-9422daec0925 req-e3cfb7e8-5bf5-4286-af71-010267565588 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077492 Aug 02 07:26:54.134578 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3093/6112] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:26:54.521608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-62b72567-446a-4e87-ab50-30b9b0826e0f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:54.522434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-62b72567-446a-4e87-ab50-30b9b0826e0f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:54.556347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62b72567-446a-4e87-ab50-30b9b0826e0f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:54.557069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62b72567-446a-4e87-ab50-30b9b0826e0f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:54.561871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62b72567-446a-4e87-ab50-30b9b0826e0f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:54.562252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62b72567-446a-4e87-ab50-30b9b0826e0f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:54.637944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62b72567-446a-4e87-ab50-30b9b0826e0f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:54.642709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62b72567-446a-4e87-ab50-30b9b0826e0f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:54.643394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-62b72567-446a-4e87-ab50-30b9b0826e0f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lazy-loading 'fault' on Instance uuid 71d1a6fd-af22-471f-bcbd-3cb77e15f464 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:26:54.759872 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-62b72567-446a-4e87-ab50-30b9b0826e0f tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 200 len: 1453 microversion: 2.1 time: 0.238636 Aug 02 07:26:54.768074 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3020/6113] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:54 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 1453 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:55.787607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bf05d6e6-d0fd-4fcb-916a-c2da24bd8a0e tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:55.788447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bf05d6e6-d0fd-4fcb-916a-c2da24bd8a0e tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: 71d1a6fd-af22-471f-bcbd-3cb77e15f464] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:55.803627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf05d6e6-d0fd-4fcb-916a-c2da24bd8a0e tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:55.806931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf05d6e6-d0fd-4fcb-916a-c2da24bd8a0e tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:55.808351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf05d6e6-d0fd-4fcb-916a-c2da24bd8a0e tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:55.809304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf05d6e6-d0fd-4fcb-916a-c2da24bd8a0e tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:55.829852 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-bf05d6e6-d0fd-4fcb-916a-c2da24bd8a0e tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] HTTP exception thrown: Instance 71d1a6fd-af22-471f-bcbd-3cb77e15f464 could not be found. Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bf05d6e6-d0fd-4fcb-916a-c2da24bd8a0e tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Request method failure captured: Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 HTTP/1.1 Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NGTL8b-oJLS8u5o7c6A1CqSwRAL5QqbASCcsXlGU26k48V56GJ0ZLARv5kDdJveh9XOQzHXyZdCwp6UHaChez6AMfp6rvxE2vsVA2r7yqOwGoWtmTTCSM0N9mfUN4ED_UqO5aDqjUaBNghL-nRjn-p0Duc9qrI68v96pMo4URN54ZM Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: cd06840f7a2d4a9aa9dd62e06dfb2549 Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestServerMultinode-573694866 Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cd06840f7a2d4a9aa9dd62e06dfb2549"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd06840f7a2d4a9aa9dd62e06dfb2549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cd06840f7a2d4a9aa9dd62e06dfb2549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd06840f7a2d4a9aa9dd62e06dfb2549"}]}] Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestServerMultinode-573694866 Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: cd06840f7a2d4a9aa9dd62e06dfb2549 Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestServerMultinode-573694866 Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestServerMultinode-573694866-project-admin Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 065ae734106843be9e076edb0e198e35 Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestServerMultinode-573694866-project-admin Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 71d1a6fd-af22-471f-bcbd-3cb77e15f464 could not be found. Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '71d1a6fd-af22-471f-bcbd-3cb77e15f464'} Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71d1a6fd-af22-471f-bcbd-3cb77e15f464 could not be found. Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71d1a6fd-af22-471f-bcbd-3cb77e15f464 could not be found. Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:26:55.831984 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:26:55.835882 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:26:55.835882 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:26:55.835882 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:26:55.835882 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:26:55.835882 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:26:55.835882 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71d1a6fd-af22-471f-bcbd-3cb77e15f464 could not be found. Aug 02 07:26:55.835882 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:26:55.835882 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bf05d6e6-d0fd-4fcb-916a-c2da24bd8a0e tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Returning 404 to user: Instance 71d1a6fd-af22-471f-bcbd-3cb77e15f464 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:26:55.835882 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bf05d6e6-d0fd-4fcb-916a-c2da24bd8a0e tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464" status: 404 len: 111 microversion: 2.1 time: 0.050525 Aug 02 07:26:55.835882 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3094/6114] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:55 2022] GET /compute/v2.1/servers/71d1a6fd-af22-471f-bcbd-3cb77e15f464 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:26:55.847272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a6629422-b0a6-4117-8940-63ba90a93a8d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:55.847800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a6629422-b0a6-4117-8940-63ba90a93a8d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:55.858471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6629422-b0a6-4117-8940-63ba90a93a8d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:55.859845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6629422-b0a6-4117-8940-63ba90a93a8d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:55.860979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6629422-b0a6-4117-8940-63ba90a93a8d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:55.861574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6629422-b0a6-4117-8940-63ba90a93a8d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:55.891673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a6629422-b0a6-4117-8940-63ba90a93a8d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:26:55.991683 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a6629422-b0a6-4117-8940-63ba90a93a8d tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "DELETE /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 204 len: 0 microversion: 2.1 time: 0.149353 Aug 02 07:26:55.992506 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3021/6115] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:26:55 2022] DELETE /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:26:56.003821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02817cb9-d9a4-4d3a-af00-b9bab334efc8 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:56.005564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-02817cb9-d9a4-4d3a-af00-b9bab334efc8 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:56.019553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02817cb9-d9a4-4d3a-af00-b9bab334efc8 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:56.022303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02817cb9-d9a4-4d3a-af00-b9bab334efc8 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:56.023686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02817cb9-d9a4-4d3a-af00-b9bab334efc8 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:56.024361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02817cb9-d9a4-4d3a-af00-b9bab334efc8 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:56.426072 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-02817cb9-d9a4-4d3a-af00-b9bab334efc8 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1653 microversion: 2.1 time: 0.428050 Aug 02 07:26:56.426827 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3095/6116] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:55 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1653 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:57.448343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8647915f-fb55-41a0-bac8-0d51da0ee3f9 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:57.449031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8647915f-fb55-41a0-bac8-0d51da0ee3f9 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:57.461093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8647915f-fb55-41a0-bac8-0d51da0ee3f9 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:57.463777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8647915f-fb55-41a0-bac8-0d51da0ee3f9 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:57.465706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8647915f-fb55-41a0-bac8-0d51da0ee3f9 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:57.468213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8647915f-fb55-41a0-bac8-0d51da0ee3f9 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:57.744834 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8647915f-fb55-41a0-bac8-0d51da0ee3f9 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 200 len: 1653 microversion: 2.1 time: 0.297966 Aug 02 07:26:57.758320 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3022/6117] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:57 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 1653 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:26:58.078778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-2c5bbe39-7fb0-4fc6-ab47-f12c18fd7dcc req-7a3a9c5d-c996-400f-a2fd-7fb3b70089ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a830a0-668d-4532-a672-53b6b7a6c301", "name": "network-vif-deleted", "tag": "9f88dd16-502a-4070-9db2-33078c31802c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:26:58.090583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2c5bbe39-7fb0-4fc6-ab47-f12c18fd7dcc req-7a3a9c5d-c996-400f-a2fd-7fb3b70089ce service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:58.091265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2c5bbe39-7fb0-4fc6-ab47-f12c18fd7dcc req-7a3a9c5d-c996-400f-a2fd-7fb3b70089ce service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:58.109647 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-2c5bbe39-7fb0-4fc6-ab47-f12c18fd7dcc req-7a3a9c5d-c996-400f-a2fd-7fb3b70089ce service nova] Creating event network-vif-deleted:9f88dd16-502a-4070-9db2-33078c31802c for instance b8a830a0-668d-4532-a672-53b6b7a6c301 on n-h2-851337-3 Aug 02 07:26:58.117378 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-2c5bbe39-7fb0-4fc6-ab47-f12c18fd7dcc req-7a3a9c5d-c996-400f-a2fd-7fb3b70089ce service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042480 Aug 02 07:26:58.118710 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3096/6118] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:26:58.769741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2335b263-725f-45f2-a9c4-002a20d746d3 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:26:58.770459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2335b263-725f-45f2-a9c4-002a20d746d3 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] [instance: b8a830a0-668d-4532-a672-53b6b7a6c301] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:26:58.779212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2335b263-725f-45f2-a9c4-002a20d746d3 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:58.779975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2335b263-725f-45f2-a9c4-002a20d746d3 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:58.781238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2335b263-725f-45f2-a9c4-002a20d746d3 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:26:58.781936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2335b263-725f-45f2-a9c4-002a20d746d3 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:26:58.799063 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-2335b263-725f-45f2-a9c4-002a20d746d3 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] HTTP exception thrown: Instance b8a830a0-668d-4532-a672-53b6b7a6c301 could not be found. Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2335b263-725f-45f2-a9c4-002a20d746d3 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Request method failure captured: Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 HTTP/1.1 Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NGTL8b-oJLS8u5o7c6A1CqSwRAL5QqbASCcsXlGU26k48V56GJ0ZLARv5kDdJveh9XOQzHXyZdCwp6UHaChez6AMfp6rvxE2vsVA2r7yqOwGoWtmTTCSM0N9mfUN4ED_UqO5aDqjUaBNghL-nRjn-p0Duc9qrI68v96pMo4URN54ZM Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: cd06840f7a2d4a9aa9dd62e06dfb2549 Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestServerMultinode-573694866 Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cd06840f7a2d4a9aa9dd62e06dfb2549"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd06840f7a2d4a9aa9dd62e06dfb2549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cd06840f7a2d4a9aa9dd62e06dfb2549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cd06840f7a2d4a9aa9dd62e06dfb2549"}]}] Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestServerMultinode-573694866 Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: cd06840f7a2d4a9aa9dd62e06dfb2549 Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestServerMultinode-573694866 Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestServerMultinode-573694866-project-admin Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 065ae734106843be9e076edb0e198e35 Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestServerMultinode-573694866-project-admin Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance b8a830a0-668d-4532-a672-53b6b7a6c301 could not be found. Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'b8a830a0-668d-4532-a672-53b6b7a6c301'} Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a830a0-668d-4532-a672-53b6b7a6c301 could not be found. Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a830a0-668d-4532-a672-53b6b7a6c301 could not be found. Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:26:58.801193 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:26:58.806351 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:26:58.806351 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:26:58.806351 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:26:58.806351 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:26:58.806351 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:26:58.806351 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a830a0-668d-4532-a672-53b6b7a6c301 could not be found. Aug 02 07:26:58.806351 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:26:58.808150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2335b263-725f-45f2-a9c4-002a20d746d3 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] Returning 404 to user: Instance b8a830a0-668d-4532-a672-53b6b7a6c301 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:26:58.809232 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2335b263-725f-45f2-a9c4-002a20d746d3 tempest-TestServerMultinode-573694866 tempest-TestServerMultinode-573694866-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301" status: 404 len: 111 microversion: 2.1 time: 0.043895 Aug 02 07:26:58.810313 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3023/6119] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:26:58 2022] GET /compute/v2.1/servers/b8a830a0-668d-4532-a672-53b6b7a6c301 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:27:07.229957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-63d78ad4-57ca-46e0-ad10-e9176d3e913b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Action: 'create', calling method: .version_select at 0x7f927a456790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1966428504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcu/0ZR0hvBDjl4RyiB17NLJyulae9dN4Hx8sqgbGPxlLB1cn5TTTwFcEc+Z6WmwUd3beAznh89GsNZQHBygXBrJD+VRyluik/+MLFdEaekXh+rIBWc94EjQFxOLMCOQg=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:27:07.266313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-63d78ad4-57ca-46e0-ad10-e9176d3e913b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Getting quotas for project 47a4bcdb764647e7a0ac29ca20ceae03. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:27:07.282265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-63d78ad4-57ca-46e0-ad10-e9176d3e913b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Getting quotas for user f5b47f98af604fea9f078504441d6c76 and project 47a4bcdb764647e7a0ac29ca20ceae03. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:27:07.338706 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-63d78ad4-57ca-46e0-ad10-e9176d3e913b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.121235 Aug 02 07:27:07.339769 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3097/6120] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:27:07 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:27:11.911330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-995427051", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "baa5abed-e83a-4d9c-bfb7-99318e519d78"}], "key_name": "tempest-TestNetworkBasicOps-1966428504", "security_groups": [{"name": "tempest-secgroup-smoke-1103256277"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:27:11.929667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:11.931196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:12.241390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] validate_networks() for [('baa5abed-e83a-4d9c-bfb7-99318e519d78', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:27:13.568232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:27:13.572446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:27:13.573863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:27:13.575161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:27:13.575996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:27:13.589022 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:13.589691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:13.590724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:13.591355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:13.621157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Getting quotas for project 47a4bcdb764647e7a0ac29ca20ceae03. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:27:13.630967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Getting quotas for user f5b47f98af604fea9f078504441d6c76 and project 47a4bcdb764647e7a0ac29ca20ceae03. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:27:13.652164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:27:13.655231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:27:13.719756 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-32296215-9bed-4b33-b30a-a6c51b36e0ec tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.815626 Aug 02 07:27:13.722048 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3024/6121] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:27:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:27:13.733548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7844bd8c-96dd-430e-bd47-50afbeee9c8d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:13.735021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7844bd8c-96dd-430e-bd47-50afbeee9c8d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:13.744509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=43 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:13.747366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:13.953280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7844bd8c-96dd-430e-bd47-50afbeee9c8d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:13.969065 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7844bd8c-96dd-430e-bd47-50afbeee9c8d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1248 microversion: 2.1 time: 0.240413 Aug 02 07:27:13.969688 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3098/6122] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:13 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1248 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:27:14.997986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aab93c8f-3dcd-482d-aa42-683dc5eca8bd tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:15.001285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aab93c8f-3dcd-482d-aa42-683dc5eca8bd tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:15.022643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aab93c8f-3dcd-482d-aa42-683dc5eca8bd tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:15.023740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aab93c8f-3dcd-482d-aa42-683dc5eca8bd tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:15.028953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aab93c8f-3dcd-482d-aa42-683dc5eca8bd tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:15.031016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aab93c8f-3dcd-482d-aa42-683dc5eca8bd tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:15.232777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aab93c8f-3dcd-482d-aa42-683dc5eca8bd tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:15.259711 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aab93c8f-3dcd-482d-aa42-683dc5eca8bd tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1244 microversion: 2.1 time: 0.270273 Aug 02 07:27:15.262687 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3025/6123] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:14 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1244 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:16.287249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8c85f02a-ad1c-4ae9-be63-8efd9ace7a6e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:16.288449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8c85f02a-ad1c-4ae9-be63-8efd9ace7a6e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:16.311223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c85f02a-ad1c-4ae9-be63-8efd9ace7a6e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:16.312661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c85f02a-ad1c-4ae9-be63-8efd9ace7a6e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:16.315639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c85f02a-ad1c-4ae9-be63-8efd9ace7a6e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:16.316209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c85f02a-ad1c-4ae9-be63-8efd9ace7a6e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:16.597256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8c85f02a-ad1c-4ae9-be63-8efd9ace7a6e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:16.612242 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8c85f02a-ad1c-4ae9-be63-8efd9ace7a6e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1306 microversion: 2.1 time: 0.331507 Aug 02 07:27:16.616413 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3099/6124] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:16 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1306 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:17.638979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-12f1c5ed-790a-49ec-a844-d8d503ed4e1d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:17.642010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-12f1c5ed-790a-49ec-a844-d8d503ed4e1d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:17.658563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12f1c5ed-790a-49ec-a844-d8d503ed4e1d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:17.659736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12f1c5ed-790a-49ec-a844-d8d503ed4e1d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:17.661362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12f1c5ed-790a-49ec-a844-d8d503ed4e1d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:17.661816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-12f1c5ed-790a-49ec-a844-d8d503ed4e1d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:18.065378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1436959401", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "72f8d627-7175-41e8-ae30-1b6be0f66580"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:27:18.150368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] validate_networks() for [('72f8d627-7175-41e8-ae30-1b6be0f66580', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:27:18.525478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-12f1c5ed-790a-49ec-a844-d8d503ed4e1d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:18.536795 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-12f1c5ed-790a-49ec-a844-d8d503ed4e1d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1374 microversion: 2.1 time: 0.900492 Aug 02 07:27:18.537931 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3026/6125] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:17 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1374 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:19.169203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:27:19.169682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:27:19.170273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:27:19.170768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:27:19.171406 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:27:19.182159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:19.182619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:19.183449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:19.183924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:19.205496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Getting quotas for project b8ea0169283c4a87be48143f715b35fb. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:27:19.211551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Getting quotas for user 48d537e33871467daa3644bf0ac939e7 and project b8ea0169283c4a87be48143f715b35fb. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:27:19.226546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:27:19.229136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:27:19.294262 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3180204f-0141-4cd9-a56a-d750f6441332 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.509302 Aug 02 07:27:19.302028 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3100/6126] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:27:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:27:19.307665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bed5e66b-ee8f-4b9b-b28b-0f469afd9fb2 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:19.308298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bed5e66b-ee8f-4b9b-b28b-0f469afd9fb2 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:19.432126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6c23e49c-8899-47b2-8411-09667a276ddb req-3fd89396-9853-4427-934e-cc3cbfffeb5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d10a84-0fa6-4e3e-8604-c8b946ee129d", "tag": "6ee8655d-dc3c-4285-a871-23285b881ec0"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:27:19.454404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bed5e66b-ee8f-4b9b-b28b-0f469afd9fb2 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:19.464467 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bed5e66b-ee8f-4b9b-b28b-0f469afd9fb2 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1214 microversion: 2.1 time: 0.160830 Aug 02 07:27:19.467391 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3027/6127] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:19 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:19.471277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6c23e49c-8899-47b2-8411-09667a276ddb req-3fd89396-9853-4427-934e-cc3cbfffeb5e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:19.472035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6c23e49c-8899-47b2-8411-09667a276ddb req-3fd89396-9853-4427-934e-cc3cbfffeb5e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:19.518749 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-6c23e49c-8899-47b2-8411-09667a276ddb req-3fd89396-9853-4427-934e-cc3cbfffeb5e service nova] Creating event network-changed:6ee8655d-dc3c-4285-a871-23285b881ec0 for instance d6d10a84-0fa6-4e3e-8604-c8b946ee129d on n-h2-851337-3 Aug 02 07:27:19.526471 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6c23e49c-8899-47b2-8411-09667a276ddb req-3fd89396-9853-4427-934e-cc3cbfffeb5e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098338 Aug 02 07:27:19.527957 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3101/6128] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:27:19.558157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5eb9b1d2-c13d-48e2-90db-28fd32e6b047 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:19.558774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5eb9b1d2-c13d-48e2-90db-28fd32e6b047 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:19.568276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5eb9b1d2-c13d-48e2-90db-28fd32e6b047 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:19.568733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5eb9b1d2-c13d-48e2-90db-28fd32e6b047 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:19.569552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5eb9b1d2-c13d-48e2-90db-28fd32e6b047 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:19.570030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5eb9b1d2-c13d-48e2-90db-28fd32e6b047 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:19.940956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5eb9b1d2-c13d-48e2-90db-28fd32e6b047 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:19.954641 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5eb9b1d2-c13d-48e2-90db-28fd32e6b047 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1374 microversion: 2.1 time: 0.400443 Aug 02 07:27:19.956074 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3028/6129] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:19 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1374 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:20.488659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2954a11e-150b-4a94-bf1d-968a47e5ae58 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:20.489711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2954a11e-150b-4a94-bf1d-968a47e5ae58 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:20.499784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2954a11e-150b-4a94-bf1d-968a47e5ae58 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:20.505138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2954a11e-150b-4a94-bf1d-968a47e5ae58 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:20.508457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2954a11e-150b-4a94-bf1d-968a47e5ae58 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:20.511065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2954a11e-150b-4a94-bf1d-968a47e5ae58 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:20.631166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2954a11e-150b-4a94-bf1d-968a47e5ae58 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:20.639575 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2954a11e-150b-4a94-bf1d-968a47e5ae58 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1266 microversion: 2.1 time: 0.156701 Aug 02 07:27:20.640907 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3102/6130] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:20 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:20.976315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-266466fd-1423-4b47-b591-1aa523307008 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:20.977688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-266466fd-1423-4b47-b591-1aa523307008 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:20.988280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-266466fd-1423-4b47-b591-1aa523307008 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:20.992941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-266466fd-1423-4b47-b591-1aa523307008 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:20.994323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-266466fd-1423-4b47-b591-1aa523307008 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:20.995113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-266466fd-1423-4b47-b591-1aa523307008 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:21.383377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-266466fd-1423-4b47-b591-1aa523307008 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:21.394484 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-266466fd-1423-4b47-b591-1aa523307008 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1374 microversion: 2.1 time: 0.422542 Aug 02 07:27:21.396913 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3029/6131] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:20 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1374 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:21.661117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4e1d86b0-3484-4c5b-8e17-53f1f0af0274 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:21.661843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4e1d86b0-3484-4c5b-8e17-53f1f0af0274 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:21.674818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e1d86b0-3484-4c5b-8e17-53f1f0af0274 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:21.677971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e1d86b0-3484-4c5b-8e17-53f1f0af0274 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:21.679038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e1d86b0-3484-4c5b-8e17-53f1f0af0274 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:21.680251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e1d86b0-3484-4c5b-8e17-53f1f0af0274 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:21.834613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4e1d86b0-3484-4c5b-8e17-53f1f0af0274 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:21.843779 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4e1d86b0-3484-4c5b-8e17-53f1f0af0274 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1272 microversion: 2.1 time: 0.186758 Aug 02 07:27:21.847037 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3103/6132] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:21 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:22.416830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1e634981-ccfc-4988-bf8d-b5f5e6ae8d3b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:22.417504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1e634981-ccfc-4988-bf8d-b5f5e6ae8d3b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:22.427085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e634981-ccfc-4988-bf8d-b5f5e6ae8d3b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:22.430674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e634981-ccfc-4988-bf8d-b5f5e6ae8d3b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:22.434590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e634981-ccfc-4988-bf8d-b5f5e6ae8d3b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:22.436099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e634981-ccfc-4988-bf8d-b5f5e6ae8d3b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:22.868164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1e634981-ccfc-4988-bf8d-b5f5e6ae8d3b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:22.873949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3188c277-6ce0-4efa-a7f2-b6717e29a0e1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:22.874626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3188c277-6ce0-4efa-a7f2-b6717e29a0e1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:22.887301 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1e634981-ccfc-4988-bf8d-b5f5e6ae8d3b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1374 microversion: 2.1 time: 0.473098 Aug 02 07:27:22.888308 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3030/6133] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:22 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1374 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:22.946255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3188c277-6ce0-4efa-a7f2-b6717e29a0e1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:22.946963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3188c277-6ce0-4efa-a7f2-b6717e29a0e1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:22.947909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3188c277-6ce0-4efa-a7f2-b6717e29a0e1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:22.948494 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3188c277-6ce0-4efa-a7f2-b6717e29a0e1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:23.290684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3188c277-6ce0-4efa-a7f2-b6717e29a0e1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:23.325837 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3188c277-6ce0-4efa-a7f2-b6717e29a0e1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1314 microversion: 2.1 time: 0.452258 Aug 02 07:27:23.326586 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3104/6134] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:22 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:23.916444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0211cf41-08e8-4e8d-8bc0-9185f597e866 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:23.920131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0211cf41-08e8-4e8d-8bc0-9185f597e866 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:23.924858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:23.929283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0211cf41-08e8-4e8d-8bc0-9185f597e866 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:23.930106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0211cf41-08e8-4e8d-8bc0-9185f597e866 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:23.931123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0211cf41-08e8-4e8d-8bc0-9185f597e866 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:23.931999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0211cf41-08e8-4e8d-8bc0-9185f597e866 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:24.348162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ee12b387-9a28-4851-a1d6-f682365126a3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:24.348935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ee12b387-9a28-4851-a1d6-f682365126a3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:24.368347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee12b387-9a28-4851-a1d6-f682365126a3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:24.370726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee12b387-9a28-4851-a1d6-f682365126a3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:24.371774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee12b387-9a28-4851-a1d6-f682365126a3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:24.375432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee12b387-9a28-4851-a1d6-f682365126a3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:24.606851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0211cf41-08e8-4e8d-8bc0-9185f597e866 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:24.619387 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0211cf41-08e8-4e8d-8bc0-9185f597e866 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1374 microversion: 2.1 time: 0.708525 Aug 02 07:27:24.620438 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3031/6135] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:23 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1374 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:24.648178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-064553e5-f054-4eae-9647-b1df54709898 req-ea16cf78-d458-40d2-ae50-e28a5134c920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a16fda-5b20-4183-8bd8-b5394aaca5dc", "tag": "c13150dc-1ada-4f97-86f2-90290844b317"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:27:24.690465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-064553e5-f054-4eae-9647-b1df54709898 req-ea16cf78-d458-40d2-ae50-e28a5134c920 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:24.693762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-064553e5-f054-4eae-9647-b1df54709898 req-ea16cf78-d458-40d2-ae50-e28a5134c920 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:24.726941 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-064553e5-f054-4eae-9647-b1df54709898 req-ea16cf78-d458-40d2-ae50-e28a5134c920 service nova] Creating event network-changed:c13150dc-1ada-4f97-86f2-90290844b317 for instance f6a16fda-5b20-4183-8bd8-b5394aaca5dc on n-h1-851337-3 Aug 02 07:27:24.741250 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-064553e5-f054-4eae-9647-b1df54709898 req-ea16cf78-d458-40d2-ae50-e28a5134c920 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104943 Aug 02 07:27:24.742261 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3032/6136] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:27:25.554178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ee12b387-9a28-4851-a1d6-f682365126a3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:25.582771 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ee12b387-9a28-4851-a1d6-f682365126a3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1314 microversion: 2.1 time: 1.238681 Aug 02 07:27:25.596752 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3105/6137] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:24 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1314 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:25.646950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a426f4fe-e425-4660-a061-aeecd75bdbe1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:25.648421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a426f4fe-e425-4660-a061-aeecd75bdbe1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:25.695824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a426f4fe-e425-4660-a061-aeecd75bdbe1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:25.696901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a426f4fe-e425-4660-a061-aeecd75bdbe1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:25.702390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a426f4fe-e425-4660-a061-aeecd75bdbe1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:25.703666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a426f4fe-e425-4660-a061-aeecd75bdbe1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:26.087939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a426f4fe-e425-4660-a061-aeecd75bdbe1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:26.096652 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a426f4fe-e425-4660-a061-aeecd75bdbe1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1374 microversion: 2.1 time: 0.454347 Aug 02 07:27:26.099211 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3033/6138] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:25 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1374 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:26.611654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d62db9e9-28ce-426b-badb-aaa071f156ae tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:26.612403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d62db9e9-28ce-426b-badb-aaa071f156ae tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:26.636661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d62db9e9-28ce-426b-badb-aaa071f156ae tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:26.637109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d62db9e9-28ce-426b-badb-aaa071f156ae tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:26.646034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d62db9e9-28ce-426b-badb-aaa071f156ae tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:26.646779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d62db9e9-28ce-426b-badb-aaa071f156ae tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:26.804864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-6754444a-8c26-4508-8f23-2589231671ce req-35a66e18-a378-40f7-95d9-a7ffd351ed51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d10a84-0fa6-4e3e-8604-c8b946ee129d", "name": "network-vif-plugged", "status": "completed", "tag": "6ee8655d-dc3c-4285-a871-23285b881ec0"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:27:26.846463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6754444a-8c26-4508-8f23-2589231671ce req-35a66e18-a378-40f7-95d9-a7ffd351ed51 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:26.850108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6754444a-8c26-4508-8f23-2589231671ce req-35a66e18-a378-40f7-95d9-a7ffd351ed51 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:26.892245 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-6754444a-8c26-4508-8f23-2589231671ce req-35a66e18-a378-40f7-95d9-a7ffd351ed51 service nova] Creating event network-vif-plugged:6ee8655d-dc3c-4285-a871-23285b881ec0 for instance d6d10a84-0fa6-4e3e-8604-c8b946ee129d on n-h2-851337-3 Aug 02 07:27:26.917970 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-6754444a-8c26-4508-8f23-2589231671ce req-35a66e18-a378-40f7-95d9-a7ffd351ed51 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112613 Aug 02 07:27:26.920164 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3034/6139] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:27:27.046445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d62db9e9-28ce-426b-badb-aaa071f156ae tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:27.055342 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d62db9e9-28ce-426b-badb-aaa071f156ae tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1314 microversion: 2.1 time: 0.455593 Aug 02 07:27:27.055930 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3106/6140] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:26 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:27.124068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dfe9ae20-497b-4e9b-afcb-d3dae70220b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:27.124769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dfe9ae20-497b-4e9b-afcb-d3dae70220b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:27.136368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfe9ae20-497b-4e9b-afcb-d3dae70220b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:27.136825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfe9ae20-497b-4e9b-afcb-d3dae70220b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:27.137621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfe9ae20-497b-4e9b-afcb-d3dae70220b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:27.138110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfe9ae20-497b-4e9b-afcb-d3dae70220b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:27.366609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dfe9ae20-497b-4e9b-afcb-d3dae70220b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:27.382502 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dfe9ae20-497b-4e9b-afcb-d3dae70220b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1374 microversion: 2.1 time: 0.262785 Aug 02 07:27:27.383422 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3035/6141] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:27 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1374 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:28.079904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2de2bfbe-641a-407d-ac23-90b732df60b7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:28.081155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2de2bfbe-641a-407d-ac23-90b732df60b7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:28.099331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2de2bfbe-641a-407d-ac23-90b732df60b7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:28.101411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2de2bfbe-641a-407d-ac23-90b732df60b7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:28.102514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2de2bfbe-641a-407d-ac23-90b732df60b7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:28.104649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2de2bfbe-641a-407d-ac23-90b732df60b7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:28.404885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bc28d5ee-66af-49d9-92c7-e34fa7d2d333 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:28.404885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bc28d5ee-66af-49d9-92c7-e34fa7d2d333 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:28.423969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc28d5ee-66af-49d9-92c7-e34fa7d2d333 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:28.424420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc28d5ee-66af-49d9-92c7-e34fa7d2d333 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:28.425203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc28d5ee-66af-49d9-92c7-e34fa7d2d333 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:28.425704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc28d5ee-66af-49d9-92c7-e34fa7d2d333 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:28.675992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2de2bfbe-641a-407d-ac23-90b732df60b7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:28.687255 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2de2bfbe-641a-407d-ac23-90b732df60b7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1314 microversion: 2.1 time: 0.614099 Aug 02 07:27:28.690772 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3107/6142] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:28 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:28.914105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bc28d5ee-66af-49d9-92c7-e34fa7d2d333 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:28.924439 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bc28d5ee-66af-49d9-92c7-e34fa7d2d333 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1547 microversion: 2.1 time: 0.524274 Aug 02 07:27:28.926051 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3036/6143] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:28 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1547 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:28.947356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4093b409-4689-4495-a49a-9313a079d04c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:28.947993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4093b409-4689-4495-a49a-9313a079d04c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:28.955070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4093b409-4689-4495-a49a-9313a079d04c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:28.955845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4093b409-4689-4495-a49a-9313a079d04c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:28.957013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4093b409-4689-4495-a49a-9313a079d04c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:28.957722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4093b409-4689-4495-a49a-9313a079d04c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:29.182650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4093b409-4689-4495-a49a-9313a079d04c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:29.195545 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4093b409-4689-4495-a49a-9313a079d04c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1547 microversion: 2.1 time: 0.252612 Aug 02 07:27:29.196908 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3108/6144] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:28 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1547 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:29.711925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4d59575f-b84b-486b-b97e-eff424a50ef1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:29.712773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4d59575f-b84b-486b-b97e-eff424a50ef1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:29.715989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=8 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:29.749233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d59575f-b84b-486b-b97e-eff424a50ef1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:29.751030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d59575f-b84b-486b-b97e-eff424a50ef1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:29.753513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d59575f-b84b-486b-b97e-eff424a50ef1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:29.755644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d59575f-b84b-486b-b97e-eff424a50ef1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:30.348638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4d59575f-b84b-486b-b97e-eff424a50ef1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:30.362399 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4d59575f-b84b-486b-b97e-eff424a50ef1 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1314 microversion: 2.1 time: 0.655245 Aug 02 07:27:30.381322 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3037/6145] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:29 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:31.385348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ff746786-783e-4ef2-bb71-a3ae358b6dda tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:31.386721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ff746786-783e-4ef2-bb71-a3ae358b6dda tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:31.390137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:31.390809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=12 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:31.406086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff746786-783e-4ef2-bb71-a3ae358b6dda tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:31.409072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff746786-783e-4ef2-bb71-a3ae358b6dda tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:31.409943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff746786-783e-4ef2-bb71-a3ae358b6dda tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:31.417855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff746786-783e-4ef2-bb71-a3ae358b6dda tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:32.855062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ff746786-783e-4ef2-bb71-a3ae358b6dda tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:32.870550 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ff746786-783e-4ef2-bb71-a3ae358b6dda tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1314 microversion: 2.1 time: 1.487762 Aug 02 07:27:32.871811 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3109/6146] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:31 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1314 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:33.892183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f64ad324-e297-4f8c-8ff9-c3362ed70158 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:33.895810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f64ad324-e297-4f8c-8ff9-c3362ed70158 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:33.925162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f64ad324-e297-4f8c-8ff9-c3362ed70158 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:33.925927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f64ad324-e297-4f8c-8ff9-c3362ed70158 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:33.928569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f64ad324-e297-4f8c-8ff9-c3362ed70158 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:33.929196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f64ad324-e297-4f8c-8ff9-c3362ed70158 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:35.430647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f64ad324-e297-4f8c-8ff9-c3362ed70158 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:35.442563 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f64ad324-e297-4f8c-8ff9-c3362ed70158 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1314 microversion: 2.1 time: 1.554321 Aug 02 07:27:35.448669 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3038/6147] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:33 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1314 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:27:35.815127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-8d7b47b5-22d1-4dfd-abb0-d680c56d2f37 req-2dd23be3-0877-4790-a22c-95db3f7a66ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a16fda-5b20-4183-8bd8-b5394aaca5dc", "name": "network-vif-plugged", "status": "completed", "tag": "c13150dc-1ada-4f97-86f2-90290844b317"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:27:35.846954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8d7b47b5-22d1-4dfd-abb0-d680c56d2f37 req-2dd23be3-0877-4790-a22c-95db3f7a66ff service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:35.847826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8d7b47b5-22d1-4dfd-abb0-d680c56d2f37 req-2dd23be3-0877-4790-a22c-95db3f7a66ff service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:35.885042 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-8d7b47b5-22d1-4dfd-abb0-d680c56d2f37 req-2dd23be3-0877-4790-a22c-95db3f7a66ff service nova] Creating event network-vif-plugged:c13150dc-1ada-4f97-86f2-90290844b317 for instance f6a16fda-5b20-4183-8bd8-b5394aaca5dc on n-h1-851337-3 Aug 02 07:27:35.899722 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-8d7b47b5-22d1-4dfd-abb0-d680c56d2f37 req-2dd23be3-0877-4790-a22c-95db3f7a66ff service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086772 Aug 02 07:27:35.903274 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3110/6148] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:27:36.298474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-aa5fd71f-172c-4b68-8fa6-97ddde5fd97f req-7663001c-fc09-4b3e-893d-6fbd581b3390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d10a84-0fa6-4e3e-8604-c8b946ee129d", "tag": "6ee8655d-dc3c-4285-a871-23285b881ec0"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:27:36.335963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-aa5fd71f-172c-4b68-8fa6-97ddde5fd97f req-7663001c-fc09-4b3e-893d-6fbd581b3390 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:36.336409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-aa5fd71f-172c-4b68-8fa6-97ddde5fd97f req-7663001c-fc09-4b3e-893d-6fbd581b3390 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:36.382799 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-aa5fd71f-172c-4b68-8fa6-97ddde5fd97f req-7663001c-fc09-4b3e-893d-6fbd581b3390 service nova] Creating event network-changed:6ee8655d-dc3c-4285-a871-23285b881ec0 for instance d6d10a84-0fa6-4e3e-8604-c8b946ee129d on n-h2-851337-3 Aug 02 07:27:36.397066 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-aa5fd71f-172c-4b68-8fa6-97ddde5fd97f req-7663001c-fc09-4b3e-893d-6fbd581b3390 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103326 Aug 02 07:27:36.401707 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3039/6149] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:27:36.469803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f5e6334-70c7-4518-afd0-be2d47e5f8be tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:36.470638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4f5e6334-70c7-4518-afd0-be2d47e5f8be tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:36.481454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f5e6334-70c7-4518-afd0-be2d47e5f8be tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:36.481919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f5e6334-70c7-4518-afd0-be2d47e5f8be tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:36.488037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f5e6334-70c7-4518-afd0-be2d47e5f8be tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:36.490136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f5e6334-70c7-4518-afd0-be2d47e5f8be tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:36.819880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4f5e6334-70c7-4518-afd0-be2d47e5f8be tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:36.832453 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4f5e6334-70c7-4518-afd0-be2d47e5f8be tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1314 microversion: 2.1 time: 0.366930 Aug 02 07:27:36.858880 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3111/6150] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:36 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:37.861607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f330f82a-3ccb-4318-b33f-7adb64b379c7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:37.864758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f330f82a-3ccb-4318-b33f-7adb64b379c7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:37.888647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f330f82a-3ccb-4318-b33f-7adb64b379c7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:37.891323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f330f82a-3ccb-4318-b33f-7adb64b379c7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:37.894612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f330f82a-3ccb-4318-b33f-7adb64b379c7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:37.895172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f330f82a-3ccb-4318-b33f-7adb64b379c7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:38.154537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f330f82a-3ccb-4318-b33f-7adb64b379c7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:38.167429 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f330f82a-3ccb-4318-b33f-7adb64b379c7 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1314 microversion: 2.1 time: 0.316980 Aug 02 07:27:38.168031 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3040/6151] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:37 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:39.191083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b19a453b-a863-4bf8-9774-7732ce893768 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:39.191712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b19a453b-a863-4bf8-9774-7732ce893768 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:39.205554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b19a453b-a863-4bf8-9774-7732ce893768 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:39.206089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b19a453b-a863-4bf8-9774-7732ce893768 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:39.206938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b19a453b-a863-4bf8-9774-7732ce893768 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:39.207384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b19a453b-a863-4bf8-9774-7732ce893768 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:39.397741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b19a453b-a863-4bf8-9774-7732ce893768 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:39.407388 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b19a453b-a863-4bf8-9774-7732ce893768 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1499 microversion: 2.1 time: 0.220336 Aug 02 07:27:39.408945 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3112/6152] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:39 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1499 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:43.784997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7f40520f-0f4a-4167-bcff-9da3df160b98 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:43.786171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7f40520f-0f4a-4167-bcff-9da3df160b98 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:43.795218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:43.797758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f40520f-0f4a-4167-bcff-9da3df160b98 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:43.798353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f40520f-0f4a-4167-bcff-9da3df160b98 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:43.800590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f40520f-0f4a-4167-bcff-9da3df160b98 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:43.801372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7f40520f-0f4a-4167-bcff-9da3df160b98 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:43.809349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=81 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:43.858882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7f40520f-0f4a-4167-bcff-9da3df160b98 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:27:43.997942 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7f40520f-0f4a-4167-bcff-9da3df160b98 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 204 len: 0 microversion: 2.1 time: 0.219147 Aug 02 07:27:44.003842 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3041/6153] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:27:43 2022] DELETE /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:27:44.018746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab77f77a-d0b3-478d-82e0-fba12cdaf314 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:44.019995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab77f77a-d0b3-478d-82e0-fba12cdaf314 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:44.023713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:44.039410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab77f77a-d0b3-478d-82e0-fba12cdaf314 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:44.040101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab77f77a-d0b3-478d-82e0-fba12cdaf314 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:44.041064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab77f77a-d0b3-478d-82e0-fba12cdaf314 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:44.041706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab77f77a-d0b3-478d-82e0-fba12cdaf314 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:44.046113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=73 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:44.325264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab77f77a-d0b3-478d-82e0-fba12cdaf314 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:44.339350 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab77f77a-d0b3-478d-82e0-fba12cdaf314 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1505 microversion: 2.1 time: 0.334097 Aug 02 07:27:44.340068 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3113/6154] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:44 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:45.363199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-11e0ec84-fd45-406a-91c3-73d55c638fbe tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:45.364953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-11e0ec84-fd45-406a-91c3-73d55c638fbe tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:45.373172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11e0ec84-fd45-406a-91c3-73d55c638fbe tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:45.373595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11e0ec84-fd45-406a-91c3-73d55c638fbe tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:45.374474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11e0ec84-fd45-406a-91c3-73d55c638fbe tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:45.375067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11e0ec84-fd45-406a-91c3-73d55c638fbe tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:45.566615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-11e0ec84-fd45-406a-91c3-73d55c638fbe tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:45.574794 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-11e0ec84-fd45-406a-91c3-73d55c638fbe tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1505 microversion: 2.1 time: 0.217594 Aug 02 07:27:45.575371 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3042/6155] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:45 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:27:46.597564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-99846cc5-878a-466a-8c87-162c0933caa3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:46.598351 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-99846cc5-878a-466a-8c87-162c0933caa3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:46.618344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99846cc5-878a-466a-8c87-162c0933caa3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:46.619409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99846cc5-878a-466a-8c87-162c0933caa3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:46.620191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99846cc5-878a-466a-8c87-162c0933caa3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:46.621265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-57d14c93-cfb0-4a95-b6d1-f48210023b07 req-d7f75bd6-8995-40e8-b31d-760a1450197b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a16fda-5b20-4183-8bd8-b5394aaca5dc", "name": "network-vif-deleted", "tag": "c13150dc-1ada-4f97-86f2-90290844b317"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:27:46.626904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-99846cc5-878a-466a-8c87-162c0933caa3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:46.654784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-57d14c93-cfb0-4a95-b6d1-f48210023b07 req-d7f75bd6-8995-40e8-b31d-760a1450197b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:46.655231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-57d14c93-cfb0-4a95-b6d1-f48210023b07 req-d7f75bd6-8995-40e8-b31d-760a1450197b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:46.675033 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-57d14c93-cfb0-4a95-b6d1-f48210023b07 req-d7f75bd6-8995-40e8-b31d-760a1450197b service nova] Creating event network-vif-deleted:c13150dc-1ada-4f97-86f2-90290844b317 for instance f6a16fda-5b20-4183-8bd8-b5394aaca5dc on n-h1-851337-3 Aug 02 07:27:46.692507 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-57d14c93-cfb0-4a95-b6d1-f48210023b07 req-d7f75bd6-8995-40e8-b31d-760a1450197b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074577 Aug 02 07:27:46.695372 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3043/6156] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:27:46.725677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-99846cc5-878a-466a-8c87-162c0933caa3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d537e33871467daa3644bf0ac939e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ea0169283c4a87be48143f715b35fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:46.737356 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-99846cc5-878a-466a-8c87-162c0933caa3 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 200 len: 1463 microversion: 2.1 time: 0.144719 Aug 02 07:27:46.746057 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3114/6157] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:46 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:47.339876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1387043999", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "f7bbf45a-8d90-4dd0-bc15-0fc1cdb2eb45"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:27:47.407033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] validate_networks() for [('f7bbf45a-8d90-4dd0-bc15-0fc1cdb2eb45', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:27:47.762046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0c2c8553-a97f-4e69-bb96-a8f6001b8c50 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:47.766606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0c2c8553-a97f-4e69-bb96-a8f6001b8c50 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] [instance: f6a16fda-5b20-4183-8bd8-b5394aaca5dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:47.776290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c2c8553-a97f-4e69-bb96-a8f6001b8c50 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:47.777250 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c2c8553-a97f-4e69-bb96-a8f6001b8c50 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:47.778536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c2c8553-a97f-4e69-bb96-a8f6001b8c50 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:47.779481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c2c8553-a97f-4e69-bb96-a8f6001b8c50 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:47.803610 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-0c2c8553-a97f-4e69-bb96-a8f6001b8c50 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] HTTP exception thrown: Instance f6a16fda-5b20-4183-8bd8-b5394aaca5dc could not be found. Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0c2c8553-a97f-4e69-bb96-a8f6001b8c50 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Request method failure captured: Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc HTTP/1.1 Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NHS4QJpvvttjiTusQ2NNm12-2P0lvI7b_5m-drYkTHQP_MCZDxgjPg5aoVSYnSaClz1ajoNQ664lpqM-RgXnFsuijmx0QdNock1PbC2Ekc7LCbmyDl_bS4hoyuC13wXFSIVSBPdjSPAtUHEf93p5tgapUk2urGiehaJR4Sk5yGLC6M Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: b8ea0169283c4a87be48143f715b35fb Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-VolumesActionsTest-1593232512 Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8ea0169283c4a87be48143f715b35fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8ea0169283c4a87be48143f715b35fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8ea0169283c4a87be48143f715b35fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8ea0169283c4a87be48143f715b35fb"}]}] Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-VolumesActionsTest-1593232512 Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: b8ea0169283c4a87be48143f715b35fb Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-VolumesActionsTest-1593232512 Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-VolumesActionsTest-1593232512-project Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 48d537e33871467daa3644bf0ac939e7 Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-VolumesActionsTest-1593232512-project Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance f6a16fda-5b20-4183-8bd8-b5394aaca5dc could not be found. Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'f6a16fda-5b20-4183-8bd8-b5394aaca5dc'} Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6a16fda-5b20-4183-8bd8-b5394aaca5dc could not be found. Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6a16fda-5b20-4183-8bd8-b5394aaca5dc could not be found. Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:27:47.805933 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:27:47.809923 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:27:47.809923 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:27:47.809923 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:27:47.809923 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:27:47.809923 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:27:47.809923 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6a16fda-5b20-4183-8bd8-b5394aaca5dc could not be found. Aug 02 07:27:47.809923 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:27:47.812003 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0c2c8553-a97f-4e69-bb96-a8f6001b8c50 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] Returning 404 to user: Instance f6a16fda-5b20-4183-8bd8-b5394aaca5dc could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:27:47.812616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:27:47.813076 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0c2c8553-a97f-4e69-bb96-a8f6001b8c50 tempest-VolumesActionsTest-1593232512 tempest-VolumesActionsTest-1593232512-project] 10.222.0.79 "GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc" status: 404 len: 111 microversion: 2.1 time: 0.055521 Aug 02 07:27:47.813227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:27:47.813580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:27:47.817837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:27:47.818026 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3115/6158] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:47 2022] GET /compute/v2.1/servers/f6a16fda-5b20-4183-8bd8-b5394aaca5dc => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:27:47.818119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:27:47.836728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:47.837185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:47.844026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:47.844026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:47.880841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Getting quotas for project 8019a67fcd8b45e0b6d67531dc524f73. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:27:47.886468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Getting quotas for user 702a892887df47c589671d94bedfef28 and project 8019a67fcd8b45e0b6d67531dc524f73. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:27:47.900064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:27:47.903119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:27:47.987151 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-770e1af7-33bc-46c5-ac10-9e725febf7c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829685 Aug 02 07:27:47.988092 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3044/6159] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:27:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:27:48.001198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f5842754-1b57-46c0-a8ed-aa296af45b05 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:48.001988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f5842754-1b57-46c0-a8ed-aa296af45b05 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:48.087859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f5842754-1b57-46c0-a8ed-aa296af45b05 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:48.099716 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f5842754-1b57-46c0-a8ed-aa296af45b05 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1215 microversion: 2.1 time: 0.102182 Aug 02 07:27:48.100771 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3116/6160] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:47 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:49.131006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-485069df-8d8d-456a-bb9b-2741c74b1682 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:49.134142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-485069df-8d8d-456a-bb9b-2741c74b1682 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:49.150652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-485069df-8d8d-456a-bb9b-2741c74b1682 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:49.151472 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-485069df-8d8d-456a-bb9b-2741c74b1682 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:49.153089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-485069df-8d8d-456a-bb9b-2741c74b1682 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:49.154098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-485069df-8d8d-456a-bb9b-2741c74b1682 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:49.249187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-485069df-8d8d-456a-bb9b-2741c74b1682 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:49.261232 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-485069df-8d8d-456a-bb9b-2741c74b1682 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1267 microversion: 2.1 time: 0.144101 Aug 02 07:27:49.262148 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3045/6161] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:49 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:50.285395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b50ee74f-0785-45ea-b629-83ad07775096 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:50.288993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b50ee74f-0785-45ea-b629-83ad07775096 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:50.299171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b50ee74f-0785-45ea-b629-83ad07775096 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:50.299589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b50ee74f-0785-45ea-b629-83ad07775096 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:50.312428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b50ee74f-0785-45ea-b629-83ad07775096 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:50.312893 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b50ee74f-0785-45ea-b629-83ad07775096 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:50.512328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b50ee74f-0785-45ea-b629-83ad07775096 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:50.526452 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b50ee74f-0785-45ea-b629-83ad07775096 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1315 microversion: 2.1 time: 0.245714 Aug 02 07:27:50.546231 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3117/6162] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:50 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:50.913769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-21e10448-4082-43bd-a8e0-6ebf6b269b0a req-22d15c7f-a11e-4243-a000-26fee88b9df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9de67f2d-006b-494c-8681-7e373485c11b", "tag": "2651e43c-a269-401d-9244-2829d838b276"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:27:50.938968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-21e10448-4082-43bd-a8e0-6ebf6b269b0a req-22d15c7f-a11e-4243-a000-26fee88b9df1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:50.942079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-21e10448-4082-43bd-a8e0-6ebf6b269b0a req-22d15c7f-a11e-4243-a000-26fee88b9df1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:50.967892 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-21e10448-4082-43bd-a8e0-6ebf6b269b0a req-22d15c7f-a11e-4243-a000-26fee88b9df1 service nova] Creating event network-changed:2651e43c-a269-401d-9244-2829d838b276 for instance 9de67f2d-006b-494c-8681-7e373485c11b on n-h1-851337-3 Aug 02 07:27:50.984761 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-21e10448-4082-43bd-a8e0-6ebf6b269b0a req-22d15c7f-a11e-4243-a000-26fee88b9df1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074680 Aug 02 07:27:50.985495 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3046/6163] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:27:51.556327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6dd5de2f-a565-431d-be91-977dde07e5b7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:51.558483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6dd5de2f-a565-431d-be91-977dde07e5b7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:51.573632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dd5de2f-a565-431d-be91-977dde07e5b7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:51.575206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dd5de2f-a565-431d-be91-977dde07e5b7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:51.579245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dd5de2f-a565-431d-be91-977dde07e5b7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:51.579710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6dd5de2f-a565-431d-be91-977dde07e5b7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:51.744287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6dd5de2f-a565-431d-be91-977dde07e5b7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:51.753389 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6dd5de2f-a565-431d-be91-977dde07e5b7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1315 microversion: 2.1 time: 0.202300 Aug 02 07:27:51.754078 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3118/6164] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:51 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:27:52.781839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0201791e-d2c5-43b4-a9b6-b42e7d013d97 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:52.783362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0201791e-d2c5-43b4-a9b6-b42e7d013d97 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:52.797442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0201791e-d2c5-43b4-a9b6-b42e7d013d97 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:52.798780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0201791e-d2c5-43b4-a9b6-b42e7d013d97 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:52.801526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0201791e-d2c5-43b4-a9b6-b42e7d013d97 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:52.802275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0201791e-d2c5-43b4-a9b6-b42e7d013d97 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:52.993424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0201791e-d2c5-43b4-a9b6-b42e7d013d97 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:53.001476 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0201791e-d2c5-43b4-a9b6-b42e7d013d97 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1315 microversion: 2.1 time: 0.228756 Aug 02 07:27:53.002249 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3047/6165] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:52 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:53.096559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b8f5b967-22e9-4f86-9b13-e9f79d910f9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:27:53.099724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b8f5b967-22e9-4f86-9b13-e9f79d910f9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:53.115303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8f5b967-22e9-4f86-9b13-e9f79d910f9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:53.118001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8f5b967-22e9-4f86-9b13-e9f79d910f9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:53.119837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8f5b967-22e9-4f86-9b13-e9f79d910f9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:53.120295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8f5b967-22e9-4f86-9b13-e9f79d910f9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:53.203214 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b8f5b967-22e9-4f86-9b13-e9f79d910f9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "POST /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d/action" status: 200 len: 24566 microversion: 2.1 time: 0.111454 Aug 02 07:27:53.203989 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3119/6166] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:27:53 2022] POST /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d/action => generated 24566 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:27:54.025927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-821a670a-ec73-481b-a4f0-689840846d1b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:54.026848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-821a670a-ec73-481b-a4f0-689840846d1b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:54.049721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-821a670a-ec73-481b-a4f0-689840846d1b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:54.050209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-821a670a-ec73-481b-a4f0-689840846d1b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:54.056343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-821a670a-ec73-481b-a4f0-689840846d1b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:54.058752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-821a670a-ec73-481b-a4f0-689840846d1b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:54.358396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-821a670a-ec73-481b-a4f0-689840846d1b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:54.371276 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-821a670a-ec73-481b-a4f0-689840846d1b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1315 microversion: 2.1 time: 0.349235 Aug 02 07:27:54.373607 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3048/6167] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:54 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:55.395828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2861cc0c-7bb6-4d90-961f-691e74d686a7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:55.397233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2861cc0c-7bb6-4d90-961f-691e74d686a7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:55.406764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2861cc0c-7bb6-4d90-961f-691e74d686a7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:55.407213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2861cc0c-7bb6-4d90-961f-691e74d686a7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:55.407991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2861cc0c-7bb6-4d90-961f-691e74d686a7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:55.408429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2861cc0c-7bb6-4d90-961f-691e74d686a7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:55.568317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2861cc0c-7bb6-4d90-961f-691e74d686a7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:55.581203 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2861cc0c-7bb6-4d90-961f-691e74d686a7 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1315 microversion: 2.1 time: 0.192152 Aug 02 07:27:55.582278 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3120/6168] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:55 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:56.365731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-813c9fb7-47f8-4b1e-ad2a-6eb3c205a741 req-894a2332-df27-4227-a019-e61f502e2eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de67f2d-006b-494c-8681-7e373485c11b", "name": "network-vif-plugged", "status": "completed", "tag": "2651e43c-a269-401d-9244-2829d838b276"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:27:56.384422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-813c9fb7-47f8-4b1e-ad2a-6eb3c205a741 req-894a2332-df27-4227-a019-e61f502e2eed service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:56.397383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-813c9fb7-47f8-4b1e-ad2a-6eb3c205a741 req-894a2332-df27-4227-a019-e61f502e2eed service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:56.426867 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-813c9fb7-47f8-4b1e-ad2a-6eb3c205a741 req-894a2332-df27-4227-a019-e61f502e2eed service nova] Creating event network-vif-plugged:2651e43c-a269-401d-9244-2829d838b276 for instance 9de67f2d-006b-494c-8681-7e373485c11b on n-h1-851337-3 Aug 02 07:27:56.437380 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-813c9fb7-47f8-4b1e-ad2a-6eb3c205a741 req-894a2332-df27-4227-a019-e61f502e2eed service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076961 Aug 02 07:27:56.438959 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3049/6169] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:27:56.604914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7c8b7c92-ea75-467c-971c-50b1f8d347e6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:56.606214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7c8b7c92-ea75-467c-971c-50b1f8d347e6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:56.615251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c8b7c92-ea75-467c-971c-50b1f8d347e6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:56.615951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c8b7c92-ea75-467c-971c-50b1f8d347e6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:56.617804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c8b7c92-ea75-467c-971c-50b1f8d347e6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:56.618463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c8b7c92-ea75-467c-971c-50b1f8d347e6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:56.767731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7c8b7c92-ea75-467c-971c-50b1f8d347e6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:56.777590 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7c8b7c92-ea75-467c-971c-50b1f8d347e6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1315 microversion: 2.1 time: 0.176647 Aug 02 07:27:56.778894 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3121/6170] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:56 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:57.800471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2b304c08-7701-4160-b993-bd41a21cb5ba tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:57.801175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2b304c08-7701-4160-b993-bd41a21cb5ba tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:57.812188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b304c08-7701-4160-b993-bd41a21cb5ba tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:57.813349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b304c08-7701-4160-b993-bd41a21cb5ba tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:57.814635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b304c08-7701-4160-b993-bd41a21cb5ba tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:57.817719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b304c08-7701-4160-b993-bd41a21cb5ba tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:57.860361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:57.895089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:58.029830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2b304c08-7701-4160-b993-bd41a21cb5ba tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:58.050447 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2b304c08-7701-4160-b993-bd41a21cb5ba tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1315 microversion: 2.1 time: 0.242590 Aug 02 07:27:58.050447 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3050/6171] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:57 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:59.060270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ae2197b-65c9-4169-809e-1da8e1cbeb7c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:59.061408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9ae2197b-65c9-4169-809e-1da8e1cbeb7c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:59.068030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:27:59.070458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ae2197b-65c9-4169-809e-1da8e1cbeb7c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:59.071084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ae2197b-65c9-4169-809e-1da8e1cbeb7c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:59.072069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ae2197b-65c9-4169-809e-1da8e1cbeb7c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:59.072919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ae2197b-65c9-4169-809e-1da8e1cbeb7c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:59.264806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9ae2197b-65c9-4169-809e-1da8e1cbeb7c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:59.276303 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9ae2197b-65c9-4169-809e-1da8e1cbeb7c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1501 microversion: 2.1 time: 0.219494 Aug 02 07:27:59.277845 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3122/6172] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:59 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1501 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:27:59.306369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a761941d-d962-4d7e-9f02-e3fc99c82811 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:59.307723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a761941d-d962-4d7e-9f02-e3fc99c82811 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:59.320558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a761941d-d962-4d7e-9f02-e3fc99c82811 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:59.321469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a761941d-d962-4d7e-9f02-e3fc99c82811 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:59.322589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a761941d-d962-4d7e-9f02-e3fc99c82811 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:59.323164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a761941d-d962-4d7e-9f02-e3fc99c82811 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:59.476762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a761941d-d962-4d7e-9f02-e3fc99c82811 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:59.487824 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a761941d-d962-4d7e-9f02-e3fc99c82811 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1501 microversion: 2.1 time: 0.189118 Aug 02 07:27:59.489232 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3051/6173] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:59 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1501 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:27:59.515634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-64dc754b-7e3d-48b9-b1ba-62d82143d29c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:27:59.516566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-64dc754b-7e3d-48b9-b1ba-62d82143d29c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:59.525150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64dc754b-7e3d-48b9-b1ba-62d82143d29c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:59.526077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64dc754b-7e3d-48b9-b1ba-62d82143d29c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:59.527194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64dc754b-7e3d-48b9-b1ba-62d82143d29c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:59.527785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64dc754b-7e3d-48b9-b1ba-62d82143d29c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:59.559764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-64dc754b-7e3d-48b9-b1ba-62d82143d29c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lazy-loading 'flavor' on Instance uuid 9de67f2d-006b-494c-8681-7e373485c11b {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:27:59.674738 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-64dc754b-7e3d-48b9-b1ba-62d82143d29c tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "POST /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b/action" status: 202 len: 0 microversion: 2.1 time: 0.164602 Aug 02 07:27:59.676580 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3123/6174] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:27:59 2022] POST /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:27:59.683961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2f3f3a0c-554b-486f-8881-954ac130eba6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:27:59.684863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2f3f3a0c-554b-486f-8881-954ac130eba6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:27:59.694329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f3f3a0c-554b-486f-8881-954ac130eba6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:59.698827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f3f3a0c-554b-486f-8881-954ac130eba6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:59.700044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f3f3a0c-554b-486f-8881-954ac130eba6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:27:59.700720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2f3f3a0c-554b-486f-8881-954ac130eba6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:27:59.890367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2f3f3a0c-554b-486f-8881-954ac130eba6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:27:59.900564 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2f3f3a0c-554b-486f-8881-954ac130eba6 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1509 microversion: 2.1 time: 0.220211 Aug 02 07:27:59.902171 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3052/6175] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:27:59 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:00.925483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0e5828cb-4a72-4dbc-adaa-15dfa9dff469 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:00.930202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0e5828cb-4a72-4dbc-adaa-15dfa9dff469 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:00.938847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e5828cb-4a72-4dbc-adaa-15dfa9dff469 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:00.939622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e5828cb-4a72-4dbc-adaa-15dfa9dff469 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:00.940888 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e5828cb-4a72-4dbc-adaa-15dfa9dff469 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:00.941334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0e5828cb-4a72-4dbc-adaa-15dfa9dff469 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:01.413921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0e5828cb-4a72-4dbc-adaa-15dfa9dff469 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:01.423005 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0e5828cb-4a72-4dbc-adaa-15dfa9dff469 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1492 microversion: 2.1 time: 0.502773 Aug 02 07:28:01.424132 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3124/6176] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:00 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1492 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:01.444105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-916b98cf-9e21-4d3a-aba8-6257296c4b4f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:28:01.444670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-916b98cf-9e21-4d3a-aba8-6257296c4b4f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:01.452697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-916b98cf-9e21-4d3a-aba8-6257296c4b4f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:01.453134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-916b98cf-9e21-4d3a-aba8-6257296c4b4f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:01.454176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-916b98cf-9e21-4d3a-aba8-6257296c4b4f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:01.454774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-916b98cf-9e21-4d3a-aba8-6257296c4b4f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:01.551712 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-916b98cf-9e21-4d3a-aba8-6257296c4b4f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "POST /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b/action" status: 202 len: 0 microversion: 2.1 time: 0.111346 Aug 02 07:28:01.553292 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3053/6177] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:28:01 2022] POST /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:28:01.561924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-21099d1e-1f87-4790-98c1-c002194b1455 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:01.562723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-21099d1e-1f87-4790-98c1-c002194b1455 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:01.570178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21099d1e-1f87-4790-98c1-c002194b1455 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:01.571428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21099d1e-1f87-4790-98c1-c002194b1455 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:01.573032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21099d1e-1f87-4790-98c1-c002194b1455 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:01.573839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21099d1e-1f87-4790-98c1-c002194b1455 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:01.802259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-21099d1e-1f87-4790-98c1-c002194b1455 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:01.814100 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-21099d1e-1f87-4790-98c1-c002194b1455 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1498 microversion: 2.1 time: 0.256437 Aug 02 07:28:01.815900 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3125/6178] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:01 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1498 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:02.838369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5aa18005-ee1e-46bb-a002-30fee811eb60 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:02.839353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5aa18005-ee1e-46bb-a002-30fee811eb60 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:02.845942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5aa18005-ee1e-46bb-a002-30fee811eb60 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:02.846399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5aa18005-ee1e-46bb-a002-30fee811eb60 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:02.847205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5aa18005-ee1e-46bb-a002-30fee811eb60 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:02.847640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5aa18005-ee1e-46bb-a002-30fee811eb60 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:03.036605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5aa18005-ee1e-46bb-a002-30fee811eb60 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:03.046624 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5aa18005-ee1e-46bb-a002-30fee811eb60 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1498 microversion: 2.1 time: 0.213748 Aug 02 07:28:03.047683 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3054/6179] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:02 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1498 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:04.067944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c2030d5d-7732-42b3-99d1-f8871e4df918 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:04.068566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c2030d5d-7732-42b3-99d1-f8871e4df918 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:04.076540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2030d5d-7732-42b3-99d1-f8871e4df918 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:04.076985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2030d5d-7732-42b3-99d1-f8871e4df918 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:04.077766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2030d5d-7732-42b3-99d1-f8871e4df918 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:04.078501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2030d5d-7732-42b3-99d1-f8871e4df918 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:04.290817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c2030d5d-7732-42b3-99d1-f8871e4df918 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:04.310743 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c2030d5d-7732-42b3-99d1-f8871e4df918 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1501 microversion: 2.1 time: 0.246813 Aug 02 07:28:04.334236 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3126/6180] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:04 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1501 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:04.355110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5c8bd3a7-15ca-4cf0-b09c-bbde7b36fac9 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:28:04.356473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5c8bd3a7-15ca-4cf0-b09c-bbde7b36fac9 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:04.364496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c8bd3a7-15ca-4cf0-b09c-bbde7b36fac9 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:04.365192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c8bd3a7-15ca-4cf0-b09c-bbde7b36fac9 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:04.366237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c8bd3a7-15ca-4cf0-b09c-bbde7b36fac9 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:04.366871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c8bd3a7-15ca-4cf0-b09c-bbde7b36fac9 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:04.405099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-5c8bd3a7-15ca-4cf0-b09c-bbde7b36fac9 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lazy-loading 'flavor' on Instance uuid 9de67f2d-006b-494c-8681-7e373485c11b {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:28:04.528344 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5c8bd3a7-15ca-4cf0-b09c-bbde7b36fac9 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "POST /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b/action" status: 202 len: 0 microversion: 2.1 time: 0.176264 Aug 02 07:28:04.530189 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3055/6181] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:28:04 2022] POST /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:28:04.538473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df1a9e76-9a0a-4488-b315-29aaf16a700f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:04.539099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df1a9e76-9a0a-4488-b315-29aaf16a700f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:04.555700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df1a9e76-9a0a-4488-b315-29aaf16a700f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:04.556966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df1a9e76-9a0a-4488-b315-29aaf16a700f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:04.559177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df1a9e76-9a0a-4488-b315-29aaf16a700f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:04.559827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df1a9e76-9a0a-4488-b315-29aaf16a700f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:04.985877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-df1a9e76-9a0a-4488-b315-29aaf16a700f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:04.995961 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df1a9e76-9a0a-4488-b315-29aaf16a700f tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1509 microversion: 2.1 time: 0.460908 Aug 02 07:28:04.997155 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3127/6182] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:04 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1509 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:06.020293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a4b06408-2426-4815-b565-c37185a26d09 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:06.021002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a4b06408-2426-4815-b565-c37185a26d09 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:06.061727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4b06408-2426-4815-b565-c37185a26d09 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:06.062574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4b06408-2426-4815-b565-c37185a26d09 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:06.063603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4b06408-2426-4815-b565-c37185a26d09 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:06.064235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a4b06408-2426-4815-b565-c37185a26d09 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:06.064352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-74d7ca6e-9b75-4441-b297-b0d26541e1ee tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Action: 'create', calling method: .version_select at 0x7f927a1c21f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-511701564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqNE50MbeWIh+7PJ2GhKDABH1ka6nSByhCHzT909Us05zEzp7+R8Jpt+RWFZGZQBAMdFF0DEgxw6YBzqqLm6t8vHUDyrdPGuZdJHxH8S5GHPiDRkhIRxQ1iBnO2ihXeMQ=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:28:06.092494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:28:06.131621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-74d7ca6e-9b75-4441-b297-b0d26541e1ee tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Getting quotas for project 47a4bcdb764647e7a0ac29ca20ceae03. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:28:06.141879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-74d7ca6e-9b75-4441-b297-b0d26541e1ee tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Getting quotas for user f5b47f98af604fea9f078504441d6c76 and project 47a4bcdb764647e7a0ac29ca20ceae03. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:28:06.205015 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-74d7ca6e-9b75-4441-b297-b0d26541e1ee tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.144547 Aug 02 07:28:06.206053 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3128/6183] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:28:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:28:06.323945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a4b06408-2426-4815-b565-c37185a26d09 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:06.335199 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a4b06408-2426-4815-b565-c37185a26d09 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1492 microversion: 2.1 time: 0.319774 Aug 02 07:28:06.349919 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3056/6184] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:06 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1492 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:06.357559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0a6cc935-0a39-483a-b386-3e53995774b2 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:28:06.358598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0a6cc935-0a39-483a-b386-3e53995774b2 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:06.378974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a6cc935-0a39-483a-b386-3e53995774b2 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:06.379713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a6cc935-0a39-483a-b386-3e53995774b2 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:06.380685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a6cc935-0a39-483a-b386-3e53995774b2 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:06.381703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a6cc935-0a39-483a-b386-3e53995774b2 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:06.498233 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0a6cc935-0a39-483a-b386-3e53995774b2 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "POST /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b/action" status: 202 len: 0 microversion: 2.1 time: 0.144722 Aug 02 07:28:06.499397 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3129/6185] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:28:06 2022] POST /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:28:06.509000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e03fff36-6ff4-4c1f-aa07-d644bc8b675b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:06.510175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e03fff36-6ff4-4c1f-aa07-d644bc8b675b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:06.518204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e03fff36-6ff4-4c1f-aa07-d644bc8b675b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:06.519670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e03fff36-6ff4-4c1f-aa07-d644bc8b675b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:06.520816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e03fff36-6ff4-4c1f-aa07-d644bc8b675b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:06.521461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e03fff36-6ff4-4c1f-aa07-d644bc8b675b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:06.865558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e03fff36-6ff4-4c1f-aa07-d644bc8b675b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:06.880000 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e03fff36-6ff4-4c1f-aa07-d644bc8b675b tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1498 microversion: 2.1 time: 0.375353 Aug 02 07:28:06.895176 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3057/6186] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:06 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1498 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:07.908258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-42f7de37-64b9-4e28-9d69-f061a925f871 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:07.909580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-42f7de37-64b9-4e28-9d69-f061a925f871 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:07.919561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42f7de37-64b9-4e28-9d69-f061a925f871 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:07.920300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42f7de37-64b9-4e28-9d69-f061a925f871 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:07.921519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42f7de37-64b9-4e28-9d69-f061a925f871 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:07.922201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42f7de37-64b9-4e28-9d69-f061a925f871 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:07.955878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:28:08.358985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-42f7de37-64b9-4e28-9d69-f061a925f871 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:08.371496 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-42f7de37-64b9-4e28-9d69-f061a925f871 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1498 microversion: 2.1 time: 0.469650 Aug 02 07:28:08.391952 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3130/6187] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:07 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1498 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:08.803644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1082048548", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "bcbf3f84-dbe2-4db0-a106-ed1630005ab0"}], "key_name": "tempest-TestNetworkBasicOps-511701564", "security_groups": [{"name": "tempest-secgroup-smoke-1733131192"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:28:09.007481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] validate_networks() for [('bcbf3f84-dbe2-4db0-a106-ed1630005ab0', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:28:09.396190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-11b57d2c-e675-4f72-94bf-727070fce0ad tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:09.397143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-11b57d2c-e675-4f72-94bf-727070fce0ad tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:09.405550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11b57d2c-e675-4f72-94bf-727070fce0ad tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:09.416342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11b57d2c-e675-4f72-94bf-727070fce0ad tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:09.417400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11b57d2c-e675-4f72-94bf-727070fce0ad tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:09.417868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-11b57d2c-e675-4f72-94bf-727070fce0ad tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:09.689858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-11b57d2c-e675-4f72-94bf-727070fce0ad tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:09.700022 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-11b57d2c-e675-4f72-94bf-727070fce0ad tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1501 microversion: 2.1 time: 0.307821 Aug 02 07:28:09.704839 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3131/6188] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:09 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1501 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:09.736480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-74f5b88e-7032-4198-b21d-1bab989cc685 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:09.737680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-74f5b88e-7032-4198-b21d-1bab989cc685 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:09.749420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74f5b88e-7032-4198-b21d-1bab989cc685 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:09.755419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74f5b88e-7032-4198-b21d-1bab989cc685 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:09.756646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74f5b88e-7032-4198-b21d-1bab989cc685 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:09.757656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74f5b88e-7032-4198-b21d-1bab989cc685 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:09.831343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-74f5b88e-7032-4198-b21d-1bab989cc685 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:28:09.873478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:28:09.875193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:28:09.875875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:28:09.876497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:28:09.877667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:28:09.891462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:09.892151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:09.893229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:09.894006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:09.928007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Getting quotas for project 47a4bcdb764647e7a0ac29ca20ceae03. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:28:09.949972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Getting quotas for user f5b47f98af604fea9f078504441d6c76 and project 47a4bcdb764647e7a0ac29ca20ceae03. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:28:09.987944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:28:09.991282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:28:10.056266 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-74f5b88e-7032-4198-b21d-1bab989cc685 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 204 len: 0 microversion: 2.1 time: 0.324244 Aug 02 07:28:10.057667 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3132/6189] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:28:09 2022] DELETE /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:28:10.069360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-467ad797-8fe0-4d19-bcb8-34bba532b286 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:10.070279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-467ad797-8fe0-4d19-bcb8-34bba532b286 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:10.077617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-467ad797-8fe0-4d19-bcb8-34bba532b286 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:10.078271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-467ad797-8fe0-4d19-bcb8-34bba532b286 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:10.079212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-467ad797-8fe0-4d19-bcb8-34bba532b286 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:10.079810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-467ad797-8fe0-4d19-bcb8-34bba532b286 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:10.087619 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b715085b-ee5a-4302-a99e-6e2c12912a7a tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.290461 Aug 02 07:28:10.088276 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3058/6190] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:28:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:28:10.103088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-284f562b-037e-49fa-9054-72f92f232f3c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:10.112611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-284f562b-037e-49fa-9054-72f92f232f3c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:10.234777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-284f562b-037e-49fa-9054-72f92f232f3c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:10.245834 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-284f562b-037e-49fa-9054-72f92f232f3c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 200 len: 1248 microversion: 2.1 time: 0.149292 Aug 02 07:28:10.247102 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3059/6191] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:10 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 1248 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:28:10.317728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-467ad797-8fe0-4d19-bcb8-34bba532b286 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:10.331922 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-467ad797-8fe0-4d19-bcb8-34bba532b286 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1507 microversion: 2.1 time: 0.269504 Aug 02 07:28:10.347430 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3133/6192] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:10 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1507 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:11.271083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-48400cd1-f53d-421c-a098-0c5dff7af7b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:11.271673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-48400cd1-f53d-421c-a098-0c5dff7af7b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:11.284107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48400cd1-f53d-421c-a098-0c5dff7af7b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:11.284566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48400cd1-f53d-421c-a098-0c5dff7af7b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:11.285403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48400cd1-f53d-421c-a098-0c5dff7af7b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:11.285914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48400cd1-f53d-421c-a098-0c5dff7af7b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:11.354525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-114f2596-3a9a-43d9-8f40-6dcd242e8194 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:11.355134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-114f2596-3a9a-43d9-8f40-6dcd242e8194 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:11.370392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-114f2596-3a9a-43d9-8f40-6dcd242e8194 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:11.371103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-114f2596-3a9a-43d9-8f40-6dcd242e8194 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:11.371898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-48400cd1-f53d-421c-a098-0c5dff7af7b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:11.372264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-114f2596-3a9a-43d9-8f40-6dcd242e8194 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:11.372851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-114f2596-3a9a-43d9-8f40-6dcd242e8194 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:11.381625 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-48400cd1-f53d-421c-a098-0c5dff7af7b7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 200 len: 1300 microversion: 2.1 time: 0.114641 Aug 02 07:28:11.382726 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3060/6193] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:11 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:11.607919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-114f2596-3a9a-43d9-8f40-6dcd242e8194 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:11.619684 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-114f2596-3a9a-43d9-8f40-6dcd242e8194 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1507 microversion: 2.1 time: 0.268810 Aug 02 07:28:11.620800 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3134/6194] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:11 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:28:12.404797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ca5d20c4-503d-4e32-946f-8308e10db62b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:12.407226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ca5d20c4-503d-4e32-946f-8308e10db62b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:12.420340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca5d20c4-503d-4e32-946f-8308e10db62b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:12.421771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca5d20c4-503d-4e32-946f-8308e10db62b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:12.423099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca5d20c4-503d-4e32-946f-8308e10db62b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:12.423880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca5d20c4-503d-4e32-946f-8308e10db62b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:12.562441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ca5d20c4-503d-4e32-946f-8308e10db62b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:12.580588 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ca5d20c4-503d-4e32-946f-8308e10db62b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 200 len: 1306 microversion: 2.1 time: 0.180515 Aug 02 07:28:12.581623 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3061/6195] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:12 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 1306 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:12.641175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d7c931dc-86d3-4213-9412-8030581af9c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:12.641825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d7c931dc-86d3-4213-9412-8030581af9c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:12.658701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7c931dc-86d3-4213-9412-8030581af9c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:12.659543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7c931dc-86d3-4213-9412-8030581af9c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:12.664495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7c931dc-86d3-4213-9412-8030581af9c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:12.664609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d7c931dc-86d3-4213-9412-8030581af9c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:12.805076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d7c931dc-86d3-4213-9412-8030581af9c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702a892887df47c589671d94bedfef28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8019a67fcd8b45e0b6d67531dc524f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:12.818645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c9309e80-878f-4a3b-93d4-1cf6bee1c7a9 req-991ff712-d43b-4f27-b34b-b27c0c162386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de67f2d-006b-494c-8681-7e373485c11b", "name": "network-vif-deleted", "tag": "2651e43c-a269-401d-9244-2829d838b276"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:28:12.843026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c9309e80-878f-4a3b-93d4-1cf6bee1c7a9 req-991ff712-d43b-4f27-b34b-b27c0c162386 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:12.844580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c9309e80-878f-4a3b-93d4-1cf6bee1c7a9 req-991ff712-d43b-4f27-b34b-b27c0c162386 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:12.846097 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d7c931dc-86d3-4213-9412-8030581af9c8 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 200 len: 1465 microversion: 2.1 time: 0.208677 Aug 02 07:28:12.860877 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3135/6196] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:12 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 1465 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:12.897958 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c9309e80-878f-4a3b-93d4-1cf6bee1c7a9 req-991ff712-d43b-4f27-b34b-b27c0c162386 service nova] Creating event network-vif-deleted:2651e43c-a269-401d-9244-2829d838b276 for instance 9de67f2d-006b-494c-8681-7e373485c11b on n-h1-851337-3 Aug 02 07:28:12.919883 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c9309e80-878f-4a3b-93d4-1cf6bee1c7a9 req-991ff712-d43b-4f27-b34b-b27c0c162386 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103974 Aug 02 07:28:12.920830 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3062/6197] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:28:13.603763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-88b74d2f-fa5a-42dc-a62a-fb490f6da430 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:13.604558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-88b74d2f-fa5a-42dc-a62a-fb490f6da430 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:13.629525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88b74d2f-fa5a-42dc-a62a-fb490f6da430 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:13.630589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88b74d2f-fa5a-42dc-a62a-fb490f6da430 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:13.632569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88b74d2f-fa5a-42dc-a62a-fb490f6da430 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:13.636880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88b74d2f-fa5a-42dc-a62a-fb490f6da430 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:13.894621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2e341f58-fdd9-4b10-adf5-5e592f15e115 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:13.895372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2e341f58-fdd9-4b10-adf5-5e592f15e115 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] [instance: 9de67f2d-006b-494c-8681-7e373485c11b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:13.903126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:28:13.912320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e341f58-fdd9-4b10-adf5-5e592f15e115 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:13.912968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e341f58-fdd9-4b10-adf5-5e592f15e115 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:13.913824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e341f58-fdd9-4b10-adf5-5e592f15e115 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:13.914512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e341f58-fdd9-4b10-adf5-5e592f15e115 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:13.938351 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-2e341f58-fdd9-4b10-adf5-5e592f15e115 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] HTTP exception thrown: Instance 9de67f2d-006b-494c-8681-7e373485c11b could not be found. Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2e341f58-fdd9-4b10-adf5-5e592f15e115 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Request method failure captured: Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b HTTP/1.1 Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NHxuniQJJZt03rdBap70wBGPVbKQHfCeYPMKbxiZ7huD70J4BmGyXiWJ0Qs-HRGYonGLZCuToRh8Ggpxbu2zp7KhM1D1-MwjADIe4YDGdhLG1INl_7RXF6D1kq_G1Ypfnd_DshtpLbCVe8oDJg4PkOZ-Y2o8tnphAlY79eG7sX5b9Y Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 8019a67fcd8b45e0b6d67531dc524f73 Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestServerAdvancedOps-1399590662 Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8019a67fcd8b45e0b6d67531dc524f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8019a67fcd8b45e0b6d67531dc524f73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8019a67fcd8b45e0b6d67531dc524f73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8019a67fcd8b45e0b6d67531dc524f73"}]}] Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestServerAdvancedOps-1399590662 Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 8019a67fcd8b45e0b6d67531dc524f73 Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestServerAdvancedOps-1399590662 Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestServerAdvancedOps-1399590662-project Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 702a892887df47c589671d94bedfef28 Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestServerAdvancedOps-1399590662-project Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 9de67f2d-006b-494c-8681-7e373485c11b could not be found. Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '9de67f2d-006b-494c-8681-7e373485c11b'} Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de67f2d-006b-494c-8681-7e373485c11b could not be found. Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de67f2d-006b-494c-8681-7e373485c11b could not be found. Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:28:13.940772 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:28:13.947253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:28:13.947253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:28:13.947253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:28:13.947253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:28:13.947253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:28:13.947253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de67f2d-006b-494c-8681-7e373485c11b could not be found. Aug 02 07:28:13.947253 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:28:13.947253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2e341f58-fdd9-4b10-adf5-5e592f15e115 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] Returning 404 to user: Instance 9de67f2d-006b-494c-8681-7e373485c11b could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:28:13.947253 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2e341f58-fdd9-4b10-adf5-5e592f15e115 tempest-TestServerAdvancedOps-1399590662 tempest-TestServerAdvancedOps-1399590662-project] 10.222.0.79 "GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b" status: 404 len: 111 microversion: 2.1 time: 0.059637 Aug 02 07:28:13.947253 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3063/6198] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:13 2022] GET /compute/v2.1/servers/9de67f2d-006b-494c-8681-7e373485c11b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:28:13.976360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-88b74d2f-fa5a-42dc-a62a-fb490f6da430 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:13.986276 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-88b74d2f-fa5a-42dc-a62a-fb490f6da430 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 200 len: 1374 microversion: 2.1 time: 0.386977 Aug 02 07:28:13.987408 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3136/6199] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:13 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 1374 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:14.294259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8e4f511e-5138-4a4c-b886-9bf0c3af8e8c req-2d9d8710-b0dd-4fca-94e9-e98c76c3824a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb5cd1a2-501a-478a-8ac5-eaf5b767a056", "tag": "af723d00-042a-487b-9d7a-d13d0baae65d"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:28:14.317743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8e4f511e-5138-4a4c-b886-9bf0c3af8e8c req-2d9d8710-b0dd-4fca-94e9-e98c76c3824a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:14.319690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8e4f511e-5138-4a4c-b886-9bf0c3af8e8c req-2d9d8710-b0dd-4fca-94e9-e98c76c3824a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:14.355659 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8e4f511e-5138-4a4c-b886-9bf0c3af8e8c req-2d9d8710-b0dd-4fca-94e9-e98c76c3824a service nova] Creating event network-changed:af723d00-042a-487b-9d7a-d13d0baae65d for instance cb5cd1a2-501a-478a-8ac5-eaf5b767a056 on n-h2-851337-3 Aug 02 07:28:14.370168 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8e4f511e-5138-4a4c-b886-9bf0c3af8e8c req-2d9d8710-b0dd-4fca-94e9-e98c76c3824a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084188 Aug 02 07:28:14.374475 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3064/6200] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:28:15.017228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3b3c3d91-01cf-4f0a-8cc9-7be3733ddfd9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:15.024971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3b3c3d91-01cf-4f0a-8cc9-7be3733ddfd9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:15.043859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:28:15.058217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b3c3d91-01cf-4f0a-8cc9-7be3733ddfd9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:15.058693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b3c3d91-01cf-4f0a-8cc9-7be3733ddfd9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:15.059488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b3c3d91-01cf-4f0a-8cc9-7be3733ddfd9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:15.059974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b3c3d91-01cf-4f0a-8cc9-7be3733ddfd9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:15.322604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3b3c3d91-01cf-4f0a-8cc9-7be3733ddfd9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:15.331725 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3b3c3d91-01cf-4f0a-8cc9-7be3733ddfd9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 200 len: 1374 microversion: 2.1 time: 0.324108 Aug 02 07:28:15.343028 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3137/6201] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:15 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 1374 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:16.364388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d6317dce-da39-4b0c-8049-71ee56731485 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:16.367197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d6317dce-da39-4b0c-8049-71ee56731485 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:16.392323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6317dce-da39-4b0c-8049-71ee56731485 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:16.393003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6317dce-da39-4b0c-8049-71ee56731485 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:16.394144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6317dce-da39-4b0c-8049-71ee56731485 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:16.394688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d6317dce-da39-4b0c-8049-71ee56731485 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:17.132978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d6317dce-da39-4b0c-8049-71ee56731485 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:17.142017 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d6317dce-da39-4b0c-8049-71ee56731485 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 200 len: 1374 microversion: 2.1 time: 0.792853 Aug 02 07:28:17.143600 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3065/6202] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:16 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 1374 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:18.164878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-572a6b68-50b0-4c60-925a-a7ce17b1f8a0 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:18.166734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-572a6b68-50b0-4c60-925a-a7ce17b1f8a0 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:18.169876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:28:18.177326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-572a6b68-50b0-4c60-925a-a7ce17b1f8a0 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:18.177990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-572a6b68-50b0-4c60-925a-a7ce17b1f8a0 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:18.178919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-572a6b68-50b0-4c60-925a-a7ce17b1f8a0 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:18.179505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-572a6b68-50b0-4c60-925a-a7ce17b1f8a0 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:18.339788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-572a6b68-50b0-4c60-925a-a7ce17b1f8a0 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:18.348440 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-572a6b68-50b0-4c60-925a-a7ce17b1f8a0 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 200 len: 1374 microversion: 2.1 time: 0.188269 Aug 02 07:28:18.349009 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3138/6203] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:18 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:19.379712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4a67d772-5fe8-4c60-8cde-02c80c390c66 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:19.379712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4a67d772-5fe8-4c60-8cde-02c80c390c66 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:19.399415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a67d772-5fe8-4c60-8cde-02c80c390c66 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:19.400210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a67d772-5fe8-4c60-8cde-02c80c390c66 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:19.401617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a67d772-5fe8-4c60-8cde-02c80c390c66 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:19.402286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a67d772-5fe8-4c60-8cde-02c80c390c66 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:19.548156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4a67d772-5fe8-4c60-8cde-02c80c390c66 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:19.557276 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4a67d772-5fe8-4c60-8cde-02c80c390c66 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 200 len: 1374 microversion: 2.1 time: 0.186002 Aug 02 07:28:19.558473 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3066/6204] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:19 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 1374 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:20.580766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5fefdb7b-d0dd-4a82-92e6-f8ad22bdec97 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:20.582013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5fefdb7b-d0dd-4a82-92e6-f8ad22bdec97 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:20.592744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5fefdb7b-d0dd-4a82-92e6-f8ad22bdec97 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:20.593217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5fefdb7b-d0dd-4a82-92e6-f8ad22bdec97 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:20.598060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5fefdb7b-d0dd-4a82-92e6-f8ad22bdec97 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:20.598812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5fefdb7b-d0dd-4a82-92e6-f8ad22bdec97 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:20.864429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5fefdb7b-d0dd-4a82-92e6-f8ad22bdec97 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:20.874811 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5fefdb7b-d0dd-4a82-92e6-f8ad22bdec97 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 200 len: 1374 microversion: 2.1 time: 0.297819 Aug 02 07:28:20.876134 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3139/6205] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:20 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 1374 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:20.978167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c6ef837b-fb68-4e11-8c35-c3c0225f36f7 req-6c6c782e-9c86-4614-9193-f93e048af900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5cd1a2-501a-478a-8ac5-eaf5b767a056", "name": "network-vif-plugged", "status": "completed", "tag": "af723d00-042a-487b-9d7a-d13d0baae65d"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:28:20.994944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:28:20.999204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=8 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:28:21.005360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c6ef837b-fb68-4e11-8c35-c3c0225f36f7 req-6c6c782e-9c86-4614-9193-f93e048af900 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:21.008446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c6ef837b-fb68-4e11-8c35-c3c0225f36f7 req-6c6c782e-9c86-4614-9193-f93e048af900 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:21.039544 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c6ef837b-fb68-4e11-8c35-c3c0225f36f7 req-6c6c782e-9c86-4614-9193-f93e048af900 service nova] Creating event network-vif-plugged:af723d00-042a-487b-9d7a-d13d0baae65d for instance cb5cd1a2-501a-478a-8ac5-eaf5b767a056 on n-h2-851337-3 Aug 02 07:28:21.045429 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c6ef837b-fb68-4e11-8c35-c3c0225f36f7 req-6c6c782e-9c86-4614-9193-f93e048af900 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074864 Aug 02 07:28:21.046881 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3067/6206] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:28:21.896845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-882a471e-c6cc-48fc-9290-be751c7f7981 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:21.898143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-882a471e-c6cc-48fc-9290-be751c7f7981 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:21.906547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-882a471e-c6cc-48fc-9290-be751c7f7981 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:21.907281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-882a471e-c6cc-48fc-9290-be751c7f7981 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:21.908492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-882a471e-c6cc-48fc-9290-be751c7f7981 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:21.909121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-882a471e-c6cc-48fc-9290-be751c7f7981 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:22.097257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-882a471e-c6cc-48fc-9290-be751c7f7981 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:22.106076 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-882a471e-c6cc-48fc-9290-be751c7f7981 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 200 len: 1374 microversion: 2.1 time: 0.213287 Aug 02 07:28:22.106665 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3140/6207] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:21 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 1374 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:23.132653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d1fd4f6b-444d-41bd-bec7-9f2225b1d6de tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:23.134188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d1fd4f6b-444d-41bd-bec7-9f2225b1d6de tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:23.152852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d1fd4f6b-444d-41bd-bec7-9f2225b1d6de tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:23.153872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d1fd4f6b-444d-41bd-bec7-9f2225b1d6de tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:23.154849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d1fd4f6b-444d-41bd-bec7-9f2225b1d6de tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:23.155663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d1fd4f6b-444d-41bd-bec7-9f2225b1d6de tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:23.323795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d1fd4f6b-444d-41bd-bec7-9f2225b1d6de tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:23.332582 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d1fd4f6b-444d-41bd-bec7-9f2225b1d6de tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 200 len: 1547 microversion: 2.1 time: 0.205666 Aug 02 07:28:23.334247 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3068/6208] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:23 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 1547 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:23.354206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a05be5b1-97f1-4667-8783-50841c31ee45 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:23.355705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a05be5b1-97f1-4667-8783-50841c31ee45 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:23.377797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a05be5b1-97f1-4667-8783-50841c31ee45 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:23.378586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a05be5b1-97f1-4667-8783-50841c31ee45 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:23.379576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a05be5b1-97f1-4667-8783-50841c31ee45 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:23.382550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a05be5b1-97f1-4667-8783-50841c31ee45 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:23.737308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a05be5b1-97f1-4667-8783-50841c31ee45 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:23.772637 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a05be5b1-97f1-4667-8783-50841c31ee45 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 200 len: 1547 microversion: 2.1 time: 0.419677 Aug 02 07:28:23.789799 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3141/6209] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:23 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 1547 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:28:45.754314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-6543940", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0d1870d6-b690-488c-949c-e9ffb422cf78", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5a68237c-f872-4b09-8d4c-16c9a40f01a7"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:28:45.786944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=11 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:28:45.788049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=51 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:28:45.862183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] validate_networks() for [('5a68237c-f872-4b09-8d4c-16c9a40f01a7', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:28:46.411649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:28:46.412294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:28:46.412919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:28:46.413483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:28:46.414094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:28:46.431150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:46.431878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:46.433471 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:46.434669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:46.457850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:28:46.464039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for user 9f2f38363b9644f7956995d598509787 and project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:28:46.619380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:28:46.628625 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d1870d6-b690-488c-949c-e9ffb422cf78',volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:28:46.856024 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dafc8932-85c1-4697-b932-00890ec51a54 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.105593 Aug 02 07:28:46.865040 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3069/6210] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:28:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:28:46.869838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-24692808-5d9d-4891-a34d-f6c989b6b155 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:46.872807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-24692808-5d9d-4891-a34d-f6c989b6b155 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:46.880305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=9 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:28:46.882296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:28:46.968681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-24692808-5d9d-4891-a34d-f6c989b6b155 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:46.979659 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-24692808-5d9d-4891-a34d-f6c989b6b155 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1054 microversion: 2.1 time: 0.114013 Aug 02 07:28:46.980806 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3142/6211] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:46 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1054 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:28:48.004807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d830b70a-8632-4f52-8999-828d60cf3cf4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:48.009307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d830b70a-8632-4f52-8999-828d60cf3cf4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:48.043038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d830b70a-8632-4f52-8999-828d60cf3cf4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:48.043623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d830b70a-8632-4f52-8999-828d60cf3cf4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:48.044430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d830b70a-8632-4f52-8999-828d60cf3cf4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:48.044884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d830b70a-8632-4f52-8999-828d60cf3cf4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:48.270873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d830b70a-8632-4f52-8999-828d60cf3cf4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:48.282407 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d830b70a-8632-4f52-8999-828d60cf3cf4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1152 microversion: 2.1 time: 0.284901 Aug 02 07:28:48.284310 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3070/6212] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:47 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1152 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:49.309500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c2e85027-4fe6-4c26-9b6c-2f0730f38823 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:49.311077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c2e85027-4fe6-4c26-9b6c-2f0730f38823 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:49.323195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2e85027-4fe6-4c26-9b6c-2f0730f38823 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:49.324122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2e85027-4fe6-4c26-9b6c-2f0730f38823 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:49.328004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2e85027-4fe6-4c26-9b6c-2f0730f38823 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:49.329182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2e85027-4fe6-4c26-9b6c-2f0730f38823 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:49.437601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c2e85027-4fe6-4c26-9b6c-2f0730f38823 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:49.451209 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c2e85027-4fe6-4c26-9b6c-2f0730f38823 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1170 microversion: 2.1 time: 0.147900 Aug 02 07:28:49.455245 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3143/6213] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:49 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1170 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:50.100789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0fe6fbda-8958-4e31-a819-2e851828915b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:50.102332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0fe6fbda-8958-4e31-a819-2e851828915b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:50.121057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fe6fbda-8958-4e31-a819-2e851828915b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:50.121527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fe6fbda-8958-4e31-a819-2e851828915b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:50.130780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fe6fbda-8958-4e31-a819-2e851828915b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:50.131245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fe6fbda-8958-4e31-a819-2e851828915b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:50.225296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0fe6fbda-8958-4e31-a819-2e851828915b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:28:50.422481 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0fe6fbda-8958-4e31-a819-2e851828915b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 204 len: 0 microversion: 2.1 time: 0.325523 Aug 02 07:28:50.427167 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3071/6214] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:28:50 2022] DELETE /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:28:50.433501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b56dc25-36b8-4104-90da-8ad427d55e2e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:50.434845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b56dc25-36b8-4104-90da-8ad427d55e2e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:50.467009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b56dc25-36b8-4104-90da-8ad427d55e2e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:50.470398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b56dc25-36b8-4104-90da-8ad427d55e2e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:50.471496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b56dc25-36b8-4104-90da-8ad427d55e2e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:50.474122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b56dc25-36b8-4104-90da-8ad427d55e2e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:50.484336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5857b6ab-2d0c-4448-8cc5-c58e6dffebe3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:50.489517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5857b6ab-2d0c-4448-8cc5-c58e6dffebe3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:50.500432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5857b6ab-2d0c-4448-8cc5-c58e6dffebe3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:50.503598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5857b6ab-2d0c-4448-8cc5-c58e6dffebe3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:50.504536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5857b6ab-2d0c-4448-8cc5-c58e6dffebe3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:50.506270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5857b6ab-2d0c-4448-8cc5-c58e6dffebe3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:50.860536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7b56dc25-36b8-4104-90da-8ad427d55e2e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:50.875786 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b56dc25-36b8-4104-90da-8ad427d55e2e tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 200 len: 1553 microversion: 2.1 time: 0.447164 Aug 02 07:28:50.889862 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3144/6215] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:50 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 1553 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:28:51.033657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5857b6ab-2d0c-4448-8cc5-c58e6dffebe3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:51.044042 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5857b6ab-2d0c-4448-8cc5-c58e6dffebe3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1212 microversion: 2.1 time: 0.566678 Aug 02 07:28:51.065150 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3072/6216] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:50 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1212 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:51.460373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-58e078d6-ff56-43b4-8e33-43dd85bb75d7 req-5754d5a9-ee0c-4c31-b721-f193efd22a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a17412d2-da38-4c1e-a9fc-1324a61a496f", "tag": "9efef12e-0a49-45f4-aba2-877791dc5b72"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:28:51.484105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-58e078d6-ff56-43b4-8e33-43dd85bb75d7 req-5754d5a9-ee0c-4c31-b721-f193efd22a00 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:51.484551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-58e078d6-ff56-43b4-8e33-43dd85bb75d7 req-5754d5a9-ee0c-4c31-b721-f193efd22a00 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:51.559959 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-58e078d6-ff56-43b4-8e33-43dd85bb75d7 req-5754d5a9-ee0c-4c31-b721-f193efd22a00 service nova] Creating event network-changed:9efef12e-0a49-45f4-aba2-877791dc5b72 for instance a17412d2-da38-4c1e-a9fc-1324a61a496f on n-h1-851337-3 Aug 02 07:28:51.575709 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-58e078d6-ff56-43b4-8e33-43dd85bb75d7 req-5754d5a9-ee0c-4c31-b721-f193efd22a00 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118009 Aug 02 07:28:51.578731 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3145/6217] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:28:51.896878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-785963f4-8b5a-4334-aaa3-129bd86f1337 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:51.897582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-785963f4-8b5a-4334-aaa3-129bd86f1337 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:51.914638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-785963f4-8b5a-4334-aaa3-129bd86f1337 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:51.915104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-785963f4-8b5a-4334-aaa3-129bd86f1337 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:51.919474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-785963f4-8b5a-4334-aaa3-129bd86f1337 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:51.919929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-785963f4-8b5a-4334-aaa3-129bd86f1337 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:52.076624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f43c7d8b-2e84-468b-b1fc-5a7d4aa58bd3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:52.077269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f43c7d8b-2e84-468b-b1fc-5a7d4aa58bd3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:52.088985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f43c7d8b-2e84-468b-b1fc-5a7d4aa58bd3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:52.093339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f43c7d8b-2e84-468b-b1fc-5a7d4aa58bd3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:52.094404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f43c7d8b-2e84-468b-b1fc-5a7d4aa58bd3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:52.100115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f43c7d8b-2e84-468b-b1fc-5a7d4aa58bd3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:52.778975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-785963f4-8b5a-4334-aaa3-129bd86f1337 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:52.791864 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-785963f4-8b5a-4334-aaa3-129bd86f1337 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 200 len: 1553 microversion: 2.1 time: 0.899120 Aug 02 07:28:52.794076 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3073/6218] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:51 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 1553 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:52.820359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f43c7d8b-2e84-468b-b1fc-5a7d4aa58bd3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:52.828638 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f43c7d8b-2e84-468b-b1fc-5a7d4aa58bd3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1212 microversion: 2.1 time: 0.760153 Aug 02 07:28:52.829239 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3146/6219] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:52 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1212 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:53.043631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-207ffbe7-8cf3-43c0-926f-e5b38330c24f req-79cd0bc4-5514-4ce3-9d45-654cf7b6997f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5cd1a2-501a-478a-8ac5-eaf5b767a056", "name": "network-vif-deleted", "tag": "af723d00-042a-487b-9d7a-d13d0baae65d"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:28:53.079145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-207ffbe7-8cf3-43c0-926f-e5b38330c24f req-79cd0bc4-5514-4ce3-9d45-654cf7b6997f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:53.080349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-207ffbe7-8cf3-43c0-926f-e5b38330c24f req-79cd0bc4-5514-4ce3-9d45-654cf7b6997f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:53.143607 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-207ffbe7-8cf3-43c0-926f-e5b38330c24f req-79cd0bc4-5514-4ce3-9d45-654cf7b6997f service nova] Creating event network-vif-deleted:af723d00-042a-487b-9d7a-d13d0baae65d for instance cb5cd1a2-501a-478a-8ac5-eaf5b767a056 on n-h2-851337-3 Aug 02 07:28:53.155642 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-207ffbe7-8cf3-43c0-926f-e5b38330c24f req-79cd0bc4-5514-4ce3-9d45-654cf7b6997f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115577 Aug 02 07:28:53.156546 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3074/6220] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:28:53.820126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2cd41913-2b4a-41ce-b590-877966744c53 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:53.821465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2cd41913-2b4a-41ce-b590-877966744c53 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: cb5cd1a2-501a-478a-8ac5-eaf5b767a056] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:53.830327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2cd41913-2b4a-41ce-b590-877966744c53 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:53.831040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2cd41913-2b4a-41ce-b590-877966744c53 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:53.832042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2cd41913-2b4a-41ce-b590-877966744c53 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:53.832699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2cd41913-2b4a-41ce-b590-877966744c53 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:53.851694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9b7fb758-0156-4ece-92f8-2fb8fca2f82a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:53.852644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9b7fb758-0156-4ece-92f8-2fb8fca2f82a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:53.860537 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-2cd41913-2b4a-41ce-b590-877966744c53 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] HTTP exception thrown: Instance cb5cd1a2-501a-478a-8ac5-eaf5b767a056 could not be found. Aug 02 07:28:53.863459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b7fb758-0156-4ece-92f8-2fb8fca2f82a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:53.866431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b7fb758-0156-4ece-92f8-2fb8fca2f82a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:53.867481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b7fb758-0156-4ece-92f8-2fb8fca2f82a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:53.868149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b7fb758-0156-4ece-92f8-2fb8fca2f82a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2cd41913-2b4a-41ce-b590-877966744c53 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Request method failure captured: Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 HTTP/1.1 Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NG-8hmFiyPky85Lm7XpDAm6gmY_XRDupbkbwT0DLZ1cxMJtdiDO09SMxEjm0MZDLxfu9w8aZOW4ecHtY3A0ML8B5QCBZ6yKLzUnNdK0vkJVZkhZbqiGFUVkt006FZ0FJbgL22W94j8roOEMT8KcTeLjyuh7Kld7FPEXFrZhS0jzA4A Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 47a4bcdb764647e7a0ac29ca20ceae03 Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestNetworkBasicOps-1976904351 Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/47a4bcdb764647e7a0ac29ca20ceae03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/47a4bcdb764647e7a0ac29ca20ceae03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_47a4bcdb764647e7a0ac29ca20ceae03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/47a4bcdb764647e7a0ac29ca20ceae03"}]}] Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestNetworkBasicOps-1976904351 Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 47a4bcdb764647e7a0ac29ca20ceae03 Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestNetworkBasicOps-1976904351 Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestNetworkBasicOps-1976904351-project Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: f5b47f98af604fea9f078504441d6c76 Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestNetworkBasicOps-1976904351-project Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance cb5cd1a2-501a-478a-8ac5-eaf5b767a056 could not be found. Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'cb5cd1a2-501a-478a-8ac5-eaf5b767a056'} Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb5cd1a2-501a-478a-8ac5-eaf5b767a056 could not be found. Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb5cd1a2-501a-478a-8ac5-eaf5b767a056 could not be found. Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:28:53.875046 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:28:53.880251 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:28:53.880251 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:28:53.880251 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:28:53.880251 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:28:53.880251 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:28:53.880251 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb5cd1a2-501a-478a-8ac5-eaf5b767a056 could not be found. Aug 02 07:28:53.880251 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:28:53.880251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2cd41913-2b4a-41ce-b590-877966744c53 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Returning 404 to user: Instance cb5cd1a2-501a-478a-8ac5-eaf5b767a056 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:28:53.880251 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2cd41913-2b4a-41ce-b590-877966744c53 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056" status: 404 len: 111 microversion: 2.1 time: 0.060488 Aug 02 07:28:53.880251 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3147/6221] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:53 2022] GET /compute/v2.1/servers/cb5cd1a2-501a-478a-8ac5-eaf5b767a056 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:28:54.064353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9b7fb758-0156-4ece-92f8-2fb8fca2f82a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:54.075416 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9b7fb758-0156-4ece-92f8-2fb8fca2f82a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1212 microversion: 2.1 time: 0.227906 Aug 02 07:28:54.077297 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3075/6222] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:53 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1212 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:28:54.152991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d1370912-1877-4dbb-9379-81d1846d5115 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '.version_select at 0x7f927b261e50>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:54.195029 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d1370912-1877-4dbb-9379-81d1846d5115 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-511701564" status: 202 len: 0 microversion: 2.1 time: 0.045833 Aug 02 07:28:54.196195 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3148/6223] 10.222.0.79 () {58 vars in 1254 bytes} [Tue Aug 2 07:28:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-511701564 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:28:55.101552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-598051e5-53ea-4aab-a664-0425120af26b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:55.106531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-598051e5-53ea-4aab-a664-0425120af26b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:55.129451 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-598051e5-53ea-4aab-a664-0425120af26b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:55.129762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-598051e5-53ea-4aab-a664-0425120af26b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:55.131202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-598051e5-53ea-4aab-a664-0425120af26b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:55.138353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-598051e5-53ea-4aab-a664-0425120af26b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:55.449491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-598051e5-53ea-4aab-a664-0425120af26b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:55.460960 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-598051e5-53ea-4aab-a664-0425120af26b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1212 microversion: 2.1 time: 0.363253 Aug 02 07:28:55.461597 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3076/6224] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:55 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1212 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:56.489699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-983087ae-9335-428e-892a-5c58cb451db6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:56.491231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-983087ae-9335-428e-892a-5c58cb451db6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:56.500820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-983087ae-9335-428e-892a-5c58cb451db6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:56.501521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-983087ae-9335-428e-892a-5c58cb451db6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:56.502723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-983087ae-9335-428e-892a-5c58cb451db6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:56.503469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-983087ae-9335-428e-892a-5c58cb451db6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:56.651312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8ae3928d-a06b-466e-8a0f-75e34cec4b16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:56.651849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8ae3928d-a06b-466e-8a0f-75e34cec4b16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:56.666249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:28:56.666999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:28:56.671209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ae3928d-a06b-466e-8a0f-75e34cec4b16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:56.671654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ae3928d-a06b-466e-8a0f-75e34cec4b16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:56.672748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ae3928d-a06b-466e-8a0f-75e34cec4b16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:56.673382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ae3928d-a06b-466e-8a0f-75e34cec4b16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:56.692914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-983087ae-9335-428e-892a-5c58cb451db6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:56.701396 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-983087ae-9335-428e-892a-5c58cb451db6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1200 microversion: 2.1 time: 0.220412 Aug 02 07:28:56.702021 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3149/6225] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:56 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1200 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:56.717671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-c136b30d-d06b-40eb-9871-c21776a38670 req-70716992-417e-4d45-85fe-d8418f97a875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d10a84-0fa6-4e3e-8604-c8b946ee129d", "tag": "6ee8655d-dc3c-4285-a871-23285b881ec0"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:28:56.735686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c136b30d-d06b-40eb-9871-c21776a38670 req-70716992-417e-4d45-85fe-d8418f97a875 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:56.738944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c136b30d-d06b-40eb-9871-c21776a38670 req-70716992-417e-4d45-85fe-d8418f97a875 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:56.757206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8ae3928d-a06b-466e-8a0f-75e34cec4b16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:28:56.759891 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-c136b30d-d06b-40eb-9871-c21776a38670 req-70716992-417e-4d45-85fe-d8418f97a875 service nova] Creating event network-changed:6ee8655d-dc3c-4285-a871-23285b881ec0 for instance d6d10a84-0fa6-4e3e-8604-c8b946ee129d on n-h2-851337-3 Aug 02 07:28:56.766104 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-c136b30d-d06b-40eb-9871-c21776a38670 req-70716992-417e-4d45-85fe-d8418f97a875 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056278 Aug 02 07:28:56.766977 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3150/6226] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:28:56.897998 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8ae3928d-a06b-466e-8a0f-75e34cec4b16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 204 len: 0 microversion: 2.1 time: 0.251038 Aug 02 07:28:56.904489 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3077/6227] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:28:56 2022] DELETE /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:28:56.914078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4e3b218e-ea09-436d-8841-70f6fb262872 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:56.914792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4e3b218e-ea09-436d-8841-70f6fb262872 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:56.936307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e3b218e-ea09-436d-8841-70f6fb262872 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:56.936672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e3b218e-ea09-436d-8841-70f6fb262872 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:56.937460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e3b218e-ea09-436d-8841-70f6fb262872 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:56.937923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e3b218e-ea09-436d-8841-70f6fb262872 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:56.977639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:28:57.120271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4e3b218e-ea09-436d-8841-70f6fb262872 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:57.129434 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4e3b218e-ea09-436d-8841-70f6fb262872 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1672 microversion: 2.1 time: 0.220076 Aug 02 07:28:57.142783 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3151/6228] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:56 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1672 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:57.725143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7551e6c6-26dc-4f1a-b99d-e902ce522f0a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:57.726136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7551e6c6-26dc-4f1a-b99d-e902ce522f0a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:57.736777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7551e6c6-26dc-4f1a-b99d-e902ce522f0a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:57.737227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7551e6c6-26dc-4f1a-b99d-e902ce522f0a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:57.738580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7551e6c6-26dc-4f1a-b99d-e902ce522f0a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:57.739192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7551e6c6-26dc-4f1a-b99d-e902ce522f0a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:57.923551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7551e6c6-26dc-4f1a-b99d-e902ce522f0a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:57.948162 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7551e6c6-26dc-4f1a-b99d-e902ce522f0a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1200 microversion: 2.1 time: 0.224829 Aug 02 07:28:57.954249 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3078/6229] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:57 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1200 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:58.152718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a5697ed2-a969-4cd3-8bb2-06c833fbac16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:58.153336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a5697ed2-a969-4cd3-8bb2-06c833fbac16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:58.169081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5697ed2-a969-4cd3-8bb2-06c833fbac16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:58.169340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5697ed2-a969-4cd3-8bb2-06c833fbac16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:58.170164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5697ed2-a969-4cd3-8bb2-06c833fbac16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:58.170602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a5697ed2-a969-4cd3-8bb2-06c833fbac16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:58.428430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a5697ed2-a969-4cd3-8bb2-06c833fbac16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:58.437308 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a5697ed2-a969-4cd3-8bb2-06c833fbac16 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1672 microversion: 2.1 time: 0.288438 Aug 02 07:28:58.450357 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3152/6230] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:58 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1672 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:58.968901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34a255df-ffd2-4099-a6f5-d8a036202308 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:58.969633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-34a255df-ffd2-4099-a6f5-d8a036202308 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:58.995660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34a255df-ffd2-4099-a6f5-d8a036202308 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:58.996455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34a255df-ffd2-4099-a6f5-d8a036202308 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:58.998602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34a255df-ffd2-4099-a6f5-d8a036202308 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:59.000887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34a255df-ffd2-4099-a6f5-d8a036202308 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:59.195014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-8718ae18-8fe9-4712-b02d-2d4023e83891 req-c726a119-3a4d-4ba6-9977-bb8fc2a88732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d10a84-0fa6-4e3e-8604-c8b946ee129d", "name": "network-vif-deleted", "tag": "6ee8655d-dc3c-4285-a871-23285b881ec0"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:28:59.214851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8718ae18-8fe9-4712-b02d-2d4023e83891 req-c726a119-3a4d-4ba6-9977-bb8fc2a88732 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:59.215453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-8718ae18-8fe9-4712-b02d-2d4023e83891 req-c726a119-3a4d-4ba6-9977-bb8fc2a88732 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:59.238231 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-8718ae18-8fe9-4712-b02d-2d4023e83891 req-c726a119-3a4d-4ba6-9977-bb8fc2a88732 service nova] Creating event network-vif-deleted:6ee8655d-dc3c-4285-a871-23285b881ec0 for instance d6d10a84-0fa6-4e3e-8604-c8b946ee129d on n-h2-851337-3 Aug 02 07:28:59.248115 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-8718ae18-8fe9-4712-b02d-2d4023e83891 req-c726a119-3a4d-4ba6-9977-bb8fc2a88732 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057196 Aug 02 07:28:59.249294 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3153/6231] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:28:59.294394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-34a255df-ffd2-4099-a6f5-d8a036202308 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:59.302762 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-34a255df-ffd2-4099-a6f5-d8a036202308 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1200 microversion: 2.1 time: 0.337492 Aug 02 07:28:59.309991 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3079/6232] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:58 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1200 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:28:59.462426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-36ae36c3-e77e-4f36-b7f1-74ceaf19145c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:28:59.463599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-36ae36c3-e77e-4f36-b7f1-74ceaf19145c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:28:59.473268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36ae36c3-e77e-4f36-b7f1-74ceaf19145c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:59.473869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36ae36c3-e77e-4f36-b7f1-74ceaf19145c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:59.475267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36ae36c3-e77e-4f36-b7f1-74ceaf19145c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:59.475950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36ae36c3-e77e-4f36-b7f1-74ceaf19145c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:59.524278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36ae36c3-e77e-4f36-b7f1-74ceaf19145c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:28:59.525589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36ae36c3-e77e-4f36-b7f1-74ceaf19145c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:28:59.526276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-36ae36c3-e77e-4f36-b7f1-74ceaf19145c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lazy-loading 'fault' on Instance uuid d6d10a84-0fa6-4e3e-8604-c8b946ee129d {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:28:59.607042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-36ae36c3-e77e-4f36-b7f1-74ceaf19145c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:28:59.618688 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-36ae36c3-e77e-4f36-b7f1-74ceaf19145c tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 200 len: 1338 microversion: 2.1 time: 0.161845 Aug 02 07:28:59.619610 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3154/6233] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:28:59 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 1338 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:29:00.324007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5cc34533-852d-4f24-b659-1cb7af06f740 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:00.324602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5cc34533-852d-4f24-b659-1cb7af06f740 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:00.332382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cc34533-852d-4f24-b659-1cb7af06f740 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:00.333159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cc34533-852d-4f24-b659-1cb7af06f740 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:00.334030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cc34533-852d-4f24-b659-1cb7af06f740 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:00.334633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cc34533-852d-4f24-b659-1cb7af06f740 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:00.485702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5cc34533-852d-4f24-b659-1cb7af06f740 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:00.494621 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5cc34533-852d-4f24-b659-1cb7af06f740 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1200 microversion: 2.1 time: 0.174555 Aug 02 07:29:00.495198 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3080/6234] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:00 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1200 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:00.642200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9221dfd2-0b7a-4807-89e6-275c96f7bb7f tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:00.643230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9221dfd2-0b7a-4807-89e6-275c96f7bb7f tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: d6d10a84-0fa6-4e3e-8604-c8b946ee129d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:00.650678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9221dfd2-0b7a-4807-89e6-275c96f7bb7f tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:00.651373 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9221dfd2-0b7a-4807-89e6-275c96f7bb7f tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:00.652280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9221dfd2-0b7a-4807-89e6-275c96f7bb7f tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:00.652949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9221dfd2-0b7a-4807-89e6-275c96f7bb7f tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:00.667255 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-9221dfd2-0b7a-4807-89e6-275c96f7bb7f tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] HTTP exception thrown: Instance d6d10a84-0fa6-4e3e-8604-c8b946ee129d could not be found. Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9221dfd2-0b7a-4807-89e6-275c96f7bb7f tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Request method failure captured: Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d HTTP/1.1 Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NG-8hmFiyPky85Lm7XpDAm6gmY_XRDupbkbwT0DLZ1cxMJtdiDO09SMxEjm0MZDLxfu9w8aZOW4ecHtY3A0ML8B5QCBZ6yKLzUnNdK0vkJVZkhZbqiGFUVkt006FZ0FJbgL22W94j8roOEMT8KcTeLjyuh7Kld7FPEXFrZhS0jzA4A Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 47a4bcdb764647e7a0ac29ca20ceae03 Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestNetworkBasicOps-1976904351 Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/47a4bcdb764647e7a0ac29ca20ceae03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/47a4bcdb764647e7a0ac29ca20ceae03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_47a4bcdb764647e7a0ac29ca20ceae03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/47a4bcdb764647e7a0ac29ca20ceae03"}]}] Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestNetworkBasicOps-1976904351 Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 47a4bcdb764647e7a0ac29ca20ceae03 Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestNetworkBasicOps-1976904351 Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestNetworkBasicOps-1976904351-project Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: f5b47f98af604fea9f078504441d6c76 Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestNetworkBasicOps-1976904351-project Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance d6d10a84-0fa6-4e3e-8604-c8b946ee129d could not be found. Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'd6d10a84-0fa6-4e3e-8604-c8b946ee129d'} Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d10a84-0fa6-4e3e-8604-c8b946ee129d could not be found. Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d10a84-0fa6-4e3e-8604-c8b946ee129d could not be found. Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:29:00.669062 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:00.673935 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:29:00.673935 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:29:00.673935 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:29:00.673935 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:29:00.673935 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:29:00.673935 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d10a84-0fa6-4e3e-8604-c8b946ee129d could not be found. Aug 02 07:29:00.673935 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:00.673935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9221dfd2-0b7a-4807-89e6-275c96f7bb7f tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Returning 404 to user: Instance d6d10a84-0fa6-4e3e-8604-c8b946ee129d could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:29:00.675615 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9221dfd2-0b7a-4807-89e6-275c96f7bb7f tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d" status: 404 len: 111 microversion: 2.1 time: 0.037731 Aug 02 07:29:00.676256 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3155/6235] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:00 2022] GET /compute/v2.1/servers/d6d10a84-0fa6-4e3e-8604-c8b946ee129d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:29:00.872716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cecf83e0-f989-46ec-8016-dccf284bd346 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '.version_select at 0x7f9279e884c0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:00.900052 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cecf83e0-f989-46ec-8016-dccf284bd346 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1966428504" status: 202 len: 0 microversion: 2.1 time: 0.031274 Aug 02 07:29:00.901367 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3081/6236] 10.222.0.79 () {58 vars in 1257 bytes} [Tue Aug 2 07:29:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1966428504 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:29:01.516830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9b402cad-fc1b-42a0-89c7-ee1432352e2f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:01.517565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9b402cad-fc1b-42a0-89c7-ee1432352e2f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:01.529616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b402cad-fc1b-42a0-89c7-ee1432352e2f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:01.530291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b402cad-fc1b-42a0-89c7-ee1432352e2f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:01.533658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b402cad-fc1b-42a0-89c7-ee1432352e2f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:01.535753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b402cad-fc1b-42a0-89c7-ee1432352e2f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:01.692024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9b402cad-fc1b-42a0-89c7-ee1432352e2f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:01.700732 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9b402cad-fc1b-42a0-89c7-ee1432352e2f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1200 microversion: 2.1 time: 0.188801 Aug 02 07:29:01.701846 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3156/6237] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:01 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1200 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:02.722158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aa3846b6-9f88-4ebb-9745-37e269c077bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:02.722638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aa3846b6-9f88-4ebb-9745-37e269c077bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:02.729872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa3846b6-9f88-4ebb-9745-37e269c077bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:02.730677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa3846b6-9f88-4ebb-9745-37e269c077bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:02.731664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa3846b6-9f88-4ebb-9745-37e269c077bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:02.732433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa3846b6-9f88-4ebb-9745-37e269c077bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:02.901109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aa3846b6-9f88-4ebb-9745-37e269c077bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:02.910515 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aa3846b6-9f88-4ebb-9745-37e269c077bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1200 microversion: 2.1 time: 0.192484 Aug 02 07:29:02.911996 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3082/6238] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:02 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1200 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:03.931895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-60c6c072-6fe5-4362-ad97-f721459d5157 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:03.932513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-60c6c072-6fe5-4362-ad97-f721459d5157 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:03.940505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-60c6c072-6fe5-4362-ad97-f721459d5157 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:03.940965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-60c6c072-6fe5-4362-ad97-f721459d5157 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:03.941751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-60c6c072-6fe5-4362-ad97-f721459d5157 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:03.950445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-60c6c072-6fe5-4362-ad97-f721459d5157 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:04.181464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-60c6c072-6fe5-4362-ad97-f721459d5157 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:04.194174 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-60c6c072-6fe5-4362-ad97-f721459d5157 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1200 microversion: 2.1 time: 0.266017 Aug 02 07:29:04.197500 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3157/6239] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:03 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1200 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:05.217236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-51f310da-ec36-46a8-b94f-d441cbd65a3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:05.218506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-51f310da-ec36-46a8-b94f-d441cbd65a3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:05.234822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51f310da-ec36-46a8-b94f-d441cbd65a3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:05.235542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51f310da-ec36-46a8-b94f-d441cbd65a3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:05.237452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51f310da-ec36-46a8-b94f-d441cbd65a3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:05.240951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51f310da-ec36-46a8-b94f-d441cbd65a3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:05.604747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-51f310da-ec36-46a8-b94f-d441cbd65a3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:05.617862 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-51f310da-ec36-46a8-b94f-d441cbd65a3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1200 microversion: 2.1 time: 0.404962 Aug 02 07:29:05.618690 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3083/6240] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:05 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1200 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:06.640378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3751b742-398d-47d0-aff5-dc6705b8c4c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:06.641087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3751b742-398d-47d0-aff5-dc6705b8c4c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:06.653365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3751b742-398d-47d0-aff5-dc6705b8c4c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:06.659092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3751b742-398d-47d0-aff5-dc6705b8c4c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:06.660100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3751b742-398d-47d0-aff5-dc6705b8c4c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:06.662507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3751b742-398d-47d0-aff5-dc6705b8c4c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:06.793356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ca8bbd73-174b-4483-988d-c6e0efa36295 req-9e3fda78-b56a-4708-aa87-455f03cae496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17412d2-da38-4c1e-a9fc-1324a61a496f", "name": "network-vif-plugged", "status": "completed", "tag": "9efef12e-0a49-45f4-aba2-877791dc5b72"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:29:06.808573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ca8bbd73-174b-4483-988d-c6e0efa36295 req-9e3fda78-b56a-4708-aa87-455f03cae496 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:06.809286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ca8bbd73-174b-4483-988d-c6e0efa36295 req-9e3fda78-b56a-4708-aa87-455f03cae496 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:06.824113 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ca8bbd73-174b-4483-988d-c6e0efa36295 req-9e3fda78-b56a-4708-aa87-455f03cae496 service nova] Creating event network-vif-plugged:9efef12e-0a49-45f4-aba2-877791dc5b72 for instance a17412d2-da38-4c1e-a9fc-1324a61a496f on n-h1-851337-3 Aug 02 07:29:06.830499 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ca8bbd73-174b-4483-988d-c6e0efa36295 req-9e3fda78-b56a-4708-aa87-455f03cae496 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046362 Aug 02 07:29:06.831379 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3084/6241] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:29:07.007318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3751b742-398d-47d0-aff5-dc6705b8c4c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:07.018831 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3751b742-398d-47d0-aff5-dc6705b8c4c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1200 microversion: 2.1 time: 0.382310 Aug 02 07:29:07.020121 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3158/6242] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:06 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1200 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:08.049570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c73bd8d8-cba9-41f5-bb08-9b56b69f4864 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:08.052166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c73bd8d8-cba9-41f5-bb08-9b56b69f4864 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:08.069332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c73bd8d8-cba9-41f5-bb08-9b56b69f4864 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:08.070563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c73bd8d8-cba9-41f5-bb08-9b56b69f4864 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:08.072924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c73bd8d8-cba9-41f5-bb08-9b56b69f4864 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:08.074747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c73bd8d8-cba9-41f5-bb08-9b56b69f4864 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:08.109207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:29:08.271976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c73bd8d8-cba9-41f5-bb08-9b56b69f4864 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:08.285884 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c73bd8d8-cba9-41f5-bb08-9b56b69f4864 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1200 microversion: 2.1 time: 0.248906 Aug 02 07:29:08.288081 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3085/6243] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:08 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1200 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:09.308927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-22c6d556-f986-42ce-9068-afe76bec9b1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:09.309878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-22c6d556-f986-42ce-9068-afe76bec9b1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:09.322162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22c6d556-f986-42ce-9068-afe76bec9b1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:09.326550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22c6d556-f986-42ce-9068-afe76bec9b1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:09.329265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22c6d556-f986-42ce-9068-afe76bec9b1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:09.331628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22c6d556-f986-42ce-9068-afe76bec9b1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:09.782861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-22c6d556-f986-42ce-9068-afe76bec9b1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:09.807340 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-22c6d556-f986-42ce-9068-afe76bec9b1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1386 microversion: 2.1 time: 0.502271 Aug 02 07:29:09.808261 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3159/6244] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:09 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1386 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:09.836442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-84283166-f1e2-4062-a2ab-edb4962caff7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:09.837057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-84283166-f1e2-4062-a2ab-edb4962caff7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:09.852880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84283166-f1e2-4062-a2ab-edb4962caff7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:09.857634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84283166-f1e2-4062-a2ab-edb4962caff7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:09.858670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84283166-f1e2-4062-a2ab-edb4962caff7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:09.859257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-84283166-f1e2-4062-a2ab-edb4962caff7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:10.387065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-84283166-f1e2-4062-a2ab-edb4962caff7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:10.401546 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-84283166-f1e2-4062-a2ab-edb4962caff7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1386 microversion: 2.1 time: 0.571645 Aug 02 07:29:10.402787 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3086/6245] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:09 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1386 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:10.428442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-665aa1e2-b91a-4938-92d4-12a8bb779399 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:10.429705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-665aa1e2-b91a-4938-92d4-12a8bb779399 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:10.450638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-665aa1e2-b91a-4938-92d4-12a8bb779399 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:10.454677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-665aa1e2-b91a-4938-92d4-12a8bb779399 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:10.460163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-665aa1e2-b91a-4938-92d4-12a8bb779399 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:10.460705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-665aa1e2-b91a-4938-92d4-12a8bb779399 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:10.807960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-665aa1e2-b91a-4938-92d4-12a8bb779399 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:10.818188 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-665aa1e2-b91a-4938-92d4-12a8bb779399 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1386 microversion: 2.1 time: 0.393985 Aug 02 07:29:10.820480 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3160/6246] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:10 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1386 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:10.840625 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b88607fe-c68e-421d-8117-6c99727cae76 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:10.841142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b88607fe-c68e-421d-8117-6c99727cae76 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:10.852123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b88607fe-c68e-421d-8117-6c99727cae76 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:10.852574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b88607fe-c68e-421d-8117-6c99727cae76 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:10.853366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b88607fe-c68e-421d-8117-6c99727cae76 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:10.853796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b88607fe-c68e-421d-8117-6c99727cae76 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:10.890756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b88607fe-c68e-421d-8117-6c99727cae76 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:29:11.006591 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b88607fe-c68e-421d-8117-6c99727cae76 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 204 len: 0 microversion: 2.1 time: 0.169585 Aug 02 07:29:11.007696 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3087/6247] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:29:10 2022] DELETE /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:29:11.017096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aa9627db-1e2d-4d67-9da8-3a3b32fead36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:11.020973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aa9627db-1e2d-4d67-9da8-3a3b32fead36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:11.027764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa9627db-1e2d-4d67-9da8-3a3b32fead36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:11.028800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa9627db-1e2d-4d67-9da8-3a3b32fead36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:11.029771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa9627db-1e2d-4d67-9da8-3a3b32fead36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:11.030586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa9627db-1e2d-4d67-9da8-3a3b32fead36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:11.294867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-aa9627db-1e2d-4d67-9da8-3a3b32fead36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:11.317706 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aa9627db-1e2d-4d67-9da8-3a3b32fead36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1392 microversion: 2.1 time: 0.304415 Aug 02 07:29:11.318686 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3161/6248] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:11 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1392 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:12.340106 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f9b3531-0bd9-48cf-aab7-2d6aeab62745 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:12.341072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3f9b3531-0bd9-48cf-aab7-2d6aeab62745 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:12.363108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f9b3531-0bd9-48cf-aab7-2d6aeab62745 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:12.363581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f9b3531-0bd9-48cf-aab7-2d6aeab62745 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:12.364393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f9b3531-0bd9-48cf-aab7-2d6aeab62745 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:12.364823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f9b3531-0bd9-48cf-aab7-2d6aeab62745 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:12.676551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3f9b3531-0bd9-48cf-aab7-2d6aeab62745 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:12.686173 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3f9b3531-0bd9-48cf-aab7-2d6aeab62745 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1392 microversion: 2.1 time: 0.350566 Aug 02 07:29:12.686772 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3088/6249] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:12 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1392 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:29:13.609161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-c19beabc-4ae0-416c-8c0b-1f88c0622877 req-8fb26644-1cc8-43c0-95d2-001e0fa24d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17412d2-da38-4c1e-a9fc-1324a61a496f", "name": "network-vif-deleted", "tag": "9efef12e-0a49-45f4-aba2-877791dc5b72"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:29:13.635743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c19beabc-4ae0-416c-8c0b-1f88c0622877 req-8fb26644-1cc8-43c0-95d2-001e0fa24d47 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:13.638136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c19beabc-4ae0-416c-8c0b-1f88c0622877 req-8fb26644-1cc8-43c0-95d2-001e0fa24d47 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:13.666680 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-c19beabc-4ae0-416c-8c0b-1f88c0622877 req-8fb26644-1cc8-43c0-95d2-001e0fa24d47 service nova] Creating event network-vif-deleted:9efef12e-0a49-45f4-aba2-877791dc5b72 for instance a17412d2-da38-4c1e-a9fc-1324a61a496f on n-h1-851337-3 Aug 02 07:29:13.678601 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-c19beabc-4ae0-416c-8c0b-1f88c0622877 req-8fb26644-1cc8-43c0-95d2-001e0fa24d47 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073326 Aug 02 07:29:13.681962 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3162/6250] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:29:13.719364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e590c210-a96a-4d32-bb91-e51e75e3a757 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:13.720687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e590c210-a96a-4d32-bb91-e51e75e3a757 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:13.762181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e590c210-a96a-4d32-bb91-e51e75e3a757 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:13.762631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e590c210-a96a-4d32-bb91-e51e75e3a757 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:13.763422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e590c210-a96a-4d32-bb91-e51e75e3a757 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:13.771445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e590c210-a96a-4d32-bb91-e51e75e3a757 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:13.987221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e590c210-a96a-4d32-bb91-e51e75e3a757 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:14.005154 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e590c210-a96a-4d32-bb91-e51e75e3a757 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1185 microversion: 2.1 time: 0.297176 Aug 02 07:29:14.006160 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3089/6251] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:13 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1185 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:14.071689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-96f7c8bc-c76d-46ef-9eb0-6ddf9defcfab tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Action: 'create', calling method: .version_select at 0x7f927b2613a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1312077640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/GdTLSWcA30dpRjVH1m0eCjNtuosvr2bbwwQnf0wxulZLmJI9Yfl6fS4d1Ipzbbgfhkrl+AwodG3zP9sNzzE8QbTDh4gIThjMUZQV9PKyyGg7cci12tmx4SasgFwJBDA=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:29:14.105533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-96f7c8bc-c76d-46ef-9eb0-6ddf9defcfab tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Getting quotas for project 47a4bcdb764647e7a0ac29ca20ceae03. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:29:14.116408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-96f7c8bc-c76d-46ef-9eb0-6ddf9defcfab tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Getting quotas for user f5b47f98af604fea9f078504441d6c76 and project 47a4bcdb764647e7a0ac29ca20ceae03. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:29:14.181471 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-96f7c8bc-c76d-46ef-9eb0-6ddf9defcfab tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.114067 Aug 02 07:29:14.182453 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3163/6252] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:29:14 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:29:15.028188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d443b84b-4e5a-4995-ae74-cd1de4a9bb3e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:15.029866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d443b84b-4e5a-4995-ae74-cd1de4a9bb3e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:15.056587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d443b84b-4e5a-4995-ae74-cd1de4a9bb3e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:15.057232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d443b84b-4e5a-4995-ae74-cd1de4a9bb3e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:15.058290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d443b84b-4e5a-4995-ae74-cd1de4a9bb3e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:15.058909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d443b84b-4e5a-4995-ae74-cd1de4a9bb3e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:15.219686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d443b84b-4e5a-4995-ae74-cd1de4a9bb3e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:15.232755 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d443b84b-4e5a-4995-ae74-cd1de4a9bb3e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1185 microversion: 2.1 time: 0.208992 Aug 02 07:29:15.233836 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3090/6253] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:15 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1185 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:16.128284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1302398291", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "df251f24-489c-46c1-a014-78a9aee18c8e"}], "key_name": "tempest-TestNetworkBasicOps-1312077640", "security_groups": [{"name": "tempest-secgroup-smoke-136154438"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:29:16.258632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0a40f4d4-66ff-437a-bd86-1ddf78c1b8b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:16.259342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0a40f4d4-66ff-437a-bd86-1ddf78c1b8b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:16.263912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:29:16.299889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a40f4d4-66ff-437a-bd86-1ddf78c1b8b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:16.302422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a40f4d4-66ff-437a-bd86-1ddf78c1b8b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:16.305312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a40f4d4-66ff-437a-bd86-1ddf78c1b8b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:16.306059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a40f4d4-66ff-437a-bd86-1ddf78c1b8b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:16.411935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] validate_networks() for [('df251f24-489c-46c1-a014-78a9aee18c8e', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:29:16.455735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0a40f4d4-66ff-437a-bd86-1ddf78c1b8b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:16.464227 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0a40f4d4-66ff-437a-bd86-1ddf78c1b8b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1185 microversion: 2.1 time: 0.211369 Aug 02 07:29:16.464822 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3091/6254] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:16 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1185 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:17.063141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:29:17.063561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:29:17.064027 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:29:17.064430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:29:17.064834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:29:17.067224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:29:17.085844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:17.086952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:17.090758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:17.091907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:17.138485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=93 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:29:17.165847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Getting quotas for project 47a4bcdb764647e7a0ac29ca20ceae03. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:29:17.177988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Getting quotas for user f5b47f98af604fea9f078504441d6c76 and project 47a4bcdb764647e7a0ac29ca20ceae03. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:29:17.218593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:29:17.221847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:29:17.291708 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-784e76b5-3981-42e2-ad8f-7985a52cc077 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.168253 Aug 02 07:29:17.294940 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3164/6255] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:29:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:29:17.305997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-557c79a1-631d-43e1-88c1-08ffa4119e26 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:17.318312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-557c79a1-631d-43e1-88c1-08ffa4119e26 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:17.420290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-557c79a1-631d-43e1-88c1-08ffa4119e26 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:17.427636 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-557c79a1-631d-43e1-88c1-08ffa4119e26 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 200 len: 1249 microversion: 2.1 time: 0.125527 Aug 02 07:29:17.448797 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3092/6256] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:17 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 1249 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:17.484872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9fa24cc8-e65e-491a-885a-5515c0c06dcd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:17.485499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9fa24cc8-e65e-491a-885a-5515c0c06dcd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:17.494306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9fa24cc8-e65e-491a-885a-5515c0c06dcd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:17.494701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9fa24cc8-e65e-491a-885a-5515c0c06dcd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:17.495484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9fa24cc8-e65e-491a-885a-5515c0c06dcd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:17.495933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9fa24cc8-e65e-491a-885a-5515c0c06dcd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:17.632019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9fa24cc8-e65e-491a-885a-5515c0c06dcd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:17.640304 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9fa24cc8-e65e-491a-885a-5515c0c06dcd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1185 microversion: 2.1 time: 0.159263 Aug 02 07:29:17.641552 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3165/6257] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:17 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:18.452415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b76bf177-d59e-4bff-ada7-bf18954e4b07 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:18.453670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b76bf177-d59e-4bff-ada7-bf18954e4b07 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:18.473652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b76bf177-d59e-4bff-ada7-bf18954e4b07 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:18.475123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b76bf177-d59e-4bff-ada7-bf18954e4b07 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:18.477172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b76bf177-d59e-4bff-ada7-bf18954e4b07 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:18.479904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b76bf177-d59e-4bff-ada7-bf18954e4b07 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:18.610306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b76bf177-d59e-4bff-ada7-bf18954e4b07 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:18.623409 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b76bf177-d59e-4bff-ada7-bf18954e4b07 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 200 len: 1301 microversion: 2.1 time: 0.176000 Aug 02 07:29:18.624018 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3093/6258] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:18 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 1301 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:18.660846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-50630725-51d0-4312-ad7b-fef4978b26a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:18.662204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-50630725-51d0-4312-ad7b-fef4978b26a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:18.679307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50630725-51d0-4312-ad7b-fef4978b26a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:18.680130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50630725-51d0-4312-ad7b-fef4978b26a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:18.681167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50630725-51d0-4312-ad7b-fef4978b26a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:18.681845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-50630725-51d0-4312-ad7b-fef4978b26a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:18.817392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-50630725-51d0-4312-ad7b-fef4978b26a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:18.826551 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-50630725-51d0-4312-ad7b-fef4978b26a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1185 microversion: 2.1 time: 0.169708 Aug 02 07:29:18.827146 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3166/6259] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:18 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:19.645005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-86b2a9a7-58de-4a90-9874-25e7151f6deb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:19.646279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-86b2a9a7-58de-4a90-9874-25e7151f6deb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:19.657096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86b2a9a7-58de-4a90-9874-25e7151f6deb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:19.660734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86b2a9a7-58de-4a90-9874-25e7151f6deb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:19.662441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86b2a9a7-58de-4a90-9874-25e7151f6deb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:19.665924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-86b2a9a7-58de-4a90-9874-25e7151f6deb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:19.798956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-86b2a9a7-58de-4a90-9874-25e7151f6deb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:19.808499 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-86b2a9a7-58de-4a90-9874-25e7151f6deb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 200 len: 1307 microversion: 2.1 time: 0.167436 Aug 02 07:29:19.811922 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3094/6260] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:19 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 1307 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:19.851659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6f23c846-8225-4676-8ec7-fe9d7b6cb015 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:19.853248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6f23c846-8225-4676-8ec7-fe9d7b6cb015 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:19.863735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f23c846-8225-4676-8ec7-fe9d7b6cb015 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:19.864649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f23c846-8225-4676-8ec7-fe9d7b6cb015 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:19.867094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f23c846-8225-4676-8ec7-fe9d7b6cb015 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:19.867814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6f23c846-8225-4676-8ec7-fe9d7b6cb015 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:20.040236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6f23c846-8225-4676-8ec7-fe9d7b6cb015 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:20.050565 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6f23c846-8225-4676-8ec7-fe9d7b6cb015 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 200 len: 1185 microversion: 2.1 time: 0.205769 Aug 02 07:29:20.051489 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3167/6261] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:19 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 1185 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:20.842025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0f7b92b8-525b-4c85-a904-a89e14e07386 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:20.843353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0f7b92b8-525b-4c85-a904-a89e14e07386 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:20.851206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f7b92b8-525b-4c85-a904-a89e14e07386 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:20.851915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f7b92b8-525b-4c85-a904-a89e14e07386 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:20.853029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f7b92b8-525b-4c85-a904-a89e14e07386 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:20.853858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f7b92b8-525b-4c85-a904-a89e14e07386 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:20.903919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-961e9bcb-fa38-4e9c-ace0-3903215d1030 req-0ddb057d-bcfa-4ecf-b85d-8a5f07eb0448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "399a7eff-6f3e-4f49-b276-96f35b43ef07", "tag": "b83a1955-387d-41cd-bd2f-b438b250d12a"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:29:20.916091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-961e9bcb-fa38-4e9c-ace0-3903215d1030 req-0ddb057d-bcfa-4ecf-b85d-8a5f07eb0448 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:20.916762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-961e9bcb-fa38-4e9c-ace0-3903215d1030 req-0ddb057d-bcfa-4ecf-b85d-8a5f07eb0448 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:20.935984 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-961e9bcb-fa38-4e9c-ace0-3903215d1030 req-0ddb057d-bcfa-4ecf-b85d-8a5f07eb0448 service nova] Creating event network-changed:b83a1955-387d-41cd-bd2f-b438b250d12a for instance 399a7eff-6f3e-4f49-b276-96f35b43ef07 on n-h2-851337-3 Aug 02 07:29:20.941504 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-961e9bcb-fa38-4e9c-ace0-3903215d1030 req-0ddb057d-bcfa-4ecf-b85d-8a5f07eb0448 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045259 Aug 02 07:29:20.942237 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3168/6262] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:29:21.083398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-09c0b009-7c24-460f-9328-c796b2c5ac6f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:21.084173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-09c0b009-7c24-460f-9328-c796b2c5ac6f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: a17412d2-da38-4c1e-a9fc-1324a61a496f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:21.090864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09c0b009-7c24-460f-9328-c796b2c5ac6f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:21.091365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09c0b009-7c24-460f-9328-c796b2c5ac6f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:21.092288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09c0b009-7c24-460f-9328-c796b2c5ac6f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:21.092941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09c0b009-7c24-460f-9328-c796b2c5ac6f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:21.107296 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-09c0b009-7c24-460f-9328-c796b2c5ac6f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance a17412d2-da38-4c1e-a9fc-1324a61a496f could not be found. Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-09c0b009-7c24-460f-9328-c796b2c5ac6f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f HTTP/1.1 Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance a17412d2-da38-4c1e-a9fc-1324a61a496f could not be found. Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'a17412d2-da38-4c1e-a9fc-1324a61a496f'} Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a17412d2-da38-4c1e-a9fc-1324a61a496f could not be found. Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a17412d2-da38-4c1e-a9fc-1324a61a496f could not be found. Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:29:21.109184 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:21.114372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:29:21.114372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:29:21.114372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:29:21.114372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:29:21.114372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:29:21.114372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a17412d2-da38-4c1e-a9fc-1324a61a496f could not be found. Aug 02 07:29:21.114372 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:21.114372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-09c0b009-7c24-460f-9328-c796b2c5ac6f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance a17412d2-da38-4c1e-a9fc-1324a61a496f could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:29:21.114372 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-09c0b009-7c24-460f-9328-c796b2c5ac6f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f" status: 404 len: 111 microversion: 2.1 time: 0.031734 Aug 02 07:29:21.115967 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3169/6263] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:21 2022] GET /compute/v2.1/servers/a17412d2-da38-4c1e-a9fc-1324a61a496f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:29:21.173806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0f7b92b8-525b-4c85-a904-a89e14e07386 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:21.183496 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0f7b92b8-525b-4c85-a904-a89e14e07386 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 200 len: 1374 microversion: 2.1 time: 0.345412 Aug 02 07:29:21.185094 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3095/6264] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:20 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 1374 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:22.206379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fc6d0e3a-9b38-42bf-99ca-2360706ae9ca tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:22.206976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fc6d0e3a-9b38-42bf-99ca-2360706ae9ca tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:22.214229 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc6d0e3a-9b38-42bf-99ca-2360706ae9ca tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:22.214671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc6d0e3a-9b38-42bf-99ca-2360706ae9ca tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:22.215441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc6d0e3a-9b38-42bf-99ca-2360706ae9ca tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:22.215873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fc6d0e3a-9b38-42bf-99ca-2360706ae9ca tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:22.474187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fc6d0e3a-9b38-42bf-99ca-2360706ae9ca tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:22.484141 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fc6d0e3a-9b38-42bf-99ca-2360706ae9ca tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 200 len: 1374 microversion: 2.1 time: 0.281594 Aug 02 07:29:22.489289 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3170/6265] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:22 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 1374 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:23.512519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-69308c92-a802-4cf9-9fc5-e4e1312a63b1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:23.513312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-69308c92-a802-4cf9-9fc5-e4e1312a63b1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:23.520969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69308c92-a802-4cf9-9fc5-e4e1312a63b1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:23.521539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69308c92-a802-4cf9-9fc5-e4e1312a63b1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:23.522448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69308c92-a802-4cf9-9fc5-e4e1312a63b1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:23.522982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-69308c92-a802-4cf9-9fc5-e4e1312a63b1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:23.667012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-69308c92-a802-4cf9-9fc5-e4e1312a63b1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:23.675684 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-69308c92-a802-4cf9-9fc5-e4e1312a63b1 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 200 len: 1374 microversion: 2.1 time: 0.167334 Aug 02 07:29:23.676328 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3096/6266] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:23 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:24.701539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aa44301c-8b4e-41b9-9474-4e5b4ea230bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:24.704347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aa44301c-8b4e-41b9-9474-4e5b4ea230bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:24.715445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa44301c-8b4e-41b9-9474-4e5b4ea230bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:24.715879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa44301c-8b4e-41b9-9474-4e5b4ea230bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:24.716653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa44301c-8b4e-41b9-9474-4e5b4ea230bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:24.717289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa44301c-8b4e-41b9-9474-4e5b4ea230bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:24.911916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-aa44301c-8b4e-41b9-9474-4e5b4ea230bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:24.925242 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aa44301c-8b4e-41b9-9474-4e5b4ea230bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 200 len: 1374 microversion: 2.1 time: 0.232259 Aug 02 07:29:24.926430 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3171/6267] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:24 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 1374 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:25.952274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-87e6337e-bee7-4272-b248-35b5d6ab2271 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:25.953059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-87e6337e-bee7-4272-b248-35b5d6ab2271 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:25.961723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87e6337e-bee7-4272-b248-35b5d6ab2271 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:25.962267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87e6337e-bee7-4272-b248-35b5d6ab2271 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:25.968673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87e6337e-bee7-4272-b248-35b5d6ab2271 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:25.969153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87e6337e-bee7-4272-b248-35b5d6ab2271 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:26.120613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-87e6337e-bee7-4272-b248-35b5d6ab2271 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:26.128375 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-87e6337e-bee7-4272-b248-35b5d6ab2271 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 200 len: 1374 microversion: 2.1 time: 0.180610 Aug 02 07:29:26.128925 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3097/6268] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:25 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:26.412768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1027742712", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "dd260335-b8f7-492e-92b8-4d74f365e775", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5a68237c-f872-4b09-8d4c-16c9a40f01a7"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:29:26.475433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] validate_networks() for [('5a68237c-f872-4b09-8d4c-16c9a40f01a7', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:29:26.875032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:29:26.875461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:29:26.875943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:29:26.876360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:29:26.876774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:29:26.886227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:26.886655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:26.887458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:26.888082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:26.905521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:29:26.911243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for user 9f2f38363b9644f7956995d598509787 and project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:29:26.969741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:29:26.971891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd260335-b8f7-492e-92b8-4d74f365e775',volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:29:27.122564 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-19f0836a-b1aa-4de3-ba23-36668bebf3be tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713777 Aug 02 07:29:27.123254 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3172/6269] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:29:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:29:27.136427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-80ed5c9b-5fe9-4312-a782-251f4719cb8d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:27.137262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-80ed5c9b-5fe9-4312-a782-251f4719cb8d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:27.150491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0a4fe06f-c04c-4cd5-a334-2bdfc8c90f47 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:27.151228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0a4fe06f-c04c-4cd5-a334-2bdfc8c90f47 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:27.164134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a4fe06f-c04c-4cd5-a334-2bdfc8c90f47 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:27.166898 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a4fe06f-c04c-4cd5-a334-2bdfc8c90f47 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:27.167910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a4fe06f-c04c-4cd5-a334-2bdfc8c90f47 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:27.168511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a4fe06f-c04c-4cd5-a334-2bdfc8c90f47 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:27.259558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-80ed5c9b-5fe9-4312-a782-251f4719cb8d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:27.270803 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-80ed5c9b-5fe9-4312-a782-251f4719cb8d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1057 microversion: 2.1 time: 0.139178 Aug 02 07:29:27.271529 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3098/6270] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:27 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1057 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:27.292409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-0ae1e781-f3af-4b7b-9229-b3a77430e667 req-30cc9d1a-d352-44bc-a3a4-be11e5ca7c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399a7eff-6f3e-4f49-b276-96f35b43ef07", "name": "network-vif-plugged", "status": "completed", "tag": "b83a1955-387d-41cd-bd2f-b438b250d12a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:29:27.304724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0ae1e781-f3af-4b7b-9229-b3a77430e667 req-30cc9d1a-d352-44bc-a3a4-be11e5ca7c57 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:27.305179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0ae1e781-f3af-4b7b-9229-b3a77430e667 req-30cc9d1a-d352-44bc-a3a4-be11e5ca7c57 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:27.317971 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-0ae1e781-f3af-4b7b-9229-b3a77430e667 req-30cc9d1a-d352-44bc-a3a4-be11e5ca7c57 service nova] Creating event network-vif-plugged:b83a1955-387d-41cd-bd2f-b438b250d12a for instance 399a7eff-6f3e-4f49-b276-96f35b43ef07 on n-h2-851337-3 Aug 02 07:29:27.326374 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-0ae1e781-f3af-4b7b-9229-b3a77430e667 req-30cc9d1a-d352-44bc-a3a4-be11e5ca7c57 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052099 Aug 02 07:29:27.326987 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3099/6271] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:29:27.387565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0a4fe06f-c04c-4cd5-a334-2bdfc8c90f47 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:27.398044 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0a4fe06f-c04c-4cd5-a334-2bdfc8c90f47 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 200 len: 1374 microversion: 2.1 time: 0.253146 Aug 02 07:29:27.398640 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3173/6272] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:27 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 1374 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:29:28.297170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-18678ca1-e0b0-44ef-a0e0-6b6b592bec62 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:28.298162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-18678ca1-e0b0-44ef-a0e0-6b6b592bec62 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:28.309204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18678ca1-e0b0-44ef-a0e0-6b6b592bec62 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:28.309658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18678ca1-e0b0-44ef-a0e0-6b6b592bec62 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:28.310503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18678ca1-e0b0-44ef-a0e0-6b6b592bec62 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:28.312438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-18678ca1-e0b0-44ef-a0e0-6b6b592bec62 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:28.383203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-18678ca1-e0b0-44ef-a0e0-6b6b592bec62 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:28.391436 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-18678ca1-e0b0-44ef-a0e0-6b6b592bec62 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1173 microversion: 2.1 time: 0.100377 Aug 02 07:29:28.392206 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3100/6273] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:28 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1173 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:28.420063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2fd16ba-8bc8-4cd0-869b-6e68281ea344 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:28.420685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f2fd16ba-8bc8-4cd0-869b-6e68281ea344 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:28.427740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2fd16ba-8bc8-4cd0-869b-6e68281ea344 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:28.428132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2fd16ba-8bc8-4cd0-869b-6e68281ea344 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:28.428908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2fd16ba-8bc8-4cd0-869b-6e68281ea344 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:28.429348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2fd16ba-8bc8-4cd0-869b-6e68281ea344 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:28.612064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f2fd16ba-8bc8-4cd0-869b-6e68281ea344 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:28.621481 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f2fd16ba-8bc8-4cd0-869b-6e68281ea344 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 200 len: 1374 microversion: 2.1 time: 0.205156 Aug 02 07:29:28.623443 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3174/6274] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:28 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 1374 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:29.414663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dffc539a-e9fc-42a0-ac3f-c9e8b20c5dd6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:29.415359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dffc539a-e9fc-42a0-ac3f-c9e8b20c5dd6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:29.424810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dffc539a-e9fc-42a0-ac3f-c9e8b20c5dd6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:29.425685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dffc539a-e9fc-42a0-ac3f-c9e8b20c5dd6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:29.426899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dffc539a-e9fc-42a0-ac3f-c9e8b20c5dd6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:29.427546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dffc539a-e9fc-42a0-ac3f-c9e8b20c5dd6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:29.582179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dffc539a-e9fc-42a0-ac3f-c9e8b20c5dd6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:29.589867 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dffc539a-e9fc-42a0-ac3f-c9e8b20c5dd6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1215 microversion: 2.1 time: 0.180865 Aug 02 07:29:29.590691 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3101/6275] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:29 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1215 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:29.645824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b05bfb43-71ff-4c8e-8633-5a9539a62762 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:29.646698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b05bfb43-71ff-4c8e-8633-5a9539a62762 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:29.654103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-9fdf326b-af58-4497-ad84-39d1e43e4399 req-ffeaaf70-05a2-4de8-a890-9e0aae77018d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8123cc9-cb30-4d6f-9753-752169c68b84", "tag": "bb2f3880-24a9-4805-ba5c-e593e1795d4a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:29:29.657489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b05bfb43-71ff-4c8e-8633-5a9539a62762 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:29.658070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b05bfb43-71ff-4c8e-8633-5a9539a62762 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:29.658930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b05bfb43-71ff-4c8e-8633-5a9539a62762 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:29.659681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b05bfb43-71ff-4c8e-8633-5a9539a62762 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:29.667841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9fdf326b-af58-4497-ad84-39d1e43e4399 req-ffeaaf70-05a2-4de8-a890-9e0aae77018d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:29.668362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9fdf326b-af58-4497-ad84-39d1e43e4399 req-ffeaaf70-05a2-4de8-a890-9e0aae77018d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:29.681276 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-9fdf326b-af58-4497-ad84-39d1e43e4399 req-ffeaaf70-05a2-4de8-a890-9e0aae77018d service nova] Creating event network-changed:bb2f3880-24a9-4805-ba5c-e593e1795d4a for instance c8123cc9-cb30-4d6f-9753-752169c68b84 on n-h1-851337-3 Aug 02 07:29:29.687392 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-9fdf326b-af58-4497-ad84-39d1e43e4399 req-ffeaaf70-05a2-4de8-a890-9e0aae77018d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037609 Aug 02 07:29:29.688568 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3102/6276] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:29:29.833133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b05bfb43-71ff-4c8e-8633-5a9539a62762 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:29.848495 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b05bfb43-71ff-4c8e-8633-5a9539a62762 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 200 len: 1547 microversion: 2.1 time: 0.207764 Aug 02 07:29:29.861920 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3175/6277] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:29 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 1547 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:29:29.871540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b41418e1-5aad-4464-a538-14bccc21cd1b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:29.872483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b41418e1-5aad-4464-a538-14bccc21cd1b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:29.879699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b41418e1-5aad-4464-a538-14bccc21cd1b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:29.880435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b41418e1-5aad-4464-a538-14bccc21cd1b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:29.881411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b41418e1-5aad-4464-a538-14bccc21cd1b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:29.882058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b41418e1-5aad-4464-a538-14bccc21cd1b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:29.904890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:29:30.038140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b41418e1-5aad-4464-a538-14bccc21cd1b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:30.046388 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b41418e1-5aad-4464-a538-14bccc21cd1b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 200 len: 1547 microversion: 2.1 time: 0.179269 Aug 02 07:29:30.047133 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3103/6278] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:29 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 1547 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:30.610307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d5575ba9-4913-4400-9311-8015b7d975fc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:30.610926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d5575ba9-4913-4400-9311-8015b7d975fc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:30.626732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d5575ba9-4913-4400-9311-8015b7d975fc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:30.628113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d5575ba9-4913-4400-9311-8015b7d975fc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:30.629343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d5575ba9-4913-4400-9311-8015b7d975fc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:30.630048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d5575ba9-4913-4400-9311-8015b7d975fc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:31.247029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d5575ba9-4913-4400-9311-8015b7d975fc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:31.255101 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d5575ba9-4913-4400-9311-8015b7d975fc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1215 microversion: 2.1 time: 0.648569 Aug 02 07:29:31.255661 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3176/6279] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:30 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1215 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:29:32.217436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-2b7c7dc9-5c25-41df-841c-c703fa495981 req-bb9d87ca-771f-4312-b0bb-a218866eb5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "399a7eff-6f3e-4f49-b276-96f35b43ef07", "tag": "b83a1955-387d-41cd-bd2f-b438b250d12a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:29:32.239206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2b7c7dc9-5c25-41df-841c-c703fa495981 req-bb9d87ca-771f-4312-b0bb-a218866eb5a2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:32.239993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2b7c7dc9-5c25-41df-841c-c703fa495981 req-bb9d87ca-771f-4312-b0bb-a218866eb5a2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:32.264838 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-2b7c7dc9-5c25-41df-841c-c703fa495981 req-bb9d87ca-771f-4312-b0bb-a218866eb5a2 service nova] Creating event network-changed:b83a1955-387d-41cd-bd2f-b438b250d12a for instance 399a7eff-6f3e-4f49-b276-96f35b43ef07 on n-h2-851337-3 Aug 02 07:29:32.278218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9e69f6f9-daa8-4b97-ae88-af86b84cacdd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:32.279226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9e69f6f9-daa8-4b97-ae88-af86b84cacdd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:32.287693 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-2b7c7dc9-5c25-41df-841c-c703fa495981 req-bb9d87ca-771f-4312-b0bb-a218866eb5a2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075653 Aug 02 07:29:32.288799 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3104/6280] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:29:32.301298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e69f6f9-daa8-4b97-ae88-af86b84cacdd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:32.301752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e69f6f9-daa8-4b97-ae88-af86b84cacdd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:32.302791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e69f6f9-daa8-4b97-ae88-af86b84cacdd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:32.303264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9e69f6f9-daa8-4b97-ae88-af86b84cacdd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:32.531153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9e69f6f9-daa8-4b97-ae88-af86b84cacdd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:32.539970 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9e69f6f9-daa8-4b97-ae88-af86b84cacdd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1215 microversion: 2.1 time: 0.266933 Aug 02 07:29:32.541529 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3177/6281] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:32 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:33.566023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b404e49f-db25-4c3b-805a-8bec854d3143 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:33.566769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b404e49f-db25-4c3b-805a-8bec854d3143 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:33.574272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b404e49f-db25-4c3b-805a-8bec854d3143 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:33.575113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b404e49f-db25-4c3b-805a-8bec854d3143 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:33.576101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b404e49f-db25-4c3b-805a-8bec854d3143 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:33.576526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b404e49f-db25-4c3b-805a-8bec854d3143 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:33.708744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b404e49f-db25-4c3b-805a-8bec854d3143 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:33.716999 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b404e49f-db25-4c3b-805a-8bec854d3143 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1215 microversion: 2.1 time: 0.158405 Aug 02 07:29:33.717585 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3105/6282] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:33 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:34.739045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c84bddf6-8a5d-45cb-9349-b5ad68388903 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:34.739668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c84bddf6-8a5d-45cb-9349-b5ad68388903 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:34.747713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c84bddf6-8a5d-45cb-9349-b5ad68388903 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:34.748559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c84bddf6-8a5d-45cb-9349-b5ad68388903 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:34.749622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c84bddf6-8a5d-45cb-9349-b5ad68388903 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:34.750312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c84bddf6-8a5d-45cb-9349-b5ad68388903 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:34.891567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c84bddf6-8a5d-45cb-9349-b5ad68388903 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:34.899433 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c84bddf6-8a5d-45cb-9349-b5ad68388903 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1215 microversion: 2.1 time: 0.164608 Aug 02 07:29:34.899996 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3178/6283] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:34 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:29:35.921721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9609f905-892a-4de9-a064-5413d6ac5434 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:35.922459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9609f905-892a-4de9-a064-5413d6ac5434 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:35.929566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9609f905-892a-4de9-a064-5413d6ac5434 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:35.930056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9609f905-892a-4de9-a064-5413d6ac5434 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:35.930878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9609f905-892a-4de9-a064-5413d6ac5434 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:35.931306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9609f905-892a-4de9-a064-5413d6ac5434 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:36.094149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9609f905-892a-4de9-a064-5413d6ac5434 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:36.105426 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9609f905-892a-4de9-a064-5413d6ac5434 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1215 microversion: 2.1 time: 0.188909 Aug 02 07:29:36.106632 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3106/6284] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:35 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1215 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:37.127668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b6b2bb7c-573c-4808-a57c-b834a7a26dde tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:37.128292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b6b2bb7c-573c-4808-a57c-b834a7a26dde tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:37.130485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:29:37.131178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=16 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:29:37.138748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6b2bb7c-573c-4808-a57c-b834a7a26dde tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:37.139192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6b2bb7c-573c-4808-a57c-b834a7a26dde tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:37.139978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6b2bb7c-573c-4808-a57c-b834a7a26dde tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:37.140414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6b2bb7c-573c-4808-a57c-b834a7a26dde tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:37.312246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b6b2bb7c-573c-4808-a57c-b834a7a26dde tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:37.321688 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b6b2bb7c-573c-4808-a57c-b834a7a26dde tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1203 microversion: 2.1 time: 0.198416 Aug 02 07:29:37.323262 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3179/6285] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:37 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1203 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:38.344374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7758070b-85e2-46df-86c7-6af78e553a19 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:38.344923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7758070b-85e2-46df-86c7-6af78e553a19 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:38.348408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:29:38.355242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7758070b-85e2-46df-86c7-6af78e553a19 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:38.355722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7758070b-85e2-46df-86c7-6af78e553a19 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:38.356745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7758070b-85e2-46df-86c7-6af78e553a19 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:38.357019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7758070b-85e2-46df-86c7-6af78e553a19 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:38.494397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7758070b-85e2-46df-86c7-6af78e553a19 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:38.502312 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7758070b-85e2-46df-86c7-6af78e553a19 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1203 microversion: 2.1 time: 0.162828 Aug 02 07:29:38.502881 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3107/6286] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:38 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:39.523823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4d3f0c47-3604-4156-b6f1-5b8bee8e9ade tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:39.524568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4d3f0c47-3604-4156-b6f1-5b8bee8e9ade tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:39.532493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d3f0c47-3604-4156-b6f1-5b8bee8e9ade tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:39.532967 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d3f0c47-3604-4156-b6f1-5b8bee8e9ade tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:39.533737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d3f0c47-3604-4156-b6f1-5b8bee8e9ade tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:39.534236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d3f0c47-3604-4156-b6f1-5b8bee8e9ade tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:39.669023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4d3f0c47-3604-4156-b6f1-5b8bee8e9ade tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:39.677043 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4d3f0c47-3604-4156-b6f1-5b8bee8e9ade tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1203 microversion: 2.1 time: 0.157293 Aug 02 07:29:39.677871 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3180/6287] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:39 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:40.698660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-23f4ea51-e4af-4232-9547-ae5ed6143688 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:40.699282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-23f4ea51-e4af-4232-9547-ae5ed6143688 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:40.707028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23f4ea51-e4af-4232-9547-ae5ed6143688 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:40.707485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23f4ea51-e4af-4232-9547-ae5ed6143688 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:40.709942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23f4ea51-e4af-4232-9547-ae5ed6143688 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:40.709942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-23f4ea51-e4af-4232-9547-ae5ed6143688 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:40.853433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-23f4ea51-e4af-4232-9547-ae5ed6143688 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:40.861502 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-23f4ea51-e4af-4232-9547-ae5ed6143688 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1203 microversion: 2.1 time: 0.167174 Aug 02 07:29:40.862246 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3108/6288] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:40 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:41.885249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b5540f0-a5a9-4303-bc30-5b60758ea3bc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:41.885919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6b5540f0-a5a9-4303-bc30-5b60758ea3bc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:41.896173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b5540f0-a5a9-4303-bc30-5b60758ea3bc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:41.896776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b5540f0-a5a9-4303-bc30-5b60758ea3bc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:41.897927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b5540f0-a5a9-4303-bc30-5b60758ea3bc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:41.898513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b5540f0-a5a9-4303-bc30-5b60758ea3bc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:42.051313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6b5540f0-a5a9-4303-bc30-5b60758ea3bc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:42.059491 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6b5540f0-a5a9-4303-bc30-5b60758ea3bc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1203 microversion: 2.1 time: 0.180228 Aug 02 07:29:42.060082 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3181/6289] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:41 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1203 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:43.080086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-53fbf4ed-d5cf-408c-884f-73e47dad9d2b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:43.080702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-53fbf4ed-d5cf-408c-884f-73e47dad9d2b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:43.088380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53fbf4ed-d5cf-408c-884f-73e47dad9d2b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:43.088836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53fbf4ed-d5cf-408c-884f-73e47dad9d2b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:43.089604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53fbf4ed-d5cf-408c-884f-73e47dad9d2b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:43.090079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53fbf4ed-d5cf-408c-884f-73e47dad9d2b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:43.300324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-53fbf4ed-d5cf-408c-884f-73e47dad9d2b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:43.300324 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-53fbf4ed-d5cf-408c-884f-73e47dad9d2b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1203 microversion: 2.1 time: 0.164212 Aug 02 07:29:43.300324 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3109/6290] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:43 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:44.263768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1b3dc173-d44d-46b9-84bd-dbf570f77791 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:44.264632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1b3dc173-d44d-46b9-84bd-dbf570f77791 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:44.281052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b3dc173-d44d-46b9-84bd-dbf570f77791 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:44.281804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b3dc173-d44d-46b9-84bd-dbf570f77791 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:44.283118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b3dc173-d44d-46b9-84bd-dbf570f77791 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:44.283834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b3dc173-d44d-46b9-84bd-dbf570f77791 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:44.426565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1b3dc173-d44d-46b9-84bd-dbf570f77791 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:44.434665 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1b3dc173-d44d-46b9-84bd-dbf570f77791 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1203 microversion: 2.1 time: 0.177368 Aug 02 07:29:44.435312 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3182/6291] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:44 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1203 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:45.457150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7e7e7c80-05bf-4f94-be04-1a6a505fed25 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:45.458756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7e7e7c80-05bf-4f94-be04-1a6a505fed25 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:45.470059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e7e7c80-05bf-4f94-be04-1a6a505fed25 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:45.470504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e7e7c80-05bf-4f94-be04-1a6a505fed25 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:45.471267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e7e7c80-05bf-4f94-be04-1a6a505fed25 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:45.471714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e7e7c80-05bf-4f94-be04-1a6a505fed25 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:45.610785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7e7e7c80-05bf-4f94-be04-1a6a505fed25 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:45.618974 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7e7e7c80-05bf-4f94-be04-1a6a505fed25 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1203 microversion: 2.1 time: 0.165917 Aug 02 07:29:45.619565 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3110/6292] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:45 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:46.640211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f9ee4223-c9ee-4223-a59d-2c4a9478a46e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:46.640796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f9ee4223-c9ee-4223-a59d-2c4a9478a46e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:46.648655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9ee4223-c9ee-4223-a59d-2c4a9478a46e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:46.649332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9ee4223-c9ee-4223-a59d-2c4a9478a46e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:46.650257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9ee4223-c9ee-4223-a59d-2c4a9478a46e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:46.650920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f9ee4223-c9ee-4223-a59d-2c4a9478a46e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:46.684746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=100 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:29:46.820142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f9ee4223-c9ee-4223-a59d-2c4a9478a46e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:46.826968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-27eda9f4-8a0d-4f82-976e-f8bb6c17cb5f req-c8341ab7-6b88-4ef3-9751-5d8a02e455f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8123cc9-cb30-4d6f-9753-752169c68b84", "name": "network-vif-plugged", "status": "completed", "tag": "bb2f3880-24a9-4805-ba5c-e593e1795d4a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:29:46.843516 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f9ee4223-c9ee-4223-a59d-2c4a9478a46e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1203 microversion: 2.1 time: 0.206043 Aug 02 07:29:46.850099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=44 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:29:46.857848 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3183/6293] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:46 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1203 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:46.859151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-27eda9f4-8a0d-4f82-976e-f8bb6c17cb5f req-c8341ab7-6b88-4ef3-9751-5d8a02e455f0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:46.859721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-27eda9f4-8a0d-4f82-976e-f8bb6c17cb5f req-c8341ab7-6b88-4ef3-9751-5d8a02e455f0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:46.877678 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-27eda9f4-8a0d-4f82-976e-f8bb6c17cb5f req-c8341ab7-6b88-4ef3-9751-5d8a02e455f0 service nova] Creating event network-vif-plugged:bb2f3880-24a9-4805-ba5c-e593e1795d4a for instance c8123cc9-cb30-4d6f-9753-752169c68b84 on n-h1-851337-3 Aug 02 07:29:46.883726 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-27eda9f4-8a0d-4f82-976e-f8bb6c17cb5f req-c8341ab7-6b88-4ef3-9751-5d8a02e455f0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060462 Aug 02 07:29:46.885255 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3111/6294] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:29:47.864349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4ef77968-05af-424f-92ad-f1f7ed6357bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:47.865010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4ef77968-05af-424f-92ad-f1f7ed6357bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:47.868243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:29:47.873661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ef77968-05af-424f-92ad-f1f7ed6357bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:47.874137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ef77968-05af-424f-92ad-f1f7ed6357bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:47.874932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ef77968-05af-424f-92ad-f1f7ed6357bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:47.875357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4ef77968-05af-424f-92ad-f1f7ed6357bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:48.013631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4ef77968-05af-424f-92ad-f1f7ed6357bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:48.021555 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4ef77968-05af-424f-92ad-f1f7ed6357bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1203 microversion: 2.1 time: 0.161222 Aug 02 07:29:48.022153 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3184/6295] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:47 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:49.047717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2c9de655-5772-49d8-8fb9-1f3c7047fe4d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:49.049049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2c9de655-5772-49d8-8fb9-1f3c7047fe4d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:49.061441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c9de655-5772-49d8-8fb9-1f3c7047fe4d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:49.061917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c9de655-5772-49d8-8fb9-1f3c7047fe4d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:49.062841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c9de655-5772-49d8-8fb9-1f3c7047fe4d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:49.063275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c9de655-5772-49d8-8fb9-1f3c7047fe4d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:49.198481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2c9de655-5772-49d8-8fb9-1f3c7047fe4d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:49.206549 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2c9de655-5772-49d8-8fb9-1f3c7047fe4d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1389 microversion: 2.1 time: 0.163080 Aug 02 07:29:49.207141 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3112/6296] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:49 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:49.226815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a584bc14-5d45-49ac-949c-781cc8b30d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:49.227387 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a584bc14-5d45-49ac-949c-781cc8b30d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:49.234540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a584bc14-5d45-49ac-949c-781cc8b30d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:49.234980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a584bc14-5d45-49ac-949c-781cc8b30d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:49.235782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a584bc14-5d45-49ac-949c-781cc8b30d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:49.236189 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a584bc14-5d45-49ac-949c-781cc8b30d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:49.380766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a584bc14-5d45-49ac-949c-781cc8b30d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:49.388883 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a584bc14-5d45-49ac-949c-781cc8b30d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1389 microversion: 2.1 time: 0.165981 Aug 02 07:29:49.389829 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3185/6297] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:49 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:49.408891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-45c63db1-1ddc-452c-9a5c-f99ee9d0845f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:49.409594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-45c63db1-1ddc-452c-9a5c-f99ee9d0845f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:49.416354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45c63db1-1ddc-452c-9a5c-f99ee9d0845f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:49.416892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45c63db1-1ddc-452c-9a5c-f99ee9d0845f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:49.417756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45c63db1-1ddc-452c-9a5c-f99ee9d0845f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:49.418271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45c63db1-1ddc-452c-9a5c-f99ee9d0845f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:49.552883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-45c63db1-1ddc-452c-9a5c-f99ee9d0845f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:49.560781 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-45c63db1-1ddc-452c-9a5c-f99ee9d0845f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1389 microversion: 2.1 time: 0.155875 Aug 02 07:29:49.561364 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3113/6298] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:49 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:49.581347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-75fcecd1-26ac-4142-b61b-944790b7521b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:49.581841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-75fcecd1-26ac-4142-b61b-944790b7521b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:49.590478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75fcecd1-26ac-4142-b61b-944790b7521b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:49.591044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75fcecd1-26ac-4142-b61b-944790b7521b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:49.592214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75fcecd1-26ac-4142-b61b-944790b7521b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:49.592525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75fcecd1-26ac-4142-b61b-944790b7521b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:49.621318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-75fcecd1-26ac-4142-b61b-944790b7521b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:29:49.705315 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-75fcecd1-26ac-4142-b61b-944790b7521b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 204 len: 0 microversion: 2.1 time: 0.127935 Aug 02 07:29:49.705988 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3186/6299] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:29:49 2022] DELETE /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:29:49.715157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ebe9a7e7-7a42-4e40-8b68-9c12c41a2240 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:49.715810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ebe9a7e7-7a42-4e40-8b68-9c12c41a2240 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:49.722617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebe9a7e7-7a42-4e40-8b68-9c12c41a2240 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:49.723061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebe9a7e7-7a42-4e40-8b68-9c12c41a2240 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:49.723923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebe9a7e7-7a42-4e40-8b68-9c12c41a2240 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:49.724370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ebe9a7e7-7a42-4e40-8b68-9c12c41a2240 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:49.866156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ebe9a7e7-7a42-4e40-8b68-9c12c41a2240 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:49.875635 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ebe9a7e7-7a42-4e40-8b68-9c12c41a2240 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1395 microversion: 2.1 time: 0.164400 Aug 02 07:29:49.876537 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3114/6300] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:49 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1395 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:50.898105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1f06c4a6-e7f8-4b52-9cb7-1ce6e0fbfd36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:50.898758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1f06c4a6-e7f8-4b52-9cb7-1ce6e0fbfd36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:50.906863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f06c4a6-e7f8-4b52-9cb7-1ce6e0fbfd36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:50.907310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f06c4a6-e7f8-4b52-9cb7-1ce6e0fbfd36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:50.908086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f06c4a6-e7f8-4b52-9cb7-1ce6e0fbfd36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:50.908502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1f06c4a6-e7f8-4b52-9cb7-1ce6e0fbfd36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:51.062597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1f06c4a6-e7f8-4b52-9cb7-1ce6e0fbfd36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:51.071634 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1f06c4a6-e7f8-4b52-9cb7-1ce6e0fbfd36 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1395 microversion: 2.1 time: 0.178421 Aug 02 07:29:51.072379 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3187/6301] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:50 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1395 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:51.910879 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-176676e2-0292-46fc-92cd-9c5e0af9b41b req-1d3fab1b-2274-4718-a934-1df202200a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8123cc9-cb30-4d6f-9753-752169c68b84", "name": "network-vif-deleted", "tag": "bb2f3880-24a9-4805-ba5c-e593e1795d4a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:29:51.925371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-176676e2-0292-46fc-92cd-9c5e0af9b41b req-1d3fab1b-2274-4718-a934-1df202200a7c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:51.925810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-176676e2-0292-46fc-92cd-9c5e0af9b41b req-1d3fab1b-2274-4718-a934-1df202200a7c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:51.940443 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-176676e2-0292-46fc-92cd-9c5e0af9b41b req-1d3fab1b-2274-4718-a934-1df202200a7c service nova] Creating event network-vif-deleted:bb2f3880-24a9-4805-ba5c-e593e1795d4a for instance c8123cc9-cb30-4d6f-9753-752169c68b84 on n-h1-851337-3 Aug 02 07:29:51.946990 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-176676e2-0292-46fc-92cd-9c5e0af9b41b req-1d3fab1b-2274-4718-a934-1df202200a7c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039856 Aug 02 07:29:51.949512 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3115/6302] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:29:52.102190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7e40b9c-24af-4b2d-b79e-b7655e1828a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:52.102828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e7e40b9c-24af-4b2d-b79e-b7655e1828a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:52.115516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7e40b9c-24af-4b2d-b79e-b7655e1828a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:52.115965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7e40b9c-24af-4b2d-b79e-b7655e1828a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:52.117103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7e40b9c-24af-4b2d-b79e-b7655e1828a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:52.117537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7e40b9c-24af-4b2d-b79e-b7655e1828a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:52.185258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e7e40b9c-24af-4b2d-b79e-b7655e1828a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:52.193857 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7e40b9c-24af-4b2d-b79e-b7655e1828a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1188 microversion: 2.1 time: 0.104861 Aug 02 07:29:52.194567 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3188/6303] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:52 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1188 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:29:53.217089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6448fc6d-812b-4831-aa16-8844b154553c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:53.218026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6448fc6d-812b-4831-aa16-8844b154553c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:53.224813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6448fc6d-812b-4831-aa16-8844b154553c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:53.225333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6448fc6d-812b-4831-aa16-8844b154553c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:53.226824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6448fc6d-812b-4831-aa16-8844b154553c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:53.227357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6448fc6d-812b-4831-aa16-8844b154553c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:53.308307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6448fc6d-812b-4831-aa16-8844b154553c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:53.317034 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6448fc6d-812b-4831-aa16-8844b154553c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1188 microversion: 2.1 time: 0.105600 Aug 02 07:29:53.317728 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3116/6304] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:53 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1188 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:53.472576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-03e6a8a7-608e-4bd9-975d-064bfd6456bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:29:53.474887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-03e6a8a7-608e-4bd9-975d-064bfd6456bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:53.482766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03e6a8a7-608e-4bd9-975d-064bfd6456bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:53.483198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03e6a8a7-608e-4bd9-975d-064bfd6456bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:53.484302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03e6a8a7-608e-4bd9-975d-064bfd6456bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:53.484745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03e6a8a7-608e-4bd9-975d-064bfd6456bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:53.540224 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-03e6a8a7-608e-4bd9-975d-064bfd6456bb tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "POST /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07/action" status: 200 len: 24581 microversion: 2.1 time: 0.072657 Aug 02 07:29:53.547794 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3189/6305] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:29:53 2022] POST /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07/action => generated 24581 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:29:54.342680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b573bc14-ef43-4a96-8ccd-7064c7c0d741 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:54.343281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b573bc14-ef43-4a96-8ccd-7064c7c0d741 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:54.351402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b573bc14-ef43-4a96-8ccd-7064c7c0d741 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:54.351827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b573bc14-ef43-4a96-8ccd-7064c7c0d741 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:54.353070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b573bc14-ef43-4a96-8ccd-7064c7c0d741 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:54.353070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b573bc14-ef43-4a96-8ccd-7064c7c0d741 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:54.430560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b573bc14-ef43-4a96-8ccd-7064c7c0d741 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:54.438931 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b573bc14-ef43-4a96-8ccd-7064c7c0d741 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1188 microversion: 2.1 time: 0.100371 Aug 02 07:29:54.439909 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3117/6306] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:54 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1188 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:55.460832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-484e2252-6597-4088-90ea-5372cf515b2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:55.461755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-484e2252-6597-4088-90ea-5372cf515b2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:55.470343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-484e2252-6597-4088-90ea-5372cf515b2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:55.470992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-484e2252-6597-4088-90ea-5372cf515b2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:55.472523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-484e2252-6597-4088-90ea-5372cf515b2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:55.472523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-484e2252-6597-4088-90ea-5372cf515b2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:55.551696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-484e2252-6597-4088-90ea-5372cf515b2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:55.559805 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-484e2252-6597-4088-90ea-5372cf515b2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1188 microversion: 2.1 time: 0.103607 Aug 02 07:29:55.560761 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3190/6307] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:55 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:56.581062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f24f5740-6e1f-4c12-8c37-ec1c93057393 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:56.581622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f24f5740-6e1f-4c12-8c37-ec1c93057393 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:56.589177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f24f5740-6e1f-4c12-8c37-ec1c93057393 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:56.589631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f24f5740-6e1f-4c12-8c37-ec1c93057393 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:56.590449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f24f5740-6e1f-4c12-8c37-ec1c93057393 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:56.590847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f24f5740-6e1f-4c12-8c37-ec1c93057393 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:56.629049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f24f5740-6e1f-4c12-8c37-ec1c93057393 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:56.629499 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f24f5740-6e1f-4c12-8c37-ec1c93057393 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:56.629996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-f24f5740-6e1f-4c12-8c37-ec1c93057393 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lazy-loading 'fault' on Instance uuid c8123cc9-cb30-4d6f-9753-752169c68b84 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:29:56.674792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f24f5740-6e1f-4c12-8c37-ec1c93057393 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:29:56.683041 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f24f5740-6e1f-4c12-8c37-ec1c93057393 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 200 len: 1193 microversion: 2.1 time: 0.105869 Aug 02 07:29:56.696541 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3118/6308] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:56 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 1193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:29:57.704069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e9184fc1-ffd8-4d03-9a54-2d2d507772e5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:29:57.704668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e9184fc1-ffd8-4d03-9a54-2d2d507772e5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: c8123cc9-cb30-4d6f-9753-752169c68b84] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:29:57.712977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9184fc1-ffd8-4d03-9a54-2d2d507772e5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:57.713515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9184fc1-ffd8-4d03-9a54-2d2d507772e5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:57.714444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9184fc1-ffd8-4d03-9a54-2d2d507772e5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:29:57.714955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e9184fc1-ffd8-4d03-9a54-2d2d507772e5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:29:57.730253 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-e9184fc1-ffd8-4d03-9a54-2d2d507772e5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance c8123cc9-cb30-4d6f-9753-752169c68b84 could not be found. Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e9184fc1-ffd8-4d03-9a54-2d2d507772e5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 HTTP/1.1 Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance c8123cc9-cb30-4d6f-9753-752169c68b84 could not be found. Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'c8123cc9-cb30-4d6f-9753-752169c68b84'} Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8123cc9-cb30-4d6f-9753-752169c68b84 could not be found. Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8123cc9-cb30-4d6f-9753-752169c68b84 could not be found. Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:29:57.731970 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:57.740624 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:29:57.740624 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:29:57.740624 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:29:57.740624 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:29:57.740624 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:29:57.740624 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8123cc9-cb30-4d6f-9753-752169c68b84 could not be found. Aug 02 07:29:57.740624 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:29:57.740624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e9184fc1-ffd8-4d03-9a54-2d2d507772e5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance c8123cc9-cb30-4d6f-9753-752169c68b84 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:29:57.740624 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e9184fc1-ffd8-4d03-9a54-2d2d507772e5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84" status: 404 len: 111 microversion: 2.1 time: 0.034720 Aug 02 07:29:57.740624 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3191/6309] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:29:57 2022] GET /compute/v2.1/servers/c8123cc9-cb30-4d6f-9753-752169c68b84 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:30:00.024334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-32aebcbc-43e9-4bd3-9f03-ba90352afed9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:30:00.027705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-32aebcbc-43e9-4bd3-9f03-ba90352afed9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:00.035391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32aebcbc-43e9-4bd3-9f03-ba90352afed9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:00.035846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32aebcbc-43e9-4bd3-9f03-ba90352afed9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:00.036676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32aebcbc-43e9-4bd3-9f03-ba90352afed9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:00.037248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-32aebcbc-43e9-4bd3-9f03-ba90352afed9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:00.040175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=83 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:00.095007 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-32aebcbc-43e9-4bd3-9f03-ba90352afed9 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "POST /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07/action" status: 200 len: 32645 microversion: 2.1 time: 0.074344 Aug 02 07:30:00.095556 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3119/6310] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:30:00 2022] POST /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07/action => generated 32645 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 07:30:01.292856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-33603b8e-9f32-40a2-b92b-c82ee5e2d089 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:01.293432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-33603b8e-9f32-40a2-b92b-c82ee5e2d089 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:01.304461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33603b8e-9f32-40a2-b92b-c82ee5e2d089 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:01.305451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33603b8e-9f32-40a2-b92b-c82ee5e2d089 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:01.306507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33603b8e-9f32-40a2-b92b-c82ee5e2d089 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:01.307116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33603b8e-9f32-40a2-b92b-c82ee5e2d089 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:01.307246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8ce4526e-c28a-4402-af7b-d68623eacafb req-48f93361-550f-4fb9-8f1b-008282951025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "399a7eff-6f3e-4f49-b276-96f35b43ef07", "tag": "b83a1955-387d-41cd-bd2f-b438b250d12a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:30:01.330596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8ce4526e-c28a-4402-af7b-d68623eacafb req-48f93361-550f-4fb9-8f1b-008282951025 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:01.331041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8ce4526e-c28a-4402-af7b-d68623eacafb req-48f93361-550f-4fb9-8f1b-008282951025 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:01.336517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-33603b8e-9f32-40a2-b92b-c82ee5e2d089 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:30:01.364400 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8ce4526e-c28a-4402-af7b-d68623eacafb req-48f93361-550f-4fb9-8f1b-008282951025 service nova] Creating event network-changed:b83a1955-387d-41cd-bd2f-b438b250d12a for instance 399a7eff-6f3e-4f49-b276-96f35b43ef07 on n-h2-851337-3 Aug 02 07:30:01.373825 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8ce4526e-c28a-4402-af7b-d68623eacafb req-48f93361-550f-4fb9-8f1b-008282951025 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067767 Aug 02 07:30:01.376210 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3120/6311] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:30:01.480918 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-33603b8e-9f32-40a2-b92b-c82ee5e2d089 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "DELETE /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 204 len: 0 microversion: 2.1 time: 0.191235 Aug 02 07:30:01.486867 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3192/6312] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:30:01 2022] DELETE /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:30:01.492601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-76def602-05c8-47b6-8f89-9e9f6917da9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:01.493558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-76def602-05c8-47b6-8f89-9e9f6917da9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:01.501729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76def602-05c8-47b6-8f89-9e9f6917da9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:01.502483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76def602-05c8-47b6-8f89-9e9f6917da9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:01.503535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76def602-05c8-47b6-8f89-9e9f6917da9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:01.504132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76def602-05c8-47b6-8f89-9e9f6917da9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:01.665208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-76def602-05c8-47b6-8f89-9e9f6917da9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:01.674466 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-76def602-05c8-47b6-8f89-9e9f6917da9b tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 200 len: 1672 microversion: 2.1 time: 0.186554 Aug 02 07:30:01.689187 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3121/6313] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:01 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 1672 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:30:02.698549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cf1c2166-b467-4980-bf1d-c077fbc4dc04 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:02.699255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cf1c2166-b467-4980-bf1d-c077fbc4dc04 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:02.708895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf1c2166-b467-4980-bf1d-c077fbc4dc04 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:02.714714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf1c2166-b467-4980-bf1d-c077fbc4dc04 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:02.715817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf1c2166-b467-4980-bf1d-c077fbc4dc04 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:02.716400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf1c2166-b467-4980-bf1d-c077fbc4dc04 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:02.883657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-906c61d6-48c6-4162-b68f-9f494651c6aa tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Action: 'create', calling method: .version_select at 0x7f927a2cbe50>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-279792654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdeXMtG/uD7OxwlPZIImp/EzQZod8QHnvRggbN2E7quUoQUOda5do15balQiNhGOw1nIGuWwdm1vKXA/OULItEP1jOKq2zwGynLqZvrislVCP6WQOZp07Vmjsr3re03Ww=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:30:02.900574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-906c61d6-48c6-4162-b68f-9f494651c6aa tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Getting quotas for project a4921bf4677140c3b7a6cd91af197769. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:30:02.907560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-906c61d6-48c6-4162-b68f-9f494651c6aa tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Getting quotas for user 86324b5e87a54105baaed4bb550bc787 and project a4921bf4677140c3b7a6cd91af197769. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:30:02.939826 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-906c61d6-48c6-4162-b68f-9f494651c6aa tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.060016 Aug 02 07:30:02.940734 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3122/6314] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:30:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:30:03.236156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cf1c2166-b467-4980-bf1d-c077fbc4dc04 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b47f98af604fea9f078504441d6c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a4bcdb764647e7a0ac29ca20ceae03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:03.254196 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cf1c2166-b467-4980-bf1d-c077fbc4dc04 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 200 len: 1672 microversion: 2.1 time: 0.559452 Aug 02 07:30:03.256729 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3193/6315] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:02 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 1672 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:03.666924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-01f5c21f-0922-4b90-8c8c-f74abba023c5 req-06694e53-ee87-435f-b3c8-640c4aac3cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399a7eff-6f3e-4f49-b276-96f35b43ef07", "name": "network-vif-deleted", "tag": "b83a1955-387d-41cd-bd2f-b438b250d12a"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:30:03.683854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-01f5c21f-0922-4b90-8c8c-f74abba023c5 req-06694e53-ee87-435f-b3c8-640c4aac3cbe service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:03.684532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-01f5c21f-0922-4b90-8c8c-f74abba023c5 req-06694e53-ee87-435f-b3c8-640c4aac3cbe service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:03.699127 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-01f5c21f-0922-4b90-8c8c-f74abba023c5 req-06694e53-ee87-435f-b3c8-640c4aac3cbe service nova] Creating event network-vif-deleted:b83a1955-387d-41cd-bd2f-b438b250d12a for instance 399a7eff-6f3e-4f49-b276-96f35b43ef07 on n-h2-851337-3 Aug 02 07:30:03.706061 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-01f5c21f-0922-4b90-8c8c-f74abba023c5 req-06694e53-ee87-435f-b3c8-640c4aac3cbe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046568 Aug 02 07:30:03.707911 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3123/6316] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:30:04.208123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1559138704", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "05319646-ae7a-4823-a7a3-3e8891d9d4e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-279792654", "security_groups": [{"name": "tempest-secgroup-smoke-1114039756"}], "networks": [{"uuid": "148c755a-8e02-46ff-9c59-5a8e7954aec4"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:30:04.277173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ef8607ab-fb98-48f4-bda1-440725ad214d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:04.277965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ef8607ab-fb98-48f4-bda1-440725ad214d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] [instance: 399a7eff-6f3e-4f49-b276-96f35b43ef07] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:04.287283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef8607ab-fb98-48f4-bda1-440725ad214d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:04.287987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef8607ab-fb98-48f4-bda1-440725ad214d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:04.288770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef8607ab-fb98-48f4-bda1-440725ad214d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:04.289195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef8607ab-fb98-48f4-bda1-440725ad214d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:04.305491 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-ef8607ab-fb98-48f4-bda1-440725ad214d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] HTTP exception thrown: Instance 399a7eff-6f3e-4f49-b276-96f35b43ef07 could not be found. Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ef8607ab-fb98-48f4-bda1-440725ad214d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Request method failure captured: Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 HTTP/1.1 Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NG-8hmFiyPky85Lm7XpDAm6gmY_XRDupbkbwT0DLZ1cxMJtdiDO09SMxEjm0MZDLxfu9w8aZOW4ecHtY3A0ML8B5QCBZ6yKLzUnNdK0vkJVZkhZbqiGFUVkt006FZ0FJbgL22W94j8roOEMT8KcTeLjyuh7Kld7FPEXFrZhS0jzA4A Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 47a4bcdb764647e7a0ac29ca20ceae03 Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestNetworkBasicOps-1976904351 Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/47a4bcdb764647e7a0ac29ca20ceae03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/47a4bcdb764647e7a0ac29ca20ceae03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_47a4bcdb764647e7a0ac29ca20ceae03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/47a4bcdb764647e7a0ac29ca20ceae03"}]}] Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestNetworkBasicOps-1976904351 Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 47a4bcdb764647e7a0ac29ca20ceae03 Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestNetworkBasicOps-1976904351 Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestNetworkBasicOps-1976904351-project Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: f5b47f98af604fea9f078504441d6c76 Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestNetworkBasicOps-1976904351-project Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 399a7eff-6f3e-4f49-b276-96f35b43ef07 could not be found. Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '399a7eff-6f3e-4f49-b276-96f35b43ef07'} Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 399a7eff-6f3e-4f49-b276-96f35b43ef07 could not be found. Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 399a7eff-6f3e-4f49-b276-96f35b43ef07 could not be found. Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:30:04.307277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:30:04.312054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:30:04.312054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:30:04.312054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:30:04.312054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:30:04.312054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:30:04.312054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 399a7eff-6f3e-4f49-b276-96f35b43ef07 could not be found. Aug 02 07:30:04.312054 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:30:04.312054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ef8607ab-fb98-48f4-bda1-440725ad214d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Returning 404 to user: Instance 399a7eff-6f3e-4f49-b276-96f35b43ef07 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:30:04.312054 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ef8607ab-fb98-48f4-bda1-440725ad214d tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07" status: 404 len: 111 microversion: 2.1 time: 0.036227 Aug 02 07:30:04.312054 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3124/6317] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:04 2022] GET /compute/v2.1/servers/399a7eff-6f3e-4f49-b276-96f35b43ef07 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:30:04.349113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] validate_networks() for [('148c755a-8e02-46ff-9c59-5a8e7954aec4', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:30:04.629108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fe6b6314-0a9d-4b3f-9480-3610627d1be7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] Calling method '.version_select at 0x7f9279ea8160>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:04.649739 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fe6b6314-0a9d-4b3f-9480-3610627d1be7 tempest-TestNetworkBasicOps-1976904351 tempest-TestNetworkBasicOps-1976904351-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1312077640" status: 202 len: 0 microversion: 2.1 time: 0.024445 Aug 02 07:30:04.650983 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3125/6318] 10.222.0.79 () {58 vars in 1257 bytes} [Tue Aug 2 07:30:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1312077640 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:30:05.211803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:30:05.213102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:30:05.214037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:30:05.214761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:30:05.215176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:30:05.229481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:05.230002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:05.230796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:05.231417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:05.249675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Getting quotas for project a4921bf4677140c3b7a6cd91af197769. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:30:05.255841 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Getting quotas for user 86324b5e87a54105baaed4bb550bc787 and project a4921bf4677140c3b7a6cd91af197769. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:30:05.319936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:30:05.322691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='05319646-ae7a-4823-a7a3-3e8891d9d4e9',volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:30:05.486077 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6a27b96f-d5c4-4d87-b025-d65d78c6741e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.282275 Aug 02 07:30:05.487233 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3194/6319] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:30:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:30:05.506574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-58a756dc-5191-4319-869f-478eda4ca0b2 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:05.507273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-58a756dc-5191-4319-869f-478eda4ca0b2 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:05.574736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-58a756dc-5191-4319-869f-478eda4ca0b2 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:05.583622 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-58a756dc-5191-4319-869f-478eda4ca0b2 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1098 microversion: 2.1 time: 0.088865 Aug 02 07:30:05.584808 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3126/6320] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:05 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1098 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:30:06.605046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-78428671-96c4-49a0-9175-c3b70fbcfcc9 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:06.606466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-78428671-96c4-49a0-9175-c3b70fbcfcc9 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:06.619820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78428671-96c4-49a0-9175-c3b70fbcfcc9 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:06.622547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78428671-96c4-49a0-9175-c3b70fbcfcc9 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:06.623615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78428671-96c4-49a0-9175-c3b70fbcfcc9 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:06.624493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78428671-96c4-49a0-9175-c3b70fbcfcc9 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:06.912855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-78428671-96c4-49a0-9175-c3b70fbcfcc9 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:06.939783 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-78428671-96c4-49a0-9175-c3b70fbcfcc9 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1196 microversion: 2.1 time: 0.338789 Aug 02 07:30:06.941502 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3195/6321] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:06 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1196 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:07.969832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bd107718-11c9-4d8e-ab12-ef60c42980ea tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:07.970568 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bd107718-11c9-4d8e-ab12-ef60c42980ea tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:07.989368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd107718-11c9-4d8e-ab12-ef60c42980ea tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:07.989849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd107718-11c9-4d8e-ab12-ef60c42980ea tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:07.990757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd107718-11c9-4d8e-ab12-ef60c42980ea tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:07.995411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bd107718-11c9-4d8e-ab12-ef60c42980ea tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:08.718254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bd107718-11c9-4d8e-ab12-ef60c42980ea tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:08.729623 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bd107718-11c9-4d8e-ab12-ef60c42980ea tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1282 microversion: 2.1 time: 0.772728 Aug 02 07:30:08.730276 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3127/6322] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:07 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1282 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:09.005132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-a6e3e3f8-d26e-46c5-91be-c2ceee585001 req-0d82e4ee-3d07-401c-9fe6-d4d297932b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d8de02-f21b-4eaa-9223-21ea6227f261", "tag": "3dce0d45-4559-4688-9bd1-9f31898a4cf4"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:30:09.024419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a6e3e3f8-d26e-46c5-91be-c2ceee585001 req-0d82e4ee-3d07-401c-9fe6-d4d297932b08 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:09.025206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a6e3e3f8-d26e-46c5-91be-c2ceee585001 req-0d82e4ee-3d07-401c-9fe6-d4d297932b08 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:09.043239 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-a6e3e3f8-d26e-46c5-91be-c2ceee585001 req-0d82e4ee-3d07-401c-9fe6-d4d297932b08 service nova] Creating event network-changed:3dce0d45-4559-4688-9bd1-9f31898a4cf4 for instance 32d8de02-f21b-4eaa-9223-21ea6227f261 on n-h2-851337-3 Aug 02 07:30:09.051259 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-a6e3e3f8-d26e-46c5-91be-c2ceee585001 req-0d82e4ee-3d07-401c-9fe6-d4d297932b08 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054983 Aug 02 07:30:09.052677 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3196/6323] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:30:09.751952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a6a6ee70-9c1d-4f60-96ed-a125d5f330dc tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:09.752779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a6a6ee70-9c1d-4f60-96ed-a125d5f330dc tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:09.768876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6a6ee70-9c1d-4f60-96ed-a125d5f330dc tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:09.769442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6a6ee70-9c1d-4f60-96ed-a125d5f330dc tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:09.770328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6a6ee70-9c1d-4f60-96ed-a125d5f330dc tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:09.770761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a6a6ee70-9c1d-4f60-96ed-a125d5f330dc tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:10.152138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a6a6ee70-9c1d-4f60-96ed-a125d5f330dc tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:10.167115 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a6a6ee70-9c1d-4f60-96ed-a125d5f330dc tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1282 microversion: 2.1 time: 0.419540 Aug 02 07:30:10.168115 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3128/6324] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:09 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1282 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:11.190031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7ebd5d55-1e62-42a2-9b8b-bc38a2341569 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:11.191595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7ebd5d55-1e62-42a2-9b8b-bc38a2341569 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:11.199965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ebd5d55-1e62-42a2-9b8b-bc38a2341569 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:11.200786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ebd5d55-1e62-42a2-9b8b-bc38a2341569 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:11.201846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ebd5d55-1e62-42a2-9b8b-bc38a2341569 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:11.202582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7ebd5d55-1e62-42a2-9b8b-bc38a2341569 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:11.398957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7ebd5d55-1e62-42a2-9b8b-bc38a2341569 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:11.414701 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7ebd5d55-1e62-42a2-9b8b-bc38a2341569 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1282 microversion: 2.1 time: 0.228923 Aug 02 07:30:11.415484 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3197/6325] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:11 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1282 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:12.436942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-195ed714-d900-4eb4-a5eb-93f5423c4a3f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:12.437527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-195ed714-d900-4eb4-a5eb-93f5423c4a3f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:12.444733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-195ed714-d900-4eb4-a5eb-93f5423c4a3f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:12.445193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-195ed714-d900-4eb4-a5eb-93f5423c4a3f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:12.446000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-195ed714-d900-4eb4-a5eb-93f5423c4a3f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:12.446438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-195ed714-d900-4eb4-a5eb-93f5423c4a3f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:12.618680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-195ed714-d900-4eb4-a5eb-93f5423c4a3f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:12.627637 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-195ed714-d900-4eb4-a5eb-93f5423c4a3f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1282 microversion: 2.1 time: 0.194755 Aug 02 07:30:12.628729 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3129/6326] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:12 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:13.649191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4dc34070-dfb0-4ec5-96ad-94e8966b615d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:13.650045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4dc34070-dfb0-4ec5-96ad-94e8966b615d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:13.657600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4dc34070-dfb0-4ec5-96ad-94e8966b615d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:13.658096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4dc34070-dfb0-4ec5-96ad-94e8966b615d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:13.658873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4dc34070-dfb0-4ec5-96ad-94e8966b615d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:13.659307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4dc34070-dfb0-4ec5-96ad-94e8966b615d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:13.799539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4dc34070-dfb0-4ec5-96ad-94e8966b615d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:13.809191 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4dc34070-dfb0-4ec5-96ad-94e8966b615d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1270 microversion: 2.1 time: 0.164075 Aug 02 07:30:13.809808 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3198/6327] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:13 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:14.830467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7ef7d35e-f227-4642-a925-4e901ecfe0d8 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:14.831067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7ef7d35e-f227-4642-a925-4e901ecfe0d8 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:14.840112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ef7d35e-f227-4642-a925-4e901ecfe0d8 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:14.840895 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ef7d35e-f227-4642-a925-4e901ecfe0d8 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:14.843027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ef7d35e-f227-4642-a925-4e901ecfe0d8 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:14.843508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ef7d35e-f227-4642-a925-4e901ecfe0d8 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:14.988069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7ef7d35e-f227-4642-a925-4e901ecfe0d8 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:14.996482 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7ef7d35e-f227-4642-a925-4e901ecfe0d8 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1270 microversion: 2.1 time: 0.169999 Aug 02 07:30:14.997072 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3130/6328] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:14 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:16.017046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-68e88cc8-7eb9-4754-893e-7a6af999494d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:16.017880 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-68e88cc8-7eb9-4754-893e-7a6af999494d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:16.020876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:16.022107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:16.028301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68e88cc8-7eb9-4754-893e-7a6af999494d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:16.028742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68e88cc8-7eb9-4754-893e-7a6af999494d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:16.029511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68e88cc8-7eb9-4754-893e-7a6af999494d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:16.029994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68e88cc8-7eb9-4754-893e-7a6af999494d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:16.032698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:16.174522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-68e88cc8-7eb9-4754-893e-7a6af999494d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:16.185165 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-68e88cc8-7eb9-4754-893e-7a6af999494d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1270 microversion: 2.1 time: 0.172118 Aug 02 07:30:16.185735 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3199/6329] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:16 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:17.315792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fd1e1b75-bc1d-4c9a-aaca-e8cf007f46ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:17.316545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fd1e1b75-bc1d-4c9a-aaca-e8cf007f46ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:17.320344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:17.322209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:17.330859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd1e1b75-bc1d-4c9a-aaca-e8cf007f46ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:17.331383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd1e1b75-bc1d-4c9a-aaca-e8cf007f46ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:17.332153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd1e1b75-bc1d-4c9a-aaca-e8cf007f46ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:17.332578 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd1e1b75-bc1d-4c9a-aaca-e8cf007f46ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:17.478349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fd1e1b75-bc1d-4c9a-aaca-e8cf007f46ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:17.486262 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fd1e1b75-bc1d-4c9a-aaca-e8cf007f46ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1270 microversion: 2.1 time: 0.174514 Aug 02 07:30:17.489943 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3131/6330] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:17 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:18.508340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4fef8e5e-5280-4b23-b077-ac435b4e2974 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:18.509050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4fef8e5e-5280-4b23-b077-ac435b4e2974 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:18.512005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:18.518142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fef8e5e-5280-4b23-b077-ac435b4e2974 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:18.518621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fef8e5e-5280-4b23-b077-ac435b4e2974 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:18.519563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fef8e5e-5280-4b23-b077-ac435b4e2974 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:18.520134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4fef8e5e-5280-4b23-b077-ac435b4e2974 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:18.666927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4fef8e5e-5280-4b23-b077-ac435b4e2974 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:18.675300 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4fef8e5e-5280-4b23-b077-ac435b4e2974 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1270 microversion: 2.1 time: 0.170892 Aug 02 07:30:18.675980 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3200/6331] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:18 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:19.697186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-007c74c3-e8c3-4b20-8b82-dae884624d4b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:19.697826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-007c74c3-e8c3-4b20-8b82-dae884624d4b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:19.706721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-007c74c3-e8c3-4b20-8b82-dae884624d4b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:19.707171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-007c74c3-e8c3-4b20-8b82-dae884624d4b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:19.708006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-007c74c3-e8c3-4b20-8b82-dae884624d4b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:19.708444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-007c74c3-e8c3-4b20-8b82-dae884624d4b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:19.878981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-007c74c3-e8c3-4b20-8b82-dae884624d4b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:19.888761 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-007c74c3-e8c3-4b20-8b82-dae884624d4b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1270 microversion: 2.1 time: 0.195766 Aug 02 07:30:19.889413 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3132/6332] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:19 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:20.910567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b75fe5e-03b1-4f82-bcd8-00f68b999d9f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:20.911133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b75fe5e-03b1-4f82-bcd8-00f68b999d9f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:20.918915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b75fe5e-03b1-4f82-bcd8-00f68b999d9f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:20.919632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b75fe5e-03b1-4f82-bcd8-00f68b999d9f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:20.920500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b75fe5e-03b1-4f82-bcd8-00f68b999d9f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:20.920956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b75fe5e-03b1-4f82-bcd8-00f68b999d9f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:21.063095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7b75fe5e-03b1-4f82-bcd8-00f68b999d9f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:21.071285 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b75fe5e-03b1-4f82-bcd8-00f68b999d9f tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1270 microversion: 2.1 time: 0.165532 Aug 02 07:30:21.071872 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3201/6333] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:20 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:22.092702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cbbe4a6f-af10-4716-9842-993ed69be7fa tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:22.093302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cbbe4a6f-af10-4716-9842-993ed69be7fa tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:22.100842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbbe4a6f-af10-4716-9842-993ed69be7fa tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:22.101343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbbe4a6f-af10-4716-9842-993ed69be7fa tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:22.102090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbbe4a6f-af10-4716-9842-993ed69be7fa tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:22.102525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbbe4a6f-af10-4716-9842-993ed69be7fa tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:22.246501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cbbe4a6f-af10-4716-9842-993ed69be7fa tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:22.254583 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cbbe4a6f-af10-4716-9842-993ed69be7fa tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1270 microversion: 2.1 time: 0.166035 Aug 02 07:30:22.255491 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3133/6334] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:22 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:23.276216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d2d17b00-ff3a-4aaa-b243-f4353f7c8595 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:23.276839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d2d17b00-ff3a-4aaa-b243-f4353f7c8595 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:23.284477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2d17b00-ff3a-4aaa-b243-f4353f7c8595 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:23.284935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2d17b00-ff3a-4aaa-b243-f4353f7c8595 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:23.285853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2d17b00-ff3a-4aaa-b243-f4353f7c8595 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:23.286330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2d17b00-ff3a-4aaa-b243-f4353f7c8595 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:23.431966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d2d17b00-ff3a-4aaa-b243-f4353f7c8595 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:23.441667 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d2d17b00-ff3a-4aaa-b243-f4353f7c8595 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1270 microversion: 2.1 time: 0.169391 Aug 02 07:30:23.446099 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3202/6335] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:23 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:23.482052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-5aba514b-8bc2-496e-b38a-4e10a66bb207 req-13e98ef7-a2fd-467b-9292-e28b5ce05288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d8de02-f21b-4eaa-9223-21ea6227f261", "name": "network-vif-plugged", "status": "completed", "tag": "3dce0d45-4559-4688-9bd1-9f31898a4cf4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:30:23.504406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5aba514b-8bc2-496e-b38a-4e10a66bb207 req-13e98ef7-a2fd-467b-9292-e28b5ce05288 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:23.506953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5aba514b-8bc2-496e-b38a-4e10a66bb207 req-13e98ef7-a2fd-467b-9292-e28b5ce05288 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:23.518793 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-5aba514b-8bc2-496e-b38a-4e10a66bb207 req-13e98ef7-a2fd-467b-9292-e28b5ce05288 service nova] Creating event network-vif-plugged:3dce0d45-4559-4688-9bd1-9f31898a4cf4 for instance 32d8de02-f21b-4eaa-9223-21ea6227f261 on n-h2-851337-3 Aug 02 07:30:23.524763 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-5aba514b-8bc2-496e-b38a-4e10a66bb207 req-13e98ef7-a2fd-467b-9292-e28b5ce05288 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049000 Aug 02 07:30:23.525454 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3134/6336] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:30:24.462345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-54fac6ca-334b-4739-858b-8f679c53f80a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:24.463059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-54fac6ca-334b-4739-858b-8f679c53f80a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:24.470557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54fac6ca-334b-4739-858b-8f679c53f80a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:24.470964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54fac6ca-334b-4739-858b-8f679c53f80a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:24.471755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54fac6ca-334b-4739-858b-8f679c53f80a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:24.472195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54fac6ca-334b-4739-858b-8f679c53f80a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:24.511458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-853911746", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "241c6c90-b51f-40e6-8cbb-67c3cd773fba", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "5a68237c-f872-4b09-8d4c-16c9a40f01a7"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:30:24.609831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] validate_networks() for [('5a68237c-f872-4b09-8d4c-16c9a40f01a7', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:30:24.619399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-54fac6ca-334b-4739-858b-8f679c53f80a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:24.627324 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-54fac6ca-334b-4739-858b-8f679c53f80a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1270 microversion: 2.1 time: 0.169052 Aug 02 07:30:24.627931 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3203/6337] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:24 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:25.017192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:30:25.017619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:30:25.018148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:30:25.018529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:30:25.018933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:30:25.028756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:25.029207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:25.030027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:25.030462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:25.048282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:30:25.053732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for user 9f2f38363b9644f7956995d598509787 and project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:30:25.066127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:30:25.068495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='241c6c90-b51f-40e6-8cbb-67c3cd773fba',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:30:25.142686 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c9852cc7-0a66-4d6a-a422-648f4328c56f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636399 Aug 02 07:30:25.143353 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3135/6338] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:30:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:30:25.154719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ad8dbf16-f9b1-43a4-aeaf-2a3a43b8a6e5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:25.155618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ad8dbf16-f9b1-43a4-aeaf-2a3a43b8a6e5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:25.212651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ad8dbf16-f9b1-43a4-aeaf-2a3a43b8a6e5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:25.220774 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ad8dbf16-f9b1-43a4-aeaf-2a3a43b8a6e5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1056 microversion: 2.1 time: 0.070089 Aug 02 07:30:25.221363 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3204/6339] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:25 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1056 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:25.653167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0a3187da-c0e7-4bd0-b865-2eeb27fcc0ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:25.653776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0a3187da-c0e7-4bd0-b865-2eeb27fcc0ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:25.661653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a3187da-c0e7-4bd0-b865-2eeb27fcc0ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:25.662358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a3187da-c0e7-4bd0-b865-2eeb27fcc0ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:25.664578 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a3187da-c0e7-4bd0-b865-2eeb27fcc0ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:25.665017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0a3187da-c0e7-4bd0-b865-2eeb27fcc0ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:25.809852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0a3187da-c0e7-4bd0-b865-2eeb27fcc0ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:25.817783 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0a3187da-c0e7-4bd0-b865-2eeb27fcc0ca tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1458 microversion: 2.1 time: 0.169452 Aug 02 07:30:25.818386 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3136/6340] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:25 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1458 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:30:25.838046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3ce74308-c3b3-469a-a59d-5914322c2a27 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:25.838683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3ce74308-c3b3-469a-a59d-5914322c2a27 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:25.847103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ce74308-c3b3-469a-a59d-5914322c2a27 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:25.847554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ce74308-c3b3-469a-a59d-5914322c2a27 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:25.848333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ce74308-c3b3-469a-a59d-5914322c2a27 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:25.848771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ce74308-c3b3-469a-a59d-5914322c2a27 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:26.002284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3ce74308-c3b3-469a-a59d-5914322c2a27 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:26.010110 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3ce74308-c3b3-469a-a59d-5914322c2a27 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1458 microversion: 2.1 time: 0.175958 Aug 02 07:30:26.010677 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3205/6341] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:25 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1458 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:26.241371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d9cc9451-3e16-4edc-be20-ef2a6304baf5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:26.242162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d9cc9451-3e16-4edc-be20-ef2a6304baf5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:26.252268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9cc9451-3e16-4edc-be20-ef2a6304baf5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:26.252929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9cc9451-3e16-4edc-be20-ef2a6304baf5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:26.254109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9cc9451-3e16-4edc-be20-ef2a6304baf5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:26.254614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9cc9451-3e16-4edc-be20-ef2a6304baf5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:26.367440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d9cc9451-3e16-4edc-be20-ef2a6304baf5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:26.381841 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d9cc9451-3e16-4edc-be20-ef2a6304baf5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1126 microversion: 2.1 time: 0.144601 Aug 02 07:30:26.382836 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3137/6342] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:26 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1126 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:27.418672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-64bc2183-1414-460a-b965-5b966816c27c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:27.419394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-64bc2183-1414-460a-b965-5b966816c27c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:27.431359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64bc2183-1414-460a-b965-5b966816c27c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:27.432376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64bc2183-1414-460a-b965-5b966816c27c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:27.434246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64bc2183-1414-460a-b965-5b966816c27c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:27.435405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-64bc2183-1414-460a-b965-5b966816c27c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:28.044151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b845d5a8-c0d2-4c72-9d8a-c2377a90ee77 req-6db34098-c2fa-4abc-8903-444bf27f41ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f344980-17aa-4a0a-833d-361edfb17627", "tag": "bfdcabc2-fd7c-49ec-b261-1fbcd8e14382"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:30:28.078838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b845d5a8-c0d2-4c72-9d8a-c2377a90ee77 req-6db34098-c2fa-4abc-8903-444bf27f41ea service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:28.080232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b845d5a8-c0d2-4c72-9d8a-c2377a90ee77 req-6db34098-c2fa-4abc-8903-444bf27f41ea service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:28.099829 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b845d5a8-c0d2-4c72-9d8a-c2377a90ee77 req-6db34098-c2fa-4abc-8903-444bf27f41ea service nova] Creating event network-changed:bfdcabc2-fd7c-49ec-b261-1fbcd8e14382 for instance 1f344980-17aa-4a0a-833d-361edfb17627 on n-h1-851337-3 Aug 02 07:30:28.106372 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b845d5a8-c0d2-4c72-9d8a-c2377a90ee77 req-6db34098-c2fa-4abc-8903-444bf27f41ea service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071766 Aug 02 07:30:28.109691 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3138/6343] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:30:28.134767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-64bc2183-1414-460a-b965-5b966816c27c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:28.143732 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-64bc2183-1414-460a-b965-5b966816c27c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1168 microversion: 2.1 time: 0.742892 Aug 02 07:30:28.144712 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3206/6344] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:27 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1168 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:28.504264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a951c83e-9e1f-433b-88ca-19800871acca req-e0fd334c-637c-49e8-9b60-ffe5bc9ab197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d8de02-f21b-4eaa-9223-21ea6227f261", "tag": "3dce0d45-4559-4688-9bd1-9f31898a4cf4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:30:28.524262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a951c83e-9e1f-433b-88ca-19800871acca req-e0fd334c-637c-49e8-9b60-ffe5bc9ab197 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:28.525986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a951c83e-9e1f-433b-88ca-19800871acca req-e0fd334c-637c-49e8-9b60-ffe5bc9ab197 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:28.556224 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a951c83e-9e1f-433b-88ca-19800871acca req-e0fd334c-637c-49e8-9b60-ffe5bc9ab197 service nova] Creating event network-changed:3dce0d45-4559-4688-9bd1-9f31898a4cf4 for instance 32d8de02-f21b-4eaa-9223-21ea6227f261 on n-h2-851337-3 Aug 02 07:30:28.564523 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a951c83e-9e1f-433b-88ca-19800871acca req-e0fd334c-637c-49e8-9b60-ffe5bc9ab197 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064754 Aug 02 07:30:28.565806 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3139/6345] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:30:29.164912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3b2c7159-2449-4d71-8e60-3cf484d37e3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:29.166268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3b2c7159-2449-4d71-8e60-3cf484d37e3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:29.178254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b2c7159-2449-4d71-8e60-3cf484d37e3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:29.184072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b2c7159-2449-4d71-8e60-3cf484d37e3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:29.185295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b2c7159-2449-4d71-8e60-3cf484d37e3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:29.186013 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3b2c7159-2449-4d71-8e60-3cf484d37e3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:29.611994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3b2c7159-2449-4d71-8e60-3cf484d37e3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:29.622863 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3b2c7159-2449-4d71-8e60-3cf484d37e3b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1168 microversion: 2.1 time: 0.461746 Aug 02 07:30:29.624187 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3207/6346] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:29 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1168 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:30.581619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e986fab2-ff26-4ead-897d-2b25a9fe6427 req-bb819c89-f600-4303-ac3c-b803f3840ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d8de02-f21b-4eaa-9223-21ea6227f261", "tag": "3dce0d45-4559-4688-9bd1-9f31898a4cf4"}, {"name": "network-changed", "server_uuid": "32d8de02-f21b-4eaa-9223-21ea6227f261", "tag": "3dce0d45-4559-4688-9bd1-9f31898a4cf4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:30:30.597867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e986fab2-ff26-4ead-897d-2b25a9fe6427 req-bb819c89-f600-4303-ac3c-b803f3840ee4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:30.599073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e986fab2-ff26-4ead-897d-2b25a9fe6427 req-bb819c89-f600-4303-ac3c-b803f3840ee4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:30.614489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=78 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:30.617816 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e986fab2-ff26-4ead-897d-2b25a9fe6427 req-bb819c89-f600-4303-ac3c-b803f3840ee4 service nova] Creating event network-changed:3dce0d45-4559-4688-9bd1-9f31898a4cf4 for instance 32d8de02-f21b-4eaa-9223-21ea6227f261 on n-h2-851337-3 Aug 02 07:30:30.619096 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e986fab2-ff26-4ead-897d-2b25a9fe6427 req-bb819c89-f600-4303-ac3c-b803f3840ee4 service nova] Creating event network-changed:3dce0d45-4559-4688-9bd1-9f31898a4cf4 for instance 32d8de02-f21b-4eaa-9223-21ea6227f261 on n-h2-851337-3 Aug 02 07:30:30.626931 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e986fab2-ff26-4ead-897d-2b25a9fe6427 req-bb819c89-f600-4303-ac3c-b803f3840ee4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049845 Aug 02 07:30:30.628237 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3140/6347] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:30:30.644181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-91386b08-169a-4adb-9493-8f98a6a501d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:30.644794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-91386b08-169a-4adb-9493-8f98a6a501d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:30.652190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91386b08-169a-4adb-9493-8f98a6a501d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:30.652601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91386b08-169a-4adb-9493-8f98a6a501d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:30.653571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91386b08-169a-4adb-9493-8f98a6a501d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:30.654187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-91386b08-169a-4adb-9493-8f98a6a501d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:30.894299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-91386b08-169a-4adb-9493-8f98a6a501d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:30.904942 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-91386b08-169a-4adb-9493-8f98a6a501d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1168 microversion: 2.1 time: 0.264624 Aug 02 07:30:30.905823 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3208/6348] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:30 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1168 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:31.937488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-490b810f-af9f-47e1-b3a2-be7fca657135 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:31.940448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-490b810f-af9f-47e1-b3a2-be7fca657135 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:31.947805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-490b810f-af9f-47e1-b3a2-be7fca657135 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:31.948271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-490b810f-af9f-47e1-b3a2-be7fca657135 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:31.949049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-490b810f-af9f-47e1-b3a2-be7fca657135 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:31.949664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-490b810f-af9f-47e1-b3a2-be7fca657135 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:32.243289 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-490b810f-af9f-47e1-b3a2-be7fca657135 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:32.251368 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-490b810f-af9f-47e1-b3a2-be7fca657135 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1168 microversion: 2.1 time: 0.325470 Aug 02 07:30:32.252196 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3141/6349] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:31 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1168 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:33.275831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-936c693b-f3df-4974-9f7d-38b4b985ec23 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:33.276490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-936c693b-f3df-4974-9f7d-38b4b985ec23 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:33.284236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-936c693b-f3df-4974-9f7d-38b4b985ec23 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:33.284688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-936c693b-f3df-4974-9f7d-38b4b985ec23 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:33.285456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-936c693b-f3df-4974-9f7d-38b4b985ec23 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:33.285982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-936c693b-f3df-4974-9f7d-38b4b985ec23 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:33.440099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-936c693b-f3df-4974-9f7d-38b4b985ec23 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:33.455145 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-936c693b-f3df-4974-9f7d-38b4b985ec23 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1168 microversion: 2.1 time: 0.184536 Aug 02 07:30:33.469500 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3209/6350] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:33 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1168 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:34.478121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c0302820-1867-40c9-b7ef-919e66cc107b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:34.478678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c0302820-1867-40c9-b7ef-919e66cc107b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:34.485459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0302820-1867-40c9-b7ef-919e66cc107b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:34.486081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0302820-1867-40c9-b7ef-919e66cc107b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:34.487034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0302820-1867-40c9-b7ef-919e66cc107b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:34.487474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0302820-1867-40c9-b7ef-919e66cc107b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:34.627241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c0302820-1867-40c9-b7ef-919e66cc107b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:34.635796 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c0302820-1867-40c9-b7ef-919e66cc107b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1168 microversion: 2.1 time: 0.161690 Aug 02 07:30:34.636381 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3142/6351] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:34 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:35.657444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c3df2aaa-37c8-4509-b570-fef25e6c38a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:35.658091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c3df2aaa-37c8-4509-b570-fef25e6c38a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:35.660897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:35.667238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c3df2aaa-37c8-4509-b570-fef25e6c38a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:35.667687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c3df2aaa-37c8-4509-b570-fef25e6c38a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:35.668446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c3df2aaa-37c8-4509-b570-fef25e6c38a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:35.668966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c3df2aaa-37c8-4509-b570-fef25e6c38a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:35.805874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c3df2aaa-37c8-4509-b570-fef25e6c38a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:35.814649 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c3df2aaa-37c8-4509-b570-fef25e6c38a7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1168 microversion: 2.1 time: 0.161618 Aug 02 07:30:35.815286 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3210/6352] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:35 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:36.836763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-71489718-de2c-47f3-a7b6-d25bc99d6352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:36.837578 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-71489718-de2c-47f3-a7b6-d25bc99d6352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:36.841436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:36.842230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:36.847900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71489718-de2c-47f3-a7b6-d25bc99d6352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:36.848355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71489718-de2c-47f3-a7b6-d25bc99d6352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:36.849189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71489718-de2c-47f3-a7b6-d25bc99d6352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:36.849799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-71489718-de2c-47f3-a7b6-d25bc99d6352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:36.986849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-71489718-de2c-47f3-a7b6-d25bc99d6352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:36.995000 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-71489718-de2c-47f3-a7b6-d25bc99d6352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1168 microversion: 2.1 time: 0.162168 Aug 02 07:30:36.995819 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3143/6353] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:36 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:38.016359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc9bdc2d-190f-4d62-baf3-c4641472cc27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:38.016991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bc9bdc2d-190f-4d62-baf3-c4641472cc27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:38.024148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc9bdc2d-190f-4d62-baf3-c4641472cc27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:38.024577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc9bdc2d-190f-4d62-baf3-c4641472cc27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:38.025368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc9bdc2d-190f-4d62-baf3-c4641472cc27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:38.025802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc9bdc2d-190f-4d62-baf3-c4641472cc27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:38.163766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bc9bdc2d-190f-4d62-baf3-c4641472cc27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:38.171917 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc9bdc2d-190f-4d62-baf3-c4641472cc27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1168 microversion: 2.1 time: 0.159962 Aug 02 07:30:38.172541 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3211/6354] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:38 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:39.193050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5ca4df09-85b6-46c5-92bd-4b31a7c1f915 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:39.193836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5ca4df09-85b6-46c5-92bd-4b31a7c1f915 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:39.201812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ca4df09-85b6-46c5-92bd-4b31a7c1f915 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:39.202302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ca4df09-85b6-46c5-92bd-4b31a7c1f915 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:39.203093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ca4df09-85b6-46c5-92bd-4b31a7c1f915 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:39.203534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ca4df09-85b6-46c5-92bd-4b31a7c1f915 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:39.353265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5ca4df09-85b6-46c5-92bd-4b31a7c1f915 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:39.361109 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5ca4df09-85b6-46c5-92bd-4b31a7c1f915 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1168 microversion: 2.1 time: 0.172083 Aug 02 07:30:39.361664 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3144/6355] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:39 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1168 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:40.383155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7188967c-f96d-4d61-8967-7432cbbbfdc4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:40.383720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7188967c-f96d-4d61-8967-7432cbbbfdc4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:40.391829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7188967c-f96d-4d61-8967-7432cbbbfdc4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:40.392285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7188967c-f96d-4d61-8967-7432cbbbfdc4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:40.393053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7188967c-f96d-4d61-8967-7432cbbbfdc4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:40.393488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7188967c-f96d-4d61-8967-7432cbbbfdc4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:40.530222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7188967c-f96d-4d61-8967-7432cbbbfdc4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:40.538668 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7188967c-f96d-4d61-8967-7432cbbbfdc4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1168 microversion: 2.1 time: 0.159443 Aug 02 07:30:40.539598 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3212/6356] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:40 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:41.561133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7458e372-cc83-4097-b105-2f9963a75d67 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:41.561735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7458e372-cc83-4097-b105-2f9963a75d67 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:41.571533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7458e372-cc83-4097-b105-2f9963a75d67 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:41.572274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7458e372-cc83-4097-b105-2f9963a75d67 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:41.573588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7458e372-cc83-4097-b105-2f9963a75d67 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:41.574347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7458e372-cc83-4097-b105-2f9963a75d67 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:41.711226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7458e372-cc83-4097-b105-2f9963a75d67 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:41.719242 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7458e372-cc83-4097-b105-2f9963a75d67 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1202 microversion: 2.1 time: 0.162076 Aug 02 07:30:41.719800 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3145/6357] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:41 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:42.743194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-210b5cbd-11d6-4d41-9d90-3ace98d9f301 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:42.744413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-210b5cbd-11d6-4d41-9d90-3ace98d9f301 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:42.756539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-210b5cbd-11d6-4d41-9d90-3ace98d9f301 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:42.757231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-210b5cbd-11d6-4d41-9d90-3ace98d9f301 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:42.758552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-210b5cbd-11d6-4d41-9d90-3ace98d9f301 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:42.759465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-210b5cbd-11d6-4d41-9d90-3ace98d9f301 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:42.904158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-210b5cbd-11d6-4d41-9d90-3ace98d9f301 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:42.912054 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-210b5cbd-11d6-4d41-9d90-3ace98d9f301 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1202 microversion: 2.1 time: 0.174782 Aug 02 07:30:42.912661 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3213/6358] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:42 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1202 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:43.936188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d3c60392-0844-46c9-94d8-e8b36a96840e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:43.936782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d3c60392-0844-46c9-94d8-e8b36a96840e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:43.944199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d3c60392-0844-46c9-94d8-e8b36a96840e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:43.944667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d3c60392-0844-46c9-94d8-e8b36a96840e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:43.945424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d3c60392-0844-46c9-94d8-e8b36a96840e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:43.945855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d3c60392-0844-46c9-94d8-e8b36a96840e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:44.083016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d3c60392-0844-46c9-94d8-e8b36a96840e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:44.091157 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d3c60392-0844-46c9-94d8-e8b36a96840e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1202 microversion: 2.1 time: 0.160435 Aug 02 07:30:44.091775 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3146/6359] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:43 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:45.113208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a3dbd7f8-4315-44d6-b0b3-40622deec2a9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:45.113864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a3dbd7f8-4315-44d6-b0b3-40622deec2a9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:45.122208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a3dbd7f8-4315-44d6-b0b3-40622deec2a9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:45.122649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a3dbd7f8-4315-44d6-b0b3-40622deec2a9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:45.123450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a3dbd7f8-4315-44d6-b0b3-40622deec2a9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:45.123881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a3dbd7f8-4315-44d6-b0b3-40622deec2a9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:45.271868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a3dbd7f8-4315-44d6-b0b3-40622deec2a9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:45.281121 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a3dbd7f8-4315-44d6-b0b3-40622deec2a9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1202 microversion: 2.1 time: 0.172312 Aug 02 07:30:45.281699 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3214/6360] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:45 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1202 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:46.303141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-88a864a4-1e4b-4745-88c6-b57d06d44017 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:46.303778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-88a864a4-1e4b-4745-88c6-b57d06d44017 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:46.311425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88a864a4-1e4b-4745-88c6-b57d06d44017 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:46.311866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88a864a4-1e4b-4745-88c6-b57d06d44017 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:46.312677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88a864a4-1e4b-4745-88c6-b57d06d44017 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:46.313145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88a864a4-1e4b-4745-88c6-b57d06d44017 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:46.445941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-88a864a4-1e4b-4745-88c6-b57d06d44017 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:46.454318 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-88a864a4-1e4b-4745-88c6-b57d06d44017 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1202 microversion: 2.1 time: 0.155307 Aug 02 07:30:46.454918 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3147/6361] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:46 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:47.475850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2f32d69a-135a-4504-affb-abb255b4820e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:47.476611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2f32d69a-135a-4504-affb-abb255b4820e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:47.484401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f32d69a-135a-4504-affb-abb255b4820e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:47.484926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f32d69a-135a-4504-affb-abb255b4820e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:47.485792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f32d69a-135a-4504-affb-abb255b4820e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:47.486454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2f32d69a-135a-4504-affb-abb255b4820e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:47.489416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=90 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:47.632000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2f32d69a-135a-4504-affb-abb255b4820e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:47.639797 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2f32d69a-135a-4504-affb-abb255b4820e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1202 microversion: 2.1 time: 0.168279 Aug 02 07:30:47.640369 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3215/6362] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:47 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:48.660896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9517d114-8329-496c-b726-e9ad02856d42 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:48.661502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9517d114-8329-496c-b726-e9ad02856d42 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:48.664401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:48.670010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9517d114-8329-496c-b726-e9ad02856d42 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:48.670462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9517d114-8329-496c-b726-e9ad02856d42 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:48.671224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9517d114-8329-496c-b726-e9ad02856d42 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:48.671657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9517d114-8329-496c-b726-e9ad02856d42 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:48.814544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9517d114-8329-496c-b726-e9ad02856d42 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:48.825375 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9517d114-8329-496c-b726-e9ad02856d42 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1202 microversion: 2.1 time: 0.168306 Aug 02 07:30:48.826118 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3148/6363] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:48 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:49.851043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1ef3973f-b939-4a8e-a704-49b273a705c8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:49.851596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1ef3973f-b939-4a8e-a704-49b273a705c8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:49.854441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=34 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:49.862172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ef3973f-b939-4a8e-a704-49b273a705c8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:49.862741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ef3973f-b939-4a8e-a704-49b273a705c8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:49.863859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ef3973f-b939-4a8e-a704-49b273a705c8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:49.864271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ef3973f-b939-4a8e-a704-49b273a705c8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:50.014153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1ef3973f-b939-4a8e-a704-49b273a705c8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:50.022438 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1ef3973f-b939-4a8e-a704-49b273a705c8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1202 microversion: 2.1 time: 0.176687 Aug 02 07:30:50.023040 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3216/6364] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:49 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1202 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:51.043068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3463a2d8-1c83-4200-80f2-12600192dfc1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:51.043759 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3463a2d8-1c83-4200-80f2-12600192dfc1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:51.051221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3463a2d8-1c83-4200-80f2-12600192dfc1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:51.051659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3463a2d8-1c83-4200-80f2-12600192dfc1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:51.052784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3463a2d8-1c83-4200-80f2-12600192dfc1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:51.052914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3463a2d8-1c83-4200-80f2-12600192dfc1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:51.192668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3463a2d8-1c83-4200-80f2-12600192dfc1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:51.200756 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3463a2d8-1c83-4200-80f2-12600192dfc1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1202 microversion: 2.1 time: 0.161645 Aug 02 07:30:51.201352 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3149/6365] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:51 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:51.252635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-5a58a474-c2dd-47e3-9dea-4574bb7fb0d3 req-651e57bf-d943-4380-8592-a85db3cf3e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f344980-17aa-4a0a-833d-361edfb17627", "name": "network-vif-plugged", "status": "completed", "tag": "bfdcabc2-fd7c-49ec-b261-1fbcd8e14382"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:30:51.267343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-5a58a474-c2dd-47e3-9dea-4574bb7fb0d3 req-651e57bf-d943-4380-8592-a85db3cf3e0a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:51.267959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-5a58a474-c2dd-47e3-9dea-4574bb7fb0d3 req-651e57bf-d943-4380-8592-a85db3cf3e0a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:51.285990 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-5a58a474-c2dd-47e3-9dea-4574bb7fb0d3 req-651e57bf-d943-4380-8592-a85db3cf3e0a service nova] Creating event network-vif-plugged:bfdcabc2-fd7c-49ec-b261-1fbcd8e14382 for instance 1f344980-17aa-4a0a-833d-361edfb17627 on n-h1-851337-3 Aug 02 07:30:51.291710 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-5a58a474-c2dd-47e3-9dea-4574bb7fb0d3 req-651e57bf-d943-4380-8592-a85db3cf3e0a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193492 Aug 02 07:30:51.292315 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3217/6366] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:30:52.221136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-45e8e3b2-903e-4c89-85db-5f11e074c539 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:52.221834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-45e8e3b2-903e-4c89-85db-5f11e074c539 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:52.229834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45e8e3b2-903e-4c89-85db-5f11e074c539 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:52.230873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45e8e3b2-903e-4c89-85db-5f11e074c539 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:52.231462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45e8e3b2-903e-4c89-85db-5f11e074c539 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:52.231907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45e8e3b2-903e-4c89-85db-5f11e074c539 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:52.375249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-45e8e3b2-903e-4c89-85db-5f11e074c539 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:52.383901 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-45e8e3b2-903e-4c89-85db-5f11e074c539 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1202 microversion: 2.1 time: 0.166933 Aug 02 07:30:52.384489 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3150/6367] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:52 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:53.407407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cf20aeb1-56ee-4d68-825e-f4a001793ec0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:53.408222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cf20aeb1-56ee-4d68-825e-f4a001793ec0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:53.415026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf20aeb1-56ee-4d68-825e-f4a001793ec0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:53.415468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf20aeb1-56ee-4d68-825e-f4a001793ec0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:53.416228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf20aeb1-56ee-4d68-825e-f4a001793ec0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:53.416682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf20aeb1-56ee-4d68-825e-f4a001793ec0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:53.564618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cf20aeb1-56ee-4d68-825e-f4a001793ec0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:53.572573 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cf20aeb1-56ee-4d68-825e-f4a001793ec0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1388 microversion: 2.1 time: 0.170707 Aug 02 07:30:53.573127 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3218/6368] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:53 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1388 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:53.594424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-448129f5-2dea-4f78-88b4-9068e1aec7bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:53.595116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-448129f5-2dea-4f78-88b4-9068e1aec7bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:53.604208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-448129f5-2dea-4f78-88b4-9068e1aec7bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:53.604765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-448129f5-2dea-4f78-88b4-9068e1aec7bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:53.605875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-448129f5-2dea-4f78-88b4-9068e1aec7bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:53.606349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-448129f5-2dea-4f78-88b4-9068e1aec7bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:53.749724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-448129f5-2dea-4f78-88b4-9068e1aec7bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:53.757827 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-448129f5-2dea-4f78-88b4-9068e1aec7bf tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1388 microversion: 2.1 time: 0.167486 Aug 02 07:30:53.758416 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3151/6369] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:53 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1388 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:53.778399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-319cbc4e-e2a5-4fcb-a076-8d8df77befa9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:53.778976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-319cbc4e-e2a5-4fcb-a076-8d8df77befa9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:53.785372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-319cbc4e-e2a5-4fcb-a076-8d8df77befa9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:53.785814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-319cbc4e-e2a5-4fcb-a076-8d8df77befa9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:53.786706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-319cbc4e-e2a5-4fcb-a076-8d8df77befa9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:53.787146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-319cbc4e-e2a5-4fcb-a076-8d8df77befa9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:53.922544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-319cbc4e-e2a5-4fcb-a076-8d8df77befa9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:53.932775 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-319cbc4e-e2a5-4fcb-a076-8d8df77befa9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1388 microversion: 2.1 time: 0.158126 Aug 02 07:30:53.934008 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3219/6370] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:53 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1388 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:54.014286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cbecd404-c153-41bb-8781-c0bbbaaa8383 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:54.014961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cbecd404-c153-41bb-8781-c0bbbaaa8383 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:54.022310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbecd404-c153-41bb-8781-c0bbbaaa8383 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:54.022806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbecd404-c153-41bb-8781-c0bbbaaa8383 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:54.023613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbecd404-c153-41bb-8781-c0bbbaaa8383 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:54.024046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cbecd404-c153-41bb-8781-c0bbbaaa8383 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:54.055567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cbecd404-c153-41bb-8781-c0bbbaaa8383 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:30:54.137376 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cbecd404-c153-41bb-8781-c0bbbaaa8383 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 204 len: 0 microversion: 2.1 time: 0.127581 Aug 02 07:30:54.138045 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3152/6371] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:30:54 2022] DELETE /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:30:54.147278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-74778b85-c2b2-4440-b82a-f71167927284 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:54.147848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-74778b85-c2b2-4440-b82a-f71167927284 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:54.154714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74778b85-c2b2-4440-b82a-f71167927284 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:54.155165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74778b85-c2b2-4440-b82a-f71167927284 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:54.156111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74778b85-c2b2-4440-b82a-f71167927284 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:54.156588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-74778b85-c2b2-4440-b82a-f71167927284 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:54.293343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-74778b85-c2b2-4440-b82a-f71167927284 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:54.305715 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-74778b85-c2b2-4440-b82a-f71167927284 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1394 microversion: 2.1 time: 0.162849 Aug 02 07:30:54.306327 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3220/6372] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:54 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1394 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:55.331597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6c99860f-cb01-4333-83ca-cd94f696f54b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:55.332684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6c99860f-cb01-4333-83ca-cd94f696f54b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:55.342082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c99860f-cb01-4333-83ca-cd94f696f54b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:55.342533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c99860f-cb01-4333-83ca-cd94f696f54b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:55.343309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c99860f-cb01-4333-83ca-cd94f696f54b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:55.343739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c99860f-cb01-4333-83ca-cd94f696f54b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:55.497014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6c99860f-cb01-4333-83ca-cd94f696f54b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:55.505232 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6c99860f-cb01-4333-83ca-cd94f696f54b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1394 microversion: 2.1 time: 0.180839 Aug 02 07:30:55.505814 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3153/6373] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:55 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1394 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:56.370051 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ce8b9475-66b6-455e-9eb0-8776a4ac7cc5 req-a38e7ad6-5080-4304-b3fa-39a4c76346e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f344980-17aa-4a0a-833d-361edfb17627", "name": "network-vif-deleted", "tag": "bfdcabc2-fd7c-49ec-b261-1fbcd8e14382"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:30:56.384396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ce8b9475-66b6-455e-9eb0-8776a4ac7cc5 req-a38e7ad6-5080-4304-b3fa-39a4c76346e5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:56.385682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ce8b9475-66b6-455e-9eb0-8776a4ac7cc5 req-a38e7ad6-5080-4304-b3fa-39a4c76346e5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:56.400560 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ce8b9475-66b6-455e-9eb0-8776a4ac7cc5 req-a38e7ad6-5080-4304-b3fa-39a4c76346e5 service nova] Creating event network-vif-deleted:bfdcabc2-fd7c-49ec-b261-1fbcd8e14382 for instance 1f344980-17aa-4a0a-833d-361edfb17627 on n-h1-851337-3 Aug 02 07:30:56.406236 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ce8b9475-66b6-455e-9eb0-8776a4ac7cc5 req-a38e7ad6-5080-4304-b3fa-39a4c76346e5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040533 Aug 02 07:30:56.407349 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3221/6374] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:30:56.527037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-24a7006d-b728-4799-873a-f2f1fad56ac7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:56.527655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-24a7006d-b728-4799-873a-f2f1fad56ac7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:56.535103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24a7006d-b728-4799-873a-f2f1fad56ac7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:56.535539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24a7006d-b728-4799-873a-f2f1fad56ac7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:56.536308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24a7006d-b728-4799-873a-f2f1fad56ac7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:56.536714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24a7006d-b728-4799-873a-f2f1fad56ac7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:56.599937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-24a7006d-b728-4799-873a-f2f1fad56ac7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:56.608185 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-24a7006d-b728-4799-873a-f2f1fad56ac7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1187 microversion: 2.1 time: 0.085167 Aug 02 07:30:56.609000 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3154/6375] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:56 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:30:57.631009 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b8ef82c7-f423-49f1-abcf-df2756291a47 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:57.631744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b8ef82c7-f423-49f1-abcf-df2756291a47 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:57.639756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8ef82c7-f423-49f1-abcf-df2756291a47 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:57.640214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8ef82c7-f423-49f1-abcf-df2756291a47 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:57.640993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8ef82c7-f423-49f1-abcf-df2756291a47 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:57.641436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8ef82c7-f423-49f1-abcf-df2756291a47 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:57.709152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b8ef82c7-f423-49f1-abcf-df2756291a47 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:57.717112 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b8ef82c7-f423-49f1-abcf-df2756291a47 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1187 microversion: 2.1 time: 0.090651 Aug 02 07:30:57.717689 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3222/6376] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:57 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:58.737937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d5c97418-e44a-4d52-8bd1-3bf0516ee9ce tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:58.738604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d5c97418-e44a-4d52-8bd1-3bf0516ee9ce tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:58.746804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5c97418-e44a-4d52-8bd1-3bf0516ee9ce tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:58.747255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5c97418-e44a-4d52-8bd1-3bf0516ee9ce tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:58.748043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5c97418-e44a-4d52-8bd1-3bf0516ee9ce tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:58.748476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5c97418-e44a-4d52-8bd1-3bf0516ee9ce tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:58.813601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d5c97418-e44a-4d52-8bd1-3bf0516ee9ce tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:58.816160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:30:58.823329 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d5c97418-e44a-4d52-8bd1-3bf0516ee9ce tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1187 microversion: 2.1 time: 0.089558 Aug 02 07:30:58.823933 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3155/6377] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:58 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:30:59.844927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7c89d10b-29be-4b4f-9b3e-76296e3fefd1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:30:59.845541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7c89d10b-29be-4b4f-9b3e-76296e3fefd1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:30:59.854621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c89d10b-29be-4b4f-9b3e-76296e3fefd1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:59.855097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c89d10b-29be-4b4f-9b3e-76296e3fefd1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:59.856213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c89d10b-29be-4b4f-9b3e-76296e3fefd1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:30:59.856769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c89d10b-29be-4b4f-9b3e-76296e3fefd1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:30:59.924654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7c89d10b-29be-4b4f-9b3e-76296e3fefd1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:30:59.934093 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7c89d10b-29be-4b4f-9b3e-76296e3fefd1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1187 microversion: 2.1 time: 0.093523 Aug 02 07:30:59.934769 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3223/6378] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:30:59 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:00.956401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-48ff7b45-beab-4858-8d32-3d1d94028ca9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:00.956989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-48ff7b45-beab-4858-8d32-3d1d94028ca9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:00.965434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48ff7b45-beab-4858-8d32-3d1d94028ca9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:00.965884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48ff7b45-beab-4858-8d32-3d1d94028ca9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:00.966697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48ff7b45-beab-4858-8d32-3d1d94028ca9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:00.967144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48ff7b45-beab-4858-8d32-3d1d94028ca9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:01.003289 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48ff7b45-beab-4858-8d32-3d1d94028ca9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:01.003739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48ff7b45-beab-4858-8d32-3d1d94028ca9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:01.004188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-48ff7b45-beab-4858-8d32-3d1d94028ca9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lazy-loading 'fault' on Instance uuid 1f344980-17aa-4a0a-833d-361edfb17627 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:31:01.047219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-48ff7b45-beab-4858-8d32-3d1d94028ca9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:01.055526 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-48ff7b45-beab-4858-8d32-3d1d94028ca9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 200 len: 1192 microversion: 2.1 time: 0.103715 Aug 02 07:31:01.056290 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3156/6379] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:00 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 1192 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:02.083220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0be226cf-5258-48a7-9d07-1056bae613bb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:02.084443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0be226cf-5258-48a7-9d07-1056bae613bb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:02.095507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0be226cf-5258-48a7-9d07-1056bae613bb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:02.096091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0be226cf-5258-48a7-9d07-1056bae613bb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:02.097071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0be226cf-5258-48a7-9d07-1056bae613bb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:02.097520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0be226cf-5258-48a7-9d07-1056bae613bb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:02.112822 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-0be226cf-5258-48a7-9d07-1056bae613bb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0be226cf-5258-48a7-9d07-1056bae613bb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 HTTP/1.1 Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '1f344980-17aa-4a0a-833d-361edfb17627'} Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:31:02.114439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:02.126887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:31:02.126887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:31:02.126887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:31:02.126887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:31:02.126887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:31:02.126887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:02.126887 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:02.126887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0be226cf-5258-48a7-9d07-1056bae613bb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:31:02.126887 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0be226cf-5258-48a7-9d07-1056bae613bb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 404 len: 111 microversion: 2.1 time: 0.040677 Aug 02 07:31:02.126887 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3224/6380] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:02 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:31:04.270321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6ea8ddbf-a03a-46f9-a26d-f9761a99650a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:04.271392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6ea8ddbf-a03a-46f9-a26d-f9761a99650a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:04.279101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ea8ddbf-a03a-46f9-a26d-f9761a99650a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:04.280727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ea8ddbf-a03a-46f9-a26d-f9761a99650a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:04.281735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ea8ddbf-a03a-46f9-a26d-f9761a99650a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:04.282429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ea8ddbf-a03a-46f9-a26d-f9761a99650a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:04.298696 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-6ea8ddbf-a03a-46f9-a26d-f9761a99650a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6ea8ddbf-a03a-46f9-a26d-f9761a99650a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 HTTP/1.1 Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '1f344980-17aa-4a0a-833d-361edfb17627'} Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:31:04.300777 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:31:04.306214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:04.306214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:31:04.306214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:31:04.306214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:31:04.306214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:31:04.306214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:31:04.306214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:31:04.306214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:31:04.306214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:31:04.306214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:04.306214 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:31:04.306214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6ea8ddbf-a03a-46f9-a26d-f9761a99650a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:31:04.307153 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6ea8ddbf-a03a-46f9-a26d-f9761a99650a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 404 len: 111 microversion: 2.1 time: 0.039615 Aug 02 07:31:04.308293 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3157/6381] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:31:04 2022] DELETE /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:31:04.316564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-00f01e1b-5dce-4c3c-b7c2-7bf2b3ee77d7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:04.317254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-00f01e1b-5dce-4c3c-b7c2-7bf2b3ee77d7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 1f344980-17aa-4a0a-833d-361edfb17627] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:04.328219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d38bb1f4-c30e-4642-b89d-5878fb11a2de tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:04.330613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00f01e1b-5dce-4c3c-b7c2-7bf2b3ee77d7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:04.331076 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d38bb1f4-c30e-4642-b89d-5878fb11a2de tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:04.331597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00f01e1b-5dce-4c3c-b7c2-7bf2b3ee77d7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:04.332541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00f01e1b-5dce-4c3c-b7c2-7bf2b3ee77d7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:04.333129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00f01e1b-5dce-4c3c-b7c2-7bf2b3ee77d7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:04.339481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d38bb1f4-c30e-4642-b89d-5878fb11a2de tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:04.339712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d38bb1f4-c30e-4642-b89d-5878fb11a2de tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:04.340403 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d38bb1f4-c30e-4642-b89d-5878fb11a2de tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:04.340840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d38bb1f4-c30e-4642-b89d-5878fb11a2de tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:04.349589 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-00f01e1b-5dce-4c3c-b7c2-7bf2b3ee77d7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-00f01e1b-5dce-4c3c-b7c2-7bf2b3ee77d7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 HTTP/1.1 Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '1f344980-17aa-4a0a-833d-361edfb17627'} Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:31:04.351564 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:04.356572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:31:04.356572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:31:04.356572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:31:04.356572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:31:04.356572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:31:04.356572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. Aug 02 07:31:04.356572 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:04.357816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-00f01e1b-5dce-4c3c-b7c2-7bf2b3ee77d7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance 1f344980-17aa-4a0a-833d-361edfb17627 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:31:04.358888 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-00f01e1b-5dce-4c3c-b7c2-7bf2b3ee77d7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627" status: 404 len: 111 microversion: 2.1 time: 0.046311 Aug 02 07:31:04.359952 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3225/6382] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:04 2022] GET /compute/v2.1/servers/1f344980-17aa-4a0a-833d-361edfb17627 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:31:04.377924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d38bb1f4-c30e-4642-b89d-5878fb11a2de tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:31:04.484525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e5f8753d-d688-45f2-86b2-b49351951986 req-c9b8a3aa-6c68-4bf5-9402-569891740a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d8de02-f21b-4eaa-9223-21ea6227f261", "tag": "3dce0d45-4559-4688-9bd1-9f31898a4cf4"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:31:04.499328 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d38bb1f4-c30e-4642-b89d-5878fb11a2de tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "DELETE /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 204 len: 0 microversion: 2.1 time: 0.173197 Aug 02 07:31:04.504558 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3158/6383] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:31:04 2022] DELETE /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:31:04.504713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e5f8753d-d688-45f2-86b2-b49351951986 req-c9b8a3aa-6c68-4bf5-9402-569891740a5d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:04.505021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e5f8753d-d688-45f2-86b2-b49351951986 req-c9b8a3aa-6c68-4bf5-9402-569891740a5d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:04.512987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-93b1a671-b216-4089-8e7c-70cb712b8d13 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:04.514686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-93b1a671-b216-4089-8e7c-70cb712b8d13 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:04.522740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93b1a671-b216-4089-8e7c-70cb712b8d13 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:04.523819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93b1a671-b216-4089-8e7c-70cb712b8d13 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:04.525829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93b1a671-b216-4089-8e7c-70cb712b8d13 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:04.526399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93b1a671-b216-4089-8e7c-70cb712b8d13 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:04.534074 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e5f8753d-d688-45f2-86b2-b49351951986 req-c9b8a3aa-6c68-4bf5-9402-569891740a5d service nova] Creating event network-changed:3dce0d45-4559-4688-9bd1-9f31898a4cf4 for instance 32d8de02-f21b-4eaa-9223-21ea6227f261 on n-h2-851337-3 Aug 02 07:31:04.551789 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e5f8753d-d688-45f2-86b2-b49351951986 req-c9b8a3aa-6c68-4bf5-9402-569891740a5d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190276 Aug 02 07:31:04.552728 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3226/6384] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:31:04.693279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-93b1a671-b216-4089-8e7c-70cb712b8d13 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:04.701671 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-93b1a671-b216-4089-8e7c-70cb712b8d13 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1582 microversion: 2.1 time: 0.195263 Aug 02 07:31:04.702703 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3159/6385] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:04 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1582 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:05.728774 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44d538d4-9164-4a2e-a603-621599f4092d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:05.731955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-44d538d4-9164-4a2e-a603-621599f4092d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:05.738737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44d538d4-9164-4a2e-a603-621599f4092d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:05.739416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44d538d4-9164-4a2e-a603-621599f4092d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:05.740216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44d538d4-9164-4a2e-a603-621599f4092d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:05.740834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44d538d4-9164-4a2e-a603-621599f4092d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:05.892891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-44d538d4-9164-4a2e-a603-621599f4092d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:05.901492 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-44d538d4-9164-4a2e-a603-621599f4092d tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1582 microversion: 2.1 time: 0.177992 Aug 02 07:31:05.902193 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3227/6386] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:05 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1582 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:06.568190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-f1188309-e781-4860-932a-40593ed05d9b req-6436f130-21e8-4040-8c9a-538de6f28426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d8de02-f21b-4eaa-9223-21ea6227f261", "name": "network-vif-deleted", "tag": "3dce0d45-4559-4688-9bd1-9f31898a4cf4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:31:06.580392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f1188309-e781-4860-932a-40593ed05d9b req-6436f130-21e8-4040-8c9a-538de6f28426 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:06.580841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f1188309-e781-4860-932a-40593ed05d9b req-6436f130-21e8-4040-8c9a-538de6f28426 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:06.593439 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-f1188309-e781-4860-932a-40593ed05d9b req-6436f130-21e8-4040-8c9a-538de6f28426 service nova] Creating event network-vif-deleted:3dce0d45-4559-4688-9bd1-9f31898a4cf4 for instance 32d8de02-f21b-4eaa-9223-21ea6227f261 on n-h2-851337-3 Aug 02 07:31:06.600318 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-f1188309-e781-4860-932a-40593ed05d9b req-6436f130-21e8-4040-8c9a-538de6f28426 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035933 Aug 02 07:31:06.600977 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3160/6387] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:31:06.925265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-262626e1-ddf2-4b1a-bfa0-3e7b9620aaff tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:06.926553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-262626e1-ddf2-4b1a-bfa0-3e7b9620aaff tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:06.935306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-262626e1-ddf2-4b1a-bfa0-3e7b9620aaff tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:06.936051 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-262626e1-ddf2-4b1a-bfa0-3e7b9620aaff tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:06.937028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-262626e1-ddf2-4b1a-bfa0-3e7b9620aaff tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:06.937631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-262626e1-ddf2-4b1a-bfa0-3e7b9620aaff tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:07.019426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-262626e1-ddf2-4b1a-bfa0-3e7b9620aaff tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:07.029180 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-262626e1-ddf2-4b1a-bfa0-3e7b9620aaff tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1229 microversion: 2.1 time: 0.108523 Aug 02 07:31:07.034249 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3228/6388] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:06 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1229 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:08.052337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-049d69be-77de-4fc0-aa95-91a689a9a94a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:08.052929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-049d69be-77de-4fc0-aa95-91a689a9a94a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:08.060091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-049d69be-77de-4fc0-aa95-91a689a9a94a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:08.060544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-049d69be-77de-4fc0-aa95-91a689a9a94a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:08.061296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-049d69be-77de-4fc0-aa95-91a689a9a94a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:08.061751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-049d69be-77de-4fc0-aa95-91a689a9a94a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:08.449455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-049d69be-77de-4fc0-aa95-91a689a9a94a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:08.458115 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-049d69be-77de-4fc0-aa95-91a689a9a94a tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1229 microversion: 2.1 time: 0.410932 Aug 02 07:31:08.459263 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3161/6389] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:08 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1229 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:09.480792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0b528e68-e75a-41ca-aed4-5c188592085b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:09.481477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0b528e68-e75a-41ca-aed4-5c188592085b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:09.493555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b528e68-e75a-41ca-aed4-5c188592085b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:09.494447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b528e68-e75a-41ca-aed4-5c188592085b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:09.495937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b528e68-e75a-41ca-aed4-5c188592085b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:09.496485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b528e68-e75a-41ca-aed4-5c188592085b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:09.585664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0b528e68-e75a-41ca-aed4-5c188592085b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:09.597597 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0b528e68-e75a-41ca-aed4-5c188592085b tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1229 microversion: 2.1 time: 0.121636 Aug 02 07:31:09.605220 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3229/6390] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:09 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1229 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:31:10.621600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0ab40e50-9543-4af1-b3f9-3217e7be3b0e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:10.622355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0ab40e50-9543-4af1-b3f9-3217e7be3b0e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:10.629496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ab40e50-9543-4af1-b3f9-3217e7be3b0e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:10.630034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ab40e50-9543-4af1-b3f9-3217e7be3b0e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:10.631181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ab40e50-9543-4af1-b3f9-3217e7be3b0e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:10.631614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0ab40e50-9543-4af1-b3f9-3217e7be3b0e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:10.700634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0ab40e50-9543-4af1-b3f9-3217e7be3b0e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324b5e87a54105baaed4bb550bc787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4921bf4677140c3b7a6cd91af197769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:10.709473 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0ab40e50-9543-4af1-b3f9-3217e7be3b0e tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 200 len: 1229 microversion: 2.1 time: 0.092565 Aug 02 07:31:10.710351 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3162/6391] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:10 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:11.731155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-869efe36-4829-4f01-8f5a-9015601d7cc1 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:11.731752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-869efe36-4829-4f01-8f5a-9015601d7cc1 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] [instance: 32d8de02-f21b-4eaa-9223-21ea6227f261] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:11.741763 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-869efe36-4829-4f01-8f5a-9015601d7cc1 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:11.742471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-869efe36-4829-4f01-8f5a-9015601d7cc1 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:11.743823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-869efe36-4829-4f01-8f5a-9015601d7cc1 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:11.744433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-869efe36-4829-4f01-8f5a-9015601d7cc1 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:11.760362 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-869efe36-4829-4f01-8f5a-9015601d7cc1 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] HTTP exception thrown: Instance 32d8de02-f21b-4eaa-9223-21ea6227f261 could not be found. Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-869efe36-4829-4f01-8f5a-9015601d7cc1 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Request method failure captured: Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 HTTP/1.1 Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NHe-g95eHpcWtEp4KXoIBM5bbNXplOT3Qk4WL9Dx5X1bEYt6kNB_fTp7fFu1CqRmdFkkl-Ku6Srcw347AkrTo7pIusn7GNRX4HBui1lKcxgrfG7ss4zMcb7oVKwoMDsjmjoL_cufPMPwX1t-lm7KXkmtuBzFoyL46Zgmqn1cz-cnjY Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: a4921bf4677140c3b7a6cd91af197769 Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestVolumeBackupRestore-1227172730 Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a4921bf4677140c3b7a6cd91af197769"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a4921bf4677140c3b7a6cd91af197769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a4921bf4677140c3b7a6cd91af197769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a4921bf4677140c3b7a6cd91af197769"}]}] Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestVolumeBackupRestore-1227172730 Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: a4921bf4677140c3b7a6cd91af197769 Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1227172730 Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestVolumeBackupRestore-1227172730-project Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 86324b5e87a54105baaed4bb550bc787 Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestVolumeBackupRestore-1227172730-project Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 32d8de02-f21b-4eaa-9223-21ea6227f261 could not be found. Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '32d8de02-f21b-4eaa-9223-21ea6227f261'} Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d8de02-f21b-4eaa-9223-21ea6227f261 could not be found. Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d8de02-f21b-4eaa-9223-21ea6227f261 could not be found. Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:31:11.762125 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:11.767736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:31:11.767736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:31:11.767736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:31:11.767736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:31:11.767736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:31:11.767736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d8de02-f21b-4eaa-9223-21ea6227f261 could not be found. Aug 02 07:31:11.767736 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:31:11.767736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-869efe36-4829-4f01-8f5a-9015601d7cc1 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Returning 404 to user: Instance 32d8de02-f21b-4eaa-9223-21ea6227f261 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:31:11.767736 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-869efe36-4829-4f01-8f5a-9015601d7cc1 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261" status: 404 len: 111 microversion: 2.1 time: 0.036573 Aug 02 07:31:11.767736 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3230/6392] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:11 2022] GET /compute/v2.1/servers/32d8de02-f21b-4eaa-9223-21ea6227f261 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:31:11.937213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a09e5be0-bc56-4e67-9bc0-16ed5ca07ac1 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] Calling method '.version_select at 0x7f9279e5be50>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:11.962292 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a09e5be0-bc56-4e67-9bc0-16ed5ca07ac1 tempest-TestVolumeBackupRestore-1227172730 tempest-TestVolumeBackupRestore-1227172730-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-279792654" status: 202 len: 0 microversion: 2.1 time: 0.028899 Aug 02 07:31:11.962917 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3163/6393] 10.222.0.79 () {58 vars in 1266 bytes} [Tue Aug 2 07:31:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-279792654 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:31:27.721151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1831316761", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f783f9ae-ed83-49cd-99d1-559c0c36257b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "5a68237c-f872-4b09-8d4c-16c9a40f01a7"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:31:27.731920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=29 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:31:27.732584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=71 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:31:27.786717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] validate_networks() for [('5a68237c-f872-4b09-8d4c-16c9a40f01a7', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:31:28.294010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:31:28.294449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:31:28.294953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:31:28.295397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:31:28.295820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:31:28.305739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:28.306159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:28.307007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:28.307447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:28.324579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:31:28.330050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for user 9f2f38363b9644f7956995d598509787 and project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:31:28.390128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:31:28.392242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f783f9ae-ed83-49cd-99d1-559c0c36257b',volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:31:28.535979 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c229b3fa-13b3-4692-b393-15feb2747373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818599 Aug 02 07:31:28.536802 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3231/6394] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:31:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:31:28.545819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:31:28.547009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:31:28.552078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b2dbe35b-47e4-45e3-a083-04ad70c2ddf1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:28.552713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b2dbe35b-47e4-45e3-a083-04ad70c2ddf1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:28.616519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b2dbe35b-47e4-45e3-a083-04ad70c2ddf1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:28.624253 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b2dbe35b-47e4-45e3-a083-04ad70c2ddf1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1071 microversion: 2.1 time: 0.080295 Aug 02 07:31:28.624792 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3164/6395] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:28 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1071 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:29.645514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d94b57f3-090f-4c5d-96f1-63cf2382a689 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:29.646341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d94b57f3-090f-4c5d-96f1-63cf2382a689 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:29.654223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d94b57f3-090f-4c5d-96f1-63cf2382a689 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:29.654680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d94b57f3-090f-4c5d-96f1-63cf2382a689 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:29.655476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d94b57f3-090f-4c5d-96f1-63cf2382a689 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:29.655895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d94b57f3-090f-4c5d-96f1-63cf2382a689 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:29.723493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d94b57f3-090f-4c5d-96f1-63cf2382a689 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:29.733137 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d94b57f3-090f-4c5d-96f1-63cf2382a689 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1177 microversion: 2.1 time: 0.091675 Aug 02 07:31:29.733651 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3232/6396] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:29 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1177 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:30.755144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-745aa15e-e450-4f2f-9f9f-9bacdb679d92 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:30.755730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-745aa15e-e450-4f2f-9f9f-9bacdb679d92 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:30.764216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-745aa15e-e450-4f2f-9f9f-9bacdb679d92 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:30.764650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-745aa15e-e450-4f2f-9f9f-9bacdb679d92 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:30.765521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-745aa15e-e450-4f2f-9f9f-9bacdb679d92 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:30.766051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-745aa15e-e450-4f2f-9f9f-9bacdb679d92 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:30.913409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-745aa15e-e450-4f2f-9f9f-9bacdb679d92 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:30.922897 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-745aa15e-e450-4f2f-9f9f-9bacdb679d92 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1229 microversion: 2.1 time: 0.171618 Aug 02 07:31:30.923503 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3165/6397] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:30 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1229 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:30.998718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-1cf08671-e22c-4def-97a5-a5b4bdad105f req-ed890c9c-346f-4a09-86f2-419364c63edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c2eb34-58a3-4a4a-9aee-aa63a0e103d8", "tag": "5cccded2-52c0-40c2-b63b-d5e62b24b102"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:31:31.015332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-1cf08671-e22c-4def-97a5-a5b4bdad105f req-ed890c9c-346f-4a09-86f2-419364c63edb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:31.015927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-1cf08671-e22c-4def-97a5-a5b4bdad105f req-ed890c9c-346f-4a09-86f2-419364c63edb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:31.030865 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-1cf08671-e22c-4def-97a5-a5b4bdad105f req-ed890c9c-346f-4a09-86f2-419364c63edb service nova] Creating event network-changed:5cccded2-52c0-40c2-b63b-d5e62b24b102 for instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 on n-h1-851337-3 Aug 02 07:31:31.035953 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-1cf08671-e22c-4def-97a5-a5b4bdad105f req-ed890c9c-346f-4a09-86f2-419364c63edb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045297 Aug 02 07:31:31.037234 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3233/6398] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:31:31.945190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6a111e94-1d1e-453c-b124-e44190e3764e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:31.945807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6a111e94-1d1e-453c-b124-e44190e3764e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:31.955445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a111e94-1d1e-453c-b124-e44190e3764e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:31.955900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a111e94-1d1e-453c-b124-e44190e3764e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:31.956719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a111e94-1d1e-453c-b124-e44190e3764e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:31.957151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a111e94-1d1e-453c-b124-e44190e3764e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:32.111119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6a111e94-1d1e-453c-b124-e44190e3764e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:32.119886 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6a111e94-1d1e-453c-b124-e44190e3764e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1229 microversion: 2.1 time: 0.179200 Aug 02 07:31:32.120834 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3166/6399] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:31 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1229 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:33.142535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b55aa9f9-cbad-4bb2-b602-aeb2720a05c2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:33.143099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b55aa9f9-cbad-4bb2-b602-aeb2720a05c2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:33.150928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b55aa9f9-cbad-4bb2-b602-aeb2720a05c2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:33.151372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b55aa9f9-cbad-4bb2-b602-aeb2720a05c2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:33.152151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b55aa9f9-cbad-4bb2-b602-aeb2720a05c2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:33.152589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b55aa9f9-cbad-4bb2-b602-aeb2720a05c2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:33.285067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b55aa9f9-cbad-4bb2-b602-aeb2720a05c2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:33.293228 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b55aa9f9-cbad-4bb2-b602-aeb2720a05c2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1229 microversion: 2.1 time: 0.155270 Aug 02 07:31:33.293809 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3234/6400] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:33 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1229 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:34.314784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-864dccc5-719d-44d2-aa0b-874a1059cb59 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:34.315485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-864dccc5-719d-44d2-aa0b-874a1059cb59 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:34.322137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-864dccc5-719d-44d2-aa0b-874a1059cb59 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:34.322590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-864dccc5-719d-44d2-aa0b-874a1059cb59 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:34.323366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-864dccc5-719d-44d2-aa0b-874a1059cb59 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:34.323803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-864dccc5-719d-44d2-aa0b-874a1059cb59 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:34.460745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-864dccc5-719d-44d2-aa0b-874a1059cb59 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:34.468946 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-864dccc5-719d-44d2-aa0b-874a1059cb59 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1229 microversion: 2.1 time: 0.158380 Aug 02 07:31:34.469536 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3167/6401] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:34 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1229 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:35.494501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2051fe9e-cb01-40aa-a401-54c99ae0ac55 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:35.496008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2051fe9e-cb01-40aa-a401-54c99ae0ac55 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:35.503791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2051fe9e-cb01-40aa-a401-54c99ae0ac55 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:35.504241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2051fe9e-cb01-40aa-a401-54c99ae0ac55 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:35.505037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2051fe9e-cb01-40aa-a401-54c99ae0ac55 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:35.505468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2051fe9e-cb01-40aa-a401-54c99ae0ac55 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:35.647035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2051fe9e-cb01-40aa-a401-54c99ae0ac55 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:35.657452 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2051fe9e-cb01-40aa-a401-54c99ae0ac55 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1217 microversion: 2.1 time: 0.169526 Aug 02 07:31:35.658077 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3235/6402] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:35 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:36.683557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8e82dbf3-9469-46f7-9bd8-4c8655435eb5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:36.684596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8e82dbf3-9469-46f7-9bd8-4c8655435eb5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:36.696077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e82dbf3-9469-46f7-9bd8-4c8655435eb5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:36.696826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e82dbf3-9469-46f7-9bd8-4c8655435eb5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:36.698118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e82dbf3-9469-46f7-9bd8-4c8655435eb5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:36.698914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8e82dbf3-9469-46f7-9bd8-4c8655435eb5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:36.837675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8e82dbf3-9469-46f7-9bd8-4c8655435eb5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:36.845727 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8e82dbf3-9469-46f7-9bd8-4c8655435eb5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1217 microversion: 2.1 time: 0.168780 Aug 02 07:31:36.846339 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3168/6403] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:36 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:37.871341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4d7528a8-93d5-4112-80e3-13ccc6c026bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:37.872174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4d7528a8-93d5-4112-80e3-13ccc6c026bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:37.878737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d7528a8-93d5-4112-80e3-13ccc6c026bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:37.879216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d7528a8-93d5-4112-80e3-13ccc6c026bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:37.879992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d7528a8-93d5-4112-80e3-13ccc6c026bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:37.880427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d7528a8-93d5-4112-80e3-13ccc6c026bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:38.013534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4d7528a8-93d5-4112-80e3-13ccc6c026bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:38.021321 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4d7528a8-93d5-4112-80e3-13ccc6c026bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1217 microversion: 2.1 time: 0.157580 Aug 02 07:31:38.021916 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3236/6404] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:37 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:39.043326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8c1ca8ef-830c-4290-ab4f-24d0faf2a55f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:39.043930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8c1ca8ef-830c-4290-ab4f-24d0faf2a55f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:39.046956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:31:39.052770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c1ca8ef-830c-4290-ab4f-24d0faf2a55f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:39.055622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c1ca8ef-830c-4290-ab4f-24d0faf2a55f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:39.055622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c1ca8ef-830c-4290-ab4f-24d0faf2a55f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:39.055622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c1ca8ef-830c-4290-ab4f-24d0faf2a55f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:39.196558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8c1ca8ef-830c-4290-ab4f-24d0faf2a55f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:39.207012 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8c1ca8ef-830c-4290-ab4f-24d0faf2a55f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1217 microversion: 2.1 time: 0.166228 Aug 02 07:31:39.207012 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3169/6405] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:39 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:40.230978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f2fc7ce4-0297-410f-a08a-9176bdd30110 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:40.232037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f2fc7ce4-0297-410f-a08a-9176bdd30110 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:40.235280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:31:40.236386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:31:40.247625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2fc7ce4-0297-410f-a08a-9176bdd30110 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:40.248514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2fc7ce4-0297-410f-a08a-9176bdd30110 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:40.249304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2fc7ce4-0297-410f-a08a-9176bdd30110 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:40.249742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f2fc7ce4-0297-410f-a08a-9176bdd30110 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:40.399347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f2fc7ce4-0297-410f-a08a-9176bdd30110 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:40.407583 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f2fc7ce4-0297-410f-a08a-9176bdd30110 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1217 microversion: 2.1 time: 0.183345 Aug 02 07:31:40.408156 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3237/6406] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:40 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:41.432932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5ecaf74e-4b59-4091-9274-bce6b6874440 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:41.433942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5ecaf74e-4b59-4091-9274-bce6b6874440 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:41.442328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ecaf74e-4b59-4091-9274-bce6b6874440 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:41.442767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ecaf74e-4b59-4091-9274-bce6b6874440 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:41.443519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ecaf74e-4b59-4091-9274-bce6b6874440 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:41.443947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ecaf74e-4b59-4091-9274-bce6b6874440 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:41.577699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5ecaf74e-4b59-4091-9274-bce6b6874440 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:41.586117 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5ecaf74e-4b59-4091-9274-bce6b6874440 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1217 microversion: 2.1 time: 0.159854 Aug 02 07:31:41.586711 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3170/6407] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:41 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:42.607957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f6c147f0-18f8-4e6f-80f5-cd7116fdb70b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:42.608562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f6c147f0-18f8-4e6f-80f5-cd7116fdb70b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:42.616435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6c147f0-18f8-4e6f-80f5-cd7116fdb70b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:42.616879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6c147f0-18f8-4e6f-80f5-cd7116fdb70b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:42.617679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6c147f0-18f8-4e6f-80f5-cd7116fdb70b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:42.618172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6c147f0-18f8-4e6f-80f5-cd7116fdb70b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:42.766176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f6c147f0-18f8-4e6f-80f5-cd7116fdb70b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:42.774471 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f6c147f0-18f8-4e6f-80f5-cd7116fdb70b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1217 microversion: 2.1 time: 0.170838 Aug 02 07:31:42.775058 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3238/6408] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:42 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:43.799810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-152bef30-1ad7-4b79-8311-2a423b86b7cd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:43.800689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-152bef30-1ad7-4b79-8311-2a423b86b7cd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:43.812837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-152bef30-1ad7-4b79-8311-2a423b86b7cd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:43.813594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-152bef30-1ad7-4b79-8311-2a423b86b7cd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:43.814966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-152bef30-1ad7-4b79-8311-2a423b86b7cd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:43.815657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-152bef30-1ad7-4b79-8311-2a423b86b7cd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:43.963843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-152bef30-1ad7-4b79-8311-2a423b86b7cd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:43.972174 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-152bef30-1ad7-4b79-8311-2a423b86b7cd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1217 microversion: 2.1 time: 0.179114 Aug 02 07:31:43.972998 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3171/6409] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:43 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:44.997360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9d554c75-017a-42b5-acf0-d1295699bc71 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:44.998319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9d554c75-017a-42b5-acf0-d1295699bc71 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:45.006424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d554c75-017a-42b5-acf0-d1295699bc71 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:45.006876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d554c75-017a-42b5-acf0-d1295699bc71 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:45.007630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d554c75-017a-42b5-acf0-d1295699bc71 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:45.008059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d554c75-017a-42b5-acf0-d1295699bc71 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:45.148135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9d554c75-017a-42b5-acf0-d1295699bc71 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:45.158566 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9d554c75-017a-42b5-acf0-d1295699bc71 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1217 microversion: 2.1 time: 0.168192 Aug 02 07:31:45.159132 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3239/6410] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:44 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:45.438235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a4aaf79a-9813-4564-8c0d-8768c63883ff req-c18c60bc-0fa0-4a64-9a84-3bbba46139cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c2eb34-58a3-4a4a-9aee-aa63a0e103d8", "name": "network-vif-plugged", "status": "completed", "tag": "5cccded2-52c0-40c2-b63b-d5e62b24b102"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:31:45.451631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a4aaf79a-9813-4564-8c0d-8768c63883ff req-c18c60bc-0fa0-4a64-9a84-3bbba46139cb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:45.452254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a4aaf79a-9813-4564-8c0d-8768c63883ff req-c18c60bc-0fa0-4a64-9a84-3bbba46139cb service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:45.463786 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a4aaf79a-9813-4564-8c0d-8768c63883ff req-c18c60bc-0fa0-4a64-9a84-3bbba46139cb service nova] Creating event network-vif-plugged:5cccded2-52c0-40c2-b63b-d5e62b24b102 for instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 on n-h1-851337-3 Aug 02 07:31:45.468886 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a4aaf79a-9813-4564-8c0d-8768c63883ff req-c18c60bc-0fa0-4a64-9a84-3bbba46139cb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034573 Aug 02 07:31:45.469491 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3172/6411] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:31:46.183617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c5cdc86d-be22-48da-a436-4bb0266a1c27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:46.184614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c5cdc86d-be22-48da-a436-4bb0266a1c27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:46.196722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5cdc86d-be22-48da-a436-4bb0266a1c27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:46.197474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5cdc86d-be22-48da-a436-4bb0266a1c27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:46.198805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5cdc86d-be22-48da-a436-4bb0266a1c27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:46.199539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c5cdc86d-be22-48da-a436-4bb0266a1c27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:46.337659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c5cdc86d-be22-48da-a436-4bb0266a1c27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:46.345569 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c5cdc86d-be22-48da-a436-4bb0266a1c27 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1217 microversion: 2.1 time: 0.168692 Aug 02 07:31:46.346171 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3240/6412] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:46 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:47.373567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cab78225-c8dd-44bb-9d86-dce97c822e5c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:47.374897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cab78225-c8dd-44bb-9d86-dce97c822e5c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:47.385617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cab78225-c8dd-44bb-9d86-dce97c822e5c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:47.386415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cab78225-c8dd-44bb-9d86-dce97c822e5c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:47.387807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cab78225-c8dd-44bb-9d86-dce97c822e5c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:47.388518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cab78225-c8dd-44bb-9d86-dce97c822e5c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:47.524606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cab78225-c8dd-44bb-9d86-dce97c822e5c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:47.536068 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cab78225-c8dd-44bb-9d86-dce97c822e5c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1404 microversion: 2.1 time: 0.171010 Aug 02 07:31:47.536872 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3173/6413] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:47 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:47.561195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-40673f3f-ae34-4e0f-bf96-09a55d959a86 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:47.561775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-40673f3f-ae34-4e0f-bf96-09a55d959a86 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:47.569299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40673f3f-ae34-4e0f-bf96-09a55d959a86 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:47.569799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40673f3f-ae34-4e0f-bf96-09a55d959a86 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:47.570606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40673f3f-ae34-4e0f-bf96-09a55d959a86 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:47.571038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40673f3f-ae34-4e0f-bf96-09a55d959a86 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:47.714200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-40673f3f-ae34-4e0f-bf96-09a55d959a86 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:47.722720 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-40673f3f-ae34-4e0f-bf96-09a55d959a86 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1404 microversion: 2.1 time: 0.165450 Aug 02 07:31:47.723313 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3241/6414] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:47 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:47.746574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c414eef2-cac7-4ba3-8dc9-f368b9c2b09f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-257297577"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:31:47.750567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c414eef2-cac7-4ba3-8dc9-f368b9c2b09f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:47.757926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c414eef2-cac7-4ba3-8dc9-f368b9c2b09f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:47.758394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c414eef2-cac7-4ba3-8dc9-f368b9c2b09f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:47.759157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c414eef2-cac7-4ba3-8dc9-f368b9c2b09f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:47.759591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c414eef2-cac7-4ba3-8dc9-f368b9c2b09f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:47.853820 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.compute.api [None req-c414eef2-cac7-4ba3-8dc9-f368b9c2b09f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Attempting to quiesce instance before volume snapshot. Aug 02 07:31:47.915190 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.compute.api [None req-c414eef2-cac7-4ba3-8dc9-f368b9c2b09f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 02 07:31:48.001478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c414eef2-cac7-4ba3-8dc9-f368b9c2b09f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Creating snapshot from volume f783f9ae-ed83-49cd-99d1-559c0c36257b. {{(pid=126119) snapshot_instance /opt/stack/nova/nova/compute/api.py:3456}} Aug 02 07:31:49.031765 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c414eef2-cac7-4ba3-8dc9-f368b9c2b09f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "POST /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8/action" status: 202 len: 0 microversion: 2.1 time: 1.291973 Aug 02 07:31:49.037681 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3174/6415] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:31:47 2022] POST /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8/action => generated 0 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 02 07:31:50.196214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1842261679", "imageRef": "168511db-3f3e-4675-bafd-11b1bd7820ba", "flavorRef": "452", "networks": [{"uuid": "5a68237c-f872-4b09-8d4c-16c9a40f01a7"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:31:50.257422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] validate_networks() for [('5a68237c-f872-4b09-8d4c-16c9a40f01a7', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:31:50.644812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:31:50.645230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:31:50.645701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:31:50.646145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:31:50.646560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:31:50.656220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:50.656662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:50.657452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:50.657863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:50.677488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:31:50.683115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for user 9f2f38363b9644f7956995d598509787 and project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:31:50.695856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:31:50.698501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='faf2d4fe-deda-466e-9e6d-ad7f5cf4778f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:31:50.773706 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-221ec17c-4263-4a6c-aa02-b213c6700e2a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581449 Aug 02 07:31:50.774381 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3242/6416] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:31:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:31:50.787486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7d6a5b20-9017-4e24-b9e6-c8cd7160ddf8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:50.788190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7d6a5b20-9017-4e24-b9e6-c8cd7160ddf8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:50.856437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7d6a5b20-9017-4e24-b9e6-c8cd7160ddf8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:50.864080 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7d6a5b20-9017-4e24-b9e6-c8cd7160ddf8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1230 microversion: 2.1 time: 0.082137 Aug 02 07:31:50.864608 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3175/6417] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:50 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1230 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:51.887631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5caee57c-4fe7-45e7-9a51-13c9a4a941f7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:51.887631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5caee57c-4fe7-45e7-9a51-13c9a4a941f7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:51.895672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5caee57c-4fe7-45e7-9a51-13c9a4a941f7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:51.896070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5caee57c-4fe7-45e7-9a51-13c9a4a941f7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:51.896846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5caee57c-4fe7-45e7-9a51-13c9a4a941f7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:51.897290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5caee57c-4fe7-45e7-9a51-13c9a4a941f7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:51.982098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5caee57c-4fe7-45e7-9a51-13c9a4a941f7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:51.989848 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5caee57c-4fe7-45e7-9a51-13c9a4a941f7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1300 microversion: 2.1 time: 0.108552 Aug 02 07:31:51.990807 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3243/6418] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:51 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:53.016315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-be7373a9-1e56-467d-b77e-63dadd8e284e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:53.017990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-be7373a9-1e56-467d-b77e-63dadd8e284e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:53.028185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be7373a9-1e56-467d-b77e-63dadd8e284e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:53.029783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be7373a9-1e56-467d-b77e-63dadd8e284e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:53.033553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be7373a9-1e56-467d-b77e-63dadd8e284e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:53.033553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-be7373a9-1e56-467d-b77e-63dadd8e284e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:53.205424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-378e25eb-e884-45f4-a4a0-7f7af637f506 req-62de36a1-0718-4dbc-a1e8-e06f484c544a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77e9f2b7-bb0f-43ac-875c-aab99c1b68dc", "tag": "38fece49-aa9f-4ff4-b9c9-a81906842629"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:31:53.231389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-378e25eb-e884-45f4-a4a0-7f7af637f506 req-62de36a1-0718-4dbc-a1e8-e06f484c544a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:53.231826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-378e25eb-e884-45f4-a4a0-7f7af637f506 req-62de36a1-0718-4dbc-a1e8-e06f484c544a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:53.243816 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-378e25eb-e884-45f4-a4a0-7f7af637f506 req-62de36a1-0718-4dbc-a1e8-e06f484c544a service nova] Creating event network-changed:38fece49-aa9f-4ff4-b9c9-a81906842629 for instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc on n-h2-851337-3 Aug 02 07:31:53.250160 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-378e25eb-e884-45f4-a4a0-7f7af637f506 req-62de36a1-0718-4dbc-a1e8-e06f484c544a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048629 Aug 02 07:31:53.250704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-be7373a9-1e56-467d-b77e-63dadd8e284e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:53.251720 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3244/6419] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:31:53.262653 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-be7373a9-1e56-467d-b77e-63dadd8e284e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1342 microversion: 2.1 time: 0.253831 Aug 02 07:31:53.272609 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3176/6420] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:53 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1342 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:54.284584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-10fd2ee5-9f68-4ee1-a04e-b60d0cf05d90 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:54.285282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-10fd2ee5-9f68-4ee1-a04e-b60d0cf05d90 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:54.292869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10fd2ee5-9f68-4ee1-a04e-b60d0cf05d90 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:54.293314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10fd2ee5-9f68-4ee1-a04e-b60d0cf05d90 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:54.294130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10fd2ee5-9f68-4ee1-a04e-b60d0cf05d90 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:54.294564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10fd2ee5-9f68-4ee1-a04e-b60d0cf05d90 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:54.433778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-10fd2ee5-9f68-4ee1-a04e-b60d0cf05d90 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:54.441984 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-10fd2ee5-9f68-4ee1-a04e-b60d0cf05d90 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1342 microversion: 2.1 time: 0.161849 Aug 02 07:31:54.442547 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3245/6421] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:54 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:55.468880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d8ada4fc-df6b-473a-87ca-4d65c6879d9b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:55.470339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d8ada4fc-df6b-473a-87ca-4d65c6879d9b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:55.479909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8ada4fc-df6b-473a-87ca-4d65c6879d9b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:55.480487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8ada4fc-df6b-473a-87ca-4d65c6879d9b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:55.481347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8ada4fc-df6b-473a-87ca-4d65c6879d9b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:55.481726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d8ada4fc-df6b-473a-87ca-4d65c6879d9b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:55.639719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d8ada4fc-df6b-473a-87ca-4d65c6879d9b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:55.649156 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d8ada4fc-df6b-473a-87ca-4d65c6879d9b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1342 microversion: 2.1 time: 0.185262 Aug 02 07:31:55.650034 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3177/6422] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:55 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1342 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:56.673055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-00a551c7-c891-48db-b75b-253a18051257 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:56.673953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-00a551c7-c891-48db-b75b-253a18051257 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:56.682395 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00a551c7-c891-48db-b75b-253a18051257 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:56.682925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00a551c7-c891-48db-b75b-253a18051257 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:56.683697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00a551c7-c891-48db-b75b-253a18051257 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:56.684142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00a551c7-c891-48db-b75b-253a18051257 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:57.009910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-00a551c7-c891-48db-b75b-253a18051257 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:57.023606 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-00a551c7-c891-48db-b75b-253a18051257 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1342 microversion: 2.1 time: 0.355715 Aug 02 07:31:57.037915 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3246/6423] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:56 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1342 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:31:58.050717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-abfd4e9f-ec03-45ec-9935-7c845b85fc21 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:58.052298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-abfd4e9f-ec03-45ec-9935-7c845b85fc21 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:58.061470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abfd4e9f-ec03-45ec-9935-7c845b85fc21 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:58.062087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abfd4e9f-ec03-45ec-9935-7c845b85fc21 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:58.063104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abfd4e9f-ec03-45ec-9935-7c845b85fc21 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:58.063773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abfd4e9f-ec03-45ec-9935-7c845b85fc21 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:58.243847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-abfd4e9f-ec03-45ec-9935-7c845b85fc21 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:58.254551 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-abfd4e9f-ec03-45ec-9935-7c845b85fc21 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1342 microversion: 2.1 time: 0.208390 Aug 02 07:31:58.255390 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3178/6424] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:58 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:31:59.277908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b436fa29-c7ee-45f7-81f7-ee285e656ca0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:31:59.279171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b436fa29-c7ee-45f7-81f7-ee285e656ca0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:31:59.282463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:31:59.288448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b436fa29-c7ee-45f7-81f7-ee285e656ca0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:59.288979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b436fa29-c7ee-45f7-81f7-ee285e656ca0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:59.289882 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b436fa29-c7ee-45f7-81f7-ee285e656ca0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:31:59.290356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b436fa29-c7ee-45f7-81f7-ee285e656ca0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:31:59.307732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=81 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:31:59.427135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b436fa29-c7ee-45f7-81f7-ee285e656ca0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:31:59.435118 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b436fa29-c7ee-45f7-81f7-ee285e656ca0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1342 microversion: 2.1 time: 0.161210 Aug 02 07:31:59.448133 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3247/6425] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:31:59 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:00.459062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-519e0ce1-5550-4614-8b71-6c535d74593d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:00.459907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-519e0ce1-5550-4614-8b71-6c535d74593d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:00.463820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=35 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:32:00.472371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-519e0ce1-5550-4614-8b71-6c535d74593d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:00.472862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-519e0ce1-5550-4614-8b71-6c535d74593d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:00.473651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-519e0ce1-5550-4614-8b71-6c535d74593d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:00.474133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-519e0ce1-5550-4614-8b71-6c535d74593d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:00.476984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:32:00.619711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-519e0ce1-5550-4614-8b71-6c535d74593d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:00.628071 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-519e0ce1-5550-4614-8b71-6c535d74593d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1342 microversion: 2.1 time: 0.174860 Aug 02 07:32:00.628664 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3179/6426] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:00 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1342 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:01.649290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c1182e1e-e6f2-4eff-85a1-504ecb174767 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:01.649926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c1182e1e-e6f2-4eff-85a1-504ecb174767 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:01.652773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:32:01.653426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:32:01.659397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1182e1e-e6f2-4eff-85a1-504ecb174767 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:01.660071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1182e1e-e6f2-4eff-85a1-504ecb174767 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:01.660973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1182e1e-e6f2-4eff-85a1-504ecb174767 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:01.661481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1182e1e-e6f2-4eff-85a1-504ecb174767 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:01.799510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c1182e1e-e6f2-4eff-85a1-504ecb174767 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:01.807626 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c1182e1e-e6f2-4eff-85a1-504ecb174767 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1342 microversion: 2.1 time: 0.162706 Aug 02 07:32:01.808251 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3248/6427] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:01 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:02.828673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3389f13c-60fc-4d26-9167-c6295a6c328d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:02.829272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3389f13c-60fc-4d26-9167-c6295a6c328d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:02.832320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:32:02.838383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3389f13c-60fc-4d26-9167-c6295a6c328d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:02.839062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3389f13c-60fc-4d26-9167-c6295a6c328d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:02.840032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3389f13c-60fc-4d26-9167-c6295a6c328d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:02.840630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3389f13c-60fc-4d26-9167-c6295a6c328d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:02.992121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3389f13c-60fc-4d26-9167-c6295a6c328d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:03.000843 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3389f13c-60fc-4d26-9167-c6295a6c328d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1342 microversion: 2.1 time: 0.175949 Aug 02 07:32:03.001558 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3180/6428] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:02 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1342 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:04.022224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-27765e71-f62a-4fa7-9285-fc3a29600c9e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:04.022853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-27765e71-f62a-4fa7-9285-fc3a29600c9e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:04.030406 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27765e71-f62a-4fa7-9285-fc3a29600c9e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:04.031077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27765e71-f62a-4fa7-9285-fc3a29600c9e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:04.031879 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27765e71-f62a-4fa7-9285-fc3a29600c9e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:04.032300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27765e71-f62a-4fa7-9285-fc3a29600c9e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:04.172973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-27765e71-f62a-4fa7-9285-fc3a29600c9e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:04.180687 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-27765e71-f62a-4fa7-9285-fc3a29600c9e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1342 microversion: 2.1 time: 0.162617 Aug 02 07:32:04.181305 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3249/6429] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:04 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:05.202307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-82da9e7c-ad84-4b6a-a729-2e3cb9b5d19c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:05.202882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-82da9e7c-ad84-4b6a-a729-2e3cb9b5d19c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:05.210412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82da9e7c-ad84-4b6a-a729-2e3cb9b5d19c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:05.210873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82da9e7c-ad84-4b6a-a729-2e3cb9b5d19c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:05.211711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82da9e7c-ad84-4b6a-a729-2e3cb9b5d19c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:05.212098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82da9e7c-ad84-4b6a-a729-2e3cb9b5d19c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:05.353113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-82da9e7c-ad84-4b6a-a729-2e3cb9b5d19c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:05.362376 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-82da9e7c-ad84-4b6a-a729-2e3cb9b5d19c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1342 microversion: 2.1 time: 0.163962 Aug 02 07:32:05.363287 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3181/6430] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:05 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:06.384300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-abd25a0b-8305-4dcb-b747-a2d5fba65b94 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:06.384934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-abd25a0b-8305-4dcb-b747-a2d5fba65b94 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:06.392357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abd25a0b-8305-4dcb-b747-a2d5fba65b94 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:06.392790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abd25a0b-8305-4dcb-b747-a2d5fba65b94 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:06.393559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abd25a0b-8305-4dcb-b747-a2d5fba65b94 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:06.394004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abd25a0b-8305-4dcb-b747-a2d5fba65b94 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:06.530038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-abd25a0b-8305-4dcb-b747-a2d5fba65b94 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:06.538258 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-abd25a0b-8305-4dcb-b747-a2d5fba65b94 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1388 microversion: 2.1 time: 0.158011 Aug 02 07:32:06.538929 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3250/6431] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:06 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1388 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:07.560784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-53029fd8-377f-449b-b782-978c124b1aa6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:07.561467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-53029fd8-377f-449b-b782-978c124b1aa6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:07.569741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53029fd8-377f-449b-b782-978c124b1aa6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:07.570290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53029fd8-377f-449b-b782-978c124b1aa6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:07.571150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53029fd8-377f-449b-b782-978c124b1aa6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:07.571641 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53029fd8-377f-449b-b782-978c124b1aa6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:07.712993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-53029fd8-377f-449b-b782-978c124b1aa6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:07.721293 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-53029fd8-377f-449b-b782-978c124b1aa6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1376 microversion: 2.1 time: 0.165021 Aug 02 07:32:07.721878 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3182/6432] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:07 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1376 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:08.743473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6bc8572b-3a58-43ca-8690-b1fa02fdad8c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:08.744091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6bc8572b-3a58-43ca-8690-b1fa02fdad8c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:08.751708 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bc8572b-3a58-43ca-8690-b1fa02fdad8c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:08.752161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bc8572b-3a58-43ca-8690-b1fa02fdad8c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:08.752933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bc8572b-3a58-43ca-8690-b1fa02fdad8c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:08.753420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6bc8572b-3a58-43ca-8690-b1fa02fdad8c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:09.204084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6bc8572b-3a58-43ca-8690-b1fa02fdad8c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:09.212294 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6bc8572b-3a58-43ca-8690-b1fa02fdad8c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1376 microversion: 2.1 time: 0.473231 Aug 02 07:32:09.212903 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3251/6433] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:08 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1376 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:10.234730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-00d4609d-8d55-48e3-9c08-71e959e929fb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:10.235371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-00d4609d-8d55-48e3-9c08-71e959e929fb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:10.242910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00d4609d-8d55-48e3-9c08-71e959e929fb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:10.243373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00d4609d-8d55-48e3-9c08-71e959e929fb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:10.244424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00d4609d-8d55-48e3-9c08-71e959e929fb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:10.244592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00d4609d-8d55-48e3-9c08-71e959e929fb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:10.380335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-00d4609d-8d55-48e3-9c08-71e959e929fb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:10.389389 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-00d4609d-8d55-48e3-9c08-71e959e929fb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1376 microversion: 2.1 time: 0.158644 Aug 02 07:32:10.390022 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3183/6434] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:10 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:11.411827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e5739cb6-662e-4d15-bc02-8328fd72ee6d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:11.412512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e5739cb6-662e-4d15-bc02-8328fd72ee6d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:11.421191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5739cb6-662e-4d15-bc02-8328fd72ee6d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:11.421798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5739cb6-662e-4d15-bc02-8328fd72ee6d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:11.422598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5739cb6-662e-4d15-bc02-8328fd72ee6d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:11.423033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e5739cb6-662e-4d15-bc02-8328fd72ee6d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:11.577361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e5739cb6-662e-4d15-bc02-8328fd72ee6d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:11.587021 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e5739cb6-662e-4d15-bc02-8328fd72ee6d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1376 microversion: 2.1 time: 0.179190 Aug 02 07:32:11.588275 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3252/6435] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:11 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1376 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:12.608527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e2ee5371-7dda-4442-a126-78ee4a3b1efe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:12.609115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e2ee5371-7dda-4442-a126-78ee4a3b1efe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:12.616637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e2ee5371-7dda-4442-a126-78ee4a3b1efe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:12.617119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e2ee5371-7dda-4442-a126-78ee4a3b1efe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:12.617868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e2ee5371-7dda-4442-a126-78ee4a3b1efe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:12.618350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e2ee5371-7dda-4442-a126-78ee4a3b1efe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:12.757928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e2ee5371-7dda-4442-a126-78ee4a3b1efe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:12.766339 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e2ee5371-7dda-4442-a126-78ee4a3b1efe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1376 microversion: 2.1 time: 0.161815 Aug 02 07:32:12.766901 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3184/6436] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:12 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1376 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:13.790173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-90259210-1dde-4227-8a00-63307b0db3ec tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:13.790738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-90259210-1dde-4227-8a00-63307b0db3ec tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:13.798610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90259210-1dde-4227-8a00-63307b0db3ec tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:13.799064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90259210-1dde-4227-8a00-63307b0db3ec tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:13.799952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90259210-1dde-4227-8a00-63307b0db3ec tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:13.800461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90259210-1dde-4227-8a00-63307b0db3ec tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:13.938563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-90259210-1dde-4227-8a00-63307b0db3ec tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:13.947304 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-90259210-1dde-4227-8a00-63307b0db3ec tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1376 microversion: 2.1 time: 0.161510 Aug 02 07:32:13.947958 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3253/6437] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:13 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1376 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:14.979117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-de90e546-1838-42c8-889b-635f1c7bd021 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:14.980974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-de90e546-1838-42c8-889b-635f1c7bd021 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:14.991753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de90e546-1838-42c8-889b-635f1c7bd021 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:14.992211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de90e546-1838-42c8-889b-635f1c7bd021 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:14.993019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de90e546-1838-42c8-889b-635f1c7bd021 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:14.993484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de90e546-1838-42c8-889b-635f1c7bd021 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:15.154034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-de90e546-1838-42c8-889b-635f1c7bd021 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:15.163613 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-de90e546-1838-42c8-889b-635f1c7bd021 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1376 microversion: 2.1 time: 0.191815 Aug 02 07:32:15.164191 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3185/6438] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:14 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1376 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:16.057002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-0c80f2a5-45d8-45aa-834c-995b757a2dda req-f8b16ec2-727c-40f2-bcca-2c53f068a818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e9f2b7-bb0f-43ac-875c-aab99c1b68dc", "name": "network-vif-plugged", "status": "completed", "tag": "38fece49-aa9f-4ff4-b9c9-a81906842629"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:32:16.069217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0c80f2a5-45d8-45aa-834c-995b757a2dda req-f8b16ec2-727c-40f2-bcca-2c53f068a818 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:16.070111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-0c80f2a5-45d8-45aa-834c-995b757a2dda req-f8b16ec2-727c-40f2-bcca-2c53f068a818 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:16.082510 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-0c80f2a5-45d8-45aa-834c-995b757a2dda req-f8b16ec2-727c-40f2-bcca-2c53f068a818 service nova] Creating event network-vif-plugged:38fece49-aa9f-4ff4-b9c9-a81906842629 for instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc on n-h2-851337-3 Aug 02 07:32:16.089794 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-0c80f2a5-45d8-45aa-834c-995b757a2dda req-f8b16ec2-727c-40f2-bcca-2c53f068a818 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036621 Aug 02 07:32:16.090012 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3254/6439] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:32:16.186951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aacdac33-7c23-4b87-b3fa-612af1c57af0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:16.187616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aacdac33-7c23-4b87-b3fa-612af1c57af0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:16.196617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aacdac33-7c23-4b87-b3fa-612af1c57af0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:16.197198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aacdac33-7c23-4b87-b3fa-612af1c57af0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:16.198180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aacdac33-7c23-4b87-b3fa-612af1c57af0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:16.198656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aacdac33-7c23-4b87-b3fa-612af1c57af0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:16.359382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aacdac33-7c23-4b87-b3fa-612af1c57af0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:16.368666 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aacdac33-7c23-4b87-b3fa-612af1c57af0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1376 microversion: 2.1 time: 0.185912 Aug 02 07:32:16.372166 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3186/6440] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:16 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1376 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:17.394611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e1837d6d-762c-47c2-a95a-e5bdd6cc3b5e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:17.395287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e1837d6d-762c-47c2-a95a-e5bdd6cc3b5e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:17.402087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1837d6d-762c-47c2-a95a-e5bdd6cc3b5e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:17.402532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1837d6d-762c-47c2-a95a-e5bdd6cc3b5e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:17.403348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1837d6d-762c-47c2-a95a-e5bdd6cc3b5e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:17.403732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1837d6d-762c-47c2-a95a-e5bdd6cc3b5e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:17.560381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e1837d6d-762c-47c2-a95a-e5bdd6cc3b5e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:17.568532 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e1837d6d-762c-47c2-a95a-e5bdd6cc3b5e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1563 microversion: 2.1 time: 0.179228 Aug 02 07:32:17.569111 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3255/6441] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:17 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:17.590523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-df4d61b0-07e2-4950-9189-c0158f39b02f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:17.591528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-df4d61b0-07e2-4950-9189-c0158f39b02f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:17.599238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-df4d61b0-07e2-4950-9189-c0158f39b02f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:17.599757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-df4d61b0-07e2-4950-9189-c0158f39b02f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:17.600615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-df4d61b0-07e2-4950-9189-c0158f39b02f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:17.601093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-df4d61b0-07e2-4950-9189-c0158f39b02f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:17.744019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-df4d61b0-07e2-4950-9189-c0158f39b02f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:17.755211 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-df4d61b0-07e2-4950-9189-c0158f39b02f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1563 microversion: 2.1 time: 0.168883 Aug 02 07:32:17.756014 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3187/6442] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:17 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:17.839274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-24e0ec81-1c1b-49ad-a701-ab902338e7dc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:17.839793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-24e0ec81-1c1b-49ad-a701-ab902338e7dc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:17.848839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24e0ec81-1c1b-49ad-a701-ab902338e7dc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:17.849627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24e0ec81-1c1b-49ad-a701-ab902338e7dc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:17.851055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24e0ec81-1c1b-49ad-a701-ab902338e7dc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:17.851823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24e0ec81-1c1b-49ad-a701-ab902338e7dc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:17.883516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-24e0ec81-1c1b-49ad-a701-ab902338e7dc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:32:17.965697 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-24e0ec81-1c1b-49ad-a701-ab902338e7dc tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "DELETE /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 204 len: 0 microversion: 2.1 time: 0.130209 Aug 02 07:32:17.966242 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3256/6443] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:32:17 2022] DELETE /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:32:17.975417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e4b67fb8-6214-4d0e-8586-ad90167c1640 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:17.976050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e4b67fb8-6214-4d0e-8586-ad90167c1640 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:17.982324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4b67fb8-6214-4d0e-8586-ad90167c1640 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:17.982774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4b67fb8-6214-4d0e-8586-ad90167c1640 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:17.983530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4b67fb8-6214-4d0e-8586-ad90167c1640 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:17.983969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4b67fb8-6214-4d0e-8586-ad90167c1640 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:18.139068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e4b67fb8-6214-4d0e-8586-ad90167c1640 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:18.147446 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e4b67fb8-6214-4d0e-8586-ad90167c1640 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1569 microversion: 2.1 time: 0.176041 Aug 02 07:32:18.148030 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3188/6444] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:17 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:19.171442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fbd95983-71c4-492d-945f-b528cdecbbd2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:19.172446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fbd95983-71c4-492d-945f-b528cdecbbd2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:19.181533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbd95983-71c4-492d-945f-b528cdecbbd2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:19.182185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbd95983-71c4-492d-945f-b528cdecbbd2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:19.183163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbd95983-71c4-492d-945f-b528cdecbbd2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:19.183740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fbd95983-71c4-492d-945f-b528cdecbbd2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:19.343511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fbd95983-71c4-492d-945f-b528cdecbbd2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:19.354881 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fbd95983-71c4-492d-945f-b528cdecbbd2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1569 microversion: 2.1 time: 0.188842 Aug 02 07:32:19.356055 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3257/6445] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:19 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:19.920553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b867d95d-7617-43c3-b295-000b833da357 req-42422ad3-d03f-40a7-8891-88f2c78bc6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e9f2b7-bb0f-43ac-875c-aab99c1b68dc", "name": "network-vif-deleted", "tag": "38fece49-aa9f-4ff4-b9c9-a81906842629"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:32:19.931718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b867d95d-7617-43c3-b295-000b833da357 req-42422ad3-d03f-40a7-8891-88f2c78bc6d8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:19.932170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b867d95d-7617-43c3-b295-000b833da357 req-42422ad3-d03f-40a7-8891-88f2c78bc6d8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:19.945004 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b867d95d-7617-43c3-b295-000b833da357 req-42422ad3-d03f-40a7-8891-88f2c78bc6d8 service nova] Creating event network-vif-deleted:38fece49-aa9f-4ff4-b9c9-a81906842629 for instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc on n-h2-851337-3 Aug 02 07:32:19.951061 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b867d95d-7617-43c3-b295-000b833da357 req-42422ad3-d03f-40a7-8891-88f2c78bc6d8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034252 Aug 02 07:32:19.952034 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3189/6446] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:32:20.379128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-36368ee9-5020-4f70-afcc-72a535df9703 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:20.379866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-36368ee9-5020-4f70-afcc-72a535df9703 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:20.387624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36368ee9-5020-4f70-afcc-72a535df9703 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:20.388276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36368ee9-5020-4f70-afcc-72a535df9703 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:20.389098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36368ee9-5020-4f70-afcc-72a535df9703 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:20.389657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-36368ee9-5020-4f70-afcc-72a535df9703 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:20.455265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-36368ee9-5020-4f70-afcc-72a535df9703 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:20.463087 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-36368ee9-5020-4f70-afcc-72a535df9703 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1361 microversion: 2.1 time: 0.088108 Aug 02 07:32:20.463665 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3258/6447] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:20 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1361 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:21.486340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e7852feb-610b-4ec0-b2bb-ef5a1c6817b6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:21.487058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e7852feb-610b-4ec0-b2bb-ef5a1c6817b6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:21.493850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7852feb-610b-4ec0-b2bb-ef5a1c6817b6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:21.494330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7852feb-610b-4ec0-b2bb-ef5a1c6817b6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:21.495114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7852feb-610b-4ec0-b2bb-ef5a1c6817b6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:21.495555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e7852feb-610b-4ec0-b2bb-ef5a1c6817b6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:21.563638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e7852feb-610b-4ec0-b2bb-ef5a1c6817b6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:21.571865 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e7852feb-610b-4ec0-b2bb-ef5a1c6817b6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1361 microversion: 2.1 time: 0.090871 Aug 02 07:32:21.572449 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3190/6448] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:21 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:22.594993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-54ea8139-0153-4b02-ba10-f61592ad6344 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:22.595639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-54ea8139-0153-4b02-ba10-f61592ad6344 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:22.603145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54ea8139-0153-4b02-ba10-f61592ad6344 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:22.603595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54ea8139-0153-4b02-ba10-f61592ad6344 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:22.604338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54ea8139-0153-4b02-ba10-f61592ad6344 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:22.604802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-54ea8139-0153-4b02-ba10-f61592ad6344 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:22.670795 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-54ea8139-0153-4b02-ba10-f61592ad6344 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:22.678800 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-54ea8139-0153-4b02-ba10-f61592ad6344 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1361 microversion: 2.1 time: 0.087886 Aug 02 07:32:22.679391 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3259/6449] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:22 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1361 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:23.699345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ed0e782-4c08-4e7e-9d9e-0e713697a4b2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:23.699954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ed0e782-4c08-4e7e-9d9e-0e713697a4b2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:23.707609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ed0e782-4c08-4e7e-9d9e-0e713697a4b2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:23.708074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ed0e782-4c08-4e7e-9d9e-0e713697a4b2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:23.708845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ed0e782-4c08-4e7e-9d9e-0e713697a4b2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:23.709288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ed0e782-4c08-4e7e-9d9e-0e713697a4b2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:23.773821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ed0e782-4c08-4e7e-9d9e-0e713697a4b2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:23.781927 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ed0e782-4c08-4e7e-9d9e-0e713697a4b2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 200 len: 1361 microversion: 2.1 time: 0.086610 Aug 02 07:32:23.782539 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3191/6450] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:23 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 1361 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:24.802874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-14f2f1ac-7534-4e15-ba44-78b117f6ba01 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:24.803582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-14f2f1ac-7534-4e15-ba44-78b117f6ba01 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:24.811576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14f2f1ac-7534-4e15-ba44-78b117f6ba01 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:24.812043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14f2f1ac-7534-4e15-ba44-78b117f6ba01 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:24.812820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14f2f1ac-7534-4e15-ba44-78b117f6ba01 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:24.813261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14f2f1ac-7534-4e15-ba44-78b117f6ba01 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:24.827697 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-14f2f1ac-7534-4e15-ba44-78b117f6ba01 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-14f2f1ac-7534-4e15-ba44-78b117f6ba01 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc HTTP/1.1 Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '77e9f2b7-bb0f-43ac-875c-aab99c1b68dc'} Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:32:24.829515 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:24.834821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:24.834821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:32:24.834821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:32:24.834821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:32:24.834821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:32:24.834821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:24.834821 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:24.834821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-14f2f1ac-7534-4e15-ba44-78b117f6ba01 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:32:24.834821 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-14f2f1ac-7534-4e15-ba44-78b117f6ba01 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 404 len: 111 microversion: 2.1 time: 0.032354 Aug 02 07:32:24.834821 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3260/6451] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:24 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:32:30.193500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-30bf3f29-c617-4183-96d3-9b67ab2eef29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:30.194075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-30bf3f29-c617-4183-96d3-9b67ab2eef29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:30.201611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30bf3f29-c617-4183-96d3-9b67ab2eef29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:30.202107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30bf3f29-c617-4183-96d3-9b67ab2eef29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:30.202883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30bf3f29-c617-4183-96d3-9b67ab2eef29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:30.203326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30bf3f29-c617-4183-96d3-9b67ab2eef29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:30.233709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-30bf3f29-c617-4183-96d3-9b67ab2eef29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:32:30.314406 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-30bf3f29-c617-4183-96d3-9b67ab2eef29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "DELETE /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 204 len: 0 microversion: 2.1 time: 0.124329 Aug 02 07:32:30.314772 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3192/6452] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:32:30 2022] DELETE /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:32:30.322914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e77a4681-f394-44a9-a923-cedee83a99ef tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:30.323518 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e77a4681-f394-44a9-a923-cedee83a99ef tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:30.326606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:32:30.332023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e77a4681-f394-44a9-a923-cedee83a99ef tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:30.332480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e77a4681-f394-44a9-a923-cedee83a99ef tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:30.333264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e77a4681-f394-44a9-a923-cedee83a99ef tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:30.333766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e77a4681-f394-44a9-a923-cedee83a99ef tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:30.339626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:32:30.469839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e77a4681-f394-44a9-a923-cedee83a99ef tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:30.478231 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e77a4681-f394-44a9-a923-cedee83a99ef tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1410 microversion: 2.1 time: 0.159240 Aug 02 07:32:30.478826 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3261/6453] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:30 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1410 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:31.505771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bcad15fe-c1d6-43fe-a1eb-f86ccb30cf89 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:31.506991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bcad15fe-c1d6-43fe-a1eb-f86ccb30cf89 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:31.511434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:32:31.521767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcad15fe-c1d6-43fe-a1eb-f86ccb30cf89 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:31.522594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcad15fe-c1d6-43fe-a1eb-f86ccb30cf89 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:31.523883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcad15fe-c1d6-43fe-a1eb-f86ccb30cf89 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:31.524634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcad15fe-c1d6-43fe-a1eb-f86ccb30cf89 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:31.530444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:32:31.665288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bcad15fe-c1d6-43fe-a1eb-f86ccb30cf89 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:31.674044 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bcad15fe-c1d6-43fe-a1eb-f86ccb30cf89 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1410 microversion: 2.1 time: 0.175847 Aug 02 07:32:31.674631 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3193/6454] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:31 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1410 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:32.695500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e4f81330-7e21-42ea-817c-4cc16f3a52d6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:32.696132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e4f81330-7e21-42ea-817c-4cc16f3a52d6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:32.703987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e4f81330-7e21-42ea-817c-4cc16f3a52d6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:32.704450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e4f81330-7e21-42ea-817c-4cc16f3a52d6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:32.705233 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e4f81330-7e21-42ea-817c-4cc16f3a52d6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:32.705671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e4f81330-7e21-42ea-817c-4cc16f3a52d6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:32.849972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e4f81330-7e21-42ea-817c-4cc16f3a52d6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:32.858256 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e4f81330-7e21-42ea-817c-4cc16f3a52d6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1410 microversion: 2.1 time: 0.166747 Aug 02 07:32:32.858881 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3262/6455] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:32 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1410 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:33.041579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ba857d02-9c74-4b47-bf4d-dde8e45f50f7 req-1be8d815-f86e-4ede-b67b-ca167a5b6a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c2eb34-58a3-4a4a-9aee-aa63a0e103d8", "name": "network-vif-deleted", "tag": "5cccded2-52c0-40c2-b63b-d5e62b24b102"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:32:33.051595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ba857d02-9c74-4b47-bf4d-dde8e45f50f7 req-1be8d815-f86e-4ede-b67b-ca167a5b6a78 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:33.052054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ba857d02-9c74-4b47-bf4d-dde8e45f50f7 req-1be8d815-f86e-4ede-b67b-ca167a5b6a78 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:33.063646 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ba857d02-9c74-4b47-bf4d-dde8e45f50f7 req-1be8d815-f86e-4ede-b67b-ca167a5b6a78 service nova] Creating event network-vif-deleted:5cccded2-52c0-40c2-b63b-d5e62b24b102 for instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 on n-h1-851337-3 Aug 02 07:32:33.068678 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ba857d02-9c74-4b47-bf4d-dde8e45f50f7 req-1be8d815-f86e-4ede-b67b-ca167a5b6a78 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104388 Aug 02 07:32:33.069553 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3194/6456] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:32:33.881052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e4c5483-a44d-42e2-a72c-1a984a90cb29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:33.881695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7e4c5483-a44d-42e2-a72c-1a984a90cb29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:33.889511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e4c5483-a44d-42e2-a72c-1a984a90cb29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:33.889999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e4c5483-a44d-42e2-a72c-1a984a90cb29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:33.890777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e4c5483-a44d-42e2-a72c-1a984a90cb29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:33.891219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e4c5483-a44d-42e2-a72c-1a984a90cb29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:33.959730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7e4c5483-a44d-42e2-a72c-1a984a90cb29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:33.967970 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7e4c5483-a44d-42e2-a72c-1a984a90cb29 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1202 microversion: 2.1 time: 0.090961 Aug 02 07:32:33.968554 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3263/6457] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:33 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:34.990724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a3e1ab3b-c404-4716-b974-452d9ba09323 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:34.991422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a3e1ab3b-c404-4716-b974-452d9ba09323 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:34.998720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3e1ab3b-c404-4716-b974-452d9ba09323 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:34.999175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3e1ab3b-c404-4716-b974-452d9ba09323 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:35.000306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3e1ab3b-c404-4716-b974-452d9ba09323 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:35.000770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a3e1ab3b-c404-4716-b974-452d9ba09323 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:35.069453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a3e1ab3b-c404-4716-b974-452d9ba09323 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:35.078018 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a3e1ab3b-c404-4716-b974-452d9ba09323 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1202 microversion: 2.1 time: 0.092514 Aug 02 07:32:35.078658 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3195/6458] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:34 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:36.101651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-88e59ac2-c9bf-47d4-b59b-308cb85daca5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:36.102507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-88e59ac2-c9bf-47d4-b59b-308cb85daca5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:36.113113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88e59ac2-c9bf-47d4-b59b-308cb85daca5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:36.113715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88e59ac2-c9bf-47d4-b59b-308cb85daca5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:36.115000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88e59ac2-c9bf-47d4-b59b-308cb85daca5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:36.115715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88e59ac2-c9bf-47d4-b59b-308cb85daca5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:36.185354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-88e59ac2-c9bf-47d4-b59b-308cb85daca5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:36.196020 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-88e59ac2-c9bf-47d4-b59b-308cb85daca5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1202 microversion: 2.1 time: 0.100232 Aug 02 07:32:36.196635 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3264/6459] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:36 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1202 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:37.216780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-730753a6-ef9a-456a-8f66-029b77e8482b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:37.217561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-730753a6-ef9a-456a-8f66-029b77e8482b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:37.224608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-730753a6-ef9a-456a-8f66-029b77e8482b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:37.225063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-730753a6-ef9a-456a-8f66-029b77e8482b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:37.225840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-730753a6-ef9a-456a-8f66-029b77e8482b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:37.226300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-730753a6-ef9a-456a-8f66-029b77e8482b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:37.258616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-730753a6-ef9a-456a-8f66-029b77e8482b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:37.258975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-730753a6-ef9a-456a-8f66-029b77e8482b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:37.259426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-730753a6-ef9a-456a-8f66-029b77e8482b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lazy-loading 'fault' on Instance uuid 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:32:37.301607 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-730753a6-ef9a-456a-8f66-029b77e8482b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:37.309884 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-730753a6-ef9a-456a-8f66-029b77e8482b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 200 len: 1207 microversion: 2.1 time: 0.097050 Aug 02 07:32:37.310486 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3196/6460] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:37 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 1207 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:38.331825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c25176a4-03da-411d-a8c5-175f3b487313 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:38.332422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c25176a4-03da-411d-a8c5-175f3b487313 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:38.339190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c25176a4-03da-411d-a8c5-175f3b487313 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:38.339636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c25176a4-03da-411d-a8c5-175f3b487313 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:38.340396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c25176a4-03da-411d-a8c5-175f3b487313 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:38.340825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c25176a4-03da-411d-a8c5-175f3b487313 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:38.355153 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-c25176a4-03da-411d-a8c5-175f3b487313 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c25176a4-03da-411d-a8c5-175f3b487313 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 HTTP/1.1 Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '28c2eb34-58a3-4a4a-9aee-aa63a0e103d8'} Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:32:38.356772 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:38.361747 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:38.361747 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:32:38.361747 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:32:38.361747 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:32:38.361747 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:32:38.361747 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:38.361747 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:38.361747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c25176a4-03da-411d-a8c5-175f3b487313 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:32:38.361747 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c25176a4-03da-411d-a8c5-175f3b487313 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 404 len: 111 microversion: 2.1 time: 0.030612 Aug 02 07:32:38.361747 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3265/6461] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:38 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:32:40.502180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a7945586-6320-40eb-95a8-9066df9f416d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:40.502824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a7945586-6320-40eb-95a8-9066df9f416d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:40.510566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7945586-6320-40eb-95a8-9066df9f416d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:40.511034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7945586-6320-40eb-95a8-9066df9f416d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:40.511845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7945586-6320-40eb-95a8-9066df9f416d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:40.512299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7945586-6320-40eb-95a8-9066df9f416d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:40.529731 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-a7945586-6320-40eb-95a8-9066df9f416d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a7945586-6320-40eb-95a8-9066df9f416d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc HTTP/1.1 Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '77e9f2b7-bb0f-43ac-875c-aab99c1b68dc'} Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:32:40.531504 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:32:40.536094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:40.536094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.536094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:32:40.536094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.536094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:40.536094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:32:40.536094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:32:40.536094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:32:40.536094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:32:40.536094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:40.536094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.536094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a7945586-6320-40eb-95a8-9066df9f416d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:32:40.536094 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a7945586-6320-40eb-95a8-9066df9f416d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "DELETE /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 404 len: 111 microversion: 2.1 time: 0.035354 Aug 02 07:32:40.536094 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3197/6462] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:32:40 2022] DELETE /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:32:40.542202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-777d282f-49fb-4629-9166-a63cbcc72d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:40.542813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-777d282f-49fb-4629-9166-a63cbcc72d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:40.549752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-777d282f-49fb-4629-9166-a63cbcc72d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:40.550165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-777d282f-49fb-4629-9166-a63cbcc72d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:40.550945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-777d282f-49fb-4629-9166-a63cbcc72d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:40.551378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-777d282f-49fb-4629-9166-a63cbcc72d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:40.565525 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-777d282f-49fb-4629-9166-a63cbcc72d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-777d282f-49fb-4629-9166-a63cbcc72d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc HTTP/1.1 Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '77e9f2b7-bb0f-43ac-875c-aab99c1b68dc'} Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:32:40.567113 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.571703 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:40.571703 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:32:40.571703 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:32:40.571703 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:32:40.571703 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:32:40.571703 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. Aug 02 07:32:40.571703 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.571703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-777d282f-49fb-4629-9166-a63cbcc72d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance 77e9f2b7-bb0f-43ac-875c-aab99c1b68dc could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:32:40.571703 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-777d282f-49fb-4629-9166-a63cbcc72d66 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc" status: 404 len: 111 microversion: 2.1 time: 0.030310 Aug 02 07:32:40.571703 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3266/6463] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:40 2022] GET /compute/v2.1/servers/77e9f2b7-bb0f-43ac-875c-aab99c1b68dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:32:40.964981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a2b87bac-4b76-41fd-843e-46f73990a9f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:40.965530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a2b87bac-4b76-41fd-843e-46f73990a9f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:40.972300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2b87bac-4b76-41fd-843e-46f73990a9f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:40.972839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2b87bac-4b76-41fd-843e-46f73990a9f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:40.973756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2b87bac-4b76-41fd-843e-46f73990a9f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:40.974317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a2b87bac-4b76-41fd-843e-46f73990a9f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:40.989058 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-a2b87bac-4b76-41fd-843e-46f73990a9f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a2b87bac-4b76-41fd-843e-46f73990a9f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 HTTP/1.1 Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '28c2eb34-58a3-4a4a-9aee-aa63a0e103d8'} Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:32:40.990797 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:32:40.996038 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:40.996038 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.996038 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:32:40.996038 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.996038 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:40.996038 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:32:40.996038 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:32:40.996038 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:32:40.996038 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:32:40.996038 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:40.996038 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:32:40.996038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a2b87bac-4b76-41fd-843e-46f73990a9f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:32:40.996038 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a2b87bac-4b76-41fd-843e-46f73990a9f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "DELETE /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 404 len: 111 microversion: 2.1 time: 0.033784 Aug 02 07:32:40.996038 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3198/6464] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:32:40 2022] DELETE /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:32:41.004216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-10b090c2-65b1-4927-80e4-6218b490ee00 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:41.004842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-10b090c2-65b1-4927-80e4-6218b490ee00 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:41.013636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10b090c2-65b1-4927-80e4-6218b490ee00 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:41.014198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10b090c2-65b1-4927-80e4-6218b490ee00 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:41.015289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10b090c2-65b1-4927-80e4-6218b490ee00 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:41.015956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10b090c2-65b1-4927-80e4-6218b490ee00 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:41.030938 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-10b090c2-65b1-4927-80e4-6218b490ee00 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-10b090c2-65b1-4927-80e4-6218b490ee00 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 HTTP/1.1 Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '28c2eb34-58a3-4a4a-9aee-aa63a0e103d8'} Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:32:41.032502 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:41.037853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:32:41.037853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:32:41.037853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:32:41.037853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:32:41.037853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:32:41.037853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. Aug 02 07:32:41.037853 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:32:41.037853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-10b090c2-65b1-4927-80e4-6218b490ee00 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance 28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:32:41.037853 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-10b090c2-65b1-4927-80e4-6218b490ee00 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8" status: 404 len: 111 microversion: 2.1 time: 0.033877 Aug 02 07:32:41.037853 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3267/6465] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:40 2022] GET /compute/v2.1/servers/28c2eb34-58a3-4a4a-9aee-aa63a0e103d8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:32:41.113357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d7c410e3-3d9e-43a6-a585-8bd55578491b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Action: 'create', calling method: .version_select at 0x7f927a9b3550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-582216103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNafbBbWGOCDZ3NeuniwU990jNvc/idEurMnAattpxoMjElLxo+FLSqcEoEdYsgO5LRHD45HY0YWbO2UoPKKrFjJjSwaSZW/l2zK5hajhVq+LttXDoQz54HF/DrIoALGVg=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:32:41.131663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-d7c410e3-3d9e-43a6-a585-8bd55578491b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:32:41.137692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-d7c410e3-3d9e-43a6-a585-8bd55578491b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for user 9f2f38363b9644f7956995d598509787 and project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:32:41.167766 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d7c410e3-3d9e-43a6-a585-8bd55578491b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.058691 Aug 02 07:32:41.168411 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3199/6466] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:32:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:32:46.162386 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:32:46.163090 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 07:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:32:57.492050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-585735600", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-582216103", "security_groups": [{"name": "tempest-secgroup-smoke-302398715"}], "block_device_mapping_v2": [{"uuid": "31bc83c3-2c4f-49c9-a65d-c20e5ea55d91", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5a68237c-f872-4b09-8d4c-16c9a40f01a7"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:32:57.503916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=13 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:32:57.504567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=29 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:32:57.620295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] validate_networks() for [('5a68237c-f872-4b09-8d4c-16c9a40f01a7', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:32:58.006826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:32:58.007261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:32:58.007740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:32:58.008154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:32:58.008571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:32:58.018427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:58.018905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:58.019678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:58.020148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:58.038330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:32:58.043769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for user 9f2f38363b9644f7956995d598509787 and project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:32:58.110203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:32:58.112345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31bc83c3-2c4f-49c9-a65d-c20e5ea55d91',volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:32:58.246475 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dca18201-5b6c-4109-abb3-c789ba43bc6a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.758339 Aug 02 07:32:58.253187 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3268/6467] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:32:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:32:58.256848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=25 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:32:58.257627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:32:58.258517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:32:58.264226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b6552690-9c3c-4589-8325-7e7bc85d4743 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:58.264854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b6552690-9c3c-4589-8325-7e7bc85d4743 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:58.322133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b6552690-9c3c-4589-8325-7e7bc85d4743 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:58.329115 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b6552690-9c3c-4589-8325-7e7bc85d4743 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1093 microversion: 2.1 time: 0.074423 Aug 02 07:32:58.329670 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3200/6468] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:58 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:32:59.350537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-78e6fb36-bcb3-462c-8925-e0904506ee18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:32:59.351516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-78e6fb36-bcb3-462c-8925-e0904506ee18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:32:59.360547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e6fb36-bcb3-462c-8925-e0904506ee18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:59.361000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e6fb36-bcb3-462c-8925-e0904506ee18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:59.361963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e6fb36-bcb3-462c-8925-e0904506ee18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:32:59.362401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-78e6fb36-bcb3-462c-8925-e0904506ee18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:32:59.441064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-78e6fb36-bcb3-462c-8925-e0904506ee18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:32:59.449989 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-78e6fb36-bcb3-462c-8925-e0904506ee18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1209 microversion: 2.1 time: 0.103686 Aug 02 07:32:59.450579 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3269/6469] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:32:59 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:00.472653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1fb696a3-0cad-4dbf-a15d-6b332ab622a8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:00.473513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1fb696a3-0cad-4dbf-a15d-6b332ab622a8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:00.481843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1fb696a3-0cad-4dbf-a15d-6b332ab622a8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:00.482351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1fb696a3-0cad-4dbf-a15d-6b332ab622a8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:00.483673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1fb696a3-0cad-4dbf-a15d-6b332ab622a8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:00.484262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1fb696a3-0cad-4dbf-a15d-6b332ab622a8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:00.668953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-f36da91c-6a7a-4340-9a1f-23992ce36624 req-ed355dc4-7f12-4671-bf67-eb85025b351f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b5d84d-9e0f-4686-98ce-b4d10e8b551c", "tag": "94896100-b679-46dd-87eb-bb9e3fd16058"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:33:00.681097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f36da91c-6a7a-4340-9a1f-23992ce36624 req-ed355dc4-7f12-4671-bf67-eb85025b351f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:00.681523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f36da91c-6a7a-4340-9a1f-23992ce36624 req-ed355dc4-7f12-4671-bf67-eb85025b351f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:00.693979 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f36da91c-6a7a-4340-9a1f-23992ce36624 req-ed355dc4-7f12-4671-bf67-eb85025b351f service nova] Creating event network-changed:94896100-b679-46dd-87eb-bb9e3fd16058 for instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c on n-h2-851337-3 Aug 02 07:33:00.699774 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-f36da91c-6a7a-4340-9a1f-23992ce36624 req-ed355dc4-7f12-4671-bf67-eb85025b351f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035174 Aug 02 07:33:00.701019 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3270/6470] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:33:00.756505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1fb696a3-0cad-4dbf-a15d-6b332ab622a8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:00.773135 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1fb696a3-0cad-4dbf-a15d-6b332ab622a8 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1276 microversion: 2.1 time: 0.305507 Aug 02 07:33:00.773811 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3201/6471] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:00 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1276 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:01.795283 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-23c1b827-1694-4aec-8c53-e621e042c184 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:01.795993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-23c1b827-1694-4aec-8c53-e621e042c184 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:01.803406 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23c1b827-1694-4aec-8c53-e621e042c184 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:01.803864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23c1b827-1694-4aec-8c53-e621e042c184 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:01.804653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23c1b827-1694-4aec-8c53-e621e042c184 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:01.805093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-23c1b827-1694-4aec-8c53-e621e042c184 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:01.943821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-23c1b827-1694-4aec-8c53-e621e042c184 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:01.952254 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-23c1b827-1694-4aec-8c53-e621e042c184 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1276 microversion: 2.1 time: 0.162333 Aug 02 07:33:01.952915 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3271/6472] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:01 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:02.973331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e82f8e7b-08e6-4291-ba29-c40136794373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:02.974113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e82f8e7b-08e6-4291-ba29-c40136794373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:02.981747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e82f8e7b-08e6-4291-ba29-c40136794373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:02.982243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e82f8e7b-08e6-4291-ba29-c40136794373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:02.983026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e82f8e7b-08e6-4291-ba29-c40136794373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:02.983479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e82f8e7b-08e6-4291-ba29-c40136794373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:03.125195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e82f8e7b-08e6-4291-ba29-c40136794373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:03.133625 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e82f8e7b-08e6-4291-ba29-c40136794373 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1276 microversion: 2.1 time: 0.164293 Aug 02 07:33:03.134355 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3202/6473] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:02 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:04.154707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d100b687-aa04-4d0f-a5f8-3dbae7f0e525 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:04.155321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d100b687-aa04-4d0f-a5f8-3dbae7f0e525 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:04.162488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d100b687-aa04-4d0f-a5f8-3dbae7f0e525 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:04.162923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d100b687-aa04-4d0f-a5f8-3dbae7f0e525 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:04.163692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d100b687-aa04-4d0f-a5f8-3dbae7f0e525 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:04.164103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d100b687-aa04-4d0f-a5f8-3dbae7f0e525 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:04.303152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d100b687-aa04-4d0f-a5f8-3dbae7f0e525 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:04.311865 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d100b687-aa04-4d0f-a5f8-3dbae7f0e525 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1276 microversion: 2.1 time: 0.160426 Aug 02 07:33:04.312682 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3272/6474] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:04 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:05.333448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2051df20-5356-45e2-a534-2a2326378916 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:05.334090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2051df20-5356-45e2-a534-2a2326378916 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:05.340803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2051df20-5356-45e2-a534-2a2326378916 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:05.341262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2051df20-5356-45e2-a534-2a2326378916 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:05.342442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2051df20-5356-45e2-a534-2a2326378916 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:05.342898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2051df20-5356-45e2-a534-2a2326378916 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:05.504366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2051df20-5356-45e2-a534-2a2326378916 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:05.512735 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2051df20-5356-45e2-a534-2a2326378916 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1264 microversion: 2.1 time: 0.183683 Aug 02 07:33:05.513312 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3203/6475] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:05 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:06.538343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c2df94f4-139e-4cf8-b4ab-35e9ce3e5559 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:06.539334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c2df94f4-139e-4cf8-b4ab-35e9ce3e5559 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:06.551391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2df94f4-139e-4cf8-b4ab-35e9ce3e5559 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:06.552152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2df94f4-139e-4cf8-b4ab-35e9ce3e5559 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:06.553417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2df94f4-139e-4cf8-b4ab-35e9ce3e5559 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:06.554202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2df94f4-139e-4cf8-b4ab-35e9ce3e5559 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:06.700381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c2df94f4-139e-4cf8-b4ab-35e9ce3e5559 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:06.712320 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c2df94f4-139e-4cf8-b4ab-35e9ce3e5559 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1264 microversion: 2.1 time: 0.180738 Aug 02 07:33:06.712890 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3273/6476] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:06 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:07.737836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a385eba1-554f-4b46-8c04-9f985971bb9c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:07.738743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a385eba1-554f-4b46-8c04-9f985971bb9c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:07.751340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a385eba1-554f-4b46-8c04-9f985971bb9c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:07.752099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a385eba1-554f-4b46-8c04-9f985971bb9c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:07.753393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a385eba1-554f-4b46-8c04-9f985971bb9c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:07.754176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a385eba1-554f-4b46-8c04-9f985971bb9c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:07.894836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a385eba1-554f-4b46-8c04-9f985971bb9c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:07.907504 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a385eba1-554f-4b46-8c04-9f985971bb9c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1264 microversion: 2.1 time: 0.176147 Aug 02 07:33:07.908435 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3204/6477] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:07 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:08.929229 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bb791d0d-47b7-4a59-97c3-3374e8d99627 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:08.929832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bb791d0d-47b7-4a59-97c3-3374e8d99627 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:08.932198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:33:08.932870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:33:08.938970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb791d0d-47b7-4a59-97c3-3374e8d99627 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:08.939415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb791d0d-47b7-4a59-97c3-3374e8d99627 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:08.940183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb791d0d-47b7-4a59-97c3-3374e8d99627 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:08.940608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bb791d0d-47b7-4a59-97c3-3374e8d99627 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:09.079622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bb791d0d-47b7-4a59-97c3-3374e8d99627 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:09.087894 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bb791d0d-47b7-4a59-97c3-3374e8d99627 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1264 microversion: 2.1 time: 0.162800 Aug 02 07:33:09.088661 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3274/6478] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:08 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:10.113445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c95b6f68-9556-4738-8570-eddfd7ecf90e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:10.114456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c95b6f68-9556-4738-8570-eddfd7ecf90e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:10.117518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:33:10.125859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c95b6f68-9556-4738-8570-eddfd7ecf90e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:10.126350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c95b6f68-9556-4738-8570-eddfd7ecf90e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:10.127135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c95b6f68-9556-4738-8570-eddfd7ecf90e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:10.127582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c95b6f68-9556-4738-8570-eddfd7ecf90e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:10.264484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c95b6f68-9556-4738-8570-eddfd7ecf90e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:10.276530 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c95b6f68-9556-4738-8570-eddfd7ecf90e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1264 microversion: 2.1 time: 0.169915 Aug 02 07:33:10.277397 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3205/6479] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:10 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:11.302099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f365401-ad5e-428f-a077-87efbea587ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:11.303071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4f365401-ad5e-428f-a077-87efbea587ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:11.315748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f365401-ad5e-428f-a077-87efbea587ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:11.316505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f365401-ad5e-428f-a077-87efbea587ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:11.317818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f365401-ad5e-428f-a077-87efbea587ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:11.318599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f365401-ad5e-428f-a077-87efbea587ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:11.462854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4f365401-ad5e-428f-a077-87efbea587ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:11.470976 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4f365401-ad5e-428f-a077-87efbea587ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1264 microversion: 2.1 time: 0.175599 Aug 02 07:33:11.471573 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3275/6480] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:11 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:12.493664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e2a78da9-488a-4c39-a543-bbb97b9bb1a6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:12.494274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e2a78da9-488a-4c39-a543-bbb97b9bb1a6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:12.502569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e2a78da9-488a-4c39-a543-bbb97b9bb1a6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:12.503098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e2a78da9-488a-4c39-a543-bbb97b9bb1a6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:12.503895 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e2a78da9-488a-4c39-a543-bbb97b9bb1a6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:12.504342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e2a78da9-488a-4c39-a543-bbb97b9bb1a6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:12.637709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e2a78da9-488a-4c39-a543-bbb97b9bb1a6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:12.645435 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e2a78da9-488a-4c39-a543-bbb97b9bb1a6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1264 microversion: 2.1 time: 0.157154 Aug 02 07:33:12.646038 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3206/6481] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:12 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:13.669767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-45abe225-3021-4cf6-bbc8-f965267a0814 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:13.670447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-45abe225-3021-4cf6-bbc8-f965267a0814 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:13.677784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45abe225-3021-4cf6-bbc8-f965267a0814 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:13.678261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45abe225-3021-4cf6-bbc8-f965267a0814 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:13.679025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45abe225-3021-4cf6-bbc8-f965267a0814 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:13.679464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45abe225-3021-4cf6-bbc8-f965267a0814 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:13.831167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-45abe225-3021-4cf6-bbc8-f965267a0814 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:13.841465 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-45abe225-3021-4cf6-bbc8-f965267a0814 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1264 microversion: 2.1 time: 0.177254 Aug 02 07:33:13.842068 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3276/6482] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:13 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:14.313748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-035a4d36-2d96-42c6-957b-9d9918e38a81 req-02133da0-97c7-4e59-b900-3c83e31e1f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b5d84d-9e0f-4686-98ce-b4d10e8b551c", "name": "network-vif-plugged", "status": "completed", "tag": "94896100-b679-46dd-87eb-bb9e3fd16058"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:33:14.325305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-035a4d36-2d96-42c6-957b-9d9918e38a81 req-02133da0-97c7-4e59-b900-3c83e31e1f29 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:14.325754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-035a4d36-2d96-42c6-957b-9d9918e38a81 req-02133da0-97c7-4e59-b900-3c83e31e1f29 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:14.337704 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-035a4d36-2d96-42c6-957b-9d9918e38a81 req-02133da0-97c7-4e59-b900-3c83e31e1f29 service nova] Creating event network-vif-plugged:94896100-b679-46dd-87eb-bb9e3fd16058 for instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c on n-h2-851337-3 Aug 02 07:33:14.342973 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-035a4d36-2d96-42c6-957b-9d9918e38a81 req-02133da0-97c7-4e59-b900-3c83e31e1f29 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032990 Aug 02 07:33:14.343544 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3207/6483] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:33:14.866606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-67016551-b618-40e4-aacf-15dcac8e411a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:14.867579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-67016551-b618-40e4-aacf-15dcac8e411a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:14.876740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-67016551-b618-40e4-aacf-15dcac8e411a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:14.877193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-67016551-b618-40e4-aacf-15dcac8e411a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:14.877994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-67016551-b618-40e4-aacf-15dcac8e411a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:14.878429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-67016551-b618-40e4-aacf-15dcac8e411a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:15.021849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-67016551-b618-40e4-aacf-15dcac8e411a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:15.030344 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-67016551-b618-40e4-aacf-15dcac8e411a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1264 microversion: 2.1 time: 0.170369 Aug 02 07:33:15.030947 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3277/6484] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:14 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:16.057593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-92d6c54a-cc18-4c4a-8bb8-82ffc561f789 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:16.058735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-92d6c54a-cc18-4c4a-8bb8-82ffc561f789 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:16.069552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92d6c54a-cc18-4c4a-8bb8-82ffc561f789 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:16.070375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92d6c54a-cc18-4c4a-8bb8-82ffc561f789 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:16.071666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92d6c54a-cc18-4c4a-8bb8-82ffc561f789 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:16.072414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92d6c54a-cc18-4c4a-8bb8-82ffc561f789 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:16.218637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-92d6c54a-cc18-4c4a-8bb8-82ffc561f789 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:16.226614 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-92d6c54a-cc18-4c4a-8bb8-82ffc561f789 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1451 microversion: 2.1 time: 0.177696 Aug 02 07:33:16.227245 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3208/6485] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:16 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:16.247382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5ed95df6-a1cc-4d03-8dab-e81ec8274048 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:33:16.247955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5ed95df6-a1cc-4d03-8dab-e81ec8274048 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:33:16.255828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5ed95df6-a1cc-4d03-8dab-e81ec8274048 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:16.256279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5ed95df6-a1cc-4d03-8dab-e81ec8274048 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:16.257048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5ed95df6-a1cc-4d03-8dab-e81ec8274048 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:16.257483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5ed95df6-a1cc-4d03-8dab-e81ec8274048 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:16.409671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5ed95df6-a1cc-4d03-8dab-e81ec8274048 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:33:16.421475 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5ed95df6-a1cc-4d03-8dab-e81ec8274048 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1451 microversion: 2.1 time: 0.177871 Aug 02 07:33:16.422369 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3278/6486] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:33:16 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:33:18.274250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-3cca1a94-35b9-4a5c-acc4-9e847cbe60ca req-8e7d42cc-8212-41c3-ae05-83a3a1840d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b5d84d-9e0f-4686-98ce-b4d10e8b551c", "tag": "94896100-b679-46dd-87eb-bb9e3fd16058"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:33:18.287053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3cca1a94-35b9-4a5c-acc4-9e847cbe60ca req-8e7d42cc-8212-41c3-ae05-83a3a1840d04 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:33:18.287510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3cca1a94-35b9-4a5c-acc4-9e847cbe60ca req-8e7d42cc-8212-41c3-ae05-83a3a1840d04 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:33:18.298977 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-3cca1a94-35b9-4a5c-acc4-9e847cbe60ca req-8e7d42cc-8212-41c3-ae05-83a3a1840d04 service nova] Creating event network-changed:94896100-b679-46dd-87eb-bb9e3fd16058 for instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c on n-h2-851337-3 Aug 02 07:33:18.304239 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-3cca1a94-35b9-4a5c-acc4-9e847cbe60ca req-8e7d42cc-8212-41c3-ae05-83a3a1840d04 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033895 Aug 02 07:33:18.305050 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3209/6487] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:34:27.125388 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:34:27.126374 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 07:34:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:35:14.475581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:35:14.476456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=58 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:35:14.576526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2d1f18d3-c8d0-4da1-b208-d402008fa8f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:14.577407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2d1f18d3-c8d0-4da1-b208-d402008fa8f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:14.587001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d1f18d3-c8d0-4da1-b208-d402008fa8f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:14.587552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d1f18d3-c8d0-4da1-b208-d402008fa8f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:14.588637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d1f18d3-c8d0-4da1-b208-d402008fa8f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:14.589309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2d1f18d3-c8d0-4da1-b208-d402008fa8f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:14.616869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2d1f18d3-c8d0-4da1-b208-d402008fa8f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:35:14.700194 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2d1f18d3-c8d0-4da1-b208-d402008fa8f5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "DELETE /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 204 len: 0 microversion: 2.1 time: 0.226582 Aug 02 07:35:14.700860 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3279/6488] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:35:14 2022] DELETE /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:35:14.707842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=22 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:35:14.708576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=46 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:35:14.712844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7aeda27d-29f5-4732-8ead-abfe6f3a0491 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:14.713552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7aeda27d-29f5-4732-8ead-abfe6f3a0491 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:14.721005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7aeda27d-29f5-4732-8ead-abfe6f3a0491 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:14.721463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7aeda27d-29f5-4732-8ead-abfe6f3a0491 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:14.722282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7aeda27d-29f5-4732-8ead-abfe6f3a0491 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:14.722734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7aeda27d-29f5-4732-8ead-abfe6f3a0491 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:14.869270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7aeda27d-29f5-4732-8ead-abfe6f3a0491 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:14.877851 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7aeda27d-29f5-4732-8ead-abfe6f3a0491 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1575 microversion: 2.1 time: 0.172319 Aug 02 07:35:14.878450 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3210/6489] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:14 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:15.911497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f36e9c6e-2c24-4735-8ad3-3bdfde87b2ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:15.912657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f36e9c6e-2c24-4735-8ad3-3bdfde87b2ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:15.924519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f36e9c6e-2c24-4735-8ad3-3bdfde87b2ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:15.924961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f36e9c6e-2c24-4735-8ad3-3bdfde87b2ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:15.925681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f36e9c6e-2c24-4735-8ad3-3bdfde87b2ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:15.926174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f36e9c6e-2c24-4735-8ad3-3bdfde87b2ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:16.064099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f36e9c6e-2c24-4735-8ad3-3bdfde87b2ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:16.072050 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f36e9c6e-2c24-4735-8ad3-3bdfde87b2ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1575 microversion: 2.1 time: 0.168114 Aug 02 07:35:16.072617 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3280/6490] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:15 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:17.093388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f64e7a15-613e-41ae-a5cc-4e5843ea27bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:17.094045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f64e7a15-613e-41ae-a5cc-4e5843ea27bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:17.101591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f64e7a15-613e-41ae-a5cc-4e5843ea27bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:17.102096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f64e7a15-613e-41ae-a5cc-4e5843ea27bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:17.102881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f64e7a15-613e-41ae-a5cc-4e5843ea27bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:17.103321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f64e7a15-613e-41ae-a5cc-4e5843ea27bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:17.122770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b2aea864-2552-41b6-8a3b-b2af6dec7c52 req-e4590da4-24fe-4e9c-9cf2-1e3c72d128d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b5d84d-9e0f-4686-98ce-b4d10e8b551c", "name": "network-vif-deleted", "tag": "94896100-b679-46dd-87eb-bb9e3fd16058"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:35:17.134388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b2aea864-2552-41b6-8a3b-b2af6dec7c52 req-e4590da4-24fe-4e9c-9cf2-1e3c72d128d4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:17.134833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b2aea864-2552-41b6-8a3b-b2af6dec7c52 req-e4590da4-24fe-4e9c-9cf2-1e3c72d128d4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:17.152758 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b2aea864-2552-41b6-8a3b-b2af6dec7c52 req-e4590da4-24fe-4e9c-9cf2-1e3c72d128d4 service nova] Creating event network-vif-deleted:94896100-b679-46dd-87eb-bb9e3fd16058 for instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c on n-h2-851337-3 Aug 02 07:35:17.162395 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b2aea864-2552-41b6-8a3b-b2af6dec7c52 req-e4590da4-24fe-4e9c-9cf2-1e3c72d128d4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040173 Aug 02 07:35:17.163114 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3281/6491] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:35:17.175986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f64e7a15-613e-41ae-a5cc-4e5843ea27bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:17.193994 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f64e7a15-613e-41ae-a5cc-4e5843ea27bd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1508 microversion: 2.1 time: 0.102209 Aug 02 07:35:17.206485 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3211/6492] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:17 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1508 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:18.218355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0b6c9734-2ad4-435e-9e90-f1ef091fcb3d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:18.219756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0b6c9734-2ad4-435e-9e90-f1ef091fcb3d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:18.227151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b6c9734-2ad4-435e-9e90-f1ef091fcb3d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:18.227611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b6c9734-2ad4-435e-9e90-f1ef091fcb3d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:18.228545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b6c9734-2ad4-435e-9e90-f1ef091fcb3d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:18.228984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b6c9734-2ad4-435e-9e90-f1ef091fcb3d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:18.296064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0b6c9734-2ad4-435e-9e90-f1ef091fcb3d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:18.304083 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0b6c9734-2ad4-435e-9e90-f1ef091fcb3d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1224 microversion: 2.1 time: 0.091172 Aug 02 07:35:18.304665 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3282/6493] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:18 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:19.324954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-985086bd-f9e7-4425-b75a-5738857f7991 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:19.325856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-985086bd-f9e7-4425-b75a-5738857f7991 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:19.333092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-985086bd-f9e7-4425-b75a-5738857f7991 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:19.333556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-985086bd-f9e7-4425-b75a-5738857f7991 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:19.334377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-985086bd-f9e7-4425-b75a-5738857f7991 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:19.334825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-985086bd-f9e7-4425-b75a-5738857f7991 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:19.401164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-985086bd-f9e7-4425-b75a-5738857f7991 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:19.409293 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-985086bd-f9e7-4425-b75a-5738857f7991 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1224 microversion: 2.1 time: 0.088373 Aug 02 07:35:19.409871 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3212/6494] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:19 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:20.430722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc0f07d3-d06b-49fb-8940-c6e564f4c77a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:20.431348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bc0f07d3-d06b-49fb-8940-c6e564f4c77a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:20.439539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc0f07d3-d06b-49fb-8940-c6e564f4c77a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:20.439987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc0f07d3-d06b-49fb-8940-c6e564f4c77a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:20.440954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc0f07d3-d06b-49fb-8940-c6e564f4c77a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:20.441407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc0f07d3-d06b-49fb-8940-c6e564f4c77a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:20.510453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bc0f07d3-d06b-49fb-8940-c6e564f4c77a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:20.518573 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc0f07d3-d06b-49fb-8940-c6e564f4c77a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1224 microversion: 2.1 time: 0.091850 Aug 02 07:35:20.519181 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3283/6495] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:20 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:21.541980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15b55aee-2109-4654-a0b3-24dac7ad3172 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:21.542708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-15b55aee-2109-4654-a0b3-24dac7ad3172 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:21.555354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15b55aee-2109-4654-a0b3-24dac7ad3172 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:21.556021 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15b55aee-2109-4654-a0b3-24dac7ad3172 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:21.557416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15b55aee-2109-4654-a0b3-24dac7ad3172 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:21.558123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15b55aee-2109-4654-a0b3-24dac7ad3172 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:21.599461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15b55aee-2109-4654-a0b3-24dac7ad3172 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:21.600133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15b55aee-2109-4654-a0b3-24dac7ad3172 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:21.600618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-15b55aee-2109-4654-a0b3-24dac7ad3172 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lazy-loading 'fault' on Instance uuid 71b5d84d-9e0f-4686-98ce-b4d10e8b551c {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:35:21.646857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-15b55aee-2109-4654-a0b3-24dac7ad3172 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:21.654956 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-15b55aee-2109-4654-a0b3-24dac7ad3172 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 200 len: 1229 microversion: 2.1 time: 0.118426 Aug 02 07:35:21.655504 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3213/6496] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:21 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 1229 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:22.677776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6ba3aed-8a56-4df1-9152-3241d2cdeded tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:22.678394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d6ba3aed-8a56-4df1-9152-3241d2cdeded tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:22.686092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6ba3aed-8a56-4df1-9152-3241d2cdeded tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:22.686534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6ba3aed-8a56-4df1-9152-3241d2cdeded tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:22.687330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6ba3aed-8a56-4df1-9152-3241d2cdeded tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:22.687761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6ba3aed-8a56-4df1-9152-3241d2cdeded tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:22.702009 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-d6ba3aed-8a56-4df1-9152-3241d2cdeded tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6ba3aed-8a56-4df1-9152-3241d2cdeded tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c HTTP/1.1 Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '71b5d84d-9e0f-4686-98ce-b4d10e8b551c'} Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:35:22.703929 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:35:22.709506 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:35:22.709506 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:35:22.709506 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:35:22.709506 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:35:22.709506 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:35:22.709506 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:35:22.709506 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:35:22.709506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6ba3aed-8a56-4df1-9152-3241d2cdeded tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:35:22.709506 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d6ba3aed-8a56-4df1-9152-3241d2cdeded tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 404 len: 111 microversion: 2.1 time: 0.032788 Aug 02 07:35:22.709506 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3284/6497] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:22 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:35:22.765819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-264144149", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-582216103", "security_groups": [{"name": "tempest-secgroup-smoke-302398715"}], "block_device_mapping_v2": [{"uuid": "31bc83c3-2c4f-49c9-a65d-c20e5ea55d91", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5a68237c-f872-4b09-8d4c-16c9a40f01a7"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:35:22.890029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] validate_networks() for [('5a68237c-f872-4b09-8d4c-16c9a40f01a7', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:35:23.441038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:35:23.441483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:35:23.442033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:35:23.442459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:35:23.442887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:35:23.453272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:23.453840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:23.454754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:23.455239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:23.472785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:35:23.478669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for user 9f2f38363b9644f7956995d598509787 and project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:35:23.538589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:35:23.540878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31bc83c3-2c4f-49c9-a65d-c20e5ea55d91',volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:35:23.679959 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-54265161-6785-4279-9ef8-8594ef01fdf3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.918027 Aug 02 07:35:23.680633 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3214/6498] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:35:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:35:23.691752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5c43b1c0-f417-4159-a8d5-a80310ad6fd6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:23.692383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5c43b1c0-f417-4159-a8d5-a80310ad6fd6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:23.748410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5c43b1c0-f417-4159-a8d5-a80310ad6fd6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:23.757266 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5c43b1c0-f417-4159-a8d5-a80310ad6fd6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1093 microversion: 2.1 time: 0.069539 Aug 02 07:35:23.757833 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3285/6499] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:23 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:24.778350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2b1ebdc4-cf00-4bdc-8cb8-b0e5994263cb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:24.779013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2b1ebdc4-cf00-4bdc-8cb8-b0e5994263cb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:24.786287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b1ebdc4-cf00-4bdc-8cb8-b0e5994263cb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:24.786763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b1ebdc4-cf00-4bdc-8cb8-b0e5994263cb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:24.787762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b1ebdc4-cf00-4bdc-8cb8-b0e5994263cb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:24.788215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b1ebdc4-cf00-4bdc-8cb8-b0e5994263cb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:24.855861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2b1ebdc4-cf00-4bdc-8cb8-b0e5994263cb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:24.866186 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2b1ebdc4-cf00-4bdc-8cb8-b0e5994263cb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1199 microversion: 2.1 time: 0.092330 Aug 02 07:35:24.867331 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3215/6500] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:24 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1199 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:25.891868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b2bf8e76-77c6-4e9c-adb8-daa068ad68b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:25.892600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b2bf8e76-77c6-4e9c-adb8-daa068ad68b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:25.900338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2bf8e76-77c6-4e9c-adb8-daa068ad68b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:25.900792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2bf8e76-77c6-4e9c-adb8-daa068ad68b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:25.901614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2bf8e76-77c6-4e9c-adb8-daa068ad68b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:25.902120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2bf8e76-77c6-4e9c-adb8-daa068ad68b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:26.065908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b2bf8e76-77c6-4e9c-adb8-daa068ad68b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:26.075241 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b2bf8e76-77c6-4e9c-adb8-daa068ad68b4 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1276 microversion: 2.1 time: 0.188850 Aug 02 07:35:26.075975 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3286/6501] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:25 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1276 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:35:26.318968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-3d9344be-b9d1-42f0-9ed9-0cb7af75eee1 req-9d205f30-ae86-4bc8-aba8-3bc860a7bcde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b742fc70-b19c-48a6-b97e-632947eda107", "tag": "1adcb7bc-3480-4211-93b2-c4de25e2f02f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:35:26.330360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3d9344be-b9d1-42f0-9ed9-0cb7af75eee1 req-9d205f30-ae86-4bc8-aba8-3bc860a7bcde service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:26.331312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3d9344be-b9d1-42f0-9ed9-0cb7af75eee1 req-9d205f30-ae86-4bc8-aba8-3bc860a7bcde service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:26.343842 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-3d9344be-b9d1-42f0-9ed9-0cb7af75eee1 req-9d205f30-ae86-4bc8-aba8-3bc860a7bcde service nova] Creating event network-changed:1adcb7bc-3480-4211-93b2-c4de25e2f02f for instance b742fc70-b19c-48a6-b97e-632947eda107 on n-h1-851337-3 Aug 02 07:35:26.347392 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [req-3d9344be-b9d1-42f0-9ed9-0cb7af75eee1 req-9d205f30-ae86-4bc8-aba8-3bc860a7bcde service nova] [6ded0921-e0a3-4bed-a89a-5bc78c891de5] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 07:35:27.097247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7ec1ff2-2b2a-4841-b1a4-9987ba18e85b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:27.097863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e7ec1ff2-2b2a-4841-b1a4-9987ba18e85b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:27.105386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7ec1ff2-2b2a-4841-b1a4-9987ba18e85b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:27.105769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7ec1ff2-2b2a-4841-b1a4-9987ba18e85b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:27.106571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7ec1ff2-2b2a-4841-b1a4-9987ba18e85b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:27.107006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7ec1ff2-2b2a-4841-b1a4-9987ba18e85b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:27.249079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e7ec1ff2-2b2a-4841-b1a4-9987ba18e85b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:27.257557 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7ec1ff2-2b2a-4841-b1a4-9987ba18e85b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1276 microversion: 2.1 time: 0.164552 Aug 02 07:35:27.258194 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3287/6502] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:27 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:27.355358 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [req-3d9344be-b9d1-42f0-9ed9-0cb7af75eee1 req-9d205f30-ae86-4bc8-aba8-3bc860a7bcde service nova] [6ded0921-e0a3-4bed-a89a-5bc78c891de5] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 34948. Aug 02 07:35:27.358870 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-3d9344be-b9d1-42f0-9ed9-0cb7af75eee1 req-9d205f30-ae86-4bc8-aba8-3bc860a7bcde service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.043596 Aug 02 07:35:27.359315 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3216/6503] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:35:28.278959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-63f32076-d95e-4120-aefb-a6085841948c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:28.279568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-63f32076-d95e-4120-aefb-a6085841948c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:28.287202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63f32076-d95e-4120-aefb-a6085841948c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:28.287650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63f32076-d95e-4120-aefb-a6085841948c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:28.288478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63f32076-d95e-4120-aefb-a6085841948c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:28.288855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-63f32076-d95e-4120-aefb-a6085841948c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:28.427026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-63f32076-d95e-4120-aefb-a6085841948c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:28.434874 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-63f32076-d95e-4120-aefb-a6085841948c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1276 microversion: 2.1 time: 0.159932 Aug 02 07:35:28.435476 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3288/6504] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:28 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:29.457741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-512a27b3-7df3-4dc2-86d1-c57da116b4e0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:29.458433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-512a27b3-7df3-4dc2-86d1-c57da116b4e0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:29.468468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-512a27b3-7df3-4dc2-86d1-c57da116b4e0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:29.468929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-512a27b3-7df3-4dc2-86d1-c57da116b4e0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:29.469697 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-512a27b3-7df3-4dc2-86d1-c57da116b4e0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:29.470209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-512a27b3-7df3-4dc2-86d1-c57da116b4e0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:29.617385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-512a27b3-7df3-4dc2-86d1-c57da116b4e0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:29.625451 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-512a27b3-7df3-4dc2-86d1-c57da116b4e0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1276 microversion: 2.1 time: 0.172964 Aug 02 07:35:29.626429 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3217/6505] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:29 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:30.651444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44b2890d-003a-4cd5-93b5-fd43d812a05a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:30.652293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-44b2890d-003a-4cd5-93b5-fd43d812a05a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:30.661925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44b2890d-003a-4cd5-93b5-fd43d812a05a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:30.662404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44b2890d-003a-4cd5-93b5-fd43d812a05a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:30.663166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44b2890d-003a-4cd5-93b5-fd43d812a05a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:30.663603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44b2890d-003a-4cd5-93b5-fd43d812a05a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:30.806951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-44b2890d-003a-4cd5-93b5-fd43d812a05a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:30.814884 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-44b2890d-003a-4cd5-93b5-fd43d812a05a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1264 microversion: 2.1 time: 0.170280 Aug 02 07:35:30.815466 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3289/6506] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:30 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:31.839871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9f48afc4-1055-4cf7-9315-c0b97aee36d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:31.840886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9f48afc4-1055-4cf7-9315-c0b97aee36d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:31.850730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f48afc4-1055-4cf7-9315-c0b97aee36d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:31.851197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f48afc4-1055-4cf7-9315-c0b97aee36d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:31.851983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f48afc4-1055-4cf7-9315-c0b97aee36d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:31.852435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f48afc4-1055-4cf7-9315-c0b97aee36d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:32.000654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9f48afc4-1055-4cf7-9315-c0b97aee36d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:32.008797 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9f48afc4-1055-4cf7-9315-c0b97aee36d0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1264 microversion: 2.1 time: 0.175788 Aug 02 07:35:32.009370 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3218/6507] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:31 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:33.033407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a9bc1172-162a-4afb-a4f5-2d063973f618 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:33.034296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a9bc1172-162a-4afb-a4f5-2d063973f618 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:33.045686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9bc1172-162a-4afb-a4f5-2d063973f618 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:33.046430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9bc1172-162a-4afb-a4f5-2d063973f618 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:33.047718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9bc1172-162a-4afb-a4f5-2d063973f618 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:33.048447 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9bc1172-162a-4afb-a4f5-2d063973f618 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:33.187230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a9bc1172-162a-4afb-a4f5-2d063973f618 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:33.199228 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a9bc1172-162a-4afb-a4f5-2d063973f618 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1264 microversion: 2.1 time: 0.171799 Aug 02 07:35:33.200019 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3290/6508] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:33 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:34.223485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2b26f431-18a8-4802-b6f3-6f3aa7f29fab tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:34.224120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2b26f431-18a8-4802-b6f3-6f3aa7f29fab tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:34.226535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:35:34.227227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:35:34.233265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b26f431-18a8-4802-b6f3-6f3aa7f29fab tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:34.233730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b26f431-18a8-4802-b6f3-6f3aa7f29fab tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:34.234545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b26f431-18a8-4802-b6f3-6f3aa7f29fab tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:34.235001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2b26f431-18a8-4802-b6f3-6f3aa7f29fab tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:34.377039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2b26f431-18a8-4802-b6f3-6f3aa7f29fab tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:34.384923 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2b26f431-18a8-4802-b6f3-6f3aa7f29fab tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1264 microversion: 2.1 time: 0.165611 Aug 02 07:35:34.385459 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3219/6509] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:34 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:35.413300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8f887517-ed25-4ec2-ab9e-1098ca61d73d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:35.414401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8f887517-ed25-4ec2-ab9e-1098ca61d73d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:35.417528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:35:35.427559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f887517-ed25-4ec2-ab9e-1098ca61d73d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:35.428004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f887517-ed25-4ec2-ab9e-1098ca61d73d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:35.428764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f887517-ed25-4ec2-ab9e-1098ca61d73d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:35.429190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f887517-ed25-4ec2-ab9e-1098ca61d73d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:35.577198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8f887517-ed25-4ec2-ab9e-1098ca61d73d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:35.585056 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8f887517-ed25-4ec2-ab9e-1098ca61d73d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1264 microversion: 2.1 time: 0.178492 Aug 02 07:35:35.585628 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3291/6510] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:35 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:36.614610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-37cababb-e0a5-4887-9b7d-4d14ad67796a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:36.615974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-37cababb-e0a5-4887-9b7d-4d14ad67796a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:36.623550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37cababb-e0a5-4887-9b7d-4d14ad67796a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:36.624010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37cababb-e0a5-4887-9b7d-4d14ad67796a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:36.624781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37cababb-e0a5-4887-9b7d-4d14ad67796a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:36.625219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-37cababb-e0a5-4887-9b7d-4d14ad67796a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:36.758401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-37cababb-e0a5-4887-9b7d-4d14ad67796a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:36.766612 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-37cababb-e0a5-4887-9b7d-4d14ad67796a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1264 microversion: 2.1 time: 0.162754 Aug 02 07:35:36.767188 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3220/6511] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:36 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:37.790542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-48d43216-7f9b-4900-8a10-e9387e95fe74 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:37.791186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-48d43216-7f9b-4900-8a10-e9387e95fe74 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:37.798506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48d43216-7f9b-4900-8a10-e9387e95fe74 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:37.798999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48d43216-7f9b-4900-8a10-e9387e95fe74 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:37.799818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48d43216-7f9b-4900-8a10-e9387e95fe74 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:37.800303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48d43216-7f9b-4900-8a10-e9387e95fe74 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:37.943286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-48d43216-7f9b-4900-8a10-e9387e95fe74 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:37.951445 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-48d43216-7f9b-4900-8a10-e9387e95fe74 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1264 microversion: 2.1 time: 0.166505 Aug 02 07:35:37.951997 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3292/6512] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:37 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:38.974483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c479baf5-b6a7-470e-a448-65fb120759f6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:38.975339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c479baf5-b6a7-470e-a448-65fb120759f6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:38.984535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c479baf5-b6a7-470e-a448-65fb120759f6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:38.985116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c479baf5-b6a7-470e-a448-65fb120759f6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:38.986163 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c479baf5-b6a7-470e-a448-65fb120759f6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:38.986723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c479baf5-b6a7-470e-a448-65fb120759f6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:39.134763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c479baf5-b6a7-470e-a448-65fb120759f6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:39.143302 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c479baf5-b6a7-470e-a448-65fb120759f6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1264 microversion: 2.1 time: 0.173883 Aug 02 07:35:39.143873 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3221/6513] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:38 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:40.167714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dd3fe192-a126-4063-b7b9-05ad4a59a1c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:40.168483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dd3fe192-a126-4063-b7b9-05ad4a59a1c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:40.177942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd3fe192-a126-4063-b7b9-05ad4a59a1c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:40.178534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd3fe192-a126-4063-b7b9-05ad4a59a1c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:40.179506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd3fe192-a126-4063-b7b9-05ad4a59a1c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:40.180045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dd3fe192-a126-4063-b7b9-05ad4a59a1c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:40.328559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dd3fe192-a126-4063-b7b9-05ad4a59a1c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:40.336853 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dd3fe192-a126-4063-b7b9-05ad4a59a1c5 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1264 microversion: 2.1 time: 0.174830 Aug 02 07:35:40.337423 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3293/6514] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:40 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:40.592186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-65d29fa9-c763-4caa-b7b9-71a562d6ad68 req-c7d5149a-cbdd-462f-b85a-753fc86e7042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b742fc70-b19c-48a6-b97e-632947eda107", "name": "network-vif-plugged", "status": "completed", "tag": "1adcb7bc-3480-4211-93b2-c4de25e2f02f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:35:40.603562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-65d29fa9-c763-4caa-b7b9-71a562d6ad68 req-c7d5149a-cbdd-462f-b85a-753fc86e7042 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:40.604015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-65d29fa9-c763-4caa-b7b9-71a562d6ad68 req-c7d5149a-cbdd-462f-b85a-753fc86e7042 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:40.615481 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-65d29fa9-c763-4caa-b7b9-71a562d6ad68 req-c7d5149a-cbdd-462f-b85a-753fc86e7042 service nova] Creating event network-vif-plugged:1adcb7bc-3480-4211-93b2-c4de25e2f02f for instance b742fc70-b19c-48a6-b97e-632947eda107 on n-h1-851337-3 Aug 02 07:35:40.620669 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-65d29fa9-c763-4caa-b7b9-71a562d6ad68 req-c7d5149a-cbdd-462f-b85a-753fc86e7042 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032382 Aug 02 07:35:40.621263 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3222/6515] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:35:41.358171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-051282ef-de50-461f-a50f-a45f06d8ca61 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:41.358890 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-051282ef-de50-461f-a50f-a45f06d8ca61 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:41.367594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-051282ef-de50-461f-a50f-a45f06d8ca61 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:41.368049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-051282ef-de50-461f-a50f-a45f06d8ca61 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:41.368817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-051282ef-de50-461f-a50f-a45f06d8ca61 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:41.369253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-051282ef-de50-461f-a50f-a45f06d8ca61 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:41.512991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-051282ef-de50-461f-a50f-a45f06d8ca61 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:41.520806 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-051282ef-de50-461f-a50f-a45f06d8ca61 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1264 microversion: 2.1 time: 0.167397 Aug 02 07:35:41.521376 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3294/6516] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:41 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:42.548519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-db6db169-027e-4f67-904f-f1edd742d69c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:42.549588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-db6db169-027e-4f67-904f-f1edd742d69c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:42.558658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db6db169-027e-4f67-904f-f1edd742d69c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:42.559113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db6db169-027e-4f67-904f-f1edd742d69c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:42.559874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db6db169-027e-4f67-904f-f1edd742d69c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:42.560311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-db6db169-027e-4f67-904f-f1edd742d69c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:42.701265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-db6db169-027e-4f67-904f-f1edd742d69c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:42.709293 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-db6db169-027e-4f67-904f-f1edd742d69c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1450 microversion: 2.1 time: 0.169662 Aug 02 07:35:42.709853 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3223/6517] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:42 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:42.735277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43d33904-090f-404e-a231-c6d956f9785d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:35:42.735846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-43d33904-090f-404e-a231-c6d956f9785d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:35:42.743360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43d33904-090f-404e-a231-c6d956f9785d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:42.743766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43d33904-090f-404e-a231-c6d956f9785d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:42.744581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43d33904-090f-404e-a231-c6d956f9785d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:42.745015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43d33904-090f-404e-a231-c6d956f9785d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:42.904287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43d33904-090f-404e-a231-c6d956f9785d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:35:42.912623 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43d33904-090f-404e-a231-c6d956f9785d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1450 microversion: 2.1 time: 0.185171 Aug 02 07:35:42.913216 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3295/6518] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:35:42 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1450 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:35:45.111626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c44be7e1-293c-4e51-a471-c99918977664 req-27b82927-f0cd-4d8a-b99e-1864c205dfe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b742fc70-b19c-48a6-b97e-632947eda107", "tag": "1adcb7bc-3480-4211-93b2-c4de25e2f02f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:35:45.121804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:35:45.131285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c44be7e1-293c-4e51-a471-c99918977664 req-27b82927-f0cd-4d8a-b99e-1864c205dfe3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:35:45.131951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c44be7e1-293c-4e51-a471-c99918977664 req-27b82927-f0cd-4d8a-b99e-1864c205dfe3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:35:45.140010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=75 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:35:45.148328 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c44be7e1-293c-4e51-a471-c99918977664 req-27b82927-f0cd-4d8a-b99e-1864c205dfe3 service nova] Creating event network-changed:1adcb7bc-3480-4211-93b2-c4de25e2f02f for instance b742fc70-b19c-48a6-b97e-632947eda107 on n-h1-851337-3 Aug 02 07:35:45.153548 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c44be7e1-293c-4e51-a471-c99918977664 req-27b82927-f0cd-4d8a-b99e-1864c205dfe3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047039 Aug 02 07:35:45.154237 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3224/6519] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:36:07.229985 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:36:07.230632 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 07:36:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:37:23.616936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:37:23.617714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:37:23.622148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1791963572", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-582216103", "security_groups": [{"name": "tempest-secgroup-smoke-302398715"}], "block_device_mapping_v2": [{"uuid": "3fc3c350-f7d4-4f1c-ab72-5f171ca58f73", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5a68237c-f872-4b09-8d4c-16c9a40f01a7"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:37:23.889871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] validate_networks() for [('5a68237c-f872-4b09-8d4c-16c9a40f01a7', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:37:24.338137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:37:24.338570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:37:24.339242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:37:24.339690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:37:24.340138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:37:24.350625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:24.351245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:24.352043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:24.352483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:24.371492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:37:24.377039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Getting quotas for user 9f2f38363b9644f7956995d598509787 and project 5cc22b5a59924a6a8bc25c5b4644c709. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:37:24.438931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:37:24.441265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3fc3c350-f7d4-4f1c-ab72-5f171ca58f73',volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:37:24.590113 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b730514c-4188-4542-ba99-1244155f8e10 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.974775 Aug 02 07:37:24.596179 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3296/6520] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:37:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:37:24.601155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:37:24.602361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:37:24.607214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-19cf1c34-cdda-4cc4-a662-debf1cc9d851 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:24.608164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-19cf1c34-cdda-4cc4-a662-debf1cc9d851 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:24.731396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-19cf1c34-cdda-4cc4-a662-debf1cc9d851 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:24.738393 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-19cf1c34-cdda-4cc4-a662-debf1cc9d851 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1094 microversion: 2.1 time: 0.140191 Aug 02 07:37:24.739031 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3225/6521] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:24 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1094 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:25.760020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc93fe4b-d3ed-4cf0-b47f-211c569508f0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:25.760755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bc93fe4b-d3ed-4cf0-b47f-211c569508f0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:25.769705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc93fe4b-d3ed-4cf0-b47f-211c569508f0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:25.770195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc93fe4b-d3ed-4cf0-b47f-211c569508f0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:25.770970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc93fe4b-d3ed-4cf0-b47f-211c569508f0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:25.771412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc93fe4b-d3ed-4cf0-b47f-211c569508f0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:25.857677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bc93fe4b-d3ed-4cf0-b47f-211c569508f0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:25.866475 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc93fe4b-d3ed-4cf0-b47f-211c569508f0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1210 microversion: 2.1 time: 0.110800 Aug 02 07:37:25.869184 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3297/6522] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:25 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:26.888446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1c65ce0c-be07-4b12-bebe-0775f447d1ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:26.889108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1c65ce0c-be07-4b12-bebe-0775f447d1ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:26.899414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c65ce0c-be07-4b12-bebe-0775f447d1ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:26.901232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c65ce0c-be07-4b12-bebe-0775f447d1ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:26.902272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c65ce0c-be07-4b12-bebe-0775f447d1ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:26.903028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c65ce0c-be07-4b12-bebe-0775f447d1ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:27.127690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1c65ce0c-be07-4b12-bebe-0775f447d1ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:27.138267 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1c65ce0c-be07-4b12-bebe-0775f447d1ca tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1277 microversion: 2.1 time: 0.253659 Aug 02 07:37:27.146461 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3226/6523] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:26 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:27.279845 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-dea5933c-acb0-4c57-ba99-d482b820c98c req-408bf03b-ae15-4886-8517-c634aae15d26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c0b9353-8392-4a2c-85dd-d48c067425d5", "tag": "4945a1a2-52ce-45e9-935d-fff30f04bbdd"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:37:27.290624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-dea5933c-acb0-4c57-ba99-d482b820c98c req-408bf03b-ae15-4886-8517-c634aae15d26 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:27.291368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-dea5933c-acb0-4c57-ba99-d482b820c98c req-408bf03b-ae15-4886-8517-c634aae15d26 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:27.303779 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-dea5933c-acb0-4c57-ba99-d482b820c98c req-408bf03b-ae15-4886-8517-c634aae15d26 service nova] Creating event network-changed:4945a1a2-52ce-45e9-935d-fff30f04bbdd for instance 2c0b9353-8392-4a2c-85dd-d48c067425d5 on n-h2-851337-3 Aug 02 07:37:27.309350 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-dea5933c-acb0-4c57-ba99-d482b820c98c req-408bf03b-ae15-4886-8517-c634aae15d26 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132261 Aug 02 07:37:27.310286 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3298/6524] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:37:28.163079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3d8e6617-42ec-4324-a8a1-629ff4daae56 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:28.164147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3d8e6617-42ec-4324-a8a1-629ff4daae56 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:28.174870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d8e6617-42ec-4324-a8a1-629ff4daae56 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:28.175337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d8e6617-42ec-4324-a8a1-629ff4daae56 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:28.176966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d8e6617-42ec-4324-a8a1-629ff4daae56 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:28.178046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d8e6617-42ec-4324-a8a1-629ff4daae56 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:28.319667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3d8e6617-42ec-4324-a8a1-629ff4daae56 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:28.327471 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3d8e6617-42ec-4324-a8a1-629ff4daae56 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1277 microversion: 2.1 time: 0.172222 Aug 02 07:37:28.328054 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3227/6525] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:28 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:29.350400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1aa70e03-10c3-4d6b-9bd9-0cb996e79ad9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:29.350995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1aa70e03-10c3-4d6b-9bd9-0cb996e79ad9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:29.358953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1aa70e03-10c3-4d6b-9bd9-0cb996e79ad9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:29.359397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1aa70e03-10c3-4d6b-9bd9-0cb996e79ad9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:29.360157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1aa70e03-10c3-4d6b-9bd9-0cb996e79ad9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:29.360586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1aa70e03-10c3-4d6b-9bd9-0cb996e79ad9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:29.496305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1aa70e03-10c3-4d6b-9bd9-0cb996e79ad9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:29.504975 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1aa70e03-10c3-4d6b-9bd9-0cb996e79ad9 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1277 microversion: 2.1 time: 0.159939 Aug 02 07:37:29.505588 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3299/6526] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:29 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:30.526575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0039301f-2443-4cd9-ab21-4cb99feb9ef6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:30.527383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0039301f-2443-4cd9-ab21-4cb99feb9ef6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:30.535611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0039301f-2443-4cd9-ab21-4cb99feb9ef6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:30.535874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0039301f-2443-4cd9-ab21-4cb99feb9ef6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:30.536642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0039301f-2443-4cd9-ab21-4cb99feb9ef6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:30.537072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0039301f-2443-4cd9-ab21-4cb99feb9ef6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:30.683197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0039301f-2443-4cd9-ab21-4cb99feb9ef6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:30.692016 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0039301f-2443-4cd9-ab21-4cb99feb9ef6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1277 microversion: 2.1 time: 0.169455 Aug 02 07:37:30.692690 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3228/6527] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:30 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:31.715269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-86793479-0ccf-45b3-8f85-69af3d89c28d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:31.715985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-86793479-0ccf-45b3-8f85-69af3d89c28d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:31.724593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-86793479-0ccf-45b3-8f85-69af3d89c28d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:31.725146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-86793479-0ccf-45b3-8f85-69af3d89c28d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:31.726069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-86793479-0ccf-45b3-8f85-69af3d89c28d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:31.726577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-86793479-0ccf-45b3-8f85-69af3d89c28d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:31.872293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-86793479-0ccf-45b3-8f85-69af3d89c28d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:31.880850 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-86793479-0ccf-45b3-8f85-69af3d89c28d tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1265 microversion: 2.1 time: 0.170268 Aug 02 07:37:31.881539 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3300/6528] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:31 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:32.902883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d9220a54-36b0-41c4-9a78-9e836443ddfb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:32.903505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d9220a54-36b0-41c4-9a78-9e836443ddfb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:32.911139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9220a54-36b0-41c4-9a78-9e836443ddfb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:32.911656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9220a54-36b0-41c4-9a78-9e836443ddfb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:32.912532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9220a54-36b0-41c4-9a78-9e836443ddfb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:32.913037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9220a54-36b0-41c4-9a78-9e836443ddfb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:33.070206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d9220a54-36b0-41c4-9a78-9e836443ddfb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:33.078437 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d9220a54-36b0-41c4-9a78-9e836443ddfb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1265 microversion: 2.1 time: 0.179928 Aug 02 07:37:33.079013 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3229/6529] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:32 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:34.101617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-258afa12-d5cf-463f-a59e-22a2dfa16fa3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:34.102407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-258afa12-d5cf-463f-a59e-22a2dfa16fa3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:34.110765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-258afa12-d5cf-463f-a59e-22a2dfa16fa3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:34.111156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-258afa12-d5cf-463f-a59e-22a2dfa16fa3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:34.111927 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-258afa12-d5cf-463f-a59e-22a2dfa16fa3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:34.112369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-258afa12-d5cf-463f-a59e-22a2dfa16fa3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:34.248046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-258afa12-d5cf-463f-a59e-22a2dfa16fa3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:34.256973 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-258afa12-d5cf-463f-a59e-22a2dfa16fa3 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1265 microversion: 2.1 time: 0.160145 Aug 02 07:37:34.257571 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3301/6530] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:34 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:35.279441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-76e337a4-b248-4c53-899d-f36047404eb7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:35.280182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-76e337a4-b248-4c53-899d-f36047404eb7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:35.283094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:37:35.290229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76e337a4-b248-4c53-899d-f36047404eb7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:35.290770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76e337a4-b248-4c53-899d-f36047404eb7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:35.291781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76e337a4-b248-4c53-899d-f36047404eb7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:35.292448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76e337a4-b248-4c53-899d-f36047404eb7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:35.449747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-76e337a4-b248-4c53-899d-f36047404eb7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:35.459022 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-76e337a4-b248-4c53-899d-f36047404eb7 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1265 microversion: 2.1 time: 0.183916 Aug 02 07:37:35.459726 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3230/6531] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:35 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:36.482487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-60a4ae48-13d5-4ad2-ae80-ee8b708dd91a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:36.483173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-60a4ae48-13d5-4ad2-ae80-ee8b708dd91a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:36.485491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:37:36.486338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:37:36.494249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-60a4ae48-13d5-4ad2-ae80-ee8b708dd91a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:36.494707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-60a4ae48-13d5-4ad2-ae80-ee8b708dd91a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:36.495466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-60a4ae48-13d5-4ad2-ae80-ee8b708dd91a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:36.495925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-60a4ae48-13d5-4ad2-ae80-ee8b708dd91a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:36.651079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-60a4ae48-13d5-4ad2-ae80-ee8b708dd91a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:36.659053 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-60a4ae48-13d5-4ad2-ae80-ee8b708dd91a tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1265 microversion: 2.1 time: 0.180952 Aug 02 07:37:36.659644 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3302/6532] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:36 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:37.680896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ea41560-44bc-44bd-be80-e485364738d1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:37.681592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ea41560-44bc-44bd-be80-e485364738d1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:37.689153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ea41560-44bc-44bd-be80-e485364738d1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:37.689606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ea41560-44bc-44bd-be80-e485364738d1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:37.690399 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ea41560-44bc-44bd-be80-e485364738d1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:37.691865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ea41560-44bc-44bd-be80-e485364738d1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:37.826509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ea41560-44bc-44bd-be80-e485364738d1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:37.835057 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ea41560-44bc-44bd-be80-e485364738d1 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1265 microversion: 2.1 time: 0.158192 Aug 02 07:37:37.835639 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3231/6533] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:37 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:38.858384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-32302112-2819-4f6a-9bc1-91d72f81a8ba tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:38.859092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-32302112-2819-4f6a-9bc1-91d72f81a8ba tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:38.868881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32302112-2819-4f6a-9bc1-91d72f81a8ba tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:38.869513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32302112-2819-4f6a-9bc1-91d72f81a8ba tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:38.870703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32302112-2819-4f6a-9bc1-91d72f81a8ba tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:38.871320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32302112-2819-4f6a-9bc1-91d72f81a8ba tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:39.017677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-32302112-2819-4f6a-9bc1-91d72f81a8ba tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:39.025727 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-32302112-2819-4f6a-9bc1-91d72f81a8ba tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1265 microversion: 2.1 time: 0.173517 Aug 02 07:37:39.026328 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3303/6534] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:38 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:39.657423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-f87f6634-947b-4165-b7eb-1afc2076d12d req-db3e8270-b950-4008-be96-5ccd2ea6da1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c0b9353-8392-4a2c-85dd-d48c067425d5", "name": "network-vif-plugged", "status": "completed", "tag": "4945a1a2-52ce-45e9-935d-fff30f04bbdd"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:37:39.667486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f87f6634-947b-4165-b7eb-1afc2076d12d req-db3e8270-b950-4008-be96-5ccd2ea6da1a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:39.667951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f87f6634-947b-4165-b7eb-1afc2076d12d req-db3e8270-b950-4008-be96-5ccd2ea6da1a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:39.681707 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-f87f6634-947b-4165-b7eb-1afc2076d12d req-db3e8270-b950-4008-be96-5ccd2ea6da1a service nova] Creating event network-vif-plugged:4945a1a2-52ce-45e9-935d-fff30f04bbdd for instance 2c0b9353-8392-4a2c-85dd-d48c067425d5 on n-h2-851337-3 Aug 02 07:37:39.686969 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-f87f6634-947b-4165-b7eb-1afc2076d12d req-db3e8270-b950-4008-be96-5ccd2ea6da1a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104982 Aug 02 07:37:39.687559 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3232/6535] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:37:40.050330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7eeb1bcf-727c-4a66-92c3-7a30e5edb67c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:40.051082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7eeb1bcf-727c-4a66-92c3-7a30e5edb67c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:40.060194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7eeb1bcf-727c-4a66-92c3-7a30e5edb67c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:40.060730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7eeb1bcf-727c-4a66-92c3-7a30e5edb67c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:40.061669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7eeb1bcf-727c-4a66-92c3-7a30e5edb67c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:40.062289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7eeb1bcf-727c-4a66-92c3-7a30e5edb67c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:40.208012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7eeb1bcf-727c-4a66-92c3-7a30e5edb67c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:40.216240 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7eeb1bcf-727c-4a66-92c3-7a30e5edb67c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1265 microversion: 2.1 time: 0.172224 Aug 02 07:37:40.216831 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3304/6536] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:40 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:41.242574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5298a71e-e004-4647-93d6-0a35395bade0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:41.243732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5298a71e-e004-4647-93d6-0a35395bade0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:41.255210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5298a71e-e004-4647-93d6-0a35395bade0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:41.255676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5298a71e-e004-4647-93d6-0a35395bade0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:41.256459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5298a71e-e004-4647-93d6-0a35395bade0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:41.256939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5298a71e-e004-4647-93d6-0a35395bade0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:41.399012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5298a71e-e004-4647-93d6-0a35395bade0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:41.406925 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5298a71e-e004-4647-93d6-0a35395bade0 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1452 microversion: 2.1 time: 0.171662 Aug 02 07:37:41.407512 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3233/6537] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:41 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:41.429963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-40fc8f68-4bdd-4e5a-9c5d-34d03a79ea1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:37:41.430876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-40fc8f68-4bdd-4e5a-9c5d-34d03a79ea1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:37:41.441239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40fc8f68-4bdd-4e5a-9c5d-34d03a79ea1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:41.441693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40fc8f68-4bdd-4e5a-9c5d-34d03a79ea1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:41.442548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40fc8f68-4bdd-4e5a-9c5d-34d03a79ea1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:41.443191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-40fc8f68-4bdd-4e5a-9c5d-34d03a79ea1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:41.589120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-40fc8f68-4bdd-4e5a-9c5d-34d03a79ea1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:37:41.601225 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-40fc8f68-4bdd-4e5a-9c5d-34d03a79ea1f tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1452 microversion: 2.1 time: 0.177393 Aug 02 07:37:41.602100 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3305/6538] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:37:41 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:37:43.666705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-7b00d5ce-5d6f-4422-b2b0-468b827f55b9 req-607abb45-7cda-4f20-9dff-06191311801d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c0b9353-8392-4a2c-85dd-d48c067425d5", "tag": "4945a1a2-52ce-45e9-935d-fff30f04bbdd"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:37:43.677947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7b00d5ce-5d6f-4422-b2b0-468b827f55b9 req-607abb45-7cda-4f20-9dff-06191311801d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:37:43.678390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7b00d5ce-5d6f-4422-b2b0-468b827f55b9 req-607abb45-7cda-4f20-9dff-06191311801d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:37:43.692588 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-7b00d5ce-5d6f-4422-b2b0-468b827f55b9 req-607abb45-7cda-4f20-9dff-06191311801d service nova] Creating event network-changed:4945a1a2-52ce-45e9-935d-fff30f04bbdd for instance 2c0b9353-8392-4a2c-85dd-d48c067425d5 on n-h2-851337-3 Aug 02 07:37:43.697797 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-7b00d5ce-5d6f-4422-b2b0-468b827f55b9 req-607abb45-7cda-4f20-9dff-06191311801d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035161 Aug 02 07:37:43.698576 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3234/6539] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:37:46.100066 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:37:46.100681 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 07:37:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:37:46.173166 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:37:46.173354 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 07:37:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:37:47.138613 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:37:47.139650 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 07:37:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:39:11.900715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:39:11.901948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=52 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:39:11.904985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=22 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:39:11.905978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=46 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:39:11.906407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-caaa6efd-e632-4d99-ad76-7c66f21c7575 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:11.906688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-caaa6efd-e632-4d99-ad76-7c66f21c7575 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:11.917186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caaa6efd-e632-4d99-ad76-7c66f21c7575 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:11.917646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caaa6efd-e632-4d99-ad76-7c66f21c7575 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:11.918464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caaa6efd-e632-4d99-ad76-7c66f21c7575 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:11.919072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-caaa6efd-e632-4d99-ad76-7c66f21c7575 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:11.947887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-caaa6efd-e632-4d99-ad76-7c66f21c7575 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:39:11.969501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-1834b50c-f404-45fb-879e-234806fc733f req-c7f7907c-ba69-4387-9c50-65801aec2e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c0b9353-8392-4a2c-85dd-d48c067425d5", "tag": "4945a1a2-52ce-45e9-935d-fff30f04bbdd"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:39:11.979956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1834b50c-f404-45fb-879e-234806fc733f req-c7f7907c-ba69-4387-9c50-65801aec2e7d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:11.980402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1834b50c-f404-45fb-879e-234806fc733f req-c7f7907c-ba69-4387-9c50-65801aec2e7d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:11.992224 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-1834b50c-f404-45fb-879e-234806fc733f req-c7f7907c-ba69-4387-9c50-65801aec2e7d service nova] Creating event network-changed:4945a1a2-52ce-45e9-935d-fff30f04bbdd for instance 2c0b9353-8392-4a2c-85dd-d48c067425d5 on n-h2-851337-3 Aug 02 07:39:11.997822 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-1834b50c-f404-45fb-879e-234806fc733f req-c7f7907c-ba69-4387-9c50-65801aec2e7d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096181 Aug 02 07:39:11.999075 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3235/6540] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:39:12.037233 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-caaa6efd-e632-4d99-ad76-7c66f21c7575 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 204 len: 0 microversion: 2.1 time: 0.138164 Aug 02 07:39:12.041326 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3306/6541] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:39:11 2022] DELETE /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:39:12.047416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ef1ab37e-2e5b-423b-a624-05c265491612 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:12.048134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ef1ab37e-2e5b-423b-a624-05c265491612 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:12.055341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef1ab37e-2e5b-423b-a624-05c265491612 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:12.056217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef1ab37e-2e5b-423b-a624-05c265491612 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:12.057255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef1ab37e-2e5b-423b-a624-05c265491612 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:12.057760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef1ab37e-2e5b-423b-a624-05c265491612 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:12.199166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ef1ab37e-2e5b-423b-a624-05c265491612 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:12.207039 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ef1ab37e-2e5b-423b-a624-05c265491612 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1577 microversion: 2.1 time: 0.164049 Aug 02 07:39:12.207860 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3236/6542] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:12 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:13.230135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d9203268-e0e8-4ac2-bbe3-65622dec1a8e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:13.230844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d9203268-e0e8-4ac2-bbe3-65622dec1a8e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:13.239378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9203268-e0e8-4ac2-bbe3-65622dec1a8e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:13.239837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9203268-e0e8-4ac2-bbe3-65622dec1a8e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:13.240618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9203268-e0e8-4ac2-bbe3-65622dec1a8e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:13.241060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9203268-e0e8-4ac2-bbe3-65622dec1a8e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:13.411759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d9203268-e0e8-4ac2-bbe3-65622dec1a8e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:13.423238 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d9203268-e0e8-4ac2-bbe3-65622dec1a8e tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1577 microversion: 2.1 time: 0.197541 Aug 02 07:39:13.423845 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3307/6543] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:13 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:14.096141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-902b31a8-79ae-46dc-8922-c9cd6ad47631 req-77503675-c31c-4661-95bf-a2c09fc6b995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c0b9353-8392-4a2c-85dd-d48c067425d5", "name": "network-vif-deleted", "tag": "4945a1a2-52ce-45e9-935d-fff30f04bbdd"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:39:14.106772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-902b31a8-79ae-46dc-8922-c9cd6ad47631 req-77503675-c31c-4661-95bf-a2c09fc6b995 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:14.107289 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-902b31a8-79ae-46dc-8922-c9cd6ad47631 req-77503675-c31c-4661-95bf-a2c09fc6b995 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:14.125182 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-902b31a8-79ae-46dc-8922-c9cd6ad47631 req-77503675-c31c-4661-95bf-a2c09fc6b995 service nova] Creating event network-vif-deleted:4945a1a2-52ce-45e9-935d-fff30f04bbdd for instance 2c0b9353-8392-4a2c-85dd-d48c067425d5 on n-h2-851337-3 Aug 02 07:39:14.130430 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-902b31a8-79ae-46dc-8922-c9cd6ad47631 req-77503675-c31c-4661-95bf-a2c09fc6b995 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038063 Aug 02 07:39:14.131045 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3237/6544] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:39:14.445170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b38407fd-d271-4d7b-949c-b4e17fc265ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:14.446584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b38407fd-d271-4d7b-949c-b4e17fc265ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:14.454344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b38407fd-d271-4d7b-949c-b4e17fc265ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:14.454798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b38407fd-d271-4d7b-949c-b4e17fc265ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:14.455676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b38407fd-d271-4d7b-949c-b4e17fc265ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:14.456469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b38407fd-d271-4d7b-949c-b4e17fc265ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:14.532471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b38407fd-d271-4d7b-949c-b4e17fc265ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:14.540546 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b38407fd-d271-4d7b-949c-b4e17fc265ae tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1225 microversion: 2.1 time: 0.099530 Aug 02 07:39:14.541125 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3308/6545] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:14 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:15.563152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-76548251-d818-4e49-9c7b-a4c9879d8abd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:15.563952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-76548251-d818-4e49-9c7b-a4c9879d8abd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:15.570975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76548251-d818-4e49-9c7b-a4c9879d8abd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:15.571434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76548251-d818-4e49-9c7b-a4c9879d8abd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:15.572218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76548251-d818-4e49-9c7b-a4c9879d8abd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:15.572665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-76548251-d818-4e49-9c7b-a4c9879d8abd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:15.636728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-76548251-d818-4e49-9c7b-a4c9879d8abd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:15.645025 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-76548251-d818-4e49-9c7b-a4c9879d8abd tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1225 microversion: 2.1 time: 0.087079 Aug 02 07:39:15.645615 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3238/6546] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:15 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:16.666636 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-be1db1f7-5bc4-4c06-8cac-dc042941dca6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:16.667232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-be1db1f7-5bc4-4c06-8cac-dc042941dca6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:16.674846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be1db1f7-5bc4-4c06-8cac-dc042941dca6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:16.675300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be1db1f7-5bc4-4c06-8cac-dc042941dca6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:16.676072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be1db1f7-5bc4-4c06-8cac-dc042941dca6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:16.676506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be1db1f7-5bc4-4c06-8cac-dc042941dca6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:16.746548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-be1db1f7-5bc4-4c06-8cac-dc042941dca6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:16.755343 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-be1db1f7-5bc4-4c06-8cac-dc042941dca6 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1225 microversion: 2.1 time: 0.092676 Aug 02 07:39:16.755927 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3309/6547] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:16 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:17.776915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2572b371-b331-4e6f-bb9d-72490e881724 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:17.777576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2572b371-b331-4e6f-bb9d-72490e881724 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:17.785455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2572b371-b331-4e6f-bb9d-72490e881724 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:17.785919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2572b371-b331-4e6f-bb9d-72490e881724 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:17.786711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2572b371-b331-4e6f-bb9d-72490e881724 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:17.787209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2572b371-b331-4e6f-bb9d-72490e881724 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:17.851123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2572b371-b331-4e6f-bb9d-72490e881724 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:17.859647 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2572b371-b331-4e6f-bb9d-72490e881724 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 200 len: 1225 microversion: 2.1 time: 0.087168 Aug 02 07:39:17.860360 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3239/6548] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:17 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:18.881660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02a973de-e499-44fe-a16c-f9d420d48352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:18.882320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-02a973de-e499-44fe-a16c-f9d420d48352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 2c0b9353-8392-4a2c-85dd-d48c067425d5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:18.889815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02a973de-e499-44fe-a16c-f9d420d48352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:18.890302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02a973de-e499-44fe-a16c-f9d420d48352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:18.891064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02a973de-e499-44fe-a16c-f9d420d48352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:18.891500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-02a973de-e499-44fe-a16c-f9d420d48352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:18.905258 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-02a973de-e499-44fe-a16c-f9d420d48352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance 2c0b9353-8392-4a2c-85dd-d48c067425d5 could not be found. Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02a973de-e499-44fe-a16c-f9d420d48352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 HTTP/1.1 Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 2c0b9353-8392-4a2c-85dd-d48c067425d5 could not be found. Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '2c0b9353-8392-4a2c-85dd-d48c067425d5'} Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c0b9353-8392-4a2c-85dd-d48c067425d5 could not be found. Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c0b9353-8392-4a2c-85dd-d48c067425d5 could not be found. Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:39:18.907091 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:18.912382 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:39:18.912382 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:39:18.912382 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:39:18.912382 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:39:18.912382 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:39:18.912382 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c0b9353-8392-4a2c-85dd-d48c067425d5 could not be found. Aug 02 07:39:18.912382 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:18.912382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-02a973de-e499-44fe-a16c-f9d420d48352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance 2c0b9353-8392-4a2c-85dd-d48c067425d5 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:39:18.912382 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-02a973de-e499-44fe-a16c-f9d420d48352 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5" status: 404 len: 111 microversion: 2.1 time: 0.031280 Aug 02 07:39:18.912382 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3310/6549] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:18 2022] GET /compute/v2.1/servers/2c0b9353-8392-4a2c-85dd-d48c067425d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:39:25.156724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cace3005-8b9f-42d9-8f11-62efde135c64 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:25.157270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cace3005-8b9f-42d9-8f11-62efde135c64 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:25.158470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-57599878-0a54-4a1e-a0f3-740b333c4565 req-7f345e1d-5298-411d-87f6-cfa4842a7a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b742fc70-b19c-48a6-b97e-632947eda107", "tag": "1adcb7bc-3480-4211-93b2-c4de25e2f02f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:39:25.164609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cace3005-8b9f-42d9-8f11-62efde135c64 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:25.165072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cace3005-8b9f-42d9-8f11-62efde135c64 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:25.165858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cace3005-8b9f-42d9-8f11-62efde135c64 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:25.166329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cace3005-8b9f-42d9-8f11-62efde135c64 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:25.170350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-57599878-0a54-4a1e-a0f3-740b333c4565 req-7f345e1d-5298-411d-87f6-cfa4842a7a1b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:25.170786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-57599878-0a54-4a1e-a0f3-740b333c4565 req-7f345e1d-5298-411d-87f6-cfa4842a7a1b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:25.182786 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-57599878-0a54-4a1e-a0f3-740b333c4565 req-7f345e1d-5298-411d-87f6-cfa4842a7a1b service nova] Creating event network-changed:1adcb7bc-3480-4211-93b2-c4de25e2f02f for instance b742fc70-b19c-48a6-b97e-632947eda107 on n-h1-851337-3 Aug 02 07:39:25.188934 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-57599878-0a54-4a1e-a0f3-740b333c4565 req-7f345e1d-5298-411d-87f6-cfa4842a7a1b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034171 Aug 02 07:39:25.190252 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3311/6550] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:39:25.471474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cace3005-8b9f-42d9-8f11-62efde135c64 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:39:25.559191 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cace3005-8b9f-42d9-8f11-62efde135c64 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 204 len: 0 microversion: 2.1 time: 0.405118 Aug 02 07:39:25.559191 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3240/6551] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:39:25 2022] DELETE /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:39:25.570206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-15a2ee8d-af47-456d-ab65-13cf173446fe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:25.571440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-15a2ee8d-af47-456d-ab65-13cf173446fe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:25.578949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15a2ee8d-af47-456d-ab65-13cf173446fe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:25.579761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15a2ee8d-af47-456d-ab65-13cf173446fe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:25.580948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15a2ee8d-af47-456d-ab65-13cf173446fe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:25.581448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15a2ee8d-af47-456d-ab65-13cf173446fe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:25.731952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-15a2ee8d-af47-456d-ab65-13cf173446fe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:25.740405 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-15a2ee8d-af47-456d-ab65-13cf173446fe tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1574 microversion: 2.1 time: 0.176146 Aug 02 07:39:25.741040 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3312/6552] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:25 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:26.762454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c7c18d43-2222-40f4-94db-7f5329c0091b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:26.763362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c7c18d43-2222-40f4-94db-7f5329c0091b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:26.771942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7c18d43-2222-40f4-94db-7f5329c0091b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:26.771942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7c18d43-2222-40f4-94db-7f5329c0091b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:26.772753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7c18d43-2222-40f4-94db-7f5329c0091b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:26.773216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7c18d43-2222-40f4-94db-7f5329c0091b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:26.908018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c7c18d43-2222-40f4-94db-7f5329c0091b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:26.916058 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c7c18d43-2222-40f4-94db-7f5329c0091b tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1456 microversion: 2.1 time: 0.157971 Aug 02 07:39:26.916591 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3241/6553] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:26 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1456 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:27.937088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-556b5750-bc8a-4a4a-86c8-af01269ba4e2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:27.937802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-556b5750-bc8a-4a4a-86c8-af01269ba4e2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:27.945064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-556b5750-bc8a-4a4a-86c8-af01269ba4e2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:27.945515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-556b5750-bc8a-4a4a-86c8-af01269ba4e2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:27.946319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-556b5750-bc8a-4a4a-86c8-af01269ba4e2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:27.946747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-556b5750-bc8a-4a4a-86c8-af01269ba4e2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:28.011602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-556b5750-bc8a-4a4a-86c8-af01269ba4e2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:28.022104 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-556b5750-bc8a-4a4a-86c8-af01269ba4e2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1389 microversion: 2.1 time: 0.089046 Aug 02 07:39:28.034248 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3313/6554] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:27 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:28.076433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-110076c5-3d88-44fb-8653-3ed4f40a2f5d req-33a93a78-e65c-4dcf-aad4-60c63157836f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b742fc70-b19c-48a6-b97e-632947eda107", "name": "network-vif-deleted", "tag": "1adcb7bc-3480-4211-93b2-c4de25e2f02f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:39:28.087272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-110076c5-3d88-44fb-8653-3ed4f40a2f5d req-33a93a78-e65c-4dcf-aad4-60c63157836f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:28.087732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-110076c5-3d88-44fb-8653-3ed4f40a2f5d req-33a93a78-e65c-4dcf-aad4-60c63157836f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:28.099124 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-110076c5-3d88-44fb-8653-3ed4f40a2f5d req-33a93a78-e65c-4dcf-aad4-60c63157836f service nova] Creating event network-vif-deleted:1adcb7bc-3480-4211-93b2-c4de25e2f02f for instance b742fc70-b19c-48a6-b97e-632947eda107 on n-h1-851337-3 Aug 02 07:39:28.103978 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-110076c5-3d88-44fb-8653-3ed4f40a2f5d req-33a93a78-e65c-4dcf-aad4-60c63157836f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031221 Aug 02 07:39:28.104967 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3242/6555] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:39:29.045331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8f636cc0-c09a-4b19-9e54-64ff80feccb2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:29.046392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8f636cc0-c09a-4b19-9e54-64ff80feccb2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:29.054094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f636cc0-c09a-4b19-9e54-64ff80feccb2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:29.054671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f636cc0-c09a-4b19-9e54-64ff80feccb2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:29.055454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f636cc0-c09a-4b19-9e54-64ff80feccb2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:29.056003 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f636cc0-c09a-4b19-9e54-64ff80feccb2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:29.126769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8f636cc0-c09a-4b19-9e54-64ff80feccb2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:29.135140 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8f636cc0-c09a-4b19-9e54-64ff80feccb2 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1224 microversion: 2.1 time: 0.094254 Aug 02 07:39:29.135707 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3314/6556] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:29 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:30.159205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-abfe2a8f-e4a6-4eba-9f40-4638202b4cdb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:30.159911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-abfe2a8f-e4a6-4eba-9f40-4638202b4cdb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:30.167965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abfe2a8f-e4a6-4eba-9f40-4638202b4cdb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:30.168421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abfe2a8f-e4a6-4eba-9f40-4638202b4cdb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:30.169204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abfe2a8f-e4a6-4eba-9f40-4638202b4cdb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:30.169646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-abfe2a8f-e4a6-4eba-9f40-4638202b4cdb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:30.234514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-abfe2a8f-e4a6-4eba-9f40-4638202b4cdb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:30.242629 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-abfe2a8f-e4a6-4eba-9f40-4638202b4cdb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1224 microversion: 2.1 time: 0.089835 Aug 02 07:39:30.243362 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3243/6557] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:30 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:31.263659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-469fa7bd-6ff4-49d2-9282-5cec8957b054 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:31.264342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-469fa7bd-6ff4-49d2-9282-5cec8957b054 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:31.272089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-469fa7bd-6ff4-49d2-9282-5cec8957b054 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:31.272556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-469fa7bd-6ff4-49d2-9282-5cec8957b054 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:31.273345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-469fa7bd-6ff4-49d2-9282-5cec8957b054 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:31.273787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-469fa7bd-6ff4-49d2-9282-5cec8957b054 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:31.342786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-469fa7bd-6ff4-49d2-9282-5cec8957b054 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:31.351347 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-469fa7bd-6ff4-49d2-9282-5cec8957b054 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1224 microversion: 2.1 time: 0.091699 Aug 02 07:39:31.351948 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3315/6558] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:31 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:32.376521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-63f44ea1-2945-480a-b4e5-49f16ec8fe18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:32.377139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-63f44ea1-2945-480a-b4e5-49f16ec8fe18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:32.384863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f44ea1-2945-480a-b4e5-49f16ec8fe18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:32.385331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f44ea1-2945-480a-b4e5-49f16ec8fe18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:32.386157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f44ea1-2945-480a-b4e5-49f16ec8fe18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:32.386611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f44ea1-2945-480a-b4e5-49f16ec8fe18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:32.417554 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f44ea1-2945-480a-b4e5-49f16ec8fe18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:32.418049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63f44ea1-2945-480a-b4e5-49f16ec8fe18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:32.418510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-63f44ea1-2945-480a-b4e5-49f16ec8fe18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lazy-loading 'fault' on Instance uuid b742fc70-b19c-48a6-b97e-632947eda107 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:39:32.461281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-63f44ea1-2945-480a-b4e5-49f16ec8fe18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2f38363b9644f7956995d598509787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc22b5a59924a6a8bc25c5b4644c709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:32.471160 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-63f44ea1-2945-480a-b4e5-49f16ec8fe18 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 200 len: 1229 microversion: 2.1 time: 0.100434 Aug 02 07:39:32.471727 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3244/6559] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:32 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:33.494501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-31285b29-6cb4-4f44-bcc3-a9c8a7af2051 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:33.495406 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-31285b29-6cb4-4f44-bcc3-a9c8a7af2051 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: b742fc70-b19c-48a6-b97e-632947eda107] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:33.502651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-31285b29-6cb4-4f44-bcc3-a9c8a7af2051 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:33.503098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-31285b29-6cb4-4f44-bcc3-a9c8a7af2051 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:33.503860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-31285b29-6cb4-4f44-bcc3-a9c8a7af2051 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:33.504632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-31285b29-6cb4-4f44-bcc3-a9c8a7af2051 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:33.518924 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-31285b29-6cb4-4f44-bcc3-a9c8a7af2051 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance b742fc70-b19c-48a6-b97e-632947eda107 could not be found. Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-31285b29-6cb4-4f44-bcc3-a9c8a7af2051 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 HTTP/1.1 Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance b742fc70-b19c-48a6-b97e-632947eda107 could not be found. Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'b742fc70-b19c-48a6-b97e-632947eda107'} Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b742fc70-b19c-48a6-b97e-632947eda107 could not be found. Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b742fc70-b19c-48a6-b97e-632947eda107 could not be found. Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:39:33.520641 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:33.526626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:39:33.526626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:39:33.526626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:39:33.526626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:39:33.526626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:39:33.526626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b742fc70-b19c-48a6-b97e-632947eda107 could not be found. Aug 02 07:39:33.526626 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:33.526626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-31285b29-6cb4-4f44-bcc3-a9c8a7af2051 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance b742fc70-b19c-48a6-b97e-632947eda107 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:39:33.526626 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-31285b29-6cb4-4f44-bcc3-a9c8a7af2051 tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107" status: 404 len: 111 microversion: 2.1 time: 0.032973 Aug 02 07:39:33.526626 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3316/6560] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:33 2022] GET /compute/v2.1/servers/b742fc70-b19c-48a6-b97e-632947eda107 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:39:33.994429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-46dd6593-8ebc-4aa8-b839-8c6f8938fbbb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:33.994999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-46dd6593-8ebc-4aa8-b839-8c6f8938fbbb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:34.002402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46dd6593-8ebc-4aa8-b839-8c6f8938fbbb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:34.002875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46dd6593-8ebc-4aa8-b839-8c6f8938fbbb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:34.003675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46dd6593-8ebc-4aa8-b839-8c6f8938fbbb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:34.004493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46dd6593-8ebc-4aa8-b839-8c6f8938fbbb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:34.018371 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-46dd6593-8ebc-4aa8-b839-8c6f8938fbbb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-46dd6593-8ebc-4aa8-b839-8c6f8938fbbb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c HTTP/1.1 Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '71b5d84d-9e0f-4686-98ce-b4d10e8b551c'} Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:39:34.020098 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:39:34.025432 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:39:34.025432 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:39:34.025432 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:39:34.025432 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:39:34.025432 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:39:34.025432 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:39:34.025432 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:39:34.025432 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:39:34.025432 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:39:34.025432 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:39:34.025432 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:39:34.025432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-46dd6593-8ebc-4aa8-b839-8c6f8938fbbb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:39:34.025432 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-46dd6593-8ebc-4aa8-b839-8c6f8938fbbb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "DELETE /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 404 len: 111 microversion: 2.1 time: 0.031252 Aug 02 07:39:34.025432 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3245/6561] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:39:33 2022] DELETE /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:39:34.030709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c539ea98-cf5e-40d0-b2cb-5ed105e8e57c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:34.031333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c539ea98-cf5e-40d0-b2cb-5ed105e8e57c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] [instance: 71b5d84d-9e0f-4686-98ce-b4d10e8b551c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:34.038455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c539ea98-cf5e-40d0-b2cb-5ed105e8e57c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:34.038914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c539ea98-cf5e-40d0-b2cb-5ed105e8e57c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:34.039684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c539ea98-cf5e-40d0-b2cb-5ed105e8e57c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:34.040127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c539ea98-cf5e-40d0-b2cb-5ed105e8e57c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:34.054123 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-c539ea98-cf5e-40d0-b2cb-5ed105e8e57c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] HTTP exception thrown: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c539ea98-cf5e-40d0-b2cb-5ed105e8e57c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Request method failure captured: Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c HTTP/1.1 Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NIkDlDaVyBgBPfVCG1qDGjEiaTiMKT7onqDdgA3V3GYEknrjSMygxI4cIbhcm6NJ8sH0Woa7NC3rJq0sQO0B7KBLY9iF9C8edIIGXGxKpI0pmZ0nT9XtR5tokphx-KPK-QdI69SBYx608h3Ahhis-7_D3ZIO_oP3A1spfgKRe_Cuho Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5cc22b5a59924a6a8bc25c5b4644c709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5cc22b5a59924a6a8bc25c5b4644c709"}]}] Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestVolumeBootPattern-827390221 Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5cc22b5a59924a6a8bc25c5b4644c709 Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestVolumeBootPattern-827390221 Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 9f2f38363b9644f7956995d598509787 Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestVolumeBootPattern-827390221-project Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '71b5d84d-9e0f-4686-98ce-b4d10e8b551c'} Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:39:34.055677 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:34.061209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:39:34.061209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:39:34.061209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:39:34.061209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:39:34.061209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:39:34.061209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. Aug 02 07:39:34.061209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:39:34.061209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c539ea98-cf5e-40d0-b2cb-5ed105e8e57c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Returning 404 to user: Instance 71b5d84d-9e0f-4686-98ce-b4d10e8b551c could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:39:34.061209 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c539ea98-cf5e-40d0-b2cb-5ed105e8e57c tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c" status: 404 len: 111 microversion: 2.1 time: 0.030580 Aug 02 07:39:34.061209 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3317/6562] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:34 2022] GET /compute/v2.1/servers/71b5d84d-9e0f-4686-98ce-b4d10e8b551c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:39:37.477212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85c05fbe-4da7-4146-bf4c-83fa44538eeb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] Calling method '.version_select at 0x7f927a3a1040>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:37.517418 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-85c05fbe-4da7-4146-bf4c-83fa44538eeb tempest-TestVolumeBootPattern-827390221 tempest-TestVolumeBootPattern-827390221-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-582216103" status: 202 len: 0 microversion: 2.1 time: 0.043986 Aug 02 07:39:37.518600 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3246/6563] 10.222.0.79 () {58 vars in 1260 bytes} [Tue Aug 2 07:39:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-582216103 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:39:56.190108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:39:56.190854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:39:56.309200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-457333245", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:39:56.365627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] validate_networks() for None {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:39:56.559139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:39:56.559567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:39:56.560039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:39:56.560452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:39:56.560869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:39:56.571579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:56.572038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:56.572846 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:56.573287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:56.590701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Getting quotas for project 7535b42e7ff14503814a2837e2c7ccd8. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:39:56.596380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Getting quotas for user 74c69e3cd37b412ba019551f1540ac7c and project 7535b42e7ff14503814a2837e2c7ccd8. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:39:56.609580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:39:56.611794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:39:56.658191 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-048260c2-bc69-4b78-8eae-4fa76d802f02 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.473149 Aug 02 07:39:56.659053 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3318/6564] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:39:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:39:56.671412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8cc3e769-fa60-41c2-a985-5387dbf42ac2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:56.672023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8cc3e769-fa60-41c2-a985-5387dbf42ac2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:56.681074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:39:56.682061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:39:56.737067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8cc3e769-fa60-41c2-a985-5387dbf42ac2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c69e3cd37b412ba019551f1540ac7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535b42e7ff14503814a2837e2c7ccd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:56.743889 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8cc3e769-fa60-41c2-a985-5387dbf42ac2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] 10.222.0.79 "GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e" status: 200 len: 1221 microversion: 2.1 time: 0.076569 Aug 02 07:39:56.744463 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3247/6565] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:56 2022] GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:57.766139 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5cb87ee4-227d-4207-80b0-3e617692aa64 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:57.767103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5cb87ee4-227d-4207-80b0-3e617692aa64 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:57.774470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5cb87ee4-227d-4207-80b0-3e617692aa64 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:57.775212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5cb87ee4-227d-4207-80b0-3e617692aa64 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:57.776131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5cb87ee4-227d-4207-80b0-3e617692aa64 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:57.776832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5cb87ee4-227d-4207-80b0-3e617692aa64 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:57.848340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5cb87ee4-227d-4207-80b0-3e617692aa64 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c69e3cd37b412ba019551f1540ac7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535b42e7ff14503814a2837e2c7ccd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:57.856484 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5cb87ee4-227d-4207-80b0-3e617692aa64 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] 10.222.0.79 "GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e" status: 200 len: 1279 microversion: 2.1 time: 0.095313 Aug 02 07:39:57.857354 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3319/6566] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:57 2022] GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:58.878332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5cb2bdb6-e124-439f-9f03-f6aa285d3338 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:39:58.878979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5cb2bdb6-e124-439f-9f03-f6aa285d3338 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:39:58.887351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cb2bdb6-e124-439f-9f03-f6aa285d3338 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:58.887854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cb2bdb6-e124-439f-9f03-f6aa285d3338 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:58.888905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cb2bdb6-e124-439f-9f03-f6aa285d3338 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:58.889365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cb2bdb6-e124-439f-9f03-f6aa285d3338 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:59.136298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5cb2bdb6-e124-439f-9f03-f6aa285d3338 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c69e3cd37b412ba019551f1540ac7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535b42e7ff14503814a2837e2c7ccd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:39:59.144545 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5cb2bdb6-e124-439f-9f03-f6aa285d3338 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] 10.222.0.79 "GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e" status: 200 len: 1321 microversion: 2.1 time: 0.270194 Aug 02 07:39:59.145148 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3248/6567] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:39:58 2022] GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:39:59.552404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-2ac78e70-a35e-4a35-bcda-11c22f1203a6 req-5cd9f35c-4433-4a2a-a4ae-8064dad3774f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af839438-729c-4cd1-b569-5340ca950e9e", "tag": "182ff65d-9a55-4e68-838e-d7f3c236a952"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:39:59.563689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2ac78e70-a35e-4a35-bcda-11c22f1203a6 req-5cd9f35c-4433-4a2a-a4ae-8064dad3774f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:39:59.564140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2ac78e70-a35e-4a35-bcda-11c22f1203a6 req-5cd9f35c-4433-4a2a-a4ae-8064dad3774f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:39:59.576489 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-2ac78e70-a35e-4a35-bcda-11c22f1203a6 req-5cd9f35c-4433-4a2a-a4ae-8064dad3774f service nova] Creating event network-changed:182ff65d-9a55-4e68-838e-d7f3c236a952 for instance af839438-729c-4cd1-b569-5340ca950e9e on n-h2-851337-3 Aug 02 07:39:59.581715 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-2ac78e70-a35e-4a35-bcda-11c22f1203a6 req-5cd9f35c-4433-4a2a-a4ae-8064dad3774f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033680 Aug 02 07:39:59.582530 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3320/6568] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:40:00.170201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-079542ff-e051-4ff7-a53f-2740099f3d94 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:00.171167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-079542ff-e051-4ff7-a53f-2740099f3d94 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:00.181160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-079542ff-e051-4ff7-a53f-2740099f3d94 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:00.181706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-079542ff-e051-4ff7-a53f-2740099f3d94 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:00.182665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-079542ff-e051-4ff7-a53f-2740099f3d94 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:00.183196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-079542ff-e051-4ff7-a53f-2740099f3d94 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:00.322500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-079542ff-e051-4ff7-a53f-2740099f3d94 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c69e3cd37b412ba019551f1540ac7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535b42e7ff14503814a2837e2c7ccd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:00.330800 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-079542ff-e051-4ff7-a53f-2740099f3d94 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] 10.222.0.79 "GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e" status: 200 len: 1321 microversion: 2.1 time: 0.168546 Aug 02 07:40:00.331359 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3249/6569] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:00 2022] GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:01.353753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-38487da3-5d27-4083-941e-5ea1c465bf96 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:01.354431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-38487da3-5d27-4083-941e-5ea1c465bf96 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:01.362219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38487da3-5d27-4083-941e-5ea1c465bf96 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:01.362673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38487da3-5d27-4083-941e-5ea1c465bf96 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:01.363620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38487da3-5d27-4083-941e-5ea1c465bf96 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:01.364087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38487da3-5d27-4083-941e-5ea1c465bf96 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:01.502337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-38487da3-5d27-4083-941e-5ea1c465bf96 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c69e3cd37b412ba019551f1540ac7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535b42e7ff14503814a2837e2c7ccd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:01.510599 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-38487da3-5d27-4083-941e-5ea1c465bf96 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] 10.222.0.79 "GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e" status: 200 len: 1321 microversion: 2.1 time: 0.161971 Aug 02 07:40:01.511169 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3321/6570] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:01 2022] GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:02.536788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c4238587-f3e7-4de3-948b-b422b97b98aa tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:02.537707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c4238587-f3e7-4de3-948b-b422b97b98aa tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:02.545474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4238587-f3e7-4de3-948b-b422b97b98aa tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:02.545924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4238587-f3e7-4de3-948b-b422b97b98aa tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:02.546734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4238587-f3e7-4de3-948b-b422b97b98aa tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:02.547179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c4238587-f3e7-4de3-948b-b422b97b98aa tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:02.683742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c4238587-f3e7-4de3-948b-b422b97b98aa tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c69e3cd37b412ba019551f1540ac7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535b42e7ff14503814a2837e2c7ccd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:02.691647 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c4238587-f3e7-4de3-948b-b422b97b98aa tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] 10.222.0.79 "GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e" status: 200 len: 1321 microversion: 2.1 time: 0.161719 Aug 02 07:40:02.692253 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3250/6571] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:02 2022] GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:03.714106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e0c5b152-826e-4d4b-acbc-be53752678c0 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:03.714727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e0c5b152-826e-4d4b-acbc-be53752678c0 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:03.721986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0c5b152-826e-4d4b-acbc-be53752678c0 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:03.722446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0c5b152-826e-4d4b-acbc-be53752678c0 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:03.723225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0c5b152-826e-4d4b-acbc-be53752678c0 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:03.723680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0c5b152-826e-4d4b-acbc-be53752678c0 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:03.858168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e0c5b152-826e-4d4b-acbc-be53752678c0 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c69e3cd37b412ba019551f1540ac7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535b42e7ff14503814a2837e2c7ccd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:03.866238 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e0c5b152-826e-4d4b-acbc-be53752678c0 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] 10.222.0.79 "GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e" status: 200 len: 1321 microversion: 2.1 time: 0.157286 Aug 02 07:40:03.866824 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3322/6572] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:03 2022] GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:04.385879 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-17deed4c-9b76-46eb-848c-8beeb0434792 req-70abf705-868b-44b0-a4a0-ff869c1a2e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af839438-729c-4cd1-b569-5340ca950e9e", "name": "network-vif-plugged", "status": "completed", "tag": "182ff65d-9a55-4e68-838e-d7f3c236a952"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:40:04.397556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-17deed4c-9b76-46eb-848c-8beeb0434792 req-70abf705-868b-44b0-a4a0-ff869c1a2e57 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:04.398174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-17deed4c-9b76-46eb-848c-8beeb0434792 req-70abf705-868b-44b0-a4a0-ff869c1a2e57 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:04.409585 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-17deed4c-9b76-46eb-848c-8beeb0434792 req-70abf705-868b-44b0-a4a0-ff869c1a2e57 service nova] Creating event network-vif-plugged:182ff65d-9a55-4e68-838e-d7f3c236a952 for instance af839438-729c-4cd1-b569-5340ca950e9e on n-h2-851337-3 Aug 02 07:40:04.415141 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-17deed4c-9b76-46eb-848c-8beeb0434792 req-70abf705-868b-44b0-a4a0-ff869c1a2e57 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033047 Aug 02 07:40:04.415764 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3251/6573] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:40:04.888081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ca8ea1d7-5c62-45d2-b367-a055562cf6a2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:04.888720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ca8ea1d7-5c62-45d2-b367-a055562cf6a2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:04.896289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1d7-5c62-45d2-b367-a055562cf6a2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:04.896737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1d7-5c62-45d2-b367-a055562cf6a2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:04.897503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1d7-5c62-45d2-b367-a055562cf6a2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:04.898056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca8ea1d7-5c62-45d2-b367-a055562cf6a2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:05.041120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ca8ea1d7-5c62-45d2-b367-a055562cf6a2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c69e3cd37b412ba019551f1540ac7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535b42e7ff14503814a2837e2c7ccd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:05.050468 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ca8ea1d7-5c62-45d2-b367-a055562cf6a2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] 10.222.0.79 "GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e" status: 200 len: 1321 microversion: 2.1 time: 0.166550 Aug 02 07:40:05.051098 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3323/6574] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:04 2022] GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:06.075314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5f72214f-e897-4ee2-913f-65179716daa2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:06.075998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5f72214f-e897-4ee2-913f-65179716daa2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:06.082667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f72214f-e897-4ee2-913f-65179716daa2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:06.083131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f72214f-e897-4ee2-913f-65179716daa2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:06.083891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f72214f-e897-4ee2-913f-65179716daa2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:06.084335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f72214f-e897-4ee2-913f-65179716daa2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:06.233099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5f72214f-e897-4ee2-913f-65179716daa2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c69e3cd37b412ba019551f1540ac7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535b42e7ff14503814a2837e2c7ccd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:06.240817 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5f72214f-e897-4ee2-913f-65179716daa2 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] 10.222.0.79 "GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e" status: 200 len: 1471 microversion: 2.1 time: 0.171274 Aug 02 07:40:06.241430 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3252/6575] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:06 2022] GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:06.324750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1fcfe1bf-177e-4ddc-a540-f13fcc4dfa5a tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Calling method '.version_select at 0x7f927a7a0e50>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:06.399299 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1fcfe1bf-177e-4ddc-a540-f13fcc4dfa5a tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/8a886ec6d50b40d183fc98583af6283f" status: 200 len: 371 microversion: 2.1 time: 0.133901 Aug 02 07:40:06.399902 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3324/6576] 10.222.0.79 () {58 vars in 1242 bytes} [Tue Aug 2 07:40:06 2022] GET /compute/v2.1/os-quota-sets/8a886ec6d50b40d183fc98583af6283f => generated 371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:40:06.411788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e5706546-227b-4de6-8df7-0125fd42bbc3 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2057062378", "id": 130754734, "os-flavor-access:is_public": "True"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:40:06.414771 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:40:06.414771 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 07:40:06.432593 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e5706546-227b-4de6-8df7-0125fd42bbc3 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.024539 Aug 02 07:40:06.433109 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3253/6577] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:40:06 2022] POST /compute/v2.1/flavors => generated 435 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:40:06.445165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "130754734"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:40:06.447501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:06.454209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:06.454739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:06.455527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:06.455970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:06.543799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8198ed023e844f19acf543373a9f1d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a886ec6d50b40d183fc98583af6283f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:06.550276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2057062378 {{(pid=126120) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 07:40:06.556976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:06.557423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:06.558328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:06.558762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:06.579386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Getting quotas for project 7535b42e7ff14503814a2837e2c7ccd8. Resources: {'ram', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:40:06.584631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Getting quotas for user 74c69e3cd37b412ba019551f1540ac7c and project 7535b42e7ff14503814a2837e2c7ccd8. Resources: {'ram', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:40:06.597863 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.compute.api [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] ram quota exceeded for 8a886ec6d50b40d183fc98583af6283f, tried to resize instance. Aug 02 07:40:06.598441 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Request method failure captured: Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e/action HTTP/1.1 Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 38 Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NTMkgY5tOjlnDo2UXyJMwOEwyHvAAVoiLGe1IjfhNh440CyuDOZBANnLTdDnT4_xYSUfF-ypmcEEIQs9tMYtkuCZw_AzCeDQIg993LSukvZ8cBLF5xm-GrFSaYhzoPq1mmJ9I99I2BiJtdlJ3XO_05UxB5lcW7Kdt7CvLf7eiyGbL8 Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8a886ec6d50b40d183fc98583af6283f Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1937403766 Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader,admin Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader,admin Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8a886ec6d50b40d183fc98583af6283f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8a886ec6d50b40d183fc98583af6283f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8a886ec6d50b40d183fc98583af6283f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8a886ec6d50b40d183fc98583af6283f"}]}] Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1937403766 Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8a886ec6d50b40d183fc98583af6283f Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1937403766 Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersAdminNegativeTestJSON-1937403766-project-admin Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 8198ed023e844f19acf543373a9f1d58 Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1937403766-project-admin Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: {"resize": {"flavorRef": "130754734"}} Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'af839438-729c-4cd1-b569-5340ca950e9e', 'body': {'resize': {'flavorRef': '130754734'}}} Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:40:06.607350 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-613dc9ee-c0b3-427b-b93e-56ffb7956203 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e/action" status: 403 len: 118 microversion: 2.1 time: 0.167662 Aug 02 07:40:06.612547 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3325/6578] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:40:06 2022] POST /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e/action => generated 118 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:40:06.618310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f95e50a6-254a-42bd-9c61-8e9c81d6bf36 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:06.619070 n-d-851337-3 devstack@n-api.service[126119]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:40:06.619070 n-d-851337-3 devstack@n-api.service[126119]: warnings.warn(msg) Aug 02 07:40:06.639211 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f95e50a6-254a-42bd-9c61-8e9c81d6bf36 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/130754734" status: 202 len: 0 microversion: 2.1 time: 0.024727 Aug 02 07:40:06.639783 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3254/6579] 10.222.0.79 () {58 vars in 1158 bytes} [Tue Aug 2 07:40:06 2022] DELETE /compute/v2.1/flavors/130754734 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:40:06.649870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6358e60d-d28c-4e00-941d-8c98d15619a3 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:06.671191 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6358e60d-d28c-4e00-941d-8c98d15619a3 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026518 Aug 02 07:40:06.671754 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3326/6580] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 07:40:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:06.698593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-30c5ebfd-9476-4617-8fc8-33daec794a19 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Calling method '.version_select at 0x7f927858a9d0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:06.741808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:40:06.776385 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-30c5ebfd-9476-4617-8fc8-33daec794a19 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/8a886ec6d50b40d183fc98583af6283f" status: 200 len: 371 microversion: 2.1 time: 0.081778 Aug 02 07:40:06.776964 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3255/6581] 10.222.0.79 () {58 vars in 1242 bytes} [Tue Aug 2 07:40:06 2022] GET /compute/v2.1/os-quota-sets/8a886ec6d50b40d183fc98583af6283f => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:40:06.788930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-97a60c7c-7961-4738-a992-ea5ca437b4c6 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-670717992", "id": 596920089, "os-flavor-access:is_public": "True"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:40:06.791918 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:40:06.791918 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 07:40:06.809986 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-97a60c7c-7961-4738-a992-ea5ca437b4c6 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.025068 Aug 02 07:40:06.810563 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3327/6582] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:40:06 2022] POST /compute/v2.1/flavors => generated 433 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:40:06.823195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "596920089"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:40:06.825600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:06.832236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:06.832704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:06.833494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:06.833943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:06.921580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8198ed023e844f19acf543373a9f1d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a886ec6d50b40d183fc98583af6283f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:06.928493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-670717992 {{(pid=126119) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 07:40:06.935248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:06.935715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:06.936527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:06.936977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:06.957815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Getting quotas for project 7535b42e7ff14503814a2837e2c7ccd8. Resources: {'ram', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:40:06.963129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Getting quotas for user 74c69e3cd37b412ba019551f1540ac7c and project 7535b42e7ff14503814a2837e2c7ccd8. Resources: {'ram', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:40:06.975927 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.compute.api [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] cores quota exceeded for 8a886ec6d50b40d183fc98583af6283f, tried to resize instance. Aug 02 07:40:06.976479 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Request method failure captured: Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e/action HTTP/1.1 Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 38 Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NTMkgY5tOjlnDo2UXyJMwOEwyHvAAVoiLGe1IjfhNh440CyuDOZBANnLTdDnT4_xYSUfF-ypmcEEIQs9tMYtkuCZw_AzCeDQIg993LSukvZ8cBLF5xm-GrFSaYhzoPq1mmJ9I99I2BiJtdlJ3XO_05UxB5lcW7Kdt7CvLf7eiyGbL8 Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 8a886ec6d50b40d183fc98583af6283f Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1937403766 Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader,admin Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader,admin Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8a886ec6d50b40d183fc98583af6283f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8a886ec6d50b40d183fc98583af6283f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8a886ec6d50b40d183fc98583af6283f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8a886ec6d50b40d183fc98583af6283f"}]}] Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1937403766 Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 8a886ec6d50b40d183fc98583af6283f Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1937403766 Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersAdminNegativeTestJSON-1937403766-project-admin Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 8198ed023e844f19acf543373a9f1d58 Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1937403766-project-admin Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: {"resize": {"flavorRef": "596920089"}} Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'af839438-729c-4cd1-b569-5340ca950e9e', 'body': {'resize': {'flavorRef': '596920089'}}} Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:40:06.978638 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f1842c81-c723-4ee8-bc26-a7f5e81c444e tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e/action" status: 403 len: 113 microversion: 2.1 time: 0.161287 Aug 02 07:40:06.983611 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3256/6583] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:40:06 2022] POST /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e/action => generated 113 bytes in 163 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:40:06.990797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a96a0a18-82ea-42fc-97ca-e74b8a8e99f6 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:06.991757 n-d-851337-3 devstack@n-api.service[126120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 07:40:06.991757 n-d-851337-3 devstack@n-api.service[126120]: warnings.warn(msg) Aug 02 07:40:07.016344 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a96a0a18-82ea-42fc-97ca-e74b8a8e99f6 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/596920089" status: 202 len: 0 microversion: 2.1 time: 0.030973 Aug 02 07:40:07.016947 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3328/6584] 10.222.0.79 () {58 vars in 1158 bytes} [Tue Aug 2 07:40:06 2022] DELETE /compute/v2.1/flavors/596920089 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:40:07.025518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bdba9201-ed37-40e4-ae14-769f8ff1d931 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:07.046343 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bdba9201-ed37-40e4-ae14-769f8ff1d931 tempest-ServersAdminNegativeTestJSON-1937403766 tempest-ServersAdminNegativeTestJSON-1937403766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024841 Aug 02 07:40:07.047168 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3257/6585] 10.222.0.79 () {58 vars in 1146 bytes} [Tue Aug 2 07:40:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:07.069224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b2e2dd5f-2e23-4d5f-b626-2eb8f32899a8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:07.069789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b2e2dd5f-2e23-4d5f-b626-2eb8f32899a8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:07.076704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2e2dd5f-2e23-4d5f-b626-2eb8f32899a8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:07.077157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2e2dd5f-2e23-4d5f-b626-2eb8f32899a8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:07.077946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2e2dd5f-2e23-4d5f-b626-2eb8f32899a8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:07.078458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b2e2dd5f-2e23-4d5f-b626-2eb8f32899a8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:07.104252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b2e2dd5f-2e23-4d5f-b626-2eb8f32899a8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:40:07.184757 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b2e2dd5f-2e23-4d5f-b626-2eb8f32899a8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] 10.222.0.79 "DELETE /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e" status: 204 len: 0 microversion: 2.1 time: 0.119290 Aug 02 07:40:07.185421 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3329/6586] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:40:07 2022] DELETE /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 07:40:07.193767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e87027f1-14d9-4375-aef3-22e202d1caa8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:07.194463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e87027f1-14d9-4375-aef3-22e202d1caa8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:07.201723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e87027f1-14d9-4375-aef3-22e202d1caa8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:07.202217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e87027f1-14d9-4375-aef3-22e202d1caa8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:07.203000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e87027f1-14d9-4375-aef3-22e202d1caa8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:07.203453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e87027f1-14d9-4375-aef3-22e202d1caa8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:07.334711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e87027f1-14d9-4375-aef3-22e202d1caa8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c69e3cd37b412ba019551f1540ac7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535b42e7ff14503814a2837e2c7ccd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:07.343073 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e87027f1-14d9-4375-aef3-22e202d1caa8 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] 10.222.0.79 "GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e" status: 200 len: 1477 microversion: 2.1 time: 0.153260 Aug 02 07:40:07.343654 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3258/6587] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:07 2022] GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:08.365247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-647350bc-3238-490a-b0d2-8fa1383ba870 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:08.365977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-647350bc-3238-490a-b0d2-8fa1383ba870 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:08.373739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-647350bc-3238-490a-b0d2-8fa1383ba870 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:08.374220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-647350bc-3238-490a-b0d2-8fa1383ba870 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:08.374999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-647350bc-3238-490a-b0d2-8fa1383ba870 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:08.375439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-647350bc-3238-490a-b0d2-8fa1383ba870 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:08.520260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-647350bc-3238-490a-b0d2-8fa1383ba870 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c69e3cd37b412ba019551f1540ac7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7535b42e7ff14503814a2837e2c7ccd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:08.528741 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-647350bc-3238-490a-b0d2-8fa1383ba870 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] 10.222.0.79 "GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e" status: 200 len: 1477 microversion: 2.1 time: 0.167877 Aug 02 07:40:08.529589 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3330/6588] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:08 2022] GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e => generated 1477 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:08.989924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-978f948a-b56d-4ce1-9a18-1c5fbf4b7d44 req-cc02b3fd-00c5-45ab-9545-89498f7b28c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af839438-729c-4cd1-b569-5340ca950e9e", "name": "network-vif-deleted", "tag": "182ff65d-9a55-4e68-838e-d7f3c236a952"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:40:09.003417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-978f948a-b56d-4ce1-9a18-1c5fbf4b7d44 req-cc02b3fd-00c5-45ab-9545-89498f7b28c5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:09.003876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-978f948a-b56d-4ce1-9a18-1c5fbf4b7d44 req-cc02b3fd-00c5-45ab-9545-89498f7b28c5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:09.016950 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-978f948a-b56d-4ce1-9a18-1c5fbf4b7d44 req-cc02b3fd-00c5-45ab-9545-89498f7b28c5 service nova] Creating event network-vif-deleted:182ff65d-9a55-4e68-838e-d7f3c236a952 for instance af839438-729c-4cd1-b569-5340ca950e9e on n-h2-851337-3 Aug 02 07:40:09.024473 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-978f948a-b56d-4ce1-9a18-1c5fbf4b7d44 req-cc02b3fd-00c5-45ab-9545-89498f7b28c5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039142 Aug 02 07:40:09.025837 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3259/6589] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:40:09.550280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-572c5087-2621-4a41-94ab-d89c78099d93 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:09.550856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-572c5087-2621-4a41-94ab-d89c78099d93 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] [instance: af839438-729c-4cd1-b569-5340ca950e9e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:09.558574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-572c5087-2621-4a41-94ab-d89c78099d93 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:09.559012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-572c5087-2621-4a41-94ab-d89c78099d93 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:09.559781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-572c5087-2621-4a41-94ab-d89c78099d93 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:09.560208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-572c5087-2621-4a41-94ab-d89c78099d93 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:09.577301 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-572c5087-2621-4a41-94ab-d89c78099d93 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] HTTP exception thrown: Instance af839438-729c-4cd1-b569-5340ca950e9e could not be found. Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-572c5087-2621-4a41-94ab-d89c78099d93 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Request method failure captured: Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e HTTP/1.1 Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NTLGIXMt3ALK-kyvtz9v1emttxJsRlCgUF11fUOZ0Aa45nkJ-6hMsFV4sNWNewCECtAsC5T3el_sUaN62j9nNYx81M8KQmDW8czdvhBpYecLUtapRiovkHhYDqxvjmESMH2r8e0d46HXRiivF12AUs73yO9va_0JS2idzYlIC1DHew Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 7535b42e7ff14503814a2837e2c7ccd8 Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1174501157 Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7535b42e7ff14503814a2837e2c7ccd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7535b42e7ff14503814a2837e2c7ccd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7535b42e7ff14503814a2837e2c7ccd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7535b42e7ff14503814a2837e2c7ccd8"}]}] Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1174501157 Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 7535b42e7ff14503814a2837e2c7ccd8 Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1174501157 Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersAdminNegativeTestJSON-1174501157-project Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 74c69e3cd37b412ba019551f1540ac7c Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1174501157-project Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance af839438-729c-4cd1-b569-5340ca950e9e could not be found. Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'af839438-729c-4cd1-b569-5340ca950e9e'} Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af839438-729c-4cd1-b569-5340ca950e9e could not be found. Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af839438-729c-4cd1-b569-5340ca950e9e could not be found. Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:40:09.578999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:40:09.584755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:40:09.584755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:40:09.584755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:40:09.584755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:40:09.584755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:40:09.584755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:40:09.584755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af839438-729c-4cd1-b569-5340ca950e9e could not be found. Aug 02 07:40:09.584755 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:40:09.584755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-572c5087-2621-4a41-94ab-d89c78099d93 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] Returning 404 to user: Instance af839438-729c-4cd1-b569-5340ca950e9e could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:40:09.584755 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-572c5087-2621-4a41-94ab-d89c78099d93 tempest-ServersAdminNegativeTestJSON-1174501157 tempest-ServersAdminNegativeTestJSON-1174501157-project] 10.222.0.79 "GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e" status: 404 len: 111 microversion: 2.1 time: 0.034286 Aug 02 07:40:09.584755 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3331/6590] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:09 2022] GET /compute/v2.1/servers/af839438-729c-4cd1-b569-5340ca950e9e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:40:15.989849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-987881096", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "fcfcac75-a38d-4cba-95e3-84930a471cea"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:40:16.044698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] validate_networks() for [('fcfcac75-a38d-4cba-95e3-84930a471cea', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:40:16.447582 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:40:16.448322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:40:16.449168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:40:16.449883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:40:16.450614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:40:16.462048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:16.462508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:16.463311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:16.463790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:16.481516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Getting quotas for project 35017d2b95cc499bbc4a80af6ff7b8c8. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:40:16.487397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Getting quotas for user 1bf2861424344f4eb401f2a598f576f7 and project 35017d2b95cc499bbc4a80af6ff7b8c8. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:40:16.501943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:40:16.504671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:40:16.564591 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7a8bf816-4177-410e-8c13-3f8e442959f6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699375 Aug 02 07:40:16.565446 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3260/6591] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:40:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:40:16.579448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7c2eb7f-5324-41ed-8287-bcc7e6aa17e9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:16.582101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e7c2eb7f-5324-41ed-8287-bcc7e6aa17e9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:16.586213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:40:16.587157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=5 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:40:16.657911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e7c2eb7f-5324-41ed-8287-bcc7e6aa17e9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:16.666813 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7c2eb7f-5324-41ed-8287-bcc7e6aa17e9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1214 microversion: 2.1 time: 0.094335 Aug 02 07:40:16.667471 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3332/6592] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:16 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:17.694262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-70913860-cdef-494b-b523-8593d59d9609 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:17.695561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-70913860-cdef-494b-b523-8593d59d9609 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:17.702358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70913860-cdef-494b-b523-8593d59d9609 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:17.703037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70913860-cdef-494b-b523-8593d59d9609 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:17.703990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70913860-cdef-494b-b523-8593d59d9609 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:17.705161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70913860-cdef-494b-b523-8593d59d9609 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:17.807523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-70913860-cdef-494b-b523-8593d59d9609 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:17.815921 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-70913860-cdef-494b-b523-8593d59d9609 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1272 microversion: 2.1 time: 0.127412 Aug 02 07:40:17.816524 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3261/6593] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:17 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1272 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:18.838077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-af3617dd-4d1f-44fc-9b3d-c7fce44992bd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:18.839493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-af3617dd-4d1f-44fc-9b3d-c7fce44992bd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:18.851293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af3617dd-4d1f-44fc-9b3d-c7fce44992bd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:18.852012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af3617dd-4d1f-44fc-9b3d-c7fce44992bd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:18.853038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af3617dd-4d1f-44fc-9b3d-c7fce44992bd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:18.853676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af3617dd-4d1f-44fc-9b3d-c7fce44992bd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:19.064496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-af3617dd-4d1f-44fc-9b3d-c7fce44992bd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:19.074854 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-af3617dd-4d1f-44fc-9b3d-c7fce44992bd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1314 microversion: 2.1 time: 0.241381 Aug 02 07:40:19.090094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-5279f000-d077-4657-a6b3-c96702693061 req-656b24c8-d644-40e4-b129-c4f831e7baab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c4cb1ae-69b7-4380-86a6-636b6da6909e", "tag": "8b4ca7c4-ee9a-4860-b39e-7d2578722c53"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:40:19.092991 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3333/6594] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:18 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:19.109104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5279f000-d077-4657-a6b3-c96702693061 req-656b24c8-d644-40e4-b129-c4f831e7baab service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:19.109562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5279f000-d077-4657-a6b3-c96702693061 req-656b24c8-d644-40e4-b129-c4f831e7baab service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:19.132425 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-5279f000-d077-4657-a6b3-c96702693061 req-656b24c8-d644-40e4-b129-c4f831e7baab service nova] Creating event network-changed:8b4ca7c4-ee9a-4860-b39e-7d2578722c53 for instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e on n-h2-851337-3 Aug 02 07:40:19.141395 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-5279f000-d077-4657-a6b3-c96702693061 req-656b24c8-d644-40e4-b129-c4f831e7baab service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057381 Aug 02 07:40:19.142050 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3262/6595] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:40:20.099108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8c677605-90a4-4d7c-b3b3-4b33407fe9d2 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:20.099977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8c677605-90a4-4d7c-b3b3-4b33407fe9d2 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:20.111428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c677605-90a4-4d7c-b3b3-4b33407fe9d2 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:20.112123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c677605-90a4-4d7c-b3b3-4b33407fe9d2 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:20.113365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c677605-90a4-4d7c-b3b3-4b33407fe9d2 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:20.114125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8c677605-90a4-4d7c-b3b3-4b33407fe9d2 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:20.251317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8c677605-90a4-4d7c-b3b3-4b33407fe9d2 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:20.260763 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8c677605-90a4-4d7c-b3b3-4b33407fe9d2 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1314 microversion: 2.1 time: 0.167597 Aug 02 07:40:20.261308 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3334/6596] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:20 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:21.289077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c6a7e48a-6def-483e-9c9d-a8d7495df464 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:21.290305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c6a7e48a-6def-483e-9c9d-a8d7495df464 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:21.301805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6a7e48a-6def-483e-9c9d-a8d7495df464 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:21.302624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6a7e48a-6def-483e-9c9d-a8d7495df464 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:21.303972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6a7e48a-6def-483e-9c9d-a8d7495df464 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:21.304419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c6a7e48a-6def-483e-9c9d-a8d7495df464 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:21.468046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c6a7e48a-6def-483e-9c9d-a8d7495df464 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:21.478376 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c6a7e48a-6def-483e-9c9d-a8d7495df464 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1314 microversion: 2.1 time: 0.197862 Aug 02 07:40:21.479282 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3263/6597] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:21 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:22.504861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8f7b2372-4d0d-4266-90b8-7f1b7bd35fef tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:22.505455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8f7b2372-4d0d-4266-90b8-7f1b7bd35fef tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:22.512821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7b2372-4d0d-4266-90b8-7f1b7bd35fef tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:22.513275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7b2372-4d0d-4266-90b8-7f1b7bd35fef tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:22.514468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7b2372-4d0d-4266-90b8-7f1b7bd35fef tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:22.514621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f7b2372-4d0d-4266-90b8-7f1b7bd35fef tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:22.648453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8f7b2372-4d0d-4266-90b8-7f1b7bd35fef tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:22.656130 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8f7b2372-4d0d-4266-90b8-7f1b7bd35fef tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1314 microversion: 2.1 time: 0.155662 Aug 02 07:40:22.656715 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3335/6598] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:22 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:23.681153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ed04d932-44c9-4a12-9a95-7eaf08c403f8 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:23.682026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ed04d932-44c9-4a12-9a95-7eaf08c403f8 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:23.691774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed04d932-44c9-4a12-9a95-7eaf08c403f8 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:23.692395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed04d932-44c9-4a12-9a95-7eaf08c403f8 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:23.693453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed04d932-44c9-4a12-9a95-7eaf08c403f8 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:23.694116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed04d932-44c9-4a12-9a95-7eaf08c403f8 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:23.840822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ed04d932-44c9-4a12-9a95-7eaf08c403f8 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:23.849280 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ed04d932-44c9-4a12-9a95-7eaf08c403f8 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1314 microversion: 2.1 time: 0.174362 Aug 02 07:40:23.849838 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3264/6599] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:23 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:24.433914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-40d25229-7b46-4b69-b6fb-357ed719dbd4 req-c9a05325-60ab-408f-85a1-7ea09187ef23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4cb1ae-69b7-4380-86a6-636b6da6909e", "name": "network-vif-plugged", "status": "completed", "tag": "8b4ca7c4-ee9a-4860-b39e-7d2578722c53"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:40:24.446403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-40d25229-7b46-4b69-b6fb-357ed719dbd4 req-c9a05325-60ab-408f-85a1-7ea09187ef23 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:24.446867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-40d25229-7b46-4b69-b6fb-357ed719dbd4 req-c9a05325-60ab-408f-85a1-7ea09187ef23 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:24.458350 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-40d25229-7b46-4b69-b6fb-357ed719dbd4 req-c9a05325-60ab-408f-85a1-7ea09187ef23 service nova] Creating event network-vif-plugged:8b4ca7c4-ee9a-4860-b39e-7d2578722c53 for instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e on n-h2-851337-3 Aug 02 07:40:24.463599 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-40d25229-7b46-4b69-b6fb-357ed719dbd4 req-c9a05325-60ab-408f-85a1-7ea09187ef23 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033611 Aug 02 07:40:24.464603 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3336/6600] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:40:24.876739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e459d723-c1fe-4bf3-a164-8af9bc768138 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:24.877367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e459d723-c1fe-4bf3-a164-8af9bc768138 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:24.885265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e459d723-c1fe-4bf3-a164-8af9bc768138 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:24.885732 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e459d723-c1fe-4bf3-a164-8af9bc768138 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:24.886580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e459d723-c1fe-4bf3-a164-8af9bc768138 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:24.887151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e459d723-c1fe-4bf3-a164-8af9bc768138 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:25.016746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e459d723-c1fe-4bf3-a164-8af9bc768138 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:25.024786 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e459d723-c1fe-4bf3-a164-8af9bc768138 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1314 microversion: 2.1 time: 0.152098 Aug 02 07:40:25.025363 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3265/6601] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:24 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:26.056403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2da57ead-951f-4f7b-88f2-a453851d8eb9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:26.057057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2da57ead-951f-4f7b-88f2-a453851d8eb9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:26.064678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2da57ead-951f-4f7b-88f2-a453851d8eb9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:26.065150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2da57ead-951f-4f7b-88f2-a453851d8eb9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:26.065974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2da57ead-951f-4f7b-88f2-a453851d8eb9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:26.066420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2da57ead-951f-4f7b-88f2-a453851d8eb9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:26.520454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2da57ead-951f-4f7b-88f2-a453851d8eb9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:26.523640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:40:26.530426 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2da57ead-951f-4f7b-88f2-a453851d8eb9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1501 microversion: 2.1 time: 0.479702 Aug 02 07:40:26.531005 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3337/6602] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:26 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1501 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:26.551828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5b7ffce6-edcc-4236-b001-50539719ae1d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:40:26.554459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5b7ffce6-edcc-4236-b001-50539719ae1d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:26.557327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=5 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:40:26.558789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=8 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:40:26.564019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b7ffce6-edcc-4236-b001-50539719ae1d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:26.564506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b7ffce6-edcc-4236-b001-50539719ae1d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:26.565285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b7ffce6-edcc-4236-b001-50539719ae1d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:26.565736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b7ffce6-edcc-4236-b001-50539719ae1d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:26.594422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5b7ffce6-edcc-4236-b001-50539719ae1d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:26.600534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5b7ffce6-edcc-4236-b001-50539719ae1d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Old instance type m1.heat2, new instance type m1.heat {{(pid=126119) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 07:40:26.607221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5b7ffce6-edcc-4236-b001-50539719ae1d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:40:26.607687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5b7ffce6-edcc-4236-b001-50539719ae1d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:40:26.608176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5b7ffce6-edcc-4236-b001-50539719ae1d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:40:26.608602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5b7ffce6-edcc-4236-b001-50539719ae1d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:40:26.609028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5b7ffce6-edcc-4236-b001-50539719ae1d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:40:26.686149 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5b7ffce6-edcc-4236-b001-50539719ae1d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "POST /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e/action" status: 202 len: 0 microversion: 2.1 time: 0.137769 Aug 02 07:40:26.687017 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3266/6603] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:40:26 2022] POST /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:40:26.695096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e3a9b29-984a-49e5-9d49-68243ec3b96e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:26.695986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7e3a9b29-984a-49e5-9d49-68243ec3b96e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:26.699760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:40:26.700446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:40:26.705519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e3a9b29-984a-49e5-9d49-68243ec3b96e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:26.705996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e3a9b29-984a-49e5-9d49-68243ec3b96e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:26.706942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e3a9b29-984a-49e5-9d49-68243ec3b96e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:26.707377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e3a9b29-984a-49e5-9d49-68243ec3b96e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:26.883343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7e3a9b29-984a-49e5-9d49-68243ec3b96e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:26.891391 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7e3a9b29-984a-49e5-9d49-68243ec3b96e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1510 microversion: 2.1 time: 0.200210 Aug 02 07:40:26.891984 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3338/6604] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:26 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:27.913927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e94773e5-e16f-4c12-b173-779a21fb2d2c tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:27.914579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e94773e5-e16f-4c12-b173-779a21fb2d2c tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:27.917441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:40:27.924208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e94773e5-e16f-4c12-b173-779a21fb2d2c tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:27.924677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e94773e5-e16f-4c12-b173-779a21fb2d2c tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:27.925470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e94773e5-e16f-4c12-b173-779a21fb2d2c tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:27.925942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e94773e5-e16f-4c12-b173-779a21fb2d2c tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:27.930144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:40:28.070438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e94773e5-e16f-4c12-b173-779a21fb2d2c tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:28.078637 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e94773e5-e16f-4c12-b173-779a21fb2d2c tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1510 microversion: 2.1 time: 0.169306 Aug 02 07:40:28.079221 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3267/6605] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:27 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:29.100396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ea808b1-5fb8-4e66-9e4a-b63be8e7f6cf tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:29.101023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9ea808b1-5fb8-4e66-9e4a-b63be8e7f6cf tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:29.108571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ea808b1-5fb8-4e66-9e4a-b63be8e7f6cf tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:29.109349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ea808b1-5fb8-4e66-9e4a-b63be8e7f6cf tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:29.110382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ea808b1-5fb8-4e66-9e4a-b63be8e7f6cf tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:29.110834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ea808b1-5fb8-4e66-9e4a-b63be8e7f6cf tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:29.252319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9ea808b1-5fb8-4e66-9e4a-b63be8e7f6cf tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:29.262243 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9ea808b1-5fb8-4e66-9e4a-b63be8e7f6cf tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.165812 Aug 02 07:40:29.262801 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3339/6606] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:29 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:30.288140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-eaf27421-8249-4687-bab5-720c8b2aa449 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:30.289215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-eaf27421-8249-4687-bab5-720c8b2aa449 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:30.300956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eaf27421-8249-4687-bab5-720c8b2aa449 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:30.301709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eaf27421-8249-4687-bab5-720c8b2aa449 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:30.303024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eaf27421-8249-4687-bab5-720c8b2aa449 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:30.303767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-eaf27421-8249-4687-bab5-720c8b2aa449 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:30.453276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-eaf27421-8249-4687-bab5-720c8b2aa449 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:30.463377 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-eaf27421-8249-4687-bab5-720c8b2aa449 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.181953 Aug 02 07:40:30.463945 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3268/6607] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:30 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:31.488870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-19fb46ea-a84c-4d08-a633-44272e0a8c56 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:31.490068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-19fb46ea-a84c-4d08-a633-44272e0a8c56 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:31.501931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19fb46ea-a84c-4d08-a633-44272e0a8c56 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:31.502703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19fb46ea-a84c-4d08-a633-44272e0a8c56 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:31.503952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19fb46ea-a84c-4d08-a633-44272e0a8c56 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:31.505067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-19fb46ea-a84c-4d08-a633-44272e0a8c56 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:31.644300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-19fb46ea-a84c-4d08-a633-44272e0a8c56 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:31.655848 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-19fb46ea-a84c-4d08-a633-44272e0a8c56 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.173410 Aug 02 07:40:31.656620 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3340/6608] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:31 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:32.683563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d2d978de-bfdf-4f26-b61f-d8cc9171c5cb tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:32.684363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d2d978de-bfdf-4f26-b61f-d8cc9171c5cb tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:32.693043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2d978de-bfdf-4f26-b61f-d8cc9171c5cb tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:32.693587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2d978de-bfdf-4f26-b61f-d8cc9171c5cb tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:32.694549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2d978de-bfdf-4f26-b61f-d8cc9171c5cb tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:32.695081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2d978de-bfdf-4f26-b61f-d8cc9171c5cb tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:32.836334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d2d978de-bfdf-4f26-b61f-d8cc9171c5cb tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:32.844406 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d2d978de-bfdf-4f26-b61f-d8cc9171c5cb tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.166528 Aug 02 07:40:32.844997 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3269/6609] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:32 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:33.866920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ee25f28b-5bad-4733-ba62-3404bfaab714 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:33.867560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ee25f28b-5bad-4733-ba62-3404bfaab714 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:33.875203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee25f28b-5bad-4733-ba62-3404bfaab714 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:33.875649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee25f28b-5bad-4733-ba62-3404bfaab714 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:33.876415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee25f28b-5bad-4733-ba62-3404bfaab714 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:33.876850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee25f28b-5bad-4733-ba62-3404bfaab714 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:34.015940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ee25f28b-5bad-4733-ba62-3404bfaab714 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:34.026944 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ee25f28b-5bad-4733-ba62-3404bfaab714 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.164028 Aug 02 07:40:34.027521 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3341/6610] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:33 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:35.053452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ec7b34cf-c579-49a9-9ec2-e5c011ece24d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:35.054505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ec7b34cf-c579-49a9-9ec2-e5c011ece24d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:35.062105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec7b34cf-c579-49a9-9ec2-e5c011ece24d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:35.062576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec7b34cf-c579-49a9-9ec2-e5c011ece24d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:35.063348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec7b34cf-c579-49a9-9ec2-e5c011ece24d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:35.063790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec7b34cf-c579-49a9-9ec2-e5c011ece24d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:35.203487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ec7b34cf-c579-49a9-9ec2-e5c011ece24d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:35.215391 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ec7b34cf-c579-49a9-9ec2-e5c011ece24d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.168260 Aug 02 07:40:35.216114 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3270/6611] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:35 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:36.245081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0f484342-78bb-4b68-b4ce-8cda0b7c90c0 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:36.245769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0f484342-78bb-4b68-b4ce-8cda0b7c90c0 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:36.255228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f484342-78bb-4b68-b4ce-8cda0b7c90c0 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:36.255758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f484342-78bb-4b68-b4ce-8cda0b7c90c0 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:36.256736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f484342-78bb-4b68-b4ce-8cda0b7c90c0 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:36.257243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0f484342-78bb-4b68-b4ce-8cda0b7c90c0 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:36.395960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0f484342-78bb-4b68-b4ce-8cda0b7c90c0 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:36.405501 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0f484342-78bb-4b68-b4ce-8cda0b7c90c0 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.166766 Aug 02 07:40:36.406171 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3342/6612] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:36 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:37.436671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4e0b90aa-3b73-4007-87b5-e833a1c1d951 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:37.437755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4e0b90aa-3b73-4007-87b5-e833a1c1d951 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:37.452176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e0b90aa-3b73-4007-87b5-e833a1c1d951 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:37.452907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e0b90aa-3b73-4007-87b5-e833a1c1d951 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:37.453805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e0b90aa-3b73-4007-87b5-e833a1c1d951 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:37.454269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4e0b90aa-3b73-4007-87b5-e833a1c1d951 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:37.607677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4e0b90aa-3b73-4007-87b5-e833a1c1d951 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:37.616396 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4e0b90aa-3b73-4007-87b5-e833a1c1d951 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.191265 Aug 02 07:40:37.616959 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3271/6613] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:37 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:38.642716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-93e80d9a-6e2b-4d4e-8d83-7073c5efd70e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:38.643728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-93e80d9a-6e2b-4d4e-8d83-7073c5efd70e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:38.653165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93e80d9a-6e2b-4d4e-8d83-7073c5efd70e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:38.653619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93e80d9a-6e2b-4d4e-8d83-7073c5efd70e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:38.654418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93e80d9a-6e2b-4d4e-8d83-7073c5efd70e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:38.654861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93e80d9a-6e2b-4d4e-8d83-7073c5efd70e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:38.798242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-93e80d9a-6e2b-4d4e-8d83-7073c5efd70e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:38.806029 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-93e80d9a-6e2b-4d4e-8d83-7073c5efd70e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.170166 Aug 02 07:40:38.806657 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3343/6614] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:38 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:39.829057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d71e51d7-b02a-4a6c-893e-2bc228fc7886 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:39.829810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d71e51d7-b02a-4a6c-893e-2bc228fc7886 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:39.838311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d71e51d7-b02a-4a6c-893e-2bc228fc7886 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:39.838840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d71e51d7-b02a-4a6c-893e-2bc228fc7886 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:39.839811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d71e51d7-b02a-4a6c-893e-2bc228fc7886 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:39.840343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d71e51d7-b02a-4a6c-893e-2bc228fc7886 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:39.985601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d71e51d7-b02a-4a6c-893e-2bc228fc7886 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:39.993643 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d71e51d7-b02a-4a6c-893e-2bc228fc7886 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.169069 Aug 02 07:40:39.994273 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3272/6615] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:39 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:41.019418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-51bb97e0-8d56-4a13-a648-f7e28cd98b3f tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:41.020515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-51bb97e0-8d56-4a13-a648-f7e28cd98b3f tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:41.030508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51bb97e0-8d56-4a13-a648-f7e28cd98b3f tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:41.030963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51bb97e0-8d56-4a13-a648-f7e28cd98b3f tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:41.031766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51bb97e0-8d56-4a13-a648-f7e28cd98b3f tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:41.032197 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51bb97e0-8d56-4a13-a648-f7e28cd98b3f tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:41.172329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-51bb97e0-8d56-4a13-a648-f7e28cd98b3f tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:41.180572 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-51bb97e0-8d56-4a13-a648-f7e28cd98b3f tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.167878 Aug 02 07:40:41.181159 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3344/6616] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:41 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:42.206326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-29f91db0-1b19-4542-9762-fae5acb3d884 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:42.207375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-29f91db0-1b19-4542-9762-fae5acb3d884 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:42.217480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f91db0-1b19-4542-9762-fae5acb3d884 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:42.217977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f91db0-1b19-4542-9762-fae5acb3d884 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:42.218762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f91db0-1b19-4542-9762-fae5acb3d884 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:42.219212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29f91db0-1b19-4542-9762-fae5acb3d884 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:42.357257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-29f91db0-1b19-4542-9762-fae5acb3d884 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:42.365356 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-29f91db0-1b19-4542-9762-fae5acb3d884 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.165670 Aug 02 07:40:42.365956 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3273/6617] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:42 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:43.390906 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ca4991c7-f60b-4b4f-8ba2-7f7f92d1f6d6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:43.391552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ca4991c7-f60b-4b4f-8ba2-7f7f92d1f6d6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:43.398969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca4991c7-f60b-4b4f-8ba2-7f7f92d1f6d6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:43.399415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca4991c7-f60b-4b4f-8ba2-7f7f92d1f6d6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:43.400176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca4991c7-f60b-4b4f-8ba2-7f7f92d1f6d6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:43.400612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca4991c7-f60b-4b4f-8ba2-7f7f92d1f6d6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:43.540907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ca4991c7-f60b-4b4f-8ba2-7f7f92d1f6d6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:43.548963 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ca4991c7-f60b-4b4f-8ba2-7f7f92d1f6d6 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.162521 Aug 02 07:40:43.549587 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3345/6618] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:43 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:44.575125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-de521e45-2d4c-4c0b-aca5-1efcd8ccd051 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:44.576171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-de521e45-2d4c-4c0b-aca5-1efcd8ccd051 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:44.588001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de521e45-2d4c-4c0b-aca5-1efcd8ccd051 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:44.588762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de521e45-2d4c-4c0b-aca5-1efcd8ccd051 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:44.590301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de521e45-2d4c-4c0b-aca5-1efcd8ccd051 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:44.590753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de521e45-2d4c-4c0b-aca5-1efcd8ccd051 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:44.745432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-de521e45-2d4c-4c0b-aca5-1efcd8ccd051 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:44.751635 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-de521e45-2d4c-4c0b-aca5-1efcd8ccd051 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.183567 Aug 02 07:40:44.752224 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3274/6619] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:44 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:45.773605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7f91c10f-4730-4f1d-a17d-4ce4e9fd2625 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:45.774270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7f91c10f-4730-4f1d-a17d-4ce4e9fd2625 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:45.782090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f91c10f-4730-4f1d-a17d-4ce4e9fd2625 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:45.782537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f91c10f-4730-4f1d-a17d-4ce4e9fd2625 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:45.783304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f91c10f-4730-4f1d-a17d-4ce4e9fd2625 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:45.783742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f91c10f-4730-4f1d-a17d-4ce4e9fd2625 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:45.924535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7f91c10f-4730-4f1d-a17d-4ce4e9fd2625 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:45.935576 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7f91c10f-4730-4f1d-a17d-4ce4e9fd2625 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.165971 Aug 02 07:40:45.936164 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3346/6620] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:45 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:46.960907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e54c2e7e-03ba-44ce-8e95-d2bc602a778d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:46.961921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e54c2e7e-03ba-44ce-8e95-d2bc602a778d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:46.970667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e54c2e7e-03ba-44ce-8e95-d2bc602a778d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:46.971127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e54c2e7e-03ba-44ce-8e95-d2bc602a778d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:46.971906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e54c2e7e-03ba-44ce-8e95-d2bc602a778d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:46.972347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e54c2e7e-03ba-44ce-8e95-d2bc602a778d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:47.121857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e54c2e7e-03ba-44ce-8e95-d2bc602a778d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:47.130399 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e54c2e7e-03ba-44ce-8e95-d2bc602a778d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.176034 Aug 02 07:40:47.130998 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3275/6621] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:46 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:48.156322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7dea9677-8a77-42ce-94c5-5338047d42db tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:48.156888 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7dea9677-8a77-42ce-94c5-5338047d42db tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:48.164235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dea9677-8a77-42ce-94c5-5338047d42db tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:48.164682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dea9677-8a77-42ce-94c5-5338047d42db tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:48.165459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dea9677-8a77-42ce-94c5-5338047d42db tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:48.165886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dea9677-8a77-42ce-94c5-5338047d42db tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:48.330818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7dea9677-8a77-42ce-94c5-5338047d42db tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:48.341057 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7dea9677-8a77-42ce-94c5-5338047d42db tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.189398 Aug 02 07:40:48.341615 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3347/6622] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:48 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:49.367849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1c092934-6b73-4ee3-b903-cf8f0fddd86b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:49.368966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1c092934-6b73-4ee3-b903-cf8f0fddd86b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:49.377385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c092934-6b73-4ee3-b903-cf8f0fddd86b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:49.377919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c092934-6b73-4ee3-b903-cf8f0fddd86b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:49.378699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c092934-6b73-4ee3-b903-cf8f0fddd86b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:49.379159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c092934-6b73-4ee3-b903-cf8f0fddd86b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:49.522936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1c092934-6b73-4ee3-b903-cf8f0fddd86b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:49.531545 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1c092934-6b73-4ee3-b903-cf8f0fddd86b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.171140 Aug 02 07:40:49.532138 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3276/6623] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:49 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:50.553171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-79231640-6771-47e9-94d5-3a947e2248cd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:50.553835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-79231640-6771-47e9-94d5-3a947e2248cd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:50.561736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79231640-6771-47e9-94d5-3a947e2248cd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:50.562217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79231640-6771-47e9-94d5-3a947e2248cd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:50.562974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79231640-6771-47e9-94d5-3a947e2248cd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:50.563420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79231640-6771-47e9-94d5-3a947e2248cd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:50.700778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-79231640-6771-47e9-94d5-3a947e2248cd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:50.708434 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-79231640-6771-47e9-94d5-3a947e2248cd tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.159497 Aug 02 07:40:50.708985 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3348/6624] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:50 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:51.733841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-714386ab-fdb9-4ce8-8efc-9e0a4a62ed8e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:51.734703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-714386ab-fdb9-4ce8-8efc-9e0a4a62ed8e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:51.744282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-714386ab-fdb9-4ce8-8efc-9e0a4a62ed8e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:51.744896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-714386ab-fdb9-4ce8-8efc-9e0a4a62ed8e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:51.746063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-714386ab-fdb9-4ce8-8efc-9e0a4a62ed8e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:51.746659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-714386ab-fdb9-4ce8-8efc-9e0a4a62ed8e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:51.893279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-714386ab-fdb9-4ce8-8efc-9e0a4a62ed8e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:51.904603 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-714386ab-fdb9-4ce8-8efc-9e0a4a62ed8e tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.177145 Aug 02 07:40:51.905424 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3277/6625] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:51 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:52.935727 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a08a757e-0cca-45ca-93ef-1956d55cfd09 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:52.936703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a08a757e-0cca-45ca-93ef-1956d55cfd09 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:52.948618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a08a757e-0cca-45ca-93ef-1956d55cfd09 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:52.949547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a08a757e-0cca-45ca-93ef-1956d55cfd09 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:52.950869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a08a757e-0cca-45ca-93ef-1956d55cfd09 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:52.951498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a08a757e-0cca-45ca-93ef-1956d55cfd09 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:53.098004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a08a757e-0cca-45ca-93ef-1956d55cfd09 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:53.106830 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a08a757e-0cca-45ca-93ef-1956d55cfd09 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.177802 Aug 02 07:40:53.107491 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3349/6626] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:52 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:54.138629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-855b8eb4-86c2-4c4f-92ba-0a15711a8b9d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:54.139213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-855b8eb4-86c2-4c4f-92ba-0a15711a8b9d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:54.146633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-855b8eb4-86c2-4c4f-92ba-0a15711a8b9d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:54.147091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-855b8eb4-86c2-4c4f-92ba-0a15711a8b9d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:54.147866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-855b8eb4-86c2-4c4f-92ba-0a15711a8b9d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:54.148309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-855b8eb4-86c2-4c4f-92ba-0a15711a8b9d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:54.307391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-855b8eb4-86c2-4c4f-92ba-0a15711a8b9d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:54.318416 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-855b8eb4-86c2-4c4f-92ba-0a15711a8b9d tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.186505 Aug 02 07:40:54.319177 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3278/6627] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:54 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:40:55.345635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83276357-84ea-47f0-be3e-e2f36e56fb83 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:55.346428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-83276357-84ea-47f0-be3e-e2f36e56fb83 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:55.356036 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83276357-84ea-47f0-be3e-e2f36e56fb83 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:55.356630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83276357-84ea-47f0-be3e-e2f36e56fb83 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:55.357642 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83276357-84ea-47f0-be3e-e2f36e56fb83 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:55.358257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83276357-84ea-47f0-be3e-e2f36e56fb83 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:55.495259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-83276357-84ea-47f0-be3e-e2f36e56fb83 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:55.503444 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-83276357-84ea-47f0-be3e-e2f36e56fb83 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1515 microversion: 2.1 time: 0.163709 Aug 02 07:40:55.503987 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3350/6628] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:55 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:56.375047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c83d05bc-47ce-4567-a24e-6f91d6562651 req-59a7632a-eff7-40a8-b766-82fd69b0b0ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4cb1ae-69b7-4380-86a6-636b6da6909e", "name": "network-vif-unplugged", "status": "completed", "tag": "8b4ca7c4-ee9a-4860-b39e-7d2578722c53"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:40:56.385822 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c83d05bc-47ce-4567-a24e-6f91d6562651 req-59a7632a-eff7-40a8-b766-82fd69b0b0ae service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:56.386319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c83d05bc-47ce-4567-a24e-6f91d6562651 req-59a7632a-eff7-40a8-b766-82fd69b0b0ae service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:56.398354 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c83d05bc-47ce-4567-a24e-6f91d6562651 req-59a7632a-eff7-40a8-b766-82fd69b0b0ae service nova] Creating event network-vif-unplugged:8b4ca7c4-ee9a-4860-b39e-7d2578722c53 for instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e on n-h1-851337-3 Aug 02 07:40:56.404043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-c83d05bc-47ce-4567-a24e-6f91d6562651 req-59a7632a-eff7-40a8-b766-82fd69b0b0ae service nova] Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:40:56.416048 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c83d05bc-47ce-4567-a24e-6f91d6562651 req-59a7632a-eff7-40a8-b766-82fd69b0b0ae service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044022 Aug 02 07:40:56.416048 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3279/6629] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:40:56.524960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c6daeb27-9b39-42fd-9172-e0618792a12b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:56.525599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c6daeb27-9b39-42fd-9172-e0618792a12b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:56.533216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6daeb27-9b39-42fd-9172-e0618792a12b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:56.533661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6daeb27-9b39-42fd-9172-e0618792a12b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:56.534483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6daeb27-9b39-42fd-9172-e0618792a12b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:56.534919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c6daeb27-9b39-42fd-9172-e0618792a12b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:56.680055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c6daeb27-9b39-42fd-9172-e0618792a12b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:56.688235 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c6daeb27-9b39-42fd-9172-e0618792a12b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1514 microversion: 2.1 time: 0.167199 Aug 02 07:40:56.688826 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3351/6630] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:56 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:57.711100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7ff4ee37-22f7-4faf-b4d7-7aefaa7fd0e9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:57.711749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7ff4ee37-22f7-4faf-b4d7-7aefaa7fd0e9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:57.719051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ff4ee37-22f7-4faf-b4d7-7aefaa7fd0e9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:57.719512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ff4ee37-22f7-4faf-b4d7-7aefaa7fd0e9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:57.720290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ff4ee37-22f7-4faf-b4d7-7aefaa7fd0e9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:57.720735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ff4ee37-22f7-4faf-b4d7-7aefaa7fd0e9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:57.874107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7ff4ee37-22f7-4faf-b4d7-7aefaa7fd0e9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:57.882566 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7ff4ee37-22f7-4faf-b4d7-7aefaa7fd0e9 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1512 microversion: 2.1 time: 0.176933 Aug 02 07:40:57.883151 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3280/6631] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:57 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:40:58.436052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e77584b7-9e1d-4960-ac80-96aa5d82e466 req-ea4b8d57-5e23-4eb2-9945-0149e6362f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c4cb1ae-69b7-4380-86a6-636b6da6909e", "tag": "8b4ca7c4-ee9a-4860-b39e-7d2578722c53"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:40:58.441554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=28 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:40:58.447305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e77584b7-9e1d-4960-ac80-96aa5d82e466 req-ea4b8d57-5e23-4eb2-9945-0149e6362f20 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:58.447733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e77584b7-9e1d-4960-ac80-96aa5d82e466 req-ea4b8d57-5e23-4eb2-9945-0149e6362f20 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:58.450620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=86 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:40:58.462870 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e77584b7-9e1d-4960-ac80-96aa5d82e466 req-ea4b8d57-5e23-4eb2-9945-0149e6362f20 service nova] Creating event network-changed:8b4ca7c4-ee9a-4860-b39e-7d2578722c53 for instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e on n-h1-851337-3 Aug 02 07:40:58.468325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-e77584b7-9e1d-4960-ac80-96aa5d82e466 req-ea4b8d57-5e23-4eb2-9945-0149e6362f20 service nova] Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:40:58.481667 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e77584b7-9e1d-4960-ac80-96aa5d82e466 req-ea4b8d57-5e23-4eb2-9945-0149e6362f20 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051698 Aug 02 07:40:58.482427 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3352/6632] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:40:58.905049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1823f6da-6425-4661-b0bb-e56cb595cd06 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:40:58.905722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1823f6da-6425-4661-b0bb-e56cb595cd06 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:40:58.908721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=28 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:40:58.915167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1823f6da-6425-4661-b0bb-e56cb595cd06 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:58.915634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1823f6da-6425-4661-b0bb-e56cb595cd06 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:58.916424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1823f6da-6425-4661-b0bb-e56cb595cd06 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:40:58.916902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1823f6da-6425-4661-b0bb-e56cb595cd06 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:40:58.919756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=82 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:40:59.077179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1823f6da-6425-4661-b0bb-e56cb595cd06 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:40:59.086180 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1823f6da-6425-4661-b0bb-e56cb595cd06 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1512 microversion: 2.1 time: 0.185364 Aug 02 07:40:59.087170 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3281/6633] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:40:58 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:00.109912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a63864e6-f233-4efd-959a-5c1bc69588ec tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:00.110487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a63864e6-f233-4efd-959a-5c1bc69588ec tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:00.117205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a63864e6-f233-4efd-959a-5c1bc69588ec tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:00.117646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a63864e6-f233-4efd-959a-5c1bc69588ec tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:00.118436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a63864e6-f233-4efd-959a-5c1bc69588ec tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:00.118861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a63864e6-f233-4efd-959a-5c1bc69588ec tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:00.251564 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a63864e6-f233-4efd-959a-5c1bc69588ec tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:00.259795 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a63864e6-f233-4efd-959a-5c1bc69588ec tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1512 microversion: 2.1 time: 0.155611 Aug 02 07:41:00.260379 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3353/6634] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:00 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:01.284464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-259a399b-f69e-4668-b173-a0956a15c120 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:01.285235 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-259a399b-f69e-4668-b173-a0956a15c120 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:01.295280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-259a399b-f69e-4668-b173-a0956a15c120 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:01.295887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-259a399b-f69e-4668-b173-a0956a15c120 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:01.296922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-259a399b-f69e-4668-b173-a0956a15c120 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:01.297485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-259a399b-f69e-4668-b173-a0956a15c120 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:01.441652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-259a399b-f69e-4668-b173-a0956a15c120 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:01.449504 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-259a399b-f69e-4668-b173-a0956a15c120 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1509 microversion: 2.1 time: 0.171226 Aug 02 07:41:01.450130 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3282/6635] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:01 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:01.476946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-69e5ad6a-2d07-4f75-a471-e64c10cb6689 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:01.477468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-69e5ad6a-2d07-4f75-a471-e64c10cb6689 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:01.484652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69e5ad6a-2d07-4f75-a471-e64c10cb6689 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:01.485102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69e5ad6a-2d07-4f75-a471-e64c10cb6689 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:01.485914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69e5ad6a-2d07-4f75-a471-e64c10cb6689 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:01.486350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69e5ad6a-2d07-4f75-a471-e64c10cb6689 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:01.512436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-69e5ad6a-2d07-4f75-a471-e64c10cb6689 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:41:01.568755 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.compute.api [None req-69e5ad6a-2d07-4f75-a471-e64c10cb6689 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Found an unconfirmed migration during delete, id: 16, status: finished Aug 02 07:41:02.952478 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-69e5ad6a-2d07-4f75-a471-e64c10cb6689 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 204 len: 0 microversion: 2.1 time: 1.479011 Aug 02 07:41:02.953218 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3354/6636] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:41:01 2022] DELETE /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 0 bytes in 1481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:41:02.961544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-95177b23-4453-4792-897c-aa312ee260f7 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:02.962198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-95177b23-4453-4792-897c-aa312ee260f7 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:02.969661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95177b23-4453-4792-897c-aa312ee260f7 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:02.970152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95177b23-4453-4792-897c-aa312ee260f7 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:02.970931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95177b23-4453-4792-897c-aa312ee260f7 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:02.971375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-95177b23-4453-4792-897c-aa312ee260f7 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:03.116274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-95177b23-4453-4792-897c-aa312ee260f7 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:03.124365 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-95177b23-4453-4792-897c-aa312ee260f7 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1501 microversion: 2.1 time: 0.166788 Aug 02 07:41:03.124944 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3283/6637] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:02 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:04.147096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ee60e207-94ac-44f2-8d1a-be350e2167ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:04.147829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ee60e207-94ac-44f2-8d1a-be350e2167ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:04.155190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee60e207-94ac-44f2-8d1a-be350e2167ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:04.155644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee60e207-94ac-44f2-8d1a-be350e2167ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:04.156418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee60e207-94ac-44f2-8d1a-be350e2167ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:04.156878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee60e207-94ac-44f2-8d1a-be350e2167ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:04.219379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-3cdd07c2-831b-4054-9871-8f53c56c239a req-33ce02d1-47d7-4ab9-9eb3-0f566e3d9070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4cb1ae-69b7-4380-86a6-636b6da6909e", "name": "network-vif-plugged", "status": "completed", "tag": "8b4ca7c4-ee9a-4860-b39e-7d2578722c53"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:41:04.231574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3cdd07c2-831b-4054-9871-8f53c56c239a req-33ce02d1-47d7-4ab9-9eb3-0f566e3d9070 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:04.232139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3cdd07c2-831b-4054-9871-8f53c56c239a req-33ce02d1-47d7-4ab9-9eb3-0f566e3d9070 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:04.244877 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-3cdd07c2-831b-4054-9871-8f53c56c239a req-33ce02d1-47d7-4ab9-9eb3-0f566e3d9070 service nova] Creating event network-vif-plugged:8b4ca7c4-ee9a-4860-b39e-7d2578722c53 for instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e on n-h1-851337-3 Aug 02 07:41:04.250317 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-3cdd07c2-831b-4054-9871-8f53c56c239a req-33ce02d1-47d7-4ab9-9eb3-0f566e3d9070 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035208 Aug 02 07:41:04.250942 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3284/6638] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:41:04.299179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ee60e207-94ac-44f2-8d1a-be350e2167ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:04.307135 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ee60e207-94ac-44f2-8d1a-be350e2167ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1501 microversion: 2.1 time: 0.164470 Aug 02 07:41:04.307796 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3355/6639] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:04 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:05.081095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-542c42f5-5886-4e13-b7b5-c84102d9b084 req-3d6839d2-5826-47db-98be-6a87af9341dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4cb1ae-69b7-4380-86a6-636b6da6909e", "name": "network-vif-deleted", "tag": "8b4ca7c4-ee9a-4860-b39e-7d2578722c53"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:41:05.091547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-542c42f5-5886-4e13-b7b5-c84102d9b084 req-3d6839d2-5826-47db-98be-6a87af9341dc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:05.092735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-542c42f5-5886-4e13-b7b5-c84102d9b084 req-3d6839d2-5826-47db-98be-6a87af9341dc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:05.108313 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-542c42f5-5886-4e13-b7b5-c84102d9b084 req-3d6839d2-5826-47db-98be-6a87af9341dc service nova] Creating event network-vif-deleted:8b4ca7c4-ee9a-4860-b39e-7d2578722c53 for instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e on n-h1-851337-3 Aug 02 07:41:05.114384 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-542c42f5-5886-4e13-b7b5-c84102d9b084 req-3d6839d2-5826-47db-98be-6a87af9341dc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037561 Aug 02 07:41:05.115016 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3285/6640] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:41:05.332543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-30a0b351-8eb6-4ea3-8f26-d94a6c5da33b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:05.333540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-30a0b351-8eb6-4ea3-8f26-d94a6c5da33b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:05.344696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30a0b351-8eb6-4ea3-8f26-d94a6c5da33b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:05.345143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30a0b351-8eb6-4ea3-8f26-d94a6c5da33b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:05.346015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30a0b351-8eb6-4ea3-8f26-d94a6c5da33b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:05.346359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30a0b351-8eb6-4ea3-8f26-d94a6c5da33b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:05.380193 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30a0b351-8eb6-4ea3-8f26-d94a6c5da33b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:05.380634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30a0b351-8eb6-4ea3-8f26-d94a6c5da33b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:05.381092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-30a0b351-8eb6-4ea3-8f26-d94a6c5da33b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lazy-loading 'fault' on Instance uuid 3c4cb1ae-69b7-4380-86a6-636b6da6909e {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:41:05.426713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-30a0b351-8eb6-4ea3-8f26-d94a6c5da33b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf2861424344f4eb401f2a598f576f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35017d2b95cc499bbc4a80af6ff7b8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:05.434897 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-30a0b351-8eb6-4ea3-8f26-d94a6c5da33b tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 200 len: 1304 microversion: 2.1 time: 0.109136 Aug 02 07:41:05.435480 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3356/6641] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:05 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:06.462976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-07767b84-3914-4c61-940e-13151fda2233 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:06.464173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-07767b84-3914-4c61-940e-13151fda2233 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:06.472751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07767b84-3914-4c61-940e-13151fda2233 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:06.473228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07767b84-3914-4c61-940e-13151fda2233 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:06.474049 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07767b84-3914-4c61-940e-13151fda2233 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:06.474509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-07767b84-3914-4c61-940e-13151fda2233 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:06.488438 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-07767b84-3914-4c61-940e-13151fda2233 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] HTTP exception thrown: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-07767b84-3914-4c61-940e-13151fda2233 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Request method failure captured: Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e HTTP/1.1 Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NTf-pMYgYrofmePCjRuBnsfRAOLZ7HTB0eHH0b7b7vsKLHW-WsWqLrS5vX0nSVB8mR1nnxiEdQwa2UUi8Af-n-FsRGCLRX1iZPraAOqLmHkgE5BkRINEUhiCE8RTPYUCrnwMNfXbdM5rxXeOLkVPLDiVIA255fLU_92oO8K2Am93Z0 Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 35017d2b95cc499bbc4a80af6ff7b8c8 Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-DeleteServersTestJSON-1295097346 Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35017d2b95cc499bbc4a80af6ff7b8c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35017d2b95cc499bbc4a80af6ff7b8c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35017d2b95cc499bbc4a80af6ff7b8c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35017d2b95cc499bbc4a80af6ff7b8c8"}]}] Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-DeleteServersTestJSON-1295097346 Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 35017d2b95cc499bbc4a80af6ff7b8c8 Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-DeleteServersTestJSON-1295097346 Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-DeleteServersTestJSON-1295097346-project Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 1bf2861424344f4eb401f2a598f576f7 Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-DeleteServersTestJSON-1295097346-project Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '3c4cb1ae-69b7-4380-86a6-636b6da6909e'} Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:41:06.490171 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.496094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:41:06.496094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:41:06.496094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:41:06.496094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:41:06.496094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:41:06.496094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.496094 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.496094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-07767b84-3914-4c61-940e-13151fda2233 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Returning 404 to user: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:41:06.496094 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-07767b84-3914-4c61-940e-13151fda2233 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 404 len: 111 microversion: 2.1 time: 0.037300 Aug 02 07:41:06.496094 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3286/6642] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:06 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:41:06.505626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a82a62f0-a405-475b-afca-a0716beb8bb4 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:06.506220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a82a62f0-a405-475b-afca-a0716beb8bb4 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:06.513677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a82a62f0-a405-475b-afca-a0716beb8bb4 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:06.514194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a82a62f0-a405-475b-afca-a0716beb8bb4 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:06.514943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a82a62f0-a405-475b-afca-a0716beb8bb4 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:06.515371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a82a62f0-a405-475b-afca-a0716beb8bb4 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:06.532519 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-a82a62f0-a405-475b-afca-a0716beb8bb4 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] HTTP exception thrown: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a82a62f0-a405-475b-afca-a0716beb8bb4 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Request method failure captured: Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e HTTP/1.1 Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NTf-pMYgYrofmePCjRuBnsfRAOLZ7HTB0eHH0b7b7vsKLHW-WsWqLrS5vX0nSVB8mR1nnxiEdQwa2UUi8Af-n-FsRGCLRX1iZPraAOqLmHkgE5BkRINEUhiCE8RTPYUCrnwMNfXbdM5rxXeOLkVPLDiVIA255fLU_92oO8K2Am93Z0 Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 35017d2b95cc499bbc4a80af6ff7b8c8 Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-DeleteServersTestJSON-1295097346 Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35017d2b95cc499bbc4a80af6ff7b8c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35017d2b95cc499bbc4a80af6ff7b8c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35017d2b95cc499bbc4a80af6ff7b8c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35017d2b95cc499bbc4a80af6ff7b8c8"}]}] Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-DeleteServersTestJSON-1295097346 Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 35017d2b95cc499bbc4a80af6ff7b8c8 Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-DeleteServersTestJSON-1295097346 Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-DeleteServersTestJSON-1295097346-project Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 1bf2861424344f4eb401f2a598f576f7 Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-DeleteServersTestJSON-1295097346-project Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '3c4cb1ae-69b7-4380-86a6-636b6da6909e'} Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:41:06.534213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:41:06.539628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.539628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.539628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:41:06.539628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.539628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:41:06.539628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:41:06.539628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:41:06.539628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:41:06.539628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:41:06.539628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.539628 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.539628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a82a62f0-a405-475b-afca-a0716beb8bb4 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Returning 404 to user: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:41:06.539628 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a82a62f0-a405-475b-afca-a0716beb8bb4 tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 404 len: 111 microversion: 2.1 time: 0.034268 Aug 02 07:41:06.539628 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3357/6643] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:41:06 2022] DELETE /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:41:06.546324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0e8ccd56-2336-487c-8ebe-6cb3030b31ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:06.547227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0e8ccd56-2336-487c-8ebe-6cb3030b31ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] [instance: 3c4cb1ae-69b7-4380-86a6-636b6da6909e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:06.556632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e8ccd56-2336-487c-8ebe-6cb3030b31ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:06.557245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e8ccd56-2336-487c-8ebe-6cb3030b31ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:06.558311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e8ccd56-2336-487c-8ebe-6cb3030b31ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:06.558923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0e8ccd56-2336-487c-8ebe-6cb3030b31ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:06.574100 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-0e8ccd56-2336-487c-8ebe-6cb3030b31ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] HTTP exception thrown: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0e8ccd56-2336-487c-8ebe-6cb3030b31ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Request method failure captured: Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e HTTP/1.1 Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NTf-pMYgYrofmePCjRuBnsfRAOLZ7HTB0eHH0b7b7vsKLHW-WsWqLrS5vX0nSVB8mR1nnxiEdQwa2UUi8Af-n-FsRGCLRX1iZPraAOqLmHkgE5BkRINEUhiCE8RTPYUCrnwMNfXbdM5rxXeOLkVPLDiVIA255fLU_92oO8K2Am93Z0 Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 35017d2b95cc499bbc4a80af6ff7b8c8 Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-DeleteServersTestJSON-1295097346 Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35017d2b95cc499bbc4a80af6ff7b8c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35017d2b95cc499bbc4a80af6ff7b8c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35017d2b95cc499bbc4a80af6ff7b8c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35017d2b95cc499bbc4a80af6ff7b8c8"}]}] Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-DeleteServersTestJSON-1295097346 Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 35017d2b95cc499bbc4a80af6ff7b8c8 Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-DeleteServersTestJSON-1295097346 Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-DeleteServersTestJSON-1295097346-project Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 1bf2861424344f4eb401f2a598f576f7 Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-DeleteServersTestJSON-1295097346-project Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '3c4cb1ae-69b7-4380-86a6-636b6da6909e'} Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:41:06.575657 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.581192 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:41:06.581192 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:41:06.581192 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:41:06.581192 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:41:06.581192 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:41:06.581192 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. Aug 02 07:41:06.581192 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:41:06.581192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0e8ccd56-2336-487c-8ebe-6cb3030b31ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] Returning 404 to user: Instance 3c4cb1ae-69b7-4380-86a6-636b6da6909e could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:41:06.581192 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0e8ccd56-2336-487c-8ebe-6cb3030b31ac tempest-DeleteServersTestJSON-1295097346 tempest-DeleteServersTestJSON-1295097346-project] 10.222.0.79 "GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e" status: 404 len: 111 microversion: 2.1 time: 0.036666 Aug 02 07:41:06.581192 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3287/6644] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:06 2022] GET /compute/v2.1/servers/3c4cb1ae-69b7-4380-86a6-636b6da6909e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:41:07.152114 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:41:07.152323 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 07:41:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:41:15.470748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-202067600", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "e29910aa-4bfc-4b63-9484-b63d16393606"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:41:15.525602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] validate_networks() for [('e29910aa-4bfc-4b63-9484-b63d16393606', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:41:15.912888 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:41:15.913531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:41:15.914271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:41:15.914720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:41:15.915332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:41:15.928964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:15.929498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:15.930655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:15.931276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:15.951223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Getting quotas for project b4078336b80c49fba3e371f839e622f0. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:41:15.956713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Getting quotas for user db1525aaafa24ea696e915feba2ee005 and project b4078336b80c49fba3e371f839e622f0. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:41:15.970781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:41:15.973091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:41:16.019587 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bffce228-7b67-4d21-9f0f-2d1ce0b3851e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687037 Aug 02 07:41:16.020411 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3358/6645] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:41:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:41:16.031637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8e8a632d-6641-4f30-931f-43e048bb34e0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:16.032212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8e8a632d-6641-4f30-931f-43e048bb34e0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:16.100241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8e8a632d-6641-4f30-931f-43e048bb34e0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:16.107921 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8e8a632d-6641-4f30-931f-43e048bb34e0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1217 microversion: 2.1 time: 0.080460 Aug 02 07:41:16.108499 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3288/6646] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:16 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:17.131734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-146165ab-61ef-4162-8cf5-97c844e64675 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:17.132827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-146165ab-61ef-4162-8cf5-97c844e64675 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:17.144437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-146165ab-61ef-4162-8cf5-97c844e64675 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:17.147418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-146165ab-61ef-4162-8cf5-97c844e64675 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:17.148302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-146165ab-61ef-4162-8cf5-97c844e64675 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:17.151118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-146165ab-61ef-4162-8cf5-97c844e64675 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:17.226516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-146165ab-61ef-4162-8cf5-97c844e64675 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:17.234742 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-146165ab-61ef-4162-8cf5-97c844e64675 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1287 microversion: 2.1 time: 0.109779 Aug 02 07:41:17.235412 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3359/6647] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:17 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:18.256901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-49094abd-4ad9-4dde-8f90-cc1793885892 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:18.257543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-49094abd-4ad9-4dde-8f90-cc1793885892 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:18.259816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=25 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:41:18.268391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49094abd-4ad9-4dde-8f90-cc1793885892 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:18.268866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49094abd-4ad9-4dde-8f90-cc1793885892 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:18.269667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49094abd-4ad9-4dde-8f90-cc1793885892 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:18.270158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-49094abd-4ad9-4dde-8f90-cc1793885892 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:18.418079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-49094abd-4ad9-4dde-8f90-cc1793885892 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:18.420100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-4efb6c18-9b4f-42b8-8e9f-91cd593badbf req-204bc7c5-079c-46b7-b136-a0961bd91f43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "187a0897-a153-4bf4-8396-46d536695800", "tag": "fda6050c-066f-4a42-b0df-33cd4af2eaa5"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:41:18.428213 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-49094abd-4ad9-4dde-8f90-cc1793885892 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1317 microversion: 2.1 time: 0.175766 Aug 02 07:41:18.428893 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3289/6648] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:18 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:18.434647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4efb6c18-9b4f-42b8-8e9f-91cd593badbf req-204bc7c5-079c-46b7-b136-a0961bd91f43 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:18.435308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4efb6c18-9b4f-42b8-8e9f-91cd593badbf req-204bc7c5-079c-46b7-b136-a0961bd91f43 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:18.451250 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-4efb6c18-9b4f-42b8-8e9f-91cd593badbf req-204bc7c5-079c-46b7-b136-a0961bd91f43 service nova] Creating event network-changed:fda6050c-066f-4a42-b0df-33cd4af2eaa5 for instance 187a0897-a153-4bf4-8396-46d536695800 on n-h1-851337-3 Aug 02 07:41:18.456679 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-4efb6c18-9b4f-42b8-8e9f-91cd593badbf req-204bc7c5-079c-46b7-b136-a0961bd91f43 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041560 Aug 02 07:41:18.457269 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3360/6649] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:41:19.454050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f00bf707-760c-4d71-8e39-702615ac5f6e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:19.454657 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f00bf707-760c-4d71-8e39-702615ac5f6e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:19.462165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f00bf707-760c-4d71-8e39-702615ac5f6e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:19.462632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f00bf707-760c-4d71-8e39-702615ac5f6e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:19.463423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f00bf707-760c-4d71-8e39-702615ac5f6e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:19.463859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f00bf707-760c-4d71-8e39-702615ac5f6e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:19.603570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f00bf707-760c-4d71-8e39-702615ac5f6e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:19.613853 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f00bf707-760c-4d71-8e39-702615ac5f6e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1317 microversion: 2.1 time: 0.166062 Aug 02 07:41:19.614501 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3290/6650] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:19 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:20.637633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83f6727f-f7aa-49a4-8632-ec205d66403b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:20.638355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-83f6727f-f7aa-49a4-8632-ec205d66403b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:20.645216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83f6727f-f7aa-49a4-8632-ec205d66403b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:20.645838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83f6727f-f7aa-49a4-8632-ec205d66403b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:20.646639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83f6727f-f7aa-49a4-8632-ec205d66403b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:20.647078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83f6727f-f7aa-49a4-8632-ec205d66403b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:20.786694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-83f6727f-f7aa-49a4-8632-ec205d66403b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:20.797290 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-83f6727f-f7aa-49a4-8632-ec205d66403b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1317 microversion: 2.1 time: 0.165423 Aug 02 07:41:20.797928 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3361/6651] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:20 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:21.826713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bf92ab9d-f9a6-437b-a18d-c44fbe5a90d8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:21.827570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bf92ab9d-f9a6-437b-a18d-c44fbe5a90d8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:21.836181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf92ab9d-f9a6-437b-a18d-c44fbe5a90d8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:21.836682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf92ab9d-f9a6-437b-a18d-c44fbe5a90d8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:21.837653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf92ab9d-f9a6-437b-a18d-c44fbe5a90d8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:21.838367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf92ab9d-f9a6-437b-a18d-c44fbe5a90d8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:21.972511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bf92ab9d-f9a6-437b-a18d-c44fbe5a90d8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:21.980636 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bf92ab9d-f9a6-437b-a18d-c44fbe5a90d8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1317 microversion: 2.1 time: 0.158595 Aug 02 07:41:21.981208 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3291/6652] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:21 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:23.005269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ac71d259-43d1-420c-81f2-4f70c8df767c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:23.006037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ac71d259-43d1-420c-81f2-4f70c8df767c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:23.014595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac71d259-43d1-420c-81f2-4f70c8df767c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:23.015136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac71d259-43d1-420c-81f2-4f70c8df767c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:23.016031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac71d259-43d1-420c-81f2-4f70c8df767c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:23.016571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac71d259-43d1-420c-81f2-4f70c8df767c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:23.160827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ac71d259-43d1-420c-81f2-4f70c8df767c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:23.169073 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ac71d259-43d1-420c-81f2-4f70c8df767c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1317 microversion: 2.1 time: 0.169827 Aug 02 07:41:23.169692 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3362/6653] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:22 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:24.197787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aa4a0916-f113-4f90-8e70-3e2af3271b96 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:24.198676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aa4a0916-f113-4f90-8e70-3e2af3271b96 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:24.206272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa4a0916-f113-4f90-8e70-3e2af3271b96 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:24.206742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa4a0916-f113-4f90-8e70-3e2af3271b96 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:24.207512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa4a0916-f113-4f90-8e70-3e2af3271b96 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:24.207958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aa4a0916-f113-4f90-8e70-3e2af3271b96 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:24.347533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aa4a0916-f113-4f90-8e70-3e2af3271b96 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:24.356427 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aa4a0916-f113-4f90-8e70-3e2af3271b96 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1317 microversion: 2.1 time: 0.162610 Aug 02 07:41:24.357054 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3292/6654] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:24 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:25.383016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fa7e7567-cc68-43fa-b692-cf292f0b60c7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:25.383869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fa7e7567-cc68-43fa-b692-cf292f0b60c7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:25.395690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa7e7567-cc68-43fa-b692-cf292f0b60c7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:25.396365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa7e7567-cc68-43fa-b692-cf292f0b60c7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:25.397583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa7e7567-cc68-43fa-b692-cf292f0b60c7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:25.398151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa7e7567-cc68-43fa-b692-cf292f0b60c7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:25.541429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fa7e7567-cc68-43fa-b692-cf292f0b60c7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:25.552031 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fa7e7567-cc68-43fa-b692-cf292f0b60c7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1317 microversion: 2.1 time: 0.176252 Aug 02 07:41:25.552607 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3363/6655] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:25 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:26.324664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-1b2f2c52-9eb7-41f5-9816-caa37cb0b09b req-fb9485da-50f7-44ce-97b7-33a280aa3bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187a0897-a153-4bf4-8396-46d536695800", "name": "network-vif-plugged", "status": "completed", "tag": "fda6050c-066f-4a42-b0df-33cd4af2eaa5"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:41:26.330503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:41:26.336327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1b2f2c52-9eb7-41f5-9816-caa37cb0b09b req-fb9485da-50f7-44ce-97b7-33a280aa3bc9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:26.336787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-1b2f2c52-9eb7-41f5-9816-caa37cb0b09b req-fb9485da-50f7-44ce-97b7-33a280aa3bc9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:26.349930 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-1b2f2c52-9eb7-41f5-9816-caa37cb0b09b req-fb9485da-50f7-44ce-97b7-33a280aa3bc9 service nova] Creating event network-vif-plugged:fda6050c-066f-4a42-b0df-33cd4af2eaa5 for instance 187a0897-a153-4bf4-8396-46d536695800 on n-h1-851337-3 Aug 02 07:41:26.355140 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-1b2f2c52-9eb7-41f5-9816-caa37cb0b09b req-fb9485da-50f7-44ce-97b7-33a280aa3bc9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034401 Aug 02 07:41:26.355911 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3293/6656] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:41:26.573074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-81119d4f-be4a-4041-9d55-ace66a9e781e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:26.573716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-81119d4f-be4a-4041-9d55-ace66a9e781e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:26.575804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:41:26.576503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:41:26.583655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81119d4f-be4a-4041-9d55-ace66a9e781e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:26.584110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81119d4f-be4a-4041-9d55-ace66a9e781e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:26.584878 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81119d4f-be4a-4041-9d55-ace66a9e781e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:26.585311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81119d4f-be4a-4041-9d55-ace66a9e781e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:26.731839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-81119d4f-be4a-4041-9d55-ace66a9e781e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:26.744281 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-81119d4f-be4a-4041-9d55-ace66a9e781e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1317 microversion: 2.1 time: 0.175218 Aug 02 07:41:26.745055 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3364/6657] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:26 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:27.770544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-08071e49-6431-4597-bbc6-72403e6796a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:27.772387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-08071e49-6431-4597-bbc6-72403e6796a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:27.780047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08071e49-6431-4597-bbc6-72403e6796a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:27.780509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08071e49-6431-4597-bbc6-72403e6796a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:27.781294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08071e49-6431-4597-bbc6-72403e6796a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:27.781740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-08071e49-6431-4597-bbc6-72403e6796a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:27.918940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-08071e49-6431-4597-bbc6-72403e6796a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:27.927215 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-08071e49-6431-4597-bbc6-72403e6796a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1317 microversion: 2.1 time: 0.163154 Aug 02 07:41:27.927988 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3294/6658] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:27 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:28.951122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-201812ce-8cad-455c-a774-46920db98da4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:28.951712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-201812ce-8cad-455c-a774-46920db98da4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:28.955660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:41:28.962228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-201812ce-8cad-455c-a774-46920db98da4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:28.962833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-201812ce-8cad-455c-a774-46920db98da4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:28.964065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-201812ce-8cad-455c-a774-46920db98da4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:28.964669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-201812ce-8cad-455c-a774-46920db98da4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:28.969119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:41:29.113429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-201812ce-8cad-455c-a774-46920db98da4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:29.121406 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-201812ce-8cad-455c-a774-46920db98da4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1507 microversion: 2.1 time: 0.174820 Aug 02 07:41:29.121992 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3365/6659] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:28 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:29.142462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8fe63f2b-9f2c-43cf-a2fb-8b5abe6294b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:29.143098 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8fe63f2b-9f2c-43cf-a2fb-8b5abe6294b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:29.146031 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=30 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:41:29.152068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe63f2b-9f2c-43cf-a2fb-8b5abe6294b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:29.152550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe63f2b-9f2c-43cf-a2fb-8b5abe6294b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:29.153339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe63f2b-9f2c-43cf-a2fb-8b5abe6294b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:29.153779 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8fe63f2b-9f2c-43cf-a2fb-8b5abe6294b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:29.292565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8fe63f2b-9f2c-43cf-a2fb-8b5abe6294b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:29.301042 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8fe63f2b-9f2c-43cf-a2fb-8b5abe6294b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1507 microversion: 2.1 time: 0.162702 Aug 02 07:41:29.301629 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3295/6660] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:29 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:29.331622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b1e75a1d-3f1a-4f86-84d2-118ee4321f17 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:41:29.335459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b1e75a1d-3f1a-4f86-84d2-118ee4321f17 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:29.342105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1e75a1d-3f1a-4f86-84d2-118ee4321f17 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:29.342554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1e75a1d-3f1a-4f86-84d2-118ee4321f17 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:29.343307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1e75a1d-3f1a-4f86-84d2-118ee4321f17 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:29.343735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1e75a1d-3f1a-4f86-84d2-118ee4321f17 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:29.414249 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b1e75a1d-3f1a-4f86-84d2-118ee4321f17 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "PUT /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1079 microversion: 2.1 time: 0.088531 Aug 02 07:41:29.414964 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3366/6661] 10.222.0.79 () {60 vars in 1256 bytes} [Tue Aug 2 07:41:29 2022] PUT /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1079 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:29.437875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3d3fdd3c-fb39-4d47-955d-826cce9180bb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:29.438536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3d3fdd3c-fb39-4d47-955d-826cce9180bb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:29.444940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d3fdd3c-fb39-4d47-955d-826cce9180bb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:29.445416 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d3fdd3c-fb39-4d47-955d-826cce9180bb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:29.446231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d3fdd3c-fb39-4d47-955d-826cce9180bb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:29.446673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d3fdd3c-fb39-4d47-955d-826cce9180bb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:29.591651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3d3fdd3c-fb39-4d47-955d-826cce9180bb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:29.602144 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3d3fdd3c-fb39-4d47-955d-826cce9180bb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1505 microversion: 2.1 time: 0.167946 Aug 02 07:41:29.602736 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3296/6662] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:29 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:29.624660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c33c4da-5240-46b6-8d5f-b6b80fa073fe tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:29.625552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1c33c4da-5240-46b6-8d5f-b6b80fa073fe tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:29.634590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c33c4da-5240-46b6-8d5f-b6b80fa073fe tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:29.635044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c33c4da-5240-46b6-8d5f-b6b80fa073fe tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:29.635810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c33c4da-5240-46b6-8d5f-b6b80fa073fe tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:29.636249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c33c4da-5240-46b6-8d5f-b6b80fa073fe tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:29.782643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1c33c4da-5240-46b6-8d5f-b6b80fa073fe tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:29.790807 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1c33c4da-5240-46b6-8d5f-b6b80fa073fe tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1505 microversion: 2.1 time: 0.172330 Aug 02 07:41:29.791399 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3367/6663] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:29 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:29.811398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-53171dab-1ed8-4410-bee4-5c7544902df7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:41:29.813735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-53171dab-1ed8-4410-bee4-5c7544902df7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:29.820584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53171dab-1ed8-4410-bee4-5c7544902df7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:29.821045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53171dab-1ed8-4410-bee4-5c7544902df7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:29.821917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53171dab-1ed8-4410-bee4-5c7544902df7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:29.822418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53171dab-1ed8-4410-bee4-5c7544902df7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:29.855029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-53171dab-1ed8-4410-bee4-5c7544902df7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:29.861495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-53171dab-1ed8-4410-bee4-5c7544902df7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Old instance type m1.heat2, new instance type m1.heat {{(pid=126119) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 07:41:29.868383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-53171dab-1ed8-4410-bee4-5c7544902df7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:41:29.868816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-53171dab-1ed8-4410-bee4-5c7544902df7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:41:29.869304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-53171dab-1ed8-4410-bee4-5c7544902df7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:41:29.869699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-53171dab-1ed8-4410-bee4-5c7544902df7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:41:29.870194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-53171dab-1ed8-4410-bee4-5c7544902df7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:41:29.941331 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-53171dab-1ed8-4410-bee4-5c7544902df7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "POST /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800/action" status: 202 len: 0 microversion: 2.1 time: 0.133687 Aug 02 07:41:29.941976 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3297/6664] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:41:29 2022] POST /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:41:29.950460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-46f92e7a-f977-439f-8d88-800214a3edef tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:29.951144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-46f92e7a-f977-439f-8d88-800214a3edef tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:29.958457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-46f92e7a-f977-439f-8d88-800214a3edef tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:29.959090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-46f92e7a-f977-439f-8d88-800214a3edef tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:29.959656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-46f92e7a-f977-439f-8d88-800214a3edef tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:29.960089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-46f92e7a-f977-439f-8d88-800214a3edef tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:30.120649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-46f92e7a-f977-439f-8d88-800214a3edef tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:30.128991 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-46f92e7a-f977-439f-8d88-800214a3edef tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1516 microversion: 2.1 time: 0.182572 Aug 02 07:41:30.129906 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3368/6665] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:29 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:31.154545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-45839f17-5e18-4ed4-9023-d39b451a209f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:31.155192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-45839f17-5e18-4ed4-9023-d39b451a209f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:31.164000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45839f17-5e18-4ed4-9023-d39b451a209f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:31.164494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45839f17-5e18-4ed4-9023-d39b451a209f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:31.165316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45839f17-5e18-4ed4-9023-d39b451a209f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:31.165909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45839f17-5e18-4ed4-9023-d39b451a209f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:31.303552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-45839f17-5e18-4ed4-9023-d39b451a209f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:31.312491 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-45839f17-5e18-4ed4-9023-d39b451a209f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1516 microversion: 2.1 time: 0.164521 Aug 02 07:41:31.313085 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3298/6666] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:31 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:32.338160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-03a3eb91-9ada-4f3f-adff-e4372381b0e8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:32.338724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-03a3eb91-9ada-4f3f-adff-e4372381b0e8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:32.346451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03a3eb91-9ada-4f3f-adff-e4372381b0e8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:32.346899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03a3eb91-9ada-4f3f-adff-e4372381b0e8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:32.347649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03a3eb91-9ada-4f3f-adff-e4372381b0e8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:32.348098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03a3eb91-9ada-4f3f-adff-e4372381b0e8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:32.510210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-03a3eb91-9ada-4f3f-adff-e4372381b0e8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:32.518647 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-03a3eb91-9ada-4f3f-adff-e4372381b0e8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.187119 Aug 02 07:41:32.519209 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3369/6667] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:32 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:33.543825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-41083cde-c329-4a6c-9566-b8327f0d7523 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:33.544468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-41083cde-c329-4a6c-9566-b8327f0d7523 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:33.552198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41083cde-c329-4a6c-9566-b8327f0d7523 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:33.552696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41083cde-c329-4a6c-9566-b8327f0d7523 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:33.553511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41083cde-c329-4a6c-9566-b8327f0d7523 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:33.554007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41083cde-c329-4a6c-9566-b8327f0d7523 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:33.700812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-41083cde-c329-4a6c-9566-b8327f0d7523 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:33.708758 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-41083cde-c329-4a6c-9566-b8327f0d7523 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.169873 Aug 02 07:41:33.709334 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3299/6668] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:33 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:34.741783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-885ced28-fb6a-43b0-87ae-cddaa2147851 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:34.742589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-885ced28-fb6a-43b0-87ae-cddaa2147851 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:34.752321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-885ced28-fb6a-43b0-87ae-cddaa2147851 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:34.752918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-885ced28-fb6a-43b0-87ae-cddaa2147851 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:34.753951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-885ced28-fb6a-43b0-87ae-cddaa2147851 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:34.754566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-885ced28-fb6a-43b0-87ae-cddaa2147851 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:34.897512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-885ced28-fb6a-43b0-87ae-cddaa2147851 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:34.908827 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-885ced28-fb6a-43b0-87ae-cddaa2147851 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.172410 Aug 02 07:41:34.909416 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3370/6669] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:34 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:35.933970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fbfa42ec-02c9-4483-a025-22eb82aeed54 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:35.934968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fbfa42ec-02c9-4483-a025-22eb82aeed54 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:35.942990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbfa42ec-02c9-4483-a025-22eb82aeed54 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:35.943450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbfa42ec-02c9-4483-a025-22eb82aeed54 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:35.944240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbfa42ec-02c9-4483-a025-22eb82aeed54 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:35.944687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fbfa42ec-02c9-4483-a025-22eb82aeed54 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:36.104336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fbfa42ec-02c9-4483-a025-22eb82aeed54 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:36.122048 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fbfa42ec-02c9-4483-a025-22eb82aeed54 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.194180 Aug 02 07:41:36.122954 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3300/6670] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:35 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:37.151314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e6f72ee6-a59a-4821-80a7-5239b9a1858b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:37.151922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e6f72ee6-a59a-4821-80a7-5239b9a1858b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:37.160102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6f72ee6-a59a-4821-80a7-5239b9a1858b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:37.160554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6f72ee6-a59a-4821-80a7-5239b9a1858b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:37.161315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6f72ee6-a59a-4821-80a7-5239b9a1858b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:37.161749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6f72ee6-a59a-4821-80a7-5239b9a1858b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:37.313306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e6f72ee6-a59a-4821-80a7-5239b9a1858b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:37.324010 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e6f72ee6-a59a-4821-80a7-5239b9a1858b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.179255 Aug 02 07:41:37.324886 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3371/6671] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:37 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:38.352470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-33abfd7c-6f65-487b-8621-8d9b18dfa81e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:38.353147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-33abfd7c-6f65-487b-8621-8d9b18dfa81e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:38.364332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33abfd7c-6f65-487b-8621-8d9b18dfa81e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:38.365630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33abfd7c-6f65-487b-8621-8d9b18dfa81e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:38.366916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33abfd7c-6f65-487b-8621-8d9b18dfa81e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:38.367465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-33abfd7c-6f65-487b-8621-8d9b18dfa81e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:38.528876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-33abfd7c-6f65-487b-8621-8d9b18dfa81e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:38.537310 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-33abfd7c-6f65-487b-8621-8d9b18dfa81e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.191648 Aug 02 07:41:38.537970 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3301/6672] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:38 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:39.564150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f0857906-20ad-434f-8179-53d3c5c9cd3e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:39.564812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f0857906-20ad-434f-8179-53d3c5c9cd3e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:39.572725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0857906-20ad-434f-8179-53d3c5c9cd3e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:39.573204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0857906-20ad-434f-8179-53d3c5c9cd3e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:39.574049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0857906-20ad-434f-8179-53d3c5c9cd3e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:39.574506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f0857906-20ad-434f-8179-53d3c5c9cd3e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:39.731868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f0857906-20ad-434f-8179-53d3c5c9cd3e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:39.743374 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f0857906-20ad-434f-8179-53d3c5c9cd3e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.184228 Aug 02 07:41:39.744152 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3372/6673] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:39 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:40.768547 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d88dcdf0-d81d-4a4b-bb2f-3f59951808d6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:40.769183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d88dcdf0-d81d-4a4b-bb2f-3f59951808d6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:40.776652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d88dcdf0-d81d-4a4b-bb2f-3f59951808d6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:40.777125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d88dcdf0-d81d-4a4b-bb2f-3f59951808d6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:40.777930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d88dcdf0-d81d-4a4b-bb2f-3f59951808d6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:40.778401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d88dcdf0-d81d-4a4b-bb2f-3f59951808d6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:40.922673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d88dcdf0-d81d-4a4b-bb2f-3f59951808d6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:40.930355 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d88dcdf0-d81d-4a4b-bb2f-3f59951808d6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.166400 Aug 02 07:41:40.930940 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3302/6674] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:40 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:41.953184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7dd19281-e7d4-436d-8aae-604c965074a0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:41.953827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7dd19281-e7d4-436d-8aae-604c965074a0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:41.961581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dd19281-e7d4-436d-8aae-604c965074a0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:41.962048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dd19281-e7d4-436d-8aae-604c965074a0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:41.962815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dd19281-e7d4-436d-8aae-604c965074a0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:41.963585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7dd19281-e7d4-436d-8aae-604c965074a0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:42.115627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7dd19281-e7d4-436d-8aae-604c965074a0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:42.126931 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7dd19281-e7d4-436d-8aae-604c965074a0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.178641 Aug 02 07:41:42.127492 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3373/6675] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:41 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:43.149145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6c13e734-092c-408a-b59c-b6926dcbc1bc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:43.149802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6c13e734-092c-408a-b59c-b6926dcbc1bc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:43.157415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c13e734-092c-408a-b59c-b6926dcbc1bc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:43.157968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c13e734-092c-408a-b59c-b6926dcbc1bc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:43.158863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c13e734-092c-408a-b59c-b6926dcbc1bc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:43.159102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c13e734-092c-408a-b59c-b6926dcbc1bc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:43.298897 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6c13e734-092c-408a-b59c-b6926dcbc1bc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:43.307428 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6c13e734-092c-408a-b59c-b6926dcbc1bc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.162193 Aug 02 07:41:43.308030 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3303/6676] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:43 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:44.329093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f773d969-d2f2-4d74-934d-c55cc07a1e4d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:44.329931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f773d969-d2f2-4d74-934d-c55cc07a1e4d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:44.337041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f773d969-d2f2-4d74-934d-c55cc07a1e4d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:44.337488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f773d969-d2f2-4d74-934d-c55cc07a1e4d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:44.338278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f773d969-d2f2-4d74-934d-c55cc07a1e4d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:44.338714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f773d969-d2f2-4d74-934d-c55cc07a1e4d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:44.478562 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f773d969-d2f2-4d74-934d-c55cc07a1e4d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:44.486836 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f773d969-d2f2-4d74-934d-c55cc07a1e4d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.161651 Aug 02 07:41:44.487426 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3374/6677] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:44 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:45.509034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9e7e5ba0-7f00-4b58-95f5-ca9330db0a8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:45.509805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9e7e5ba0-7f00-4b58-95f5-ca9330db0a8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:45.518820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e7e5ba0-7f00-4b58-95f5-ca9330db0a8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:45.519299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e7e5ba0-7f00-4b58-95f5-ca9330db0a8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:45.520116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e7e5ba0-7f00-4b58-95f5-ca9330db0a8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:45.520570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e7e5ba0-7f00-4b58-95f5-ca9330db0a8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:45.673271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9e7e5ba0-7f00-4b58-95f5-ca9330db0a8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:45.676936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:41:45.681865 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9e7e5ba0-7f00-4b58-95f5-ca9330db0a8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.177374 Aug 02 07:41:45.682519 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3304/6678] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:45 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:46.710575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-48d37897-743f-448a-9dd1-0d714f5502b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:46.711645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-48d37897-743f-448a-9dd1-0d714f5502b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:46.723416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48d37897-743f-448a-9dd1-0d714f5502b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:46.724162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48d37897-743f-448a-9dd1-0d714f5502b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:46.725424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48d37897-743f-448a-9dd1-0d714f5502b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:46.726186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-48d37897-743f-448a-9dd1-0d714f5502b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:46.873617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-48d37897-743f-448a-9dd1-0d714f5502b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:46.881766 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-48d37897-743f-448a-9dd1-0d714f5502b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.177874 Aug 02 07:41:46.882375 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3375/6679] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:46 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:47.904628 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-448e6e9e-a8a4-41a0-a8d6-2a031f010714 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:47.905256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-448e6e9e-a8a4-41a0-a8d6-2a031f010714 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:47.913489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-448e6e9e-a8a4-41a0-a8d6-2a031f010714 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:47.913984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-448e6e9e-a8a4-41a0-a8d6-2a031f010714 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:47.914762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-448e6e9e-a8a4-41a0-a8d6-2a031f010714 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:47.915215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-448e6e9e-a8a4-41a0-a8d6-2a031f010714 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:48.061703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-448e6e9e-a8a4-41a0-a8d6-2a031f010714 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:48.070112 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-448e6e9e-a8a4-41a0-a8d6-2a031f010714 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.169458 Aug 02 07:41:48.070693 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3305/6680] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:47 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:49.096279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-00a9aeaa-0b9c-43ee-8a90-0130d9720d64 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:49.097236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-00a9aeaa-0b9c-43ee-8a90-0130d9720d64 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:49.108949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00a9aeaa-0b9c-43ee-8a90-0130d9720d64 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:49.109613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00a9aeaa-0b9c-43ee-8a90-0130d9720d64 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:49.110835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00a9aeaa-0b9c-43ee-8a90-0130d9720d64 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:49.111627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-00a9aeaa-0b9c-43ee-8a90-0130d9720d64 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:49.255657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-00a9aeaa-0b9c-43ee-8a90-0130d9720d64 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:49.263970 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-00a9aeaa-0b9c-43ee-8a90-0130d9720d64 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.174445 Aug 02 07:41:49.264592 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3376/6681] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:49 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:50.286303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d319b54-f3be-4823-a16c-1d87481ac57e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:50.287010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5d319b54-f3be-4823-a16c-1d87481ac57e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:50.295764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d319b54-f3be-4823-a16c-1d87481ac57e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:50.296263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d319b54-f3be-4823-a16c-1d87481ac57e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:50.297243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d319b54-f3be-4823-a16c-1d87481ac57e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:50.297713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d319b54-f3be-4823-a16c-1d87481ac57e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:50.449496 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5d319b54-f3be-4823-a16c-1d87481ac57e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:50.457645 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5d319b54-f3be-4823-a16c-1d87481ac57e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.175339 Aug 02 07:41:50.458338 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3306/6682] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:50 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:51.482861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-181327c4-f30d-46f6-8b3e-94d7dce37fcf tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:51.483848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-181327c4-f30d-46f6-8b3e-94d7dce37fcf tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:51.495909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-181327c4-f30d-46f6-8b3e-94d7dce37fcf tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:51.496793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-181327c4-f30d-46f6-8b3e-94d7dce37fcf tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:51.498182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-181327c4-f30d-46f6-8b3e-94d7dce37fcf tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:51.498953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-181327c4-f30d-46f6-8b3e-94d7dce37fcf tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:51.632664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-181327c4-f30d-46f6-8b3e-94d7dce37fcf tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:51.640433 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-181327c4-f30d-46f6-8b3e-94d7dce37fcf tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.164161 Aug 02 07:41:51.641039 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3377/6683] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:51 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:52.664511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-47fea8cf-cfcd-4f48-9d8c-ecec540e44aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:52.665166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-47fea8cf-cfcd-4f48-9d8c-ecec540e44aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:52.673264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47fea8cf-cfcd-4f48-9d8c-ecec540e44aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:52.673911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47fea8cf-cfcd-4f48-9d8c-ecec540e44aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:52.674749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47fea8cf-cfcd-4f48-9d8c-ecec540e44aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:52.675203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47fea8cf-cfcd-4f48-9d8c-ecec540e44aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:52.819268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-47fea8cf-cfcd-4f48-9d8c-ecec540e44aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:52.827670 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-47fea8cf-cfcd-4f48-9d8c-ecec540e44aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.167500 Aug 02 07:41:52.828261 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3307/6684] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:52 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:53.850561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b4fae5a-3ef5-458e-b988-64cd613b1af4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:53.851164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b4fae5a-3ef5-458e-b988-64cd613b1af4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:53.858911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b4fae5a-3ef5-458e-b988-64cd613b1af4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:53.859390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b4fae5a-3ef5-458e-b988-64cd613b1af4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:53.860155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b4fae5a-3ef5-458e-b988-64cd613b1af4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:53.860588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b4fae5a-3ef5-458e-b988-64cd613b1af4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:54.006877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7b4fae5a-3ef5-458e-b988-64cd613b1af4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:54.015590 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b4fae5a-3ef5-458e-b988-64cd613b1af4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.168924 Aug 02 07:41:54.016181 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3378/6685] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:53 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:55.041352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-78d2371d-2b1a-47d5-b024-eb30835a4d1e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:55.042018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-78d2371d-2b1a-47d5-b024-eb30835a4d1e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:55.049693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78d2371d-2b1a-47d5-b024-eb30835a4d1e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:55.050229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78d2371d-2b1a-47d5-b024-eb30835a4d1e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:55.051074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78d2371d-2b1a-47d5-b024-eb30835a4d1e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:55.051553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78d2371d-2b1a-47d5-b024-eb30835a4d1e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:55.201731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-78d2371d-2b1a-47d5-b024-eb30835a4d1e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:55.210312 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-78d2371d-2b1a-47d5-b024-eb30835a4d1e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.173212 Aug 02 07:41:55.210900 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3308/6686] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:55 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:56.232623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f7461790-b525-4e8b-a6ab-7194a6e746c5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:56.233241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f7461790-b525-4e8b-a6ab-7194a6e746c5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:56.241276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7461790-b525-4e8b-a6ab-7194a6e746c5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:56.241743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7461790-b525-4e8b-a6ab-7194a6e746c5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:56.242610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7461790-b525-4e8b-a6ab-7194a6e746c5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:56.243060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7461790-b525-4e8b-a6ab-7194a6e746c5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:56.404051 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f7461790-b525-4e8b-a6ab-7194a6e746c5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:56.412999 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f7461790-b525-4e8b-a6ab-7194a6e746c5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.184426 Aug 02 07:41:56.413615 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3379/6687] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:56 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:57.435101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dbe917fb-ae53-494e-ae59-51bed1943453 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:57.435810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dbe917fb-ae53-494e-ae59-51bed1943453 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:57.443882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbe917fb-ae53-494e-ae59-51bed1943453 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:57.444351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbe917fb-ae53-494e-ae59-51bed1943453 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:57.445182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbe917fb-ae53-494e-ae59-51bed1943453 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:57.445637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dbe917fb-ae53-494e-ae59-51bed1943453 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:57.598132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dbe917fb-ae53-494e-ae59-51bed1943453 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:57.609792 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dbe917fb-ae53-494e-ae59-51bed1943453 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.178618 Aug 02 07:41:57.610892 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3309/6688] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:57 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:58.634699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d8e0c88a-7e6e-4d4f-ae23-28b7194d0f4e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:58.635629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d8e0c88a-7e6e-4d4f-ae23-28b7194d0f4e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:58.643184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8e0c88a-7e6e-4d4f-ae23-28b7194d0f4e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:58.643622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8e0c88a-7e6e-4d4f-ae23-28b7194d0f4e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:58.644391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8e0c88a-7e6e-4d4f-ae23-28b7194d0f4e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:58.644823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8e0c88a-7e6e-4d4f-ae23-28b7194d0f4e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:58.796478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d8e0c88a-7e6e-4d4f-ae23-28b7194d0f4e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:41:58.805076 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d8e0c88a-7e6e-4d4f-ae23-28b7194d0f4e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1521 microversion: 2.1 time: 0.174452 Aug 02 07:41:58.805688 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3380/6689] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:58 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:41:59.578091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-7f2ac72b-b43e-4f2e-b4d0-e3e99848fcb7 req-00aed4e9-bf31-4a9a-b0ea-61d1c4a70dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187a0897-a153-4bf4-8396-46d536695800", "name": "network-vif-unplugged", "status": "completed", "tag": "fda6050c-066f-4a42-b0df-33cd4af2eaa5"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:41:59.584846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=34 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:41:59.592332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7f2ac72b-b43e-4f2e-b4d0-e3e99848fcb7 req-00aed4e9-bf31-4a9a-b0ea-61d1c4a70dbf service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:59.593019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7f2ac72b-b43e-4f2e-b4d0-e3e99848fcb7 req-00aed4e9-bf31-4a9a-b0ea-61d1c4a70dbf service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:59.609416 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-7f2ac72b-b43e-4f2e-b4d0-e3e99848fcb7 req-00aed4e9-bf31-4a9a-b0ea-61d1c4a70dbf service nova] Creating event network-vif-unplugged:fda6050c-066f-4a42-b0df-33cd4af2eaa5 for instance 187a0897-a153-4bf4-8396-46d536695800 on n-h2-851337-3 Aug 02 07:41:59.616862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-7f2ac72b-b43e-4f2e-b4d0-e3e99848fcb7 req-00aed4e9-bf31-4a9a-b0ea-61d1c4a70dbf service nova] Instance 187a0897-a153-4bf4-8396-46d536695800 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:41:59.632540 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-7f2ac72b-b43e-4f2e-b4d0-e3e99848fcb7 req-00aed4e9-bf31-4a9a-b0ea-61d1c4a70dbf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057986 Aug 02 07:41:59.633200 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3310/6690] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:41:59.827682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e65d66b-86d3-4d03-96a1-acc2d7d25376 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:41:59.828325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7e65d66b-86d3-4d03-96a1-acc2d7d25376 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:41:59.831539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=32 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:41:59.843324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e65d66b-86d3-4d03-96a1-acc2d7d25376 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:59.843324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e65d66b-86d3-4d03-96a1-acc2d7d25376 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:59.843324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e65d66b-86d3-4d03-96a1-acc2d7d25376 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:41:59.843324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e65d66b-86d3-4d03-96a1-acc2d7d25376 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:41:59.844673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:42:00.171692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7e65d66b-86d3-4d03-96a1-acc2d7d25376 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:00.180717 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7e65d66b-86d3-4d03-96a1-acc2d7d25376 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1520 microversion: 2.1 time: 0.357403 Aug 02 07:42:00.181323 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3381/6691] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:41:59 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:01.205184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4292ab0c-30b4-4bd2-851a-dc2b0445c11d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:01.205972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4292ab0c-30b4-4bd2-851a-dc2b0445c11d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:01.217017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4292ab0c-30b4-4bd2-851a-dc2b0445c11d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:01.217600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4292ab0c-30b4-4bd2-851a-dc2b0445c11d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:01.218761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4292ab0c-30b4-4bd2-851a-dc2b0445c11d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:01.219192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4292ab0c-30b4-4bd2-851a-dc2b0445c11d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:01.372064 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4292ab0c-30b4-4bd2-851a-dc2b0445c11d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:01.382265 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4292ab0c-30b4-4bd2-851a-dc2b0445c11d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1518 microversion: 2.1 time: 0.182371 Aug 02 07:42:01.382943 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3311/6692] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:01 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:01.664697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-74355720-22b0-4e58-818f-066a0f44a81f req-57657559-a1b7-4762-98fd-b081f1784228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "187a0897-a153-4bf4-8396-46d536695800", "tag": "fda6050c-066f-4a42-b0df-33cd4af2eaa5"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:42:01.675565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-74355720-22b0-4e58-818f-066a0f44a81f req-57657559-a1b7-4762-98fd-b081f1784228 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:01.676001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-74355720-22b0-4e58-818f-066a0f44a81f req-57657559-a1b7-4762-98fd-b081f1784228 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:01.688608 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-74355720-22b0-4e58-818f-066a0f44a81f req-57657559-a1b7-4762-98fd-b081f1784228 service nova] Creating event network-changed:fda6050c-066f-4a42-b0df-33cd4af2eaa5 for instance 187a0897-a153-4bf4-8396-46d536695800 on n-h2-851337-3 Aug 02 07:42:01.694486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-74355720-22b0-4e58-818f-066a0f44a81f req-57657559-a1b7-4762-98fd-b081f1784228 service nova] Instance 187a0897-a153-4bf4-8396-46d536695800 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:42:01.705985 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-74355720-22b0-4e58-818f-066a0f44a81f req-57657559-a1b7-4762-98fd-b081f1784228 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045141 Aug 02 07:42:01.706601 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3382/6693] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:42:02.406537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0d651931-590e-4830-acc6-fbc8eeb6d4aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:02.407738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0d651931-590e-4830-acc6-fbc8eeb6d4aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:02.421669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d651931-590e-4830-acc6-fbc8eeb6d4aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:02.423260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d651931-590e-4830-acc6-fbc8eeb6d4aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:02.425039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d651931-590e-4830-acc6-fbc8eeb6d4aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:02.425854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d651931-590e-4830-acc6-fbc8eeb6d4aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:02.691931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0d651931-590e-4830-acc6-fbc8eeb6d4aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:02.705037 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0d651931-590e-4830-acc6-fbc8eeb6d4aa tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1515 microversion: 2.1 time: 0.303491 Aug 02 07:42:02.706137 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3312/6694] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:02 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:02.728497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d0952945-bab5-49d1-9488-952f366c8fdc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:42:02.729148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d0952945-bab5-49d1-9488-952f366c8fdc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:02.740289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0952945-bab5-49d1-9488-952f366c8fdc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:02.740741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0952945-bab5-49d1-9488-952f366c8fdc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:02.741849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0952945-bab5-49d1-9488-952f366c8fdc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:02.742358 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0952945-bab5-49d1-9488-952f366c8fdc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:02.816059 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d0952945-bab5-49d1-9488-952f366c8fdc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "POST /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800/action" status: 204 len: 0 microversion: 2.1 time: 0.092399 Aug 02 07:42:02.816650 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3383/6695] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:42:02 2022] POST /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800/action => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:42:02.829023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3fddd108-6136-4c2a-815d-a5b3e2117a2a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:02.830179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3fddd108-6136-4c2a-815d-a5b3e2117a2a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:02.842001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fddd108-6136-4c2a-815d-a5b3e2117a2a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:02.842535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fddd108-6136-4c2a-815d-a5b3e2117a2a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:02.843791 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fddd108-6136-4c2a-815d-a5b3e2117a2a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:02.844651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fddd108-6136-4c2a-815d-a5b3e2117a2a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:03.040478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3fddd108-6136-4c2a-815d-a5b3e2117a2a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:03.055256 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3fddd108-6136-4c2a-815d-a5b3e2117a2a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1515 microversion: 2.1 time: 0.233114 Aug 02 07:42:03.056958 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3313/6696] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:02 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1515 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:04.094066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-81d4cb19-6419-4390-bec7-533803d9f4be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:04.094872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-81d4cb19-6419-4390-bec7-533803d9f4be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:04.104830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81d4cb19-6419-4390-bec7-533803d9f4be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:04.105401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81d4cb19-6419-4390-bec7-533803d9f4be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:04.106392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81d4cb19-6419-4390-bec7-533803d9f4be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:04.106828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81d4cb19-6419-4390-bec7-533803d9f4be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:04.619644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-81d4cb19-6419-4390-bec7-533803d9f4be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:04.628741 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-81d4cb19-6419-4390-bec7-533803d9f4be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1515 microversion: 2.1 time: 0.541289 Aug 02 07:42:04.630384 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3384/6697] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:04 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1515 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:04.993719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-65160c35-e079-4da1-820b-c03867e0fbbd req-fa185585-cb80-4991-9c06-37350b360c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187a0897-a153-4bf4-8396-46d536695800", "name": "network-vif-plugged", "status": "completed", "tag": "fda6050c-066f-4a42-b0df-33cd4af2eaa5"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:42:05.007514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-65160c35-e079-4da1-820b-c03867e0fbbd req-fa185585-cb80-4991-9c06-37350b360c9b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:05.007996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-65160c35-e079-4da1-820b-c03867e0fbbd req-fa185585-cb80-4991-9c06-37350b360c9b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:05.021371 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-65160c35-e079-4da1-820b-c03867e0fbbd req-fa185585-cb80-4991-9c06-37350b360c9b service nova] Creating event network-vif-plugged:fda6050c-066f-4a42-b0df-33cd4af2eaa5 for instance 187a0897-a153-4bf4-8396-46d536695800 on n-h2-851337-3 Aug 02 07:42:05.027779 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-65160c35-e079-4da1-820b-c03867e0fbbd req-fa185585-cb80-4991-9c06-37350b360c9b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037367 Aug 02 07:42:05.029027 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3314/6698] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:42:05.653334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cdda2757-146b-47d5-99c6-afb0690055b6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:05.654012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cdda2757-146b-47d5-99c6-afb0690055b6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:05.664204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdda2757-146b-47d5-99c6-afb0690055b6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:05.665054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdda2757-146b-47d5-99c6-afb0690055b6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:05.666410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdda2757-146b-47d5-99c6-afb0690055b6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:05.667158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cdda2757-146b-47d5-99c6-afb0690055b6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:05.840899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cdda2757-146b-47d5-99c6-afb0690055b6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:05.852381 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cdda2757-146b-47d5-99c6-afb0690055b6 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1507 microversion: 2.1 time: 0.203130 Aug 02 07:42:05.852910 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3385/6699] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:05 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1507 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:05.874350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9742da48-c7df-49e6-91b7-d7555384d03e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:05.875074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9742da48-c7df-49e6-91b7-d7555384d03e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:05.882251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9742da48-c7df-49e6-91b7-d7555384d03e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:05.882717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9742da48-c7df-49e6-91b7-d7555384d03e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:05.883511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9742da48-c7df-49e6-91b7-d7555384d03e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:05.883957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9742da48-c7df-49e6-91b7-d7555384d03e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:06.028775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9742da48-c7df-49e6-91b7-d7555384d03e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:06.043186 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9742da48-c7df-49e6-91b7-d7555384d03e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1507 microversion: 2.1 time: 0.173234 Aug 02 07:42:06.043851 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3315/6700] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:05 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:06.067418 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b77e9710-36cf-4f72-86ba-3cddfeec00ef tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Action: 'create', calling method: .version_select at 0x7f9279ce0310>, body: {"keypair": {"name": "tempest-keypair-1162117568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ArhyF0dhUvtFcJS6lQL2SIyfQQGUl60aD+0gedAQkRhxOrTtrZpRX/lC/840j/U6Jyrx9yPs1+ZhjBNPkgHVxYQVBffNejtlhHj4oX0UTdfvl1kGqBd3iVgjo6SXifQ=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:42:06.083691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-b77e9710-36cf-4f72-86ba-3cddfeec00ef tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Getting quotas for project b4078336b80c49fba3e371f839e622f0. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:42:06.089532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-b77e9710-36cf-4f72-86ba-3cddfeec00ef tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Getting quotas for user db1525aaafa24ea696e915feba2ee005 and project b4078336b80c49fba3e371f839e622f0. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:42:06.120626 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b77e9710-36cf-4f72-86ba-3cddfeec00ef tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057200 Aug 02 07:42:06.121248 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3386/6701] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:42:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:42:07.538853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1ea65594-c653-4f3b-b20c-be16a02efa23 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:07.539801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1ea65594-c653-4f3b-b20c-be16a02efa23 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:07.547820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ea65594-c653-4f3b-b20c-be16a02efa23 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:07.548290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ea65594-c653-4f3b-b20c-be16a02efa23 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:07.549101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ea65594-c653-4f3b-b20c-be16a02efa23 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:07.549631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ea65594-c653-4f3b-b20c-be16a02efa23 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:07.705705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1ea65594-c653-4f3b-b20c-be16a02efa23 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:07.714720 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1ea65594-c653-4f3b-b20c-be16a02efa23 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 200 len: 1507 microversion: 2.1 time: 0.181830 Aug 02 07:42:07.715319 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3316/6702] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:07 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:42:07.737308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9b8027fc-0182-4141-a702-3e7d773c3ffb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:07.737957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9b8027fc-0182-4141-a702-3e7d773c3ffb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:07.747191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b8027fc-0182-4141-a702-3e7d773c3ffb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:07.747644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b8027fc-0182-4141-a702-3e7d773c3ffb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:07.748429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b8027fc-0182-4141-a702-3e7d773c3ffb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:07.748885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b8027fc-0182-4141-a702-3e7d773c3ffb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:07.777247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9b8027fc-0182-4141-a702-3e7d773c3ffb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:42:07.882639 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9b8027fc-0182-4141-a702-3e7d773c3ffb tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "DELETE /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 204 len: 0 microversion: 2.1 time: 0.149341 Aug 02 07:42:07.883892 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3387/6703] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:42:07 2022] DELETE /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:42:07.965114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-727211078", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "e29910aa-4bfc-4b63-9484-b63d16393606"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:42:08.025408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] validate_networks() for [('e29910aa-4bfc-4b63-9484-b63d16393606', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:42:08.496654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:42:08.497025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:42:08.497578 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:42:08.498035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:42:08.498457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:42:08.508669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:08.509130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:08.509952 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:08.510423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:08.528647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Getting quotas for project b4078336b80c49fba3e371f839e622f0. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:42:08.535532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Getting quotas for user db1525aaafa24ea696e915feba2ee005 and project b4078336b80c49fba3e371f839e622f0. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:42:08.552571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:42:08.555100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:42:08.608854 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5ebbe53f-5f87-40ce-995c-07f7e7232209 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648282 Aug 02 07:42:08.609545 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3317/6704] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:42:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:42:08.626499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ba44405d-5e46-456d-a028-b4d4a203fa68 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:08.628132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ba44405d-5e46-456d-a028-b4d4a203fa68 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:08.709788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ba44405d-5e46-456d-a028-b4d4a203fa68 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:08.714251 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ba44405d-5e46-456d-a028-b4d4a203fa68 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1217 microversion: 2.1 time: 0.096577 Aug 02 07:42:08.715335 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3388/6705] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:08 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:09.748238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6c751743-b330-4be3-bd1c-cdb430f565e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:09.748908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6c751743-b330-4be3-bd1c-cdb430f565e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:09.767914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c751743-b330-4be3-bd1c-cdb430f565e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:09.768636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c751743-b330-4be3-bd1c-cdb430f565e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:09.769652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c751743-b330-4be3-bd1c-cdb430f565e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:09.770267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6c751743-b330-4be3-bd1c-cdb430f565e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:09.788960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-4b8ccca8-9c74-4984-9a4b-10bb4eccbf1c req-ddc8f984-7752-4c71-bd92-69606c3727a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187a0897-a153-4bf4-8396-46d536695800", "name": "network-vif-deleted", "tag": "fda6050c-066f-4a42-b0df-33cd4af2eaa5"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:42:09.802957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4b8ccca8-9c74-4984-9a4b-10bb4eccbf1c req-ddc8f984-7752-4c71-bd92-69606c3727a9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:09.803552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4b8ccca8-9c74-4984-9a4b-10bb4eccbf1c req-ddc8f984-7752-4c71-bd92-69606c3727a9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:09.832677 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-4b8ccca8-9c74-4984-9a4b-10bb4eccbf1c req-ddc8f984-7752-4c71-bd92-69606c3727a9 service nova] Creating event network-vif-deleted:fda6050c-066f-4a42-b0df-33cd4af2eaa5 for instance 187a0897-a153-4bf4-8396-46d536695800 on n-h2-851337-3 Aug 02 07:42:09.839251 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-4b8ccca8-9c74-4984-9a4b-10bb4eccbf1c req-ddc8f984-7752-4c71-bd92-69606c3727a9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053821 Aug 02 07:42:09.840574 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3389/6706] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:42:09.881712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6c751743-b330-4be3-bd1c-cdb430f565e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:09.893726 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6c751743-b330-4be3-bd1c-cdb430f565e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1269 microversion: 2.1 time: 0.154150 Aug 02 07:42:09.895894 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3318/6707] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:09 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:10.918437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d769c895-e0fd-43a7-83ff-eb6ad3f15cb8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:10.919275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d769c895-e0fd-43a7-83ff-eb6ad3f15cb8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:10.926477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d769c895-e0fd-43a7-83ff-eb6ad3f15cb8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:10.926926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d769c895-e0fd-43a7-83ff-eb6ad3f15cb8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:10.927708 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d769c895-e0fd-43a7-83ff-eb6ad3f15cb8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:10.928144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d769c895-e0fd-43a7-83ff-eb6ad3f15cb8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:11.080043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d769c895-e0fd-43a7-83ff-eb6ad3f15cb8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:11.092190 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d769c895-e0fd-43a7-83ff-eb6ad3f15cb8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1317 microversion: 2.1 time: 0.178582 Aug 02 07:42:11.093399 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3390/6708] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:10 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:11.258532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-0d0f426b-a662-496f-bd8e-47993abd5881 req-2cbc605a-bb4a-4eeb-9d9a-0b6189a4d92e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9198035-3976-4221-9c74-1306b3bebf2e", "tag": "34b558ef-9a14-4031-8a6a-58c89e755c6e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:42:11.271706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0d0f426b-a662-496f-bd8e-47993abd5881 req-2cbc605a-bb4a-4eeb-9d9a-0b6189a4d92e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:11.272142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0d0f426b-a662-496f-bd8e-47993abd5881 req-2cbc605a-bb4a-4eeb-9d9a-0b6189a4d92e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:11.284863 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-0d0f426b-a662-496f-bd8e-47993abd5881 req-2cbc605a-bb4a-4eeb-9d9a-0b6189a4d92e service nova] Creating event network-changed:34b558ef-9a14-4031-8a6a-58c89e755c6e for instance a9198035-3976-4221-9c74-1306b3bebf2e on n-h1-851337-3 Aug 02 07:42:11.290207 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-0d0f426b-a662-496f-bd8e-47993abd5881 req-2cbc605a-bb4a-4eeb-9d9a-0b6189a4d92e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036669 Aug 02 07:42:11.291108 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3319/6709] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:42:12.123282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c267d4a4-6d66-4215-a08e-6295957e3821 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:12.124022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c267d4a4-6d66-4215-a08e-6295957e3821 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:12.134127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c267d4a4-6d66-4215-a08e-6295957e3821 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:12.135133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c267d4a4-6d66-4215-a08e-6295957e3821 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:12.136407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c267d4a4-6d66-4215-a08e-6295957e3821 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:12.137127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c267d4a4-6d66-4215-a08e-6295957e3821 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:12.285757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c267d4a4-6d66-4215-a08e-6295957e3821 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:12.297965 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c267d4a4-6d66-4215-a08e-6295957e3821 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1317 microversion: 2.1 time: 0.180552 Aug 02 07:42:12.298756 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3391/6710] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:12 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:13.322904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2a7fa448-f168-499b-9c3c-939baa65fcad tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:13.323839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2a7fa448-f168-499b-9c3c-939baa65fcad tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:13.332817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a7fa448-f168-499b-9c3c-939baa65fcad tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:13.333421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a7fa448-f168-499b-9c3c-939baa65fcad tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:13.334540 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a7fa448-f168-499b-9c3c-939baa65fcad tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:13.335109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a7fa448-f168-499b-9c3c-939baa65fcad tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:13.492337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2a7fa448-f168-499b-9c3c-939baa65fcad tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:13.503492 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2a7fa448-f168-499b-9c3c-939baa65fcad tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1317 microversion: 2.1 time: 0.187527 Aug 02 07:42:13.504084 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3320/6711] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:13 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:14.528208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d69660f5-83ea-4598-a2b7-bb01038ef219 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:14.529191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d69660f5-83ea-4598-a2b7-bb01038ef219 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:14.539881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d69660f5-83ea-4598-a2b7-bb01038ef219 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:14.540579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d69660f5-83ea-4598-a2b7-bb01038ef219 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:14.542128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d69660f5-83ea-4598-a2b7-bb01038ef219 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:14.542753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d69660f5-83ea-4598-a2b7-bb01038ef219 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:14.693304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d69660f5-83ea-4598-a2b7-bb01038ef219 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:14.704147 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d69660f5-83ea-4598-a2b7-bb01038ef219 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1317 microversion: 2.1 time: 0.181267 Aug 02 07:42:14.704919 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3392/6712] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:14 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:15.729003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-75ff49a8-0576-4ce3-9cf4-89f3fd639d0b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:15.730089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-75ff49a8-0576-4ce3-9cf4-89f3fd639d0b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:15.740340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75ff49a8-0576-4ce3-9cf4-89f3fd639d0b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:15.741002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75ff49a8-0576-4ce3-9cf4-89f3fd639d0b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:15.742185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75ff49a8-0576-4ce3-9cf4-89f3fd639d0b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:15.742833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75ff49a8-0576-4ce3-9cf4-89f3fd639d0b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:15.885363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-75ff49a8-0576-4ce3-9cf4-89f3fd639d0b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:15.893440 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-75ff49a8-0576-4ce3-9cf4-89f3fd639d0b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1317 microversion: 2.1 time: 0.170033 Aug 02 07:42:15.894327 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3321/6713] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:15 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:16.915514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8d166ea1-9b26-4562-a72d-a9afab579637 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:16.916414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8d166ea1-9b26-4562-a72d-a9afab579637 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:16.923794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d166ea1-9b26-4562-a72d-a9afab579637 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:16.924239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d166ea1-9b26-4562-a72d-a9afab579637 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:16.925097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d166ea1-9b26-4562-a72d-a9afab579637 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:16.925527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d166ea1-9b26-4562-a72d-a9afab579637 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:17.066645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8d166ea1-9b26-4562-a72d-a9afab579637 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:17.074930 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8d166ea1-9b26-4562-a72d-a9afab579637 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1317 microversion: 2.1 time: 0.163292 Aug 02 07:42:17.075842 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3393/6714] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:16 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:18.101067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-14489894-ed79-4028-8de2-e3b00f77e29e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:18.102009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-14489894-ed79-4028-8de2-e3b00f77e29e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:18.113324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14489894-ed79-4028-8de2-e3b00f77e29e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:18.113789 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14489894-ed79-4028-8de2-e3b00f77e29e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:18.114620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14489894-ed79-4028-8de2-e3b00f77e29e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:18.115073 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-14489894-ed79-4028-8de2-e3b00f77e29e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:18.118016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=89 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:42:18.267072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-14489894-ed79-4028-8de2-e3b00f77e29e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:18.277251 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-14489894-ed79-4028-8de2-e3b00f77e29e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1317 microversion: 2.1 time: 0.183189 Aug 02 07:42:18.277841 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3322/6715] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:18 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:18.620721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-f531e882-dac5-4252-a3b3-020b1a5eca42 req-dbffed24-f4ab-4527-87ca-73a47431d22a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9198035-3976-4221-9c74-1306b3bebf2e", "name": "network-vif-plugged", "status": "completed", "tag": "34b558ef-9a14-4031-8a6a-58c89e755c6e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:42:18.633112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f531e882-dac5-4252-a3b3-020b1a5eca42 req-dbffed24-f4ab-4527-87ca-73a47431d22a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:18.633640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f531e882-dac5-4252-a3b3-020b1a5eca42 req-dbffed24-f4ab-4527-87ca-73a47431d22a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:18.645804 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f531e882-dac5-4252-a3b3-020b1a5eca42 req-dbffed24-f4ab-4527-87ca-73a47431d22a service nova] Creating event network-vif-plugged:34b558ef-9a14-4031-8a6a-58c89e755c6e for instance a9198035-3976-4221-9c74-1306b3bebf2e on n-h1-851337-3 Aug 02 07:42:18.650973 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-f531e882-dac5-4252-a3b3-020b1a5eca42 req-dbffed24-f4ab-4527-87ca-73a47431d22a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034596 Aug 02 07:42:18.651603 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3394/6716] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:42:19.300358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aecdd86c-130b-4801-aad3-0b8bf861fa32 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:19.301083 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aecdd86c-130b-4801-aad3-0b8bf861fa32 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:19.303400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:42:19.304281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:42:19.313352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aecdd86c-130b-4801-aad3-0b8bf861fa32 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:19.313941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aecdd86c-130b-4801-aad3-0b8bf861fa32 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:19.315074 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aecdd86c-130b-4801-aad3-0b8bf861fa32 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:19.315525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aecdd86c-130b-4801-aad3-0b8bf861fa32 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:19.458745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-aecdd86c-130b-4801-aad3-0b8bf861fa32 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:19.466999 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aecdd86c-130b-4801-aad3-0b8bf861fa32 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1317 microversion: 2.1 time: 0.171692 Aug 02 07:42:19.467629 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3323/6717] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:19 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:20.488126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:42:20.493676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c80a9ba4-251e-485f-aceb-91431bcf25fd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:20.494475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c80a9ba4-251e-485f-aceb-91431bcf25fd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:20.502058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c80a9ba4-251e-485f-aceb-91431bcf25fd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:20.502547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c80a9ba4-251e-485f-aceb-91431bcf25fd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:20.503406 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c80a9ba4-251e-485f-aceb-91431bcf25fd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:20.503889 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c80a9ba4-251e-485f-aceb-91431bcf25fd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:20.653677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c80a9ba4-251e-485f-aceb-91431bcf25fd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:20.661874 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c80a9ba4-251e-485f-aceb-91431bcf25fd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1507 microversion: 2.1 time: 0.174900 Aug 02 07:42:20.662487 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3395/6718] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:20 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:20.682462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6ebe36fc-f168-482c-9beb-e86923af3ecd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:20.683057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6ebe36fc-f168-482c-9beb-e86923af3ecd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:20.691435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ebe36fc-f168-482c-9beb-e86923af3ecd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:20.691888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ebe36fc-f168-482c-9beb-e86923af3ecd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:20.692655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ebe36fc-f168-482c-9beb-e86923af3ecd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:20.693099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6ebe36fc-f168-482c-9beb-e86923af3ecd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:20.844234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6ebe36fc-f168-482c-9beb-e86923af3ecd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:20.854522 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6ebe36fc-f168-482c-9beb-e86923af3ecd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1507 microversion: 2.1 time: 0.175985 Aug 02 07:42:20.855368 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3324/6719] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:20 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:20.875035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1639b13a-c266-4f04-8fe9-6d037ab82d8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:42:20.877451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1639b13a-c266-4f04-8fe9-6d037ab82d8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:20.886734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1639b13a-c266-4f04-8fe9-6d037ab82d8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:20.887088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1639b13a-c266-4f04-8fe9-6d037ab82d8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:20.887823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1639b13a-c266-4f04-8fe9-6d037ab82d8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:20.888257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1639b13a-c266-4f04-8fe9-6d037ab82d8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:20.917047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1639b13a-c266-4f04-8fe9-6d037ab82d8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:20.923243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1639b13a-c266-4f04-8fe9-6d037ab82d8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Old instance type m1.heat2, new instance type m1.heat {{(pid=126120) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 07:42:20.929876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1639b13a-c266-4f04-8fe9-6d037ab82d8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:42:20.930319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1639b13a-c266-4f04-8fe9-6d037ab82d8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:42:20.930762 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1639b13a-c266-4f04-8fe9-6d037ab82d8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:42:20.931168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1639b13a-c266-4f04-8fe9-6d037ab82d8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:42:20.931572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-1639b13a-c266-4f04-8fe9-6d037ab82d8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:42:20.997228 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1639b13a-c266-4f04-8fe9-6d037ab82d8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "POST /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e/action" status: 202 len: 0 microversion: 2.1 time: 0.126117 Aug 02 07:42:20.997833 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3396/6720] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:42:20 2022] POST /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:42:21.006454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f91a8e42-0ced-4a17-8fcf-4a061d2c2281 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:21.007087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f91a8e42-0ced-4a17-8fcf-4a061d2c2281 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:21.013217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f91a8e42-0ced-4a17-8fcf-4a061d2c2281 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:21.013682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f91a8e42-0ced-4a17-8fcf-4a061d2c2281 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:21.014498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f91a8e42-0ced-4a17-8fcf-4a061d2c2281 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:21.014948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f91a8e42-0ced-4a17-8fcf-4a061d2c2281 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:21.175919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f91a8e42-0ced-4a17-8fcf-4a061d2c2281 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:21.183700 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f91a8e42-0ced-4a17-8fcf-4a061d2c2281 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1514 microversion: 2.1 time: 0.181597 Aug 02 07:42:21.184314 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3325/6721] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:21 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:22.208711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a04403e2-1cd6-47cc-b960-f5f7ff9017b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:22.209426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a04403e2-1cd6-47cc-b960-f5f7ff9017b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:22.223040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a04403e2-1cd6-47cc-b960-f5f7ff9017b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:22.223493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a04403e2-1cd6-47cc-b960-f5f7ff9017b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:22.224257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a04403e2-1cd6-47cc-b960-f5f7ff9017b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:22.224692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a04403e2-1cd6-47cc-b960-f5f7ff9017b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:22.228794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:42:22.362614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a04403e2-1cd6-47cc-b960-f5f7ff9017b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:22.370533 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a04403e2-1cd6-47cc-b960-f5f7ff9017b2 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1514 microversion: 2.1 time: 0.168732 Aug 02 07:42:22.371203 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3397/6722] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:22 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:23.397084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1ba583a8-7d88-4eda-af1f-625a5f471743 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:23.397740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1ba583a8-7d88-4eda-af1f-625a5f471743 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:23.406358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ba583a8-7d88-4eda-af1f-625a5f471743 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:23.406827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ba583a8-7d88-4eda-af1f-625a5f471743 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:23.407614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ba583a8-7d88-4eda-af1f-625a5f471743 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:23.408056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ba583a8-7d88-4eda-af1f-625a5f471743 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:23.557760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1ba583a8-7d88-4eda-af1f-625a5f471743 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:23.566138 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1ba583a8-7d88-4eda-af1f-625a5f471743 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.175400 Aug 02 07:42:23.566725 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3326/6723] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:23 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:24.588493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0bc2c059-9540-4c68-a0e7-f6b3e1c8d6c8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:24.589157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0bc2c059-9540-4c68-a0e7-f6b3e1c8d6c8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:24.597734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bc2c059-9540-4c68-a0e7-f6b3e1c8d6c8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:24.598332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bc2c059-9540-4c68-a0e7-f6b3e1c8d6c8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:24.599499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bc2c059-9540-4c68-a0e7-f6b3e1c8d6c8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:24.600207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bc2c059-9540-4c68-a0e7-f6b3e1c8d6c8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:24.806801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0bc2c059-9540-4c68-a0e7-f6b3e1c8d6c8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:24.814529 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0bc2c059-9540-4c68-a0e7-f6b3e1c8d6c8 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.230112 Aug 02 07:42:24.815193 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3398/6724] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:24 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:25.838221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-92733e81-c1ef-44bd-aaac-25536d4afb13 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:25.839167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-92733e81-c1ef-44bd-aaac-25536d4afb13 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:25.847901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92733e81-c1ef-44bd-aaac-25536d4afb13 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:25.848363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92733e81-c1ef-44bd-aaac-25536d4afb13 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:25.849365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92733e81-c1ef-44bd-aaac-25536d4afb13 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:25.849820 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-92733e81-c1ef-44bd-aaac-25536d4afb13 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:26.048788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-92733e81-c1ef-44bd-aaac-25536d4afb13 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:26.060017 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-92733e81-c1ef-44bd-aaac-25536d4afb13 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.226960 Aug 02 07:42:26.060583 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3327/6725] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:25 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:27.082134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-af593bac-e722-49a8-9def-c39471aba67d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:27.082791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-af593bac-e722-49a8-9def-c39471aba67d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:27.090670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af593bac-e722-49a8-9def-c39471aba67d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:27.091117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af593bac-e722-49a8-9def-c39471aba67d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:27.091915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af593bac-e722-49a8-9def-c39471aba67d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:27.092346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-af593bac-e722-49a8-9def-c39471aba67d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:27.237780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-af593bac-e722-49a8-9def-c39471aba67d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:27.245752 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-af593bac-e722-49a8-9def-c39471aba67d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.168351 Aug 02 07:42:27.246363 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3399/6726] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:27 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:28.271402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c35b90c1-b320-4c83-89bc-e2be909ad8e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:28.272262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c35b90c1-b320-4c83-89bc-e2be909ad8e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:28.284019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c35b90c1-b320-4c83-89bc-e2be909ad8e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:28.284639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c35b90c1-b320-4c83-89bc-e2be909ad8e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:28.285435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c35b90c1-b320-4c83-89bc-e2be909ad8e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:28.285886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c35b90c1-b320-4c83-89bc-e2be909ad8e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:28.430248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c35b90c1-b320-4c83-89bc-e2be909ad8e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:28.441929 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c35b90c1-b320-4c83-89bc-e2be909ad8e7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.177366 Aug 02 07:42:28.442553 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3328/6727] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:28 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:29.468151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8f045384-d6f4-4ea3-afe5-a24b89a6d48e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:29.469284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8f045384-d6f4-4ea3-afe5-a24b89a6d48e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:29.478174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f045384-d6f4-4ea3-afe5-a24b89a6d48e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:29.478628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f045384-d6f4-4ea3-afe5-a24b89a6d48e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:29.479402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f045384-d6f4-4ea3-afe5-a24b89a6d48e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:29.479836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f045384-d6f4-4ea3-afe5-a24b89a6d48e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:29.638228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8f045384-d6f4-4ea3-afe5-a24b89a6d48e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:29.646438 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8f045384-d6f4-4ea3-afe5-a24b89a6d48e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.185963 Aug 02 07:42:29.647308 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3400/6728] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:29 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:30.668232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e0e923cc-fe9a-45b0-abf4-f1c77e210692 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:30.668861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e0e923cc-fe9a-45b0-abf4-f1c77e210692 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:30.671798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:42:30.677610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0e923cc-fe9a-45b0-abf4-f1c77e210692 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:30.678096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0e923cc-fe9a-45b0-abf4-f1c77e210692 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:30.678884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0e923cc-fe9a-45b0-abf4-f1c77e210692 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:30.679340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0e923cc-fe9a-45b0-abf4-f1c77e210692 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:30.831001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e0e923cc-fe9a-45b0-abf4-f1c77e210692 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:30.841970 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e0e923cc-fe9a-45b0-abf4-f1c77e210692 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.175854 Aug 02 07:42:30.841970 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3329/6729] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:30 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:31.863162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ee5847a7-a317-4b11-afe1-564024620f8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:31.863777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ee5847a7-a317-4b11-afe1-564024620f8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:31.867289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:42:31.873220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee5847a7-a317-4b11-afe1-564024620f8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:31.873601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee5847a7-a317-4b11-afe1-564024620f8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:31.874422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee5847a7-a317-4b11-afe1-564024620f8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:31.874864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee5847a7-a317-4b11-afe1-564024620f8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:32.019357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ee5847a7-a317-4b11-afe1-564024620f8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:32.028766 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ee5847a7-a317-4b11-afe1-564024620f8d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.169420 Aug 02 07:42:32.029367 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3401/6730] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:31 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:33.052422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e36c1963-5d3c-4791-8aeb-612076bc9547 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:33.053120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e36c1963-5d3c-4791-8aeb-612076bc9547 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:33.060597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e36c1963-5d3c-4791-8aeb-612076bc9547 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:33.061061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e36c1963-5d3c-4791-8aeb-612076bc9547 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:33.061858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e36c1963-5d3c-4791-8aeb-612076bc9547 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:33.062332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e36c1963-5d3c-4791-8aeb-612076bc9547 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:33.203593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e36c1963-5d3c-4791-8aeb-612076bc9547 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:33.212052 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e36c1963-5d3c-4791-8aeb-612076bc9547 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.164474 Aug 02 07:42:33.212652 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3330/6731] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:33 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:34.234838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1a5f9bbf-e6d1-478d-8624-5f79d1f6f10e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:34.235483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1a5f9bbf-e6d1-478d-8624-5f79d1f6f10e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:34.242998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a5f9bbf-e6d1-478d-8624-5f79d1f6f10e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:34.243443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a5f9bbf-e6d1-478d-8624-5f79d1f6f10e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:34.244316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a5f9bbf-e6d1-478d-8624-5f79d1f6f10e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:34.244725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1a5f9bbf-e6d1-478d-8624-5f79d1f6f10e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:34.379724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1a5f9bbf-e6d1-478d-8624-5f79d1f6f10e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:34.392011 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1a5f9bbf-e6d1-478d-8624-5f79d1f6f10e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.160889 Aug 02 07:42:34.392871 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3402/6732] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:34 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:35.414715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3e07c980-d74f-482d-a950-451b07ac51be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:35.415419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3e07c980-d74f-482d-a950-451b07ac51be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:35.423476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e07c980-d74f-482d-a950-451b07ac51be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:35.424222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e07c980-d74f-482d-a950-451b07ac51be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:35.425583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e07c980-d74f-482d-a950-451b07ac51be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:35.426282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e07c980-d74f-482d-a950-451b07ac51be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:35.572908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3e07c980-d74f-482d-a950-451b07ac51be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:35.581551 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3e07c980-d74f-482d-a950-451b07ac51be tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.171326 Aug 02 07:42:35.582206 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3331/6733] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:35 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:36.615326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7c3f4fc0-9a8a-4380-835d-e47148ebb328 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:36.615993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7c3f4fc0-9a8a-4380-835d-e47148ebb328 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:36.623566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c3f4fc0-9a8a-4380-835d-e47148ebb328 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:36.624011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c3f4fc0-9a8a-4380-835d-e47148ebb328 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:36.624831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c3f4fc0-9a8a-4380-835d-e47148ebb328 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:36.625262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c3f4fc0-9a8a-4380-835d-e47148ebb328 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:36.777403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7c3f4fc0-9a8a-4380-835d-e47148ebb328 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:36.786338 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7c3f4fc0-9a8a-4380-835d-e47148ebb328 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.176572 Aug 02 07:42:36.787026 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3403/6734] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:36 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:37.813464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3bdab52c-f883-41ab-8f06-ea1616130ef7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:37.814225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3bdab52c-f883-41ab-8f06-ea1616130ef7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:37.822286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bdab52c-f883-41ab-8f06-ea1616130ef7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:37.822755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bdab52c-f883-41ab-8f06-ea1616130ef7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:37.823536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bdab52c-f883-41ab-8f06-ea1616130ef7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:37.823984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bdab52c-f883-41ab-8f06-ea1616130ef7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:37.967463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3bdab52c-f883-41ab-8f06-ea1616130ef7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:37.975505 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3bdab52c-f883-41ab-8f06-ea1616130ef7 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.166445 Aug 02 07:42:37.976086 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3332/6735] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:37 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:38.998899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0bfa521a-64b0-4355-bf60-821498bae47f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:38.999736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0bfa521a-64b0-4355-bf60-821498bae47f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:39.009330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bfa521a-64b0-4355-bf60-821498bae47f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:39.009777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bfa521a-64b0-4355-bf60-821498bae47f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:39.010877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bfa521a-64b0-4355-bf60-821498bae47f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:39.011304 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bfa521a-64b0-4355-bf60-821498bae47f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:39.163724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0bfa521a-64b0-4355-bf60-821498bae47f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:39.171962 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0bfa521a-64b0-4355-bf60-821498bae47f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.178443 Aug 02 07:42:39.172543 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3404/6736] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:38 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:40.193671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ef7d7b1f-b49c-423d-8c99-203028ac4e7d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:40.194324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ef7d7b1f-b49c-423d-8c99-203028ac4e7d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:40.202046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef7d7b1f-b49c-423d-8c99-203028ac4e7d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:40.202509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef7d7b1f-b49c-423d-8c99-203028ac4e7d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:40.203317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef7d7b1f-b49c-423d-8c99-203028ac4e7d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:40.203827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ef7d7b1f-b49c-423d-8c99-203028ac4e7d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:40.341006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ef7d7b1f-b49c-423d-8c99-203028ac4e7d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:40.348982 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ef7d7b1f-b49c-423d-8c99-203028ac4e7d tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.159387 Aug 02 07:42:40.349572 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3333/6737] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:40 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:41.370999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43acf19e-4c19-4bbf-857d-f7dbef0751cd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:41.371661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-43acf19e-4c19-4bbf-857d-f7dbef0751cd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:41.381766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43acf19e-4c19-4bbf-857d-f7dbef0751cd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:41.382457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43acf19e-4c19-4bbf-857d-f7dbef0751cd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:41.383770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43acf19e-4c19-4bbf-857d-f7dbef0751cd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:41.384528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43acf19e-4c19-4bbf-857d-f7dbef0751cd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:41.550500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43acf19e-4c19-4bbf-857d-f7dbef0751cd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:41.558896 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43acf19e-4c19-4bbf-857d-f7dbef0751cd tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.192024 Aug 02 07:42:41.559472 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3405/6738] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:41 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:42.581111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cd69a568-b5e4-48ed-9c51-453e19305132 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:42.581756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cd69a568-b5e4-48ed-9c51-453e19305132 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:42.589764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd69a568-b5e4-48ed-9c51-453e19305132 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:42.590253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd69a568-b5e4-48ed-9c51-453e19305132 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:42.591027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd69a568-b5e4-48ed-9c51-453e19305132 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:42.591493 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd69a568-b5e4-48ed-9c51-453e19305132 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:42.744017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cd69a568-b5e4-48ed-9c51-453e19305132 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:42.752193 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cd69a568-b5e4-48ed-9c51-453e19305132 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.175351 Aug 02 07:42:42.752944 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3334/6739] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:42 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:43.775122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-699c6fd9-6552-4ccd-adee-e4bacef253b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:43.775706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-699c6fd9-6552-4ccd-adee-e4bacef253b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:43.783246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-699c6fd9-6552-4ccd-adee-e4bacef253b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:43.783690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-699c6fd9-6552-4ccd-adee-e4bacef253b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:43.784441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-699c6fd9-6552-4ccd-adee-e4bacef253b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:43.785198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-699c6fd9-6552-4ccd-adee-e4bacef253b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:43.931357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-699c6fd9-6552-4ccd-adee-e4bacef253b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:43.939450 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-699c6fd9-6552-4ccd-adee-e4bacef253b0 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.168557 Aug 02 07:42:43.940016 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3406/6740] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:43 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:44.964020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ed973e7b-6cba-41d6-a2f0-6ca88fdf1f5b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:44.964690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ed973e7b-6cba-41d6-a2f0-6ca88fdf1f5b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:44.972311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed973e7b-6cba-41d6-a2f0-6ca88fdf1f5b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:44.972774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed973e7b-6cba-41d6-a2f0-6ca88fdf1f5b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:44.973554 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed973e7b-6cba-41d6-a2f0-6ca88fdf1f5b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:44.974033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ed973e7b-6cba-41d6-a2f0-6ca88fdf1f5b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:45.126603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ed973e7b-6cba-41d6-a2f0-6ca88fdf1f5b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:45.135450 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ed973e7b-6cba-41d6-a2f0-6ca88fdf1f5b tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.175360 Aug 02 07:42:45.136011 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3335/6741] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:44 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:46.112663 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:42:46.113362 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 07:42:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:42:46.158129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-18630cc1-6850-4c6d-a19c-8ba2960463dc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:46.158791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-18630cc1-6850-4c6d-a19c-8ba2960463dc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:46.166569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18630cc1-6850-4c6d-a19c-8ba2960463dc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:46.167025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18630cc1-6850-4c6d-a19c-8ba2960463dc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:46.168065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18630cc1-6850-4c6d-a19c-8ba2960463dc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:46.168615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18630cc1-6850-4c6d-a19c-8ba2960463dc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:46.311005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-18630cc1-6850-4c6d-a19c-8ba2960463dc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:46.319123 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-18630cc1-6850-4c6d-a19c-8ba2960463dc tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.165240 Aug 02 07:42:46.319923 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3407/6742] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:46 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:47.349764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-48d17a75-27e9-4c64-a70c-843de04cad20 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:47.350489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-48d17a75-27e9-4c64-a70c-843de04cad20 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:47.361677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48d17a75-27e9-4c64-a70c-843de04cad20 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:47.362296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48d17a75-27e9-4c64-a70c-843de04cad20 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:47.363321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48d17a75-27e9-4c64-a70c-843de04cad20 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:47.363782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-48d17a75-27e9-4c64-a70c-843de04cad20 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:47.523946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-48d17a75-27e9-4c64-a70c-843de04cad20 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:47.538404 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-48d17a75-27e9-4c64-a70c-843de04cad20 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.193314 Aug 02 07:42:47.539006 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3336/6743] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:47 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:48.562803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-39969e6c-4d11-45eb-b525-34d070231450 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:48.563404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-39969e6c-4d11-45eb-b525-34d070231450 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:48.573251 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39969e6c-4d11-45eb-b525-34d070231450 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:48.573791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39969e6c-4d11-45eb-b525-34d070231450 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:48.574438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39969e6c-4d11-45eb-b525-34d070231450 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:48.574875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39969e6c-4d11-45eb-b525-34d070231450 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:48.712912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-39969e6c-4d11-45eb-b525-34d070231450 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:48.723405 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-39969e6c-4d11-45eb-b525-34d070231450 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.166627 Aug 02 07:42:48.724059 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3408/6744] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:48 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:49.745475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e5c4d6d2-cbf2-404d-bb1b-782f70531fc5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:49.746248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e5c4d6d2-cbf2-404d-bb1b-782f70531fc5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:49.753621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5c4d6d2-cbf2-404d-bb1b-782f70531fc5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:49.754117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5c4d6d2-cbf2-404d-bb1b-782f70531fc5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:49.755319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5c4d6d2-cbf2-404d-bb1b-782f70531fc5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:49.755725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e5c4d6d2-cbf2-404d-bb1b-782f70531fc5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:49.758503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=90 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:42:49.898007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e5c4d6d2-cbf2-404d-bb1b-782f70531fc5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:49.906040 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e5c4d6d2-cbf2-404d-bb1b-782f70531fc5 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1519 microversion: 2.1 time: 0.164876 Aug 02 07:42:49.906602 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3337/6745] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:49 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:50.478477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-822cf223-48a5-4122-b707-86d2ee707f70 req-87433d0a-d664-4260-b2d6-f3500ecd89b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9198035-3976-4221-9c74-1306b3bebf2e", "name": "network-vif-unplugged", "status": "completed", "tag": "34b558ef-9a14-4031-8a6a-58c89e755c6e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:42:50.488357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-822cf223-48a5-4122-b707-86d2ee707f70 req-87433d0a-d664-4260-b2d6-f3500ecd89b3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:50.488796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-822cf223-48a5-4122-b707-86d2ee707f70 req-87433d0a-d664-4260-b2d6-f3500ecd89b3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:50.501173 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-822cf223-48a5-4122-b707-86d2ee707f70 req-87433d0a-d664-4260-b2d6-f3500ecd89b3 service nova] Creating event network-vif-unplugged:34b558ef-9a14-4031-8a6a-58c89e755c6e for instance a9198035-3976-4221-9c74-1306b3bebf2e on n-h2-851337-3 Aug 02 07:42:50.507184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-822cf223-48a5-4122-b707-86d2ee707f70 req-87433d0a-d664-4260-b2d6-f3500ecd89b3 service nova] Instance a9198035-3976-4221-9c74-1306b3bebf2e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:42:50.518270 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-822cf223-48a5-4122-b707-86d2ee707f70 req-87433d0a-d664-4260-b2d6-f3500ecd89b3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131929 Aug 02 07:42:50.519042 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3409/6746] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:42:50.927771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-acfe8bba-372f-40d2-b7c5-3afdcf42a173 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:50.928584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-acfe8bba-372f-40d2-b7c5-3afdcf42a173 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:50.936261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-acfe8bba-372f-40d2-b7c5-3afdcf42a173 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:50.936720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-acfe8bba-372f-40d2-b7c5-3afdcf42a173 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:50.937502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-acfe8bba-372f-40d2-b7c5-3afdcf42a173 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:50.937953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-acfe8bba-372f-40d2-b7c5-3afdcf42a173 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:51.186313 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-acfe8bba-372f-40d2-b7c5-3afdcf42a173 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:51.194629 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-acfe8bba-372f-40d2-b7c5-3afdcf42a173 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1518 microversion: 2.1 time: 0.270858 Aug 02 07:42:51.195268 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3338/6747] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:50 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1518 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:52.223063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aaf01c80-7e4d-4c65-958b-7ad2fc3a88da tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:52.224092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aaf01c80-7e4d-4c65-958b-7ad2fc3a88da tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:52.232821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aaf01c80-7e4d-4c65-958b-7ad2fc3a88da tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:52.233274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aaf01c80-7e4d-4c65-958b-7ad2fc3a88da tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:52.234108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aaf01c80-7e4d-4c65-958b-7ad2fc3a88da tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:52.234545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aaf01c80-7e4d-4c65-958b-7ad2fc3a88da tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:52.256835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=78 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:42:52.381152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-aaf01c80-7e4d-4c65-958b-7ad2fc3a88da tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:52.389443 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aaf01c80-7e4d-4c65-958b-7ad2fc3a88da tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1516 microversion: 2.1 time: 0.175323 Aug 02 07:42:52.390089 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3410/6748] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:52 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:42:52.540935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-182eefdb-98ee-4c95-ae6c-33aca057137d req-b1192dc2-fda7-4055-9e36-65de1c9662c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9198035-3976-4221-9c74-1306b3bebf2e", "tag": "34b558ef-9a14-4031-8a6a-58c89e755c6e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:42:52.552044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-182eefdb-98ee-4c95-ae6c-33aca057137d req-b1192dc2-fda7-4055-9e36-65de1c9662c9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:52.552483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-182eefdb-98ee-4c95-ae6c-33aca057137d req-b1192dc2-fda7-4055-9e36-65de1c9662c9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:52.565528 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-182eefdb-98ee-4c95-ae6c-33aca057137d req-b1192dc2-fda7-4055-9e36-65de1c9662c9 service nova] Creating event network-changed:34b558ef-9a14-4031-8a6a-58c89e755c6e for instance a9198035-3976-4221-9c74-1306b3bebf2e on n-h2-851337-3 Aug 02 07:42:52.571536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-182eefdb-98ee-4c95-ae6c-33aca057137d req-b1192dc2-fda7-4055-9e36-65de1c9662c9 service nova] Instance a9198035-3976-4221-9c74-1306b3bebf2e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:42:52.584002 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-182eefdb-98ee-4c95-ae6c-33aca057137d req-b1192dc2-fda7-4055-9e36-65de1c9662c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046980 Aug 02 07:42:52.584612 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3339/6749] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:42:53.411536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d9a4824b-d05e-47cd-b11b-1e2c25d8d2d3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:53.412138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d9a4824b-d05e-47cd-b11b-1e2c25d8d2d3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:53.419928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9a4824b-d05e-47cd-b11b-1e2c25d8d2d3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:53.420374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9a4824b-d05e-47cd-b11b-1e2c25d8d2d3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:53.421140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9a4824b-d05e-47cd-b11b-1e2c25d8d2d3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:53.421570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d9a4824b-d05e-47cd-b11b-1e2c25d8d2d3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:53.952308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d9a4824b-d05e-47cd-b11b-1e2c25d8d2d3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:53.960610 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d9a4824b-d05e-47cd-b11b-1e2c25d8d2d3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1513 microversion: 2.1 time: 0.553129 Aug 02 07:42:53.961191 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3411/6750] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:53 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1513 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:53.982839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-68b628da-43ac-4a60-9ffa-8a239272a2a1 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:42:53.983461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-68b628da-43ac-4a60-9ffa-8a239272a2a1 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:53.991305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68b628da-43ac-4a60-9ffa-8a239272a2a1 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:53.991766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68b628da-43ac-4a60-9ffa-8a239272a2a1 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:53.992560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68b628da-43ac-4a60-9ffa-8a239272a2a1 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:53.993001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68b628da-43ac-4a60-9ffa-8a239272a2a1 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:54.059191 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-68b628da-43ac-4a60-9ffa-8a239272a2a1 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "POST /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e/action" status: 204 len: 0 microversion: 2.1 time: 0.080514 Aug 02 07:42:54.059867 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3340/6751] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:42:53 2022] POST /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:42:54.068348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-686bde88-7489-4192-88e9-42ff7f44747c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:54.069047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-686bde88-7489-4192-88e9-42ff7f44747c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:54.075874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-686bde88-7489-4192-88e9-42ff7f44747c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:54.076371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-686bde88-7489-4192-88e9-42ff7f44747c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:54.077257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-686bde88-7489-4192-88e9-42ff7f44747c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:54.077737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-686bde88-7489-4192-88e9-42ff7f44747c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:54.218954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-686bde88-7489-4192-88e9-42ff7f44747c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:54.226941 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-686bde88-7489-4192-88e9-42ff7f44747c tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1513 microversion: 2.1 time: 0.162517 Aug 02 07:42:54.227661 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3412/6752] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:54 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:55.250935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-809a3e1a-14a9-4a50-8e4c-a7eeb7374e06 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:55.251655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-809a3e1a-14a9-4a50-8e4c-a7eeb7374e06 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:55.258560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-809a3e1a-14a9-4a50-8e4c-a7eeb7374e06 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:55.259025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-809a3e1a-14a9-4a50-8e4c-a7eeb7374e06 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:55.259830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-809a3e1a-14a9-4a50-8e4c-a7eeb7374e06 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:55.260278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-809a3e1a-14a9-4a50-8e4c-a7eeb7374e06 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:55.367671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ae2edf41-8270-43e5-9fb3-9840612193f8 req-0e8a08c2-ec96-47a6-920d-c11ed046caa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9198035-3976-4221-9c74-1306b3bebf2e", "name": "network-vif-plugged", "status": "completed", "tag": "34b558ef-9a14-4031-8a6a-58c89e755c6e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:42:55.377870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ae2edf41-8270-43e5-9fb3-9840612193f8 req-0e8a08c2-ec96-47a6-920d-c11ed046caa5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:55.378374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ae2edf41-8270-43e5-9fb3-9840612193f8 req-0e8a08c2-ec96-47a6-920d-c11ed046caa5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:55.391560 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ae2edf41-8270-43e5-9fb3-9840612193f8 req-0e8a08c2-ec96-47a6-920d-c11ed046caa5 service nova] Creating event network-vif-plugged:34b558ef-9a14-4031-8a6a-58c89e755c6e for instance a9198035-3976-4221-9c74-1306b3bebf2e on n-h2-851337-3 Aug 02 07:42:55.396635 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-ae2edf41-8270-43e5-9fb3-9840612193f8 req-0e8a08c2-ec96-47a6-920d-c11ed046caa5 service nova] Instance a9198035-3976-4221-9c74-1306b3bebf2e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:42:55.408783 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ae2edf41-8270-43e5-9fb3-9840612193f8 req-0e8a08c2-ec96-47a6-920d-c11ed046caa5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126091 Aug 02 07:42:55.409394 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3413/6753] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:42:55.409532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-809a3e1a-14a9-4a50-8e4c-a7eeb7374e06 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:55.418563 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-809a3e1a-14a9-4a50-8e4c-a7eeb7374e06 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1513 microversion: 2.1 time: 0.173268 Aug 02 07:42:55.419140 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3341/6754] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:55 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:56.442350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-46d86a56-330e-4ced-9008-bd97d0e8a0a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:56.443773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-46d86a56-330e-4ced-9008-bd97d0e8a0a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:56.450794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-46d86a56-330e-4ced-9008-bd97d0e8a0a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:56.451504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-46d86a56-330e-4ced-9008-bd97d0e8a0a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:56.452265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-46d86a56-330e-4ced-9008-bd97d0e8a0a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:56.452696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-46d86a56-330e-4ced-9008-bd97d0e8a0a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:56.591856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-46d86a56-330e-4ced-9008-bd97d0e8a0a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:56.603118 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-46d86a56-330e-4ced-9008-bd97d0e8a0a3 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1505 microversion: 2.1 time: 0.165771 Aug 02 07:42:56.603668 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3414/6755] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:56 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:56.633489 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-251197ef-332e-4ac4-bcb4-f63d86252d14 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:56.634187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-251197ef-332e-4ac4-bcb4-f63d86252d14 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:56.641968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-251197ef-332e-4ac4-bcb4-f63d86252d14 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:56.642433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-251197ef-332e-4ac4-bcb4-f63d86252d14 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:56.643216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-251197ef-332e-4ac4-bcb4-f63d86252d14 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:56.643664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-251197ef-332e-4ac4-bcb4-f63d86252d14 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:56.786203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-251197ef-332e-4ac4-bcb4-f63d86252d14 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:56.797315 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-251197ef-332e-4ac4-bcb4-f63d86252d14 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1505 microversion: 2.1 time: 0.167871 Aug 02 07:42:56.798169 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3342/6756] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:56 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:56.821092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c0d87728-761f-4c1b-bbf6-b46987bb9043 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:56.821782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c0d87728-761f-4c1b-bbf6-b46987bb9043 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:56.828662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0d87728-761f-4c1b-bbf6-b46987bb9043 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:56.829116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0d87728-761f-4c1b-bbf6-b46987bb9043 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:56.829911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0d87728-761f-4c1b-bbf6-b46987bb9043 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:56.830354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c0d87728-761f-4c1b-bbf6-b46987bb9043 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:56.970658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c0d87728-761f-4c1b-bbf6-b46987bb9043 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:56.983338 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c0d87728-761f-4c1b-bbf6-b46987bb9043 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1505 microversion: 2.1 time: 0.165852 Aug 02 07:42:56.984254 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3415/6757] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:56 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:57.008932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2a3841ac-8cb8-4a2c-beaf-e4f7cb68259e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:57.009426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2a3841ac-8cb8-4a2c-beaf-e4f7cb68259e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:57.016225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a3841ac-8cb8-4a2c-beaf-e4f7cb68259e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:57.016690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a3841ac-8cb8-4a2c-beaf-e4f7cb68259e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:57.017481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a3841ac-8cb8-4a2c-beaf-e4f7cb68259e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:57.017937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a3841ac-8cb8-4a2c-beaf-e4f7cb68259e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:57.044173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2a3841ac-8cb8-4a2c-beaf-e4f7cb68259e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:42:57.138337 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2a3841ac-8cb8-4a2c-beaf-e4f7cb68259e tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 204 len: 0 microversion: 2.1 time: 0.133310 Aug 02 07:42:57.138954 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3343/6758] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:42:57 2022] DELETE /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:42:57.155741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-33cb2b24-c7c1-4ff4-9446-2bb34e7e99ff tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:57.156255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-33cb2b24-c7c1-4ff4-9446-2bb34e7e99ff tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:57.163122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33cb2b24-c7c1-4ff4-9446-2bb34e7e99ff tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:57.163563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33cb2b24-c7c1-4ff4-9446-2bb34e7e99ff tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:57.164350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33cb2b24-c7c1-4ff4-9446-2bb34e7e99ff tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:57.164777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-33cb2b24-c7c1-4ff4-9446-2bb34e7e99ff tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:57.194260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-33cb2b24-c7c1-4ff4-9446-2bb34e7e99ff tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:42:57.239174 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.compute.api [None req-33cb2b24-c7c1-4ff4-9446-2bb34e7e99ff tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Instance is already in deleting state, ignoring this request Aug 02 07:42:57.239916 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-33cb2b24-c7c1-4ff4-9446-2bb34e7e99ff tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 204 len: 0 microversion: 2.1 time: 0.088229 Aug 02 07:42:57.240476 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3416/6759] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:42:57 2022] DELETE /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 07:42:57.253025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9529d4c9-0177-447a-b1a5-37ae3dad9d09 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:57.254243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9529d4c9-0177-447a-b1a5-37ae3dad9d09 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:57.263130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9529d4c9-0177-447a-b1a5-37ae3dad9d09 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:57.263588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9529d4c9-0177-447a-b1a5-37ae3dad9d09 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:57.264378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9529d4c9-0177-447a-b1a5-37ae3dad9d09 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:57.264826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9529d4c9-0177-447a-b1a5-37ae3dad9d09 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:57.400155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9529d4c9-0177-447a-b1a5-37ae3dad9d09 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:57.408257 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9529d4c9-0177-447a-b1a5-37ae3dad9d09 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1511 microversion: 2.1 time: 0.162582 Aug 02 07:42:57.408858 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3344/6760] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:57 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:58.432793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-39754175-d5c9-44b7-abb9-be4c8c76f08a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:58.433382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-39754175-d5c9-44b7-abb9-be4c8c76f08a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:58.440867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39754175-d5c9-44b7-abb9-be4c8c76f08a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:58.441278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39754175-d5c9-44b7-abb9-be4c8c76f08a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:58.442124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39754175-d5c9-44b7-abb9-be4c8c76f08a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:58.442561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39754175-d5c9-44b7-abb9-be4c8c76f08a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:58.677553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-39754175-d5c9-44b7-abb9-be4c8c76f08a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1525aaafa24ea696e915feba2ee005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4078336b80c49fba3e371f839e622f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:42:58.686465 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-39754175-d5c9-44b7-abb9-be4c8c76f08a tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 200 len: 1511 microversion: 2.1 time: 0.257747 Aug 02 07:42:58.687043 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3417/6761] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:58 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:42:58.970847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8decadaa-d48e-4bc7-97bc-a9e49a68dc12 req-2e47028d-84d2-4bfe-a4fe-0997c96be0ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9198035-3976-4221-9c74-1306b3bebf2e", "name": "network-vif-deleted", "tag": "34b558ef-9a14-4031-8a6a-58c89e755c6e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:42:58.983479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8decadaa-d48e-4bc7-97bc-a9e49a68dc12 req-2e47028d-84d2-4bfe-a4fe-0997c96be0ae service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:58.983939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8decadaa-d48e-4bc7-97bc-a9e49a68dc12 req-2e47028d-84d2-4bfe-a4fe-0997c96be0ae service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:58.996956 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8decadaa-d48e-4bc7-97bc-a9e49a68dc12 req-2e47028d-84d2-4bfe-a4fe-0997c96be0ae service nova] Creating event network-vif-deleted:34b558ef-9a14-4031-8a6a-58c89e755c6e for instance a9198035-3976-4221-9c74-1306b3bebf2e on n-h2-851337-3 Aug 02 07:42:59.002088 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8decadaa-d48e-4bc7-97bc-a9e49a68dc12 req-2e47028d-84d2-4bfe-a4fe-0997c96be0ae service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035171 Aug 02 07:42:59.002728 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3345/6762] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:42:59.709232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7c188fcc-70b3-4102-9c89-52936971fad4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:59.709875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7c188fcc-70b3-4102-9c89-52936971fad4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: a9198035-3976-4221-9c74-1306b3bebf2e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:42:59.717484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c188fcc-70b3-4102-9c89-52936971fad4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:59.717933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c188fcc-70b3-4102-9c89-52936971fad4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:59.718718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c188fcc-70b3-4102-9c89-52936971fad4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:42:59.719134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7c188fcc-70b3-4102-9c89-52936971fad4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:42:59.733034 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-7c188fcc-70b3-4102-9c89-52936971fad4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] HTTP exception thrown: Instance a9198035-3976-4221-9c74-1306b3bebf2e could not be found. Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7c188fcc-70b3-4102-9c89-52936971fad4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Request method failure captured: Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e HTTP/1.1 Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NUbkaNxOmVGT-9wpL4_clyTqdU2nUavTfzZ4RhvsdVYLzueYmMasuuhtYqNuZ_-t4MhCUWqw5c-4WLhaVEn4_HAP3isOzqtRw6M15E7jD4WQqQ-4zeYK3GZUjZlXppUOD_6OzSAfGGDDsoBWWUdC62KJzulMPmucH5iSUVxoKs4eHs Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: b4078336b80c49fba3e371f839e622f0 Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1107116558 Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b4078336b80c49fba3e371f839e622f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4078336b80c49fba3e371f839e622f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b4078336b80c49fba3e371f839e622f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4078336b80c49fba3e371f839e622f0"}]}] Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerDiskConfigTestJSON-1107116558 Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: b4078336b80c49fba3e371f839e622f0 Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1107116558 Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerDiskConfigTestJSON-1107116558-project Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: db1525aaafa24ea696e915feba2ee005 Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerDiskConfigTestJSON-1107116558-project Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance a9198035-3976-4221-9c74-1306b3bebf2e could not be found. Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'a9198035-3976-4221-9c74-1306b3bebf2e'} Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9198035-3976-4221-9c74-1306b3bebf2e could not be found. Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9198035-3976-4221-9c74-1306b3bebf2e could not be found. Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:42:59.734737 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:42:59.740876 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:42:59.740876 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:42:59.740876 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:42:59.740876 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:42:59.740876 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:42:59.740876 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9198035-3976-4221-9c74-1306b3bebf2e could not be found. Aug 02 07:42:59.740876 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:42:59.740876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7c188fcc-70b3-4102-9c89-52936971fad4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Returning 404 to user: Instance a9198035-3976-4221-9c74-1306b3bebf2e could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:42:59.740876 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7c188fcc-70b3-4102-9c89-52936971fad4 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e" status: 404 len: 111 microversion: 2.1 time: 0.031177 Aug 02 07:42:59.740876 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3418/6763] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:42:59 2022] GET /compute/v2.1/servers/a9198035-3976-4221-9c74-1306b3bebf2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:42:59.746196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2612f80d-61e4-4743-97b6-38c0b900a63f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '.version_select at 0x7f927abb0940>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:42:59.771608 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2612f80d-61e4-4743-97b6-38c0b900a63f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162117568" status: 202 len: 0 microversion: 2.1 time: 0.029974 Aug 02 07:42:59.772204 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3346/6764] 10.222.0.79 () {58 vars in 1221 bytes} [Tue Aug 2 07:42:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162117568 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:43:00.411152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eacd194e-3157-4a66-bc62-177270429108 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:43:00.411701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-eacd194e-3157-4a66-bc62-177270429108 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:43:00.418637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eacd194e-3157-4a66-bc62-177270429108 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:00.419075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eacd194e-3157-4a66-bc62-177270429108 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:00.419833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eacd194e-3157-4a66-bc62-177270429108 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:00.420258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eacd194e-3157-4a66-bc62-177270429108 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:00.435222 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-eacd194e-3157-4a66-bc62-177270429108 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] HTTP exception thrown: Instance 187a0897-a153-4bf4-8396-46d536695800 could not be found. Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eacd194e-3157-4a66-bc62-177270429108 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Request method failure captured: Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 HTTP/1.1 Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NUbkaNxOmVGT-9wpL4_clyTqdU2nUavTfzZ4RhvsdVYLzueYmMasuuhtYqNuZ_-t4MhCUWqw5c-4WLhaVEn4_HAP3isOzqtRw6M15E7jD4WQqQ-4zeYK3GZUjZlXppUOD_6OzSAfGGDDsoBWWUdC62KJzulMPmucH5iSUVxoKs4eHs Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: b4078336b80c49fba3e371f839e622f0 Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1107116558 Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b4078336b80c49fba3e371f839e622f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4078336b80c49fba3e371f839e622f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b4078336b80c49fba3e371f839e622f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4078336b80c49fba3e371f839e622f0"}]}] Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerDiskConfigTestJSON-1107116558 Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: b4078336b80c49fba3e371f839e622f0 Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1107116558 Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerDiskConfigTestJSON-1107116558-project Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: db1525aaafa24ea696e915feba2ee005 Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerDiskConfigTestJSON-1107116558-project Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 187a0897-a153-4bf4-8396-46d536695800 could not be found. Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '187a0897-a153-4bf4-8396-46d536695800'} Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 187a0897-a153-4bf4-8396-46d536695800 could not be found. Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:43:00.436781 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:43:00.441873 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 187a0897-a153-4bf4-8396-46d536695800 could not be found. Aug 02 07:43:00.441873 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:43:00.441873 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:43:00.441873 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:43:00.441873 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:43:00.441873 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:43:00.441873 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:43:00.441873 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:43:00.441873 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:43:00.441873 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 187a0897-a153-4bf4-8396-46d536695800 could not be found. Aug 02 07:43:00.441873 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:43:00.441873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eacd194e-3157-4a66-bc62-177270429108 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Returning 404 to user: Instance 187a0897-a153-4bf4-8396-46d536695800 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:43:00.441873 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-eacd194e-3157-4a66-bc62-177270429108 tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "DELETE /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 404 len: 111 microversion: 2.1 time: 0.031614 Aug 02 07:43:00.441873 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3419/6765] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:43:00 2022] DELETE /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:43:00.448462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34f6365c-7ab3-41f2-9d81-41be865e958f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:43:00.449250 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-34f6365c-7ab3-41f2-9d81-41be865e958f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] [instance: 187a0897-a153-4bf4-8396-46d536695800] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:43:00.456310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34f6365c-7ab3-41f2-9d81-41be865e958f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:00.456770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34f6365c-7ab3-41f2-9d81-41be865e958f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:00.457552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34f6365c-7ab3-41f2-9d81-41be865e958f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:00.458040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-34f6365c-7ab3-41f2-9d81-41be865e958f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:00.471592 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-34f6365c-7ab3-41f2-9d81-41be865e958f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] HTTP exception thrown: Instance 187a0897-a153-4bf4-8396-46d536695800 could not be found. Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34f6365c-7ab3-41f2-9d81-41be865e958f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Request method failure captured: Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 HTTP/1.1 Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NUbkaNxOmVGT-9wpL4_clyTqdU2nUavTfzZ4RhvsdVYLzueYmMasuuhtYqNuZ_-t4MhCUWqw5c-4WLhaVEn4_HAP3isOzqtRw6M15E7jD4WQqQ-4zeYK3GZUjZlXppUOD_6OzSAfGGDDsoBWWUdC62KJzulMPmucH5iSUVxoKs4eHs Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: b4078336b80c49fba3e371f839e622f0 Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1107116558 Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b4078336b80c49fba3e371f839e622f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4078336b80c49fba3e371f839e622f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b4078336b80c49fba3e371f839e622f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b4078336b80c49fba3e371f839e622f0"}]}] Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerDiskConfigTestJSON-1107116558 Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: b4078336b80c49fba3e371f839e622f0 Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1107116558 Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerDiskConfigTestJSON-1107116558-project Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: db1525aaafa24ea696e915feba2ee005 Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerDiskConfigTestJSON-1107116558-project Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 187a0897-a153-4bf4-8396-46d536695800 could not be found. Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '187a0897-a153-4bf4-8396-46d536695800'} Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 187a0897-a153-4bf4-8396-46d536695800 could not be found. Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 187a0897-a153-4bf4-8396-46d536695800 could not be found. Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:43:00.473278 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:43:00.478518 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:43:00.478518 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:43:00.478518 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:43:00.478518 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:43:00.478518 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:43:00.478518 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 187a0897-a153-4bf4-8396-46d536695800 could not be found. Aug 02 07:43:00.478518 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:43:00.478518 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-34f6365c-7ab3-41f2-9d81-41be865e958f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] Returning 404 to user: Instance 187a0897-a153-4bf4-8396-46d536695800 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:43:00.478518 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-34f6365c-7ab3-41f2-9d81-41be865e958f tempest-ServerDiskConfigTestJSON-1107116558 tempest-ServerDiskConfigTestJSON-1107116558-project] 10.222.0.79 "GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800" status: 404 len: 111 microversion: 2.1 time: 0.031304 Aug 02 07:43:00.478518 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3347/6766] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:43:00 2022] GET /compute/v2.1/servers/187a0897-a153-4bf4-8396-46d536695800 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:43:09.603410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4348c671-208b-4170-8b29-b33eb394da3e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'create', calling method: .version_select at 0x7f9279f0dc10>, body: {"keypair": {"name": "tempest-keypair-1730148551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCD8h3lTGHulYfn4GgIGjilnepWOS7IJEjNy1/V7qFH8UE5AL3ZB4Em9haUsgKGv1fKW/UEncrLIxf73BOraGeDDZWEhFjq3pAiKf1sTHruSmPKuVPkP2y4nG1xe5Pxdg=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:43:09.609329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=38 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:43:09.622870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-4348c671-208b-4170-8b29-b33eb394da3e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Getting quotas for project 693ef5caeeb34c95b6c5b4390df3487a. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:43:09.628641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-4348c671-208b-4170-8b29-b33eb394da3e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Getting quotas for user abff1bade52a439093f9d43ed63fc857 and project 693ef5caeeb34c95b6c5b4390df3487a. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:43:09.658467 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4348c671-208b-4170-8b29-b33eb394da3e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.183812 Aug 02 07:43:09.658966 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3420/6767] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:43:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:43:11.004650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-272235808", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04888cbc-b87e-4deb-bc18-190dfb5b7a24"}], "security_groups": [{"name": "tempest-securitygroup--1251438242"}], "key_name": "tempest-keypair-1730148551", "user_data": "}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:43:11.013790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:43:11.014585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:43:11.117121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] validate_networks() for [('04888cbc-b87e-4deb-bc18-190dfb5b7a24', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:43:11.515205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:43:11.515650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:43:11.516145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:43:11.516594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:43:11.517071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:43:11.528411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:11.528899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:11.529745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:11.530251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:11.550442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Getting quotas for project 693ef5caeeb34c95b6c5b4390df3487a. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:43:11.556258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Getting quotas for user abff1bade52a439093f9d43ed63fc857 and project 693ef5caeeb34c95b6c5b4390df3487a. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:43:11.570869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:43:11.573187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:43:11.624004 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-317ade9d-b838-42e4-9dbd-22f94f702832 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.623941 Aug 02 07:43:11.624842 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3348/6768] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:43:10 2022] POST /compute/v2.1/servers => generated 409 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:43:11.632861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:43:11.639223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1eed6165-7743-4bf2-8e15-65bd35f449ec tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:43:11.640160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1eed6165-7743-4bf2-8e15-65bd35f449ec tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:43:11.708693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1eed6165-7743-4bf2-8e15-65bd35f449ec tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:43:11.716690 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1eed6165-7743-4bf2-8e15-65bd35f449ec tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1238 microversion: 2.1 time: 0.084507 Aug 02 07:43:11.717579 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3421/6769] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:43:11 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:43:12.740330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-88926e53-0c8d-4c7a-8fcf-bc45b641fbab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:43:12.741146 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-88926e53-0c8d-4c7a-8fcf-bc45b641fbab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:43:12.757998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88926e53-0c8d-4c7a-8fcf-bc45b641fbab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:12.758556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88926e53-0c8d-4c7a-8fcf-bc45b641fbab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:12.759469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88926e53-0c8d-4c7a-8fcf-bc45b641fbab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:12.759914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88926e53-0c8d-4c7a-8fcf-bc45b641fbab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:12.861069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-88926e53-0c8d-4c7a-8fcf-bc45b641fbab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:43:12.873214 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-88926e53-0c8d-4c7a-8fcf-bc45b641fbab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1290 microversion: 2.1 time: 0.136830 Aug 02 07:43:12.874704 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3349/6770] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:43:12 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1290 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:43:13.895199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6e782bce-6171-44ba-a6eb-acfa9afe0f05 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:43:13.895798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6e782bce-6171-44ba-a6eb-acfa9afe0f05 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:43:13.903502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e782bce-6171-44ba-a6eb-acfa9afe0f05 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:13.903944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e782bce-6171-44ba-a6eb-acfa9afe0f05 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:13.904710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e782bce-6171-44ba-a6eb-acfa9afe0f05 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:13.905159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6e782bce-6171-44ba-a6eb-acfa9afe0f05 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:14.043712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6e782bce-6171-44ba-a6eb-acfa9afe0f05 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:43:14.052411 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6e782bce-6171-44ba-a6eb-acfa9afe0f05 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1364 microversion: 2.1 time: 0.160979 Aug 02 07:43:14.053169 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3422/6771] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:43:13 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:43:14.304424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-9e7d6d63-e739-48ff-b2f0-906ff618ebdf req-8e772d6f-92f2-4bf2-bde2-80e2d06f9cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57cd5ee0-6fa9-4197-88a1-b885ab9929dc", "tag": "93e313f1-b366-4b98-b92e-0fb64a16e2db"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:43:14.314904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9e7d6d63-e739-48ff-b2f0-906ff618ebdf req-8e772d6f-92f2-4bf2-bde2-80e2d06f9cc7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:14.315632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9e7d6d63-e739-48ff-b2f0-906ff618ebdf req-8e772d6f-92f2-4bf2-bde2-80e2d06f9cc7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:14.327967 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-9e7d6d63-e739-48ff-b2f0-906ff618ebdf req-8e772d6f-92f2-4bf2-bde2-80e2d06f9cc7 service nova] Creating event network-changed:93e313f1-b366-4b98-b92e-0fb64a16e2db for instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc on n-h1-851337-3 Aug 02 07:43:14.333109 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-9e7d6d63-e739-48ff-b2f0-906ff618ebdf req-8e772d6f-92f2-4bf2-bde2-80e2d06f9cc7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032794 Aug 02 07:43:14.333714 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3350/6772] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:43:15.076721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab17b9b1-5eed-4495-bc35-4dc23ceb3786 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:43:15.077502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab17b9b1-5eed-4495-bc35-4dc23ceb3786 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:43:15.086595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab17b9b1-5eed-4495-bc35-4dc23ceb3786 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:15.087204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab17b9b1-5eed-4495-bc35-4dc23ceb3786 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:15.088016 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab17b9b1-5eed-4495-bc35-4dc23ceb3786 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:15.088526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab17b9b1-5eed-4495-bc35-4dc23ceb3786 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:15.230174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab17b9b1-5eed-4495-bc35-4dc23ceb3786 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:43:15.242407 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab17b9b1-5eed-4495-bc35-4dc23ceb3786 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1364 microversion: 2.1 time: 0.170011 Aug 02 07:43:15.243220 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3423/6773] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:43:15 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:43:16.269915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0cc34321-4830-4378-91d4-0c5e71b00f18 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:43:16.270640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0cc34321-4830-4378-91d4-0c5e71b00f18 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:43:16.277762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0cc34321-4830-4378-91d4-0c5e71b00f18 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:16.278295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0cc34321-4830-4378-91d4-0c5e71b00f18 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:16.279121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0cc34321-4830-4378-91d4-0c5e71b00f18 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:16.279592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0cc34321-4830-4378-91d4-0c5e71b00f18 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:16.427079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0cc34321-4830-4378-91d4-0c5e71b00f18 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:43:16.435805 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0cc34321-4830-4378-91d4-0c5e71b00f18 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1364 microversion: 2.1 time: 0.171674 Aug 02 07:43:16.436396 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3351/6774] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:43:16 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:43:17.458338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ffc0cadd-0eeb-4d8d-bec1-316690215a4b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:43:17.458941 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ffc0cadd-0eeb-4d8d-bec1-316690215a4b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:43:17.466362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ffc0cadd-0eeb-4d8d-bec1-316690215a4b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:17.466740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ffc0cadd-0eeb-4d8d-bec1-316690215a4b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:17.467492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ffc0cadd-0eeb-4d8d-bec1-316690215a4b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:17.467920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ffc0cadd-0eeb-4d8d-bec1-316690215a4b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:17.610008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ffc0cadd-0eeb-4d8d-bec1-316690215a4b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:43:17.618259 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ffc0cadd-0eeb-4d8d-bec1-316690215a4b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1364 microversion: 2.1 time: 0.163747 Aug 02 07:43:17.618804 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3424/6775] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:43:17 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:43:18.640401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5fe44191-6efc-4465-bcc6-b630d05b931d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:43:18.641190 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5fe44191-6efc-4465-bcc6-b630d05b931d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:43:18.649043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5fe44191-6efc-4465-bcc6-b630d05b931d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:18.649524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5fe44191-6efc-4465-bcc6-b630d05b931d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:18.650346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5fe44191-6efc-4465-bcc6-b630d05b931d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:18.650802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5fe44191-6efc-4465-bcc6-b630d05b931d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:18.799388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5fe44191-6efc-4465-bcc6-b630d05b931d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:43:18.807623 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5fe44191-6efc-4465-bcc6-b630d05b931d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1364 microversion: 2.1 time: 0.172115 Aug 02 07:43:18.808208 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3352/6776] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:43:18 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:43:19.832125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5dbd7f0d-2e93-42aa-8ff3-6fe94a1cb0df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:43:19.832752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5dbd7f0d-2e93-42aa-8ff3-6fe94a1cb0df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:43:19.840283 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dbd7f0d-2e93-42aa-8ff3-6fe94a1cb0df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:19.840739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dbd7f0d-2e93-42aa-8ff3-6fe94a1cb0df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:19.841507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dbd7f0d-2e93-42aa-8ff3-6fe94a1cb0df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:19.841948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5dbd7f0d-2e93-42aa-8ff3-6fe94a1cb0df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:19.978587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5dbd7f0d-2e93-42aa-8ff3-6fe94a1cb0df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:43:19.986303 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5dbd7f0d-2e93-42aa-8ff3-6fe94a1cb0df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1364 microversion: 2.1 time: 0.160488 Aug 02 07:43:19.986922 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3425/6777] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:43:19 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:43:20.955669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-91832a53-7c78-4760-aa1b-892483702c15 req-d8358e83-7d37-4852-bf9a-5191204b1917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57cd5ee0-6fa9-4197-88a1-b885ab9929dc", "name": "network-vif-plugged", "status": "completed", "tag": "93e313f1-b366-4b98-b92e-0fb64a16e2db"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:43:20.967484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-91832a53-7c78-4760-aa1b-892483702c15 req-d8358e83-7d37-4852-bf9a-5191204b1917 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:20.967941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-91832a53-7c78-4760-aa1b-892483702c15 req-d8358e83-7d37-4852-bf9a-5191204b1917 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:20.979709 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-91832a53-7c78-4760-aa1b-892483702c15 req-d8358e83-7d37-4852-bf9a-5191204b1917 service nova] Creating event network-vif-plugged:93e313f1-b366-4b98-b92e-0fb64a16e2db for instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc on n-h1-851337-3 Aug 02 07:43:20.985215 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-91832a53-7c78-4760-aa1b-892483702c15 req-d8358e83-7d37-4852-bf9a-5191204b1917 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033500 Aug 02 07:43:20.986157 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3353/6778] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:43:21.007588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ebba0cd2-8329-46dd-835b-2fec32de20a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:43:21.008224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ebba0cd2-8329-46dd-835b-2fec32de20a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:43:21.015503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebba0cd2-8329-46dd-835b-2fec32de20a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:21.015959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebba0cd2-8329-46dd-835b-2fec32de20a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:21.016720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebba0cd2-8329-46dd-835b-2fec32de20a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:21.017173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebba0cd2-8329-46dd-835b-2fec32de20a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:21.175820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ebba0cd2-8329-46dd-835b-2fec32de20a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:43:21.183902 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ebba0cd2-8329-46dd-835b-2fec32de20a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1364 microversion: 2.1 time: 0.180738 Aug 02 07:43:21.184492 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3426/6779] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:43:21 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:43:22.205630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:43:22.206809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:43:22.212305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8ac68422-94b5-4bc5-a594-4ef30cb860f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:43:22.213029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8ac68422-94b5-4bc5-a594-4ef30cb860f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:43:22.220482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ac68422-94b5-4bc5-a594-4ef30cb860f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:22.220951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ac68422-94b5-4bc5-a594-4ef30cb860f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:22.221849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ac68422-94b5-4bc5-a594-4ef30cb860f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:22.222325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ac68422-94b5-4bc5-a594-4ef30cb860f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:22.360599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8ac68422-94b5-4bc5-a594-4ef30cb860f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:43:22.370966 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8ac68422-94b5-4bc5-a594-4ef30cb860f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1364 microversion: 2.1 time: 0.166770 Aug 02 07:43:22.371805 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3354/6780] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:43:22 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:43:23.396289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d0b7918c-cd65-41d2-b2c3-65d2a92a6b6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:43:23.396997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d0b7918c-cd65-41d2-b2c3-65d2a92a6b6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:43:23.399213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:43:23.405788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0b7918c-cd65-41d2-b2c3-65d2a92a6b6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:23.406286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0b7918c-cd65-41d2-b2c3-65d2a92a6b6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:23.407060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0b7918c-cd65-41d2-b2c3-65d2a92a6b6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:23.407498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d0b7918c-cd65-41d2-b2c3-65d2a92a6b6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:23.550267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d0b7918c-cd65-41d2-b2c3-65d2a92a6b6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:43:23.558453 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d0b7918c-cd65-41d2-b2c3-65d2a92a6b6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1552 microversion: 2.1 time: 0.166713 Aug 02 07:43:23.559043 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3427/6781] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:43:23 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:43:23.582110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7c2730d6-bccf-4426-933b-3cc5e1ace154 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:43:23.582637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7c2730d6-bccf-4426-933b-3cc5e1ace154 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:43:23.591553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c2730d6-bccf-4426-933b-3cc5e1ace154 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:23.592008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c2730d6-bccf-4426-933b-3cc5e1ace154 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:23.592778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c2730d6-bccf-4426-933b-3cc5e1ace154 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:23.593219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7c2730d6-bccf-4426-933b-3cc5e1ace154 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:23.677082 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7c2730d6-bccf-4426-933b-3cc5e1ace154 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101575 Aug 02 07:43:23.677701 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3355/6782] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 07:43:23 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:43:24.665565 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-f5d8d86a-e611-49b5-aac9-39f562ae831f req-58698cb8-bcd9-42dc-9b83-41e32fd12e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57cd5ee0-6fa9-4197-88a1-b885ab9929dc", "tag": "93e313f1-b366-4b98-b92e-0fb64a16e2db"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:43:24.676125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f5d8d86a-e611-49b5-aac9-39f562ae831f req-58698cb8-bcd9-42dc-9b83-41e32fd12e22 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:43:24.676639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f5d8d86a-e611-49b5-aac9-39f562ae831f req-58698cb8-bcd9-42dc-9b83-41e32fd12e22 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:43:24.688036 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f5d8d86a-e611-49b5-aac9-39f562ae831f req-58698cb8-bcd9-42dc-9b83-41e32fd12e22 service nova] Creating event network-changed:93e313f1-b366-4b98-b92e-0fb64a16e2db for instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc on n-h1-851337-3 Aug 02 07:43:24.693141 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-f5d8d86a-e611-49b5-aac9-39f562ae831f req-58698cb8-bcd9-42dc-9b83-41e32fd12e22 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031516 Aug 02 07:43:24.693811 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3428/6783] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:44:29.042504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:44:29.043333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=34 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:44:29.047670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-516b4f1b-6219-4138-b7ee-cd7f3ae42be9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:29.048324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-516b4f1b-6219-4138-b7ee-cd7f3ae42be9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:29.056084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-516b4f1b-6219-4138-b7ee-cd7f3ae42be9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:29.056536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-516b4f1b-6219-4138-b7ee-cd7f3ae42be9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:29.057329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-516b4f1b-6219-4138-b7ee-cd7f3ae42be9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:29.057780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-516b4f1b-6219-4138-b7ee-cd7f3ae42be9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:29.372214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-516b4f1b-6219-4138-b7ee-cd7f3ae42be9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:29.381781 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-516b4f1b-6219-4138-b7ee-cd7f3ae42be9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1671 microversion: 2.1 time: 0.341739 Aug 02 07:44:29.382511 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3356/6784] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:29 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1671 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:29.403276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:44:29.404028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=38 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:44:29.408531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-12cf0749-30d3-4cfb-bdf6-68c527e6b6ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:29.409238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-12cf0749-30d3-4cfb-bdf6-68c527e6b6ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:29.417330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12cf0749-30d3-4cfb-bdf6-68c527e6b6ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:29.417854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12cf0749-30d3-4cfb-bdf6-68c527e6b6ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:29.419028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12cf0749-30d3-4cfb-bdf6-68c527e6b6ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:29.419595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12cf0749-30d3-4cfb-bdf6-68c527e6b6ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:29.707464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-12cf0749-30d3-4cfb-bdf6-68c527e6b6ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:29.715344 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-12cf0749-30d3-4cfb-bdf6-68c527e6b6ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1671 microversion: 2.1 time: 0.314937 Aug 02 07:44:29.715893 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3429/6785] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:29 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1671 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:29.739542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5c110c75-518e-475a-b342-ac26bc6f4d52 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:29.740203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5c110c75-518e-475a-b342-ac26bc6f4d52 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:29.746988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c110c75-518e-475a-b342-ac26bc6f4d52 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:29.747454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c110c75-518e-475a-b342-ac26bc6f4d52 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:29.748410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c110c75-518e-475a-b342-ac26bc6f4d52 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:29.748999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c110c75-518e-475a-b342-ac26bc6f4d52 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:29.903025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5c110c75-518e-475a-b342-ac26bc6f4d52 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:29.913275 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5c110c75-518e-475a-b342-ac26bc6f4d52 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1671 microversion: 2.1 time: 0.177760 Aug 02 07:44:29.913879 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3357/6786] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:29 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1671 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:29.934419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3790b236-6026-43ea-b1d1-d07e62f645ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:44:29.936690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3790b236-6026-43ea-b1d1-d07e62f645ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:29.943488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3790b236-6026-43ea-b1d1-d07e62f645ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:29.943937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3790b236-6026-43ea-b1d1-d07e62f645ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:29.944712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3790b236-6026-43ea-b1d1-d07e62f645ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:29.945150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3790b236-6026-43ea-b1d1-d07e62f645ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:29.975382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3790b236-6026-43ea-b1d1-d07e62f645ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:29.982022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3790b236-6026-43ea-b1d1-d07e62f645ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Old instance type m1.heat2, new instance type m1.heat {{(pid=126120) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 07:44:29.988769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3790b236-6026-43ea-b1d1-d07e62f645ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:44:29.989200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3790b236-6026-43ea-b1d1-d07e62f645ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:44:29.989660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3790b236-6026-43ea-b1d1-d07e62f645ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:44:29.990173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3790b236-6026-43ea-b1d1-d07e62f645ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:44:29.990610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3790b236-6026-43ea-b1d1-d07e62f645ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:44:30.062320 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3790b236-6026-43ea-b1d1-d07e62f645ad tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc/action" status: 202 len: 0 microversion: 2.1 time: 0.131710 Aug 02 07:44:30.062944 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3430/6787] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:44:29 2022] POST /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:44:30.072170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e0dc5e62-d9b0-4ba2-995f-03b6b546e3c2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:30.072792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e0dc5e62-d9b0-4ba2-995f-03b6b546e3c2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:30.080333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0dc5e62-d9b0-4ba2-995f-03b6b546e3c2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:30.080805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0dc5e62-d9b0-4ba2-995f-03b6b546e3c2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:30.082157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0dc5e62-d9b0-4ba2-995f-03b6b546e3c2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:30.082797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0dc5e62-d9b0-4ba2-995f-03b6b546e3c2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:30.267774 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e0dc5e62-d9b0-4ba2-995f-03b6b546e3c2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:30.275861 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e0dc5e62-d9b0-4ba2-995f-03b6b546e3c2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1680 microversion: 2.1 time: 0.208157 Aug 02 07:44:30.276446 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3358/6788] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:30 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:31.298065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e143e3b7-d95c-48c1-b142-f2535388f998 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:31.299514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e143e3b7-d95c-48c1-b142-f2535388f998 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:31.306865 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e143e3b7-d95c-48c1-b142-f2535388f998 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:31.307321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e143e3b7-d95c-48c1-b142-f2535388f998 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:31.308098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e143e3b7-d95c-48c1-b142-f2535388f998 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:31.308530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e143e3b7-d95c-48c1-b142-f2535388f998 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:31.455745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e143e3b7-d95c-48c1-b142-f2535388f998 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:31.464429 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e143e3b7-d95c-48c1-b142-f2535388f998 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1680 microversion: 2.1 time: 0.171129 Aug 02 07:44:31.465046 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3431/6789] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:31 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:32.490020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c7eb3d8d-022c-4ff9-83b1-1d495dcf7d04 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:32.490643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c7eb3d8d-022c-4ff9-83b1-1d495dcf7d04 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:32.498286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7eb3d8d-022c-4ff9-83b1-1d495dcf7d04 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:32.498754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7eb3d8d-022c-4ff9-83b1-1d495dcf7d04 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:32.499545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7eb3d8d-022c-4ff9-83b1-1d495dcf7d04 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:32.500015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7eb3d8d-022c-4ff9-83b1-1d495dcf7d04 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:32.637425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c7eb3d8d-022c-4ff9-83b1-1d495dcf7d04 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:32.649026 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c7eb3d8d-022c-4ff9-83b1-1d495dcf7d04 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1685 microversion: 2.1 time: 0.162775 Aug 02 07:44:32.649781 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3359/6790] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:32 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:33.671701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3903113f-b98c-46e8-8e23-78685dd0440b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:33.672335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3903113f-b98c-46e8-8e23-78685dd0440b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:33.679857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3903113f-b98c-46e8-8e23-78685dd0440b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:33.680306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3903113f-b98c-46e8-8e23-78685dd0440b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:33.681084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3903113f-b98c-46e8-8e23-78685dd0440b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:33.681548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3903113f-b98c-46e8-8e23-78685dd0440b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:34.164458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3903113f-b98c-46e8-8e23-78685dd0440b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:34.174230 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3903113f-b98c-46e8-8e23-78685dd0440b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1685 microversion: 2.1 time: 0.506422 Aug 02 07:44:34.174870 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3432/6791] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:33 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1685 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:35.196839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9c3caa48-bf9d-4a1c-aa0e-fe73e6e2dae1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:35.197556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9c3caa48-bf9d-4a1c-aa0e-fe73e6e2dae1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:35.205295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c3caa48-bf9d-4a1c-aa0e-fe73e6e2dae1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:35.205775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c3caa48-bf9d-4a1c-aa0e-fe73e6e2dae1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:35.206588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c3caa48-bf9d-4a1c-aa0e-fe73e6e2dae1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:35.207035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9c3caa48-bf9d-4a1c-aa0e-fe73e6e2dae1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:35.356081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9c3caa48-bf9d-4a1c-aa0e-fe73e6e2dae1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:35.364543 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9c3caa48-bf9d-4a1c-aa0e-fe73e6e2dae1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1685 microversion: 2.1 time: 0.172179 Aug 02 07:44:35.365389 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3360/6792] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:35 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:36.387188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8d0157c5-0e88-4ad2-84f7-391f4c77ef72 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:36.387829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8d0157c5-0e88-4ad2-84f7-391f4c77ef72 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:36.395495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d0157c5-0e88-4ad2-84f7-391f4c77ef72 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:36.395945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d0157c5-0e88-4ad2-84f7-391f4c77ef72 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:36.396742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d0157c5-0e88-4ad2-84f7-391f4c77ef72 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:36.397179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8d0157c5-0e88-4ad2-84f7-391f4c77ef72 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:36.539875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8d0157c5-0e88-4ad2-84f7-391f4c77ef72 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:36.548092 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8d0157c5-0e88-4ad2-84f7-391f4c77ef72 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1685 microversion: 2.1 time: 0.164822 Aug 02 07:44:36.548654 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3433/6793] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:36 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:37.575142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-30354bd8-b575-4a91-8ad5-28c4f94a04ea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:37.575783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-30354bd8-b575-4a91-8ad5-28c4f94a04ea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:37.583712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30354bd8-b575-4a91-8ad5-28c4f94a04ea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:37.584219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30354bd8-b575-4a91-8ad5-28c4f94a04ea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:37.585020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30354bd8-b575-4a91-8ad5-28c4f94a04ea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:37.585453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30354bd8-b575-4a91-8ad5-28c4f94a04ea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:37.724856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-30354bd8-b575-4a91-8ad5-28c4f94a04ea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:37.732946 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-30354bd8-b575-4a91-8ad5-28c4f94a04ea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1685 microversion: 2.1 time: 0.161861 Aug 02 07:44:37.733569 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3361/6794] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:37 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:38.755560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-88807c19-a47f-4614-9322-dcfe9503c826 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:38.756260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-88807c19-a47f-4614-9322-dcfe9503c826 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:38.763173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88807c19-a47f-4614-9322-dcfe9503c826 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:38.763619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88807c19-a47f-4614-9322-dcfe9503c826 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:38.764498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88807c19-a47f-4614-9322-dcfe9503c826 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:38.764860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88807c19-a47f-4614-9322-dcfe9503c826 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:38.913314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-88807c19-a47f-4614-9322-dcfe9503c826 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:38.925632 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-88807c19-a47f-4614-9322-dcfe9503c826 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1685 microversion: 2.1 time: 0.174291 Aug 02 07:44:38.926440 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3434/6795] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:38 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:39.948474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5cc3e14c-450e-41c4-a03c-ec5936d9e656 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:39.949112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5cc3e14c-450e-41c4-a03c-ec5936d9e656 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:39.956882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cc3e14c-450e-41c4-a03c-ec5936d9e656 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:39.957343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cc3e14c-450e-41c4-a03c-ec5936d9e656 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:39.958172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cc3e14c-450e-41c4-a03c-ec5936d9e656 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:39.958621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5cc3e14c-450e-41c4-a03c-ec5936d9e656 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:40.118862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5cc3e14c-450e-41c4-a03c-ec5936d9e656 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:40.127705 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5cc3e14c-450e-41c4-a03c-ec5936d9e656 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1685 microversion: 2.1 time: 0.183117 Aug 02 07:44:40.128302 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3362/6796] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:39 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:41.150196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ec258621-be31-43d5-81b9-74ead1649ed6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:41.150868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ec258621-be31-43d5-81b9-74ead1649ed6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:41.159672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec258621-be31-43d5-81b9-74ead1649ed6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:41.160125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec258621-be31-43d5-81b9-74ead1649ed6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:41.160899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec258621-be31-43d5-81b9-74ead1649ed6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:41.161335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec258621-be31-43d5-81b9-74ead1649ed6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:41.298580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ec258621-be31-43d5-81b9-74ead1649ed6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:41.310162 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ec258621-be31-43d5-81b9-74ead1649ed6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1685 microversion: 2.1 time: 0.163965 Aug 02 07:44:41.310778 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3435/6797] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:41 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:42.336288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a421507c-a81c-4b25-b129-26f640b7b307 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:42.337296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a421507c-a81c-4b25-b129-26f640b7b307 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:42.349497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a421507c-a81c-4b25-b129-26f640b7b307 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:42.349939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a421507c-a81c-4b25-b129-26f640b7b307 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:42.350771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a421507c-a81c-4b25-b129-26f640b7b307 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:42.351227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a421507c-a81c-4b25-b129-26f640b7b307 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:42.490195 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a421507c-a81c-4b25-b129-26f640b7b307 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:42.499516 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a421507c-a81c-4b25-b129-26f640b7b307 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1685 microversion: 2.1 time: 0.169923 Aug 02 07:44:42.500101 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3363/6798] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:42 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:43.521977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-25babd61-b193-46e0-a861-ad229970d7f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:43.522627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-25babd61-b193-46e0-a861-ad229970d7f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:43.530536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-25babd61-b193-46e0-a861-ad229970d7f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:43.531014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-25babd61-b193-46e0-a861-ad229970d7f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:43.531809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-25babd61-b193-46e0-a861-ad229970d7f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:43.532245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-25babd61-b193-46e0-a861-ad229970d7f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:43.694225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-25babd61-b193-46e0-a861-ad229970d7f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:43.701941 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-25babd61-b193-46e0-a861-ad229970d7f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1685 microversion: 2.1 time: 0.184049 Aug 02 07:44:43.702516 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3436/6799] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:43 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:44.726295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c89d61d5-101f-4d4e-903e-71fc4315df03 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:44.726907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c89d61d5-101f-4d4e-903e-71fc4315df03 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:44.737734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c89d61d5-101f-4d4e-903e-71fc4315df03 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:44.738256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c89d61d5-101f-4d4e-903e-71fc4315df03 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:44.739054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c89d61d5-101f-4d4e-903e-71fc4315df03 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:44.739510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c89d61d5-101f-4d4e-903e-71fc4315df03 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:44.860120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-a560d201-f2cb-43aa-8ed8-8b8b215470e6 req-055de2e4-3216-472b-8c98-e33a428dad8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57cd5ee0-6fa9-4197-88a1-b885ab9929dc", "name": "network-vif-unplugged", "status": "completed", "tag": "93e313f1-b366-4b98-b92e-0fb64a16e2db"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:44:44.870032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a560d201-f2cb-43aa-8ed8-8b8b215470e6 req-055de2e4-3216-472b-8c98-e33a428dad8f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:44.870470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a560d201-f2cb-43aa-8ed8-8b8b215470e6 req-055de2e4-3216-472b-8c98-e33a428dad8f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:44.883147 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-a560d201-f2cb-43aa-8ed8-8b8b215470e6 req-055de2e4-3216-472b-8c98-e33a428dad8f service nova] Creating event network-vif-unplugged:93e313f1-b366-4b98-b92e-0fb64a16e2db for instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc on n-h2-851337-3 Aug 02 07:44:44.888786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-a560d201-f2cb-43aa-8ed8-8b8b215470e6 req-055de2e4-3216-472b-8c98-e33a428dad8f service nova] Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:44:44.903948 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-a560d201-f2cb-43aa-8ed8-8b8b215470e6 req-055de2e4-3216-472b-8c98-e33a428dad8f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105102 Aug 02 07:44:44.904583 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3437/6800] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:44:45.110948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c89d61d5-101f-4d4e-903e-71fc4315df03 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:45.127847 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c89d61d5-101f-4d4e-903e-71fc4315df03 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1684 microversion: 2.1 time: 0.405697 Aug 02 07:44:45.128903 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3364/6801] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:44 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1684 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:44:46.153260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-04b542eb-b2fc-4369-beca-1eac26c2ba09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:46.153857 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-04b542eb-b2fc-4369-beca-1eac26c2ba09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:46.160946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04b542eb-b2fc-4369-beca-1eac26c2ba09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:46.161392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04b542eb-b2fc-4369-beca-1eac26c2ba09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:46.162269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04b542eb-b2fc-4369-beca-1eac26c2ba09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:46.162701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04b542eb-b2fc-4369-beca-1eac26c2ba09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:46.319213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-04b542eb-b2fc-4369-beca-1eac26c2ba09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:46.327542 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-04b542eb-b2fc-4369-beca-1eac26c2ba09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1682 microversion: 2.1 time: 0.179473 Aug 02 07:44:46.328127 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3438/6802] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:46 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:46.921050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-0d67ddf6-79ca-4f2b-8c48-a64f79249c97 req-3e1f7db7-f2c5-41f1-bce7-9ce56f91f961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57cd5ee0-6fa9-4197-88a1-b885ab9929dc", "tag": "93e313f1-b366-4b98-b92e-0fb64a16e2db"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:44:46.934128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0d67ddf6-79ca-4f2b-8c48-a64f79249c97 req-3e1f7db7-f2c5-41f1-bce7-9ce56f91f961 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:46.934836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0d67ddf6-79ca-4f2b-8c48-a64f79249c97 req-3e1f7db7-f2c5-41f1-bce7-9ce56f91f961 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:46.950033 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-0d67ddf6-79ca-4f2b-8c48-a64f79249c97 req-3e1f7db7-f2c5-41f1-bce7-9ce56f91f961 service nova] Creating event network-changed:93e313f1-b366-4b98-b92e-0fb64a16e2db for instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc on n-h2-851337-3 Aug 02 07:44:46.955876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-0d67ddf6-79ca-4f2b-8c48-a64f79249c97 req-3e1f7db7-f2c5-41f1-bce7-9ce56f91f961 service nova] Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:44:46.967602 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-0d67ddf6-79ca-4f2b-8c48-a64f79249c97 req-3e1f7db7-f2c5-41f1-bce7-9ce56f91f961 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050519 Aug 02 07:44:46.968222 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3365/6803] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:44:47.348660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-03bd3302-f308-4dbe-a675-a4eb816ba879 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:47.349321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-03bd3302-f308-4dbe-a675-a4eb816ba879 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:47.360713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03bd3302-f308-4dbe-a675-a4eb816ba879 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:47.361163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03bd3302-f308-4dbe-a675-a4eb816ba879 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:47.362563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03bd3302-f308-4dbe-a675-a4eb816ba879 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:47.362996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-03bd3302-f308-4dbe-a675-a4eb816ba879 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:47.622532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-03bd3302-f308-4dbe-a675-a4eb816ba879 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:47.630959 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-03bd3302-f308-4dbe-a675-a4eb816ba879 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1682 microversion: 2.1 time: 0.285979 Aug 02 07:44:47.631538 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3439/6804] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:47 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1682 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:48.658548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b557ee03-4812-4e71-8354-c7a6d4539e81 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:48.659561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b557ee03-4812-4e71-8354-c7a6d4539e81 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:48.668587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b557ee03-4812-4e71-8354-c7a6d4539e81 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:48.669339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b557ee03-4812-4e71-8354-c7a6d4539e81 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:48.670353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b557ee03-4812-4e71-8354-c7a6d4539e81 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:48.671053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b557ee03-4812-4e71-8354-c7a6d4539e81 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:48.819584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b557ee03-4812-4e71-8354-c7a6d4539e81 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:48.829667 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b557ee03-4812-4e71-8354-c7a6d4539e81 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1679 microversion: 2.1 time: 0.179239 Aug 02 07:44:48.830534 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3366/6805] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:48 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:48.851571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d491afb1-2dff-41a2-9681-fbec3cb290a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:44:48.852089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d491afb1-2dff-41a2-9681-fbec3cb290a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:48.861168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d491afb1-2dff-41a2-9681-fbec3cb290a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:48.861752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d491afb1-2dff-41a2-9681-fbec3cb290a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:48.862985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d491afb1-2dff-41a2-9681-fbec3cb290a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:48.863604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d491afb1-2dff-41a2-9681-fbec3cb290a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:48.938759 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d491afb1-2dff-41a2-9681-fbec3cb290a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc/action" status: 204 len: 0 microversion: 2.1 time: 0.090987 Aug 02 07:44:48.939428 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3440/6806] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:44:48 2022] POST /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc/action => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:44:48.949884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2c07e9b6-8a14-4137-a944-7032e576b2c3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:48.950565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2c07e9b6-8a14-4137-a944-7032e576b2c3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:48.957441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c07e9b6-8a14-4137-a944-7032e576b2c3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:48.958054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c07e9b6-8a14-4137-a944-7032e576b2c3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:48.958903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c07e9b6-8a14-4137-a944-7032e576b2c3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:48.959437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c07e9b6-8a14-4137-a944-7032e576b2c3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:49.108778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2c07e9b6-8a14-4137-a944-7032e576b2c3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:49.117135 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2c07e9b6-8a14-4137-a944-7032e576b2c3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1679 microversion: 2.1 time: 0.172252 Aug 02 07:44:49.117725 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3367/6807] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:48 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:50.146821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1af0dfea-f4e6-4665-a226-7e1d1f6521da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:50.148224 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1af0dfea-f4e6-4665-a226-7e1d1f6521da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:50.157770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1af0dfea-f4e6-4665-a226-7e1d1f6521da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:50.158260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1af0dfea-f4e6-4665-a226-7e1d1f6521da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:50.159268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1af0dfea-f4e6-4665-a226-7e1d1f6521da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:50.159481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1af0dfea-f4e6-4665-a226-7e1d1f6521da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:50.190621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-4a0af1a3-5d18-4d5a-8211-d18cb6d957bc req-56a3a3cb-3a89-49db-be81-03ed88f2ee82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57cd5ee0-6fa9-4197-88a1-b885ab9929dc", "name": "network-vif-plugged", "status": "completed", "tag": "93e313f1-b366-4b98-b92e-0fb64a16e2db"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:44:50.203201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4a0af1a3-5d18-4d5a-8211-d18cb6d957bc req-56a3a3cb-3a89-49db-be81-03ed88f2ee82 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:50.203691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4a0af1a3-5d18-4d5a-8211-d18cb6d957bc req-56a3a3cb-3a89-49db-be81-03ed88f2ee82 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:50.217006 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-4a0af1a3-5d18-4d5a-8211-d18cb6d957bc req-56a3a3cb-3a89-49db-be81-03ed88f2ee82 service nova] Creating event network-vif-plugged:93e313f1-b366-4b98-b92e-0fb64a16e2db for instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc on n-h2-851337-3 Aug 02 07:44:50.222754 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-4a0af1a3-5d18-4d5a-8211-d18cb6d957bc req-56a3a3cb-3a89-49db-be81-03ed88f2ee82 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094353 Aug 02 07:44:50.225838 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3441/6808] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:44:50.316943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1af0dfea-f4e6-4665-a226-7e1d1f6521da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:50.325729 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1af0dfea-f4e6-4665-a226-7e1d1f6521da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1679 microversion: 2.1 time: 0.190070 Aug 02 07:44:50.326371 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3368/6809] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:50 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:44:51.355504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4e02bb11-2b05-46ac-a874-a4f348c08bbf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:51.356198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4e02bb11-2b05-46ac-a874-a4f348c08bbf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:51.363339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e02bb11-2b05-46ac-a874-a4f348c08bbf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:51.363787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e02bb11-2b05-46ac-a874-a4f348c08bbf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:51.364550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e02bb11-2b05-46ac-a874-a4f348c08bbf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:51.365181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4e02bb11-2b05-46ac-a874-a4f348c08bbf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:51.508533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4e02bb11-2b05-46ac-a874-a4f348c08bbf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:51.516588 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4e02bb11-2b05-46ac-a874-a4f348c08bbf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1671 microversion: 2.1 time: 0.166281 Aug 02 07:44:51.517167 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3442/6810] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:51 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:51.540242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6db41ab0-22a7-4b7b-b73f-f6586698ba3c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:51.541029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6db41ab0-22a7-4b7b-b73f-f6586698ba3c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:51.548844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6db41ab0-22a7-4b7b-b73f-f6586698ba3c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:51.549303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6db41ab0-22a7-4b7b-b73f-f6586698ba3c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:51.550132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6db41ab0-22a7-4b7b-b73f-f6586698ba3c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:51.550575 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6db41ab0-22a7-4b7b-b73f-f6586698ba3c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:51.693069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6db41ab0-22a7-4b7b-b73f-f6586698ba3c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:51.701043 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6db41ab0-22a7-4b7b-b73f-f6586698ba3c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1671 microversion: 2.1 time: 0.167156 Aug 02 07:44:51.701620 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3369/6811] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:51 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:51.721734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f45dd4e8-6fbf-460f-b03a-76b9edc8eedc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:51.722362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f45dd4e8-6fbf-460f-b03a-76b9edc8eedc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:51.728818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f45dd4e8-6fbf-460f-b03a-76b9edc8eedc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:51.729359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f45dd4e8-6fbf-460f-b03a-76b9edc8eedc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:51.730192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f45dd4e8-6fbf-460f-b03a-76b9edc8eedc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:51.730625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f45dd4e8-6fbf-460f-b03a-76b9edc8eedc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:51.873513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f45dd4e8-6fbf-460f-b03a-76b9edc8eedc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:51.882967 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f45dd4e8-6fbf-460f-b03a-76b9edc8eedc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1671 microversion: 2.1 time: 0.165007 Aug 02 07:44:51.883636 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3443/6812] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:51 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:44:51.903640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f32683a1-e1fa-4193-abad-c2e061b1a667 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:51.904063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f32683a1-e1fa-4193-abad-c2e061b1a667 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:51.910424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f32683a1-e1fa-4193-abad-c2e061b1a667 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:51.910875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f32683a1-e1fa-4193-abad-c2e061b1a667 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:51.911695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f32683a1-e1fa-4193-abad-c2e061b1a667 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:51.912139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f32683a1-e1fa-4193-abad-c2e061b1a667 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:51.951246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f32683a1-e1fa-4193-abad-c2e061b1a667 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:44:52.055255 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f32683a1-e1fa-4193-abad-c2e061b1a667 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "DELETE /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 204 len: 0 microversion: 2.1 time: 0.154944 Aug 02 07:44:52.056269 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3370/6813] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:44:51 2022] DELETE /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 07:44:52.067268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d2e38b99-3300-4bcf-9c14-4a573dd9a41d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:52.068031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d2e38b99-3300-4bcf-9c14-4a573dd9a41d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:52.074990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2e38b99-3300-4bcf-9c14-4a573dd9a41d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:52.075427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2e38b99-3300-4bcf-9c14-4a573dd9a41d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:52.076219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2e38b99-3300-4bcf-9c14-4a573dd9a41d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:52.076641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d2e38b99-3300-4bcf-9c14-4a573dd9a41d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:52.081647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:44:52.480015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d2e38b99-3300-4bcf-9c14-4a573dd9a41d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:52.488735 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d2e38b99-3300-4bcf-9c14-4a573dd9a41d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1677 microversion: 2.1 time: 0.425866 Aug 02 07:44:52.489423 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3444/6814] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:52 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1677 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:53.517646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-44c8bffe-e40d-4e31-9122-8230a580be1e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:53.518367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-44c8bffe-e40d-4e31-9122-8230a580be1e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:53.526194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44c8bffe-e40d-4e31-9122-8230a580be1e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:53.526664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44c8bffe-e40d-4e31-9122-8230a580be1e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:53.527750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44c8bffe-e40d-4e31-9122-8230a580be1e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:53.528205 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44c8bffe-e40d-4e31-9122-8230a580be1e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:53.548115 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:44:53.745280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44c8bffe-e40d-4e31-9122-8230a580be1e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:53.753062 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-44c8bffe-e40d-4e31-9122-8230a580be1e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 200 len: 1677 microversion: 2.1 time: 0.239811 Aug 02 07:44:53.753664 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3371/6815] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:53 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 1677 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:54.315755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-cb0fa255-1b76-49f0-b88f-3f1491bdbdc4 req-33c7a76f-e93b-47e9-895a-39deb50d9283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57cd5ee0-6fa9-4197-88a1-b885ab9929dc", "name": "network-vif-deleted", "tag": "93e313f1-b366-4b98-b92e-0fb64a16e2db"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:44:54.332554 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-cb0fa255-1b76-49f0-b88f-3f1491bdbdc4 req-33c7a76f-e93b-47e9-895a-39deb50d9283 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:54.333569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-cb0fa255-1b76-49f0-b88f-3f1491bdbdc4 req-33c7a76f-e93b-47e9-895a-39deb50d9283 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:54.350101 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-cb0fa255-1b76-49f0-b88f-3f1491bdbdc4 req-33c7a76f-e93b-47e9-895a-39deb50d9283 service nova] Creating event network-vif-deleted:93e313f1-b366-4b98-b92e-0fb64a16e2db for instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc on n-h2-851337-3 Aug 02 07:44:54.358295 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-cb0fa255-1b76-49f0-b88f-3f1491bdbdc4 req-33c7a76f-e93b-47e9-895a-39deb50d9283 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046464 Aug 02 07:44:54.359341 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3445/6816] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:44:54.776086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ee57c275-d606-4274-bc0f-bd5a62f2bd48 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:54.776894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ee57c275-d606-4274-bc0f-bd5a62f2bd48 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:54.784095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee57c275-d606-4274-bc0f-bd5a62f2bd48 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:54.784555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee57c275-d606-4274-bc0f-bd5a62f2bd48 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:54.785324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee57c275-d606-4274-bc0f-bd5a62f2bd48 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:54.785991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee57c275-d606-4274-bc0f-bd5a62f2bd48 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:54.799836 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-ee57c275-d606-4274-bc0f-bd5a62f2bd48 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ee57c275-d606-4274-bc0f-bd5a62f2bd48 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc HTTP/1.1 Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '57cd5ee0-6fa9-4197-88a1-b885ab9929dc'} Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:44:54.801555 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:44:54.814681 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:44:54.814681 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:44:54.814681 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:44:54.814681 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:44:54.814681 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:44:54.814681 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:44:54.814681 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:44:54.814681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ee57c275-d606-4274-bc0f-bd5a62f2bd48 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:44:54.814681 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ee57c275-d606-4274-bc0f-bd5a62f2bd48 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 404 len: 111 microversion: 2.1 time: 0.031251 Aug 02 07:44:54.814681 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3372/6817] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:54 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:44:54.822196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1b4f8446-04d1-48b6-a503-d2734170ecbb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:54.822968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1b4f8446-04d1-48b6-a503-d2734170ecbb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:54.830068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b4f8446-04d1-48b6-a503-d2734170ecbb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:54.830507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b4f8446-04d1-48b6-a503-d2734170ecbb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:54.831286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b4f8446-04d1-48b6-a503-d2734170ecbb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:54.831716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b4f8446-04d1-48b6-a503-d2734170ecbb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:54.850219 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-1b4f8446-04d1-48b6-a503-d2734170ecbb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1b4f8446-04d1-48b6-a503-d2734170ecbb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc HTTP/1.1 Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '57cd5ee0-6fa9-4197-88a1-b885ab9929dc'} Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:44:54.851885 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:44:54.860766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:44:54.860766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:44:54.860766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:44:54.860766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:44:54.860766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:44:54.860766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:44:54.860766 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:44:54.860766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1b4f8446-04d1-48b6-a503-d2734170ecbb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:44:54.860766 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1b4f8446-04d1-48b6-a503-d2734170ecbb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 404 len: 111 microversion: 2.1 time: 0.035376 Aug 02 07:44:54.865937 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3446/6818] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:54 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:44:54.911686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2087653529", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "04888cbc-b87e-4deb-bc18-190dfb5b7a24"}], "security_groups": [{"name": "tempest-securitygroup--1251438242"}], "key_name": "tempest-keypair-1730148551", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:44:55.031715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] validate_networks() for [('04888cbc-b87e-4deb-bc18-190dfb5b7a24', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:44:55.546022 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:44:55.546571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:44:55.547284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:44:55.547824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:44:55.548417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:44:55.557833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:55.558542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:55.559150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:55.559600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:55.577041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Getting quotas for project 693ef5caeeb34c95b6c5b4390df3487a. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:44:55.582814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Getting quotas for user abff1bade52a439093f9d43ed63fc857 and project 693ef5caeeb34c95b6c5b4390df3487a. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:44:55.599280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:44:55.601596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:44:55.650686 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9aa5e9da-2b93-466b-ad74-19ab70ec8161 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.746054 Aug 02 07:44:55.651613 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3373/6819] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:44:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:44:55.662858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e61db71d-e100-422f-997b-6f49ab5b76d4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:55.663555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e61db71d-e100-422f-997b-6f49ab5b76d4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:55.722457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e61db71d-e100-422f-997b-6f49ab5b76d4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:55.732052 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e61db71d-e100-422f-997b-6f49ab5b76d4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1239 microversion: 2.1 time: 0.072978 Aug 02 07:44:55.732935 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3447/6820] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:55 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:44:56.755894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-461864bb-6f67-4563-a1de-624716e9268e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:56.757263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-461864bb-6f67-4563-a1de-624716e9268e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:56.768979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-461864bb-6f67-4563-a1de-624716e9268e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:56.769655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-461864bb-6f67-4563-a1de-624716e9268e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:56.770665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-461864bb-6f67-4563-a1de-624716e9268e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:56.771304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-461864bb-6f67-4563-a1de-624716e9268e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:56.877322 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-461864bb-6f67-4563-a1de-624716e9268e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:56.890622 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-461864bb-6f67-4563-a1de-624716e9268e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1299 microversion: 2.1 time: 0.138988 Aug 02 07:44:56.891939 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3374/6821] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:56 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:57.925165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dfbf6c5e-3f6a-4a2a-9e38-233a8b604067 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:57.925768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dfbf6c5e-3f6a-4a2a-9e38-233a8b604067 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:57.933135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dfbf6c5e-3f6a-4a2a-9e38-233a8b604067 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:57.933587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dfbf6c5e-3f6a-4a2a-9e38-233a8b604067 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:57.934412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dfbf6c5e-3f6a-4a2a-9e38-233a8b604067 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:57.934847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dfbf6c5e-3f6a-4a2a-9e38-233a8b604067 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:58.088534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dfbf6c5e-3f6a-4a2a-9e38-233a8b604067 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:58.097559 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dfbf6c5e-3f6a-4a2a-9e38-233a8b604067 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1365 microversion: 2.1 time: 0.177327 Aug 02 07:44:58.098500 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3448/6822] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:57 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:44:58.613395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-fc0cf3d5-d471-4e6f-8cc2-08809ed8dfb6 req-bf3cd808-0f8b-42c8-8b72-bc166b0c285c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9c9f97-6224-4392-a3d4-a0b38588beda", "tag": "a5bce68b-3b8c-4986-b767-fb99fa882ee5"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:44:58.623355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fc0cf3d5-d471-4e6f-8cc2-08809ed8dfb6 req-bf3cd808-0f8b-42c8-8b72-bc166b0c285c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:58.623803 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fc0cf3d5-d471-4e6f-8cc2-08809ed8dfb6 req-bf3cd808-0f8b-42c8-8b72-bc166b0c285c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:58.635748 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-fc0cf3d5-d471-4e6f-8cc2-08809ed8dfb6 req-bf3cd808-0f8b-42c8-8b72-bc166b0c285c service nova] Creating event network-changed:a5bce68b-3b8c-4986-b767-fb99fa882ee5 for instance 3d9c9f97-6224-4392-a3d4-a0b38588beda on n-h1-851337-3 Aug 02 07:44:58.641561 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-fc0cf3d5-d471-4e6f-8cc2-08809ed8dfb6 req-bf3cd808-0f8b-42c8-8b72-bc166b0c285c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083417 Aug 02 07:44:58.642793 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3375/6823] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:44:59.120735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3ad8c133-c613-4666-8b8c-42ccb6dbb36b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:44:59.121372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3ad8c133-c613-4666-8b8c-42ccb6dbb36b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:44:59.131151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ad8c133-c613-4666-8b8c-42ccb6dbb36b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:59.132048 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ad8c133-c613-4666-8b8c-42ccb6dbb36b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:59.132918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ad8c133-c613-4666-8b8c-42ccb6dbb36b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:44:59.133357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ad8c133-c613-4666-8b8c-42ccb6dbb36b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:44:59.267257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3ad8c133-c613-4666-8b8c-42ccb6dbb36b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:44:59.275265 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3ad8c133-c613-4666-8b8c-42ccb6dbb36b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1365 microversion: 2.1 time: 0.158868 Aug 02 07:44:59.275835 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3449/6824] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:44:59 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:45:00.304706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a0662fff-4681-46bf-bad7-8c7de48a3dbd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:45:00.305934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a0662fff-4681-46bf-bad7-8c7de48a3dbd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:45:00.309095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:45:00.321253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a0662fff-4681-46bf-bad7-8c7de48a3dbd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:00.321712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a0662fff-4681-46bf-bad7-8c7de48a3dbd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:00.322645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a0662fff-4681-46bf-bad7-8c7de48a3dbd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:00.323096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a0662fff-4681-46bf-bad7-8c7de48a3dbd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:00.475151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a0662fff-4681-46bf-bad7-8c7de48a3dbd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:45:00.488236 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a0662fff-4681-46bf-bad7-8c7de48a3dbd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1365 microversion: 2.1 time: 0.192106 Aug 02 07:45:00.489270 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3376/6825] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:45:00 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:45:01.513796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-34df4e94-f44f-49cb-b19e-a7cb2e2c5405 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:45:01.514458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-34df4e94-f44f-49cb-b19e-a7cb2e2c5405 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:45:01.517375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=49 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:45:01.523076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34df4e94-f44f-49cb-b19e-a7cb2e2c5405 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:01.523534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34df4e94-f44f-49cb-b19e-a7cb2e2c5405 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:01.524322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34df4e94-f44f-49cb-b19e-a7cb2e2c5405 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:01.524787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-34df4e94-f44f-49cb-b19e-a7cb2e2c5405 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:01.685549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-34df4e94-f44f-49cb-b19e-a7cb2e2c5405 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:45:01.696550 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-34df4e94-f44f-49cb-b19e-a7cb2e2c5405 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1365 microversion: 2.1 time: 0.186315 Aug 02 07:45:01.697422 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3450/6826] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:45:01 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:45:02.721623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d1fe2d11-d0b8-45e8-91ff-2f4defe9e02b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:45:02.722273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d1fe2d11-d0b8-45e8-91ff-2f4defe9e02b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:45:02.729790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d1fe2d11-d0b8-45e8-91ff-2f4defe9e02b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:02.730283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d1fe2d11-d0b8-45e8-91ff-2f4defe9e02b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:02.731069 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d1fe2d11-d0b8-45e8-91ff-2f4defe9e02b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:02.731514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d1fe2d11-d0b8-45e8-91ff-2f4defe9e02b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:02.904589 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d1fe2d11-d0b8-45e8-91ff-2f4defe9e02b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:45:02.912747 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d1fe2d11-d0b8-45e8-91ff-2f4defe9e02b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1365 microversion: 2.1 time: 0.195197 Aug 02 07:45:02.913339 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3377/6827] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:45:02 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:45:03.935353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c28b4af9-d64a-409f-8a22-0eb4dc2e4d9e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:45:03.936237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c28b4af9-d64a-409f-8a22-0eb4dc2e4d9e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:45:03.943498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c28b4af9-d64a-409f-8a22-0eb4dc2e4d9e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:03.943955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c28b4af9-d64a-409f-8a22-0eb4dc2e4d9e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:03.944826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c28b4af9-d64a-409f-8a22-0eb4dc2e4d9e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:03.945303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c28b4af9-d64a-409f-8a22-0eb4dc2e4d9e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:04.097663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c28b4af9-d64a-409f-8a22-0eb4dc2e4d9e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:45:04.108860 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c28b4af9-d64a-409f-8a22-0eb4dc2e4d9e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1365 microversion: 2.1 time: 0.177369 Aug 02 07:45:04.109951 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3451/6828] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:45:03 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:45:05.137601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a68a315c-0343-40df-a7ba-4943a52e05fc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:45:05.138296 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a68a315c-0343-40df-a7ba-4943a52e05fc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:45:05.144911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a68a315c-0343-40df-a7ba-4943a52e05fc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:05.145361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a68a315c-0343-40df-a7ba-4943a52e05fc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:05.146300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a68a315c-0343-40df-a7ba-4943a52e05fc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:05.146740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a68a315c-0343-40df-a7ba-4943a52e05fc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:05.291295 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a68a315c-0343-40df-a7ba-4943a52e05fc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:45:05.304806 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a68a315c-0343-40df-a7ba-4943a52e05fc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1365 microversion: 2.1 time: 0.175614 Aug 02 07:45:05.305427 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3378/6829] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:45:05 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:45:05.632155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-67a33c4d-1f9a-4446-b101-2a04d8b54a6b req-edfe82dc-5223-4036-a638-3d657ac67bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9c9f97-6224-4392-a3d4-a0b38588beda", "name": "network-vif-plugged", "status": "completed", "tag": "a5bce68b-3b8c-4986-b767-fb99fa882ee5"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:45:05.645123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-67a33c4d-1f9a-4446-b101-2a04d8b54a6b req-edfe82dc-5223-4036-a638-3d657ac67bf8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:05.645835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-67a33c4d-1f9a-4446-b101-2a04d8b54a6b req-edfe82dc-5223-4036-a638-3d657ac67bf8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:05.661333 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-67a33c4d-1f9a-4446-b101-2a04d8b54a6b req-edfe82dc-5223-4036-a638-3d657ac67bf8 service nova] Creating event network-vif-plugged:a5bce68b-3b8c-4986-b767-fb99fa882ee5 for instance 3d9c9f97-6224-4392-a3d4-a0b38588beda on n-h1-851337-3 Aug 02 07:45:05.674734 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-67a33c4d-1f9a-4446-b101-2a04d8b54a6b req-edfe82dc-5223-4036-a638-3d657ac67bf8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046391 Aug 02 07:45:05.675156 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3452/6830] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:45:06.327885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cccf77b1-58fb-47ad-b8ab-98fb3bd7e8f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:45:06.328763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cccf77b1-58fb-47ad-b8ab-98fb3bd7e8f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:45:06.330653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:45:06.331356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:45:06.338834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cccf77b1-58fb-47ad-b8ab-98fb3bd7e8f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:06.339482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cccf77b1-58fb-47ad-b8ab-98fb3bd7e8f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:06.340795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cccf77b1-58fb-47ad-b8ab-98fb3bd7e8f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:06.341512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cccf77b1-58fb-47ad-b8ab-98fb3bd7e8f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:06.497872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cccf77b1-58fb-47ad-b8ab-98fb3bd7e8f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:45:06.506213 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cccf77b1-58fb-47ad-b8ab-98fb3bd7e8f9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1365 microversion: 2.1 time: 0.182653 Aug 02 07:45:06.507007 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3379/6831] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:45:06 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:45:07.528932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:45:07.534367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-24e24f5a-cb00-4da1-a005-c0184302bf4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:45:07.535066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-24e24f5a-cb00-4da1-a005-c0184302bf4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:45:07.541810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24e24f5a-cb00-4da1-a005-c0184302bf4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:07.542263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24e24f5a-cb00-4da1-a005-c0184302bf4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:07.543023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24e24f5a-cb00-4da1-a005-c0184302bf4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:07.543460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24e24f5a-cb00-4da1-a005-c0184302bf4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:07.700733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-24e24f5a-cb00-4da1-a005-c0184302bf4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:45:07.708726 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-24e24f5a-cb00-4da1-a005-c0184302bf4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1552 microversion: 2.1 time: 0.180903 Aug 02 07:45:07.709412 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3453/6832] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:45:07 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1552 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:45:07.730450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5c58ad65-95cc-4880-ace5-e8d0c192a599 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:45:07.731048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5c58ad65-95cc-4880-ace5-e8d0c192a599 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:45:07.738200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c58ad65-95cc-4880-ace5-e8d0c192a599 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:07.738661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c58ad65-95cc-4880-ace5-e8d0c192a599 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:07.739477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c58ad65-95cc-4880-ace5-e8d0c192a599 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:07.739918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c58ad65-95cc-4880-ace5-e8d0c192a599 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:07.825139 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5c58ad65-95cc-4880-ace5-e8d0c192a599 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098589 Aug 02 07:45:07.825811 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3380/6833] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 07:45:07 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:45:09.235183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-81e2091b-77c8-43e4-a3c3-3f7d72d561c4 req-49baab6f-5bd4-4eea-adb6-36547e9d2af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9c9f97-6224-4392-a3d4-a0b38588beda", "tag": "a5bce68b-3b8c-4986-b767-fb99fa882ee5"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:45:09.246256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-81e2091b-77c8-43e4-a3c3-3f7d72d561c4 req-49baab6f-5bd4-4eea-adb6-36547e9d2af9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:45:09.247164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-81e2091b-77c8-43e4-a3c3-3f7d72d561c4 req-49baab6f-5bd4-4eea-adb6-36547e9d2af9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:45:09.262679 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-81e2091b-77c8-43e4-a3c3-3f7d72d561c4 req-49baab6f-5bd4-4eea-adb6-36547e9d2af9 service nova] Creating event network-changed:a5bce68b-3b8c-4986-b767-fb99fa882ee5 for instance 3d9c9f97-6224-4392-a3d4-a0b38588beda on n-h1-851337-3 Aug 02 07:45:09.269754 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-81e2091b-77c8-43e4-a3c3-3f7d72d561c4 req-49baab6f-5bd4-4eea-adb6-36547e9d2af9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038241 Aug 02 07:45:09.271213 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3454/6834] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:46:06.122287 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:46:06.123025 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 07:46:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:46:07.164782 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:46:07.165825 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 07:46:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:46:13.021459 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52c7fbf0-ab5b-40ba-9153-7d2f92273477] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 07:46:13.022349 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ad41dfa6-acfa-4002-ab8d-84c3526bc6c6] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 07:46:13.023013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=9 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:46:13.023792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=44 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:46:13.029219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-97054ed6-e035-4597-9959-acbbdf4c853d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:46:13.039745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97054ed6-e035-4597-9959-acbbdf4c853d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:13.040207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-97054ed6-e035-4597-9959-acbbdf4c853d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:13.067604 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-97054ed6-e035-4597-9959-acbbdf4c853d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Going to try to stop instance {{(pid=126119) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 07:46:13.113740 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-97054ed6-e035-4597-9959-acbbdf4c853d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda/action" status: 202 len: 0 microversion: 2.1 time: 0.094198 Aug 02 07:46:13.114422 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3381/6835] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:46:13 2022] POST /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:46:13.122828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=9 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:46:13.123598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=43 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:46:13.129705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9206514c-31d7-4142-b7d1-21ce367681b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:13.130984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9206514c-31d7-4142-b7d1-21ce367681b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:13.140086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9206514c-31d7-4142-b7d1-21ce367681b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:13.140503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9206514c-31d7-4142-b7d1-21ce367681b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:13.141445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9206514c-31d7-4142-b7d1-21ce367681b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:13.142163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9206514c-31d7-4142-b7d1-21ce367681b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:13.287977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9206514c-31d7-4142-b7d1-21ce367681b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:13.296308 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9206514c-31d7-4142-b7d1-21ce367681b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1681 microversion: 2.1 time: 0.176426 Aug 02 07:46:13.296950 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3455/6836] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:13 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:14.320703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-022c32a9-6248-43e9-be92-f1818b3c98ec tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:14.321419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-022c32a9-6248-43e9-be92-f1818b3c98ec tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:14.330542 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] [ad41dfa6-acfa-4002-ab8d-84c3526bc6c6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36482. Aug 02 07:46:14.333034 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] [52c7fbf0-ab5b-40ba-9153-7d2f92273477] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36480. Aug 02 07:46:14.335548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-022c32a9-6248-43e9-be92-f1818b3c98ec tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:14.336015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-022c32a9-6248-43e9-be92-f1818b3c98ec tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:14.336800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-022c32a9-6248-43e9-be92-f1818b3c98ec tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:14.337252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-022c32a9-6248-43e9-be92-f1818b3c98ec tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:14.483265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-022c32a9-6248-43e9-be92-f1818b3c98ec tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:14.491535 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-022c32a9-6248-43e9-be92-f1818b3c98ec tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1681 microversion: 2.1 time: 0.177023 Aug 02 07:46:14.492141 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3382/6837] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:14 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:15.515051 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-65d64fc4-56e1-49ce-b099-370a5b5bcfee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:15.515641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-65d64fc4-56e1-49ce-b099-370a5b5bcfee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:15.526468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-65d64fc4-56e1-49ce-b099-370a5b5bcfee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:15.526928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-65d64fc4-56e1-49ce-b099-370a5b5bcfee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:15.527697 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-65d64fc4-56e1-49ce-b099-370a5b5bcfee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:15.528128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-65d64fc4-56e1-49ce-b099-370a5b5bcfee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:15.668886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-65d64fc4-56e1-49ce-b099-370a5b5bcfee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:15.678150 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-65d64fc4-56e1-49ce-b099-370a5b5bcfee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1681 microversion: 2.1 time: 0.167086 Aug 02 07:46:15.678692 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3456/6838] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:15 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:16.700025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-85e9cd95-a45e-4c89-9ae0-5f06cd957685 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:16.700675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-85e9cd95-a45e-4c89-9ae0-5f06cd957685 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:16.708164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85e9cd95-a45e-4c89-9ae0-5f06cd957685 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:16.708626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85e9cd95-a45e-4c89-9ae0-5f06cd957685 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:16.709405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85e9cd95-a45e-4c89-9ae0-5f06cd957685 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:16.709849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-85e9cd95-a45e-4c89-9ae0-5f06cd957685 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:16.848149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-85e9cd95-a45e-4c89-9ae0-5f06cd957685 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:16.859400 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-85e9cd95-a45e-4c89-9ae0-5f06cd957685 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1681 microversion: 2.1 time: 0.163240 Aug 02 07:46:16.860185 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3383/6839] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:16 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:17.888477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-15726ede-163e-4ea8-b256-78fd0a510dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:17.889096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-15726ede-163e-4ea8-b256-78fd0a510dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:17.900028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15726ede-163e-4ea8-b256-78fd0a510dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:17.900474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15726ede-163e-4ea8-b256-78fd0a510dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:17.901248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15726ede-163e-4ea8-b256-78fd0a510dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:17.901693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-15726ede-163e-4ea8-b256-78fd0a510dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:18.058654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-15726ede-163e-4ea8-b256-78fd0a510dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:18.069306 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-15726ede-163e-4ea8-b256-78fd0a510dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1681 microversion: 2.1 time: 0.187256 Aug 02 07:46:18.070037 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3457/6840] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:17 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:19.099214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-460ac06e-3df7-41f4-8de1-72ebc1a2316c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:19.099835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-460ac06e-3df7-41f4-8de1-72ebc1a2316c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:19.108183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-460ac06e-3df7-41f4-8de1-72ebc1a2316c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:19.108655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-460ac06e-3df7-41f4-8de1-72ebc1a2316c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:19.109444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-460ac06e-3df7-41f4-8de1-72ebc1a2316c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:19.109917 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-460ac06e-3df7-41f4-8de1-72ebc1a2316c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:19.260065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-460ac06e-3df7-41f4-8de1-72ebc1a2316c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:19.268667 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-460ac06e-3df7-41f4-8de1-72ebc1a2316c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1681 microversion: 2.1 time: 0.175718 Aug 02 07:46:19.269271 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3384/6841] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:19 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:20.291840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-95f4facb-52f7-4f67-87fc-3249e08bfd2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:20.292498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-95f4facb-52f7-4f67-87fc-3249e08bfd2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:20.301999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-95f4facb-52f7-4f67-87fc-3249e08bfd2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:20.302388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-95f4facb-52f7-4f67-87fc-3249e08bfd2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:20.303168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-95f4facb-52f7-4f67-87fc-3249e08bfd2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:20.303609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-95f4facb-52f7-4f67-87fc-3249e08bfd2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:20.452263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-95f4facb-52f7-4f67-87fc-3249e08bfd2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:20.460503 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-95f4facb-52f7-4f67-87fc-3249e08bfd2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1681 microversion: 2.1 time: 0.172935 Aug 02 07:46:20.461109 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3458/6842] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:20 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:21.482418 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0eaa4dd2-d163-4af4-8d55-d321c9e1d6f2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:21.483050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0eaa4dd2-d163-4af4-8d55-d321c9e1d6f2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:21.491053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0eaa4dd2-d163-4af4-8d55-d321c9e1d6f2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:21.491519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0eaa4dd2-d163-4af4-8d55-d321c9e1d6f2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:21.492520 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0eaa4dd2-d163-4af4-8d55-d321c9e1d6f2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:21.492964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0eaa4dd2-d163-4af4-8d55-d321c9e1d6f2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:21.636136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0eaa4dd2-d163-4af4-8d55-d321c9e1d6f2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:21.644318 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0eaa4dd2-d163-4af4-8d55-d321c9e1d6f2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1681 microversion: 2.1 time: 0.166085 Aug 02 07:46:21.645173 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3385/6843] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:21 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:22.668538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-79bc84d8-a474-48c1-ab96-60357464e467 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:22.669298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-79bc84d8-a474-48c1-ab96-60357464e467 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:22.677826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79bc84d8-a474-48c1-ab96-60357464e467 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:22.678322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79bc84d8-a474-48c1-ab96-60357464e467 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:22.679142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79bc84d8-a474-48c1-ab96-60357464e467 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:22.679586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79bc84d8-a474-48c1-ab96-60357464e467 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:22.825619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-79bc84d8-a474-48c1-ab96-60357464e467 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:22.836767 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-79bc84d8-a474-48c1-ab96-60357464e467 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1681 microversion: 2.1 time: 0.173061 Aug 02 07:46:22.837350 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3459/6844] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:22 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:23.859172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bcbe8c73-3a90-4e0b-9cbc-177cd934ae77 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:23.859756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bcbe8c73-3a90-4e0b-9cbc-177cd934ae77 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:23.868092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcbe8c73-3a90-4e0b-9cbc-177cd934ae77 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:23.868551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcbe8c73-3a90-4e0b-9cbc-177cd934ae77 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:23.869349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcbe8c73-3a90-4e0b-9cbc-177cd934ae77 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:23.869797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bcbe8c73-3a90-4e0b-9cbc-177cd934ae77 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:24.016720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bcbe8c73-3a90-4e0b-9cbc-177cd934ae77 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:24.025926 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bcbe8c73-3a90-4e0b-9cbc-177cd934ae77 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1658 microversion: 2.1 time: 0.170740 Aug 02 07:46:24.026539 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3386/6845] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:23 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1658 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:24.047965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ea7fa58b-5f5d-4fb7-9187-507a36da4a25 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:46:24.051347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ea7fa58b-5f5d-4fb7-9187-507a36da4a25 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:24.058593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea7fa58b-5f5d-4fb7-9187-507a36da4a25 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:24.059034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea7fa58b-5f5d-4fb7-9187-507a36da4a25 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:24.059797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea7fa58b-5f5d-4fb7-9187-507a36da4a25 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:24.060230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ea7fa58b-5f5d-4fb7-9187-507a36da4a25 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:24.090017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ea7fa58b-5f5d-4fb7-9187-507a36da4a25 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:24.096531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ea7fa58b-5f5d-4fb7-9187-507a36da4a25 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Old instance type m1.heat2, new instance type m1.heat {{(pid=126120) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 07:46:24.103275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ea7fa58b-5f5d-4fb7-9187-507a36da4a25 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:46:24.103627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ea7fa58b-5f5d-4fb7-9187-507a36da4a25 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:46:24.104098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ea7fa58b-5f5d-4fb7-9187-507a36da4a25 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:46:24.104505 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ea7fa58b-5f5d-4fb7-9187-507a36da4a25 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:46:24.104909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-ea7fa58b-5f5d-4fb7-9187-507a36da4a25 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:46:24.174195 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ea7fa58b-5f5d-4fb7-9187-507a36da4a25 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda/action" status: 202 len: 0 microversion: 2.1 time: 0.130268 Aug 02 07:46:24.174813 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3460/6846] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:46:24 2022] POST /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:46:24.183415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7577f88a-e088-4149-a4fd-39b450bcc82d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:24.184038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7577f88a-e088-4149-a4fd-39b450bcc82d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:24.190338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7577f88a-e088-4149-a4fd-39b450bcc82d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:24.190766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7577f88a-e088-4149-a4fd-39b450bcc82d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:24.191500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7577f88a-e088-4149-a4fd-39b450bcc82d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:24.191939 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7577f88a-e088-4149-a4fd-39b450bcc82d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:24.341962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7577f88a-e088-4149-a4fd-39b450bcc82d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:24.350035 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7577f88a-e088-4149-a4fd-39b450bcc82d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1681 microversion: 2.1 time: 0.170492 Aug 02 07:46:24.350693 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3387/6847] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:24 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:25.372606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c71a71ac-e10c-42c9-a4c2-a9dd7c3cb975 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:25.373291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c71a71ac-e10c-42c9-a4c2-a9dd7c3cb975 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:25.379780 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c71a71ac-e10c-42c9-a4c2-a9dd7c3cb975 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:25.380628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c71a71ac-e10c-42c9-a4c2-a9dd7c3cb975 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:25.381478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c71a71ac-e10c-42c9-a4c2-a9dd7c3cb975 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:25.381936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c71a71ac-e10c-42c9-a4c2-a9dd7c3cb975 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:25.546099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c71a71ac-e10c-42c9-a4c2-a9dd7c3cb975 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:25.554730 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c71a71ac-e10c-42c9-a4c2-a9dd7c3cb975 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1681 microversion: 2.1 time: 0.187211 Aug 02 07:46:25.555330 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3461/6848] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:25 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:26.577010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-63e4d110-2a5f-47df-afec-315add1ed223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:26.577685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-63e4d110-2a5f-47df-afec-315add1ed223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:26.585251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63e4d110-2a5f-47df-afec-315add1ed223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:26.585714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63e4d110-2a5f-47df-afec-315add1ed223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:26.586531 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63e4d110-2a5f-47df-afec-315add1ed223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:26.586979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-63e4d110-2a5f-47df-afec-315add1ed223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:26.732707 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-63e4d110-2a5f-47df-afec-315add1ed223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:26.743061 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-63e4d110-2a5f-47df-afec-315add1ed223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1686 microversion: 2.1 time: 0.169956 Aug 02 07:46:26.743658 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3388/6849] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:26 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:27.766226 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e08c80ad-e504-4f5d-943f-0307bbedf1fe tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:27.766928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e08c80ad-e504-4f5d-943f-0307bbedf1fe tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:27.774798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e08c80ad-e504-4f5d-943f-0307bbedf1fe tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:27.775247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e08c80ad-e504-4f5d-943f-0307bbedf1fe tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:27.776030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e08c80ad-e504-4f5d-943f-0307bbedf1fe tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:27.776466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e08c80ad-e504-4f5d-943f-0307bbedf1fe tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:27.916723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e08c80ad-e504-4f5d-943f-0307bbedf1fe tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:27.924793 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e08c80ad-e504-4f5d-943f-0307bbedf1fe tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1686 microversion: 2.1 time: 0.162612 Aug 02 07:46:27.925341 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3462/6850] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:27 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:28.916701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a6c3830a-c0bc-49db-a2d5-95fd73bfa009 req-7eacdeff-c9b2-4db9-a90f-e6106f5e5fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9c9f97-6224-4392-a3d4-a0b38588beda", "name": "network-vif-unplugged", "status": "completed", "tag": "a5bce68b-3b8c-4986-b767-fb99fa882ee5"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:46:28.928199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a6c3830a-c0bc-49db-a2d5-95fd73bfa009 req-7eacdeff-c9b2-4db9-a90f-e6106f5e5fd4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:28.928199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a6c3830a-c0bc-49db-a2d5-95fd73bfa009 req-7eacdeff-c9b2-4db9-a90f-e6106f5e5fd4 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:28.941135 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a6c3830a-c0bc-49db-a2d5-95fd73bfa009 req-7eacdeff-c9b2-4db9-a90f-e6106f5e5fd4 service nova] Creating event network-vif-unplugged:a5bce68b-3b8c-4986-b767-fb99fa882ee5 for instance 3d9c9f97-6224-4392-a3d4-a0b38588beda on n-h2-851337-3 Aug 02 07:46:28.947419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-a6c3830a-c0bc-49db-a2d5-95fd73bfa009 req-7eacdeff-c9b2-4db9-a90f-e6106f5e5fd4 service nova] Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:46:28.949946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d17d1bd6-c7b8-4292-834c-4b493c2e9164 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:28.950799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d17d1bd6-c7b8-4292-834c-4b493c2e9164 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:28.960247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d17d1bd6-c7b8-4292-834c-4b493c2e9164 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:28.960860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d17d1bd6-c7b8-4292-834c-4b493c2e9164 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:28.961629 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a6c3830a-c0bc-49db-a2d5-95fd73bfa009 req-7eacdeff-c9b2-4db9-a90f-e6106f5e5fd4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048795 Aug 02 07:46:28.961764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d17d1bd6-c7b8-4292-834c-4b493c2e9164 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:28.962120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d17d1bd6-c7b8-4292-834c-4b493c2e9164 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:28.962615 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3389/6851] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:46:29.240093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d17d1bd6-c7b8-4292-834c-4b493c2e9164 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:29.248453 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d17d1bd6-c7b8-4292-834c-4b493c2e9164 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1685 microversion: 2.1 time: 0.305367 Aug 02 07:46:29.249129 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3463/6852] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:28 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1685 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:30.272498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0f6fea02-7c81-4e16-93ec-ff6c499f1601 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:30.273196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0f6fea02-7c81-4e16-93ec-ff6c499f1601 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:30.280058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f6fea02-7c81-4e16-93ec-ff6c499f1601 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:30.280527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f6fea02-7c81-4e16-93ec-ff6c499f1601 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:30.281302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f6fea02-7c81-4e16-93ec-ff6c499f1601 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:30.281751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f6fea02-7c81-4e16-93ec-ff6c499f1601 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:30.418856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0f6fea02-7c81-4e16-93ec-ff6c499f1601 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:30.426941 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0f6fea02-7c81-4e16-93ec-ff6c499f1601 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1683 microversion: 2.1 time: 0.159601 Aug 02 07:46:30.429065 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3390/6853] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:30 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:31.002102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b81217ac-6bf4-4501-8a55-14e8afa99985 req-dd6e3ebe-1c8b-435e-ad30-d3b78d9bd456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9c9f97-6224-4392-a3d4-a0b38588beda", "tag": "a5bce68b-3b8c-4986-b767-fb99fa882ee5"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:46:31.013424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b81217ac-6bf4-4501-8a55-14e8afa99985 req-dd6e3ebe-1c8b-435e-ad30-d3b78d9bd456 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:31.013814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b81217ac-6bf4-4501-8a55-14e8afa99985 req-dd6e3ebe-1c8b-435e-ad30-d3b78d9bd456 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:31.026574 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b81217ac-6bf4-4501-8a55-14e8afa99985 req-dd6e3ebe-1c8b-435e-ad30-d3b78d9bd456 service nova] Creating event network-changed:a5bce68b-3b8c-4986-b767-fb99fa882ee5 for instance 3d9c9f97-6224-4392-a3d4-a0b38588beda on n-h2-851337-3 Aug 02 07:46:31.032280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-b81217ac-6bf4-4501-8a55-14e8afa99985 req-dd6e3ebe-1c8b-435e-ad30-d3b78d9bd456 service nova] Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:46:31.043703 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b81217ac-6bf4-4501-8a55-14e8afa99985 req-dd6e3ebe-1c8b-435e-ad30-d3b78d9bd456 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045744 Aug 02 07:46:31.044310 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3464/6854] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:46:31.455508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-511d77c1-bfd6-47ab-b715-3f545986a6ab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:31.456425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-511d77c1-bfd6-47ab-b715-3f545986a6ab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:31.466560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-511d77c1-bfd6-47ab-b715-3f545986a6ab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:31.467198 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-511d77c1-bfd6-47ab-b715-3f545986a6ab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:31.468227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-511d77c1-bfd6-47ab-b715-3f545986a6ab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:31.468780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-511d77c1-bfd6-47ab-b715-3f545986a6ab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:31.695871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-511d77c1-bfd6-47ab-b715-3f545986a6ab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:31.703967 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-511d77c1-bfd6-47ab-b715-3f545986a6ab tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1679 microversion: 2.1 time: 0.254272 Aug 02 07:46:31.704585 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3391/6855] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:31 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:31.730512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aa487753-8e80-4a5b-aa29-0596c1bfd29d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:46:31.731136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aa487753-8e80-4a5b-aa29-0596c1bfd29d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:31.737784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa487753-8e80-4a5b-aa29-0596c1bfd29d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:31.738289 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa487753-8e80-4a5b-aa29-0596c1bfd29d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:31.739071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa487753-8e80-4a5b-aa29-0596c1bfd29d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:31.739508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa487753-8e80-4a5b-aa29-0596c1bfd29d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:31.802397 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aa487753-8e80-4a5b-aa29-0596c1bfd29d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda/action" status: 204 len: 0 microversion: 2.1 time: 0.075930 Aug 02 07:46:31.803013 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3465/6856] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:46:31 2022] POST /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:46:31.811303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-718e21ad-a67b-404c-b5c2-8b613ce55d79 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:31.811923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-718e21ad-a67b-404c-b5c2-8b613ce55d79 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:31.818679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-718e21ad-a67b-404c-b5c2-8b613ce55d79 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:31.819138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-718e21ad-a67b-404c-b5c2-8b613ce55d79 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:31.820169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-718e21ad-a67b-404c-b5c2-8b613ce55d79 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:31.820751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-718e21ad-a67b-404c-b5c2-8b613ce55d79 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:31.976112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-718e21ad-a67b-404c-b5c2-8b613ce55d79 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:31.984582 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-718e21ad-a67b-404c-b5c2-8b613ce55d79 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1679 microversion: 2.1 time: 0.177159 Aug 02 07:46:31.985181 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3392/6857] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:31 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:33.009759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3eb1a2ec-9fc1-456d-892e-b770efce46cb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:33.010578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3eb1a2ec-9fc1-456d-892e-b770efce46cb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:33.017952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3eb1a2ec-9fc1-456d-892e-b770efce46cb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:33.018749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3eb1a2ec-9fc1-456d-892e-b770efce46cb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:33.019725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3eb1a2ec-9fc1-456d-892e-b770efce46cb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:33.020118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3eb1a2ec-9fc1-456d-892e-b770efce46cb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:33.167007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3eb1a2ec-9fc1-456d-892e-b770efce46cb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:33.174627 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3eb1a2ec-9fc1-456d-892e-b770efce46cb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1679 microversion: 2.1 time: 0.170798 Aug 02 07:46:33.175188 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3466/6858] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:33 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:34.197026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1e3fd168-e012-4a30-9ac4-eaeb934cadd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:34.197685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1e3fd168-e012-4a30-9ac4-eaeb934cadd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:34.205245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e3fd168-e012-4a30-9ac4-eaeb934cadd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:34.205731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e3fd168-e012-4a30-9ac4-eaeb934cadd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:34.206552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e3fd168-e012-4a30-9ac4-eaeb934cadd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:34.206994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e3fd168-e012-4a30-9ac4-eaeb934cadd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:34.352285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1e3fd168-e012-4a30-9ac4-eaeb934cadd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:34.362792 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1e3fd168-e012-4a30-9ac4-eaeb934cadd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1658 microversion: 2.1 time: 0.169811 Aug 02 07:46:34.363768 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3393/6859] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:34 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1658 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:34.383990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4550cfff-8577-490f-a464-1485dd46f3e3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:34.384607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4550cfff-8577-490f-a464-1485dd46f3e3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:34.392312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4550cfff-8577-490f-a464-1485dd46f3e3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:34.392776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4550cfff-8577-490f-a464-1485dd46f3e3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:34.393560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4550cfff-8577-490f-a464-1485dd46f3e3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:34.394029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4550cfff-8577-490f-a464-1485dd46f3e3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:34.546764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4550cfff-8577-490f-a464-1485dd46f3e3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:34.555351 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4550cfff-8577-490f-a464-1485dd46f3e3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1658 microversion: 2.1 time: 0.175632 Aug 02 07:46:34.556194 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3467/6860] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:34 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1658 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:34.576437 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b55c5c6b-1ac8-4035-a2c8-4d0258e59a45 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:46:34.582900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b55c5c6b-1ac8-4035-a2c8-4d0258e59a45 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:34.583357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b55c5c6b-1ac8-4035-a2c8-4d0258e59a45 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:34.606891 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b55c5c6b-1ac8-4035-a2c8-4d0258e59a45 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Going to try to start instance {{(pid=126119) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 07:46:34.659528 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b55c5c6b-1ac8-4035-a2c8-4d0258e59a45 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda/action" status: 202 len: 0 microversion: 2.1 time: 0.086473 Aug 02 07:46:34.663757 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3394/6861] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:46:34 2022] POST /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:46:34.673975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b802cf7-916d-47fd-b9ef-fcfd27a2ec91 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:34.674624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4b802cf7-916d-47fd-b9ef-fcfd27a2ec91 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:34.685253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-11b4baf3-cee8-49aa-bf62-dc93869519fc req-33bbc91f-e07f-41ce-acee-8b771d2bef6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9c9f97-6224-4392-a3d4-a0b38588beda", "name": "network-vif-plugged", "status": "completed", "tag": "a5bce68b-3b8c-4986-b767-fb99fa882ee5"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:46:34.686375 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b802cf7-916d-47fd-b9ef-fcfd27a2ec91 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:34.687521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b802cf7-916d-47fd-b9ef-fcfd27a2ec91 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:34.688372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b802cf7-916d-47fd-b9ef-fcfd27a2ec91 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:34.688753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b802cf7-916d-47fd-b9ef-fcfd27a2ec91 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:34.700725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-11b4baf3-cee8-49aa-bf62-dc93869519fc req-33bbc91f-e07f-41ce-acee-8b771d2bef6a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:34.701196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-11b4baf3-cee8-49aa-bf62-dc93869519fc req-33bbc91f-e07f-41ce-acee-8b771d2bef6a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:34.714353 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-11b4baf3-cee8-49aa-bf62-dc93869519fc req-33bbc91f-e07f-41ce-acee-8b771d2bef6a service nova] Creating event network-vif-plugged:a5bce68b-3b8c-4986-b767-fb99fa882ee5 for instance 3d9c9f97-6224-4392-a3d4-a0b38588beda on n-h2-851337-3 Aug 02 07:46:34.719445 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-11b4baf3-cee8-49aa-bf62-dc93869519fc req-33bbc91f-e07f-41ce-acee-8b771d2bef6a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041351 Aug 02 07:46:34.720814 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3395/6862] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:46:34.942076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4b802cf7-916d-47fd-b9ef-fcfd27a2ec91 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:34.950678 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4b802cf7-916d-47fd-b9ef-fcfd27a2ec91 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1667 microversion: 2.1 time: 0.280655 Aug 02 07:46:34.951301 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3468/6863] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:34 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1667 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:35.974136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-06d5f51e-5c6a-4597-a35c-87d3b1485e0b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:35.974855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-06d5f51e-5c6a-4597-a35c-87d3b1485e0b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:35.981847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06d5f51e-5c6a-4597-a35c-87d3b1485e0b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:35.982337 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06d5f51e-5c6a-4597-a35c-87d3b1485e0b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:35.983171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06d5f51e-5c6a-4597-a35c-87d3b1485e0b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:35.983621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-06d5f51e-5c6a-4597-a35c-87d3b1485e0b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:36.002981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:46:36.147769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-06d5f51e-5c6a-4597-a35c-87d3b1485e0b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:36.156429 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-06d5f51e-5c6a-4597-a35c-87d3b1485e0b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1671 microversion: 2.1 time: 0.187578 Aug 02 07:46:36.157302 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3396/6864] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:35 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1671 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:36.177716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ebe10c94-4081-403b-95a3-3276331e929e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:36.178300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ebe10c94-4081-403b-95a3-3276331e929e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:36.185947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebe10c94-4081-403b-95a3-3276331e929e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:36.186397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebe10c94-4081-403b-95a3-3276331e929e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:36.187195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebe10c94-4081-403b-95a3-3276331e929e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:36.187619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ebe10c94-4081-403b-95a3-3276331e929e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:36.205230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:46:36.220665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ebe10c94-4081-403b-95a3-3276331e929e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:46:36.308149 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ebe10c94-4081-403b-95a3-3276331e929e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 204 len: 0 microversion: 2.1 time: 0.134266 Aug 02 07:46:36.308810 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3469/6865] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:46:36 2022] DELETE /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:46:36.317383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f5f8ef93-755d-4911-a73b-fa19803174a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:36.318036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f5f8ef93-755d-4911-a73b-fa19803174a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:36.324210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5f8ef93-755d-4911-a73b-fa19803174a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:36.324650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5f8ef93-755d-4911-a73b-fa19803174a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:36.325413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5f8ef93-755d-4911-a73b-fa19803174a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:36.325856 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5f8ef93-755d-4911-a73b-fa19803174a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:36.463380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f5f8ef93-755d-4911-a73b-fa19803174a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:36.473569 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f5f8ef93-755d-4911-a73b-fa19803174a3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1677 microversion: 2.1 time: 0.159968 Aug 02 07:46:36.474498 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3397/6866] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:36 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:46:37.503236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5a976204-cfb4-4524-89d5-07cdd826da39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:37.504408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5a976204-cfb4-4524-89d5-07cdd826da39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:37.515394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5a976204-cfb4-4524-89d5-07cdd826da39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:37.516142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5a976204-cfb4-4524-89d5-07cdd826da39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:37.517421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5a976204-cfb4-4524-89d5-07cdd826da39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:37.518196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5a976204-cfb4-4524-89d5-07cdd826da39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:38.053803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5a976204-cfb4-4524-89d5-07cdd826da39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:38.062174 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5a976204-cfb4-4524-89d5-07cdd826da39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 200 len: 1677 microversion: 2.1 time: 0.566487 Aug 02 07:46:38.062761 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3470/6867] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:37 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 1677 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:38.853662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-511c9a43-0bf4-495c-8036-14a728baa60b req-1f36bb9a-1a52-483b-a11f-d0e2c46e710e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9c9f97-6224-4392-a3d4-a0b38588beda", "name": "network-vif-deleted", "tag": "a5bce68b-3b8c-4986-b767-fb99fa882ee5"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:46:38.865793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-511c9a43-0bf4-495c-8036-14a728baa60b req-1f36bb9a-1a52-483b-a11f-d0e2c46e710e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:38.866909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-511c9a43-0bf4-495c-8036-14a728baa60b req-1f36bb9a-1a52-483b-a11f-d0e2c46e710e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:38.880303 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-511c9a43-0bf4-495c-8036-14a728baa60b req-1f36bb9a-1a52-483b-a11f-d0e2c46e710e service nova] Creating event network-vif-deleted:a5bce68b-3b8c-4986-b767-fb99fa882ee5 for instance 3d9c9f97-6224-4392-a3d4-a0b38588beda on n-h2-851337-3 Aug 02 07:46:38.885107 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-511c9a43-0bf4-495c-8036-14a728baa60b req-1f36bb9a-1a52-483b-a11f-d0e2c46e710e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035187 Aug 02 07:46:38.885748 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3398/6868] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:46:39.084386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b2b491b-dcbc-431c-9766-0ed13962f010 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:39.084944 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6b2b491b-dcbc-431c-9766-0ed13962f010 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:39.093122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b2b491b-dcbc-431c-9766-0ed13962f010 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:39.094205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b2b491b-dcbc-431c-9766-0ed13962f010 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:39.095386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b2b491b-dcbc-431c-9766-0ed13962f010 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:39.095890 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b2b491b-dcbc-431c-9766-0ed13962f010 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:39.110434 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-6b2b491b-dcbc-431c-9766-0ed13962f010 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b2b491b-dcbc-431c-9766-0ed13962f010 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda HTTP/1.1 Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '3d9c9f97-6224-4392-a3d4-a0b38588beda'} Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:46:39.112561 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:46:39.118405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:46:39.118405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:46:39.118405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:46:39.118405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:46:39.118405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:46:39.118405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:46:39.118405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:46:39.119805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b2b491b-dcbc-431c-9766-0ed13962f010 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:46:39.120835 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6b2b491b-dcbc-431c-9766-0ed13962f010 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 404 len: 111 microversion: 2.1 time: 0.040841 Aug 02 07:46:39.121580 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3471/6869] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:39 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:46:39.135991 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-96237c79-d932-4446-b6aa-0ca944802dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:39.136704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-96237c79-d932-4446-b6aa-0ca944802dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:39.143182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96237c79-d932-4446-b6aa-0ca944802dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:39.143643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96237c79-d932-4446-b6aa-0ca944802dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:39.144536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96237c79-d932-4446-b6aa-0ca944802dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:39.145005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96237c79-d932-4446-b6aa-0ca944802dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:39.159537 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-96237c79-d932-4446-b6aa-0ca944802dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-96237c79-d932-4446-b6aa-0ca944802dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda HTTP/1.1 Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '3d9c9f97-6224-4392-a3d4-a0b38588beda'} Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:46:39.161277 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:46:39.166305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:46:39.166305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:46:39.166305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:46:39.166305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:46:39.166305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:46:39.166305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:46:39.166305 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:46:39.166305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-96237c79-d932-4446-b6aa-0ca944802dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:46:39.166305 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-96237c79-d932-4446-b6aa-0ca944802dfc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 404 len: 111 microversion: 2.1 time: 0.031294 Aug 02 07:46:39.166305 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3399/6870] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:39 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:46:39.212238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-650767069", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "04888cbc-b87e-4deb-bc18-190dfb5b7a24"}], "security_groups": [{"name": "tempest-securitygroup--1251438242"}], "key_name": "tempest-keypair-1730148551", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:46:39.322546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] validate_networks() for [('04888cbc-b87e-4deb-bc18-190dfb5b7a24', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:46:39.810971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:46:39.811430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:46:39.811909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:46:39.812322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:46:39.812736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:46:39.829536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:39.830180 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:39.832379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:39.832833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:39.863986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Getting quotas for project 693ef5caeeb34c95b6c5b4390df3487a. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:46:39.870060 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Getting quotas for user abff1bade52a439093f9d43ed63fc857 and project 693ef5caeeb34c95b6c5b4390df3487a. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:46:39.884446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:46:39.886767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:46:39.941128 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6fd02ae1-e290-47fc-b396-ff1e1fbc1cb6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.732669 Aug 02 07:46:39.941765 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3472/6871] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:46:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:46:39.952894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0428b399-d43d-471b-8824-e2e08b1fd1ce tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:39.953609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0428b399-d43d-471b-8824-e2e08b1fd1ce tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:40.019038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0428b399-d43d-471b-8824-e2e08b1fd1ce tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:40.028658 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0428b399-d43d-471b-8824-e2e08b1fd1ce tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1238 microversion: 2.1 time: 0.079577 Aug 02 07:46:40.029270 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3400/6872] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:39 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:41.051936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f51e204a-d2be-4949-b036-107102be3ec6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:41.052628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f51e204a-d2be-4949-b036-107102be3ec6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:41.060293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f51e204a-d2be-4949-b036-107102be3ec6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:41.060755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f51e204a-d2be-4949-b036-107102be3ec6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:41.061544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f51e204a-d2be-4949-b036-107102be3ec6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:41.062043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f51e204a-d2be-4949-b036-107102be3ec6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:41.136641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f51e204a-d2be-4949-b036-107102be3ec6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:41.145063 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f51e204a-d2be-4949-b036-107102be3ec6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1308 microversion: 2.1 time: 0.098413 Aug 02 07:46:41.145837 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3473/6873] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:41 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:42.168201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-03d35c1e-0b56-4336-a5df-9b0013aa4902 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:42.169253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-03d35c1e-0b56-4336-a5df-9b0013aa4902 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:42.178254 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-03d35c1e-0b56-4336-a5df-9b0013aa4902 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:42.179033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-03d35c1e-0b56-4336-a5df-9b0013aa4902 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:42.181515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-03d35c1e-0b56-4336-a5df-9b0013aa4902 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:42.183194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-03d35c1e-0b56-4336-a5df-9b0013aa4902 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:42.319185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-03d35c1e-0b56-4336-a5df-9b0013aa4902 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:42.327181 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-03d35c1e-0b56-4336-a5df-9b0013aa4902 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1364 microversion: 2.1 time: 0.163288 Aug 02 07:46:42.327935 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3401/6874] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:42 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:42.392955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-60fbdb09-e58e-4184-8825-07b36ca70b96 req-830c2335-1e17-41f7-9b70-32d678156acf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ab3faf-712c-41cf-aa1d-0b6dff40c9cf", "tag": "ec899310-86dc-4220-b8da-6eb1b635db1f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:46:42.409681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-60fbdb09-e58e-4184-8825-07b36ca70b96 req-830c2335-1e17-41f7-9b70-32d678156acf service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:42.410143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-60fbdb09-e58e-4184-8825-07b36ca70b96 req-830c2335-1e17-41f7-9b70-32d678156acf service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:42.423093 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-60fbdb09-e58e-4184-8825-07b36ca70b96 req-830c2335-1e17-41f7-9b70-32d678156acf service nova] Creating event network-changed:ec899310-86dc-4220-b8da-6eb1b635db1f for instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf on n-h1-851337-3 Aug 02 07:46:42.428631 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-60fbdb09-e58e-4184-8825-07b36ca70b96 req-830c2335-1e17-41f7-9b70-32d678156acf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040011 Aug 02 07:46:42.429754 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3474/6875] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:46:43.350581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7795dde8-ab77-4dbb-a1e5-384bd033d1fb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:43.351208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7795dde8-ab77-4dbb-a1e5-384bd033d1fb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:43.354122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=45 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:46:43.359835 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7795dde8-ab77-4dbb-a1e5-384bd033d1fb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:43.360312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7795dde8-ab77-4dbb-a1e5-384bd033d1fb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:43.361099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7795dde8-ab77-4dbb-a1e5-384bd033d1fb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:43.361552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7795dde8-ab77-4dbb-a1e5-384bd033d1fb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:43.504750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7795dde8-ab77-4dbb-a1e5-384bd033d1fb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:43.513407 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7795dde8-ab77-4dbb-a1e5-384bd033d1fb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1364 microversion: 2.1 time: 0.166902 Aug 02 07:46:43.514013 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3402/6876] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:43 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:44.535894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-834294a0-7e48-4622-a980-f772158a1223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:44.536508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-834294a0-7e48-4622-a980-f772158a1223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:44.539533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:46:44.545473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-834294a0-7e48-4622-a980-f772158a1223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:44.545948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-834294a0-7e48-4622-a980-f772158a1223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:44.546733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-834294a0-7e48-4622-a980-f772158a1223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:44.547245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-834294a0-7e48-4622-a980-f772158a1223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:44.691930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-834294a0-7e48-4622-a980-f772158a1223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:44.699637 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-834294a0-7e48-4622-a980-f772158a1223 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1364 microversion: 2.1 time: 0.168531 Aug 02 07:46:44.700229 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3475/6877] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:44 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:45.721486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2d95528d-1500-48dc-801a-9dbc7fe41098 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:45.722207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2d95528d-1500-48dc-801a-9dbc7fe41098 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:45.728929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d95528d-1500-48dc-801a-9dbc7fe41098 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:45.729397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d95528d-1500-48dc-801a-9dbc7fe41098 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:45.730197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d95528d-1500-48dc-801a-9dbc7fe41098 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:45.730642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d95528d-1500-48dc-801a-9dbc7fe41098 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:45.865132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2d95528d-1500-48dc-801a-9dbc7fe41098 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:45.873205 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2d95528d-1500-48dc-801a-9dbc7fe41098 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1364 microversion: 2.1 time: 0.156137 Aug 02 07:46:45.873817 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3403/6878] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:45 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:46.896348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5e7f1d43-30f4-4b96-a4ac-74def9483430 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:46.897140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5e7f1d43-30f4-4b96-a4ac-74def9483430 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:46.908065 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e7f1d43-30f4-4b96-a4ac-74def9483430 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:46.909037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e7f1d43-30f4-4b96-a4ac-74def9483430 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:46.909747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e7f1d43-30f4-4b96-a4ac-74def9483430 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:46.910227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e7f1d43-30f4-4b96-a4ac-74def9483430 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:47.051525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5e7f1d43-30f4-4b96-a4ac-74def9483430 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:47.059325 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5e7f1d43-30f4-4b96-a4ac-74def9483430 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1364 microversion: 2.1 time: 0.167612 Aug 02 07:46:47.059893 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3476/6879] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:46 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:48.081567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-22647e0b-2536-4da5-abc7-26462daf7fcd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:48.082331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-22647e0b-2536-4da5-abc7-26462daf7fcd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:48.089764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22647e0b-2536-4da5-abc7-26462daf7fcd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:48.090252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22647e0b-2536-4da5-abc7-26462daf7fcd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:48.091036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22647e0b-2536-4da5-abc7-26462daf7fcd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:48.091510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22647e0b-2536-4da5-abc7-26462daf7fcd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:48.233209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-22647e0b-2536-4da5-abc7-26462daf7fcd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:48.241185 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-22647e0b-2536-4da5-abc7-26462daf7fcd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1364 microversion: 2.1 time: 0.164051 Aug 02 07:46:48.241744 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3404/6880] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:48 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:49.264130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d743f689-77a4-40f7-bbe2-219e7fe35195 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:49.265161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d743f689-77a4-40f7-bbe2-219e7fe35195 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:49.274085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d743f689-77a4-40f7-bbe2-219e7fe35195 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:49.274540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d743f689-77a4-40f7-bbe2-219e7fe35195 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:49.275318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d743f689-77a4-40f7-bbe2-219e7fe35195 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:49.275756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d743f689-77a4-40f7-bbe2-219e7fe35195 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:49.415653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d743f689-77a4-40f7-bbe2-219e7fe35195 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:49.423235 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d743f689-77a4-40f7-bbe2-219e7fe35195 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1364 microversion: 2.1 time: 0.163664 Aug 02 07:46:49.423793 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3477/6881] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:49 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:50.206696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-341c1261-a4ee-447a-b969-48ca816845d2 req-61859e90-d5e5-4b36-9e29-2a8ee3cb72e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ab3faf-712c-41cf-aa1d-0b6dff40c9cf", "name": "network-vif-plugged", "status": "completed", "tag": "ec899310-86dc-4220-b8da-6eb1b635db1f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:46:50.213647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:46:50.222650 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-341c1261-a4ee-447a-b969-48ca816845d2 req-61859e90-d5e5-4b36-9e29-2a8ee3cb72e1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:50.223112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-341c1261-a4ee-447a-b969-48ca816845d2 req-61859e90-d5e5-4b36-9e29-2a8ee3cb72e1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:50.234797 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-341c1261-a4ee-447a-b969-48ca816845d2 req-61859e90-d5e5-4b36-9e29-2a8ee3cb72e1 service nova] Creating event network-vif-plugged:ec899310-86dc-4220-b8da-6eb1b635db1f for instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf on n-h1-851337-3 Aug 02 07:46:50.241716 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-341c1261-a4ee-447a-b969-48ca816845d2 req-61859e90-d5e5-4b36-9e29-2a8ee3cb72e1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037808 Aug 02 07:46:50.243969 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3405/6882] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:46:50.445142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ecc1240-1bea-4fed-868a-f69c5ffc1b33 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:50.445764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2ecc1240-1bea-4fed-868a-f69c5ffc1b33 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:50.447743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:46:50.448404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:46:50.455910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ecc1240-1bea-4fed-868a-f69c5ffc1b33 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:50.456390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ecc1240-1bea-4fed-868a-f69c5ffc1b33 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:50.457188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ecc1240-1bea-4fed-868a-f69c5ffc1b33 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:50.457625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ecc1240-1bea-4fed-868a-f69c5ffc1b33 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:50.593862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2ecc1240-1bea-4fed-868a-f69c5ffc1b33 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:50.601714 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2ecc1240-1bea-4fed-868a-f69c5ffc1b33 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1364 microversion: 2.1 time: 0.160810 Aug 02 07:46:50.602347 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3478/6883] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:50 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:51.625580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f1980a2e-0e9d-4f37-9f1c-cc3ee1ff37f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:51.626341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f1980a2e-0e9d-4f37-9f1c-cc3ee1ff37f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:51.633924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1980a2e-0e9d-4f37-9f1c-cc3ee1ff37f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:51.634412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1980a2e-0e9d-4f37-9f1c-cc3ee1ff37f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:51.635218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1980a2e-0e9d-4f37-9f1c-cc3ee1ff37f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:51.635654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1980a2e-0e9d-4f37-9f1c-cc3ee1ff37f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:51.787739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f1980a2e-0e9d-4f37-9f1c-cc3ee1ff37f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:51.796569 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f1980a2e-0e9d-4f37-9f1c-cc3ee1ff37f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1364 microversion: 2.1 time: 0.176288 Aug 02 07:46:51.797217 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3406/6884] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:51 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:52.821476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fff8b7aa-f54a-4b6f-ac50-f0c484d7e47c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:52.822301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fff8b7aa-f54a-4b6f-ac50-f0c484d7e47c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:52.833318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fff8b7aa-f54a-4b6f-ac50-f0c484d7e47c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:52.833764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fff8b7aa-f54a-4b6f-ac50-f0c484d7e47c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:52.834561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fff8b7aa-f54a-4b6f-ac50-f0c484d7e47c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:52.834997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fff8b7aa-f54a-4b6f-ac50-f0c484d7e47c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:52.988765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fff8b7aa-f54a-4b6f-ac50-f0c484d7e47c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:46:52.996818 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fff8b7aa-f54a-4b6f-ac50-f0c484d7e47c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1551 microversion: 2.1 time: 0.181491 Aug 02 07:46:52.997432 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3479/6885] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:46:52 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1551 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:46:53.030551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c1e5a7af-1be7-4c47-b128-6c0c087d025a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:46:53.031336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c1e5a7af-1be7-4c47-b128-6c0c087d025a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:46:53.042382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1e5a7af-1be7-4c47-b128-6c0c087d025a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:53.043017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1e5a7af-1be7-4c47-b128-6c0c087d025a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:53.044228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1e5a7af-1be7-4c47-b128-6c0c087d025a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:53.044965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c1e5a7af-1be7-4c47-b128-6c0c087d025a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:53.127345 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c1e5a7af-1be7-4c47-b128-6c0c087d025a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105210 Aug 02 07:46:53.127963 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3407/6886] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 07:46:53 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:46:54.121089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-40d70ff1-e285-43a8-a367-36dbacf5734a req-2b725e79-6691-4562-8042-508cbd5a1af2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ab3faf-712c-41cf-aa1d-0b6dff40c9cf", "tag": "ec899310-86dc-4220-b8da-6eb1b635db1f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:46:54.132768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-40d70ff1-e285-43a8-a367-36dbacf5734a req-2b725e79-6691-4562-8042-508cbd5a1af2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:46:54.133209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-40d70ff1-e285-43a8-a367-36dbacf5734a req-2b725e79-6691-4562-8042-508cbd5a1af2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:46:54.145170 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-40d70ff1-e285-43a8-a367-36dbacf5734a req-2b725e79-6691-4562-8042-508cbd5a1af2 service nova] Creating event network-changed:ec899310-86dc-4220-b8da-6eb1b635db1f for instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf on n-h1-851337-3 Aug 02 07:46:54.150658 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-40d70ff1-e285-43a8-a367-36dbacf5734a req-2b725e79-6691-4562-8042-508cbd5a1af2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033332 Aug 02 07:46:54.151648 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3480/6887] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:47:46.190500 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:47:46.191463 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 07:47:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:48:07.196715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=11 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:48:07.197979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=48 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:48:07.202812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-978a791f-e696-4969-af5a-5285ad750664 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:48:07.205081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-978a791f-e696-4969-af5a-5285ad750664 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:07.212155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-978a791f-e696-4969-af5a-5285ad750664 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:07.212609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-978a791f-e696-4969-af5a-5285ad750664 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:07.213376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-978a791f-e696-4969-af5a-5285ad750664 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:07.213813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-978a791f-e696-4969-af5a-5285ad750664 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:07.244036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-978a791f-e696-4969-af5a-5285ad750664 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:07.250381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-978a791f-e696-4969-af5a-5285ad750664 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Old instance type m1.heat2, new instance type m1.heat {{(pid=126119) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 07:48:07.257557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-978a791f-e696-4969-af5a-5285ad750664 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:48:07.258003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-978a791f-e696-4969-af5a-5285ad750664 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:48:07.258486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-978a791f-e696-4969-af5a-5285ad750664 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:48:07.258898 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-978a791f-e696-4969-af5a-5285ad750664 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:48:07.259312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-978a791f-e696-4969-af5a-5285ad750664 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:48:07.327614 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-978a791f-e696-4969-af5a-5285ad750664 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf/action" status: 202 len: 0 microversion: 2.1 time: 0.134959 Aug 02 07:48:07.328247 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3408/6888] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:48:07 2022] POST /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:48:07.335354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=11 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:48:07.336496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:48:07.342147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3cb9d8ad-1789-4658-9087-087adec0c095 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:07.342851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3cb9d8ad-1789-4658-9087-087adec0c095 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:07.350988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cb9d8ad-1789-4658-9087-087adec0c095 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:07.351438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cb9d8ad-1789-4658-9087-087adec0c095 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:07.352383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cb9d8ad-1789-4658-9087-087adec0c095 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:07.352991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3cb9d8ad-1789-4658-9087-087adec0c095 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:07.530362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3cb9d8ad-1789-4658-9087-087adec0c095 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:07.541021 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3cb9d8ad-1789-4658-9087-087adec0c095 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1679 microversion: 2.1 time: 0.208298 Aug 02 07:48:07.541709 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3481/6889] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:07 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:08.568358 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b36f4862-852c-4741-b2c8-b739445ba025 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:08.569838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b36f4862-852c-4741-b2c8-b739445ba025 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:08.580868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b36f4862-852c-4741-b2c8-b739445ba025 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:08.581359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b36f4862-852c-4741-b2c8-b739445ba025 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:08.582184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b36f4862-852c-4741-b2c8-b739445ba025 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:08.582639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b36f4862-852c-4741-b2c8-b739445ba025 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:08.776183 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b36f4862-852c-4741-b2c8-b739445ba025 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:08.787387 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b36f4862-852c-4741-b2c8-b739445ba025 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1679 microversion: 2.1 time: 0.227116 Aug 02 07:48:08.793794 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3409/6890] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:08 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1679 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:09.809345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0d99d6fd-23da-4293-b1d1-bf9a46bffe09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:09.809952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0d99d6fd-23da-4293-b1d1-bf9a46bffe09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:09.817754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d99d6fd-23da-4293-b1d1-bf9a46bffe09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:09.818263 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d99d6fd-23da-4293-b1d1-bf9a46bffe09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:09.819047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d99d6fd-23da-4293-b1d1-bf9a46bffe09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:09.819489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0d99d6fd-23da-4293-b1d1-bf9a46bffe09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:09.969748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0d99d6fd-23da-4293-b1d1-bf9a46bffe09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:09.981825 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0d99d6fd-23da-4293-b1d1-bf9a46bffe09 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1684 microversion: 2.1 time: 0.176543 Aug 02 07:48:09.982714 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3482/6891] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:09 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:11.011924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3a9e8b8f-390b-4e40-bbf0-dc571adeda8e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:11.012571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3a9e8b8f-390b-4e40-bbf0-dc571adeda8e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:11.020022 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a9e8b8f-390b-4e40-bbf0-dc571adeda8e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:11.020475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a9e8b8f-390b-4e40-bbf0-dc571adeda8e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:11.021249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a9e8b8f-390b-4e40-bbf0-dc571adeda8e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:11.021692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a9e8b8f-390b-4e40-bbf0-dc571adeda8e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:11.170148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3a9e8b8f-390b-4e40-bbf0-dc571adeda8e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:11.179093 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3a9e8b8f-390b-4e40-bbf0-dc571adeda8e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1684 microversion: 2.1 time: 0.171274 Aug 02 07:48:11.179797 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3410/6892] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:11 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:12.201413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a814ea09-0a77-4f7e-a9d3-475faf980e20 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:12.202072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a814ea09-0a77-4f7e-a9d3-475faf980e20 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:12.210082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a814ea09-0a77-4f7e-a9d3-475faf980e20 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:12.210550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a814ea09-0a77-4f7e-a9d3-475faf980e20 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:12.211328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a814ea09-0a77-4f7e-a9d3-475faf980e20 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:12.211772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a814ea09-0a77-4f7e-a9d3-475faf980e20 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:12.353672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a814ea09-0a77-4f7e-a9d3-475faf980e20 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:12.361456 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a814ea09-0a77-4f7e-a9d3-475faf980e20 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1684 microversion: 2.1 time: 0.164118 Aug 02 07:48:12.362169 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3483/6893] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:12 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:13.390143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9f960274-6139-4f23-85f5-ae1a48d2d3c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:13.391319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9f960274-6139-4f23-85f5-ae1a48d2d3c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:13.402945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f960274-6139-4f23-85f5-ae1a48d2d3c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:13.403409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f960274-6139-4f23-85f5-ae1a48d2d3c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:13.404196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f960274-6139-4f23-85f5-ae1a48d2d3c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:13.404652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9f960274-6139-4f23-85f5-ae1a48d2d3c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:13.556640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9f960274-6139-4f23-85f5-ae1a48d2d3c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:13.564922 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9f960274-6139-4f23-85f5-ae1a48d2d3c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1684 microversion: 2.1 time: 0.181702 Aug 02 07:48:13.565501 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3411/6894] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:13 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:14.591353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e37b3ea5-108b-4102-baf1-6c200ea6da92 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:14.592382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e37b3ea5-108b-4102-baf1-6c200ea6da92 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:14.604352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e37b3ea5-108b-4102-baf1-6c200ea6da92 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:14.604969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e37b3ea5-108b-4102-baf1-6c200ea6da92 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:14.605737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e37b3ea5-108b-4102-baf1-6c200ea6da92 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:14.606235 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e37b3ea5-108b-4102-baf1-6c200ea6da92 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:14.757201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e37b3ea5-108b-4102-baf1-6c200ea6da92 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:14.769238 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e37b3ea5-108b-4102-baf1-6c200ea6da92 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1684 microversion: 2.1 time: 0.184453 Aug 02 07:48:14.770062 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3484/6895] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:14 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1684 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:15.794217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-efd5e2cf-b01a-4d04-a299-d182ca71a407 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:15.794855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-efd5e2cf-b01a-4d04-a299-d182ca71a407 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:15.801585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-efd5e2cf-b01a-4d04-a299-d182ca71a407 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:15.802188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-efd5e2cf-b01a-4d04-a299-d182ca71a407 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:15.802970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-efd5e2cf-b01a-4d04-a299-d182ca71a407 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:15.803409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-efd5e2cf-b01a-4d04-a299-d182ca71a407 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:15.943757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-efd5e2cf-b01a-4d04-a299-d182ca71a407 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:15.951630 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-efd5e2cf-b01a-4d04-a299-d182ca71a407 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1684 microversion: 2.1 time: 0.163461 Aug 02 07:48:15.952204 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3412/6896] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:15 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:16.976973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b69a333-ef8f-4bf2-83c0-6770da12c2f3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:16.977815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4b69a333-ef8f-4bf2-83c0-6770da12c2f3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:16.989000 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b69a333-ef8f-4bf2-83c0-6770da12c2f3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:16.989694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b69a333-ef8f-4bf2-83c0-6770da12c2f3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:16.991128 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b69a333-ef8f-4bf2-83c0-6770da12c2f3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:16.991861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b69a333-ef8f-4bf2-83c0-6770da12c2f3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:17.129453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4b69a333-ef8f-4bf2-83c0-6770da12c2f3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:17.151166 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4b69a333-ef8f-4bf2-83c0-6770da12c2f3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1684 microversion: 2.1 time: 0.179888 Aug 02 07:48:17.151985 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3485/6897] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:16 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1684 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:18.173558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-51d61ec7-11f6-458a-9689-5b8d6b31b3c0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:18.174212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-51d61ec7-11f6-458a-9689-5b8d6b31b3c0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:18.181683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51d61ec7-11f6-458a-9689-5b8d6b31b3c0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:18.182164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51d61ec7-11f6-458a-9689-5b8d6b31b3c0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:18.182926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51d61ec7-11f6-458a-9689-5b8d6b31b3c0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:18.183364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51d61ec7-11f6-458a-9689-5b8d6b31b3c0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:18.332003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-51d61ec7-11f6-458a-9689-5b8d6b31b3c0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:18.340053 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-51d61ec7-11f6-458a-9689-5b8d6b31b3c0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1684 microversion: 2.1 time: 0.170441 Aug 02 07:48:18.340629 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3413/6898] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:18 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:19.369241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b549a272-f42c-4826-8608-c597cfc58598 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:19.370112 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b549a272-f42c-4826-8608-c597cfc58598 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:19.378082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b549a272-f42c-4826-8608-c597cfc58598 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:19.378551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b549a272-f42c-4826-8608-c597cfc58598 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:19.379328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b549a272-f42c-4826-8608-c597cfc58598 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:19.380088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b549a272-f42c-4826-8608-c597cfc58598 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:19.518968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b549a272-f42c-4826-8608-c597cfc58598 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:19.527276 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b549a272-f42c-4826-8608-c597cfc58598 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1684 microversion: 2.1 time: 0.163428 Aug 02 07:48:19.527886 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3486/6899] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:19 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:20.551245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-80050c89-1168-47b6-b80b-25739d77970f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:20.552055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-80050c89-1168-47b6-b80b-25739d77970f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:20.562210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-80050c89-1168-47b6-b80b-25739d77970f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:20.562867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-80050c89-1168-47b6-b80b-25739d77970f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:20.563967 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-80050c89-1168-47b6-b80b-25739d77970f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:20.564743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-80050c89-1168-47b6-b80b-25739d77970f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:20.704059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-80050c89-1168-47b6-b80b-25739d77970f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:20.712373 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-80050c89-1168-47b6-b80b-25739d77970f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1684 microversion: 2.1 time: 0.166668 Aug 02 07:48:20.712958 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3414/6900] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:20 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:21.734521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6462908-eb84-4fb1-b71b-269997519733 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:21.735168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d6462908-eb84-4fb1-b71b-269997519733 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:21.744175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6462908-eb84-4fb1-b71b-269997519733 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:21.744653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6462908-eb84-4fb1-b71b-269997519733 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:21.745553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6462908-eb84-4fb1-b71b-269997519733 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:21.746029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6462908-eb84-4fb1-b71b-269997519733 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:21.959350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d6462908-eb84-4fb1-b71b-269997519733 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:21.967387 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d6462908-eb84-4fb1-b71b-269997519733 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1683 microversion: 2.1 time: 0.237063 Aug 02 07:48:21.967954 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3487/6901] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:21 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1683 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:22.191830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a25a18b5-fe0e-44dc-8e5d-6bdafb4bec01 req-fa222f8c-c033-4209-b5e2-0aac1bdd1135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ab3faf-712c-41cf-aa1d-0b6dff40c9cf", "name": "network-vif-unplugged", "status": "completed", "tag": "ec899310-86dc-4220-b8da-6eb1b635db1f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:48:22.206291 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a25a18b5-fe0e-44dc-8e5d-6bdafb4bec01 req-fa222f8c-c033-4209-b5e2-0aac1bdd1135 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:22.206778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a25a18b5-fe0e-44dc-8e5d-6bdafb4bec01 req-fa222f8c-c033-4209-b5e2-0aac1bdd1135 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:22.221178 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a25a18b5-fe0e-44dc-8e5d-6bdafb4bec01 req-fa222f8c-c033-4209-b5e2-0aac1bdd1135 service nova] Creating event network-vif-unplugged:ec899310-86dc-4220-b8da-6eb1b635db1f for instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf on n-h2-851337-3 Aug 02 07:48:22.227371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-a25a18b5-fe0e-44dc-8e5d-6bdafb4bec01 req-fa222f8c-c033-4209-b5e2-0aac1bdd1135 service nova] Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:48:22.238856 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a25a18b5-fe0e-44dc-8e5d-6bdafb4bec01 req-fa222f8c-c033-4209-b5e2-0aac1bdd1135 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051001 Aug 02 07:48:22.239671 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3415/6902] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:48:22.990594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d49d816c-93ea-4d0f-8976-09ac0226e692 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:22.991190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d49d816c-93ea-4d0f-8976-09ac0226e692 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:22.999146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d49d816c-93ea-4d0f-8976-09ac0226e692 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:22.999603 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d49d816c-93ea-4d0f-8976-09ac0226e692 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:23.000398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d49d816c-93ea-4d0f-8976-09ac0226e692 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:23.000838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d49d816c-93ea-4d0f-8976-09ac0226e692 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:23.328252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d49d816c-93ea-4d0f-8976-09ac0226e692 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:23.338617 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d49d816c-93ea-4d0f-8976-09ac0226e692 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1683 microversion: 2.1 time: 0.351743 Aug 02 07:48:23.339117 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3488/6903] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:22 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1683 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:24.261667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-cfe8592e-1038-4115-8f7e-69f2520a9b25 req-1e4f9e9f-e9db-45bc-8bef-9cf050f51837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ab3faf-712c-41cf-aa1d-0b6dff40c9cf", "tag": "ec899310-86dc-4220-b8da-6eb1b635db1f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:48:24.273038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cfe8592e-1038-4115-8f7e-69f2520a9b25 req-1e4f9e9f-e9db-45bc-8bef-9cf050f51837 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:24.273497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cfe8592e-1038-4115-8f7e-69f2520a9b25 req-1e4f9e9f-e9db-45bc-8bef-9cf050f51837 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:24.285922 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-cfe8592e-1038-4115-8f7e-69f2520a9b25 req-1e4f9e9f-e9db-45bc-8bef-9cf050f51837 service nova] Creating event network-changed:ec899310-86dc-4220-b8da-6eb1b635db1f for instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf on n-h2-851337-3 Aug 02 07:48:24.291927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-cfe8592e-1038-4115-8f7e-69f2520a9b25 req-1e4f9e9f-e9db-45bc-8bef-9cf050f51837 service nova] Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:48:24.303634 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-cfe8592e-1038-4115-8f7e-69f2520a9b25 req-1e4f9e9f-e9db-45bc-8bef-9cf050f51837 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049334 Aug 02 07:48:24.304270 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3416/6904] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:48:24.362862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-41b310d1-26ee-4b84-b155-d97c7195c024 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:24.363490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-41b310d1-26ee-4b84-b155-d97c7195c024 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:24.371118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41b310d1-26ee-4b84-b155-d97c7195c024 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:24.371620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41b310d1-26ee-4b84-b155-d97c7195c024 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:24.372532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41b310d1-26ee-4b84-b155-d97c7195c024 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:24.372970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41b310d1-26ee-4b84-b155-d97c7195c024 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:24.511979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-41b310d1-26ee-4b84-b155-d97c7195c024 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:24.520287 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-41b310d1-26ee-4b84-b155-d97c7195c024 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1681 microversion: 2.1 time: 0.161360 Aug 02 07:48:24.520997 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3489/6905] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:24 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:25.545130 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cd597caa-493e-4515-b280-7805ab017dc4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:25.545837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cd597caa-493e-4515-b280-7805ab017dc4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:25.553066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd597caa-493e-4515-b280-7805ab017dc4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:25.553504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd597caa-493e-4515-b280-7805ab017dc4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:25.554335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd597caa-493e-4515-b280-7805ab017dc4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:25.554794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cd597caa-493e-4515-b280-7805ab017dc4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:25.710909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cd597caa-493e-4515-b280-7805ab017dc4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:25.718622 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cd597caa-493e-4515-b280-7805ab017dc4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1678 microversion: 2.1 time: 0.179354 Aug 02 07:48:25.719201 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3417/6906] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:25 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:25.741234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-30d22def-918e-443e-a68a-d724bc193e58 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:48:25.741855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-30d22def-918e-443e-a68a-d724bc193e58 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:25.752229 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30d22def-918e-443e-a68a-d724bc193e58 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:25.752790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30d22def-918e-443e-a68a-d724bc193e58 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:25.753972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30d22def-918e-443e-a68a-d724bc193e58 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:25.755241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30d22def-918e-443e-a68a-d724bc193e58 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:25.799331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30d22def-918e-443e-a68a-d724bc193e58 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:25.799686 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30d22def-918e-443e-a68a-d724bc193e58 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:25.800473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30d22def-918e-443e-a68a-d724bc193e58 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:25.800905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30d22def-918e-443e-a68a-d724bc193e58 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:25.822141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-30d22def-918e-443e-a68a-d724bc193e58 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Getting quotas for project 693ef5caeeb34c95b6c5b4390df3487a. Resources: {'ram', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:48:25.827597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-30d22def-918e-443e-a68a-d724bc193e58 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Getting quotas for user abff1bade52a439093f9d43ed63fc857 and project 693ef5caeeb34c95b6c5b4390df3487a. Resources: {'ram', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:48:25.938501 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-30d22def-918e-443e-a68a-d724bc193e58 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf/action" status: 202 len: 0 microversion: 2.1 time: 0.202578 Aug 02 07:48:25.939142 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3490/6907] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:48:25 2022] POST /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:48:25.947675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7ba97f20-941f-485d-834e-2a1589821639 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:25.948371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7ba97f20-941f-485d-834e-2a1589821639 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:25.954953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ba97f20-941f-485d-834e-2a1589821639 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:25.955442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ba97f20-941f-485d-834e-2a1589821639 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:25.956214 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ba97f20-941f-485d-834e-2a1589821639 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:25.956639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7ba97f20-941f-485d-834e-2a1589821639 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:26.167978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7ba97f20-941f-485d-834e-2a1589821639 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:26.176124 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7ba97f20-941f-485d-834e-2a1589821639 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1677 microversion: 2.1 time: 0.232470 Aug 02 07:48:26.176965 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3418/6908] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:25 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:27.198324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2807a1e9-4695-40ee-ae55-a775a550648f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:27.199040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-013bdc57-c917-4aae-ae06-c80ee1145997 req-2e655678-6b57-4822-a070-38e1a749dae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ab3faf-712c-41cf-aa1d-0b6dff40c9cf", "name": "network-vif-plugged", "status": "completed", "tag": "ec899310-86dc-4220-b8da-6eb1b635db1f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:48:27.199434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2807a1e9-4695-40ee-ae55-a775a550648f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:27.207113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2807a1e9-4695-40ee-ae55-a775a550648f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:27.207415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2807a1e9-4695-40ee-ae55-a775a550648f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:27.208364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2807a1e9-4695-40ee-ae55-a775a550648f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:27.209013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2807a1e9-4695-40ee-ae55-a775a550648f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:27.211437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-013bdc57-c917-4aae-ae06-c80ee1145997 req-2e655678-6b57-4822-a070-38e1a749dae9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:27.212118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-013bdc57-c917-4aae-ae06-c80ee1145997 req-2e655678-6b57-4822-a070-38e1a749dae9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:27.225348 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-013bdc57-c917-4aae-ae06-c80ee1145997 req-2e655678-6b57-4822-a070-38e1a749dae9 service nova] Creating event network-vif-plugged:ec899310-86dc-4220-b8da-6eb1b635db1f for instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf on n-h2-851337-3 Aug 02 07:48:27.231302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-013bdc57-c917-4aae-ae06-c80ee1145997 req-2e655678-6b57-4822-a070-38e1a749dae9 service nova] Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:48:27.244300 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-013bdc57-c917-4aae-ae06-c80ee1145997 req-2e655678-6b57-4822-a070-38e1a749dae9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051087 Aug 02 07:48:27.245827 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3491/6909] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:48:27.349240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2807a1e9-4695-40ee-ae55-a775a550648f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:27.358989 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2807a1e9-4695-40ee-ae55-a775a550648f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1677 microversion: 2.1 time: 0.164781 Aug 02 07:48:27.359576 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3419/6910] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:27 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:28.382039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fa16fb7d-b439-4fac-beba-a2c04a9989f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:28.383456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fa16fb7d-b439-4fac-beba-a2c04a9989f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:28.391170 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa16fb7d-b439-4fac-beba-a2c04a9989f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:28.392411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa16fb7d-b439-4fac-beba-a2c04a9989f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:28.393408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa16fb7d-b439-4fac-beba-a2c04a9989f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:28.393864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa16fb7d-b439-4fac-beba-a2c04a9989f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:28.539622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fa16fb7d-b439-4fac-beba-a2c04a9989f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:28.547842 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fa16fb7d-b439-4fac-beba-a2c04a9989f6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1677 microversion: 2.1 time: 0.171358 Aug 02 07:48:28.548460 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3492/6911] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:28 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:29.089922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-60cb3cf4-7de7-4b69-8627-c954e18eedb9 req-bab1ecf5-dec6-482e-af01-236397b13b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ab3faf-712c-41cf-aa1d-0b6dff40c9cf", "name": "network-vif-unplugged", "status": "completed", "tag": "ec899310-86dc-4220-b8da-6eb1b635db1f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:48:29.101594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-60cb3cf4-7de7-4b69-8627-c954e18eedb9 req-bab1ecf5-dec6-482e-af01-236397b13b2b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:29.102244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-60cb3cf4-7de7-4b69-8627-c954e18eedb9 req-bab1ecf5-dec6-482e-af01-236397b13b2b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:29.118271 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-60cb3cf4-7de7-4b69-8627-c954e18eedb9 req-bab1ecf5-dec6-482e-af01-236397b13b2b service nova] Creating event network-vif-unplugged:ec899310-86dc-4220-b8da-6eb1b635db1f for instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf on n-h1-851337-3 Aug 02 07:48:29.124140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-60cb3cf4-7de7-4b69-8627-c954e18eedb9 req-bab1ecf5-dec6-482e-af01-236397b13b2b service nova] Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:48:29.135803 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-60cb3cf4-7de7-4b69-8627-c954e18eedb9 req-bab1ecf5-dec6-482e-af01-236397b13b2b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050168 Aug 02 07:48:29.136424 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3420/6912] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:48:29.570008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-06e2dbb6-3acf-449f-8f1a-49d3f4845005 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:29.570634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-06e2dbb6-3acf-449f-8f1a-49d3f4845005 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:29.578201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06e2dbb6-3acf-449f-8f1a-49d3f4845005 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:29.578684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06e2dbb6-3acf-449f-8f1a-49d3f4845005 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:29.579484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06e2dbb6-3acf-449f-8f1a-49d3f4845005 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:29.579925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06e2dbb6-3acf-449f-8f1a-49d3f4845005 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:29.719947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-06e2dbb6-3acf-449f-8f1a-49d3f4845005 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:29.728100 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-06e2dbb6-3acf-449f-8f1a-49d3f4845005 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1677 microversion: 2.1 time: 0.162372 Aug 02 07:48:29.728651 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3493/6913] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:29 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:30.756742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6e159369-e401-4be5-807f-22efa4090c44 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:30.757713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6e159369-e401-4be5-807f-22efa4090c44 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:30.767362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e159369-e401-4be5-807f-22efa4090c44 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:30.767815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e159369-e401-4be5-807f-22efa4090c44 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:30.768585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e159369-e401-4be5-807f-22efa4090c44 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:30.769019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6e159369-e401-4be5-807f-22efa4090c44 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:30.921756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6e159369-e401-4be5-807f-22efa4090c44 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:30.930029 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6e159369-e401-4be5-807f-22efa4090c44 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1677 microversion: 2.1 time: 0.182526 Aug 02 07:48:30.930602 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3421/6914] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:30 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:31.161644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-d1cfaad2-1f75-47be-92b3-5481a56169b8 req-9a308317-3a6e-40ec-8b1b-ecb0a8ef415e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ab3faf-712c-41cf-aa1d-0b6dff40c9cf", "tag": "ec899310-86dc-4220-b8da-6eb1b635db1f"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:48:31.172490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d1cfaad2-1f75-47be-92b3-5481a56169b8 req-9a308317-3a6e-40ec-8b1b-ecb0a8ef415e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:31.172912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d1cfaad2-1f75-47be-92b3-5481a56169b8 req-9a308317-3a6e-40ec-8b1b-ecb0a8ef415e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:31.185111 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-d1cfaad2-1f75-47be-92b3-5481a56169b8 req-9a308317-3a6e-40ec-8b1b-ecb0a8ef415e service nova] Creating event network-changed:ec899310-86dc-4220-b8da-6eb1b635db1f for instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf on n-h1-851337-3 Aug 02 07:48:31.190799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-d1cfaad2-1f75-47be-92b3-5481a56169b8 req-9a308317-3a6e-40ec-8b1b-ecb0a8ef415e service nova] Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:48:31.202384 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-d1cfaad2-1f75-47be-92b3-5481a56169b8 req-9a308317-3a6e-40ec-8b1b-ecb0a8ef415e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044487 Aug 02 07:48:31.202977 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3494/6915] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:48:31.952063 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-31da700e-94a2-4286-b63a-0bc54b6a131d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:31.952852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-31da700e-94a2-4286-b63a-0bc54b6a131d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:31.960914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31da700e-94a2-4286-b63a-0bc54b6a131d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:31.961374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31da700e-94a2-4286-b63a-0bc54b6a131d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:31.962199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31da700e-94a2-4286-b63a-0bc54b6a131d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:31.962645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-31da700e-94a2-4286-b63a-0bc54b6a131d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:32.102014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-31da700e-94a2-4286-b63a-0bc54b6a131d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:32.111244 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-31da700e-94a2-4286-b63a-0bc54b6a131d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1677 microversion: 2.1 time: 0.163432 Aug 02 07:48:32.112024 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3422/6916] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:31 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:33.135336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-049900da-3534-4f79-836e-c3398da4f0c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:33.136826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-049900da-3534-4f79-836e-c3398da4f0c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:33.143993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-049900da-3534-4f79-836e-c3398da4f0c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:33.144721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-049900da-3534-4f79-836e-c3398da4f0c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:33.145741 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-049900da-3534-4f79-836e-c3398da4f0c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:33.146489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-049900da-3534-4f79-836e-c3398da4f0c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:33.151558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:48:33.299328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-049900da-3534-4f79-836e-c3398da4f0c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:33.307617 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-049900da-3534-4f79-836e-c3398da4f0c7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1677 microversion: 2.1 time: 0.178226 Aug 02 07:48:33.308176 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3495/6917] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:33 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:34.333473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-419cf20d-0dc9-4b05-a3cc-7505646b0743 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:34.334134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-419cf20d-0dc9-4b05-a3cc-7505646b0743 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:34.342336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-419cf20d-0dc9-4b05-a3cc-7505646b0743 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:34.342812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-419cf20d-0dc9-4b05-a3cc-7505646b0743 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:34.343710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-419cf20d-0dc9-4b05-a3cc-7505646b0743 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:34.344169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-419cf20d-0dc9-4b05-a3cc-7505646b0743 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:34.480587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-419cf20d-0dc9-4b05-a3cc-7505646b0743 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:34.489152 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-419cf20d-0dc9-4b05-a3cc-7505646b0743 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1670 microversion: 2.1 time: 0.160170 Aug 02 07:48:34.489779 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3423/6918] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:34 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:34.510683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e6f1708d-c90b-4a5e-b1da-f4acf7f14357 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:34.511303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e6f1708d-c90b-4a5e-b1da-f4acf7f14357 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:34.518993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6f1708d-c90b-4a5e-b1da-f4acf7f14357 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:34.519462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6f1708d-c90b-4a5e-b1da-f4acf7f14357 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:34.520239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6f1708d-c90b-4a5e-b1da-f4acf7f14357 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:34.520682 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6f1708d-c90b-4a5e-b1da-f4acf7f14357 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:34.659150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e6f1708d-c90b-4a5e-b1da-f4acf7f14357 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:34.667089 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e6f1708d-c90b-4a5e-b1da-f4acf7f14357 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1670 microversion: 2.1 time: 0.160380 Aug 02 07:48:34.667695 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3496/6919] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:34 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:34.687683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2089d5ae-ec2a-4c78-ae2a-4268c678a44a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:34.688292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2089d5ae-ec2a-4c78-ae2a-4268c678a44a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:34.694754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2089d5ae-ec2a-4c78-ae2a-4268c678a44a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:34.695213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2089d5ae-ec2a-4c78-ae2a-4268c678a44a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:34.695989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2089d5ae-ec2a-4c78-ae2a-4268c678a44a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:34.696429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2089d5ae-ec2a-4c78-ae2a-4268c678a44a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:34.700672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:48:34.832065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2089d5ae-ec2a-4c78-ae2a-4268c678a44a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:34.841361 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2089d5ae-ec2a-4c78-ae2a-4268c678a44a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1670 microversion: 2.1 time: 0.157686 Aug 02 07:48:34.841964 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3424/6920] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:34 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:34.862199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2ce8a9bc-37df-4a4d-bb87-c7fb0407c1cd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:34.862726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2ce8a9bc-37df-4a4d-bb87-c7fb0407c1cd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:34.869147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ce8a9bc-37df-4a4d-bb87-c7fb0407c1cd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:34.869589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ce8a9bc-37df-4a4d-bb87-c7fb0407c1cd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:34.870404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ce8a9bc-37df-4a4d-bb87-c7fb0407c1cd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:34.870839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2ce8a9bc-37df-4a4d-bb87-c7fb0407c1cd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:34.907327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2ce8a9bc-37df-4a4d-bb87-c7fb0407c1cd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:48:34.998785 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2ce8a9bc-37df-4a4d-bb87-c7fb0407c1cd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "DELETE /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 204 len: 0 microversion: 2.1 time: 0.140316 Aug 02 07:48:34.999443 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3497/6921] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:48:34 2022] DELETE /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 07:48:35.009922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-503d8fee-172c-4880-865c-c9145539cbd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:35.010761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-503d8fee-172c-4880-865c-c9145539cbd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:35.018848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-503d8fee-172c-4880-865c-c9145539cbd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:35.019306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-503d8fee-172c-4880-865c-c9145539cbd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:35.020080 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-503d8fee-172c-4880-865c-c9145539cbd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:35.020542 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-503d8fee-172c-4880-865c-c9145539cbd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:35.166135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-503d8fee-172c-4880-865c-c9145539cbd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:35.175594 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-503d8fee-172c-4880-865c-c9145539cbd5 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1676 microversion: 2.1 time: 0.170703 Aug 02 07:48:35.176221 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3425/6922] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:35 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:36.202404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8ce5a4cc-f86b-47c6-99eb-fee8e6fe7f2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:36.203436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8ce5a4cc-f86b-47c6-99eb-fee8e6fe7f2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:36.206371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:48:36.212838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ce5a4cc-f86b-47c6-99eb-fee8e6fe7f2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:36.213296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ce5a4cc-f86b-47c6-99eb-fee8e6fe7f2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:36.214120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ce5a4cc-f86b-47c6-99eb-fee8e6fe7f2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:36.214566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8ce5a4cc-f86b-47c6-99eb-fee8e6fe7f2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:36.358615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8ce5a4cc-f86b-47c6-99eb-fee8e6fe7f2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:36.367006 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8ce5a4cc-f86b-47c6-99eb-fee8e6fe7f2b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1676 microversion: 2.1 time: 0.172050 Aug 02 07:48:36.367586 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3498/6923] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:36 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:36.715213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-0e7689a6-7fff-4f76-a2ab-23d458ef4508 req-460c2bbd-ca44-4294-a8cc-29b06aa3a168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ab3faf-712c-41cf-aa1d-0b6dff40c9cf", "name": "network-vif-plugged", "status": "completed", "tag": "ec899310-86dc-4220-b8da-6eb1b635db1f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:48:36.727622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0e7689a6-7fff-4f76-a2ab-23d458ef4508 req-460c2bbd-ca44-4294-a8cc-29b06aa3a168 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:36.728082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0e7689a6-7fff-4f76-a2ab-23d458ef4508 req-460c2bbd-ca44-4294-a8cc-29b06aa3a168 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:36.739689 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-0e7689a6-7fff-4f76-a2ab-23d458ef4508 req-460c2bbd-ca44-4294-a8cc-29b06aa3a168 service nova] Creating event network-vif-plugged:ec899310-86dc-4220-b8da-6eb1b635db1f for instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf on n-h1-851337-3 Aug 02 07:48:36.744818 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-0e7689a6-7fff-4f76-a2ab-23d458ef4508 req-460c2bbd-ca44-4294-a8cc-29b06aa3a168 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034553 Aug 02 07:48:36.745580 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3426/6924] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:48:37.390158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-20eaaf07-d65f-43a3-8f45-fba777b84d66 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:37.390787 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-20eaaf07-d65f-43a3-8f45-fba777b84d66 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:37.392959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:48:37.398979 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-20eaaf07-d65f-43a3-8f45-fba777b84d66 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:37.399437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-20eaaf07-d65f-43a3-8f45-fba777b84d66 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:37.400232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-20eaaf07-d65f-43a3-8f45-fba777b84d66 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:37.400691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-20eaaf07-d65f-43a3-8f45-fba777b84d66 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:37.475597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-20eaaf07-d65f-43a3-8f45-fba777b84d66 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:37.490559 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-20eaaf07-d65f-43a3-8f45-fba777b84d66 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 200 len: 1608 microversion: 2.1 time: 0.099963 Aug 02 07:48:37.491468 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3499/6925] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:37 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 1608 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:37.741642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-637b0fe1-f445-4baa-926b-7c389b89800a req-f2a8256e-0c72-4a9d-a60f-0de91969aebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ab3faf-712c-41cf-aa1d-0b6dff40c9cf", "name": "network-vif-deleted", "tag": "ec899310-86dc-4220-b8da-6eb1b635db1f"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:48:37.748128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=43 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:48:37.755213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-637b0fe1-f445-4baa-926b-7c389b89800a req-f2a8256e-0c72-4a9d-a60f-0de91969aebc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:37.755670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-637b0fe1-f445-4baa-926b-7c389b89800a req-f2a8256e-0c72-4a9d-a60f-0de91969aebc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:37.770113 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-637b0fe1-f445-4baa-926b-7c389b89800a req-f2a8256e-0c72-4a9d-a60f-0de91969aebc service nova] Creating event network-vif-deleted:ec899310-86dc-4220-b8da-6eb1b635db1f for instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf on n-h1-851337-3 Aug 02 07:48:37.775619 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-637b0fe1-f445-4baa-926b-7c389b89800a req-f2a8256e-0c72-4a9d-a60f-0de91969aebc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038190 Aug 02 07:48:37.778233 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3427/6926] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:48:38.513176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f0a1078-5296-472e-8d68-4918bb89aec9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:38.513800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5f0a1078-5296-472e-8d68-4918bb89aec9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:38.522368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0a1078-5296-472e-8d68-4918bb89aec9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:38.522807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0a1078-5296-472e-8d68-4918bb89aec9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:38.523615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0a1078-5296-472e-8d68-4918bb89aec9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:38.524043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5f0a1078-5296-472e-8d68-4918bb89aec9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:38.539427 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-5f0a1078-5296-472e-8d68-4918bb89aec9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f0a1078-5296-472e-8d68-4918bb89aec9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf HTTP/1.1 Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '82ab3faf-712c-41cf-aa1d-0b6dff40c9cf'} Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:48:38.541151 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:48:38.547056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:48:38.547056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:48:38.547056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:48:38.547056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:48:38.547056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:48:38.547056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:48:38.547056 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:48:38.547056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5f0a1078-5296-472e-8d68-4918bb89aec9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:48:38.547056 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5f0a1078-5296-472e-8d68-4918bb89aec9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 404 len: 111 microversion: 2.1 time: 0.033611 Aug 02 07:48:38.547056 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3500/6927] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:38 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:48:38.559754 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e79c4d78-0ed9-4286-96a2-9b1355e04a87 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:38.560652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e79c4d78-0ed9-4286-96a2-9b1355e04a87 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:38.568153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e79c4d78-0ed9-4286-96a2-9b1355e04a87 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:38.568667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e79c4d78-0ed9-4286-96a2-9b1355e04a87 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:38.569566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e79c4d78-0ed9-4286-96a2-9b1355e04a87 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:38.570053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e79c4d78-0ed9-4286-96a2-9b1355e04a87 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:38.585223 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-e79c4d78-0ed9-4286-96a2-9b1355e04a87 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e79c4d78-0ed9-4286-96a2-9b1355e04a87 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf HTTP/1.1 Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '82ab3faf-712c-41cf-aa1d-0b6dff40c9cf'} Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:48:38.586984 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:48:38.598624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:48:38.598624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:48:38.598624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:48:38.598624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:48:38.598624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:48:38.598624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:48:38.598624 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:48:38.598624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e79c4d78-0ed9-4286-96a2-9b1355e04a87 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:48:38.598624 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e79c4d78-0ed9-4286-96a2-9b1355e04a87 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 404 len: 111 microversion: 2.1 time: 0.033161 Aug 02 07:48:38.598624 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3428/6928] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:38 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:48:38.705735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-912419773", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "04888cbc-b87e-4deb-bc18-190dfb5b7a24"}], "security_groups": [{"name": "tempest-securitygroup--1251438242"}], "key_name": "tempest-keypair-1730148551", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:48:38.813690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] validate_networks() for [('04888cbc-b87e-4deb-bc18-190dfb5b7a24', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:48:39.216609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:48:39.217343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:48:39.218043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:48:39.218798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:48:39.219254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:48:39.233808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:39.234441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:39.235343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:39.235753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:39.254359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Getting quotas for project 693ef5caeeb34c95b6c5b4390df3487a. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:48:39.260773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Getting quotas for user abff1bade52a439093f9d43ed63fc857 and project 693ef5caeeb34c95b6c5b4390df3487a. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:48:39.274873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:48:39.277209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:48:39.327206 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-47382cb8-0af1-45c7-a362-eeb534e06d11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.625772 Aug 02 07:48:39.327840 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3501/6929] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:48:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:48:39.339045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a61763fc-52bc-41ca-a86d-52d6867c15c8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:39.339675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a61763fc-52bc-41ca-a86d-52d6867c15c8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:39.402907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a61763fc-52bc-41ca-a86d-52d6867c15c8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:39.411673 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a61763fc-52bc-41ca-a86d-52d6867c15c8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1238 microversion: 2.1 time: 0.076435 Aug 02 07:48:39.412241 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3429/6930] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:39 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:40.434441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-66faa10f-e9bc-4d49-850c-21392bc6a3c6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:40.435149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-66faa10f-e9bc-4d49-850c-21392bc6a3c6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:40.442426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-66faa10f-e9bc-4d49-850c-21392bc6a3c6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:40.442886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-66faa10f-e9bc-4d49-850c-21392bc6a3c6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:40.443655 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-66faa10f-e9bc-4d49-850c-21392bc6a3c6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:40.444050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-66faa10f-e9bc-4d49-850c-21392bc6a3c6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:40.524126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-66faa10f-e9bc-4d49-850c-21392bc6a3c6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:40.531716 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-66faa10f-e9bc-4d49-850c-21392bc6a3c6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1308 microversion: 2.1 time: 0.102139 Aug 02 07:48:40.532280 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3502/6931] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:40 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:41.552978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6f7a7649-791c-4517-a762-696ed26a142c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:41.553698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6f7a7649-791c-4517-a762-696ed26a142c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:41.560931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f7a7649-791c-4517-a762-696ed26a142c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:41.561463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f7a7649-791c-4517-a762-696ed26a142c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:41.562461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f7a7649-791c-4517-a762-696ed26a142c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:41.562979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f7a7649-791c-4517-a762-696ed26a142c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:41.762912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6f7a7649-791c-4517-a762-696ed26a142c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:41.771026 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6f7a7649-791c-4517-a762-696ed26a142c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1364 microversion: 2.1 time: 0.222098 Aug 02 07:48:41.771619 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3430/6932] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:41 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:41.801569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-d8b42bf4-5ece-468c-bd3d-43fe7ac3ec28 req-558ee819-e207-4a93-b70a-1fd5ec123877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b1d0cc-7dfd-430d-9940-293a3afe7737", "tag": "04f2741e-5630-417a-ba85-be8d96a5bbfe"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:48:41.813287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d8b42bf4-5ece-468c-bd3d-43fe7ac3ec28 req-558ee819-e207-4a93-b70a-1fd5ec123877 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:41.813732 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-d8b42bf4-5ece-468c-bd3d-43fe7ac3ec28 req-558ee819-e207-4a93-b70a-1fd5ec123877 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:41.825506 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-d8b42bf4-5ece-468c-bd3d-43fe7ac3ec28 req-558ee819-e207-4a93-b70a-1fd5ec123877 service nova] Creating event network-changed:04f2741e-5630-417a-ba85-be8d96a5bbfe for instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 on n-h2-851337-3 Aug 02 07:48:41.830868 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-d8b42bf4-5ece-468c-bd3d-43fe7ac3ec28 req-558ee819-e207-4a93-b70a-1fd5ec123877 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033302 Aug 02 07:48:41.832057 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3503/6933] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:48:42.796964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8bed6eb0-e5f4-412a-89ab-c0b23f219888 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:42.797567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8bed6eb0-e5f4-412a-89ab-c0b23f219888 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:42.805134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bed6eb0-e5f4-412a-89ab-c0b23f219888 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:42.805598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bed6eb0-e5f4-412a-89ab-c0b23f219888 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:42.806441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bed6eb0-e5f4-412a-89ab-c0b23f219888 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:42.806901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8bed6eb0-e5f4-412a-89ab-c0b23f219888 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:42.949506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8bed6eb0-e5f4-412a-89ab-c0b23f219888 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:42.957560 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8bed6eb0-e5f4-412a-89ab-c0b23f219888 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1364 microversion: 2.1 time: 0.166710 Aug 02 07:48:42.958179 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3431/6934] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:42 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:43.981212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-eba3141d-2ff6-4f0f-8d92-45ed9edd7a6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:43.981986 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-eba3141d-2ff6-4f0f-8d92-45ed9edd7a6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:43.988934 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eba3141d-2ff6-4f0f-8d92-45ed9edd7a6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:43.989376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eba3141d-2ff6-4f0f-8d92-45ed9edd7a6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:43.990186 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eba3141d-2ff6-4f0f-8d92-45ed9edd7a6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:43.990616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-eba3141d-2ff6-4f0f-8d92-45ed9edd7a6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:44.139272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-eba3141d-2ff6-4f0f-8d92-45ed9edd7a6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:44.148153 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-eba3141d-2ff6-4f0f-8d92-45ed9edd7a6c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1364 microversion: 2.1 time: 0.172635 Aug 02 07:48:44.148749 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3504/6935] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:43 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:45.173511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a7628d67-cc20-4bb9-b352-497043539f3b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:45.174161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a7628d67-cc20-4bb9-b352-497043539f3b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:45.180862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7628d67-cc20-4bb9-b352-497043539f3b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:45.181329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7628d67-cc20-4bb9-b352-497043539f3b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:45.182138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7628d67-cc20-4bb9-b352-497043539f3b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:45.182587 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a7628d67-cc20-4bb9-b352-497043539f3b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:45.317415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a7628d67-cc20-4bb9-b352-497043539f3b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:45.325067 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a7628d67-cc20-4bb9-b352-497043539f3b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1364 microversion: 2.1 time: 0.158547 Aug 02 07:48:45.325651 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3432/6936] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:45 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:46.348364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4949cbd4-edca-43f0-b3e4-6e9e51fa0403 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:46.349049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4949cbd4-edca-43f0-b3e4-6e9e51fa0403 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:46.357454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4949cbd4-edca-43f0-b3e4-6e9e51fa0403 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:46.358003 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4949cbd4-edca-43f0-b3e4-6e9e51fa0403 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:46.358895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4949cbd4-edca-43f0-b3e4-6e9e51fa0403 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:46.359372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4949cbd4-edca-43f0-b3e4-6e9e51fa0403 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:46.501812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4949cbd4-edca-43f0-b3e4-6e9e51fa0403 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:46.510749 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4949cbd4-edca-43f0-b3e4-6e9e51fa0403 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1364 microversion: 2.1 time: 0.167151 Aug 02 07:48:46.511348 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3505/6937] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:46 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:47.265654 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-63120b9b-1701-4d47-9bd3-e5e5c452da19 req-1556827f-3560-47b6-ac64-ec8ada6b12b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b1d0cc-7dfd-430d-9940-293a3afe7737", "name": "network-vif-plugged", "status": "completed", "tag": "04f2741e-5630-417a-ba85-be8d96a5bbfe"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:48:47.277036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-63120b9b-1701-4d47-9bd3-e5e5c452da19 req-1556827f-3560-47b6-ac64-ec8ada6b12b1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:47.277488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-63120b9b-1701-4d47-9bd3-e5e5c452da19 req-1556827f-3560-47b6-ac64-ec8ada6b12b1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:47.290491 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-63120b9b-1701-4d47-9bd3-e5e5c452da19 req-1556827f-3560-47b6-ac64-ec8ada6b12b1 service nova] Creating event network-vif-plugged:04f2741e-5630-417a-ba85-be8d96a5bbfe for instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 on n-h2-851337-3 Aug 02 07:48:47.295487 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-63120b9b-1701-4d47-9bd3-e5e5c452da19 req-1556827f-3560-47b6-ac64-ec8ada6b12b1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033954 Aug 02 07:48:47.296087 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3433/6938] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:48:47.534598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-648d8de0-4e70-4d5e-972c-dd963428e3cf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:47.535246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-648d8de0-4e70-4d5e-972c-dd963428e3cf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:47.542917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-648d8de0-4e70-4d5e-972c-dd963428e3cf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:47.543370 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-648d8de0-4e70-4d5e-972c-dd963428e3cf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:47.544141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-648d8de0-4e70-4d5e-972c-dd963428e3cf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:47.544579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-648d8de0-4e70-4d5e-972c-dd963428e3cf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:47.689791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-648d8de0-4e70-4d5e-972c-dd963428e3cf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:47.698448 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-648d8de0-4e70-4d5e-972c-dd963428e3cf tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1364 microversion: 2.1 time: 0.169106 Aug 02 07:48:47.698933 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3506/6939] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:47 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:48.726309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-41c68e3d-537f-426c-87bb-cf29f17d9d39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:48.727006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-41c68e3d-537f-426c-87bb-cf29f17d9d39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:48.734690 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41c68e3d-537f-426c-87bb-cf29f17d9d39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:48.735260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41c68e3d-537f-426c-87bb-cf29f17d9d39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:48.736046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41c68e3d-537f-426c-87bb-cf29f17d9d39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:48.736494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-41c68e3d-537f-426c-87bb-cf29f17d9d39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:48.871747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-41c68e3d-537f-426c-87bb-cf29f17d9d39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:48:48.880059 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-41c68e3d-537f-426c-87bb-cf29f17d9d39 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1551 microversion: 2.1 time: 0.161501 Aug 02 07:48:48.880636 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3434/6940] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:48:48 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:48:48.901652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c07d2d3a-991a-4910-a52d-45b7176fd6b7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:48:48.902291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c07d2d3a-991a-4910-a52d-45b7176fd6b7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:48:48.909652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c07d2d3a-991a-4910-a52d-45b7176fd6b7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:48.910114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c07d2d3a-991a-4910-a52d-45b7176fd6b7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:48.910911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c07d2d3a-991a-4910-a52d-45b7176fd6b7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:48.911345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c07d2d3a-991a-4910-a52d-45b7176fd6b7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:48.991238 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c07d2d3a-991a-4910-a52d-45b7176fd6b7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093632 Aug 02 07:48:48.991885 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3507/6941] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 07:48:48 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:48:50.318482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-d6d72c59-7f6e-4c2f-96bf-7217f481db10 req-e3b508c8-b8ae-470f-9de6-e218c022b726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b1d0cc-7dfd-430d-9940-293a3afe7737", "tag": "04f2741e-5630-417a-ba85-be8d96a5bbfe"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:48:50.323925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:48:50.330816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d6d72c59-7f6e-4c2f-96bf-7217f481db10 req-e3b508c8-b8ae-470f-9de6-e218c022b726 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:48:50.331269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d6d72c59-7f6e-4c2f-96bf-7217f481db10 req-e3b508c8-b8ae-470f-9de6-e218c022b726 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:48:50.343822 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-d6d72c59-7f6e-4c2f-96bf-7217f481db10 req-e3b508c8-b8ae-470f-9de6-e218c022b726 service nova] Creating event network-changed:04f2741e-5630-417a-ba85-be8d96a5bbfe for instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 on n-h2-851337-3 Aug 02 07:48:50.349089 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-d6d72c59-7f6e-4c2f-96bf-7217f481db10 req-e3b508c8-b8ae-470f-9de6-e218c022b726 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034554 Aug 02 07:48:50.349713 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3435/6942] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:49:24.617801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:49:24.618789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:49:24.620754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:49:24.621384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:49:24.625750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-827dd50b-6796-424a-af2a-a4c21a952829 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:24.626413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-827dd50b-6796-424a-af2a-a4c21a952829 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:24.635241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-827dd50b-6796-424a-af2a-a4c21a952829 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:24.635691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-827dd50b-6796-424a-af2a-a4c21a952829 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:24.636473 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-827dd50b-6796-424a-af2a-a4c21a952829 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:24.636910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-827dd50b-6796-424a-af2a-a4c21a952829 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:24.779127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-827dd50b-6796-424a-af2a-a4c21a952829 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:24.787189 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-827dd50b-6796-424a-af2a-a4c21a952829 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1670 microversion: 2.1 time: 0.170324 Aug 02 07:49:24.787769 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3508/6943] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:24 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:24.811691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=19 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:49:24.812485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=44 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:49:24.817449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-74d6a2ae-f4c2-4789-96d2-a0f8cd15eba2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b88ff038-b372-49a2-acc7-d7abfb9b577a"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:49:24.819950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-74d6a2ae-f4c2-4789-96d2-a0f8cd15eba2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:24.827440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74d6a2ae-f4c2-4789-96d2-a0f8cd15eba2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:24.827910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74d6a2ae-f4c2-4789-96d2-a0f8cd15eba2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:24.828784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74d6a2ae-f4c2-4789-96d2-a0f8cd15eba2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:24.829231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-74d6a2ae-f4c2-4789-96d2-a0f8cd15eba2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:25.091519 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-74d6a2ae-f4c2-4789-96d2-a0f8cd15eba2 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282104 Aug 02 07:49:25.092202 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3436/6944] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:49:24 2022] POST /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:49:26.132273 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:49:26.133133 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 07:49:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:49:27.178424 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:49:27.179017 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 07:49:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:49:35.865918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f1115863-0b4d-48d2-8646-c1a8cf425096 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:49:35.868273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f1115863-0b4d-48d2-8646-c1a8cf425096 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:35.871157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:49:35.871821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:49:35.878855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1115863-0b4d-48d2-8646-c1a8cf425096 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:35.879312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1115863-0b4d-48d2-8646-c1a8cf425096 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:35.880414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1115863-0b4d-48d2-8646-c1a8cf425096 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:35.880859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1115863-0b4d-48d2-8646-c1a8cf425096 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:35.908729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f1115863-0b4d-48d2-8646-c1a8cf425096 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:35.915188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f1115863-0b4d-48d2-8646-c1a8cf425096 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Old instance type m1.heat2, new instance type m1.heat {{(pid=126120) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 07:49:35.922293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f1115863-0b4d-48d2-8646-c1a8cf425096 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:49:35.922724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f1115863-0b4d-48d2-8646-c1a8cf425096 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:49:35.923204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f1115863-0b4d-48d2-8646-c1a8cf425096 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:49:35.923618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f1115863-0b4d-48d2-8646-c1a8cf425096 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:49:35.924033 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-f1115863-0b4d-48d2-8646-c1a8cf425096 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:49:35.994415 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f1115863-0b4d-48d2-8646-c1a8cf425096 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737/action" status: 202 len: 0 microversion: 2.1 time: 0.132398 Aug 02 07:49:35.995076 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3509/6945] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:49:35 2022] POST /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:49:36.002391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:49:36.003280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:49:36.007912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f1fa0be3-4311-404e-980a-d2d36d3bdf82 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:36.008778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f1fa0be3-4311-404e-980a-d2d36d3bdf82 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:36.017016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1fa0be3-4311-404e-980a-d2d36d3bdf82 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:36.017799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1fa0be3-4311-404e-980a-d2d36d3bdf82 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:36.018660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1fa0be3-4311-404e-980a-d2d36d3bdf82 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:36.019112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1fa0be3-4311-404e-980a-d2d36d3bdf82 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:36.236765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f1fa0be3-4311-404e-980a-d2d36d3bdf82 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:36.244865 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f1fa0be3-4311-404e-980a-d2d36d3bdf82 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1725 microversion: 2.1 time: 0.245250 Aug 02 07:49:36.245553 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3437/6946] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:35 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:37.274526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f813b21a-e1fb-45b1-a3ee-e618dffd2443 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:37.275370 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f813b21a-e1fb-45b1-a3ee-e618dffd2443 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:37.285500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f813b21a-e1fb-45b1-a3ee-e618dffd2443 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:37.285957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f813b21a-e1fb-45b1-a3ee-e618dffd2443 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:37.287035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f813b21a-e1fb-45b1-a3ee-e618dffd2443 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:37.287476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f813b21a-e1fb-45b1-a3ee-e618dffd2443 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:37.574020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f813b21a-e1fb-45b1-a3ee-e618dffd2443 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:37.582944 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f813b21a-e1fb-45b1-a3ee-e618dffd2443 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1725 microversion: 2.1 time: 0.318094 Aug 02 07:49:37.583553 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3510/6947] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:37 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1725 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:38.604249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-187bdd3f-32a9-434d-9394-a07536cd37ef tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:38.604882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-187bdd3f-32a9-434d-9394-a07536cd37ef tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:38.612065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-187bdd3f-32a9-434d-9394-a07536cd37ef tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:38.612521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-187bdd3f-32a9-434d-9394-a07536cd37ef tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:38.613287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-187bdd3f-32a9-434d-9394-a07536cd37ef tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:38.613726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-187bdd3f-32a9-434d-9394-a07536cd37ef tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:38.764834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-187bdd3f-32a9-434d-9394-a07536cd37ef tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:38.776831 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-187bdd3f-32a9-434d-9394-a07536cd37ef tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.176317 Aug 02 07:49:38.777583 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3438/6948] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:38 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:39.804096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8abdd380-158b-4cfe-9fcd-821da210f49e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:39.805082 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8abdd380-158b-4cfe-9fcd-821da210f49e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:39.816843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8abdd380-158b-4cfe-9fcd-821da210f49e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:39.817601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8abdd380-158b-4cfe-9fcd-821da210f49e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:39.818939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8abdd380-158b-4cfe-9fcd-821da210f49e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:39.819679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8abdd380-158b-4cfe-9fcd-821da210f49e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:39.969129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8abdd380-158b-4cfe-9fcd-821da210f49e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:39.982452 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8abdd380-158b-4cfe-9fcd-821da210f49e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.184525 Aug 02 07:49:39.983295 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3511/6949] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:39 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:41.006187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7e4f0094-28a7-4d86-b0af-cb755e17d114 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:41.006808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7e4f0094-28a7-4d86-b0af-cb755e17d114 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:41.014532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e4f0094-28a7-4d86-b0af-cb755e17d114 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:41.014994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e4f0094-28a7-4d86-b0af-cb755e17d114 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:41.015784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e4f0094-28a7-4d86-b0af-cb755e17d114 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:41.016245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e4f0094-28a7-4d86-b0af-cb755e17d114 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:41.157274 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7e4f0094-28a7-4d86-b0af-cb755e17d114 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:41.172321 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7e4f0094-28a7-4d86-b0af-cb755e17d114 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.170532 Aug 02 07:49:41.172940 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3439/6950] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:41 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:42.194698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2cbbab0c-694d-424c-aeff-71d3424d22d3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:42.195308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2cbbab0c-694d-424c-aeff-71d3424d22d3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:42.202915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2cbbab0c-694d-424c-aeff-71d3424d22d3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:42.203400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2cbbab0c-694d-424c-aeff-71d3424d22d3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:42.204175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2cbbab0c-694d-424c-aeff-71d3424d22d3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:42.204621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2cbbab0c-694d-424c-aeff-71d3424d22d3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:42.351285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2cbbab0c-694d-424c-aeff-71d3424d22d3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:42.360000 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2cbbab0c-694d-424c-aeff-71d3424d22d3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.169193 Aug 02 07:49:42.360623 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3512/6951] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:42 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:43.382553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-268a0622-8ea0-445a-8ab2-8743b7f060e4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:43.383194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-268a0622-8ea0-445a-8ab2-8743b7f060e4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:43.390454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-268a0622-8ea0-445a-8ab2-8743b7f060e4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:43.390914 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-268a0622-8ea0-445a-8ab2-8743b7f060e4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:43.391698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-268a0622-8ea0-445a-8ab2-8743b7f060e4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:43.392145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-268a0622-8ea0-445a-8ab2-8743b7f060e4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:43.537370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-268a0622-8ea0-445a-8ab2-8743b7f060e4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:43.548481 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-268a0622-8ea0-445a-8ab2-8743b7f060e4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.170408 Aug 02 07:49:43.549099 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3440/6952] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:43 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:44.570356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-38cbac39-b128-48c5-b5ef-4be4db1ea2fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:44.570993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-38cbac39-b128-48c5-b5ef-4be4db1ea2fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:44.578394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38cbac39-b128-48c5-b5ef-4be4db1ea2fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:44.578850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38cbac39-b128-48c5-b5ef-4be4db1ea2fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:44.579632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38cbac39-b128-48c5-b5ef-4be4db1ea2fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:44.580069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-38cbac39-b128-48c5-b5ef-4be4db1ea2fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:44.719364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-38cbac39-b128-48c5-b5ef-4be4db1ea2fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:44.727737 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-38cbac39-b128-48c5-b5ef-4be4db1ea2fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.161513 Aug 02 07:49:44.728313 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3513/6953] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:44 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:45.749649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-daeb9a88-a8fc-4bb7-9f70-13cb262fbb4c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:45.750400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-daeb9a88-a8fc-4bb7-9f70-13cb262fbb4c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:45.758756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daeb9a88-a8fc-4bb7-9f70-13cb262fbb4c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:45.759347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daeb9a88-a8fc-4bb7-9f70-13cb262fbb4c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:45.760148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daeb9a88-a8fc-4bb7-9f70-13cb262fbb4c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:45.760586 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-daeb9a88-a8fc-4bb7-9f70-13cb262fbb4c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:45.908281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-daeb9a88-a8fc-4bb7-9f70-13cb262fbb4c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:45.920284 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-daeb9a88-a8fc-4bb7-9f70-13cb262fbb4c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.174486 Aug 02 07:49:45.921021 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3441/6954] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:45 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:46.944437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b5e3631b-1d34-4f5f-8b7c-16d170765119 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:46.945162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b5e3631b-1d34-4f5f-8b7c-16d170765119 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:46.955509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5e3631b-1d34-4f5f-8b7c-16d170765119 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:46.956094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5e3631b-1d34-4f5f-8b7c-16d170765119 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:46.957105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5e3631b-1d34-4f5f-8b7c-16d170765119 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:46.957684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b5e3631b-1d34-4f5f-8b7c-16d170765119 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:47.098333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b5e3631b-1d34-4f5f-8b7c-16d170765119 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:47.106513 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b5e3631b-1d34-4f5f-8b7c-16d170765119 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.167314 Aug 02 07:49:47.107118 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3514/6955] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:46 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:48.130426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-29b80367-1a07-4296-aa1c-d2747d52c737 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:48.131065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-29b80367-1a07-4296-aa1c-d2747d52c737 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:48.140646 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29b80367-1a07-4296-aa1c-d2747d52c737 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:48.141173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29b80367-1a07-4296-aa1c-d2747d52c737 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:48.142327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29b80367-1a07-4296-aa1c-d2747d52c737 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:48.142778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-29b80367-1a07-4296-aa1c-d2747d52c737 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:48.287285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-29b80367-1a07-4296-aa1c-d2747d52c737 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:48.296212 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-29b80367-1a07-4296-aa1c-d2747d52c737 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.170661 Aug 02 07:49:48.296796 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3442/6956] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:48 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:49.322679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a954bef5-d318-434a-90b2-e8b1660a49f0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:49.323672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a954bef5-d318-434a-90b2-e8b1660a49f0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:49.333345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a954bef5-d318-434a-90b2-e8b1660a49f0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:49.333804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a954bef5-d318-434a-90b2-e8b1660a49f0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:49.334620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a954bef5-d318-434a-90b2-e8b1660a49f0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:49.335061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a954bef5-d318-434a-90b2-e8b1660a49f0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:49.479858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a954bef5-d318-434a-90b2-e8b1660a49f0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:49.488386 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a954bef5-d318-434a-90b2-e8b1660a49f0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.172646 Aug 02 07:49:49.489030 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3515/6957] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:49 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:50.521651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-78890ba8-bbf3-4d0a-bbc8-744b9ff79d23 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:50.522680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-78890ba8-bbf3-4d0a-bbc8-744b9ff79d23 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:50.533996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78890ba8-bbf3-4d0a-bbc8-744b9ff79d23 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:50.534460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78890ba8-bbf3-4d0a-bbc8-744b9ff79d23 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:50.535273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78890ba8-bbf3-4d0a-bbc8-744b9ff79d23 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:50.535724 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78890ba8-bbf3-4d0a-bbc8-744b9ff79d23 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:50.684794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-78890ba8-bbf3-4d0a-bbc8-744b9ff79d23 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:50.697270 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-78890ba8-bbf3-4d0a-bbc8-744b9ff79d23 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.181781 Aug 02 07:49:50.698103 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3443/6958] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:50 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:51.725989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-76b546ee-bcbd-4a4e-b9b2-94c36d7970a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:51.726653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-76b546ee-bcbd-4a4e-b9b2-94c36d7970a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:51.734439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76b546ee-bcbd-4a4e-b9b2-94c36d7970a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:51.734875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76b546ee-bcbd-4a4e-b9b2-94c36d7970a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:51.735785 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76b546ee-bcbd-4a4e-b9b2-94c36d7970a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:51.736242 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-76b546ee-bcbd-4a4e-b9b2-94c36d7970a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:51.889093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-76b546ee-bcbd-4a4e-b9b2-94c36d7970a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:51.898087 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-76b546ee-bcbd-4a4e-b9b2-94c36d7970a4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.176027 Aug 02 07:49:51.898771 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3516/6959] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:51 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:52.923011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d9d7a9fc-1e0f-426f-b624-05607c054aa1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:52.923609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d9d7a9fc-1e0f-426f-b624-05607c054aa1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:52.931099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9d7a9fc-1e0f-426f-b624-05607c054aa1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:52.931558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9d7a9fc-1e0f-426f-b624-05607c054aa1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:52.932324 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9d7a9fc-1e0f-426f-b624-05607c054aa1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:52.932768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9d7a9fc-1e0f-426f-b624-05607c054aa1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:53.080166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d9d7a9fc-1e0f-426f-b624-05607c054aa1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:53.088720 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d9d7a9fc-1e0f-426f-b624-05607c054aa1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.169694 Aug 02 07:49:53.089309 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3444/6960] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:52 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:54.111914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a3dce0e2-964a-47bd-9ce3-30215d549479 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:54.112526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a3dce0e2-964a-47bd-9ce3-30215d549479 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:54.120147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a3dce0e2-964a-47bd-9ce3-30215d549479 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:54.120601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a3dce0e2-964a-47bd-9ce3-30215d549479 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:54.121411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a3dce0e2-964a-47bd-9ce3-30215d549479 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:54.121852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a3dce0e2-964a-47bd-9ce3-30215d549479 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:54.276320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a3dce0e2-964a-47bd-9ce3-30215d549479 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:54.285132 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a3dce0e2-964a-47bd-9ce3-30215d549479 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.177391 Aug 02 07:49:54.285730 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3517/6961] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:54 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:55.308070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-88c9ec35-e82c-40b6-8c68-b74294fd13d6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:55.309137 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-88c9ec35-e82c-40b6-8c68-b74294fd13d6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:55.317446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88c9ec35-e82c-40b6-8c68-b74294fd13d6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:55.318002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88c9ec35-e82c-40b6-8c68-b74294fd13d6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:55.319050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88c9ec35-e82c-40b6-8c68-b74294fd13d6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:55.319371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-88c9ec35-e82c-40b6-8c68-b74294fd13d6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:55.470550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-88c9ec35-e82c-40b6-8c68-b74294fd13d6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:55.479741 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-88c9ec35-e82c-40b6-8c68-b74294fd13d6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.176448 Aug 02 07:49:55.480356 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3445/6962] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:55 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:56.506053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-49b35cd4-3652-4481-94b9-61e8bbe763c1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:56.507004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-49b35cd4-3652-4481-94b9-61e8bbe763c1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:56.514907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49b35cd4-3652-4481-94b9-61e8bbe763c1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:56.515357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49b35cd4-3652-4481-94b9-61e8bbe763c1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:56.516221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49b35cd4-3652-4481-94b9-61e8bbe763c1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:56.516658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-49b35cd4-3652-4481-94b9-61e8bbe763c1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:56.664824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-49b35cd4-3652-4481-94b9-61e8bbe763c1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:56.673575 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-49b35cd4-3652-4481-94b9-61e8bbe763c1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1730 microversion: 2.1 time: 0.174585 Aug 02 07:49:56.674206 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3518/6963] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:56 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:57.695566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-79b2f378-6527-4238-8418-56f99d20f14e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:57.696212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-79b2f378-6527-4238-8418-56f99d20f14e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:57.703386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79b2f378-6527-4238-8418-56f99d20f14e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:57.703848 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79b2f378-6527-4238-8418-56f99d20f14e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:57.704660 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79b2f378-6527-4238-8418-56f99d20f14e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:57.705082 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-79b2f378-6527-4238-8418-56f99d20f14e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:57.720041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b12aca2d-9a7d-4665-8d22-dfc4c287ec8c req-2447ac85-11fa-47ca-b9a8-a631040b961d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b1d0cc-7dfd-430d-9940-293a3afe7737", "name": "network-vif-unplugged", "status": "completed", "tag": "04f2741e-5630-417a-ba85-be8d96a5bbfe"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:49:57.733797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b12aca2d-9a7d-4665-8d22-dfc4c287ec8c req-2447ac85-11fa-47ca-b9a8-a631040b961d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:57.734542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b12aca2d-9a7d-4665-8d22-dfc4c287ec8c req-2447ac85-11fa-47ca-b9a8-a631040b961d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:57.748536 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b12aca2d-9a7d-4665-8d22-dfc4c287ec8c req-2447ac85-11fa-47ca-b9a8-a631040b961d service nova] Creating event network-vif-unplugged:04f2741e-5630-417a-ba85-be8d96a5bbfe for instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 on n-h1-851337-3 Aug 02 07:49:57.756515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-b12aca2d-9a7d-4665-8d22-dfc4c287ec8c req-2447ac85-11fa-47ca-b9a8-a631040b961d service nova] Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:49:57.769339 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b12aca2d-9a7d-4665-8d22-dfc4c287ec8c req-2447ac85-11fa-47ca-b9a8-a631040b961d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054478 Aug 02 07:49:57.770689 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3519/6964] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:49:57.845609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-79b2f378-6527-4238-8418-56f99d20f14e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:57.855261 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-79b2f378-6527-4238-8418-56f99d20f14e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1729 microversion: 2.1 time: 0.163621 Aug 02 07:49:57.856409 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3446/6965] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:57 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:58.878658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-925d36ba-6041-42aa-89c3-546f5d43a93f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:49:58.879698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-925d36ba-6041-42aa-89c3-546f5d43a93f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:49:58.886676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-925d36ba-6041-42aa-89c3-546f5d43a93f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:58.887144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-925d36ba-6041-42aa-89c3-546f5d43a93f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:58.887935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-925d36ba-6041-42aa-89c3-546f5d43a93f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:58.888374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-925d36ba-6041-42aa-89c3-546f5d43a93f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:59.028433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-925d36ba-6041-42aa-89c3-546f5d43a93f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:49:59.037054 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-925d36ba-6041-42aa-89c3-546f5d43a93f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1727 microversion: 2.1 time: 0.164005 Aug 02 07:49:59.037684 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3520/6966] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:49:58 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:49:59.843454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e41c9851-fecd-457b-83d3-9624b387ffbd req-5b3eebca-94e5-4e98-b9c3-11c3df89286c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b1d0cc-7dfd-430d-9940-293a3afe7737", "tag": "04f2741e-5630-417a-ba85-be8d96a5bbfe"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:49:59.854227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e41c9851-fecd-457b-83d3-9624b387ffbd req-5b3eebca-94e5-4e98-b9c3-11c3df89286c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:49:59.854687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e41c9851-fecd-457b-83d3-9624b387ffbd req-5b3eebca-94e5-4e98-b9c3-11c3df89286c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:49:59.866687 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e41c9851-fecd-457b-83d3-9624b387ffbd req-5b3eebca-94e5-4e98-b9c3-11c3df89286c service nova] Creating event network-changed:04f2741e-5630-417a-ba85-be8d96a5bbfe for instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 on n-h1-851337-3 Aug 02 07:49:59.872177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-e41c9851-fecd-457b-83d3-9624b387ffbd req-5b3eebca-94e5-4e98-b9c3-11c3df89286c service nova] Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:49:59.883913 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e41c9851-fecd-457b-83d3-9624b387ffbd req-5b3eebca-94e5-4e98-b9c3-11c3df89286c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098585 Aug 02 07:49:59.884540 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3447/6967] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:50:00.059317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0c394c30-0480-46c5-9958-14d448641816 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:00.059939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0c394c30-0480-46c5-9958-14d448641816 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:00.068025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c394c30-0480-46c5-9958-14d448641816 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:00.068826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c394c30-0480-46c5-9958-14d448641816 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:00.069851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c394c30-0480-46c5-9958-14d448641816 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:00.070534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c394c30-0480-46c5-9958-14d448641816 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:00.309833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0c394c30-0480-46c5-9958-14d448641816 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:00.319839 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0c394c30-0480-46c5-9958-14d448641816 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1727 microversion: 2.1 time: 0.264390 Aug 02 07:50:00.320839 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3521/6968] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:00 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1727 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:01.343764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-46c7e059-63cc-45d4-856e-fb9f3435b296 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:01.344497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-46c7e059-63cc-45d4-856e-fb9f3435b296 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:01.351259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46c7e059-63cc-45d4-856e-fb9f3435b296 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:01.351717 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46c7e059-63cc-45d4-856e-fb9f3435b296 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:01.352491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46c7e059-63cc-45d4-856e-fb9f3435b296 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:01.352934 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-46c7e059-63cc-45d4-856e-fb9f3435b296 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:01.492597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-46c7e059-63cc-45d4-856e-fb9f3435b296 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:01.501195 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-46c7e059-63cc-45d4-856e-fb9f3435b296 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1727 microversion: 2.1 time: 0.162616 Aug 02 07:50:01.501858 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3448/6969] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:01 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:02.524276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a1b9249a-16c2-47bd-993b-448da5c1e411 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:02.525095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a1b9249a-16c2-47bd-993b-448da5c1e411 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:02.533976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1b9249a-16c2-47bd-993b-448da5c1e411 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:02.533976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1b9249a-16c2-47bd-993b-448da5c1e411 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:02.534520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1b9249a-16c2-47bd-993b-448da5c1e411 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:02.534959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a1b9249a-16c2-47bd-993b-448da5c1e411 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:02.698598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a1b9249a-16c2-47bd-993b-448da5c1e411 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:02.707083 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a1b9249a-16c2-47bd-993b-448da5c1e411 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1727 microversion: 2.1 time: 0.186785 Aug 02 07:50:02.707627 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3522/6970] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:02 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:03.729097 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b30b8b90-324d-438b-a403-ed07505af1da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:03.729682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b30b8b90-324d-438b-a403-ed07505af1da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:03.737135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b30b8b90-324d-438b-a403-ed07505af1da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:03.737601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b30b8b90-324d-438b-a403-ed07505af1da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:03.738417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b30b8b90-324d-438b-a403-ed07505af1da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:03.738863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b30b8b90-324d-438b-a403-ed07505af1da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:03.877202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b30b8b90-324d-438b-a403-ed07505af1da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:03.886042 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b30b8b90-324d-438b-a403-ed07505af1da tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1727 microversion: 2.1 time: 0.161016 Aug 02 07:50:03.886600 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3449/6971] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:03 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:04.908669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-30c92331-d66d-4943-b757-034262b02f2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:04.909291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-30c92331-d66d-4943-b757-034262b02f2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:04.917030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30c92331-d66d-4943-b757-034262b02f2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:04.917475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30c92331-d66d-4943-b757-034262b02f2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:04.918444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30c92331-d66d-4943-b757-034262b02f2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:04.918748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-30c92331-d66d-4943-b757-034262b02f2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:05.070604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-30c92331-d66d-4943-b757-034262b02f2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:05.081849 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-30c92331-d66d-4943-b757-034262b02f2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1727 microversion: 2.1 time: 0.177445 Aug 02 07:50:05.082499 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3523/6972] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:04 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:06.104778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-945619ef-9085-4560-8864-1a0044f6b9b4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:06.105353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-945619ef-9085-4560-8864-1a0044f6b9b4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:06.108253 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=27 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:50:06.114197 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-945619ef-9085-4560-8864-1a0044f6b9b4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:06.114652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-945619ef-9085-4560-8864-1a0044f6b9b4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:06.115434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-945619ef-9085-4560-8864-1a0044f6b9b4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:06.115871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-945619ef-9085-4560-8864-1a0044f6b9b4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:06.118889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=77 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:50:06.258071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-945619ef-9085-4560-8864-1a0044f6b9b4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:06.266517 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-945619ef-9085-4560-8864-1a0044f6b9b4 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1727 microversion: 2.1 time: 0.165958 Aug 02 07:50:06.267084 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3450/6973] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:06 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:07.288410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-884d3a84-93fc-4545-ae8e-b7e80f2ef0b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:07.289046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-884d3a84-93fc-4545-ae8e-b7e80f2ef0b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:07.291160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=35 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:50:07.296901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-884d3a84-93fc-4545-ae8e-b7e80f2ef0b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:07.297357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-884d3a84-93fc-4545-ae8e-b7e80f2ef0b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:07.298234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-884d3a84-93fc-4545-ae8e-b7e80f2ef0b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:07.298663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-884d3a84-93fc-4545-ae8e-b7e80f2ef0b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:07.301530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:50:07.447779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-884d3a84-93fc-4545-ae8e-b7e80f2ef0b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:07.457211 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-884d3a84-93fc-4545-ae8e-b7e80f2ef0b8 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1727 microversion: 2.1 time: 0.173116 Aug 02 07:50:07.457796 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3524/6974] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:07 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:08.480386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-82347bc2-aec7-4b88-bb3d-07d3f7031a2c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:08.481033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-82347bc2-aec7-4b88-bb3d-07d3f7031a2c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:08.488998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82347bc2-aec7-4b88-bb3d-07d3f7031a2c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:08.489461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82347bc2-aec7-4b88-bb3d-07d3f7031a2c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:08.490272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82347bc2-aec7-4b88-bb3d-07d3f7031a2c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:08.490719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82347bc2-aec7-4b88-bb3d-07d3f7031a2c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:08.642795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-82347bc2-aec7-4b88-bb3d-07d3f7031a2c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:08.651401 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-82347bc2-aec7-4b88-bb3d-07d3f7031a2c tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1727 microversion: 2.1 time: 0.175051 Aug 02 07:50:08.651984 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3451/6975] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:08 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:09.674455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ead0c45b-8ed8-4ada-9ca8-917c9e733808 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:09.675561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ead0c45b-8ed8-4ada-9ca8-917c9e733808 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:09.683508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ead0c45b-8ed8-4ada-9ca8-917c9e733808 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:09.683952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ead0c45b-8ed8-4ada-9ca8-917c9e733808 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:09.684725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ead0c45b-8ed8-4ada-9ca8-917c9e733808 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:09.685134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ead0c45b-8ed8-4ada-9ca8-917c9e733808 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:09.840759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ead0c45b-8ed8-4ada-9ca8-917c9e733808 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:09.853407 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ead0c45b-8ed8-4ada-9ca8-917c9e733808 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1727 microversion: 2.1 time: 0.184133 Aug 02 07:50:09.854453 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3525/6976] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:09 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:10.875786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72acb107-9855-41e3-840c-1a10f744785a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:10.876360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-72acb107-9855-41e3-840c-1a10f744785a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:10.886811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72acb107-9855-41e3-840c-1a10f744785a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:10.887345 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72acb107-9855-41e3-840c-1a10f744785a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:10.888228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72acb107-9855-41e3-840c-1a10f744785a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:10.888885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72acb107-9855-41e3-840c-1a10f744785a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:11.040770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-72acb107-9855-41e3-840c-1a10f744785a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:11.051669 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-72acb107-9855-41e3-840c-1a10f744785a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1727 microversion: 2.1 time: 0.180042 Aug 02 07:50:11.052277 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3452/6977] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:10 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:12.073612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ac0f4e54-4098-452d-947f-d92d733ec6e6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:12.074312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ac0f4e54-4098-452d-947f-d92d733ec6e6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:12.081812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac0f4e54-4098-452d-947f-d92d733ec6e6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:12.082296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac0f4e54-4098-452d-947f-d92d733ec6e6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:12.083077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac0f4e54-4098-452d-947f-d92d733ec6e6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:12.083523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac0f4e54-4098-452d-947f-d92d733ec6e6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:12.233911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ac0f4e54-4098-452d-947f-d92d733ec6e6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:12.242914 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ac0f4e54-4098-452d-947f-d92d733ec6e6 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1727 microversion: 2.1 time: 0.173295 Aug 02 07:50:12.243524 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3526/6978] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:12 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:13.268109 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8c6d02e4-0de2-4bad-8866-f1add92db06e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:13.268685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8c6d02e4-0de2-4bad-8866-f1add92db06e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:13.275935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c6d02e4-0de2-4bad-8866-f1add92db06e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:13.276363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c6d02e4-0de2-4bad-8866-f1add92db06e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:13.277147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c6d02e4-0de2-4bad-8866-f1add92db06e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:13.277586 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8c6d02e4-0de2-4bad-8866-f1add92db06e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:13.424809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8c6d02e4-0de2-4bad-8866-f1add92db06e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:13.434008 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8c6d02e4-0de2-4bad-8866-f1add92db06e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1724 microversion: 2.1 time: 0.169806 Aug 02 07:50:13.434642 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3453/6979] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:13 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:13.456024 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ef0d866b-60b6-4265-b7be-f69d5628bcea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:50:13.456588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ef0d866b-60b6-4265-b7be-f69d5628bcea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:13.463733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef0d866b-60b6-4265-b7be-f69d5628bcea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:13.464212 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef0d866b-60b6-4265-b7be-f69d5628bcea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:13.464949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef0d866b-60b6-4265-b7be-f69d5628bcea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:13.465386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef0d866b-60b6-4265-b7be-f69d5628bcea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:13.506364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef0d866b-60b6-4265-b7be-f69d5628bcea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:13.506815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef0d866b-60b6-4265-b7be-f69d5628bcea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:13.507616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef0d866b-60b6-4265-b7be-f69d5628bcea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:13.508113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ef0d866b-60b6-4265-b7be-f69d5628bcea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:13.530034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-ef0d866b-60b6-4265-b7be-f69d5628bcea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Getting quotas for project 693ef5caeeb34c95b6c5b4390df3487a. Resources: {'ram', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:50:13.535936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-ef0d866b-60b6-4265-b7be-f69d5628bcea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Getting quotas for user abff1bade52a439093f9d43ed63fc857 and project 693ef5caeeb34c95b6c5b4390df3487a. Resources: {'ram', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:50:13.653579 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ef0d866b-60b6-4265-b7be-f69d5628bcea tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "POST /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737/action" status: 202 len: 0 microversion: 2.1 time: 0.201484 Aug 02 07:50:13.654220 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3527/6980] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:50:13 2022] POST /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:50:13.663010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d458554f-f778-4593-9e43-3a8746fe9abc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:13.663661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d458554f-f778-4593-9e43-3a8746fe9abc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:13.670182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d458554f-f778-4593-9e43-3a8746fe9abc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:13.670642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d458554f-f778-4593-9e43-3a8746fe9abc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:13.671410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d458554f-f778-4593-9e43-3a8746fe9abc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:13.671859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d458554f-f778-4593-9e43-3a8746fe9abc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:13.830046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d458554f-f778-4593-9e43-3a8746fe9abc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:13.840635 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d458554f-f778-4593-9e43-3a8746fe9abc tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.180831 Aug 02 07:50:13.852808 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3454/6981] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:13 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:14.861687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-213397a3-074f-420b-81a4-1ee6ab941a0f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:14.862425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-213397a3-074f-420b-81a4-1ee6ab941a0f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:14.871117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-213397a3-074f-420b-81a4-1ee6ab941a0f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:14.871602 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-213397a3-074f-420b-81a4-1ee6ab941a0f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:14.872380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-213397a3-074f-420b-81a4-1ee6ab941a0f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:14.872822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-213397a3-074f-420b-81a4-1ee6ab941a0f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:15.016338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-213397a3-074f-420b-81a4-1ee6ab941a0f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:15.024982 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-213397a3-074f-420b-81a4-1ee6ab941a0f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.167769 Aug 02 07:50:15.025569 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3528/6982] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:14 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:15.294749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-3b0508a3-9bef-4f44-a50f-47cee7b8d42e req-bebef8a1-e0c5-4b9e-8939-54ecf4377a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b1d0cc-7dfd-430d-9940-293a3afe7737", "name": "network-vif-plugged", "status": "completed", "tag": "04f2741e-5630-417a-ba85-be8d96a5bbfe"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:50:15.308999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3b0508a3-9bef-4f44-a50f-47cee7b8d42e req-bebef8a1-e0c5-4b9e-8939-54ecf4377a66 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:15.309781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3b0508a3-9bef-4f44-a50f-47cee7b8d42e req-bebef8a1-e0c5-4b9e-8939-54ecf4377a66 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:15.323045 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-3b0508a3-9bef-4f44-a50f-47cee7b8d42e req-bebef8a1-e0c5-4b9e-8939-54ecf4377a66 service nova] Creating event network-vif-plugged:04f2741e-5630-417a-ba85-be8d96a5bbfe for instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 on n-h1-851337-3 Aug 02 07:50:15.329466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-3b0508a3-9bef-4f44-a50f-47cee7b8d42e req-bebef8a1-e0c5-4b9e-8939-54ecf4377a66 service nova] Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:50:15.341959 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-3b0508a3-9bef-4f44-a50f-47cee7b8d42e req-bebef8a1-e0c5-4b9e-8939-54ecf4377a66 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104976 Aug 02 07:50:15.342599 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3455/6983] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:50:16.047859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0259d69f-350f-411b-a4b1-02868e797586 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:16.048611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0259d69f-350f-411b-a4b1-02868e797586 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:16.056058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0259d69f-350f-411b-a4b1-02868e797586 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:16.056510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0259d69f-350f-411b-a4b1-02868e797586 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:16.057284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0259d69f-350f-411b-a4b1-02868e797586 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:16.057724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0259d69f-350f-411b-a4b1-02868e797586 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:16.218168 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0259d69f-350f-411b-a4b1-02868e797586 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:16.226638 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0259d69f-350f-411b-a4b1-02868e797586 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.183530 Aug 02 07:50:16.227219 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3529/6984] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:16 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:17.251283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e4fb1b4f-7799-44a9-ab02-181079010e4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:17.251963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e4fb1b4f-7799-44a9-ab02-181079010e4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:17.259352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4fb1b4f-7799-44a9-ab02-181079010e4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:17.259814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4fb1b4f-7799-44a9-ab02-181079010e4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:17.260627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4fb1b4f-7799-44a9-ab02-181079010e4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:17.261075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4fb1b4f-7799-44a9-ab02-181079010e4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:17.407588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e4fb1b4f-7799-44a9-ab02-181079010e4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:17.416251 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e4fb1b4f-7799-44a9-ab02-181079010e4d tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.171087 Aug 02 07:50:17.416834 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3456/6985] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:17 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:18.439006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f6d6eb19-335d-4980-9d38-86b2641cd297 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:18.439607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f6d6eb19-335d-4980-9d38-86b2641cd297 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:18.449489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6d6eb19-335d-4980-9d38-86b2641cd297 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:18.450008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6d6eb19-335d-4980-9d38-86b2641cd297 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:18.450812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6d6eb19-335d-4980-9d38-86b2641cd297 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:18.451239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f6d6eb19-335d-4980-9d38-86b2641cd297 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:18.597268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f6d6eb19-335d-4980-9d38-86b2641cd297 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:18.617624 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f6d6eb19-335d-4980-9d38-86b2641cd297 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.182786 Aug 02 07:50:18.618723 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3530/6986] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:18 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:19.640977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4d2a1a83-a1ac-4683-b89f-dd14e0a4b94f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:19.641859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4d2a1a83-a1ac-4683-b89f-dd14e0a4b94f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:19.649443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d2a1a83-a1ac-4683-b89f-dd14e0a4b94f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:19.649946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d2a1a83-a1ac-4683-b89f-dd14e0a4b94f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:19.650815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d2a1a83-a1ac-4683-b89f-dd14e0a4b94f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:19.651228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d2a1a83-a1ac-4683-b89f-dd14e0a4b94f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:19.864645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4d2a1a83-a1ac-4683-b89f-dd14e0a4b94f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:19.873570 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4d2a1a83-a1ac-4683-b89f-dd14e0a4b94f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.236570 Aug 02 07:50:19.874207 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3457/6987] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:19 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:19.975195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-f82b39a3-c398-44b6-a701-b574b5c74e73 req-a7b4d73d-e55f-4140-b8c4-de1de18d00da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b1d0cc-7dfd-430d-9940-293a3afe7737", "name": "network-vif-unplugged", "status": "completed", "tag": "04f2741e-5630-417a-ba85-be8d96a5bbfe"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:50:19.986269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f82b39a3-c398-44b6-a701-b574b5c74e73 req-a7b4d73d-e55f-4140-b8c4-de1de18d00da service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:19.987484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f82b39a3-c398-44b6-a701-b574b5c74e73 req-a7b4d73d-e55f-4140-b8c4-de1de18d00da service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:20.003044 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f82b39a3-c398-44b6-a701-b574b5c74e73 req-a7b4d73d-e55f-4140-b8c4-de1de18d00da service nova] Creating event network-vif-unplugged:04f2741e-5630-417a-ba85-be8d96a5bbfe for instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 on n-h2-851337-3 Aug 02 07:50:20.009563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-f82b39a3-c398-44b6-a701-b574b5c74e73 req-a7b4d73d-e55f-4140-b8c4-de1de18d00da service nova] Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:50:20.023238 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-f82b39a3-c398-44b6-a701-b574b5c74e73 req-a7b4d73d-e55f-4140-b8c4-de1de18d00da service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138026 Aug 02 07:50:20.024135 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3531/6988] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:50:20.903978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f40b3634-73aa-4e96-9a43-ef09b65bb45a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:20.908217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f40b3634-73aa-4e96-9a43-ef09b65bb45a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:20.919915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f40b3634-73aa-4e96-9a43-ef09b65bb45a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:20.920594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f40b3634-73aa-4e96-9a43-ef09b65bb45a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:20.931089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f40b3634-73aa-4e96-9a43-ef09b65bb45a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:20.932265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f40b3634-73aa-4e96-9a43-ef09b65bb45a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:21.100385 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f40b3634-73aa-4e96-9a43-ef09b65bb45a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:21.110196 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f40b3634-73aa-4e96-9a43-ef09b65bb45a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.210364 Aug 02 07:50:21.110796 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3458/6989] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:20 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:22.045648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-17f6d1d2-bba4-4c33-8c33-e9a12db056f2 req-988f3cf2-3d6c-49f3-a497-6f11b8eb1b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b1d0cc-7dfd-430d-9940-293a3afe7737", "tag": "04f2741e-5630-417a-ba85-be8d96a5bbfe"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:50:22.062248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-17f6d1d2-bba4-4c33-8c33-e9a12db056f2 req-988f3cf2-3d6c-49f3-a497-6f11b8eb1b94 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:22.062818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-17f6d1d2-bba4-4c33-8c33-e9a12db056f2 req-988f3cf2-3d6c-49f3-a497-6f11b8eb1b94 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:22.077563 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-17f6d1d2-bba4-4c33-8c33-e9a12db056f2 req-988f3cf2-3d6c-49f3-a497-6f11b8eb1b94 service nova] Creating event network-changed:04f2741e-5630-417a-ba85-be8d96a5bbfe for instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 on n-h2-851337-3 Aug 02 07:50:22.085412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-17f6d1d2-bba4-4c33-8c33-e9a12db056f2 req-988f3cf2-3d6c-49f3-a497-6f11b8eb1b94 service nova] Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 07:50:22.100136 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-17f6d1d2-bba4-4c33-8c33-e9a12db056f2 req-988f3cf2-3d6c-49f3-a497-6f11b8eb1b94 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060091 Aug 02 07:50:22.101160 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3532/6990] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:50:22.143453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dfac15f3-6f3c-4ee9-8a43-3252916f969a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:22.147461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dfac15f3-6f3c-4ee9-8a43-3252916f969a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:22.161381 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfac15f3-6f3c-4ee9-8a43-3252916f969a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:22.162364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfac15f3-6f3c-4ee9-8a43-3252916f969a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:22.164398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfac15f3-6f3c-4ee9-8a43-3252916f969a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:22.165118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dfac15f3-6f3c-4ee9-8a43-3252916f969a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:22.539234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dfac15f3-6f3c-4ee9-8a43-3252916f969a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:22.555801 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dfac15f3-6f3c-4ee9-8a43-3252916f969a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.426421 Aug 02 07:50:22.557031 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3459/6991] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:22 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:23.587952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:50:23.595501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-574f013e-2fb4-4569-bb9d-d9aca81b994b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:23.596862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-574f013e-2fb4-4569-bb9d-d9aca81b994b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:23.605930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-574f013e-2fb4-4569-bb9d-d9aca81b994b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:23.606384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-574f013e-2fb4-4569-bb9d-d9aca81b994b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:23.607207 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-574f013e-2fb4-4569-bb9d-d9aca81b994b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:23.607775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-574f013e-2fb4-4569-bb9d-d9aca81b994b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:23.788314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-574f013e-2fb4-4569-bb9d-d9aca81b994b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:23.798853 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-574f013e-2fb4-4569-bb9d-d9aca81b994b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.215015 Aug 02 07:50:23.799459 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3533/6992] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:23 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:24.823070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-30a8c70f-1f27-4c99-8b0b-f7bb8bc167f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:24.824305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-30a8c70f-1f27-4c99-8b0b-f7bb8bc167f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:24.832829 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30a8c70f-1f27-4c99-8b0b-f7bb8bc167f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:24.833288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30a8c70f-1f27-4c99-8b0b-f7bb8bc167f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:24.834116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30a8c70f-1f27-4c99-8b0b-f7bb8bc167f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:24.834559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-30a8c70f-1f27-4c99-8b0b-f7bb8bc167f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:24.980452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-30a8c70f-1f27-4c99-8b0b-f7bb8bc167f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:24.992629 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-30a8c70f-1f27-4c99-8b0b-f7bb8bc167f7 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.174502 Aug 02 07:50:24.997280 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3460/6993] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:24 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:26.021034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c766646a-f980-4959-973b-aeb66dc565df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:26.021747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c766646a-f980-4959-973b-aeb66dc565df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:26.029270 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c766646a-f980-4959-973b-aeb66dc565df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:26.029720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c766646a-f980-4959-973b-aeb66dc565df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:26.030612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c766646a-f980-4959-973b-aeb66dc565df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:26.031039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c766646a-f980-4959-973b-aeb66dc565df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:26.185723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c766646a-f980-4959-973b-aeb66dc565df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:26.195360 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c766646a-f980-4959-973b-aeb66dc565df tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.178354 Aug 02 07:50:26.195978 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3534/6994] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:26 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:27.224179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6702de4c-7594-417b-9438-46fd5e9f9615 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:27.224895 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6702de4c-7594-417b-9438-46fd5e9f9615 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:27.232994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6702de4c-7594-417b-9438-46fd5e9f9615 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:27.233461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6702de4c-7594-417b-9438-46fd5e9f9615 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:27.234326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6702de4c-7594-417b-9438-46fd5e9f9615 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:27.234906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6702de4c-7594-417b-9438-46fd5e9f9615 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:27.454303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6702de4c-7594-417b-9438-46fd5e9f9615 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:27.466359 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6702de4c-7594-417b-9438-46fd5e9f9615 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.247963 Aug 02 07:50:27.467886 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3461/6995] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:27 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:28.502467 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-22539e30-3a4c-4407-90bf-1de8b0d8d953 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:28.503040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-22539e30-3a4c-4407-90bf-1de8b0d8d953 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:28.511104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22539e30-3a4c-4407-90bf-1de8b0d8d953 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:28.511559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22539e30-3a4c-4407-90bf-1de8b0d8d953 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:28.512334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22539e30-3a4c-4407-90bf-1de8b0d8d953 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:28.512772 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22539e30-3a4c-4407-90bf-1de8b0d8d953 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:28.675310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-22539e30-3a4c-4407-90bf-1de8b0d8d953 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:28.685530 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-22539e30-3a4c-4407-90bf-1de8b0d8d953 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.187330 Aug 02 07:50:28.686195 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3535/6996] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:28 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:29.708870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a5edd1c2-bb7c-45f3-805a-584f8bb2fe57 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:29.709719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a5edd1c2-bb7c-45f3-805a-584f8bb2fe57 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:29.716766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5edd1c2-bb7c-45f3-805a-584f8bb2fe57 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:29.717338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5edd1c2-bb7c-45f3-805a-584f8bb2fe57 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:29.718606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5edd1c2-bb7c-45f3-805a-584f8bb2fe57 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:29.719172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5edd1c2-bb7c-45f3-805a-584f8bb2fe57 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:29.867268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a5edd1c2-bb7c-45f3-805a-584f8bb2fe57 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:29.875937 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a5edd1c2-bb7c-45f3-805a-584f8bb2fe57 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.171220 Aug 02 07:50:29.876525 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3462/6997] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:29 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:30.898260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e63b38b6-10bd-4e42-9b64-43d5abcd9f06 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:30.898869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e63b38b6-10bd-4e42-9b64-43d5abcd9f06 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:30.906319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e63b38b6-10bd-4e42-9b64-43d5abcd9f06 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:30.906890 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e63b38b6-10bd-4e42-9b64-43d5abcd9f06 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:30.907632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e63b38b6-10bd-4e42-9b64-43d5abcd9f06 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:30.908071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e63b38b6-10bd-4e42-9b64-43d5abcd9f06 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:31.041909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e63b38b6-10bd-4e42-9b64-43d5abcd9f06 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:31.050488 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e63b38b6-10bd-4e42-9b64-43d5abcd9f06 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.156250 Aug 02 07:50:31.051068 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3536/6998] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:30 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:32.072941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-36593755-3211-4542-b6ad-b4fffca17817 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:32.073572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-36593755-3211-4542-b6ad-b4fffca17817 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:32.081338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36593755-3211-4542-b6ad-b4fffca17817 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:32.081827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36593755-3211-4542-b6ad-b4fffca17817 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:32.082629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36593755-3211-4542-b6ad-b4fffca17817 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:32.083077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-36593755-3211-4542-b6ad-b4fffca17817 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:32.246643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-36593755-3211-4542-b6ad-b4fffca17817 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:32.256041 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-36593755-3211-4542-b6ad-b4fffca17817 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.187163 Aug 02 07:50:32.256625 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3463/6999] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:32 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:50:33.278919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0914193f-7e7e-49f6-8b08-fd4aee68e8dd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:33.279574 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0914193f-7e7e-49f6-8b08-fd4aee68e8dd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:33.289972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0914193f-7e7e-49f6-8b08-fd4aee68e8dd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:33.290527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0914193f-7e7e-49f6-8b08-fd4aee68e8dd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:33.291743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0914193f-7e7e-49f6-8b08-fd4aee68e8dd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:33.292426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0914193f-7e7e-49f6-8b08-fd4aee68e8dd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:33.493480 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0914193f-7e7e-49f6-8b08-fd4aee68e8dd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:33.509332 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0914193f-7e7e-49f6-8b08-fd4aee68e8dd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1723 microversion: 2.1 time: 0.234454 Aug 02 07:50:33.510008 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3537/7000] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:33 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:50:34.532601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3f723648-c752-4cc8-be2b-e2c11758ab7a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:34.533145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3f723648-c752-4cc8-be2b-e2c11758ab7a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:34.540673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f723648-c752-4cc8-be2b-e2c11758ab7a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:34.541135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f723648-c752-4cc8-be2b-e2c11758ab7a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:34.541980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f723648-c752-4cc8-be2b-e2c11758ab7a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:34.542431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3f723648-c752-4cc8-be2b-e2c11758ab7a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:34.684036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3f723648-c752-4cc8-be2b-e2c11758ab7a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:34.698244 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3f723648-c752-4cc8-be2b-e2c11758ab7a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1716 microversion: 2.1 time: 0.169747 Aug 02 07:50:34.698838 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3464/7001] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:34 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:34.721539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-879348b6-96e5-4bec-958e-f325ef245aeb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:34.722299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-879348b6-96e5-4bec-958e-f325ef245aeb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:34.732683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-879348b6-96e5-4bec-958e-f325ef245aeb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:34.733331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-879348b6-96e5-4bec-958e-f325ef245aeb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:34.734546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-879348b6-96e5-4bec-958e-f325ef245aeb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:34.735296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-879348b6-96e5-4bec-958e-f325ef245aeb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:34.750912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:50:34.891949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-879348b6-96e5-4bec-958e-f325ef245aeb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:34.900444 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-879348b6-96e5-4bec-958e-f325ef245aeb tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1716 microversion: 2.1 time: 0.183864 Aug 02 07:50:34.901069 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3538/7002] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:34 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1716 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:34.920815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-741c243a-3f6a-45c8-bdf3-1ae7031ddd14 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:34.921444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-741c243a-3f6a-45c8-bdf3-1ae7031ddd14 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:34.928047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-741c243a-3f6a-45c8-bdf3-1ae7031ddd14 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:34.928511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-741c243a-3f6a-45c8-bdf3-1ae7031ddd14 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:34.929284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-741c243a-3f6a-45c8-bdf3-1ae7031ddd14 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:34.929731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-741c243a-3f6a-45c8-bdf3-1ae7031ddd14 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:35.073477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-741c243a-3f6a-45c8-bdf3-1ae7031ddd14 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:35.082385 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-741c243a-3f6a-45c8-bdf3-1ae7031ddd14 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1716 microversion: 2.1 time: 0.165493 Aug 02 07:50:35.083022 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3465/7003] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:34 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:35.103259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e6f01225-54fd-4f97-ad3b-4e532e42cb1f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:35.103760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e6f01225-54fd-4f97-ad3b-4e532e42cb1f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:35.110580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6f01225-54fd-4f97-ad3b-4e532e42cb1f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:35.111023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6f01225-54fd-4f97-ad3b-4e532e42cb1f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:35.111797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6f01225-54fd-4f97-ad3b-4e532e42cb1f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:35.112232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e6f01225-54fd-4f97-ad3b-4e532e42cb1f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:35.140336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e6f01225-54fd-4f97-ad3b-4e532e42cb1f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:50:35.232135 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e6f01225-54fd-4f97-ad3b-4e532e42cb1f tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "DELETE /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 204 len: 0 microversion: 2.1 time: 0.132553 Aug 02 07:50:35.232906 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3539/7004] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:50:35 2022] DELETE /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:50:35.243461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7945e02c-8610-4651-9d48-ae0c58ff760b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:35.244372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7945e02c-8610-4651-9d48-ae0c58ff760b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:35.256731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7945e02c-8610-4651-9d48-ae0c58ff760b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:35.257473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7945e02c-8610-4651-9d48-ae0c58ff760b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:35.258837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7945e02c-8610-4651-9d48-ae0c58ff760b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:35.259618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7945e02c-8610-4651-9d48-ae0c58ff760b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:35.405357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7945e02c-8610-4651-9d48-ae0c58ff760b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:35.413671 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7945e02c-8610-4651-9d48-ae0c58ff760b tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1722 microversion: 2.1 time: 0.175583 Aug 02 07:50:35.414269 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3466/7005] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:35 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:50:35.951133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-733cafd8-863d-4c29-82e5-c5d9a63b7d4b req-3eac29f5-28e6-4332-85c7-78d8842c7c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b1d0cc-7dfd-430d-9940-293a3afe7737", "name": "network-vif-plugged", "status": "completed", "tag": "04f2741e-5630-417a-ba85-be8d96a5bbfe"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:50:35.966481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-733cafd8-863d-4c29-82e5-c5d9a63b7d4b req-3eac29f5-28e6-4332-85c7-78d8842c7c23 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:35.966756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-733cafd8-863d-4c29-82e5-c5d9a63b7d4b req-3eac29f5-28e6-4332-85c7-78d8842c7c23 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:35.981454 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-733cafd8-863d-4c29-82e5-c5d9a63b7d4b req-3eac29f5-28e6-4332-85c7-78d8842c7c23 service nova] Creating event network-vif-plugged:04f2741e-5630-417a-ba85-be8d96a5bbfe for instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 on n-h2-851337-3 Aug 02 07:50:35.986745 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-733cafd8-863d-4c29-82e5-c5d9a63b7d4b req-3eac29f5-28e6-4332-85c7-78d8842c7c23 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041121 Aug 02 07:50:35.987835 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3540/7006] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:50:36.439719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dcf4e598-8a5f-452d-be78-c820c5b32b5a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:36.440344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dcf4e598-8a5f-452d-be78-c820c5b32b5a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:36.443728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=34 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:50:36.449694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dcf4e598-8a5f-452d-be78-c820c5b32b5a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:36.450414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dcf4e598-8a5f-452d-be78-c820c5b32b5a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:36.451679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dcf4e598-8a5f-452d-be78-c820c5b32b5a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:36.452391 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dcf4e598-8a5f-452d-be78-c820c5b32b5a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:36.459051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=100 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:50:36.615832 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dcf4e598-8a5f-452d-be78-c820c5b32b5a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:36.624646 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dcf4e598-8a5f-452d-be78-c820c5b32b5a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1722 microversion: 2.1 time: 0.189120 Aug 02 07:50:36.625318 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3467/7007] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:36 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:37.650240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-08d73752-9d71-485b-ac79-f67bed0db285 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:37.651627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-08d73752-9d71-485b-ac79-f67bed0db285 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:37.655040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:50:37.667566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08d73752-9d71-485b-ac79-f67bed0db285 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:37.668680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08d73752-9d71-485b-ac79-f67bed0db285 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:37.670111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08d73752-9d71-485b-ac79-f67bed0db285 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:37.670875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-08d73752-9d71-485b-ac79-f67bed0db285 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:37.776543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-08d73752-9d71-485b-ac79-f67bed0db285 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:37.789227 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-08d73752-9d71-485b-ac79-f67bed0db285 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1654 microversion: 2.1 time: 0.146134 Aug 02 07:50:37.790670 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3541/7008] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:37 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1654 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:50:37.862117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-61e39871-09fc-49f2-b723-04bdaac84ae3 req-7e05278e-f890-44b0-b8aa-3c6bbb6c08f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b1d0cc-7dfd-430d-9940-293a3afe7737", "name": "network-vif-deleted", "tag": "04f2741e-5630-417a-ba85-be8d96a5bbfe"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:50:37.875566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-61e39871-09fc-49f2-b723-04bdaac84ae3 req-7e05278e-f890-44b0-b8aa-3c6bbb6c08f9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:37.876304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-61e39871-09fc-49f2-b723-04bdaac84ae3 req-7e05278e-f890-44b0-b8aa-3c6bbb6c08f9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:37.903902 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-61e39871-09fc-49f2-b723-04bdaac84ae3 req-7e05278e-f890-44b0-b8aa-3c6bbb6c08f9 service nova] Creating event network-vif-deleted:04f2741e-5630-417a-ba85-be8d96a5bbfe for instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 on n-h2-851337-3 Aug 02 07:50:37.919384 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-61e39871-09fc-49f2-b723-04bdaac84ae3 req-7e05278e-f890-44b0-b8aa-3c6bbb6c08f9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069036 Aug 02 07:50:37.920005 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3468/7009] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:50:38.822555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3754f7e6-6129-4a81-81fb-1785cb1a8032 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:38.823923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3754f7e6-6129-4a81-81fb-1785cb1a8032 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:38.832365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3754f7e6-6129-4a81-81fb-1785cb1a8032 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:38.832938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3754f7e6-6129-4a81-81fb-1785cb1a8032 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:38.834003 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3754f7e6-6129-4a81-81fb-1785cb1a8032 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:38.834510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3754f7e6-6129-4a81-81fb-1785cb1a8032 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:38.937939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3754f7e6-6129-4a81-81fb-1785cb1a8032 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:38.947038 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3754f7e6-6129-4a81-81fb-1785cb1a8032 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1369 microversion: 2.1 time: 0.128441 Aug 02 07:50:38.947559 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3542/7010] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:38 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1369 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:39.981889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c249bfe9-e90c-454f-ab8b-5412032c8a22 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:39.982669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c249bfe9-e90c-454f-ab8b-5412032c8a22 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:39.990056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c249bfe9-e90c-454f-ab8b-5412032c8a22 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:39.990550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c249bfe9-e90c-454f-ab8b-5412032c8a22 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:39.991394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c249bfe9-e90c-454f-ab8b-5412032c8a22 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:39.991870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c249bfe9-e90c-454f-ab8b-5412032c8a22 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:40.066937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c249bfe9-e90c-454f-ab8b-5412032c8a22 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:40.077364 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c249bfe9-e90c-454f-ab8b-5412032c8a22 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1369 microversion: 2.1 time: 0.101017 Aug 02 07:50:40.078361 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3469/7011] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:39 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:41.099853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2befc53b-4eab-431a-aa38-7b28826b99b3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:41.100362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2befc53b-4eab-431a-aa38-7b28826b99b3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:41.107585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2befc53b-4eab-431a-aa38-7b28826b99b3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:41.107995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2befc53b-4eab-431a-aa38-7b28826b99b3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:41.108806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2befc53b-4eab-431a-aa38-7b28826b99b3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:41.109227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2befc53b-4eab-431a-aa38-7b28826b99b3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:41.178169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2befc53b-4eab-431a-aa38-7b28826b99b3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:41.186875 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2befc53b-4eab-431a-aa38-7b28826b99b3 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1369 microversion: 2.1 time: 0.091221 Aug 02 07:50:41.187556 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3543/7012] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:41 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:50:42.209028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e644f924-54d7-4750-bd62-75543ba9dc2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:42.209817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e644f924-54d7-4750-bd62-75543ba9dc2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:42.217839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e644f924-54d7-4750-bd62-75543ba9dc2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:42.218375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e644f924-54d7-4750-bd62-75543ba9dc2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:42.219293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e644f924-54d7-4750-bd62-75543ba9dc2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:42.219742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e644f924-54d7-4750-bd62-75543ba9dc2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:42.292272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e644f924-54d7-4750-bd62-75543ba9dc2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abff1bade52a439093f9d43ed63fc857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693ef5caeeb34c95b6c5b4390df3487a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:42.302963 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e644f924-54d7-4750-bd62-75543ba9dc2e tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 200 len: 1369 microversion: 2.1 time: 0.098158 Aug 02 07:50:42.303629 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3470/7013] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:42 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:43.326306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9d57ce13-2867-49d3-8132-4273d47c98ee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:43.326915 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9d57ce13-2867-49d3-8132-4273d47c98ee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:43.335578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d57ce13-2867-49d3-8132-4273d47c98ee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:43.336025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d57ce13-2867-49d3-8132-4273d47c98ee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:43.336784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d57ce13-2867-49d3-8132-4273d47c98ee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:43.337213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d57ce13-2867-49d3-8132-4273d47c98ee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:43.351791 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-9d57ce13-2867-49d3-8132-4273d47c98ee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9d57ce13-2867-49d3-8132-4273d47c98ee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 HTTP/1.1 Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '75b1d0cc-7dfd-430d-9940-293a3afe7737'} Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:43.353468 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:43.357005 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:43.357005 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:43.357005 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:43.357005 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:50:43.357005 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:50:43.357005 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:43.357005 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:43.357005 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9d57ce13-2867-49d3-8132-4273d47c98ee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:50:43.357005 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9d57ce13-2867-49d3-8132-4273d47c98ee tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 404 len: 111 microversion: 2.1 time: 0.034045 Aug 02 07:50:43.357005 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3544/7014] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:43 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:50:43.424460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8f1ef190-b7fc-4bcc-b557-7096fb8b2de1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:43.426677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8f1ef190-b7fc-4bcc-b557-7096fb8b2de1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:43.434362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f1ef190-b7fc-4bcc-b557-7096fb8b2de1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:43.434819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f1ef190-b7fc-4bcc-b557-7096fb8b2de1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:43.435599 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f1ef190-b7fc-4bcc-b557-7096fb8b2de1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:43.436033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f1ef190-b7fc-4bcc-b557-7096fb8b2de1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:43.450058 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-8f1ef190-b7fc-4bcc-b557-7096fb8b2de1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8f1ef190-b7fc-4bcc-b557-7096fb8b2de1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737/os-volume_attachments HTTP/1.1 Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'server_id': '75b1d0cc-7dfd-430d-9940-293a3afe7737'} Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:50:43.451861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:50:43.455592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:43.455592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:43.455592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:43.455592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:43.455592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:43.455592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:43.455592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:43.455592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:50:43.455592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:50:43.455592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:43.455592 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:43.455592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8f1ef190-b7fc-4bcc-b557-7096fb8b2de1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:50:43.455592 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8f1ef190-b7fc-4bcc-b557-7096fb8b2de1 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033017 Aug 02 07:50:43.455592 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3471/7015] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:50:43 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:50:46.825038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44250217-b350-4424-bae4-8fe36350cb11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:46.825595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-44250217-b350-4424-bae4-8fe36350cb11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:46.833853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44250217-b350-4424-bae4-8fe36350cb11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:46.834349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44250217-b350-4424-bae4-8fe36350cb11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:46.835136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44250217-b350-4424-bae4-8fe36350cb11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:46.835579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44250217-b350-4424-bae4-8fe36350cb11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:46.850761 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-44250217-b350-4424-bae4-8fe36350cb11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44250217-b350-4424-bae4-8fe36350cb11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 HTTP/1.1 Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '75b1d0cc-7dfd-430d-9940-293a3afe7737'} Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:50:46.852364 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:50:46.855347 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:46.855347 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.855347 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:46.855347 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.855347 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:46.855347 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:46.855347 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:46.855347 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:50:46.855347 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:50:46.855347 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:46.855347 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.855347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44250217-b350-4424-bae4-8fe36350cb11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:50:46.855347 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-44250217-b350-4424-bae4-8fe36350cb11 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "DELETE /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 404 len: 111 microversion: 2.1 time: 0.032932 Aug 02 07:50:46.855347 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3545/7016] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:50:46 2022] DELETE /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:50:46.863610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-418d8e97-8cd7-4675-8141-2c4cef8cd5d0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:46.864225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-418d8e97-8cd7-4675-8141-2c4cef8cd5d0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 75b1d0cc-7dfd-430d-9940-293a3afe7737] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:46.870825 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-418d8e97-8cd7-4675-8141-2c4cef8cd5d0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:46.871281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-418d8e97-8cd7-4675-8141-2c4cef8cd5d0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:46.872045 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-418d8e97-8cd7-4675-8141-2c4cef8cd5d0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:46.872486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-418d8e97-8cd7-4675-8141-2c4cef8cd5d0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:46.886900 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-418d8e97-8cd7-4675-8141-2c4cef8cd5d0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-418d8e97-8cd7-4675-8141-2c4cef8cd5d0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 HTTP/1.1 Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '75b1d0cc-7dfd-430d-9940-293a3afe7737'} Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:46.888615 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.893741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:46.893741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:46.893741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:46.893741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:50:46.893741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:50:46.893741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. Aug 02 07:50:46.893741 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.893741 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-418d8e97-8cd7-4675-8141-2c4cef8cd5d0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 75b1d0cc-7dfd-430d-9940-293a3afe7737 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:50:46.893741 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-418d8e97-8cd7-4675-8141-2c4cef8cd5d0 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737" status: 404 len: 111 microversion: 2.1 time: 0.031054 Aug 02 07:50:46.893741 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3472/7017] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:46 2022] GET /compute/v2.1/servers/75b1d0cc-7dfd-430d-9940-293a3afe7737 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:50:46.904165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d496eeb3-2899-4e07-bc22-1d5e7888eb21 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:46.904667 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d496eeb3-2899-4e07-bc22-1d5e7888eb21 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:46.911594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d496eeb3-2899-4e07-bc22-1d5e7888eb21 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:46.912022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d496eeb3-2899-4e07-bc22-1d5e7888eb21 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:46.912804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d496eeb3-2899-4e07-bc22-1d5e7888eb21 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:46.913241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d496eeb3-2899-4e07-bc22-1d5e7888eb21 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:46.927612 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-d496eeb3-2899-4e07-bc22-1d5e7888eb21 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d496eeb3-2899-4e07-bc22-1d5e7888eb21 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf HTTP/1.1 Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '82ab3faf-712c-41cf-aa1d-0b6dff40c9cf'} Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:50:46.929204 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:50:46.932801 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:50:46.932801 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.932801 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:46.932801 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.932801 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:46.932801 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:46.932801 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:46.932801 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:50:46.932801 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:50:46.932801 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:50:46.932801 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.932801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d496eeb3-2899-4e07-bc22-1d5e7888eb21 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:50:46.932801 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d496eeb3-2899-4e07-bc22-1d5e7888eb21 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "DELETE /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 404 len: 111 microversion: 2.1 time: 0.034034 Aug 02 07:50:46.934786 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3546/7018] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:50:46 2022] DELETE /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:50:46.939719 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6954bb36-3d6c-4517-a874-c41c4b44194a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:46.940529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6954bb36-3d6c-4517-a874-c41c4b44194a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:46.947538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6954bb36-3d6c-4517-a874-c41c4b44194a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:46.947982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6954bb36-3d6c-4517-a874-c41c4b44194a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:46.948809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6954bb36-3d6c-4517-a874-c41c4b44194a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:46.949238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6954bb36-3d6c-4517-a874-c41c4b44194a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:46.964781 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-6954bb36-3d6c-4517-a874-c41c4b44194a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6954bb36-3d6c-4517-a874-c41c4b44194a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf HTTP/1.1 Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '82ab3faf-712c-41cf-aa1d-0b6dff40c9cf'} Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:46.966410 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.972306 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:46.972306 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:46.972306 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:46.972306 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:50:46.972306 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:50:46.972306 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. Aug 02 07:50:46.972306 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:46.972306 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6954bb36-3d6c-4517-a874-c41c4b44194a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 82ab3faf-712c-41cf-aa1d-0b6dff40c9cf could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:50:46.972306 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6954bb36-3d6c-4517-a874-c41c4b44194a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf" status: 404 len: 111 microversion: 2.1 time: 0.032263 Aug 02 07:50:46.972306 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3473/7019] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:46 2022] GET /compute/v2.1/servers/82ab3faf-712c-41cf-aa1d-0b6dff40c9cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 07:50:46.977874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c97c870-315e-440b-b456-a2b6bb54d3fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:46.978398 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9c97c870-315e-440b-b456-a2b6bb54d3fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:46.986882 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c97c870-315e-440b-b456-a2b6bb54d3fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:46.987335 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c97c870-315e-440b-b456-a2b6bb54d3fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:46.988119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c97c870-315e-440b-b456-a2b6bb54d3fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:46.988552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9c97c870-315e-440b-b456-a2b6bb54d3fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:47.010489 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-9c97c870-315e-440b-b456-a2b6bb54d3fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c97c870-315e-440b-b456-a2b6bb54d3fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda HTTP/1.1 Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '3d9c9f97-6224-4392-a3d4-a0b38588beda'} Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:50:47.012083 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:50:47.015968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:50:47.015968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.015968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:47.015968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.015968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:47.015968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:47.015968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:47.015968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:50:47.015968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:50:47.015968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:50:47.015968 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.015968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9c97c870-315e-440b-b456-a2b6bb54d3fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:50:47.015968 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9c97c870-315e-440b-b456-a2b6bb54d3fd tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 404 len: 111 microversion: 2.1 time: 0.039787 Aug 02 07:50:47.015968 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3547/7020] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:50:46 2022] DELETE /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:50:47.022882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cf34dfbd-1e35-4a92-981a-ab7a1a407528 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:47.023477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cf34dfbd-1e35-4a92-981a-ab7a1a407528 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 3d9c9f97-6224-4392-a3d4-a0b38588beda] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:47.029940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf34dfbd-1e35-4a92-981a-ab7a1a407528 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:47.030497 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf34dfbd-1e35-4a92-981a-ab7a1a407528 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:47.031311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf34dfbd-1e35-4a92-981a-ab7a1a407528 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:47.031764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cf34dfbd-1e35-4a92-981a-ab7a1a407528 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:47.047138 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-cf34dfbd-1e35-4a92-981a-ab7a1a407528 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cf34dfbd-1e35-4a92-981a-ab7a1a407528 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda HTTP/1.1 Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '3d9c9f97-6224-4392-a3d4-a0b38588beda'} Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:47.048750 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.052528 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:47.052528 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:47.052528 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:47.052528 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:50:47.052528 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:50:47.052528 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. Aug 02 07:50:47.052528 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.052528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cf34dfbd-1e35-4a92-981a-ab7a1a407528 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 3d9c9f97-6224-4392-a3d4-a0b38588beda could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:50:47.052528 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cf34dfbd-1e35-4a92-981a-ab7a1a407528 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda" status: 404 len: 111 microversion: 2.1 time: 0.031237 Aug 02 07:50:47.052528 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3474/7021] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:47 2022] GET /compute/v2.1/servers/3d9c9f97-6224-4392-a3d4-a0b38588beda => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:50:47.060006 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b1d6188c-c61d-4502-9769-aac59dfddaed tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:47.060512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b1d6188c-c61d-4502-9769-aac59dfddaed tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:47.067509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1d6188c-c61d-4502-9769-aac59dfddaed tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:47.067982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1d6188c-c61d-4502-9769-aac59dfddaed tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:47.068804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1d6188c-c61d-4502-9769-aac59dfddaed tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:47.069245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b1d6188c-c61d-4502-9769-aac59dfddaed tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:47.084040 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-b1d6188c-c61d-4502-9769-aac59dfddaed tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b1d6188c-c61d-4502-9769-aac59dfddaed tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc HTTP/1.1 Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '57cd5ee0-6fa9-4197-88a1-b885ab9929dc'} Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:50:47.085643 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:50:47.092287 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:50:47.092287 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.092287 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:47.092287 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.092287 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:47.092287 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:47.092287 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:47.092287 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:50:47.092287 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:50:47.092287 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:50:47.092287 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.092287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b1d6188c-c61d-4502-9769-aac59dfddaed tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:50:47.092287 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b1d6188c-c61d-4502-9769-aac59dfddaed tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "DELETE /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 404 len: 111 microversion: 2.1 time: 0.031391 Aug 02 07:50:47.092287 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3548/7022] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:50:47 2022] DELETE /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:50:47.097277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4b9d06da-6636-4cdf-8d1e-7a751728f14a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:47.097918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4b9d06da-6636-4cdf-8d1e-7a751728f14a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] [instance: 57cd5ee0-6fa9-4197-88a1-b885ab9929dc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:47.105327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b9d06da-6636-4cdf-8d1e-7a751728f14a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:47.105790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b9d06da-6636-4cdf-8d1e-7a751728f14a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:47.106662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b9d06da-6636-4cdf-8d1e-7a751728f14a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:47.107189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4b9d06da-6636-4cdf-8d1e-7a751728f14a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:47.121860 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-4b9d06da-6636-4cdf-8d1e-7a751728f14a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] HTTP exception thrown: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4b9d06da-6636-4cdf-8d1e-7a751728f14a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Request method failure captured: Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc HTTP/1.1 Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NWNQOJd_r_Pi5Al7WV2P5ZKUfpI6nZLdx5fqRbPLpD_HeXfzcGYraaEBaPUYziJm6pN925lefAVeOkPFk-mwqyziiBqXMU3Brwn2gl-DCY0oWEgHOXkYbuwbRsZFxTamGab06vSK6BzfvtnXp9nrR77UzipbEzM-s6cwhom2_STdYk Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_693ef5caeeb34c95b6c5b4390df3487a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/693ef5caeeb34c95b6c5b4390df3487a"}]}] Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 693ef5caeeb34c95b6c5b4390df3487a Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692674621 Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: abff1bade52a439093f9d43ed63fc857 Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServerActionsTestJSON-1692674621-project Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '57cd5ee0-6fa9-4197-88a1-b885ab9929dc'} Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:50:47.123494 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.127625 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:50:47.127625 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:50:47.127625 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:50:47.127625 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:50:47.127625 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:50:47.127625 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. Aug 02 07:50:47.127625 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:50:47.127625 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4b9d06da-6636-4cdf-8d1e-7a751728f14a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Returning 404 to user: Instance 57cd5ee0-6fa9-4197-88a1-b885ab9929dc could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:50:47.127625 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4b9d06da-6636-4cdf-8d1e-7a751728f14a tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc" status: 404 len: 111 microversion: 2.1 time: 0.032313 Aug 02 07:50:47.127625 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3475/7023] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:47 2022] GET /compute/v2.1/servers/57cd5ee0-6fa9-4197-88a1-b885ab9929dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:50:47.134530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-592b0b12-b7c5-4644-b97f-728c66129da9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] Calling method '.version_select at 0x7f9279c62820>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:47.163347 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-592b0b12-b7c5-4644-b97f-728c66129da9 tempest-ServerActionsTestJSON-1692674621 tempest-ServerActionsTestJSON-1692674621-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730148551" status: 202 len: 0 microversion: 2.1 time: 0.032644 Aug 02 07:50:47.164202 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3549/7024] 10.222.0.79 () {58 vars in 1221 bytes} [Tue Aug 2 07:50:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730148551 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:50:57.102374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=17 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:50:57.112116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=29 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:50:57.156299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-306081719", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "e6dffa5d-b179-434e-b441-eb29320417d4"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:50:57.214711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] validate_networks() for [('e6dffa5d-b179-434e-b441-eb29320417d4', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:50:57.666133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:50:57.666763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:50:57.667515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:50:57.667959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:50:57.668394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:50:57.679217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:57.679800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:57.680691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:57.681203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:57.702689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Getting quotas for project 886bf3a7986b40fda0845b34d75671e0. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:50:57.708465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Getting quotas for user 50e96ab6d59d4fb9a8b10fd54b0ef1d8 and project 886bf3a7986b40fda0845b34d75671e0. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:50:57.722638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:50:57.724950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:50:57.771505 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [492dfc6d-c3b2-4a7c-ac58-a9c00dfd70f6] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 07:50:58.780337 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [492dfc6d-c3b2-4a7c-ac58-a9c00dfd70f6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 37280. Aug 02 07:50:58.785131 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a5be5e89-c245-42f5-84e2-479e6b5b4666 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.809911 Aug 02 07:50:58.785796 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3476/7025] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:50:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:50:58.794871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:50:58.795649 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:50:58.800885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0f8ea021-28a9-4f9a-bebe-c30ea91655f7 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:58.802634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0f8ea021-28a9-4f9a-bebe-c30ea91655f7 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:58.871613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0f8ea021-28a9-4f9a-bebe-c30ea91655f7 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:50:58.879650 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0f8ea021-28a9-4f9a-bebe-c30ea91655f7 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1216 microversion: 2.1 time: 0.086221 Aug 02 07:50:58.880227 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3550/7026] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:58 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:50:59.902299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-57ab34da-1ad6-49f9-94bc-a26d255d48ef tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:50:59.904522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-57ab34da-1ad6-49f9-94bc-a26d255d48ef tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:50:59.915506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-57ab34da-1ad6-49f9-94bc-a26d255d48ef tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:59.915971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-57ab34da-1ad6-49f9-94bc-a26d255d48ef tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:50:59.917142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-57ab34da-1ad6-49f9-94bc-a26d255d48ef tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:50:59.917630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-57ab34da-1ad6-49f9-94bc-a26d255d48ef tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:00.022359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-57ab34da-1ad6-49f9-94bc-a26d255d48ef tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:00.030470 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-57ab34da-1ad6-49f9-94bc-a26d255d48ef tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1286 microversion: 2.1 time: 0.133291 Aug 02 07:51:00.031456 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3477/7027] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:50:59 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:01.052842 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b588d12b-27b3-4581-9f67-10f5e37d9afd tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:01.054409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b588d12b-27b3-4581-9f67-10f5e37d9afd tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:01.062908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b588d12b-27b3-4581-9f67-10f5e37d9afd tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:01.063449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b588d12b-27b3-4581-9f67-10f5e37d9afd tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:01.064569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b588d12b-27b3-4581-9f67-10f5e37d9afd tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:01.065214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b588d12b-27b3-4581-9f67-10f5e37d9afd tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:01.269691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b588d12b-27b3-4581-9f67-10f5e37d9afd tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:01.278899 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b588d12b-27b3-4581-9f67-10f5e37d9afd tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1316 microversion: 2.1 time: 0.230144 Aug 02 07:51:01.286686 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3551/7028] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:01 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:01.322942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-0ca82aea-726d-45a1-a1d7-c50217fffe71 req-937495e8-63da-4c06-b487-d8d6016fca2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8c3b956-7a44-473c-afe1-f342e1bc3551", "tag": "cb884f18-fb80-4d2d-9ac5-85c89b08c8d7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:51:01.348757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0ca82aea-726d-45a1-a1d7-c50217fffe71 req-937495e8-63da-4c06-b487-d8d6016fca2c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:01.349293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0ca82aea-726d-45a1-a1d7-c50217fffe71 req-937495e8-63da-4c06-b487-d8d6016fca2c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:01.364886 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-0ca82aea-726d-45a1-a1d7-c50217fffe71 req-937495e8-63da-4c06-b487-d8d6016fca2c service nova] Creating event network-changed:cb884f18-fb80-4d2d-9ac5-85c89b08c8d7 for instance f8c3b956-7a44-473c-afe1-f342e1bc3551 on n-h2-851337-3 Aug 02 07:51:01.370463 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-0ca82aea-726d-45a1-a1d7-c50217fffe71 req-937495e8-63da-4c06-b487-d8d6016fca2c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053340 Aug 02 07:51:01.371334 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3478/7029] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:51:02.301042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2bb52c5d-855d-4eff-9f64-b8d42aab1c3a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:02.301660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2bb52c5d-855d-4eff-9f64-b8d42aab1c3a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:02.309071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bb52c5d-855d-4eff-9f64-b8d42aab1c3a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:02.309532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bb52c5d-855d-4eff-9f64-b8d42aab1c3a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:02.310415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bb52c5d-855d-4eff-9f64-b8d42aab1c3a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:02.310851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2bb52c5d-855d-4eff-9f64-b8d42aab1c3a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:02.447267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2bb52c5d-855d-4eff-9f64-b8d42aab1c3a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:02.457193 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2bb52c5d-855d-4eff-9f64-b8d42aab1c3a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1316 microversion: 2.1 time: 0.160219 Aug 02 07:51:02.457755 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3552/7030] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:02 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:03.480621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-58187914-2ecc-47a7-9b02-f5c105862584 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:03.481559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-58187914-2ecc-47a7-9b02-f5c105862584 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:03.488483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-58187914-2ecc-47a7-9b02-f5c105862584 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:03.488951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-58187914-2ecc-47a7-9b02-f5c105862584 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:03.489727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-58187914-2ecc-47a7-9b02-f5c105862584 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:03.490236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-58187914-2ecc-47a7-9b02-f5c105862584 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:03.631698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-58187914-2ecc-47a7-9b02-f5c105862584 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:03.639992 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-58187914-2ecc-47a7-9b02-f5c105862584 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1316 microversion: 2.1 time: 0.165306 Aug 02 07:51:03.640589 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3479/7031] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:03 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:04.662925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-43bf5fda-4545-425e-9cd8-ec600f1211d1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:04.663547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-43bf5fda-4545-425e-9cd8-ec600f1211d1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:04.672437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43bf5fda-4545-425e-9cd8-ec600f1211d1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:04.672964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43bf5fda-4545-425e-9cd8-ec600f1211d1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:04.673827 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43bf5fda-4545-425e-9cd8-ec600f1211d1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:04.674301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-43bf5fda-4545-425e-9cd8-ec600f1211d1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:04.825487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-43bf5fda-4545-425e-9cd8-ec600f1211d1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:04.833663 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-43bf5fda-4545-425e-9cd8-ec600f1211d1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1316 microversion: 2.1 time: 0.174766 Aug 02 07:51:04.834268 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3553/7032] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:04 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:05.865192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-350203d2-d85c-411c-95db-b5d63d16bbe4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:05.865818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-350203d2-d85c-411c-95db-b5d63d16bbe4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:05.873269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-350203d2-d85c-411c-95db-b5d63d16bbe4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:05.873736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-350203d2-d85c-411c-95db-b5d63d16bbe4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:05.874623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-350203d2-d85c-411c-95db-b5d63d16bbe4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:05.875072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-350203d2-d85c-411c-95db-b5d63d16bbe4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:06.018749 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-350203d2-d85c-411c-95db-b5d63d16bbe4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:06.026722 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-350203d2-d85c-411c-95db-b5d63d16bbe4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1316 microversion: 2.1 time: 0.165611 Aug 02 07:51:06.027312 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3480/7033] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:05 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:06.101337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-f22b4f1d-92d5-42c7-8b4c-fecf47cb53a3 req-2f050311-d48e-4bc2-b242-b5627bfa6af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8c3b956-7a44-473c-afe1-f342e1bc3551", "name": "network-vif-plugged", "status": "completed", "tag": "cb884f18-fb80-4d2d-9ac5-85c89b08c8d7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:51:06.112561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f22b4f1d-92d5-42c7-8b4c-fecf47cb53a3 req-2f050311-d48e-4bc2-b242-b5627bfa6af2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:06.113019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f22b4f1d-92d5-42c7-8b4c-fecf47cb53a3 req-2f050311-d48e-4bc2-b242-b5627bfa6af2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:06.125648 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f22b4f1d-92d5-42c7-8b4c-fecf47cb53a3 req-2f050311-d48e-4bc2-b242-b5627bfa6af2 service nova] Creating event network-vif-plugged:cb884f18-fb80-4d2d-9ac5-85c89b08c8d7 for instance f8c3b956-7a44-473c-afe1-f342e1bc3551 on n-h2-851337-3 Aug 02 07:51:06.132569 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-f22b4f1d-92d5-42c7-8b4c-fecf47cb53a3 req-2f050311-d48e-4bc2-b242-b5627bfa6af2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034936 Aug 02 07:51:06.133197 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3554/7034] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:51:07.048221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5be54d95-e255-4314-b56d-8f881e5da78a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:07.048946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5be54d95-e255-4314-b56d-8f881e5da78a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:07.058204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5be54d95-e255-4314-b56d-8f881e5da78a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:07.058664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5be54d95-e255-4314-b56d-8f881e5da78a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:07.059529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5be54d95-e255-4314-b56d-8f881e5da78a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:07.059972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5be54d95-e255-4314-b56d-8f881e5da78a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:07.202362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5be54d95-e255-4314-b56d-8f881e5da78a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:07.210443 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5be54d95-e255-4314-b56d-8f881e5da78a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1316 microversion: 2.1 time: 0.166250 Aug 02 07:51:07.211031 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3481/7035] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:07 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:08.235148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a32c063a-fe42-4ee4-b528-2c4e84628698 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:08.235902 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a32c063a-fe42-4ee4-b528-2c4e84628698 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:08.242753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a32c063a-fe42-4ee4-b528-2c4e84628698 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:08.243195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a32c063a-fe42-4ee4-b528-2c4e84628698 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:08.243957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a32c063a-fe42-4ee4-b528-2c4e84628698 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:08.244409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a32c063a-fe42-4ee4-b528-2c4e84628698 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:08.389864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a32c063a-fe42-4ee4-b528-2c4e84628698 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:08.397997 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a32c063a-fe42-4ee4-b528-2c4e84628698 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1504 microversion: 2.1 time: 0.169152 Aug 02 07:51:08.398526 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3555/7036] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:08 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:08.465768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-883588802", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "e6dffa5d-b179-434e-b441-eb29320417d4"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:51:08.474951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:51:08.475640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:51:08.523851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] validate_networks() for [('e6dffa5d-b179-434e-b441-eb29320417d4', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:51:08.920469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:51:08.920935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:51:08.921401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:51:08.921840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:51:08.922297 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:51:08.933452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:08.933927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:08.935116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:08.935365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:08.953319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Getting quotas for project 886bf3a7986b40fda0845b34d75671e0. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:51:08.958841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Getting quotas for user 50e96ab6d59d4fb9a8b10fd54b0ef1d8 and project 886bf3a7986b40fda0845b34d75671e0. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:51:08.971859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:51:08.974240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:51:09.021777 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f567c210-4773-46e2-9a88-38f089ada60d tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561306 Aug 02 07:51:09.022652 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3482/7037] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:51:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:51:09.033776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-84ad5576-b4b1-47a0-a0f4-3665f8143bf6 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:09.034428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-84ad5576-b4b1-47a0-a0f4-3665f8143bf6 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:09.036530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:51:09.095448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-84ad5576-b4b1-47a0-a0f4-3665f8143bf6 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:09.104046 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-84ad5576-b4b1-47a0-a0f4-3665f8143bf6 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 200 len: 1216 microversion: 2.1 time: 0.074218 Aug 02 07:51:09.104834 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3556/7038] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:09 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:51:10.127513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-44eab13b-c256-4e64-b672-8fd54b00425e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:10.128806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-44eab13b-c256-4e64-b672-8fd54b00425e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:10.136006 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44eab13b-c256-4e64-b672-8fd54b00425e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:10.136668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44eab13b-c256-4e64-b672-8fd54b00425e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:10.137521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44eab13b-c256-4e64-b672-8fd54b00425e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:10.138557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-44eab13b-c256-4e64-b672-8fd54b00425e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:10.213637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-44eab13b-c256-4e64-b672-8fd54b00425e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:10.222972 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-44eab13b-c256-4e64-b672-8fd54b00425e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 200 len: 1286 microversion: 2.1 time: 0.100315 Aug 02 07:51:10.223712 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3483/7039] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:10 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:11.243852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-edcb58ba-8a1e-4de6-8fff-e4cdd4be7eb2 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:11.244486 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-edcb58ba-8a1e-4de6-8fff-e4cdd4be7eb2 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:11.256045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-edcb58ba-8a1e-4de6-8fff-e4cdd4be7eb2 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:11.256849 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-edcb58ba-8a1e-4de6-8fff-e4cdd4be7eb2 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:11.257691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-edcb58ba-8a1e-4de6-8fff-e4cdd4be7eb2 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:11.258145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-edcb58ba-8a1e-4de6-8fff-e4cdd4be7eb2 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:11.400988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-edcb58ba-8a1e-4de6-8fff-e4cdd4be7eb2 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:11.409084 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-edcb58ba-8a1e-4de6-8fff-e4cdd4be7eb2 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 200 len: 1316 microversion: 2.1 time: 0.169151 Aug 02 07:51:11.409664 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3557/7040] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:11 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:11.475543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-31a0af87-5c9b-4e9b-b054-0304793ca45d req-9916ac58-c457-49b5-914e-191bc5f49076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33064608-d76f-43bf-9f68-09d323844e59", "tag": "476646de-ad33-4863-9a78-baf76e16ac72"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:51:11.487349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-31a0af87-5c9b-4e9b-b054-0304793ca45d req-9916ac58-c457-49b5-914e-191bc5f49076 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:11.487845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-31a0af87-5c9b-4e9b-b054-0304793ca45d req-9916ac58-c457-49b5-914e-191bc5f49076 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:11.503372 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-31a0af87-5c9b-4e9b-b054-0304793ca45d req-9916ac58-c457-49b5-914e-191bc5f49076 service nova] Creating event network-changed:476646de-ad33-4863-9a78-baf76e16ac72 for instance 33064608-d76f-43bf-9f68-09d323844e59 on n-h1-851337-3 Aug 02 07:51:11.509040 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-31a0af87-5c9b-4e9b-b054-0304793ca45d req-9916ac58-c457-49b5-914e-191bc5f49076 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037399 Aug 02 07:51:11.509672 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3484/7041] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:51:12.431884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5c32b91f-5c3b-47d9-9115-ad4dcdab54a4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:12.432512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5c32b91f-5c3b-47d9-9115-ad4dcdab54a4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:12.440895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c32b91f-5c3b-47d9-9115-ad4dcdab54a4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:12.441349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c32b91f-5c3b-47d9-9115-ad4dcdab54a4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:12.442174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c32b91f-5c3b-47d9-9115-ad4dcdab54a4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:12.442614 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5c32b91f-5c3b-47d9-9115-ad4dcdab54a4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:12.587376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5c32b91f-5c3b-47d9-9115-ad4dcdab54a4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:12.595291 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5c32b91f-5c3b-47d9-9115-ad4dcdab54a4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 200 len: 1316 microversion: 2.1 time: 0.167895 Aug 02 07:51:12.595869 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3558/7042] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:12 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:13.618013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ee86dedc-311b-48f2-9c06-97644efaf103 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:13.618746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ee86dedc-311b-48f2-9c06-97644efaf103 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:13.625245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee86dedc-311b-48f2-9c06-97644efaf103 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:13.625808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee86dedc-311b-48f2-9c06-97644efaf103 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:13.626614 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee86dedc-311b-48f2-9c06-97644efaf103 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:13.627056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ee86dedc-311b-48f2-9c06-97644efaf103 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:13.767606 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ee86dedc-311b-48f2-9c06-97644efaf103 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:13.775811 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ee86dedc-311b-48f2-9c06-97644efaf103 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 200 len: 1316 microversion: 2.1 time: 0.163137 Aug 02 07:51:13.776392 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3485/7043] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:13 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:14.804917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0b4432c3-6cda-4b75-8b87-15d99c21b24f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:14.805500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0b4432c3-6cda-4b75-8b87-15d99c21b24f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:14.813309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b4432c3-6cda-4b75-8b87-15d99c21b24f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:14.813768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b4432c3-6cda-4b75-8b87-15d99c21b24f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:14.814580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b4432c3-6cda-4b75-8b87-15d99c21b24f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:14.815017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b4432c3-6cda-4b75-8b87-15d99c21b24f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:14.961843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0b4432c3-6cda-4b75-8b87-15d99c21b24f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:14.970617 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0b4432c3-6cda-4b75-8b87-15d99c21b24f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 200 len: 1316 microversion: 2.1 time: 0.169618 Aug 02 07:51:14.971211 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3559/7044] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:14 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:15.998903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-39412f63-26f7-4dc7-9c4e-cd172150607a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:15.999794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-39412f63-26f7-4dc7-9c4e-cd172150607a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:16.009200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39412f63-26f7-4dc7-9c4e-cd172150607a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:16.009780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39412f63-26f7-4dc7-9c4e-cd172150607a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:16.011086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39412f63-26f7-4dc7-9c4e-cd172150607a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:16.011642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39412f63-26f7-4dc7-9c4e-cd172150607a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:16.158693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-39412f63-26f7-4dc7-9c4e-cd172150607a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:16.166392 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-39412f63-26f7-4dc7-9c4e-cd172150607a tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 200 len: 1316 microversion: 2.1 time: 0.173628 Aug 02 07:51:16.166960 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3486/7045] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:15 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:17.188073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0c980fbd-6ef0-47c9-b984-bcf69d488058 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:17.188666 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0c980fbd-6ef0-47c9-b984-bcf69d488058 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:17.196396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c980fbd-6ef0-47c9-b984-bcf69d488058 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:17.196854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c980fbd-6ef0-47c9-b984-bcf69d488058 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:17.197631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c980fbd-6ef0-47c9-b984-bcf69d488058 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:17.198110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0c980fbd-6ef0-47c9-b984-bcf69d488058 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:17.337361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0c980fbd-6ef0-47c9-b984-bcf69d488058 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:17.347224 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0c980fbd-6ef0-47c9-b984-bcf69d488058 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 200 len: 1316 microversion: 2.1 time: 0.162886 Aug 02 07:51:17.347815 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3560/7046] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:17 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:17.634782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c39ed262-27b4-4bf9-9d23-8e0df6100c82 req-873f550e-cb6f-4a5e-8b84-c6c8eeef06f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33064608-d76f-43bf-9f68-09d323844e59", "name": "network-vif-plugged", "status": "completed", "tag": "476646de-ad33-4863-9a78-baf76e16ac72"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:51:17.646046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c39ed262-27b4-4bf9-9d23-8e0df6100c82 req-873f550e-cb6f-4a5e-8b84-c6c8eeef06f5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:17.646548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c39ed262-27b4-4bf9-9d23-8e0df6100c82 req-873f550e-cb6f-4a5e-8b84-c6c8eeef06f5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:17.658839 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c39ed262-27b4-4bf9-9d23-8e0df6100c82 req-873f550e-cb6f-4a5e-8b84-c6c8eeef06f5 service nova] Creating event network-vif-plugged:476646de-ad33-4863-9a78-baf76e16ac72 for instance 33064608-d76f-43bf-9f68-09d323844e59 on n-h1-851337-3 Aug 02 07:51:17.664131 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c39ed262-27b4-4bf9-9d23-8e0df6100c82 req-873f550e-cb6f-4a5e-8b84-c6c8eeef06f5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032951 Aug 02 07:51:17.664665 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3487/7047] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:51:18.369945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-57e63ea8-a7d8-4f28-846b-c6726eb23858 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:18.370803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-57e63ea8-a7d8-4f28-846b-c6726eb23858 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:18.380855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57e63ea8-a7d8-4f28-846b-c6726eb23858 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:18.381461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57e63ea8-a7d8-4f28-846b-c6726eb23858 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:18.382532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57e63ea8-a7d8-4f28-846b-c6726eb23858 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:18.383113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-57e63ea8-a7d8-4f28-846b-c6726eb23858 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:18.517568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-57e63ea8-a7d8-4f28-846b-c6726eb23858 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:18.526153 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-57e63ea8-a7d8-4f28-846b-c6726eb23858 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 200 len: 1316 microversion: 2.1 time: 0.161442 Aug 02 07:51:18.526754 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3561/7048] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:18 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:19.545412 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:51:19.546237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:51:19.550397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72fd2f63-d994-4759-bedb-d27c00edca76 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:19.551173 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-72fd2f63-d994-4759-bedb-d27c00edca76 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:19.558673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72fd2f63-d994-4759-bedb-d27c00edca76 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:19.559135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72fd2f63-d994-4759-bedb-d27c00edca76 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:19.559912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72fd2f63-d994-4759-bedb-d27c00edca76 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:19.560356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72fd2f63-d994-4759-bedb-d27c00edca76 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:19.706517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-72fd2f63-d994-4759-bedb-d27c00edca76 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:19.714269 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-72fd2f63-d994-4759-bedb-d27c00edca76 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 200 len: 1504 microversion: 2.1 time: 0.170672 Aug 02 07:51:19.714840 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3488/7049] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:19 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:19.742042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f3d86637-3063-49ed-8e16-41af4ece6505 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:19.742568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f3d86637-3063-49ed-8e16-41af4ece6505 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:19.744469 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:51:19.751140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3d86637-3063-49ed-8e16-41af4ece6505 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:19.751586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3d86637-3063-49ed-8e16-41af4ece6505 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:19.752352 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3d86637-3063-49ed-8e16-41af4ece6505 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:19.752786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3d86637-3063-49ed-8e16-41af4ece6505 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:19.780127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f3d86637-3063-49ed-8e16-41af4ece6505 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:51:19.860133 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f3d86637-3063-49ed-8e16-41af4ece6505 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "DELETE /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 204 len: 0 microversion: 2.1 time: 0.121448 Aug 02 07:51:19.860768 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3562/7050] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:51:19 2022] DELETE /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:51:19.869530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-96af2e0a-8ba2-4ea7-9190-c08fdf10e469 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:19.870174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-96af2e0a-8ba2-4ea7-9190-c08fdf10e469 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:19.876268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96af2e0a-8ba2-4ea7-9190-c08fdf10e469 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:19.876723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96af2e0a-8ba2-4ea7-9190-c08fdf10e469 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:19.877483 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96af2e0a-8ba2-4ea7-9190-c08fdf10e469 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:19.877948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96af2e0a-8ba2-4ea7-9190-c08fdf10e469 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:20.011800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-96af2e0a-8ba2-4ea7-9190-c08fdf10e469 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:20.019646 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-96af2e0a-8ba2-4ea7-9190-c08fdf10e469 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 200 len: 1510 microversion: 2.1 time: 0.154130 Aug 02 07:51:20.020232 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3489/7051] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:19 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:51:21.046744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ab688822-4292-4d80-917a-9ff181c5a4bf tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:21.047429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ab688822-4292-4d80-917a-9ff181c5a4bf tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:21.055216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab688822-4292-4d80-917a-9ff181c5a4bf tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:21.055698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab688822-4292-4d80-917a-9ff181c5a4bf tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:21.056454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab688822-4292-4d80-917a-9ff181c5a4bf tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:21.056895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ab688822-4292-4d80-917a-9ff181c5a4bf tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:21.205860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ab688822-4292-4d80-917a-9ff181c5a4bf tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:21.214586 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ab688822-4292-4d80-917a-9ff181c5a4bf tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 200 len: 1510 microversion: 2.1 time: 0.172407 Aug 02 07:51:21.215140 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3563/7052] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:21 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:21.935718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ceec2084-aba3-4d8a-aade-5953bbb64d2f req-053796d4-395a-4ff3-99e8-1e83773367e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33064608-d76f-43bf-9f68-09d323844e59", "name": "network-vif-deleted", "tag": "476646de-ad33-4863-9a78-baf76e16ac72"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:51:21.946798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ceec2084-aba3-4d8a-aade-5953bbb64d2f req-053796d4-395a-4ff3-99e8-1e83773367e2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:21.947234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ceec2084-aba3-4d8a-aade-5953bbb64d2f req-053796d4-395a-4ff3-99e8-1e83773367e2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:21.971477 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ceec2084-aba3-4d8a-aade-5953bbb64d2f req-053796d4-395a-4ff3-99e8-1e83773367e2 service nova] Creating event network-vif-deleted:476646de-ad33-4863-9a78-baf76e16ac72 for instance 33064608-d76f-43bf-9f68-09d323844e59 on n-h1-851337-3 Aug 02 07:51:21.982214 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ceec2084-aba3-4d8a-aade-5953bbb64d2f req-053796d4-395a-4ff3-99e8-1e83773367e2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050376 Aug 02 07:51:21.983009 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3490/7053] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:51:22.237023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fcf2d277-169e-4103-8e15-a12a1fc22476 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:22.237668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fcf2d277-169e-4103-8e15-a12a1fc22476 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:22.245421 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fcf2d277-169e-4103-8e15-a12a1fc22476 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:22.245876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fcf2d277-169e-4103-8e15-a12a1fc22476 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:22.246692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fcf2d277-169e-4103-8e15-a12a1fc22476 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:22.247134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fcf2d277-169e-4103-8e15-a12a1fc22476 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:22.283329 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fcf2d277-169e-4103-8e15-a12a1fc22476 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:22.283784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fcf2d277-169e-4103-8e15-a12a1fc22476 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:22.284231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-fcf2d277-169e-4103-8e15-a12a1fc22476 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lazy-loading 'fault' on Instance uuid 33064608-d76f-43bf-9f68-09d323844e59 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:51:22.328742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fcf2d277-169e-4103-8e15-a12a1fc22476 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:22.337079 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fcf2d277-169e-4103-8e15-a12a1fc22476 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 200 len: 1306 microversion: 2.1 time: 0.103974 Aug 02 07:51:22.337703 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3564/7054] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:22 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 1306 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:23.364809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-851cd801-4c7b-4c53-9a7f-37ee0879a6b1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:23.365664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-851cd801-4c7b-4c53-9a7f-37ee0879a6b1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:23.375919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-851cd801-4c7b-4c53-9a7f-37ee0879a6b1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:23.376615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-851cd801-4c7b-4c53-9a7f-37ee0879a6b1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:23.377872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-851cd801-4c7b-4c53-9a7f-37ee0879a6b1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:23.378658 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-851cd801-4c7b-4c53-9a7f-37ee0879a6b1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:23.394538 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-851cd801-4c7b-4c53-9a7f-37ee0879a6b1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] HTTP exception thrown: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-851cd801-4c7b-4c53-9a7f-37ee0879a6b1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Request method failure captured: Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 HTTP/1.1 Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Ndgdi8sx_cxBZO3vt2umvTWJSPFuZ0XuWO_x2f_Ny9geQ0mlUMHjYKCuSIHqmHZar2XuAuWFufXPrZwuKAGC7kZp5PxFAUG1BfBjX5f77UgYJwzX48Nkkx-vO0L9VxxgzpQQXUFh9i_SYD5qmiATalW4FMnMFtvIe2CcuWQWM6_kjQ Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 886bf3a7986b40fda0845b34d75671e0 Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/886bf3a7986b40fda0845b34d75671e0"}]}] Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 886bf3a7986b40fda0845b34d75671e0 Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-504497565-project Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 50e96ab6d59d4fb9a8b10fd54b0ef1d8 Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-504497565-project Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '33064608-d76f-43bf-9f68-09d323844e59'} Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:51:23.396203 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:23.400116 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:23.400116 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:51:23.400116 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:51:23.400116 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:51:23.400116 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:51:23.400116 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:23.400116 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:23.400116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-851cd801-4c7b-4c53-9a7f-37ee0879a6b1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Returning 404 to user: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:51:23.400116 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-851cd801-4c7b-4c53-9a7f-37ee0879a6b1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 404 len: 111 microversion: 2.1 time: 0.041029 Aug 02 07:51:23.400116 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3491/7055] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:23 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:51:23.407081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cf954389-7350-423d-95f3-4d02bcda56c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:23.407701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cf954389-7350-423d-95f3-4d02bcda56c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:23.415240 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf954389-7350-423d-95f3-4d02bcda56c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:23.415694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf954389-7350-423d-95f3-4d02bcda56c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:23.416461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf954389-7350-423d-95f3-4d02bcda56c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:23.416897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf954389-7350-423d-95f3-4d02bcda56c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:23.559952 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cf954389-7350-423d-95f3-4d02bcda56c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:23.567766 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cf954389-7350-423d-95f3-4d02bcda56c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1504 microversion: 2.1 time: 0.164661 Aug 02 07:51:23.568343 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3565/7056] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:23 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:23.591338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d44cd151-5bae-4013-98de-5b18116e8bad tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:51:23.594583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d44cd151-5bae-4013-98de-5b18116e8bad tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: b440b3b1-725f-46b0-b474-24f3447904b5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:23.603391 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-d44cd151-5bae-4013-98de-5b18116e8bad tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] HTTP exception thrown: Instance b440b3b1-725f-46b0-b474-24f3447904b5 could not be found. Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d44cd151-5bae-4013-98de-5b18116e8bad tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Request method failure captured: Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/b440b3b1-725f-46b0-b474-24f3447904b5/action HTTP/1.1 Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 32 Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Ndgdi8sx_cxBZO3vt2umvTWJSPFuZ0XuWO_x2f_Ny9geQ0mlUMHjYKCuSIHqmHZar2XuAuWFufXPrZwuKAGC7kZp5PxFAUG1BfBjX5f77UgYJwzX48Nkkx-vO0L9VxxgzpQQXUFh9i_SYD5qmiATalW4FMnMFtvIe2CcuWQWM6_kjQ Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 886bf3a7986b40fda0845b34d75671e0 Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/886bf3a7986b40fda0845b34d75671e0"}]}] Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 886bf3a7986b40fda0845b34d75671e0 Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-504497565-project Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 50e96ab6d59d4fb9a8b10fd54b0ef1d8 Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-504497565-project Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: {"resize": {"flavorRef": "452"}} Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance b440b3b1-725f-46b0-b474-24f3447904b5 could not be found. Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'b440b3b1-725f-46b0-b474-24f3447904b5', 'body': {'resize': {'flavorRef': '452'}}} Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b440b3b1-725f-46b0-b474-24f3447904b5 could not be found. Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:51:23.605865 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:51:23.609861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b440b3b1-725f-46b0-b474-24f3447904b5 could not be found. Aug 02 07:51:23.609861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:23.609861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:51:23.609861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:23.609861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:23.609861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:51:23.609861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:51:23.609861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:51:23.609861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:51:23.609861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b440b3b1-725f-46b0-b474-24f3447904b5 could not be found. Aug 02 07:51:23.609861 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:23.609861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d44cd151-5bae-4013-98de-5b18116e8bad tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Returning 404 to user: Instance b440b3b1-725f-46b0-b474-24f3447904b5 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:51:23.609861 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d44cd151-5bae-4013-98de-5b18116e8bad tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "POST /compute/v2.1/servers/b440b3b1-725f-46b0-b474-24f3447904b5/action" status: 404 len: 111 microversion: 2.1 time: 0.023189 Aug 02 07:51:23.609861 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3492/7057] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:51:23 2022] POST /compute/v2.1/servers/b440b3b1-725f-46b0-b474-24f3447904b5/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:51:23.618671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3f47db4a-f5a6-4161-ad4a-9baa731f482b tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:23.619219 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3f47db4a-f5a6-4161-ad4a-9baa731f482b tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:23.628162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f47db4a-f5a6-4161-ad4a-9baa731f482b tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:23.628815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f47db4a-f5a6-4161-ad4a-9baa731f482b tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:23.630401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f47db4a-f5a6-4161-ad4a-9baa731f482b tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:23.631053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3f47db4a-f5a6-4161-ad4a-9baa731f482b tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:23.773953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3f47db4a-f5a6-4161-ad4a-9baa731f482b tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:23.785336 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3f47db4a-f5a6-4161-ad4a-9baa731f482b tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1504 microversion: 2.1 time: 0.171537 Aug 02 07:51:23.785921 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3566/7058] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:23 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:23.807371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3b1459be-fbb2-4c0e-856a-dc7ea0a5b13c tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:23.808001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3b1459be-fbb2-4c0e-856a-dc7ea0a5b13c tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:23.815100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b1459be-fbb2-4c0e-856a-dc7ea0a5b13c tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:23.815700 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b1459be-fbb2-4c0e-856a-dc7ea0a5b13c tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:23.816463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b1459be-fbb2-4c0e-856a-dc7ea0a5b13c tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:23.816902 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b1459be-fbb2-4c0e-856a-dc7ea0a5b13c tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:23.959283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3b1459be-fbb2-4c0e-856a-dc7ea0a5b13c tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:23.971086 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3b1459be-fbb2-4c0e-856a-dc7ea0a5b13c tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1504 microversion: 2.1 time: 0.168247 Aug 02 07:51:23.972061 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3493/7059] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:23 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:51:23.992758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1ddab910-a42e-4d70-8046-944a2fd82bf8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "3e12455f-feaa-49b2-b5ca-24801fa44750"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:51:23.995223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1ddab910-a42e-4d70-8046-944a2fd82bf8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:24.002028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ddab910-a42e-4d70-8046-944a2fd82bf8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.002483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ddab910-a42e-4d70-8046-944a2fd82bf8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.003384 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ddab910-a42e-4d70-8046-944a2fd82bf8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.003830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1ddab910-a42e-4d70-8046-944a2fd82bf8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.008461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:51:24.047267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1ddab910-a42e-4d70-8046-944a2fd82bf8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:24.053097 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-1ddab910-a42e-4d70-8046-944a2fd82bf8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] HTTP exception thrown: Flavor 3e12455f-feaa-49b2-b5ca-24801fa44750 could not be found. Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1ddab910-a42e-4d70-8046-944a2fd82bf8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Request method failure captured: Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: request: POST /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551/action HTTP/1.1 Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 65 Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Ndgdi8sx_cxBZO3vt2umvTWJSPFuZ0XuWO_x2f_Ny9geQ0mlUMHjYKCuSIHqmHZar2XuAuWFufXPrZwuKAGC7kZp5PxFAUG1BfBjX5f77UgYJwzX48Nkkx-vO0L9VxxgzpQQXUFh9i_SYD5qmiATalW4FMnMFtvIe2CcuWQWM6_kjQ Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 886bf3a7986b40fda0845b34d75671e0 Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/886bf3a7986b40fda0845b34d75671e0"}]}] Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 886bf3a7986b40fda0845b34d75671e0 Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-504497565-project Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 50e96ab6d59d4fb9a8b10fd54b0ef1d8 Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-504497565-project Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: {"resize": {"flavorRef": "3e12455f-feaa-49b2-b5ca-24801fa44750"}} Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: exception: Flavor 3e12455f-feaa-49b2-b5ca-24801fa44750 could not be found. Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'f8c3b956-7a44-473c-afe1-f342e1bc3551', 'body': {'resize': {'flavorRef': '3e12455f-feaa-49b2-b5ca-24801fa44750'}}} Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 07:51:24.055089 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 3e12455f-feaa-49b2-b5ca-24801fa44750 could not be found. Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 3e12455f-feaa-49b2-b5ca-24801fa44750 could not be found. Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 3e12455f-feaa-49b2-b5ca-24801fa44750 could not be found. Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1ddab910-a42e-4d70-8046-944a2fd82bf8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Returning 400 to user: Flavor 3e12455f-feaa-49b2-b5ca-24801fa44750 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1ddab910-a42e-4d70-8046-944a2fd82bf8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "POST /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551/action" status: 400 len: 107 microversion: 2.1 time: 0.068013 Aug 02 07:51:24.058819 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3567/7060] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:51:23 2022] POST /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551/action => generated 107 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 07:51:24.065777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-51014575-b706-4fe5-b401-8a3a9f271be1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:24.066443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-51014575-b706-4fe5-b401-8a3a9f271be1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:24.072769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51014575-b706-4fe5-b401-8a3a9f271be1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.073227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51014575-b706-4fe5-b401-8a3a9f271be1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.074040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51014575-b706-4fe5-b401-8a3a9f271be1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.074491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-51014575-b706-4fe5-b401-8a3a9f271be1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.216495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-51014575-b706-4fe5-b401-8a3a9f271be1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:24.227323 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-51014575-b706-4fe5-b401-8a3a9f271be1 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1504 microversion: 2.1 time: 0.165421 Aug 02 07:51:24.227952 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3494/7061] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:24 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:24.251852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8b49f401-73f8-45f5-9aa3-01fcf12eb1c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:24.252441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8b49f401-73f8-45f5-9aa3-01fcf12eb1c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:24.259282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b49f401-73f8-45f5-9aa3-01fcf12eb1c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.259743 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b49f401-73f8-45f5-9aa3-01fcf12eb1c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.260531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b49f401-73f8-45f5-9aa3-01fcf12eb1c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.260973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b49f401-73f8-45f5-9aa3-01fcf12eb1c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.405256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8b49f401-73f8-45f5-9aa3-01fcf12eb1c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:24.415758 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8b49f401-73f8-45f5-9aa3-01fcf12eb1c9 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1504 microversion: 2.1 time: 0.167565 Aug 02 07:51:24.416442 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3568/7062] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:24 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:24.443278 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0a171e5d-8995-4088-ac92-7da43a404222 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0a171e5d-8995-4088-ac92-7da43a404222 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Request method failure captured: Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: request: POST /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551/action HTTP/1.1 Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 29 Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Ndgdi8sx_cxBZO3vt2umvTWJSPFuZ0XuWO_x2f_Ny9geQ0mlUMHjYKCuSIHqmHZar2XuAuWFufXPrZwuKAGC7kZp5PxFAUG1BfBjX5f77UgYJwzX48Nkkx-vO0L9VxxgzpQQXUFh9i_SYD5qmiATalW4FMnMFtvIe2CcuWQWM6_kjQ Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 886bf3a7986b40fda0845b34d75671e0 Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/886bf3a7986b40fda0845b34d75671e0"}]}] Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 886bf3a7986b40fda0845b34d75671e0 Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-504497565-project Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 50e96ab6d59d4fb9a8b10fd54b0ef1d8 Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-504497565-project Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: {"resize": {"flavorRef": ""}} Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'f8c3b956-7a44-473c-afe1-f342e1bc3551', 'body': {'resize': {'flavorRef': ''}}} Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise error Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi '' Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.448091 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:51:24.452490 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.452490 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:24.452490 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:51:24.452490 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:51:24.452490 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 07:51:24.452490 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 07:51:24.452490 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 02 07:51:24.452490 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.452490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0a171e5d-8995-4088-ac92-7da43a404222 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:51:24.452490 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0a171e5d-8995-4088-ac92-7da43a404222 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "POST /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551/action" status: 400 len: 113 microversion: 2.1 time: 0.012051 Aug 02 07:51:24.452490 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3495/7063] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:51:24 2022] POST /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551/action => generated 113 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 07:51:24.459514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-32624b3f-fedd-44fc-b7b8-aa3a319ff9e8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:24.460136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-32624b3f-fedd-44fc-b7b8-aa3a319ff9e8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:24.466475 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32624b3f-fedd-44fc-b7b8-aa3a319ff9e8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.466896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32624b3f-fedd-44fc-b7b8-aa3a319ff9e8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.467691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32624b3f-fedd-44fc-b7b8-aa3a319ff9e8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.468153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32624b3f-fedd-44fc-b7b8-aa3a319ff9e8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.620918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-32624b3f-fedd-44fc-b7b8-aa3a319ff9e8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:24.628815 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-32624b3f-fedd-44fc-b7b8-aa3a319ff9e8 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1504 microversion: 2.1 time: 0.174113 Aug 02 07:51:24.629767 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3569/7064] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:24 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:24.654330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5e94ccb6-3625-44f9-b65b-87a8b489743e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:24.654868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5e94ccb6-3625-44f9-b65b-87a8b489743e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:24.662635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e94ccb6-3625-44f9-b65b-87a8b489743e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.663100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e94ccb6-3625-44f9-b65b-87a8b489743e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.663878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e94ccb6-3625-44f9-b65b-87a8b489743e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.664326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5e94ccb6-3625-44f9-b65b-87a8b489743e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.678080 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-5e94ccb6-3625-44f9-b65b-87a8b489743e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] HTTP exception thrown: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5e94ccb6-3625-44f9-b65b-87a8b489743e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Request method failure captured: Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 HTTP/1.1 Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Ndgdi8sx_cxBZO3vt2umvTWJSPFuZ0XuWO_x2f_Ny9geQ0mlUMHjYKCuSIHqmHZar2XuAuWFufXPrZwuKAGC7kZp5PxFAUG1BfBjX5f77UgYJwzX48Nkkx-vO0L9VxxgzpQQXUFh9i_SYD5qmiATalW4FMnMFtvIe2CcuWQWM6_kjQ Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 886bf3a7986b40fda0845b34d75671e0 Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/886bf3a7986b40fda0845b34d75671e0"}]}] Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 886bf3a7986b40fda0845b34d75671e0 Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-504497565-project Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 50e96ab6d59d4fb9a8b10fd54b0ef1d8 Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-504497565-project Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '33064608-d76f-43bf-9f68-09d323844e59'} Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:51:24.679585 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:51:24.682691 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:24.682691 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.682691 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:51:24.682691 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.682691 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:24.682691 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:51:24.682691 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:51:24.682691 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:51:24.682691 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:51:24.682691 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:24.682691 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.682691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5e94ccb6-3625-44f9-b65b-87a8b489743e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Returning 404 to user: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:51:24.682691 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5e94ccb6-3625-44f9-b65b-87a8b489743e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "DELETE /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 404 len: 111 microversion: 2.1 time: 0.031584 Aug 02 07:51:24.682691 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3496/7065] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:51:24 2022] DELETE /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:51:24.689819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-81ad3c0c-cfe1-491f-8afc-4e802c4d7aec tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:24.690470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-81ad3c0c-cfe1-491f-8afc-4e802c4d7aec tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: 33064608-d76f-43bf-9f68-09d323844e59] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:24.697138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81ad3c0c-cfe1-491f-8afc-4e802c4d7aec tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.697610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81ad3c0c-cfe1-491f-8afc-4e802c4d7aec tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.698393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81ad3c0c-cfe1-491f-8afc-4e802c4d7aec tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.698833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-81ad3c0c-cfe1-491f-8afc-4e802c4d7aec tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.712738 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-81ad3c0c-cfe1-491f-8afc-4e802c4d7aec tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] HTTP exception thrown: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-81ad3c0c-cfe1-491f-8afc-4e802c4d7aec tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Request method failure captured: Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 HTTP/1.1 Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Ndgdi8sx_cxBZO3vt2umvTWJSPFuZ0XuWO_x2f_Ny9geQ0mlUMHjYKCuSIHqmHZar2XuAuWFufXPrZwuKAGC7kZp5PxFAUG1BfBjX5f77UgYJwzX48Nkkx-vO0L9VxxgzpQQXUFh9i_SYD5qmiATalW4FMnMFtvIe2CcuWQWM6_kjQ Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 886bf3a7986b40fda0845b34d75671e0 Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/886bf3a7986b40fda0845b34d75671e0"}]}] Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 886bf3a7986b40fda0845b34d75671e0 Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-ServersNegativeTestJSON-504497565-project Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 50e96ab6d59d4fb9a8b10fd54b0ef1d8 Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-ServersNegativeTestJSON-504497565-project Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '33064608-d76f-43bf-9f68-09d323844e59'} Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:51:24.714393 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.718510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:24.718510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:51:24.718510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:51:24.718510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:51:24.718510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:51:24.718510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. Aug 02 07:51:24.718510 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:51:24.718510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-81ad3c0c-cfe1-491f-8afc-4e802c4d7aec tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Returning 404 to user: Instance 33064608-d76f-43bf-9f68-09d323844e59 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:51:24.718510 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-81ad3c0c-cfe1-491f-8afc-4e802c4d7aec tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59" status: 404 len: 111 microversion: 2.1 time: 0.029907 Aug 02 07:51:24.718510 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3570/7066] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:24 2022] GET /compute/v2.1/servers/33064608-d76f-43bf-9f68-09d323844e59 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:51:24.724840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15b3ef27-3ffe-4647-83bc-e3144222796e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:24.725354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-15b3ef27-3ffe-4647-83bc-e3144222796e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:24.732425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15b3ef27-3ffe-4647-83bc-e3144222796e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.732890 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15b3ef27-3ffe-4647-83bc-e3144222796e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.733659 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15b3ef27-3ffe-4647-83bc-e3144222796e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.734138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15b3ef27-3ffe-4647-83bc-e3144222796e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.761141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-15b3ef27-3ffe-4647-83bc-e3144222796e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:51:24.850506 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-15b3ef27-3ffe-4647-83bc-e3144222796e tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 204 len: 0 microversion: 2.1 time: 0.129220 Aug 02 07:51:24.851277 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3497/7067] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:51:24 2022] DELETE /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:51:24.859801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5148ef20-8e6e-48ab-bb7b-3d77cc4233c4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:24.860419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5148ef20-8e6e-48ab-bb7b-3d77cc4233c4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:24.866874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5148ef20-8e6e-48ab-bb7b-3d77cc4233c4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.867357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5148ef20-8e6e-48ab-bb7b-3d77cc4233c4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:24.868182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5148ef20-8e6e-48ab-bb7b-3d77cc4233c4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:24.868672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5148ef20-8e6e-48ab-bb7b-3d77cc4233c4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:25.033611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5148ef20-8e6e-48ab-bb7b-3d77cc4233c4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:25.044500 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5148ef20-8e6e-48ab-bb7b-3d77cc4233c4 tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1510 microversion: 2.1 time: 0.188465 Aug 02 07:51:25.045604 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3571/7068] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:24 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:26.069053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3d1cf912-79e3-42c6-8e25-aea673b3e49f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:26.069767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3d1cf912-79e3-42c6-8e25-aea673b3e49f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:26.077307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d1cf912-79e3-42c6-8e25-aea673b3e49f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:26.077771 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d1cf912-79e3-42c6-8e25-aea673b3e49f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:26.078596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d1cf912-79e3-42c6-8e25-aea673b3e49f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:26.079035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d1cf912-79e3-42c6-8e25-aea673b3e49f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:26.084036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:51:26.276468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3d1cf912-79e3-42c6-8e25-aea673b3e49f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e96ab6d59d4fb9a8b10fd54b0ef1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886bf3a7986b40fda0845b34d75671e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:51:26.284669 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3d1cf912-79e3-42c6-8e25-aea673b3e49f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 200 len: 1510 microversion: 2.1 time: 0.219992 Aug 02 07:51:26.285360 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3498/7069] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:26 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:51:26.690740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-a800e874-d39f-489b-b8c3-d4f60b2dc1bb req-c765280b-f544-4d97-9561-7f64553d7440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8c3b956-7a44-473c-afe1-f342e1bc3551", "name": "network-vif-deleted", "tag": "cb884f18-fb80-4d2d-9ac5-85c89b08c8d7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:51:26.701247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a800e874-d39f-489b-b8c3-d4f60b2dc1bb req-c765280b-f544-4d97-9561-7f64553d7440 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:26.701688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-a800e874-d39f-489b-b8c3-d4f60b2dc1bb req-c765280b-f544-4d97-9561-7f64553d7440 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:26.715240 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-a800e874-d39f-489b-b8c3-d4f60b2dc1bb req-c765280b-f544-4d97-9561-7f64553d7440 service nova] Creating event network-vif-deleted:cb884f18-fb80-4d2d-9ac5-85c89b08c8d7 for instance f8c3b956-7a44-473c-afe1-f342e1bc3551 on n-h2-851337-3 Aug 02 07:51:26.720733 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-a800e874-d39f-489b-b8c3-d4f60b2dc1bb req-c765280b-f544-4d97-9561-7f64553d7440 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033609 Aug 02 07:51:26.721388 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3572/7070] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:51:27.309134 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-165660aa-cd1c-4ea4-bf78-d6a7c955589f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:51:27.310028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-165660aa-cd1c-4ea4-bf78-d6a7c955589f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] [instance: f8c3b956-7a44-473c-afe1-f342e1bc3551] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:51:27.314113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:51:27.322524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-165660aa-cd1c-4ea4-bf78-d6a7c955589f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:27.323187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-165660aa-cd1c-4ea4-bf78-d6a7c955589f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:27.324301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-165660aa-cd1c-4ea4-bf78-d6a7c955589f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:51:27.324986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-165660aa-cd1c-4ea4-bf78-d6a7c955589f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:51:27.343617 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-165660aa-cd1c-4ea4-bf78-d6a7c955589f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] HTTP exception thrown: Instance f8c3b956-7a44-473c-afe1-f342e1bc3551 could not be found. Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-165660aa-cd1c-4ea4-bf78-d6a7c955589f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Request method failure captured: Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 HTTP/1.1 Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6Ndgdi8sx_cxBZO3vt2umvTWJSPFuZ0XuWO_x2f_Ny9geQ0mlUMHjYKCuSIHqmHZar2XuAuWFufXPrZwuKAGC7kZp5PxFAUG1BfBjX5f77UgYJwzX48Nkkx-vO0L9VxxgzpQQXUFh9i_SYD5qmiATalW4FMnMFtvIe2CcuWQWM6_kjQ Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 886bf3a7986b40fda0845b34d75671e0 Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_886bf3a7986b40fda0845b34d75671e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/886bf3a7986b40fda0845b34d75671e0"}]}] Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 886bf3a7986b40fda0845b34d75671e0 Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-ServersNegativeTestJSON-504497565 Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-ServersNegativeTestJSON-504497565-project Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 50e96ab6d59d4fb9a8b10fd54b0ef1d8 Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-ServersNegativeTestJSON-504497565-project Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance f8c3b956-7a44-473c-afe1-f342e1bc3551 could not be found. Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'f8c3b956-7a44-473c-afe1-f342e1bc3551'} Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8c3b956-7a44-473c-afe1-f342e1bc3551 could not be found. Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8c3b956-7a44-473c-afe1-f342e1bc3551 could not be found. Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:51:27.345298 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:27.350462 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:51:27.350462 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:51:27.350462 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:51:27.350462 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:51:27.350462 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:51:27.350462 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8c3b956-7a44-473c-afe1-f342e1bc3551 could not be found. Aug 02 07:51:27.350462 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:51:27.350462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-165660aa-cd1c-4ea4-bf78-d6a7c955589f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] Returning 404 to user: Instance f8c3b956-7a44-473c-afe1-f342e1bc3551 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:51:27.350462 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-165660aa-cd1c-4ea4-bf78-d6a7c955589f tempest-ServersNegativeTestJSON-504497565 tempest-ServersNegativeTestJSON-504497565-project] 10.222.0.79 "GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551" status: 404 len: 111 microversion: 2.1 time: 0.043766 Aug 02 07:51:27.350462 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3499/7071] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:51:27 2022] GET /compute/v2.1/servers/f8c3b956-7a44-473c-afe1-f342e1bc3551 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:52:03.702647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:52:03.703572 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=24 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:52:03.944938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-71f5b581-9a52-4bfe-89e1-d3ed45a761a1 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Action: 'create', calling method: .version_select at 0x7f928c27a430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2009590575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwtjd478ZM6Fc8JDlVnIhAUxOW15DuENTF71h5UJaXFYgXg0xLx4l3ZDigDHnb2NLMcd01hgCOAxf2zwQS6HVUxdFRST3MsO9yupkLFOl1RXQw7tmllyNTPDO6yUihCHA=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:52:03.962282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-71f5b581-9a52-4bfe-89e1-d3ed45a761a1 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Getting quotas for project ec1f157bb1714147b20c874723c97478. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:52:03.968309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-71f5b581-9a52-4bfe-89e1-d3ed45a761a1 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Getting quotas for user b1a33055a7d7429dbf7e4590de2e605f and project ec1f157bb1714147b20c874723c97478. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:52:03.998174 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-71f5b581-9a52-4bfe-89e1-d3ed45a761a1 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.298430 Aug 02 07:52:03.998796 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3573/7072] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:52:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:52:04.067276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-50135088", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2009590575", "networks": [{"uuid": "c17ffa28-374c-42cb-9f03-ae5c3d01dca9"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:52:04.077180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:52:04.077929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:52:04.129526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] validate_networks() for [('c17ffa28-374c-42cb-9f03-ae5c3d01dca9', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:52:04.549678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:52:04.550150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:52:04.550736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:52:04.551165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:52:04.551593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:52:04.561331 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:04.561796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:04.562672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:04.563158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:04.581661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Getting quotas for project ec1f157bb1714147b20c874723c97478. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:52:04.587422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Getting quotas for user b1a33055a7d7429dbf7e4590de2e605f and project ec1f157bb1714147b20c874723c97478. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:52:04.603012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:52:04.605387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:52:04.656746 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-60ef6d7f-ed2e-4aee-adcd-26b39e6d03df tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593745 Aug 02 07:52:04.657587 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3500/7073] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:52:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:52:04.671252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-81a68692-078d-450d-bad6-a005ebe83294 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:04.672198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-81a68692-078d-450d-bad6-a005ebe83294 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:04.740052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-81a68692-078d-450d-bad6-a005ebe83294 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:04.750238 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-81a68692-078d-450d-bad6-a005ebe83294 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 200 len: 1261 microversion: 2.1 time: 0.084920 Aug 02 07:52:04.751758 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3574/7074] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:04 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:05.780232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a154952c-51e8-4704-b223-446fc47ee7b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:05.782617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a154952c-51e8-4704-b223-446fc47ee7b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:05.795588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a154952c-51e8-4704-b223-446fc47ee7b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:05.796980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a154952c-51e8-4704-b223-446fc47ee7b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:05.798665 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a154952c-51e8-4704-b223-446fc47ee7b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:05.799201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a154952c-51e8-4704-b223-446fc47ee7b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:05.896971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a154952c-51e8-4704-b223-446fc47ee7b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:05.906292 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a154952c-51e8-4704-b223-446fc47ee7b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 200 len: 1331 microversion: 2.1 time: 0.137094 Aug 02 07:52:05.906950 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3501/7075] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:05 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:06.932286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-93bfd7f0-0e2c-422f-a85d-ca6103fa8572 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:06.933394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-93bfd7f0-0e2c-422f-a85d-ca6103fa8572 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:06.940980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93bfd7f0-0e2c-422f-a85d-ca6103fa8572 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:06.941570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93bfd7f0-0e2c-422f-a85d-ca6103fa8572 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:06.942532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93bfd7f0-0e2c-422f-a85d-ca6103fa8572 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:06.943237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93bfd7f0-0e2c-422f-a85d-ca6103fa8572 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:07.194151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-93bfd7f0-0e2c-422f-a85d-ca6103fa8572 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:07.205298 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-93bfd7f0-0e2c-422f-a85d-ca6103fa8572 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 200 len: 1361 microversion: 2.1 time: 0.278503 Aug 02 07:52:07.206315 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3575/7076] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:06 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:07.301989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-768218c0-0fde-4502-98d1-3faddc768f11 req-91ef7af1-78dd-4022-b1a4-990b6ca078a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4d2054b-2131-4fd9-9758-c11a7822869b", "tag": "7042edc5-226a-4d8f-b908-878110421081"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:52:07.314311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-768218c0-0fde-4502-98d1-3faddc768f11 req-91ef7af1-78dd-4022-b1a4-990b6ca078a7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:07.315001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-768218c0-0fde-4502-98d1-3faddc768f11 req-91ef7af1-78dd-4022-b1a4-990b6ca078a7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:07.331044 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-768218c0-0fde-4502-98d1-3faddc768f11 req-91ef7af1-78dd-4022-b1a4-990b6ca078a7 service nova] Creating event network-changed:7042edc5-226a-4d8f-b908-878110421081 for instance f4d2054b-2131-4fd9-9758-c11a7822869b on n-h2-851337-3 Aug 02 07:52:07.337054 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-768218c0-0fde-4502-98d1-3faddc768f11 req-91ef7af1-78dd-4022-b1a4-990b6ca078a7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040951 Aug 02 07:52:07.337678 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3502/7077] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:52:08.231095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b07f1874-8b16-466b-9100-627872b86565 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:08.231809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b07f1874-8b16-466b-9100-627872b86565 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:08.240734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b07f1874-8b16-466b-9100-627872b86565 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:08.241173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b07f1874-8b16-466b-9100-627872b86565 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:08.241935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b07f1874-8b16-466b-9100-627872b86565 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:08.242365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b07f1874-8b16-466b-9100-627872b86565 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:08.385963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b07f1874-8b16-466b-9100-627872b86565 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:08.394709 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b07f1874-8b16-466b-9100-627872b86565 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 200 len: 1361 microversion: 2.1 time: 0.169912 Aug 02 07:52:08.395296 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3576/7078] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:08 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:09.415688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3fffa6bc-f4ef-4c23-9be6-15f9747a2155 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:09.416379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3fffa6bc-f4ef-4c23-9be6-15f9747a2155 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:09.424096 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fffa6bc-f4ef-4c23-9be6-15f9747a2155 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:09.424550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fffa6bc-f4ef-4c23-9be6-15f9747a2155 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:09.425377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fffa6bc-f4ef-4c23-9be6-15f9747a2155 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:09.426070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3fffa6bc-f4ef-4c23-9be6-15f9747a2155 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:09.573815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3fffa6bc-f4ef-4c23-9be6-15f9747a2155 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:09.581876 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3fffa6bc-f4ef-4c23-9be6-15f9747a2155 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 200 len: 1361 microversion: 2.1 time: 0.170457 Aug 02 07:52:09.595604 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3503/7079] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:09 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:10.605624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3ea3d7e2-8f89-4cf7-befc-1932bc9c1ba8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:10.606383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3ea3d7e2-8f89-4cf7-befc-1932bc9c1ba8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:10.614058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ea3d7e2-8f89-4cf7-befc-1932bc9c1ba8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:10.614514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ea3d7e2-8f89-4cf7-befc-1932bc9c1ba8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:10.615262 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ea3d7e2-8f89-4cf7-befc-1932bc9c1ba8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:10.615728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3ea3d7e2-8f89-4cf7-befc-1932bc9c1ba8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:10.758063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3ea3d7e2-8f89-4cf7-befc-1932bc9c1ba8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:10.768082 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3ea3d7e2-8f89-4cf7-befc-1932bc9c1ba8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 200 len: 1361 microversion: 2.1 time: 0.168336 Aug 02 07:52:10.768673 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3577/7080] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:10 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:11.789569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b679a25d-f20c-40bc-84c0-ebf4cbadc497 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:11.790286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b679a25d-f20c-40bc-84c0-ebf4cbadc497 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:11.797858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b679a25d-f20c-40bc-84c0-ebf4cbadc497 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:11.798287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b679a25d-f20c-40bc-84c0-ebf4cbadc497 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:11.799058 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b679a25d-f20c-40bc-84c0-ebf4cbadc497 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:11.799498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b679a25d-f20c-40bc-84c0-ebf4cbadc497 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:11.959905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b679a25d-f20c-40bc-84c0-ebf4cbadc497 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:11.968750 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b679a25d-f20c-40bc-84c0-ebf4cbadc497 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 200 len: 1361 microversion: 2.1 time: 0.183321 Aug 02 07:52:11.969307 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3504/7081] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:11 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:12.419699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ef6bdecb-cfb4-4a6a-a264-93c3507cf917 req-f8ea4e81-f078-48cb-b9dd-f6b734736fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d2054b-2131-4fd9-9758-c11a7822869b", "name": "network-vif-plugged", "status": "completed", "tag": "7042edc5-226a-4d8f-b908-878110421081"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:52:12.432895 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ef6bdecb-cfb4-4a6a-a264-93c3507cf917 req-f8ea4e81-f078-48cb-b9dd-f6b734736fbc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:12.433410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ef6bdecb-cfb4-4a6a-a264-93c3507cf917 req-f8ea4e81-f078-48cb-b9dd-f6b734736fbc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:12.447342 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ef6bdecb-cfb4-4a6a-a264-93c3507cf917 req-f8ea4e81-f078-48cb-b9dd-f6b734736fbc service nova] Creating event network-vif-plugged:7042edc5-226a-4d8f-b908-878110421081 for instance f4d2054b-2131-4fd9-9758-c11a7822869b on n-h2-851337-3 Aug 02 07:52:12.452654 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ef6bdecb-cfb4-4a6a-a264-93c3507cf917 req-f8ea4e81-f078-48cb-b9dd-f6b734736fbc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037372 Aug 02 07:52:12.453348 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3578/7082] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:52:12.991089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9935e670-bfb7-4c6d-9d6b-fdee221ee9f4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:12.991712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9935e670-bfb7-4c6d-9d6b-fdee221ee9f4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:13.002157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9935e670-bfb7-4c6d-9d6b-fdee221ee9f4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:13.002880 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9935e670-bfb7-4c6d-9d6b-fdee221ee9f4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:13.004221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9935e670-bfb7-4c6d-9d6b-fdee221ee9f4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:13.004664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9935e670-bfb7-4c6d-9d6b-fdee221ee9f4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:13.142157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9935e670-bfb7-4c6d-9d6b-fdee221ee9f4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:13.150426 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9935e670-bfb7-4c6d-9d6b-fdee221ee9f4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 200 len: 1361 microversion: 2.1 time: 0.163675 Aug 02 07:52:13.151009 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3505/7083] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:12 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:14.175243 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4d9e9cf4-5bd5-490c-92ef-2be5169de4cc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:14.175954 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4d9e9cf4-5bd5-490c-92ef-2be5169de4cc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:14.182914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d9e9cf4-5bd5-490c-92ef-2be5169de4cc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:14.183367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d9e9cf4-5bd5-490c-92ef-2be5169de4cc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:14.184148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d9e9cf4-5bd5-490c-92ef-2be5169de4cc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:14.184591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4d9e9cf4-5bd5-490c-92ef-2be5169de4cc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:14.331786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4d9e9cf4-5bd5-490c-92ef-2be5169de4cc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:14.340818 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4d9e9cf4-5bd5-490c-92ef-2be5169de4cc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 200 len: 1553 microversion: 2.1 time: 0.172147 Aug 02 07:52:14.341431 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3579/7084] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:14 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:14.364441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-45f84907-ad3b-4dc8-863f-287f648a29c1 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:14.365047 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-45f84907-ad3b-4dc8-863f-287f648a29c1 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:14.372029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45f84907-ad3b-4dc8-863f-287f648a29c1 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:14.372480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45f84907-ad3b-4dc8-863f-287f648a29c1 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:14.373257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45f84907-ad3b-4dc8-863f-287f648a29c1 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:14.373703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-45f84907-ad3b-4dc8-863f-287f648a29c1 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:14.521918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-45f84907-ad3b-4dc8-863f-287f648a29c1 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:14.533481 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-45f84907-ad3b-4dc8-863f-287f648a29c1 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 200 len: 1553 microversion: 2.1 time: 0.173028 Aug 02 07:52:14.534749 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3506/7085] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:14 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:16.323524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9a911964-8738-4f07-ace9-2c840278b1a9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d8c8ce7-9dd0-40df-a60d-9cc5729bb70f"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:52:16.325919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9a911964-8738-4f07-ace9-2c840278b1a9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:16.327995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:52:16.334499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a911964-8738-4f07-ace9-2c840278b1a9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:16.334947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a911964-8738-4f07-ace9-2c840278b1a9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:16.335736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a911964-8738-4f07-ace9-2c840278b1a9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:16.336172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9a911964-8738-4f07-ace9-2c840278b1a9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:16.608770 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9a911964-8738-4f07-ace9-2c840278b1a9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "POST /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289196 Aug 02 07:52:16.609447 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3580/7086] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:52:16 2022] POST /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:52:27.390286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1ea8806-5403-4f3e-9aa7-69f3a19a72ae tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:27.390857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b1ea8806-5403-4f3e-9aa7-69f3a19a72ae tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:27.392896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:52:27.393585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:52:27.395326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:52:27.396017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=34 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:52:27.403756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1ea8806-5403-4f3e-9aa7-69f3a19a72ae tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:27.404218 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1ea8806-5403-4f3e-9aa7-69f3a19a72ae tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:27.405017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1ea8806-5403-4f3e-9aa7-69f3a19a72ae tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:27.405462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1ea8806-5403-4f3e-9aa7-69f3a19a72ae tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:27.494750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-b1ea8806-5403-4f3e-9aa7-69f3a19a72ae tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lazy-loading 'services' on Instance uuid f4d2054b-2131-4fd9-9758-c11a7822869b {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:52:27.581802 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b1ea8806-5403-4f3e-9aa7-69f3a19a72ae tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments/3d8c8ce7-9dd0-40df-a60d-9cc5729bb70f" status: 202 len: 0 microversion: 2.1 time: 0.195457 Aug 02 07:52:27.582489 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3507/7087] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:52:27 2022] DELETE /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments/3d8c8ce7-9dd0-40df-a60d-9cc5729bb70f => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:52:27.590014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:52:27.591078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:52:27.596452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b6f77264-304a-4a74-b8ff-e33e0eb6cb72 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:27.599148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b6f77264-304a-4a74-b8ff-e33e0eb6cb72 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:27.608674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6f77264-304a-4a74-b8ff-e33e0eb6cb72 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:27.609133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6f77264-304a-4a74-b8ff-e33e0eb6cb72 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:27.609943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6f77264-304a-4a74-b8ff-e33e0eb6cb72 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:27.610388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6f77264-304a-4a74-b8ff-e33e0eb6cb72 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:27.643561 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b6f77264-304a-4a74-b8ff-e33e0eb6cb72 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055508 Aug 02 07:52:27.644137 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3581/7088] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:52:27 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:52:28.658154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-aec85335-a492-4820-9eca-04d411498eda tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:28.660936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-aec85335-a492-4820-9eca-04d411498eda tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:28.667782 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aec85335-a492-4820-9eca-04d411498eda tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:28.668245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aec85335-a492-4820-9eca-04d411498eda tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:28.669029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aec85335-a492-4820-9eca-04d411498eda tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:28.669477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-aec85335-a492-4820-9eca-04d411498eda tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:28.700667 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-aec85335-a492-4820-9eca-04d411498eda tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047871 Aug 02 07:52:28.701511 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3508/7089] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:52:28 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:52:29.714516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4866c362-0a6f-4ee9-a931-143569b7fd99 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:29.716806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4866c362-0a6f-4ee9-a931-143569b7fd99 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:29.726728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4866c362-0a6f-4ee9-a931-143569b7fd99 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:29.727319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4866c362-0a6f-4ee9-a931-143569b7fd99 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:29.728443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4866c362-0a6f-4ee9-a931-143569b7fd99 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:29.729094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4866c362-0a6f-4ee9-a931-143569b7fd99 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:29.764411 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4866c362-0a6f-4ee9-a931-143569b7fd99 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055477 Aug 02 07:52:29.764956 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3582/7090] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:52:29 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:52:30.778629 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-630dff35-0584-47e4-a26a-78c0004b5d67 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:30.780801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-630dff35-0584-47e4-a26a-78c0004b5d67 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:30.788087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-630dff35-0584-47e4-a26a-78c0004b5d67 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:30.788543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-630dff35-0584-47e4-a26a-78c0004b5d67 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:30.789311 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-630dff35-0584-47e4-a26a-78c0004b5d67 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:30.789748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-630dff35-0584-47e4-a26a-78c0004b5d67 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:30.823907 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-630dff35-0584-47e4-a26a-78c0004b5d67 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049348 Aug 02 07:52:30.824479 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3509/7091] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:52:30 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:52:31.836444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5bde9b65-c26e-40c2-a1c8-ad43caebad2f tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:31.839327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5bde9b65-c26e-40c2-a1c8-ad43caebad2f tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:31.849866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bde9b65-c26e-40c2-a1c8-ad43caebad2f tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:31.849866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bde9b65-c26e-40c2-a1c8-ad43caebad2f tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:31.850718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bde9b65-c26e-40c2-a1c8-ad43caebad2f tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:31.851161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bde9b65-c26e-40c2-a1c8-ad43caebad2f tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:31.885096 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5bde9b65-c26e-40c2-a1c8-ad43caebad2f tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052387 Aug 02 07:52:31.886077 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3583/7092] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:52:31 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:52:32.899709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c2033d4e-9339-4752-b457-60912bd12047 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:32.902048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c2033d4e-9339-4752-b457-60912bd12047 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:32.909263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2033d4e-9339-4752-b457-60912bd12047 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:32.909729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2033d4e-9339-4752-b457-60912bd12047 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:32.910584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2033d4e-9339-4752-b457-60912bd12047 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:32.911038 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c2033d4e-9339-4752-b457-60912bd12047 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:32.941418 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c2033d4e-9339-4752-b457-60912bd12047 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045925 Aug 02 07:52:32.942069 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3510/7093] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:52:32 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:52:32.952888 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a526b13c-4370-4639-bef3-f2dccd653d47 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:32.953399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a526b13c-4370-4639-bef3-f2dccd653d47 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:32.960526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a526b13c-4370-4639-bef3-f2dccd653d47 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:32.960984 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a526b13c-4370-4639-bef3-f2dccd653d47 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:32.961847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a526b13c-4370-4639-bef3-f2dccd653d47 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:32.962319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a526b13c-4370-4639-bef3-f2dccd653d47 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:33.050234 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-a526b13c-4370-4639-bef3-f2dccd653d47 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] HTTP exception thrown: Instance f4d2054b-2131-4fd9-9758-c11a7822869b is not attached to volume 3d8c8ce7-9dd0-40df-a60d-9cc5729bb70f Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a526b13c-4370-4639-bef3-f2dccd653d47 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Request method failure captured: Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments/3d8c8ce7-9dd0-40df-a60d-9cc5729bb70f HTTP/1.1 Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NeeNyIj5luQ_WpPzOeZWJDeNOegScwqfvMDRUTMYNwRC8TGXMepYGKEsZM2eI9INargLb2-q9Pkb039Htieq9P3-2-Gqo4FHIoHwftT1D1yFATErInZy_46NrR_upUrfDG38ZrsVyRgrU0X-DJgpOI4hpkvFq2mlxexiJz4JHZSufc Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: ec1f157bb1714147b20c874723c97478 Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ec1f157bb1714147b20c874723c97478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec1f157bb1714147b20c874723c97478"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ec1f157bb1714147b20c874723c97478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec1f157bb1714147b20c874723c97478"}]}] Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: ec1f157bb1714147b20c874723c97478 Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestEncryptedCinderVolumes-854212237-project Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b1a33055a7d7429dbf7e4590de2e605f Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestEncryptedCinderVolumes-854212237-project Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance f4d2054b-2131-4fd9-9758-c11a7822869b is not attached to volume 3d8c8ce7-9dd0-40df-a60d-9cc5729bb70f Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'server_id': 'f4d2054b-2131-4fd9-9758-c11a7822869b', 'id': '3d8c8ce7-9dd0-40df-a60d-9cc5729bb70f'} Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3d8c8ce7-9dd0-40df-a60d-9cc5729bb70f. Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d2054b-2131-4fd9-9758-c11a7822869b is not attached to volume 3d8c8ce7-9dd0-40df-a60d-9cc5729bb70f Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:52:33.063587 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:52:33.068765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:52:33.068765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:52:33.068765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d2054b-2131-4fd9-9758-c11a7822869b is not attached to volume 3d8c8ce7-9dd0-40df-a60d-9cc5729bb70f Aug 02 07:52:33.068765 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:52:33.068765 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a526b13c-4370-4639-bef3-f2dccd653d47 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Returning 404 to user: Instance f4d2054b-2131-4fd9-9758-c11a7822869b is not attached to volume 3d8c8ce7-9dd0-40df-a60d-9cc5729bb70f {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:52:33.068765 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a526b13c-4370-4639-bef3-f2dccd653d47 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments/3d8c8ce7-9dd0-40df-a60d-9cc5729bb70f" status: 404 len: 154 microversion: 2.1 time: 0.116686 Aug 02 07:52:33.068765 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3584/7094] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:52:32 2022] DELETE /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b/os-volume_attachments/3d8c8ce7-9dd0-40df-a60d-9cc5729bb70f => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:52:36.436479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ada45652-bd3a-4050-b0a9-05ee0855df9e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:36.437000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ada45652-bd3a-4050-b0a9-05ee0855df9e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:36.444583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ada45652-bd3a-4050-b0a9-05ee0855df9e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:36.445043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ada45652-bd3a-4050-b0a9-05ee0855df9e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:36.445815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ada45652-bd3a-4050-b0a9-05ee0855df9e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:36.446290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ada45652-bd3a-4050-b0a9-05ee0855df9e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:36.472721 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ada45652-bd3a-4050-b0a9-05ee0855df9e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:52:36.561130 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ada45652-bd3a-4050-b0a9-05ee0855df9e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 204 len: 0 microversion: 2.1 time: 0.127718 Aug 02 07:52:36.561383 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3511/7095] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:52:36 2022] DELETE /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:52:36.571959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1e568419-8782-47a5-b9b3-9cc0a25a0810 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:36.572541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1e568419-8782-47a5-b9b3-9cc0a25a0810 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:36.580162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e568419-8782-47a5-b9b3-9cc0a25a0810 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:36.580607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e568419-8782-47a5-b9b3-9cc0a25a0810 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:36.581377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e568419-8782-47a5-b9b3-9cc0a25a0810 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:36.581813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1e568419-8782-47a5-b9b3-9cc0a25a0810 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:36.722931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1e568419-8782-47a5-b9b3-9cc0a25a0810 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:36.732746 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1e568419-8782-47a5-b9b3-9cc0a25a0810 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 200 len: 1559 microversion: 2.1 time: 0.166541 Aug 02 07:52:36.733330 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3585/7096] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:36 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:52:37.755627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-de838428-adf5-44fa-9662-c31fe0376881 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:37.756216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-de838428-adf5-44fa-9662-c31fe0376881 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:37.763868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de838428-adf5-44fa-9662-c31fe0376881 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:37.764325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de838428-adf5-44fa-9662-c31fe0376881 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:37.765127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de838428-adf5-44fa-9662-c31fe0376881 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:37.765553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de838428-adf5-44fa-9662-c31fe0376881 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:37.905301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-de838428-adf5-44fa-9662-c31fe0376881 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:37.914421 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-de838428-adf5-44fa-9662-c31fe0376881 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 200 len: 1559 microversion: 2.1 time: 0.163588 Aug 02 07:52:37.915000 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3512/7097] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:37 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:38.554964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e0266972-c2d4-4e04-b207-9efe581638ef req-4216cc1b-1bee-499d-90d6-913ed2299c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d2054b-2131-4fd9-9758-c11a7822869b", "name": "network-vif-deleted", "tag": "7042edc5-226a-4d8f-b908-878110421081"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:52:38.567848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e0266972-c2d4-4e04-b207-9efe581638ef req-4216cc1b-1bee-499d-90d6-913ed2299c15 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:38.568648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e0266972-c2d4-4e04-b207-9efe581638ef req-4216cc1b-1bee-499d-90d6-913ed2299c15 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:38.584078 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e0266972-c2d4-4e04-b207-9efe581638ef req-4216cc1b-1bee-499d-90d6-913ed2299c15 service nova] Creating event network-vif-deleted:7042edc5-226a-4d8f-b908-878110421081 for instance f4d2054b-2131-4fd9-9758-c11a7822869b on n-h2-851337-3 Aug 02 07:52:38.589401 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e0266972-c2d4-4e04-b207-9efe581638ef req-4216cc1b-1bee-499d-90d6-913ed2299c15 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038246 Aug 02 07:52:38.590046 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3586/7098] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:52:38.937692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-00e4aeaa-618b-4253-9701-66025e54ebd7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:38.939189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-00e4aeaa-618b-4253-9701-66025e54ebd7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:38.947678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00e4aeaa-618b-4253-9701-66025e54ebd7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:38.948139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00e4aeaa-618b-4253-9701-66025e54ebd7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:38.948963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00e4aeaa-618b-4253-9701-66025e54ebd7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:38.949676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00e4aeaa-618b-4253-9701-66025e54ebd7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:38.998046 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00e4aeaa-618b-4253-9701-66025e54ebd7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:38.998679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-00e4aeaa-618b-4253-9701-66025e54ebd7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:38.999153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-00e4aeaa-618b-4253-9701-66025e54ebd7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lazy-loading 'fault' on Instance uuid f4d2054b-2131-4fd9-9758-c11a7822869b {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:52:39.048127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-00e4aeaa-618b-4253-9701-66025e54ebd7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:39.055420 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-00e4aeaa-618b-4253-9701-66025e54ebd7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 200 len: 1351 microversion: 2.1 time: 0.121831 Aug 02 07:52:39.055909 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3513/7099] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:38 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 1351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:40.078748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e41df368-3881-4848-b215-aa2d43c36b34 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:40.079491 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e41df368-3881-4848-b215-aa2d43c36b34 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: f4d2054b-2131-4fd9-9758-c11a7822869b] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:40.086380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e41df368-3881-4848-b215-aa2d43c36b34 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:40.086883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e41df368-3881-4848-b215-aa2d43c36b34 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:40.087664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e41df368-3881-4848-b215-aa2d43c36b34 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:40.088097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e41df368-3881-4848-b215-aa2d43c36b34 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:40.102405 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-e41df368-3881-4848-b215-aa2d43c36b34 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] HTTP exception thrown: Instance f4d2054b-2131-4fd9-9758-c11a7822869b could not be found. Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e41df368-3881-4848-b215-aa2d43c36b34 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Request method failure captured: Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b HTTP/1.1 Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NeeNyIj5luQ_WpPzOeZWJDeNOegScwqfvMDRUTMYNwRC8TGXMepYGKEsZM2eI9INargLb2-q9Pkb039Htieq9P3-2-Gqo4FHIoHwftT1D1yFATErInZy_46NrR_upUrfDG38ZrsVyRgrU0X-DJgpOI4hpkvFq2mlxexiJz4JHZSufc Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: ec1f157bb1714147b20c874723c97478 Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ec1f157bb1714147b20c874723c97478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec1f157bb1714147b20c874723c97478"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ec1f157bb1714147b20c874723c97478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec1f157bb1714147b20c874723c97478"}]}] Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: ec1f157bb1714147b20c874723c97478 Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestEncryptedCinderVolumes-854212237-project Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: b1a33055a7d7429dbf7e4590de2e605f Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestEncryptedCinderVolumes-854212237-project Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance f4d2054b-2131-4fd9-9758-c11a7822869b could not be found. Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'f4d2054b-2131-4fd9-9758-c11a7822869b'} Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d2054b-2131-4fd9-9758-c11a7822869b could not be found. Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d2054b-2131-4fd9-9758-c11a7822869b could not be found. Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:52:40.103999 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:52:40.107872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:52:40.107872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:52:40.107872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:52:40.107872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:52:40.107872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:52:40.107872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d2054b-2131-4fd9-9758-c11a7822869b could not be found. Aug 02 07:52:40.107872 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:52:40.107872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e41df368-3881-4848-b215-aa2d43c36b34 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Returning 404 to user: Instance f4d2054b-2131-4fd9-9758-c11a7822869b could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:52:40.107872 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e41df368-3881-4848-b215-aa2d43c36b34 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b" status: 404 len: 111 microversion: 2.1 time: 0.032005 Aug 02 07:52:40.107872 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3587/7100] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:40 2022] GET /compute/v2.1/servers/f4d2054b-2131-4fd9-9758-c11a7822869b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:52:40.115562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-32f3a1b0-b608-4a0e-9934-2c0aa1141066 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '.version_select at 0x7f927afbbd30>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:40.121354 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [None req-32f3a1b0-b608-4a0e-9934-2c0aa1141066 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [af7f37fb-ea4c-4e48-9dc2-e8e7aa30923e] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 07:52:41.130675 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [None req-32f3a1b0-b608-4a0e-9934-2c0aa1141066 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [af7f37fb-ea4c-4e48-9dc2-e8e7aa30923e] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 37814. Aug 02 07:52:41.152724 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-32f3a1b0-b608-4a0e-9934-2c0aa1141066 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2009590575" status: 202 len: 0 microversion: 2.1 time: 1.041302 Aug 02 07:52:41.153328 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3514/7101] 10.222.0.79 () {58 vars in 1278 bytes} [Tue Aug 2 07:52:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2009590575 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:52:41.170695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-085a508d-3428-49f5-a9e9-516b93d8df02 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Action: 'create', calling method: .version_select at 0x7f927a82f820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-103497774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYsY+W59e6Y9vbTZLe12h68Vq9pTvzWsOma6lyskVDpgKofJnjM0kmPvlFCIOE941zB2Q1MbA1K/CrTyW+WiwpVZaKeU5dZY6MpilkwCtw9PvlDvfjUaAXSya2a70AuEA=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:52:41.188369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-085a508d-3428-49f5-a9e9-516b93d8df02 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Getting quotas for project ec1f157bb1714147b20c874723c97478. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:52:41.195178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-085a508d-3428-49f5-a9e9-516b93d8df02 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Getting quotas for user b1a33055a7d7429dbf7e4590de2e605f and project ec1f157bb1714147b20c874723c97478. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:52:41.221190 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-085a508d-3428-49f5-a9e9-516b93d8df02 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.055002 Aug 02 07:52:41.221811 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3588/7102] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:52:41 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:52:41.274839 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1767056345", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-103497774", "networks": [{"uuid": "c17ffa28-374c-42cb-9f03-ae5c3d01dca9"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:52:41.331911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] validate_networks() for [('c17ffa28-374c-42cb-9f03-ae5c3d01dca9', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:52:41.742678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:52:41.743182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:52:41.743670 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:52:41.744094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:52:41.744524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:52:41.754348 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:41.754799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:41.755610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:41.756052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:41.778037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Getting quotas for project ec1f157bb1714147b20c874723c97478. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:52:41.783836 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Getting quotas for user b1a33055a7d7429dbf7e4590de2e605f and project ec1f157bb1714147b20c874723c97478. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:52:41.797735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:52:41.800176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:52:41.847696 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fe4f8852-f338-4547-a7e1-4338720798d4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576848 Aug 02 07:52:41.848367 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3515/7103] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:52:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:52:41.859624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fe1602d2-1b7d-4789-8af4-ef01eb82be61 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:41.860241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fe1602d2-1b7d-4789-8af4-ef01eb82be61 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:41.918188 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fe1602d2-1b7d-4789-8af4-ef01eb82be61 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:41.925361 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fe1602d2-1b7d-4789-8af4-ef01eb82be61 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc" status: 200 len: 1262 microversion: 2.1 time: 0.069811 Aug 02 07:52:41.925953 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3589/7104] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:41 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:42.947972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8a66c357-060d-46c5-9920-88e7bb2cebd5 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:42.949328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8a66c357-060d-46c5-9920-88e7bb2cebd5 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:42.955948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a66c357-060d-46c5-9920-88e7bb2cebd5 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:42.956698 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a66c357-060d-46c5-9920-88e7bb2cebd5 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:42.957871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a66c357-060d-46c5-9920-88e7bb2cebd5 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:42.958555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8a66c357-060d-46c5-9920-88e7bb2cebd5 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:43.046365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8a66c357-060d-46c5-9920-88e7bb2cebd5 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:43.054796 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8a66c357-060d-46c5-9920-88e7bb2cebd5 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc" status: 200 len: 1332 microversion: 2.1 time: 0.111914 Aug 02 07:52:43.055426 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3516/7105] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:42 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:44.077609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ce72a30d-b69f-4f51-bea0-8c9dda7e9c92 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:44.077992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ce72a30d-b69f-4f51-bea0-8c9dda7e9c92 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:44.085693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce72a30d-b69f-4f51-bea0-8c9dda7e9c92 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:44.086315 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce72a30d-b69f-4f51-bea0-8c9dda7e9c92 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:44.087135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce72a30d-b69f-4f51-bea0-8c9dda7e9c92 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:44.087612 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ce72a30d-b69f-4f51-bea0-8c9dda7e9c92 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:44.282680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ce72a30d-b69f-4f51-bea0-8c9dda7e9c92 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:44.291517 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ce72a30d-b69f-4f51-bea0-8c9dda7e9c92 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc" status: 200 len: 1362 microversion: 2.1 time: 0.219019 Aug 02 07:52:44.292585 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3590/7106] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:44 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:44.314141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e365a0ee-e3c7-4a9e-bb39-f67e324c4ca6 req-30020605-ee9f-4e32-adb1-3be9b2edd1fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da809341-a4f1-45f8-bb2b-bc0d4bd52edc", "tag": "915d3b0b-f7cc-4697-8eed-d086c0fe8025"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:52:44.333043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e365a0ee-e3c7-4a9e-bb39-f67e324c4ca6 req-30020605-ee9f-4e32-adb1-3be9b2edd1fd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:44.333494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e365a0ee-e3c7-4a9e-bb39-f67e324c4ca6 req-30020605-ee9f-4e32-adb1-3be9b2edd1fd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:44.359974 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e365a0ee-e3c7-4a9e-bb39-f67e324c4ca6 req-30020605-ee9f-4e32-adb1-3be9b2edd1fd service nova] Creating event network-changed:915d3b0b-f7cc-4697-8eed-d086c0fe8025 for instance da809341-a4f1-45f8-bb2b-bc0d4bd52edc on n-h2-851337-3 Aug 02 07:52:44.365142 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e365a0ee-e3c7-4a9e-bb39-f67e324c4ca6 req-30020605-ee9f-4e32-adb1-3be9b2edd1fd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061529 Aug 02 07:52:44.372823 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3517/7107] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:52:45.317129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-966c1465-1d24-4e1c-99c9-154c2caa0ff6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:45.317951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-966c1465-1d24-4e1c-99c9-154c2caa0ff6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:45.327999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-966c1465-1d24-4e1c-99c9-154c2caa0ff6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:45.328688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-966c1465-1d24-4e1c-99c9-154c2caa0ff6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:45.329478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-966c1465-1d24-4e1c-99c9-154c2caa0ff6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:45.330132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-966c1465-1d24-4e1c-99c9-154c2caa0ff6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:45.470918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-966c1465-1d24-4e1c-99c9-154c2caa0ff6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:45.479501 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-966c1465-1d24-4e1c-99c9-154c2caa0ff6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc" status: 200 len: 1362 microversion: 2.1 time: 0.168463 Aug 02 07:52:45.480079 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3591/7108] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:45 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:46.502572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1015faf4-cfa9-4873-92d4-5be3f3afbbc8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:46.504050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1015faf4-cfa9-4873-92d4-5be3f3afbbc8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:46.510924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1015faf4-cfa9-4873-92d4-5be3f3afbbc8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:46.511516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1015faf4-cfa9-4873-92d4-5be3f3afbbc8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:46.512234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1015faf4-cfa9-4873-92d4-5be3f3afbbc8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:46.512711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1015faf4-cfa9-4873-92d4-5be3f3afbbc8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:46.664652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1015faf4-cfa9-4873-92d4-5be3f3afbbc8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:46.674325 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1015faf4-cfa9-4873-92d4-5be3f3afbbc8 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc" status: 200 len: 1362 microversion: 2.1 time: 0.177608 Aug 02 07:52:46.675008 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3518/7109] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:46 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:47.254754 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:52:47.255322 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 07:52:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:52:47.695701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b8fc8416-aaa7-475b-ae08-097c5b24f28c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:47.696327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b8fc8416-aaa7-475b-ae08-097c5b24f28c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:47.704391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8fc8416-aaa7-475b-ae08-097c5b24f28c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:47.704839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8fc8416-aaa7-475b-ae08-097c5b24f28c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:47.705646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8fc8416-aaa7-475b-ae08-097c5b24f28c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:47.706120 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8fc8416-aaa7-475b-ae08-097c5b24f28c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:47.843403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b8fc8416-aaa7-475b-ae08-097c5b24f28c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:47.857384 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b8fc8416-aaa7-475b-ae08-097c5b24f28c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc" status: 200 len: 1362 microversion: 2.1 time: 0.165438 Aug 02 07:52:47.861157 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3592/7110] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:47 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:48.603570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-ac92eaee-ea9e-4e16-aa13-4a4c02942d08 req-43bce132-7f0d-4224-bcc0-155eef58f6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da809341-a4f1-45f8-bb2b-bc0d4bd52edc", "name": "network-vif-plugged", "status": "completed", "tag": "915d3b0b-f7cc-4697-8eed-d086c0fe8025"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:52:48.615387 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ac92eaee-ea9e-4e16-aa13-4a4c02942d08 req-43bce132-7f0d-4224-bcc0-155eef58f6a9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:48.615970 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-ac92eaee-ea9e-4e16-aa13-4a4c02942d08 req-43bce132-7f0d-4224-bcc0-155eef58f6a9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:48.628259 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-ac92eaee-ea9e-4e16-aa13-4a4c02942d08 req-43bce132-7f0d-4224-bcc0-155eef58f6a9 service nova] Creating event network-vif-plugged:915d3b0b-f7cc-4697-8eed-d086c0fe8025 for instance da809341-a4f1-45f8-bb2b-bc0d4bd52edc on n-h2-851337-3 Aug 02 07:52:48.634196 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-ac92eaee-ea9e-4e16-aa13-4a4c02942d08 req-43bce132-7f0d-4224-bcc0-155eef58f6a9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034678 Aug 02 07:52:48.634831 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3519/7111] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:52:48.881991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2384cb70-5a91-4662-bc93-1fea5ee5ae13 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:48.882738 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2384cb70-5a91-4662-bc93-1fea5ee5ae13 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:48.892293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2384cb70-5a91-4662-bc93-1fea5ee5ae13 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:48.892820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2384cb70-5a91-4662-bc93-1fea5ee5ae13 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:48.893593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2384cb70-5a91-4662-bc93-1fea5ee5ae13 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:48.894169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2384cb70-5a91-4662-bc93-1fea5ee5ae13 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:49.029989 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2384cb70-5a91-4662-bc93-1fea5ee5ae13 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:49.039561 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2384cb70-5a91-4662-bc93-1fea5ee5ae13 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc" status: 200 len: 1362 microversion: 2.1 time: 0.162483 Aug 02 07:52:49.040177 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3593/7112] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:48 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:50.063219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3b2c62e7-75ab-419a-9841-44b53595204e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:50.063920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3b2c62e7-75ab-419a-9841-44b53595204e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:50.071187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b2c62e7-75ab-419a-9841-44b53595204e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:50.071644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b2c62e7-75ab-419a-9841-44b53595204e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:50.072473 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b2c62e7-75ab-419a-9841-44b53595204e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:50.073170 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b2c62e7-75ab-419a-9841-44b53595204e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:50.208788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3b2c62e7-75ab-419a-9841-44b53595204e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:50.217615 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3b2c62e7-75ab-419a-9841-44b53595204e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc" status: 200 len: 1555 microversion: 2.1 time: 0.160239 Aug 02 07:52:50.218347 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3520/7113] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:50 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:50.238256 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-611c62e9-858e-4171-b7e9-ccac7bdfc345 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:52:50.238836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-611c62e9-858e-4171-b7e9-ccac7bdfc345 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:50.246174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-611c62e9-858e-4171-b7e9-ccac7bdfc345 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:50.246625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-611c62e9-858e-4171-b7e9-ccac7bdfc345 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:50.247408 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-611c62e9-858e-4171-b7e9-ccac7bdfc345 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:50.247848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-611c62e9-858e-4171-b7e9-ccac7bdfc345 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:50.399668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-611c62e9-858e-4171-b7e9-ccac7bdfc345 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:52:50.408531 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-611c62e9-858e-4171-b7e9-ccac7bdfc345 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc" status: 200 len: 1555 microversion: 2.1 time: 0.174225 Aug 02 07:52:50.409052 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3594/7114] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:52:50 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:52:51.939119 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e48e57df-786f-4671-9814-fbde7a575191 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "308fd0cc-c530-4295-a2bf-3fd8a2b33be0"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:52:51.941549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e48e57df-786f-4671-9814-fbde7a575191 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:52:51.944537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:52:51.945258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:52:51.951801 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e48e57df-786f-4671-9814-fbde7a575191 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:51.952266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e48e57df-786f-4671-9814-fbde7a575191 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:51.953057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e48e57df-786f-4671-9814-fbde7a575191 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:52:51.953501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e48e57df-786f-4671-9814-fbde7a575191 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:52:52.243978 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e48e57df-786f-4671-9814-fbde7a575191 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "POST /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308707 Aug 02 07:52:52.244785 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3521/7115] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:52:51 2022] POST /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:03.043990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e0639b8f-b4cd-4501-bd59-4aa16b0d5b82 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:03.044645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e0639b8f-b4cd-4501-bd59-4aa16b0d5b82 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:03.047627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:53:03.048507 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:53:03.049331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=64 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:53:03.056029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0639b8f-b4cd-4501-bd59-4aa16b0d5b82 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:03.056527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0639b8f-b4cd-4501-bd59-4aa16b0d5b82 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:03.057330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0639b8f-b4cd-4501-bd59-4aa16b0d5b82 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:03.057814 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0639b8f-b4cd-4501-bd59-4aa16b0d5b82 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:03.146696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-e0639b8f-b4cd-4501-bd59-4aa16b0d5b82 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lazy-loading 'services' on Instance uuid da809341-a4f1-45f8-bb2b-bc0d4bd52edc {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:53:03.227245 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e0639b8f-b4cd-4501-bd59-4aa16b0d5b82 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "DELETE /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments/308fd0cc-c530-4295-a2bf-3fd8a2b33be0" status: 202 len: 0 microversion: 2.1 time: 0.187274 Aug 02 07:53:03.227991 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3595/7116] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:53:03 2022] DELETE /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments/308fd0cc-c530-4295-a2bf-3fd8a2b33be0 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:53:03.236286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:53:03.237569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:53:03.243287 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3cf2c1c4-bf69-4b98-99b5-63fa4e45f015 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:03.246154 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3cf2c1c4-bf69-4b98-99b5-63fa4e45f015 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:03.255426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cf2c1c4-bf69-4b98-99b5-63fa4e45f015 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:03.255965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cf2c1c4-bf69-4b98-99b5-63fa4e45f015 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:03.256827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cf2c1c4-bf69-4b98-99b5-63fa4e45f015 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:03.257364 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cf2c1c4-bf69-4b98-99b5-63fa4e45f015 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:03.304460 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3cf2c1c4-bf69-4b98-99b5-63fa4e45f015 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070738 Aug 02 07:53:03.305115 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3522/7117] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:53:03 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:04.320298 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1d59e1ca-5d23-44f9-8026-e4e700844ad6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:04.322825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1d59e1ca-5d23-44f9-8026-e4e700844ad6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:04.330083 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d59e1ca-5d23-44f9-8026-e4e700844ad6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:04.330534 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d59e1ca-5d23-44f9-8026-e4e700844ad6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:04.331330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d59e1ca-5d23-44f9-8026-e4e700844ad6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:04.331800 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1d59e1ca-5d23-44f9-8026-e4e700844ad6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:04.363607 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1d59e1ca-5d23-44f9-8026-e4e700844ad6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048898 Aug 02 07:53:04.364181 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3596/7118] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:53:04 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:05.376246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7105fa69-fcb5-4344-b765-46d0966fc997 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:05.379008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7105fa69-fcb5-4344-b765-46d0966fc997 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:05.386709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7105fa69-fcb5-4344-b765-46d0966fc997 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:05.387166 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7105fa69-fcb5-4344-b765-46d0966fc997 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:05.387956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7105fa69-fcb5-4344-b765-46d0966fc997 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:05.388401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7105fa69-fcb5-4344-b765-46d0966fc997 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:05.423787 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7105fa69-fcb5-4344-b765-46d0966fc997 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051691 Aug 02 07:53:05.424802 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3523/7119] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:53:05 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:06.436669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a2db39b9-63b6-49db-8801-b155fb42c6e3 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:06.438924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a2db39b9-63b6-49db-8801-b155fb42c6e3 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:06.447818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a2db39b9-63b6-49db-8801-b155fb42c6e3 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:06.448276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a2db39b9-63b6-49db-8801-b155fb42c6e3 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:06.449157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a2db39b9-63b6-49db-8801-b155fb42c6e3 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:06.449591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a2db39b9-63b6-49db-8801-b155fb42c6e3 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:06.480838 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a2db39b9-63b6-49db-8801-b155fb42c6e3 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048588 Aug 02 07:53:06.481427 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3597/7120] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:53:06 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:07.494105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8ab0903d-52e8-44a1-8657-05483f93f2ff tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:07.496745 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8ab0903d-52e8-44a1-8657-05483f93f2ff tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:07.505092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ab0903d-52e8-44a1-8657-05483f93f2ff tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:07.505645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ab0903d-52e8-44a1-8657-05483f93f2ff tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:07.506639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ab0903d-52e8-44a1-8657-05483f93f2ff tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:07.507090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8ab0903d-52e8-44a1-8657-05483f93f2ff tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:07.540476 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8ab0903d-52e8-44a1-8657-05483f93f2ff tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050633 Aug 02 07:53:07.541055 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3524/7121] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:53:07 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:08.553546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc83ffbc-5ac3-4ef8-966f-39e09dad3820 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:08.555807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bc83ffbc-5ac3-4ef8-966f-39e09dad3820 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:08.562690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc83ffbc-5ac3-4ef8-966f-39e09dad3820 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:08.563142 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc83ffbc-5ac3-4ef8-966f-39e09dad3820 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:08.563918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc83ffbc-5ac3-4ef8-966f-39e09dad3820 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:08.564347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc83ffbc-5ac3-4ef8-966f-39e09dad3820 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:08.595206 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc83ffbc-5ac3-4ef8-966f-39e09dad3820 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046090 Aug 02 07:53:08.595793 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3598/7122] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:53:08 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:53:08.607307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7dc044ff-b95b-43df-9ac9-b182652113fb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:08.607863 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7dc044ff-b95b-43df-9ac9-b182652113fb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:08.615647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7dc044ff-b95b-43df-9ac9-b182652113fb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:08.616117 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7dc044ff-b95b-43df-9ac9-b182652113fb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:08.616932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7dc044ff-b95b-43df-9ac9-b182652113fb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:08.617379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7dc044ff-b95b-43df-9ac9-b182652113fb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:08.700552 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-7dc044ff-b95b-43df-9ac9-b182652113fb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] HTTP exception thrown: Instance da809341-a4f1-45f8-bb2b-bc0d4bd52edc is not attached to volume 308fd0cc-c530-4295-a2bf-3fd8a2b33be0 Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7dc044ff-b95b-43df-9ac9-b182652113fb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Request method failure captured: Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments/308fd0cc-c530-4295-a2bf-3fd8a2b33be0 HTTP/1.1 Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NeeNyIj5luQ_WpPzOeZWJDeNOegScwqfvMDRUTMYNwRC8TGXMepYGKEsZM2eI9INargLb2-q9Pkb039Htieq9P3-2-Gqo4FHIoHwftT1D1yFATErInZy_46NrR_upUrfDG38ZrsVyRgrU0X-DJgpOI4hpkvFq2mlxexiJz4JHZSufc Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: ec1f157bb1714147b20c874723c97478 Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ec1f157bb1714147b20c874723c97478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec1f157bb1714147b20c874723c97478"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ec1f157bb1714147b20c874723c97478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec1f157bb1714147b20c874723c97478"}]}] Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: ec1f157bb1714147b20c874723c97478 Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestEncryptedCinderVolumes-854212237-project Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b1a33055a7d7429dbf7e4590de2e605f Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestEncryptedCinderVolumes-854212237-project Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance da809341-a4f1-45f8-bb2b-bc0d4bd52edc is not attached to volume 308fd0cc-c530-4295-a2bf-3fd8a2b33be0 Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'server_id': 'da809341-a4f1-45f8-bb2b-bc0d4bd52edc', 'id': '308fd0cc-c530-4295-a2bf-3fd8a2b33be0'} Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 308fd0cc-c530-4295-a2bf-3fd8a2b33be0. Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da809341-a4f1-45f8-bb2b-bc0d4bd52edc is not attached to volume 308fd0cc-c530-4295-a2bf-3fd8a2b33be0 Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:53:08.702696 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:53:08.706516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:53:08.706516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:53:08.706516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da809341-a4f1-45f8-bb2b-bc0d4bd52edc is not attached to volume 308fd0cc-c530-4295-a2bf-3fd8a2b33be0 Aug 02 07:53:08.706516 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:08.706516 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7dc044ff-b95b-43df-9ac9-b182652113fb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Returning 404 to user: Instance da809341-a4f1-45f8-bb2b-bc0d4bd52edc is not attached to volume 308fd0cc-c530-4295-a2bf-3fd8a2b33be0 {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:53:08.706516 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7dc044ff-b95b-43df-9ac9-b182652113fb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "DELETE /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments/308fd0cc-c530-4295-a2bf-3fd8a2b33be0" status: 404 len: 154 microversion: 2.1 time: 0.101311 Aug 02 07:53:08.706516 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3525/7123] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:53:08 2022] DELETE /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc/os-volume_attachments/308fd0cc-c530-4295-a2bf-3fd8a2b33be0 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:53:12.095099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d63f7905-3271-4647-b21b-eefd03a6b1f7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:12.095776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d63f7905-3271-4647-b21b-eefd03a6b1f7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:12.103361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d63f7905-3271-4647-b21b-eefd03a6b1f7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:12.103712 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d63f7905-3271-4647-b21b-eefd03a6b1f7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:12.104510 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d63f7905-3271-4647-b21b-eefd03a6b1f7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:12.104947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d63f7905-3271-4647-b21b-eefd03a6b1f7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:12.139399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d63f7905-3271-4647-b21b-eefd03a6b1f7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:53:12.244910 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d63f7905-3271-4647-b21b-eefd03a6b1f7 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "DELETE /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc" status: 204 len: 0 microversion: 2.1 time: 0.152306 Aug 02 07:53:12.250217 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3599/7124] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:53:12 2022] DELETE /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:53:12.256946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-53bafd1e-c2f8-4cd6-b6c4-ff8b72bfba59 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:12.257695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-53bafd1e-c2f8-4cd6-b6c4-ff8b72bfba59 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:12.265352 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53bafd1e-c2f8-4cd6-b6c4-ff8b72bfba59 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:12.265927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53bafd1e-c2f8-4cd6-b6c4-ff8b72bfba59 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:12.266790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53bafd1e-c2f8-4cd6-b6c4-ff8b72bfba59 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:12.267305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-53bafd1e-c2f8-4cd6-b6c4-ff8b72bfba59 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:12.413851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-53bafd1e-c2f8-4cd6-b6c4-ff8b72bfba59 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:12.422342 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-53bafd1e-c2f8-4cd6-b6c4-ff8b72bfba59 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc" status: 200 len: 1561 microversion: 2.1 time: 0.170625 Aug 02 07:53:12.422905 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3526/7125] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:12 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:13.444939 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a645b502-9b21-45ec-97a4-9ec2c6c294de tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:13.446338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a645b502-9b21-45ec-97a4-9ec2c6c294de tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:13.455202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a645b502-9b21-45ec-97a4-9ec2c6c294de tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:13.455647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a645b502-9b21-45ec-97a4-9ec2c6c294de tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:13.456918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a645b502-9b21-45ec-97a4-9ec2c6c294de tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:13.457397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a645b502-9b21-45ec-97a4-9ec2c6c294de tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:13.616253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a645b502-9b21-45ec-97a4-9ec2c6c294de tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:13.625308 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a645b502-9b21-45ec-97a4-9ec2c6c294de tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc" status: 200 len: 1561 microversion: 2.1 time: 0.184811 Aug 02 07:53:13.625916 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3600/7126] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:13 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:14.292758 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-12747e9c-889c-4d84-8858-b6d39be882a4 req-f1d636af-b22d-4eb0-bd6e-2339cdd1e133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da809341-a4f1-45f8-bb2b-bc0d4bd52edc", "name": "network-vif-deleted", "tag": "915d3b0b-f7cc-4697-8eed-d086c0fe8025"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:53:14.304722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-12747e9c-889c-4d84-8858-b6d39be882a4 req-f1d636af-b22d-4eb0-bd6e-2339cdd1e133 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:14.305230 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-12747e9c-889c-4d84-8858-b6d39be882a4 req-f1d636af-b22d-4eb0-bd6e-2339cdd1e133 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:14.323941 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-12747e9c-889c-4d84-8858-b6d39be882a4 req-f1d636af-b22d-4eb0-bd6e-2339cdd1e133 service nova] Creating event network-vif-deleted:915d3b0b-f7cc-4697-8eed-d086c0fe8025 for instance da809341-a4f1-45f8-bb2b-bc0d4bd52edc on n-h2-851337-3 Aug 02 07:53:14.329579 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-12747e9c-889c-4d84-8858-b6d39be882a4 req-f1d636af-b22d-4eb0-bd6e-2339cdd1e133 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040513 Aug 02 07:53:14.330226 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3527/7127] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:14.647663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-55a6ef52-649b-41ac-a0c5-3e014cc9dc38 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:14.648278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-55a6ef52-649b-41ac-a0c5-3e014cc9dc38 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:14.655470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55a6ef52-649b-41ac-a0c5-3e014cc9dc38 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:14.655923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55a6ef52-649b-41ac-a0c5-3e014cc9dc38 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:14.656683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55a6ef52-649b-41ac-a0c5-3e014cc9dc38 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:14.657134 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55a6ef52-649b-41ac-a0c5-3e014cc9dc38 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:14.689753 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55a6ef52-649b-41ac-a0c5-3e014cc9dc38 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:14.690231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-55a6ef52-649b-41ac-a0c5-3e014cc9dc38 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:14.690688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-55a6ef52-649b-41ac-a0c5-3e014cc9dc38 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lazy-loading 'fault' on Instance uuid da809341-a4f1-45f8-bb2b-bc0d4bd52edc {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:53:14.736498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-55a6ef52-649b-41ac-a0c5-3e014cc9dc38 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:14.745535 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-55a6ef52-649b-41ac-a0c5-3e014cc9dc38 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc" status: 200 len: 1352 microversion: 2.1 time: 0.101929 Aug 02 07:53:14.746251 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3601/7128] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:14 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:15.769032 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72da2a86-2dce-427b-aad6-03cc5697bd46 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:15.769770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-72da2a86-2dce-427b-aad6-03cc5697bd46 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: da809341-a4f1-45f8-bb2b-bc0d4bd52edc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:15.776706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72da2a86-2dce-427b-aad6-03cc5697bd46 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:15.777141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72da2a86-2dce-427b-aad6-03cc5697bd46 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:15.777973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72da2a86-2dce-427b-aad6-03cc5697bd46 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:15.778454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72da2a86-2dce-427b-aad6-03cc5697bd46 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:15.793280 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-72da2a86-2dce-427b-aad6-03cc5697bd46 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] HTTP exception thrown: Instance da809341-a4f1-45f8-bb2b-bc0d4bd52edc could not be found. Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72da2a86-2dce-427b-aad6-03cc5697bd46 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Request method failure captured: Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc HTTP/1.1 Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NeeNyIj5luQ_WpPzOeZWJDeNOegScwqfvMDRUTMYNwRC8TGXMepYGKEsZM2eI9INargLb2-q9Pkb039Htieq9P3-2-Gqo4FHIoHwftT1D1yFATErInZy_46NrR_upUrfDG38ZrsVyRgrU0X-DJgpOI4hpkvFq2mlxexiJz4JHZSufc Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: ec1f157bb1714147b20c874723c97478 Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ec1f157bb1714147b20c874723c97478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec1f157bb1714147b20c874723c97478"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ec1f157bb1714147b20c874723c97478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec1f157bb1714147b20c874723c97478"}]}] Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: ec1f157bb1714147b20c874723c97478 Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestEncryptedCinderVolumes-854212237-project Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b1a33055a7d7429dbf7e4590de2e605f Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestEncryptedCinderVolumes-854212237-project Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance da809341-a4f1-45f8-bb2b-bc0d4bd52edc could not be found. Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'da809341-a4f1-45f8-bb2b-bc0d4bd52edc'} Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da809341-a4f1-45f8-bb2b-bc0d4bd52edc could not be found. Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da809341-a4f1-45f8-bb2b-bc0d4bd52edc could not be found. Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:53:15.794990 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:15.798507 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:53:15.798507 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:53:15.798507 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:53:15.798507 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:53:15.798507 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:53:15.798507 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da809341-a4f1-45f8-bb2b-bc0d4bd52edc could not be found. Aug 02 07:53:15.798507 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:15.798507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72da2a86-2dce-427b-aad6-03cc5697bd46 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Returning 404 to user: Instance da809341-a4f1-45f8-bb2b-bc0d4bd52edc could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:53:15.798507 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-72da2a86-2dce-427b-aad6-03cc5697bd46 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc" status: 404 len: 111 microversion: 2.1 time: 0.032739 Aug 02 07:53:15.798507 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3528/7129] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:15 2022] GET /compute/v2.1/servers/da809341-a4f1-45f8-bb2b-bc0d4bd52edc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:53:15.807764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b2dbae46-ad54-440e-9b04-3bca23655812 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '.version_select at 0x7f927a836700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:15.831801 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b2dbae46-ad54-440e-9b04-3bca23655812 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-103497774" status: 202 len: 0 microversion: 2.1 time: 0.029225 Aug 02 07:53:15.832404 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3602/7130] 10.222.0.79 () {58 vars in 1275 bytes} [Tue Aug 2 07:53:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-103497774 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:53:15.849299 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0c2e5c9d-dac6-4897-b813-12e7757ab1b6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Action: 'create', calling method: .version_select at 0x7f927aad7ca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1385380334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAbJQLdDW2qj6nrIoF+0DaivFLkBFdo2VlI4c+GhRHwSvjLI7ZFPGmt4mPOkcl72d9NTC9DLxu9sBVlIyaxuwLZramjZ+47MzD1k44O4HOrePgoOx2EZ/3d+KrHacyDLg=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:53:15.867231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-0c2e5c9d-dac6-4897-b813-12e7757ab1b6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Getting quotas for project ec1f157bb1714147b20c874723c97478. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:53:15.876468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-0c2e5c9d-dac6-4897-b813-12e7757ab1b6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Getting quotas for user b1a33055a7d7429dbf7e4590de2e605f and project ec1f157bb1714147b20c874723c97478. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:53:15.901578 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0c2e5c9d-dac6-4897-b813-12e7757ab1b6 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.056663 Aug 02 07:53:15.902201 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3529/7131] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:53:15 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:15.954045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1951922919", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1385380334", "networks": [{"uuid": "c17ffa28-374c-42cb-9f03-ae5c3d01dca9"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:53:16.012951 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] validate_networks() for [('c17ffa28-374c-42cb-9f03-ae5c3d01dca9', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:53:16.544701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:53:16.545105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:53:16.545581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:53:16.546140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:53:16.546557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:53:16.556641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:16.557089 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:16.557930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:16.558374 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:16.578348 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Getting quotas for project ec1f157bb1714147b20c874723c97478. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:53:16.584297 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Getting quotas for user b1a33055a7d7429dbf7e4590de2e605f and project ec1f157bb1714147b20c874723c97478. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:53:16.598455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:53:16.600793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:53:16.651457 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-10930f9e-c797-4cf6-a867-1419ddfe2153 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701294 Aug 02 07:53:16.652142 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3603/7132] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:53:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:53:16.669383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a249b958-efb2-45dc-a596-6a27d5e58e4d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:16.670139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a249b958-efb2-45dc-a596-6a27d5e58e4d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:16.727396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a249b958-efb2-45dc-a596-6a27d5e58e4d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:16.736607 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a249b958-efb2-45dc-a596-6a27d5e58e4d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 200 len: 1263 microversion: 2.1 time: 0.072730 Aug 02 07:53:16.737354 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3530/7133] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:16 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 1263 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:17.759833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ae653083-8a46-4d34-acec-e4646913ea1d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:17.760376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ae653083-8a46-4d34-acec-e4646913ea1d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:17.767677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae653083-8a46-4d34-acec-e4646913ea1d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:17.768218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae653083-8a46-4d34-acec-e4646913ea1d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:17.769245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae653083-8a46-4d34-acec-e4646913ea1d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:17.769751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ae653083-8a46-4d34-acec-e4646913ea1d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:18.197521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ae653083-8a46-4d34-acec-e4646913ea1d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:18.205345 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ae653083-8a46-4d34-acec-e4646913ea1d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 200 len: 1333 microversion: 2.1 time: 0.450610 Aug 02 07:53:18.206025 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3604/7134] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:17 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 1333 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:19.227039 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-60d404e3-da8a-4a99-987c-2548db89dbbc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:19.227907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-60d404e3-da8a-4a99-987c-2548db89dbbc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:19.235277 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60d404e3-da8a-4a99-987c-2548db89dbbc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:19.235728 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60d404e3-da8a-4a99-987c-2548db89dbbc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:19.236506 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60d404e3-da8a-4a99-987c-2548db89dbbc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:19.236921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-60d404e3-da8a-4a99-987c-2548db89dbbc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:19.436960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-60d404e3-da8a-4a99-987c-2548db89dbbc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:19.446592 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-60d404e3-da8a-4a99-987c-2548db89dbbc tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 200 len: 1363 microversion: 2.1 time: 0.223019 Aug 02 07:53:19.447530 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3531/7135] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:19 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:19.461575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-cdf91cb9-0ccb-4dd5-a170-9663d64b67fa req-7f38ca26-25ad-4448-bb6b-83dbd71b94cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077", "tag": "14c63c31-7dac-480b-a0d2-57cec97f6831"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:53:19.475578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-cdf91cb9-0ccb-4dd5-a170-9663d64b67fa req-7f38ca26-25ad-4448-bb6b-83dbd71b94cf service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:19.476039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-cdf91cb9-0ccb-4dd5-a170-9663d64b67fa req-7f38ca26-25ad-4448-bb6b-83dbd71b94cf service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:19.488031 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-cdf91cb9-0ccb-4dd5-a170-9663d64b67fa req-7f38ca26-25ad-4448-bb6b-83dbd71b94cf service nova] Creating event network-changed:14c63c31-7dac-480b-a0d2-57cec97f6831 for instance df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 on n-h2-851337-3 Aug 02 07:53:19.493290 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-cdf91cb9-0ccb-4dd5-a170-9663d64b67fa req-7f38ca26-25ad-4448-bb6b-83dbd71b94cf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046409 Aug 02 07:53:19.493761 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3605/7136] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:53:20.473004 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f207e753-8f03-4663-8281-299ecf5b607b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:20.473703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f207e753-8f03-4663-8281-299ecf5b607b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:20.481261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f207e753-8f03-4663-8281-299ecf5b607b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:20.481735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f207e753-8f03-4663-8281-299ecf5b607b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:20.482557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f207e753-8f03-4663-8281-299ecf5b607b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:20.483015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f207e753-8f03-4663-8281-299ecf5b607b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:20.660577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f207e753-8f03-4663-8281-299ecf5b607b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:20.671406 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f207e753-8f03-4663-8281-299ecf5b607b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 200 len: 1363 microversion: 2.1 time: 0.202365 Aug 02 07:53:20.672025 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3532/7137] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:20 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:53:21.700660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e1bd479a-c4ed-47ce-8b09-19ab966d1c91 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:21.701377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e1bd479a-c4ed-47ce-8b09-19ab966d1c91 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:21.708096 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1bd479a-c4ed-47ce-8b09-19ab966d1c91 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:21.708537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1bd479a-c4ed-47ce-8b09-19ab966d1c91 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:21.709303 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1bd479a-c4ed-47ce-8b09-19ab966d1c91 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:21.709737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e1bd479a-c4ed-47ce-8b09-19ab966d1c91 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:21.852012 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e1bd479a-c4ed-47ce-8b09-19ab966d1c91 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:21.860831 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e1bd479a-c4ed-47ce-8b09-19ab966d1c91 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 200 len: 1363 microversion: 2.1 time: 0.166302 Aug 02 07:53:21.861426 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3606/7138] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:21 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:22.882401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dc190d8f-7bd4-4e4b-8a24-00df54565b7a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:22.883015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dc190d8f-7bd4-4e4b-8a24-00df54565b7a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:22.890377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc190d8f-7bd4-4e4b-8a24-00df54565b7a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:22.891220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc190d8f-7bd4-4e4b-8a24-00df54565b7a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:22.891595 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc190d8f-7bd4-4e4b-8a24-00df54565b7a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:22.892034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-dc190d8f-7bd4-4e4b-8a24-00df54565b7a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:23.037122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dc190d8f-7bd4-4e4b-8a24-00df54565b7a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:23.049401 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dc190d8f-7bd4-4e4b-8a24-00df54565b7a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 200 len: 1363 microversion: 2.1 time: 0.171267 Aug 02 07:53:23.050018 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3533/7139] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:22 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:24.072049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-504c6afd-a019-49f8-8f90-c2ec7b53062a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:24.072688 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-504c6afd-a019-49f8-8f90-c2ec7b53062a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:24.081109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-504c6afd-a019-49f8-8f90-c2ec7b53062a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:24.081561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-504c6afd-a019-49f8-8f90-c2ec7b53062a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:24.082391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-504c6afd-a019-49f8-8f90-c2ec7b53062a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:24.082831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-504c6afd-a019-49f8-8f90-c2ec7b53062a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:24.227379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-504c6afd-a019-49f8-8f90-c2ec7b53062a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:24.235610 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-504c6afd-a019-49f8-8f90-c2ec7b53062a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 200 len: 1363 microversion: 2.1 time: 0.167593 Aug 02 07:53:24.236224 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3607/7140] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:24 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:24.806193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-decb3155-570c-448c-ab4f-a5239d145833 req-29258b68-c81a-4e9c-bd05-e1f1c6ad4ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077", "name": "network-vif-plugged", "status": "completed", "tag": "14c63c31-7dac-480b-a0d2-57cec97f6831"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:53:24.819457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-decb3155-570c-448c-ab4f-a5239d145833 req-29258b68-c81a-4e9c-bd05-e1f1c6ad4ee5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:24.819901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-decb3155-570c-448c-ab4f-a5239d145833 req-29258b68-c81a-4e9c-bd05-e1f1c6ad4ee5 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:24.832129 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-decb3155-570c-448c-ab4f-a5239d145833 req-29258b68-c81a-4e9c-bd05-e1f1c6ad4ee5 service nova] Creating event network-vif-plugged:14c63c31-7dac-480b-a0d2-57cec97f6831 for instance df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 on n-h2-851337-3 Aug 02 07:53:24.837238 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-decb3155-570c-448c-ab4f-a5239d145833 req-29258b68-c81a-4e9c-bd05-e1f1c6ad4ee5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034849 Aug 02 07:53:24.838524 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3534/7141] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:25.257514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0b54e33e-4518-45fd-b305-14bfdd7728b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:25.258143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0b54e33e-4518-45fd-b305-14bfdd7728b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:25.265836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b54e33e-4518-45fd-b305-14bfdd7728b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:25.266300 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b54e33e-4518-45fd-b305-14bfdd7728b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:25.267066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b54e33e-4518-45fd-b305-14bfdd7728b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:25.267498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0b54e33e-4518-45fd-b305-14bfdd7728b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:25.411793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0b54e33e-4518-45fd-b305-14bfdd7728b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:25.422458 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0b54e33e-4518-45fd-b305-14bfdd7728b2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 200 len: 1363 microversion: 2.1 time: 0.169333 Aug 02 07:53:25.423073 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3608/7142] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:25 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:26.445769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-318dc694-e2f3-4c96-ae2e-eaad1d860a0d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:26.446702 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-318dc694-e2f3-4c96-ae2e-eaad1d860a0d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:26.454413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-318dc694-e2f3-4c96-ae2e-eaad1d860a0d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:26.454876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-318dc694-e2f3-4c96-ae2e-eaad1d860a0d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:26.455668 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-318dc694-e2f3-4c96-ae2e-eaad1d860a0d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:26.456121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-318dc694-e2f3-4c96-ae2e-eaad1d860a0d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:26.600940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-318dc694-e2f3-4c96-ae2e-eaad1d860a0d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:26.611340 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-318dc694-e2f3-4c96-ae2e-eaad1d860a0d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 200 len: 1555 microversion: 2.1 time: 0.170655 Aug 02 07:53:26.612100 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3535/7143] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:26 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:26.633276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d776c66e-ce1d-4af0-bdb5-4384574aa3c4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:26.633874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d776c66e-ce1d-4af0-bdb5-4384574aa3c4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:26.637002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:53:26.637658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:53:26.644088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d776c66e-ce1d-4af0-bdb5-4384574aa3c4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:26.644536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d776c66e-ce1d-4af0-bdb5-4384574aa3c4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:26.645319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d776c66e-ce1d-4af0-bdb5-4384574aa3c4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:26.645823 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d776c66e-ce1d-4af0-bdb5-4384574aa3c4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:26.792111 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d776c66e-ce1d-4af0-bdb5-4384574aa3c4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:26.800601 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d776c66e-ce1d-4af0-bdb5-4384574aa3c4 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 200 len: 1555 microversion: 2.1 time: 0.171852 Aug 02 07:53:26.801204 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3609/7144] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:26 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:28.343409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1ef150f0-acd2-4391-ac6c-17fa11e45adb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4039565-9cc5-4b78-b8ad-9e9371b0fc83"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:53:28.345762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1ef150f0-acd2-4391-ac6c-17fa11e45adb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:28.347842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:53:28.354485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ef150f0-acd2-4391-ac6c-17fa11e45adb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:28.354943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ef150f0-acd2-4391-ac6c-17fa11e45adb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:28.355757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ef150f0-acd2-4391-ac6c-17fa11e45adb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:28.356201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1ef150f0-acd2-4391-ac6c-17fa11e45adb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:28.634800 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1ef150f0-acd2-4391-ac6c-17fa11e45adb tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "POST /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295493 Aug 02 07:53:28.635461 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3536/7145] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:53:28 2022] POST /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:39.379119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d59a146e-30b8-4eb0-a37e-298f0f74c0b9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:39.379674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d59a146e-30b8-4eb0-a37e-298f0f74c0b9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:39.381615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:53:39.382524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:53:39.389745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d59a146e-30b8-4eb0-a37e-298f0f74c0b9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:39.390228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d59a146e-30b8-4eb0-a37e-298f0f74c0b9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:39.390985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d59a146e-30b8-4eb0-a37e-298f0f74c0b9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:39.391433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d59a146e-30b8-4eb0-a37e-298f0f74c0b9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:39.477283 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-d59a146e-30b8-4eb0-a37e-298f0f74c0b9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lazy-loading 'services' on Instance uuid df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:53:39.551877 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d59a146e-30b8-4eb0-a37e-298f0f74c0b9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "DELETE /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments/f4039565-9cc5-4b78-b8ad-9e9371b0fc83" status: 202 len: 0 microversion: 2.1 time: 0.177397 Aug 02 07:53:39.552483 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3610/7146] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:53:39 2022] DELETE /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments/f4039565-9cc5-4b78-b8ad-9e9371b0fc83 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:53:39.559373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:53:39.560265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:53:39.564879 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6a7dc8d3-096f-4cd2-bb84-8e0f9564143b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:39.567386 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6a7dc8d3-096f-4cd2-bb84-8e0f9564143b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:39.575840 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a7dc8d3-096f-4cd2-bb84-8e0f9564143b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:39.576329 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a7dc8d3-096f-4cd2-bb84-8e0f9564143b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:39.577217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a7dc8d3-096f-4cd2-bb84-8e0f9564143b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:39.577819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6a7dc8d3-096f-4cd2-bb84-8e0f9564143b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:39.611981 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6a7dc8d3-096f-4cd2-bb84-8e0f9564143b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054457 Aug 02 07:53:39.612924 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3537/7147] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:53:39 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:40.626524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b47b0654-704a-4d31-8cb5-75100a3056ac tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:40.629273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b47b0654-704a-4d31-8cb5-75100a3056ac tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:40.636632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b47b0654-704a-4d31-8cb5-75100a3056ac tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:40.637103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b47b0654-704a-4d31-8cb5-75100a3056ac tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:40.637942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b47b0654-704a-4d31-8cb5-75100a3056ac tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:40.638400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b47b0654-704a-4d31-8cb5-75100a3056ac tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:40.669867 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b47b0654-704a-4d31-8cb5-75100a3056ac tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048620 Aug 02 07:53:40.670461 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3611/7148] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:53:40 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:41.683152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bc131a65-2077-49f7-90de-74b6e62b11c3 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:41.685566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bc131a65-2077-49f7-90de-74b6e62b11c3 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:41.693203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc131a65-2077-49f7-90de-74b6e62b11c3 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:41.693666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc131a65-2077-49f7-90de-74b6e62b11c3 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:41.694523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc131a65-2077-49f7-90de-74b6e62b11c3 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:41.695028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc131a65-2077-49f7-90de-74b6e62b11c3 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:41.727298 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bc131a65-2077-49f7-90de-74b6e62b11c3 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048484 Aug 02 07:53:41.727884 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3538/7149] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:53:41 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:42.741639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a9d9283a-dcbd-4625-bc7c-240dd50a9bd2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:42.744076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a9d9283a-dcbd-4625-bc7c-240dd50a9bd2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:42.751651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9d9283a-dcbd-4625-bc7c-240dd50a9bd2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:42.752097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9d9283a-dcbd-4625-bc7c-240dd50a9bd2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:42.752868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9d9283a-dcbd-4625-bc7c-240dd50a9bd2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:42.753605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9d9283a-dcbd-4625-bc7c-240dd50a9bd2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:42.786225 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a9d9283a-dcbd-4625-bc7c-240dd50a9bd2 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048520 Aug 02 07:53:42.787123 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3612/7150] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:53:42 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:43.805521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3b1fd7dc-4c2a-44a5-8fc8-10154c95d165 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:43.807694 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3b1fd7dc-4c2a-44a5-8fc8-10154c95d165 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:43.815185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b1fd7dc-4c2a-44a5-8fc8-10154c95d165 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:43.815640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b1fd7dc-4c2a-44a5-8fc8-10154c95d165 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:43.816454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b1fd7dc-4c2a-44a5-8fc8-10154c95d165 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:43.816889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3b1fd7dc-4c2a-44a5-8fc8-10154c95d165 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:43.858847 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3b1fd7dc-4c2a-44a5-8fc8-10154c95d165 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057650 Aug 02 07:53:43.859443 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3539/7151] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:53:43 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:53:44.871392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b9252d65-a351-4bb8-992f-409df976f015 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:44.873695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b9252d65-a351-4bb8-992f-409df976f015 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:44.881175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9252d65-a351-4bb8-992f-409df976f015 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:44.881624 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9252d65-a351-4bb8-992f-409df976f015 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:44.882431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9252d65-a351-4bb8-992f-409df976f015 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:44.882835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9252d65-a351-4bb8-992f-409df976f015 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:44.912861 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b9252d65-a351-4bb8-992f-409df976f015 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045588 Aug 02 07:53:44.913402 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3613/7152] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:53:44 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:53:44.924084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-56f2128b-01aa-4400-8ec1-328579321c0b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:44.924704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-56f2128b-01aa-4400-8ec1-328579321c0b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:44.931833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-56f2128b-01aa-4400-8ec1-328579321c0b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:44.932317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-56f2128b-01aa-4400-8ec1-328579321c0b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:44.933089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-56f2128b-01aa-4400-8ec1-328579321c0b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:44.933528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-56f2128b-01aa-4400-8ec1-328579321c0b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:45.010413 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-56f2128b-01aa-4400-8ec1-328579321c0b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] HTTP exception thrown: Instance df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 is not attached to volume f4039565-9cc5-4b78-b8ad-9e9371b0fc83 Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-56f2128b-01aa-4400-8ec1-328579321c0b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Request method failure captured: Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: request: DELETE /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments/f4039565-9cc5-4b78-b8ad-9e9371b0fc83 HTTP/1.1 Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NeeNyIj5luQ_WpPzOeZWJDeNOegScwqfvMDRUTMYNwRC8TGXMepYGKEsZM2eI9INargLb2-q9Pkb039Htieq9P3-2-Gqo4FHIoHwftT1D1yFATErInZy_46NrR_upUrfDG38ZrsVyRgrU0X-DJgpOI4hpkvFq2mlxexiJz4JHZSufc Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: ec1f157bb1714147b20c874723c97478 Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ec1f157bb1714147b20c874723c97478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec1f157bb1714147b20c874723c97478"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ec1f157bb1714147b20c874723c97478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec1f157bb1714147b20c874723c97478"}]}] Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: ec1f157bb1714147b20c874723c97478 Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestEncryptedCinderVolumes-854212237-project Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b1a33055a7d7429dbf7e4590de2e605f Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestEncryptedCinderVolumes-854212237-project Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 is not attached to volume f4039565-9cc5-4b78-b8ad-9e9371b0fc83 Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'server_id': 'df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077', 'id': 'f4039565-9cc5-4b78-b8ad-9e9371b0fc83'} Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f4039565-9cc5-4b78-b8ad-9e9371b0fc83. Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 is not attached to volume f4039565-9cc5-4b78-b8ad-9e9371b0fc83 Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:53:45.012088 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:53:45.016275 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:53:45.016275 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:53:45.016275 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 is not attached to volume f4039565-9cc5-4b78-b8ad-9e9371b0fc83 Aug 02 07:53:45.016275 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:45.016275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-56f2128b-01aa-4400-8ec1-328579321c0b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Returning 404 to user: Instance df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 is not attached to volume f4039565-9cc5-4b78-b8ad-9e9371b0fc83 {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:53:45.016275 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-56f2128b-01aa-4400-8ec1-328579321c0b tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "DELETE /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments/f4039565-9cc5-4b78-b8ad-9e9371b0fc83" status: 404 len: 154 microversion: 2.1 time: 0.093606 Aug 02 07:53:45.016275 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3540/7153] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:53:44 2022] DELETE /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077/os-volume_attachments/f4039565-9cc5-4b78-b8ad-9e9371b0fc83 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:53:48.390107 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bfa3ddb4-34ef-4286-a8f4-241eebf6b68a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:48.390993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bfa3ddb4-34ef-4286-a8f4-241eebf6b68a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:48.397938 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfa3ddb4-34ef-4286-a8f4-241eebf6b68a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:48.398428 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfa3ddb4-34ef-4286-a8f4-241eebf6b68a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:48.399227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfa3ddb4-34ef-4286-a8f4-241eebf6b68a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:48.399669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bfa3ddb4-34ef-4286-a8f4-241eebf6b68a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:48.431001 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bfa3ddb4-34ef-4286-a8f4-241eebf6b68a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:53:48.546966 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bfa3ddb4-34ef-4286-a8f4-241eebf6b68a tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "DELETE /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 204 len: 0 microversion: 2.1 time: 0.161339 Aug 02 07:53:48.547613 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3614/7154] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:53:48 2022] DELETE /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 07:53:48.561999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3826a45e-a7ef-401b-991c-15c0e830137e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:48.563555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3826a45e-a7ef-401b-991c-15c0e830137e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:48.574877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3826a45e-a7ef-401b-991c-15c0e830137e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:48.575338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3826a45e-a7ef-401b-991c-15c0e830137e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:48.576153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3826a45e-a7ef-401b-991c-15c0e830137e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:48.576632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3826a45e-a7ef-401b-991c-15c0e830137e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:48.730768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3826a45e-a7ef-401b-991c-15c0e830137e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:48.741801 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3826a45e-a7ef-401b-991c-15c0e830137e tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 200 len: 1561 microversion: 2.1 time: 0.188303 Aug 02 07:53:48.742807 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3541/7155] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:48 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 1561 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:49.768284 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-44751c8c-e59d-49b6-bf90-d681a56acc5d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:49.768981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-44751c8c-e59d-49b6-bf90-d681a56acc5d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:49.776856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44751c8c-e59d-49b6-bf90-d681a56acc5d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:49.777305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44751c8c-e59d-49b6-bf90-d681a56acc5d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:49.778443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44751c8c-e59d-49b6-bf90-d681a56acc5d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:49.779099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-44751c8c-e59d-49b6-bf90-d681a56acc5d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:49.928261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-44751c8c-e59d-49b6-bf90-d681a56acc5d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:49.936644 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-44751c8c-e59d-49b6-bf90-d681a56acc5d tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 200 len: 1561 microversion: 2.1 time: 0.175223 Aug 02 07:53:49.937234 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3615/7156] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:49 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:50.736470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-675318b9-969e-4a6f-b4f2-34238e79d5da req-f1ea4395-6d35-42ed-ba99-cbadc3b2fc4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077", "name": "network-vif-deleted", "tag": "14c63c31-7dac-480b-a0d2-57cec97f6831"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:53:50.747973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-675318b9-969e-4a6f-b4f2-34238e79d5da req-f1ea4395-6d35-42ed-ba99-cbadc3b2fc4d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:50.748459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-675318b9-969e-4a6f-b4f2-34238e79d5da req-f1ea4395-6d35-42ed-ba99-cbadc3b2fc4d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:50.763826 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-675318b9-969e-4a6f-b4f2-34238e79d5da req-f1ea4395-6d35-42ed-ba99-cbadc3b2fc4d service nova] Creating event network-vif-deleted:14c63c31-7dac-480b-a0d2-57cec97f6831 for instance df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 on n-h2-851337-3 Aug 02 07:53:50.769382 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-675318b9-969e-4a6f-b4f2-34238e79d5da req-f1ea4395-6d35-42ed-ba99-cbadc3b2fc4d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037926 Aug 02 07:53:50.770017 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3542/7157] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:53:50.960427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-28d7b5ee-cb7e-40c4-8800-c531bc1eb3d9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:50.962108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-28d7b5ee-cb7e-40c4-8800-c531bc1eb3d9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:50.973724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28d7b5ee-cb7e-40c4-8800-c531bc1eb3d9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:50.974558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28d7b5ee-cb7e-40c4-8800-c531bc1eb3d9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:50.975839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28d7b5ee-cb7e-40c4-8800-c531bc1eb3d9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:50.976468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28d7b5ee-cb7e-40c4-8800-c531bc1eb3d9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:51.012265 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28d7b5ee-cb7e-40c4-8800-c531bc1eb3d9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:51.012709 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28d7b5ee-cb7e-40c4-8800-c531bc1eb3d9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:51.013169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-28d7b5ee-cb7e-40c4-8800-c531bc1eb3d9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lazy-loading 'fault' on Instance uuid df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:53:51.069728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-28d7b5ee-cb7e-40c4-8800-c531bc1eb3d9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a33055a7d7429dbf7e4590de2e605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1f157bb1714147b20c874723c97478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:53:51.078389 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-28d7b5ee-cb7e-40c4-8800-c531bc1eb3d9 tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 200 len: 1353 microversion: 2.1 time: 0.124096 Aug 02 07:53:51.079227 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3616/7158] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:50 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 1353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:53:52.106318 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-11752079-6ec4-49a9-bf3d-52bf56878a2c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:52.106920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-11752079-6ec4-49a9-bf3d-52bf56878a2c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] [instance: df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:53:52.113874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11752079-6ec4-49a9-bf3d-52bf56878a2c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:52.114369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11752079-6ec4-49a9-bf3d-52bf56878a2c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:52.115187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11752079-6ec4-49a9-bf3d-52bf56878a2c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:53:52.115656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-11752079-6ec4-49a9-bf3d-52bf56878a2c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:53:52.130239 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-11752079-6ec4-49a9-bf3d-52bf56878a2c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] HTTP exception thrown: Instance df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 could not be found. Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-11752079-6ec4-49a9-bf3d-52bf56878a2c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Request method failure captured: Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 HTTP/1.1 Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NeeNyIj5luQ_WpPzOeZWJDeNOegScwqfvMDRUTMYNwRC8TGXMepYGKEsZM2eI9INargLb2-q9Pkb039Htieq9P3-2-Gqo4FHIoHwftT1D1yFATErInZy_46NrR_upUrfDG38ZrsVyRgrU0X-DJgpOI4hpkvFq2mlxexiJz4JHZSufc Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: ec1f157bb1714147b20c874723c97478 Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ec1f157bb1714147b20c874723c97478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec1f157bb1714147b20c874723c97478"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ec1f157bb1714147b20c874723c97478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec1f157bb1714147b20c874723c97478"}]}] Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: ec1f157bb1714147b20c874723c97478 Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-854212237 Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestEncryptedCinderVolumes-854212237-project Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: b1a33055a7d7429dbf7e4590de2e605f Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestEncryptedCinderVolumes-854212237-project Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 could not be found. Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077'} Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 could not be found. Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 could not be found. Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:53:52.131905 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:52.138342 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:53:52.138342 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:53:52.138342 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:53:52.138342 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:53:52.138342 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:53:52.138342 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 could not be found. Aug 02 07:53:52.138342 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 07:53:52.138342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-11752079-6ec4-49a9-bf3d-52bf56878a2c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Returning 404 to user: Instance df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:53:52.138342 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-11752079-6ec4-49a9-bf3d-52bf56878a2c tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077" status: 404 len: 111 microversion: 2.1 time: 0.032474 Aug 02 07:53:52.138342 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3543/7159] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:53:52 2022] GET /compute/v2.1/servers/df5d2cb1-3f2c-4f8b-b5e7-bc0da475a077 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:53:52.143392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c7d97e10-c415-4ccc-8938-6ada8b31ea3f tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] Calling method '.version_select at 0x7f9279c1e700>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:53:52.172282 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c7d97e10-c415-4ccc-8938-6ada8b31ea3f tempest-TestEncryptedCinderVolumes-854212237 tempest-TestEncryptedCinderVolumes-854212237-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1385380334" status: 202 len: 0 microversion: 2.1 time: 0.033298 Aug 02 07:53:52.172887 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3617/7160] 10.222.0.79 () {58 vars in 1278 bytes} [Tue Aug 2 07:53:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1385380334 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 07:54:20.360033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8c29ee9b-deec-480a-8a66-b511430f108c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Action: 'create', calling method: .version_select at 0x7f927ae96dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1599059993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBaGmABwBVG/U95ebfM8M8AOvCmu1Gs2cu8ciD4gKocaJ5UfQta5KoQvXphC2d/isDkicRLAP5T4Qj2OdmYKAtx4yUz+7qVOW8cp4t+YFGUGuK0mEreHhZZdP/xflTegg=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:54:20.367346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=14 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:54:20.368685 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=34 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:54:20.383208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-8c29ee9b-deec-480a-8a66-b511430f108c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Getting quotas for project 8b63ef2342794a4585fd3062f6d01d05. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:54:20.389443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-8c29ee9b-deec-480a-8a66-b511430f108c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Getting quotas for user 377a3a65f0904cc98bc85c1d4e2e2822 and project 8b63ef2342794a4585fd3062f6d01d05. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:54:20.422174 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8c29ee9b-deec-480a-8a66-b511430f108c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.068244 Aug 02 07:54:20.422799 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3544/7161] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:54:20 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:54:20.478336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:54:20.479103 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:54:20.483313 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1374926503", "imageRef": "0bd63b5d-5f02-4840-98fb-c0785b21d139", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1599059993", "networks": [{"uuid": "1e10eb13-4cf0-48b1-84e0-6fdbc0969a5e"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:54:20.539125 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] validate_networks() for [('1e10eb13-4cf0-48b1-84e0-6fdbc0969a5e', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:54:20.941821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:54:20.942543 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:54:20.943310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:54:20.943970 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:54:20.944643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:54:20.955279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:20.955748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:20.956990 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:20.957729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:20.981079 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Getting quotas for project 8b63ef2342794a4585fd3062f6d01d05. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:54:20.986631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Getting quotas for user 377a3a65f0904cc98bc85c1d4e2e2822 and project 8b63ef2342794a4585fd3062f6d01d05. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:54:21.000026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:54:21.002312 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0bd63b5d-5f02-4840-98fb-c0785b21d139',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:54:21.054318 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-24106fbf-a0a0-4b8f-8d2e-122b82f5c5cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578597 Aug 02 07:54:21.055295 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3618/7162] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:54:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:54:21.067858 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cf0845fe-2007-4958-bb10-c31937a0ea20 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:21.068692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cf0845fe-2007-4958-bb10-c31937a0ea20 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:21.127590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cf0845fe-2007-4958-bb10-c31937a0ea20 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:21.134934 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cf0845fe-2007-4958-bb10-c31937a0ea20 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1259 microversion: 2.1 time: 0.072294 Aug 02 07:54:21.135703 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3545/7163] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:21 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:22.157245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7434f45a-7463-4e7e-97d6-a6c6b80188da tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:22.158791 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7434f45a-7463-4e7e-97d6-a6c6b80188da tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:22.166067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7434f45a-7463-4e7e-97d6-a6c6b80188da tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:22.166802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7434f45a-7463-4e7e-97d6-a6c6b80188da tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:22.167793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7434f45a-7463-4e7e-97d6-a6c6b80188da tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:22.168310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7434f45a-7463-4e7e-97d6-a6c6b80188da tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:22.234540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7434f45a-7463-4e7e-97d6-a6c6b80188da tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:22.243199 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7434f45a-7463-4e7e-97d6-a6c6b80188da tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1319 microversion: 2.1 time: 0.090919 Aug 02 07:54:22.243909 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3619/7164] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:22 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1319 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:23.264940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cdfedd67-10df-4ec4-8c18-28dca154dda4 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:23.265460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cdfedd67-10df-4ec4-8c18-28dca154dda4 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:23.273093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdfedd67-10df-4ec4-8c18-28dca154dda4 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:23.273543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdfedd67-10df-4ec4-8c18-28dca154dda4 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:23.274359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdfedd67-10df-4ec4-8c18-28dca154dda4 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:23.274978 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdfedd67-10df-4ec4-8c18-28dca154dda4 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:23.416883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cdfedd67-10df-4ec4-8c18-28dca154dda4 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:23.427093 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cdfedd67-10df-4ec4-8c18-28dca154dda4 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.166222 Aug 02 07:54:23.428185 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3546/7165] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:23 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:24.451581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aff2a771-078a-470f-979f-a26603c3b363 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:24.452268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aff2a771-078a-470f-979f-a26603c3b363 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:24.460463 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aff2a771-078a-470f-979f-a26603c3b363 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:24.460976 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aff2a771-078a-470f-979f-a26603c3b363 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:24.462108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aff2a771-078a-470f-979f-a26603c3b363 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:24.462759 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aff2a771-078a-470f-979f-a26603c3b363 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:24.613476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-aff2a771-078a-470f-979f-a26603c3b363 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:24.625622 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aff2a771-078a-470f-979f-a26603c3b363 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.178189 Aug 02 07:54:24.626291 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3620/7166] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:24 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:25.647245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5ce144af-a4b6-4a3c-a8c2-62a7c3ba68a2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:25.647866 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5ce144af-a4b6-4a3c-a8c2-62a7c3ba68a2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:25.655596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ce144af-a4b6-4a3c-a8c2-62a7c3ba68a2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:25.656056 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ce144af-a4b6-4a3c-a8c2-62a7c3ba68a2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:25.656899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ce144af-a4b6-4a3c-a8c2-62a7c3ba68a2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:25.657346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5ce144af-a4b6-4a3c-a8c2-62a7c3ba68a2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:25.802361 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5ce144af-a4b6-4a3c-a8c2-62a7c3ba68a2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:25.810186 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5ce144af-a4b6-4a3c-a8c2-62a7c3ba68a2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.166775 Aug 02 07:54:25.810987 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3547/7167] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:25 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:26.832848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7179ddf-d2ad-4f1e-84da-5681e63d5034 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:26.834071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e7179ddf-d2ad-4f1e-84da-5681e63d5034 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:26.855247 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7179ddf-d2ad-4f1e-84da-5681e63d5034 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:26.862094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7179ddf-d2ad-4f1e-84da-5681e63d5034 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:26.862094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7179ddf-d2ad-4f1e-84da-5681e63d5034 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:26.862094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7179ddf-d2ad-4f1e-84da-5681e63d5034 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:27.024432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e7179ddf-d2ad-4f1e-84da-5681e63d5034 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:27.032374 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7179ddf-d2ad-4f1e-84da-5681e63d5034 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.204666 Aug 02 07:54:27.032992 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3621/7168] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:26 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:28.053158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2d23ecdd-a528-41ba-878b-0851bf64bed6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:28.053761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2d23ecdd-a528-41ba-878b-0851bf64bed6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:28.061371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d23ecdd-a528-41ba-878b-0851bf64bed6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:28.061962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d23ecdd-a528-41ba-878b-0851bf64bed6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:28.062847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d23ecdd-a528-41ba-878b-0851bf64bed6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:28.063374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d23ecdd-a528-41ba-878b-0851bf64bed6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:28.214070 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2d23ecdd-a528-41ba-878b-0851bf64bed6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:28.224243 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2d23ecdd-a528-41ba-878b-0851bf64bed6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.175116 Aug 02 07:54:28.224820 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3548/7169] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:28 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:29.246807 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9859c5c1-6c32-4567-90de-18c75bd05cee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:29.248714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9859c5c1-6c32-4567-90de-18c75bd05cee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:29.256618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9859c5c1-6c32-4567-90de-18c75bd05cee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:29.257077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9859c5c1-6c32-4567-90de-18c75bd05cee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:29.257866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9859c5c1-6c32-4567-90de-18c75bd05cee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:29.258639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9859c5c1-6c32-4567-90de-18c75bd05cee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:29.401584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9859c5c1-6c32-4567-90de-18c75bd05cee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:29.409930 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9859c5c1-6c32-4567-90de-18c75bd05cee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.168861 Aug 02 07:54:29.410977 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3622/7170] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:29 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:30.431194 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3a808ebf-afbb-479b-b00d-32865ed87a68 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:30.431837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3a808ebf-afbb-479b-b00d-32865ed87a68 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:30.439630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a808ebf-afbb-479b-b00d-32865ed87a68 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:30.440099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a808ebf-afbb-479b-b00d-32865ed87a68 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:30.440877 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a808ebf-afbb-479b-b00d-32865ed87a68 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:30.441328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3a808ebf-afbb-479b-b00d-32865ed87a68 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:30.593909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3a808ebf-afbb-479b-b00d-32865ed87a68 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:30.603540 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3a808ebf-afbb-479b-b00d-32865ed87a68 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.176290 Aug 02 07:54:30.604134 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3549/7171] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:30 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:31.627052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5e27e90a-7aad-4829-a316-8887a1dcc29d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:31.627801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5e27e90a-7aad-4829-a316-8887a1dcc29d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:31.631962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:54:31.632871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:54:31.641087 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e27e90a-7aad-4829-a316-8887a1dcc29d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:31.641705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e27e90a-7aad-4829-a316-8887a1dcc29d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:31.642769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e27e90a-7aad-4829-a316-8887a1dcc29d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:31.643361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5e27e90a-7aad-4829-a316-8887a1dcc29d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:31.781583 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5e27e90a-7aad-4829-a316-8887a1dcc29d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:31.789470 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5e27e90a-7aad-4829-a316-8887a1dcc29d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.167884 Aug 02 07:54:31.790083 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3623/7172] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:31 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:32.811909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-96262d1d-7d82-44e5-8c71-acd99234ebcc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:32.812534 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-96262d1d-7d82-44e5-8c71-acd99234ebcc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:32.814546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:54:32.821988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96262d1d-7d82-44e5-8c71-acd99234ebcc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:32.822441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96262d1d-7d82-44e5-8c71-acd99234ebcc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:32.823231 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96262d1d-7d82-44e5-8c71-acd99234ebcc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:32.823669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-96262d1d-7d82-44e5-8c71-acd99234ebcc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:32.986961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-96262d1d-7d82-44e5-8c71-acd99234ebcc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:32.996525 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-96262d1d-7d82-44e5-8c71-acd99234ebcc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.189111 Aug 02 07:54:32.997132 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3550/7173] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:32 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:34.018643 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f776b81a-3275-4ca8-ab33-5fa5c846e252 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:34.019378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f776b81a-3275-4ca8-ab33-5fa5c846e252 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:34.027314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f776b81a-3275-4ca8-ab33-5fa5c846e252 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:34.027768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f776b81a-3275-4ca8-ab33-5fa5c846e252 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:34.028581 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f776b81a-3275-4ca8-ab33-5fa5c846e252 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:34.029031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f776b81a-3275-4ca8-ab33-5fa5c846e252 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:34.175760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f776b81a-3275-4ca8-ab33-5fa5c846e252 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:34.183999 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f776b81a-3275-4ca8-ab33-5fa5c846e252 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.169434 Aug 02 07:54:34.193848 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3624/7174] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:34 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:34.562737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-7014fac2-b4f4-4c16-ad18-c45e1f40cb78 req-71cfc949-9b09-488d-a50e-33f9a9325831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebc7ae5-ca50-4bce-aad4-65b68fbd0679", "tag": "04b0ba84-3631-44ea-b484-d65a7505e70e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:54:34.578915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7014fac2-b4f4-4c16-ad18-c45e1f40cb78 req-71cfc949-9b09-488d-a50e-33f9a9325831 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:34.579634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7014fac2-b4f4-4c16-ad18-c45e1f40cb78 req-71cfc949-9b09-488d-a50e-33f9a9325831 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:34.595193 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-7014fac2-b4f4-4c16-ad18-c45e1f40cb78 req-71cfc949-9b09-488d-a50e-33f9a9325831 service nova] Creating event network-changed:04b0ba84-3631-44ea-b484-d65a7505e70e for instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 on n-h1-851337-3 Aug 02 07:54:34.603473 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-7014fac2-b4f4-4c16-ad18-c45e1f40cb78 req-71cfc949-9b09-488d-a50e-33f9a9325831 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046618 Aug 02 07:54:34.604521 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3551/7175] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:54:35.208913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b008aaee-fe62-431f-9c8a-3396c36b0cb8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:35.209521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b008aaee-fe62-431f-9c8a-3396c36b0cb8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:35.217855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b008aaee-fe62-431f-9c8a-3396c36b0cb8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:35.218423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b008aaee-fe62-431f-9c8a-3396c36b0cb8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:35.219144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b008aaee-fe62-431f-9c8a-3396c36b0cb8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:35.219569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b008aaee-fe62-431f-9c8a-3396c36b0cb8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:35.362501 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b008aaee-fe62-431f-9c8a-3396c36b0cb8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:35.372046 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b008aaee-fe62-431f-9c8a-3396c36b0cb8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.168999 Aug 02 07:54:35.372972 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3625/7176] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:35 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:36.401508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d2e8c668-9be9-4b8e-ab85-fe8bec198186 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:36.402245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d2e8c668-9be9-4b8e-ab85-fe8bec198186 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:36.409279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2e8c668-9be9-4b8e-ab85-fe8bec198186 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:36.409679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2e8c668-9be9-4b8e-ab85-fe8bec198186 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:36.410498 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2e8c668-9be9-4b8e-ab85-fe8bec198186 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:36.410948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d2e8c668-9be9-4b8e-ab85-fe8bec198186 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:36.744450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d2e8c668-9be9-4b8e-ab85-fe8bec198186 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:36.753606 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d2e8c668-9be9-4b8e-ab85-fe8bec198186 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.359441 Aug 02 07:54:36.754238 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3552/7177] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:36 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:37.778366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-95117453-accc-4a20-9860-b646191c0b56 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:37.779131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-95117453-accc-4a20-9860-b646191c0b56 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:37.788316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-95117453-accc-4a20-9860-b646191c0b56 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:37.789086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-95117453-accc-4a20-9860-b646191c0b56 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:37.790713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-95117453-accc-4a20-9860-b646191c0b56 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:37.791423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-95117453-accc-4a20-9860-b646191c0b56 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:38.001744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-95117453-accc-4a20-9860-b646191c0b56 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:38.011906 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-95117453-accc-4a20-9860-b646191c0b56 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.238879 Aug 02 07:54:38.013102 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3626/7178] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:37 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:39.036908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-17fd02df-96a2-4b39-be4f-be563be2bab8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:39.037508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-17fd02df-96a2-4b39-be4f-be563be2bab8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:39.046252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17fd02df-96a2-4b39-be4f-be563be2bab8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:39.046725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17fd02df-96a2-4b39-be4f-be563be2bab8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:39.047532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17fd02df-96a2-4b39-be4f-be563be2bab8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:39.047983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-17fd02df-96a2-4b39-be4f-be563be2bab8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:39.194954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-17fd02df-96a2-4b39-be4f-be563be2bab8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:39.203387 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-17fd02df-96a2-4b39-be4f-be563be2bab8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.170528 Aug 02 07:54:39.203954 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3553/7179] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:39 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:40.224669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1c43de33-16b2-4d9b-b448-edf77f981e9d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:40.225310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1c43de33-16b2-4d9b-b448-edf77f981e9d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:40.235558 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c43de33-16b2-4d9b-b448-edf77f981e9d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:40.236135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c43de33-16b2-4d9b-b448-edf77f981e9d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:40.237307 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c43de33-16b2-4d9b-b448-edf77f981e9d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:40.238070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1c43de33-16b2-4d9b-b448-edf77f981e9d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:40.380042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1c43de33-16b2-4d9b-b448-edf77f981e9d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:40.391085 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1c43de33-16b2-4d9b-b448-edf77f981e9d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.170381 Aug 02 07:54:40.391710 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3627/7180] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:40 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:40.526189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-910274b5-8be2-4900-a65c-de96c8f361a4 req-77534f90-5cdf-48e6-9bf8-7ced8ddbdf6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebc7ae5-ca50-4bce-aad4-65b68fbd0679", "name": "network-vif-plugged", "status": "completed", "tag": "04b0ba84-3631-44ea-b484-d65a7505e70e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:54:40.537918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-910274b5-8be2-4900-a65c-de96c8f361a4 req-77534f90-5cdf-48e6-9bf8-7ced8ddbdf6c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:40.538394 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-910274b5-8be2-4900-a65c-de96c8f361a4 req-77534f90-5cdf-48e6-9bf8-7ced8ddbdf6c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:40.551080 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-910274b5-8be2-4900-a65c-de96c8f361a4 req-77534f90-5cdf-48e6-9bf8-7ced8ddbdf6c service nova] Creating event network-vif-plugged:04b0ba84-3631-44ea-b484-d65a7505e70e for instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 on n-h1-851337-3 Aug 02 07:54:40.557051 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-910274b5-8be2-4900-a65c-de96c8f361a4 req-77534f90-5cdf-48e6-9bf8-7ced8ddbdf6c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033946 Aug 02 07:54:40.557051 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3554/7181] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:54:41.413462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cedea44f-e659-4a7b-87b1-1b2b06a5e84a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:41.414117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cedea44f-e659-4a7b-87b1-1b2b06a5e84a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:41.421783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cedea44f-e659-4a7b-87b1-1b2b06a5e84a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:41.422267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cedea44f-e659-4a7b-87b1-1b2b06a5e84a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:41.423049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cedea44f-e659-4a7b-87b1-1b2b06a5e84a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:41.423485 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cedea44f-e659-4a7b-87b1-1b2b06a5e84a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:41.565714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cedea44f-e659-4a7b-87b1-1b2b06a5e84a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:41.574195 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cedea44f-e659-4a7b-87b1-1b2b06a5e84a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1359 microversion: 2.1 time: 0.164761 Aug 02 07:54:41.574745 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3628/7182] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:41 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:42.596731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-67e5ad4a-84e3-4355-838f-762b11d01a85 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:42.597450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-67e5ad4a-84e3-4355-838f-762b11d01a85 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:42.605377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67e5ad4a-84e3-4355-838f-762b11d01a85 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:42.605812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67e5ad4a-84e3-4355-838f-762b11d01a85 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:42.606726 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67e5ad4a-84e3-4355-838f-762b11d01a85 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:42.607188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-67e5ad4a-84e3-4355-838f-762b11d01a85 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:42.742525 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-67e5ad4a-84e3-4355-838f-762b11d01a85 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:42.750628 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-67e5ad4a-84e3-4355-838f-762b11d01a85 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1547 microversion: 2.1 time: 0.158422 Aug 02 07:54:42.751235 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3555/7183] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:42 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:42.773191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b34bdeb7-396e-46cc-8f92-6c5d2c7d1860 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:42.773812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b34bdeb7-396e-46cc-8f92-6c5d2c7d1860 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:42.781805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b34bdeb7-396e-46cc-8f92-6c5d2c7d1860 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:42.781805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b34bdeb7-396e-46cc-8f92-6c5d2c7d1860 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:42.782677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b34bdeb7-396e-46cc-8f92-6c5d2c7d1860 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:42.783110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b34bdeb7-396e-46cc-8f92-6c5d2c7d1860 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:42.931495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b34bdeb7-396e-46cc-8f92-6c5d2c7d1860 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:42.939671 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b34bdeb7-396e-46cc-8f92-6c5d2c7d1860 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1547 microversion: 2.1 time: 0.170419 Aug 02 07:54:42.940468 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3629/7184] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:42 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1547 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:42.959945 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b85792c8-099f-40e3-a38d-d902c6102352 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:42.964634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b85792c8-099f-40e3-a38d-d902c6102352 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:42.965422 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b85792c8-099f-40e3-a38d-d902c6102352 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Searching by: {'deleted': False, 'project_id': '8b63ef2342794a4585fd3062f6d01d05'} {{(pid=126119) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:54:42.971275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b85792c8-099f-40e3-a38d-d902c6102352 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:42.971738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b85792c8-099f-40e3-a38d-d902c6102352 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:42.972549 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b85792c8-099f-40e3-a38d-d902c6102352 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:42.972997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b85792c8-099f-40e3-a38d-d902c6102352 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:42.997514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.multi_cell_list [None req-b85792c8-099f-40e3-a38d-d902c6102352 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126119) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:54:43.024336 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b85792c8-099f-40e3-a38d-d902c6102352 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068357 Aug 02 07:54:43.024926 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3556/7185] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Aug 2 07:54:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:54:43.036755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6a48e6e4-540b-48a0-93e3-e56345b1804f tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:43.037376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6a48e6e4-540b-48a0-93e3-e56345b1804f tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:43.043768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a48e6e4-540b-48a0-93e3-e56345b1804f tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:43.044225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a48e6e4-540b-48a0-93e3-e56345b1804f tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:43.045039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a48e6e4-540b-48a0-93e3-e56345b1804f tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:43.045456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6a48e6e4-540b-48a0-93e3-e56345b1804f tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:43.182806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6a48e6e4-540b-48a0-93e3-e56345b1804f tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:43.191072 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6a48e6e4-540b-48a0-93e3-e56345b1804f tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1547 microversion: 2.1 time: 0.158293 Aug 02 07:54:43.191634 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3630/7186] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:43 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:54:44.740478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-737a72b0-6b59-4bd8-8250-7220e2602874 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71f3b2a5-2d42-4e64-a791-07056df9814e"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:54:44.743168 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-737a72b0-6b59-4bd8-8250-7220e2602874 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:44.749937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-737a72b0-6b59-4bd8-8250-7220e2602874 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:44.750433 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-737a72b0-6b59-4bd8-8250-7220e2602874 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:44.751237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-737a72b0-6b59-4bd8-8250-7220e2602874 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:44.751689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-737a72b0-6b59-4bd8-8250-7220e2602874 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:45.024467 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-737a72b0-6b59-4bd8-8250-7220e2602874 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "POST /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288283 Aug 02 07:54:45.025134 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3557/7187] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:54:44 2022] POST /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:54:58.174004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b0391fc6-ae45-4225-946c-301da89fd341 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:54:58.174616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b0391fc6-ae45-4225-946c-301da89fd341 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:54:58.177736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:54:58.178455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=74 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:54:58.185634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0391fc6-ae45-4225-946c-301da89fd341 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:58.186213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0391fc6-ae45-4225-946c-301da89fd341 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:58.187132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0391fc6-ae45-4225-946c-301da89fd341 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:54:58.187578 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0391fc6-ae45-4225-946c-301da89fd341 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:54:58.344778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b0391fc6-ae45-4225-946c-301da89fd341 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:54:58.353940 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b0391fc6-ae45-4225-946c-301da89fd341 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1593 microversion: 2.1 time: 0.183968 Aug 02 07:54:58.354576 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3631/7188] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:54:58 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1593 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:55:00.536740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:55:00.537528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:55:00.538885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:55:00.667988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-130e8186-f27d-4034-9ac3-29e8d781fbf3 req-37fd1552-909f-4d2f-b86a-4125de8fa571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebc7ae5-ca50-4bce-aad4-65b68fbd0679", "tag": "04b0ba84-3631-44ea-b484-d65a7505e70e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:55:00.690078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-130e8186-f27d-4034-9ac3-29e8d781fbf3 req-37fd1552-909f-4d2f-b86a-4125de8fa571 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:55:00.690985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-130e8186-f27d-4034-9ac3-29e8d781fbf3 req-37fd1552-909f-4d2f-b86a-4125de8fa571 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:55:00.709779 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-130e8186-f27d-4034-9ac3-29e8d781fbf3 req-37fd1552-909f-4d2f-b86a-4125de8fa571 service nova] Creating event network-changed:04b0ba84-3631-44ea-b484-d65a7505e70e for instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 on n-h1-851337-3 Aug 02 07:55:00.717507 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-130e8186-f27d-4034-9ac3-29e8d781fbf3 req-37fd1552-909f-4d2f-b86a-4125de8fa571 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187261 Aug 02 07:55:00.718963 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3558/7189] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:55:01.828668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-354f9901-98dc-4c1e-82d0-8ce5f9c14655 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2088611304"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:55:01.829369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-354f9901-98dc-4c1e-82d0-8ce5f9c14655 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:55:01.838267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-354f9901-98dc-4c1e-82d0-8ce5f9c14655 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:55:01.839014 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-354f9901-98dc-4c1e-82d0-8ce5f9c14655 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:55:01.840017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-354f9901-98dc-4c1e-82d0-8ce5f9c14655 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:55:01.840650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-354f9901-98dc-4c1e-82d0-8ce5f9c14655 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:55:02.002101 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.network.security_group_api [None req-354f9901-98dc-4c1e-82d0-8ce5f9c14655 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Adding security group ee487a9f-8e44-4fca-98db-0a49f4128ee8 to port 04b0ba84-3631-44ea-b484-d65a7505e70e Aug 02 07:55:02.349289 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-354f9901-98dc-4c1e-82d0-8ce5f9c14655 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "POST /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/action" status: 202 len: 0 microversion: 2.1 time: 0.524894 Aug 02 07:55:02.350369 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3632/7190] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:55:01 2022] POST /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:55:02.359335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b7207041-9506-4659-adca-89a3cc38495e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:55:02.360175 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b7207041-9506-4659-adca-89a3cc38495e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:55:02.360393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-53455b8a-2beb-44fa-830c-b7091a873b14 req-b8cc6be7-a432-4132-af73-f8f8e277155e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebc7ae5-ca50-4bce-aad4-65b68fbd0679", "tag": "04b0ba84-3631-44ea-b484-d65a7505e70e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:55:02.373135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-53455b8a-2beb-44fa-830c-b7091a873b14 req-b8cc6be7-a432-4132-af73-f8f8e277155e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:55:02.374149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-53455b8a-2beb-44fa-830c-b7091a873b14 req-b8cc6be7-a432-4132-af73-f8f8e277155e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:55:02.380067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7207041-9506-4659-adca-89a3cc38495e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:55:02.381036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7207041-9506-4659-adca-89a3cc38495e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:55:02.382447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7207041-9506-4659-adca-89a3cc38495e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:55:02.384462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b7207041-9506-4659-adca-89a3cc38495e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:55:02.393464 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-53455b8a-2beb-44fa-830c-b7091a873b14 req-b8cc6be7-a432-4132-af73-f8f8e277155e service nova] Creating event network-changed:04b0ba84-3631-44ea-b484-d65a7505e70e for instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 on n-h1-851337-3 Aug 02 07:55:02.399463 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-53455b8a-2beb-44fa-830c-b7091a873b14 req-b8cc6be7-a432-4132-af73-f8f8e277155e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043098 Aug 02 07:55:02.400864 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3633/7191] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:55:02.576529 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b7207041-9506-4659-adca-89a3cc38495e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:55:02.587542 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b7207041-9506-4659-adca-89a3cc38495e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1759 microversion: 2.1 time: 0.232032 Aug 02 07:55:02.588979 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3559/7192] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:55:02 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1759 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:57:18.674364 n-d-851337-3 devstack@n-api.service[126120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c0c3e5c9-f933-4314-bd57-3d2ecb041378] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 07:57:18.675187 n-d-851337-3 devstack@n-api.service[126120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da609bec-98c7-4964-8d17-beefad60c655] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 07:57:18.675777 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:57:18.676668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=12 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:57:18.681354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-136e8da8-352a-491e-91a5-d65bcbbc3b07 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:57:18.683714 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-136e8da8-352a-491e-91a5-d65bcbbc3b07 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:57:18.691549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-136e8da8-352a-491e-91a5-d65bcbbc3b07 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:57:18.692018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-136e8da8-352a-491e-91a5-d65bcbbc3b07 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:57:18.692794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-136e8da8-352a-491e-91a5-d65bcbbc3b07 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:57:18.693225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-136e8da8-352a-491e-91a5-d65bcbbc3b07 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:57:18.771715 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-136e8da8-352a-491e-91a5-d65bcbbc3b07 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "POST /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/action" status: 202 len: 0 microversion: 2.1 time: 0.098712 Aug 02 07:57:18.772646 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3634/7193] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:57:18 2022] POST /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:57:18.779050 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52c7fbf0-ab5b-40ba-9153-7d2f92273477] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 07:57:18.780188 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ad41dfa6-acfa-4002-ab8d-84c3526bc6c6] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 07:57:18.781090 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:57:18.782065 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=8 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:57:18.786408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-19c7958d-492b-40ab-8b5e-df5c30d68daa tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:57:18.787009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-19c7958d-492b-40ab-8b5e-df5c30d68daa tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:57:18.794088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19c7958d-492b-40ab-8b5e-df5c30d68daa tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:57:18.794590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19c7958d-492b-40ab-8b5e-df5c30d68daa tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:57:18.795366 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19c7958d-492b-40ab-8b5e-df5c30d68daa tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:57:18.795810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-19c7958d-492b-40ab-8b5e-df5c30d68daa tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:57:18.943722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-19c7958d-492b-40ab-8b5e-df5c30d68daa tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:57:18.952074 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-19c7958d-492b-40ab-8b5e-df5c30d68daa tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1761 microversion: 2.1 time: 0.175033 Aug 02 07:57:18.952686 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3560/7194] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:57:18 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1761 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:57:19.978980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f3b75e96-c213-4148-b5e0-c22a23b7fc3a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:57:19.979687 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f3b75e96-c213-4148-b5e0-c22a23b7fc3a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:57:19.988102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3b75e96-c213-4148-b5e0-c22a23b7fc3a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:57:19.988551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3b75e96-c213-4148-b5e0-c22a23b7fc3a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:57:19.989320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3b75e96-c213-4148-b5e0-c22a23b7fc3a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:57:19.989758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f3b75e96-c213-4148-b5e0-c22a23b7fc3a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:57:19.997125 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] [c0c3e5c9-f933-4314-bd57-3d2ecb041378] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 38506. Aug 02 07:57:20.001498 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] [da609bec-98c7-4964-8d17-beefad60c655] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 38508. Aug 02 07:57:20.147653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f3b75e96-c213-4148-b5e0-c22a23b7fc3a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:57:20.156350 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f3b75e96-c213-4148-b5e0-c22a23b7fc3a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1766 microversion: 2.1 time: 0.185491 Aug 02 07:57:20.156942 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3635/7195] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:57:19 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1766 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:57:21.185828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bda2bb8b-b1a3-4cf6-82eb-99b61201814d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:57:21.186907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bda2bb8b-b1a3-4cf6-82eb-99b61201814d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:57:21.196410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bda2bb8b-b1a3-4cf6-82eb-99b61201814d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:57:21.196865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bda2bb8b-b1a3-4cf6-82eb-99b61201814d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:57:21.197642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bda2bb8b-b1a3-4cf6-82eb-99b61201814d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:57:21.198122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bda2bb8b-b1a3-4cf6-82eb-99b61201814d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:57:21.215581 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] [52c7fbf0-ab5b-40ba-9153-7d2f92273477] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 38512. Aug 02 07:57:21.220486 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] [ad41dfa6-acfa-4002-ab8d-84c3526bc6c6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 38514. Aug 02 07:57:21.357871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bda2bb8b-b1a3-4cf6-82eb-99b61201814d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:57:21.367372 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bda2bb8b-b1a3-4cf6-82eb-99b61201814d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1759 microversion: 2.1 time: 0.185803 Aug 02 07:57:21.367955 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3561/7196] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:57:21 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1759 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:57:46.209040 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:57:46.210176 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 07:57:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:58:03.059123 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:58:03.059825 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 07:58:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:58:52.877671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:58:52.878552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:58:52.882922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-717c528c-2565-4767-977e-2e6e74791ac5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2088611304"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:58:52.883466 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-717c528c-2565-4767-977e-2e6e74791ac5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:58:52.891588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-717c528c-2565-4767-977e-2e6e74791ac5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:52.892040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-717c528c-2565-4767-977e-2e6e74791ac5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:52.892843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-717c528c-2565-4767-977e-2e6e74791ac5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:52.893280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-717c528c-2565-4767-977e-2e6e74791ac5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:53.032639 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.network.security_group_api [None req-717c528c-2565-4767-977e-2e6e74791ac5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Removing security group ee487a9f-8e44-4fca-98db-0a49f4128ee8 from port 04b0ba84-3631-44ea-b484-d65a7505e70e Aug 02 07:58:53.346259 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-717c528c-2565-4767-977e-2e6e74791ac5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "POST /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/action" status: 202 len: 0 microversion: 2.1 time: 0.470781 Aug 02 07:58:53.347133 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3636/7197] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:58:52 2022] POST /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:58:53.357703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:58:53.359382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=12 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:58:53.457922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-86f3d09f-abe0-4dff-b8b0-ae805557397a req-e37f79ae-ff02-434c-8132-1235f833f761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebc7ae5-ca50-4bce-aad4-65b68fbd0679", "tag": "04b0ba84-3631-44ea-b484-d65a7505e70e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:58:53.469738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-86f3d09f-abe0-4dff-b8b0-ae805557397a req-e37f79ae-ff02-434c-8132-1235f833f761 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:53.470232 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-86f3d09f-abe0-4dff-b8b0-ae805557397a req-e37f79ae-ff02-434c-8132-1235f833f761 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:53.482399 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-86f3d09f-abe0-4dff-b8b0-ae805557397a req-e37f79ae-ff02-434c-8132-1235f833f761 service nova] Creating event network-changed:04b0ba84-3631-44ea-b484-d65a7505e70e for instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 on n-h1-851337-3 Aug 02 07:58:53.490353 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-86f3d09f-abe0-4dff-b8b0-ae805557397a req-e37f79ae-ff02-434c-8132-1235f833f761 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137639 Aug 02 07:58:53.491228 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3562/7198] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:58:54.830386 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ac7dc1a6-a37e-404d-9a99-351843ac812a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:58:54.831273 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ac7dc1a6-a37e-404d-9a99-351843ac812a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:58:54.837393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac7dc1a6-a37e-404d-9a99-351843ac812a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:54.842359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac7dc1a6-a37e-404d-9a99-351843ac812a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:54.842359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac7dc1a6-a37e-404d-9a99-351843ac812a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:54.842359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ac7dc1a6-a37e-404d-9a99-351843ac812a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:54.924836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-ac7dc1a6-a37e-404d-9a99-351843ac812a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lazy-loading 'services' on Instance uuid 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 07:58:55.000093 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ac7dc1a6-a37e-404d-9a99-351843ac812a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments/71f3b2a5-2d42-4e64-a791-07056df9814e" status: 202 len: 0 microversion: 2.1 time: 0.174764 Aug 02 07:58:55.002092 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3637/7199] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:58:54 2022] DELETE /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments/71f3b2a5-2d42-4e64-a791-07056df9814e => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:58:55.012016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-683a60b1-416c-4a99-bcad-324df54bf81e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:58:55.015054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-683a60b1-416c-4a99-bcad-324df54bf81e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:58:55.021968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-683a60b1-416c-4a99-bcad-324df54bf81e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:55.022674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-683a60b1-416c-4a99-bcad-324df54bf81e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:55.023484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-683a60b1-416c-4a99-bcad-324df54bf81e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:55.023931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-683a60b1-416c-4a99-bcad-324df54bf81e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:55.054387 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-683a60b1-416c-4a99-bcad-324df54bf81e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048015 Aug 02 07:58:55.054939 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3563/7200] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:58:55 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:58:55.507885 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-57c81b3f-ea0e-4d64-b785-99b3357051fb req-31b8b4ec-2e40-4d72-8b97-5550a97cf06b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebc7ae5-ca50-4bce-aad4-65b68fbd0679", "tag": "04b0ba84-3631-44ea-b484-d65a7505e70e"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:58:55.518630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-57c81b3f-ea0e-4d64-b785-99b3357051fb req-31b8b4ec-2e40-4d72-8b97-5550a97cf06b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:55.519077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-57c81b3f-ea0e-4d64-b785-99b3357051fb req-31b8b4ec-2e40-4d72-8b97-5550a97cf06b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:55.530751 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-57c81b3f-ea0e-4d64-b785-99b3357051fb req-31b8b4ec-2e40-4d72-8b97-5550a97cf06b service nova] Creating event network-changed:04b0ba84-3631-44ea-b484-d65a7505e70e for instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 on n-h1-851337-3 Aug 02 07:58:55.535562 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-57c81b3f-ea0e-4d64-b785-99b3357051fb req-31b8b4ec-2e40-4d72-8b97-5550a97cf06b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032458 Aug 02 07:58:55.536185 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3638/7201] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:58:56.068142 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c05b6db5-c062-4455-99cf-c5856eaaf778 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:58:56.070966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c05b6db5-c062-4455-99cf-c5856eaaf778 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:58:56.078861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c05b6db5-c062-4455-99cf-c5856eaaf778 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:56.079320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c05b6db5-c062-4455-99cf-c5856eaaf778 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:56.080126 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c05b6db5-c062-4455-99cf-c5856eaaf778 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:56.080620 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c05b6db5-c062-4455-99cf-c5856eaaf778 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:56.121588 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c05b6db5-c062-4455-99cf-c5856eaaf778 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057663 Aug 02 07:58:56.122253 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3564/7202] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:58:56 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:58:57.138828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-790db6e9-71ba-421f-9424-49beb505e07d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:58:57.140998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-790db6e9-71ba-421f-9424-49beb505e07d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:58:57.148040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-790db6e9-71ba-421f-9424-49beb505e07d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:57.148482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-790db6e9-71ba-421f-9424-49beb505e07d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:57.149930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-790db6e9-71ba-421f-9424-49beb505e07d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:57.150344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-790db6e9-71ba-421f-9424-49beb505e07d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:57.183190 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-790db6e9-71ba-421f-9424-49beb505e07d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050534 Aug 02 07:58:57.183780 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3639/7203] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:58:57 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:58:58.195727 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-820da0c4-e2b8-4665-9ab6-13b6aa9fcaa3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:58:58.198248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-820da0c4-e2b8-4665-9ab6-13b6aa9fcaa3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:58:58.206036 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-820da0c4-e2b8-4665-9ab6-13b6aa9fcaa3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:58.206507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-820da0c4-e2b8-4665-9ab6-13b6aa9fcaa3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:58.207308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-820da0c4-e2b8-4665-9ab6-13b6aa9fcaa3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:58.207768 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-820da0c4-e2b8-4665-9ab6-13b6aa9fcaa3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:58.239256 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-820da0c4-e2b8-4665-9ab6-13b6aa9fcaa3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047519 Aug 02 07:58:58.240077 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3565/7204] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:58:58 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:58:59.252966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-80c712b0-c155-4979-b969-c7831bfab835 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:58:59.255343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-80c712b0-c155-4979-b969-c7831bfab835 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:58:59.263077 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80c712b0-c155-4979-b969-c7831bfab835 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:59.263530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80c712b0-c155-4979-b969-c7831bfab835 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:59.264316 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80c712b0-c155-4979-b969-c7831bfab835 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:58:59.264755 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-80c712b0-c155-4979-b969-c7831bfab835 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:58:59.295634 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-80c712b0-c155-4979-b969-c7831bfab835 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047302 Aug 02 07:58:59.296251 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3640/7205] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:58:59 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:59:00.310725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-02082967-51aa-44a6-9270-43811de25bb0 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:00.313363 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-02082967-51aa-44a6-9270-43811de25bb0 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:00.322988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02082967-51aa-44a6-9270-43811de25bb0 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:00.322988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02082967-51aa-44a6-9270-43811de25bb0 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:00.323653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02082967-51aa-44a6-9270-43811de25bb0 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:00.324091 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-02082967-51aa-44a6-9270-43811de25bb0 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:00.356493 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-02082967-51aa-44a6-9270-43811de25bb0 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051365 Aug 02 07:59:00.357075 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3566/7206] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 07:59:00 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 07:59:00.368277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ec2817dd-1f6f-4417-ad8c-bd666e9690ba tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:00.368856 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ec2817dd-1f6f-4417-ad8c-bd666e9690ba tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:00.376728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec2817dd-1f6f-4417-ad8c-bd666e9690ba tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:00.377183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec2817dd-1f6f-4417-ad8c-bd666e9690ba tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:00.377999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec2817dd-1f6f-4417-ad8c-bd666e9690ba tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:00.378442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ec2817dd-1f6f-4417-ad8c-bd666e9690ba tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:00.463389 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-ec2817dd-1f6f-4417-ad8c-bd666e9690ba tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] HTTP exception thrown: Instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 is not attached to volume 71f3b2a5-2d42-4e64-a791-07056df9814e Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ec2817dd-1f6f-4417-ad8c-bd666e9690ba tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Request method failure captured: Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments/71f3b2a5-2d42-4e64-a791-07056df9814e HTTP/1.1 Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Ngdh1CktBasOWTtJs2_95282_KvN92KzGuB5xsWW0KC8e_olieQ_cV6Tlv-DiDsZXJcAWMcYw7iwY7w0CZ6r6a2_LlSzwt4ZTwWv56p69xjhoK0zOZj5jbXSBPy9pTJ5lpWZCUftwxN-BmOejbbuWQ0stz7wzgVU1wLRv7k_Sruig0 Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8b63ef2342794a4585fd3062f6d01d05 Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestMinimumBasicScenario-437822553 Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8b63ef2342794a4585fd3062f6d01d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8b63ef2342794a4585fd3062f6d01d05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8b63ef2342794a4585fd3062f6d01d05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8b63ef2342794a4585fd3062f6d01d05"}]}] Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestMinimumBasicScenario-437822553 Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8b63ef2342794a4585fd3062f6d01d05 Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestMinimumBasicScenario-437822553 Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestMinimumBasicScenario-437822553-project Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 377a3a65f0904cc98bc85c1d4e2e2822 Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestMinimumBasicScenario-437822553-project Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 is not attached to volume 71f3b2a5-2d42-4e64-a791-07056df9814e Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'server_id': '3ebc7ae5-ca50-4bce-aad4-65b68fbd0679', 'id': '71f3b2a5-2d42-4e64-a791-07056df9814e'} Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 71f3b2a5-2d42-4e64-a791-07056df9814e. Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 is not attached to volume 71f3b2a5-2d42-4e64-a791-07056df9814e Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:59:00.465040 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:59:00.469097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:59:00.469097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:59:00.469097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 is not attached to volume 71f3b2a5-2d42-4e64-a791-07056df9814e Aug 02 07:59:00.469097 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:59:00.469097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ec2817dd-1f6f-4417-ad8c-bd666e9690ba tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Returning 404 to user: Instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 is not attached to volume 71f3b2a5-2d42-4e64-a791-07056df9814e {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:59:00.469097 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ec2817dd-1f6f-4417-ad8c-bd666e9690ba tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments/71f3b2a5-2d42-4e64-a791-07056df9814e" status: 404 len: 154 microversion: 2.1 time: 0.102415 Aug 02 07:59:00.469097 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3641/7207] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 07:59:00 2022] DELETE /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679/os-volume_attachments/71f3b2a5-2d42-4e64-a791-07056df9814e => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:59:03.742677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-62724be8-d372-4629-90eb-edc54322e2b8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:03.743524 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-62724be8-d372-4629-90eb-edc54322e2b8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:03.752011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62724be8-d372-4629-90eb-edc54322e2b8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:03.752555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62724be8-d372-4629-90eb-edc54322e2b8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:03.753552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62724be8-d372-4629-90eb-edc54322e2b8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:03.754062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-62724be8-d372-4629-90eb-edc54322e2b8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:03.781911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-62724be8-d372-4629-90eb-edc54322e2b8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 07:59:03.866168 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-62724be8-d372-4629-90eb-edc54322e2b8 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 204 len: 0 microversion: 2.1 time: 0.127244 Aug 02 07:59:03.866767 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3567/7208] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 07:59:03 2022] DELETE /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 07:59:03.877257 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-987e5650-803b-4d61-87e4-7f8ce36d8eee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:03.877956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-987e5650-803b-4d61-87e4-7f8ce36d8eee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:03.886864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-987e5650-803b-4d61-87e4-7f8ce36d8eee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:03.887647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-987e5650-803b-4d61-87e4-7f8ce36d8eee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:03.888522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-987e5650-803b-4d61-87e4-7f8ce36d8eee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:03.888994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-987e5650-803b-4d61-87e4-7f8ce36d8eee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:04.048897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-987e5650-803b-4d61-87e4-7f8ce36d8eee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:04.057207 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-987e5650-803b-4d61-87e4-7f8ce36d8eee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1553 microversion: 2.1 time: 0.184567 Aug 02 07:59:04.057782 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3642/7209] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:03 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:59:05.082583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-70b16282-8499-4d72-810b-52f77869abfd tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:05.083144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-70b16282-8499-4d72-810b-52f77869abfd tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:05.091537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70b16282-8499-4d72-810b-52f77869abfd tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:05.091999 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70b16282-8499-4d72-810b-52f77869abfd tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:05.092783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70b16282-8499-4d72-810b-52f77869abfd tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:05.093228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70b16282-8499-4d72-810b-52f77869abfd tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:05.234477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-70b16282-8499-4d72-810b-52f77869abfd tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:05.242673 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-70b16282-8499-4d72-810b-52f77869abfd tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1553 microversion: 2.1 time: 0.164648 Aug 02 07:59:05.243262 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3568/7210] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:05 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:06.265269 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-53c1d931-72fc-494f-b53b-0da9cd3909cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:06.266059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-53c1d931-72fc-494f-b53b-0da9cd3909cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:06.273388 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53c1d931-72fc-494f-b53b-0da9cd3909cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:06.273826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53c1d931-72fc-494f-b53b-0da9cd3909cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:06.274641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53c1d931-72fc-494f-b53b-0da9cd3909cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:06.275075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53c1d931-72fc-494f-b53b-0da9cd3909cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:06.448619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-53c1d931-72fc-494f-b53b-0da9cd3909cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:06.452490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-9835ace1-b31d-47f5-8801-0f331aff2a0e req-561f0049-a3bc-48b6-b76a-0246c8a57011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebc7ae5-ca50-4bce-aad4-65b68fbd0679", "name": "network-vif-deleted", "tag": "04b0ba84-3631-44ea-b484-d65a7505e70e"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:59:06.457862 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-53c1d931-72fc-494f-b53b-0da9cd3909cf tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 200 len: 1553 microversion: 2.1 time: 0.196817 Aug 02 07:59:06.459561 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3643/7211] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:06 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 1553 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:06.463961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9835ace1-b31d-47f5-8801-0f331aff2a0e req-561f0049-a3bc-48b6-b76a-0246c8a57011 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:06.464415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-9835ace1-b31d-47f5-8801-0f331aff2a0e req-561f0049-a3bc-48b6-b76a-0246c8a57011 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:06.476592 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-9835ace1-b31d-47f5-8801-0f331aff2a0e req-561f0049-a3bc-48b6-b76a-0246c8a57011 service nova] Creating event network-vif-deleted:04b0ba84-3631-44ea-b484-d65a7505e70e for instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 on n-h1-851337-3 Aug 02 07:59:06.482362 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-9835ace1-b31d-47f5-8801-0f331aff2a0e req-561f0049-a3bc-48b6-b76a-0246c8a57011 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037181 Aug 02 07:59:06.483080 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3569/7212] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:59:07.482161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-75867399-2293-4441-955e-7a8fb5f9c0d3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:07.482745 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-75867399-2293-4441-955e-7a8fb5f9c0d3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:07.490928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75867399-2293-4441-955e-7a8fb5f9c0d3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:07.491393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75867399-2293-4441-955e-7a8fb5f9c0d3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:07.492221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75867399-2293-4441-955e-7a8fb5f9c0d3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:07.492695 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75867399-2293-4441-955e-7a8fb5f9c0d3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:07.514362 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-75867399-2293-4441-955e-7a8fb5f9c0d3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] HTTP exception thrown: Instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 could not be found. Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-75867399-2293-4441-955e-7a8fb5f9c0d3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Request method failure captured: Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 HTTP/1.1 Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Ngdh1CktBasOWTtJs2_95282_KvN92KzGuB5xsWW0KC8e_olieQ_cV6Tlv-DiDsZXJcAWMcYw7iwY7w0CZ6r6a2_LlSzwt4ZTwWv56p69xjhoK0zOZj5jbXSBPy9pTJ5lpWZCUftwxN-BmOejbbuWQ0stz7wzgVU1wLRv7k_Sruig0 Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8b63ef2342794a4585fd3062f6d01d05 Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestMinimumBasicScenario-437822553 Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8b63ef2342794a4585fd3062f6d01d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8b63ef2342794a4585fd3062f6d01d05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8b63ef2342794a4585fd3062f6d01d05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8b63ef2342794a4585fd3062f6d01d05"}]}] Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestMinimumBasicScenario-437822553 Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8b63ef2342794a4585fd3062f6d01d05 Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestMinimumBasicScenario-437822553 Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestMinimumBasicScenario-437822553-project Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 377a3a65f0904cc98bc85c1d4e2e2822 Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestMinimumBasicScenario-437822553-project Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 could not be found. Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '3ebc7ae5-ca50-4bce-aad4-65b68fbd0679'} Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 could not be found. Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 could not be found. Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 07:59:07.515993 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:59:07.520405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 07:59:07.520405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 07:59:07.520405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 07:59:07.520405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 07:59:07.520405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 07:59:07.520405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 could not be found. Aug 02 07:59:07.520405 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 07:59:07.520405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-75867399-2293-4441-955e-7a8fb5f9c0d3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Returning 404 to user: Instance 3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 07:59:07.520405 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-75867399-2293-4441-955e-7a8fb5f9c0d3 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679" status: 404 len: 111 microversion: 2.1 time: 0.039727 Aug 02 07:59:07.520405 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3644/7213] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:07 2022] GET /compute/v2.1/servers/3ebc7ae5-ca50-4bce-aad4-65b68fbd0679 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 07:59:07.532949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-99fc4300-0ae6-4c8c-98ec-2203fa6f0a2f tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '.version_select at 0x7f927b61bdc0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:07.537752 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [None req-99fc4300-0ae6-4c8c-98ec-2203fa6f0a2f tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [af7f37fb-ea4c-4e48-9dc2-e8e7aa30923e] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 07:59:08.545875 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [None req-99fc4300-0ae6-4c8c-98ec-2203fa6f0a2f tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [af7f37fb-ea4c-4e48-9dc2-e8e7aa30923e] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 38624. Aug 02 07:59:08.569684 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-99fc4300-0ae6-4c8c-98ec-2203fa6f0a2f tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1599059993" status: 202 len: 0 microversion: 2.1 time: 1.044690 Aug 02 07:59:08.570304 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3570/7214] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 07:59:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1599059993 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:59:17.795414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=18 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:59:17.796259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:59:17.864642 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d37a3eb5-c4db-41cc-9f71-08ac5b1399d2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Action: 'create', calling method: .version_select at 0x7f9279cf44c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1483531561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkLy5p8Nl6iZrpNneoK7XfPeevSJL8bVWhuwcEQsblV20Yq/N5tXPUr6+pbpTW8nXA6EpVUTWwKiIssk7yau0NlZcJzzPScTXCct32y0W+yO9Lo4hZFxCG2WJ3j4sXOvQ=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:59:17.885380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-d37a3eb5-c4db-41cc-9f71-08ac5b1399d2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Getting quotas for project 8b63ef2342794a4585fd3062f6d01d05. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:59:17.892234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-d37a3eb5-c4db-41cc-9f71-08ac5b1399d2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Getting quotas for user 377a3a65f0904cc98bc85c1d4e2e2822 and project 8b63ef2342794a4585fd3062f6d01d05. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:59:17.907510 n-d-851337-3 devstack@n-api.service[126120]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d37a3eb5-c4db-41cc-9f71-08ac5b1399d2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [d1d9312e-73bb-465a-9eea-324f96560b63] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 07:59:18.916474 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [None req-d37a3eb5-c4db-41cc-9f71-08ac5b1399d2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [d1d9312e-73bb-465a-9eea-324f96560b63] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 38712. Aug 02 07:59:18.934567 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d37a3eb5-c4db-41cc-9f71-08ac5b1399d2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.144925 Aug 02 07:59:18.935162 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3645/7215] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 07:59:17 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:59:18.988490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:59:18.989327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:59:18.993693 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1234512461", "imageRef": "fdb9c531-e2ea-4700-995c-13964c993f76", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1483531561", "networks": [{"uuid": "1e10eb13-4cf0-48b1-84e0-6fdbc0969a5e"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:59:19.052786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] validate_networks() for [('1e10eb13-4cf0-48b1-84e0-6fdbc0969a5e', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 07:59:19.511870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 07:59:19.512559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 07:59:19.513294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 07:59:19.513922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 07:59:19.514560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 07:59:19.525527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:19.526027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:19.526843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:19.527294 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:19.545305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Getting quotas for project 8b63ef2342794a4585fd3062f6d01d05. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 07:59:19.551642 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Getting quotas for user 377a3a65f0904cc98bc85c1d4e2e2822 and project 8b63ef2342794a4585fd3062f6d01d05. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 07:59:19.565742 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 07:59:19.568158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fdb9c531-e2ea-4700-995c-13964c993f76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 07:59:19.616694 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4a253bc4-016e-4dfa-ab1a-1e996f1e8cd7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629958 Aug 02 07:59:19.617366 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3571/7216] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 07:59:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 07:59:19.628724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7a78b9ef-9444-487f-a25b-1e13ee1ab53d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:19.629382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7a78b9ef-9444-487f-a25b-1e13ee1ab53d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:19.684527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7a78b9ef-9444-487f-a25b-1e13ee1ab53d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:19.692049 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7a78b9ef-9444-487f-a25b-1e13ee1ab53d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1259 microversion: 2.1 time: 0.067622 Aug 02 07:59:19.692641 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3646/7217] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:19 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:20.713911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bc94ea10-65be-440a-b289-84204c1dd51d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:20.714824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bc94ea10-65be-440a-b289-84204c1dd51d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:20.776536 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bc94ea10-65be-440a-b289-84204c1dd51d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:20.783849 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bc94ea10-65be-440a-b289-84204c1dd51d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1259 microversion: 2.1 time: 0.074891 Aug 02 07:59:20.784436 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3572/7218] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:20 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1259 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:21.805691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-30b9c437-c5d8-4b17-8e5b-31eb416994af tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:21.806338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-30b9c437-c5d8-4b17-8e5b-31eb416994af tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:21.864343 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-30b9c437-c5d8-4b17-8e5b-31eb416994af tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:21.871915 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-30b9c437-c5d8-4b17-8e5b-31eb416994af tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1259 microversion: 2.1 time: 0.070343 Aug 02 07:59:21.872535 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3647/7219] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:21 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:22.894643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c4ac8d0a-4220-4a00-8568-0143725a2082 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:22.895244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c4ac8d0a-4220-4a00-8568-0143725a2082 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:22.957138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c4ac8d0a-4220-4a00-8568-0143725a2082 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:22.965041 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c4ac8d0a-4220-4a00-8568-0143725a2082 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1259 microversion: 2.1 time: 0.074771 Aug 02 07:59:22.965729 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3573/7220] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:22 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1259 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:23.989023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-922e6d59-beb7-40a8-9291-1169c9fe24df tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:23.989634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-922e6d59-beb7-40a8-9291-1169c9fe24df tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:23.997629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-922e6d59-beb7-40a8-9291-1169c9fe24df tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:23.998152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-922e6d59-beb7-40a8-9291-1169c9fe24df tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:23.998968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-922e6d59-beb7-40a8-9291-1169c9fe24df tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:23.999427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-922e6d59-beb7-40a8-9291-1169c9fe24df tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:24.064848 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-922e6d59-beb7-40a8-9291-1169c9fe24df tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:24.072950 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-922e6d59-beb7-40a8-9291-1169c9fe24df tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1263 microversion: 2.1 time: 0.089184 Aug 02 07:59:24.073538 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3648/7221] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:23 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:25.094692 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-162e4270-bdef-43c6-8dee-22b785a85b87 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:25.095992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-162e4270-bdef-43c6-8dee-22b785a85b87 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:25.108651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-162e4270-bdef-43c6-8dee-22b785a85b87 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:25.113710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-162e4270-bdef-43c6-8dee-22b785a85b87 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:25.114869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-162e4270-bdef-43c6-8dee-22b785a85b87 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:25.118382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-162e4270-bdef-43c6-8dee-22b785a85b87 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:25.317964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-162e4270-bdef-43c6-8dee-22b785a85b87 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:25.330082 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-162e4270-bdef-43c6-8dee-22b785a85b87 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1317 microversion: 2.1 time: 0.239439 Aug 02 07:59:25.344470 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3574/7222] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:25 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:59:26.352721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6930cb3c-647a-4a39-b74b-58bd55d1a3c9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:26.354353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6930cb3c-647a-4a39-b74b-58bd55d1a3c9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:26.362002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6930cb3c-647a-4a39-b74b-58bd55d1a3c9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:26.362499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6930cb3c-647a-4a39-b74b-58bd55d1a3c9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:26.363319 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6930cb3c-647a-4a39-b74b-58bd55d1a3c9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:26.364104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6930cb3c-647a-4a39-b74b-58bd55d1a3c9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:26.508955 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6930cb3c-647a-4a39-b74b-58bd55d1a3c9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:26.517649 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6930cb3c-647a-4a39-b74b-58bd55d1a3c9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1359 microversion: 2.1 time: 0.169370 Aug 02 07:59:26.531142 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3649/7223] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:26 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:27.270661 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 07:59:27.270941 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 07:59:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 07:59:27.541377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3ec51d62-84d2-4719-8ed0-5627d3393dd6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:27.544025 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3ec51d62-84d2-4719-8ed0-5627d3393dd6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:27.550362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ec51d62-84d2-4719-8ed0-5627d3393dd6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:27.550915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ec51d62-84d2-4719-8ed0-5627d3393dd6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:27.551795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ec51d62-84d2-4719-8ed0-5627d3393dd6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:27.552334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3ec51d62-84d2-4719-8ed0-5627d3393dd6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:27.706767 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3ec51d62-84d2-4719-8ed0-5627d3393dd6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:27.714866 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3ec51d62-84d2-4719-8ed0-5627d3393dd6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1359 microversion: 2.1 time: 0.179297 Aug 02 07:59:27.719668 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3575/7224] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:27 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:28.736720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8e9c1d3e-d9ed-4443-a960-4f3e9b1dc142 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:28.738017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8e9c1d3e-d9ed-4443-a960-4f3e9b1dc142 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:28.745425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e9c1d3e-d9ed-4443-a960-4f3e9b1dc142 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:28.745871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e9c1d3e-d9ed-4443-a960-4f3e9b1dc142 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:28.746673 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e9c1d3e-d9ed-4443-a960-4f3e9b1dc142 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:28.747106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8e9c1d3e-d9ed-4443-a960-4f3e9b1dc142 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:28.893569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8e9c1d3e-d9ed-4443-a960-4f3e9b1dc142 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:28.901549 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8e9c1d3e-d9ed-4443-a960-4f3e9b1dc142 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1359 microversion: 2.1 time: 0.169174 Aug 02 07:59:28.902198 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3650/7225] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:28 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:29.925458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e4e96861-736a-4a9e-b383-c711492f4be1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:29.926423 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e4e96861-736a-4a9e-b383-c711492f4be1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:29.929263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:59:29.937485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4e96861-736a-4a9e-b383-c711492f4be1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:29.938558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4e96861-736a-4a9e-b383-c711492f4be1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:29.941071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4e96861-736a-4a9e-b383-c711492f4be1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:29.942751 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e4e96861-736a-4a9e-b383-c711492f4be1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:30.087851 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e4e96861-736a-4a9e-b383-c711492f4be1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:30.095675 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e4e96861-736a-4a9e-b383-c711492f4be1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1359 microversion: 2.1 time: 0.174375 Aug 02 07:59:30.096469 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3576/7226] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:29 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:31.117034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6b84b26e-8b36-4a9e-9dd9-1a9381e3ccee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:31.117742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6b84b26e-8b36-4a9e-9dd9-1a9381e3ccee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:31.125043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b84b26e-8b36-4a9e-9dd9-1a9381e3ccee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:31.125506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b84b26e-8b36-4a9e-9dd9-1a9381e3ccee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:31.126683 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b84b26e-8b36-4a9e-9dd9-1a9381e3ccee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:31.127129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6b84b26e-8b36-4a9e-9dd9-1a9381e3ccee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:31.307656 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6b84b26e-8b36-4a9e-9dd9-1a9381e3ccee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:31.316349 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6b84b26e-8b36-4a9e-9dd9-1a9381e3ccee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1359 microversion: 2.1 time: 0.203278 Aug 02 07:59:31.330657 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3651/7227] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:31 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:59:32.337241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1dc4774c-d5b1-4ed4-a460-8a64aba2f1ee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:32.337882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1dc4774c-d5b1-4ed4-a460-8a64aba2f1ee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:32.345305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1dc4774c-d5b1-4ed4-a460-8a64aba2f1ee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:32.345764 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1dc4774c-d5b1-4ed4-a460-8a64aba2f1ee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:32.346585 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1dc4774c-d5b1-4ed4-a460-8a64aba2f1ee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:32.347030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1dc4774c-d5b1-4ed4-a460-8a64aba2f1ee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:32.483997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1dc4774c-d5b1-4ed4-a460-8a64aba2f1ee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:32.492471 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1dc4774c-d5b1-4ed4-a460-8a64aba2f1ee tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1359 microversion: 2.1 time: 0.159071 Aug 02 07:59:32.493106 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3577/7228] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:32 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:33.514699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b6e47f64-4c1d-4900-87bc-31e91cf804f1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:33.515311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b6e47f64-4c1d-4900-87bc-31e91cf804f1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:33.517246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:59:33.523855 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6e47f64-4c1d-4900-87bc-31e91cf804f1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:33.524305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6e47f64-4c1d-4900-87bc-31e91cf804f1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:33.525072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6e47f64-4c1d-4900-87bc-31e91cf804f1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:33.525532 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b6e47f64-4c1d-4900-87bc-31e91cf804f1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:33.727255 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-fd4a3a02-8d32-43ee-b387-733160440366 req-8cc8d1a3-ab65-4d6a-a4e3-283ed31648fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b62c9b54-0b8d-463b-ac1d-b64316ce665c", "tag": "95e16776-e6a4-4317-8a74-7b04e2e0e1c7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:59:33.729114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b6e47f64-4c1d-4900-87bc-31e91cf804f1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:33.737875 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=10 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:59:33.739317 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b6e47f64-4c1d-4900-87bc-31e91cf804f1 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1359 microversion: 2.1 time: 0.228563 Aug 02 07:59:33.740580 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3652/7229] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:33 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:33.751551 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fd4a3a02-8d32-43ee-b387-733160440366 req-8cc8d1a3-ab65-4d6a-a4e3-283ed31648fc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:33.752027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fd4a3a02-8d32-43ee-b387-733160440366 req-8cc8d1a3-ab65-4d6a-a4e3-283ed31648fc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:33.767817 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-fd4a3a02-8d32-43ee-b387-733160440366 req-8cc8d1a3-ab65-4d6a-a4e3-283ed31648fc service nova] Creating event network-changed:95e16776-e6a4-4317-8a74-7b04e2e0e1c7 for instance b62c9b54-0b8d-463b-ac1d-b64316ce665c on n-h2-851337-3 Aug 02 07:59:33.773417 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-fd4a3a02-8d32-43ee-b387-733160440366 req-8cc8d1a3-ab65-4d6a-a4e3-283ed31648fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050530 Aug 02 07:59:33.774082 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3578/7230] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 07:59:34.768987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a140c42c-536a-4270-9c48-9a934a41dc11 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:34.770078 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a140c42c-536a-4270-9c48-9a934a41dc11 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:34.782104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a140c42c-536a-4270-9c48-9a934a41dc11 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:34.782861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a140c42c-536a-4270-9c48-9a934a41dc11 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:34.784153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a140c42c-536a-4270-9c48-9a934a41dc11 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:34.784888 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a140c42c-536a-4270-9c48-9a934a41dc11 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:34.919706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a140c42c-536a-4270-9c48-9a934a41dc11 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:34.927667 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a140c42c-536a-4270-9c48-9a934a41dc11 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1359 microversion: 2.1 time: 0.165343 Aug 02 07:59:34.928255 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3653/7231] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:34 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:35.955393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e0e3db46-7614-410c-aa4d-740359aa37d7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:35.956561 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e0e3db46-7614-410c-aa4d-740359aa37d7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:35.964171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0e3db46-7614-410c-aa4d-740359aa37d7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:35.964632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0e3db46-7614-410c-aa4d-740359aa37d7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:35.965405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0e3db46-7614-410c-aa4d-740359aa37d7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:35.965850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0e3db46-7614-410c-aa4d-740359aa37d7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:36.109256 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e0e3db46-7614-410c-aa4d-740359aa37d7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:36.117175 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e0e3db46-7614-410c-aa4d-740359aa37d7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1359 microversion: 2.1 time: 0.170367 Aug 02 07:59:36.117790 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3579/7232] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:35 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:37.139030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-07ec5241-d59f-4bca-b0ec-5094a2a09cd5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:37.139625 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-07ec5241-d59f-4bca-b0ec-5094a2a09cd5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:37.148051 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07ec5241-d59f-4bca-b0ec-5094a2a09cd5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:37.148520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07ec5241-d59f-4bca-b0ec-5094a2a09cd5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:37.149556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07ec5241-d59f-4bca-b0ec-5094a2a09cd5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:37.150476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07ec5241-d59f-4bca-b0ec-5094a2a09cd5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:37.291066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-07ec5241-d59f-4bca-b0ec-5094a2a09cd5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:37.299312 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-07ec5241-d59f-4bca-b0ec-5094a2a09cd5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1359 microversion: 2.1 time: 0.164775 Aug 02 07:59:37.299893 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3654/7233] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:37 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:38.323085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2a589606-3dad-4299-9999-68d8379e0bdc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:38.323705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2a589606-3dad-4299-9999-68d8379e0bdc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:38.331684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a589606-3dad-4299-9999-68d8379e0bdc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:38.332140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a589606-3dad-4299-9999-68d8379e0bdc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:38.332909 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a589606-3dad-4299-9999-68d8379e0bdc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:38.333353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2a589606-3dad-4299-9999-68d8379e0bdc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:38.529630 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2a589606-3dad-4299-9999-68d8379e0bdc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:38.537773 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2a589606-3dad-4299-9999-68d8379e0bdc tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1359 microversion: 2.1 time: 0.218991 Aug 02 07:59:38.538398 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3580/7234] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:38 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:38.636040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-534192c1-f147-4fc0-a303-7242ef4da999 req-043ae635-6457-4a9b-a30b-cf5e4b931e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b62c9b54-0b8d-463b-ac1d-b64316ce665c", "name": "network-vif-plugged", "status": "completed", "tag": "95e16776-e6a4-4317-8a74-7b04e2e0e1c7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:59:38.647429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-534192c1-f147-4fc0-a303-7242ef4da999 req-043ae635-6457-4a9b-a30b-cf5e4b931e3c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:38.648002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-534192c1-f147-4fc0-a303-7242ef4da999 req-043ae635-6457-4a9b-a30b-cf5e4b931e3c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:38.664236 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-534192c1-f147-4fc0-a303-7242ef4da999 req-043ae635-6457-4a9b-a30b-cf5e4b931e3c service nova] Creating event network-vif-plugged:95e16776-e6a4-4317-8a74-7b04e2e0e1c7 for instance b62c9b54-0b8d-463b-ac1d-b64316ce665c on n-h2-851337-3 Aug 02 07:59:38.669489 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-534192c1-f147-4fc0-a303-7242ef4da999 req-043ae635-6457-4a9b-a30b-cf5e4b931e3c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098665 Aug 02 07:59:38.670274 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3655/7235] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:59:39.563786 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-39ca9d2f-5d06-44cc-a120-cf26492bca0a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:39.564643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-39ca9d2f-5d06-44cc-a120-cf26492bca0a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:39.576436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39ca9d2f-5d06-44cc-a120-cf26492bca0a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:39.577153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39ca9d2f-5d06-44cc-a120-cf26492bca0a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:39.578410 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39ca9d2f-5d06-44cc-a120-cf26492bca0a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:39.579127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39ca9d2f-5d06-44cc-a120-cf26492bca0a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:39.722969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-39ca9d2f-5d06-44cc-a120-cf26492bca0a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:39.733655 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-39ca9d2f-5d06-44cc-a120-cf26492bca0a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1359 microversion: 2.1 time: 0.176339 Aug 02 07:59:39.734745 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3581/7236] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:39 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:40.760613 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-228a06bc-2348-4a8d-959f-a695d50c8200 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:40.761299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-228a06bc-2348-4a8d-959f-a695d50c8200 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:40.768359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-228a06bc-2348-4a8d-959f-a695d50c8200 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:40.768803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-228a06bc-2348-4a8d-959f-a695d50c8200 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:40.769566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-228a06bc-2348-4a8d-959f-a695d50c8200 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:40.770031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-228a06bc-2348-4a8d-959f-a695d50c8200 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:40.961290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-228a06bc-2348-4a8d-959f-a695d50c8200 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:40.969401 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-228a06bc-2348-4a8d-959f-a695d50c8200 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1547 microversion: 2.1 time: 0.215564 Aug 02 07:59:40.970031 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3656/7237] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:40 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1547 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:40.992229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1f8068c6-e896-42fa-b4a7-2053be5c6534 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:40.992814 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1f8068c6-e896-42fa-b4a7-2053be5c6534 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:41.000591 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f8068c6-e896-42fa-b4a7-2053be5c6534 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:41.001463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f8068c6-e896-42fa-b4a7-2053be5c6534 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:41.002302 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f8068c6-e896-42fa-b4a7-2053be5c6534 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:41.002753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1f8068c6-e896-42fa-b4a7-2053be5c6534 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:41.148087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1f8068c6-e896-42fa-b4a7-2053be5c6534 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:41.156373 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1f8068c6-e896-42fa-b4a7-2053be5c6534 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1547 microversion: 2.1 time: 0.169788 Aug 02 07:59:41.156989 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3582/7238] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:40 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:41.184223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-87e65655-f4ed-44be-b313-df1fa5fe9f80 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:41.188783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-87e65655-f4ed-44be-b313-df1fa5fe9f80 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:41.189584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-87e65655-f4ed-44be-b313-df1fa5fe9f80 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Searching by: {'deleted': False, 'project_id': '8b63ef2342794a4585fd3062f6d01d05'} {{(pid=126120) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 07:59:41.195449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87e65655-f4ed-44be-b313-df1fa5fe9f80 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:41.195900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87e65655-f4ed-44be-b313-df1fa5fe9f80 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:41.196698 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87e65655-f4ed-44be-b313-df1fa5fe9f80 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:41.197129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-87e65655-f4ed-44be-b313-df1fa5fe9f80 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:41.222783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.multi_cell_list [None req-87e65655-f4ed-44be-b313-df1fa5fe9f80 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 07:59:41.250888 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-87e65655-f4ed-44be-b313-df1fa5fe9f80 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070605 Aug 02 07:59:41.251852 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3657/7239] 10.222.0.79 () {58 vars in 1125 bytes} [Tue Aug 2 07:59:41 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:59:41.266305 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7d43b0f3-8846-4c17-b43d-922386b7bde5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:41.267216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7d43b0f3-8846-4c17-b43d-922386b7bde5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:41.275023 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d43b0f3-8846-4c17-b43d-922386b7bde5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:41.275513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d43b0f3-8846-4c17-b43d-922386b7bde5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:41.276279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d43b0f3-8846-4c17-b43d-922386b7bde5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:41.276805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d43b0f3-8846-4c17-b43d-922386b7bde5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:41.412425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7d43b0f3-8846-4c17-b43d-922386b7bde5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:41.420419 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7d43b0f3-8846-4c17-b43d-922386b7bde5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1547 microversion: 2.1 time: 0.160454 Aug 02 07:59:41.420991 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3583/7240] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:41 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:42.962689 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6ce585d3-dc74-42df-af4b-e04e1130a216 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8787ab00-ea2d-4af8-b494-92f36c7c2781"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:59:42.965105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6ce585d3-dc74-42df-af4b-e04e1130a216 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:42.972781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ce585d3-dc74-42df-af4b-e04e1130a216 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:42.973238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ce585d3-dc74-42df-af4b-e04e1130a216 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:42.974031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ce585d3-dc74-42df-af4b-e04e1130a216 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:42.974437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6ce585d3-dc74-42df-af4b-e04e1130a216 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:43.230849 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6ce585d3-dc74-42df-af4b-e04e1130a216 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "POST /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271686 Aug 02 07:59:43.231801 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3658/7241] 10.222.0.79 () {60 vars in 1323 bytes} [Tue Aug 2 07:59:42 2022] POST /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:59:54.034729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-75ffd7ec-44c0-4639-85c4-936ac9d4b85a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:54.035353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-75ffd7ec-44c0-4639-85c4-936ac9d4b85a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:54.037565 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:59:54.038301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=58 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:59:54.044092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75ffd7ec-44c0-4639-85c4-936ac9d4b85a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:54.044552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75ffd7ec-44c0-4639-85c4-936ac9d4b85a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:54.045346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75ffd7ec-44c0-4639-85c4-936ac9d4b85a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:54.045795 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75ffd7ec-44c0-4639-85c4-936ac9d4b85a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:54.189821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-75ffd7ec-44c0-4639-85c4-936ac9d4b85a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:54.201832 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-75ffd7ec-44c0-4639-85c4-936ac9d4b85a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1593 microversion: 2.1 time: 0.171113 Aug 02 07:59:54.202588 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3584/7242] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:54 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1593 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 07:59:56.205332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:59:56.206302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:59:56.206862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 07:59:56.210940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b3281ea8-891b-4e1d-85fe-b86755c4ebdd req-61cbcc86-76de-4209-8cb0-cf97c664ba46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b62c9b54-0b8d-463b-ac1d-b64316ce665c", "tag": "95e16776-e6a4-4317-8a74-7b04e2e0e1c7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:59:56.222570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b3281ea8-891b-4e1d-85fe-b86755c4ebdd req-61cbcc86-76de-4209-8cb0-cf97c664ba46 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:56.223076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b3281ea8-891b-4e1d-85fe-b86755c4ebdd req-61cbcc86-76de-4209-8cb0-cf97c664ba46 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:56.235619 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b3281ea8-891b-4e1d-85fe-b86755c4ebdd req-61cbcc86-76de-4209-8cb0-cf97c664ba46 service nova] Creating event network-changed:95e16776-e6a4-4317-8a74-7b04e2e0e1c7 for instance b62c9b54-0b8d-463b-ac1d-b64316ce665c on n-h2-851337-3 Aug 02 07:59:56.242865 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b3281ea8-891b-4e1d-85fe-b86755c4ebdd req-61cbcc86-76de-4209-8cb0-cf97c664ba46 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039340 Aug 02 07:59:56.243448 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3659/7243] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 07:59:57.213794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9129ba70-7a40-404d-a7ee-4701f7d319d6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1781576112"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:59:57.214389 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9129ba70-7a40-404d-a7ee-4701f7d319d6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:57.221950 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9129ba70-7a40-404d-a7ee-4701f7d319d6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:57.222448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9129ba70-7a40-404d-a7ee-4701f7d319d6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:57.223208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9129ba70-7a40-404d-a7ee-4701f7d319d6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:57.224028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9129ba70-7a40-404d-a7ee-4701f7d319d6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:57.360343 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.network.security_group_api [None req-9129ba70-7a40-404d-a7ee-4701f7d319d6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Adding security group d80b7307-7ccd-436d-98c8-b53fd22bc690 to port 95e16776-e6a4-4317-8a74-7b04e2e0e1c7 Aug 02 07:59:57.696337 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9129ba70-7a40-404d-a7ee-4701f7d319d6 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "POST /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/action" status: 202 len: 0 microversion: 2.1 time: 0.485759 Aug 02 07:59:57.697163 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3585/7244] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 07:59:57 2022] POST /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 07:59:57.707098 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7f23f6e-e152-4e56-aa46-7e56338ffc38 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 07:59:57.708066 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e7f23f6e-e152-4e56-aa46-7e56338ffc38 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 07:59:57.718015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7f23f6e-e152-4e56-aa46-7e56338ffc38 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:57.718015 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7f23f6e-e152-4e56-aa46-7e56338ffc38 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:57.718894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7f23f6e-e152-4e56-aa46-7e56338ffc38 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:57.719730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7f23f6e-e152-4e56-aa46-7e56338ffc38 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:57.879828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e7f23f6e-e152-4e56-aa46-7e56338ffc38 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 07:59:57.888431 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7f23f6e-e152-4e56-aa46-7e56338ffc38 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1759 microversion: 2.1 time: 0.186609 Aug 02 07:59:57.889013 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3660/7245] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 07:59:57 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1759 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 07:59:58.259804 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-dfc07dce-d43e-4701-a0c4-89bdb9002b9c req-3aa02423-c612-4008-9574-2bb43a910899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b62c9b54-0b8d-463b-ac1d-b64316ce665c", "tag": "95e16776-e6a4-4317-8a74-7b04e2e0e1c7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 07:59:58.269777 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-dfc07dce-d43e-4701-a0c4-89bdb9002b9c req-3aa02423-c612-4008-9574-2bb43a910899 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 07:59:58.270258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-dfc07dce-d43e-4701-a0c4-89bdb9002b9c req-3aa02423-c612-4008-9574-2bb43a910899 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 07:59:58.282249 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-dfc07dce-d43e-4701-a0c4-89bdb9002b9c req-3aa02423-c612-4008-9574-2bb43a910899 service nova] Creating event network-changed:95e16776-e6a4-4317-8a74-7b04e2e0e1c7 for instance b62c9b54-0b8d-463b-ac1d-b64316ce665c on n-h2-851337-3 Aug 02 07:59:58.287318 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-dfc07dce-d43e-4701-a0c4-89bdb9002b9c req-3aa02423-c612-4008-9574-2bb43a910899 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032325 Aug 02 07:59:58.288037 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3586/7246] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 07:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:00:12.876483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-42edfad9-cf0c-4913-99ca-24f54f1c086d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:00:12.878767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-42edfad9-cf0c-4913-99ca-24f54f1c086d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:12.881694 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:00:12.882365 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=8 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:00:12.888350 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42edfad9-cf0c-4913-99ca-24f54f1c086d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:12.888799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42edfad9-cf0c-4913-99ca-24f54f1c086d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:12.889561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42edfad9-cf0c-4913-99ca-24f54f1c086d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:12.890017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-42edfad9-cf0c-4913-99ca-24f54f1c086d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:12.971865 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-42edfad9-cf0c-4913-99ca-24f54f1c086d tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "POST /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/action" status: 202 len: 0 microversion: 2.1 time: 0.099111 Aug 02 08:00:12.973008 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3661/7247] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:00:12 2022] POST /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:00:12.979275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:00:12.980044 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=12 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:00:12.984737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8d858d6d-f02c-49e6-9690-d6f62be14080 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:12.985560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8d858d6d-f02c-49e6-9690-d6f62be14080 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:12.993357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d858d6d-f02c-49e6-9690-d6f62be14080 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:12.993819 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d858d6d-f02c-49e6-9690-d6f62be14080 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:12.994632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d858d6d-f02c-49e6-9690-d6f62be14080 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:12.995101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d858d6d-f02c-49e6-9690-d6f62be14080 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:13.247089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8d858d6d-f02c-49e6-9690-d6f62be14080 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:00:13.256278 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8d858d6d-f02c-49e6-9690-d6f62be14080 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1751 microversion: 2.1 time: 0.278916 Aug 02 08:00:13.256886 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3587/7248] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:00:12 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1751 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:00:14.282873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a0375be3-ddc7-480f-ada5-e361e2c841e9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:14.283808 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a0375be3-ddc7-480f-ada5-e361e2c841e9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:14.296288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0375be3-ddc7-480f-ada5-e361e2c841e9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:14.297011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0375be3-ddc7-480f-ada5-e361e2c841e9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:14.298232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0375be3-ddc7-480f-ada5-e361e2c841e9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:14.298665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a0375be3-ddc7-480f-ada5-e361e2c841e9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:14.463500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a0375be3-ddc7-480f-ada5-e361e2c841e9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:00:14.476789 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a0375be3-ddc7-480f-ada5-e361e2c841e9 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1756 microversion: 2.1 time: 0.200718 Aug 02 08:00:14.477653 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3662/7249] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:00:14 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:00:15.504676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e0a780e1-d4be-4bef-b19b-c17499fc370a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:15.505215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e0a780e1-d4be-4bef-b19b-c17499fc370a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:15.512515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0a780e1-d4be-4bef-b19b-c17499fc370a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:15.512981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0a780e1-d4be-4bef-b19b-c17499fc370a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:15.513763 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0a780e1-d4be-4bef-b19b-c17499fc370a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:15.514252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e0a780e1-d4be-4bef-b19b-c17499fc370a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:15.674636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e0a780e1-d4be-4bef-b19b-c17499fc370a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:00:15.683138 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e0a780e1-d4be-4bef-b19b-c17499fc370a tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1756 microversion: 2.1 time: 0.184616 Aug 02 08:00:15.683692 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3588/7250] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:00:15 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:00:16.707496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8f08092d-109e-4853-8202-1d56f37c42e7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:16.708105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8f08092d-109e-4853-8202-1d56f37c42e7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:16.715652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f08092d-109e-4853-8202-1d56f37c42e7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:16.716113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f08092d-109e-4853-8202-1d56f37c42e7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:16.716884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f08092d-109e-4853-8202-1d56f37c42e7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:16.717325 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8f08092d-109e-4853-8202-1d56f37c42e7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:16.870515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8f08092d-109e-4853-8202-1d56f37c42e7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:00:16.879470 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8f08092d-109e-4853-8202-1d56f37c42e7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1756 microversion: 2.1 time: 0.176605 Aug 02 08:00:16.880032 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3663/7251] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:00:16 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:00:17.901158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4880e505-602e-4e77-a708-f2e182c5d85e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:17.901792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4880e505-602e-4e77-a708-f2e182c5d85e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:17.909351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4880e505-602e-4e77-a708-f2e182c5d85e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:17.909815 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4880e505-602e-4e77-a708-f2e182c5d85e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:17.910621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4880e505-602e-4e77-a708-f2e182c5d85e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:17.911071 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4880e505-602e-4e77-a708-f2e182c5d85e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:18.066156 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4880e505-602e-4e77-a708-f2e182c5d85e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:00:18.079267 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4880e505-602e-4e77-a708-f2e182c5d85e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1756 microversion: 2.1 time: 0.181452 Aug 02 08:00:18.080087 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3589/7252] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:00:17 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:00:19.105450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-85e4152e-b2be-495c-9b29-1e4ddca77903 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:19.106345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-85e4152e-b2be-495c-9b29-1e4ddca77903 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:19.118793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-85e4152e-b2be-495c-9b29-1e4ddca77903 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:19.119547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-85e4152e-b2be-495c-9b29-1e4ddca77903 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:19.120822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-85e4152e-b2be-495c-9b29-1e4ddca77903 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:19.121555 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-85e4152e-b2be-495c-9b29-1e4ddca77903 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:19.272472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-85e4152e-b2be-495c-9b29-1e4ddca77903 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:00:19.280923 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-85e4152e-b2be-495c-9b29-1e4ddca77903 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1756 microversion: 2.1 time: 0.182290 Aug 02 08:00:19.281462 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3664/7253] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:00:19 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:00:20.305960 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6baf2d50-dede-4528-9291-6ea433fccf1b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:20.306743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6baf2d50-dede-4528-9291-6ea433fccf1b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:20.314992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6baf2d50-dede-4528-9291-6ea433fccf1b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:20.315456 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6baf2d50-dede-4528-9291-6ea433fccf1b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:20.316239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6baf2d50-dede-4528-9291-6ea433fccf1b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:20.316713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6baf2d50-dede-4528-9291-6ea433fccf1b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:20.476689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6baf2d50-dede-4528-9291-6ea433fccf1b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:00:20.485296 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6baf2d50-dede-4528-9291-6ea433fccf1b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1756 microversion: 2.1 time: 0.184741 Aug 02 08:00:20.486026 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3590/7254] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:00:20 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:00:21.509151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-be4c370b-ec1c-47d9-ac0b-c113c6a61b06 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:21.509678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-be4c370b-ec1c-47d9-ac0b-c113c6a61b06 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:21.519587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be4c370b-ec1c-47d9-ac0b-c113c6a61b06 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:21.520227 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be4c370b-ec1c-47d9-ac0b-c113c6a61b06 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:21.521589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be4c370b-ec1c-47d9-ac0b-c113c6a61b06 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:21.522213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-be4c370b-ec1c-47d9-ac0b-c113c6a61b06 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:21.677692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-be4c370b-ec1c-47d9-ac0b-c113c6a61b06 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:00:21.686848 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-be4c370b-ec1c-47d9-ac0b-c113c6a61b06 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1756 microversion: 2.1 time: 0.181960 Aug 02 08:00:21.687558 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3665/7255] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:00:21 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:00:22.710626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b3d91953-5686-494b-8ef9-a3b0afb93fe2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:22.711225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b3d91953-5686-494b-8ef9-a3b0afb93fe2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:22.718244 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b3d91953-5686-494b-8ef9-a3b0afb93fe2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:22.718705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b3d91953-5686-494b-8ef9-a3b0afb93fe2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:22.719515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b3d91953-5686-494b-8ef9-a3b0afb93fe2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:22.719937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b3d91953-5686-494b-8ef9-a3b0afb93fe2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:22.874686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b3d91953-5686-494b-8ef9-a3b0afb93fe2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:00:22.888701 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b3d91953-5686-494b-8ef9-a3b0afb93fe2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1756 microversion: 2.1 time: 0.182269 Aug 02 08:00:22.889542 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3591/7256] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:00:22 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:00:23.920158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a9adbd17-4dd3-4801-a0e1-9a9e415f0961 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:23.921253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a9adbd17-4dd3-4801-a0e1-9a9e415f0961 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:23.930035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9adbd17-4dd3-4801-a0e1-9a9e415f0961 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:23.930490 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9adbd17-4dd3-4801-a0e1-9a9e415f0961 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:23.931264 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9adbd17-4dd3-4801-a0e1-9a9e415f0961 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:23.931704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9adbd17-4dd3-4801-a0e1-9a9e415f0961 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:24.099370 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a9adbd17-4dd3-4801-a0e1-9a9e415f0961 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:00:24.111569 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a9adbd17-4dd3-4801-a0e1-9a9e415f0961 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1756 microversion: 2.1 time: 0.197828 Aug 02 08:00:24.112218 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3666/7257] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:00:23 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:00:25.133885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-93ad801e-8f90-446d-b695-b7b291e24391 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:25.134448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-93ad801e-8f90-446d-b695-b7b291e24391 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:25.142213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93ad801e-8f90-446d-b695-b7b291e24391 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:25.142672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93ad801e-8f90-446d-b695-b7b291e24391 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:25.143443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93ad801e-8f90-446d-b695-b7b291e24391 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:25.143885 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93ad801e-8f90-446d-b695-b7b291e24391 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:25.297847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-93ad801e-8f90-446d-b695-b7b291e24391 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:00:25.306443 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-93ad801e-8f90-446d-b695-b7b291e24391 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1759 microversion: 2.1 time: 0.176664 Aug 02 08:00:25.307031 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3592/7258] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:00:25 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1759 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:00:53.830778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-53f84a18-d1bf-4449-8a2b-9257c3767800 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1781576112"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:00:53.831468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-53f84a18-d1bf-4449-8a2b-9257c3767800 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:53.833850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=12 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:00:53.834659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:00:53.842958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53f84a18-d1bf-4449-8a2b-9257c3767800 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:53.845176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53f84a18-d1bf-4449-8a2b-9257c3767800 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:53.845176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53f84a18-d1bf-4449-8a2b-9257c3767800 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:53.845176 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53f84a18-d1bf-4449-8a2b-9257c3767800 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:53.988203 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.network.security_group_api [None req-53f84a18-d1bf-4449-8a2b-9257c3767800 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Removing security group d80b7307-7ccd-436d-98c8-b53fd22bc690 from port 95e16776-e6a4-4317-8a74-7b04e2e0e1c7 Aug 02 08:00:54.328403 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-53f84a18-d1bf-4449-8a2b-9257c3767800 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "POST /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/action" status: 202 len: 0 microversion: 2.1 time: 0.502876 Aug 02 08:00:54.329299 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3667/7259] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:00:53 2022] POST /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:00:54.336171 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=12 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:00:54.339535 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=36 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:00:54.348061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-be2d653d-d8ff-4e6b-b2c2-4c2a78feb3ec req-b22b9274-9f07-44ce-9431-77b55ea02050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b62c9b54-0b8d-463b-ac1d-b64316ce665c", "tag": "95e16776-e6a4-4317-8a74-7b04e2e0e1c7"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:00:54.361174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-be2d653d-d8ff-4e6b-b2c2-4c2a78feb3ec req-b22b9274-9f07-44ce-9431-77b55ea02050 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:54.361532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-be2d653d-d8ff-4e6b-b2c2-4c2a78feb3ec req-b22b9274-9f07-44ce-9431-77b55ea02050 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:54.374882 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-be2d653d-d8ff-4e6b-b2c2-4c2a78feb3ec req-b22b9274-9f07-44ce-9431-77b55ea02050 service nova] Creating event network-changed:95e16776-e6a4-4317-8a74-7b04e2e0e1c7 for instance b62c9b54-0b8d-463b-ac1d-b64316ce665c on n-h2-851337-3 Aug 02 08:00:54.381215 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-be2d653d-d8ff-4e6b-b2c2-4c2a78feb3ec req-b22b9274-9f07-44ce-9431-77b55ea02050 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047250 Aug 02 08:00:54.382181 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3593/7260] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:00:56.026537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c42db1f1-b858-4759-bc85-1c8c0c83371e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:56.027116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c42db1f1-b858-4759-bc85-1c8c0c83371e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:56.033610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c42db1f1-b858-4759-bc85-1c8c0c83371e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:56.034109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c42db1f1-b858-4759-bc85-1c8c0c83371e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:56.034866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c42db1f1-b858-4759-bc85-1c8c0c83371e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:56.035338 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c42db1f1-b858-4759-bc85-1c8c0c83371e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:56.116881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-c42db1f1-b858-4759-bc85-1c8c0c83371e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lazy-loading 'services' on Instance uuid b62c9b54-0b8d-463b-ac1d-b64316ce665c {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:00:56.195137 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c42db1f1-b858-4759-bc85-1c8c0c83371e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments/8787ab00-ea2d-4af8-b494-92f36c7c2781" status: 202 len: 0 microversion: 2.1 time: 0.173472 Aug 02 08:00:56.195861 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3668/7261] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 08:00:56 2022] DELETE /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments/8787ab00-ea2d-4af8-b494-92f36c7c2781 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:00:56.206541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4d0be80a-d605-47fc-99ad-3bde42f06c67 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:56.210372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4d0be80a-d605-47fc-99ad-3bde42f06c67 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:56.219920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d0be80a-d605-47fc-99ad-3bde42f06c67 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:56.220377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d0be80a-d605-47fc-99ad-3bde42f06c67 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:56.221180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d0be80a-d605-47fc-99ad-3bde42f06c67 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:56.221773 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d0be80a-d605-47fc-99ad-3bde42f06c67 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:56.255942 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4d0be80a-d605-47fc-99ad-3bde42f06c67 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054940 Aug 02 08:00:56.256513 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3594/7262] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 08:00:56 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:00:56.396825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-bc039da5-8f6d-4de3-8033-7097969ae9b6 req-c11f2d09-fbbd-4a8e-b8b7-f69f7b3128c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b62c9b54-0b8d-463b-ac1d-b64316ce665c", "tag": "95e16776-e6a4-4317-8a74-7b04e2e0e1c7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:00:56.407359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-bc039da5-8f6d-4de3-8033-7097969ae9b6 req-c11f2d09-fbbd-4a8e-b8b7-f69f7b3128c9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:56.407888 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-bc039da5-8f6d-4de3-8033-7097969ae9b6 req-c11f2d09-fbbd-4a8e-b8b7-f69f7b3128c9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:56.420153 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-bc039da5-8f6d-4de3-8033-7097969ae9b6 req-c11f2d09-fbbd-4a8e-b8b7-f69f7b3128c9 service nova] Creating event network-changed:95e16776-e6a4-4317-8a74-7b04e2e0e1c7 for instance b62c9b54-0b8d-463b-ac1d-b64316ce665c on n-h2-851337-3 Aug 02 08:00:56.425207 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-bc039da5-8f6d-4de3-8033-7097969ae9b6 req-c11f2d09-fbbd-4a8e-b8b7-f69f7b3128c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032618 Aug 02 08:00:56.426001 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3669/7263] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:00:57.269753 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3e622fe2-ab6b-45bd-bfc5-38fcab64b87e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:57.271747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3e622fe2-ab6b-45bd-bfc5-38fcab64b87e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:57.279336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e622fe2-ab6b-45bd-bfc5-38fcab64b87e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:57.279810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e622fe2-ab6b-45bd-bfc5-38fcab64b87e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:57.280609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e622fe2-ab6b-45bd-bfc5-38fcab64b87e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:57.281059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3e622fe2-ab6b-45bd-bfc5-38fcab64b87e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:57.312130 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3e622fe2-ab6b-45bd-bfc5-38fcab64b87e tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047080 Aug 02 08:00:57.312776 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3595/7264] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 08:00:57 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:00:58.326971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b2ff62a-c0cc-4c6b-8fe5-3a7589367cc5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:58.330090 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b2ff62a-c0cc-4c6b-8fe5-3a7589367cc5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:58.337664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b2ff62a-c0cc-4c6b-8fe5-3a7589367cc5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:58.338152 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b2ff62a-c0cc-4c6b-8fe5-3a7589367cc5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:58.339172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b2ff62a-c0cc-4c6b-8fe5-3a7589367cc5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:58.339345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b2ff62a-c0cc-4c6b-8fe5-3a7589367cc5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:58.372210 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b2ff62a-c0cc-4c6b-8fe5-3a7589367cc5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050821 Aug 02 08:00:58.372792 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3670/7265] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 08:00:58 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:00:59.385958 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2228b851-f5d8-4a85-aa95-3527fefbb7b7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:00:59.388371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2228b851-f5d8-4a85-aa95-3527fefbb7b7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:00:59.396127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2228b851-f5d8-4a85-aa95-3527fefbb7b7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:59.396594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2228b851-f5d8-4a85-aa95-3527fefbb7b7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:59.397419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2228b851-f5d8-4a85-aa95-3527fefbb7b7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:00:59.397868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2228b851-f5d8-4a85-aa95-3527fefbb7b7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:00:59.431089 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2228b851-f5d8-4a85-aa95-3527fefbb7b7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049342 Aug 02 08:00:59.431675 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3596/7266] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 08:00:59 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:01:00.443971 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-25e8a246-0506-43e7-b383-302b5c4517b5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:00.446174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-25e8a246-0506-43e7-b383-302b5c4517b5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:00.453645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-25e8a246-0506-43e7-b383-302b5c4517b5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:00.454119 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-25e8a246-0506-43e7-b383-302b5c4517b5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:00.454884 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-25e8a246-0506-43e7-b383-302b5c4517b5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:00.455318 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-25e8a246-0506-43e7-b383-302b5c4517b5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:00.485536 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-25e8a246-0506-43e7-b383-302b5c4517b5 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045615 Aug 02 08:01:00.486168 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3671/7267] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 08:01:00 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:01:01.500053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5915848c-1b41-4f03-b4ab-14da6ab1a4b7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:01.502847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5915848c-1b41-4f03-b4ab-14da6ab1a4b7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:01.510500 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5915848c-1b41-4f03-b4ab-14da6ab1a4b7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:01.510986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5915848c-1b41-4f03-b4ab-14da6ab1a4b7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:01.511800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5915848c-1b41-4f03-b4ab-14da6ab1a4b7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:01.512261 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5915848c-1b41-4f03-b4ab-14da6ab1a4b7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:01.543554 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5915848c-1b41-4f03-b4ab-14da6ab1a4b7 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047909 Aug 02 08:01:01.544273 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3597/7268] 10.222.0.79 () {58 vars in 1302 bytes} [Tue Aug 2 08:01:01 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 08:01:01.555022 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7012692b-2bb2-492e-947a-05a7066bf221 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:01.555597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7012692b-2bb2-492e-947a-05a7066bf221 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:01.563203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7012692b-2bb2-492e-947a-05a7066bf221 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:01.563657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7012692b-2bb2-492e-947a-05a7066bf221 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:01.564435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7012692b-2bb2-492e-947a-05a7066bf221 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:01.564876 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7012692b-2bb2-492e-947a-05a7066bf221 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:01.654417 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-7012692b-2bb2-492e-947a-05a7066bf221 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] HTTP exception thrown: Instance b62c9b54-0b8d-463b-ac1d-b64316ce665c is not attached to volume 8787ab00-ea2d-4af8-b494-92f36c7c2781 Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7012692b-2bb2-492e-947a-05a7066bf221 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Request method failure captured: Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: request: DELETE /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments/8787ab00-ea2d-4af8-b494-92f36c7c2781 HTTP/1.1 Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Ngdh1CktBasOWTtJs2_95282_KvN92KzGuB5xsWW0KC8e_olieQ_cV6Tlv-DiDsZXJcAWMcYw7iwY7w0CZ6r6a2_LlSzwt4ZTwWv56p69xjhoK0zOZj5jbXSBPy9pTJ5lpWZCUftwxN-BmOejbbuWQ0stz7wzgVU1wLRv7k_Sruig0 Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8b63ef2342794a4585fd3062f6d01d05 Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestMinimumBasicScenario-437822553 Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8b63ef2342794a4585fd3062f6d01d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8b63ef2342794a4585fd3062f6d01d05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8b63ef2342794a4585fd3062f6d01d05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8b63ef2342794a4585fd3062f6d01d05"}]}] Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestMinimumBasicScenario-437822553 Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8b63ef2342794a4585fd3062f6d01d05 Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestMinimumBasicScenario-437822553 Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestMinimumBasicScenario-437822553-project Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 377a3a65f0904cc98bc85c1d4e2e2822 Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestMinimumBasicScenario-437822553-project Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance b62c9b54-0b8d-463b-ac1d-b64316ce665c is not attached to volume 8787ab00-ea2d-4af8-b494-92f36c7c2781 Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'server_id': 'b62c9b54-0b8d-463b-ac1d-b64316ce665c', 'id': '8787ab00-ea2d-4af8-b494-92f36c7c2781'} Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8787ab00-ea2d-4af8-b494-92f36c7c2781. Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b62c9b54-0b8d-463b-ac1d-b64316ce665c is not attached to volume 8787ab00-ea2d-4af8-b494-92f36c7c2781 Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:01:01.656092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:01:01.659746 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:01:01.659746 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:01:01.659746 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b62c9b54-0b8d-463b-ac1d-b64316ce665c is not attached to volume 8787ab00-ea2d-4af8-b494-92f36c7c2781 Aug 02 08:01:01.659746 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:01:01.659746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7012692b-2bb2-492e-947a-05a7066bf221 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Returning 404 to user: Instance b62c9b54-0b8d-463b-ac1d-b64316ce665c is not attached to volume 8787ab00-ea2d-4af8-b494-92f36c7c2781 {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:01:01.659746 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7012692b-2bb2-492e-947a-05a7066bf221 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments/8787ab00-ea2d-4af8-b494-92f36c7c2781" status: 404 len: 154 microversion: 2.1 time: 0.106693 Aug 02 08:01:01.659746 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3672/7269] 10.222.0.79 () {58 vars in 1416 bytes} [Tue Aug 2 08:01:01 2022] DELETE /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c/os-volume_attachments/8787ab00-ea2d-4af8-b494-92f36c7c2781 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:01:04.936637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c5cc9537-4336-4136-b9f8-66e5c9a6254b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:04.937141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c5cc9537-4336-4136-b9f8-66e5c9a6254b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:04.944928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5cc9537-4336-4136-b9f8-66e5c9a6254b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:04.945397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5cc9537-4336-4136-b9f8-66e5c9a6254b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:04.946220 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5cc9537-4336-4136-b9f8-66e5c9a6254b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:04.946673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5cc9537-4336-4136-b9f8-66e5c9a6254b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:04.973041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c5cc9537-4336-4136-b9f8-66e5c9a6254b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 08:01:05.063574 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c5cc9537-4336-4136-b9f8-66e5c9a6254b tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 204 len: 0 microversion: 2.1 time: 0.130622 Aug 02 08:01:05.070196 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3598/7270] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 08:01:04 2022] DELETE /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:01:05.075085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4494043b-7464-4a34-861e-5ac056047443 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:05.075811 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4494043b-7464-4a34-861e-5ac056047443 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:05.083923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4494043b-7464-4a34-861e-5ac056047443 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:05.084378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4494043b-7464-4a34-861e-5ac056047443 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:05.085169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4494043b-7464-4a34-861e-5ac056047443 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:05.085609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4494043b-7464-4a34-861e-5ac056047443 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:05.220309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4494043b-7464-4a34-861e-5ac056047443 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:05.228669 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4494043b-7464-4a34-861e-5ac056047443 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1553 microversion: 2.1 time: 0.157734 Aug 02 08:01:05.229262 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3673/7271] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:05 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:06.255761 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9e449eed-41ca-4345-834a-061376a9bd29 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:06.256450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9e449eed-41ca-4345-834a-061376a9bd29 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:06.266438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e449eed-41ca-4345-834a-061376a9bd29 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:06.266992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e449eed-41ca-4345-834a-061376a9bd29 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:06.268181 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e449eed-41ca-4345-834a-061376a9bd29 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:06.268797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9e449eed-41ca-4345-834a-061376a9bd29 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:06.415081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9e449eed-41ca-4345-834a-061376a9bd29 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:06.423775 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9e449eed-41ca-4345-834a-061376a9bd29 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1553 microversion: 2.1 time: 0.172352 Aug 02 08:01:06.424351 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3599/7272] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:06 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:07.158179 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-f89c9e11-c389-445b-8620-4cb15e848539 req-acb3e424-2b0b-4e35-bee0-dacb05fa8a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b62c9b54-0b8d-463b-ac1d-b64316ce665c", "name": "network-vif-deleted", "tag": "95e16776-e6a4-4317-8a74-7b04e2e0e1c7"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:01:07.172231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f89c9e11-c389-445b-8620-4cb15e848539 req-acb3e424-2b0b-4e35-bee0-dacb05fa8a60 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:07.172678 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f89c9e11-c389-445b-8620-4cb15e848539 req-acb3e424-2b0b-4e35-bee0-dacb05fa8a60 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:07.187229 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f89c9e11-c389-445b-8620-4cb15e848539 req-acb3e424-2b0b-4e35-bee0-dacb05fa8a60 service nova] Creating event network-vif-deleted:95e16776-e6a4-4317-8a74-7b04e2e0e1c7 for instance b62c9b54-0b8d-463b-ac1d-b64316ce665c on n-h2-851337-3 Aug 02 08:01:07.192425 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-f89c9e11-c389-445b-8620-4cb15e848539 req-acb3e424-2b0b-4e35-bee0-dacb05fa8a60 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038153 Aug 02 08:01:07.193012 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3674/7273] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:01:07.445434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1d7a49ad-9baf-4492-9919-05e0f80dfa9c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:07.446228 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1d7a49ad-9baf-4492-9919-05e0f80dfa9c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:07.454583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d7a49ad-9baf-4492-9919-05e0f80dfa9c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:07.455234 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d7a49ad-9baf-4492-9919-05e0f80dfa9c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:07.456110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d7a49ad-9baf-4492-9919-05e0f80dfa9c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:07.456556 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d7a49ad-9baf-4492-9919-05e0f80dfa9c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:07.492915 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d7a49ad-9baf-4492-9919-05e0f80dfa9c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:07.493383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d7a49ad-9baf-4492-9919-05e0f80dfa9c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:07.493846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-1d7a49ad-9baf-4492-9919-05e0f80dfa9c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lazy-loading 'fault' on Instance uuid b62c9b54-0b8d-463b-ac1d-b64316ce665c {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:01:07.539026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1d7a49ad-9baf-4492-9919-05e0f80dfa9c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377a3a65f0904cc98bc85c1d4e2e2822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b63ef2342794a4585fd3062f6d01d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:07.547352 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1d7a49ad-9baf-4492-9919-05e0f80dfa9c tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 200 len: 1349 microversion: 2.1 time: 0.106122 Aug 02 08:01:07.547948 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3600/7274] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:07 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 1349 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:08.571479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-457b5093-d556-46d3-a970-c3a4aafd3dd2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:08.572349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-457b5093-d556-46d3-a970-c3a4aafd3dd2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] [instance: b62c9b54-0b8d-463b-ac1d-b64316ce665c] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:08.580369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-457b5093-d556-46d3-a970-c3a4aafd3dd2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:08.580817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-457b5093-d556-46d3-a970-c3a4aafd3dd2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:08.581586 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-457b5093-d556-46d3-a970-c3a4aafd3dd2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:08.582064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-457b5093-d556-46d3-a970-c3a4aafd3dd2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:08.596075 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-457b5093-d556-46d3-a970-c3a4aafd3dd2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] HTTP exception thrown: Instance b62c9b54-0b8d-463b-ac1d-b64316ce665c could not be found. Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-457b5093-d556-46d3-a970-c3a4aafd3dd2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Request method failure captured: Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c HTTP/1.1 Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Ngdh1CktBasOWTtJs2_95282_KvN92KzGuB5xsWW0KC8e_olieQ_cV6Tlv-DiDsZXJcAWMcYw7iwY7w0CZ6r6a2_LlSzwt4ZTwWv56p69xjhoK0zOZj5jbXSBPy9pTJ5lpWZCUftwxN-BmOejbbuWQ0stz7wzgVU1wLRv7k_Sruig0 Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 8b63ef2342794a4585fd3062f6d01d05 Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestMinimumBasicScenario-437822553 Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8b63ef2342794a4585fd3062f6d01d05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8b63ef2342794a4585fd3062f6d01d05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8b63ef2342794a4585fd3062f6d01d05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8b63ef2342794a4585fd3062f6d01d05"}]}] Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestMinimumBasicScenario-437822553 Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 8b63ef2342794a4585fd3062f6d01d05 Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestMinimumBasicScenario-437822553 Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestMinimumBasicScenario-437822553-project Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 377a3a65f0904cc98bc85c1d4e2e2822 Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestMinimumBasicScenario-437822553-project Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance b62c9b54-0b8d-463b-ac1d-b64316ce665c could not be found. Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': 'b62c9b54-0b8d-463b-ac1d-b64316ce665c'} Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b62c9b54-0b8d-463b-ac1d-b64316ce665c could not be found. Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b62c9b54-0b8d-463b-ac1d-b64316ce665c could not be found. Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:01:08.597803 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:01:08.602092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:01:08.602092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:01:08.602092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:01:08.602092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:01:08.602092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:01:08.602092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b62c9b54-0b8d-463b-ac1d-b64316ce665c could not be found. Aug 02 08:01:08.602092 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:01:08.602092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-457b5093-d556-46d3-a970-c3a4aafd3dd2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Returning 404 to user: Instance b62c9b54-0b8d-463b-ac1d-b64316ce665c could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:01:08.602092 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-457b5093-d556-46d3-a970-c3a4aafd3dd2 tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c" status: 404 len: 111 microversion: 2.1 time: 0.033323 Aug 02 08:01:08.602092 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3675/7275] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:08 2022] GET /compute/v2.1/servers/b62c9b54-0b8d-463b-ac1d-b64316ce665c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:01:08.609762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1131721-0fa2-4088-aad9-7b6fe19ed8ab tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] Calling method '.version_select at 0x7f927a325b80>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:08.633817 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b1131721-0fa2-4088-aad9-7b6fe19ed8ab tempest-TestMinimumBasicScenario-437822553 tempest-TestMinimumBasicScenario-437822553-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1483531561" status: 202 len: 0 microversion: 2.1 time: 0.027935 Aug 02 08:01:08.634436 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3601/7276] 10.222.0.79 () {58 vars in 1272 bytes} [Tue Aug 2 08:01:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1483531561 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:01:18.148301 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0347cfe7-ebf2-4a9a-b748-6bf968fbb2c1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'create', calling method: .version_select at 0x7f928c27b430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-42259204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqwxcYuef+xNhIfyALo/iuhbWboEMWh8m4+1hNkYwfhoEGVf6fzAjMUzIFlKcXDKfVURxWzPKhuRRYrAZOdnjhwmnb8S4mtc+B1idkCEJxqp7rcEYzC+H8xodEaHsCQLQ=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:01:18.166045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0347cfe7-ebf2-4a9a-b748-6bf968fbb2c1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for project efe942df311d4907b01d32a8bdd17e05. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:01:18.171775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-0347cfe7-ebf2-4a9a-b748-6bf968fbb2c1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for user 601715059796424bae5c160b4a5eb382 and project efe942df311d4907b01d32a8bdd17e05. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:01:18.199596 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0347cfe7-ebf2-4a9a-b748-6bf968fbb2c1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.250582 Aug 02 08:01:18.200124 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3676/7277] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 08:01:17 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:01:24.542784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:01:24.544537 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:01:24.549627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1741905215", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "ab032e15-0b27-4055-b284-5901290b7797"}], "key_name": "tempest-TestNetworkAdvancedServerOps-42259204", "security_groups": [{"name": "tempest-secgroup-smoke-460229961"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:01:24.674833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] validate_networks() for [('ab032e15-0b27-4055-b284-5901290b7797', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:01:25.069238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:01:25.069681 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:01:25.070189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:01:25.070616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:01:25.071054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:01:25.081321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:25.081807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:25.082653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:25.083107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:25.101487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for project efe942df311d4907b01d32a8bdd17e05. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:01:25.107141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for user 601715059796424bae5c160b4a5eb382 and project efe942df311d4907b01d32a8bdd17e05. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:01:25.120562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:01:25.122979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:01:25.171954 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-def94a1d-5711-4108-b4a5-9083ab9ac6f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.631333 Aug 02 08:01:25.172612 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3602/7278] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 08:01:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:01:25.183705 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-387b26ca-88ac-4e71-bc7f-6d11a851ce89 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:25.184403 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-387b26ca-88ac-4e71-bc7f-6d11a851ce89 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:25.187332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:01:25.188157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:01:25.252588 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-387b26ca-88ac-4e71-bc7f-6d11a851ce89 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:25.262408 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-387b26ca-88ac-4e71-bc7f-6d11a851ce89 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1265 microversion: 2.1 time: 0.082592 Aug 02 08:01:25.274591 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3677/7279] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:25 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:26.285666 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f78fa14d-9b7f-485a-8d18-6d3211572be2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:26.286340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f78fa14d-9b7f-485a-8d18-6d3211572be2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:26.294379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f78fa14d-9b7f-485a-8d18-6d3211572be2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:26.294743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f78fa14d-9b7f-485a-8d18-6d3211572be2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:26.295550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f78fa14d-9b7f-485a-8d18-6d3211572be2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:26.297353 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f78fa14d-9b7f-485a-8d18-6d3211572be2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:26.388581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f78fa14d-9b7f-485a-8d18-6d3211572be2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:26.396650 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f78fa14d-9b7f-485a-8d18-6d3211572be2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1317 microversion: 2.1 time: 0.115703 Aug 02 08:01:26.397375 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3603/7280] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:26 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1317 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:27.419500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-920291ae-3497-4ce0-942c-f81ef185157a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:27.420716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-920291ae-3497-4ce0-942c-f81ef185157a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:27.431871 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-920291ae-3497-4ce0-942c-f81ef185157a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:27.432582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-920291ae-3497-4ce0-942c-f81ef185157a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:27.433663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-920291ae-3497-4ce0-942c-f81ef185157a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:27.434707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-920291ae-3497-4ce0-942c-f81ef185157a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:27.517716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-920291ae-3497-4ce0-942c-f81ef185157a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:27.533426 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-920291ae-3497-4ce0-942c-f81ef185157a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1323 microversion: 2.1 time: 0.118083 Aug 02 08:01:27.547158 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3678/7281] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:27 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1323 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:28.469400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-6de6070a-1069-4ea6-b5a3-c85637f6bc61 req-a584e189-6fa1-4abd-9bf7-12823325a599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cee0da0-9618-4424-a009-ba41a96431cc", "tag": "8c5dd4a9-6235-44a5-8763-2e29c24404dd"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:01:28.479185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6de6070a-1069-4ea6-b5a3-c85637f6bc61 req-a584e189-6fa1-4abd-9bf7-12823325a599 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:28.479675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6de6070a-1069-4ea6-b5a3-c85637f6bc61 req-a584e189-6fa1-4abd-9bf7-12823325a599 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:28.491399 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-6de6070a-1069-4ea6-b5a3-c85637f6bc61 req-a584e189-6fa1-4abd-9bf7-12823325a599 service nova] Creating event network-changed:8c5dd4a9-6235-44a5-8763-2e29c24404dd for instance 3cee0da0-9618-4424-a009-ba41a96431cc on n-h1-851337-3 Aug 02 08:01:28.497214 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-6de6070a-1069-4ea6-b5a3-c85637f6bc61 req-a584e189-6fa1-4abd-9bf7-12823325a599 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097593 Aug 02 08:01:28.497830 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3604/7282] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:01:28.556750 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-756c517e-c869-40f7-92ac-123a8a1ef75b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:28.557369 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-756c517e-c869-40f7-92ac-123a8a1ef75b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:28.565454 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-756c517e-c869-40f7-92ac-123a8a1ef75b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:28.565918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-756c517e-c869-40f7-92ac-123a8a1ef75b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:28.566724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-756c517e-c869-40f7-92ac-123a8a1ef75b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:28.567163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-756c517e-c869-40f7-92ac-123a8a1ef75b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:28.713472 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-756c517e-c869-40f7-92ac-123a8a1ef75b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:28.721469 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-756c517e-c869-40f7-92ac-123a8a1ef75b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1390 microversion: 2.1 time: 0.168900 Aug 02 08:01:28.722095 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3679/7283] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:28 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:29.747574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c5cb1018-99c9-43de-8c71-b87f664b6a18 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:29.748282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c5cb1018-99c9-43de-8c71-b87f664b6a18 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:29.755484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5cb1018-99c9-43de-8c71-b87f664b6a18 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:29.755949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5cb1018-99c9-43de-8c71-b87f664b6a18 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:29.756733 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5cb1018-99c9-43de-8c71-b87f664b6a18 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:29.757186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c5cb1018-99c9-43de-8c71-b87f664b6a18 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:29.902435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c5cb1018-99c9-43de-8c71-b87f664b6a18 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:29.910501 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c5cb1018-99c9-43de-8c71-b87f664b6a18 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1390 microversion: 2.1 time: 0.169974 Aug 02 08:01:29.911074 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3605/7284] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:29 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:30.931220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0a21048c-9074-479a-8d26-4689995f8fbf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:30.931810 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0a21048c-9074-479a-8d26-4689995f8fbf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:30.939390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a21048c-9074-479a-8d26-4689995f8fbf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:30.939858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a21048c-9074-479a-8d26-4689995f8fbf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:30.940638 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a21048c-9074-479a-8d26-4689995f8fbf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:30.941084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0a21048c-9074-479a-8d26-4689995f8fbf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:31.081644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0a21048c-9074-479a-8d26-4689995f8fbf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:31.089619 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0a21048c-9074-479a-8d26-4689995f8fbf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1390 microversion: 2.1 time: 0.162409 Aug 02 08:01:31.090371 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3680/7285] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:30 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:32.111826 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c7e43ae2-916b-4a5d-884e-87e16d69211e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:32.112349 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c7e43ae2-916b-4a5d-884e-87e16d69211e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:32.120780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7e43ae2-916b-4a5d-884e-87e16d69211e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:32.121267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7e43ae2-916b-4a5d-884e-87e16d69211e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:32.122037 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7e43ae2-916b-4a5d-884e-87e16d69211e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:32.122477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c7e43ae2-916b-4a5d-884e-87e16d69211e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:32.269757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c7e43ae2-916b-4a5d-884e-87e16d69211e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:32.280269 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c7e43ae2-916b-4a5d-884e-87e16d69211e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1390 microversion: 2.1 time: 0.172871 Aug 02 08:01:32.280852 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3606/7286] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:32 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1390 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:33.301334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-930fe368-ad43-41c7-ad44-41075fb12656 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:33.302002 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-930fe368-ad43-41c7-ad44-41075fb12656 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:33.310528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-930fe368-ad43-41c7-ad44-41075fb12656 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:33.311201 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-930fe368-ad43-41c7-ad44-41075fb12656 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:33.312108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-930fe368-ad43-41c7-ad44-41075fb12656 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:33.312610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-930fe368-ad43-41c7-ad44-41075fb12656 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:33.455618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-930fe368-ad43-41c7-ad44-41075fb12656 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:33.466310 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-930fe368-ad43-41c7-ad44-41075fb12656 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1390 microversion: 2.1 time: 0.168999 Aug 02 08:01:33.466883 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3681/7287] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:33 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:34.487998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8f585604-0fa3-4894-8736-0279c44ee3b6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:34.488633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8f585604-0fa3-4894-8736-0279c44ee3b6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:34.496127 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f585604-0fa3-4894-8736-0279c44ee3b6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:34.496584 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f585604-0fa3-4894-8736-0279c44ee3b6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:34.497355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f585604-0fa3-4894-8736-0279c44ee3b6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:34.497802 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8f585604-0fa3-4894-8736-0279c44ee3b6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:34.512366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-4a39bfac-11ef-488a-a551-cdc7237ff6fb req-c7e24d55-aee2-49c2-a358-1097e9b8e259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cee0da0-9618-4424-a009-ba41a96431cc", "name": "network-vif-plugged", "status": "completed", "tag": "8c5dd4a9-6235-44a5-8763-2e29c24404dd"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:01:34.524041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4a39bfac-11ef-488a-a551-cdc7237ff6fb req-c7e24d55-aee2-49c2-a358-1097e9b8e259 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:34.524599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-4a39bfac-11ef-488a-a551-cdc7237ff6fb req-c7e24d55-aee2-49c2-a358-1097e9b8e259 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:34.538619 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-4a39bfac-11ef-488a-a551-cdc7237ff6fb req-c7e24d55-aee2-49c2-a358-1097e9b8e259 service nova] Creating event network-vif-plugged:8c5dd4a9-6235-44a5-8763-2e29c24404dd for instance 3cee0da0-9618-4424-a009-ba41a96431cc on n-h1-851337-3 Aug 02 08:01:34.543914 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-4a39bfac-11ef-488a-a551-cdc7237ff6fb req-c7e24d55-aee2-49c2-a358-1097e9b8e259 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036418 Aug 02 08:01:34.544820 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3682/7288] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:01:34.649486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8f585604-0fa3-4894-8736-0279c44ee3b6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:34.657627 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8f585604-0fa3-4894-8736-0279c44ee3b6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1390 microversion: 2.1 time: 0.173628 Aug 02 08:01:34.658254 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3607/7289] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:34 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:35.675911 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:01:35.681132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-060b179f-a5fe-42ca-a12f-fefec338d414 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:35.681869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-060b179f-a5fe-42ca-a12f-fefec338d414 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:35.688746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-060b179f-a5fe-42ca-a12f-fefec338d414 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:35.689203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-060b179f-a5fe-42ca-a12f-fefec338d414 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:35.690007 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-060b179f-a5fe-42ca-a12f-fefec338d414 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:35.690446 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-060b179f-a5fe-42ca-a12f-fefec338d414 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:35.827337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-060b179f-a5fe-42ca-a12f-fefec338d414 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:35.835938 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-060b179f-a5fe-42ca-a12f-fefec338d414 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1390 microversion: 2.1 time: 0.161009 Aug 02 08:01:35.836527 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3683/7290] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:35 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:36.855738 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:01:36.856382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:01:36.861054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d459002-3a9e-4a2c-8844-567e88c7d2ff tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:36.861664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5d459002-3a9e-4a2c-8844-567e88c7d2ff tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:36.868706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d459002-3a9e-4a2c-8844-567e88c7d2ff tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:36.869099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d459002-3a9e-4a2c-8844-567e88c7d2ff tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:36.869861 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d459002-3a9e-4a2c-8844-567e88c7d2ff tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:36.870326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d459002-3a9e-4a2c-8844-567e88c7d2ff tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:37.016675 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5d459002-3a9e-4a2c-8844-567e88c7d2ff tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:37.024436 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5d459002-3a9e-4a2c-8844-567e88c7d2ff tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1562 microversion: 2.1 time: 0.170140 Aug 02 08:01:37.024989 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3608/7291] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:36 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:37.051059 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f7ebcf2d-5b6b-4a48-8cdc-1a17fa3e05dd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:37.051710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f7ebcf2d-5b6b-4a48-8cdc-1a17fa3e05dd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:37.059327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7ebcf2d-5b6b-4a48-8cdc-1a17fa3e05dd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:37.059760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7ebcf2d-5b6b-4a48-8cdc-1a17fa3e05dd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:37.060529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7ebcf2d-5b6b-4a48-8cdc-1a17fa3e05dd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:37.060965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f7ebcf2d-5b6b-4a48-8cdc-1a17fa3e05dd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:37.209575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f7ebcf2d-5b6b-4a48-8cdc-1a17fa3e05dd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:37.218694 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f7ebcf2d-5b6b-4a48-8cdc-1a17fa3e05dd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1562 microversion: 2.1 time: 0.171540 Aug 02 08:01:37.219317 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3684/7292] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:37 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:01:38.904325 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d9d9f5cf-2fd9-47dc-b79b-9cefbce76362 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:01:38.904924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d9d9f5cf-2fd9-47dc-b79b-9cefbce76362 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:01:38.906162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-21394f10-ecaa-4ef4-9eba-7e9e7816817f req-cbc2c601-307a-4601-8d68-e39f6d8e1fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cee0da0-9618-4424-a009-ba41a96431cc", "tag": "8c5dd4a9-6235-44a5-8763-2e29c24404dd"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:01:38.912309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9d9f5cf-2fd9-47dc-b79b-9cefbce76362 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:38.912986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9d9f5cf-2fd9-47dc-b79b-9cefbce76362 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:38.913805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9d9f5cf-2fd9-47dc-b79b-9cefbce76362 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:38.914574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d9d9f5cf-2fd9-47dc-b79b-9cefbce76362 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:38.917218 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-21394f10-ecaa-4ef4-9eba-7e9e7816817f req-cbc2c601-307a-4601-8d68-e39f6d8e1fbd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:01:38.917526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-21394f10-ecaa-4ef4-9eba-7e9e7816817f req-cbc2c601-307a-4601-8d68-e39f6d8e1fbd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:01:38.929065 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-21394f10-ecaa-4ef4-9eba-7e9e7816817f req-cbc2c601-307a-4601-8d68-e39f6d8e1fbd service nova] Creating event network-changed:8c5dd4a9-6235-44a5-8763-2e29c24404dd for instance 3cee0da0-9618-4424-a009-ba41a96431cc on n-h1-851337-3 Aug 02 08:01:38.934414 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-21394f10-ecaa-4ef4-9eba-7e9e7816817f req-cbc2c601-307a-4601-8d68-e39f6d8e1fbd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031957 Aug 02 08:01:38.935042 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3685/7293] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:01:39.056647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d9d9f5cf-2fd9-47dc-b79b-9cefbce76362 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:01:39.065205 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d9d9f5cf-2fd9-47dc-b79b-9cefbce76362 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1562 microversion: 2.1 time: 0.165039 Aug 02 08:01:39.066188 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3609/7294] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:01:38 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:02:12.686809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=19 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:02:12.687595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=40 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:02:12.692579 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-edd6332f-e0c8-4299-a61c-ec6a27ea7381 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:02:12.694932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-edd6332f-e0c8-4299-a61c-ec6a27ea7381 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:02:12.702401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-edd6332f-e0c8-4299-a61c-ec6a27ea7381 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:12.702828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-edd6332f-e0c8-4299-a61c-ec6a27ea7381 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:12.703623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-edd6332f-e0c8-4299-a61c-ec6a27ea7381 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:12.704052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-edd6332f-e0c8-4299-a61c-ec6a27ea7381 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:12.770405 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-edd6332f-e0c8-4299-a61c-ec6a27ea7381 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc/action" status: 200 len: 24572 microversion: 2.1 time: 0.085512 Aug 02 08:02:12.771039 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3686/7295] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:02:12 2022] POST /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc/action => generated 24572 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:02:43.148149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:02:43.148862 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=40 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:02:43.153431 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-10cdb123-cade-45d6-bfd6-bddc950de024 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:02:43.154007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-10cdb123-cade-45d6-bfd6-bddc950de024 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:02:43.162734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10cdb123-cade-45d6-bfd6-bddc950de024 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:43.163199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10cdb123-cade-45d6-bfd6-bddc950de024 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:43.164050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10cdb123-cade-45d6-bfd6-bddc950de024 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:43.164501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-10cdb123-cade-45d6-bfd6-bddc950de024 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:43.239890 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-10cdb123-cade-45d6-bfd6-bddc950de024 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc/action" status: 202 len: 0 microversion: 2.1 time: 0.093593 Aug 02 08:02:43.240703 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3610/7296] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:02:43 2022] POST /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:02:43.251690 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f0254d0-9894-41ea-bc5f-b09b7ed7da97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:02:43.252433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4f0254d0-9894-41ea-bc5f-b09b7ed7da97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:02:43.255427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:02:43.256086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:02:43.263063 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f0254d0-9894-41ea-bc5f-b09b7ed7da97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:43.263594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f0254d0-9894-41ea-bc5f-b09b7ed7da97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:43.264378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f0254d0-9894-41ea-bc5f-b09b7ed7da97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:43.264813 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f0254d0-9894-41ea-bc5f-b09b7ed7da97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:43.414426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4f0254d0-9894-41ea-bc5f-b09b7ed7da97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:02:43.422679 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4f0254d0-9894-41ea-bc5f-b09b7ed7da97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1686 microversion: 2.1 time: 0.175681 Aug 02 08:02:43.423253 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3687/7297] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:02:43 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:02:44.446601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3d85db7d-03e3-47a1-821e-4ad141892be0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:02:44.447369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3d85db7d-03e3-47a1-821e-4ad141892be0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:02:44.454317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d85db7d-03e3-47a1-821e-4ad141892be0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:44.454781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d85db7d-03e3-47a1-821e-4ad141892be0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:44.455597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d85db7d-03e3-47a1-821e-4ad141892be0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:44.456213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d85db7d-03e3-47a1-821e-4ad141892be0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:44.603776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3d85db7d-03e3-47a1-821e-4ad141892be0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:02:44.612085 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3d85db7d-03e3-47a1-821e-4ad141892be0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1666 microversion: 2.1 time: 0.171041 Aug 02 08:02:44.612641 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3611/7298] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:02:44 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1666 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:02:45.710322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a6fd6c94-8d6d-4c75-9e20-8a19ce7ac7ae tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:02:45.712707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a6fd6c94-8d6d-4c75-9e20-8a19ce7ac7ae tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:02:45.722832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6fd6c94-8d6d-4c75-9e20-8a19ce7ac7ae tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:45.723286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6fd6c94-8d6d-4c75-9e20-8a19ce7ac7ae tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:45.724101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6fd6c94-8d6d-4c75-9e20-8a19ce7ac7ae tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:45.724508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6fd6c94-8d6d-4c75-9e20-8a19ce7ac7ae tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:45.787102 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a6fd6c94-8d6d-4c75-9e20-8a19ce7ac7ae tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc/action" status: 200 len: 32648 microversion: 2.1 time: 0.080631 Aug 02 08:02:45.787775 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3688/7299] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:02:45 2022] POST /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc/action => generated 32648 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:02:45.799976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-627f6313-2565-46d0-8064-24fe9eaa9ab0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:02:45.800559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-627f6313-2565-46d0-8064-24fe9eaa9ab0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:02:45.808120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-627f6313-2565-46d0-8064-24fe9eaa9ab0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:45.808579 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-627f6313-2565-46d0-8064-24fe9eaa9ab0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:45.809356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-627f6313-2565-46d0-8064-24fe9eaa9ab0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:45.810454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-627f6313-2565-46d0-8064-24fe9eaa9ab0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:45.891151 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-627f6313-2565-46d0-8064-24fe9eaa9ab0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc/action" status: 202 len: 0 microversion: 2.1 time: 0.094748 Aug 02 08:02:45.892307 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3612/7300] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:02:45 2022] POST /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:02:45.905161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a9f28542-157d-496c-9f6b-5948094e1cc5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:02:45.906516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a9f28542-157d-496c-9f6b-5948094e1cc5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:02:45.918156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9f28542-157d-496c-9f6b-5948094e1cc5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:45.918764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9f28542-157d-496c-9f6b-5948094e1cc5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:45.919620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9f28542-157d-496c-9f6b-5948094e1cc5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:45.920101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a9f28542-157d-496c-9f6b-5948094e1cc5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:46.066553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a9f28542-157d-496c-9f6b-5948094e1cc5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:02:46.075534 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a9f28542-157d-496c-9f6b-5948094e1cc5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1673 microversion: 2.1 time: 0.178001 Aug 02 08:02:46.076109 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3689/7301] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:02:45 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:02:47.100248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-855c322f-d888-4022-8e6c-3a1e94c9a9ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:02:47.100987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-855c322f-d888-4022-8e6c-3a1e94c9a9ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:02:47.109342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-855c322f-d888-4022-8e6c-3a1e94c9a9ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:47.109845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-855c322f-d888-4022-8e6c-3a1e94c9a9ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:47.110645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-855c322f-d888-4022-8e6c-3a1e94c9a9ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:47.111092 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-855c322f-d888-4022-8e6c-3a1e94c9a9ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:47.249588 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-855c322f-d888-4022-8e6c-3a1e94c9a9ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:02:47.259033 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-855c322f-d888-4022-8e6c-3a1e94c9a9ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1681 microversion: 2.1 time: 0.164720 Aug 02 08:02:47.259625 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3613/7302] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:02:47 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:02:47.279820 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:02:47.280287 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 08:02:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:02:47.366699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bf2811c1-2fcf-4bb2-a25e-40eecbd20586 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:02:47.368869 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bf2811c1-2fcf-4bb2-a25e-40eecbd20586 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:02:47.377513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf2811c1-2fcf-4bb2-a25e-40eecbd20586 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:47.378127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf2811c1-2fcf-4bb2-a25e-40eecbd20586 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:47.378921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf2811c1-2fcf-4bb2-a25e-40eecbd20586 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:47.379449 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bf2811c1-2fcf-4bb2-a25e-40eecbd20586 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:47.438377 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bf2811c1-2fcf-4bb2-a25e-40eecbd20586 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc/action" status: 200 len: 37982 microversion: 2.1 time: 0.075558 Aug 02 08:02:47.439022 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3690/7303] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:02:47 2022] POST /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc/action => generated 37982 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:02:48.487651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-82abdf43-bd49-4460-96ef-1cd49fdeae5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:02:48.488159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-82abdf43-bd49-4460-96ef-1cd49fdeae5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:02:48.491457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-2d4fa0a9-c7c3-4e4f-b930-43a46f46e3fa req-9180b97f-4b0b-455e-88db-5a261f63b4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cee0da0-9618-4424-a009-ba41a96431cc", "tag": "8c5dd4a9-6235-44a5-8763-2e29c24404dd"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:02:48.495442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82abdf43-bd49-4460-96ef-1cd49fdeae5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:48.495896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82abdf43-bd49-4460-96ef-1cd49fdeae5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:48.496669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82abdf43-bd49-4460-96ef-1cd49fdeae5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:48.497286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-82abdf43-bd49-4460-96ef-1cd49fdeae5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:48.504438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2d4fa0a9-c7c3-4e4f-b930-43a46f46e3fa req-9180b97f-4b0b-455e-88db-5a261f63b4d0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:48.505239 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2d4fa0a9-c7c3-4e4f-b930-43a46f46e3fa req-9180b97f-4b0b-455e-88db-5a261f63b4d0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:48.520756 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-2d4fa0a9-c7c3-4e4f-b930-43a46f46e3fa req-9180b97f-4b0b-455e-88db-5a261f63b4d0 service nova] Creating event network-changed:8c5dd4a9-6235-44a5-8763-2e29c24404dd for instance 3cee0da0-9618-4424-a009-ba41a96431cc on n-h1-851337-3 Aug 02 08:02:48.525881 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-2d4fa0a9-c7c3-4e4f-b930-43a46f46e3fa req-9180b97f-4b0b-455e-88db-5a261f63b4d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038727 Aug 02 08:02:48.526772 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3691/7304] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:02:48.531449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-82abdf43-bd49-4460-96ef-1cd49fdeae5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 08:02:48.632663 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-82abdf43-bd49-4460-96ef-1cd49fdeae5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 204 len: 0 microversion: 2.1 time: 0.148184 Aug 02 08:02:48.633718 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3614/7305] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 08:02:48 2022] DELETE /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:02:48.645521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2780c924-ff22-484a-be8e-8faefb268ee4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:02:48.646249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2780c924-ff22-484a-be8e-8faefb268ee4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:02:48.652824 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2780c924-ff22-484a-be8e-8faefb268ee4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:48.653294 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2780c924-ff22-484a-be8e-8faefb268ee4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:48.654116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2780c924-ff22-484a-be8e-8faefb268ee4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:48.654559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2780c924-ff22-484a-be8e-8faefb268ee4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:48.810515 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2780c924-ff22-484a-be8e-8faefb268ee4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:02:48.818840 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2780c924-ff22-484a-be8e-8faefb268ee4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1687 microversion: 2.1 time: 0.178498 Aug 02 08:02:48.819424 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3692/7306] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:02:48 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:02:49.843510 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-28480738-af6c-477c-9d4a-fa29e97f70c1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:02:49.845638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-28480738-af6c-477c-9d4a-fa29e97f70c1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:02:49.856477 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28480738-af6c-477c-9d4a-fa29e97f70c1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:49.857062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28480738-af6c-477c-9d4a-fa29e97f70c1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:49.858248 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28480738-af6c-477c-9d4a-fa29e97f70c1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:49.858973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-28480738-af6c-477c-9d4a-fa29e97f70c1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:50.012502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-28480738-af6c-477c-9d4a-fa29e97f70c1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:02:50.020585 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-28480738-af6c-477c-9d4a-fa29e97f70c1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1687 microversion: 2.1 time: 0.181925 Aug 02 08:02:50.021108 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3615/7307] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:02:49 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:02:50.939041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b24dda8c-e534-4f23-a50b-574e501aeb23 req-14ea471c-856a-40b5-a392-02d7d838d5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cee0da0-9618-4424-a009-ba41a96431cc", "name": "network-vif-deleted", "tag": "8c5dd4a9-6235-44a5-8763-2e29c24404dd"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:02:50.950195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b24dda8c-e534-4f23-a50b-574e501aeb23 req-14ea471c-856a-40b5-a392-02d7d838d5c7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:50.950650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b24dda8c-e534-4f23-a50b-574e501aeb23 req-14ea471c-856a-40b5-a392-02d7d838d5c7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:50.963447 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b24dda8c-e534-4f23-a50b-574e501aeb23 req-14ea471c-856a-40b5-a392-02d7d838d5c7 service nova] Creating event network-vif-deleted:8c5dd4a9-6235-44a5-8763-2e29c24404dd for instance 3cee0da0-9618-4424-a009-ba41a96431cc on n-h1-851337-3 Aug 02 08:02:50.969532 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b24dda8c-e534-4f23-a50b-574e501aeb23 req-14ea471c-856a-40b5-a392-02d7d838d5c7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035163 Aug 02 08:02:50.970207 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3693/7308] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:02:51.046221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1c5ce0b2-6b3d-4c2a-9715-e3315e318919 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:02:51.047157 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1c5ce0b2-6b3d-4c2a-9715-e3315e318919 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:02:51.055691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c5ce0b2-6b3d-4c2a-9715-e3315e318919 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:51.056182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c5ce0b2-6b3d-4c2a-9715-e3315e318919 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:51.057152 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c5ce0b2-6b3d-4c2a-9715-e3315e318919 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:51.057608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c5ce0b2-6b3d-4c2a-9715-e3315e318919 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:51.100105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c5ce0b2-6b3d-4c2a-9715-e3315e318919 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:51.100635 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1c5ce0b2-6b3d-4c2a-9715-e3315e318919 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:51.101165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-1c5ce0b2-6b3d-4c2a-9715-e3315e318919 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lazy-loading 'fault' on Instance uuid 3cee0da0-9618-4424-a009-ba41a96431cc {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:02:51.148411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1c5ce0b2-6b3d-4c2a-9715-e3315e318919 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:02:51.156963 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1c5ce0b2-6b3d-4c2a-9715-e3315e318919 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 200 len: 1355 microversion: 2.1 time: 0.115820 Aug 02 08:02:51.157597 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3616/7309] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:02:51 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 1355 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:02:52.184887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a6646779-26b9-46e6-80c9-a5f5ef8b0ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:02:52.186061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a6646779-26b9-46e6-80c9-a5f5ef8b0ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 3cee0da0-9618-4424-a009-ba41a96431cc] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:02:52.197145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6646779-26b9-46e6-80c9-a5f5ef8b0ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:52.197943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6646779-26b9-46e6-80c9-a5f5ef8b0ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:52.199311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6646779-26b9-46e6-80c9-a5f5ef8b0ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:02:52.200040 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a6646779-26b9-46e6-80c9-a5f5ef8b0ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:02:52.215298 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-a6646779-26b9-46e6-80c9-a5f5ef8b0ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] HTTP exception thrown: Instance 3cee0da0-9618-4424-a009-ba41a96431cc could not be found. Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a6646779-26b9-46e6-80c9-a5f5ef8b0ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Request method failure captured: Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc HTTP/1.1 Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NnNXwQjzTe5ucEgWVr6FK5R_x-1PXSjORQwgK-HLJwg4ud0xCiQ2RxkmamNcISiMo4ifaafVN2MJnljlZbb38Rp3hdz9WWClfF8DfJRGHtUcgwK-nhNzEPhYJpv5Hbll_ZHACbAYvLF-wQIz_sIq23lqNZYgHg_IZwEzGzmdwo5X1U Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: efe942df311d4907b01d32a8bdd17e05 Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/efe942df311d4907b01d32a8bdd17e05"}]}] Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: efe942df311d4907b01d32a8bdd17e05 Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestNetworkAdvancedServerOps-1822902672-project Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 601715059796424bae5c160b4a5eb382 Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1822902672-project Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 3cee0da0-9618-4424-a009-ba41a96431cc could not be found. Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '3cee0da0-9618-4424-a009-ba41a96431cc'} Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cee0da0-9618-4424-a009-ba41a96431cc could not be found. Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cee0da0-9618-4424-a009-ba41a96431cc could not be found. Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:02:52.216980 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:02:52.221209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:02:52.221209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:02:52.221209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:02:52.221209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:02:52.221209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:02:52.221209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:02:52.221209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cee0da0-9618-4424-a009-ba41a96431cc could not be found. Aug 02 08:02:52.221209 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:02:52.221209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a6646779-26b9-46e6-80c9-a5f5ef8b0ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Returning 404 to user: Instance 3cee0da0-9618-4424-a009-ba41a96431cc could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:02:52.221209 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a6646779-26b9-46e6-80c9-a5f5ef8b0ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc" status: 404 len: 111 microversion: 2.1 time: 0.042167 Aug 02 08:02:52.221209 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3694/7310] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:02:52 2022] GET /compute/v2.1/servers/3cee0da0-9618-4424-a009-ba41a96431cc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:02:55.748340 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bfa89fb5-3e28-4527-b2f4-b2a8767992a8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '.version_select at 0x7f927a325f70>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:02:55.776187 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bfa89fb5-3e28-4527-b2f4-b2a8767992a8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-42259204" status: 202 len: 0 microversion: 2.1 time: 0.032527 Aug 02 08:02:55.776792 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3617/7311] 10.222.0.79 () {58 vars in 1278 bytes} [Tue Aug 2 08:02:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-42259204 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:02:55.798789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83c0b5d5-61f7-4bd1-8f0e-79d7a0abd3e5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'create', calling method: .version_select at 0x7f9279e061f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2041443664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOrKouGAGQZPzXi9ojyQMiQ06c8G5VZMCe4seD6T3CSDIzCWAe3toFojpba5jQnFFhMxoSL2gSVAa+xlrFp8gnbUtTn0QfFhSb/WlvpWC1h45kMn4BWbp6gJHkTY8Ujrw=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:02:55.817160 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-83c0b5d5-61f7-4bd1-8f0e-79d7a0abd3e5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for project efe942df311d4907b01d32a8bdd17e05. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:02:55.823825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-83c0b5d5-61f7-4bd1-8f0e-79d7a0abd3e5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for user 601715059796424bae5c160b4a5eb382 and project efe942df311d4907b01d32a8bdd17e05. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:02:55.856329 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-83c0b5d5-61f7-4bd1-8f0e-79d7a0abd3e5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.061728 Aug 02 08:02:55.857043 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3695/7312] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 08:02:55 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:03:01.789494 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-540758455", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "fe463bb8-f497-4b36-aa53-51243ae95edc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2041443664", "security_groups": [{"name": "tempest-secgroup-smoke-1470466358"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:03:01.804968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:03:01.976998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] validate_networks() for [('fe463bb8-f497-4b36-aa53-51243ae95edc', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:03:02.415799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:03:02.416661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:03:02.417124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:03:02.417562 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:03:02.418011 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:03:02.428559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:02.429354 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:02.430446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:02.431135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:02.456523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for project efe942df311d4907b01d32a8bdd17e05. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:03:02.462684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for user 601715059796424bae5c160b4a5eb382 and project efe942df311d4907b01d32a8bdd17e05. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:03:02.477323 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:03:02.480140 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:03:02.531419 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2ca13301-7b7e-4d24-8ebf-b7f44e2579fd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.748686 Aug 02 08:03:02.532401 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3618/7313] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 08:03:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:03:02.541663 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=32 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:03:02.546178 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-686cd03d-3c46-44ef-8fbf-06b9f9ccc47e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:02.547153 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-686cd03d-3c46-44ef-8fbf-06b9f9ccc47e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:02.628905 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-686cd03d-3c46-44ef-8fbf-06b9f9ccc47e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:02.638406 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-686cd03d-3c46-44ef-8fbf-06b9f9ccc47e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1266 microversion: 2.1 time: 0.098307 Aug 02 08:03:02.639698 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3696/7314] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:02 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:03.665484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8d86c57b-b3f2-41ba-94d7-95ad023f2bf7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:03.666409 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8d86c57b-b3f2-41ba-94d7-95ad023f2bf7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:03.676028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d86c57b-b3f2-41ba-94d7-95ad023f2bf7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:03.676519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d86c57b-b3f2-41ba-94d7-95ad023f2bf7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:03.677563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d86c57b-b3f2-41ba-94d7-95ad023f2bf7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:03.678068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8d86c57b-b3f2-41ba-94d7-95ad023f2bf7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:03.779706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8d86c57b-b3f2-41ba-94d7-95ad023f2bf7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:03.790842 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8d86c57b-b3f2-41ba-94d7-95ad023f2bf7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1326 microversion: 2.1 time: 0.130485 Aug 02 08:03:03.791837 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3619/7315] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:03 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1326 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:04.812767 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4b8bc070-4bc2-464c-952b-7e20364cbd31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:04.814190 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4b8bc070-4bc2-464c-952b-7e20364cbd31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:04.831184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b8bc070-4bc2-464c-952b-7e20364cbd31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:04.831837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b8bc070-4bc2-464c-952b-7e20364cbd31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:04.832877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b8bc070-4bc2-464c-952b-7e20364cbd31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:04.833630 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4b8bc070-4bc2-464c-952b-7e20364cbd31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:05.069336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4b8bc070-4bc2-464c-952b-7e20364cbd31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:05.077483 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4b8bc070-4bc2-464c-952b-7e20364cbd31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1392 microversion: 2.1 time: 0.268891 Aug 02 08:03:05.078301 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3697/7316] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:04 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1392 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:05.334567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-bef002af-f26c-44c2-821e-e04e9d8994bd req-913c4a7f-73f8-4cd0-b98a-7ddc8f947bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae10d0fd-756f-403c-b032-43d2039ab105", "tag": "965f7dd2-4981-4b7c-8702-db0a9e7fddbc"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:03:05.360818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-bef002af-f26c-44c2-821e-e04e9d8994bd req-913c4a7f-73f8-4cd0-b98a-7ddc8f947bb8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:05.361573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-bef002af-f26c-44c2-821e-e04e9d8994bd req-913c4a7f-73f8-4cd0-b98a-7ddc8f947bb8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:05.382888 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-bef002af-f26c-44c2-821e-e04e9d8994bd req-913c4a7f-73f8-4cd0-b98a-7ddc8f947bb8 service nova] Creating event network-changed:965f7dd2-4981-4b7c-8702-db0a9e7fddbc for instance ae10d0fd-756f-403c-b032-43d2039ab105 on n-h2-851337-3 Aug 02 08:03:05.390152 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-bef002af-f26c-44c2-821e-e04e9d8994bd req-913c4a7f-73f8-4cd0-b98a-7ddc8f947bb8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060748 Aug 02 08:03:05.391170 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3620/7317] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:03:06.101114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e2cf8c05-d7fe-4206-a2f0-787985be53f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:06.101675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e2cf8c05-d7fe-4206-a2f0-787985be53f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:06.110137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e2cf8c05-d7fe-4206-a2f0-787985be53f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:06.110702 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e2cf8c05-d7fe-4206-a2f0-787985be53f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:06.111566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e2cf8c05-d7fe-4206-a2f0-787985be53f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:06.112061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e2cf8c05-d7fe-4206-a2f0-787985be53f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:06.255883 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e2cf8c05-d7fe-4206-a2f0-787985be53f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:06.264117 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e2cf8c05-d7fe-4206-a2f0-787985be53f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1392 microversion: 2.1 time: 0.167671 Aug 02 08:03:06.264793 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3698/7318] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:06 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:07.291509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0fff211f-e9bd-4a7e-95c5-8cc61827b456 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:07.292574 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0fff211f-e9bd-4a7e-95c5-8cc61827b456 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:07.301013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fff211f-e9bd-4a7e-95c5-8cc61827b456 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:07.301485 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fff211f-e9bd-4a7e-95c5-8cc61827b456 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:07.302293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fff211f-e9bd-4a7e-95c5-8cc61827b456 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:07.302744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0fff211f-e9bd-4a7e-95c5-8cc61827b456 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:07.451543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0fff211f-e9bd-4a7e-95c5-8cc61827b456 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:07.459334 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0fff211f-e9bd-4a7e-95c5-8cc61827b456 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1392 microversion: 2.1 time: 0.176498 Aug 02 08:03:07.459913 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3621/7319] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:07 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:08.484249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ff8644b4-bae8-4065-b025-055beaea2cd9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:08.485209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ff8644b4-bae8-4065-b025-055beaea2cd9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:08.497385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff8644b4-bae8-4065-b025-055beaea2cd9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:08.498175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff8644b4-bae8-4065-b025-055beaea2cd9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:08.499431 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff8644b4-bae8-4065-b025-055beaea2cd9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:08.500230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ff8644b4-bae8-4065-b025-055beaea2cd9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:08.643928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ff8644b4-bae8-4065-b025-055beaea2cd9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:08.652414 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ff8644b4-bae8-4065-b025-055beaea2cd9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1392 microversion: 2.1 time: 0.175027 Aug 02 08:03:08.652991 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3699/7320] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:08 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:09.673043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-72076de3-e5d3-4209-8596-4766c00a8abe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:09.673921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-72076de3-e5d3-4209-8596-4766c00a8abe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:09.681307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72076de3-e5d3-4209-8596-4766c00a8abe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:09.682124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72076de3-e5d3-4209-8596-4766c00a8abe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:09.682930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72076de3-e5d3-4209-8596-4766c00a8abe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:09.683374 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-72076de3-e5d3-4209-8596-4766c00a8abe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:09.747039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-94c789fc-de74-478a-9e65-af7e48444749 req-7083c204-f4e1-41b8-850a-e1663cf35cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae10d0fd-756f-403c-b032-43d2039ab105", "name": "network-vif-plugged", "status": "completed", "tag": "965f7dd2-4981-4b7c-8702-db0a9e7fddbc"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:03:09.783140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-94c789fc-de74-478a-9e65-af7e48444749 req-7083c204-f4e1-41b8-850a-e1663cf35cf1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:09.783943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-94c789fc-de74-478a-9e65-af7e48444749 req-7083c204-f4e1-41b8-850a-e1663cf35cf1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:09.801227 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-94c789fc-de74-478a-9e65-af7e48444749 req-7083c204-f4e1-41b8-850a-e1663cf35cf1 service nova] Creating event network-vif-plugged:965f7dd2-4981-4b7c-8702-db0a9e7fddbc for instance ae10d0fd-756f-403c-b032-43d2039ab105 on n-h2-851337-3 Aug 02 08:03:09.809280 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-94c789fc-de74-478a-9e65-af7e48444749 req-7083c204-f4e1-41b8-850a-e1663cf35cf1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068663 Aug 02 08:03:09.810508 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3700/7321] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:03:09.837257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-72076de3-e5d3-4209-8596-4766c00a8abe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:09.848544 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-72076de3-e5d3-4209-8596-4766c00a8abe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1392 microversion: 2.1 time: 0.179596 Aug 02 08:03:09.850187 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3622/7322] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:09 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:10.872455 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-187a556b-932c-4d3a-a47f-5fbd413d4ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:10.873157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-187a556b-932c-4d3a-a47f-5fbd413d4ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:10.880622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-187a556b-932c-4d3a-a47f-5fbd413d4ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:10.881072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-187a556b-932c-4d3a-a47f-5fbd413d4ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:10.881867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-187a556b-932c-4d3a-a47f-5fbd413d4ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:10.882317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-187a556b-932c-4d3a-a47f-5fbd413d4ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:11.026721 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-187a556b-932c-4d3a-a47f-5fbd413d4ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:11.037690 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-187a556b-932c-4d3a-a47f-5fbd413d4ebd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1392 microversion: 2.1 time: 0.170374 Aug 02 08:03:11.038890 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3701/7323] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:10 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:12.060007 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0606550f-08bd-4853-af64-d041b442b412 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:12.060570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0606550f-08bd-4853-af64-d041b442b412 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:12.068346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0606550f-08bd-4853-af64-d041b442b412 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:12.068816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0606550f-08bd-4853-af64-d041b442b412 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:12.069597 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0606550f-08bd-4853-af64-d041b442b412 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:12.070161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0606550f-08bd-4853-af64-d041b442b412 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:12.226404 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0606550f-08bd-4853-af64-d041b442b412 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:12.237007 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0606550f-08bd-4853-af64-d041b442b412 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1564 microversion: 2.1 time: 0.180716 Aug 02 08:03:12.237993 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3623/7324] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:12 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:12.264651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f85cdbf5-2e30-4449-9cbf-09d3f3c515de tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:12.265611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f85cdbf5-2e30-4449-9cbf-09d3f3c515de tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:12.277432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f85cdbf5-2e30-4449-9cbf-09d3f3c515de tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:12.278221 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f85cdbf5-2e30-4449-9cbf-09d3f3c515de tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:12.279477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f85cdbf5-2e30-4449-9cbf-09d3f3c515de tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:12.280194 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f85cdbf5-2e30-4449-9cbf-09d3f3c515de tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:12.425456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f85cdbf5-2e30-4449-9cbf-09d3f3c515de tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:12.437863 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f85cdbf5-2e30-4449-9cbf-09d3f3c515de tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1564 microversion: 2.1 time: 0.179580 Aug 02 08:03:12.438477 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3702/7325] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:12 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:14.116072 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e46e357e-5102-4af6-8378-1b70e4b37812 req-b78ca4d0-4010-4033-bb55-c19b213a7a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae10d0fd-756f-403c-b032-43d2039ab105", "tag": "965f7dd2-4981-4b7c-8702-db0a9e7fddbc"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:03:14.122105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fc85cead-23c6-44a6-b058-c0e73bf23069 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:14.122929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fc85cead-23c6-44a6-b058-c0e73bf23069 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:14.124980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:03:14.126015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:03:14.129873 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:03:14.131436 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:03:14.139828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:03:14.147159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc85cead-23c6-44a6-b058-c0e73bf23069 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:14.147603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc85cead-23c6-44a6-b058-c0e73bf23069 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:14.148478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc85cead-23c6-44a6-b058-c0e73bf23069 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:14.148918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fc85cead-23c6-44a6-b058-c0e73bf23069 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:14.150445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e46e357e-5102-4af6-8378-1b70e4b37812 req-b78ca4d0-4010-4033-bb55-c19b213a7a11 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:14.150903 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e46e357e-5102-4af6-8378-1b70e4b37812 req-b78ca4d0-4010-4033-bb55-c19b213a7a11 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:14.164381 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e46e357e-5102-4af6-8378-1b70e4b37812 req-b78ca4d0-4010-4033-bb55-c19b213a7a11 service nova] Creating event network-changed:965f7dd2-4981-4b7c-8702-db0a9e7fddbc for instance ae10d0fd-756f-403c-b032-43d2039ab105 on n-h2-851337-3 Aug 02 08:03:14.169779 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e46e357e-5102-4af6-8378-1b70e4b37812 req-b78ca4d0-4010-4033-bb55-c19b213a7a11 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057437 Aug 02 08:03:14.170792 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3703/7326] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:03:14.382899 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fc85cead-23c6-44a6-b058-c0e73bf23069 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:14.391300 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fc85cead-23c6-44a6-b058-c0e73bf23069 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1564 microversion: 2.1 time: 0.280666 Aug 02 08:03:14.392110 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3624/7327] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:14 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1564 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:38.004904 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=34 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:03:38.005752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:03:38.011202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d6c9d9b2-d65c-4b75-b881-3af9d0df3ff2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:03:38.013606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d6c9d9b2-d65c-4b75-b881-3af9d0df3ff2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:38.021549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6c9d9b2-d65c-4b75-b881-3af9d0df3ff2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:38.022032 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6c9d9b2-d65c-4b75-b881-3af9d0df3ff2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:38.022805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6c9d9b2-d65c-4b75-b881-3af9d0df3ff2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:38.023238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d6c9d9b2-d65c-4b75-b881-3af9d0df3ff2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:38.075860 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d6c9d9b2-d65c-4b75-b881-3af9d0df3ff2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105/action" status: 200 len: 24568 microversion: 2.1 time: 0.073030 Aug 02 08:03:38.076506 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3704/7328] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:03:38 2022] POST /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105/action => generated 24568 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:03:44.501199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-22afb159-49f6-4be5-91b7-a571b82e4bac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:03:44.504002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-22afb159-49f6-4be5-91b7-a571b82e4bac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:44.506153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:03:44.506816 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=34 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:03:44.515165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22afb159-49f6-4be5-91b7-a571b82e4bac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:44.515765 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22afb159-49f6-4be5-91b7-a571b82e4bac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:44.516797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22afb159-49f6-4be5-91b7-a571b82e4bac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:44.517375 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-22afb159-49f6-4be5-91b7-a571b82e4bac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:44.601254 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-22afb159-49f6-4be5-91b7-a571b82e4bac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105/action" status: 202 len: 0 microversion: 2.1 time: 0.104641 Aug 02 08:03:44.601918 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3625/7329] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:03:44 2022] POST /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:03:44.611225 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-338c76a8-70c6-4be2-86f6-d846876b2a93 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:44.612135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-338c76a8-70c6-4be2-86f6-d846876b2a93 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:44.621043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-338c76a8-70c6-4be2-86f6-d846876b2a93 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:44.621496 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-338c76a8-70c6-4be2-86f6-d846876b2a93 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:44.622626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-338c76a8-70c6-4be2-86f6-d846876b2a93 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:44.623067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-338c76a8-70c6-4be2-86f6-d846876b2a93 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:44.850452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-338c76a8-70c6-4be2-86f6-d846876b2a93 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:44.858590 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-338c76a8-70c6-4be2-86f6-d846876b2a93 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1675 microversion: 2.1 time: 0.251545 Aug 02 08:03:44.859196 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3705/7330] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:44 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1675 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:45.884165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c574f679-9a4e-48b4-9888-ae7a5b2c6ea6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:45.884865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c574f679-9a4e-48b4-9888-ae7a5b2c6ea6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:45.891778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c574f679-9a4e-48b4-9888-ae7a5b2c6ea6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:45.892226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c574f679-9a4e-48b4-9888-ae7a5b2c6ea6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:45.893003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c574f679-9a4e-48b4-9888-ae7a5b2c6ea6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:45.893444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c574f679-9a4e-48b4-9888-ae7a5b2c6ea6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:46.043022 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c574f679-9a4e-48b4-9888-ae7a5b2c6ea6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:46.053114 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c574f679-9a4e-48b4-9888-ae7a5b2c6ea6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1680 microversion: 2.1 time: 0.174988 Aug 02 08:03:46.053683 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3626/7331] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:45 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:47.077960 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-de122590-20db-4194-b7bb-75e9986c3a48 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:47.078594 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-de122590-20db-4194-b7bb-75e9986c3a48 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:47.089108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de122590-20db-4194-b7bb-75e9986c3a48 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:47.089108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de122590-20db-4194-b7bb-75e9986c3a48 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:47.089108 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de122590-20db-4194-b7bb-75e9986c3a48 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:47.089470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-de122590-20db-4194-b7bb-75e9986c3a48 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:47.225768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-de122590-20db-4194-b7bb-75e9986c3a48 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:47.234261 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-de122590-20db-4194-b7bb-75e9986c3a48 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1680 microversion: 2.1 time: 0.162622 Aug 02 08:03:47.234833 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3706/7332] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:47 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:48.259454 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4217f40a-7850-49e8-95e2-010c06e019fc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:48.260067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4217f40a-7850-49e8-95e2-010c06e019fc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:48.268559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4217f40a-7850-49e8-95e2-010c06e019fc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:48.269216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4217f40a-7850-49e8-95e2-010c06e019fc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:48.270029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4217f40a-7850-49e8-95e2-010c06e019fc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:48.270478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4217f40a-7850-49e8-95e2-010c06e019fc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:48.419179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4217f40a-7850-49e8-95e2-010c06e019fc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:48.428509 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4217f40a-7850-49e8-95e2-010c06e019fc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1680 microversion: 2.1 time: 0.174182 Aug 02 08:03:48.429110 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3627/7333] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:48 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:49.450681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-72a8d161-14c7-4d6b-8346-c4fbd6d46af3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:49.451287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-72a8d161-14c7-4d6b-8346-c4fbd6d46af3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:49.460465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72a8d161-14c7-4d6b-8346-c4fbd6d46af3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:49.461211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72a8d161-14c7-4d6b-8346-c4fbd6d46af3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:49.462547 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72a8d161-14c7-4d6b-8346-c4fbd6d46af3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:49.463150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-72a8d161-14c7-4d6b-8346-c4fbd6d46af3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:49.606992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-72a8d161-14c7-4d6b-8346-c4fbd6d46af3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:49.615333 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-72a8d161-14c7-4d6b-8346-c4fbd6d46af3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1680 microversion: 2.1 time: 0.168540 Aug 02 08:03:49.615834 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3707/7334] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:49 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:50.640514 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c188415a-dae7-4433-8de0-4019a17b3b1a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:50.641124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c188415a-dae7-4433-8de0-4019a17b3b1a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:50.650086 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c188415a-dae7-4433-8de0-4019a17b3b1a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:50.650532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c188415a-dae7-4433-8de0-4019a17b3b1a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:50.651304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c188415a-dae7-4433-8de0-4019a17b3b1a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:50.651756 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c188415a-dae7-4433-8de0-4019a17b3b1a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:50.796208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c188415a-dae7-4433-8de0-4019a17b3b1a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:50.807334 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c188415a-dae7-4433-8de0-4019a17b3b1a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1680 microversion: 2.1 time: 0.173214 Aug 02 08:03:50.808227 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3628/7335] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:50 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:51.838267 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-852952b7-d937-4802-8ba9-0c3f9dcac92a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:51.838974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-852952b7-d937-4802-8ba9-0c3f9dcac92a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:51.848575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-852952b7-d937-4802-8ba9-0c3f9dcac92a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:51.849200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-852952b7-d937-4802-8ba9-0c3f9dcac92a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:51.850054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-852952b7-d937-4802-8ba9-0c3f9dcac92a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:51.850493 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-852952b7-d937-4802-8ba9-0c3f9dcac92a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:52.015752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-852952b7-d937-4802-8ba9-0c3f9dcac92a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:52.024526 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-852952b7-d937-4802-8ba9-0c3f9dcac92a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1680 microversion: 2.1 time: 0.191817 Aug 02 08:03:52.025088 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3708/7336] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:51 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:53.047852 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0f8f63ee-7491-44ac-a92c-116483b2bff7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:53.048522 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0f8f63ee-7491-44ac-a92c-116483b2bff7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:53.055567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f8f63ee-7491-44ac-a92c-116483b2bff7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:53.056033 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f8f63ee-7491-44ac-a92c-116483b2bff7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:53.056823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f8f63ee-7491-44ac-a92c-116483b2bff7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:53.057271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0f8f63ee-7491-44ac-a92c-116483b2bff7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:53.200233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0f8f63ee-7491-44ac-a92c-116483b2bff7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:53.208336 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0f8f63ee-7491-44ac-a92c-116483b2bff7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1680 microversion: 2.1 time: 0.164858 Aug 02 08:03:53.208916 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3629/7337] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:53 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:54.234390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e652e01f-f5fa-4e6d-ba79-3504cd405217 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:54.235509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e652e01f-f5fa-4e6d-ba79-3504cd405217 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:54.244268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e652e01f-f5fa-4e6d-ba79-3504cd405217 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:54.244733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e652e01f-f5fa-4e6d-ba79-3504cd405217 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:54.245498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e652e01f-f5fa-4e6d-ba79-3504cd405217 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:54.245950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e652e01f-f5fa-4e6d-ba79-3504cd405217 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:54.402132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e652e01f-f5fa-4e6d-ba79-3504cd405217 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:54.413283 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e652e01f-f5fa-4e6d-ba79-3504cd405217 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1680 microversion: 2.1 time: 0.185698 Aug 02 08:03:54.414144 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3709/7338] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:54 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:55.439993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4d1f1abc-d422-40b2-af95-10cd397ecc12 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:55.440750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4d1f1abc-d422-40b2-af95-10cd397ecc12 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:55.448918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d1f1abc-d422-40b2-af95-10cd397ecc12 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:55.449378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d1f1abc-d422-40b2-af95-10cd397ecc12 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:55.450186 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d1f1abc-d422-40b2-af95-10cd397ecc12 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:55.450623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4d1f1abc-d422-40b2-af95-10cd397ecc12 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:55.591927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4d1f1abc-d422-40b2-af95-10cd397ecc12 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:55.601388 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4d1f1abc-d422-40b2-af95-10cd397ecc12 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1680 microversion: 2.1 time: 0.165622 Aug 02 08:03:55.602201 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3630/7339] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:55 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:03:56.625794 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0bdbcadb-d9c7-4d07-a136-bcdf436d924f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:03:56.626444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0bdbcadb-d9c7-4d07-a136-bcdf436d924f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:03:56.634992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bdbcadb-d9c7-4d07-a136-bcdf436d924f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:56.635184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bdbcadb-d9c7-4d07-a136-bcdf436d924f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:56.636068 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bdbcadb-d9c7-4d07-a136-bcdf436d924f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:03:56.636514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0bdbcadb-d9c7-4d07-a136-bcdf436d924f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:03:56.781035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0bdbcadb-d9c7-4d07-a136-bcdf436d924f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:03:56.790826 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0bdbcadb-d9c7-4d07-a136-bcdf436d924f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1683 microversion: 2.1 time: 0.169896 Aug 02 08:03:56.791408 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3710/7340] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:03:56 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:04:21.007411 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7e87580d-146b-4dd1-a681-068414eed159 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:04:21.009711 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7e87580d-146b-4dd1-a681-068414eed159 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:21.012718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=12 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:04:21.013392 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:04:21.020546 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e87580d-146b-4dd1-a681-068414eed159 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:21.021019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e87580d-146b-4dd1-a681-068414eed159 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:21.021796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e87580d-146b-4dd1-a681-068414eed159 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:21.022266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7e87580d-146b-4dd1-a681-068414eed159 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:21.085166 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7e87580d-146b-4dd1-a681-068414eed159 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105/action" status: 200 len: 69083 microversion: 2.1 time: 0.083591 Aug 02 08:04:21.086113 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3631/7341] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:04:20 2022] POST /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105/action => generated 69083 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:04:28.174645 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a7179b51-d2b8-43ce-98d4-01147b6b9006 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:28.175711 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a7179b51-d2b8-43ce-98d4-01147b6b9006 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:28.177303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-041665d3-fd43-4da3-92aa-8d10a029b6fe req-03cfb36c-f2fa-4127-8fad-a0b5921a0d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae10d0fd-756f-403c-b032-43d2039ab105", "tag": "965f7dd2-4981-4b7c-8702-db0a9e7fddbc"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:04:28.180044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=14 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:04:28.180894 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=40 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:04:28.185483 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7179b51-d2b8-43ce-98d4-01147b6b9006 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:28.186171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7179b51-d2b8-43ce-98d4-01147b6b9006 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:28.187145 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7179b51-d2b8-43ce-98d4-01147b6b9006 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:28.187747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a7179b51-d2b8-43ce-98d4-01147b6b9006 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:28.189167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-041665d3-fd43-4da3-92aa-8d10a029b6fe req-03cfb36c-f2fa-4127-8fad-a0b5921a0d00 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:28.189627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-041665d3-fd43-4da3-92aa-8d10a029b6fe req-03cfb36c-f2fa-4127-8fad-a0b5921a0d00 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:28.202957 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-041665d3-fd43-4da3-92aa-8d10a029b6fe req-03cfb36c-f2fa-4127-8fad-a0b5921a0d00 service nova] Creating event network-changed:965f7dd2-4981-4b7c-8702-db0a9e7fddbc for instance ae10d0fd-756f-403c-b032-43d2039ab105 on n-h2-851337-3 Aug 02 08:04:28.208144 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-041665d3-fd43-4da3-92aa-8d10a029b6fe req-03cfb36c-f2fa-4127-8fad-a0b5921a0d00 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035115 Aug 02 08:04:28.208919 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3632/7342] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:04:28.216781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a7179b51-d2b8-43ce-98d4-01147b6b9006 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 08:04:28.301638 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a7179b51-d2b8-43ce-98d4-01147b6b9006 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 204 len: 0 microversion: 2.1 time: 0.130749 Aug 02 08:04:28.302604 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3711/7343] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 08:04:28 2022] DELETE /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:04:28.313202 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-307380a9-7eb6-42b8-9925-fec548fa3e57 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:28.313943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-307380a9-7eb6-42b8-9925-fec548fa3e57 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:28.321390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-307380a9-7eb6-42b8-9925-fec548fa3e57 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:28.321845 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-307380a9-7eb6-42b8-9925-fec548fa3e57 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:28.322647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-307380a9-7eb6-42b8-9925-fec548fa3e57 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:28.323089 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-307380a9-7eb6-42b8-9925-fec548fa3e57 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:28.484539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-307380a9-7eb6-42b8-9925-fec548fa3e57 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:04:28.492624 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-307380a9-7eb6-42b8-9925-fec548fa3e57 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1689 microversion: 2.1 time: 0.184342 Aug 02 08:04:28.493599 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3633/7344] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:28 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:04:29.515628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-27e9602d-0f36-4f0f-b77d-70a940492a4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:29.516392 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-27e9602d-0f36-4f0f-b77d-70a940492a4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:29.525021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27e9602d-0f36-4f0f-b77d-70a940492a4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:29.525252 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27e9602d-0f36-4f0f-b77d-70a940492a4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:29.526231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27e9602d-0f36-4f0f-b77d-70a940492a4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:29.526576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-27e9602d-0f36-4f0f-b77d-70a940492a4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:29.736799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-27e9602d-0f36-4f0f-b77d-70a940492a4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:04:29.745104 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-27e9602d-0f36-4f0f-b77d-70a940492a4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1689 microversion: 2.1 time: 0.233730 Aug 02 08:04:29.745929 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3712/7345] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:29 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1689 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:04:30.515455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-639a5b2f-c9f9-415f-a2a3-befc1ff2ef9d req-2a1d1ff4-b591-436e-a7e4-def106e50226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae10d0fd-756f-403c-b032-43d2039ab105", "name": "network-vif-deleted", "tag": "965f7dd2-4981-4b7c-8702-db0a9e7fddbc"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:04:30.528055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-639a5b2f-c9f9-415f-a2a3-befc1ff2ef9d req-2a1d1ff4-b591-436e-a7e4-def106e50226 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:30.528503 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-639a5b2f-c9f9-415f-a2a3-befc1ff2ef9d req-2a1d1ff4-b591-436e-a7e4-def106e50226 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:30.543810 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-639a5b2f-c9f9-415f-a2a3-befc1ff2ef9d req-2a1d1ff4-b591-436e-a7e4-def106e50226 service nova] Creating event network-vif-deleted:965f7dd2-4981-4b7c-8702-db0a9e7fddbc for instance ae10d0fd-756f-403c-b032-43d2039ab105 on n-h2-851337-3 Aug 02 08:04:30.549181 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-639a5b2f-c9f9-415f-a2a3-befc1ff2ef9d req-2a1d1ff4-b591-436e-a7e4-def106e50226 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037400 Aug 02 08:04:30.553384 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3634/7346] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:04:30.770582 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-18695827-f94a-4e14-8967-ae4936d84a25 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:30.771155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-18695827-f94a-4e14-8967-ae4936d84a25 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:30.780173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18695827-f94a-4e14-8967-ae4936d84a25 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:30.780644 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18695827-f94a-4e14-8967-ae4936d84a25 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:30.781439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18695827-f94a-4e14-8967-ae4936d84a25 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:30.781907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18695827-f94a-4e14-8967-ae4936d84a25 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:30.818652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18695827-f94a-4e14-8967-ae4936d84a25 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:30.819110 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18695827-f94a-4e14-8967-ae4936d84a25 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:30.819632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-18695827-f94a-4e14-8967-ae4936d84a25 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lazy-loading 'fault' on Instance uuid ae10d0fd-756f-403c-b032-43d2039ab105 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:04:30.865442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-18695827-f94a-4e14-8967-ae4936d84a25 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:04:30.873534 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-18695827-f94a-4e14-8967-ae4936d84a25 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 200 len: 1356 microversion: 2.1 time: 0.109222 Aug 02 08:04:30.874188 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3713/7347] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:30 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:04:31.898682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e9fcfe59-171c-440e-9045-aac9cfb2768c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:31.899515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e9fcfe59-171c-440e-9045-aac9cfb2768c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: ae10d0fd-756f-403c-b032-43d2039ab105] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:31.906713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9fcfe59-171c-440e-9045-aac9cfb2768c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:31.907177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9fcfe59-171c-440e-9045-aac9cfb2768c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:31.907953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9fcfe59-171c-440e-9045-aac9cfb2768c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:31.908397 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e9fcfe59-171c-440e-9045-aac9cfb2768c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:31.927374 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-e9fcfe59-171c-440e-9045-aac9cfb2768c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] HTTP exception thrown: Instance ae10d0fd-756f-403c-b032-43d2039ab105 could not be found. Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e9fcfe59-171c-440e-9045-aac9cfb2768c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Request method failure captured: Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 HTTP/1.1 Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NnNXwQjzTe5ucEgWVr6FK5R_x-1PXSjORQwgK-HLJwg4ud0xCiQ2RxkmamNcISiMo4ifaafVN2MJnljlZbb38Rp3hdz9WWClfF8DfJRGHtUcgwK-nhNzEPhYJpv5Hbll_ZHACbAYvLF-wQIz_sIq23lqNZYgHg_IZwEzGzmdwo5X1U Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: efe942df311d4907b01d32a8bdd17e05 Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/efe942df311d4907b01d32a8bdd17e05"}]}] Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: efe942df311d4907b01d32a8bdd17e05 Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestNetworkAdvancedServerOps-1822902672-project Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 601715059796424bae5c160b4a5eb382 Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1822902672-project Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance ae10d0fd-756f-403c-b032-43d2039ab105 could not be found. Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'ae10d0fd-756f-403c-b032-43d2039ab105'} Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae10d0fd-756f-403c-b032-43d2039ab105 could not be found. Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae10d0fd-756f-403c-b032-43d2039ab105 could not be found. Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:04:31.929590 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:04:31.934923 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:04:31.934923 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:04:31.934923 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:04:31.934923 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:04:31.934923 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:04:31.934923 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:04:31.934923 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae10d0fd-756f-403c-b032-43d2039ab105 could not be found. Aug 02 08:04:31.934923 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:04:31.934923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e9fcfe59-171c-440e-9045-aac9cfb2768c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Returning 404 to user: Instance ae10d0fd-756f-403c-b032-43d2039ab105 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:04:31.934923 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e9fcfe59-171c-440e-9045-aac9cfb2768c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105" status: 404 len: 111 microversion: 2.1 time: 0.038804 Aug 02 08:04:31.934923 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3635/7348] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:31 2022] GET /compute/v2.1/servers/ae10d0fd-756f-403c-b032-43d2039ab105 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:04:35.398498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5a080096-1f8e-49e7-b390-009726b58780 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '.version_select at 0x7f9279e06550>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:35.424234 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5a080096-1f8e-49e7-b390-009726b58780 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2041443664" status: 202 len: 0 microversion: 2.1 time: 0.030818 Aug 02 08:04:35.425342 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3714/7349] 10.222.0.79 () {58 vars in 1284 bytes} [Tue Aug 2 08:04:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2041443664 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:04:35.447463 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-024baebc-264e-4aaa-bb90-5fc97a980a20 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'create', calling method: .version_select at 0x7f9279df45e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-199349177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBuc6jDLyBv+zzNniuug3EZTpMXbsBykqXUjleE3+5UpiSulbr3sSf5ZyQztSp3Vp1HhZPayxqJo5QepD2TSK5Z4DFsxGi3yYT3+JR1PK46DwJXWd1bvjPhBk6dQMx45Q=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:04:35.464896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-024baebc-264e-4aaa-bb90-5fc97a980a20 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for project efe942df311d4907b01d32a8bdd17e05. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:04:35.470328 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-024baebc-264e-4aaa-bb90-5fc97a980a20 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for user 601715059796424bae5c160b4a5eb382 and project efe942df311d4907b01d32a8bdd17e05. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:04:35.513716 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-024baebc-264e-4aaa-bb90-5fc97a980a20 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.070251 Aug 02 08:04:35.514682 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3636/7350] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 08:04:35 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:04:41.288806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:04:41.294391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-264875775", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "4b1c23dd-9da3-4761-9e6c-af2fd0978c41"}], "key_name": "tempest-TestNetworkAdvancedServerOps-199349177", "security_groups": [{"name": "tempest-secgroup-smoke-1018615902"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:04:41.625703 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] validate_networks() for [('4b1c23dd-9da3-4761-9e6c-af2fd0978c41', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:04:42.132401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:04:42.132769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:04:42.133425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:04:42.133926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:04:42.134379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:04:42.144896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:42.145519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:42.146409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:42.146852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:42.169987 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for project efe942df311d4907b01d32a8bdd17e05. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:04:42.175921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for user 601715059796424bae5c160b4a5eb382 and project efe942df311d4907b01d32a8bdd17e05. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:04:42.189632 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:04:42.192668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:04:42.242601 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e0515332-2345-4141-9d86-b30fc8970760 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.955643 Aug 02 08:04:42.249447 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3715/7351] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 08:04:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:04:42.253881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=16 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:04:42.259784 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-08f7b59c-b597-4179-bc83-275028ec5c55 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:42.260426 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-08f7b59c-b597-4179-bc83-275028ec5c55 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:42.399672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-08f7b59c-b597-4179-bc83-275028ec5c55 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:04:42.407596 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-08f7b59c-b597-4179-bc83-275028ec5c55 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1265 microversion: 2.1 time: 0.156219 Aug 02 08:04:42.408184 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3637/7352] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:42 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:04:43.430320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7195854a-60a7-44ff-bb73-8847a61898e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:43.430937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7195854a-60a7-44ff-bb73-8847a61898e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:43.440334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7195854a-60a7-44ff-bb73-8847a61898e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:43.441064 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7195854a-60a7-44ff-bb73-8847a61898e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:43.442345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7195854a-60a7-44ff-bb73-8847a61898e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:43.442817 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7195854a-60a7-44ff-bb73-8847a61898e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:43.534271 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7195854a-60a7-44ff-bb73-8847a61898e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:04:43.544804 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7195854a-60a7-44ff-bb73-8847a61898e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1323 microversion: 2.1 time: 0.120270 Aug 02 08:04:43.545498 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3716/7353] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:43 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1323 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:04:44.567427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-87aa4b3e-02eb-43a9-adb2-fa217fc9d5ac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:44.568081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-87aa4b3e-02eb-43a9-adb2-fa217fc9d5ac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:44.576238 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87aa4b3e-02eb-43a9-adb2-fa217fc9d5ac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:44.576944 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87aa4b3e-02eb-43a9-adb2-fa217fc9d5ac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:44.577982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87aa4b3e-02eb-43a9-adb2-fa217fc9d5ac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:44.578440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-87aa4b3e-02eb-43a9-adb2-fa217fc9d5ac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:44.721819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-c543c445-1c85-4c11-8f85-e76e825f257e req-15ed9620-45a7-481b-b1b3-cf6dd8bfe678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0671683-31e2-468c-8960-f145ecfabd6d", "tag": "5c4ccc0e-e785-4f83-88e0-782516b5afb8"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:04:44.735105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-87aa4b3e-02eb-43a9-adb2-fa217fc9d5ac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:04:44.740117 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c543c445-1c85-4c11-8f85-e76e825f257e req-15ed9620-45a7-481b-b1b3-cf6dd8bfe678 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:44.740947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c543c445-1c85-4c11-8f85-e76e825f257e req-15ed9620-45a7-481b-b1b3-cf6dd8bfe678 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:44.745998 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-87aa4b3e-02eb-43a9-adb2-fa217fc9d5ac tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1391 microversion: 2.1 time: 0.182220 Aug 02 08:04:44.747360 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3638/7354] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:44 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:04:44.771038 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-c543c445-1c85-4c11-8f85-e76e825f257e req-15ed9620-45a7-481b-b1b3-cf6dd8bfe678 service nova] Creating event network-changed:5c4ccc0e-e785-4f83-88e0-782516b5afb8 for instance c0671683-31e2-468c-8960-f145ecfabd6d on n-h2-851337-3 Aug 02 08:04:44.777561 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-c543c445-1c85-4c11-8f85-e76e825f257e req-15ed9620-45a7-481b-b1b3-cf6dd8bfe678 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059646 Aug 02 08:04:44.778298 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3717/7355] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:04:45.768402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7d975806-351b-4a59-896b-0a20aa2d25ca tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:45.768987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7d975806-351b-4a59-896b-0a20aa2d25ca tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:45.776390 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d975806-351b-4a59-896b-0a20aa2d25ca tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:45.776859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d975806-351b-4a59-896b-0a20aa2d25ca tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:45.777626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d975806-351b-4a59-896b-0a20aa2d25ca tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:45.778121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d975806-351b-4a59-896b-0a20aa2d25ca tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:45.953474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7d975806-351b-4a59-896b-0a20aa2d25ca tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:04:45.961929 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7d975806-351b-4a59-896b-0a20aa2d25ca tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1391 microversion: 2.1 time: 0.197404 Aug 02 08:04:45.963150 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3639/7356] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:45 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1391 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:04:46.985191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-396ff8d0-6c33-4d92-8998-60d31dd7cb31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:46.985926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-396ff8d0-6c33-4d92-8998-60d31dd7cb31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:46.992974 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-396ff8d0-6c33-4d92-8998-60d31dd7cb31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:46.993426 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-396ff8d0-6c33-4d92-8998-60d31dd7cb31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:46.994230 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-396ff8d0-6c33-4d92-8998-60d31dd7cb31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:46.994651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-396ff8d0-6c33-4d92-8998-60d31dd7cb31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:47.150459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-396ff8d0-6c33-4d92-8998-60d31dd7cb31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:04:47.162535 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-396ff8d0-6c33-4d92-8998-60d31dd7cb31 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1391 microversion: 2.1 time: 0.182067 Aug 02 08:04:47.163445 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3718/7357] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:46 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:04:48.184343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-310eba46-a942-4967-8def-935a254a748d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:48.184966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-310eba46-a942-4967-8def-935a254a748d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:48.192225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-310eba46-a942-4967-8def-935a254a748d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:48.192649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-310eba46-a942-4967-8def-935a254a748d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:48.193638 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-310eba46-a942-4967-8def-935a254a748d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:48.194161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-310eba46-a942-4967-8def-935a254a748d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:48.333290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-310eba46-a942-4967-8def-935a254a748d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:04:48.341145 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-310eba46-a942-4967-8def-935a254a748d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1391 microversion: 2.1 time: 0.160782 Aug 02 08:04:48.341736 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3640/7358] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:48 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:04:49.365728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6849ca86-4ad0-49e5-bd22-1d37f2d73433 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:49.366605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6849ca86-4ad0-49e5-bd22-1d37f2d73433 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:49.376324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6849ca86-4ad0-49e5-bd22-1d37f2d73433 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:49.376963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6849ca86-4ad0-49e5-bd22-1d37f2d73433 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:49.378399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6849ca86-4ad0-49e5-bd22-1d37f2d73433 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:49.378997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6849ca86-4ad0-49e5-bd22-1d37f2d73433 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:49.520331 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6849ca86-4ad0-49e5-bd22-1d37f2d73433 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:04:49.531438 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6849ca86-4ad0-49e5-bd22-1d37f2d73433 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1391 microversion: 2.1 time: 0.170525 Aug 02 08:04:49.532206 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3719/7359] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:49 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:04:50.348286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-5456c246-bcc4-4f26-a381-7b651da29d46 req-97b132d5-bf6b-41b0-9648-e9d1d8e70ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0671683-31e2-468c-8960-f145ecfabd6d", "name": "network-vif-plugged", "status": "completed", "tag": "5c4ccc0e-e785-4f83-88e0-782516b5afb8"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:04:50.360288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5456c246-bcc4-4f26-a381-7b651da29d46 req-97b132d5-bf6b-41b0-9648-e9d1d8e70ba8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:50.360746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-5456c246-bcc4-4f26-a381-7b651da29d46 req-97b132d5-bf6b-41b0-9648-e9d1d8e70ba8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:50.372084 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-5456c246-bcc4-4f26-a381-7b651da29d46 req-97b132d5-bf6b-41b0-9648-e9d1d8e70ba8 service nova] Creating event network-vif-plugged:5c4ccc0e-e785-4f83-88e0-782516b5afb8 for instance c0671683-31e2-468c-8960-f145ecfabd6d on n-h2-851337-3 Aug 02 08:04:50.377296 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-5456c246-bcc4-4f26-a381-7b651da29d46 req-97b132d5-bf6b-41b0-9648-e9d1d8e70ba8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091729 Aug 02 08:04:50.378158 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3641/7360] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:04:50.556158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cf0b367d-5882-4382-b36c-f03f113a8f5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:50.556775 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cf0b367d-5882-4382-b36c-f03f113a8f5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:50.563323 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf0b367d-5882-4382-b36c-f03f113a8f5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:50.563771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf0b367d-5882-4382-b36c-f03f113a8f5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:50.564560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf0b367d-5882-4382-b36c-f03f113a8f5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:50.564992 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cf0b367d-5882-4382-b36c-f03f113a8f5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:50.707135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cf0b367d-5882-4382-b36c-f03f113a8f5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:04:50.715296 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cf0b367d-5882-4382-b36c-f03f113a8f5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1391 microversion: 2.1 time: 0.164861 Aug 02 08:04:50.715883 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3720/7361] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:50 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:04:51.737258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2c90fc43-6e0a-4755-964f-375e95b2b02d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:51.737979 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2c90fc43-6e0a-4755-964f-375e95b2b02d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:51.740315 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:04:51.746160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c90fc43-6e0a-4755-964f-375e95b2b02d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:51.746615 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c90fc43-6e0a-4755-964f-375e95b2b02d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:51.747383 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c90fc43-6e0a-4755-964f-375e95b2b02d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:51.747827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2c90fc43-6e0a-4755-964f-375e95b2b02d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:51.887632 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2c90fc43-6e0a-4755-964f-375e95b2b02d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:04:51.898796 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2c90fc43-6e0a-4755-964f-375e95b2b02d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1562 microversion: 2.1 time: 0.165891 Aug 02 08:04:51.899585 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3642/7362] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:51 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:04:51.919843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-37b9471b-f486-4f95-8b00-346b5dab6634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:51.920478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-37b9471b-f486-4f95-8b00-346b5dab6634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:51.927896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37b9471b-f486-4f95-8b00-346b5dab6634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:51.928336 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37b9471b-f486-4f95-8b00-346b5dab6634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:51.929255 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37b9471b-f486-4f95-8b00-346b5dab6634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:51.930047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37b9471b-f486-4f95-8b00-346b5dab6634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:52.085659 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-37b9471b-f486-4f95-8b00-346b5dab6634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:04:52.093713 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-37b9471b-f486-4f95-8b00-346b5dab6634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1562 microversion: 2.1 time: 0.177801 Aug 02 08:04:52.094751 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3721/7363] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:51 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:04:53.805608 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c106cb30-ceed-4187-a164-35535fb61272 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:04:53.807464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:04:53.809053 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c106cb30-ceed-4187-a164-35535fb61272 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:04:53.811143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:04:53.817465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c106cb30-ceed-4187-a164-35535fb61272 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:53.818258 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:04:53.821747 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c106cb30-ceed-4187-a164-35535fb61272 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:53.822441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c106cb30-ceed-4187-a164-35535fb61272 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:53.822900 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c106cb30-ceed-4187-a164-35535fb61272 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:53.891713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-2f35e3fc-ae67-49d0-a551-dc0bd337b36d req-d16cd74e-7a45-4f75-80af-1a73266ba81a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0671683-31e2-468c-8960-f145ecfabd6d", "tag": "5c4ccc0e-e785-4f83-88e0-782516b5afb8"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:04:53.904356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2f35e3fc-ae67-49d0-a551-dc0bd337b36d req-d16cd74e-7a45-4f75-80af-1a73266ba81a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:04:53.904953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-2f35e3fc-ae67-49d0-a551-dc0bd337b36d req-d16cd74e-7a45-4f75-80af-1a73266ba81a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:04:53.916947 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-2f35e3fc-ae67-49d0-a551-dc0bd337b36d req-d16cd74e-7a45-4f75-80af-1a73266ba81a service nova] Creating event network-changed:5c4ccc0e-e785-4f83-88e0-782516b5afb8 for instance c0671683-31e2-468c-8960-f145ecfabd6d on n-h2-851337-3 Aug 02 08:04:53.922379 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-2f35e3fc-ae67-49d0-a551-dc0bd337b36d req-d16cd74e-7a45-4f75-80af-1a73266ba81a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123705 Aug 02 08:04:53.923155 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3722/7364] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:04:53.977838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c106cb30-ceed-4187-a164-35535fb61272 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:04:53.986656 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c106cb30-ceed-4187-a164-35535fb61272 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1562 microversion: 2.1 time: 0.189896 Aug 02 08:04:53.987503 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3643/7365] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:04:53 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1562 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:15.238559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:05:15.239302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=36 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:05:15.244432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6af0bb54-a7fd-443d-816c-7947acf49f4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:05:15.246921 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6af0bb54-a7fd-443d-816c-7947acf49f4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:15.256272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6af0bb54-a7fd-443d-816c-7947acf49f4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:15.256696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6af0bb54-a7fd-443d-816c-7947acf49f4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:15.257461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6af0bb54-a7fd-443d-816c-7947acf49f4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:15.257985 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6af0bb54-a7fd-443d-816c-7947acf49f4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:15.314846 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6af0bb54-a7fd-443d-816c-7947acf49f4c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d/action" status: 200 len: 24564 microversion: 2.1 time: 0.077796 Aug 02 08:05:15.316068 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3723/7366] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:05:15 2022] POST /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d/action => generated 24564 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:05:26.000817 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-75990c35-7fcc-4709-b3ad-deedfaf6d701 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:05:26.003225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-75990c35-7fcc-4709-b3ad-deedfaf6d701 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:26.005617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:05:26.006384 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=32 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:05:26.012734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75990c35-7fcc-4709-b3ad-deedfaf6d701 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:26.013179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75990c35-7fcc-4709-b3ad-deedfaf6d701 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:26.013995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75990c35-7fcc-4709-b3ad-deedfaf6d701 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:26.014442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-75990c35-7fcc-4709-b3ad-deedfaf6d701 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:26.105504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-75990c35-7fcc-4709-b3ad-deedfaf6d701 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:26.115517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-75990c35-7fcc-4709-b3ad-deedfaf6d701 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Old instance type m1.heat2, new instance type m1.heat {{(pid=126119) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 02 08:05:26.122847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-75990c35-7fcc-4709-b3ad-deedfaf6d701 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:05:26.123281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-75990c35-7fcc-4709-b3ad-deedfaf6d701 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:05:26.123788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-75990c35-7fcc-4709-b3ad-deedfaf6d701 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:05:26.124209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-75990c35-7fcc-4709-b3ad-deedfaf6d701 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:05:26.124639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-75990c35-7fcc-4709-b3ad-deedfaf6d701 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:05:26.196240 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-75990c35-7fcc-4709-b3ad-deedfaf6d701 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d/action" status: 202 len: 0 microversion: 2.1 time: 0.200417 Aug 02 08:05:26.196869 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3644/7367] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:05:25 2022] POST /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:05:26.206114 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-549e0621-e4f0-4da9-920b-a0d7b5cf6d22 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:26.206818 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-549e0621-e4f0-4da9-920b-a0d7b5cf6d22 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:26.209423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:05:26.210109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:05:26.216806 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-549e0621-e4f0-4da9-920b-a0d7b5cf6d22 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:26.217291 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-549e0621-e4f0-4da9-920b-a0d7b5cf6d22 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:26.218073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-549e0621-e4f0-4da9-920b-a0d7b5cf6d22 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:26.218668 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-549e0621-e4f0-4da9-920b-a0d7b5cf6d22 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:26.368330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-549e0621-e4f0-4da9-920b-a0d7b5cf6d22 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:26.376369 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-549e0621-e4f0-4da9-920b-a0d7b5cf6d22 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1688 microversion: 2.1 time: 0.174725 Aug 02 08:05:26.376935 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3724/7368] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:26 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:27.402557 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-47b03abb-edea-4fb0-b888-fb349ef85bdd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:27.403211 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-47b03abb-edea-4fb0-b888-fb349ef85bdd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:27.415161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47b03abb-edea-4fb0-b888-fb349ef85bdd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:27.415161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47b03abb-edea-4fb0-b888-fb349ef85bdd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:27.415928 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47b03abb-edea-4fb0-b888-fb349ef85bdd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:27.416355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-47b03abb-edea-4fb0-b888-fb349ef85bdd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:27.557355 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-47b03abb-edea-4fb0-b888-fb349ef85bdd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:27.565387 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-47b03abb-edea-4fb0-b888-fb349ef85bdd tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1688 microversion: 2.1 time: 0.169672 Aug 02 08:05:27.565958 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3645/7369] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:27 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:28.586937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8b7e006d-9cbe-4056-963e-591e2f57b802 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:28.587627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8b7e006d-9cbe-4056-963e-591e2f57b802 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:28.595121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b7e006d-9cbe-4056-963e-591e2f57b802 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:28.595567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b7e006d-9cbe-4056-963e-591e2f57b802 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:28.596344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b7e006d-9cbe-4056-963e-591e2f57b802 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:28.596809 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b7e006d-9cbe-4056-963e-591e2f57b802 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:28.742354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8b7e006d-9cbe-4056-963e-591e2f57b802 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:28.750067 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8b7e006d-9cbe-4056-963e-591e2f57b802 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1688 microversion: 2.1 time: 0.167138 Aug 02 08:05:28.750643 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3725/7370] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:28 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:29.772722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e75c2e1e-f7da-4504-8ff0-8140c8dfd2a9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:29.773283 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e75c2e1e-f7da-4504-8ff0-8140c8dfd2a9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:29.781182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e75c2e1e-f7da-4504-8ff0-8140c8dfd2a9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:29.781640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e75c2e1e-f7da-4504-8ff0-8140c8dfd2a9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:29.782439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e75c2e1e-f7da-4504-8ff0-8140c8dfd2a9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:29.782903 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e75c2e1e-f7da-4504-8ff0-8140c8dfd2a9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:29.921102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e75c2e1e-f7da-4504-8ff0-8140c8dfd2a9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:29.930263 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e75c2e1e-f7da-4504-8ff0-8140c8dfd2a9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1688 microversion: 2.1 time: 0.161551 Aug 02 08:05:29.931131 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3646/7371] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:29 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:30.953151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-05475ace-d41a-4e3a-b6e9-467be62ca42d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:30.953742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-05475ace-d41a-4e3a-b6e9-467be62ca42d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:30.960946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05475ace-d41a-4e3a-b6e9-467be62ca42d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:30.961396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05475ace-d41a-4e3a-b6e9-467be62ca42d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:30.962162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05475ace-d41a-4e3a-b6e9-467be62ca42d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:30.962652 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05475ace-d41a-4e3a-b6e9-467be62ca42d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:31.110390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-05475ace-d41a-4e3a-b6e9-467be62ca42d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:31.120062 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-05475ace-d41a-4e3a-b6e9-467be62ca42d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1688 microversion: 2.1 time: 0.170798 Aug 02 08:05:31.121054 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3726/7372] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:30 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:32.148469 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-962300ec-ca6b-4576-bd16-7b927b4281f5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:32.149169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-962300ec-ca6b-4576-bd16-7b927b4281f5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:32.157101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-962300ec-ca6b-4576-bd16-7b927b4281f5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:32.157560 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-962300ec-ca6b-4576-bd16-7b927b4281f5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:32.158398 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-962300ec-ca6b-4576-bd16-7b927b4281f5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:32.158838 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-962300ec-ca6b-4576-bd16-7b927b4281f5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:32.330373 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-962300ec-ca6b-4576-bd16-7b927b4281f5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:32.338372 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-962300ec-ca6b-4576-bd16-7b927b4281f5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1688 microversion: 2.1 time: 0.195131 Aug 02 08:05:32.338952 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3647/7373] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:32 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:33.360701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ca67edab-f785-4684-b31e-b6499194fd04 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:33.361311 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ca67edab-f785-4684-b31e-b6499194fd04 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:33.370522 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca67edab-f785-4684-b31e-b6499194fd04 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:33.371031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca67edab-f785-4684-b31e-b6499194fd04 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:33.371830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca67edab-f785-4684-b31e-b6499194fd04 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:33.372274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ca67edab-f785-4684-b31e-b6499194fd04 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:33.525468 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-ca67edab-f785-4684-b31e-b6499194fd04 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:33.534997 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ca67edab-f785-4684-b31e-b6499194fd04 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1693 microversion: 2.1 time: 0.178342 Aug 02 08:05:33.535900 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3727/7374] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:33 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:34.567371 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a9b900f7-d2cf-49b6-af5b-f7cefc9eebc7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:34.567940 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a9b900f7-d2cf-49b6-af5b-f7cefc9eebc7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:34.577421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9b900f7-d2cf-49b6-af5b-f7cefc9eebc7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:34.578110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9b900f7-d2cf-49b6-af5b-f7cefc9eebc7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:34.579265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9b900f7-d2cf-49b6-af5b-f7cefc9eebc7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:34.579889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a9b900f7-d2cf-49b6-af5b-f7cefc9eebc7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:34.729379 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a9b900f7-d2cf-49b6-af5b-f7cefc9eebc7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:34.737485 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a9b900f7-d2cf-49b6-af5b-f7cefc9eebc7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1693 microversion: 2.1 time: 0.174235 Aug 02 08:05:34.738104 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3648/7375] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:34 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:35.759802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-161136c7-73aa-4204-a91d-eaefa8ac7ffc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:35.760563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-161136c7-73aa-4204-a91d-eaefa8ac7ffc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:35.767940 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-161136c7-73aa-4204-a91d-eaefa8ac7ffc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:35.768385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-161136c7-73aa-4204-a91d-eaefa8ac7ffc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:35.769159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-161136c7-73aa-4204-a91d-eaefa8ac7ffc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:35.769595 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-161136c7-73aa-4204-a91d-eaefa8ac7ffc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:35.912355 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-161136c7-73aa-4204-a91d-eaefa8ac7ffc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:35.920741 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-161136c7-73aa-4204-a91d-eaefa8ac7ffc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1693 microversion: 2.1 time: 0.165025 Aug 02 08:05:35.921329 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3728/7376] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:35 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:36.944854 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4aabfbdf-24f2-48a4-a731-b9ded2075d5d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:36.945552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4aabfbdf-24f2-48a4-a731-b9ded2075d5d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:36.953785 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4aabfbdf-24f2-48a4-a731-b9ded2075d5d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:36.954276 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4aabfbdf-24f2-48a4-a731-b9ded2075d5d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:36.955067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4aabfbdf-24f2-48a4-a731-b9ded2075d5d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:36.955512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4aabfbdf-24f2-48a4-a731-b9ded2075d5d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:37.098067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4aabfbdf-24f2-48a4-a731-b9ded2075d5d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:37.106330 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4aabfbdf-24f2-48a4-a731-b9ded2075d5d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1693 microversion: 2.1 time: 0.166884 Aug 02 08:05:37.106846 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3649/7377] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:36 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:05:38.128433 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-98c004b2-0646-491f-b9a3-82554486a603 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:38.129401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-98c004b2-0646-491f-b9a3-82554486a603 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:38.137106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98c004b2-0646-491f-b9a3-82554486a603 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:38.137561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98c004b2-0646-491f-b9a3-82554486a603 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:38.138400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98c004b2-0646-491f-b9a3-82554486a603 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:38.138832 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-98c004b2-0646-491f-b9a3-82554486a603 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:38.276790 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-98c004b2-0646-491f-b9a3-82554486a603 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:38.284915 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-98c004b2-0646-491f-b9a3-82554486a603 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1693 microversion: 2.1 time: 0.160599 Aug 02 08:05:38.285478 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3729/7378] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:38 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:39.307532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5b5d4be4-d679-49ae-af02-c13d76462f35 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:39.308144 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5b5d4be4-d679-49ae-af02-c13d76462f35 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:39.315593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b5d4be4-d679-49ae-af02-c13d76462f35 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:39.316050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b5d4be4-d679-49ae-af02-c13d76462f35 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:39.316813 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b5d4be4-d679-49ae-af02-c13d76462f35 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:39.317252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5b5d4be4-d679-49ae-af02-c13d76462f35 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:39.454809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5b5d4be4-d679-49ae-af02-c13d76462f35 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:39.463784 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5b5d4be4-d679-49ae-af02-c13d76462f35 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1693 microversion: 2.1 time: 0.159552 Aug 02 08:05:39.463784 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3650/7379] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:39 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:40.484908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-06072677-7d07-4b27-93a3-53893544b6e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:40.485523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-06072677-7d07-4b27-93a3-53893544b6e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:40.493147 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06072677-7d07-4b27-93a3-53893544b6e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:40.493742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06072677-7d07-4b27-93a3-53893544b6e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:40.494569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06072677-7d07-4b27-93a3-53893544b6e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:40.495004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06072677-7d07-4b27-93a3-53893544b6e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:40.641019 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-06072677-7d07-4b27-93a3-53893544b6e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:40.649371 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-06072677-7d07-4b27-93a3-53893544b6e1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1693 microversion: 2.1 time: 0.168695 Aug 02 08:05:40.649954 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3730/7380] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:40 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:41.671631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4548ce3c-7c0a-4e9b-a675-48af64259fb6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:41.672247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4548ce3c-7c0a-4e9b-a675-48af64259fb6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:41.680087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4548ce3c-7c0a-4e9b-a675-48af64259fb6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:41.680676 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4548ce3c-7c0a-4e9b-a675-48af64259fb6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:41.681468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4548ce3c-7c0a-4e9b-a675-48af64259fb6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:41.681920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4548ce3c-7c0a-4e9b-a675-48af64259fb6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:41.833912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4548ce3c-7c0a-4e9b-a675-48af64259fb6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:41.842557 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4548ce3c-7c0a-4e9b-a675-48af64259fb6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1693 microversion: 2.1 time: 0.174871 Aug 02 08:05:41.843357 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3651/7381] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:41 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:42.868799 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3860d208-8e19-4a30-b7dd-f7d96e64fe32 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:42.869492 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3860d208-8e19-4a30-b7dd-f7d96e64fe32 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:42.878756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3860d208-8e19-4a30-b7dd-f7d96e64fe32 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:42.879684 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3860d208-8e19-4a30-b7dd-f7d96e64fe32 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:42.880764 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3860d208-8e19-4a30-b7dd-f7d96e64fe32 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:42.881362 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3860d208-8e19-4a30-b7dd-f7d96e64fe32 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:43.030731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3860d208-8e19-4a30-b7dd-f7d96e64fe32 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:43.042385 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3860d208-8e19-4a30-b7dd-f7d96e64fe32 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1693 microversion: 2.1 time: 0.180964 Aug 02 08:05:43.042978 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3731/7382] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:42 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1693 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:44.072713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f1b88642-7d83-40e2-a224-bd3ca94386ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:44.073419 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f1b88642-7d83-40e2-a224-bd3ca94386ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:44.082040 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1b88642-7d83-40e2-a224-bd3ca94386ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:44.082580 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1b88642-7d83-40e2-a224-bd3ca94386ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:44.083478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1b88642-7d83-40e2-a224-bd3ca94386ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:44.084001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f1b88642-7d83-40e2-a224-bd3ca94386ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:44.224439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f1b88642-7d83-40e2-a224-bd3ca94386ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:44.233458 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f1b88642-7d83-40e2-a224-bd3ca94386ec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1693 microversion: 2.1 time: 0.165750 Aug 02 08:05:44.234063 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3652/7383] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:44 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:45.213740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-f0edab2a-f7b7-44a8-8086-e0e9c5b24fed req-ddb942f6-43f0-442f-a402-f484c5ad46ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0671683-31e2-468c-8960-f145ecfabd6d", "name": "network-vif-unplugged", "status": "completed", "tag": "5c4ccc0e-e785-4f83-88e0-782516b5afb8"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:05:45.225232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f0edab2a-f7b7-44a8-8086-e0e9c5b24fed req-ddb942f6-43f0-442f-a402-f484c5ad46ef service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:45.225978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-f0edab2a-f7b7-44a8-8086-e0e9c5b24fed req-ddb942f6-43f0-442f-a402-f484c5ad46ef service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:45.239233 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-f0edab2a-f7b7-44a8-8086-e0e9c5b24fed req-ddb942f6-43f0-442f-a402-f484c5ad46ef service nova] Creating event network-vif-unplugged:5c4ccc0e-e785-4f83-88e0-782516b5afb8 for instance c0671683-31e2-468c-8960-f145ecfabd6d on n-h1-851337-3 Aug 02 08:05:45.244899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [req-f0edab2a-f7b7-44a8-8086-e0e9c5b24fed req-ddb942f6-43f0-442f-a402-f484c5ad46ef service nova] Instance c0671683-31e2-468c-8960-f145ecfabd6d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126120) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 08:05:45.255921 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f820ac28-9c0f-46c8-a874-d02b488e6f64 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:45.256517 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f820ac28-9c0f-46c8-a874-d02b488e6f64 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:45.266237 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f820ac28-9c0f-46c8-a874-d02b488e6f64 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:45.266699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f820ac28-9c0f-46c8-a874-d02b488e6f64 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:45.267323 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-f0edab2a-f7b7-44a8-8086-e0e9c5b24fed req-ddb942f6-43f0-442f-a402-f484c5ad46ef service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057737 Aug 02 08:05:45.267555 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f820ac28-9c0f-46c8-a874-d02b488e6f64 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:45.268182 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f820ac28-9c0f-46c8-a874-d02b488e6f64 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:45.268571 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3732/7384] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:05:45.860132 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f820ac28-9c0f-46c8-a874-d02b488e6f64 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:45.868490 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f820ac28-9c0f-46c8-a874-d02b488e6f64 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1692 microversion: 2.1 time: 0.616252 Aug 02 08:05:45.868490 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3653/7385] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:45 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1692 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:05:46.893084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-09735f9c-568e-4dbe-829c-3876613d7c06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:46.893836 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-09735f9c-568e-4dbe-829c-3876613d7c06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:46.902460 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09735f9c-568e-4dbe-829c-3876613d7c06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:46.902973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09735f9c-568e-4dbe-829c-3876613d7c06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:46.903853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09735f9c-568e-4dbe-829c-3876613d7c06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:46.904364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-09735f9c-568e-4dbe-829c-3876613d7c06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:47.049646 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-09735f9c-568e-4dbe-829c-3876613d7c06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:47.060149 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-09735f9c-568e-4dbe-829c-3876613d7c06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1690 microversion: 2.1 time: 0.172883 Aug 02 08:05:47.060743 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3733/7386] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:46 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:47.301837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-f74f8349-2531-46e6-80a1-41c84ec976af req-82670daa-19fc-4ef5-b6ff-9d2074a2b463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0671683-31e2-468c-8960-f145ecfabd6d", "tag": "5c4ccc0e-e785-4f83-88e0-782516b5afb8"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:05:47.312887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f74f8349-2531-46e6-80a1-41c84ec976af req-82670daa-19fc-4ef5-b6ff-9d2074a2b463 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:47.313336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f74f8349-2531-46e6-80a1-41c84ec976af req-82670daa-19fc-4ef5-b6ff-9d2074a2b463 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:47.326290 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-f74f8349-2531-46e6-80a1-41c84ec976af req-82670daa-19fc-4ef5-b6ff-9d2074a2b463 service nova] Creating event network-changed:5c4ccc0e-e785-4f83-88e0-782516b5afb8 for instance c0671683-31e2-468c-8960-f145ecfabd6d on n-h1-851337-3 Aug 02 08:05:47.332284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [req-f74f8349-2531-46e6-80a1-41c84ec976af req-82670daa-19fc-4ef5-b6ff-9d2074a2b463 service nova] Instance c0671683-31e2-468c-8960-f145ecfabd6d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-851337-3', 'n-h1-851337-3'} {{(pid=126119) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 02 08:05:47.344040 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-f74f8349-2531-46e6-80a1-41c84ec976af req-82670daa-19fc-4ef5-b6ff-9d2074a2b463 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045952 Aug 02 08:05:47.344645 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3654/7387] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:05:48.082342 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-8b47b0a4-1dad-4683-a731-b63fd2bc7bf4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:48.082925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-8b47b0a4-1dad-4683-a731-b63fd2bc7bf4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:48.090502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b47b0a4-1dad-4683-a731-b63fd2bc7bf4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:48.090957 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b47b0a4-1dad-4683-a731-b63fd2bc7bf4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:48.091734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b47b0a4-1dad-4683-a731-b63fd2bc7bf4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:48.092175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-8b47b0a4-1dad-4683-a731-b63fd2bc7bf4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:48.232540 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-8b47b0a4-1dad-4683-a731-b63fd2bc7bf4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:48.243648 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-8b47b0a4-1dad-4683-a731-b63fd2bc7bf4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1690 microversion: 2.1 time: 0.165245 Aug 02 08:05:48.244442 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3734/7388] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:48 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:49.274888 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7d469911-9303-4a55-962f-a4afb227cc8a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:49.275639 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7d469911-9303-4a55-962f-a4afb227cc8a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:49.282245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d469911-9303-4a55-962f-a4afb227cc8a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:49.282706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d469911-9303-4a55-962f-a4afb227cc8a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:49.283480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d469911-9303-4a55-962f-a4afb227cc8a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:49.283926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7d469911-9303-4a55-962f-a4afb227cc8a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:49.480512 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7d469911-9303-4a55-962f-a4afb227cc8a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:49.489474 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7d469911-9303-4a55-962f-a4afb227cc8a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1690 microversion: 2.1 time: 0.220605 Aug 02 08:05:49.490318 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3655/7389] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:49 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1690 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:50.514443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b7f6c89e-e5d2-44ad-afb3-34f423e0df4f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:50.515209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b7f6c89e-e5d2-44ad-afb3-34f423e0df4f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:50.523080 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7f6c89e-e5d2-44ad-afb3-34f423e0df4f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:50.523617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7f6c89e-e5d2-44ad-afb3-34f423e0df4f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:50.524529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7f6c89e-e5d2-44ad-afb3-34f423e0df4f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:50.525062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b7f6c89e-e5d2-44ad-afb3-34f423e0df4f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:50.667154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b7f6c89e-e5d2-44ad-afb3-34f423e0df4f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:50.678668 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b7f6c89e-e5d2-44ad-afb3-34f423e0df4f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1687 microversion: 2.1 time: 0.169321 Aug 02 08:05:50.679490 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3735/7390] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:50 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:50.706251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-562c70a7-3089-4872-8c17-1cdb71e00d8e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:05:50.706806 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-562c70a7-3089-4872-8c17-1cdb71e00d8e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:50.714247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-562c70a7-3089-4872-8c17-1cdb71e00d8e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:50.714714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-562c70a7-3089-4872-8c17-1cdb71e00d8e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:50.715502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-562c70a7-3089-4872-8c17-1cdb71e00d8e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:50.715985 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-562c70a7-3089-4872-8c17-1cdb71e00d8e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:50.780081 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-562c70a7-3089-4872-8c17-1cdb71e00d8e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d/action" status: 204 len: 0 microversion: 2.1 time: 0.077559 Aug 02 08:05:50.780649 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3656/7391] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:05:50 2022] POST /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:05:50.789621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-25985a5a-32f3-48c9-8ad1-32b4800cc846 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:50.790299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-25985a5a-32f3-48c9-8ad1-32b4800cc846 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:50.796530 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-25985a5a-32f3-48c9-8ad1-32b4800cc846 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:50.797664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-25985a5a-32f3-48c9-8ad1-32b4800cc846 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:50.798337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-25985a5a-32f3-48c9-8ad1-32b4800cc846 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:50.798337 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-25985a5a-32f3-48c9-8ad1-32b4800cc846 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:50.943833 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-25985a5a-32f3-48c9-8ad1-32b4800cc846 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:50.951853 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-25985a5a-32f3-48c9-8ad1-32b4800cc846 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1687 microversion: 2.1 time: 0.166266 Aug 02 08:05:50.952443 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3736/7392] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:50 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:50.973159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e88ce6d5-5e7f-4bed-95a1-1dbe297f7506 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:50.973865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e88ce6d5-5e7f-4bed-95a1-1dbe297f7506 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:50.980626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e88ce6d5-5e7f-4bed-95a1-1dbe297f7506 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:50.981093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e88ce6d5-5e7f-4bed-95a1-1dbe297f7506 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:50.981948 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e88ce6d5-5e7f-4bed-95a1-1dbe297f7506 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:50.982400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e88ce6d5-5e7f-4bed-95a1-1dbe297f7506 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:51.132262 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e88ce6d5-5e7f-4bed-95a1-1dbe297f7506 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:51.140768 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e88ce6d5-5e7f-4bed-95a1-1dbe297f7506 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1687 microversion: 2.1 time: 0.171813 Aug 02 08:05:51.141356 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3657/7393] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:50 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:52.162751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-14e8baf7-af37-4c89-a99e-65a35866d05c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:52.163391 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-14e8baf7-af37-4c89-a99e-65a35866d05c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:52.172138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14e8baf7-af37-4c89-a99e-65a35866d05c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:52.172691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14e8baf7-af37-4c89-a99e-65a35866d05c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:52.173481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14e8baf7-af37-4c89-a99e-65a35866d05c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:52.174017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-14e8baf7-af37-4c89-a99e-65a35866d05c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:52.327826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-14e8baf7-af37-4c89-a99e-65a35866d05c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:52.336635 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-14e8baf7-af37-4c89-a99e-65a35866d05c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1687 microversion: 2.1 time: 0.177170 Aug 02 08:05:52.337462 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3737/7394] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:52 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:53.363041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f3fc37b5-61af-4e46-affe-3f74f7db2819 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:05:53.364147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f3fc37b5-61af-4e46-affe-3f74f7db2819 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:05:53.375590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3fc37b5-61af-4e46-affe-3f74f7db2819 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:53.376356 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3fc37b5-61af-4e46-affe-3f74f7db2819 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:53.377667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3fc37b5-61af-4e46-affe-3f74f7db2819 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:53.378470 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f3fc37b5-61af-4e46-affe-3f74f7db2819 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:53.397438 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:05:53.525881 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f3fc37b5-61af-4e46-affe-3f74f7db2819 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:05:53.534539 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f3fc37b5-61af-4e46-affe-3f74f7db2819 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1679 microversion: 2.1 time: 0.177987 Aug 02 08:05:53.535126 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3658/7395] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:05:53 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:05:53.717610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-e97e329e-197b-4ef9-a7bf-e093649ce391 req-4316bb86-6872-4a93-a16d-1a5bcf798acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0671683-31e2-468c-8960-f145ecfabd6d", "name": "network-vif-plugged", "status": "completed", "tag": "5c4ccc0e-e785-4f83-88e0-782516b5afb8"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:05:53.733121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e97e329e-197b-4ef9-a7bf-e093649ce391 req-4316bb86-6872-4a93-a16d-1a5bcf798acd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:05:53.733681 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-e97e329e-197b-4ef9-a7bf-e093649ce391 req-4316bb86-6872-4a93-a16d-1a5bcf798acd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:05:53.746585 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-e97e329e-197b-4ef9-a7bf-e093649ce391 req-4316bb86-6872-4a93-a16d-1a5bcf798acd service nova] Creating event network-vif-plugged:5c4ccc0e-e785-4f83-88e0-782516b5afb8 for instance c0671683-31e2-468c-8960-f145ecfabd6d on n-h1-851337-3 Aug 02 08:05:53.751736 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-e97e329e-197b-4ef9-a7bf-e093649ce391 req-4316bb86-6872-4a93-a16d-1a5bcf798acd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038084 Aug 02 08:05:53.752577 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3738/7396] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:06:21.769994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=34 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:06:21.770878 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:06:21.818490 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-78f047ef-7aa3-4aa3-8e74-27fbe9f5ec8e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:06:21.820841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-78f047ef-7aa3-4aa3-8e74-27fbe9f5ec8e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:06:21.827543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78f047ef-7aa3-4aa3-8e74-27fbe9f5ec8e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:21.828008 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78f047ef-7aa3-4aa3-8e74-27fbe9f5ec8e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:21.828798 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78f047ef-7aa3-4aa3-8e74-27fbe9f5ec8e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:21.829245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-78f047ef-7aa3-4aa3-8e74-27fbe9f5ec8e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:21.894821 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-78f047ef-7aa3-4aa3-8e74-27fbe9f5ec8e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d/action" status: 200 len: 24575 microversion: 2.1 time: 0.129754 Aug 02 08:06:21.895450 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3659/7397] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:06:21 2022] POST /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d/action => generated 24575 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:06:45.894706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-aa88a374-840e-4e85-b7a5-2bcd834f30df tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:06:45.895353 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aa88a374-840e-4e85-b7a5-2bcd834f30df tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:06:45.898057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=30 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:06:45.898726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=84 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:06:45.901136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:06:45.902121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:06:45.912198 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa88a374-840e-4e85-b7a5-2bcd834f30df tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:45.913502 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa88a374-840e-4e85-b7a5-2bcd834f30df tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:45.915397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa88a374-840e-4e85-b7a5-2bcd834f30df tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:45.917182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-aa88a374-840e-4e85-b7a5-2bcd834f30df tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:45.948601 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-aa88a374-840e-4e85-b7a5-2bcd834f30df tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 08:06:45.965674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-f1e2b748-8806-4dea-bd22-592fd5469dfe req-d5b89555-27a8-4d83-8f87-8d5fcafb5dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0671683-31e2-468c-8960-f145ecfabd6d", "tag": "5c4ccc0e-e785-4f83-88e0-782516b5afb8"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:06:45.975959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f1e2b748-8806-4dea-bd22-592fd5469dfe req-d5b89555-27a8-4d83-8f87-8d5fcafb5dee service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:45.976319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f1e2b748-8806-4dea-bd22-592fd5469dfe req-d5b89555-27a8-4d83-8f87-8d5fcafb5dee service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:45.987787 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-f1e2b748-8806-4dea-bd22-592fd5469dfe req-d5b89555-27a8-4d83-8f87-8d5fcafb5dee service nova] Creating event network-changed:5c4ccc0e-e785-4f83-88e0-782516b5afb8 for instance c0671683-31e2-468c-8960-f145ecfabd6d on n-h1-851337-3 Aug 02 08:06:45.993679 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-f1e2b748-8806-4dea-bd22-592fd5469dfe req-d5b89555-27a8-4d83-8f87-8d5fcafb5dee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105316 Aug 02 08:06:45.994662 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3660/7398] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:06:46.042300 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-aa88a374-840e-4e85-b7a5-2bcd834f30df tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 204 len: 0 microversion: 2.1 time: 0.157206 Aug 02 08:06:46.042951 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3739/7399] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 08:06:45 2022] DELETE /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:06:46.054169 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9a476a35-cc39-469a-af74-bf078d6f6180 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:06:46.055596 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9a476a35-cc39-469a-af74-bf078d6f6180 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:06:46.063491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a476a35-cc39-469a-af74-bf078d6f6180 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:46.063963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a476a35-cc39-469a-af74-bf078d6f6180 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:46.064983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a476a35-cc39-469a-af74-bf078d6f6180 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:46.065583 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a476a35-cc39-469a-af74-bf078d6f6180 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:46.246388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9a476a35-cc39-469a-af74-bf078d6f6180 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:06:46.255724 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9a476a35-cc39-469a-af74-bf078d6f6180 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1685 microversion: 2.1 time: 0.206379 Aug 02 08:06:46.256911 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3661/7400] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:06:46 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1685 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:06:47.280839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-39626c2d-c764-4382-bf80-6359e0aa54cc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:06:47.281539 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-39626c2d-c764-4382-bf80-6359e0aa54cc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:06:47.289175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39626c2d-c764-4382-bf80-6359e0aa54cc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:47.290102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39626c2d-c764-4382-bf80-6359e0aa54cc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:47.290924 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39626c2d-c764-4382-bf80-6359e0aa54cc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:47.291360 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39626c2d-c764-4382-bf80-6359e0aa54cc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:47.438462 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-39626c2d-c764-4382-bf80-6359e0aa54cc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:06:47.447402 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-39626c2d-c764-4382-bf80-6359e0aa54cc tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1685 microversion: 2.1 time: 0.171001 Aug 02 08:06:47.448003 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3740/7401] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:06:47 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:06:48.079936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-be521652-8e59-4f59-9635-8ddc96dd3cd9 req-4d37048a-07d0-46fd-9e39-730df0c0cef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0671683-31e2-468c-8960-f145ecfabd6d", "name": "network-vif-deleted", "tag": "5c4ccc0e-e785-4f83-88e0-782516b5afb8"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:06:48.091636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-be521652-8e59-4f59-9635-8ddc96dd3cd9 req-4d37048a-07d0-46fd-9e39-730df0c0cef7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:48.092087 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-be521652-8e59-4f59-9635-8ddc96dd3cd9 req-4d37048a-07d0-46fd-9e39-730df0c0cef7 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:48.104076 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-be521652-8e59-4f59-9635-8ddc96dd3cd9 req-4d37048a-07d0-46fd-9e39-730df0c0cef7 service nova] Creating event network-vif-deleted:5c4ccc0e-e785-4f83-88e0-782516b5afb8 for instance c0671683-31e2-468c-8960-f145ecfabd6d on n-h1-851337-3 Aug 02 08:06:48.109509 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-be521652-8e59-4f59-9635-8ddc96dd3cd9 req-4d37048a-07d0-46fd-9e39-730df0c0cef7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033473 Aug 02 08:06:48.110170 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3662/7402] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:06:48.472450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-69cd6ced-9d56-4a2d-84f6-1ab92ab4908a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:06:48.473162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-69cd6ced-9d56-4a2d-84f6-1ab92ab4908a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:06:48.482260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69cd6ced-9d56-4a2d-84f6-1ab92ab4908a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:48.482866 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69cd6ced-9d56-4a2d-84f6-1ab92ab4908a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:48.483710 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69cd6ced-9d56-4a2d-84f6-1ab92ab4908a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:48.484156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69cd6ced-9d56-4a2d-84f6-1ab92ab4908a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:48.518593 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69cd6ced-9d56-4a2d-84f6-1ab92ab4908a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:48.519071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69cd6ced-9d56-4a2d-84f6-1ab92ab4908a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:48.519619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-69cd6ced-9d56-4a2d-84f6-1ab92ab4908a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lazy-loading 'fault' on Instance uuid c0671683-31e2-468c-8960-f145ecfabd6d {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:06:48.568796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-69cd6ced-9d56-4a2d-84f6-1ab92ab4908a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:06:48.577045 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-69cd6ced-9d56-4a2d-84f6-1ab92ab4908a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 200 len: 1355 microversion: 2.1 time: 0.108678 Aug 02 08:06:48.577658 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3741/7403] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:06:48 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 1355 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:06:49.603102 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3d4313e4-9a69-4bcd-accd-0c38f40220f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:06:49.603821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3d4313e4-9a69-4bcd-accd-0c38f40220f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: c0671683-31e2-468c-8960-f145ecfabd6d] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:06:49.610766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d4313e4-9a69-4bcd-accd-0c38f40220f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:49.611219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d4313e4-9a69-4bcd-accd-0c38f40220f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:49.611989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d4313e4-9a69-4bcd-accd-0c38f40220f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:49.612428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3d4313e4-9a69-4bcd-accd-0c38f40220f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:49.626160 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-3d4313e4-9a69-4bcd-accd-0c38f40220f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] HTTP exception thrown: Instance c0671683-31e2-468c-8960-f145ecfabd6d could not be found. Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3d4313e4-9a69-4bcd-accd-0c38f40220f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Request method failure captured: Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d HTTP/1.1 Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NnNXwQjzTe5ucEgWVr6FK5R_x-1PXSjORQwgK-HLJwg4ud0xCiQ2RxkmamNcISiMo4ifaafVN2MJnljlZbb38Rp3hdz9WWClfF8DfJRGHtUcgwK-nhNzEPhYJpv5Hbll_ZHACbAYvLF-wQIz_sIq23lqNZYgHg_IZwEzGzmdwo5X1U Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: efe942df311d4907b01d32a8bdd17e05 Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/efe942df311d4907b01d32a8bdd17e05"}]}] Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: efe942df311d4907b01d32a8bdd17e05 Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestNetworkAdvancedServerOps-1822902672-project Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 601715059796424bae5c160b4a5eb382 Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1822902672-project Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance c0671683-31e2-468c-8960-f145ecfabd6d could not be found. Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': 'c0671683-31e2-468c-8960-f145ecfabd6d'} Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0671683-31e2-468c-8960-f145ecfabd6d could not be found. Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0671683-31e2-468c-8960-f145ecfabd6d could not be found. Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:06:49.627781 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:06:49.632968 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:06:49.632968 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:06:49.632968 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:06:49.632968 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:06:49.632968 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:06:49.632968 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:06:49.632968 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0671683-31e2-468c-8960-f145ecfabd6d could not be found. Aug 02 08:06:49.632968 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:06:49.632968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3d4313e4-9a69-4bcd-accd-0c38f40220f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Returning 404 to user: Instance c0671683-31e2-468c-8960-f145ecfabd6d could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:06:49.632968 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3d4313e4-9a69-4bcd-accd-0c38f40220f8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d" status: 404 len: 111 microversion: 2.1 time: 0.032191 Aug 02 08:06:49.632968 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3663/7404] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:06:49 2022] GET /compute/v2.1/servers/c0671683-31e2-468c-8960-f145ecfabd6d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:06:53.124361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-28608944-1933-41b9-8e3c-02b76a2d808f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '.version_select at 0x7f927ab1f1f0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:06:53.149177 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-28608944-1933-41b9-8e3c-02b76a2d808f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-199349177" status: 202 len: 0 microversion: 2.1 time: 0.028761 Aug 02 08:06:53.153567 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3742/7405] 10.222.0.79 () {58 vars in 1281 bytes} [Tue Aug 2 08:06:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-199349177 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 08:06:53.172963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-573859e9-d21b-4635-8457-7b29dca2357e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'create', calling method: .version_select at 0x7f927a9b35e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1237711159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ6Ee3FH8QLHHeXT3RCTQrs35Zseyg1jDmzlgJiSreEzb0CKeufcAGB28zhaSnLvvTFrymPlSiYvdrrUUVj+BCVUWSI8+9FgNzjZq4ZRgW07Nt+Gh0T3YvooKxGHDpZrg=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:06:53.189576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-573859e9-d21b-4635-8457-7b29dca2357e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for project efe942df311d4907b01d32a8bdd17e05. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:06:53.198172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-573859e9-d21b-4635-8457-7b29dca2357e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for user 601715059796424bae5c160b4a5eb382 and project efe942df311d4907b01d32a8bdd17e05. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:06:53.222580 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-573859e9-d21b-4635-8457-7b29dca2357e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053728 Aug 02 08:06:53.223196 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3664/7406] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 08:06:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:06:58.797886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:06:58.803786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-990714129", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "00bd4285-ae05-478c-906c-30f5e8e3234b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1237711159", "security_groups": [{"name": "tempest-secgroup-smoke-569490636"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:06:58.923994 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] validate_networks() for [('00bd4285-ae05-478c-906c-30f5e8e3234b', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:06:59.376982 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:06:59.377410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:06:59.377937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:06:59.378339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:06:59.378760 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:06:59.390074 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:59.390527 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:59.391333 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:06:59.391798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:06:59.410238 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for project efe942df311d4907b01d32a8bdd17e05. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:06:59.415829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for user 601715059796424bae5c160b4a5eb382 and project efe942df311d4907b01d32a8bdd17e05. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:06:59.431611 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:06:59.434174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:06:59.485284 n-d-851337-3 devstack@n-api.service[126120]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [eac8f7f7-deba-4782-bc7e-84d0a49eeca7] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 08:07:00.494261 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [eac8f7f7-deba-4782-bc7e-84d0a49eeca7] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 39836. Aug 02 08:07:00.498564 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7e925368-39ac-40ed-bdfe-06cad3f229ce tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.702662 Aug 02 08:07:00.499231 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3743/7407] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 08:06:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:07:00.508708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=12 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:07:00.513603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7417a579-aced-43d2-b72a-e91c82f14cf9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:00.514292 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7417a579-aced-43d2-b72a-e91c82f14cf9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:00.581246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7417a579-aced-43d2-b72a-e91c82f14cf9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:00.590861 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7417a579-aced-43d2-b72a-e91c82f14cf9 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1266 microversion: 2.1 time: 0.083865 Aug 02 08:07:00.591446 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3665/7408] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:00 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:01.612815 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-51385fb0-0e46-40de-9d6d-4615e9f10d47 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:01.613434 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-51385fb0-0e46-40de-9d6d-4615e9f10d47 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:01.627901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51385fb0-0e46-40de-9d6d-4615e9f10d47 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:01.630965 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51385fb0-0e46-40de-9d6d-4615e9f10d47 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:01.631872 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51385fb0-0e46-40de-9d6d-4615e9f10d47 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:01.632320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-51385fb0-0e46-40de-9d6d-4615e9f10d47 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:01.753282 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-51385fb0-0e46-40de-9d6d-4615e9f10d47 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:01.767934 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-51385fb0-0e46-40de-9d6d-4615e9f10d47 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1336 microversion: 2.1 time: 0.159874 Aug 02 08:07:01.769583 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3744/7409] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:01 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1336 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:02.790710 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ca8123bd-246a-4014-9a37-75d89846025b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:02.791334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ca8123bd-246a-4014-9a37-75d89846025b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:02.805233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca8123bd-246a-4014-9a37-75d89846025b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:02.805718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca8123bd-246a-4014-9a37-75d89846025b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:02.806532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca8123bd-246a-4014-9a37-75d89846025b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:02.806982 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca8123bd-246a-4014-9a37-75d89846025b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:02.960850 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ca8123bd-246a-4014-9a37-75d89846025b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:02.968836 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ca8123bd-246a-4014-9a37-75d89846025b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1391 microversion: 2.1 time: 0.182282 Aug 02 08:07:02.969804 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3666/7410] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:02 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:03.055912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-7961113f-dc7f-4cfb-9b4c-a7cd344106c6 req-f3129278-7ba7-4486-b6c4-8f7fbfb95f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315a461f-ec55-44b4-a6a3-8e9d36d21179", "tag": "42a47ead-1e96-4aaa-a315-9d803f9feb69"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:07:03.073598 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7961113f-dc7f-4cfb-9b4c-a7cd344106c6 req-f3129278-7ba7-4486-b6c4-8f7fbfb95f8a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:03.074308 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-7961113f-dc7f-4cfb-9b4c-a7cd344106c6 req-f3129278-7ba7-4486-b6c4-8f7fbfb95f8a service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:03.087390 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-7961113f-dc7f-4cfb-9b4c-a7cd344106c6 req-f3129278-7ba7-4486-b6c4-8f7fbfb95f8a service nova] Creating event network-changed:42a47ead-1e96-4aaa-a315-9d803f9feb69 for instance 315a461f-ec55-44b4-a6a3-8e9d36d21179 on n-h2-851337-3 Aug 02 08:07:03.092623 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-7961113f-dc7f-4cfb-9b4c-a7cd344106c6 req-f3129278-7ba7-4486-b6c4-8f7fbfb95f8a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040921 Aug 02 08:07:03.093723 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3745/7411] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:07:03.991997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5c7beecf-35eb-4fd2-84cf-57113e65feec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:03.992651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5c7beecf-35eb-4fd2-84cf-57113e65feec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:04.000993 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c7beecf-35eb-4fd2-84cf-57113e65feec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:04.001484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c7beecf-35eb-4fd2-84cf-57113e65feec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:04.002377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c7beecf-35eb-4fd2-84cf-57113e65feec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:04.002796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5c7beecf-35eb-4fd2-84cf-57113e65feec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:04.144209 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5c7beecf-35eb-4fd2-84cf-57113e65feec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:04.152510 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5c7beecf-35eb-4fd2-84cf-57113e65feec tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1391 microversion: 2.1 time: 0.165118 Aug 02 08:07:04.153085 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3667/7412] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:03 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:05.173730 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-abb4ef36-4afe-406d-a30a-dd498386de9c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:05.174440 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-abb4ef36-4afe-406d-a30a-dd498386de9c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:05.182477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abb4ef36-4afe-406d-a30a-dd498386de9c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:05.182912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abb4ef36-4afe-406d-a30a-dd498386de9c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:05.183719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abb4ef36-4afe-406d-a30a-dd498386de9c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:05.184159 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-abb4ef36-4afe-406d-a30a-dd498386de9c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:05.329217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-abb4ef36-4afe-406d-a30a-dd498386de9c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:05.337869 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-abb4ef36-4afe-406d-a30a-dd498386de9c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1391 microversion: 2.1 time: 0.168475 Aug 02 08:07:05.338846 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3746/7413] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:05 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:06.360210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c0e97608-3e19-4e00-ac81-7a6406ca358e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:06.360874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c0e97608-3e19-4e00-ac81-7a6406ca358e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:06.369725 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0e97608-3e19-4e00-ac81-7a6406ca358e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:06.370207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0e97608-3e19-4e00-ac81-7a6406ca358e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:06.370988 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0e97608-3e19-4e00-ac81-7a6406ca358e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:06.371539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0e97608-3e19-4e00-ac81-7a6406ca358e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:06.522267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c0e97608-3e19-4e00-ac81-7a6406ca358e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:06.530380 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c0e97608-3e19-4e00-ac81-7a6406ca358e tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1391 microversion: 2.1 time: 0.174930 Aug 02 08:07:06.530975 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3668/7414] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:06 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:06.949788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-537517de-5957-4e08-8f27-966f84c57df1 req-84c946d8-3e7e-4cac-8350-1451204dcc4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315a461f-ec55-44b4-a6a3-8e9d36d21179", "name": "network-vif-plugged", "status": "completed", "tag": "42a47ead-1e96-4aaa-a315-9d803f9feb69"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:07:06.962138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-537517de-5957-4e08-8f27-966f84c57df1 req-84c946d8-3e7e-4cac-8350-1451204dcc4d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:06.962778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-537517de-5957-4e08-8f27-966f84c57df1 req-84c946d8-3e7e-4cac-8350-1451204dcc4d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:06.975099 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-537517de-5957-4e08-8f27-966f84c57df1 req-84c946d8-3e7e-4cac-8350-1451204dcc4d service nova] Creating event network-vif-plugged:42a47ead-1e96-4aaa-a315-9d803f9feb69 for instance 315a461f-ec55-44b4-a6a3-8e9d36d21179 on n-h2-851337-3 Aug 02 08:07:06.980392 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-537517de-5957-4e08-8f27-966f84c57df1 req-84c946d8-3e7e-4cac-8350-1451204dcc4d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034424 Aug 02 08:07:06.981020 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3747/7415] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:07:07.552896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-24c2034f-17f9-49e5-a9fa-c5403edf22da tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:07.553505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-24c2034f-17f9-49e5-a9fa-c5403edf22da tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:07.561189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24c2034f-17f9-49e5-a9fa-c5403edf22da tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:07.561655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24c2034f-17f9-49e5-a9fa-c5403edf22da tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:07.562474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24c2034f-17f9-49e5-a9fa-c5403edf22da tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:07.562926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-24c2034f-17f9-49e5-a9fa-c5403edf22da tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:07.701714 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-24c2034f-17f9-49e5-a9fa-c5403edf22da tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:07.711808 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-24c2034f-17f9-49e5-a9fa-c5403edf22da tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1391 microversion: 2.1 time: 0.162756 Aug 02 08:07:07.712674 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3669/7416] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:07 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:08.738478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-645e8691-b6ee-4540-a86f-cc974d20583a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:08.739173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-645e8691-b6ee-4540-a86f-cc974d20583a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:08.747295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-645e8691-b6ee-4540-a86f-cc974d20583a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:08.747758 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-645e8691-b6ee-4540-a86f-cc974d20583a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:08.748737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-645e8691-b6ee-4540-a86f-cc974d20583a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:08.749061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-645e8691-b6ee-4540-a86f-cc974d20583a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:08.902874 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-645e8691-b6ee-4540-a86f-cc974d20583a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:08.911001 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-645e8691-b6ee-4540-a86f-cc974d20583a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1563 microversion: 2.1 time: 0.176912 Aug 02 08:07:08.911657 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3748/7417] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:08 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:08.932193 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-940e9f6a-f14a-4846-a5ae-231faf88db3a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:08.933078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-940e9f6a-f14a-4846-a5ae-231faf88db3a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:08.940357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-940e9f6a-f14a-4846-a5ae-231faf88db3a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:08.940824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-940e9f6a-f14a-4846-a5ae-231faf88db3a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:08.941612 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-940e9f6a-f14a-4846-a5ae-231faf88db3a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:08.942104 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-940e9f6a-f14a-4846-a5ae-231faf88db3a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:09.084884 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-940e9f6a-f14a-4846-a5ae-231faf88db3a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:09.093280 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-940e9f6a-f14a-4846-a5ae-231faf88db3a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1563 microversion: 2.1 time: 0.165027 Aug 02 08:07:09.093839 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3670/7418] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:08 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:11.080143 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3541bff7-5d50-47b7-aec6-034a0991c4f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:11.080874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:07:11.081442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3541bff7-5d50-47b7-aec6-034a0991c4f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:11.083295 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:07:11.084010 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:07:11.084533 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-2098f6b1-2dc5-4311-be3d-0635e344226c req-5c75218a-6b3a-495f-aedf-6a0a46de0e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315a461f-ec55-44b4-a6a3-8e9d36d21179", "tag": "42a47ead-1e96-4aaa-a315-9d803f9feb69"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:07:11.092788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3541bff7-5d50-47b7-aec6-034a0991c4f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:11.093278 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3541bff7-5d50-47b7-aec6-034a0991c4f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:11.094058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3541bff7-5d50-47b7-aec6-034a0991c4f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:11.094498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3541bff7-5d50-47b7-aec6-034a0991c4f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:11.095360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2098f6b1-2dc5-4311-be3d-0635e344226c req-5c75218a-6b3a-495f-aedf-6a0a46de0e2c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:11.095821 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2098f6b1-2dc5-4311-be3d-0635e344226c req-5c75218a-6b3a-495f-aedf-6a0a46de0e2c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:11.108154 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-2098f6b1-2dc5-4311-be3d-0635e344226c req-5c75218a-6b3a-495f-aedf-6a0a46de0e2c service nova] Creating event network-changed:42a47ead-1e96-4aaa-a315-9d803f9feb69 for instance 315a461f-ec55-44b4-a6a3-8e9d36d21179 on n-h2-851337-3 Aug 02 08:07:11.113386 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-2098f6b1-2dc5-4311-be3d-0635e344226c req-5c75218a-6b3a-495f-aedf-6a0a46de0e2c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034533 Aug 02 08:07:11.117262 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3671/7419] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:07:11.260761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3541bff7-5d50-47b7-aec6-034a0991c4f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:11.268931 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3541bff7-5d50-47b7-aec6-034a0991c4f1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1563 microversion: 2.1 time: 0.193152 Aug 02 08:07:11.284642 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3749/7420] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:11 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1563 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:32.586486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:07:32.587217 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=32 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:07:32.591872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-493b9ee4-970b-460d-84ab-d6ad2e09fa54 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:07:32.594164 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-493b9ee4-970b-460d-84ab-d6ad2e09fa54 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:32.602461 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-493b9ee4-970b-460d-84ab-d6ad2e09fa54 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:32.603932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-493b9ee4-970b-460d-84ab-d6ad2e09fa54 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:32.603932 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-493b9ee4-970b-460d-84ab-d6ad2e09fa54 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:32.604243 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-493b9ee4-970b-460d-84ab-d6ad2e09fa54 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:32.661952 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-493b9ee4-970b-460d-84ab-d6ad2e09fa54 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179/action" status: 200 len: 24572 microversion: 2.1 time: 0.077387 Aug 02 08:07:32.662999 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3672/7421] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:07:32 2022] POST /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179/action => generated 24572 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:07:43.726831 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-479fbf34-acbc-4d9d-9cd6-f567aa8b9665 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:07:43.729459 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:07:43.730232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=30 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:07:43.736671 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-479fbf34-acbc-4d9d-9cd6-f567aa8b9665 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:43.737058 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-479fbf34-acbc-4d9d-9cd6-f567aa8b9665 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:43.762327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-479fbf34-acbc-4d9d-9cd6-f567aa8b9665 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Going to try to stop instance {{(pid=126120) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 08:07:43.812571 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-479fbf34-acbc-4d9d-9cd6-f567aa8b9665 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179/action" status: 202 len: 0 microversion: 2.1 time: 0.089236 Aug 02 08:07:43.813592 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3750/7422] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:07:43 2022] POST /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:07:43.823114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a58fca79-ba8b-449d-9464-5636cd3ba194 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:43.823923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a58fca79-ba8b-449d-9464-5636cd3ba194 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:43.829971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:07:43.830679 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=4 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:07:43.837569 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a58fca79-ba8b-449d-9464-5636cd3ba194 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:43.838225 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a58fca79-ba8b-449d-9464-5636cd3ba194 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:43.839095 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a58fca79-ba8b-449d-9464-5636cd3ba194 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:43.839538 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a58fca79-ba8b-449d-9464-5636cd3ba194 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:43.990981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a58fca79-ba8b-449d-9464-5636cd3ba194 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:43.999599 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a58fca79-ba8b-449d-9464-5636cd3ba194 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1691 microversion: 2.1 time: 0.181303 Aug 02 08:07:44.000169 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3673/7423] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:43 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:45.026482 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c1a276c6-d083-4455-8b58-afd8f2478694 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:45.027488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c1a276c6-d083-4455-8b58-afd8f2478694 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:45.037825 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1a276c6-d083-4455-8b58-afd8f2478694 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:45.038620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1a276c6-d083-4455-8b58-afd8f2478694 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:45.039929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1a276c6-d083-4455-8b58-afd8f2478694 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:45.040571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c1a276c6-d083-4455-8b58-afd8f2478694 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:45.196181 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c1a276c6-d083-4455-8b58-afd8f2478694 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:45.208692 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c1a276c6-d083-4455-8b58-afd8f2478694 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1691 microversion: 2.1 time: 0.188483 Aug 02 08:07:45.209608 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3751/7424] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:45 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1691 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:46.230502 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:07:46.232904 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 08:07:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 (ip 10.222.0.79) !!! Aug 02 08:07:46.237824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-66efcab2-b0c0-46e2-9259-7c7fd4d45e13 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:46.244479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-66efcab2-b0c0-46e2-9259-7c7fd4d45e13 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:46.256750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66efcab2-b0c0-46e2-9259-7c7fd4d45e13 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:46.257210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66efcab2-b0c0-46e2-9259-7c7fd4d45e13 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:46.258020 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66efcab2-b0c0-46e2-9259-7c7fd4d45e13 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:46.258474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-66efcab2-b0c0-46e2-9259-7c7fd4d45e13 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:46.410158 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-66efcab2-b0c0-46e2-9259-7c7fd4d45e13 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:46.418210 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-66efcab2-b0c0-46e2-9259-7c7fd4d45e13 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1691 microversion: 2.1 time: 0.189199 Aug 02 08:07:46.418907 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3674/7425] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:46 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1691 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:47.442404 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-df5e46b8-6e1c-4a99-ab02-0974958570b8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:47.443182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-df5e46b8-6e1c-4a99-ab02-0974958570b8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:47.452948 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df5e46b8-6e1c-4a99-ab02-0974958570b8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:47.453548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df5e46b8-6e1c-4a99-ab02-0974958570b8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:47.455430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df5e46b8-6e1c-4a99-ab02-0974958570b8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:47.456008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-df5e46b8-6e1c-4a99-ab02-0974958570b8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:47.599980 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-df5e46b8-6e1c-4a99-ab02-0974958570b8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:47.613841 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-df5e46b8-6e1c-4a99-ab02-0974958570b8 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1691 microversion: 2.1 time: 0.176505 Aug 02 08:07:47.614757 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3752/7426] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:47 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:48.640544 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1d8d20ba-e68c-44e1-88ea-b32cf261c47c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:48.641268 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1d8d20ba-e68c-44e1-88ea-b32cf261c47c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:48.650326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d8d20ba-e68c-44e1-88ea-b32cf261c47c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:48.650883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d8d20ba-e68c-44e1-88ea-b32cf261c47c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:48.652141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d8d20ba-e68c-44e1-88ea-b32cf261c47c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:48.652678 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d8d20ba-e68c-44e1-88ea-b32cf261c47c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:48.789823 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1d8d20ba-e68c-44e1-88ea-b32cf261c47c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:48.797859 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1d8d20ba-e68c-44e1-88ea-b32cf261c47c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1691 microversion: 2.1 time: 0.162324 Aug 02 08:07:48.798485 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3675/7427] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:48 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:49.824113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-6546911c-7a88-4e6b-959f-76192e0e47db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:49.825023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-6546911c-7a88-4e6b-959f-76192e0e47db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:49.837503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6546911c-7a88-4e6b-959f-76192e0e47db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:49.838438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6546911c-7a88-4e6b-959f-76192e0e47db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:49.839346 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6546911c-7a88-4e6b-959f-76192e0e47db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:49.839761 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-6546911c-7a88-4e6b-959f-76192e0e47db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:49.985296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-6546911c-7a88-4e6b-959f-76192e0e47db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:49.993935 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-6546911c-7a88-4e6b-959f-76192e0e47db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1691 microversion: 2.1 time: 0.176578 Aug 02 08:07:49.994570 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3753/7428] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:49 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:51.018507 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1807f883-04c3-4033-b0d9-d3177c2efee3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:51.019284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1807f883-04c3-4033-b0d9-d3177c2efee3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:51.029281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1807f883-04c3-4033-b0d9-d3177c2efee3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:51.029925 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1807f883-04c3-4033-b0d9-d3177c2efee3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:51.030963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1807f883-04c3-4033-b0d9-d3177c2efee3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:51.031567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1807f883-04c3-4033-b0d9-d3177c2efee3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:51.175122 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1807f883-04c3-4033-b0d9-d3177c2efee3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:51.183229 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1807f883-04c3-4033-b0d9-d3177c2efee3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1691 microversion: 2.1 time: 0.170228 Aug 02 08:07:51.183830 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3676/7429] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:51 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:52.205224 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7b7e77cf-bddf-44d0-a515-dc69eadddb10 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:52.205962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7b7e77cf-bddf-44d0-a515-dc69eadddb10 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:52.212781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b7e77cf-bddf-44d0-a515-dc69eadddb10 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:52.213237 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b7e77cf-bddf-44d0-a515-dc69eadddb10 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:52.214203 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b7e77cf-bddf-44d0-a515-dc69eadddb10 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:52.214749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7b7e77cf-bddf-44d0-a515-dc69eadddb10 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:52.365344 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7b7e77cf-bddf-44d0-a515-dc69eadddb10 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:52.376811 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7b7e77cf-bddf-44d0-a515-dc69eadddb10 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1691 microversion: 2.1 time: 0.175283 Aug 02 08:07:52.377731 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3754/7430] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:52 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:53.402400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-101d5175-97be-4942-b636-8728503cdf06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:53.403015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-101d5175-97be-4942-b636-8728503cdf06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:53.410094 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-101d5175-97be-4942-b636-8728503cdf06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:53.410559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-101d5175-97be-4942-b636-8728503cdf06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:53.411369 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-101d5175-97be-4942-b636-8728503cdf06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:53.411809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-101d5175-97be-4942-b636-8728503cdf06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:53.549241 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-101d5175-97be-4942-b636-8728503cdf06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:53.557259 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-101d5175-97be-4942-b636-8728503cdf06 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1691 microversion: 2.1 time: 0.160052 Aug 02 08:07:53.558064 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3677/7431] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:53 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:54.579126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fd95034a-aca7-470c-827d-4929b0931939 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:54.579781 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fd95034a-aca7-470c-827d-4929b0931939 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:54.587340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fd95034a-aca7-470c-827d-4929b0931939 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:54.587783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fd95034a-aca7-470c-827d-4929b0931939 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:54.588637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fd95034a-aca7-470c-827d-4929b0931939 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:54.589100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fd95034a-aca7-470c-827d-4929b0931939 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:54.722606 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fd95034a-aca7-470c-827d-4929b0931939 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:54.730658 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fd95034a-aca7-470c-827d-4929b0931939 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1668 microversion: 2.1 time: 0.155483 Aug 02 08:07:54.731224 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3755/7432] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:54 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:55.827484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d18e4e44-62ef-4599-b21e-e17e5ff0093d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:07:55.829662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d18e4e44-62ef-4599-b21e-e17e5ff0093d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:55.837174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d18e4e44-62ef-4599-b21e-e17e5ff0093d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:55.837627 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d18e4e44-62ef-4599-b21e-e17e5ff0093d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:55.838446 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d18e4e44-62ef-4599-b21e-e17e5ff0093d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:55.838889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d18e4e44-62ef-4599-b21e-e17e5ff0093d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:55.891620 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d18e4e44-62ef-4599-b21e-e17e5ff0093d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179/action" status: 200 len: 38372 microversion: 2.1 time: 0.068023 Aug 02 08:07:55.892269 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3678/7433] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:07:55 2022] POST /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179/action => generated 38372 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:07:55.904367 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b4a70b18-2e4d-4c1f-b886-51ff2561911f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:07:55.911783 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b4a70b18-2e4d-4c1f-b886-51ff2561911f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:55.912236 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b4a70b18-2e4d-4c1f-b886-51ff2561911f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:55.934788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b4a70b18-2e4d-4c1f-b886-51ff2561911f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Going to try to start instance {{(pid=126120) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 08:07:55.978707 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b4a70b18-2e4d-4c1f-b886-51ff2561911f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179/action" status: 202 len: 0 microversion: 2.1 time: 0.078195 Aug 02 08:07:55.979317 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3756/7434] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:07:55 2022] POST /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:07:55.988523 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c8dcda0d-8635-45ed-b349-df092caea23b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:55.989245 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c8dcda0d-8635-45ed-b349-df092caea23b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:55.996831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8dcda0d-8635-45ed-b349-df092caea23b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:55.997330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8dcda0d-8635-45ed-b349-df092caea23b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:55.998138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8dcda0d-8635-45ed-b349-df092caea23b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:55.998616 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c8dcda0d-8635-45ed-b349-df092caea23b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:56.140873 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c8dcda0d-8635-45ed-b349-df092caea23b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:56.149144 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c8dcda0d-8635-45ed-b349-df092caea23b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1677 microversion: 2.1 time: 0.164939 Aug 02 08:07:56.149738 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3679/7435] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:55 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:07:57.173192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-252fce42-dae4-4782-b228-25a328ecc974 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:07:57.173909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-252fce42-dae4-4782-b228-25a328ecc974 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:07:57.180858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-252fce42-dae4-4782-b228-25a328ecc974 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:57.181310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-252fce42-dae4-4782-b228-25a328ecc974 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:57.182167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-252fce42-dae4-4782-b228-25a328ecc974 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:07:57.182622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-252fce42-dae4-4782-b228-25a328ecc974 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:07:57.322205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-252fce42-dae4-4782-b228-25a328ecc974 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:07:57.330011 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-252fce42-dae4-4782-b228-25a328ecc974 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1681 microversion: 2.1 time: 0.162119 Aug 02 08:07:57.330598 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3757/7436] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:07:57 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:23.545288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-52a05beb-941c-408b-8bed-584892ea0a28 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:08:23.548797 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-52a05beb-941c-408b-8bed-584892ea0a28 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:23.553484 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=14 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:08:23.554479 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=40 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:08:23.570722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-52a05beb-941c-408b-8bed-584892ea0a28 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:23.571191 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-52a05beb-941c-408b-8bed-584892ea0a28 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:23.571987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-52a05beb-941c-408b-8bed-584892ea0a28 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:23.572435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-52a05beb-941c-408b-8bed-584892ea0a28 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:23.628159 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-52a05beb-941c-408b-8bed-584892ea0a28 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179/action" status: 200 len: 62939 microversion: 2.1 time: 0.086962 Aug 02 08:08:23.628840 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3680/7437] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:08:23 2022] POST /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179/action => generated 62939 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:08:31.086231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f5a4565a-6ac5-480b-aa11-a382530b76d3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:31.087155 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f5a4565a-6ac5-480b-aa11-a382530b76d3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:31.088923 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-386ac67e-7136-4ce8-b790-753bab98f8a1 req-0b32f497-13f4-4593-9a4f-655747c58082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315a461f-ec55-44b4-a6a3-8e9d36d21179", "tag": "42a47ead-1e96-4aaa-a315-9d803f9feb69"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:08:31.089633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=16 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:08:31.090287 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:08:31.097633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5a4565a-6ac5-480b-aa11-a382530b76d3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:31.098450 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5a4565a-6ac5-480b-aa11-a382530b76d3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:31.099245 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5a4565a-6ac5-480b-aa11-a382530b76d3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:31.099838 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f5a4565a-6ac5-480b-aa11-a382530b76d3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:31.103112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-386ac67e-7136-4ce8-b790-753bab98f8a1 req-0b32f497-13f4-4593-9a4f-655747c58082 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:31.104301 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-386ac67e-7136-4ce8-b790-753bab98f8a1 req-0b32f497-13f4-4593-9a4f-655747c58082 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:31.116480 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-386ac67e-7136-4ce8-b790-753bab98f8a1 req-0b32f497-13f4-4593-9a4f-655747c58082 service nova] Creating event network-changed:42a47ead-1e96-4aaa-a315-9d803f9feb69 for instance 315a461f-ec55-44b4-a6a3-8e9d36d21179 on n-h2-851337-3 Aug 02 08:08:31.122398 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-386ac67e-7136-4ce8-b790-753bab98f8a1 req-0b32f497-13f4-4593-9a4f-655747c58082 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037652 Aug 02 08:08:31.123134 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3681/7438] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:08:31.131991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f5a4565a-6ac5-480b-aa11-a382530b76d3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 08:08:31.252692 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f5a4565a-6ac5-480b-aa11-a382530b76d3 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "DELETE /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 204 len: 0 microversion: 2.1 time: 0.169494 Aug 02 08:08:31.256890 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3758/7439] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 08:08:31 2022] DELETE /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:08:31.267519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6022492f-41ef-4556-8797-90e5fe45bc62 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:31.268125 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6022492f-41ef-4556-8797-90e5fe45bc62 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:31.275259 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6022492f-41ef-4556-8797-90e5fe45bc62 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:31.275598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6022492f-41ef-4556-8797-90e5fe45bc62 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:31.276378 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6022492f-41ef-4556-8797-90e5fe45bc62 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:31.276833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6022492f-41ef-4556-8797-90e5fe45bc62 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:31.435160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6022492f-41ef-4556-8797-90e5fe45bc62 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:31.444084 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6022492f-41ef-4556-8797-90e5fe45bc62 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1687 microversion: 2.1 time: 0.181478 Aug 02 08:08:31.444825 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3682/7440] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:31 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:32.470972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-28b7659e-01b5-4114-9168-9e34da7fddd2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:32.471744 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-28b7659e-01b5-4114-9168-9e34da7fddd2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:32.480685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28b7659e-01b5-4114-9168-9e34da7fddd2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:32.481192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28b7659e-01b5-4114-9168-9e34da7fddd2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:32.482196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28b7659e-01b5-4114-9168-9e34da7fddd2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:32.482654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28b7659e-01b5-4114-9168-9e34da7fddd2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:32.648141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-28b7659e-01b5-4114-9168-9e34da7fddd2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:32.657034 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-28b7659e-01b5-4114-9168-9e34da7fddd2 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1687 microversion: 2.1 time: 0.191009 Aug 02 08:08:32.657618 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3759/7441] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:32 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1687 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:33.333343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-2a1a34e3-6708-435f-bb56-967fc86f34b4 req-8782e10e-710d-4cc9-b75f-1ce7aaf144fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315a461f-ec55-44b4-a6a3-8e9d36d21179", "name": "network-vif-deleted", "tag": "42a47ead-1e96-4aaa-a315-9d803f9feb69"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:08:33.344652 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2a1a34e3-6708-435f-bb56-967fc86f34b4 req-8782e10e-710d-4cc9-b75f-1ce7aaf144fe service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:33.345252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-2a1a34e3-6708-435f-bb56-967fc86f34b4 req-8782e10e-710d-4cc9-b75f-1ce7aaf144fe service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:33.359273 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-2a1a34e3-6708-435f-bb56-967fc86f34b4 req-8782e10e-710d-4cc9-b75f-1ce7aaf144fe service nova] Creating event network-vif-deleted:42a47ead-1e96-4aaa-a315-9d803f9feb69 for instance 315a461f-ec55-44b4-a6a3-8e9d36d21179 on n-h2-851337-3 Aug 02 08:08:33.365281 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-2a1a34e3-6708-435f-bb56-967fc86f34b4 req-8782e10e-710d-4cc9-b75f-1ce7aaf144fe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035575 Aug 02 08:08:33.365937 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3683/7442] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:08:33.682918 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d4c17469-fb5d-45cd-a8de-0d29996963db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:33.683508 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d4c17469-fb5d-45cd-a8de-0d29996963db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:33.691138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d4c17469-fb5d-45cd-a8de-0d29996963db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:33.691584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d4c17469-fb5d-45cd-a8de-0d29996963db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:33.692368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d4c17469-fb5d-45cd-a8de-0d29996963db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:33.692801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d4c17469-fb5d-45cd-a8de-0d29996963db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:33.731305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d4c17469-fb5d-45cd-a8de-0d29996963db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:33.732175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d4c17469-fb5d-45cd-a8de-0d29996963db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:33.732661 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-d4c17469-fb5d-45cd-a8de-0d29996963db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lazy-loading 'fault' on Instance uuid 315a461f-ec55-44b4-a6a3-8e9d36d21179 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:08:33.788154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d4c17469-fb5d-45cd-a8de-0d29996963db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:33.797619 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d4c17469-fb5d-45cd-a8de-0d29996963db tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 200 len: 1356 microversion: 2.1 time: 0.118637 Aug 02 08:08:33.798440 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3760/7443] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:33 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 1356 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:34.821530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-428680bb-9782-4e27-a5df-6048b4eb5e78 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:34.822271 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-428680bb-9782-4e27-a5df-6048b4eb5e78 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 315a461f-ec55-44b4-a6a3-8e9d36d21179] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:34.829267 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-428680bb-9782-4e27-a5df-6048b4eb5e78 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:34.829730 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-428680bb-9782-4e27-a5df-6048b4eb5e78 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:34.830618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-428680bb-9782-4e27-a5df-6048b4eb5e78 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:34.831072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-428680bb-9782-4e27-a5df-6048b4eb5e78 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:34.846145 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-428680bb-9782-4e27-a5df-6048b4eb5e78 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] HTTP exception thrown: Instance 315a461f-ec55-44b4-a6a3-8e9d36d21179 could not be found. Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-428680bb-9782-4e27-a5df-6048b4eb5e78 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Request method failure captured: Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 HTTP/1.1 Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6NnNXwQjzTe5ucEgWVr6FK5R_x-1PXSjORQwgK-HLJwg4ud0xCiQ2RxkmamNcISiMo4ifaafVN2MJnljlZbb38Rp3hdz9WWClfF8DfJRGHtUcgwK-nhNzEPhYJpv5Hbll_ZHACbAYvLF-wQIz_sIq23lqNZYgHg_IZwEzGzmdwo5X1U Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: efe942df311d4907b01d32a8bdd17e05 Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/efe942df311d4907b01d32a8bdd17e05"}]}] Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: efe942df311d4907b01d32a8bdd17e05 Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestNetworkAdvancedServerOps-1822902672-project Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 601715059796424bae5c160b4a5eb382 Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1822902672-project Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 315a461f-ec55-44b4-a6a3-8e9d36d21179 could not be found. Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '315a461f-ec55-44b4-a6a3-8e9d36d21179'} Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 315a461f-ec55-44b4-a6a3-8e9d36d21179 could not be found. Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 315a461f-ec55-44b4-a6a3-8e9d36d21179 could not be found. Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:08:34.847841 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:08:34.852443 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:08:34.852443 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:08:34.852443 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:08:34.852443 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:08:34.852443 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:08:34.852443 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:08:34.852443 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 315a461f-ec55-44b4-a6a3-8e9d36d21179 could not be found. Aug 02 08:08:34.852443 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:08:34.852443 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-428680bb-9782-4e27-a5df-6048b4eb5e78 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Returning 404 to user: Instance 315a461f-ec55-44b4-a6a3-8e9d36d21179 could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:08:34.852443 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-428680bb-9782-4e27-a5df-6048b4eb5e78 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179" status: 404 len: 111 microversion: 2.1 time: 0.033296 Aug 02 08:08:34.854464 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3684/7444] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:34 2022] GET /compute/v2.1/servers/315a461f-ec55-44b4-a6a3-8e9d36d21179 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:08:37.974561 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f6060dc4-0f0e-4913-865e-f91f6ac9b632 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '.version_select at 0x7f927a9ce3a0>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:37.996861 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f6060dc4-0f0e-4913-865e-f91f6ac9b632 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1237711159" status: 202 len: 0 microversion: 2.1 time: 0.025788 Aug 02 08:08:37.997924 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3761/7445] 10.222.0.79 () {58 vars in 1284 bytes} [Tue Aug 2 08:08:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1237711159 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:08:38.025457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2dd03384-3806-4c2a-ae36-f42b16f3681b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'create', calling method: .version_select at 0x7f9279e0ae50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-604815631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJxW+vtIkO1LCpm2jSkYhA4l7GZ10AZSMqtfnEgGjqOmbjSgfPPgqVkxzJKcG+gT5uUU70eB5qXEdisF0Zyzsn022r0XuWHX3hEztk+zlTSNgsU7mpfLDd0/iuRp2NaVw=="}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:08:38.042708 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2dd03384-3806-4c2a-ae36-f42b16f3681b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for project efe942df311d4907b01d32a8bdd17e05. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:08:38.048067 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-2dd03384-3806-4c2a-ae36-f42b16f3681b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for user 601715059796424bae5c160b4a5eb382 and project efe942df311d4907b01d32a8bdd17e05. Resources: {'key_pairs'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:08:38.077062 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2dd03384-3806-4c2a-ae36-f42b16f3681b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055506 Aug 02 08:08:38.077882 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3685/7446] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 08:08:38 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:08:43.776597 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1387896708", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "networks": [{"uuid": "a31fe468-2058-422c-b807-26f1614aab5f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-604815631", "security_groups": [{"name": "tempest-secgroup-smoke-1048647438"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:08:43.798061 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:08:43.933187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] validate_networks() for [('a31fe468-2058-422c-b807-26f1614aab5f', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:08:44.382568 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:08:44.383211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:08:44.384054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:08:44.384770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:08:44.385735 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:08:44.400401 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:44.400840 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:44.401631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:44.402104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:44.421933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for project efe942df311d4907b01d32a8bdd17e05. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:08:44.427819 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Getting quotas for user 601715059796424bae5c160b4a5eb382 and project efe942df311d4907b01d32a8bdd17e05. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:08:44.442481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:08:44.445199 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:08:44.500085 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3e180bea-5b84-4f75-bdfc-caacd7f94634 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.727443 Aug 02 08:08:44.501049 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3762/7447] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 08:08:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:08:44.513987 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-dc7549a4-c5e5-443c-a6ef-4ba488101e86 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:44.515028 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-dc7549a4-c5e5-443c-a6ef-4ba488101e86 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:44.582775 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-dc7549a4-c5e5-443c-a6ef-4ba488101e86 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:44.597121 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-dc7549a4-c5e5-443c-a6ef-4ba488101e86 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1266 microversion: 2.1 time: 0.088103 Aug 02 08:08:44.598316 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3686/7448] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:44 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:45.620341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-88ecc966-538e-4d87-8980-f074d529fe3c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:45.620962 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-88ecc966-538e-4d87-8980-f074d529fe3c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:45.638830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88ecc966-538e-4d87-8980-f074d529fe3c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:45.639296 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88ecc966-538e-4d87-8980-f074d529fe3c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:45.640206 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88ecc966-538e-4d87-8980-f074d529fe3c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:45.640570 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-88ecc966-538e-4d87-8980-f074d529fe3c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:45.757031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-88ecc966-538e-4d87-8980-f074d529fe3c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:45.767467 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-88ecc966-538e-4d87-8980-f074d529fe3c tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1326 microversion: 2.1 time: 0.153255 Aug 02 08:08:45.769331 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3763/7449] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:45 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:46.789439 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1515d4ae-6b51-4d43-ac65-84901b12c005 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:46.790215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1515d4ae-6b51-4d43-ac65-84901b12c005 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:46.792449 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=16 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:08:46.799796 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1515d4ae-6b51-4d43-ac65-84901b12c005 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:46.800342 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1515d4ae-6b51-4d43-ac65-84901b12c005 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:46.801317 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1515d4ae-6b51-4d43-ac65-84901b12c005 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:46.801810 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1515d4ae-6b51-4d43-ac65-84901b12c005 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:46.945435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1515d4ae-6b51-4d43-ac65-84901b12c005 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:46.957943 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1515d4ae-6b51-4d43-ac65-84901b12c005 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1392 microversion: 2.1 time: 0.172682 Aug 02 08:08:46.958561 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3687/7450] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:46 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:47.454623 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-520aec17-3a6c-468c-8e11-60ee28f855c2 req-fa3da96c-95b0-47fe-a115-9fbee7b81adf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e334cc-1fea-46ef-9d54-8aa6d0d01ab5", "tag": "9d518e08-67a1-4818-85d8-21614454501c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:08:47.468038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-520aec17-3a6c-468c-8e11-60ee28f855c2 req-fa3da96c-95b0-47fe-a115-9fbee7b81adf service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:47.468487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-520aec17-3a6c-468c-8e11-60ee28f855c2 req-fa3da96c-95b0-47fe-a115-9fbee7b81adf service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:47.481272 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-520aec17-3a6c-468c-8e11-60ee28f855c2 req-fa3da96c-95b0-47fe-a115-9fbee7b81adf service nova] Creating event network-changed:9d518e08-67a1-4818-85d8-21614454501c for instance 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 on n-h1-851337-3 Aug 02 08:08:47.486903 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-520aec17-3a6c-468c-8e11-60ee28f855c2 req-fa3da96c-95b0-47fe-a115-9fbee7b81adf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037127 Aug 02 08:08:47.487510 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3764/7451] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:08:47.979174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-38467f44-32ea-45ba-8196-6254191bdfc4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:47.979811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-38467f44-32ea-45ba-8196-6254191bdfc4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:47.987236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38467f44-32ea-45ba-8196-6254191bdfc4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:47.987695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38467f44-32ea-45ba-8196-6254191bdfc4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:47.988487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38467f44-32ea-45ba-8196-6254191bdfc4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:47.988942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-38467f44-32ea-45ba-8196-6254191bdfc4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:48.129199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-38467f44-32ea-45ba-8196-6254191bdfc4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:48.140329 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-38467f44-32ea-45ba-8196-6254191bdfc4 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1392 microversion: 2.1 time: 0.165186 Aug 02 08:08:48.140952 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3688/7452] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:47 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:49.166867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-32ce5802-1d0a-4d92-913a-3525af491894 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:49.168025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-32ce5802-1d0a-4d92-913a-3525af491894 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:49.177113 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32ce5802-1d0a-4d92-913a-3525af491894 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:49.177560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32ce5802-1d0a-4d92-913a-3525af491894 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:49.178368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32ce5802-1d0a-4d92-913a-3525af491894 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:49.179105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-32ce5802-1d0a-4d92-913a-3525af491894 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:49.322925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-32ce5802-1d0a-4d92-913a-3525af491894 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:49.330961 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-32ce5802-1d0a-4d92-913a-3525af491894 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1392 microversion: 2.1 time: 0.171294 Aug 02 08:08:49.331575 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3765/7453] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:49 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:50.352242 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-90179fb9-34fd-441f-998f-288000c0e488 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:50.355894 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-90179fb9-34fd-441f-998f-288000c0e488 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:50.361105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90179fb9-34fd-441f-998f-288000c0e488 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:50.361563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90179fb9-34fd-441f-998f-288000c0e488 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:50.362488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90179fb9-34fd-441f-998f-288000c0e488 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:50.363180 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-90179fb9-34fd-441f-998f-288000c0e488 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:50.507846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-90179fb9-34fd-441f-998f-288000c0e488 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:50.516450 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-90179fb9-34fd-441f-998f-288000c0e488 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1392 microversion: 2.1 time: 0.168261 Aug 02 08:08:50.517287 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3689/7454] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:50 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:51.538157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-171526b9-17d4-464b-86fd-ea2bdc77e61d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:51.538803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-171526b9-17d4-464b-86fd-ea2bdc77e61d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:51.545341 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-171526b9-17d4-464b-86fd-ea2bdc77e61d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:51.545802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-171526b9-17d4-464b-86fd-ea2bdc77e61d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:51.546599 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-171526b9-17d4-464b-86fd-ea2bdc77e61d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:51.547045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-171526b9-17d4-464b-86fd-ea2bdc77e61d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:51.698953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-171526b9-17d4-464b-86fd-ea2bdc77e61d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:51.708790 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-171526b9-17d4-464b-86fd-ea2bdc77e61d tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1392 microversion: 2.1 time: 0.174884 Aug 02 08:08:51.709380 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3766/7455] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:51 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:52.730199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-39afdd02-fb97-4b55-b913-08436580dabf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:52.730983 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-39afdd02-fb97-4b55-b913-08436580dabf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:52.740869 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39afdd02-fb97-4b55-b913-08436580dabf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:52.741457 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39afdd02-fb97-4b55-b913-08436580dabf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:52.742400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39afdd02-fb97-4b55-b913-08436580dabf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:52.742846 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-39afdd02-fb97-4b55-b913-08436580dabf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:52.886420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-39afdd02-fb97-4b55-b913-08436580dabf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:52.895824 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-39afdd02-fb97-4b55-b913-08436580dabf tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1392 microversion: 2.1 time: 0.170044 Aug 02 08:08:52.896412 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3690/7456] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:52 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:53.918441 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-150c9e9f-491a-43dd-ae80-e0c8f04ec978 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:53.919056 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-150c9e9f-491a-43dd-ae80-e0c8f04ec978 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:53.926926 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-150c9e9f-491a-43dd-ae80-e0c8f04ec978 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:53.927394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-150c9e9f-491a-43dd-ae80-e0c8f04ec978 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:53.928183 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-150c9e9f-491a-43dd-ae80-e0c8f04ec978 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:53.928622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-150c9e9f-491a-43dd-ae80-e0c8f04ec978 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:54.066662 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-150c9e9f-491a-43dd-ae80-e0c8f04ec978 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:54.074578 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-150c9e9f-491a-43dd-ae80-e0c8f04ec978 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1392 microversion: 2.1 time: 0.160428 Aug 02 08:08:54.075132 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3767/7457] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:53 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:54.618249 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-0372cfd4-a98f-48b9-a5c8-7fbab01dc30e req-45313408-5806-4d79-89a8-f16d9063290f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e334cc-1fea-46ef-9d54-8aa6d0d01ab5", "name": "network-vif-plugged", "status": "completed", "tag": "9d518e08-67a1-4818-85d8-21614454501c"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:08:54.624338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:08:54.625075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:08:54.632430 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0372cfd4-a98f-48b9-a5c8-7fbab01dc30e req-45313408-5806-4d79-89a8-f16d9063290f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:54.632887 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0372cfd4-a98f-48b9-a5c8-7fbab01dc30e req-45313408-5806-4d79-89a8-f16d9063290f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:54.646061 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-0372cfd4-a98f-48b9-a5c8-7fbab01dc30e req-45313408-5806-4d79-89a8-f16d9063290f service nova] Creating event network-vif-plugged:9d518e08-67a1-4818-85d8-21614454501c for instance 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 on n-h1-851337-3 Aug 02 08:08:54.652312 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-0372cfd4-a98f-48b9-a5c8-7fbab01dc30e req-45313408-5806-4d79-89a8-f16d9063290f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037116 Aug 02 08:08:54.652753 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3691/7458] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:08:55.096736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-f1352d44-839f-4143-b568-a018bcfa0f7a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:55.097410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-f1352d44-839f-4143-b568-a018bcfa0f7a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:55.099509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:08:55.100192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:08:55.107619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1352d44-839f-4143-b568-a018bcfa0f7a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:55.108071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1352d44-839f-4143-b568-a018bcfa0f7a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:55.108853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1352d44-839f-4143-b568-a018bcfa0f7a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:55.109293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-f1352d44-839f-4143-b568-a018bcfa0f7a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:55.246465 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-f1352d44-839f-4143-b568-a018bcfa0f7a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:55.254528 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-f1352d44-839f-4143-b568-a018bcfa0f7a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1392 microversion: 2.1 time: 0.161954 Aug 02 08:08:55.255109 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3768/7459] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:55 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:56.277746 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ecba3b3-dd80-425e-a4a1-b2a60114f6fa tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:56.278474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ecba3b3-dd80-425e-a4a1-b2a60114f6fa tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:56.285924 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ecba3b3-dd80-425e-a4a1-b2a60114f6fa tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:56.286421 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ecba3b3-dd80-425e-a4a1-b2a60114f6fa tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:56.287206 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ecba3b3-dd80-425e-a4a1-b2a60114f6fa tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:56.287655 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ecba3b3-dd80-425e-a4a1-b2a60114f6fa tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:56.424920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ecba3b3-dd80-425e-a4a1-b2a60114f6fa tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:56.433094 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ecba3b3-dd80-425e-a4a1-b2a60114f6fa tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1563 microversion: 2.1 time: 0.160558 Aug 02 08:08:56.433672 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3692/7460] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:56 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:56.453621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4cbccd81-1f16-4c6c-b971-4ee0bc247a5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:56.454241 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4cbccd81-1f16-4c6c-b971-4ee0bc247a5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:56.462091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4cbccd81-1f16-4c6c-b971-4ee0bc247a5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:56.462778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4cbccd81-1f16-4c6c-b971-4ee0bc247a5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:56.464097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4cbccd81-1f16-4c6c-b971-4ee0bc247a5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:56.464896 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4cbccd81-1f16-4c6c-b971-4ee0bc247a5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:56.605035 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4cbccd81-1f16-4c6c-b971-4ee0bc247a5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:56.613256 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4cbccd81-1f16-4c6c-b971-4ee0bc247a5b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1563 microversion: 2.1 time: 0.163530 Aug 02 08:08:56.613845 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3769/7461] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:56 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:08:58.593081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cdc37892-6cfa-45a3-85a0-4f7352afb531 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:08:58.593712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cdc37892-6cfa-45a3-85a0-4f7352afb531 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:08:58.595461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-07e858c6-0deb-423a-a730-e1d9a235c90c req-bb240156-a462-418f-86f0-0e747f28cba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e334cc-1fea-46ef-9d54-8aa6d0d01ab5", "tag": "9d518e08-67a1-4818-85d8-21614454501c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:08:58.603434 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdc37892-6cfa-45a3-85a0-4f7352afb531 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:58.603904 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdc37892-6cfa-45a3-85a0-4f7352afb531 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:58.605118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdc37892-6cfa-45a3-85a0-4f7352afb531 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:58.605577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cdc37892-6cfa-45a3-85a0-4f7352afb531 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:58.606900 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-07e858c6-0deb-423a-a730-e1d9a235c90c req-bb240156-a462-418f-86f0-0e747f28cba6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:08:58.607347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-07e858c6-0deb-423a-a730-e1d9a235c90c req-bb240156-a462-418f-86f0-0e747f28cba6 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:08:58.620580 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-07e858c6-0deb-423a-a730-e1d9a235c90c req-bb240156-a462-418f-86f0-0e747f28cba6 service nova] Creating event network-changed:9d518e08-67a1-4818-85d8-21614454501c for instance 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 on n-h1-851337-3 Aug 02 08:08:58.628688 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-07e858c6-0deb-423a-a730-e1d9a235c90c req-bb240156-a462-418f-86f0-0e747f28cba6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036923 Aug 02 08:08:58.629356 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3770/7462] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:08:58.773139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cdc37892-6cfa-45a3-85a0-4f7352afb531 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:08:58.790750 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cdc37892-6cfa-45a3-85a0-4f7352afb531 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1563 microversion: 2.1 time: 0.201204 Aug 02 08:08:58.791794 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3693/7463] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:08:58 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1563 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:32.103771 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:32.104476 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=42 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:32.109088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-28c1069b-71d0-4312-a84a-83bc46d77fbe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:09:32.111464 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-28c1069b-71d0-4312-a84a-83bc46d77fbe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:09:32.119844 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28c1069b-71d0-4312-a84a-83bc46d77fbe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:09:32.120324 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28c1069b-71d0-4312-a84a-83bc46d77fbe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:09:32.121116 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28c1069b-71d0-4312-a84a-83bc46d77fbe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:09:32.121548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28c1069b-71d0-4312-a84a-83bc46d77fbe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:09:32.186697 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-28c1069b-71d0-4312-a84a-83bc46d77fbe tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5/action" status: 200 len: 24563 microversion: 2.1 time: 0.085011 Aug 02 08:09:32.187370 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3771/7464] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:09:32 2022] POST /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5/action => generated 24563 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:10:02.617530 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=5 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:02.618310 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=38 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:02.623916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2d0dd363-1170-4124-865c-50b95330f77a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:10:02.624716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2d0dd363-1170-4124-865c-50b95330f77a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:02.633321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d0dd363-1170-4124-865c-50b95330f77a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:02.633864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d0dd363-1170-4124-865c-50b95330f77a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:02.634808 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d0dd363-1170-4124-865c-50b95330f77a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:02.635334 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2d0dd363-1170-4124-865c-50b95330f77a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:02.660014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-2d0dd363-1170-4124-865c-50b95330f77a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lazy-loading 'flavor' on Instance uuid 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:10:02.744699 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2d0dd363-1170-4124-865c-50b95330f77a tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.129468 Aug 02 08:10:02.745343 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3694/7465] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:10:02 2022] POST /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:10:02.754309 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b8459cc2-c198-4af5-982d-f9b9b0354dcb tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:02.754998 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b8459cc2-c198-4af5-982d-f9b9b0354dcb tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:02.758129 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:02.758959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:02.766127 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8459cc2-c198-4af5-982d-f9b9b0354dcb tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:02.766487 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8459cc2-c198-4af5-982d-f9b9b0354dcb tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:02.767260 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8459cc2-c198-4af5-982d-f9b9b0354dcb tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:02.767798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b8459cc2-c198-4af5-982d-f9b9b0354dcb tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:03.013292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b8459cc2-c198-4af5-982d-f9b9b0354dcb tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:03.024418 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b8459cc2-c198-4af5-982d-f9b9b0354dcb tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1690 microversion: 2.1 time: 0.274196 Aug 02 08:10:03.025085 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3772/7466] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:02 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1690 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:04.054343 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-8427c094-c6f6-4a58-97c4-d4c3c0cce75f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:04.055014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-8427c094-c6f6-4a58-97c4-d4c3c0cce75f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:04.062462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8427c094-c6f6-4a58-97c4-d4c3c0cce75f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:04.062918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8427c094-c6f6-4a58-97c4-d4c3c0cce75f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:04.063715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8427c094-c6f6-4a58-97c4-d4c3c0cce75f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:04.064159 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-8427c094-c6f6-4a58-97c4-d4c3c0cce75f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:04.262872 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-8427c094-c6f6-4a58-97c4-d4c3c0cce75f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:04.271171 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-8427c094-c6f6-4a58-97c4-d4c3c0cce75f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1690 microversion: 2.1 time: 0.222508 Aug 02 08:10:04.271753 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3695/7467] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:04 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1690 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:05.297228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-296bb659-223d-4100-8e5d-4b3d4704e08f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:05.298105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-296bb659-223d-4100-8e5d-4b3d4704e08f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:05.308886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-296bb659-223d-4100-8e5d-4b3d4704e08f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:05.309504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-296bb659-223d-4100-8e5d-4b3d4704e08f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:05.315330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-296bb659-223d-4100-8e5d-4b3d4704e08f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:05.315330 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-296bb659-223d-4100-8e5d-4b3d4704e08f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:05.459457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-296bb659-223d-4100-8e5d-4b3d4704e08f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:05.467332 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-296bb659-223d-4100-8e5d-4b3d4704e08f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1673 microversion: 2.1 time: 0.176554 Aug 02 08:10:05.468122 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3773/7468] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:05 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:06.566018 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6673ebd5-240d-42a9-81ad-5e6f9986c13b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:10:06.568669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6673ebd5-240d-42a9-81ad-5e6f9986c13b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:06.577395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6673ebd5-240d-42a9-81ad-5e6f9986c13b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:06.577963 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6673ebd5-240d-42a9-81ad-5e6f9986c13b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:06.578971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6673ebd5-240d-42a9-81ad-5e6f9986c13b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:06.579513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6673ebd5-240d-42a9-81ad-5e6f9986c13b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:06.634952 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6673ebd5-240d-42a9-81ad-5e6f9986c13b tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5/action" status: 200 len: 38380 microversion: 2.1 time: 0.073972 Aug 02 08:10:06.635632 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3696/7469] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:10:06 2022] POST /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5/action => generated 38380 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:10:06.648215 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83b6df74-67c8-4377-9c06-e93dbd6393c6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:10:06.648778 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-83b6df74-67c8-4377-9c06-e93dbd6393c6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:06.656121 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83b6df74-67c8-4377-9c06-e93dbd6393c6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:06.656571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83b6df74-67c8-4377-9c06-e93dbd6393c6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:06.657340 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83b6df74-67c8-4377-9c06-e93dbd6393c6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:06.657776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83b6df74-67c8-4377-9c06-e93dbd6393c6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:06.727516 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-83b6df74-67c8-4377-9c06-e93dbd6393c6 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5/action" status: 202 len: 0 microversion: 2.1 time: 0.083123 Aug 02 08:10:06.728164 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3774/7470] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:10:06 2022] POST /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:10:06.737460 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-967fd7ef-77bd-4fa3-aa47-06f362da7db1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:06.738227 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-967fd7ef-77bd-4fa3-aa47-06f362da7db1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:06.745762 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-967fd7ef-77bd-4fa3-aa47-06f362da7db1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:06.746257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-967fd7ef-77bd-4fa3-aa47-06f362da7db1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:06.747081 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-967fd7ef-77bd-4fa3-aa47-06f362da7db1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:06.747532 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-967fd7ef-77bd-4fa3-aa47-06f362da7db1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:06.895112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-967fd7ef-77bd-4fa3-aa47-06f362da7db1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:06.903116 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-967fd7ef-77bd-4fa3-aa47-06f362da7db1 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1679 microversion: 2.1 time: 0.170059 Aug 02 08:10:06.903704 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3697/7471] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:06 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:07.926828 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-12b9582d-e53b-4089-8032-a0a6942bd16f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:07.927520 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-12b9582d-e53b-4089-8032-a0a6942bd16f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:07.934590 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12b9582d-e53b-4089-8032-a0a6942bd16f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:07.935031 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12b9582d-e53b-4089-8032-a0a6942bd16f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:07.935826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12b9582d-e53b-4089-8032-a0a6942bd16f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:07.935826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-12b9582d-e53b-4089-8032-a0a6942bd16f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:08.081925 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-12b9582d-e53b-4089-8032-a0a6942bd16f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:08.089952 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-12b9582d-e53b-4089-8032-a0a6942bd16f tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1679 microversion: 2.1 time: 0.168429 Aug 02 08:10:08.090611 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3775/7472] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:07 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:09.114548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-463f265e-f437-41d3-8b45-539ad3083c17 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:09.115118 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-463f265e-f437-41d3-8b45-539ad3083c17 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:09.122622 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-463f265e-f437-41d3-8b45-539ad3083c17 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:09.123078 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-463f265e-f437-41d3-8b45-539ad3083c17 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:09.123859 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-463f265e-f437-41d3-8b45-539ad3083c17 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:09.124304 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-463f265e-f437-41d3-8b45-539ad3083c17 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:09.264776 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-463f265e-f437-41d3-8b45-539ad3083c17 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:09.272739 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-463f265e-f437-41d3-8b45-539ad3083c17 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1682 microversion: 2.1 time: 0.162228 Aug 02 08:10:09.273314 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3698/7473] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:09 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:09.371156 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e99a238b-c48d-4f06-a944-6bcedb1c8db7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:10:09.373650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e99a238b-c48d-4f06-a944-6bcedb1c8db7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:09.381091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e99a238b-c48d-4f06-a944-6bcedb1c8db7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:09.381541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e99a238b-c48d-4f06-a944-6bcedb1c8db7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:09.382746 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e99a238b-c48d-4f06-a944-6bcedb1c8db7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:09.383187 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e99a238b-c48d-4f06-a944-6bcedb1c8db7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:09.447946 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e99a238b-c48d-4f06-a944-6bcedb1c8db7 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "POST /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5/action" status: 200 len: 38380 microversion: 2.1 time: 0.080707 Aug 02 08:10:09.448628 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3776/7474] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:10:09 2022] POST /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5/action => generated 38380 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 08:10:10.514908 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3bba481b-2968-4d63-9dc1-2d0466e7b3ba tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:10.515513 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3bba481b-2968-4d63-9dc1-2d0466e7b3ba tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:10.516935 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-dce9cdba-c165-4b86-b09c-5c1000e39889 req-2364f95b-7f57-4fe8-aa3c-2575d73bc593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e334cc-1fea-46ef-9d54-8aa6d0d01ab5", "tag": "9d518e08-67a1-4818-85d8-21614454501c"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:10:10.523478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bba481b-2968-4d63-9dc1-2d0466e7b3ba tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:10.523990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bba481b-2968-4d63-9dc1-2d0466e7b3ba tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:10.525135 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bba481b-2968-4d63-9dc1-2d0466e7b3ba tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:10.525653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3bba481b-2968-4d63-9dc1-2d0466e7b3ba tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:10.529430 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-dce9cdba-c165-4b86-b09c-5c1000e39889 req-2364f95b-7f57-4fe8-aa3c-2575d73bc593 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:10.530354 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-dce9cdba-c165-4b86-b09c-5c1000e39889 req-2364f95b-7f57-4fe8-aa3c-2575d73bc593 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:10.542025 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-dce9cdba-c165-4b86-b09c-5c1000e39889 req-2364f95b-7f57-4fe8-aa3c-2575d73bc593 service nova] Creating event network-changed:9d518e08-67a1-4818-85d8-21614454501c for instance 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 on n-h1-851337-3 Aug 02 08:10:10.547598 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-dce9cdba-c165-4b86-b09c-5c1000e39889 req-2364f95b-7f57-4fe8-aa3c-2575d73bc593 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034839 Aug 02 08:10:10.548666 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3777/7475] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:10:10.559408 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3bba481b-2968-4d63-9dc1-2d0466e7b3ba tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 08:10:10.658780 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3bba481b-2968-4d63-9dc1-2d0466e7b3ba tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "DELETE /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 204 len: 0 microversion: 2.1 time: 0.146254 Aug 02 08:10:10.659989 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3699/7476] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 08:10:10 2022] DELETE /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:10.669548 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2fad4e31-35e1-4d4b-8815-23c9dd7b22e5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:10.670696 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2fad4e31-35e1-4d4b-8815-23c9dd7b22e5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:10.678875 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2fad4e31-35e1-4d4b-8815-23c9dd7b22e5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:10.680045 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2fad4e31-35e1-4d4b-8815-23c9dd7b22e5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:10.681144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2fad4e31-35e1-4d4b-8815-23c9dd7b22e5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:10.681917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2fad4e31-35e1-4d4b-8815-23c9dd7b22e5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:10.853443 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2fad4e31-35e1-4d4b-8815-23c9dd7b22e5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:10.862161 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2fad4e31-35e1-4d4b-8815-23c9dd7b22e5 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1688 microversion: 2.1 time: 0.197064 Aug 02 08:10:10.862778 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3778/7477] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:10 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1688 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:11.889706 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c3f7ac87-47e2-4824-ac39-73f069a8d951 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:11.891001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c3f7ac87-47e2-4824-ac39-73f069a8d951 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:11.900464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3f7ac87-47e2-4824-ac39-73f069a8d951 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:11.900922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3f7ac87-47e2-4824-ac39-73f069a8d951 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:11.901699 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3f7ac87-47e2-4824-ac39-73f069a8d951 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:11.902174 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c3f7ac87-47e2-4824-ac39-73f069a8d951 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:12.040624 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c3f7ac87-47e2-4824-ac39-73f069a8d951 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:12.048704 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c3f7ac87-47e2-4824-ac39-73f069a8d951 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1688 microversion: 2.1 time: 0.163568 Aug 02 08:10:12.049283 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3700/7478] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:11 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:10:13.071399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-931181ec-b066-4a1d-a017-553977e16a97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:13.072008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-931181ec-b066-4a1d-a017-553977e16a97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:13.079410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-931181ec-b066-4a1d-a017-553977e16a97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:13.079860 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-931181ec-b066-4a1d-a017-553977e16a97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:13.080622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-931181ec-b066-4a1d-a017-553977e16a97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:13.081025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-931181ec-b066-4a1d-a017-553977e16a97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:13.158731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-931181ec-b066-4a1d-a017-553977e16a97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601715059796424bae5c160b4a5eb382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe942df311d4907b01d32a8bdd17e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:13.169364 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-931181ec-b066-4a1d-a017-553977e16a97 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 200 len: 1501 microversion: 2.1 time: 0.101938 Aug 02 08:10:13.170278 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3779/7479] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:13 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 1501 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:13.206830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-cc6bf9af-62e1-47bd-8a7b-6a0d94078c10 req-c79b0ed2-040e-4a52-84e3-66c186778b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e334cc-1fea-46ef-9d54-8aa6d0d01ab5", "name": "network-vif-deleted", "tag": "9d518e08-67a1-4818-85d8-21614454501c"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:10:13.217539 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cc6bf9af-62e1-47bd-8a7b-6a0d94078c10 req-c79b0ed2-040e-4a52-84e3-66c186778b8c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:13.218016 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-cc6bf9af-62e1-47bd-8a7b-6a0d94078c10 req-c79b0ed2-040e-4a52-84e3-66c186778b8c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:13.233430 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-cc6bf9af-62e1-47bd-8a7b-6a0d94078c10 req-c79b0ed2-040e-4a52-84e3-66c186778b8c service nova] Creating event network-vif-deleted:9d518e08-67a1-4818-85d8-21614454501c for instance 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 on n-h1-851337-3 Aug 02 08:10:13.239398 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-cc6bf9af-62e1-47bd-8a7b-6a0d94078c10 req-c79b0ed2-040e-4a52-84e3-66c186778b8c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037698 Aug 02 08:10:13.240116 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3701/7480] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:10:14.191670 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7891b9f9-6260-4c2e-80bd-86a42311bb39 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:14.192288 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7891b9f9-6260-4c2e-80bd-86a42311bb39 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] [instance: 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:14.199718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7891b9f9-6260-4c2e-80bd-86a42311bb39 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:14.200162 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7891b9f9-6260-4c2e-80bd-86a42311bb39 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:14.200943 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7891b9f9-6260-4c2e-80bd-86a42311bb39 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:14.201385 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7891b9f9-6260-4c2e-80bd-86a42311bb39 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:14.215495 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-7891b9f9-6260-4c2e-80bd-86a42311bb39 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] HTTP exception thrown: Instance 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 could not be found. Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7891b9f9-6260-4c2e-80bd-86a42311bb39 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Request method failure captured: Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 HTTP/1.1 Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6NnNXwQjzTe5ucEgWVr6FK5R_x-1PXSjORQwgK-HLJwg4ud0xCiQ2RxkmamNcISiMo4ifaafVN2MJnljlZbb38Rp3hdz9WWClfF8DfJRGHtUcgwK-nhNzEPhYJpv5Hbll_ZHACbAYvLF-wQIz_sIq23lqNZYgHg_IZwEzGzmdwo5X1U Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: efe942df311d4907b01d32a8bdd17e05 Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_efe942df311d4907b01d32a8bdd17e05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/efe942df311d4907b01d32a8bdd17e05"}]}] Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: efe942df311d4907b01d32a8bdd17e05 Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1822902672 Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestNetworkAdvancedServerOps-1822902672-project Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 601715059796424bae5c160b4a5eb382 Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1822902672-project Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 could not be found. Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '17e334cc-1fea-46ef-9d54-8aa6d0d01ab5'} Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 could not be found. Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 could not be found. Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:10:14.217213 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:10:14.221577 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:10:14.221577 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:10:14.221577 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:10:14.221577 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:10:14.221577 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:10:14.221577 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:10:14.221577 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 could not be found. Aug 02 08:10:14.221577 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:10:14.221577 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7891b9f9-6260-4c2e-80bd-86a42311bb39 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Returning 404 to user: Instance 17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:10:14.221577 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7891b9f9-6260-4c2e-80bd-86a42311bb39 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5" status: 404 len: 111 microversion: 2.1 time: 0.031163 Aug 02 08:10:14.221577 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3780/7481] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:14 2022] GET /compute/v2.1/servers/17e334cc-1fea-46ef-9d54-8aa6d0d01ab5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:10:17.420258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-24aaffeb-0b53-4c74-a6b5-b9844c673fc0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] Calling method '.version_select at 0x7f92785023a0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:17.448112 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-24aaffeb-0b53-4c74-a6b5-b9844c673fc0 tempest-TestNetworkAdvancedServerOps-1822902672 tempest-TestNetworkAdvancedServerOps-1822902672-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-604815631" status: 202 len: 0 microversion: 2.1 time: 0.034976 Aug 02 08:10:17.448766 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3702/7482] 10.222.0.79 () {58 vars in 1281 bytes} [Tue Aug 2 08:10:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-604815631 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:10:29.014647 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=18 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:29.015370 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:29.237115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-55527aae-cd38-4283-ae91-53e940d5908f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Action: 'create', calling method: .version_select at 0x7f928c3309d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-888180705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMF7JK0eoARhenRzX8PexUsujcGMvSkKPtqB09zzF+nY98OEv/RSzc7qfmUcGWHzAhPPNu73ijSkTnPaMikEpFxRBJ+k/eaRZW7uKnKoa9guR2zKXI9FEhHSZbsC6BLJw=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:10:29.253526 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-55527aae-cd38-4283-ae91-53e940d5908f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Getting quotas for project 5a40b49e4d654a45a26d698706531276. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:10:29.259660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-55527aae-cd38-4283-ae91-53e940d5908f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Getting quotas for user 527cd1c0a10047fd9c757e8b55028abb and project 5a40b49e4d654a45a26d698706531276. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:10:29.287712 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-55527aae-cd38-4283-ae91-53e940d5908f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.280333 Aug 02 08:10:29.294344 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3781/7483] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 08:10:29 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:10:30.355441 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:30.356737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:30.361545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1296565336", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-888180705", "security_groups": [{"name": "tempest-secgroup-smoke-980047056"}], "networks": [{"uuid": "e6395faa-52b9-47ef-84d3-8839a3f3d659"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:10:30.473990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] validate_networks() for [('e6395faa-52b9-47ef-84d3-8839a3f3d659', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:10:30.960876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:10:30.961515 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:10:30.962123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:10:30.962600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:10:30.963084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:10:30.972942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:30.973448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:30.974285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:30.974722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:30.992279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Getting quotas for project 5a40b49e4d654a45a26d698706531276. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:10:30.997976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Getting quotas for user 527cd1c0a10047fd9c757e8b55028abb and project 5a40b49e4d654a45a26d698706531276. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:10:31.011285 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:10:31.013686 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:10:31.063727 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a05220c5-d0b7-41d4-8d1e-369e93bdcedb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.710450 Aug 02 08:10:31.070343 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3703/7484] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 08:10:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:10:31.076104 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e3866cca-a4a3-4c10-8ac6-12bee3e5b6d6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:31.076729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e3866cca-a4a3-4c10-8ac6-12bee3e5b6d6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:31.160881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e3866cca-a4a3-4c10-8ac6-12bee3e5b6d6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:31.169632 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e3866cca-a4a3-4c10-8ac6-12bee3e5b6d6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1246 microversion: 2.1 time: 0.097616 Aug 02 08:10:31.170899 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3782/7485] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:31 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:32.193989 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-42c2295f-2561-434d-9b46-ce57e89a9c1f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:32.194664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-42c2295f-2561-434d-9b46-ce57e89a9c1f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:32.203974 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42c2295f-2561-434d-9b46-ce57e89a9c1f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:32.204689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42c2295f-2561-434d-9b46-ce57e89a9c1f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:32.205757 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42c2295f-2561-434d-9b46-ce57e89a9c1f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:32.206458 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-42c2295f-2561-434d-9b46-ce57e89a9c1f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:32.302962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-42c2295f-2561-434d-9b46-ce57e89a9c1f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:32.311232 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-42c2295f-2561-434d-9b46-ce57e89a9c1f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1316 microversion: 2.1 time: 0.121494 Aug 02 08:10:32.311819 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3704/7486] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:32 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1316 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:33.336254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2842ffc5-89ee-4a53-8a38-37bdb3afa4b6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:33.337172 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2842ffc5-89ee-4a53-8a38-37bdb3afa4b6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:33.345478 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2842ffc5-89ee-4a53-8a38-37bdb3afa4b6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:33.346095 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2842ffc5-89ee-4a53-8a38-37bdb3afa4b6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:33.346945 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2842ffc5-89ee-4a53-8a38-37bdb3afa4b6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:33.347378 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2842ffc5-89ee-4a53-8a38-37bdb3afa4b6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:33.616576 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2842ffc5-89ee-4a53-8a38-37bdb3afa4b6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:33.627589 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2842ffc5-89ee-4a53-8a38-37bdb3afa4b6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1371 microversion: 2.1 time: 0.297629 Aug 02 08:10:33.628400 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3783/7487] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:33 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1371 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:33.872075 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e2ac1778-d674-456e-bcab-8f809a80b904 req-5fa60285-a174-4e81-9dc9-acb2e89e1be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65ae0882-087c-4f35-8a49-69c1d8c69a3a", "tag": "4c3e64a9-2e73-4f24-aedd-800dab55d4e4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:10:33.884981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e2ac1778-d674-456e-bcab-8f809a80b904 req-5fa60285-a174-4e81-9dc9-acb2e89e1be2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:33.885444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e2ac1778-d674-456e-bcab-8f809a80b904 req-5fa60285-a174-4e81-9dc9-acb2e89e1be2 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:33.900201 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e2ac1778-d674-456e-bcab-8f809a80b904 req-5fa60285-a174-4e81-9dc9-acb2e89e1be2 service nova] Creating event network-changed:4c3e64a9-2e73-4f24-aedd-800dab55d4e4 for instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a on n-h2-851337-3 Aug 02 08:10:33.906622 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e2ac1778-d674-456e-bcab-8f809a80b904 req-5fa60285-a174-4e81-9dc9-acb2e89e1be2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126771 Aug 02 08:10:33.907297 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3705/7488] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:10:34.649742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3bdded48-8877-48ec-a612-03bba37083c3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:34.650389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-3bdded48-8877-48ec-a612-03bba37083c3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:34.659495 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3bdded48-8877-48ec-a612-03bba37083c3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:34.660211 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3bdded48-8877-48ec-a612-03bba37083c3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:34.661037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3bdded48-8877-48ec-a612-03bba37083c3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:34.661457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-3bdded48-8877-48ec-a612-03bba37083c3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:34.823932 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-3bdded48-8877-48ec-a612-03bba37083c3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:34.831984 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3bdded48-8877-48ec-a612-03bba37083c3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1371 microversion: 2.1 time: 0.186122 Aug 02 08:10:34.832559 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3784/7489] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:34 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:35.855351 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9b9b3ab2-52ef-4fb0-831d-294321cf4962 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:35.856613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9b9b3ab2-52ef-4fb0-831d-294321cf4962 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:35.863272 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b9b3ab2-52ef-4fb0-831d-294321cf4962 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:35.863696 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b9b3ab2-52ef-4fb0-831d-294321cf4962 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:35.864882 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b9b3ab2-52ef-4fb0-831d-294321cf4962 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:35.865382 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b9b3ab2-52ef-4fb0-831d-294321cf4962 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:36.019577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9b9b3ab2-52ef-4fb0-831d-294321cf4962 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:36.032918 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9b9b3ab2-52ef-4fb0-831d-294321cf4962 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1371 microversion: 2.1 time: 0.182476 Aug 02 08:10:36.033593 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3706/7490] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:35 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:37.054417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-e7d4063d-9d42-4503-aba9-358cb5211b32 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:37.055069 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-e7d4063d-9d42-4503-aba9-358cb5211b32 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:37.067158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7d4063d-9d42-4503-aba9-358cb5211b32 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:37.070723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7d4063d-9d42-4503-aba9-358cb5211b32 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:37.071528 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7d4063d-9d42-4503-aba9-358cb5211b32 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:37.072130 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-e7d4063d-9d42-4503-aba9-358cb5211b32 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:37.223835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-e7d4063d-9d42-4503-aba9-358cb5211b32 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:37.233769 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-e7d4063d-9d42-4503-aba9-358cb5211b32 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1371 microversion: 2.1 time: 0.183098 Aug 02 08:10:37.234905 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3785/7491] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:37 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:38.011968 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-fee94a10-8368-4d09-8352-dfafc0e55e3b req-d063ef09-0efa-4660-8a14-7d1d664f884d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ae0882-087c-4f35-8a49-69c1d8c69a3a", "name": "network-vif-plugged", "status": "completed", "tag": "4c3e64a9-2e73-4f24-aedd-800dab55d4e4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:10:38.021704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fee94a10-8368-4d09-8352-dfafc0e55e3b req-d063ef09-0efa-4660-8a14-7d1d664f884d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:38.022177 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-fee94a10-8368-4d09-8352-dfafc0e55e3b req-d063ef09-0efa-4660-8a14-7d1d664f884d service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:38.033076 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-fee94a10-8368-4d09-8352-dfafc0e55e3b req-d063ef09-0efa-4660-8a14-7d1d664f884d service nova] Creating event network-vif-plugged:4c3e64a9-2e73-4f24-aedd-800dab55d4e4 for instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a on n-h2-851337-3 Aug 02 08:10:38.038218 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-fee94a10-8368-4d09-8352-dfafc0e55e3b req-d063ef09-0efa-4660-8a14-7d1d664f884d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089145 Aug 02 08:10:38.038810 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3707/7492] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:10:38.258517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-412c0688-b3c4-41a7-9382-fab84ef98aeb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:38.259248 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-412c0688-b3c4-41a7-9382-fab84ef98aeb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:38.267424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-412c0688-b3c4-41a7-9382-fab84ef98aeb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:38.267916 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-412c0688-b3c4-41a7-9382-fab84ef98aeb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:38.268834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-412c0688-b3c4-41a7-9382-fab84ef98aeb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:38.269261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-412c0688-b3c4-41a7-9382-fab84ef98aeb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:38.424768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-412c0688-b3c4-41a7-9382-fab84ef98aeb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:38.435777 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-412c0688-b3c4-41a7-9382-fab84ef98aeb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1371 microversion: 2.1 time: 0.182785 Aug 02 08:10:38.436444 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3786/7493] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:38 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:39.461280 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-20682431-5cd2-4d52-873d-60e1ebec8014 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:39.462003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-20682431-5cd2-4d52-873d-60e1ebec8014 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:39.468980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20682431-5cd2-4d52-873d-60e1ebec8014 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:39.469414 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20682431-5cd2-4d52-873d-60e1ebec8014 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:39.470269 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20682431-5cd2-4d52-873d-60e1ebec8014 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:39.470718 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-20682431-5cd2-4d52-873d-60e1ebec8014 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:39.615043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-20682431-5cd2-4d52-873d-60e1ebec8014 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:39.623054 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-20682431-5cd2-4d52-873d-60e1ebec8014 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1554 microversion: 2.1 time: 0.168081 Aug 02 08:10:39.623633 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3708/7494] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:39 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:39.645377 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7aa8d957-3a88-4159-b112-5b9682fe906e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:10:39.646039 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7aa8d957-3a88-4159-b112-5b9682fe906e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:10:39.655196 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7aa8d957-3a88-4159-b112-5b9682fe906e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:39.655766 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7aa8d957-3a88-4159-b112-5b9682fe906e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:39.656959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7aa8d957-3a88-4159-b112-5b9682fe906e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:39.657552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7aa8d957-3a88-4159-b112-5b9682fe906e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:39.797737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7aa8d957-3a88-4159-b112-5b9682fe906e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:10:39.806534 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7aa8d957-3a88-4159-b112-5b9682fe906e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1554 microversion: 2.1 time: 0.165099 Aug 02 08:10:39.807083 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3787/7495] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:10:39 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:41.854842 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-654bae36-b623-45e1-8718-4f6257544427 req-908a446e-29fe-4fc2-8b3e-a260267aff2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65ae0882-087c-4f35-8a49-69c1d8c69a3a", "tag": "4c3e64a9-2e73-4f24-aedd-800dab55d4e4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:10:41.861043 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:41.862005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:41.868977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-654bae36-b623-45e1-8718-4f6257544427 req-908a446e-29fe-4fc2-8b3e-a260267aff2e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:10:41.869440 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-654bae36-b623-45e1-8718-4f6257544427 req-908a446e-29fe-4fc2-8b3e-a260267aff2e service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:10:41.881226 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-654bae36-b623-45e1-8718-4f6257544427 req-908a446e-29fe-4fc2-8b3e-a260267aff2e service nova] Creating event network-changed:4c3e64a9-2e73-4f24-aedd-800dab55d4e4 for instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a on n-h2-851337-3 Aug 02 08:10:41.886838 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-654bae36-b623-45e1-8718-4f6257544427 req-908a446e-29fe-4fc2-8b3e-a260267aff2e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037046 Aug 02 08:10:41.887654 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3709/7496] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:11:07.294613 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:11:07.295263 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 08:11:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:12:40.083067 n-d-851337-3 devstack@n-api.service[126120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c0c3e5c9-f933-4314-bd57-3d2ecb041378] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 08:12:40.083982 n-d-851337-3 devstack@n-api.service[126120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da609bec-98c7-4964-8d17-beefad60c655] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 08:12:40.084359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:40.085276 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:40.086020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=30 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:40.090400 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9f3ff100-7aa4-4367-9bff-c8fbd28c3e49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:12:40.090964 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9f3ff100-7aa4-4367-9bff-c8fbd28c3e49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:40.099405 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f3ff100-7aa4-4367-9bff-c8fbd28c3e49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:40.099861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f3ff100-7aa4-4367-9bff-c8fbd28c3e49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:40.100629 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f3ff100-7aa4-4367-9bff-c8fbd28c3e49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:40.101067 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9f3ff100-7aa4-4367-9bff-c8fbd28c3e49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:40.124776 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-9f3ff100-7aa4-4367-9bff-c8fbd28c3e49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lazy-loading 'flavor' on Instance uuid 65ae0882-087c-4f35-8a49-69c1d8c69a3a {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:12:40.322985 n-d-851337-3 devstack@n-api.service[126120]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9f3ff100-7aa4-4367-9bff-c8fbd28c3e49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [6cd0e18e-4b3e-4ae4-875a-0b3d4587f51b] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 08:12:41.097298 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] [da609bec-98c7-4964-8d17-beefad60c655] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40360. Aug 02 08:12:41.098592 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] [c0c3e5c9-f933-4314-bd57-3d2ecb041378] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40358. Aug 02 08:12:41.336005 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [None req-9f3ff100-7aa4-4367-9bff-c8fbd28c3e49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [6cd0e18e-4b3e-4ae4-875a-0b3d4587f51b] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40362. Aug 02 08:12:41.341956 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9f3ff100-7aa4-4367-9bff-c8fbd28c3e49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "POST /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a/action" status: 202 len: 0 microversion: 2.1 time: 1.260754 Aug 02 08:12:41.343232 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3788/7497] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:12:40 2022] POST /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a/action => generated 0 bytes in 1263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:12:41.353463 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ad41dfa6-acfa-4002-ab8d-84c3526bc6c6] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 08:12:41.354400 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52c7fbf0-ab5b-40ba-9153-7d2f92273477] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 08:12:41.354919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:41.355760 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=26 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:41.360251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f4366c34-e3fb-49aa-8518-1fc4ef52da57 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:41.361116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f4366c34-e3fb-49aa-8518-1fc4ef52da57 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:41.368649 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4366c34-e3fb-49aa-8518-1fc4ef52da57 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:41.369103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4366c34-e3fb-49aa-8518-1fc4ef52da57 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:41.369876 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4366c34-e3fb-49aa-8518-1fc4ef52da57 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:41.370344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f4366c34-e3fb-49aa-8518-1fc4ef52da57 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:41.525481 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f4366c34-e3fb-49aa-8518-1fc4ef52da57 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:41.535535 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f4366c34-e3fb-49aa-8518-1fc4ef52da57 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1679 microversion: 2.1 time: 0.184923 Aug 02 08:12:41.536163 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3710/7498] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:41 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:42.566208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-18868721-683b-4047-8f13-04535e21e877 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:42.566867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-18868721-683b-4047-8f13-04535e21e877 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:42.574621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18868721-683b-4047-8f13-04535e21e877 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:42.575054 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18868721-683b-4047-8f13-04535e21e877 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:42.575908 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18868721-683b-4047-8f13-04535e21e877 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:42.576381 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-18868721-683b-4047-8f13-04535e21e877 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:42.717254 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-18868721-683b-4047-8f13-04535e21e877 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:42.725439 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-18868721-683b-4047-8f13-04535e21e877 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1679 microversion: 2.1 time: 0.165359 Aug 02 08:12:42.726020 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3789/7499] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:42 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:43.749636 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e930284e-1faf-43d4-91cb-b2c8460aed51 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:43.750357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e930284e-1faf-43d4-91cb-b2c8460aed51 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:43.764213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e930284e-1faf-43d4-91cb-b2c8460aed51 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:43.765072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e930284e-1faf-43d4-91cb-b2c8460aed51 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:43.766571 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e930284e-1faf-43d4-91cb-b2c8460aed51 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:43.767400 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e930284e-1faf-43d4-91cb-b2c8460aed51 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:43.773396 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] [52c7fbf0-ab5b-40ba-9153-7d2f92273477] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40374. Aug 02 08:12:43.776729 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] [ad41dfa6-acfa-4002-ab8d-84c3526bc6c6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40372. Aug 02 08:12:43.909949 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e930284e-1faf-43d4-91cb-b2c8460aed51 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:43.919278 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e930284e-1faf-43d4-91cb-b2c8460aed51 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1679 microversion: 2.1 time: 0.174360 Aug 02 08:12:43.919855 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3711/7500] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:43 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:44.942650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2986cc9b-8aa2-46e4-8b07-a2d4161bd6c6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:44.943559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2986cc9b-8aa2-46e4-8b07-a2d4161bd6c6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:44.951715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2986cc9b-8aa2-46e4-8b07-a2d4161bd6c6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:44.952164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2986cc9b-8aa2-46e4-8b07-a2d4161bd6c6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:44.952931 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2986cc9b-8aa2-46e4-8b07-a2d4161bd6c6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:44.953361 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2986cc9b-8aa2-46e4-8b07-a2d4161bd6c6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:45.102268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2986cc9b-8aa2-46e4-8b07-a2d4161bd6c6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:45.110447 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2986cc9b-8aa2-46e4-8b07-a2d4161bd6c6 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1679 microversion: 2.1 time: 0.173115 Aug 02 08:12:45.111071 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3790/7501] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:44 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:46.134553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5f178ba1-3329-440c-b165-de93e30285b4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:46.135213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5f178ba1-3329-440c-b165-de93e30285b4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:46.144320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f178ba1-3329-440c-b165-de93e30285b4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:46.144487 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f178ba1-3329-440c-b165-de93e30285b4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:46.145417 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f178ba1-3329-440c-b165-de93e30285b4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:46.145951 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5f178ba1-3329-440c-b165-de93e30285b4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:46.258026 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:12:46.258305 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 08:12:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a (ip 10.222.0.79) !!! Aug 02 08:12:46.306981 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5f178ba1-3329-440c-b165-de93e30285b4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:46.314856 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5f178ba1-3329-440c-b165-de93e30285b4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1679 microversion: 2.1 time: 0.185543 Aug 02 08:12:46.315434 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3712/7502] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:46 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:47.336734 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9fd023a5-95e2-49cc-b6c8-7d20c93457e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:47.337376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9fd023a5-95e2-49cc-b6c8-7d20c93457e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:47.344913 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9fd023a5-95e2-49cc-b6c8-7d20c93457e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:47.345364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9fd023a5-95e2-49cc-b6c8-7d20c93457e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:47.346322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9fd023a5-95e2-49cc-b6c8-7d20c93457e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:47.346969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9fd023a5-95e2-49cc-b6c8-7d20c93457e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:47.479575 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9fd023a5-95e2-49cc-b6c8-7d20c93457e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:47.487889 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9fd023a5-95e2-49cc-b6c8-7d20c93457e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1679 microversion: 2.1 time: 0.155244 Aug 02 08:12:47.488484 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3791/7503] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:47 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:48.513501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-cb197b1f-bdee-4732-b039-90e5e08c4666 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:48.514226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-cb197b1f-bdee-4732-b039-90e5e08c4666 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:48.521505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb197b1f-bdee-4732-b039-90e5e08c4666 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:48.522002 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb197b1f-bdee-4732-b039-90e5e08c4666 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:48.522772 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb197b1f-bdee-4732-b039-90e5e08c4666 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:48.523213 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-cb197b1f-bdee-4732-b039-90e5e08c4666 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:48.665099 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-cb197b1f-bdee-4732-b039-90e5e08c4666 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:48.673520 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-cb197b1f-bdee-4732-b039-90e5e08c4666 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1679 microversion: 2.1 time: 0.164058 Aug 02 08:12:48.674122 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3713/7504] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:48 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:49.695132 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c73e2a15-792d-4af0-b552-2f806e9e431a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:49.695748 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c73e2a15-792d-4af0-b552-2f806e9e431a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:49.703195 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c73e2a15-792d-4af0-b552-2f806e9e431a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:49.703679 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c73e2a15-792d-4af0-b552-2f806e9e431a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:49.704451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c73e2a15-792d-4af0-b552-2f806e9e431a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:49.704862 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c73e2a15-792d-4af0-b552-2f806e9e431a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:49.858407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c73e2a15-792d-4af0-b552-2f806e9e431a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:49.866024 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c73e2a15-792d-4af0-b552-2f806e9e431a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1679 microversion: 2.1 time: 0.174894 Aug 02 08:12:49.866560 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3792/7505] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:49 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:50.890744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a071e04f-3d1a-47ac-ab9c-38ebbee12179 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:50.891674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a071e04f-3d1a-47ac-ab9c-38ebbee12179 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:50.902172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a071e04f-3d1a-47ac-ab9c-38ebbee12179 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:50.902871 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a071e04f-3d1a-47ac-ab9c-38ebbee12179 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:50.904131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a071e04f-3d1a-47ac-ab9c-38ebbee12179 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:50.904787 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a071e04f-3d1a-47ac-ab9c-38ebbee12179 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:51.043769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a071e04f-3d1a-47ac-ab9c-38ebbee12179 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:51.052106 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a071e04f-3d1a-47ac-ab9c-38ebbee12179 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1679 microversion: 2.1 time: 0.166689 Aug 02 08:12:51.052681 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3714/7506] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:50 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:52.074310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4a8f36fd-1c10-467f-af48-fe4afaee1202 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:52.074968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4a8f36fd-1c10-467f-af48-fe4afaee1202 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:52.082523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a8f36fd-1c10-467f-af48-fe4afaee1202 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:52.082977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a8f36fd-1c10-467f-af48-fe4afaee1202 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:52.083740 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a8f36fd-1c10-467f-af48-fe4afaee1202 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:52.084182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a8f36fd-1c10-467f-af48-fe4afaee1202 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:52.235835 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4a8f36fd-1c10-467f-af48-fe4afaee1202 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:52.247744 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4a8f36fd-1c10-467f-af48-fe4afaee1202 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1700 microversion: 2.1 time: 0.177166 Aug 02 08:12:52.248530 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3793/7507] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:52 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1700 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:53.278442 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-608d6e28-5238-4364-9c59-f7b048f920b7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:53.279448 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-608d6e28-5238-4364-9c59-f7b048f920b7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:53.291472 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-608d6e28-5238-4364-9c59-f7b048f920b7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:53.291931 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-608d6e28-5238-4364-9c59-f7b048f920b7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:53.292713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-608d6e28-5238-4364-9c59-f7b048f920b7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:53.293189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-608d6e28-5238-4364-9c59-f7b048f920b7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:53.434395 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-608d6e28-5238-4364-9c59-f7b048f920b7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:53.442785 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-608d6e28-5238-4364-9c59-f7b048f920b7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1700 microversion: 2.1 time: 0.170941 Aug 02 08:12:53.443365 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3715/7508] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:53 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1700 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:54.463968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c342fce2-716c-4b4e-aa3d-b0500ec24699 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:54.464587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c342fce2-716c-4b4e-aa3d-b0500ec24699 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:54.472167 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c342fce2-716c-4b4e-aa3d-b0500ec24699 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:54.472617 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c342fce2-716c-4b4e-aa3d-b0500ec24699 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:54.473733 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c342fce2-716c-4b4e-aa3d-b0500ec24699 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:54.473826 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c342fce2-716c-4b4e-aa3d-b0500ec24699 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:54.618376 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c342fce2-716c-4b4e-aa3d-b0500ec24699 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:54.626087 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c342fce2-716c-4b4e-aa3d-b0500ec24699 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1695 microversion: 2.1 time: 0.166095 Aug 02 08:12:54.637276 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3794/7509] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:54 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:55.652450 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a239d82d-5120-4ff7-8fe7-e8d83a652e45 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:55.653687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a239d82d-5120-4ff7-8fe7-e8d83a652e45 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:55.660226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a239d82d-5120-4ff7-8fe7-e8d83a652e45 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:55.660683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a239d82d-5120-4ff7-8fe7-e8d83a652e45 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:55.661645 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a239d82d-5120-4ff7-8fe7-e8d83a652e45 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:55.662116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a239d82d-5120-4ff7-8fe7-e8d83a652e45 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:55.818600 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a239d82d-5120-4ff7-8fe7-e8d83a652e45 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:55.829599 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a239d82d-5120-4ff7-8fe7-e8d83a652e45 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1695 microversion: 2.1 time: 0.182826 Aug 02 08:12:55.830335 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3716/7510] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:55 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:56.752861 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-6122d05e-70a2-4d50-bdb7-3ab9e84348a7 req-2c46ad37-5eee-4015-b0f9-ce39de87149f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ae0882-087c-4f35-8a49-69c1d8c69a3a", "name": "network-vif-plugged", "status": "completed", "tag": "4c3e64a9-2e73-4f24-aedd-800dab55d4e4"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:12:56.767029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6122d05e-70a2-4d50-bdb7-3ab9e84348a7 req-2c46ad37-5eee-4015-b0f9-ce39de87149f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:56.767752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-6122d05e-70a2-4d50-bdb7-3ab9e84348a7 req-2c46ad37-5eee-4015-b0f9-ce39de87149f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:56.781112 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-6122d05e-70a2-4d50-bdb7-3ab9e84348a7 req-2c46ad37-5eee-4015-b0f9-ce39de87149f service nova] Creating event network-vif-plugged:4c3e64a9-2e73-4f24-aedd-800dab55d4e4 for instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a on n-h2-851337-3 Aug 02 08:12:56.787816 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-6122d05e-70a2-4d50-bdb7-3ab9e84348a7 req-2c46ad37-5eee-4015-b0f9-ce39de87149f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038801 Aug 02 08:12:56.788755 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3795/7511] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:12:56.856737 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4ab6d156-528c-445e-af67-b089acf3555f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:56.857911 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-4ab6d156-528c-445e-af67-b089acf3555f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:56.866233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ab6d156-528c-445e-af67-b089acf3555f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:56.867019 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ab6d156-528c-445e-af67-b089acf3555f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:56.867867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ab6d156-528c-445e-af67-b089acf3555f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:56.869505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-4ab6d156-528c-445e-af67-b089acf3555f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:57.034976 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-4ab6d156-528c-445e-af67-b089acf3555f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:57.046204 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4ab6d156-528c-445e-af67-b089acf3555f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1695 microversion: 2.1 time: 0.194858 Aug 02 08:12:57.058575 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3717/7512] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:56 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1695 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:58.068631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5ccc184e-d7b6-44be-90e9-0ecaaa985c94 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:58.069557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5ccc184e-d7b6-44be-90e9-0ecaaa985c94 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:58.076553 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5ccc184e-d7b6-44be-90e9-0ecaaa985c94 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:58.077122 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5ccc184e-d7b6-44be-90e9-0ecaaa985c94 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:58.078216 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5ccc184e-d7b6-44be-90e9-0ecaaa985c94 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:58.078726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5ccc184e-d7b6-44be-90e9-0ecaaa985c94 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:58.245457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5ccc184e-d7b6-44be-90e9-0ecaaa985c94 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:58.254343 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5ccc184e-d7b6-44be-90e9-0ecaaa985c94 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1695 microversion: 2.1 time: 0.190805 Aug 02 08:12:58.260585 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3796/7513] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:58 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1695 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:12:59.276783 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-68a40be2-8c1f-41a0-8336-5e5d752f97c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:12:59.277402 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-68a40be2-8c1f-41a0-8336-5e5d752f97c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:12:59.284864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68a40be2-8c1f-41a0-8336-5e5d752f97c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:59.286112 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68a40be2-8c1f-41a0-8336-5e5d752f97c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:59.287013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68a40be2-8c1f-41a0-8336-5e5d752f97c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:12:59.287466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-68a40be2-8c1f-41a0-8336-5e5d752f97c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:12:59.430807 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-68a40be2-8c1f-41a0-8336-5e5d752f97c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:12:59.438716 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-68a40be2-8c1f-41a0-8336-5e5d752f97c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1695 microversion: 2.1 time: 0.166290 Aug 02 08:12:59.441930 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3718/7514] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:12:59 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:00.462407 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-41841681-57fd-4f32-8e76-8e0894d6a673 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:00.463870 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-41841681-57fd-4f32-8e76-8e0894d6a673 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:00.474293 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41841681-57fd-4f32-8e76-8e0894d6a673 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:00.474949 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41841681-57fd-4f32-8e76-8e0894d6a673 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:00.475812 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41841681-57fd-4f32-8e76-8e0894d6a673 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:00.476322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-41841681-57fd-4f32-8e76-8e0894d6a673 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:00.629290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-41841681-57fd-4f32-8e76-8e0894d6a673 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:00.638208 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-41841681-57fd-4f32-8e76-8e0894d6a673 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1695 microversion: 2.1 time: 0.180601 Aug 02 08:13:00.638800 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3797/7515] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:00 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:01.661548 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bc8ab04a-0bbf-42c4-9cd2-2a0ba1e66740 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:01.662651 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bc8ab04a-0bbf-42c4-9cd2-2a0ba1e66740 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:01.670508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc8ab04a-0bbf-42c4-9cd2-2a0ba1e66740 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:01.670973 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc8ab04a-0bbf-42c4-9cd2-2a0ba1e66740 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:01.672079 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc8ab04a-0bbf-42c4-9cd2-2a0ba1e66740 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:01.672603 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc8ab04a-0bbf-42c4-9cd2-2a0ba1e66740 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:01.840966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bc8ab04a-0bbf-42c4-9cd2-2a0ba1e66740 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:01.850540 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bc8ab04a-0bbf-42c4-9cd2-2a0ba1e66740 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1695 microversion: 2.1 time: 0.193481 Aug 02 08:13:01.851137 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3719/7516] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:01 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:02.872983 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7d14a175-d393-443c-bc9d-83d5998c7632 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:02.874302 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7d14a175-d393-443c-bc9d-83d5998c7632 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:02.888736 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d14a175-d393-443c-bc9d-83d5998c7632 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:02.893966 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d14a175-d393-443c-bc9d-83d5998c7632 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:02.895816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d14a175-d393-443c-bc9d-83d5998c7632 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:02.896261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7d14a175-d393-443c-bc9d-83d5998c7632 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:03.049604 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7d14a175-d393-443c-bc9d-83d5998c7632 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:03.062058 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7d14a175-d393-443c-bc9d-83d5998c7632 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1695 microversion: 2.1 time: 0.192432 Aug 02 08:13:03.063148 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3798/7517] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:02 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:03.080324 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:13:03.080857 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 08:13:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:13:04.084593 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bb3122f4-99da-49ac-bead-b0bd1abbe16b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:04.085293 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bb3122f4-99da-49ac-bead-b0bd1abbe16b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:04.092889 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb3122f4-99da-49ac-bead-b0bd1abbe16b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:04.093347 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb3122f4-99da-49ac-bead-b0bd1abbe16b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:04.094136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb3122f4-99da-49ac-bead-b0bd1abbe16b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:04.094592 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bb3122f4-99da-49ac-bead-b0bd1abbe16b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:04.291922 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bb3122f4-99da-49ac-bead-b0bd1abbe16b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:04.302347 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bb3122f4-99da-49ac-bead-b0bd1abbe16b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1677 microversion: 2.1 time: 0.221626 Aug 02 08:13:04.303620 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3720/7518] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:04 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:05.329382 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2fefc830-c496-45d5-9489-56f6cd10a7d8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:05.330422 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2fefc830-c496-45d5-9489-56f6cd10a7d8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:05.342411 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2fefc830-c496-45d5-9489-56f6cd10a7d8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:05.343149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2fefc830-c496-45d5-9489-56f6cd10a7d8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:05.344396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2fefc830-c496-45d5-9489-56f6cd10a7d8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:05.345792 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2fefc830-c496-45d5-9489-56f6cd10a7d8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:05.489608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2fefc830-c496-45d5-9489-56f6cd10a7d8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:05.497785 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2fefc830-c496-45d5-9489-56f6cd10a7d8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1677 microversion: 2.1 time: 0.174784 Aug 02 08:13:05.498421 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3799/7519] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:05 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:06.520155 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f59bab2c-a6bb-4026-b752-ffab1ecb8b59 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:06.520743 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f59bab2c-a6bb-4026-b752-ffab1ecb8b59 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:06.529321 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f59bab2c-a6bb-4026-b752-ffab1ecb8b59 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:06.529961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f59bab2c-a6bb-4026-b752-ffab1ecb8b59 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:06.530865 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f59bab2c-a6bb-4026-b752-ffab1ecb8b59 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:06.531543 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f59bab2c-a6bb-4026-b752-ffab1ecb8b59 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:06.705055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f59bab2c-a6bb-4026-b752-ffab1ecb8b59 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:06.706729 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-acc1c530-4324-43a2-94d3-2f7cad90315a req-c4dc2c17-c829-45a2-abd5-5900fb502f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ae0882-087c-4f35-8a49-69c1d8c69a3a", "name": "network-vif-unplugged", "status": "completed", "tag": "4c3e64a9-2e73-4f24-aedd-800dab55d4e4"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:13:06.713268 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f59bab2c-a6bb-4026-b752-ffab1ecb8b59 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1680 microversion: 2.1 time: 0.197148 Aug 02 08:13:06.714174 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3721/7520] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:06 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1680 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:06.718627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-acc1c530-4324-43a2-94d3-2f7cad90315a req-c4dc2c17-c829-45a2-abd5-5900fb502f79 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:06.719533 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-acc1c530-4324-43a2-94d3-2f7cad90315a req-c4dc2c17-c829-45a2-abd5-5900fb502f79 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:06.734626 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.compute.server_external_events [req-acc1c530-4324-43a2-94d3-2f7cad90315a req-c4dc2c17-c829-45a2-abd5-5900fb502f79 service nova] Unable to find a host for instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a. Dropping event network-vif-unplugged {{(pid=126120) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 02 08:13:06.735870 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-94198c81-f78e-46a9-8c9b-fd4b4407b63c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:13:06.736313 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-acc1c530-4324-43a2-94d3-2f7cad90315a req-c4dc2c17-c829-45a2-abd5-5900fb502f79 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033217 Aug 02 08:13:06.736545 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-94198c81-f78e-46a9-8c9b-fd4b4407b63c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:06.737476 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3800/7521] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 02 08:13:06.743022 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-94198c81-f78e-46a9-8c9b-fd4b4407b63c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:06.743631 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-94198c81-f78e-46a9-8c9b-fd4b4407b63c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:06.744413 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-94198c81-f78e-46a9-8c9b-fd4b4407b63c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:06.744864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-94198c81-f78e-46a9-8c9b-fd4b4407b63c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:06.789468 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-94198c81-f78e-46a9-8c9b-fd4b4407b63c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126119) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 08:13:06.872371 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-94198c81-f78e-46a9-8c9b-fd4b4407b63c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "POST /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a/action" status: 202 len: 0 microversion: 2.1 time: 0.141434 Aug 02 08:13:06.873051 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3722/7522] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:13:06 2022] POST /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 08:13:06.881509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b84f8721-d29a-46ba-936b-e0dd4684bcde tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:06.882192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b84f8721-d29a-46ba-936b-e0dd4684bcde tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:06.888901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b84f8721-d29a-46ba-936b-e0dd4684bcde tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:06.889366 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b84f8721-d29a-46ba-936b-e0dd4684bcde tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:06.890380 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b84f8721-d29a-46ba-936b-e0dd4684bcde tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:06.890830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b84f8721-d29a-46ba-936b-e0dd4684bcde tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:07.032504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b84f8721-d29a-46ba-936b-e0dd4684bcde tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:07.040608 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b84f8721-d29a-46ba-936b-e0dd4684bcde tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1628 microversion: 2.1 time: 0.163211 Aug 02 08:13:07.041256 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3801/7523] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:06 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1628 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:08.066892 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-842d5c9e-b2c8-4670-a237-7a73eec926de tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:08.067466 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-842d5c9e-b2c8-4670-a237-7a73eec926de tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:08.076013 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-842d5c9e-b2c8-4670-a237-7a73eec926de tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:08.076475 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-842d5c9e-b2c8-4670-a237-7a73eec926de tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:08.077260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-842d5c9e-b2c8-4670-a237-7a73eec926de tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:08.077709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-842d5c9e-b2c8-4670-a237-7a73eec926de tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:08.236263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-842d5c9e-b2c8-4670-a237-7a73eec926de tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:08.244631 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-842d5c9e-b2c8-4670-a237-7a73eec926de tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.185733 Aug 02 08:13:08.245199 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3723/7524] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:08 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:09.194488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ab3f65d2-3cca-4981-86dd-9fe0724cf16c req-35423b19-c366-4e4f-bc5a-ad6c98cf82a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65ae0882-087c-4f35-8a49-69c1d8c69a3a", "tag": "4c3e64a9-2e73-4f24-aedd-800dab55d4e4"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:13:09.208853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ab3f65d2-3cca-4981-86dd-9fe0724cf16c req-35423b19-c366-4e4f-bc5a-ad6c98cf82a3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:09.209680 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ab3f65d2-3cca-4981-86dd-9fe0724cf16c req-35423b19-c366-4e4f-bc5a-ad6c98cf82a3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:09.225627 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ab3f65d2-3cca-4981-86dd-9fe0724cf16c req-35423b19-c366-4e4f-bc5a-ad6c98cf82a3 service nova] Creating event network-changed:4c3e64a9-2e73-4f24-aedd-800dab55d4e4 for instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a on n-h1-851337-3 Aug 02 08:13:09.231446 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ab3f65d2-3cca-4981-86dd-9fe0724cf16c req-35423b19-c366-4e4f-bc5a-ad6c98cf82a3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114331 Aug 02 08:13:09.232263 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3802/7525] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:13:09.267263 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-446fa68b-7b48-47e5-95ad-deed92fa440f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:09.268644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-446fa68b-7b48-47e5-95ad-deed92fa440f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:09.275906 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-446fa68b-7b48-47e5-95ad-deed92fa440f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:09.276362 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-446fa68b-7b48-47e5-95ad-deed92fa440f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:09.277121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-446fa68b-7b48-47e5-95ad-deed92fa440f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:09.277601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-446fa68b-7b48-47e5-95ad-deed92fa440f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:09.413024 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-446fa68b-7b48-47e5-95ad-deed92fa440f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:09.420932 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-446fa68b-7b48-47e5-95ad-deed92fa440f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.157643 Aug 02 08:13:09.421508 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3724/7526] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:09 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:10.443488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5bf96dba-2e7f-4acb-add4-574f9346e866 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:10.444165 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5bf96dba-2e7f-4acb-add4-574f9346e866 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:10.447321 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=31 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:10.453972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bf96dba-2e7f-4acb-add4-574f9346e866 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:10.454551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bf96dba-2e7f-4acb-add4-574f9346e866 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:10.455345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bf96dba-2e7f-4acb-add4-574f9346e866 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:10.455782 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bf96dba-2e7f-4acb-add4-574f9346e866 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:10.458707 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:10.605413 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-5bf96dba-2e7f-4acb-add4-574f9346e866 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:10.613866 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5bf96dba-2e7f-4acb-add4-574f9346e866 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.174634 Aug 02 08:13:10.614720 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3803/7527] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:10 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:11.636326 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5d23240a-267a-420c-a774-d4255e3e291c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:11.636916 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5d23240a-267a-420c-a774-d4255e3e291c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:11.639828 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:11.646072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d23240a-267a-420c-a774-d4255e3e291c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:11.646541 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d23240a-267a-420c-a774-d4255e3e291c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:11.654319 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d23240a-267a-420c-a774-d4255e3e291c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:11.655226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5d23240a-267a-420c-a774-d4255e3e291c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:11.660445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:11.816975 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-5d23240a-267a-420c-a774-d4255e3e291c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:11.825161 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5d23240a-267a-420c-a774-d4255e3e291c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.193088 Aug 02 08:13:11.825816 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3725/7528] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:11 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:12.867605 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7f254e95-62cb-4994-83cc-6d3fdaf48798 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:12.869086 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7f254e95-62cb-4994-83cc-6d3fdaf48798 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:12.878633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f254e95-62cb-4994-83cc-6d3fdaf48798 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:12.879425 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f254e95-62cb-4994-83cc-6d3fdaf48798 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:12.880704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f254e95-62cb-4994-83cc-6d3fdaf48798 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:12.881589 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7f254e95-62cb-4994-83cc-6d3fdaf48798 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:13.080837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7f254e95-62cb-4994-83cc-6d3fdaf48798 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:13.089597 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7f254e95-62cb-4994-83cc-6d3fdaf48798 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.237806 Aug 02 08:13:13.090558 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3804/7529] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:12 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:14.112682 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ab4fa094-a559-4df4-a4bb-a46168f384e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:14.113482 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ab4fa094-a559-4df4-a4bb-a46168f384e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:14.120229 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab4fa094-a559-4df4-a4bb-a46168f384e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:14.120695 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab4fa094-a559-4df4-a4bb-a46168f384e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:14.121478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab4fa094-a559-4df4-a4bb-a46168f384e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:14.121926 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ab4fa094-a559-4df4-a4bb-a46168f384e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:14.283867 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ab4fa094-a559-4df4-a4bb-a46168f384e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:14.293008 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ab4fa094-a559-4df4-a4bb-a46168f384e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.184402 Aug 02 08:13:14.293961 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3726/7530] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:14 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:15.317345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9ea6c4c7-65dc-49fe-8424-143680a13859 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:15.318085 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9ea6c4c7-65dc-49fe-8424-143680a13859 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:15.327133 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ea6c4c7-65dc-49fe-8424-143680a13859 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:15.327693 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ea6c4c7-65dc-49fe-8424-143680a13859 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:15.328556 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ea6c4c7-65dc-49fe-8424-143680a13859 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:15.329049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9ea6c4c7-65dc-49fe-8424-143680a13859 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:15.517850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9ea6c4c7-65dc-49fe-8424-143680a13859 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:15.528126 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9ea6c4c7-65dc-49fe-8424-143680a13859 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.216043 Aug 02 08:13:15.528770 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3805/7531] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:15 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:16.549618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c184fb5c-5a34-4c04-9e8a-50fe6c36a967 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:16.550656 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c184fb5c-5a34-4c04-9e8a-50fe6c36a967 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:16.558405 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c184fb5c-5a34-4c04-9e8a-50fe6c36a967 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:16.558947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c184fb5c-5a34-4c04-9e8a-50fe6c36a967 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:16.559800 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c184fb5c-5a34-4c04-9e8a-50fe6c36a967 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:16.560307 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c184fb5c-5a34-4c04-9e8a-50fe6c36a967 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:16.739192 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c184fb5c-5a34-4c04-9e8a-50fe6c36a967 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:16.747809 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c184fb5c-5a34-4c04-9e8a-50fe6c36a967 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.202137 Aug 02 08:13:16.748402 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3727/7532] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:16 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:17.770793 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-22822fa7-5f50-468a-9a23-f4b924d39e63 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:17.771423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-22822fa7-5f50-468a-9a23-f4b924d39e63 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:17.778768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22822fa7-5f50-468a-9a23-f4b924d39e63 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:17.779208 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22822fa7-5f50-468a-9a23-f4b924d39e63 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:17.779973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22822fa7-5f50-468a-9a23-f4b924d39e63 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:17.780399 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-22822fa7-5f50-468a-9a23-f4b924d39e63 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:17.931592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-22822fa7-5f50-468a-9a23-f4b924d39e63 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:17.943293 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-22822fa7-5f50-468a-9a23-f4b924d39e63 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.176221 Aug 02 08:13:17.944077 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3806/7533] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:17 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:18.973084 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9147e0a2-424e-482f-8868-7e405af72196 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:18.973864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9147e0a2-424e-482f-8868-7e405af72196 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:18.983149 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9147e0a2-424e-482f-8868-7e405af72196 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:18.983720 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9147e0a2-424e-482f-8868-7e405af72196 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:18.984683 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9147e0a2-424e-482f-8868-7e405af72196 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:18.985239 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9147e0a2-424e-482f-8868-7e405af72196 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:19.143336 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9147e0a2-424e-482f-8868-7e405af72196 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:19.154602 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9147e0a2-424e-482f-8868-7e405af72196 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.186463 Aug 02 08:13:19.155199 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3728/7534] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:18 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:20.176654 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-940c5e2f-d6e5-4ca5-a66e-6519bf903353 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:20.177268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-940c5e2f-d6e5-4ca5-a66e-6519bf903353 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:20.185003 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-940c5e2f-d6e5-4ca5-a66e-6519bf903353 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:20.185457 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-940c5e2f-d6e5-4ca5-a66e-6519bf903353 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:20.186277 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-940c5e2f-d6e5-4ca5-a66e-6519bf903353 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:20.186718 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-940c5e2f-d6e5-4ca5-a66e-6519bf903353 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:20.337537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-940c5e2f-d6e5-4ca5-a66e-6519bf903353 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:20.345872 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-940c5e2f-d6e5-4ca5-a66e-6519bf903353 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.173225 Aug 02 08:13:20.346488 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3807/7535] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:20 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:21.371196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a03475ff-2570-461a-80fd-f9afaab6743b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:21.371997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a03475ff-2570-461a-80fd-f9afaab6743b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:21.379462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a03475ff-2570-461a-80fd-f9afaab6743b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:21.379912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a03475ff-2570-461a-80fd-f9afaab6743b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:21.380677 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a03475ff-2570-461a-80fd-f9afaab6743b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:21.381116 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a03475ff-2570-461a-80fd-f9afaab6743b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:21.525380 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a03475ff-2570-461a-80fd-f9afaab6743b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:21.535415 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a03475ff-2570-461a-80fd-f9afaab6743b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.170642 Aug 02 08:13:21.536017 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3729/7536] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:21 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:22.560975 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-c2fce068-3fcf-4a1b-8267-eb664a71bc75 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:22.561591 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-c2fce068-3fcf-4a1b-8267-eb664a71bc75 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:22.569101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2fce068-3fcf-4a1b-8267-eb664a71bc75 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:22.569560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2fce068-3fcf-4a1b-8267-eb664a71bc75 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:22.570393 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2fce068-3fcf-4a1b-8267-eb664a71bc75 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:22.570837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-c2fce068-3fcf-4a1b-8267-eb664a71bc75 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:22.723839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-c2fce068-3fcf-4a1b-8267-eb664a71bc75 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:22.735089 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-c2fce068-3fcf-4a1b-8267-eb664a71bc75 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.180160 Aug 02 08:13:22.735979 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3808/7537] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:22 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:23.757216 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-de4f9633-ed29-49cb-b66b-c60b0a62241d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:23.757792 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-de4f9633-ed29-49cb-b66b-c60b0a62241d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:23.766161 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de4f9633-ed29-49cb-b66b-c60b0a62241d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:23.766618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de4f9633-ed29-49cb-b66b-c60b0a62241d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:23.767509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de4f9633-ed29-49cb-b66b-c60b0a62241d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:23.767935 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-de4f9633-ed29-49cb-b66b-c60b0a62241d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:23.907919 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-de4f9633-ed29-49cb-b66b-c60b0a62241d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:23.915743 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-de4f9633-ed29-49cb-b66b-c60b0a62241d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.162652 Aug 02 08:13:23.916364 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3730/7538] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:23 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:24.938453 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-37e56f8d-5c45-452d-a754-59b13898ca96 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:24.939052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-37e56f8d-5c45-452d-a754-59b13898ca96 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:24.946805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37e56f8d-5c45-452d-a754-59b13898ca96 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:24.947259 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37e56f8d-5c45-452d-a754-59b13898ca96 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:24.948029 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37e56f8d-5c45-452d-a754-59b13898ca96 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:24.948470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-37e56f8d-5c45-452d-a754-59b13898ca96 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:25.098339 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-37e56f8d-5c45-452d-a754-59b13898ca96 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:25.111148 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-37e56f8d-5c45-452d-a754-59b13898ca96 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.176809 Aug 02 08:13:25.111919 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3809/7539] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:24 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:25.974937 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-11eafe00-935a-4515-aaa1-ecb0883a6ae4 req-4b94bedd-0621-4ff1-ba2d-fd70f0d17b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ae0882-087c-4f35-8a49-69c1d8c69a3a", "name": "network-vif-plugged", "status": "completed", "tag": "4c3e64a9-2e73-4f24-aedd-800dab55d4e4"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:13:25.986435 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-11eafe00-935a-4515-aaa1-ecb0883a6ae4 req-4b94bedd-0621-4ff1-ba2d-fd70f0d17b03 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:25.986957 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-11eafe00-935a-4515-aaa1-ecb0883a6ae4 req-4b94bedd-0621-4ff1-ba2d-fd70f0d17b03 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:25.998550 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-11eafe00-935a-4515-aaa1-ecb0883a6ae4 req-4b94bedd-0621-4ff1-ba2d-fd70f0d17b03 service nova] Creating event network-vif-plugged:4c3e64a9-2e73-4f24-aedd-800dab55d4e4 for instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a on n-h1-851337-3 Aug 02 08:13:26.006219 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-11eafe00-935a-4515-aaa1-ecb0883a6ae4 req-4b94bedd-0621-4ff1-ba2d-fd70f0d17b03 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034236 Aug 02 08:13:26.007475 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3731/7540] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:13:26.137779 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-0068ae4e-f908-4e82-b7a5-960e4def36cb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:26.139164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-0068ae4e-f908-4e82-b7a5-960e4def36cb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:26.146417 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0068ae4e-f908-4e82-b7a5-960e4def36cb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:26.146859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0068ae4e-f908-4e82-b7a5-960e4def36cb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:26.147627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0068ae4e-f908-4e82-b7a5-960e4def36cb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:26.148192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-0068ae4e-f908-4e82-b7a5-960e4def36cb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:26.304034 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-0068ae4e-f908-4e82-b7a5-960e4def36cb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:26.312923 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-0068ae4e-f908-4e82-b7a5-960e4def36cb tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.179392 Aug 02 08:13:26.313643 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3810/7541] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:26 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:27.336017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b2ba7639-9936-4592-bd3a-6859f8c43444 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:27.336734 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b2ba7639-9936-4592-bd3a-6859f8c43444 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:27.343407 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2ba7639-9936-4592-bd3a-6859f8c43444 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:27.343874 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2ba7639-9936-4592-bd3a-6859f8c43444 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:27.344653 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2ba7639-9936-4592-bd3a-6859f8c43444 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:27.345223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b2ba7639-9936-4592-bd3a-6859f8c43444 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:27.483930 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b2ba7639-9936-4592-bd3a-6859f8c43444 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:27.491728 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b2ba7639-9936-4592-bd3a-6859f8c43444 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1686 microversion: 2.1 time: 0.161091 Aug 02 08:13:27.492312 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3732/7542] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:27 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:13:28.518439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-552446a7-ad2d-4165-9a03-8cc7f2d7f8e8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:13:28.519660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-552446a7-ad2d-4165-9a03-8cc7f2d7f8e8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:13:28.531158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-552446a7-ad2d-4165-9a03-8cc7f2d7f8e8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:28.531891 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-552446a7-ad2d-4165-9a03-8cc7f2d7f8e8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:28.536514 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-552446a7-ad2d-4165-9a03-8cc7f2d7f8e8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:13:28.536963 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-552446a7-ad2d-4165-9a03-8cc7f2d7f8e8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:13:28.688057 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-552446a7-ad2d-4165-9a03-8cc7f2d7f8e8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:13:28.700039 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-552446a7-ad2d-4165-9a03-8cc7f2d7f8e8 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1673 microversion: 2.1 time: 0.187809 Aug 02 08:13:28.700240 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3811/7543] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:13:28 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1673 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:14:27.304805 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:14:27.306256 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 08:14:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:15:13.731812 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=15 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:13.733017 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=43 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:13.733706 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=17 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:13.735135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=53 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:13.737723 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9299b009-a59b-4284-9a76-c68fec958667 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:13.738335 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9299b009-a59b-4284-9a76-c68fec958667 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:13.740500 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ab8bd93b-a880-4ea0-9a2f-c6c447be3976 req-7a8eea39-4028-46fc-bab1-11c560a488a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65ae0882-087c-4f35-8a49-69c1d8c69a3a", "tag": "4c3e64a9-2e73-4f24-aedd-800dab55d4e4"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:15:13.746062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9299b009-a59b-4284-9a76-c68fec958667 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:13.746830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9299b009-a59b-4284-9a76-c68fec958667 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:13.748072 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9299b009-a59b-4284-9a76-c68fec958667 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:13.749057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9299b009-a59b-4284-9a76-c68fec958667 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:13.752797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ab8bd93b-a880-4ea0-9a2f-c6c447be3976 req-7a8eea39-4028-46fc-bab1-11c560a488a1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:13.753232 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ab8bd93b-a880-4ea0-9a2f-c6c447be3976 req-7a8eea39-4028-46fc-bab1-11c560a488a1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:13.775261 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ab8bd93b-a880-4ea0-9a2f-c6c447be3976 req-7a8eea39-4028-46fc-bab1-11c560a488a1 service nova] Creating event network-changed:4c3e64a9-2e73-4f24-aedd-800dab55d4e4 for instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a on n-h1-851337-3 Aug 02 08:15:13.781166 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ab8bd93b-a880-4ea0-9a2f-c6c447be3976 req-7a8eea39-4028-46fc-bab1-11c560a488a1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049429 Aug 02 08:15:13.782293 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3812/7544] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:15:13.783634 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9299b009-a59b-4284-9a76-c68fec958667 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Going to try to terminate instance {{(pid=126119) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 08:15:13.879786 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9299b009-a59b-4284-9a76-c68fec958667 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "DELETE /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 204 len: 0 microversion: 2.1 time: 0.149923 Aug 02 08:15:13.880387 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3733/7545] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 08:15:13 2022] DELETE /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:15:13.890314 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7a2bd605-7934-4a5d-a5b3-64f03ed60b87 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:13.891062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7a2bd605-7934-4a5d-a5b3-64f03ed60b87 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:13.900397 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a2bd605-7934-4a5d-a5b3-64f03ed60b87 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:13.900651 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a2bd605-7934-4a5d-a5b3-64f03ed60b87 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:13.901279 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a2bd605-7934-4a5d-a5b3-64f03ed60b87 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:13.901716 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7a2bd605-7934-4a5d-a5b3-64f03ed60b87 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:14.131847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7a2bd605-7934-4a5d-a5b3-64f03ed60b87 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:14.140039 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7a2bd605-7934-4a5d-a5b3-64f03ed60b87 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1679 microversion: 2.1 time: 0.254423 Aug 02 08:15:14.140646 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3813/7546] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:13 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:15.162491 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1d8e3844-1564-426a-8557-20d5b2fb4af7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:15.163208 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1d8e3844-1564-426a-8557-20d5b2fb4af7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:15.170704 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d8e3844-1564-426a-8557-20d5b2fb4af7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:15.171027 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d8e3844-1564-426a-8557-20d5b2fb4af7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:15.171809 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d8e3844-1564-426a-8557-20d5b2fb4af7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:15.172251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1d8e3844-1564-426a-8557-20d5b2fb4af7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:15.367933 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1d8e3844-1564-426a-8557-20d5b2fb4af7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:15.375846 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1d8e3844-1564-426a-8557-20d5b2fb4af7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1679 microversion: 2.1 time: 0.217770 Aug 02 08:15:15.376424 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3734/7547] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:15 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1679 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:15.900158 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-c4dc0937-ef27-45b4-be0a-57324f79e125 req-ff456c00-6896-45a8-94e7-b205dd66bb6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ae0882-087c-4f35-8a49-69c1d8c69a3a", "name": "network-vif-deleted", "tag": "4c3e64a9-2e73-4f24-aedd-800dab55d4e4"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:15:15.912438 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c4dc0937-ef27-45b4-be0a-57324f79e125 req-ff456c00-6896-45a8-94e7-b205dd66bb6c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:15.912887 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-c4dc0937-ef27-45b4-be0a-57324f79e125 req-ff456c00-6896-45a8-94e7-b205dd66bb6c service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:15.924930 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-c4dc0937-ef27-45b4-be0a-57324f79e125 req-ff456c00-6896-45a8-94e7-b205dd66bb6c service nova] Creating event network-vif-deleted:4c3e64a9-2e73-4f24-aedd-800dab55d4e4 for instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a on n-h1-851337-3 Aug 02 08:15:15.930507 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-c4dc0937-ef27-45b4-be0a-57324f79e125 req-ff456c00-6896-45a8-94e7-b205dd66bb6c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034054 Aug 02 08:15:15.931113 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3814/7548] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:15:16.399288 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d97c0cec-7fb1-41cb-bf9f-5201632774ae tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:16.399990 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d97c0cec-7fb1-41cb-bf9f-5201632774ae tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:16.407986 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d97c0cec-7fb1-41cb-bf9f-5201632774ae tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:16.408359 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d97c0cec-7fb1-41cb-bf9f-5201632774ae tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:16.409222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d97c0cec-7fb1-41cb-bf9f-5201632774ae tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:16.409667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d97c0cec-7fb1-41cb-bf9f-5201632774ae tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:16.449476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d97c0cec-7fb1-41cb-bf9f-5201632774ae tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:16.450226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d97c0cec-7fb1-41cb-bf9f-5201632774ae tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:16.450788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.objects.instance [None req-d97c0cec-7fb1-41cb-bf9f-5201632774ae tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lazy-loading 'fault' on Instance uuid 65ae0882-087c-4f35-8a49-69c1d8c69a3a {{(pid=126119) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:15:16.505501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d97c0cec-7fb1-41cb-bf9f-5201632774ae tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:16.513838 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d97c0cec-7fb1-41cb-bf9f-5201632774ae tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 200 len: 1336 microversion: 2.1 time: 0.118473 Aug 02 08:15:16.514473 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3735/7549] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:16 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 1336 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:17.537169 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-90568ca7-d11c-40b2-8782-1f813ae505d2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:17.537914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-90568ca7-d11c-40b2-8782-1f813ae505d2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 65ae0882-087c-4f35-8a49-69c1d8c69a3a] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:17.544877 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90568ca7-d11c-40b2-8782-1f813ae505d2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:17.545334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90568ca7-d11c-40b2-8782-1f813ae505d2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:17.546140 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90568ca7-d11c-40b2-8782-1f813ae505d2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:17.546580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-90568ca7-d11c-40b2-8782-1f813ae505d2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:17.561687 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-90568ca7-d11c-40b2-8782-1f813ae505d2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] HTTP exception thrown: Instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a could not be found. Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-90568ca7-d11c-40b2-8782-1f813ae505d2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Request method failure captured: Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a HTTP/1.1 Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Nvv1c8GeTgChklhsKrtikPDNRP4Ks9LdDBjsZcvmkjU91rPf0cTEFfIdaZzVJieu0RvgjjN6yL9VI_DZxALcE4NdCb8-6rIDJ4BRzevKAE7W3sqJGcsBtPFNszwHf6F_2etEZdGXBCqtAnpuN_s-j3mZmjcMdLzezbEwrSKJ5eTX5c Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5a40b49e4d654a45a26d698706531276 Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestShelveInstance-169171009 Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5a40b49e4d654a45a26d698706531276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5a40b49e4d654a45a26d698706531276"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5a40b49e4d654a45a26d698706531276"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5a40b49e4d654a45a26d698706531276"}]}] Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestShelveInstance-169171009 Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5a40b49e4d654a45a26d698706531276 Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestShelveInstance-169171009 Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestShelveInstance-169171009-project Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 527cd1c0a10047fd9c757e8b55028abb Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestShelveInstance-169171009-project Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a could not be found. Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '65ae0882-087c-4f35-8a49-69c1d8c69a3a'} Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a could not be found. Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a could not be found. Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:15:17.563439 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:15:17.568488 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:15:17.568488 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:15:17.568488 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:15:17.568488 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:15:17.568488 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:15:17.568488 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a could not be found. Aug 02 08:15:17.568488 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:15:17.568488 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-90568ca7-d11c-40b2-8782-1f813ae505d2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Returning 404 to user: Instance 65ae0882-087c-4f35-8a49-69c1d8c69a3a could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:15:17.568488 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-90568ca7-d11c-40b2-8782-1f813ae505d2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a" status: 404 len: 111 microversion: 2.1 time: 0.032988 Aug 02 08:15:17.568488 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3815/7550] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:17 2022] GET /compute/v2.1/servers/65ae0882-087c-4f35-8a49-69c1d8c69a3a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:15:17.743790 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-4d96ff8d-61a3-43ff-9919-c9e99c0f2302 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '.version_select at 0x7f92784c0790>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:17.748669 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d96ff8d-61a3-43ff-9919-c9e99c0f2302 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [af7f37fb-ea4c-4e48-9dc2-e8e7aa30923e] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 08:15:18.757236 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [None req-4d96ff8d-61a3-43ff-9919-c9e99c0f2302 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [af7f37fb-ea4c-4e48-9dc2-e8e7aa30923e] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40672. Aug 02 08:15:18.780925 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-4d96ff8d-61a3-43ff-9919-c9e99c0f2302 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-888180705" status: 202 len: 0 microversion: 2.1 time: 1.041502 Aug 02 08:15:18.781515 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3736/7551] 10.222.0.79 () {58 vars in 1251 bytes} [Tue Aug 2 08:15:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-888180705 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:15:18.804281 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-63bb397c-8178-4f38-8cb3-7defcadfe767 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Action: 'create', calling method: .version_select at 0x7f9279c09b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-2125989603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9aufO+XKLbjtZXMyTrBI7CVtJ76qTw9Qlk2bqGfFbsTuh7A4HHj02+hA0lY09qLWkuzIxhs4Q+5ETELNWrJCVt412aSObDW/8zmb0TjkSpVhOZD/rOehflPVy2a1CSxA=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:15:18.822044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-63bb397c-8178-4f38-8cb3-7defcadfe767 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Getting quotas for project 5a40b49e4d654a45a26d698706531276. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:15:18.828489 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-63bb397c-8178-4f38-8cb3-7defcadfe767 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Getting quotas for user 527cd1c0a10047fd9c757e8b55028abb and project 5a40b49e4d654a45a26d698706531276. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:15:18.859311 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-63bb397c-8178-4f38-8cb3-7defcadfe767 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.058973 Aug 02 08:15:18.859946 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3816/7552] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 08:15:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:15:36.288167 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:36.288953 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:36.293577 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-697665895", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2125989603", "security_groups": [{"name": "tempest-secgroup-smoke-211063861"}], "networks": [{"uuid": "e6395faa-52b9-47ef-84d3-8839a3f3d659"}], "block_device_mapping_v2": [{"uuid": "ac09ceeb-47a2-42c6-bef5-20c8c64408a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:15:36.414308 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] validate_networks() for [('e6395faa-52b9-47ef-84d3-8839a3f3d659', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:15:36.863918 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:15:36.864344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:15:36.864824 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:15:36.865257 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:15:36.865643 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:15:36.875010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:36.875467 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:36.876265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:36.876705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:36.894663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Getting quotas for project 5a40b49e4d654a45a26d698706531276. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:15:36.901273 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Getting quotas for user 527cd1c0a10047fd9c757e8b55028abb and project 5a40b49e4d654a45a26d698706531276. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:15:36.964912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:15:36.968303 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac09ceeb-47a2-42c6-bef5-20c8c64408a1',volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:15:37.114208 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-639ece41-9483-4c42-80d2-59f1ddd6fbce tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.827798 Aug 02 08:15:37.114785 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3737/7553] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 08:15:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:15:37.123922 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=12 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:37.124798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=4 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:37.125479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:37.130328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-227b9418-5c38-4694-be02-845a006fad58 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:37.131115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-227b9418-5c38-4694-be02-845a006fad58 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:37.191788 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-227b9418-5c38-4694-be02-845a006fad58 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:37.201255 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-227b9418-5c38-4694-be02-845a006fad58 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1088 microversion: 2.1 time: 0.078972 Aug 02 08:15:37.202213 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3817/7554] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:37 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:38.229528 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6f4210f2-0b58-4bda-8817-107cf88d9c8e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:38.230264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6f4210f2-0b58-4bda-8817-107cf88d9c8e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:38.238601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f4210f2-0b58-4bda-8817-107cf88d9c8e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:38.239365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f4210f2-0b58-4bda-8817-107cf88d9c8e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:38.240124 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f4210f2-0b58-4bda-8817-107cf88d9c8e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:38.240563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6f4210f2-0b58-4bda-8817-107cf88d9c8e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:38.348333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6f4210f2-0b58-4bda-8817-107cf88d9c8e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:38.356179 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6f4210f2-0b58-4bda-8817-107cf88d9c8e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1194 microversion: 2.1 time: 0.131596 Aug 02 08:15:38.357118 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3738/7555] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:38 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1194 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:39.379394 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9d8aa2ad-84da-4a12-b261-5c9fd21c7de4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:39.380907 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9d8aa2ad-84da-4a12-b261-5c9fd21c7de4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:39.391166 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d8aa2ad-84da-4a12-b261-5c9fd21c7de4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:39.391999 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d8aa2ad-84da-4a12-b261-5c9fd21c7de4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:39.393011 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d8aa2ad-84da-4a12-b261-5c9fd21c7de4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:39.393676 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9d8aa2ad-84da-4a12-b261-5c9fd21c7de4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:40.001477 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9d8aa2ad-84da-4a12-b261-5c9fd21c7de4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:40.013576 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9d8aa2ad-84da-4a12-b261-5c9fd21c7de4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1271 microversion: 2.1 time: 0.638482 Aug 02 08:15:40.022741 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3818/7556] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:39 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1271 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:40.439995 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-157efd55-0e04-4a44-ab17-6cc363ef6521 req-e19c26d7-e168-4149-aaca-71b3f86c1372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028ae8e0-22ab-4ab6-92d4-7bb6584e49b7", "tag": "573c9128-b267-4f9d-9cd5-367dddc0f2f9"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:15:40.452445 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-157efd55-0e04-4a44-ab17-6cc363ef6521 req-e19c26d7-e168-4149-aaca-71b3f86c1372 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:40.453265 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-157efd55-0e04-4a44-ab17-6cc363ef6521 req-e19c26d7-e168-4149-aaca-71b3f86c1372 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:40.468076 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-157efd55-0e04-4a44-ab17-6cc363ef6521 req-e19c26d7-e168-4149-aaca-71b3f86c1372 service nova] Creating event network-changed:573c9128-b267-4f9d-9cd5-367dddc0f2f9 for instance 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 on n-h2-851337-3 Aug 02 08:15:40.474270 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-157efd55-0e04-4a44-ab17-6cc363ef6521 req-e19c26d7-e168-4149-aaca-71b3f86c1372 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138417 Aug 02 08:15:40.475979 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3739/7557] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:15:41.037246 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-7e13f9b2-5189-47ed-9785-ac007ba8fcd3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:41.039109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-7e13f9b2-5189-47ed-9785-ac007ba8fcd3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:41.047018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e13f9b2-5189-47ed-9785-ac007ba8fcd3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:41.047018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e13f9b2-5189-47ed-9785-ac007ba8fcd3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:41.047923 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e13f9b2-5189-47ed-9785-ac007ba8fcd3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:41.048608 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-7e13f9b2-5189-47ed-9785-ac007ba8fcd3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:41.254131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-7e13f9b2-5189-47ed-9785-ac007ba8fcd3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:41.270240 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-7e13f9b2-5189-47ed-9785-ac007ba8fcd3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1271 microversion: 2.1 time: 0.237022 Aug 02 08:15:41.271380 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3819/7558] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:41 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1271 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:42.292508 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b0adace1-512d-4a7b-9c48-9d1378821784 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:42.293368 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b0adace1-512d-4a7b-9c48-9d1378821784 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:42.301827 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0adace1-512d-4a7b-9c48-9d1378821784 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:42.302333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0adace1-512d-4a7b-9c48-9d1378821784 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:42.303121 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0adace1-512d-4a7b-9c48-9d1378821784 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:42.303567 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b0adace1-512d-4a7b-9c48-9d1378821784 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:42.454111 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b0adace1-512d-4a7b-9c48-9d1378821784 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:42.462868 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b0adace1-512d-4a7b-9c48-9d1378821784 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1271 microversion: 2.1 time: 0.174641 Aug 02 08:15:42.464255 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3740/7559] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:42 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:43.484968 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-fa772b78-ec1d-404e-ac16-34909d6797e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:43.485525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-fa772b78-ec1d-404e-ac16-34909d6797e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:43.493076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa772b78-ec1d-404e-ac16-34909d6797e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:43.493724 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa772b78-ec1d-404e-ac16-34909d6797e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:43.494536 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa772b78-ec1d-404e-ac16-34909d6797e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:43.494973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-fa772b78-ec1d-404e-ac16-34909d6797e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:43.656886 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-fa772b78-ec1d-404e-ac16-34909d6797e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:43.664707 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-fa772b78-ec1d-404e-ac16-34909d6797e3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1271 microversion: 2.1 time: 0.184364 Aug 02 08:15:43.665284 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3820/7560] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:43 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:44.686346 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-495059d9-1d0f-4525-a34c-06fdc17e5b3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:44.686992 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-495059d9-1d0f-4525-a34c-06fdc17e5b3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:44.694744 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-495059d9-1d0f-4525-a34c-06fdc17e5b3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:44.695201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-495059d9-1d0f-4525-a34c-06fdc17e5b3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:44.695994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-495059d9-1d0f-4525-a34c-06fdc17e5b3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:44.696447 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-495059d9-1d0f-4525-a34c-06fdc17e5b3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:44.837857 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-495059d9-1d0f-4525-a34c-06fdc17e5b3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:44.846269 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-495059d9-1d0f-4525-a34c-06fdc17e5b3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1259 microversion: 2.1 time: 0.164170 Aug 02 08:15:44.846867 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3741/7561] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:44 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:45.869852 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-793fc98e-87f8-4ade-841a-1ecaa943baa7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:45.870516 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-793fc98e-87f8-4ade-841a-1ecaa943baa7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:45.877936 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-793fc98e-87f8-4ade-841a-1ecaa943baa7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:45.878379 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-793fc98e-87f8-4ade-841a-1ecaa943baa7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:45.879137 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-793fc98e-87f8-4ade-841a-1ecaa943baa7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:45.879567 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-793fc98e-87f8-4ade-841a-1ecaa943baa7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:46.037850 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-793fc98e-87f8-4ade-841a-1ecaa943baa7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:46.045915 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-793fc98e-87f8-4ade-841a-1ecaa943baa7 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1259 microversion: 2.1 time: 0.180052 Aug 02 08:15:46.046520 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3821/7562] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:45 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:47.067519 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9bdf1fee-ff54-4e64-a499-547dc8dcf5ec tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:47.068314 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9bdf1fee-ff54-4e64-a499-547dc8dcf5ec tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:47.071165 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:47.071847 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:47.078962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bdf1fee-ff54-4e64-a499-547dc8dcf5ec tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:47.079427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bdf1fee-ff54-4e64-a499-547dc8dcf5ec tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:47.080246 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bdf1fee-ff54-4e64-a499-547dc8dcf5ec tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:47.080688 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9bdf1fee-ff54-4e64-a499-547dc8dcf5ec tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:47.230664 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9bdf1fee-ff54-4e64-a499-547dc8dcf5ec tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:47.239506 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9bdf1fee-ff54-4e64-a499-547dc8dcf5ec tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1259 microversion: 2.1 time: 0.175950 Aug 02 08:15:47.240079 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3742/7563] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:47 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:48.266144 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-83a647db-24b0-4a0a-bac6-02cd7057d194 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:48.267164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-83a647db-24b0-4a0a-bac6-02cd7057d194 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:48.271525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:48.280665 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83a647db-24b0-4a0a-bac6-02cd7057d194 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:48.281410 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83a647db-24b0-4a0a-bac6-02cd7057d194 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:48.282701 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83a647db-24b0-4a0a-bac6-02cd7057d194 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:48.283452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-83a647db-24b0-4a0a-bac6-02cd7057d194 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:48.430025 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-83a647db-24b0-4a0a-bac6-02cd7057d194 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:48.437780 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-83a647db-24b0-4a0a-bac6-02cd7057d194 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1259 microversion: 2.1 time: 0.178660 Aug 02 08:15:48.438364 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3822/7564] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:48 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:49.459640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f61ff503-fdc2-46a8-bc85-f5db88c2ec2a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:49.460176 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f61ff503-fdc2-46a8-bc85-f5db88c2ec2a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:49.467476 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f61ff503-fdc2-46a8-bc85-f5db88c2ec2a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:49.467942 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f61ff503-fdc2-46a8-bc85-f5db88c2ec2a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:49.468739 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f61ff503-fdc2-46a8-bc85-f5db88c2ec2a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:49.469187 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f61ff503-fdc2-46a8-bc85-f5db88c2ec2a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:49.627965 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f61ff503-fdc2-46a8-bc85-f5db88c2ec2a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:49.638213 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f61ff503-fdc2-46a8-bc85-f5db88c2ec2a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1259 microversion: 2.1 time: 0.182698 Aug 02 08:15:49.638925 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3743/7565] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:49 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:50.662942 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-095493c1-725a-4f9b-adfa-d44616e8555c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:50.663519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-095493c1-725a-4f9b-adfa-d44616e8555c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:50.671118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-095493c1-725a-4f9b-adfa-d44616e8555c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:50.671531 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-095493c1-725a-4f9b-adfa-d44616e8555c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:50.672306 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-095493c1-725a-4f9b-adfa-d44616e8555c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:50.672749 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-095493c1-725a-4f9b-adfa-d44616e8555c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:50.818858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-095493c1-725a-4f9b-adfa-d44616e8555c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:50.826501 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-095493c1-725a-4f9b-adfa-d44616e8555c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1259 microversion: 2.1 time: 0.169630 Aug 02 08:15:50.827071 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3823/7566] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:50 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:51.848833 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9cfaa2ea-d814-497d-b77d-152cffbcebb4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:51.849495 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9cfaa2ea-d814-497d-b77d-152cffbcebb4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:51.856946 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9cfaa2ea-d814-497d-b77d-152cffbcebb4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:51.857406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9cfaa2ea-d814-497d-b77d-152cffbcebb4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:51.858221 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9cfaa2ea-d814-497d-b77d-152cffbcebb4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:51.858669 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9cfaa2ea-d814-497d-b77d-152cffbcebb4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:51.998868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9cfaa2ea-d814-497d-b77d-152cffbcebb4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:52.006841 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9cfaa2ea-d814-497d-b77d-152cffbcebb4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1259 microversion: 2.1 time: 0.161983 Aug 02 08:15:52.007404 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3744/7567] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:51 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:53.029917 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-97c8914f-6f45-4f4e-bcef-2f5f03d09243 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:53.030537 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-97c8914f-6f45-4f4e-bcef-2f5f03d09243 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:53.038046 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97c8914f-6f45-4f4e-bcef-2f5f03d09243 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:53.038412 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97c8914f-6f45-4f4e-bcef-2f5f03d09243 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:53.039182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97c8914f-6f45-4f4e-bcef-2f5f03d09243 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:53.039600 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97c8914f-6f45-4f4e-bcef-2f5f03d09243 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:53.180020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-97c8914f-6f45-4f4e-bcef-2f5f03d09243 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:53.187880 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-97c8914f-6f45-4f4e-bcef-2f5f03d09243 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1259 microversion: 2.1 time: 0.161891 Aug 02 08:15:53.188433 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3824/7568] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:53 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:54.209129 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1e22d428-1719-427c-a1a6-eb5eb416ade0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:54.209729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1e22d428-1719-427c-a1a6-eb5eb416ade0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:54.217150 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e22d428-1719-427c-a1a6-eb5eb416ade0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:54.217623 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e22d428-1719-427c-a1a6-eb5eb416ade0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:54.218478 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e22d428-1719-427c-a1a6-eb5eb416ade0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:54.218929 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e22d428-1719-427c-a1a6-eb5eb416ade0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:54.354526 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1e22d428-1719-427c-a1a6-eb5eb416ade0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:54.362276 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1e22d428-1719-427c-a1a6-eb5eb416ade0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1259 microversion: 2.1 time: 0.157235 Aug 02 08:15:54.362861 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3745/7569] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:54 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:55.383664 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d8151712-af55-46c1-8cf4-8f9319980361 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:55.384639 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d8151712-af55-46c1-8cf4-8f9319980361 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:55.392191 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8151712-af55-46c1-8cf4-8f9319980361 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:55.392631 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8151712-af55-46c1-8cf4-8f9319980361 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:55.393383 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8151712-af55-46c1-8cf4-8f9319980361 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:55.394044 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d8151712-af55-46c1-8cf4-8f9319980361 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:55.534479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d8151712-af55-46c1-8cf4-8f9319980361 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:55.542770 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d8151712-af55-46c1-8cf4-8f9319980361 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1259 microversion: 2.1 time: 0.163135 Aug 02 08:15:55.543340 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3825/7570] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:55 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:55.851338 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-a139c9c6-5c98-48e2-a01e-125e56ee15c4 req-dff7e37e-9b41-42e4-9fa3-9ba065f2449f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028ae8e0-22ab-4ab6-92d4-7bb6584e49b7", "name": "network-vif-plugged", "status": "completed", "tag": "573c9128-b267-4f9d-9cd5-367dddc0f2f9"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:15:55.862145 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a139c9c6-5c98-48e2-a01e-125e56ee15c4 req-dff7e37e-9b41-42e4-9fa3-9ba065f2449f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:55.862602 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-a139c9c6-5c98-48e2-a01e-125e56ee15c4 req-dff7e37e-9b41-42e4-9fa3-9ba065f2449f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:55.873713 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-a139c9c6-5c98-48e2-a01e-125e56ee15c4 req-dff7e37e-9b41-42e4-9fa3-9ba065f2449f service nova] Creating event network-vif-plugged:573c9128-b267-4f9d-9cd5-367dddc0f2f9 for instance 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 on n-h2-851337-3 Aug 02 08:15:55.878792 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-a139c9c6-5c98-48e2-a01e-125e56ee15c4 req-dff7e37e-9b41-42e4-9fa3-9ba065f2449f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091525 Aug 02 08:15:55.879383 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3746/7571] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:15:56.564390 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b937d4e4-99d9-4dc9-a572-fd8af7f444a4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:56.564996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b937d4e4-99d9-4dc9-a572-fd8af7f444a4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:56.572451 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b937d4e4-99d9-4dc9-a572-fd8af7f444a4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:56.572893 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b937d4e4-99d9-4dc9-a572-fd8af7f444a4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:56.573650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b937d4e4-99d9-4dc9-a572-fd8af7f444a4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:56.574115 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b937d4e4-99d9-4dc9-a572-fd8af7f444a4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:56.706837 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b937d4e4-99d9-4dc9-a572-fd8af7f444a4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:56.715474 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b937d4e4-99d9-4dc9-a572-fd8af7f444a4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1259 microversion: 2.1 time: 0.155162 Aug 02 08:15:56.716038 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3826/7572] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:56 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:57.738066 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9d5bbb7d-eeda-42dd-98c6-d1390d8d14da tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:57.738788 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9d5bbb7d-eeda-42dd-98c6-d1390d8d14da tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:57.747000 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d5bbb7d-eeda-42dd-98c6-d1390d8d14da tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:57.747453 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d5bbb7d-eeda-42dd-98c6-d1390d8d14da tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:57.748290 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d5bbb7d-eeda-42dd-98c6-d1390d8d14da tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:57.748740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9d5bbb7d-eeda-42dd-98c6-d1390d8d14da tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:57.905572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9d5bbb7d-eeda-42dd-98c6-d1390d8d14da tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:57.913818 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9d5bbb7d-eeda-42dd-98c6-d1390d8d14da tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1442 microversion: 2.1 time: 0.180150 Aug 02 08:15:57.914433 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3747/7573] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:57 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1442 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:57.934481 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-9b0c57eb-ff29-4413-aaf8-e4b3f2a21396 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:15:57.935102 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-9b0c57eb-ff29-4413-aaf8-e4b3f2a21396 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:15:57.942627 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b0c57eb-ff29-4413-aaf8-e4b3f2a21396 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:57.943075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b0c57eb-ff29-4413-aaf8-e4b3f2a21396 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:57.943851 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b0c57eb-ff29-4413-aaf8-e4b3f2a21396 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:57.944334 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-9b0c57eb-ff29-4413-aaf8-e4b3f2a21396 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:58.080801 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-9b0c57eb-ff29-4413-aaf8-e4b3f2a21396 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:15:58.088869 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-9b0c57eb-ff29-4413-aaf8-e4b3f2a21396 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1442 microversion: 2.1 time: 0.158393 Aug 02 08:15:58.089426 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3827/7574] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:15:57 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:15:59.770054 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-b306e9fa-8b80-4a93-9454-459f9f0ef465 req-1669fc5d-b1cb-495a-a08d-b5e87bde9e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028ae8e0-22ab-4ab6-92d4-7bb6584e49b7", "tag": "573c9128-b267-4f9d-9cd5-367dddc0f2f9"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:15:59.791504 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b306e9fa-8b80-4a93-9454-459f9f0ef465 req-1669fc5d-b1cb-495a-a08d-b5e87bde9e60 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:15:59.791956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-b306e9fa-8b80-4a93-9454-459f9f0ef465 req-1669fc5d-b1cb-495a-a08d-b5e87bde9e60 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:15:59.803925 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-b306e9fa-8b80-4a93-9454-459f9f0ef465 req-1669fc5d-b1cb-495a-a08d-b5e87bde9e60 service nova] Creating event network-changed:573c9128-b267-4f9d-9cd5-367dddc0f2f9 for instance 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 on n-h2-851337-3 Aug 02 08:15:59.810506 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-b306e9fa-8b80-4a93-9454-459f9f0ef465 req-1669fc5d-b1cb-495a-a08d-b5e87bde9e60 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043991 Aug 02 08:15:59.811121 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3748/7575] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:17:46.269842 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:17:46.270618 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 08:17:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:17:47.217414 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:17:47.218036 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 08:17:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:17:47.313351 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:17:47.313529 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 08:17:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:17:54.481578 n-d-851337-3 devstack@n-api.service[126120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c0c3e5c9-f933-4314-bd57-3d2ecb041378] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 08:17:54.482762 n-d-851337-3 devstack@n-api.service[126120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da609bec-98c7-4964-8d17-beefad60c655] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 08:17:54.483327 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=24 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:54.484055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=60 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:54.488214 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-417f16cc-b9e9-443c-a3b7-776d7efb2dd1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:17:54.488747 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-417f16cc-b9e9-443c-a3b7-776d7efb2dd1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:17:54.495773 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-417f16cc-b9e9-443c-a3b7-776d7efb2dd1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:17:54.496210 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-417f16cc-b9e9-443c-a3b7-776d7efb2dd1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:17:54.496978 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-417f16cc-b9e9-443c-a3b7-776d7efb2dd1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:17:54.497416 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-417f16cc-b9e9-443c-a3b7-776d7efb2dd1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:17:54.521445 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.objects.instance [None req-417f16cc-b9e9-443c-a3b7-776d7efb2dd1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lazy-loading 'flavor' on Instance uuid 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 {{(pid=126120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 08:17:54.601623 n-d-851337-3 devstack@n-api.service[126120]: ERROR oslo.messaging._drivers.impl_rabbit [None req-417f16cc-b9e9-443c-a3b7-776d7efb2dd1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [6cd0e18e-4b3e-4ae4-875a-0b3d4587f51b] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 02 08:17:55.491752 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] [c0c3e5c9-f933-4314-bd57-3d2ecb041378] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40942. Aug 02 08:17:55.492497 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] [da609bec-98c7-4964-8d17-beefad60c655] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40944. Aug 02 08:17:55.609740 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [None req-417f16cc-b9e9-443c-a3b7-776d7efb2dd1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [6cd0e18e-4b3e-4ae4-875a-0b3d4587f51b] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40946. Aug 02 08:17:55.613749 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-417f16cc-b9e9-443c-a3b7-776d7efb2dd1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "POST /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7/action" status: 202 len: 0 microversion: 2.1 time: 1.133981 Aug 02 08:17:55.614458 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3828/7576] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:17:54 2022] POST /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7/action => generated 0 bytes in 1135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:17:55.622122 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ad41dfa6-acfa-4002-ab8d-84c3526bc6c6] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 08:17:55.623317 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52c7fbf0-ab5b-40ba-9153-7d2f92273477] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 08:17:55.623959 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:55.624715 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=56 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:55.629252 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-608e4390-d8e0-49d4-a2c8-1f017e3b3bf0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:17:55.630005 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-608e4390-d8e0-49d4-a2c8-1f017e3b3bf0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:17:55.638215 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-608e4390-d8e0-49d4-a2c8-1f017e3b3bf0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:17:55.638662 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-608e4390-d8e0-49d4-a2c8-1f017e3b3bf0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:17:55.639425 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-608e4390-d8e0-49d4-a2c8-1f017e3b3bf0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:17:55.639886 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-608e4390-d8e0-49d4-a2c8-1f017e3b3bf0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:17:55.782286 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-608e4390-d8e0-49d4-a2c8-1f017e3b3bf0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:17:55.794584 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-608e4390-d8e0-49d4-a2c8-1f017e3b3bf0 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1566 microversion: 2.1 time: 0.174109 Aug 02 08:17:55.795503 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3749/7577] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:17:55 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:17:56.818700 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-45901287-aa5f-47bb-a452-a99efde34c84 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:17:56.819525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-45901287-aa5f-47bb-a452-a99efde34c84 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:17:56.827552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45901287-aa5f-47bb-a452-a99efde34c84 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:17:56.827993 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45901287-aa5f-47bb-a452-a99efde34c84 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:17:56.828822 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45901287-aa5f-47bb-a452-a99efde34c84 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:17:56.829609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-45901287-aa5f-47bb-a452-a99efde34c84 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:17:56.980161 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-45901287-aa5f-47bb-a452-a99efde34c84 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:17:56.990744 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-45901287-aa5f-47bb-a452-a99efde34c84 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1566 microversion: 2.1 time: 0.177166 Aug 02 08:17:56.991242 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3829/7578] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:17:56 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:17:58.016339 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c0051ece-b1fe-4573-962e-63224ea8f03c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:17:58.017370 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c0051ece-b1fe-4573-962e-63224ea8f03c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:17:58.026671 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0051ece-b1fe-4573-962e-63224ea8f03c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:17:58.027133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0051ece-b1fe-4573-962e-63224ea8f03c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:17:58.027920 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0051ece-b1fe-4573-962e-63224ea8f03c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:17:58.028372 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c0051ece-b1fe-4573-962e-63224ea8f03c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:17:58.039717 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] [52c7fbf0-ab5b-40ba-9153-7d2f92273477] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40962. Aug 02 08:17:58.049971 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] [ad41dfa6-acfa-4002-ab8d-84c3526bc6c6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40960. Aug 02 08:17:58.472061 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c0051ece-b1fe-4573-962e-63224ea8f03c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:17:58.480702 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c0051ece-b1fe-4573-962e-63224ea8f03c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1566 microversion: 2.1 time: 0.470767 Aug 02 08:17:58.481282 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3750/7579] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:17:58 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1566 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:17:59.512620 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-bc366906-9814-43da-9871-ad358a663c7a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:17:59.514136 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-bc366906-9814-43da-9871-ad358a663c7a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:17:59.521286 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc366906-9814-43da-9871-ad358a663c7a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:17:59.521737 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc366906-9814-43da-9871-ad358a663c7a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:17:59.522538 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc366906-9814-43da-9871-ad358a663c7a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:17:59.522977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-bc366906-9814-43da-9871-ad358a663c7a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:17:59.672148 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-bc366906-9814-43da-9871-ad358a663c7a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:17:59.680442 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-bc366906-9814-43da-9871-ad358a663c7a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1566 microversion: 2.1 time: 0.173188 Aug 02 08:17:59.681065 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3830/7580] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:17:59 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:00.705316 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ae5ee16a-c50f-42da-a9fe-3531330eab46 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:00.705969 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ae5ee16a-c50f-42da-a9fe-3531330eab46 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:00.718712 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae5ee16a-c50f-42da-a9fe-3531330eab46 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:00.719178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae5ee16a-c50f-42da-a9fe-3531330eab46 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:00.719961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae5ee16a-c50f-42da-a9fe-3531330eab46 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:00.720464 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ae5ee16a-c50f-42da-a9fe-3531330eab46 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:00.871429 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ae5ee16a-c50f-42da-a9fe-3531330eab46 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:00.879586 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ae5ee16a-c50f-42da-a9fe-3531330eab46 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1566 microversion: 2.1 time: 0.180801 Aug 02 08:18:00.880158 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3751/7581] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:00 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:01.904088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-374183d4-8f98-4a26-aedb-4cc7e7165fc4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:01.904726 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-374183d4-8f98-4a26-aedb-4cc7e7165fc4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:01.913427 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-374183d4-8f98-4a26-aedb-4cc7e7165fc4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:01.913868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-374183d4-8f98-4a26-aedb-4cc7e7165fc4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:01.914672 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-374183d4-8f98-4a26-aedb-4cc7e7165fc4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:01.915106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-374183d4-8f98-4a26-aedb-4cc7e7165fc4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:02.057008 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-374183d4-8f98-4a26-aedb-4cc7e7165fc4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:02.065144 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-374183d4-8f98-4a26-aedb-4cc7e7165fc4 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1566 microversion: 2.1 time: 0.167686 Aug 02 08:18:02.065849 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3831/7582] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:01 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:03.091185 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-2e1f7cee-7e93-4577-9a43-6a5d6bf25848 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:03.092406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-2e1f7cee-7e93-4577-9a43-6a5d6bf25848 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:03.096656 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:18:03.096839 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 08:18:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 (ip 10.222.0.79) !!! Aug 02 08:18:03.107332 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e1f7cee-7e93-4577-9a43-6a5d6bf25848 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:03.107794 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e1f7cee-7e93-4577-9a43-6a5d6bf25848 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:03.108674 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e1f7cee-7e93-4577-9a43-6a5d6bf25848 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:03.109633 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-2e1f7cee-7e93-4577-9a43-6a5d6bf25848 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:03.258943 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-2e1f7cee-7e93-4577-9a43-6a5d6bf25848 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:03.267375 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-2e1f7cee-7e93-4577-9a43-6a5d6bf25848 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1566 microversion: 2.1 time: 0.180824 Aug 02 08:18:03.268095 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3752/7583] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:03 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:04.296853 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4a839ed1-1b1e-4b9e-b072-ee65d4aa10cf tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:04.297511 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4a839ed1-1b1e-4b9e-b072-ee65d4aa10cf tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:04.305525 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a839ed1-1b1e-4b9e-b072-ee65d4aa10cf tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:04.306171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a839ed1-1b1e-4b9e-b072-ee65d4aa10cf tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:04.306973 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a839ed1-1b1e-4b9e-b072-ee65d4aa10cf tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:04.307471 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4a839ed1-1b1e-4b9e-b072-ee65d4aa10cf tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:04.461041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4a839ed1-1b1e-4b9e-b072-ee65d4aa10cf tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:04.469638 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4a839ed1-1b1e-4b9e-b072-ee65d4aa10cf tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1566 microversion: 2.1 time: 0.179131 Aug 02 08:18:04.470228 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3832/7584] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:04 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:05.496309 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-c447acf4-4087-4157-b1df-bd94b0e5ab3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:05.497114 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-c447acf4-4087-4157-b1df-bd94b0e5ab3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:05.505703 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c447acf4-4087-4157-b1df-bd94b0e5ab3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:05.506101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c447acf4-4087-4157-b1df-bd94b0e5ab3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:05.506834 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c447acf4-4087-4157-b1df-bd94b0e5ab3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:05.507258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-c447acf4-4087-4157-b1df-bd94b0e5ab3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:05.651769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-c447acf4-4087-4157-b1df-bd94b0e5ab3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:05.659671 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-c447acf4-4087-4157-b1df-bd94b0e5ab3d tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1566 microversion: 2.1 time: 0.171136 Aug 02 08:18:05.660242 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3753/7585] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:05 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:18:06.682049 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-455edba3-906e-4444-8cb0-732faa760a49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:06.683084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-455edba3-906e-4444-8cb0-732faa760a49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:06.693552 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-455edba3-906e-4444-8cb0-732faa760a49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:06.694402 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-455edba3-906e-4444-8cb0-732faa760a49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:06.695535 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-455edba3-906e-4444-8cb0-732faa760a49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:06.695947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-455edba3-906e-4444-8cb0-732faa760a49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:06.857677 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-455edba3-906e-4444-8cb0-732faa760a49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:06.870231 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-455edba3-906e-4444-8cb0-732faa760a49 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1566 microversion: 2.1 time: 0.191959 Aug 02 08:18:06.870968 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3833/7586] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:06 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:07.892502 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9dd39ec7-f4b7-4cb9-b4fd-b3d22966ef62 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:07.893222 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9dd39ec7-f4b7-4cb9-b4fd-b3d22966ef62 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:07.900644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9dd39ec7-f4b7-4cb9-b4fd-b3d22966ef62 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:07.901207 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9dd39ec7-f4b7-4cb9-b4fd-b3d22966ef62 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:07.902029 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9dd39ec7-f4b7-4cb9-b4fd-b3d22966ef62 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:07.902474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9dd39ec7-f4b7-4cb9-b4fd-b3d22966ef62 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:08.057200 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9dd39ec7-f4b7-4cb9-b4fd-b3d22966ef62 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:08.066579 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9dd39ec7-f4b7-4cb9-b4fd-b3d22966ef62 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1566 microversion: 2.1 time: 0.178062 Aug 02 08:18:08.067156 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3754/7587] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:07 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:09.089285 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d72ec2f4-4312-4778-aa3f-a99a1d3ba319 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:09.089829 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d72ec2f4-4312-4778-aa3f-a99a1d3ba319 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:09.097372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d72ec2f4-4312-4778-aa3f-a99a1d3ba319 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:09.097854 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d72ec2f4-4312-4778-aa3f-a99a1d3ba319 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:09.098642 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d72ec2f4-4312-4778-aa3f-a99a1d3ba319 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:09.099081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d72ec2f4-4312-4778-aa3f-a99a1d3ba319 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:09.246109 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d72ec2f4-4312-4778-aa3f-a99a1d3ba319 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:09.255779 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d72ec2f4-4312-4778-aa3f-a99a1d3ba319 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1566 microversion: 2.1 time: 0.170673 Aug 02 08:18:09.256372 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3834/7588] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:09 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:10.278997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-15756c01-1bf5-49a5-8b9c-c47969e35f37 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:10.279610 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-15756c01-1bf5-49a5-8b9c-c47969e35f37 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:10.287279 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15756c01-1bf5-49a5-8b9c-c47969e35f37 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:10.287770 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15756c01-1bf5-49a5-8b9c-c47969e35f37 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:10.288570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15756c01-1bf5-49a5-8b9c-c47969e35f37 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:10.289035 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-15756c01-1bf5-49a5-8b9c-c47969e35f37 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:10.424661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-15756c01-1bf5-49a5-8b9c-c47969e35f37 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:10.432799 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-15756c01-1bf5-49a5-8b9c-c47969e35f37 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1507 microversion: 2.1 time: 0.158062 Aug 02 08:18:10.433465 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3755/7589] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:10 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:10.455409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a12fdda3-ad0f-43ee-89b0-3985952964a1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:18:10.455969 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a12fdda3-ad0f-43ee-89b0-3985952964a1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:10.463995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a12fdda3-ad0f-43ee-89b0-3985952964a1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:10.463995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a12fdda3-ad0f-43ee-89b0-3985952964a1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:10.463995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a12fdda3-ad0f-43ee-89b0-3985952964a1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:10.463995 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a12fdda3-ad0f-43ee-89b0-3985952964a1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:10.555728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a12fdda3-ad0f-43ee-89b0-3985952964a1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126120) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 08:18:10.626245 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a12fdda3-ad0f-43ee-89b0-3985952964a1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "POST /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7/action" status: 202 len: 0 microversion: 2.1 time: 0.175383 Aug 02 08:18:10.626798 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3835/7590] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:18:10 2022] POST /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:18:10.635849 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-215d274b-264a-4f9e-ba82-e571752649c2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:10.636722 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-215d274b-264a-4f9e-ba82-e571752649c2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:10.643266 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-215d274b-264a-4f9e-ba82-e571752649c2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:10.643729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-215d274b-264a-4f9e-ba82-e571752649c2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:10.644553 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-215d274b-264a-4f9e-ba82-e571752649c2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:10.645001 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-215d274b-264a-4f9e-ba82-e571752649c2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:10.786910 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-215d274b-264a-4f9e-ba82-e571752649c2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:10.795346 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-215d274b-264a-4f9e-ba82-e571752649c2 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1515 microversion: 2.1 time: 0.163941 Aug 02 08:18:10.795924 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3756/7591] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:10 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:11.818099 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-552478b0-7837-442a-a80b-2eb1ffbfd8af tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:11.818653 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-552478b0-7837-442a-a80b-2eb1ffbfd8af tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:11.825435 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-552478b0-7837-442a-a80b-2eb1ffbfd8af tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:11.825914 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-552478b0-7837-442a-a80b-2eb1ffbfd8af tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:11.826717 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-552478b0-7837-442a-a80b-2eb1ffbfd8af tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:11.827146 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-552478b0-7837-442a-a80b-2eb1ffbfd8af tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:11.978222 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-552478b0-7837-442a-a80b-2eb1ffbfd8af tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:11.991523 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-552478b0-7837-442a-a80b-2eb1ffbfd8af tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1517 microversion: 2.1 time: 0.178258 Aug 02 08:18:11.992138 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3836/7592] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:11 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:12.408619 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c0619bec-7fb3-4318-a4f3-51d69bd005f8 req-9019b604-a13a-46a1-b3e8-f1a52d2ae1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028ae8e0-22ab-4ab6-92d4-7bb6584e49b7", "name": "network-vif-unplugged", "status": "completed", "tag": "573c9128-b267-4f9d-9cd5-367dddc0f2f9"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:18:12.421428 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c0619bec-7fb3-4318-a4f3-51d69bd005f8 req-9019b604-a13a-46a1-b3e8-f1a52d2ae1d8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:12.422003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c0619bec-7fb3-4318-a4f3-51d69bd005f8 req-9019b604-a13a-46a1-b3e8-f1a52d2ae1d8 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:12.433980 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.compute.server_external_events [req-c0619bec-7fb3-4318-a4f3-51d69bd005f8 req-9019b604-a13a-46a1-b3e8-f1a52d2ae1d8 service nova] Unable to find a host for instance 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7. Dropping event network-vif-unplugged {{(pid=126119) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 02 08:18:12.435340 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c0619bec-7fb3-4318-a4f3-51d69bd005f8 req-9019b604-a13a-46a1-b3e8-f1a52d2ae1d8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031111 Aug 02 08:18:12.436224 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3757/7593] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 02 08:18:13.013592 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-58aacd68-d816-4944-bc9c-bd4cba0f5055 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:13.014356 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-58aacd68-d816-4944-bc9c-bd4cba0f5055 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:13.022290 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58aacd68-d816-4944-bc9c-bd4cba0f5055 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:13.022722 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58aacd68-d816-4944-bc9c-bd4cba0f5055 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:13.023509 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58aacd68-d816-4944-bc9c-bd4cba0f5055 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:13.023947 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-58aacd68-d816-4944-bc9c-bd4cba0f5055 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:13.164409 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-58aacd68-d816-4944-bc9c-bd4cba0f5055 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:13.172563 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-58aacd68-d816-4944-bc9c-bd4cba0f5055 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1517 microversion: 2.1 time: 0.163418 Aug 02 08:18:13.173149 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3837/7594] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:13 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:14.195465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0d0bced2-eaec-46ef-a9d1-dc1d77a3ab43 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:14.196088 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-0d0bced2-eaec-46ef-a9d1-dc1d77a3ab43 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:14.203927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d0bced2-eaec-46ef-a9d1-dc1d77a3ab43 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:14.204393 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d0bced2-eaec-46ef-a9d1-dc1d77a3ab43 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:14.205189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d0bced2-eaec-46ef-a9d1-dc1d77a3ab43 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:14.205648 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-0d0bced2-eaec-46ef-a9d1-dc1d77a3ab43 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:14.360673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-0d0bced2-eaec-46ef-a9d1-dc1d77a3ab43 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:14.368910 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0d0bced2-eaec-46ef-a9d1-dc1d77a3ab43 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1517 microversion: 2.1 time: 0.177692 Aug 02 08:18:14.369526 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3758/7595] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:14 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:15.394345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-85cfe84f-2747-4922-952d-c57e5141e03e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:15.397217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-85cfe84f-2747-4922-952d-c57e5141e03e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:15.407138 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-85cfe84f-2747-4922-952d-c57e5141e03e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:15.407587 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-85cfe84f-2747-4922-952d-c57e5141e03e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:15.408357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-85cfe84f-2747-4922-952d-c57e5141e03e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:15.408786 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-85cfe84f-2747-4922-952d-c57e5141e03e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:15.551123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-85cfe84f-2747-4922-952d-c57e5141e03e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:15.559084 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-85cfe84f-2747-4922-952d-c57e5141e03e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1517 microversion: 2.1 time: 0.171278 Aug 02 08:18:15.559656 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3838/7596] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:15 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:16.582247 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bf5a9dfa-2637-433f-a7d7-d1d5227a73a3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:16.583427 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bf5a9dfa-2637-433f-a7d7-d1d5227a73a3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:16.592486 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf5a9dfa-2637-433f-a7d7-d1d5227a73a3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:16.592966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf5a9dfa-2637-433f-a7d7-d1d5227a73a3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:16.593748 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf5a9dfa-2637-433f-a7d7-d1d5227a73a3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:16.594260 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bf5a9dfa-2637-433f-a7d7-d1d5227a73a3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:16.837843 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bf5a9dfa-2637-433f-a7d7-d1d5227a73a3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:16.847025 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bf5a9dfa-2637-433f-a7d7-d1d5227a73a3 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1573 microversion: 2.1 time: 0.270083 Aug 02 08:18:16.847890 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3759/7597] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:16 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1573 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:17.871275 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-1b63ca3a-d926-459a-89b5-70f7668fb3c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:17.871863 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-1b63ca3a-d926-459a-89b5-70f7668fb3c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:17.880021 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b63ca3a-d926-459a-89b5-70f7668fb3c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:17.880470 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b63ca3a-d926-459a-89b5-70f7668fb3c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:17.881253 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b63ca3a-d926-459a-89b5-70f7668fb3c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:17.881691 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-1b63ca3a-d926-459a-89b5-70f7668fb3c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:18.027305 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-1b63ca3a-d926-459a-89b5-70f7668fb3c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:18.041468 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-1b63ca3a-d926-459a-89b5-70f7668fb3c1 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1573 microversion: 2.1 time: 0.175200 Aug 02 08:18:18.042560 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3839/7598] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:17 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1573 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:19.065100 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d0b27c07-f84e-4912-b333-1932d0e35336 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:19.065936 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d0b27c07-f84e-4912-b333-1932d0e35336 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:19.075617 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0b27c07-f84e-4912-b333-1932d0e35336 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:19.076077 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0b27c07-f84e-4912-b333-1932d0e35336 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:19.076855 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0b27c07-f84e-4912-b333-1932d0e35336 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:19.077488 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d0b27c07-f84e-4912-b333-1932d0e35336 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:19.234972 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d0b27c07-f84e-4912-b333-1932d0e35336 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:19.244532 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d0b27c07-f84e-4912-b333-1932d0e35336 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1573 microversion: 2.1 time: 0.183379 Aug 02 08:18:19.245126 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3760/7599] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:19 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1573 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:20.267920 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4be5e679-a6cb-4406-8495-df1b9690aa22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:20.268549 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4be5e679-a6cb-4406-8495-df1b9690aa22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:20.276213 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4be5e679-a6cb-4406-8495-df1b9690aa22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:20.276658 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4be5e679-a6cb-4406-8495-df1b9690aa22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:20.277615 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4be5e679-a6cb-4406-8495-df1b9690aa22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:20.278106 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4be5e679-a6cb-4406-8495-df1b9690aa22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:20.425484 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4be5e679-a6cb-4406-8495-df1b9690aa22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:20.437306 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4be5e679-a6cb-4406-8495-df1b9690aa22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1573 microversion: 2.1 time: 0.173222 Aug 02 08:18:20.438112 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3840/7600] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:20 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:21.460093 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9a050262-d639-447d-93fd-4087e9385983 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:21.460713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9a050262-d639-447d-93fd-4087e9385983 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:21.468509 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a050262-d639-447d-93fd-4087e9385983 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:21.468966 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a050262-d639-447d-93fd-4087e9385983 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:21.469735 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a050262-d639-447d-93fd-4087e9385983 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:21.470210 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9a050262-d639-447d-93fd-4087e9385983 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:21.609051 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9a050262-d639-447d-93fd-4087e9385983 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:21.617726 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9a050262-d639-447d-93fd-4087e9385983 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1573 microversion: 2.1 time: 0.161699 Aug 02 08:18:21.618311 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3761/7601] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:21 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:22.641071 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-97f2aebc-4af6-4d15-bbed-01ff76b95282 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:22.641650 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-97f2aebc-4af6-4d15-bbed-01ff76b95282 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:22.649442 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97f2aebc-4af6-4d15-bbed-01ff76b95282 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:22.649919 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97f2aebc-4af6-4d15-bbed-01ff76b95282 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:22.650708 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97f2aebc-4af6-4d15-bbed-01ff76b95282 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:22.651123 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-97f2aebc-4af6-4d15-bbed-01ff76b95282 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:22.671028 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:18:22.793546 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-97f2aebc-4af6-4d15-bbed-01ff76b95282 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:22.802057 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-97f2aebc-4af6-4d15-bbed-01ff76b95282 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1573 microversion: 2.1 time: 0.165228 Aug 02 08:18:22.802668 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3841/7602] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:22 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:23.835590 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-61cf175c-f29f-4961-89a4-8c207123855b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:23.836204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-61cf175c-f29f-4961-89a4-8c207123855b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:23.844552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61cf175c-f29f-4961-89a4-8c207123855b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:23.844552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61cf175c-f29f-4961-89a4-8c207123855b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:23.845148 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61cf175c-f29f-4961-89a4-8c207123855b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:23.845594 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-61cf175c-f29f-4961-89a4-8c207123855b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:23.979050 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-61cf175c-f29f-4961-89a4-8c207123855b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:23.987141 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-61cf175c-f29f-4961-89a4-8c207123855b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1573 microversion: 2.1 time: 0.157886 Aug 02 08:18:23.987766 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3762/7603] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:23 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:25.011364 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-79a5d04d-70c7-42eb-b220-d926485508e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:25.012151 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-79a5d04d-70c7-42eb-b220-d926485508e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:25.015173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:18:25.021030 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79a5d04d-70c7-42eb-b220-d926485508e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:25.021479 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79a5d04d-70c7-42eb-b220-d926485508e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:25.022280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79a5d04d-70c7-42eb-b220-d926485508e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:25.022720 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-79a5d04d-70c7-42eb-b220-d926485508e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:25.170023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-79a5d04d-70c7-42eb-b220-d926485508e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:25.178089 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-79a5d04d-70c7-42eb-b220-d926485508e5 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1573 microversion: 2.1 time: 0.172358 Aug 02 08:18:25.178632 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3842/7604] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:25 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:26.204059 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d5e45e7b-7695-4bfb-b32c-37e955c80588 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:26.205320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d5e45e7b-7695-4bfb-b32c-37e955c80588 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:26.209350 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=29 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:18:26.218330 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5e45e7b-7695-4bfb-b32c-37e955c80588 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:26.218793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5e45e7b-7695-4bfb-b32c-37e955c80588 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:26.219581 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5e45e7b-7695-4bfb-b32c-37e955c80588 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:26.220030 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d5e45e7b-7695-4bfb-b32c-37e955c80588 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:26.223012 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=81 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:18:26.361563 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d5e45e7b-7695-4bfb-b32c-37e955c80588 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:26.369397 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d5e45e7b-7695-4bfb-b32c-37e955c80588 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1573 microversion: 2.1 time: 0.172125 Aug 02 08:18:26.370000 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3763/7605] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:26 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:27.402754 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-68200481-4319-4f04-9dd3-a7b5bed97789 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:27.403867 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-68200481-4319-4f04-9dd3-a7b5bed97789 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:27.411499 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68200481-4319-4f04-9dd3-a7b5bed97789 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:27.411946 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68200481-4319-4f04-9dd3-a7b5bed97789 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:27.412715 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68200481-4319-4f04-9dd3-a7b5bed97789 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:27.413150 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-68200481-4319-4f04-9dd3-a7b5bed97789 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:27.559953 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-68200481-4319-4f04-9dd3-a7b5bed97789 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:27.570534 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-68200481-4319-4f04-9dd3-a7b5bed97789 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1573 microversion: 2.1 time: 0.174743 Aug 02 08:18:27.571393 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3843/7606] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:27 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:28.551709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-d86f3c99-2431-4c6c-a4c3-66e3d839f265 req-d7a57a88-6551-4a7b-9bde-fb2a4cd08831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028ae8e0-22ab-4ab6-92d4-7bb6584e49b7", "name": "network-vif-plugged", "status": "completed", "tag": "573c9128-b267-4f9d-9cd5-367dddc0f2f9"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:18:28.562258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d86f3c99-2431-4c6c-a4c3-66e3d839f265 req-d7a57a88-6551-4a7b-9bde-fb2a4cd08831 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:28.562729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-d86f3c99-2431-4c6c-a4c3-66e3d839f265 req-d7a57a88-6551-4a7b-9bde-fb2a4cd08831 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:28.574000 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-d86f3c99-2431-4c6c-a4c3-66e3d839f265 req-d7a57a88-6551-4a7b-9bde-fb2a4cd08831 service nova] Creating event network-vif-plugged:573c9128-b267-4f9d-9cd5-367dddc0f2f9 for instance 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 on n-h2-851337-3 Aug 02 08:18:28.580385 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-d86f3c99-2431-4c6c-a4c3-66e3d839f265 req-d7a57a88-6551-4a7b-9bde-fb2a4cd08831 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032607 Aug 02 08:18:28.581180 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3764/7607] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:18:28.600174 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b9b574ff-30ce-4d2a-97fb-17d65d037b2c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:28.601541 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b9b574ff-30ce-4d2a-97fb-17d65d037b2c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:28.609141 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9b574ff-30ce-4d2a-97fb-17d65d037b2c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:28.610047 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9b574ff-30ce-4d2a-97fb-17d65d037b2c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:28.611261 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9b574ff-30ce-4d2a-97fb-17d65d037b2c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:28.611704 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b9b574ff-30ce-4d2a-97fb-17d65d037b2c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:28.792432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b9b574ff-30ce-4d2a-97fb-17d65d037b2c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:28.800593 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b9b574ff-30ce-4d2a-97fb-17d65d037b2c tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1573 microversion: 2.1 time: 0.204516 Aug 02 08:18:28.801187 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3844/7608] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:28 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1573 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:18:29.823766 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3cb252b7-5fbe-4b67-9b86-7ca9d03ad40e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:18:29.824480 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-3cb252b7-5fbe-4b67-9b86-7ca9d03ad40e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:18:29.830997 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cb252b7-5fbe-4b67-9b86-7ca9d03ad40e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:29.831462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cb252b7-5fbe-4b67-9b86-7ca9d03ad40e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:29.832240 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cb252b7-5fbe-4b67-9b86-7ca9d03ad40e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:18:29.832684 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-3cb252b7-5fbe-4b67-9b86-7ca9d03ad40e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:18:29.968667 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-3cb252b7-5fbe-4b67-9b86-7ca9d03ad40e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:18:29.977157 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3cb252b7-5fbe-4b67-9b86-7ca9d03ad40e tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1560 microversion: 2.1 time: 0.158612 Aug 02 08:18:29.977717 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3765/7609] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:18:29 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:19:49.523367 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=5 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:49.524219 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=13 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:49.525513 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-ee1e47d9-aacd-43f8-bcc7-f543fe5dbe22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:19:49.526731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ee1e47d9-aacd-43f8-bcc7-f543fe5dbe22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:19:49.530018 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=5 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:49.532503 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=20 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:49.540648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee1e47d9-aacd-43f8-bcc7-f543fe5dbe22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:49.541497 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee1e47d9-aacd-43f8-bcc7-f543fe5dbe22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:49.542641 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee1e47d9-aacd-43f8-bcc7-f543fe5dbe22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:49.543173 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-ee1e47d9-aacd-43f8-bcc7-f543fe5dbe22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:49.572839 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-ee1e47d9-aacd-43f8-bcc7-f543fe5dbe22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 08:19:49.602236 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-8e9b738c-bac0-4148-a753-8fd6b9d2122e req-d4c8e313-6e60-4f15-8898-d97a80edf0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028ae8e0-22ab-4ab6-92d4-7bb6584e49b7", "tag": "573c9128-b267-4f9d-9cd5-367dddc0f2f9"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:19:49.613131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8e9b738c-bac0-4148-a753-8fd6b9d2122e req-d4c8e313-6e60-4f15-8898-d97a80edf0d0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:49.613689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-8e9b738c-bac0-4148-a753-8fd6b9d2122e req-d4c8e313-6e60-4f15-8898-d97a80edf0d0 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:49.629082 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-8e9b738c-bac0-4148-a753-8fd6b9d2122e req-d4c8e313-6e60-4f15-8898-d97a80edf0d0 service nova] Creating event network-changed:573c9128-b267-4f9d-9cd5-367dddc0f2f9 for instance 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 on n-h2-851337-3 Aug 02 08:19:49.637043 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-8e9b738c-bac0-4148-a753-8fd6b9d2122e req-d4c8e313-6e60-4f15-8898-d97a80edf0d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115270 Aug 02 08:19:49.640934 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3766/7610] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:19:49.697513 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-ee1e47d9-aacd-43f8-bcc7-f543fe5dbe22 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "DELETE /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 204 len: 0 microversion: 2.1 time: 0.177416 Aug 02 08:19:49.699701 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3845/7611] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 08:19:49 2022] DELETE /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:19:49.709320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-6b7085ba-93c2-4967-add1-4c6a6d2677aa tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:19:49.710327 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-6b7085ba-93c2-4967-add1-4c6a6d2677aa tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:19:49.718034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b7085ba-93c2-4967-add1-4c6a6d2677aa tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:49.718415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b7085ba-93c2-4967-add1-4c6a6d2677aa tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:49.719199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b7085ba-93c2-4967-add1-4c6a6d2677aa tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:49.719640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-6b7085ba-93c2-4967-add1-4c6a6d2677aa tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:49.874689 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-6b7085ba-93c2-4967-add1-4c6a6d2677aa tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:19:49.882859 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-6b7085ba-93c2-4967-add1-4c6a6d2677aa tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1566 microversion: 2.1 time: 0.178129 Aug 02 08:19:49.897159 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3767/7612] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:19:49 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:19:50.906523 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-93757910-d3fd-4837-902f-9215bc9fd15a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:19:50.907228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-93757910-d3fd-4837-902f-9215bc9fd15a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:19:50.915185 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93757910-d3fd-4837-902f-9215bc9fd15a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:50.915685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93757910-d3fd-4837-902f-9215bc9fd15a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:50.916444 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93757910-d3fd-4837-902f-9215bc9fd15a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:50.916909 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-93757910-d3fd-4837-902f-9215bc9fd15a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:51.091217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-93757910-d3fd-4837-902f-9215bc9fd15a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:19:51.100149 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-93757910-d3fd-4837-902f-9215bc9fd15a tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1566 microversion: 2.1 time: 0.198736 Aug 02 08:19:51.100814 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3846/7613] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:19:50 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1566 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:19:51.766172 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-c7445b06-d781-4976-bb6c-842f2555047a req-d530126e-5f85-4c2e-8072-6c0f838f3ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028ae8e0-22ab-4ab6-92d4-7bb6584e49b7", "name": "network-vif-deleted", "tag": "573c9128-b267-4f9d-9cd5-367dddc0f2f9"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:19:51.777041 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c7445b06-d781-4976-bb6c-842f2555047a req-d530126e-5f85-4c2e-8072-6c0f838f3ebd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:51.777365 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-c7445b06-d781-4976-bb6c-842f2555047a req-d530126e-5f85-4c2e-8072-6c0f838f3ebd service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:51.789551 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-c7445b06-d781-4976-bb6c-842f2555047a req-d530126e-5f85-4c2e-8072-6c0f838f3ebd service nova] Creating event network-vif-deleted:573c9128-b267-4f9d-9cd5-367dddc0f2f9 for instance 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 on n-h2-851337-3 Aug 02 08:19:51.794825 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-c7445b06-d781-4976-bb6c-842f2555047a req-d530126e-5f85-4c2e-8072-6c0f838f3ebd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032444 Aug 02 08:19:51.795581 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3768/7614] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:19:52.124519 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-06d98aa6-1796-4ac0-ab98-c1680deade71 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:19:52.125149 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-06d98aa6-1796-4ac0-ab98-c1680deade71 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:19:52.132628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06d98aa6-1796-4ac0-ab98-c1680deade71 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:52.133075 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06d98aa6-1796-4ac0-ab98-c1680deade71 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:52.133847 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06d98aa6-1796-4ac0-ab98-c1680deade71 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:52.134506 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-06d98aa6-1796-4ac0-ab98-c1680deade71 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:52.207023 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-06d98aa6-1796-4ac0-ab98-c1680deade71 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:19:52.215162 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-06d98aa6-1796-4ac0-ab98-c1680deade71 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1219 microversion: 2.1 time: 0.094780 Aug 02 08:19:52.216236 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3847/7615] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:19:52 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:19:53.242868 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-93c5fbc0-7aee-4be0-983a-870579bb1e7f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:19:53.243576 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-93c5fbc0-7aee-4be0-983a-870579bb1e7f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:19:53.250883 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93c5fbc0-7aee-4be0-983a-870579bb1e7f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:53.251341 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93c5fbc0-7aee-4be0-983a-870579bb1e7f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:53.252136 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93c5fbc0-7aee-4be0-983a-870579bb1e7f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:53.252572 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-93c5fbc0-7aee-4be0-983a-870579bb1e7f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:53.322672 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-93c5fbc0-7aee-4be0-983a-870579bb1e7f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:19:53.331163 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-93c5fbc0-7aee-4be0-983a-870579bb1e7f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1219 microversion: 2.1 time: 0.093548 Aug 02 08:19:53.331749 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3769/7616] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:19:53 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:19:54.352972 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-28a7c089-9c92-4000-b1bc-ecaf3b2d5805 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:19:54.353573 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-28a7c089-9c92-4000-b1bc-ecaf3b2d5805 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:19:54.360996 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28a7c089-9c92-4000-b1bc-ecaf3b2d5805 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:54.361432 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28a7c089-9c92-4000-b1bc-ecaf3b2d5805 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:54.362220 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28a7c089-9c92-4000-b1bc-ecaf3b2d5805 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:54.362648 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-28a7c089-9c92-4000-b1bc-ecaf3b2d5805 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:54.428091 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-28a7c089-9c92-4000-b1bc-ecaf3b2d5805 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:19:54.436402 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-28a7c089-9c92-4000-b1bc-ecaf3b2d5805 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1219 microversion: 2.1 time: 0.087349 Aug 02 08:19:54.436979 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3848/7617] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:19:54 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:19:55.457055 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-f5d012f2-6922-4284-bc13-cbc9ba2c893b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:19:55.457680 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-f5d012f2-6922-4284-bc13-cbc9ba2c893b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:19:55.464955 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5d012f2-6922-4284-bc13-cbc9ba2c893b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:55.465406 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5d012f2-6922-4284-bc13-cbc9ba2c893b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:55.466201 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5d012f2-6922-4284-bc13-cbc9ba2c893b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:55.466729 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-f5d012f2-6922-4284-bc13-cbc9ba2c893b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:55.533713 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-f5d012f2-6922-4284-bc13-cbc9ba2c893b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527cd1c0a10047fd9c757e8b55028abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40b49e4d654a45a26d698706531276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:19:55.541936 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-f5d012f2-6922-4284-bc13-cbc9ba2c893b tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 200 len: 1219 microversion: 2.1 time: 0.088922 Aug 02 08:19:55.542723 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3770/7618] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:19:55 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:19:56.563557 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-451e86a2-ac5d-4e53-a7fa-67730959f58f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:19:56.564202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-451e86a2-ac5d-4e53-a7fa-67730959f58f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] [instance: 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:19:56.571004 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-451e86a2-ac5d-4e53-a7fa-67730959f58f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:56.571551 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-451e86a2-ac5d-4e53-a7fa-67730959f58f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:56.572328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-451e86a2-ac5d-4e53-a7fa-67730959f58f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:19:56.572757 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-451e86a2-ac5d-4e53-a7fa-67730959f58f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:19:56.586898 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-451e86a2-ac5d-4e53-a7fa-67730959f58f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] HTTP exception thrown: Instance 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 could not be found. Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-451e86a2-ac5d-4e53-a7fa-67730959f58f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Request method failure captured: Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 HTTP/1.1 Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6Nvv1c8GeTgChklhsKrtikPDNRP4Ks9LdDBjsZcvmkjU91rPf0cTEFfIdaZzVJieu0RvgjjN6yL9VI_DZxALcE4NdCb8-6rIDJ4BRzevKAE7W3sqJGcsBtPFNszwHf6F_2etEZdGXBCqtAnpuN_s-j3mZmjcMdLzezbEwrSKJ5eTX5c Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 5a40b49e4d654a45a26d698706531276 Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestShelveInstance-169171009 Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5a40b49e4d654a45a26d698706531276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5a40b49e4d654a45a26d698706531276"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5a40b49e4d654a45a26d698706531276"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5a40b49e4d654a45a26d698706531276"}]}] Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestShelveInstance-169171009 Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 5a40b49e4d654a45a26d698706531276 Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestShelveInstance-169171009 Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestShelveInstance-169171009-project Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 527cd1c0a10047fd9c757e8b55028abb Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestShelveInstance-169171009-project Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 could not be found. Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '028ae8e0-22ab-4ab6-92d4-7bb6584e49b7'} Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 could not be found. Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 could not be found. Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:19:56.588560 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:19:56.595234 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:19:56.595234 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:19:56.595234 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:19:56.595234 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:19:56.595234 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:19:56.595234 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 could not be found. Aug 02 08:19:56.595234 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:19:56.595234 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-451e86a2-ac5d-4e53-a7fa-67730959f58f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Returning 404 to user: Instance 028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:19:56.595234 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-451e86a2-ac5d-4e53-a7fa-67730959f58f tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7" status: 404 len: 111 microversion: 2.1 time: 0.030611 Aug 02 08:19:56.595234 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3849/7619] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:19:56 2022] GET /compute/v2.1/servers/028ae8e0-22ab-4ab6-92d4-7bb6584e49b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:19:56.792769 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-3e8bfa24-3b1f-4903-8bd3-76cc745617f9 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] Calling method '.version_select at 0x7f927aa31ca0>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:19:56.836205 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-3e8bfa24-3b1f-4903-8bd3-76cc745617f9 tempest-TestShelveInstance-169171009 tempest-TestShelveInstance-169171009-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2125989603" status: 202 len: 0 microversion: 2.1 time: 0.056914 Aug 02 08:19:56.837052 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3771/7620] 10.222.0.79 () {58 vars in 1254 bytes} [Tue Aug 2 08:19:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2125989603 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:20:15.649192 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:20:15.650719 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:20:15.847692 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-3723a544-0ff5-4f43-a68f-c8af462767f5 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Action: 'create', calling method: .version_select at 0x7f9279bde3a0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-597197763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0LgGhuwWVLAyiAx1uMLTYGwGh9L1VcWEE3IbmGprYaRSCE1ySZ140r8jANQGe8uVwuujk2f6bmVD2FVJVvnaI8bn+ocBmc4c6Ps+JUGsG2mgD0z/gbrxOxq71nHT5WMQ=="}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:20:15.879118 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-3723a544-0ff5-4f43-a68f-c8af462767f5 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Getting quotas for project 9365bbd09a88446e8e554a93606fb3d7. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:20:15.892317 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-3723a544-0ff5-4f43-a68f-c8af462767f5 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Getting quotas for user 0d87bf6966554e0d81929040d2972fea and project 9365bbd09a88446e8e554a93606fb3d7. Resources: {'key_pairs'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:20:15.925332 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-3723a544-0ff5-4f43-a68f-c8af462767f5 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.282440 Aug 02 08:20:15.931837 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3850/7621] 10.222.0.79 () {60 vars in 1159 bytes} [Tue Aug 2 08:20:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:20:17.152947 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=22 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:20:17.153750 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:20:17.157962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1006803647", "imageRef": "fbc11386-7cb6-4309-932b-7acee00d4676", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-597197763", "security_groups": [{"name": "tempest-secgroup-smoke-1650110543"}], "networks": [{"uuid": "678e4cde-2c24-4c8a-80ca-900c19aa2e25"}]}} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:20:17.400270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.network.neutron [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] validate_networks() for [('678e4cde-2c24-4c8a-80ca-900c19aa2e25', None, None, None, None, None)] {{(pid=126119) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:20:17.788401 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Flavor limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:20:17.788837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Image limits 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:20:17.789333 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Flavor pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:20:17.789752 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Image pref 0:0:0 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:20:17.790199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.virt.hardware [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126119) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:20:17.799731 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:17.800199 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:17.801014 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:17.801501 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:17.819204 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Getting quotas for project 9365bbd09a88446e8e554a93606fb3d7. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:20:17.824570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.quota [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Getting quotas for user 0d87bf6966554e0d81929040d2972fea and project 9365bbd09a88446e8e554a93606fb3d7. Resources: {'ram', 'instances', 'cores'} {{(pid=126119) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:20:17.837626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Going to run 1 instances... {{(pid=126119) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:20:17.840162 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbc11386-7cb6-4309-932b-7acee00d4676',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126119) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:20:17.893165 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-5834fb6b-d5ee-4337-9d42-ed10ef50188e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.742051 Aug 02 08:20:17.893815 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3772/7622] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 08:20:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:20:17.906859 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-af0cdd09-a265-404d-ae09-b9cf0b0c94f0 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:20:17.907517 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-af0cdd09-a265-404d-ae09-b9cf0b0c94f0 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:20:18.143956 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-af0cdd09-a265-404d-ae09-b9cf0b0c94f0 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:20:18.151314 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-af0cdd09-a265-404d-ae09-b9cf0b0c94f0 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 200 len: 1248 microversion: 2.1 time: 0.250149 Aug 02 08:20:18.151917 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3851/7623] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:20:17 2022] GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 1248 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:20:19.173251 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-50d3a17f-befe-4440-977d-e32e60b27c11 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:20:19.174009 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-50d3a17f-befe-4440-977d-e32e60b27c11 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:20:19.182687 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50d3a17f-befe-4440-977d-e32e60b27c11 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:19.184085 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50d3a17f-befe-4440-977d-e32e60b27c11 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:19.184984 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50d3a17f-befe-4440-977d-e32e60b27c11 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:19.185716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-50d3a17f-befe-4440-977d-e32e60b27c11 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:19.269964 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-50d3a17f-befe-4440-977d-e32e60b27c11 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:20:19.279895 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-50d3a17f-befe-4440-977d-e32e60b27c11 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 200 len: 1306 microversion: 2.1 time: 0.110629 Aug 02 08:20:19.281385 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3773/7624] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:20:19 2022] GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 1306 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:20:20.309092 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-75ea109f-c59b-4d14-ba10-bb886ccb5ad1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:20:20.311322 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-75ea109f-c59b-4d14-ba10-bb886ccb5ad1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:20:20.323424 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75ea109f-c59b-4d14-ba10-bb886ccb5ad1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:20.324131 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75ea109f-c59b-4d14-ba10-bb886ccb5ad1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:20.325182 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75ea109f-c59b-4d14-ba10-bb886ccb5ad1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:20.326320 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-75ea109f-c59b-4d14-ba10-bb886ccb5ad1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:20.553950 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-75ea109f-c59b-4d14-ba10-bb886ccb5ad1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:20:20.563322 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-75ea109f-c59b-4d14-ba10-bb886ccb5ad1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 200 len: 1374 microversion: 2.1 time: 0.258844 Aug 02 08:20:20.563914 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3852/7625] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:20:20 2022] GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 1374 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:20:20.660778 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-3964f85e-07bb-4e26-b891-299918d8f6f1 req-249370f2-c319-4ce4-9561-173ec24a0227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e1d6fb-2ba0-4147-841d-5626b427a99e", "tag": "b802a362-827d-4f52-a9ab-878025693fda"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:20:20.672605 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3964f85e-07bb-4e26-b891-299918d8f6f1 req-249370f2-c319-4ce4-9561-173ec24a0227 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:20.673153 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-3964f85e-07bb-4e26-b891-299918d8f6f1 req-249370f2-c319-4ce4-9561-173ec24a0227 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:20.686401 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-3964f85e-07bb-4e26-b891-299918d8f6f1 req-249370f2-c319-4ce4-9561-173ec24a0227 service nova] Creating event network-changed:b802a362-827d-4f52-a9ab-878025693fda for instance 96e1d6fb-2ba0-4147-841d-5626b427a99e on n-h2-851337-3 Aug 02 08:20:20.691733 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-3964f85e-07bb-4e26-b891-299918d8f6f1 req-249370f2-c319-4ce4-9561-173ec24a0227 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034840 Aug 02 08:20:20.692506 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3774/7626] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:20:21.589622 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-b0cfbe85-70c8-4de6-bcb6-22976b834eb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:20:21.590217 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-b0cfbe85-70c8-4de6-bcb6-22976b834eb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:20:21.604157 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0cfbe85-70c8-4de6-bcb6-22976b834eb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:21.604607 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0cfbe85-70c8-4de6-bcb6-22976b834eb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:21.605474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0cfbe85-70c8-4de6-bcb6-22976b834eb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:21.606200 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-b0cfbe85-70c8-4de6-bcb6-22976b834eb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:21.768163 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-b0cfbe85-70c8-4de6-bcb6-22976b834eb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:20:21.778015 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-b0cfbe85-70c8-4de6-bcb6-22976b834eb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 200 len: 1374 microversion: 2.1 time: 0.194059 Aug 02 08:20:21.778621 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3853/7627] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:20:21 2022] GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 1374 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:20:22.804896 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-b1ee6850-b663-4e0f-a19d-b1b0fbcb05dc tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:20:22.805474 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-b1ee6850-b663-4e0f-a19d-b1b0fbcb05dc tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:20:22.812527 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1ee6850-b663-4e0f-a19d-b1b0fbcb05dc tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:22.812994 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1ee6850-b663-4e0f-a19d-b1b0fbcb05dc tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:22.813780 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1ee6850-b663-4e0f-a19d-b1b0fbcb05dc tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:22.814275 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-b1ee6850-b663-4e0f-a19d-b1b0fbcb05dc tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:23.287927 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-b1ee6850-b663-4e0f-a19d-b1b0fbcb05dc tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:20:23.298071 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-b1ee6850-b663-4e0f-a19d-b1b0fbcb05dc tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 200 len: 1374 microversion: 2.1 time: 0.498507 Aug 02 08:20:23.298653 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3775/7628] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:20:22 2022] GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 1374 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:20:24.319512 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-04401fee-08a4-4586-b013-c89c92add668 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:20:24.320073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-04401fee-08a4-4586-b013-c89c92add668 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:20:24.327596 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04401fee-08a4-4586-b013-c89c92add668 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:24.328052 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04401fee-08a4-4586-b013-c89c92add668 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:24.328830 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04401fee-08a4-4586-b013-c89c92add668 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:24.329272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-04401fee-08a4-4586-b013-c89c92add668 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:24.488901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-04401fee-08a4-4586-b013-c89c92add668 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:20:24.496796 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-04401fee-08a4-4586-b013-c89c92add668 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 200 len: 1374 microversion: 2.1 time: 0.181381 Aug 02 08:20:24.497385 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3854/7629] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:20:24 2022] GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:20:25.518550 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e67308ae-0fa3-45af-ab22-7fd434f53245 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:20:25.519160 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e67308ae-0fa3-45af-ab22-7fd434f53245 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:20:25.526133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e67308ae-0fa3-45af-ab22-7fd434f53245 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:25.526598 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e67308ae-0fa3-45af-ab22-7fd434f53245 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:25.527388 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e67308ae-0fa3-45af-ab22-7fd434f53245 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:25.527831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e67308ae-0fa3-45af-ab22-7fd434f53245 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:25.678661 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-e67308ae-0fa3-45af-ab22-7fd434f53245 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:20:25.688767 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e67308ae-0fa3-45af-ab22-7fd434f53245 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 200 len: 1374 microversion: 2.1 time: 0.174146 Aug 02 08:20:25.689348 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3776/7630] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:20:25 2022] GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:20:26.710728 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a8168573-2f59-4e69-ac04-66462c04e1da tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:20:26.711419 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a8168573-2f59-4e69-ac04-66462c04e1da tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:20:26.718415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8168573-2f59-4e69-ac04-66462c04e1da tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:26.718868 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8168573-2f59-4e69-ac04-66462c04e1da tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:26.719634 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8168573-2f59-4e69-ac04-66462c04e1da tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:26.720070 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a8168573-2f59-4e69-ac04-66462c04e1da tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:26.868088 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a8168573-2f59-4e69-ac04-66462c04e1da tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:20:26.879484 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a8168573-2f59-4e69-ac04-66462c04e1da tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 200 len: 1374 microversion: 2.1 time: 0.172614 Aug 02 08:20:26.880339 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3855/7631] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:20:26 2022] GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:20:27.074977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-e8028889-f9c9-4c2a-ab4b-3a4a2df1438d req-09b4d1b8-7a59-4ec7-bb0a-01329a920801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e1d6fb-2ba0-4147-841d-5626b427a99e", "name": "network-vif-plugged", "status": "completed", "tag": "b802a362-827d-4f52-a9ab-878025693fda"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:20:27.088188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e8028889-f9c9-4c2a-ab4b-3a4a2df1438d req-09b4d1b8-7a59-4ec7-bb0a-01329a920801 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:27.088716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-e8028889-f9c9-4c2a-ab4b-3a4a2df1438d req-09b4d1b8-7a59-4ec7-bb0a-01329a920801 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:27.100876 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-e8028889-f9c9-4c2a-ab4b-3a4a2df1438d req-09b4d1b8-7a59-4ec7-bb0a-01329a920801 service nova] Creating event network-vif-plugged:b802a362-827d-4f52-a9ab-878025693fda for instance 96e1d6fb-2ba0-4147-841d-5626b427a99e on n-h2-851337-3 Aug 02 08:20:27.106564 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-e8028889-f9c9-4c2a-ab4b-3a4a2df1438d req-09b4d1b8-7a59-4ec7-bb0a-01329a920801 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035361 Aug 02 08:20:27.107487 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3777/7632] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:20:27.905171 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-73c6c37f-3bbe-4d29-bf7c-e505f7d8d934 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:20:27.905821 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-73c6c37f-3bbe-4d29-bf7c-e505f7d8d934 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:20:27.913368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73c6c37f-3bbe-4d29-bf7c-e505f7d8d934 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:27.913820 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73c6c37f-3bbe-4d29-bf7c-e505f7d8d934 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:27.914633 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73c6c37f-3bbe-4d29-bf7c-e505f7d8d934 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:27.915073 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-73c6c37f-3bbe-4d29-bf7c-e505f7d8d934 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:28.061616 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-73c6c37f-3bbe-4d29-bf7c-e505f7d8d934 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:20:28.069602 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-73c6c37f-3bbe-4d29-bf7c-e505f7d8d934 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 200 len: 1374 microversion: 2.1 time: 0.168441 Aug 02 08:20:28.070969 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3856/7633] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:20:27 2022] GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:20:29.090151 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:20:29.091270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=6 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:20:29.098068 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-70c719de-8dcf-4143-8b73-542bf974c334 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:20:29.099189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-70c719de-8dcf-4143-8b73-542bf974c334 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:20:29.110179 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70c719de-8dcf-4143-8b73-542bf974c334 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:29.110640 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70c719de-8dcf-4143-8b73-542bf974c334 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:29.111462 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70c719de-8dcf-4143-8b73-542bf974c334 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:29.111907 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-70c719de-8dcf-4143-8b73-542bf974c334 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:29.252956 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-70c719de-8dcf-4143-8b73-542bf974c334 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:20:29.266185 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-70c719de-8dcf-4143-8b73-542bf974c334 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 200 len: 1559 microversion: 2.1 time: 0.178332 Aug 02 08:20:29.266799 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3778/7634] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:20:29 2022] GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:20:29.288910 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-cd127ff8-6d74-44da-a75d-c13c5efad9e5 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:20:29.289529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-cd127ff8-6d74-44da-a75d-c13c5efad9e5 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:20:29.292723 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:20:29.302209 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd127ff8-6d74-44da-a75d-c13c5efad9e5 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:29.302657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd127ff8-6d74-44da-a75d-c13c5efad9e5 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:29.303429 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd127ff8-6d74-44da-a75d-c13c5efad9e5 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:29.303858 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-cd127ff8-6d74-44da-a75d-c13c5efad9e5 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:29.445041 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-cd127ff8-6d74-44da-a75d-c13c5efad9e5 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:20:29.456547 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-cd127ff8-6d74-44da-a75d-c13c5efad9e5 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 200 len: 1559 microversion: 2.1 time: 0.173132 Aug 02 08:20:29.457352 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3857/7635] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:20:29 2022] GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:20:31.170805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-786bbb16-2049-4dd8-9aec-e37d2bfe7e11 req-74a336b7-6a64-471f-8877-b886c7efeff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e1d6fb-2ba0-4147-841d-5626b427a99e", "tag": "b802a362-827d-4f52-a9ab-878025693fda"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:20:31.180609 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-786bbb16-2049-4dd8-9aec-e37d2bfe7e11 req-74a336b7-6a64-471f-8877-b886c7efeff1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:20:31.181147 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-786bbb16-2049-4dd8-9aec-e37d2bfe7e11 req-74a336b7-6a64-471f-8877-b886c7efeff1 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:20:31.193215 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-786bbb16-2049-4dd8-9aec-e37d2bfe7e11 req-74a336b7-6a64-471f-8877-b886c7efeff1 service nova] Creating event network-changed:b802a362-827d-4f52-a9ab-878025693fda for instance 96e1d6fb-2ba0-4147-841d-5626b427a99e on n-h2-851337-3 Aug 02 08:20:31.198454 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-786bbb16-2049-4dd8-9aec-e37d2bfe7e11 req-74a336b7-6a64-471f-8877-b886c7efeff1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032563 Aug 02 08:20:31.199266 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3779/7636] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:21:07.322267 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:21:07.323008 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 08:21:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:22:26.538490 n-d-851337-3 devstack@n-api.service[126120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c0c3e5c9-f933-4314-bd57-3d2ecb041378] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 08:22:26.539370 n-d-851337-3 devstack@n-api.service[126120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da609bec-98c7-4964-8d17-beefad60c655] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 08:22:26.540124 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:22:26.540933 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=36 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:22:26.545372 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dbf20dc4-e8f6-4915-9ee3-13a5fc1caa42 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1285183594"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:22:26.547770 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dbf20dc4-e8f6-4915-9ee3-13a5fc1caa42 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:26.555043 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbf20dc4-e8f6-4915-9ee3-13a5fc1caa42 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:26.555566 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbf20dc4-e8f6-4915-9ee3-13a5fc1caa42 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:26.556328 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbf20dc4-e8f6-4915-9ee3-13a5fc1caa42 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:26.556752 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dbf20dc4-e8f6-4915-9ee3-13a5fc1caa42 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:26.784335 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dbf20dc4-e8f6-4915-9ee3-13a5fc1caa42 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "POST /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e/action" status: 202 len: 0 microversion: 2.1 time: 0.247500 Aug 02 08:22:26.784970 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3858/7637] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:22:26 2022] POST /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 02 08:22:31.759273 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52c7fbf0-ab5b-40ba-9153-7d2f92273477] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 08:22:31.762686 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ad41dfa6-acfa-4002-ab8d-84c3526bc6c6] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 02 08:22:31.769264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:22:31.771901 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=32 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:22:31.870131 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-efc1f5b5-0a84-4486-98b4-d25534fdf829 req-7f4faeb9-09df-4cfd-8412-75c600f96db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e1d6fb-2ba0-4147-841d-5626b427a99e", "name": "network-vif-plugged", "status": "completed", "tag": "b802a362-827d-4f52-a9ab-878025693fda"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:22:31.882831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-efc1f5b5-0a84-4486-98b4-d25534fdf829 req-7f4faeb9-09df-4cfd-8412-75c600f96db9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:31.883613 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-efc1f5b5-0a84-4486-98b4-d25534fdf829 req-7f4faeb9-09df-4cfd-8412-75c600f96db9 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:31.899859 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-efc1f5b5-0a84-4486-98b4-d25534fdf829 req-7f4faeb9-09df-4cfd-8412-75c600f96db9 service nova] Creating event network-vif-plugged:b802a362-827d-4f52-a9ab-878025693fda for instance 96e1d6fb-2ba0-4147-841d-5626b427a99e on n-h2-851337-3 Aug 02 08:22:31.905373 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-efc1f5b5-0a84-4486-98b4-d25534fdf829 req-7f4faeb9-09df-4cfd-8412-75c600f96db9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148419 Aug 02 08:22:31.906534 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3780/7638] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:22:39.367205 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:22:39.367981 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:22:39.373038 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1549963858", "imageRef": "1510aa6c-eab1-45ce-a729-0d8a0bb4304f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-597197763", "security_groups": [{"name": "tempest-secgroup-smoke-1650110543"}], "networks": [{"uuid": "678e4cde-2c24-4c8a-80ca-900c19aa2e25"}]}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:22:39.401187 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] [da609bec-98c7-4964-8d17-beefad60c655] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 41454. Aug 02 08:22:39.402096 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] [c0c3e5c9-f933-4314-bd57-3d2ecb041378] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 41452. Aug 02 08:22:39.514609 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.network.neutron [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] validate_networks() for [('678e4cde-2c24-4c8a-80ca-900c19aa2e25', None, None, None, None, None)] {{(pid=126120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 08:22:39.936249 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Flavor limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 08:22:39.936675 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Image limits 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 08:22:39.937223 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Flavor pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 08:22:39.937637 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Image pref 0:0:0 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 08:22:39.938154 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.virt.hardware [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 08:22:39.948084 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:39.948542 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:39.949345 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:39.949784 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:39.967037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Getting quotas for project 9365bbd09a88446e8e554a93606fb3d7. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 08:22:39.972610 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.quota [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Getting quotas for user 0d87bf6966554e0d81929040d2972fea and project 9365bbd09a88446e8e554a93606fb3d7. Resources: {'ram', 'instances', 'cores'} {{(pid=126120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 08:22:39.987699 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Going to run 1 instances... {{(pid=126120) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 08:22:39.990544 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1510aa6c-eab1-45ce-a729-0d8a0bb4304f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 08:22:40.049622 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-53b11d0d-30e5-4622-bfde-339e27736c5e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.684361 Aug 02 08:22:40.050302 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3859/7639] 10.222.0.79 () {60 vars in 1147 bytes} [Tue Aug 2 08:22:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 08:22:40.062284 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-30c14976-3c1f-4cfe-a6b4-6263e12c1e8e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:40.063015 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-30c14976-3c1f-4cfe-a6b4-6263e12c1e8e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:40.095055 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] [ad41dfa6-acfa-4002-ab8d-84c3526bc6c6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 41470. Aug 02 08:22:40.095850 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] [52c7fbf0-ab5b-40ba-9153-7d2f92273477] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 41468. Aug 02 08:22:40.124010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-30c14976-3c1f-4cfe-a6b4-6263e12c1e8e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:40.131649 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-30c14976-3c1f-4cfe-a6b4-6263e12c1e8e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1248 microversion: 2.1 time: 0.073737 Aug 02 08:22:40.132212 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3781/7640] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:40 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1248 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:41.154357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-21db723f-1045-494e-84ff-7217c08178cd tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:41.154912 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-21db723f-1045-494e-84ff-7217c08178cd tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:41.161618 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21db723f-1045-494e-84ff-7217c08178cd tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:41.162094 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21db723f-1045-494e-84ff-7217c08178cd tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:41.162864 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21db723f-1045-494e-84ff-7217c08178cd tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:41.163299 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-21db723f-1045-494e-84ff-7217c08178cd tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:41.236017 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-21db723f-1045-494e-84ff-7217c08178cd tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:41.243720 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-21db723f-1045-494e-84ff-7217c08178cd tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1308 microversion: 2.1 time: 0.094250 Aug 02 08:22:41.255190 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3860/7641] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:41 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:42.265282 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ec83ec03-8e9d-4c12-8a3e-2b6f1f25729c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:42.266113 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ec83ec03-8e9d-4c12-8a3e-2b6f1f25729c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:42.268716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:22:42.275062 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec83ec03-8e9d-4c12-8a3e-2b6f1f25729c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:42.275459 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec83ec03-8e9d-4c12-8a3e-2b6f1f25729c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:42.276264 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec83ec03-8e9d-4c12-8a3e-2b6f1f25729c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:42.276716 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ec83ec03-8e9d-4c12-8a3e-2b6f1f25729c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:42.449552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ec83ec03-8e9d-4c12-8a3e-2b6f1f25729c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:42.460050 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ec83ec03-8e9d-4c12-8a3e-2b6f1f25729c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.198737 Aug 02 08:22:42.460811 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3782/7642] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:42 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 08:22:43.484050 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-07acd83b-c841-48db-a86e-3603a5ef10a1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:43.484881 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-07acd83b-c841-48db-a86e-3603a5ef10a1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:43.493796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07acd83b-c841-48db-a86e-3603a5ef10a1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:43.494731 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07acd83b-c841-48db-a86e-3603a5ef10a1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:43.495739 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07acd83b-c841-48db-a86e-3603a5ef10a1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:43.496184 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-07acd83b-c841-48db-a86e-3603a5ef10a1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:43.653805 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-07acd83b-c841-48db-a86e-3603a5ef10a1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:43.662444 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-07acd83b-c841-48db-a86e-3603a5ef10a1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.182644 Aug 02 08:22:43.663109 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3861/7643] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:43 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:43.804357 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-0db46f50-defa-428f-889c-191015cf4de1 req-497ddbef-414b-432a-81af-8d88f6017b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e1d6fb-2ba0-4147-841d-5626b427a99e", "name": "network-vif-unplugged", "status": "completed", "tag": "b802a362-827d-4f52-a9ab-878025693fda"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:22:43.819452 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0db46f50-defa-428f-889c-191015cf4de1 req-497ddbef-414b-432a-81af-8d88f6017b17 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:43.820203 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-0db46f50-defa-428f-889c-191015cf4de1 req-497ddbef-414b-432a-81af-8d88f6017b17 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:43.832513 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-0db46f50-defa-428f-889c-191015cf4de1 req-497ddbef-414b-432a-81af-8d88f6017b17 service nova] Creating event network-vif-unplugged:b802a362-827d-4f52-a9ab-878025693fda for instance 96e1d6fb-2ba0-4147-841d-5626b427a99e on n-h2-851337-3 Aug 02 08:22:43.851247 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-0db46f50-defa-428f-889c-191015cf4de1 req-497ddbef-414b-432a-81af-8d88f6017b17 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051393 Aug 02 08:22:43.851871 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3783/7644] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:22:44.684930 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-252a470f-920d-4426-9418-f570e50a5f54 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:44.685619 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-252a470f-920d-4426-9418-f570e50a5f54 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:44.693310 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-252a470f-920d-4426-9418-f570e50a5f54 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:44.693769 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-252a470f-920d-4426-9418-f570e50a5f54 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:44.694928 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-252a470f-920d-4426-9418-f570e50a5f54 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:44.695371 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-252a470f-920d-4426-9418-f570e50a5f54 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:44.858266 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-252a470f-920d-4426-9418-f570e50a5f54 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:44.869441 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-252a470f-920d-4426-9418-f570e50a5f54 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.188398 Aug 02 08:22:44.870332 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3862/7645] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:44 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:45.899141 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-bc700c50-f212-4c46-9718-9e5e37fa43c4 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:45.899941 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-bc700c50-f212-4c46-9718-9e5e37fa43c4 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:45.906396 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc700c50-f212-4c46-9718-9e5e37fa43c4 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:45.906853 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc700c50-f212-4c46-9718-9e5e37fa43c4 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:45.907621 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc700c50-f212-4c46-9718-9e5e37fa43c4 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:45.908057 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-bc700c50-f212-4c46-9718-9e5e37fa43c4 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:46.059701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-bc700c50-f212-4c46-9718-9e5e37fa43c4 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:46.069074 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-bc700c50-f212-4c46-9718-9e5e37fa43c4 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.175268 Aug 02 08:22:46.069675 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3784/7646] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:45 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:46.182270 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:22:46.182545 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 08:22:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:22:46.281388 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:22:46.281807 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 08:22:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:22:47.090816 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-69434598-0dbb-4739-9c40-441978e51030 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:47.091420 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-69434598-0dbb-4739-9c40-441978e51030 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:47.102292 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69434598-0dbb-4739-9c40-441978e51030 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:47.102685 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69434598-0dbb-4739-9c40-441978e51030 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:47.103669 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69434598-0dbb-4739-9c40-441978e51030 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:47.104100 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-69434598-0dbb-4739-9c40-441978e51030 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:47.253415 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-69434598-0dbb-4739-9c40-441978e51030 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:47.262038 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-69434598-0dbb-4739-9c40-441978e51030 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.175146 Aug 02 08:22:47.262806 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3863/7647] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:47 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:48.285511 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-a07891fe-0ece-4210-90ba-babaee1a84ae tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:48.286188 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-a07891fe-0ece-4210-90ba-babaee1a84ae tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:48.293998 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a07891fe-0ece-4210-90ba-babaee1a84ae tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:48.294465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a07891fe-0ece-4210-90ba-babaee1a84ae tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:48.295258 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a07891fe-0ece-4210-90ba-babaee1a84ae tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:48.295705 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-a07891fe-0ece-4210-90ba-babaee1a84ae tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:48.463570 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-a07891fe-0ece-4210-90ba-babaee1a84ae tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:48.472196 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-a07891fe-0ece-4210-90ba-babaee1a84ae tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.190684 Aug 02 08:22:48.473228 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3785/7648] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:48 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:49.495585 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-39a92014-e8a7-4415-98ac-9b3d841976aa tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:49.496326 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-39a92014-e8a7-4415-98ac-9b3d841976aa tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:49.503796 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39a92014-e8a7-4415-98ac-9b3d841976aa tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:49.504437 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39a92014-e8a7-4415-98ac-9b3d841976aa tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:49.505101 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39a92014-e8a7-4415-98ac-9b3d841976aa tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:49.505529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-39a92014-e8a7-4415-98ac-9b3d841976aa tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:49.643042 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-39a92014-e8a7-4415-98ac-9b3d841976aa tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:49.653641 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-39a92014-e8a7-4415-98ac-9b3d841976aa tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.163605 Aug 02 08:22:49.654465 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3864/7649] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:49 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:50.678844 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-d3ce5df8-0c61-4de0-bc85-450a8e471edb tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:50.679564 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-d3ce5df8-0c61-4de0-bc85-450a8e471edb tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:50.682344 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell0:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:22:50.688107 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d3ce5df8-0c61-4de0-bc85-450a8e471edb tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:50.688552 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d3ce5df8-0c61-4de0-bc85-450a8e471edb tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:50.689360 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d3ce5df8-0c61-4de0-bc85-450a8e471edb tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:50.689811 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-d3ce5df8-0c61-4de0-bc85-450a8e471edb tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:50.836954 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-d3ce5df8-0c61-4de0-bc85-450a8e471edb tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:50.846530 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-d3ce5df8-0c61-4de0-bc85-450a8e471edb tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.171659 Aug 02 08:22:50.847318 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3786/7650] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:50 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:51.591053 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-b69ead3b-342f-48f2-a03c-ce8248ec7df8 req-6b7eeb75-24a4-42b8-a42e-9072458e6129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13bee9d9-e945-4f80-b5eb-49bcf4b39a2f", "tag": "76957d4d-f0a2-432a-beb9-e8e8bc75f2f3"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:22:51.596177 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:22:51.597550 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell0:SELECT=6 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:22:51.605026 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b69ead3b-342f-48f2-a03c-ce8248ec7df8 req-6b7eeb75-24a4-42b8-a42e-9072458e6129 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:51.605563 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-b69ead3b-342f-48f2-a03c-ce8248ec7df8 req-6b7eeb75-24a4-42b8-a42e-9072458e6129 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:51.623382 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-b69ead3b-342f-48f2-a03c-ce8248ec7df8 req-6b7eeb75-24a4-42b8-a42e-9072458e6129 service nova] Creating event network-changed:76957d4d-f0a2-432a-beb9-e8e8bc75f2f3 for instance 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f on n-h1-851337-3 Aug 02 08:22:51.628783 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-b69ead3b-342f-48f2-a03c-ce8248ec7df8 req-6b7eeb75-24a4-42b8-a42e-9072458e6129 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041631 Aug 02 08:22:51.629718 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3865/7651] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:22:51.868110 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-fd2577aa-a2cf-493f-adc2-22e4d95ed9ba tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:51.868805 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-fd2577aa-a2cf-493f-adc2-22e4d95ed9ba tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:51.875837 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd2577aa-a2cf-493f-adc2-22e4d95ed9ba tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:51.876432 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd2577aa-a2cf-493f-adc2-22e4d95ed9ba tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:51.877128 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd2577aa-a2cf-493f-adc2-22e4d95ed9ba tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:51.877573 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-fd2577aa-a2cf-493f-adc2-22e4d95ed9ba tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:52.022233 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-fd2577aa-a2cf-493f-adc2-22e4d95ed9ba tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:52.030518 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-fd2577aa-a2cf-493f-adc2-22e4d95ed9ba tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.166700 Aug 02 08:22:52.033749 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3787/7652] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:51 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:53.056666 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-4f6b8325-1dc7-4203-801b-38551fc667a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:53.057349 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-4f6b8325-1dc7-4203-801b-38551fc667a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:53.064580 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f6b8325-1dc7-4203-801b-38551fc667a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:53.065037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f6b8325-1dc7-4203-801b-38551fc667a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:53.065804 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f6b8325-1dc7-4203-801b-38551fc667a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:53.066268 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-4f6b8325-1dc7-4203-801b-38551fc667a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:53.267452 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-4f6b8325-1dc7-4203-801b-38551fc667a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:53.275473 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-4f6b8325-1dc7-4203-801b-38551fc667a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.224456 Aug 02 08:22:53.276045 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3866/7653] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:53 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:54.297223 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9b219f90-8386-4a0d-8f06-faab28058b27 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:54.298133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9b219f90-8386-4a0d-8f06-faab28058b27 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:54.306138 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b219f90-8386-4a0d-8f06-faab28058b27 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:54.306626 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b219f90-8386-4a0d-8f06-faab28058b27 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:54.307415 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b219f90-8386-4a0d-8f06-faab28058b27 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:54.307864 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b219f90-8386-4a0d-8f06-faab28058b27 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:54.455420 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9b219f90-8386-4a0d-8f06-faab28058b27 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:54.463650 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9b219f90-8386-4a0d-8f06-faab28058b27 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.170875 Aug 02 08:22:54.464251 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3788/7654] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:54 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:55.484901 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-a271a7c6-8ef3-47e5-9e18-b8d0386f865e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:55.485521 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-a271a7c6-8ef3-47e5-9e18-b8d0386f865e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:55.493545 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a271a7c6-8ef3-47e5-9e18-b8d0386f865e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:55.494135 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a271a7c6-8ef3-47e5-9e18-b8d0386f865e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:55.495081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a271a7c6-8ef3-47e5-9e18-b8d0386f865e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:55.495524 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-a271a7c6-8ef3-47e5-9e18-b8d0386f865e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:55.644929 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-a271a7c6-8ef3-47e5-9e18-b8d0386f865e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:55.652908 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-a271a7c6-8ef3-47e5-9e18-b8d0386f865e tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.172059 Aug 02 08:22:55.653484 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3867/7655] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:55 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:56.680178 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-7aed14e0-58a1-43de-a0ee-440da71f2da2 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:56.680961 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-7aed14e0-58a1-43de-a0ee-440da71f2da2 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:56.688647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7aed14e0-58a1-43de-a0ee-440da71f2da2 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:56.689139 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7aed14e0-58a1-43de-a0ee-440da71f2da2 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:56.690101 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7aed14e0-58a1-43de-a0ee-440da71f2da2 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:56.690566 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-7aed14e0-58a1-43de-a0ee-440da71f2da2 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:56.849377 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-7aed14e0-58a1-43de-a0ee-440da71f2da2 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:56.858639 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-7aed14e0-58a1-43de-a0ee-440da71f2da2 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.184128 Aug 02 08:22:56.859254 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3789/7656] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:56 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:57.882988 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-dc331a4f-e60f-471f-ab69-ecee74bf8751 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:57.883571 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-dc331a4f-e60f-471f-ab69-ecee74bf8751 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:57.892423 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc331a4f-e60f-471f-ab69-ecee74bf8751 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:57.892897 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc331a4f-e60f-471f-ab69-ecee74bf8751 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:57.893657 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc331a4f-e60f-471f-ab69-ecee74bf8751 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:57.894202 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-dc331a4f-e60f-471f-ab69-ecee74bf8751 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:58.056274 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-dc331a4f-e60f-471f-ab69-ecee74bf8751 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:58.064619 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-dc331a4f-e60f-471f-ab69-ecee74bf8751 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.187559 Aug 02 08:22:58.065200 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3868/7657] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:57 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:22:58.506196 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-f52fbd27-2950-43fa-8652-0989d66b5bcc req-ccf42660-1022-4709-9843-4eb4917041fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13bee9d9-e945-4f80-b5eb-49bcf4b39a2f", "name": "network-vif-plugged", "status": "completed", "tag": "76957d4d-f0a2-432a-beb9-e8e8bc75f2f3"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:22:58.520424 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f52fbd27-2950-43fa-8652-0989d66b5bcc req-ccf42660-1022-4709-9843-4eb4917041fc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:58.521026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-f52fbd27-2950-43fa-8652-0989d66b5bcc req-ccf42660-1022-4709-9843-4eb4917041fc service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:58.532693 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-f52fbd27-2950-43fa-8652-0989d66b5bcc req-ccf42660-1022-4709-9843-4eb4917041fc service nova] Creating event network-vif-plugged:76957d4d-f0a2-432a-beb9-e8e8bc75f2f3 for instance 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f on n-h1-851337-3 Aug 02 08:22:58.537977 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-f52fbd27-2950-43fa-8652-0989d66b5bcc req-ccf42660-1022-4709-9843-4eb4917041fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036766 Aug 02 08:22:58.538604 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3790/7658] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:22:59.086359 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-2b37ede3-01f7-4642-8182-b30e4b549bb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:22:59.086959 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-2b37ede3-01f7-4642-8182-b30e4b549bb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:22:59.094529 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b37ede3-01f7-4642-8182-b30e4b549bb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:59.094977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b37ede3-01f7-4642-8182-b30e4b549bb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:59.095742 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b37ede3-01f7-4642-8182-b30e4b549bb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:22:59.096175 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-2b37ede3-01f7-4642-8182-b30e4b549bb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:22:59.233228 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-2b37ede3-01f7-4642-8182-b30e4b549bb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:22:59.241139 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-2b37ede3-01f7-4642-8182-b30e4b549bb6 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1374 microversion: 2.1 time: 0.158871 Aug 02 08:22:59.241715 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3869/7659] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:22:59 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:23:00.264996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-ca9bbc61-a738-4efa-986d-cc2013828a77 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:23:00.265818 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-ca9bbc61-a738-4efa-986d-cc2013828a77 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:23:00.273701 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca9bbc61-a738-4efa-986d-cc2013828a77 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:23:00.274189 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca9bbc61-a738-4efa-986d-cc2013828a77 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:23:00.275003 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca9bbc61-a738-4efa-986d-cc2013828a77 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:23:00.275455 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-ca9bbc61-a738-4efa-986d-cc2013828a77 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:23:00.428108 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-ca9bbc61-a738-4efa-986d-cc2013828a77 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:23:00.436282 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-ca9bbc61-a738-4efa-986d-cc2013828a77 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1559 microversion: 2.1 time: 0.176009 Aug 02 08:23:00.436862 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3791/7660] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:23:00 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:23:00.456798 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-203376a6-a659-428e-a30e-a17919807e93 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:23:00.457414 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-203376a6-a659-428e-a30e-a17919807e93 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:23:00.465347 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-203376a6-a659-428e-a30e-a17919807e93 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:23:00.465803 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-203376a6-a659-428e-a30e-a17919807e93 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:23:00.466640 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-203376a6-a659-428e-a30e-a17919807e93 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:23:00.467081 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-203376a6-a659-428e-a30e-a17919807e93 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:23:00.612504 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-203376a6-a659-428e-a30e-a17919807e93 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:23:00.624137 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-203376a6-a659-428e-a30e-a17919807e93 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1559 microversion: 2.1 time: 0.170955 Aug 02 08:23:00.625094 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3870/7661] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:23:00 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:23:02.395444 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-6b3ae1ba-e8e1-48cf-82b2-f924acffed14 req-9879f628-3fee-4b8e-9306-a4d67b598c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13bee9d9-e945-4f80-b5eb-49bcf4b39a2f", "tag": "76957d4d-f0a2-432a-beb9-e8e8bc75f2f3"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:23:02.400755 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=27 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:02.407103 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6b3ae1ba-e8e1-48cf-82b2-f924acffed14 req-9879f628-3fee-4b8e-9306-a4d67b598c4f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:23:02.407647 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-6b3ae1ba-e8e1-48cf-82b2-f924acffed14 req-9879f628-3fee-4b8e-9306-a4d67b598c4f service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:23:02.420106 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-6b3ae1ba-e8e1-48cf-82b2-f924acffed14 req-9879f628-3fee-4b8e-9306-a4d67b598c4f service nova] Creating event network-changed:76957d4d-f0a2-432a-beb9-e8e8bc75f2f3 for instance 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f on n-h1-851337-3 Aug 02 08:23:02.425578 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-6b3ae1ba-e8e1-48cf-82b2-f924acffed14 req-9879f628-3fee-4b8e-9306-a4d67b598c4f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098365 Aug 02 08:23:02.426411 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3792/7662] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:25:02.302991 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:02.303751 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=64 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:02.308368 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-29e9f8af-5257-41ae-bc1d-8a25c6f23319 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-737822732"}} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:25:02.311389 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-29e9f8af-5257-41ae-bc1d-8a25c6f23319 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:25:02.318628 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29e9f8af-5257-41ae-bc1d-8a25c6f23319 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:02.319076 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29e9f8af-5257-41ae-bc1d-8a25c6f23319 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:02.319843 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29e9f8af-5257-41ae-bc1d-8a25c6f23319 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:02.320280 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-29e9f8af-5257-41ae-bc1d-8a25c6f23319 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:02.524757 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-29e9f8af-5257-41ae-bc1d-8a25c6f23319 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "POST /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f/action" status: 202 len: 0 microversion: 2.1 time: 0.223721 Aug 02 08:25:02.525376 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3871/7663] 10.222.0.79 () {60 vars in 1278 bytes} [Tue Aug 2 08:25:02 2022] POST /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 02 08:25:08.943657 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ad41dfa6-acfa-4002-ab8d-84c3526bc6c6] AMQP server on 10.222.0.79:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 02 08:25:08.946734 n-d-851337-3 devstack@n-api.service[126119]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52c7fbf0-ab5b-40ba-9153-7d2f92273477] AMQP server on 10.222.0.79:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 02 08:25:08.947436 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=1 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:08.948270 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=54 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:08.957212 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-65df0c1b-b7eb-4482-bffa-0e9738ac49d9 req-679e96b9-0077-4275-9c08-c14c24f1f448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13bee9d9-e945-4f80-b5eb-49bcf4b39a2f", "name": "network-vif-plugged", "status": "completed", "tag": "76957d4d-f0a2-432a-beb9-e8e8bc75f2f3"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:25:08.970644 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-65df0c1b-b7eb-4482-bffa-0e9738ac49d9 req-679e96b9-0077-4275-9c08-c14c24f1f448 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:08.971120 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-65df0c1b-b7eb-4482-bffa-0e9738ac49d9 req-679e96b9-0077-4275-9c08-c14c24f1f448 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:08.982471 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-65df0c1b-b7eb-4482-bffa-0e9738ac49d9 req-679e96b9-0077-4275-9c08-c14c24f1f448 service nova] Creating event network-vif-plugged:76957d4d-f0a2-432a-beb9-e8e8bc75f2f3 for instance 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f on n-h1-851337-3 Aug 02 08:25:08.988425 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-65df0c1b-b7eb-4482-bffa-0e9738ac49d9 req-679e96b9-0077-4275-9c08-c14c24f1f448 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048429 Aug 02 08:25:08.988699 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3793/7664] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:25:20.423126 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-051f8d0a-ef9c-42fb-b130-41f55e315df1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:25:20.423768 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-051f8d0a-ef9c-42fb-b130-41f55e315df1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:25:20.426834 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_api:SELECT=2 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:20.427281 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_api:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:20.427789 n-d-851337-3 devstack@n-api.service[126120]: DEBUG dbcounter [-] [126120] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:20.430048 n-d-851337-3 devstack@n-api.service[126119]: DEBUG dbcounter [-] [126119] Writing DB stats nova_cell1:SELECT=2 {{(pid=126119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:20.436797 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-051f8d0a-ef9c-42fb-b130-41f55e315df1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:20.439461 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-051f8d0a-ef9c-42fb-b130-41f55e315df1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:20.440371 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] [ad41dfa6-acfa-4002-ab8d-84c3526bc6c6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 41794. Aug 02 08:25:20.441171 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] [52c7fbf0-ab5b-40ba-9153-7d2f92273477] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 41796. Aug 02 08:25:20.441396 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-051f8d0a-ef9c-42fb-b130-41f55e315df1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:20.442674 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-051f8d0a-ef9c-42fb-b130-41f55e315df1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:20.488097 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-051f8d0a-ef9c-42fb-b130-41f55e315df1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 08:25:20.516052 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-43ae8f7c-6297-487b-bf24-2ce4c4cbf3ad req-c95cb1c3-1bd1-4726-b1f0-4c8460ff889b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13bee9d9-e945-4f80-b5eb-49bcf4b39a2f", "tag": "76957d4d-f0a2-432a-beb9-e8e8bc75f2f3"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:25:20.531793 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-43ae8f7c-6297-487b-bf24-2ce4c4cbf3ad req-c95cb1c3-1bd1-4726-b1f0-4c8460ff889b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:20.532709 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-43ae8f7c-6297-487b-bf24-2ce4c4cbf3ad req-c95cb1c3-1bd1-4726-b1f0-4c8460ff889b service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:20.545273 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-43ae8f7c-6297-487b-bf24-2ce4c4cbf3ad req-c95cb1c3-1bd1-4726-b1f0-4c8460ff889b service nova] Creating event network-changed:76957d4d-f0a2-432a-beb9-e8e8bc75f2f3 for instance 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f on n-h1-851337-3 Aug 02 08:25:20.550775 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-43ae8f7c-6297-487b-bf24-2ce4c4cbf3ad req-c95cb1c3-1bd1-4726-b1f0-4c8460ff889b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129895 Aug 02 08:25:20.555059 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3794/7665] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:25:20.580506 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-051f8d0a-ef9c-42fb-b130-41f55e315df1 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "DELETE /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 204 len: 0 microversion: 2.1 time: 0.161455 Aug 02 08:25:20.581088 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3872/7666] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 08:25:20 2022] DELETE /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:25:20.590034 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-9b424380-6dbd-45dc-a97d-a92de40ec630 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:25:20.590740 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-9b424380-6dbd-45dc-a97d-a92de40ec630 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:25:20.597558 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b424380-6dbd-45dc-a97d-a92de40ec630 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:20.598320 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b424380-6dbd-45dc-a97d-a92de40ec630 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:20.599521 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b424380-6dbd-45dc-a97d-a92de40ec630 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:20.599971 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-9b424380-6dbd-45dc-a97d-a92de40ec630 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:20.799912 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-9b424380-6dbd-45dc-a97d-a92de40ec630 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:25:20.808004 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-9b424380-6dbd-45dc-a97d-a92de40ec630 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1684 microversion: 2.1 time: 0.222241 Aug 02 08:25:20.808592 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3795/7667] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:25:20 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1684 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:25:21.831756 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-543a52e3-65e7-4458-8907-f5fd862ca20b tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:25:21.832802 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-543a52e3-65e7-4458-8907-f5fd862ca20b tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:25:21.842498 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-543a52e3-65e7-4458-8907-f5fd862ca20b tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:21.842937 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-543a52e3-65e7-4458-8907-f5fd862ca20b tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:21.843725 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-543a52e3-65e7-4458-8907-f5fd862ca20b tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:21.844164 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-543a52e3-65e7-4458-8907-f5fd862ca20b tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:22.042559 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-543a52e3-65e7-4458-8907-f5fd862ca20b tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:25:22.050995 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-543a52e3-65e7-4458-8907-f5fd862ca20b tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1684 microversion: 2.1 time: 0.224455 Aug 02 08:25:22.051713 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3873/7668] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:25:21 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1684 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:25:23.073184 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1db35a54-29ad-411f-993a-0ff421cb2717 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:25:23.074830 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1db35a54-29ad-411f-993a-0ff421cb2717 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:25:23.083123 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1db35a54-29ad-411f-993a-0ff421cb2717 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:23.084465 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1db35a54-29ad-411f-993a-0ff421cb2717 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:23.086300 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1db35a54-29ad-411f-993a-0ff421cb2717 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:23.086913 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1db35a54-29ad-411f-993a-0ff421cb2717 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:23.199977 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1db35a54-29ad-411f-993a-0ff421cb2717 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:25:23.208902 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1db35a54-29ad-411f-993a-0ff421cb2717 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 200 len: 1497 microversion: 2.1 time: 0.139581 Aug 02 08:25:23.213474 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [req-ec430c18-1dd4-4896-8b0e-6a9bcaef4c61 req-d490fbff-a4fd-497a-a301-4dd97c21b0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13bee9d9-e945-4f80-b5eb-49bcf4b39a2f", "name": "network-vif-deleted", "tag": "76957d4d-f0a2-432a-beb9-e8e8bc75f2f3"}]} {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:25:23.222230 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3796/7669] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:25:23 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:25:23.224456 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ec430c18-1dd4-4896-8b0e-6a9bcaef4c61 req-d490fbff-a4fd-497a-a301-4dd97c21b0df service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:23.224899 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [req-ec430c18-1dd4-4896-8b0e-6a9bcaef4c61 req-d490fbff-a4fd-497a-a301-4dd97c21b0df service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:23.237152 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.compute.server_external_events [req-ec430c18-1dd4-4896-8b0e-6a9bcaef4c61 req-d490fbff-a4fd-497a-a301-4dd97c21b0df service nova] Creating event network-vif-deleted:76957d4d-f0a2-432a-beb9-e8e8bc75f2f3 for instance 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f on n-h1-851337-3 Aug 02 08:25:23.242765 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [req-ec430c18-1dd4-4896-8b0e-6a9bcaef4c61 req-d490fbff-a4fd-497a-a301-4dd97c21b0df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032956 Aug 02 08:25:23.243406 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3874/7670] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 08:25:24.233010 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e1712f1f-36a1-4d8f-a754-7c376f1b4493 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:25:24.233637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-e1712f1f-36a1-4d8f-a754-7c376f1b4493 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:25:24.245962 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1712f1f-36a1-4d8f-a754-7c376f1b4493 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:24.246637 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1712f1f-36a1-4d8f-a754-7c376f1b4493 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:24.247691 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1712f1f-36a1-4d8f-a754-7c376f1b4493 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:24.248143 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-e1712f1f-36a1-4d8f-a754-7c376f1b4493 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:24.264346 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.wsgi [None req-e1712f1f-36a1-4d8f-a754-7c376f1b4493 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] HTTP exception thrown: Instance 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f could not be found. Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e1712f1f-36a1-4d8f-a754-7c376f1b4493 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Request method failure captured: Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: request: GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f HTTP/1.1 Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: Accept: application/json Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: Accept-Encoding: identity Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: Connection: close Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: Content-Length: 0 Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: Content-Type: application/json Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: Host: 10.222.0.79 Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: Openstack-System-Scope: None Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: User-Agent: python-urllib3/1.26.10 Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Auth-Token: gAAAAABi6N46I_6BdeNSZQ00gjigS_W1Izy3Jxp4Z75uUcVvuu3i3Cqyyzi37K6bBDDql-sGzmEoPpDzljyCDHGPcpA8mRlXUu_M9O7bCWxmWn9uOPuQl8d0iIoM1BHiicHJebaVzn-zqsQB9O2Jd7hacVQ2zAvSUhmJnAHXqIdp7Vrpoj0KFew Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Id: None Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Domain-Name: None Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Identity-Status: Confirmed Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Is-Admin-Project: True Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Id: default Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Domain-Name: Default Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Id: 9365bbd09a88446e8e554a93606fb3d7 Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Project-Name: tempest-TestSnapshotPattern-1951553912 Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Role: member,reader Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Roles: member,reader Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9365bbd09a88446e8e554a93606fb3d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9365bbd09a88446e8e554a93606fb3d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9365bbd09a88446e8e554a93606fb3d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9365bbd09a88446e8e554a93606fb3d7"}]}] Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant: tempest-TestSnapshotPattern-1951553912 Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Id: 9365bbd09a88446e8e554a93606fb3d7 Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-Tenant-Name: tempest-TestSnapshotPattern-1951553912 Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-User: tempest-TestSnapshotPattern-1951553912-project Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Id: default Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-User-Domain-Name: Default Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-User-Id: 0d87bf6966554e0d81929040d2972fea Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: X-User-Name: tempest-TestSnapshotPattern-1951553912-project Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: method: > Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: exception: Instance 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f could not be found. Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: action_args: {'id': '13bee9d9-e945-4f80-b5eb-49bcf4b39a2f'} Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f could not be found. Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f could not be found. Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:25:24.266673 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:25:24.273663 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:25:24.273663 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:25:24.273663 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:25:24.273663 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:25:24.273663 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:25:24.273663 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f could not be found. Aug 02 08:25:24.273663 n-d-851337-3 devstack@n-api.service[126119]: ERROR nova.api.openstack.wsgi Aug 02 08:25:24.273663 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-e1712f1f-36a1-4d8f-a754-7c376f1b4493 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Returning 404 to user: Instance 13bee9d9-e945-4f80-b5eb-49bcf4b39a2f could not be found. {{(pid=126119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:25:24.273663 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-e1712f1f-36a1-4d8f-a754-7c376f1b4493 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f" status: 404 len: 111 microversion: 2.1 time: 0.040028 Aug 02 08:25:24.273663 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3797/7671] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:25:24 2022] GET /compute/v2.1/servers/13bee9d9-e945-4f80-b5eb-49bcf4b39a2f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:25:25.803357 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-05188220-028d-4a85-8cf0-d793f8016734 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:25:25.803961 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-05188220-028d-4a85-8cf0-d793f8016734 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:25:25.805312 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-dc32d40d-c6e0-426d-942f-b7dcda5b5a50 req-2f672517-2aff-4256-bc72-c6eee4ca09a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e1d6fb-2ba0-4147-841d-5626b427a99e", "tag": "b802a362-827d-4f52-a9ab-878025693fda"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:25:25.810958 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05188220-028d-4a85-8cf0-d793f8016734 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:25.811621 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05188220-028d-4a85-8cf0-d793f8016734 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:25.812569 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05188220-028d-4a85-8cf0-d793f8016734 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:25.812997 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-05188220-028d-4a85-8cf0-d793f8016734 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:25.817505 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-dc32d40d-c6e0-426d-942f-b7dcda5b5a50 req-2f672517-2aff-4256-bc72-c6eee4ca09a3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:25.817996 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-dc32d40d-c6e0-426d-942f-b7dcda5b5a50 req-2f672517-2aff-4256-bc72-c6eee4ca09a3 service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:25.831946 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-dc32d40d-c6e0-426d-942f-b7dcda5b5a50 req-2f672517-2aff-4256-bc72-c6eee4ca09a3 service nova] Creating event network-changed:b802a362-827d-4f52-a9ab-878025693fda for instance 96e1d6fb-2ba0-4147-841d-5626b427a99e on n-h2-851337-3 Aug 02 08:25:25.837922 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-dc32d40d-c6e0-426d-942f-b7dcda5b5a50 req-2f672517-2aff-4256-bc72-c6eee4ca09a3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037987 Aug 02 08:25:25.839185 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3798/7672] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:25:25.850105 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-05188220-028d-4a85-8cf0-d793f8016734 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Going to try to terminate instance {{(pid=126120) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 08:25:25.951652 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-05188220-028d-4a85-8cf0-d793f8016734 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "DELETE /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 204 len: 0 microversion: 2.1 time: 0.153681 Aug 02 08:25:25.955635 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3875/7673] 10.222.0.79 () {58 vars in 1239 bytes} [Tue Aug 2 08:25:25 2022] DELETE /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 08:25:25.966799 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-1e82f41c-714f-4b8f-aa8a-fcf02b2945a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:25:25.967831 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.compute.api [None req-1e82f41c-714f-4b8f-aa8a-fcf02b2945a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126119) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:25:25.978133 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e82f41c-714f-4b8f-aa8a-fcf02b2945a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:25.978601 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e82f41c-714f-4b8f-aa8a-fcf02b2945a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:25.982559 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e82f41c-714f-4b8f-aa8a-fcf02b2945a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:25.983026 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [None req-1e82f41c-714f-4b8f-aa8a-fcf02b2945a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:26.143226 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.policy [None req-1e82f41c-714f-4b8f-aa8a-fcf02b2945a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126119) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:25:26.151865 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-1e82f41c-714f-4b8f-aa8a-fcf02b2945a3 tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 200 len: 1683 microversion: 2.1 time: 0.193934 Aug 02 08:25:26.152442 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3799/7674] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:25:25 2022] GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 1683 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:25:27.175231 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-d557f273-749a-41e6-9624-e6fdedbf494c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:25:27.176037 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-d557f273-749a-41e6-9624-e6fdedbf494c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:25:27.183272 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d557f273-749a-41e6-9624-e6fdedbf494c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:27.183713 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d557f273-749a-41e6-9624-e6fdedbf494c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:27.184458 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d557f273-749a-41e6-9624-e6fdedbf494c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:27.184977 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-d557f273-749a-41e6-9624-e6fdedbf494c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:27.400093 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.policy [None req-d557f273-749a-41e6-9624-e6fdedbf494c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d87bf6966554e0d81929040d2972fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9365bbd09a88446e8e554a93606fb3d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126120) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 08:25:27.408713 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-d557f273-749a-41e6-9624-e6fdedbf494c tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 200 len: 1565 microversion: 2.1 time: 0.237850 Aug 02 08:25:27.409297 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3876/7675] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:25:27 2022] GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 1565 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 08:25:27.855376 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [req-7a28c024-2e08-4333-bf35-3423b0da2d7b req-075c2411-efdf-48e5-9cdf-513b28afa3fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e1d6fb-2ba0-4147-841d-5626b427a99e", "name": "network-vif-deleted", "tag": "b802a362-827d-4f52-a9ab-878025693fda"}]} {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 08:25:27.867618 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7a28c024-2e08-4333-bf35-3423b0da2d7b req-075c2411-efdf-48e5-9cdf-513b28afa3fe service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:27.868105 n-d-851337-3 devstack@n-api.service[126119]: DEBUG oslo_concurrency.lockutils [req-7a28c024-2e08-4333-bf35-3423b0da2d7b req-075c2411-efdf-48e5-9cdf-513b28afa3fe service nova] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:27.881610 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.compute.server_external_events [req-7a28c024-2e08-4333-bf35-3423b0da2d7b req-075c2411-efdf-48e5-9cdf-513b28afa3fe service nova] Creating event network-vif-deleted:b802a362-827d-4f52-a9ab-878025693fda for instance 96e1d6fb-2ba0-4147-841d-5626b427a99e on n-h2-851337-3 Aug 02 08:25:27.892965 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [req-7a28c024-2e08-4333-bf35-3423b0da2d7b req-075c2411-efdf-48e5-9cdf-513b28afa3fe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041486 Aug 02 08:25:27.893632 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3800/7676] 10.222.0.79 () {64 vars in 1317 bytes} [Tue Aug 2 08:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 08:25:28.433020 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5bfd7444-cc20-4dd7-a32c-9d3843f841ca tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '>' {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:25:28.433660 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.compute.api [None req-5bfd7444-cc20-4dd7-a32c-9d3843f841ca tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] [instance: 96e1d6fb-2ba0-4147-841d-5626b427a99e] Fetching instance by UUID {{(pid=126120) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 08:25:28.441584 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bfd7444-cc20-4dd7-a32c-9d3843f841ca tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:28.442062 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bfd7444-cc20-4dd7-a32c-9d3843f841ca tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:28.442903 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bfd7444-cc20-4dd7-a32c-9d3843f841ca tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 08:25:28.443332 n-d-851337-3 devstack@n-api.service[126120]: DEBUG oslo_concurrency.lockutils [None req-5bfd7444-cc20-4dd7-a32c-9d3843f841ca tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Lock "c3b7f982-e927-4a3f-b699-817c726d55c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 08:25:28.460735 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.wsgi [None req-5bfd7444-cc20-4dd7-a32c-9d3843f841ca tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] HTTP exception thrown: Instance 96e1d6fb-2ba0-4147-841d-5626b427a99e could not be found. Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5bfd7444-cc20-4dd7-a32c-9d3843f841ca tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Request method failure captured: Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: request: GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e HTTP/1.1 Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: Accept: application/json Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: Accept-Encoding: identity Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: Connection: close Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: Content-Length: 0 Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: Content-Type: application/json Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: Host: 10.222.0.79 Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: Openstack-System-Scope: None Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: User-Agent: python-urllib3/1.26.10 Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Auth-Token: gAAAAABi6N46I_6BdeNSZQ00gjigS_W1Izy3Jxp4Z75uUcVvuu3i3Cqyyzi37K6bBDDql-sGzmEoPpDzljyCDHGPcpA8mRlXUu_M9O7bCWxmWn9uOPuQl8d0iIoM1BHiicHJebaVzn-zqsQB9O2Jd7hacVQ2zAvSUhmJnAHXqIdp7Vrpoj0KFew Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Id: None Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Domain-Name: None Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Identity-Status: Confirmed Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Is-Admin-Project: True Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Id: default Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Domain-Name: Default Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Id: 9365bbd09a88446e8e554a93606fb3d7 Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Project-Name: tempest-TestSnapshotPattern-1951553912 Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Role: member,reader Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Roles: member,reader Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9365bbd09a88446e8e554a93606fb3d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9365bbd09a88446e8e554a93606fb3d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9365bbd09a88446e8e554a93606fb3d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9365bbd09a88446e8e554a93606fb3d7"}]}] Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant: tempest-TestSnapshotPattern-1951553912 Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Id: 9365bbd09a88446e8e554a93606fb3d7 Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-Tenant-Name: tempest-TestSnapshotPattern-1951553912 Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-User: tempest-TestSnapshotPattern-1951553912-project Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Id: default Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-User-Domain-Name: Default Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-User-Id: 0d87bf6966554e0d81929040d2972fea Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: X-User-Name: tempest-TestSnapshotPattern-1951553912-project Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: method: > Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: exception: Instance 96e1d6fb-2ba0-4147-841d-5626b427a99e could not be found. Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: action_args: {'id': '96e1d6fb-2ba0-4147-841d-5626b427a99e'} Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: {{(pid=126120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96e1d6fb-2ba0-4147-841d-5626b427a99e could not be found. Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96e1d6fb-2ba0-4147-841d-5626b427a99e could not be found. Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 08:25:28.462448 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:25:28.467055 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 08:25:28.467055 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 08:25:28.467055 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 08:25:28.467055 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 08:25:28.467055 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 08:25:28.467055 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96e1d6fb-2ba0-4147-841d-5626b427a99e could not be found. Aug 02 08:25:28.467055 n-d-851337-3 devstack@n-api.service[126120]: ERROR nova.api.openstack.wsgi Aug 02 08:25:28.467055 n-d-851337-3 devstack@n-api.service[126120]: DEBUG nova.api.openstack.wsgi [None req-5bfd7444-cc20-4dd7-a32c-9d3843f841ca tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Returning 404 to user: Instance 96e1d6fb-2ba0-4147-841d-5626b427a99e could not be found. {{(pid=126120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 08:25:28.467055 n-d-851337-3 devstack@n-api.service[126120]: INFO nova.api.openstack.requestlog [None req-5bfd7444-cc20-4dd7-a32c-9d3843f841ca tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e" status: 404 len: 111 microversion: 2.1 time: 0.034824 Aug 02 08:25:28.467055 n-d-851337-3 devstack@n-api.service[126120]: [pid: 126120|app: 0|req: 3877/7677] 10.222.0.79 () {58 vars in 1236 bytes} [Tue Aug 2 08:25:28 2022] GET /compute/v2.1/servers/96e1d6fb-2ba0-4147-841d-5626b427a99e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 08:25:28.631736 n-d-851337-3 devstack@n-api.service[126119]: DEBUG nova.api.openstack.wsgi [None req-0ca98d52-10ed-4249-8b57-52352427065b tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] Calling method '.version_select at 0x7f927a96ae50>' {{(pid=126119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 08:25:28.661564 n-d-851337-3 devstack@n-api.service[126119]: INFO nova.api.openstack.requestlog [None req-0ca98d52-10ed-4249-8b57-52352427065b tempest-TestSnapshotPattern-1951553912 tempest-TestSnapshotPattern-1951553912-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-597197763" status: 202 len: 0 microversion: 2.1 time: 0.033253 Aug 02 08:25:28.662233 n-d-851337-3 devstack@n-api.service[126119]: [pid: 126119|app: 0|req: 3801/7678] 10.222.0.79 () {58 vars in 1254 bytes} [Tue Aug 2 08:25:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-597197763 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 08:26:06.309008 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:26:06.309977 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 08:26:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:26:07.233486 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:26:07.234135 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 08:26:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:27:46.194975 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:27:46.195763 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 08:27:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:27:47.337486 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:27:47.338469 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 08:27:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:28:03.130848 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:28:03.131397 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 08:28:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:28:10.776308 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:28:10.777244 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 08:28:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:29:26.319178 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:29:26.319695 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 08:29:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:29:27.242982 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:29:27.243612 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 08:29:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:31:06.204318 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:31:06.205304 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 08:31:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:31:07.349540 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:31:07.350546 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 08:31:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:31:23.139833 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:31:23.140407 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 08:31:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:31:30.790324 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:31:30.791131 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 08:31:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:32:46.328969 n-d-851337-3 devstack@n-api.service[126119]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:32:46.329703 n-d-851337-3 devstack@n-api.service[126119]: Tue Aug 2 08:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 08:32:47.252903 n-d-851337-3 devstack@n-api.service[126120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 08:32:47.253958 n-d-851337-3 devstack@n-api.service[126120]: Tue Aug 2 08:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!